W0710 02:07:21.116000 2176503 site-packages/torch/distributed/run.py:766] 
W0710 02:07:21.116000 2176503 site-packages/torch/distributed/run.py:766] *****************************************
W0710 02:07:21.116000 2176503 site-packages/torch/distributed/run.py:766] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
W0710 02:07:21.116000 2176503 site-packages/torch/distributed/run.py:766] *****************************************
[INFO] Running in WANDB offline mode[INFO] Running in WANDB offline mode

[INFO] Running in WANDB offline mode
[INFO] Running in WANDB offline mode[INFO] Running in WANDB offline mode

[INFO] Running in WANDB offline mode[INFO] Running in WANDB offline mode

[INFO] Running in WANDB offline mode
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
Trainer._get_train_sampler replaced with custom implementation.
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
[2026-07-10 02:07:31,016] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2026-07-10 02:07:31,018] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2026-07-10 02:07:31,027] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2026-07-10 02:07:31,031] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
df: /home/dungpq6/.triton/autotune: No such file or directory
df: /home/dungpq6/.triton/autotune: No such file or directory
Trainer._get_train_sampler replaced with custom implementation.
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
[2026-07-10 02:07:31,153] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2026-07-10 02:07:31,153] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
[2026-07-10 02:07:31,330] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
[2026-07-10 02:07:31,387] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-10 02:07:31,390] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-10 02:07:31,401] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-10 02:07:31,418] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-10 02:07:31,425] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2026-07-10 02:07:31,464] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-10 02:07:31,496] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-10 02:07:31,496] [INFO] [comm.py:689:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
[2026-07-10 02:07:31,637] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-10 02:07:31,726] [INFO] [comm.py:658:init_distributed] cdb=None

Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 11283.11it/s]

Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 12008.40it/s]

Loading weights: 100%|██████████| 723/723 [00:00<00:00, 13161.30it/s]

Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 12641.56it/s]

Loading weights: 100%|██████████| 723/723 [00:00<00:00, 12707.88it/s]

Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 10932.98it/s]

Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 12785.52it/s]

Loading weights: 100%|██████████| 723/723 [00:00<00:00, 12344.88it/s]
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[FeatureFusion] importance gate ENABLED on geometry delta
[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[FeatureFusion] importance gate ENABLED on geometry delta
[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[FeatureFusion] importance gate ENABLED on geometry delta
[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[FeatureFusion] importance gate ENABLED on geometry delta
[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[FeatureFusion] importance gate ENABLED on geometry delta
[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[FeatureFusion] importance gate ENABLED on geometry delta
[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[FeatureFusion] importance gate ENABLED on geometry delta
[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[FeatureFusion] importance gate ENABLED on geometry delta
[FeatureFusion] learnable geometry scale ENABLED (init 0.5)
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Vision Module - Attention Blocks:
Trainable Block Indices: None
Non-Trainable Block Indices: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23]
Merger Module Trainable: True
LLM Module - Embed Tokens Trainable: True
LLM Module - Trainable Layer Indices: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31]
LLM Module - Non-Trainable Layer Indices: None
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_importance_gate": true,
  "geometry_learnable_scale": true,
  "geometry_merger_type": "mlp",
  "geometry_spatial_bias": false,
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 2560,
    "initializer_range": 0.02,
    "intermediate_size": 9216,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": true,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": true,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 24,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1024,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4096,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 2560,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_importance_gate": true,
  "geometry_learnable_scale": true,
  "geometry_merger_type": "mlp",
  "geometry_spatial_bias": false,
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 2560,
    "initializer_range": 0.02,
    "intermediate_size": 9216,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": true,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": true,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 24,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1024,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4096,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 2560,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_importance_gate": true,
  "geometry_learnable_scale": true,
  "geometry_merger_type": "mlp",
  "geometry_spatial_bias": false,
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 2560,
    "initializer_range": 0.02,
    "intermediate_size": 9216,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": true,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": true,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 24,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1024,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4096,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 2560,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_importance_gate": true,
  "geometry_learnable_scale": true,
  "geometry_merger_type": "mlp",
  "geometry_spatial_bias": false,
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 2560,
    "initializer_range": 0.02,
    "intermediate_size": 9216,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": true,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": true,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 24,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1024,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4096,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 2560,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_importance_gate": true,
  "geometry_learnable_scale": true,
  "geometry_merger_type": "mlp",
  "geometry_spatial_bias": false,
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 2560,
    "initializer_range": 0.02,
    "intermediate_size": 9216,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": true,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": true,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 24,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1024,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4096,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 2560,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_importance_gate": true,
  "geometry_learnable_scale": true,
  "geometry_merger_type": "mlp",
  "geometry_spatial_bias": false,
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 2560,
    "initializer_range": 0.02,
    "intermediate_size": 9216,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": true,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": true,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 24,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1024,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4096,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 2560,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_importance_gate": true,
  "geometry_learnable_scale": true,
  "geometry_merger_type": "mlp",
  "geometry_spatial_bias": false,
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 2560,
    "initializer_range": 0.02,
    "intermediate_size": 9216,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": true,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": true,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 24,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1024,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4096,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 2560,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_importance_gate": true,
  "geometry_learnable_scale": true,
  "geometry_merger_type": "mlp",
  "geometry_spatial_bias": false,
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 2560,
    "initializer_range": 0.02,
    "intermediate_size": 9216,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": true,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": true,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 24,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1024,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4096,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 2560,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Total training samples: 2429620
Total training samples: 2429620
Total training samples: 2429620
Total training samples: 2429620
Total training samples: 2429620
Formatting inputs...Skip in lazy mode
Formatting inputs...Skip in lazy mode
Formatting inputs...Skip in lazy mode
Formatting inputs...Skip in lazy mode
Formatting inputs...Skip in lazy mode
Total training samples: 2429620
Total training samples: 2429620
Formatting inputs...Skip in lazy mode
Formatting inputs...Skip in lazy mode
Total training samples: 2429620
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
Formatting inputs...Skip in lazy mode
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
NCCL version 2.26.2+cuda12.2
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  0%|          | 0/37963 [00:00<?, ?it/s]/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  0%|          | 1/37963 [01:59<1263:49:54, 119.85s/it]/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  0%|          | 2/37963 [02:10<583:57:38, 55.38s/it]  
  0%|          | 3/37963 [02:20<366:32:28, 34.76s/it]
  0%|          | 4/37963 [02:30<262:55:03, 24.93s/it]
  0%|          | 5/37963 [02:47<235:14:20, 22.31s/it]
  0%|          | 6/37963 [02:58<192:13:10, 18.23s/it]
  0%|          | 7/37963 [03:08<164:11:31, 15.57s/it]
  0%|          | 8/37963 [03:18<146:19:50, 13.88s/it]/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  0%|          | 9/37963 [03:28<134:03:30, 12.72s/it]
  0%|          | 10/37963 [03:38<125:12:32, 11.88s/it]
                                                      
{'loss': '2.345', 'grad_norm': '1214', 'learning_rate': '1.58e-07', 'epoch': '0.0002634'}

  0%|          | 10/37963 [03:39<125:12:32, 11.88s/it]
  0%|          | 11/37963 [03:56<145:55:17, 13.84s/it]
  0%|          | 12/37963 [04:07<133:53:15, 12.70s/it]
  0%|          | 13/37963 [04:17<125:29:48, 11.90s/it]
  0%|          | 14/37963 [04:27<119:43:53, 11.36s/it]
  0%|          | 15/37963 [04:37<115:35:28, 10.97s/it]
  0%|          | 16/37963 [04:47<113:07:45, 10.73s/it]
  0%|          | 17/37963 [04:57<110:33:58, 10.49s/it]
  0%|          | 18/37963 [05:07<109:30:01, 10.39s/it]
  0%|          | 19/37963 [05:17<108:57:12, 10.34s/it]
  0%|          | 20/37963 [05:27<107:24:29, 10.19s/it]
                                                      
{'loss': '0.6659', 'grad_norm': '56.11', 'learning_rate': '3.336e-07', 'epoch': '0.0005268'}

  0%|          | 20/37963 [05:27<107:24:29, 10.19s/it]
  0%|          | 21/37963 [05:37<106:19:43, 10.09s/it]
  0%|          | 22/37963 [05:47<106:11:27, 10.08s/it]
  0%|          | 23/37963 [05:57<106:20:56, 10.09s/it]
  0%|          | 24/37963 [06:07<105:35:23, 10.02s/it]
  0%|          | 25/37963 [06:17<105:25:27, 10.00s/it]
  0%|          | 26/37963 [06:27<105:56:07, 10.05s/it]
  0%|          | 27/37963 [06:37<106:04:29, 10.07s/it]
  0%|          | 28/37963 [06:47<106:18:53, 10.09s/it]
  0%|          | 29/37963 [06:57<105:52:56, 10.05s/it]
  0%|          | 30/37963 [07:08<106:17:59, 10.09s/it]
                                                      
{'loss': '0.2987', 'grad_norm': '32.75', 'learning_rate': '5.092e-07', 'epoch': '0.0007902'}

  0%|          | 30/37963 [07:08<106:17:59, 10.09s/it]
  0%|          | 31/37963 [07:18<106:20:06, 10.09s/it]
  0%|          | 32/37963 [07:28<105:44:48, 10.04s/it]
  0%|          | 33/37963 [07:38<105:54:28, 10.05s/it]
  0%|          | 34/37963 [07:48<105:41:36, 10.03s/it]
  0%|          | 35/37963 [07:58<105:52:07, 10.05s/it]
  0%|          | 36/37963 [08:08<105:53:46, 10.05s/it]
  0%|          | 37/37963 [08:18<106:18:48, 10.09s/it]
  0%|          | 38/37963 [08:35<129:53:54, 12.33s/it]
  0%|          | 39/37963 [08:45<122:03:40, 11.59s/it]
  0%|          | 40/37963 [08:55<117:29:34, 11.15s/it]
                                                      
{'loss': '0.2494', 'grad_norm': '14.56', 'learning_rate': '6.848e-07', 'epoch': '0.001054'}

  0%|          | 40/37963 [08:55<117:29:34, 11.15s/it]
  0%|          | 41/37963 [09:06<113:59:41, 10.82s/it]
  0%|          | 42/37963 [09:16<112:06:35, 10.64s/it]
  0%|          | 43/37963 [09:45<171:03:17, 16.24s/it]
  0%|          | 44/37963 [10:11<203:02:51, 19.28s/it]
  0%|          | 45/37963 [10:34<214:18:26, 20.35s/it]
  0%|          | 46/37963 [10:50<200:56:41, 19.08s/it]
  0%|          | 47/37963 [11:01<172:58:27, 16.42s/it]
  0%|          | 48/37963 [11:11<152:52:01, 14.51s/it]
  0%|          | 49/37963 [11:21<138:52:24, 13.19s/it]
  0%|          | 50/37963 [11:31<129:33:44, 12.30s/it]
                                                      
{'loss': '0.2559', 'grad_norm': '20.71', 'learning_rate': '8.604e-07', 'epoch': '0.001317'}

  0%|          | 50/37963 [11:31<129:33:44, 12.30s/it]
  0%|          | 51/37963 [11:41<122:58:28, 11.68s/it]
  0%|          | 52/37963 [11:51<117:43:41, 11.18s/it]
  0%|          | 53/37963 [12:01<113:22:05, 10.77s/it]
  0%|          | 54/37963 [12:11<111:12:43, 10.56s/it]
  0%|          | 55/37963 [12:21<108:47:58, 10.33s/it]
  0%|          | 56/37963 [12:31<107:21:26, 10.20s/it]
  0%|          | 57/37963 [12:41<107:06:20, 10.17s/it]
  0%|          | 58/37963 [12:51<106:14:02, 10.09s/it]
  0%|          | 59/37963 [13:01<106:23:36, 10.10s/it]
  0%|          | 60/37963 [13:11<106:07:28, 10.08s/it]
                                                      
{'loss': '0.2369', 'grad_norm': '14.78', 'learning_rate': '1.036e-06', 'epoch': '0.00158'}

  0%|          | 60/37963 [13:11<106:07:28, 10.08s/it]
  0%|          | 61/37963 [13:21<106:29:34, 10.11s/it]
  0%|          | 62/37963 [13:31<105:12:38,  9.99s/it]
  0%|          | 63/37963 [13:41<105:55:40, 10.06s/it]
  0%|          | 64/37963 [13:51<105:31:44, 10.02s/it]
  0%|          | 65/37963 [14:01<105:59:56, 10.07s/it]
  0%|          | 66/37963 [14:11<104:33:50,  9.93s/it]
  0%|          | 67/37963 [14:21<105:10:28,  9.99s/it]
  0%|          | 68/37963 [14:31<105:38:36, 10.04s/it]
  0%|          | 69/37963 [14:41<104:12:13,  9.90s/it]
  0%|          | 70/37963 [14:51<105:16:03, 10.00s/it]
                                                      
{'loss': '0.2217', 'grad_norm': '11.01', 'learning_rate': '1.212e-06', 'epoch': '0.001844'}

  0%|          | 70/37963 [14:51<105:16:03, 10.00s/it]
  0%|          | 71/37963 [15:01<105:25:32, 10.02s/it]
  0%|          | 72/37963 [15:11<106:14:33, 10.09s/it]
  0%|          | 73/37963 [15:21<106:31:14, 10.12s/it]
  0%|          | 74/37963 [15:32<106:47:04, 10.15s/it]
  0%|          | 75/37963 [15:42<106:25:50, 10.11s/it]
  0%|          | 76/37963 [15:52<106:53:58, 10.16s/it]
  0%|          | 77/37963 [16:02<106:49:20, 10.15s/it]
  0%|          | 78/37963 [16:12<107:06:03, 10.18s/it]
  0%|          | 79/37963 [16:22<106:53:06, 10.16s/it]
  0%|          | 80/37963 [16:33<107:03:01, 10.17s/it]
                                                      
{'loss': '0.2325', 'grad_norm': '9.719', 'learning_rate': '1.387e-06', 'epoch': '0.002107'}

  0%|          | 80/37963 [16:33<107:03:01, 10.17s/it]
  0%|          | 81/37963 [16:42<106:02:38, 10.08s/it]
  0%|          | 82/37963 [16:53<106:14:21, 10.10s/it]
  0%|          | 83/37963 [17:03<106:20:05, 10.11s/it]
  0%|          | 84/37963 [17:13<106:33:05, 10.13s/it]
  0%|          | 85/37963 [17:23<106:10:53, 10.09s/it]
  0%|          | 86/37963 [17:33<106:06:33, 10.09s/it]
  0%|          | 87/37963 [17:43<106:13:46, 10.10s/it]
  0%|          | 88/37963 [17:53<105:26:07, 10.02s/it]
  0%|          | 89/37963 [18:03<105:47:14, 10.06s/it]
  0%|          | 90/37963 [18:26<145:05:05, 13.79s/it]
                                                      
{'loss': '0.2155', 'grad_norm': '13.84', 'learning_rate': '1.563e-06', 'epoch': '0.002371'}

  0%|          | 90/37963 [18:26<145:05:05, 13.79s/it]
  0%|          | 91/37963 [18:52<184:41:56, 17.56s/it]
  0%|          | 92/37963 [19:15<200:47:04, 19.09s/it]
  0%|          | 93/37963 [19:24<171:17:40, 16.28s/it]
  0%|          | 94/37963 [19:47<193:00:03, 18.35s/it]
  0%|          | 95/37963 [19:57<166:38:30, 15.84s/it]
  0%|          | 96/37963 [20:08<148:57:34, 14.16s/it]
  0%|          | 97/37963 [20:18<136:12:39, 12.95s/it]
  0%|          | 98/37963 [20:28<127:15:37, 12.10s/it]
  0%|          | 99/37963 [20:38<121:05:23, 11.51s/it]
  0%|          | 100/37963 [20:48<116:17:46, 11.06s/it]
                                                       
{'loss': '0.2139', 'grad_norm': '12.44', 'learning_rate': '1.738e-06', 'epoch': '0.002634'}

  0%|          | 100/37963 [20:48<116:17:46, 11.06s/it]
  0%|          | 101/37963 [20:58<113:18:39, 10.77s/it]
  0%|          | 102/37963 [21:08<111:21:11, 10.59s/it]
  0%|          | 103/37963 [21:18<109:49:15, 10.44s/it]
  0%|          | 104/37963 [21:28<108:27:19, 10.31s/it]
  0%|          | 105/37963 [21:38<106:28:12, 10.12s/it]
  0%|          | 106/37963 [21:48<106:35:12, 10.14s/it]
  0%|          | 107/37963 [21:58<105:56:04, 10.07s/it]
  0%|          | 108/37963 [22:08<106:04:07, 10.09s/it]
  0%|          | 109/37963 [22:19<106:10:48, 10.10s/it]
  0%|          | 110/37963 [22:29<106:39:33, 10.14s/it]
                                                       
{'loss': '0.2183', 'grad_norm': '10.62', 'learning_rate': '1.914e-06', 'epoch': '0.002898'}

  0%|          | 110/37963 [22:29<106:39:33, 10.14s/it]
  0%|          | 111/37963 [22:39<106:39:18, 10.14s/it]
  0%|          | 112/37963 [22:49<106:33:12, 10.13s/it]
  0%|          | 113/37963 [22:59<106:29:29, 10.13s/it]
  0%|          | 114/37963 [23:09<106:37:55, 10.14s/it]
  0%|          | 115/37963 [23:19<106:39:58, 10.15s/it]
  0%|          | 116/37963 [23:30<106:52:22, 10.17s/it]
  0%|          | 117/37963 [23:40<106:57:13, 10.17s/it]
  0%|          | 118/37963 [23:50<106:45:07, 10.15s/it]
  0%|          | 119/37963 [24:00<106:36:22, 10.14s/it]
  0%|          | 120/37963 [24:10<106:51:27, 10.17s/it]
                                                       
{'loss': '0.2322', 'grad_norm': '17.65', 'learning_rate': '2.09e-06', 'epoch': '0.003161'}

  0%|          | 120/37963 [24:10<106:51:27, 10.17s/it]
  0%|          | 121/37963 [24:20<106:20:33, 10.12s/it]
  0%|          | 122/37963 [24:30<106:03:46, 10.09s/it]
  0%|          | 123/37963 [24:41<106:21:39, 10.12s/it]
  0%|          | 124/37963 [24:50<105:42:14, 10.06s/it]
  0%|          | 125/37963 [25:00<104:04:15,  9.90s/it]
  0%|          | 126/37963 [25:10<104:57:17,  9.99s/it]
  0%|          | 127/37963 [25:20<105:55:59, 10.08s/it]
  0%|          | 128/37963 [25:31<105:52:05, 10.07s/it]
  0%|          | 129/37963 [25:40<105:33:54, 10.04s/it]
  0%|          | 130/37963 [25:51<105:49:19, 10.07s/it]
                                                       
{'loss': '0.2023', 'grad_norm': '10.38', 'learning_rate': '2.265e-06', 'epoch': '0.003424'}

  0%|          | 130/37963 [25:51<105:49:19, 10.07s/it]
  0%|          | 131/37963 [26:01<106:12:45, 10.11s/it]
  0%|          | 132/37963 [26:11<106:26:10, 10.13s/it]
  0%|          | 133/37963 [26:21<105:32:13, 10.04s/it]
  0%|          | 134/37963 [26:31<105:55:20, 10.08s/it]
  0%|          | 135/37963 [26:41<106:29:31, 10.13s/it]
  0%|          | 136/37963 [26:51<106:30:07, 10.14s/it]
  0%|          | 137/37963 [27:18<157:07:47, 14.95s/it]
  0%|          | 138/37963 [27:34<161:30:08, 15.37s/it]
  0%|          | 139/37963 [27:51<165:53:47, 15.79s/it]
  0%|          | 140/37963 [28:07<168:43:39, 16.06s/it]
                                                       
{'loss': '0.2148', 'grad_norm': '15.34', 'learning_rate': '2.441e-06', 'epoch': '0.003688'}

  0%|          | 140/37963 [28:07<168:43:39, 16.06s/it]
  0%|          | 141/37963 [28:24<170:08:39, 16.19s/it]
  0%|          | 142/37963 [28:40<170:04:38, 16.19s/it]
  0%|          | 143/37963 [28:50<150:36:32, 14.34s/it]
  0%|          | 144/37963 [29:07<158:10:09, 15.06s/it]
  0%|          | 145/37963 [29:17<143:13:35, 13.63s/it]
  0%|          | 146/37963 [29:27<132:08:05, 12.58s/it]
  0%|          | 147/37963 [29:38<124:48:41, 11.88s/it]
  0%|          | 148/37963 [29:48<119:28:19, 11.37s/it]
  0%|          | 149/37963 [29:58<115:45:54, 11.02s/it]
  0%|          | 150/37963 [30:08<112:39:51, 10.73s/it]
                                                       
{'loss': '0.2174', 'grad_norm': '10.7', 'learning_rate': '2.616e-06', 'epoch': '0.003951'}

  0%|          | 150/37963 [30:08<112:39:51, 10.73s/it]
  0%|          | 151/37963 [30:18<110:37:55, 10.53s/it]
  0%|          | 152/37963 [30:28<109:29:51, 10.43s/it]
  0%|          | 153/37963 [30:38<108:22:43, 10.32s/it]
  0%|          | 154/37963 [30:48<108:03:28, 10.29s/it]
  0%|          | 155/37963 [30:59<107:45:27, 10.26s/it]
  0%|          | 156/37963 [31:09<107:40:26, 10.25s/it]
  0%|          | 157/37963 [31:19<107:29:43, 10.24s/it]
  0%|          | 158/37963 [31:29<107:39:29, 10.25s/it]
  0%|          | 159/37963 [31:39<106:54:25, 10.18s/it]
  0%|          | 160/37963 [31:50<106:44:58, 10.17s/it]
                                                       
{'loss': '0.2343', 'grad_norm': '17.64', 'learning_rate': '2.792e-06', 'epoch': '0.004215'}

  0%|          | 160/37963 [31:50<106:44:58, 10.17s/it]
  0%|          | 161/37963 [31:59<105:57:36, 10.09s/it]
  0%|          | 162/37963 [32:10<106:10:44, 10.11s/it]
  0%|          | 163/37963 [32:19<104:56:50,  9.99s/it]
  0%|          | 164/37963 [32:30<105:37:45, 10.06s/it]
  0%|          | 165/37963 [32:40<105:46:37, 10.07s/it]
  0%|          | 166/37963 [32:50<106:07:29, 10.11s/it]
  0%|          | 167/37963 [33:00<105:09:59, 10.02s/it]
  0%|          | 168/37963 [33:10<105:41:36, 10.07s/it]
  0%|          | 169/37963 [33:20<105:31:45, 10.05s/it]
  0%|          | 170/37963 [33:30<105:53:36, 10.09s/it]
                                                       
{'loss': '0.2316', 'grad_norm': '11.72', 'learning_rate': '2.968e-06', 'epoch': '0.004478'}

  0%|          | 170/37963 [33:30<105:53:36, 10.09s/it]
  0%|          | 171/37963 [33:40<104:40:23,  9.97s/it]
  0%|          | 172/37963 [33:50<105:37:19, 10.06s/it]
  0%|          | 173/37963 [34:00<106:11:43, 10.12s/it]
  0%|          | 174/37963 [34:10<105:57:43, 10.09s/it]
  0%|          | 175/37963 [34:21<106:33:59, 10.15s/it]
  0%|          | 176/37963 [34:31<106:21:52, 10.13s/it]
  0%|          | 177/37963 [34:41<105:31:45, 10.05s/it]
  0%|          | 178/37963 [34:51<106:01:24, 10.10s/it]
  0%|          | 179/37963 [35:01<105:42:45, 10.07s/it]
  0%|          | 180/37963 [35:11<105:47:34, 10.08s/it]
                                                       
{'loss': '0.2301', 'grad_norm': '10.73', 'learning_rate': '3.143e-06', 'epoch': '0.004741'}

  0%|          | 180/37963 [35:11<105:47:34, 10.08s/it]
  0%|          | 181/37963 [35:21<106:00:31, 10.10s/it]
  0%|          | 182/37963 [35:31<106:33:17, 10.15s/it]
  0%|          | 183/37963 [35:41<106:21:39, 10.13s/it]
  0%|          | 184/37963 [35:58<125:59:15, 12.01s/it]
  0%|          | 185/37963 [36:08<120:33:02, 11.49s/it]
  0%|          | 186/37963 [36:24<135:48:57, 12.94s/it]
  0%|          | 187/37963 [36:41<147:07:42, 14.02s/it]
  0%|          | 188/37963 [37:07<184:36:24, 17.59s/it]
  0%|          | 189/37963 [37:23<181:24:25, 17.29s/it]
  1%|          | 190/37963 [37:33<158:42:33, 15.13s/it]
                                                       
{'loss': '0.2127', 'grad_norm': '7.275', 'learning_rate': '3.319e-06', 'epoch': '0.005005'}

  1%|          | 190/37963 [37:33<158:42:33, 15.13s/it]
  1%|          | 191/37963 [37:50<163:59:47, 15.63s/it]
  1%|          | 192/37963 [38:00<146:33:40, 13.97s/it]
  1%|          | 193/37963 [38:10<134:00:04, 12.77s/it]
  1%|          | 194/37963 [38:20<124:47:04, 11.89s/it]
  1%|          | 195/37963 [38:30<119:42:30, 11.41s/it]
  1%|          | 196/37963 [38:41<115:35:49, 11.02s/it]
  1%|          | 197/37963 [38:51<112:11:15, 10.69s/it]
  1%|          | 198/37963 [39:01<110:35:43, 10.54s/it]
  1%|          | 199/37963 [39:11<109:08:49, 10.40s/it]
  1%|          | 200/37963 [39:21<107:37:23, 10.26s/it]
                                                       
{'loss': '0.225', 'grad_norm': '12.43', 'learning_rate': '3.494e-06', 'epoch': '0.005268'}

  1%|          | 200/37963 [39:21<107:37:23, 10.26s/it]
  1%|          | 201/37963 [39:31<107:05:35, 10.21s/it]
  1%|          | 202/37963 [39:41<107:00:05, 10.20s/it]
  1%|          | 203/37963 [39:51<107:33:15, 10.25s/it]
  1%|          | 204/37963 [40:01<107:08:49, 10.22s/it]
  1%|          | 205/37963 [40:12<107:44:01, 10.27s/it]
  1%|          | 206/37963 [40:22<107:40:03, 10.27s/it]
  1%|          | 207/37963 [40:32<107:09:21, 10.22s/it]
  1%|          | 208/37963 [40:43<107:20:30, 10.24s/it]
  1%|          | 209/37963 [40:53<107:18:01, 10.23s/it]
  1%|          | 210/37963 [41:03<106:35:59, 10.16s/it]
                                                       
{'loss': '0.2141', 'grad_norm': '13.31', 'learning_rate': '3.67e-06', 'epoch': '0.005532'}

  1%|          | 210/37963 [41:03<106:35:59, 10.16s/it]
  1%|          | 211/37963 [41:13<106:19:40, 10.14s/it]
  1%|          | 212/37963 [41:23<106:49:16, 10.19s/it]
  1%|          | 213/37963 [41:33<106:35:08, 10.16s/it]
  1%|          | 214/37963 [41:43<106:27:30, 10.15s/it]
  1%|          | 215/37963 [41:54<106:22:10, 10.14s/it]
  1%|          | 216/37963 [42:04<106:28:48, 10.16s/it]
  1%|          | 217/37963 [42:14<106:20:35, 10.14s/it]
  1%|          | 218/37963 [42:24<106:21:41, 10.14s/it]
  1%|          | 219/37963 [42:34<106:33:42, 10.16s/it]
  1%|          | 220/37963 [42:44<106:25:14, 10.15s/it]
                                                       
{'loss': '0.2051', 'grad_norm': '19.88', 'learning_rate': '3.845e-06', 'epoch': '0.005795'}

  1%|          | 220/37963 [42:44<106:25:14, 10.15s/it]
  1%|          | 221/37963 [42:54<105:17:38, 10.04s/it]
  1%|          | 222/37963 [43:04<106:06:19, 10.12s/it]
  1%|          | 223/37963 [43:15<106:45:03, 10.18s/it]
  1%|          | 224/37963 [43:25<106:43:35, 10.18s/it]
  1%|          | 225/37963 [43:35<106:59:53, 10.21s/it]
  1%|          | 226/37963 [43:45<105:52:26, 10.10s/it]
  1%|          | 227/37963 [43:55<106:29:04, 10.16s/it]
  1%|          | 228/37963 [44:05<106:35:31, 10.17s/it]
  1%|          | 229/37963 [44:15<105:57:20, 10.11s/it]
  1%|          | 230/37963 [44:26<105:56:16, 10.11s/it]
                                                       
{'loss': '0.2126', 'grad_norm': '11.66', 'learning_rate': '4.021e-06', 'epoch': '0.006059'}

  1%|          | 230/37963 [44:26<105:56:16, 10.11s/it]
  1%|          | 231/37963 [44:36<106:09:40, 10.13s/it]
  1%|          | 232/37963 [44:46<105:31:18, 10.07s/it]
  1%|          | 233/37963 [45:18<175:52:53, 16.78s/it]
  1%|          | 234/37963 [45:28<155:44:19, 14.86s/it]
  1%|          | 235/37963 [45:45<161:06:58, 15.37s/it]
  1%|          | 236/37963 [46:02<164:57:52, 15.74s/it]
  1%|          | 237/37963 [46:18<167:18:34, 15.97s/it]
  1%|          | 238/37963 [46:28<149:24:47, 14.26s/it]
  1%|          | 239/37963 [46:39<136:54:23, 13.06s/it]
  1%|          | 240/37963 [46:55<146:35:24, 13.99s/it]
                                                       
{'loss': '0.2222', 'grad_norm': '13.6', 'learning_rate': '4.197e-06', 'epoch': '0.006322'}

  1%|          | 240/37963 [46:55<146:35:24, 13.99s/it]
  1%|          | 241/37963 [47:11<154:03:01, 14.70s/it]
  1%|          | 242/37963 [47:21<139:09:27, 13.28s/it]
  1%|          | 243/37963 [47:31<129:33:09, 12.36s/it]
  1%|          | 244/37963 [47:42<122:37:03, 11.70s/it]
  1%|          | 245/37963 [47:52<118:00:37, 11.26s/it]
  1%|          | 246/37963 [48:02<114:20:54, 10.91s/it]
  1%|          | 247/37963 [48:12<111:40:36, 10.66s/it]
  1%|          | 248/37963 [48:22<110:40:15, 10.56s/it]
  1%|          | 249/37963 [48:32<108:12:34, 10.33s/it]
  1%|          | 250/37963 [48:42<107:32:38, 10.27s/it]
                                                       
{'loss': '0.1794', 'grad_norm': '14.94', 'learning_rate': '4.372e-06', 'epoch': '0.006585'}

  1%|          | 250/37963 [48:42<107:32:38, 10.27s/it]
  1%|          | 251/37963 [48:52<106:35:00, 10.17s/it]
  1%|          | 252/37963 [49:02<106:31:32, 10.17s/it]
  1%|          | 253/37963 [49:12<106:25:06, 10.16s/it]
  1%|          | 254/37963 [49:23<106:16:00, 10.15s/it]
  1%|          | 255/37963 [49:33<106:56:24, 10.21s/it]
  1%|          | 256/37963 [49:43<105:56:28, 10.11s/it]
  1%|          | 257/37963 [49:53<106:13:42, 10.14s/it]
  1%|          | 258/37963 [50:03<105:57:12, 10.12s/it]
  1%|          | 259/37963 [50:13<106:15:39, 10.15s/it]
  1%|          | 260/37963 [50:23<106:02:12, 10.12s/it]
                                                       
{'loss': '0.2158', 'grad_norm': '13.92', 'learning_rate': '4.548e-06', 'epoch': '0.006849'}

  1%|          | 260/37963 [50:23<106:02:12, 10.12s/it]
  1%|          | 261/37963 [50:34<106:14:55, 10.15s/it]
  1%|          | 262/37963 [50:44<106:41:00, 10.19s/it]
  1%|          | 263/37963 [50:54<106:47:44, 10.20s/it]
  1%|          | 264/37963 [51:04<106:24:53, 10.16s/it]
  1%|          | 265/37963 [51:14<106:25:41, 10.16s/it]
  1%|          | 266/37963 [51:25<106:53:25, 10.21s/it]
  1%|          | 267/37963 [51:35<106:38:18, 10.18s/it]
  1%|          | 268/37963 [51:45<106:28:23, 10.17s/it]
  1%|          | 269/37963 [51:55<106:23:02, 10.16s/it]
  1%|          | 270/37963 [52:05<106:19:10, 10.15s/it]
                                                       
{'loss': '0.1933', 'grad_norm': '5.824', 'learning_rate': '4.723e-06', 'epoch': '0.007112'}

  1%|          | 270/37963 [52:05<106:19:10, 10.15s/it]
  1%|          | 271/37963 [52:15<106:29:25, 10.17s/it]
  1%|          | 272/37963 [52:25<106:04:44, 10.13s/it]
  1%|          | 273/37963 [52:36<106:11:47, 10.14s/it]
  1%|          | 274/37963 [52:46<106:27:53, 10.17s/it]
  1%|          | 275/37963 [52:56<106:25:14, 10.17s/it]
  1%|          | 276/37963 [53:06<106:21:04, 10.16s/it]
  1%|          | 277/37963 [53:16<105:35:59, 10.09s/it]
  1%|          | 278/37963 [53:26<105:12:26, 10.05s/it]
  1%|          | 279/37963 [53:36<105:42:01, 10.10s/it]
  1%|          | 280/37963 [53:46<105:41:26, 10.10s/it]
                                                       
{'loss': '0.1996', 'grad_norm': '12.39', 'learning_rate': '4.899e-06', 'epoch': '0.007376'}

  1%|          | 280/37963 [53:46<105:41:26, 10.10s/it]
  1%|          | 281/37963 [54:12<155:55:55, 14.90s/it]
  1%|          | 282/37963 [54:29<162:18:08, 15.51s/it]
  1%|          | 283/37963 [54:39<145:25:54, 13.89s/it]
  1%|          | 284/37963 [54:56<154:26:32, 14.76s/it]
  1%|          | 285/37963 [55:06<139:27:45, 13.33s/it]
  1%|          | 286/37963 [55:36<189:51:45, 18.14s/it]
  1%|          | 287/37963 [55:46<165:08:11, 15.78s/it]
  1%|          | 288/37963 [56:03<168:29:02, 16.10s/it]
  1%|          | 289/37963 [56:13<149:54:26, 14.32s/it]
  1%|          | 290/37963 [56:23<135:48:14, 12.98s/it]
                                                       
{'loss': '0.1913', 'grad_norm': '9.185', 'learning_rate': '5.075e-06', 'epoch': '0.007639'}

  1%|          | 290/37963 [56:23<135:48:14, 12.98s/it]
  1%|          | 291/37963 [56:33<126:50:04, 12.12s/it]
  1%|          | 292/37963 [56:43<119:54:06, 11.46s/it]
  1%|          | 293/37963 [56:53<115:43:48, 11.06s/it]
  1%|          | 294/37963 [57:03<112:54:07, 10.79s/it]
  1%|          | 295/37963 [57:14<111:56:30, 10.70s/it]
  1%|          | 296/37963 [57:24<110:08:06, 10.53s/it]
  1%|          | 297/37963 [57:34<108:59:41, 10.42s/it]
  1%|          | 298/37963 [57:44<108:19:53, 10.35s/it]
  1%|          | 299/37963 [57:54<107:56:03, 10.32s/it]
  1%|          | 300/37963 [58:04<107:25:20, 10.27s/it]
                                                       
{'loss': '0.1974', 'grad_norm': '9.663', 'learning_rate': '5.25e-06', 'epoch': '0.007902'}

  1%|          | 300/37963 [58:04<107:25:20, 10.27s/it]
  1%|          | 301/37963 [58:15<107:20:29, 10.26s/it]
  1%|          | 302/37963 [58:25<107:32:38, 10.28s/it]
  1%|          | 303/37963 [58:35<107:17:33, 10.26s/it]
  1%|          | 304/37963 [58:45<106:57:31, 10.22s/it]
  1%|          | 305/37963 [58:55<106:39:53, 10.20s/it]
  1%|          | 306/37963 [59:06<106:32:32, 10.19s/it]
  1%|          | 307/37963 [59:16<106:33:55, 10.19s/it]
  1%|          | 308/37963 [59:26<106:15:30, 10.16s/it]
  1%|          | 309/37963 [59:36<105:51:18, 10.12s/it]
  1%|          | 310/37963 [59:46<104:55:22, 10.03s/it]
                                                       
{'loss': '0.1927', 'grad_norm': '8.514', 'learning_rate': '5.426e-06', 'epoch': '0.008166'}

  1%|          | 310/37963 [59:46<104:55:22, 10.03s/it]
  1%|          | 311/37963 [59:55<103:33:36,  9.90s/it]
  1%|          | 312/37963 [1:00:05<103:57:10,  9.94s/it]
  1%|          | 313/37963 [1:00:16<104:54:47, 10.03s/it]
  1%|          | 314/37963 [1:00:26<105:15:06, 10.06s/it]
  1%|          | 315/37963 [1:00:36<105:55:00, 10.13s/it]
  1%|          | 316/37963 [1:00:46<106:08:56, 10.15s/it]
  1%|          | 317/37963 [1:00:56<106:03:23, 10.14s/it]
  1%|          | 318/37963 [1:01:07<106:26:56, 10.18s/it]
  1%|          | 319/37963 [1:01:17<106:29:07, 10.18s/it]
  1%|          | 320/37963 [1:01:27<106:12:48, 10.16s/it]
                                                         
{'loss': '0.2001', 'grad_norm': '12.32', 'learning_rate': '5.601e-06', 'epoch': '0.008429'}

  1%|          | 320/37963 [1:01:27<106:12:48, 10.16s/it]
  1%|          | 321/37963 [1:01:37<106:12:18, 10.16s/it]
  1%|          | 322/37963 [1:01:47<105:59:29, 10.14s/it]
  1%|          | 323/37963 [1:01:57<106:30:01, 10.19s/it]
  1%|          | 324/37963 [1:02:08<106:16:53, 10.17s/it]
  1%|          | 325/37963 [1:02:18<106:19:28, 10.17s/it]
  1%|          | 326/37963 [1:02:28<106:11:52, 10.16s/it]
  1%|          | 327/37963 [1:02:38<105:53:30, 10.13s/it]
  1%|          | 328/37963 [1:02:48<105:59:42, 10.14s/it]
  1%|          | 329/37963 [1:03:08<137:08:27, 13.12s/it]
  1%|          | 330/37963 [1:03:25<148:36:00, 14.22s/it]
                                                         
{'loss': '0.2062', 'grad_norm': '7.191', 'learning_rate': '5.777e-06', 'epoch': '0.008693'}

  1%|          | 330/37963 [1:03:25<148:36:00, 14.22s/it]
  1%|          | 331/37963 [1:03:41<155:13:30, 14.85s/it]
  1%|          | 332/37963 [1:03:58<160:02:21, 15.31s/it]
  1%|          | 333/37963 [1:04:14<164:08:48, 15.70s/it]
  1%|          | 334/37963 [1:04:31<167:07:23, 15.99s/it]
  1%|          | 335/37963 [1:04:48<169:34:11, 16.22s/it]
  1%|          | 336/37963 [1:05:04<168:48:19, 16.15s/it]
  1%|          | 337/37963 [1:05:14<150:17:00, 14.38s/it]
  1%|          | 338/37963 [1:05:24<136:54:14, 13.10s/it]
  1%|          | 339/37963 [1:05:34<128:00:06, 12.25s/it]
  1%|          | 340/37963 [1:05:44<120:09:20, 11.50s/it]
                                                         
{'loss': '0.1892', 'grad_norm': '13.58', 'learning_rate': '5.953e-06', 'epoch': '0.008956'}

  1%|          | 340/37963 [1:05:44<120:09:20, 11.50s/it]
  1%|          | 341/37963 [1:05:54<115:30:21, 11.05s/it]
  1%|          | 342/37963 [1:06:04<113:00:45, 10.81s/it]
  1%|          | 343/37963 [1:06:15<111:04:19, 10.63s/it]
  1%|          | 344/37963 [1:06:25<109:45:01, 10.50s/it]
  1%|          | 345/37963 [1:06:35<107:53:38, 10.33s/it]
  1%|          | 346/37963 [1:06:45<107:42:52, 10.31s/it]
  1%|          | 347/37963 [1:06:55<107:58:34, 10.33s/it]
  1%|          | 348/37963 [1:07:06<107:32:32, 10.29s/it]
  1%|          | 349/37963 [1:07:16<107:04:22, 10.25s/it]
  1%|          | 350/37963 [1:07:26<106:53:56, 10.23s/it]
                                                         
{'loss': '0.2176', 'grad_norm': '9.882', 'learning_rate': '6.128e-06', 'epoch': '0.00922'}

  1%|          | 350/37963 [1:07:26<106:53:56, 10.23s/it]
  1%|          | 351/37963 [1:07:36<106:20:51, 10.18s/it]
  1%|          | 352/37963 [1:07:46<106:16:39, 10.17s/it]
  1%|          | 353/37963 [1:07:56<106:24:05, 10.18s/it]
  1%|          | 354/37963 [1:08:06<106:10:40, 10.16s/it]
  1%|          | 355/37963 [1:08:17<106:17:19, 10.17s/it]
  1%|          | 356/37963 [1:08:27<106:12:19, 10.17s/it]
  1%|          | 357/37963 [1:08:37<106:02:28, 10.15s/it]
  1%|          | 358/37963 [1:08:47<106:20:25, 10.18s/it]
  1%|          | 359/37963 [1:08:57<105:26:01, 10.09s/it]
  1%|          | 360/37963 [1:09:07<105:41:13, 10.12s/it]
                                                         
{'loss': '0.2002', 'grad_norm': '10.04', 'learning_rate': '6.304e-06', 'epoch': '0.009483'}

  1%|          | 360/37963 [1:09:07<105:41:13, 10.12s/it]
  1%|          | 361/37963 [1:09:17<105:42:58, 10.12s/it]
  1%|          | 362/37963 [1:09:28<106:09:29, 10.16s/it]
  1%|          | 363/37963 [1:09:38<106:01:16, 10.15s/it]
  1%|          | 364/37963 [1:09:48<105:39:55, 10.12s/it]
  1%|          | 365/37963 [1:09:58<105:58:26, 10.15s/it]
  1%|          | 366/37963 [1:10:08<106:10:39, 10.17s/it]
  1%|          | 367/37963 [1:10:18<106:34:19, 10.20s/it]
  1%|          | 368/37963 [1:10:28<105:56:26, 10.14s/it]
  1%|          | 369/37963 [1:10:39<105:48:11, 10.13s/it]
  1%|          | 370/37963 [1:10:49<105:38:33, 10.12s/it]
                                                         
{'loss': '0.2048', 'grad_norm': '7.231', 'learning_rate': '6.479e-06', 'epoch': '0.009746'}

  1%|          | 370/37963 [1:10:49<105:38:33, 10.12s/it]
  1%|          | 371/37963 [1:10:59<105:50:50, 10.14s/it]
  1%|          | 372/37963 [1:11:09<105:52:03, 10.14s/it]
  1%|          | 373/37963 [1:11:19<105:58:41, 10.15s/it]
  1%|          | 374/37963 [1:11:29<104:36:56, 10.02s/it]
  1%|          | 375/37963 [1:11:39<105:04:00, 10.06s/it]
  1%|          | 376/37963 [1:11:59<136:18:28, 13.06s/it]
  1%|          | 377/37963 [1:12:09<127:28:02, 12.21s/it]
  1%|          | 378/37963 [1:12:20<121:11:14, 11.61s/it]
  1%|          | 379/37963 [1:12:36<136:32:35, 13.08s/it]
  1%|          | 380/37963 [1:12:53<148:12:37, 14.20s/it]
                                                         
{'loss': '0.2054', 'grad_norm': '5.984', 'learning_rate': '6.655e-06', 'epoch': '0.01001'}

  1%|          | 380/37963 [1:12:53<148:12:37, 14.20s/it]
  1%|          | 381/37963 [1:13:09<155:38:19, 14.91s/it]
  1%|          | 382/37963 [1:13:32<181:07:32, 17.35s/it]
  1%|          | 383/37963 [1:13:43<158:44:59, 15.21s/it]
  1%|          | 384/37963 [1:13:59<163:32:55, 15.67s/it]
  1%|          | 385/37963 [1:14:10<146:14:58, 14.01s/it]
  1%|          | 386/37963 [1:14:26<153:26:47, 14.70s/it]
  1%|          | 387/37963 [1:14:36<138:30:39, 13.27s/it]
  1%|          | 388/37963 [1:14:46<127:33:09, 12.22s/it]
  1%|          | 389/37963 [1:14:56<120:56:02, 11.59s/it]
  1%|          | 390/37963 [1:15:06<116:30:24, 11.16s/it]
                                                         
{'loss': '0.1989', 'grad_norm': '12.45', 'learning_rate': '6.831e-06', 'epoch': '0.01027'}

  1%|          | 390/37963 [1:15:06<116:30:24, 11.16s/it]
  1%|          | 391/37963 [1:15:16<113:28:30, 10.87s/it]
  1%|          | 392/37963 [1:15:26<111:10:23, 10.65s/it]
  1%|          | 393/37963 [1:15:36<109:29:08, 10.49s/it]
  1%|          | 394/37963 [1:15:46<105:40:08, 10.13s/it]
  1%|          | 395/37963 [1:15:56<106:03:34, 10.16s/it]
  1%|          | 396/37963 [1:16:06<105:16:30, 10.09s/it]
  1%|          | 397/37963 [1:16:16<105:41:23, 10.13s/it]
  1%|          | 398/37963 [1:16:26<106:11:25, 10.18s/it]
  1%|          | 399/37963 [1:16:36<105:42:11, 10.13s/it]
  1%|          | 400/37963 [1:16:46<105:57:56, 10.16s/it]
                                                         
{'loss': '0.1954', 'grad_norm': '6.469', 'learning_rate': '7.006e-06', 'epoch': '0.01054'}

  1%|          | 400/37963 [1:16:46<105:57:56, 10.16s/it]
  1%|          | 401/37963 [1:16:57<106:00:25, 10.16s/it]
  1%|          | 402/37963 [1:17:06<104:53:12, 10.05s/it]
  1%|          | 403/37963 [1:17:16<103:11:13,  9.89s/it]
  1%|          | 404/37963 [1:17:26<103:10:40,  9.89s/it]
  1%|          | 405/37963 [1:17:36<103:08:46,  9.89s/it]
  1%|          | 406/37963 [1:17:46<104:06:37,  9.98s/it]
  1%|          | 407/37963 [1:17:56<104:40:25, 10.03s/it]
  1%|          | 408/37963 [1:18:06<104:38:23, 10.03s/it]
  1%|          | 409/37963 [1:18:16<105:19:14, 10.10s/it]
  1%|          | 410/37963 [1:18:26<104:53:48, 10.06s/it]
                                                         
{'loss': '0.1924', 'grad_norm': '4.234', 'learning_rate': '7.182e-06', 'epoch': '0.0108'}

  1%|          | 410/37963 [1:18:26<104:53:48, 10.06s/it]
  1%|          | 411/37963 [1:18:37<105:21:49, 10.10s/it]
  1%|          | 412/37963 [1:18:47<105:53:47, 10.15s/it]
  1%|          | 413/37963 [1:18:57<106:04:20, 10.17s/it]
  1%|          | 414/37963 [1:19:07<106:08:34, 10.18s/it]
  1%|          | 415/37963 [1:19:17<106:14:18, 10.19s/it]
  1%|          | 416/37963 [1:19:28<106:15:46, 10.19s/it]
  1%|          | 417/37963 [1:19:37<104:09:34,  9.99s/it]
  1%|          | 418/37963 [1:19:47<103:59:50,  9.97s/it]
  1%|          | 419/37963 [1:19:57<104:49:47, 10.05s/it]
  1%|          | 420/37963 [1:20:07<105:01:27, 10.07s/it]
                                                         
{'loss': '0.1975', 'grad_norm': '7.164', 'learning_rate': '7.357e-06', 'epoch': '0.01106'}

  1%|          | 420/37963 [1:20:07<105:01:27, 10.07s/it]
  1%|          | 421/37963 [1:20:17<104:25:54, 10.01s/it]
  1%|          | 422/37963 [1:20:27<102:33:35,  9.84s/it]
  1%|          | 423/37963 [1:20:37<103:53:31,  9.96s/it]
  1%|          | 424/37963 [1:20:57<135:32:50, 13.00s/it]
  1%|          | 425/37963 [1:21:07<126:30:48, 12.13s/it]
  1%|          | 426/37963 [1:21:17<120:01:40, 11.51s/it]
  1%|          | 427/37963 [1:21:33<134:45:42, 12.92s/it]
  1%|          | 428/37963 [1:21:57<166:31:55, 15.97s/it]
  1%|          | 429/37963 [1:22:20<189:00:11, 18.13s/it]
  1%|          | 430/37963 [1:22:30<163:46:10, 15.71s/it]
                                                         
{'loss': '0.1802', 'grad_norm': '11.31', 'learning_rate': '7.533e-06', 'epoch': '0.01133'}

  1%|          | 430/37963 [1:22:30<163:46:10, 15.71s/it]
  1%|          | 431/37963 [1:22:40<146:23:26, 14.04s/it]
  1%|          | 432/37963 [1:22:56<153:47:40, 14.75s/it]
  1%|          | 433/37963 [1:23:07<139:51:30, 13.42s/it]
  1%|          | 434/37963 [1:23:23<150:01:49, 14.39s/it]
  1%|          | 435/37963 [1:23:34<137:04:12, 13.15s/it]
  1%|          | 436/37963 [1:23:43<126:08:41, 12.10s/it]
  1%|          | 437/37963 [1:23:53<118:54:52, 11.41s/it]
  1%|          | 438/37963 [1:24:03<114:56:26, 11.03s/it]
  1%|          | 439/37963 [1:24:13<112:13:34, 10.77s/it]
  1%|          | 440/37963 [1:24:23<109:47:34, 10.53s/it]
                                                         
{'loss': '0.1882', 'grad_norm': '4.745', 'learning_rate': '7.709e-06', 'epoch': '0.01159'}

  1%|          | 440/37963 [1:24:23<109:47:34, 10.53s/it]
  1%|          | 441/37963 [1:24:34<109:01:22, 10.46s/it]
  1%|          | 442/37963 [1:24:44<108:53:53, 10.45s/it]
  1%|          | 443/37963 [1:24:54<108:14:02, 10.38s/it]
  1%|          | 444/37963 [1:25:04<106:45:38, 10.24s/it]
  1%|          | 445/37963 [1:25:14<106:25:40, 10.21s/it]
  1%|          | 446/37963 [1:25:24<105:30:28, 10.12s/it]
  1%|          | 447/37963 [1:25:34<104:12:13, 10.00s/it]
  1%|          | 448/37963 [1:25:44<104:40:24, 10.04s/it]
  1%|          | 449/37963 [1:25:54<105:06:14, 10.09s/it]
  1%|          | 450/37963 [1:26:04<105:37:55, 10.14s/it]
                                                         
{'loss': '0.1948', 'grad_norm': '7.333', 'learning_rate': '7.884e-06', 'epoch': '0.01185'}

  1%|          | 450/37963 [1:26:04<105:37:55, 10.14s/it]
  1%|          | 451/37963 [1:26:15<105:20:37, 10.11s/it]
  1%|          | 452/37963 [1:26:25<105:48:33, 10.15s/it]
  1%|          | 453/37963 [1:26:35<105:06:57, 10.09s/it]
  1%|          | 454/37963 [1:26:45<105:22:56, 10.11s/it]
  1%|          | 455/37963 [1:26:55<105:51:16, 10.16s/it]
  1%|          | 456/37963 [1:27:05<106:09:55, 10.19s/it]
  1%|          | 457/37963 [1:27:15<104:59:35, 10.08s/it]
  1%|          | 458/37963 [1:27:25<105:07:18, 10.09s/it]
  1%|          | 459/37963 [1:27:35<103:27:54,  9.93s/it]
  1%|          | 460/37963 [1:27:45<103:39:47,  9.95s/it]
                                                         
{'loss': '0.1923', 'grad_norm': '8.321', 'learning_rate': '8.06e-06', 'epoch': '0.01212'}

  1%|          | 460/37963 [1:27:45<103:39:47,  9.95s/it]
  1%|          | 461/37963 [1:27:55<104:32:20, 10.04s/it]
  1%|          | 462/37963 [1:28:05<105:08:13, 10.09s/it]
  1%|          | 463/37963 [1:28:16<105:16:56, 10.11s/it]
  1%|          | 464/37963 [1:28:26<106:13:02, 10.20s/it]
  1%|          | 465/37963 [1:28:36<106:29:11, 10.22s/it]
  1%|          | 466/37963 [1:28:46<105:39:06, 10.14s/it]
  1%|          | 467/37963 [1:28:56<104:50:40, 10.07s/it]
  1%|          | 468/37963 [1:29:06<105:48:18, 10.16s/it]
  1%|          | 469/37963 [1:29:16<105:14:47, 10.11s/it]
  1%|          | 470/37963 [1:29:36<135:33:54, 13.02s/it]
                                                         
{'loss': '0.1802', 'grad_norm': '5.623', 'learning_rate': '8.235e-06', 'epoch': '0.01238'}

  1%|          | 470/37963 [1:29:36<135:33:54, 13.02s/it]
  1%|          | 471/37963 [1:29:46<126:46:29, 12.17s/it]
  1%|          | 472/37963 [1:29:56<119:28:38, 11.47s/it]
  1%|          | 473/37963 [1:30:06<115:32:28, 11.09s/it]
  1%|          | 474/37963 [1:30:23<133:21:19, 12.81s/it]
  1%|▏         | 475/37963 [1:30:33<125:13:02, 12.02s/it]
  1%|▏         | 476/37963 [1:30:50<138:55:05, 13.34s/it]
  1%|▏         | 477/37963 [1:31:06<148:52:21, 14.30s/it]
  1%|▏         | 478/37963 [1:31:16<135:21:44, 13.00s/it]
  1%|▏         | 479/37963 [1:31:40<168:11:48, 16.15s/it]
  1%|▏         | 480/37963 [1:31:57<169:54:12, 16.32s/it]
                                                         
{'loss': '0.1939', 'grad_norm': '6.202', 'learning_rate': '8.411e-06', 'epoch': '0.01264'}

  1%|▏         | 480/37963 [1:31:57<169:54:12, 16.32s/it]
  1%|▏         | 481/37963 [1:32:13<171:09:56, 16.44s/it]
  1%|▏         | 482/37963 [1:32:24<152:01:39, 14.60s/it]
  1%|▏         | 483/37963 [1:32:34<137:34:34, 13.21s/it]
  1%|▏         | 484/37963 [1:32:44<127:56:23, 12.29s/it]
  1%|▏         | 485/37963 [1:32:54<121:06:22, 11.63s/it]
  1%|▏         | 486/37963 [1:33:04<115:40:28, 11.11s/it]
  1%|▏         | 487/37963 [1:33:14<111:41:11, 10.73s/it]
  1%|▏         | 488/37963 [1:33:24<109:34:37, 10.53s/it]
  1%|▏         | 489/37963 [1:33:34<108:35:18, 10.43s/it]
  1%|▏         | 490/37963 [1:33:44<107:59:12, 10.37s/it]
                                                         
{'loss': '0.194', 'grad_norm': '7.933', 'learning_rate': '8.586e-06', 'epoch': '0.01291'}

  1%|▏         | 490/37963 [1:33:44<107:59:12, 10.37s/it]
  1%|▏         | 491/37963 [1:33:54<105:37:42, 10.15s/it]
  1%|▏         | 492/37963 [1:34:04<104:57:38, 10.08s/it]
  1%|▏         | 493/37963 [1:34:14<104:35:03, 10.05s/it]
  1%|▏         | 494/37963 [1:34:24<105:19:02, 10.12s/it]
  1%|▏         | 495/37963 [1:34:34<105:03:59, 10.10s/it]
  1%|▏         | 496/37963 [1:34:44<104:32:34, 10.04s/it]
  1%|▏         | 497/37963 [1:34:54<104:34:00, 10.05s/it]
  1%|▏         | 498/37963 [1:35:04<105:20:38, 10.12s/it]
  1%|▏         | 499/37963 [1:35:14<105:26:20, 10.13s/it]
  1%|▏         | 500/37963 [1:35:24<105:27:43, 10.13s/it]
                                                         
{'loss': '0.2096', 'grad_norm': '13.89', 'learning_rate': '8.762e-06', 'epoch': '0.01317'}

  1%|▏         | 500/37963 [1:35:24<105:27:43, 10.13s/it]
  1%|▏         | 501/37963 [1:35:35<105:34:58, 10.15s/it]
  1%|▏         | 502/37963 [1:35:45<105:24:40, 10.13s/it]
  1%|▏         | 503/37963 [1:35:55<105:44:33, 10.16s/it]
  1%|▏         | 504/37963 [1:36:05<105:36:31, 10.15s/it]
  1%|▏         | 505/37963 [1:36:15<105:54:38, 10.18s/it]
  1%|▏         | 506/37963 [1:36:26<105:58:08, 10.18s/it]
  1%|▏         | 507/37963 [1:36:36<105:45:45, 10.17s/it]
  1%|▏         | 508/37963 [1:36:46<106:12:26, 10.21s/it]
  1%|▏         | 509/37963 [1:36:56<105:54:13, 10.18s/it]
  1%|▏         | 510/37963 [1:37:06<105:56:23, 10.18s/it]
                                                         
{'loss': '0.2099', 'grad_norm': '7.63', 'learning_rate': '8.938e-06', 'epoch': '0.01343'}

  1%|▏         | 510/37963 [1:37:06<105:56:23, 10.18s/it]
  1%|▏         | 511/37963 [1:37:16<105:45:32, 10.17s/it]
  1%|▏         | 512/37963 [1:37:27<105:35:48, 10.15s/it]
  1%|▏         | 513/37963 [1:37:37<105:14:53, 10.12s/it]
  1%|▏         | 514/37963 [1:37:47<105:43:48, 10.16s/it]
  1%|▏         | 515/37963 [1:37:57<106:21:12, 10.22s/it]
  1%|▏         | 516/37963 [1:38:07<106:13:21, 10.21s/it]
  1%|▏         | 517/37963 [1:38:18<106:04:49, 10.20s/it]
  1%|▏         | 518/37963 [1:38:38<138:02:46, 13.27s/it]
  1%|▏         | 519/37963 [1:38:48<128:43:02, 12.38s/it]
  1%|▏         | 520/37963 [1:38:59<122:02:47, 11.73s/it]
                                                         
{'loss': '0.2051', 'grad_norm': '10.69', 'learning_rate': '9.113e-06', 'epoch': '0.0137'}

  1%|▏         | 520/37963 [1:38:59<122:02:47, 11.73s/it]
  1%|▏         | 521/37963 [1:39:15<136:52:02, 13.16s/it]
  1%|▏         | 522/37963 [1:39:31<145:46:36, 14.02s/it]
  1%|▏         | 523/37963 [1:39:41<132:20:46, 12.73s/it]
  1%|▏         | 524/37963 [1:39:51<123:51:34, 11.91s/it]
  1%|▏         | 525/37963 [1:40:07<137:33:33, 13.23s/it]
  1%|▏         | 526/37963 [1:40:30<167:58:25, 16.15s/it]
  1%|▏         | 527/37963 [1:40:40<149:22:27, 14.36s/it]
  1%|▏         | 528/37963 [1:40:57<156:38:17, 15.06s/it]
  1%|▏         | 529/37963 [1:41:07<141:25:27, 13.60s/it]
  1%|▏         | 530/37963 [1:41:17<130:44:04, 12.57s/it]
                                                         
{'loss': '0.1982', 'grad_norm': '5.669', 'learning_rate': '9.289e-06', 'epoch': '0.01396'}

  1%|▏         | 530/37963 [1:41:17<130:44:04, 12.57s/it]
  1%|▏         | 531/37963 [1:41:27<123:05:30, 11.84s/it]
  1%|▏         | 532/37963 [1:41:44<137:40:27, 13.24s/it]
  1%|▏         | 533/37963 [1:41:54<128:08:31, 12.32s/it]
  1%|▏         | 534/37963 [1:42:04<121:46:31, 11.71s/it]
  1%|▏         | 535/37963 [1:42:15<117:04:41, 11.26s/it]
  1%|▏         | 536/37963 [1:42:25<113:56:14, 10.96s/it]
  1%|▏         | 537/37963 [1:42:35<111:41:06, 10.74s/it]
  1%|▏         | 538/37963 [1:42:45<109:42:09, 10.55s/it]
  1%|▏         | 539/37963 [1:42:55<106:46:00, 10.27s/it]
  1%|▏         | 540/37963 [1:43:05<106:41:11, 10.26s/it]
                                                         
{'loss': '0.198', 'grad_norm': '11.47', 'learning_rate': '9.464e-06', 'epoch': '0.01422'}

  1%|▏         | 540/37963 [1:43:05<106:41:11, 10.26s/it]
  1%|▏         | 541/37963 [1:43:15<106:24:15, 10.24s/it]
  1%|▏         | 542/37963 [1:43:25<106:06:53, 10.21s/it]
  1%|▏         | 543/37963 [1:43:36<105:53:28, 10.19s/it]
  1%|▏         | 544/37963 [1:43:46<106:04:57, 10.21s/it]
  1%|▏         | 545/37963 [1:43:56<105:57:41, 10.19s/it]
  1%|▏         | 546/37963 [1:44:06<106:12:18, 10.22s/it]
  1%|▏         | 547/37963 [1:44:16<106:03:21, 10.20s/it]
  1%|▏         | 548/37963 [1:44:27<106:07:20, 10.21s/it]
  1%|▏         | 549/37963 [1:44:37<106:01:52, 10.20s/it]
  1%|▏         | 550/37963 [1:44:47<106:10:12, 10.22s/it]
                                                         
{'loss': '0.1893', 'grad_norm': '2.757', 'learning_rate': '9.64e-06', 'epoch': '0.01449'}

  1%|▏         | 550/37963 [1:44:47<106:10:12, 10.22s/it]
  1%|▏         | 551/37963 [1:44:57<105:58:18, 10.20s/it]
  1%|▏         | 552/37963 [1:45:07<105:46:43, 10.18s/it]
  1%|▏         | 553/37963 [1:45:18<106:23:17, 10.24s/it]
  1%|▏         | 554/37963 [1:45:28<105:57:38, 10.20s/it]
  1%|▏         | 555/37963 [1:45:38<105:10:36, 10.12s/it]
  1%|▏         | 556/37963 [1:45:48<106:03:53, 10.21s/it]
  1%|▏         | 557/37963 [1:45:58<105:09:09, 10.12s/it]
  1%|▏         | 558/37963 [1:46:08<105:13:00, 10.13s/it]
  1%|▏         | 559/37963 [1:46:18<105:24:31, 10.15s/it]
  1%|▏         | 560/37963 [1:46:29<105:55:15, 10.19s/it]
                                                         
{'loss': '0.1861', 'grad_norm': '5.638', 'learning_rate': '9.816e-06', 'epoch': '0.01475'}

  1%|▏         | 560/37963 [1:46:29<105:55:15, 10.19s/it]
  1%|▏         | 561/37963 [1:46:39<105:54:51, 10.19s/it]
  1%|▏         | 562/37963 [1:46:49<105:59:41, 10.20s/it]
  1%|▏         | 563/37963 [1:46:59<105:39:13, 10.17s/it]
  1%|▏         | 564/37963 [1:47:09<104:29:44, 10.06s/it]
  1%|▏         | 565/37963 [1:47:19<104:41:30, 10.08s/it]
  1%|▏         | 566/37963 [1:47:39<134:33:06, 12.95s/it]
  1%|▏         | 567/37963 [1:47:48<124:20:54, 11.97s/it]
  1%|▏         | 568/37963 [1:47:59<118:58:12, 11.45s/it]
  1%|▏         | 569/37963 [1:48:18<144:44:08, 13.93s/it]
  2%|▏         | 570/37963 [1:48:29<133:05:10, 12.81s/it]
                                                         
{'loss': '0.1958', 'grad_norm': '5.248', 'learning_rate': '9.991e-06', 'epoch': '0.01501'}

  2%|▏         | 570/37963 [1:48:29<133:05:10, 12.81s/it]
  2%|▏         | 571/37963 [1:48:46<146:24:09, 14.10s/it]
  2%|▏         | 572/37963 [1:49:03<154:55:40, 14.92s/it]
  2%|▏         | 573/37963 [1:49:13<140:49:35, 13.56s/it]
  2%|▏         | 574/37963 [1:49:23<129:42:27, 12.49s/it]
  2%|▏         | 575/37963 [1:49:46<162:36:31, 15.66s/it]
  2%|▏         | 576/37963 [1:50:03<166:27:37, 16.03s/it]
  2%|▏         | 577/37963 [1:50:13<148:19:59, 14.28s/it]
  2%|▏         | 578/37963 [1:50:30<155:14:44, 14.95s/it]
  2%|▏         | 579/37963 [1:50:40<140:23:19, 13.52s/it]
  2%|▏         | 580/37963 [1:50:50<129:37:46, 12.48s/it]
                                                         
{'loss': '0.1965', 'grad_norm': '6.268', 'learning_rate': '1.017e-05', 'epoch': '0.01528'}

  2%|▏         | 580/37963 [1:50:50<129:37:46, 12.48s/it]
  2%|▏         | 581/37963 [1:51:00<121:22:24, 11.69s/it]
  2%|▏         | 582/37963 [1:51:10<116:42:22, 11.24s/it]
  2%|▏         | 583/37963 [1:51:20<113:24:57, 10.92s/it]
  2%|▏         | 584/37963 [1:51:30<110:54:29, 10.68s/it]
  2%|▏         | 585/37963 [1:51:40<109:07:41, 10.51s/it]
  2%|▏         | 586/37963 [1:51:51<108:25:28, 10.44s/it]
  2%|▏         | 587/37963 [1:52:01<107:35:35, 10.36s/it]
  2%|▏         | 588/37963 [1:52:11<106:00:18, 10.21s/it]
  2%|▏         | 589/37963 [1:52:21<105:00:23, 10.11s/it]
  2%|▏         | 590/37963 [1:52:31<105:01:43, 10.12s/it]
                                                         
{'loss': '0.1817', 'grad_norm': '7.422', 'learning_rate': '1.034e-05', 'epoch': '0.01554'}

  2%|▏         | 590/37963 [1:52:31<105:01:43, 10.12s/it]
  2%|▏         | 591/37963 [1:52:41<105:11:29, 10.13s/it]
  2%|▏         | 592/37963 [1:52:51<105:31:11, 10.16s/it]
  2%|▏         | 593/37963 [1:53:01<105:44:41, 10.19s/it]
  2%|▏         | 594/37963 [1:53:11<105:28:50, 10.16s/it]
  2%|▏         | 595/37963 [1:53:22<105:34:11, 10.17s/it]
  2%|▏         | 596/37963 [1:53:31<104:32:02, 10.07s/it]
  2%|▏         | 597/37963 [1:53:42<104:50:40, 10.10s/it]
  2%|▏         | 598/37963 [1:53:52<104:56:00, 10.11s/it]
  2%|▏         | 599/37963 [1:54:02<105:32:27, 10.17s/it]
  2%|▏         | 600/37963 [1:54:12<104:33:30, 10.07s/it]
                                                         
{'loss': '0.1906', 'grad_norm': '9.654', 'learning_rate': '1.052e-05', 'epoch': '0.0158'}

  2%|▏         | 600/37963 [1:54:12<104:33:30, 10.07s/it]
  2%|▏         | 601/37963 [1:54:22<104:24:22, 10.06s/it]
  2%|▏         | 602/37963 [1:54:32<104:01:10, 10.02s/it]
  2%|▏         | 603/37963 [1:54:42<103:42:30,  9.99s/it]
  2%|▏         | 604/37963 [1:54:52<103:36:09,  9.98s/it]
  2%|▏         | 605/37963 [1:55:02<104:11:16, 10.04s/it]
  2%|▏         | 606/37963 [1:55:12<104:43:19, 10.09s/it]
  2%|▏         | 607/37963 [1:55:22<105:17:08, 10.15s/it]
  2%|▏         | 608/37963 [1:55:33<105:13:43, 10.14s/it]
  2%|▏         | 609/37963 [1:55:43<105:07:01, 10.13s/it]
  2%|▏         | 610/37963 [1:55:53<105:12:15, 10.14s/it]
                                                         
{'loss': '0.1941', 'grad_norm': '6.174', 'learning_rate': '1.069e-05', 'epoch': '0.01607'}

  2%|▏         | 610/37963 [1:55:53<105:12:15, 10.14s/it]
  2%|▏         | 611/37963 [1:56:02<103:55:19, 10.02s/it]
  2%|▏         | 612/37963 [1:56:13<104:20:11, 10.06s/it]
  2%|▏         | 613/37963 [1:56:30<126:17:46, 12.17s/it]
  2%|▏         | 614/37963 [1:56:40<120:18:38, 11.60s/it]
  2%|▏         | 615/37963 [1:56:50<116:08:32, 11.20s/it]
  2%|▏         | 616/37963 [1:57:00<111:48:54, 10.78s/it]
  2%|▏         | 617/37963 [1:57:10<110:08:54, 10.62s/it]
  2%|▏         | 618/37963 [1:57:21<109:27:54, 10.55s/it]
  2%|▏         | 619/37963 [1:57:31<107:56:10, 10.41s/it]
  2%|▏         | 620/37963 [1:57:54<148:15:15, 14.29s/it]
                                                         
{'loss': '0.1821', 'grad_norm': '4.681', 'learning_rate': '1.087e-05', 'epoch': '0.01633'}

  2%|▏         | 620/37963 [1:57:54<148:15:15, 14.29s/it]
  2%|▏         | 621/37963 [1:58:04<135:24:07, 13.05s/it]
  2%|▏         | 622/37963 [1:58:14<126:19:52, 12.18s/it]
  2%|▏         | 623/37963 [1:58:37<160:03:51, 15.43s/it]
  2%|▏         | 624/37963 [1:58:48<143:33:35, 13.84s/it]
  2%|▏         | 625/37963 [1:59:04<151:58:02, 14.65s/it]
  2%|▏         | 626/37963 [1:59:14<137:54:45, 13.30s/it]
  2%|▏         | 627/37963 [1:59:31<147:55:12, 14.26s/it]
  2%|▏         | 628/37963 [1:59:41<135:15:59, 13.04s/it]
  2%|▏         | 629/37963 [1:59:51<126:42:16, 12.22s/it]
  2%|▏         | 630/37963 [2:00:01<120:11:38, 11.59s/it]
                                                         
{'loss': '0.2059', 'grad_norm': '10.34', 'learning_rate': '1.104e-05', 'epoch': '0.0166'}

  2%|▏         | 630/37963 [2:00:01<120:11:38, 11.59s/it]
  2%|▏         | 631/37963 [2:00:11<115:01:39, 11.09s/it]
  2%|▏         | 632/37963 [2:00:21<112:02:01, 10.80s/it]
  2%|▏         | 633/37963 [2:00:31<109:12:38, 10.53s/it]
  2%|▏         | 634/37963 [2:00:41<107:50:31, 10.40s/it]
  2%|▏         | 635/37963 [2:00:52<107:23:09, 10.36s/it]
  2%|▏         | 636/37963 [2:01:02<106:57:38, 10.32s/it]
  2%|▏         | 637/37963 [2:01:12<106:13:39, 10.25s/it]
  2%|▏         | 638/37963 [2:01:22<106:22:55, 10.26s/it]
  2%|▏         | 639/37963 [2:01:33<106:35:28, 10.28s/it]
  2%|▏         | 640/37963 [2:01:43<106:04:14, 10.23s/it]
                                                         
{'loss': '0.1842', 'grad_norm': '7.087', 'learning_rate': '1.122e-05', 'epoch': '0.01686'}

  2%|▏         | 640/37963 [2:01:43<106:04:14, 10.23s/it]
  2%|▏         | 641/37963 [2:01:53<106:04:08, 10.23s/it]
  2%|▏         | 642/37963 [2:02:03<105:49:00, 10.21s/it]
  2%|▏         | 643/37963 [2:02:13<106:10:55, 10.24s/it]
  2%|▏         | 644/37963 [2:02:24<106:07:51, 10.24s/it]
  2%|▏         | 645/37963 [2:02:34<105:59:06, 10.22s/it]
  2%|▏         | 646/37963 [2:02:44<105:45:29, 10.20s/it]
  2%|▏         | 647/37963 [2:02:54<106:02:28, 10.23s/it]
  2%|▏         | 648/37963 [2:03:05<105:58:48, 10.22s/it]
  2%|▏         | 649/37963 [2:03:15<105:50:22, 10.21s/it]
  2%|▏         | 650/37963 [2:03:25<105:38:12, 10.19s/it]
                                                         
{'loss': '0.1932', 'grad_norm': '6.966', 'learning_rate': '1.14e-05', 'epoch': '0.01712'}

  2%|▏         | 650/37963 [2:03:25<105:38:12, 10.19s/it]
  2%|▏         | 651/37963 [2:03:35<105:50:51, 10.21s/it]
  2%|▏         | 652/37963 [2:03:45<105:38:09, 10.19s/it]
  2%|▏         | 653/37963 [2:03:55<104:18:44, 10.06s/it]
  2%|▏         | 654/37963 [2:04:05<104:02:42, 10.04s/it]
  2%|▏         | 655/37963 [2:04:15<104:22:28, 10.07s/it]
  2%|▏         | 656/37963 [2:04:25<104:31:48, 10.09s/it]
  2%|▏         | 657/37963 [2:04:35<104:30:08, 10.08s/it]
  2%|▏         | 658/37963 [2:04:46<104:51:12, 10.12s/it]
  2%|▏         | 659/37963 [2:04:56<105:19:38, 10.16s/it]
  2%|▏         | 660/37963 [2:05:06<105:27:29, 10.18s/it]
                                                         
{'loss': '0.2149', 'grad_norm': '5.053', 'learning_rate': '1.157e-05', 'epoch': '0.01739'}

  2%|▏         | 660/37963 [2:05:06<105:27:29, 10.18s/it]
  2%|▏         | 661/37963 [2:05:16<104:22:26, 10.07s/it]
  2%|▏         | 662/37963 [2:05:26<104:49:32, 10.12s/it]
  2%|▏         | 663/37963 [2:05:36<104:50:11, 10.12s/it]
  2%|▏         | 664/37963 [2:05:53<124:35:44, 12.03s/it]
  2%|▏         | 665/37963 [2:06:03<119:03:36, 11.49s/it]
  2%|▏         | 666/37963 [2:06:19<134:37:52, 12.99s/it]
  2%|▏         | 667/37963 [2:06:36<144:19:06, 13.93s/it]
  2%|▏         | 668/37963 [2:06:52<152:32:13, 14.72s/it]
  2%|▏         | 669/37963 [2:07:02<138:31:14, 13.37s/it]
  2%|▏         | 670/37963 [2:07:12<127:58:06, 12.35s/it]
                                                         
{'loss': '0.1974', 'grad_norm': '5.832', 'learning_rate': '1.175e-05', 'epoch': '0.01765'}

  2%|▏         | 670/37963 [2:07:12<127:58:06, 12.35s/it]
  2%|▏         | 671/37963 [2:07:29<141:12:04, 13.63s/it]
  2%|▏         | 672/37963 [2:07:46<150:35:05, 14.54s/it]
  2%|▏         | 673/37963 [2:08:02<156:36:19, 15.12s/it]
  2%|▏         | 674/37963 [2:08:12<141:16:37, 13.64s/it]
  2%|▏         | 675/37963 [2:08:29<150:18:03, 14.51s/it]
  2%|▏         | 676/37963 [2:08:39<137:14:54, 13.25s/it]
  2%|▏         | 677/37963 [2:08:49<126:40:10, 12.23s/it]
  2%|▏         | 678/37963 [2:08:59<120:17:18, 11.61s/it]
  2%|▏         | 679/37963 [2:09:09<115:34:50, 11.16s/it]
  2%|▏         | 680/37963 [2:09:19<112:36:38, 10.87s/it]
                                                         
{'loss': '0.1879', 'grad_norm': '4.499', 'learning_rate': '1.192e-05', 'epoch': '0.01791'}

  2%|▏         | 680/37963 [2:09:19<112:36:38, 10.87s/it]
  2%|▏         | 681/37963 [2:09:29<109:56:50, 10.62s/it]
  2%|▏         | 682/37963 [2:09:40<108:24:14, 10.47s/it]
  2%|▏         | 683/37963 [2:09:50<106:44:11, 10.31s/it]
  2%|▏         | 684/37963 [2:10:00<107:27:20, 10.38s/it]
  2%|▏         | 685/37963 [2:10:10<106:36:20, 10.30s/it]
  2%|▏         | 686/37963 [2:10:20<106:14:12, 10.26s/it]
  2%|▏         | 687/37963 [2:10:30<105:01:08, 10.14s/it]
  2%|▏         | 688/37963 [2:10:40<105:25:32, 10.18s/it]
  2%|▏         | 689/37963 [2:10:50<104:39:33, 10.11s/it]
  2%|▏         | 690/37963 [2:11:01<104:50:45, 10.13s/it]
                                                         
{'loss': '0.2028', 'grad_norm': '7.64', 'learning_rate': '1.21e-05', 'epoch': '0.01818'}

  2%|▏         | 690/37963 [2:11:01<104:50:45, 10.13s/it]
  2%|▏         | 691/37963 [2:11:11<105:19:28, 10.17s/it]
  2%|▏         | 692/37963 [2:11:21<105:20:10, 10.17s/it]
  2%|▏         | 693/37963 [2:11:31<105:14:28, 10.17s/it]
  2%|▏         | 694/37963 [2:11:41<105:07:47, 10.16s/it]
  2%|▏         | 695/37963 [2:11:51<105:10:18, 10.16s/it]
  2%|▏         | 696/37963 [2:12:02<105:03:40, 10.15s/it]
  2%|▏         | 697/37963 [2:12:11<103:51:21, 10.03s/it]
  2%|▏         | 698/37963 [2:12:21<104:08:52, 10.06s/it]
  2%|▏         | 699/37963 [2:12:32<104:12:28, 10.07s/it]
  2%|▏         | 700/37963 [2:12:42<104:30:48, 10.10s/it]
                                                         
{'loss': '0.1975', 'grad_norm': '6.862', 'learning_rate': '1.227e-05', 'epoch': '0.01844'}

  2%|▏         | 700/37963 [2:12:42<104:30:48, 10.10s/it]
  2%|▏         | 701/37963 [2:12:52<104:44:27, 10.12s/it]
  2%|▏         | 702/37963 [2:13:02<105:12:36, 10.16s/it]
  2%|▏         | 703/37963 [2:13:12<105:18:44, 10.18s/it]
  2%|▏         | 704/37963 [2:13:22<105:04:40, 10.15s/it]
  2%|▏         | 705/37963 [2:13:33<104:57:11, 10.14s/it]
  2%|▏         | 706/37963 [2:13:43<104:26:32, 10.09s/it]
  2%|▏         | 707/37963 [2:13:53<104:36:14, 10.11s/it]
  2%|▏         | 708/37963 [2:14:03<104:47:10, 10.13s/it]
  2%|▏         | 709/37963 [2:14:13<104:55:56, 10.14s/it]
  2%|▏         | 710/37963 [2:14:23<104:56:58, 10.14s/it]
                                                         
{'loss': '0.1822', 'grad_norm': '7.665', 'learning_rate': '1.245e-05', 'epoch': '0.0187'}

  2%|▏         | 710/37963 [2:14:23<104:56:58, 10.14s/it]
  2%|▏         | 711/37963 [2:14:33<104:51:30, 10.13s/it]
  2%|▏         | 712/37963 [2:14:43<102:51:39,  9.94s/it]
  2%|▏         | 713/37963 [2:14:59<123:24:06, 11.93s/it]
  2%|▏         | 714/37963 [2:15:16<137:57:26, 13.33s/it]
  2%|▏         | 715/37963 [2:15:39<167:29:00, 16.19s/it]
  2%|▏         | 716/37963 [2:15:49<149:04:50, 14.41s/it]
  2%|▏         | 717/37963 [2:15:59<136:03:24, 13.15s/it]
  2%|▏         | 718/37963 [2:16:09<126:51:48, 12.26s/it]
  2%|▏         | 719/37963 [2:16:20<120:30:14, 11.65s/it]
  2%|▏         | 720/37963 [2:16:43<156:45:06, 15.15s/it]
                                                         
{'loss': '0.1875', 'grad_norm': '7.987', 'learning_rate': '1.263e-05', 'epoch': '0.01897'}

  2%|▏         | 720/37963 [2:16:43<156:45:06, 15.15s/it]
  2%|▏         | 721/37963 [2:16:53<140:59:58, 13.63s/it]
  2%|▏         | 722/37963 [2:17:10<150:27:35, 14.54s/it]
  2%|▏         | 723/37963 [2:17:26<156:03:41, 15.09s/it]
  2%|▏         | 724/37963 [2:17:36<141:09:39, 13.65s/it]
  2%|▏         | 725/37963 [2:17:46<130:00:34, 12.57s/it]
  2%|▏         | 726/37963 [2:17:57<122:18:17, 11.82s/it]
  2%|▏         | 727/37963 [2:18:07<116:40:29, 11.28s/it]
  2%|▏         | 728/37963 [2:18:17<113:01:43, 10.93s/it]
  2%|▏         | 729/37963 [2:18:27<110:35:52, 10.69s/it]
  2%|▏         | 730/37963 [2:18:37<109:11:26, 10.56s/it]
                                                         
{'loss': '0.1873', 'grad_norm': '4.064', 'learning_rate': '1.28e-05', 'epoch': '0.01923'}

  2%|▏         | 730/37963 [2:18:37<109:11:26, 10.56s/it]
  2%|▏         | 731/37963 [2:18:47<108:23:20, 10.48s/it]
  2%|▏         | 732/37963 [2:18:58<107:21:02, 10.38s/it]
  2%|▏         | 733/37963 [2:19:08<106:41:41, 10.32s/it]
  2%|▏         | 734/37963 [2:19:18<106:35:23, 10.31s/it]
  2%|▏         | 735/37963 [2:19:28<106:14:36, 10.27s/it]
  2%|▏         | 736/37963 [2:19:38<106:12:40, 10.27s/it]
  2%|▏         | 737/37963 [2:19:49<106:07:07, 10.26s/it]
  2%|▏         | 738/37963 [2:19:59<105:58:29, 10.25s/it]
  2%|▏         | 739/37963 [2:20:09<105:36:50, 10.21s/it]
  2%|▏         | 740/37963 [2:20:19<105:24:08, 10.19s/it]
                                                         
{'loss': '0.1926', 'grad_norm': '7.798', 'learning_rate': '1.298e-05', 'epoch': '0.01949'}

  2%|▏         | 740/37963 [2:20:19<105:24:08, 10.19s/it]
  2%|▏         | 741/37963 [2:20:29<105:08:07, 10.17s/it]
  2%|▏         | 742/37963 [2:20:39<105:06:37, 10.17s/it]
  2%|▏         | 743/37963 [2:20:50<104:59:53, 10.16s/it]
  2%|▏         | 744/37963 [2:21:00<104:23:20, 10.10s/it]
  2%|▏         | 745/37963 [2:21:10<104:58:04, 10.15s/it]
  2%|▏         | 746/37963 [2:21:20<104:59:27, 10.16s/it]
  2%|▏         | 747/37963 [2:21:30<104:46:57, 10.14s/it]
  2%|▏         | 748/37963 [2:21:40<104:46:42, 10.14s/it]
  2%|▏         | 749/37963 [2:21:50<104:05:55, 10.07s/it]
  2%|▏         | 750/37963 [2:22:00<103:52:50, 10.05s/it]
                                                         
{'loss': '0.2064', 'grad_norm': '6.305', 'learning_rate': '1.315e-05', 'epoch': '0.01976'}

  2%|▏         | 750/37963 [2:22:00<103:52:50, 10.05s/it]
  2%|▏         | 751/37963 [2:22:10<104:06:50, 10.07s/it]
  2%|▏         | 752/37963 [2:22:20<104:14:15, 10.08s/it]
  2%|▏         | 753/37963 [2:22:31<104:24:48, 10.10s/it]
  2%|▏         | 754/37963 [2:22:41<105:06:34, 10.17s/it]
  2%|▏         | 755/37963 [2:22:51<105:25:07, 10.20s/it]
  2%|▏         | 756/37963 [2:23:01<105:26:05, 10.20s/it]
  2%|▏         | 757/37963 [2:23:11<105:01:02, 10.16s/it]
  2%|▏         | 758/37963 [2:23:22<105:19:08, 10.19s/it]
  2%|▏         | 759/37963 [2:23:38<125:32:34, 12.15s/it]
  2%|▏         | 760/37963 [2:23:49<119:41:12, 11.58s/it]
                                                         
{'loss': '0.1951', 'grad_norm': '5.756', 'learning_rate': '1.333e-05', 'epoch': '0.02002'}

  2%|▏         | 760/37963 [2:23:49<119:41:12, 11.58s/it]
  2%|▏         | 761/37963 [2:23:59<115:34:07, 11.18s/it]
  2%|▏         | 762/37963 [2:24:15<131:06:56, 12.69s/it]
  2%|▏         | 763/37963 [2:24:25<123:35:35, 11.96s/it]
  2%|▏         | 764/37963 [2:24:42<137:32:28, 13.31s/it]
  2%|▏         | 765/37963 [2:24:52<127:44:42, 12.36s/it]
  2%|▏         | 766/37963 [2:25:09<140:50:17, 13.63s/it]
  2%|▏         | 767/37963 [2:25:19<130:09:42, 12.60s/it]
  2%|▏         | 768/37963 [2:25:29<122:58:16, 11.90s/it]
  2%|▏         | 769/37963 [2:25:45<137:04:30, 13.27s/it]
  2%|▏         | 770/37963 [2:25:56<127:20:36, 12.33s/it]
                                                         
{'loss': '0.2061', 'grad_norm': '8.321', 'learning_rate': '1.35e-05', 'epoch': '0.02028'}

  2%|▏         | 770/37963 [2:25:56<127:20:36, 12.33s/it]
  2%|▏         | 771/37963 [2:26:12<141:09:54, 13.66s/it]
  2%|▏         | 772/37963 [2:26:23<130:14:08, 12.61s/it]
  2%|▏         | 773/37963 [2:26:39<142:08:56, 13.76s/it]
  2%|▏         | 774/37963 [2:26:49<129:31:15, 12.54s/it]
  2%|▏         | 775/37963 [2:26:59<122:33:35, 11.86s/it]
  2%|▏         | 776/37963 [2:27:09<117:23:14, 11.36s/it]
  2%|▏         | 777/37963 [2:27:19<112:55:48, 10.93s/it]
  2%|▏         | 778/37963 [2:27:29<109:57:45, 10.65s/it]
  2%|▏         | 779/37963 [2:27:39<108:17:21, 10.48s/it]
  2%|▏         | 780/37963 [2:27:49<107:17:56, 10.39s/it]
                                                         
{'loss': '0.194', 'grad_norm': '3.934', 'learning_rate': '1.368e-05', 'epoch': '0.02055'}

  2%|▏         | 780/37963 [2:27:49<107:17:56, 10.39s/it]
  2%|▏         | 781/37963 [2:27:59<106:31:15, 10.31s/it]
  2%|▏         | 782/37963 [2:28:10<105:55:39, 10.26s/it]
  2%|▏         | 783/37963 [2:28:20<105:29:12, 10.21s/it]
  2%|▏         | 784/37963 [2:28:30<105:33:58, 10.22s/it]
  2%|▏         | 785/37963 [2:28:40<105:18:45, 10.20s/it]
  2%|▏         | 786/37963 [2:28:50<105:10:40, 10.18s/it]
  2%|▏         | 787/37963 [2:29:00<105:13:07, 10.19s/it]
  2%|▏         | 788/37963 [2:29:10<104:23:10, 10.11s/it]
  2%|▏         | 789/37963 [2:29:20<104:31:49, 10.12s/it]
  2%|▏         | 790/37963 [2:29:31<104:32:19, 10.12s/it]
                                                         
{'loss': '0.1836', 'grad_norm': '4.475', 'learning_rate': '1.385e-05', 'epoch': '0.02081'}

  2%|▏         | 790/37963 [2:29:31<104:32:19, 10.12s/it]
  2%|▏         | 791/37963 [2:29:41<103:59:46, 10.07s/it]
  2%|▏         | 792/37963 [2:29:51<104:39:19, 10.14s/it]
  2%|▏         | 793/37963 [2:30:01<104:34:58, 10.13s/it]
  2%|▏         | 794/37963 [2:30:11<104:42:08, 10.14s/it]
  2%|▏         | 795/37963 [2:30:21<104:13:01, 10.09s/it]
  2%|▏         | 796/37963 [2:30:31<104:22:25, 10.11s/it]
  2%|▏         | 797/37963 [2:30:41<103:00:55,  9.98s/it]
  2%|▏         | 798/37963 [2:30:51<103:45:26, 10.05s/it]
  2%|▏         | 799/37963 [2:31:01<104:01:32, 10.08s/it]
  2%|▏         | 800/37963 [2:31:11<104:07:26, 10.09s/it]
                                                         
{'loss': '0.2094', 'grad_norm': '14.47', 'learning_rate': '1.403e-05', 'epoch': '0.02107'}

  2%|▏         | 800/37963 [2:31:11<104:07:26, 10.09s/it]
  2%|▏         | 801/37963 [2:31:22<104:33:34, 10.13s/it]
  2%|▏         | 802/37963 [2:31:32<104:28:59, 10.12s/it]
  2%|▏         | 803/37963 [2:31:42<104:31:11, 10.13s/it]
  2%|▏         | 804/37963 [2:31:52<104:43:10, 10.15s/it]
  2%|▏         | 805/37963 [2:32:02<104:41:19, 10.14s/it]
  2%|▏         | 806/37963 [2:32:12<104:55:52, 10.17s/it]
  2%|▏         | 807/37963 [2:32:29<124:35:50, 12.07s/it]
  2%|▏         | 808/37963 [2:32:39<119:21:28, 11.56s/it]
  2%|▏         | 809/37963 [2:32:49<114:28:45, 11.09s/it]
  2%|▏         | 810/37963 [2:33:06<133:15:00, 12.91s/it]
                                                         
{'loss': '0.1855', 'grad_norm': '4.927', 'learning_rate': '1.421e-05', 'epoch': '0.02134'}

  2%|▏         | 810/37963 [2:33:06<133:15:00, 12.91s/it]
  2%|▏         | 811/37963 [2:33:17<124:37:19, 12.08s/it]
  2%|▏         | 812/37963 [2:33:33<138:29:41, 13.42s/it]
  2%|▏         | 813/37963 [2:33:43<128:27:52, 12.45s/it]
  2%|▏         | 814/37963 [2:33:53<120:30:24, 11.68s/it]
  2%|▏         | 815/37963 [2:34:23<175:23:27, 17.00s/it]
  2%|▏         | 816/37963 [2:34:33<154:09:27, 14.94s/it]
  2%|▏         | 817/37963 [2:34:43<138:28:01, 13.42s/it]
  2%|▏         | 818/37963 [2:34:59<146:03:15, 14.16s/it]
  2%|▏         | 819/37963 [2:35:09<133:37:31, 12.95s/it]
  2%|▏         | 820/37963 [2:35:19<125:01:21, 12.12s/it]
                                                         
{'loss': '0.1816', 'grad_norm': '4.543', 'learning_rate': '1.438e-05', 'epoch': '0.0216'}

  2%|▏         | 820/37963 [2:35:19<125:01:21, 12.12s/it]
  2%|▏         | 821/37963 [2:35:29<117:42:05, 11.41s/it]
  2%|▏         | 822/37963 [2:35:45<134:12:02, 13.01s/it]
  2%|▏         | 823/37963 [2:35:55<125:12:46, 12.14s/it]
  2%|▏         | 824/37963 [2:36:05<118:15:39, 11.46s/it]
  2%|▏         | 825/37963 [2:36:15<113:20:01, 10.99s/it]
  2%|▏         | 826/37963 [2:36:25<111:00:03, 10.76s/it]
  2%|▏         | 827/37963 [2:36:36<109:18:32, 10.60s/it]
  2%|▏         | 828/37963 [2:36:45<106:12:13, 10.30s/it]
  2%|▏         | 829/37963 [2:36:55<105:09:37, 10.19s/it]
  2%|▏         | 830/37963 [2:37:05<105:07:57, 10.19s/it]
                                                         
{'loss': '0.1923', 'grad_norm': '3.156', 'learning_rate': '1.456e-05', 'epoch': '0.02186'}

  2%|▏         | 830/37963 [2:37:05<105:07:57, 10.19s/it]
  2%|▏         | 831/37963 [2:37:15<104:02:21, 10.09s/it]
  2%|▏         | 832/37963 [2:37:25<104:01:51, 10.09s/it]
  2%|▏         | 833/37963 [2:37:36<104:22:53, 10.12s/it]
  2%|▏         | 834/37963 [2:37:46<104:33:28, 10.14s/it]
  2%|▏         | 835/37963 [2:37:56<104:41:39, 10.15s/it]
  2%|▏         | 836/37963 [2:38:06<104:08:40, 10.10s/it]
  2%|▏         | 837/37963 [2:38:16<104:20:28, 10.12s/it]
  2%|▏         | 838/37963 [2:38:26<104:43:11, 10.15s/it]
  2%|▏         | 839/37963 [2:38:36<104:41:50, 10.15s/it]
  2%|▏         | 840/37963 [2:38:47<104:38:23, 10.15s/it]
                                                         
{'loss': '0.187', 'grad_norm': '4.354', 'learning_rate': '1.473e-05', 'epoch': '0.02213'}

  2%|▏         | 840/37963 [2:38:47<104:38:23, 10.15s/it]
  2%|▏         | 841/37963 [2:38:57<104:44:21, 10.16s/it]
  2%|▏         | 842/37963 [2:39:07<104:55:08, 10.18s/it]
  2%|▏         | 843/37963 [2:39:17<104:59:42, 10.18s/it]
  2%|▏         | 844/37963 [2:39:27<104:44:07, 10.16s/it]
  2%|▏         | 845/37963 [2:39:37<104:05:50, 10.10s/it]
  2%|▏         | 846/37963 [2:39:47<104:38:09, 10.15s/it]
  2%|▏         | 847/37963 [2:39:57<103:23:15, 10.03s/it]
  2%|▏         | 848/37963 [2:40:07<103:07:41, 10.00s/it]
  2%|▏         | 849/37963 [2:40:17<102:20:18,  9.93s/it]
  2%|▏         | 850/37963 [2:40:27<103:47:39, 10.07s/it]
                                                         
{'loss': '0.1885', 'grad_norm': '5.855', 'learning_rate': '1.491e-05', 'epoch': '0.02239'}

  2%|▏         | 850/37963 [2:40:27<103:47:39, 10.07s/it]
  2%|▏         | 851/37963 [2:40:37<104:10:46, 10.11s/it]
  2%|▏         | 852/37963 [2:40:48<104:40:17, 10.15s/it]
  2%|▏         | 853/37963 [2:40:58<103:29:54, 10.04s/it]
  2%|▏         | 854/37963 [2:41:08<103:53:29, 10.08s/it]
  2%|▏         | 855/37963 [2:41:18<103:11:50, 10.01s/it]
  2%|▏         | 856/37963 [2:41:28<103:33:26, 10.05s/it]
  2%|▏         | 857/37963 [2:41:38<104:14:59, 10.11s/it]
  2%|▏         | 858/37963 [2:41:55<125:26:37, 12.17s/it]
  2%|▏         | 859/37963 [2:42:12<139:38:59, 13.55s/it]
  2%|▏         | 860/37963 [2:42:22<129:03:27, 12.52s/it]
                                                         
{'loss': '0.1822', 'grad_norm': '3.259', 'learning_rate': '1.508e-05', 'epoch': '0.02265'}

  2%|▏         | 860/37963 [2:42:22<129:03:27, 12.52s/it]
  2%|▏         | 861/37963 [2:42:39<142:09:55, 13.79s/it]
  2%|▏         | 862/37963 [2:42:49<130:43:01, 12.68s/it]
  2%|▏         | 863/37963 [2:43:12<162:19:57, 15.75s/it]
  2%|▏         | 864/37963 [2:43:22<144:58:57, 14.07s/it]
  2%|▏         | 865/37963 [2:43:38<152:33:28, 14.80s/it]
  2%|▏         | 866/37963 [2:43:48<138:13:51, 13.41s/it]
  2%|▏         | 867/37963 [2:43:59<128:14:10, 12.44s/it]
  2%|▏         | 868/37963 [2:44:15<141:38:55, 13.75s/it]
  2%|▏         | 869/37963 [2:44:25<129:54:45, 12.61s/it]
  2%|▏         | 870/37963 [2:44:35<122:16:57, 11.87s/it]
                                                         
{'loss': '0.1888', 'grad_norm': '6.031', 'learning_rate': '1.526e-05', 'epoch': '0.02292'}

  2%|▏         | 870/37963 [2:44:35<122:16:57, 11.87s/it]
  2%|▏         | 871/37963 [2:44:46<117:14:56, 11.38s/it]
  2%|▏         | 872/37963 [2:45:02<132:40:39, 12.88s/it]
  2%|▏         | 873/37963 [2:45:12<123:41:14, 12.01s/it]
  2%|▏         | 874/37963 [2:45:22<117:55:00, 11.45s/it]
  2%|▏         | 875/37963 [2:45:32<114:03:15, 11.07s/it]
  2%|▏         | 876/37963 [2:45:42<111:05:48, 10.78s/it]
  2%|▏         | 877/37963 [2:45:52<108:24:43, 10.52s/it]
  2%|▏         | 878/37963 [2:46:02<107:03:07, 10.39s/it]
  2%|▏         | 879/37963 [2:46:13<105:55:12, 10.28s/it]
  2%|▏         | 880/37963 [2:46:23<105:45:44, 10.27s/it]
                                                         
{'loss': '0.1986', 'grad_norm': '4.193', 'learning_rate': '1.543e-05', 'epoch': '0.02318'}

  2%|▏         | 880/37963 [2:46:23<105:45:44, 10.27s/it]
  2%|▏         | 881/37963 [2:46:33<105:15:50, 10.22s/it]
  2%|▏         | 882/37963 [2:46:43<105:22:28, 10.23s/it]
  2%|▏         | 883/37963 [2:46:53<105:22:54, 10.23s/it]
  2%|▏         | 884/37963 [2:47:03<104:48:42, 10.18s/it]
  2%|▏         | 885/37963 [2:47:14<104:39:36, 10.16s/it]
  2%|▏         | 886/37963 [2:47:24<104:38:54, 10.16s/it]
  2%|▏         | 887/37963 [2:47:34<105:01:10, 10.20s/it]
  2%|▏         | 888/37963 [2:47:44<104:47:43, 10.18s/it]
  2%|▏         | 889/37963 [2:47:54<103:40:47, 10.07s/it]
  2%|▏         | 890/37963 [2:48:04<103:52:39, 10.09s/it]
                                                         
{'loss': '0.181', 'grad_norm': '6.084', 'learning_rate': '1.561e-05', 'epoch': '0.02344'}

  2%|▏         | 890/37963 [2:48:04<103:52:39, 10.09s/it]
  2%|▏         | 891/37963 [2:48:14<104:08:58, 10.11s/it]
  2%|▏         | 892/37963 [2:48:24<102:26:38,  9.95s/it]
  2%|▏         | 893/37963 [2:48:34<103:10:08, 10.02s/it]
  2%|▏         | 894/37963 [2:48:44<103:53:03, 10.09s/it]
  2%|▏         | 895/37963 [2:48:54<103:56:05, 10.09s/it]
  2%|▏         | 896/37963 [2:49:04<103:39:16, 10.07s/it]
  2%|▏         | 897/37963 [2:49:14<102:51:22,  9.99s/it]
  2%|▏         | 898/37963 [2:49:24<103:36:26, 10.06s/it]
  2%|▏         | 899/37963 [2:49:34<103:39:46, 10.07s/it]
  2%|▏         | 900/37963 [2:49:45<104:06:58, 10.11s/it]
                                                         
{'loss': '0.1761', 'grad_norm': '5.233', 'learning_rate': '1.579e-05', 'epoch': '0.02371'}

  2%|▏         | 900/37963 [2:49:45<104:06:58, 10.11s/it]
  2%|▏         | 901/37963 [2:49:54<103:13:16, 10.03s/it]
  2%|▏         | 902/37963 [2:50:05<103:37:39, 10.07s/it]
  2%|▏         | 903/37963 [2:50:15<103:48:18, 10.08s/it]
  2%|▏         | 904/37963 [2:50:25<103:20:42, 10.04s/it]
  2%|▏         | 905/37963 [2:50:34<102:19:27,  9.94s/it]
  2%|▏         | 906/37963 [2:50:51<122:16:36, 11.88s/it]
  2%|▏         | 907/37963 [2:51:08<137:06:30, 13.32s/it]
  2%|▏         | 908/37963 [2:51:18<127:15:53, 12.36s/it]
  2%|▏         | 909/37963 [2:51:27<118:39:29, 11.53s/it]
  2%|▏         | 910/37963 [2:51:44<134:27:39, 13.06s/it]
                                                         
{'loss': '0.1945', 'grad_norm': '2.445', 'learning_rate': '1.596e-05', 'epoch': '0.02397'}

  2%|▏         | 910/37963 [2:51:44<134:27:39, 13.06s/it]
  2%|▏         | 911/37963 [2:52:00<144:56:07, 14.08s/it]
  2%|▏         | 912/37963 [2:52:17<152:01:03, 14.77s/it]
  2%|▏         | 913/37963 [2:52:27<137:33:23, 13.37s/it]
  2%|▏         | 914/37963 [2:52:37<127:39:28, 12.40s/it]
  2%|▏         | 915/37963 [2:53:00<160:17:52, 15.58s/it]
  2%|▏         | 916/37963 [2:53:10<143:46:00, 13.97s/it]
  2%|▏         | 917/37963 [2:53:20<132:01:44, 12.83s/it]
  2%|▏         | 918/37963 [2:53:31<123:56:52, 12.05s/it]
  2%|▏         | 919/37963 [2:53:41<117:58:45, 11.47s/it]
  2%|▏         | 920/37963 [2:53:51<113:53:30, 11.07s/it]
                                                         
{'loss': '0.1905', 'grad_norm': '10.24', 'learning_rate': '1.614e-05', 'epoch': '0.02423'}

  2%|▏         | 920/37963 [2:53:51<113:53:30, 11.07s/it]
  2%|▏         | 921/37963 [2:54:01<111:20:05, 10.82s/it]
  2%|▏         | 922/37963 [2:54:11<109:05:35, 10.60s/it]
  2%|▏         | 923/37963 [2:54:27<126:45:00, 12.32s/it]
  2%|▏         | 924/37963 [2:54:37<119:42:38, 11.64s/it]
  2%|▏         | 925/37963 [2:54:48<115:52:06, 11.26s/it]
  2%|▏         | 926/37963 [2:54:58<111:51:58, 10.87s/it]
  2%|▏         | 927/37963 [2:55:08<109:51:18, 10.68s/it]
  2%|▏         | 928/37963 [2:55:18<107:22:15, 10.44s/it]
  2%|▏         | 929/37963 [2:55:28<106:07:05, 10.32s/it]
  2%|▏         | 930/37963 [2:55:38<105:27:13, 10.25s/it]
                                                         
{'loss': '0.1973', 'grad_norm': '2.983', 'learning_rate': '1.631e-05', 'epoch': '0.0245'}

  2%|▏         | 930/37963 [2:55:38<105:27:13, 10.25s/it]
  2%|▏         | 931/37963 [2:55:48<104:27:09, 10.15s/it]
  2%|▏         | 932/37963 [2:55:58<104:17:18, 10.14s/it]
  2%|▏         | 933/37963 [2:56:08<104:09:53, 10.13s/it]
  2%|▏         | 934/37963 [2:56:18<104:27:18, 10.16s/it]
  2%|▏         | 935/37963 [2:56:29<104:34:08, 10.17s/it]
  2%|▏         | 936/37963 [2:56:39<104:37:54, 10.17s/it]
  2%|▏         | 937/37963 [2:56:49<104:26:06, 10.15s/it]
  2%|▏         | 938/37963 [2:56:59<104:34:58, 10.17s/it]
  2%|▏         | 939/37963 [2:57:09<104:26:36, 10.16s/it]
  2%|▏         | 940/37963 [2:57:19<104:08:14, 10.13s/it]
                                                         
{'loss': '0.1857', 'grad_norm': '3.473', 'learning_rate': '1.649e-05', 'epoch': '0.02476'}

  2%|▏         | 940/37963 [2:57:19<104:08:14, 10.13s/it]
  2%|▏         | 941/37963 [2:57:29<104:09:51, 10.13s/it]
  2%|▏         | 942/37963 [2:57:40<104:18:22, 10.14s/it]
  2%|▏         | 943/37963 [2:57:50<104:17:56, 10.14s/it]
  2%|▏         | 944/37963 [2:58:00<103:54:18, 10.10s/it]
  2%|▏         | 945/37963 [2:58:10<104:18:22, 10.14s/it]
  2%|▏         | 946/37963 [2:58:20<104:32:15, 10.17s/it]
  2%|▏         | 947/37963 [2:58:30<103:06:52, 10.03s/it]
  2%|▏         | 948/37963 [2:58:40<103:19:00, 10.05s/it]
  2%|▏         | 949/37963 [2:58:50<103:46:59, 10.09s/it]
  3%|▎         | 950/37963 [2:59:00<103:13:54, 10.04s/it]
                                                         
{'loss': '0.1726', 'grad_norm': '3.391', 'learning_rate': '1.666e-05', 'epoch': '0.02502'}

  3%|▎         | 950/37963 [2:59:00<103:13:54, 10.04s/it]
  3%|▎         | 951/37963 [2:59:10<102:59:44, 10.02s/it]
  3%|▎         | 952/37963 [2:59:20<103:27:11, 10.06s/it]
  3%|▎         | 953/37963 [2:59:30<103:43:14, 10.09s/it]
  3%|▎         | 954/37963 [2:59:41<103:49:38, 10.10s/it]
  3%|▎         | 955/37963 [2:59:50<102:53:03, 10.01s/it]
  3%|▎         | 956/37963 [3:00:01<103:29:33, 10.07s/it]
  3%|▎         | 957/37963 [3:00:25<148:35:12, 14.45s/it]
  3%|▎         | 958/37963 [3:00:48<174:43:19, 17.00s/it]
  3%|▎         | 959/37963 [3:00:58<153:23:07, 14.92s/it]
  3%|▎         | 960/37963 [3:01:15<159:20:21, 15.50s/it]
                                                         
{'loss': '0.1843', 'grad_norm': '4.649', 'learning_rate': '1.684e-05', 'epoch': '0.02529'}

  3%|▎         | 960/37963 [3:01:15<159:20:21, 15.50s/it]
  3%|▎         | 961/37963 [3:01:25<143:18:50, 13.94s/it]
  3%|▎         | 962/37963 [3:01:35<131:06:53, 12.76s/it]
  3%|▎         | 963/37963 [3:01:46<123:06:12, 11.98s/it]
  3%|▎         | 964/37963 [3:01:56<117:28:01, 11.43s/it]
  3%|▎         | 965/37963 [3:02:12<133:32:21, 12.99s/it]
  3%|▎         | 966/37963 [3:02:29<144:48:25, 14.09s/it]
  3%|▎         | 967/37963 [3:02:39<132:30:44, 12.89s/it]
  3%|▎         | 968/37963 [3:02:49<124:21:33, 12.10s/it]
  3%|▎         | 969/37963 [3:02:59<118:12:21, 11.50s/it]
  3%|▎         | 970/37963 [3:03:10<113:59:36, 11.09s/it]
                                                         
{'loss': '0.173', 'grad_norm': '2.568', 'learning_rate': '1.701e-05', 'epoch': '0.02555'}

  3%|▎         | 970/37963 [3:03:10<113:59:36, 11.09s/it]
  3%|▎         | 971/37963 [3:03:20<110:44:04, 10.78s/it]
  3%|▎         | 972/37963 [3:03:30<108:52:43, 10.60s/it]
  3%|▎         | 973/37963 [3:03:40<107:54:42, 10.50s/it]
  3%|▎         | 974/37963 [3:03:56<126:04:13, 12.27s/it]
  3%|▎         | 975/37963 [3:04:07<119:38:20, 11.64s/it]
  3%|▎         | 976/37963 [3:04:17<114:24:52, 11.14s/it]
  3%|▎         | 977/37963 [3:04:27<111:18:57, 10.83s/it]
  3%|▎         | 978/37963 [3:04:37<109:27:16, 10.65s/it]
  3%|▎         | 979/37963 [3:04:47<107:53:17, 10.50s/it]
  3%|▎         | 980/37963 [3:04:57<106:49:42, 10.40s/it]
                                                         
{'loss': '0.198', 'grad_norm': '8.548', 'learning_rate': '1.719e-05', 'epoch': '0.02581'}

  3%|▎         | 980/37963 [3:04:57<106:49:42, 10.40s/it]
  3%|▎         | 981/37963 [3:05:07<106:02:55, 10.32s/it]
  3%|▎         | 982/37963 [3:05:18<105:35:46, 10.28s/it]
  3%|▎         | 983/37963 [3:05:28<105:08:50, 10.24s/it]
  3%|▎         | 984/37963 [3:05:38<104:09:49, 10.14s/it]
  3%|▎         | 985/37963 [3:05:48<104:39:29, 10.19s/it]
  3%|▎         | 986/37963 [3:05:58<104:30:27, 10.17s/it]
  3%|▎         | 987/37963 [3:06:08<104:15:21, 10.15s/it]
  3%|▎         | 988/37963 [3:06:18<104:17:32, 10.15s/it]
  3%|▎         | 989/37963 [3:06:28<103:01:26, 10.03s/it]
  3%|▎         | 990/37963 [3:06:38<103:18:06, 10.06s/it]
                                                         
{'loss': '0.1843', 'grad_norm': '4.629', 'learning_rate': '1.737e-05', 'epoch': '0.02608'}

  3%|▎         | 990/37963 [3:06:38<103:18:06, 10.06s/it]
  3%|▎         | 991/37963 [3:06:48<103:11:12, 10.05s/it]
  3%|▎         | 992/37963 [3:06:58<103:41:21, 10.10s/it]
  3%|▎         | 993/37963 [3:07:09<103:44:18, 10.10s/it]
  3%|▎         | 994/37963 [3:07:19<103:53:57, 10.12s/it]
  3%|▎         | 995/37963 [3:07:29<104:19:53, 10.16s/it]
  3%|▎         | 996/37963 [3:07:39<104:19:05, 10.16s/it]
  3%|▎         | 997/37963 [3:07:49<104:26:00, 10.17s/it]
  3%|▎         | 998/37963 [3:08:00<104:43:41, 10.20s/it]
  3%|▎         | 999/37963 [3:08:10<104:24:50, 10.17s/it]
  3%|▎         | 1000/37963 [3:08:20<104:40:32, 10.19s/it]
                                                          
{'loss': '0.1918', 'grad_norm': '5.913', 'learning_rate': '1.754e-05', 'epoch': '0.02634'}

  3%|▎         | 1000/37963 [3:08:20<104:40:32, 10.19s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.80s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.80s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  3%|▎         | 1001/37963 [3:09:18<253:18:55, 24.67s/it]
  3%|▎         | 1002/37963 [3:09:29<208:43:44, 20.33s/it]
  3%|▎         | 1003/37963 [3:09:48<207:07:05, 20.17s/it]
  3%|▎         | 1004/37963 [3:09:59<176:15:09, 17.17s/it]
  3%|▎         | 1005/37963 [3:10:15<173:59:48, 16.95s/it]
  3%|▎         | 1006/37963 [3:10:37<190:46:19, 18.58s/it]
  3%|▎         | 1007/37963 [3:10:47<164:18:28, 16.01s/it]
  3%|▎         | 1008/37963 [3:11:04<166:15:32, 16.20s/it]
  3%|▎         | 1009/37963 [3:11:14<147:47:18, 14.40s/it]
  3%|▎         | 1010/37963 [3:11:24<134:28:15, 13.10s/it]
                                                          
{'loss': '0.1945', 'grad_norm': '4.535', 'learning_rate': '1.772e-05', 'epoch': '0.0266'}

  3%|▎         | 1010/37963 [3:11:24<134:28:15, 13.10s/it]
  3%|▎         | 1011/37963 [3:11:34<125:21:04, 12.21s/it]
  3%|▎         | 1012/37963 [3:11:45<119:06:24, 11.60s/it]
  3%|▎         | 1013/37963 [3:12:08<155:08:11, 15.11s/it]
  3%|▎         | 1014/37963 [3:12:18<140:25:19, 13.68s/it]
  3%|▎         | 1015/37963 [3:12:29<129:45:51, 12.64s/it]
  3%|▎         | 1016/37963 [3:12:39<122:17:29, 11.92s/it]
  3%|▎         | 1017/37963 [3:12:49<117:29:14, 11.45s/it]
  3%|▎         | 1018/37963 [3:12:59<113:44:32, 11.08s/it]
  3%|▎         | 1019/37963 [3:13:09<110:53:18, 10.81s/it]
  3%|▎         | 1020/37963 [3:13:20<109:02:36, 10.63s/it]
                                                          
{'loss': '0.1967', 'grad_norm': '5.627', 'learning_rate': '1.789e-05', 'epoch': '0.02687'}

  3%|▎         | 1020/37963 [3:13:20<109:02:36, 10.63s/it]
  3%|▎         | 1021/37963 [3:13:30<107:52:32, 10.51s/it]
  3%|▎         | 1022/37963 [3:13:40<106:39:46, 10.39s/it]
  3%|▎         | 1023/37963 [3:13:57<125:20:34, 12.22s/it]
  3%|▎         | 1024/37963 [3:14:06<117:45:36, 11.48s/it]
  3%|▎         | 1025/37963 [3:14:16<113:42:02, 11.08s/it]
  3%|▎         | 1026/37963 [3:14:27<110:45:31, 10.79s/it]
  3%|▎         | 1027/37963 [3:14:37<108:58:58, 10.62s/it]
  3%|▎         | 1028/37963 [3:14:47<106:36:12, 10.39s/it]
  3%|▎         | 1029/37963 [3:14:57<106:04:55, 10.34s/it]
  3%|▎         | 1030/37963 [3:15:07<105:36:43, 10.29s/it]
                                                          
{'loss': '0.1778', 'grad_norm': '3.326', 'learning_rate': '1.807e-05', 'epoch': '0.02713'}

  3%|▎         | 1030/37963 [3:15:07<105:36:43, 10.29s/it]
  3%|▎         | 1031/37963 [3:15:17<105:41:08, 10.30s/it]
  3%|▎         | 1032/37963 [3:15:28<105:30:16, 10.28s/it]
  3%|▎         | 1033/37963 [3:15:37<103:59:42, 10.14s/it]
  3%|▎         | 1034/37963 [3:15:48<104:24:19, 10.18s/it]
  3%|▎         | 1035/37963 [3:15:58<104:39:39, 10.20s/it]
  3%|▎         | 1036/37963 [3:16:08<104:09:03, 10.15s/it]
  3%|▎         | 1037/37963 [3:16:18<104:06:27, 10.15s/it]
  3%|▎         | 1038/37963 [3:16:28<103:19:41, 10.07s/it]
  3%|▎         | 1039/37963 [3:16:38<103:43:59, 10.11s/it]
  3%|▎         | 1040/37963 [3:16:48<103:57:17, 10.14s/it]
                                                          
{'loss': '0.1894', 'grad_norm': '3.686', 'learning_rate': '1.824e-05', 'epoch': '0.0274'}

  3%|▎         | 1040/37963 [3:16:48<103:57:17, 10.14s/it]
  3%|▎         | 1041/37963 [3:16:59<104:03:51, 10.15s/it]
  3%|▎         | 1042/37963 [3:17:09<104:14:12, 10.16s/it]
  3%|▎         | 1043/37963 [3:17:19<103:46:10, 10.12s/it]
  3%|▎         | 1044/37963 [3:17:29<104:04:03, 10.15s/it]
  3%|▎         | 1045/37963 [3:17:39<103:06:58, 10.06s/it]
  3%|▎         | 1046/37963 [3:17:49<102:41:16, 10.01s/it]
  3%|▎         | 1047/37963 [3:17:59<103:08:08, 10.06s/it]
  3%|▎         | 1048/37963 [3:18:09<103:24:23, 10.08s/it]
  3%|▎         | 1049/37963 [3:18:19<104:01:20, 10.14s/it]
  3%|▎         | 1050/37963 [3:18:30<104:30:59, 10.19s/it]
                                                          
{'loss': '0.182', 'grad_norm': '3.927', 'learning_rate': '1.842e-05', 'epoch': '0.02766'}

  3%|▎         | 1050/37963 [3:18:30<104:30:59, 10.19s/it]
  3%|▎         | 1051/37963 [3:18:56<154:33:54, 15.07s/it]
  3%|▎         | 1052/37963 [3:19:06<139:01:13, 13.56s/it]
  3%|▎         | 1053/37963 [3:19:16<128:34:20, 12.54s/it]
  3%|▎         | 1054/37963 [3:19:33<142:35:35, 13.91s/it]
  3%|▎         | 1055/37963 [3:19:44<130:55:59, 12.77s/it]
  3%|▎         | 1056/37963 [3:20:07<162:28:27, 15.85s/it]
  3%|▎         | 1057/37963 [3:20:17<144:48:18, 14.13s/it]
  3%|▎         | 1058/37963 [3:20:27<132:35:35, 12.93s/it]
  3%|▎         | 1059/37963 [3:20:37<124:28:10, 12.14s/it]
  3%|▎         | 1060/37963 [3:20:47<118:19:21, 11.54s/it]
                                                          
{'loss': '0.1998', 'grad_norm': '4.456', 'learning_rate': '1.86e-05', 'epoch': '0.02792'}

  3%|▎         | 1060/37963 [3:20:47<118:19:21, 11.54s/it]
  3%|▎         | 1061/37963 [3:20:57<113:59:30, 11.12s/it]
  3%|▎         | 1062/37963 [3:21:08<110:56:34, 10.82s/it]
  3%|▎         | 1063/37963 [3:21:31<148:30:02, 14.49s/it]
  3%|▎         | 1064/37963 [3:21:41<135:01:02, 13.17s/it]
  3%|▎         | 1065/37963 [3:21:50<124:31:11, 12.15s/it]
  3%|▎         | 1066/37963 [3:22:01<118:55:39, 11.60s/it]
  3%|▎         | 1067/37963 [3:22:11<114:09:13, 11.14s/it]
  3%|▎         | 1068/37963 [3:22:21<110:19:31, 10.76s/it]
  3%|▎         | 1069/37963 [3:22:31<107:34:25, 10.50s/it]
  3%|▎         | 1070/37963 [3:22:41<106:13:58, 10.37s/it]
                                                          
{'loss': '0.1789', 'grad_norm': '3.923', 'learning_rate': '1.877e-05', 'epoch': '0.02819'}

  3%|▎         | 1070/37963 [3:22:41<106:13:58, 10.37s/it]
  3%|▎         | 1071/37963 [3:22:51<105:09:00, 10.26s/it]
  3%|▎         | 1072/37963 [3:23:07<124:57:07, 12.19s/it]
  3%|▎         | 1073/37963 [3:23:17<117:28:30, 11.46s/it]
  3%|▎         | 1074/37963 [3:23:27<113:49:58, 11.11s/it]
  3%|▎         | 1075/37963 [3:23:37<110:32:17, 10.79s/it]
  3%|▎         | 1076/37963 [3:23:48<108:43:51, 10.61s/it]
  3%|▎         | 1077/37963 [3:23:58<107:12:12, 10.46s/it]
  3%|▎         | 1078/37963 [3:24:08<105:55:00, 10.34s/it]
  3%|▎         | 1079/37963 [3:24:18<104:20:15, 10.18s/it]
  3%|▎         | 1080/37963 [3:24:28<104:19:38, 10.18s/it]
                                                          
{'loss': '0.2012', 'grad_norm': '2.51', 'learning_rate': '1.895e-05', 'epoch': '0.02845'}

  3%|▎         | 1080/37963 [3:24:28<104:19:38, 10.18s/it]
  3%|▎         | 1081/37963 [3:24:38<102:57:02, 10.05s/it]
  3%|▎         | 1082/37963 [3:24:48<103:33:23, 10.11s/it]
  3%|▎         | 1083/37963 [3:24:58<103:46:53, 10.13s/it]
  3%|▎         | 1084/37963 [3:25:08<103:25:55, 10.10s/it]
  3%|▎         | 1085/37963 [3:25:18<102:32:08, 10.01s/it]
  3%|▎         | 1086/37963 [3:25:28<103:04:26, 10.06s/it]
  3%|▎         | 1087/37963 [3:25:38<102:54:06, 10.05s/it]
  3%|▎         | 1088/37963 [3:25:48<103:11:23, 10.07s/it]
  3%|▎         | 1089/37963 [3:25:58<103:27:21, 10.10s/it]
  3%|▎         | 1090/37963 [3:26:08<101:44:57,  9.93s/it]
                                                          
{'loss': '0.2011', 'grad_norm': '6.961', 'learning_rate': '1.912e-05', 'epoch': '0.02871'}

  3%|▎         | 1090/37963 [3:26:08<101:44:57,  9.93s/it]
  3%|▎         | 1091/37963 [3:26:18<101:41:33,  9.93s/it]
  3%|▎         | 1092/37963 [3:26:28<101:32:38,  9.91s/it]
  3%|▎         | 1093/37963 [3:26:38<102:25:01, 10.00s/it]
  3%|▎         | 1094/37963 [3:26:48<102:17:07,  9.99s/it]
  3%|▎         | 1095/37963 [3:26:58<101:51:08,  9.95s/it]
  3%|▎         | 1096/37963 [3:27:08<102:12:00,  9.98s/it]
  3%|▎         | 1097/37963 [3:27:18<102:32:56, 10.01s/it]
  3%|▎         | 1098/37963 [3:27:28<102:01:25,  9.96s/it]
  3%|▎         | 1099/37963 [3:27:44<121:15:11, 11.84s/it]
  3%|▎         | 1100/37963 [3:28:04<145:23:55, 14.20s/it]
                                                          
{'loss': '0.1805', 'grad_norm': '2.306', 'learning_rate': '1.93e-05', 'epoch': '0.02898'}

  3%|▎         | 1100/37963 [3:28:04<145:23:55, 14.20s/it]
  3%|▎         | 1101/37963 [3:28:14<132:53:50, 12.98s/it]
  3%|▎         | 1102/37963 [3:28:37<164:33:49, 16.07s/it]
  3%|▎         | 1103/37963 [3:28:47<146:21:41, 14.29s/it]
  3%|▎         | 1104/37963 [3:28:57<133:31:16, 13.04s/it]
  3%|▎         | 1105/37963 [3:29:13<143:06:54, 13.98s/it]
  3%|▎         | 1106/37963 [3:29:23<131:10:12, 12.81s/it]
  3%|▎         | 1107/37963 [3:29:34<122:47:25, 11.99s/it]
  3%|▎         | 1108/37963 [3:29:44<117:08:26, 11.44s/it]
  3%|▎         | 1109/37963 [3:30:00<131:56:38, 12.89s/it]
  3%|▎         | 1110/37963 [3:30:10<123:23:25, 12.05s/it]
                                                          
{'loss': '0.1926', 'grad_norm': '4.689', 'learning_rate': '1.947e-05', 'epoch': '0.02924'}

  3%|▎         | 1110/37963 [3:30:10<123:23:25, 12.05s/it]
  3%|▎         | 1111/37963 [3:30:20<117:43:36, 11.50s/it]
  3%|▎         | 1112/37963 [3:30:31<113:57:05, 11.13s/it]
  3%|▎         | 1113/37963 [3:30:41<111:11:34, 10.86s/it]
  3%|▎         | 1114/37963 [3:30:51<108:54:33, 10.64s/it]
  3%|▎         | 1115/37963 [3:31:01<107:35:51, 10.51s/it]
  3%|▎         | 1116/37963 [3:31:11<106:32:24, 10.41s/it]
  3%|▎         | 1117/37963 [3:31:21<105:48:19, 10.34s/it]
  3%|▎         | 1118/37963 [3:31:32<105:12:44, 10.28s/it]
  3%|▎         | 1119/37963 [3:31:49<125:54:19, 12.30s/it]
  3%|▎         | 1120/37963 [3:31:59<119:15:03, 11.65s/it]
                                                          
{'loss': '0.1749', 'grad_norm': '4.693', 'learning_rate': '1.965e-05', 'epoch': '0.0295'}

  3%|▎         | 1120/37963 [3:31:59<119:15:03, 11.65s/it]
  3%|▎         | 1121/37963 [3:32:09<115:01:30, 11.24s/it]
  3%|▎         | 1122/37963 [3:32:19<111:51:30, 10.93s/it]
  3%|▎         | 1123/37963 [3:32:29<109:23:49, 10.69s/it]
  3%|▎         | 1124/37963 [3:32:40<108:19:29, 10.59s/it]
  3%|▎         | 1125/37963 [3:32:50<106:39:31, 10.42s/it]
  3%|▎         | 1126/37963 [3:33:00<104:27:55, 10.21s/it]
  3%|▎         | 1127/37963 [3:33:09<103:25:58, 10.11s/it]
  3%|▎         | 1128/37963 [3:33:19<103:27:09, 10.11s/it]
  3%|▎         | 1129/37963 [3:33:29<103:00:01, 10.07s/it]
  3%|▎         | 1130/37963 [3:33:39<102:53:54, 10.06s/it]
                                                          
{'loss': '0.1831', 'grad_norm': '5.994', 'learning_rate': '1.982e-05', 'epoch': '0.02977'}

  3%|▎         | 1130/37963 [3:33:39<102:53:54, 10.06s/it]
  3%|▎         | 1131/37963 [3:33:49<102:04:47,  9.98s/it]
  3%|▎         | 1132/37963 [3:33:59<101:13:36,  9.89s/it]
  3%|▎         | 1133/37963 [3:34:09<101:28:35,  9.92s/it]
  3%|▎         | 1134/37963 [3:34:19<102:48:14, 10.05s/it]
  3%|▎         | 1135/37963 [3:34:29<103:06:04, 10.08s/it]
  3%|▎         | 1136/37963 [3:34:40<103:39:00, 10.13s/it]
  3%|▎         | 1137/37963 [3:34:50<103:48:24, 10.15s/it]
  3%|▎         | 1138/37963 [3:35:00<103:38:00, 10.13s/it]
  3%|▎         | 1139/37963 [3:35:10<103:38:13, 10.13s/it]
  3%|▎         | 1140/37963 [3:35:20<103:34:04, 10.13s/it]
                                                          
{'loss': '0.189', 'grad_norm': '3.029', 'learning_rate': '2e-05', 'epoch': '0.03003'}

  3%|▎         | 1140/37963 [3:35:20<103:34:04, 10.13s/it]
  3%|▎         | 1141/37963 [3:35:30<103:20:45, 10.10s/it]
  3%|▎         | 1142/37963 [3:35:41<103:56:06, 10.16s/it]
  3%|▎         | 1143/37963 [3:35:51<103:36:43, 10.13s/it]
  3%|▎         | 1144/37963 [3:36:01<103:27:11, 10.12s/it]
  3%|▎         | 1145/37963 [3:36:11<103:04:38, 10.08s/it]
  3%|▎         | 1146/37963 [3:36:27<122:30:49, 11.98s/it]
  3%|▎         | 1147/37963 [3:36:37<116:53:47, 11.43s/it]
  3%|▎         | 1148/37963 [3:36:54<132:06:59, 12.92s/it]
  3%|▎         | 1149/37963 [3:37:13<152:45:54, 14.94s/it]
  3%|▎         | 1150/37963 [3:37:23<138:06:38, 13.51s/it]
                                                          
{'loss': '0.1884', 'grad_norm': '8.279', 'learning_rate': '2e-05', 'epoch': '0.03029'}

  3%|▎         | 1150/37963 [3:37:23<138:06:38, 13.51s/it]
  3%|▎         | 1151/37963 [3:37:34<127:59:35, 12.52s/it]
  3%|▎         | 1152/37963 [3:37:43<119:15:53, 11.66s/it]
  3%|▎         | 1153/37963 [3:38:00<133:45:30, 13.08s/it]
  3%|▎         | 1154/37963 [3:38:15<141:35:18, 13.85s/it]
  3%|▎         | 1155/37963 [3:38:26<130:39:58, 12.78s/it]
  3%|▎         | 1156/37963 [3:38:36<121:46:41, 11.91s/it]
  3%|▎         | 1157/37963 [3:38:45<115:35:17, 11.31s/it]
  3%|▎         | 1158/37963 [3:39:09<152:01:04, 14.87s/it]
  3%|▎         | 1159/37963 [3:39:18<136:12:59, 13.32s/it]
  3%|▎         | 1160/37963 [3:39:28<126:23:43, 12.36s/it]
                                                          
{'loss': '0.1879', 'grad_norm': '4.167', 'learning_rate': '2e-05', 'epoch': '0.03056'}

  3%|▎         | 1160/37963 [3:39:28<126:23:43, 12.36s/it]
  3%|▎         | 1161/37963 [3:39:39<119:22:06, 11.68s/it]
  3%|▎         | 1162/37963 [3:39:48<113:54:11, 11.14s/it]
  3%|▎         | 1163/37963 [3:39:59<110:49:12, 10.84s/it]
  3%|▎         | 1164/37963 [3:40:09<108:42:45, 10.64s/it]
  3%|▎         | 1165/37963 [3:40:19<107:21:30, 10.50s/it]
  3%|▎         | 1166/37963 [3:40:29<105:29:20, 10.32s/it]
  3%|▎         | 1167/37963 [3:40:39<105:09:36, 10.29s/it]
  3%|▎         | 1168/37963 [3:40:49<105:04:53, 10.28s/it]
  3%|▎         | 1169/37963 [3:40:59<104:03:43, 10.18s/it]
  3%|▎         | 1170/37963 [3:41:15<121:43:16, 11.91s/it]
                                                          
{'loss': '0.1873', 'grad_norm': '3.299', 'learning_rate': '2e-05', 'epoch': '0.03082'}

  3%|▎         | 1170/37963 [3:41:15<121:43:16, 11.91s/it]
  3%|▎         | 1171/37963 [3:41:25<116:10:17, 11.37s/it]
  3%|▎         | 1172/37963 [3:41:35<112:07:46, 10.97s/it]
  3%|▎         | 1173/37963 [3:41:45<108:39:11, 10.63s/it]
  3%|▎         | 1174/37963 [3:41:55<107:04:10, 10.48s/it]
  3%|▎         | 1175/37963 [3:42:05<105:04:44, 10.28s/it]
  3%|▎         | 1176/37963 [3:42:15<104:31:07, 10.23s/it]
  3%|▎         | 1177/37963 [3:42:25<104:21:24, 10.21s/it]
  3%|▎         | 1178/37963 [3:42:36<104:08:00, 10.19s/it]
  3%|▎         | 1179/37963 [3:42:46<103:59:22, 10.18s/it]
  3%|▎         | 1180/37963 [3:42:56<103:54:11, 10.17s/it]
                                                          
{'loss': '0.1806', 'grad_norm': '3.664', 'learning_rate': '2e-05', 'epoch': '0.03108'}

  3%|▎         | 1180/37963 [3:42:56<103:54:11, 10.17s/it]
  3%|▎         | 1181/37963 [3:43:06<103:35:37, 10.14s/it]
  3%|▎         | 1182/37963 [3:43:16<103:37:32, 10.14s/it]
  3%|▎         | 1183/37963 [3:43:26<102:56:17, 10.08s/it]
  3%|▎         | 1184/37963 [3:43:36<101:33:14,  9.94s/it]
  3%|▎         | 1185/37963 [3:43:46<101:43:56,  9.96s/it]
  3%|▎         | 1186/37963 [3:43:56<101:48:38,  9.97s/it]
  3%|▎         | 1187/37963 [3:44:05<100:48:28,  9.87s/it]
  3%|▎         | 1188/37963 [3:44:15<101:36:28,  9.95s/it]
  3%|▎         | 1189/37963 [3:44:25<102:06:14, 10.00s/it]
  3%|▎         | 1190/37963 [3:44:36<102:41:50, 10.05s/it]
                                                          
{'loss': '0.1823', 'grad_norm': '3.777', 'learning_rate': '2e-05', 'epoch': '0.03135'}

  3%|▎         | 1190/37963 [3:44:36<102:41:50, 10.05s/it]
  3%|▎         | 1191/37963 [3:44:45<100:46:51,  9.87s/it]
  3%|▎         | 1192/37963 [3:44:55<101:34:12,  9.94s/it]
  3%|▎         | 1193/37963 [3:45:06<102:34:49, 10.04s/it]
  3%|▎         | 1194/37963 [3:45:16<102:45:08, 10.06s/it]
  3%|▎         | 1195/37963 [3:45:26<103:29:26, 10.13s/it]
  3%|▎         | 1196/37963 [3:45:36<102:10:52, 10.00s/it]
  3%|▎         | 1197/37963 [3:45:46<102:49:22, 10.07s/it]
  3%|▎         | 1198/37963 [3:45:56<103:01:58, 10.09s/it]
  3%|▎         | 1199/37963 [3:46:19<143:51:43, 14.09s/it]
  3%|▎         | 1200/37963 [3:46:36<151:40:03, 14.85s/it]
                                                          
{'loss': '0.1733', 'grad_norm': '5.451', 'learning_rate': '2e-05', 'epoch': '0.03161'}

  3%|▎         | 1200/37963 [3:46:36<151:40:03, 14.85s/it]
  3%|▎         | 1201/37963 [3:46:46<137:25:20, 13.46s/it]
  3%|▎         | 1202/37963 [3:46:56<127:17:18, 12.47s/it]
  3%|▎         | 1203/37963 [3:47:13<139:27:46, 13.66s/it]
  3%|▎         | 1204/37963 [3:47:36<167:58:48, 16.45s/it]
  3%|▎         | 1205/37963 [3:47:46<148:00:11, 14.50s/it]
  3%|▎         | 1206/37963 [3:48:03<155:18:20, 15.21s/it]
  3%|▎         | 1207/37963 [3:48:13<140:01:17, 13.71s/it]
  3%|▎         | 1208/37963 [3:48:23<128:59:15, 12.63s/it]
  3%|▎         | 1209/37963 [3:48:33<121:34:03, 11.91s/it]
  3%|▎         | 1210/37963 [3:48:43<116:29:14, 11.41s/it]
                                                          
{'loss': '0.1777', 'grad_norm': '13.99', 'learning_rate': '2e-05', 'epoch': '0.03187'}

  3%|▎         | 1210/37963 [3:48:43<116:29:14, 11.41s/it]
  3%|▎         | 1211/37963 [3:48:54<112:40:46, 11.04s/it]
  3%|▎         | 1212/37963 [3:49:04<109:41:57, 10.75s/it]
  3%|▎         | 1213/37963 [3:49:14<108:08:18, 10.59s/it]
  3%|▎         | 1214/37963 [3:49:24<106:43:46, 10.46s/it]
  3%|▎         | 1215/37963 [3:49:34<105:54:20, 10.38s/it]
  3%|▎         | 1216/37963 [3:49:44<104:45:04, 10.26s/it]
  3%|▎         | 1217/37963 [3:49:54<104:35:09, 10.25s/it]
  3%|▎         | 1218/37963 [3:50:04<104:08:55, 10.20s/it]
  3%|▎         | 1219/37963 [3:50:15<104:45:30, 10.26s/it]
  3%|▎         | 1220/37963 [3:50:31<124:00:34, 12.15s/it]
                                                          
{'loss': '0.19', 'grad_norm': '5.784', 'learning_rate': '2e-05', 'epoch': '0.03214'}

  3%|▎         | 1220/37963 [3:50:31<124:00:34, 12.15s/it]
  3%|▎         | 1221/37963 [3:50:42<118:05:12, 11.57s/it]
  3%|▎         | 1222/37963 [3:50:52<112:53:31, 11.06s/it]
  3%|▎         | 1223/37963 [3:51:02<109:57:55, 10.78s/it]
  3%|▎         | 1224/37963 [3:51:12<108:11:39, 10.60s/it]
  3%|▎         | 1225/37963 [3:51:22<106:59:07, 10.48s/it]
  3%|▎         | 1226/37963 [3:51:32<106:03:05, 10.39s/it]
  3%|▎         | 1227/37963 [3:51:42<105:19:38, 10.32s/it]
  3%|▎         | 1228/37963 [3:51:53<104:40:59, 10.26s/it]
  3%|▎         | 1229/37963 [3:52:03<104:18:01, 10.22s/it]
  3%|▎         | 1230/37963 [3:52:13<104:07:30, 10.20s/it]
                                                          
{'loss': '0.1996', 'grad_norm': '6.749', 'learning_rate': '2e-05', 'epoch': '0.0324'}

  3%|▎         | 1230/37963 [3:52:13<104:07:30, 10.20s/it]
  3%|▎         | 1231/37963 [3:52:23<103:59:04, 10.19s/it]
  3%|▎         | 1232/37963 [3:52:33<103:44:54, 10.17s/it]
  3%|▎         | 1233/37963 [3:52:43<103:06:00, 10.11s/it]
  3%|▎         | 1234/37963 [3:52:53<103:25:01, 10.14s/it]
  3%|▎         | 1235/37963 [3:53:03<103:12:58, 10.12s/it]
  3%|▎         | 1236/37963 [3:53:13<103:21:02, 10.13s/it]
  3%|▎         | 1237/37963 [3:53:24<103:40:35, 10.16s/it]
  3%|▎         | 1238/37963 [3:53:34<103:29:05, 10.14s/it]
  3%|▎         | 1239/37963 [3:53:44<103:30:16, 10.15s/it]
  3%|▎         | 1240/37963 [3:53:54<103:46:10, 10.17s/it]
                                                          
{'loss': '0.1927', 'grad_norm': '12.25', 'learning_rate': '2e-05', 'epoch': '0.03266'}

  3%|▎         | 1240/37963 [3:53:54<103:46:10, 10.17s/it]
  3%|▎         | 1241/37963 [3:54:04<103:54:43, 10.19s/it]
  3%|▎         | 1242/37963 [3:54:14<103:28:10, 10.14s/it]
  3%|▎         | 1243/37963 [3:54:25<103:16:13, 10.12s/it]
  3%|▎         | 1244/37963 [3:54:34<102:04:24, 10.01s/it]
  3%|▎         | 1245/37963 [3:54:44<102:27:42, 10.05s/it]
  3%|▎         | 1246/37963 [3:54:55<102:36:19, 10.06s/it]
  3%|▎         | 1247/37963 [3:55:21<152:51:33, 14.99s/it]
  3%|▎         | 1248/37963 [3:55:31<138:29:03, 13.58s/it]
  3%|▎         | 1249/37963 [3:55:41<128:07:39, 12.56s/it]
  3%|▎         | 1250/37963 [3:55:57<138:39:02, 13.60s/it]
                                                          
{'loss': '0.1909', 'grad_norm': '5.235', 'learning_rate': '2e-05', 'epoch': '0.03293'}

  3%|▎         | 1250/37963 [3:55:57<138:39:02, 13.60s/it]
  3%|▎         | 1251/37963 [3:56:08<128:04:16, 12.56s/it]
  3%|▎         | 1252/37963 [3:56:24<138:23:16, 13.57s/it]
  3%|▎         | 1253/37963 [3:56:33<126:43:30, 12.43s/it]
  3%|▎         | 1254/37963 [3:56:56<159:04:50, 15.60s/it]
  3%|▎         | 1255/37963 [3:57:07<142:36:34, 13.99s/it]
  3%|▎         | 1256/37963 [3:57:23<150:01:11, 14.71s/it]
  3%|▎         | 1257/37963 [3:57:33<135:58:37, 13.34s/it]
  3%|▎         | 1258/37963 [3:57:43<125:16:23, 12.29s/it]
  3%|▎         | 1259/37963 [3:57:53<117:53:42, 11.56s/it]
  3%|▎         | 1260/37963 [3:58:03<114:02:37, 11.19s/it]
                                                          
{'loss': '0.1956', 'grad_norm': '5.766', 'learning_rate': '2e-05', 'epoch': '0.03319'}

  3%|▎         | 1260/37963 [3:58:03<114:02:37, 11.19s/it]
  3%|▎         | 1261/37963 [3:58:13<110:44:23, 10.86s/it]
  3%|▎         | 1262/37963 [3:58:23<108:47:02, 10.67s/it]
  3%|▎         | 1263/37963 [3:58:34<107:04:13, 10.50s/it]
  3%|▎         | 1264/37963 [3:58:44<106:04:46, 10.41s/it]
  3%|▎         | 1265/37963 [3:58:54<105:12:47, 10.32s/it]
  3%|▎         | 1266/37963 [3:59:04<104:43:05, 10.27s/it]
  3%|▎         | 1267/37963 [3:59:14<103:10:29, 10.12s/it]
  3%|▎         | 1268/37963 [3:59:31<123:29:00, 12.11s/it]
  3%|▎         | 1269/37963 [3:59:40<116:27:35, 11.43s/it]
  3%|▎         | 1270/37963 [3:59:51<112:45:31, 11.06s/it]
                                                          
{'loss': '0.2', 'grad_norm': '1.8', 'learning_rate': '2e-05', 'epoch': '0.03345'}

  3%|▎         | 1270/37963 [3:59:51<112:45:31, 11.06s/it]
  3%|▎         | 1271/37963 [4:00:01<109:35:13, 10.75s/it]
  3%|▎         | 1272/37963 [4:00:11<107:18:58, 10.53s/it]
  3%|▎         | 1273/37963 [4:00:21<105:45:26, 10.38s/it]
  3%|▎         | 1274/37963 [4:00:31<104:36:07, 10.26s/it]
  3%|▎         | 1275/37963 [4:00:41<104:28:31, 10.25s/it]
  3%|▎         | 1276/37963 [4:00:51<103:55:47, 10.20s/it]
  3%|▎         | 1277/37963 [4:01:01<103:42:09, 10.18s/it]
  3%|▎         | 1278/37963 [4:01:11<103:34:28, 10.16s/it]
  3%|▎         | 1279/37963 [4:01:21<102:27:51, 10.06s/it]
  3%|▎         | 1280/37963 [4:01:31<102:46:37, 10.09s/it]
                                                          
{'loss': '0.1851', 'grad_norm': '3.017', 'learning_rate': '2e-05', 'epoch': '0.03372'}

  3%|▎         | 1280/37963 [4:01:31<102:46:37, 10.09s/it]
  3%|▎         | 1281/37963 [4:01:41<102:53:38, 10.10s/it]
  3%|▎         | 1282/37963 [4:01:51<103:09:15, 10.12s/it]
  3%|▎         | 1283/37963 [4:02:02<103:10:58, 10.13s/it]
  3%|▎         | 1284/37963 [4:02:12<103:07:38, 10.12s/it]
  3%|▎         | 1285/37963 [4:02:22<102:11:52, 10.03s/it]
  3%|▎         | 1286/37963 [4:02:32<102:29:07, 10.06s/it]
  3%|▎         | 1287/37963 [4:02:42<102:38:54, 10.08s/it]
  3%|▎         | 1288/37963 [4:02:52<102:01:07, 10.01s/it]
  3%|▎         | 1289/37963 [4:03:02<102:12:00, 10.03s/it]
  3%|▎         | 1290/37963 [4:03:12<102:22:12, 10.05s/it]
                                                          
{'loss': '0.1958', 'grad_norm': '2.221', 'learning_rate': '2e-05', 'epoch': '0.03398'}

  3%|▎         | 1290/37963 [4:03:12<102:22:12, 10.05s/it]
  3%|▎         | 1291/37963 [4:03:22<102:50:39, 10.10s/it]
  3%|▎         | 1292/37963 [4:03:32<103:06:23, 10.12s/it]
  3%|▎         | 1293/37963 [4:03:42<102:34:16, 10.07s/it]
  3%|▎         | 1294/37963 [4:03:52<101:40:30,  9.98s/it]
  3%|▎         | 1295/37963 [4:04:08<121:32:36, 11.93s/it]
  3%|▎         | 1296/37963 [4:04:18<114:08:32, 11.21s/it]
  3%|▎         | 1297/37963 [4:04:34<130:18:29, 12.79s/it]
  3%|▎         | 1298/37963 [4:04:44<120:43:01, 11.85s/it]
  3%|▎         | 1299/37963 [4:04:54<114:53:02, 11.28s/it]
  3%|▎         | 1300/37963 [4:05:20<159:31:32, 15.66s/it]
                                                          
{'loss': '0.1782', 'grad_norm': '3.318', 'learning_rate': '2e-05', 'epoch': '0.03424'}

  3%|▎         | 1300/37963 [4:05:20<159:31:32, 15.66s/it]
  3%|▎         | 1301/37963 [4:05:36<162:22:20, 15.94s/it]
  3%|▎         | 1302/37963 [4:05:53<164:25:39, 16.15s/it]
  3%|▎         | 1303/37963 [4:06:10<166:15:18, 16.33s/it]
  3%|▎         | 1304/37963 [4:06:20<147:38:27, 14.50s/it]
  3%|▎         | 1305/37963 [4:06:30<134:03:44, 13.17s/it]
  3%|▎         | 1306/37963 [4:06:40<124:43:19, 12.25s/it]
  3%|▎         | 1307/37963 [4:06:50<118:10:13, 11.61s/it]
  3%|▎         | 1308/37963 [4:07:00<113:24:08, 11.14s/it]
  3%|▎         | 1309/37963 [4:07:11<110:34:19, 10.86s/it]
  3%|▎         | 1310/37963 [4:07:20<106:10:26, 10.43s/it]
                                                          
{'loss': '0.1844', 'grad_norm': '8.121', 'learning_rate': '2e-05', 'epoch': '0.03451'}

  3%|▎         | 1310/37963 [4:07:20<106:10:26, 10.43s/it]
  3%|▎         | 1311/37963 [4:07:30<105:38:25, 10.38s/it]
  3%|▎         | 1312/37963 [4:07:40<104:44:15, 10.29s/it]
  3%|▎         | 1313/37963 [4:07:50<103:51:33, 10.20s/it]
  3%|▎         | 1314/37963 [4:08:01<103:49:28, 10.20s/it]
  3%|▎         | 1315/37963 [4:08:11<103:31:52, 10.17s/it]
  3%|▎         | 1316/37963 [4:08:21<103:19:53, 10.15s/it]
  3%|▎         | 1317/37963 [4:08:37<122:23:19, 12.02s/it]
  3%|▎         | 1318/37963 [4:08:47<116:29:34, 11.44s/it]
  3%|▎         | 1319/37963 [4:08:57<112:15:58, 11.03s/it]
  3%|▎         | 1320/37963 [4:09:07<108:04:40, 10.62s/it]
                                                          
{'loss': '0.1783', 'grad_norm': '2.411', 'learning_rate': '2e-05', 'epoch': '0.03477'}

  3%|▎         | 1320/37963 [4:09:07<108:04:40, 10.62s/it]
  3%|▎         | 1321/37963 [4:09:17<105:06:40, 10.33s/it]
  3%|▎         | 1322/37963 [4:09:27<104:18:49, 10.25s/it]
  3%|▎         | 1323/37963 [4:09:37<103:17:16, 10.15s/it]
  3%|▎         | 1324/37963 [4:09:47<103:11:53, 10.14s/it]
  3%|▎         | 1325/37963 [4:09:57<103:02:05, 10.12s/it]
  3%|▎         | 1326/37963 [4:10:07<103:02:45, 10.13s/it]
  3%|▎         | 1327/37963 [4:10:17<103:48:05, 10.20s/it]
  3%|▎         | 1328/37963 [4:10:27<102:41:59, 10.09s/it]
  4%|▎         | 1329/37963 [4:10:37<101:25:15,  9.97s/it]
  4%|▎         | 1330/37963 [4:10:47<102:07:23, 10.04s/it]
                                                          
{'loss': '0.1826', 'grad_norm': '3.171', 'learning_rate': '2e-05', 'epoch': '0.03503'}

  4%|▎         | 1330/37963 [4:10:47<102:07:23, 10.04s/it]
  4%|▎         | 1331/37963 [4:10:57<102:27:38, 10.07s/it]
  4%|▎         | 1332/37963 [4:11:07<101:52:21, 10.01s/it]
  4%|▎         | 1333/37963 [4:11:17<102:32:19, 10.08s/it]
  4%|▎         | 1334/37963 [4:11:27<102:42:44, 10.09s/it]
  4%|▎         | 1335/37963 [4:11:37<102:31:06, 10.08s/it]
  4%|▎         | 1336/37963 [4:11:48<102:58:04, 10.12s/it]
  4%|▎         | 1337/37963 [4:11:58<102:59:00, 10.12s/it]
  4%|▎         | 1338/37963 [4:12:08<103:22:58, 10.16s/it]
  4%|▎         | 1339/37963 [4:12:18<102:41:16, 10.09s/it]
  4%|▎         | 1340/37963 [4:12:28<101:58:33, 10.02s/it]
                                                          
{'loss': '0.1889', 'grad_norm': '4.957', 'learning_rate': '2e-05', 'epoch': '0.0353'}

  4%|▎         | 1340/37963 [4:12:28<101:58:33, 10.02s/it]
  4%|▎         | 1341/37963 [4:12:38<101:34:39,  9.99s/it]
  4%|▎         | 1342/37963 [4:12:48<102:06:11, 10.04s/it]
  4%|▎         | 1343/37963 [4:12:58<102:35:59, 10.09s/it]
  4%|▎         | 1344/37963 [4:13:20<140:02:08, 13.77s/it]
  4%|▎         | 1345/37963 [4:13:31<128:58:36, 12.68s/it]
  4%|▎         | 1346/37963 [4:13:47<141:24:41, 13.90s/it]
  4%|▎         | 1347/37963 [4:14:07<158:01:53, 15.54s/it]
  4%|▎         | 1348/37963 [4:14:17<141:39:12, 13.93s/it]
  4%|▎         | 1349/37963 [4:14:27<130:03:44, 12.79s/it]
  4%|▎         | 1350/37963 [4:14:50<160:18:50, 15.76s/it]
                                                          
{'loss': '0.1846', 'grad_norm': '3.483', 'learning_rate': '2e-05', 'epoch': '0.03556'}

  4%|▎         | 1350/37963 [4:14:50<160:18:50, 15.76s/it]
  4%|▎         | 1351/37963 [4:15:06<163:07:26, 16.04s/it]
  4%|▎         | 1352/37963 [4:15:17<145:03:02, 14.26s/it]
  4%|▎         | 1353/37963 [4:15:27<132:34:17, 13.04s/it]
  4%|▎         | 1354/37963 [4:15:37<123:45:57, 12.17s/it]
  4%|▎         | 1355/37963 [4:15:47<117:21:12, 11.54s/it]
  4%|▎         | 1356/37963 [4:15:57<112:59:41, 11.11s/it]
  4%|▎         | 1357/37963 [4:16:07<110:01:48, 10.82s/it]
  4%|▎         | 1358/37963 [4:16:17<108:06:54, 10.63s/it]
  4%|▎         | 1359/37963 [4:16:28<106:42:11, 10.49s/it]
  4%|▎         | 1360/37963 [4:16:38<106:15:39, 10.45s/it]
                                                          
{'loss': '0.185', 'grad_norm': '10.1', 'learning_rate': '2e-05', 'epoch': '0.03582'}

  4%|▎         | 1360/37963 [4:16:38<106:15:39, 10.45s/it]
  4%|▎         | 1361/37963 [4:16:48<105:22:19, 10.36s/it]
  4%|▎         | 1362/37963 [4:17:04<123:00:55, 12.10s/it]
  4%|▎         | 1363/37963 [4:17:14<116:47:53, 11.49s/it]
  4%|▎         | 1364/37963 [4:17:24<112:49:35, 11.10s/it]
  4%|▎         | 1365/37963 [4:17:35<110:15:53, 10.85s/it]
  4%|▎         | 1366/37963 [4:17:45<108:07:52, 10.64s/it]
  4%|▎         | 1367/37963 [4:17:55<106:53:46, 10.52s/it]
  4%|▎         | 1368/37963 [4:18:05<106:01:52, 10.43s/it]
  4%|▎         | 1369/37963 [4:18:15<104:53:30, 10.32s/it]
  4%|▎         | 1370/37963 [4:18:25<103:53:13, 10.22s/it]
                                                          
{'loss': '0.1839', 'grad_norm': '4.519', 'learning_rate': '2e-05', 'epoch': '0.03609'}

  4%|▎         | 1370/37963 [4:18:25<103:53:13, 10.22s/it]
  4%|▎         | 1371/37963 [4:18:35<103:27:57, 10.18s/it]
  4%|▎         | 1372/37963 [4:18:46<103:27:28, 10.18s/it]
  4%|▎         | 1373/37963 [4:18:56<103:22:50, 10.17s/it]
  4%|▎         | 1374/37963 [4:19:06<103:37:07, 10.20s/it]
  4%|▎         | 1375/37963 [4:19:16<103:42:28, 10.20s/it]
  4%|▎         | 1376/37963 [4:19:26<103:50:05, 10.22s/it]
  4%|▎         | 1377/37963 [4:19:37<103:49:24, 10.22s/it]
  4%|▎         | 1378/37963 [4:19:47<103:53:19, 10.22s/it]
  4%|▎         | 1379/37963 [4:19:57<103:37:10, 10.20s/it]
  4%|▎         | 1380/37963 [4:20:07<103:17:33, 10.16s/it]
                                                          
{'loss': '0.1806', 'grad_norm': '4.248', 'learning_rate': '2e-05', 'epoch': '0.03635'}

  4%|▎         | 1380/37963 [4:20:07<103:17:33, 10.16s/it]
  4%|▎         | 1381/37963 [4:20:17<102:57:40, 10.13s/it]
  4%|▎         | 1382/37963 [4:20:27<101:42:36, 10.01s/it]
  4%|▎         | 1383/37963 [4:20:37<102:28:24, 10.08s/it]
  4%|▎         | 1384/37963 [4:20:47<102:56:27, 10.13s/it]
  4%|▎         | 1385/37963 [4:20:57<101:10:16,  9.96s/it]
  4%|▎         | 1386/37963 [4:21:07<101:47:17, 10.02s/it]
  4%|▎         | 1387/37963 [4:21:17<102:23:24, 10.08s/it]
  4%|▎         | 1388/37963 [4:21:27<101:26:51,  9.99s/it]
  4%|▎         | 1389/37963 [4:21:37<101:46:47, 10.02s/it]
  4%|▎         | 1390/37963 [4:21:47<101:56:03, 10.03s/it]
                                                          
{'loss': '0.1751', 'grad_norm': '3.155', 'learning_rate': '2e-05', 'epoch': '0.03661'}

  4%|▎         | 1390/37963 [4:21:47<101:56:03, 10.03s/it]
  4%|▎         | 1391/37963 [4:21:57<102:04:56, 10.05s/it]
  4%|▎         | 1392/37963 [4:22:20<141:00:04, 13.88s/it]
  4%|▎         | 1393/37963 [4:22:36<147:40:24, 14.54s/it]
  4%|▎         | 1394/37963 [4:22:46<134:14:44, 13.22s/it]
  4%|▎         | 1395/37963 [4:23:06<152:27:22, 15.01s/it]
  4%|▎         | 1396/37963 [4:23:16<137:49:58, 13.57s/it]
  4%|▎         | 1397/37963 [4:23:26<127:06:47, 12.51s/it]
  4%|▎         | 1398/37963 [4:23:42<138:30:39, 13.64s/it]
  4%|▎         | 1399/37963 [4:23:52<127:24:30, 12.54s/it]
  4%|▎         | 1400/37963 [4:24:02<120:05:40, 11.82s/it]
                                                          
{'loss': '0.1681', 'grad_norm': '3.375', 'learning_rate': '2e-05', 'epoch': '0.03688'}

  4%|▎         | 1400/37963 [4:24:02<120:05:40, 11.82s/it]
  4%|▎         | 1401/37963 [4:24:19<134:34:29, 13.25s/it]
  4%|▎         | 1402/37963 [4:24:29<124:55:32, 12.30s/it]
  4%|▎         | 1403/37963 [4:24:39<118:21:36, 11.65s/it]
  4%|▎         | 1404/37963 [4:24:56<133:28:07, 13.14s/it]
  4%|▎         | 1405/37963 [4:25:06<124:25:05, 12.25s/it]
  4%|▎         | 1406/37963 [4:25:16<116:38:12, 11.49s/it]
  4%|▎         | 1407/37963 [4:25:25<111:43:13, 11.00s/it]
  4%|▎         | 1408/37963 [4:25:36<108:59:45, 10.73s/it]
  4%|▎         | 1409/37963 [4:25:46<106:43:33, 10.51s/it]
  4%|▎         | 1410/37963 [4:25:55<104:58:38, 10.34s/it]
                                                          
{'loss': '0.1807', 'grad_norm': '5.48', 'learning_rate': '2e-05', 'epoch': '0.03714'}

  4%|▎         | 1410/37963 [4:25:55<104:58:38, 10.34s/it]
  4%|▎         | 1411/37963 [4:26:05<103:03:20, 10.15s/it]
  4%|▎         | 1412/37963 [4:26:22<122:48:30, 12.10s/it]
  4%|▎         | 1413/37963 [4:26:32<116:44:36, 11.50s/it]
  4%|▎         | 1414/37963 [4:26:42<111:30:26, 10.98s/it]
  4%|▎         | 1415/37963 [4:26:52<108:31:00, 10.69s/it]
  4%|▎         | 1416/37963 [4:27:02<107:09:51, 10.56s/it]
  4%|▎         | 1417/37963 [4:27:12<106:05:49, 10.45s/it]
  4%|▎         | 1418/37963 [4:27:22<105:31:38, 10.40s/it]
  4%|▎         | 1419/37963 [4:27:33<104:39:26, 10.31s/it]
  4%|▎         | 1420/37963 [4:27:43<104:09:43, 10.26s/it]
                                                          
{'loss': '0.19', 'grad_norm': '2.356', 'learning_rate': '2e-05', 'epoch': '0.0374'}

  4%|▎         | 1420/37963 [4:27:43<104:09:43, 10.26s/it]
  4%|▎         | 1421/37963 [4:27:53<103:44:20, 10.22s/it]
  4%|▎         | 1422/37963 [4:28:03<103:29:24, 10.20s/it]
  4%|▎         | 1423/37963 [4:28:13<103:22:44, 10.19s/it]
  4%|▍         | 1424/37963 [4:28:23<103:04:09, 10.15s/it]
  4%|▍         | 1425/37963 [4:28:33<103:05:09, 10.16s/it]
  4%|▍         | 1426/37963 [4:28:44<103:05:38, 10.16s/it]
  4%|▍         | 1427/37963 [4:28:54<102:54:01, 10.14s/it]
  4%|▍         | 1428/37963 [4:29:04<102:20:53, 10.08s/it]
  4%|▍         | 1429/37963 [4:29:14<102:34:48, 10.11s/it]
  4%|▍         | 1430/37963 [4:29:24<103:26:13, 10.19s/it]
                                                          
{'loss': '0.1779', 'grad_norm': '4.319', 'learning_rate': '2e-05', 'epoch': '0.03767'}

  4%|▍         | 1430/37963 [4:29:24<103:26:13, 10.19s/it]
  4%|▍         | 1431/37963 [4:29:34<102:55:06, 10.14s/it]
  4%|▍         | 1432/37963 [4:29:44<103:03:28, 10.16s/it]
  4%|▍         | 1433/37963 [4:29:54<102:59:27, 10.15s/it]
  4%|▍         | 1434/37963 [4:30:05<102:56:45, 10.15s/it]
  4%|▍         | 1435/37963 [4:30:15<103:05:58, 10.16s/it]
  4%|▍         | 1436/37963 [4:30:25<103:24:41, 10.19s/it]
  4%|▍         | 1437/37963 [4:30:35<103:12:37, 10.17s/it]
  4%|▍         | 1438/37963 [4:30:45<103:05:54, 10.16s/it]
  4%|▍         | 1439/37963 [4:31:02<123:09:21, 12.14s/it]
  4%|▍         | 1440/37963 [4:31:12<117:02:23, 11.54s/it]
                                                          
{'loss': '0.1733', 'grad_norm': '5.585', 'learning_rate': '2e-05', 'epoch': '0.03793'}

  4%|▍         | 1440/37963 [4:31:12<117:02:23, 11.54s/it]
  4%|▍         | 1441/37963 [4:31:29<132:36:47, 13.07s/it]
  4%|▍         | 1442/37963 [4:31:46<144:00:45, 14.20s/it]
  4%|▍         | 1443/37963 [4:31:56<130:56:07, 12.91s/it]
  4%|▍         | 1444/37963 [4:32:06<122:18:39, 12.06s/it]
  4%|▍         | 1445/37963 [4:32:25<145:01:48, 14.30s/it]
  4%|▍         | 1446/37963 [4:32:35<132:28:21, 13.06s/it]
  4%|▍         | 1447/37963 [4:32:52<143:17:13, 14.13s/it]
  4%|▍         | 1448/37963 [4:33:02<131:19:59, 12.95s/it]
  4%|▍         | 1449/37963 [4:33:12<123:06:48, 12.14s/it]
  4%|▍         | 1450/37963 [4:33:29<136:57:53, 13.50s/it]
                                                          
{'loss': '0.1947', 'grad_norm': '4.484', 'learning_rate': '2e-05', 'epoch': '0.0382'}

  4%|▍         | 1450/37963 [4:33:29<136:57:53, 13.50s/it]
  4%|▍         | 1451/37963 [4:33:39<126:43:38, 12.50s/it]
  4%|▍         | 1452/37963 [4:33:49<119:42:12, 11.80s/it]
  4%|▍         | 1453/37963 [4:34:06<132:49:20, 13.10s/it]
  4%|▍         | 1454/37963 [4:34:16<123:58:38, 12.22s/it]
  4%|▍         | 1455/37963 [4:34:26<117:42:53, 11.61s/it]
  4%|▍         | 1456/37963 [4:34:36<112:02:44, 11.05s/it]
  4%|▍         | 1457/37963 [4:34:46<109:23:24, 10.79s/it]
  4%|▍         | 1458/37963 [4:34:56<107:28:19, 10.60s/it]
  4%|▍         | 1459/37963 [4:35:06<105:26:20, 10.40s/it]
  4%|▍         | 1460/37963 [4:35:16<104:30:13, 10.31s/it]
                                                          
{'loss': '0.1873', 'grad_norm': '2.255', 'learning_rate': '2e-05', 'epoch': '0.03846'}

  4%|▍         | 1460/37963 [4:35:16<104:30:13, 10.31s/it]
  4%|▍         | 1461/37963 [4:35:26<103:58:04, 10.25s/it]
  4%|▍         | 1462/37963 [4:35:36<103:12:10, 10.18s/it]
  4%|▍         | 1463/37963 [4:35:46<103:06:09, 10.17s/it]
  4%|▍         | 1464/37963 [4:35:57<103:18:41, 10.19s/it]
  4%|▍         | 1465/37963 [4:36:13<123:08:29, 12.15s/it]
  4%|▍         | 1466/37963 [4:36:23<116:35:38, 11.50s/it]
  4%|▍         | 1467/37963 [4:36:33<112:42:17, 11.12s/it]
  4%|▍         | 1468/37963 [4:36:44<109:59:40, 10.85s/it]
  4%|▍         | 1469/37963 [4:36:54<108:07:45, 10.67s/it]
  4%|▍         | 1470/37963 [4:37:04<106:21:32, 10.49s/it]
                                                          
{'loss': '0.1748', 'grad_norm': '2.473', 'learning_rate': '2e-05', 'epoch': '0.03872'}

  4%|▍         | 1470/37963 [4:37:04<106:21:32, 10.49s/it]
  4%|▍         | 1471/37963 [4:37:14<104:13:48, 10.28s/it]
  4%|▍         | 1472/37963 [4:37:24<102:53:21, 10.15s/it]
  4%|▍         | 1473/37963 [4:37:34<102:46:34, 10.14s/it]
  4%|▍         | 1474/37963 [4:37:44<103:09:54, 10.18s/it]
  4%|▍         | 1475/37963 [4:37:54<103:16:09, 10.19s/it]
  4%|▍         | 1476/37963 [4:38:04<103:10:04, 10.18s/it]
  4%|▍         | 1477/37963 [4:38:15<103:00:59, 10.16s/it]
  4%|▍         | 1478/37963 [4:38:25<103:00:11, 10.16s/it]
  4%|▍         | 1479/37963 [4:38:35<102:43:50, 10.14s/it]
  4%|▍         | 1480/37963 [4:38:45<102:53:00, 10.15s/it]
                                                          
{'loss': '0.1811', 'grad_norm': '4.076', 'learning_rate': '2e-05', 'epoch': '0.03899'}

  4%|▍         | 1480/37963 [4:38:45<102:53:00, 10.15s/it]
  4%|▍         | 1481/37963 [4:38:55<102:57:39, 10.16s/it]
  4%|▍         | 1482/37963 [4:39:05<103:25:52, 10.21s/it]
  4%|▍         | 1483/37963 [4:39:16<103:53:51, 10.25s/it]
  4%|▍         | 1484/37963 [4:39:26<103:31:04, 10.22s/it]
  4%|▍         | 1485/37963 [4:39:36<103:20:41, 10.20s/it]
  4%|▍         | 1486/37963 [4:39:46<103:16:27, 10.19s/it]
  4%|▍         | 1487/37963 [4:39:57<103:47:00, 10.24s/it]
  4%|▍         | 1488/37963 [4:40:07<103:29:44, 10.21s/it]
  4%|▍         | 1489/37963 [4:40:24<124:05:31, 12.25s/it]
  4%|▍         | 1490/37963 [4:40:40<136:00:15, 13.42s/it]
                                                          
{'loss': '0.1867', 'grad_norm': '5.34', 'learning_rate': '2e-05', 'epoch': '0.03925'}

  4%|▍         | 1490/37963 [4:40:40<136:00:15, 13.42s/it]
  4%|▍         | 1491/37963 [4:40:50<126:10:33, 12.45s/it]
  4%|▍         | 1492/37963 [4:41:10<148:29:56, 14.66s/it]
  4%|▍         | 1493/37963 [4:41:26<154:07:25, 15.21s/it]
  4%|▍         | 1494/37963 [4:41:36<137:16:59, 13.55s/it]
  4%|▍         | 1495/37963 [4:41:46<126:47:11, 12.52s/it]
  4%|▍         | 1496/37963 [4:42:03<139:47:33, 13.80s/it]
  4%|▍         | 1497/37963 [4:42:13<128:27:23, 12.68s/it]
  4%|▍         | 1498/37963 [4:42:23<120:58:05, 11.94s/it]
  4%|▍         | 1499/37963 [4:42:33<115:27:23, 11.40s/it]
  4%|▍         | 1500/37963 [4:42:50<131:50:34, 13.02s/it]
                                                          
{'loss': '0.1735', 'grad_norm': '3.858', 'learning_rate': '2e-05', 'epoch': '0.03951'}

  4%|▍         | 1500/37963 [4:42:50<131:50:34, 13.02s/it]
  4%|▍         | 1501/37963 [4:43:00<123:24:07, 12.18s/it]
  4%|▍         | 1502/37963 [4:43:18<138:26:23, 13.67s/it]
  4%|▍         | 1503/37963 [4:43:28<127:02:52, 12.54s/it]
  4%|▍         | 1504/37963 [4:43:38<119:50:40, 11.83s/it]
  4%|▍         | 1505/37963 [4:43:48<114:16:52, 11.28s/it]
  4%|▍         | 1506/37963 [4:43:57<109:30:31, 10.81s/it]
  4%|▍         | 1507/37963 [4:44:08<108:09:07, 10.68s/it]
  4%|▍         | 1508/37963 [4:44:18<105:46:07, 10.44s/it]
  4%|▍         | 1509/37963 [4:44:27<103:42:58, 10.24s/it]
  4%|▍         | 1510/37963 [4:44:38<103:28:20, 10.22s/it]
                                                          
{'loss': '0.1639', 'grad_norm': '5.457', 'learning_rate': '2e-05', 'epoch': '0.03978'}

  4%|▍         | 1510/37963 [4:44:38<103:28:20, 10.22s/it]
  4%|▍         | 1511/37963 [4:44:48<102:27:12, 10.12s/it]
  4%|▍         | 1512/37963 [4:44:58<102:45:09, 10.15s/it]
  4%|▍         | 1513/37963 [4:45:14<122:26:30, 12.09s/it]
  4%|▍         | 1514/37963 [4:45:25<116:35:30, 11.52s/it]
  4%|▍         | 1515/37963 [4:45:34<111:29:53, 11.01s/it]
  4%|▍         | 1516/37963 [4:45:45<108:57:43, 10.76s/it]
  4%|▍         | 1517/37963 [4:45:55<107:16:33, 10.60s/it]
  4%|▍         | 1518/37963 [4:46:05<105:44:33, 10.45s/it]
  4%|▍         | 1519/37963 [4:46:15<104:53:13, 10.36s/it]
  4%|▍         | 1520/37963 [4:46:25<104:27:44, 10.32s/it]
                                                          
{'loss': '0.1718', 'grad_norm': '2.037', 'learning_rate': '1.999e-05', 'epoch': '0.04004'}

  4%|▍         | 1520/37963 [4:46:25<104:27:44, 10.32s/it]
  4%|▍         | 1521/37963 [4:46:35<103:52:17, 10.26s/it]
  4%|▍         | 1522/37963 [4:46:45<102:30:34, 10.13s/it]
  4%|▍         | 1523/37963 [4:46:55<102:03:30, 10.08s/it]
  4%|▍         | 1524/37963 [4:47:05<102:20:54, 10.11s/it]
  4%|▍         | 1525/37963 [4:47:16<102:46:24, 10.15s/it]
  4%|▍         | 1526/37963 [4:47:26<102:49:31, 10.16s/it]
  4%|▍         | 1527/37963 [4:47:36<103:02:00, 10.18s/it]
  4%|▍         | 1528/37963 [4:47:46<102:09:30, 10.09s/it]
  4%|▍         | 1529/37963 [4:47:56<102:00:44, 10.08s/it]
  4%|▍         | 1530/37963 [4:48:06<102:15:09, 10.10s/it]
                                                          
{'loss': '0.1658', 'grad_norm': '4.362', 'learning_rate': '1.999e-05', 'epoch': '0.0403'}

  4%|▍         | 1530/37963 [4:48:06<102:15:09, 10.10s/it]
  4%|▍         | 1531/37963 [4:48:16<102:28:02, 10.13s/it]
  4%|▍         | 1532/37963 [4:48:26<102:24:00, 10.12s/it]
  4%|▍         | 1533/37963 [4:48:37<102:41:22, 10.15s/it]
  4%|▍         | 1534/37963 [4:48:47<102:53:10, 10.17s/it]
  4%|▍         | 1535/37963 [4:48:57<102:05:06, 10.09s/it]
  4%|▍         | 1536/37963 [4:49:07<102:17:10, 10.11s/it]
  4%|▍         | 1537/37963 [4:49:17<102:20:00, 10.11s/it]
  4%|▍         | 1538/37963 [4:49:27<102:41:02, 10.15s/it]
  4%|▍         | 1539/37963 [4:49:37<102:43:12, 10.15s/it]
  4%|▍         | 1540/37963 [4:49:54<122:09:55, 12.07s/it]
                                                          
{'loss': '0.1933', 'grad_norm': '5.01', 'learning_rate': '1.999e-05', 'epoch': '0.04057'}

  4%|▍         | 1540/37963 [4:49:54<122:09:55, 12.07s/it]
  4%|▍         | 1541/37963 [4:50:11<136:48:25, 13.52s/it]
  4%|▍         | 1542/37963 [4:50:20<125:04:59, 12.36s/it]
  4%|▍         | 1543/37963 [4:50:44<158:05:30, 15.63s/it]
  4%|▍         | 1544/37963 [4:50:54<141:26:54, 13.98s/it]
  4%|▍         | 1545/37963 [4:51:03<127:55:30, 12.65s/it]
  4%|▍         | 1546/37963 [4:51:20<139:50:05, 13.82s/it]
  4%|▍         | 1547/37963 [4:51:30<128:51:08, 12.74s/it]
  4%|▍         | 1548/37963 [4:51:40<121:02:48, 11.97s/it]
  4%|▍         | 1549/37963 [4:51:51<115:50:44, 11.45s/it]
  4%|▍         | 1550/37963 [4:52:01<111:14:24, 11.00s/it]
                                                          
{'loss': '0.1869', 'grad_norm': '3.444', 'learning_rate': '1.999e-05', 'epoch': '0.04083'}

  4%|▍         | 1550/37963 [4:52:01<111:14:24, 11.00s/it]
  4%|▍         | 1551/37963 [4:52:11<108:43:29, 10.75s/it]
  4%|▍         | 1552/37963 [4:52:21<106:45:30, 10.56s/it]
  4%|▍         | 1553/37963 [4:52:31<105:36:36, 10.44s/it]
  4%|▍         | 1554/37963 [4:52:48<124:05:23, 12.27s/it]
  4%|▍         | 1555/37963 [4:52:58<117:24:15, 11.61s/it]
  4%|▍         | 1556/37963 [4:53:08<112:53:30, 11.16s/it]
  4%|▍         | 1557/37963 [4:53:18<109:28:33, 10.83s/it]
  4%|▍         | 1558/37963 [4:53:28<106:48:09, 10.56s/it]
  4%|▍         | 1559/37963 [4:53:38<105:27:12, 10.43s/it]
  4%|▍         | 1560/37963 [4:53:48<104:47:52, 10.36s/it]
                                                          
{'loss': '0.1676', 'grad_norm': '4.829', 'learning_rate': '1.999e-05', 'epoch': '0.04109'}

  4%|▍         | 1560/37963 [4:53:48<104:47:52, 10.36s/it]
  4%|▍         | 1561/37963 [4:54:05<123:27:20, 12.21s/it]
  4%|▍         | 1562/37963 [4:54:15<117:16:32, 11.60s/it]
  4%|▍         | 1563/37963 [4:54:25<112:53:52, 11.17s/it]
  4%|▍         | 1564/37963 [4:54:35<110:13:45, 10.90s/it]
  4%|▍         | 1565/37963 [4:54:45<108:01:36, 10.68s/it]
  4%|▍         | 1566/37963 [4:54:55<105:36:06, 10.44s/it]
  4%|▍         | 1567/37963 [4:55:05<104:47:20, 10.36s/it]
  4%|▍         | 1568/37963 [4:55:15<103:54:14, 10.28s/it]
  4%|▍         | 1569/37963 [4:55:26<103:38:23, 10.25s/it]
  4%|▍         | 1570/37963 [4:55:36<102:25:22, 10.13s/it]
                                                          
{'loss': '0.1824', 'grad_norm': '7.646', 'learning_rate': '1.999e-05', 'epoch': '0.04136'}

  4%|▍         | 1570/37963 [4:55:36<102:25:22, 10.13s/it]
  4%|▍         | 1571/37963 [4:55:46<102:33:17, 10.15s/it]
  4%|▍         | 1572/37963 [4:55:56<102:29:10, 10.14s/it]
  4%|▍         | 1573/37963 [4:56:06<102:24:14, 10.13s/it]
  4%|▍         | 1574/37963 [4:56:16<102:39:27, 10.16s/it]
  4%|▍         | 1575/37963 [4:56:26<101:37:07, 10.05s/it]
  4%|▍         | 1576/37963 [4:56:36<102:05:34, 10.10s/it]
  4%|▍         | 1577/37963 [4:56:46<102:06:07, 10.10s/it]
  4%|▍         | 1578/37963 [4:56:56<102:21:27, 10.13s/it]
  4%|▍         | 1579/37963 [4:57:07<102:27:25, 10.14s/it]
  4%|▍         | 1580/37963 [4:57:17<102:17:06, 10.12s/it]
                                                          
{'loss': '0.1746', 'grad_norm': '2.758', 'learning_rate': '1.999e-05', 'epoch': '0.04162'}

  4%|▍         | 1580/37963 [4:57:17<102:17:06, 10.12s/it]
  4%|▍         | 1581/37963 [4:57:27<101:25:09, 10.04s/it]
  4%|▍         | 1582/37963 [4:57:36<100:42:47,  9.97s/it]
  4%|▍         | 1583/37963 [4:57:46<100:47:36,  9.97s/it]
  4%|▍         | 1584/37963 [4:57:56<101:18:06, 10.02s/it]
  4%|▍         | 1585/37963 [4:58:06<100:34:09,  9.95s/it]
  4%|▍         | 1586/37963 [4:58:16<100:38:46,  9.96s/it]
  4%|▍         | 1587/37963 [4:58:26<101:18:45, 10.03s/it]
  4%|▍         | 1588/37963 [4:58:37<101:53:11, 10.08s/it]
  4%|▍         | 1589/37963 [4:59:00<141:05:33, 13.96s/it]
  4%|▍         | 1590/37963 [4:59:10<129:08:32, 12.78s/it]
                                                          
{'loss': '0.1845', 'grad_norm': '2.038', 'learning_rate': '1.999e-05', 'epoch': '0.04188'}

  4%|▍         | 1590/37963 [4:59:10<129:08:32, 12.78s/it]
  4%|▍         | 1591/37963 [4:59:33<160:20:17, 15.87s/it]
  4%|▍         | 1592/37963 [4:59:43<143:02:51, 14.16s/it]
  4%|▍         | 1593/37963 [5:00:03<159:31:20, 15.79s/it]
  4%|▍         | 1594/37963 [5:00:19<162:09:18, 16.05s/it]
  4%|▍         | 1595/37963 [5:00:29<144:20:14, 14.29s/it]
  4%|▍         | 1596/37963 [5:00:40<131:50:25, 13.05s/it]
  4%|▍         | 1597/37963 [5:00:50<123:07:35, 12.19s/it]
  4%|▍         | 1598/37963 [5:00:59<115:49:30, 11.47s/it]
  4%|▍         | 1599/37963 [5:01:10<111:48:35, 11.07s/it]
  4%|▍         | 1600/37963 [5:01:19<107:03:21, 10.60s/it]
                                                          
{'loss': '0.1969', 'grad_norm': '2.719', 'learning_rate': '1.999e-05', 'epoch': '0.04215'}

  4%|▍         | 1600/37963 [5:01:19<107:03:21, 10.60s/it]
  4%|▍         | 1601/37963 [5:01:29<105:32:00, 10.45s/it]
  4%|▍         | 1602/37963 [5:01:39<104:34:31, 10.35s/it]
  4%|▍         | 1603/37963 [5:01:56<122:50:58, 12.16s/it]
  4%|▍         | 1604/37963 [5:02:06<116:47:38, 11.56s/it]
  4%|▍         | 1605/37963 [5:02:16<112:39:48, 11.16s/it]
  4%|▍         | 1606/37963 [5:02:33<129:00:00, 12.77s/it]
  4%|▍         | 1607/37963 [5:02:43<120:44:07, 11.96s/it]
  4%|▍         | 1608/37963 [5:02:53<115:53:41, 11.48s/it]
  4%|▍         | 1609/37963 [5:03:03<112:00:26, 11.09s/it]
  4%|▍         | 1610/37963 [5:03:14<109:28:46, 10.84s/it]
                                                          
{'loss': '0.1731', 'grad_norm': '8.819', 'learning_rate': '1.999e-05', 'epoch': '0.04241'}

  4%|▍         | 1610/37963 [5:03:14<109:28:46, 10.84s/it]
  4%|▍         | 1611/37963 [5:03:24<107:22:06, 10.63s/it]
  4%|▍         | 1612/37963 [5:03:34<105:57:24, 10.49s/it]
  4%|▍         | 1613/37963 [5:03:44<104:54:26, 10.39s/it]
  4%|▍         | 1614/37963 [5:03:54<104:10:04, 10.32s/it]
  4%|▍         | 1615/37963 [5:04:04<103:53:35, 10.29s/it]
  4%|▍         | 1616/37963 [5:04:14<103:07:13, 10.21s/it]
  4%|▍         | 1617/37963 [5:04:24<102:25:44, 10.15s/it]
  4%|▍         | 1618/37963 [5:04:34<101:32:07, 10.06s/it]
  4%|▍         | 1619/37963 [5:04:44<101:53:08, 10.09s/it]
  4%|▍         | 1620/37963 [5:04:55<102:06:44, 10.11s/it]
                                                          
{'loss': '0.1793', 'grad_norm': '7.503', 'learning_rate': '1.999e-05', 'epoch': '0.04267'}

  4%|▍         | 1620/37963 [5:04:55<102:06:44, 10.11s/it]
  4%|▍         | 1621/37963 [5:05:05<102:31:55, 10.16s/it]
  4%|▍         | 1622/37963 [5:05:15<102:31:17, 10.16s/it]
  4%|▍         | 1623/37963 [5:05:25<101:47:40, 10.08s/it]
  4%|▍         | 1624/37963 [5:05:35<102:16:41, 10.13s/it]
  4%|▍         | 1625/37963 [5:05:45<102:23:15, 10.14s/it]
  4%|▍         | 1626/37963 [5:05:55<102:25:24, 10.15s/it]
  4%|▍         | 1627/37963 [5:06:06<102:23:37, 10.14s/it]
  4%|▍         | 1628/37963 [5:06:15<101:28:02, 10.05s/it]
  4%|▍         | 1629/37963 [5:06:26<102:05:42, 10.12s/it]
  4%|▍         | 1630/37963 [5:06:36<101:20:11, 10.04s/it]
                                                          
{'loss': '0.1708', 'grad_norm': '3.215', 'learning_rate': '1.999e-05', 'epoch': '0.04294'}

  4%|▍         | 1630/37963 [5:06:36<101:20:11, 10.04s/it]
  4%|▍         | 1631/37963 [5:06:46<101:53:28, 10.10s/it]
  4%|▍         | 1632/37963 [5:06:56<101:59:30, 10.11s/it]
  4%|▍         | 1633/37963 [5:07:06<102:17:17, 10.14s/it]
  4%|▍         | 1634/37963 [5:07:17<103:04:59, 10.21s/it]
  4%|▍         | 1635/37963 [5:07:33<121:00:06, 11.99s/it]
  4%|▍         | 1636/37963 [5:07:43<115:19:17, 11.43s/it]
  4%|▍         | 1637/37963 [5:08:00<131:42:48, 13.05s/it]
  4%|▍         | 1638/37963 [5:08:16<141:10:59, 13.99s/it]
  4%|▍         | 1639/37963 [5:08:26<129:33:25, 12.84s/it]
  4%|▍         | 1640/37963 [5:08:46<151:24:36, 15.01s/it]
                                                          
{'loss': '0.1886', 'grad_norm': '7.286', 'learning_rate': '1.999e-05', 'epoch': '0.0432'}

  4%|▍         | 1640/37963 [5:08:46<151:24:36, 15.01s/it]
  4%|▍         | 1641/37963 [5:09:09<175:21:37, 17.38s/it]
  4%|▍         | 1642/37963 [5:09:19<153:14:07, 15.19s/it]
  4%|▍         | 1643/37963 [5:09:29<136:25:52, 13.52s/it]
  4%|▍         | 1644/37963 [5:09:39<126:23:17, 12.53s/it]
  4%|▍         | 1645/37963 [5:09:49<119:05:13, 11.80s/it]
  4%|▍         | 1646/37963 [5:09:59<114:08:28, 11.31s/it]
  4%|▍         | 1647/37963 [5:10:09<110:34:09, 10.96s/it]
  4%|▍         | 1648/37963 [5:10:19<106:44:11, 10.58s/it]
  4%|▍         | 1649/37963 [5:10:29<105:20:20, 10.44s/it]
  4%|▍         | 1650/37963 [5:10:39<104:28:06, 10.36s/it]
                                                          
{'loss': '0.1736', 'grad_norm': '2.326', 'learning_rate': '1.999e-05', 'epoch': '0.04346'}

  4%|▍         | 1650/37963 [5:10:39<104:28:06, 10.36s/it]
  4%|▍         | 1651/37963 [5:10:50<104:26:23, 10.35s/it]
  4%|▍         | 1652/37963 [5:11:06<121:43:49, 12.07s/it]
  4%|▍         | 1653/37963 [5:11:22<135:14:50, 13.41s/it]
  4%|▍         | 1654/37963 [5:11:32<125:24:26, 12.43s/it]
  4%|▍         | 1655/37963 [5:11:43<118:32:07, 11.75s/it]
  4%|▍         | 1656/37963 [5:11:53<113:42:08, 11.27s/it]
  4%|▍         | 1657/37963 [5:12:03<110:15:42, 10.93s/it]
  4%|▍         | 1658/37963 [5:12:13<108:05:12, 10.72s/it]
  4%|▍         | 1659/37963 [5:12:23<106:17:00, 10.54s/it]
  4%|▍         | 1660/37963 [5:12:33<105:07:43, 10.43s/it]
                                                          
{'loss': '0.1972', 'grad_norm': '4.093', 'learning_rate': '1.999e-05', 'epoch': '0.04373'}

  4%|▍         | 1660/37963 [5:12:33<105:07:43, 10.43s/it]
  4%|▍         | 1661/37963 [5:12:44<104:28:21, 10.36s/it]
  4%|▍         | 1662/37963 [5:12:53<103:01:41, 10.22s/it]
  4%|▍         | 1663/37963 [5:13:04<102:42:31, 10.19s/it]
  4%|▍         | 1664/37963 [5:13:13<100:18:04,  9.95s/it]
  4%|▍         | 1665/37963 [5:13:23<100:54:50, 10.01s/it]
  4%|▍         | 1666/37963 [5:13:33<101:08:56, 10.03s/it]
  4%|▍         | 1667/37963 [5:13:43<102:00:40, 10.12s/it]
  4%|▍         | 1668/37963 [5:13:53<100:58:31, 10.02s/it]
  4%|▍         | 1669/37963 [5:14:03<101:32:21, 10.07s/it]
  4%|▍         | 1670/37963 [5:14:13<101:10:38, 10.04s/it]
                                                          
{'loss': '0.1892', 'grad_norm': '4.512', 'learning_rate': '1.999e-05', 'epoch': '0.04399'}

  4%|▍         | 1670/37963 [5:14:13<101:10:38, 10.04s/it]
  4%|▍         | 1671/37963 [5:14:24<101:26:18, 10.06s/it]
  4%|▍         | 1672/37963 [5:14:34<101:16:18, 10.05s/it]
  4%|▍         | 1673/37963 [5:14:44<101:17:54, 10.05s/it]
  4%|▍         | 1674/37963 [5:14:54<101:33:03, 10.07s/it]
  4%|▍         | 1675/37963 [5:15:04<100:49:40, 10.00s/it]
  4%|▍         | 1676/37963 [5:15:13<100:16:53,  9.95s/it]
  4%|▍         | 1677/37963 [5:15:23<100:40:07,  9.99s/it]
  4%|▍         | 1678/37963 [5:15:34<101:10:51, 10.04s/it]
  4%|▍         | 1679/37963 [5:15:44<101:33:27, 10.08s/it]
  4%|▍         | 1680/37963 [5:15:54<102:14:04, 10.14s/it]
                                                          
{'loss': '0.1683', 'grad_norm': '2.593', 'learning_rate': '1.999e-05', 'epoch': '0.04425'}

  4%|▍         | 1680/37963 [5:15:54<102:14:04, 10.14s/it]
  4%|▍         | 1681/37963 [5:16:04<102:19:02, 10.15s/it]
  4%|▍         | 1682/37963 [5:16:14<102:17:55, 10.15s/it]
  4%|▍         | 1683/37963 [5:16:25<102:33:03, 10.18s/it]
  4%|▍         | 1684/37963 [5:16:35<101:49:10, 10.10s/it]
  4%|▍         | 1685/37963 [5:16:51<121:59:10, 12.11s/it]
  4%|▍         | 1686/37963 [5:17:02<116:30:19, 11.56s/it]
  4%|▍         | 1687/37963 [5:17:18<131:50:55, 13.08s/it]
  4%|▍         | 1688/37963 [5:17:28<123:05:30, 12.22s/it]
  4%|▍         | 1689/37963 [5:17:39<116:55:13, 11.60s/it]
  4%|▍         | 1690/37963 [5:17:58<141:24:13, 14.03s/it]
                                                          
{'loss': '0.1702', 'grad_norm': '2.95', 'learning_rate': '1.999e-05', 'epoch': '0.04452'}

  4%|▍         | 1690/37963 [5:17:58<141:24:13, 14.03s/it]
  4%|▍         | 1691/37963 [5:18:21<168:43:39, 16.75s/it]
  4%|▍         | 1692/37963 [5:18:32<148:44:21, 14.76s/it]
  4%|▍         | 1693/37963 [5:18:41<133:52:26, 13.29s/it]
  4%|▍         | 1694/37963 [5:18:51<124:03:03, 12.31s/it]
  4%|▍         | 1695/37963 [5:19:02<117:51:31, 11.70s/it]
  4%|▍         | 1696/37963 [5:19:12<113:02:18, 11.22s/it]
  4%|▍         | 1697/37963 [5:19:22<109:47:33, 10.90s/it]
  4%|▍         | 1698/37963 [5:19:32<106:27:48, 10.57s/it]
  4%|▍         | 1699/37963 [5:19:49<125:27:41, 12.45s/it]
  4%|▍         | 1700/37963 [5:19:59<118:09:56, 11.73s/it]
                                                          
{'loss': '0.1875', 'grad_norm': '2.227', 'learning_rate': '1.999e-05', 'epoch': '0.04478'}

  4%|▍         | 1700/37963 [5:19:59<118:09:56, 11.73s/it]
  4%|▍         | 1701/37963 [5:20:09<113:17:48, 11.25s/it]
  4%|▍         | 1702/37963 [5:20:26<129:58:43, 12.90s/it]
  4%|▍         | 1703/37963 [5:20:36<121:49:13, 12.09s/it]
  4%|▍         | 1704/37963 [5:20:46<116:02:24, 11.52s/it]
  4%|▍         | 1705/37963 [5:20:56<111:55:48, 11.11s/it]
  4%|▍         | 1706/37963 [5:21:06<109:34:50, 10.88s/it]
  4%|▍         | 1707/37963 [5:21:17<107:45:35, 10.70s/it]
  4%|▍         | 1708/37963 [5:21:27<105:37:25, 10.49s/it]
  5%|▍         | 1709/37963 [5:21:37<104:18:45, 10.36s/it]
  5%|▍         | 1710/37963 [5:21:47<103:25:59, 10.27s/it]
                                                          
{'loss': '0.1837', 'grad_norm': '5.079', 'learning_rate': '1.999e-05', 'epoch': '0.04504'}

  5%|▍         | 1710/37963 [5:21:47<103:25:59, 10.27s/it]
  5%|▍         | 1711/37963 [5:21:57<103:20:08, 10.26s/it]
  5%|▍         | 1712/37963 [5:22:07<102:40:21, 10.20s/it]
  5%|▍         | 1713/37963 [5:22:17<102:09:06, 10.14s/it]
  5%|▍         | 1714/37963 [5:22:27<102:35:14, 10.19s/it]
  5%|▍         | 1715/37963 [5:22:37<102:13:32, 10.15s/it]
  5%|▍         | 1716/37963 [5:22:48<102:23:29, 10.17s/it]
  5%|▍         | 1717/37963 [5:22:57<101:14:11, 10.05s/it]
  5%|▍         | 1718/37963 [5:23:08<101:37:49, 10.09s/it]
  5%|▍         | 1719/37963 [5:23:18<101:37:38, 10.09s/it]
  5%|▍         | 1720/37963 [5:23:28<101:59:35, 10.13s/it]
                                                          
{'loss': '0.1828', 'grad_norm': '2.818', 'learning_rate': '1.999e-05', 'epoch': '0.04531'}

  5%|▍         | 1720/37963 [5:23:28<101:59:35, 10.13s/it]
  5%|▍         | 1721/37963 [5:23:38<101:03:08, 10.04s/it]
  5%|▍         | 1722/37963 [5:23:48<100:46:17, 10.01s/it]
  5%|▍         | 1723/37963 [5:23:58<101:10:52, 10.05s/it]
  5%|▍         | 1724/37963 [5:24:08<101:21:17, 10.07s/it]
  5%|▍         | 1725/37963 [5:24:18<101:42:23, 10.10s/it]
  5%|▍         | 1726/37963 [5:24:28<99:49:37,  9.92s/it] 
  5%|▍         | 1727/37963 [5:24:38<100:23:24,  9.97s/it]
  5%|▍         | 1728/37963 [5:24:48<101:04:07, 10.04s/it]
  5%|▍         | 1729/37963 [5:24:58<101:03:11, 10.04s/it]
  5%|▍         | 1730/37963 [5:25:08<101:34:24, 10.09s/it]
                                                          
{'loss': '0.1883', 'grad_norm': '4.569', 'learning_rate': '1.999e-05', 'epoch': '0.04557'}

  5%|▍         | 1730/37963 [5:25:08<101:34:24, 10.09s/it]
  5%|▍         | 1731/37963 [5:25:18<101:39:07, 10.10s/it]
  5%|▍         | 1732/37963 [5:25:41<140:56:34, 14.00s/it]
  5%|▍         | 1733/37963 [5:25:52<129:21:36, 12.85s/it]
  5%|▍         | 1734/37963 [5:26:02<121:17:05, 12.05s/it]
  5%|▍         | 1735/37963 [5:26:22<146:22:11, 14.54s/it]
  5%|▍         | 1736/37963 [5:26:32<133:11:18, 13.24s/it]
  5%|▍         | 1737/37963 [5:26:43<123:55:05, 12.31s/it]
  5%|▍         | 1738/37963 [5:27:00<138:09:37, 13.73s/it]
  5%|▍         | 1739/37963 [5:27:10<127:20:36, 12.66s/it]
  5%|▍         | 1740/37963 [5:27:26<139:32:55, 13.87s/it]
                                                          
{'loss': '0.1773', 'grad_norm': '6.774', 'learning_rate': '1.999e-05', 'epoch': '0.04583'}

  5%|▍         | 1740/37963 [5:27:26<139:32:55, 13.87s/it]
  5%|▍         | 1741/37963 [5:27:37<128:32:51, 12.78s/it]
  5%|▍         | 1742/37963 [5:27:47<120:40:07, 11.99s/it]
  5%|▍         | 1743/37963 [5:28:03<134:49:14, 13.40s/it]
  5%|▍         | 1744/37963 [5:28:14<125:08:26, 12.44s/it]
  5%|▍         | 1745/37963 [5:28:30<138:11:07, 13.74s/it]
  5%|▍         | 1746/37963 [5:28:41<127:43:56, 12.70s/it]
  5%|▍         | 1747/37963 [5:28:51<119:58:32, 11.93s/it]
  5%|▍         | 1748/37963 [5:29:01<114:51:02, 11.42s/it]
  5%|▍         | 1749/37963 [5:29:11<111:22:52, 11.07s/it]
  5%|▍         | 1750/37963 [5:29:27<126:08:17, 12.54s/it]
                                                          
{'loss': '0.1924', 'grad_norm': '2.219', 'learning_rate': '1.999e-05', 'epoch': '0.0461'}

  5%|▍         | 1750/37963 [5:29:27<126:08:17, 12.54s/it]
  5%|▍         | 1751/37963 [5:29:37<118:30:13, 11.78s/it]
  5%|▍         | 1752/37963 [5:29:47<113:27:34, 11.28s/it]
  5%|▍         | 1753/37963 [5:29:57<108:51:31, 10.82s/it]
  5%|▍         | 1754/37963 [5:30:07<106:50:27, 10.62s/it]
  5%|▍         | 1755/37963 [5:30:17<105:26:28, 10.48s/it]
  5%|▍         | 1756/37963 [5:30:27<103:35:35, 10.30s/it]
  5%|▍         | 1757/37963 [5:30:37<103:00:18, 10.24s/it]
  5%|▍         | 1758/37963 [5:30:48<102:41:04, 10.21s/it]
  5%|▍         | 1759/37963 [5:30:58<102:13:31, 10.16s/it]
  5%|▍         | 1760/37963 [5:31:08<102:05:32, 10.15s/it]
                                                          
{'loss': '0.1892', 'grad_norm': '4.249', 'learning_rate': '1.999e-05', 'epoch': '0.04636'}

  5%|▍         | 1760/37963 [5:31:08<102:05:32, 10.15s/it]
  5%|▍         | 1761/37963 [5:31:18<101:37:44, 10.11s/it]
  5%|▍         | 1762/37963 [5:31:28<101:53:17, 10.13s/it]
  5%|▍         | 1763/37963 [5:31:38<102:01:20, 10.15s/it]
  5%|▍         | 1764/37963 [5:31:48<102:15:36, 10.17s/it]
  5%|▍         | 1765/37963 [5:31:59<102:10:05, 10.16s/it]
  5%|▍         | 1766/37963 [5:32:08<101:10:00, 10.06s/it]
  5%|▍         | 1767/37963 [5:32:18<101:23:55, 10.08s/it]
  5%|▍         | 1768/37963 [5:32:29<101:55:09, 10.14s/it]
  5%|▍         | 1769/37963 [5:32:39<102:00:24, 10.15s/it]
  5%|▍         | 1770/37963 [5:32:49<100:47:49, 10.03s/it]
                                                          
{'loss': '0.1897', 'grad_norm': '2.02', 'learning_rate': '1.999e-05', 'epoch': '0.04662'}

  5%|▍         | 1770/37963 [5:32:49<100:47:49, 10.03s/it]
  5%|▍         | 1771/37963 [5:32:58<99:20:13,  9.88s/it] 
  5%|▍         | 1772/37963 [5:33:08<100:04:12,  9.95s/it]
  5%|▍         | 1773/37963 [5:33:18<100:42:46, 10.02s/it]
  5%|▍         | 1774/37963 [5:33:29<101:03:12, 10.05s/it]
  5%|▍         | 1775/37963 [5:33:39<101:31:37, 10.10s/it]
  5%|▍         | 1776/37963 [5:33:49<101:34:36, 10.11s/it]
  5%|▍         | 1777/37963 [5:33:59<101:32:39, 10.10s/it]
  5%|▍         | 1778/37963 [5:34:09<101:50:26, 10.13s/it]
  5%|▍         | 1779/37963 [5:34:19<101:03:22, 10.05s/it]
  5%|▍         | 1780/37963 [5:34:42<139:47:54, 13.91s/it]
                                                          
{'loss': '0.1785', 'grad_norm': '3.633', 'learning_rate': '1.999e-05', 'epoch': '0.04689'}

  5%|▍         | 1780/37963 [5:34:42<139:47:54, 13.91s/it]
  5%|▍         | 1781/37963 [5:34:52<129:02:19, 12.84s/it]
  5%|▍         | 1782/37963 [5:35:12<150:10:24, 14.94s/it]
  5%|▍         | 1783/37963 [5:35:22<135:34:05, 13.49s/it]
  5%|▍         | 1784/37963 [5:35:39<145:12:47, 14.45s/it]
  5%|▍         | 1785/37963 [5:35:49<132:15:14, 13.16s/it]
  5%|▍         | 1786/37963 [5:35:59<122:11:00, 12.16s/it]
  5%|▍         | 1787/37963 [5:36:09<115:01:14, 11.45s/it]
  5%|▍         | 1788/37963 [5:36:18<109:15:11, 10.87s/it]
  5%|▍         | 1789/37963 [5:36:28<106:38:28, 10.61s/it]
  5%|▍         | 1790/37963 [5:36:45<123:48:10, 12.32s/it]
                                                          
{'loss': '0.1676', 'grad_norm': '2.279', 'learning_rate': '1.998e-05', 'epoch': '0.04715'}

  5%|▍         | 1790/37963 [5:36:45<123:48:10, 12.32s/it]
  5%|▍         | 1791/37963 [5:36:55<117:26:24, 11.69s/it]
  5%|▍         | 1792/37963 [5:37:11<132:18:19, 13.17s/it]
  5%|▍         | 1793/37963 [5:37:28<142:41:57, 14.20s/it]
  5%|▍         | 1794/37963 [5:37:38<130:20:54, 12.97s/it]
  5%|▍         | 1795/37963 [5:37:48<122:02:30, 12.15s/it]
  5%|▍         | 1796/37963 [5:37:59<116:07:58, 11.56s/it]
  5%|▍         | 1797/37963 [5:38:09<112:12:35, 11.17s/it]
  5%|▍         | 1798/37963 [5:38:19<109:02:21, 10.85s/it]
  5%|▍         | 1799/37963 [5:38:36<126:19:31, 12.58s/it]
  5%|▍         | 1800/37963 [5:38:45<118:20:52, 11.78s/it]
                                                          
{'loss': '0.1796', 'grad_norm': '4.708', 'learning_rate': '1.998e-05', 'epoch': '0.04741'}

  5%|▍         | 1800/37963 [5:38:45<118:20:52, 11.78s/it]
  5%|▍         | 1801/37963 [5:38:56<113:27:05, 11.29s/it]
  5%|▍         | 1802/37963 [5:39:06<110:01:49, 10.95s/it]
  5%|▍         | 1803/37963 [5:39:16<107:41:41, 10.72s/it]
  5%|▍         | 1804/37963 [5:39:26<105:57:47, 10.55s/it]
  5%|▍         | 1805/37963 [5:39:36<104:55:21, 10.45s/it]
  5%|▍         | 1806/37963 [5:39:46<104:03:20, 10.36s/it]
  5%|▍         | 1807/37963 [5:39:57<103:32:08, 10.31s/it]
  5%|▍         | 1808/37963 [5:40:07<102:55:15, 10.25s/it]
  5%|▍         | 1809/37963 [5:40:17<102:34:24, 10.21s/it]
  5%|▍         | 1810/37963 [5:40:27<101:41:13, 10.13s/it]
                                                          
{'loss': '0.1866', 'grad_norm': '2.927', 'learning_rate': '1.998e-05', 'epoch': '0.04768'}

  5%|▍         | 1810/37963 [5:40:27<101:41:13, 10.13s/it]
  5%|▍         | 1811/37963 [5:40:37<101:42:11, 10.13s/it]
  5%|▍         | 1812/37963 [5:40:47<101:24:18, 10.10s/it]
  5%|▍         | 1813/37963 [5:40:57<101:25:11, 10.10s/it]
  5%|▍         | 1814/37963 [5:41:07<101:40:33, 10.13s/it]
  5%|▍         | 1815/37963 [5:41:17<101:38:08, 10.12s/it]
  5%|▍         | 1816/37963 [5:41:28<101:45:15, 10.13s/it]
  5%|▍         | 1817/37963 [5:41:38<101:38:43, 10.12s/it]
  5%|▍         | 1818/37963 [5:41:47<100:25:56, 10.00s/it]
  5%|▍         | 1819/37963 [5:41:58<101:15:35, 10.09s/it]
  5%|▍         | 1820/37963 [5:42:08<101:25:16, 10.10s/it]
                                                          
{'loss': '0.1758', 'grad_norm': '2.633', 'learning_rate': '1.998e-05', 'epoch': '0.04794'}

  5%|▍         | 1820/37963 [5:42:08<101:25:16, 10.10s/it]
  5%|▍         | 1821/37963 [5:42:18<101:20:21, 10.09s/it]
  5%|▍         | 1822/37963 [5:42:28<100:26:38, 10.01s/it]
  5%|▍         | 1823/37963 [5:42:38<100:30:37, 10.01s/it]
  5%|▍         | 1824/37963 [5:42:48<100:29:39, 10.01s/it]
  5%|▍         | 1825/37963 [5:42:58<101:06:34, 10.07s/it]
  5%|▍         | 1826/37963 [5:43:08<101:12:00, 10.08s/it]
  5%|▍         | 1827/37963 [5:43:18<101:31:38, 10.11s/it]
  5%|▍         | 1828/37963 [5:43:38<130:08:39, 12.97s/it]
  5%|▍         | 1829/37963 [5:43:54<140:53:55, 14.04s/it]
  5%|▍         | 1830/37963 [5:44:11<148:52:19, 14.83s/it]
                                                          
{'loss': '0.1777', 'grad_norm': '2.642', 'learning_rate': '1.998e-05', 'epoch': '0.0482'}

  5%|▍         | 1830/37963 [5:44:11<148:52:19, 14.83s/it]
  5%|▍         | 1831/37963 [5:44:21<135:07:15, 13.46s/it]
  5%|▍         | 1832/37963 [5:44:31<125:12:33, 12.48s/it]
  5%|▍         | 1833/37963 [5:44:48<137:09:42, 13.67s/it]
  5%|▍         | 1834/37963 [5:44:58<126:30:17, 12.61s/it]
  5%|▍         | 1835/37963 [5:45:08<118:32:16, 11.81s/it]
  5%|▍         | 1836/37963 [5:45:18<113:37:36, 11.32s/it]
  5%|▍         | 1837/37963 [5:45:28<110:03:44, 10.97s/it]
  5%|▍         | 1838/37963 [5:45:39<107:44:02, 10.74s/it]
  5%|▍         | 1839/37963 [5:45:55<124:32:20, 12.41s/it]
  5%|▍         | 1840/37963 [5:46:11<135:05:54, 13.46s/it]
                                                          
{'loss': '0.184', 'grad_norm': '2.14', 'learning_rate': '1.998e-05', 'epoch': '0.04847'}

  5%|▍         | 1840/37963 [5:46:11<135:05:54, 13.46s/it]
  5%|▍         | 1841/37963 [5:46:21<125:19:11, 12.49s/it]
  5%|▍         | 1842/37963 [5:46:38<137:51:15, 13.74s/it]
  5%|▍         | 1843/37963 [5:46:47<126:02:53, 12.56s/it]
  5%|▍         | 1844/37963 [5:46:58<118:44:48, 11.84s/it]
  5%|▍         | 1845/37963 [5:47:08<113:38:37, 11.33s/it]
  5%|▍         | 1846/37963 [5:47:18<110:05:41, 10.97s/it]
  5%|▍         | 1847/37963 [5:47:28<107:27:44, 10.71s/it]
  5%|▍         | 1848/37963 [5:47:38<105:38:00, 10.53s/it]
  5%|▍         | 1849/37963 [5:47:48<104:30:29, 10.42s/it]
  5%|▍         | 1850/37963 [5:48:05<123:05:14, 12.27s/it]
                                                          
{'loss': '0.1841', 'grad_norm': '2.387', 'learning_rate': '1.998e-05', 'epoch': '0.04873'}

  5%|▍         | 1850/37963 [5:48:05<123:05:14, 12.27s/it]
  5%|▍         | 1851/37963 [5:48:15<116:46:30, 11.64s/it]
  5%|▍         | 1852/37963 [5:48:25<112:42:49, 11.24s/it]
  5%|▍         | 1853/37963 [5:48:35<109:29:37, 10.92s/it]
  5%|▍         | 1854/37963 [5:48:45<106:37:35, 10.63s/it]
  5%|▍         | 1855/37963 [5:48:56<105:08:06, 10.48s/it]
  5%|▍         | 1856/37963 [5:49:06<103:40:39, 10.34s/it]
  5%|▍         | 1857/37963 [5:49:16<102:46:39, 10.25s/it]
  5%|▍         | 1858/37963 [5:49:26<102:24:46, 10.21s/it]
  5%|▍         | 1859/37963 [5:49:36<101:46:07, 10.15s/it]
  5%|▍         | 1860/37963 [5:49:46<101:39:24, 10.14s/it]
                                                          
{'loss': '0.1674', 'grad_norm': '2.108', 'learning_rate': '1.998e-05', 'epoch': '0.049'}

  5%|▍         | 1860/37963 [5:49:46<101:39:24, 10.14s/it]
  5%|▍         | 1861/37963 [5:49:56<101:34:24, 10.13s/it]
  5%|▍         | 1862/37963 [5:50:06<100:49:19, 10.05s/it]
  5%|▍         | 1863/37963 [5:50:16<100:44:00, 10.05s/it]
  5%|▍         | 1864/37963 [5:50:26<100:57:03, 10.07s/it]
  5%|▍         | 1865/37963 [5:50:36<101:06:17, 10.08s/it]
  5%|▍         | 1866/37963 [5:50:46<100:29:48, 10.02s/it]
  5%|▍         | 1867/37963 [5:50:56<100:23:55, 10.01s/it]
  5%|▍         | 1868/37963 [5:51:06<100:45:43, 10.05s/it]
  5%|▍         | 1869/37963 [5:51:16<101:10:21, 10.09s/it]
  5%|▍         | 1870/37963 [5:51:26<100:58:11, 10.07s/it]
                                                          
{'loss': '0.1867', 'grad_norm': '3.954', 'learning_rate': '1.998e-05', 'epoch': '0.04926'}

  5%|▍         | 1870/37963 [5:51:26<100:58:11, 10.07s/it]
  5%|▍         | 1871/37963 [5:51:37<101:20:46, 10.11s/it]
  5%|▍         | 1872/37963 [5:51:47<101:40:18, 10.14s/it]
  5%|▍         | 1873/37963 [5:51:57<101:41:35, 10.14s/it]
  5%|▍         | 1874/37963 [5:52:07<102:07:33, 10.19s/it]
  5%|▍         | 1875/37963 [5:52:17<101:48:45, 10.16s/it]
  5%|▍         | 1876/37963 [5:52:34<121:27:51, 12.12s/it]
  5%|▍         | 1877/37963 [5:52:44<115:13:59, 11.50s/it]
  5%|▍         | 1878/37963 [5:53:10<158:07:25, 15.78s/it]
  5%|▍         | 1879/37963 [5:53:20<141:20:01, 14.10s/it]
  5%|▍         | 1880/37963 [5:53:30<129:57:41, 12.97s/it]
                                                          
{'loss': '0.1743', 'grad_norm': '2.31', 'learning_rate': '1.998e-05', 'epoch': '0.04952'}

  5%|▍         | 1880/37963 [5:53:30<129:57:41, 12.97s/it]
  5%|▍         | 1881/37963 [5:53:40<120:15:52, 12.00s/it]
  5%|▍         | 1882/37963 [5:53:50<114:56:36, 11.47s/it]
  5%|▍         | 1883/37963 [5:54:07<130:22:45, 13.01s/it]
  5%|▍         | 1884/37963 [5:54:17<122:13:03, 12.20s/it]
  5%|▍         | 1885/37963 [5:54:34<135:45:05, 13.55s/it]
  5%|▍         | 1886/37963 [5:54:44<125:13:30, 12.50s/it]
  5%|▍         | 1887/37963 [5:54:54<118:07:17, 11.79s/it]
  5%|▍         | 1888/37963 [5:55:11<132:17:08, 13.20s/it]
  5%|▍         | 1889/37963 [5:55:21<123:01:42, 12.28s/it]
  5%|▍         | 1890/37963 [5:55:37<136:02:36, 13.58s/it]
                                                          
{'loss': '0.1807', 'grad_norm': '4.993', 'learning_rate': '1.998e-05', 'epoch': '0.04979'}

  5%|▍         | 1890/37963 [5:55:37<136:02:36, 13.58s/it]
  5%|▍         | 1891/37963 [5:55:47<125:46:46, 12.55s/it]
  5%|▍         | 1892/37963 [5:55:57<117:54:21, 11.77s/it]
  5%|▍         | 1893/37963 [5:56:07<112:46:36, 11.26s/it]
  5%|▍         | 1894/37963 [5:56:18<109:42:23, 10.95s/it]
  5%|▍         | 1895/37963 [5:56:28<107:18:37, 10.71s/it]
  5%|▍         | 1896/37963 [5:56:38<105:34:38, 10.54s/it]
  5%|▍         | 1897/37963 [5:56:48<104:26:41, 10.43s/it]
  5%|▍         | 1898/37963 [5:57:05<122:37:47, 12.24s/it]
  5%|▌         | 1899/37963 [5:57:15<116:19:20, 11.61s/it]
  5%|▌         | 1900/37963 [5:57:25<112:20:31, 11.21s/it]
                                                          
{'loss': '0.1798', 'grad_norm': '3.426', 'learning_rate': '1.998e-05', 'epoch': '0.05005'}

  5%|▌         | 1900/37963 [5:57:25<112:20:31, 11.21s/it]
  5%|▌         | 1901/37963 [5:57:35<108:56:41, 10.88s/it]
  5%|▌         | 1902/37963 [5:57:45<106:43:49, 10.65s/it]
  5%|▌         | 1903/37963 [5:57:56<105:36:18, 10.54s/it]
  5%|▌         | 1904/37963 [5:58:06<104:42:14, 10.45s/it]
  5%|▌         | 1905/37963 [5:58:16<103:53:24, 10.37s/it]
  5%|▌         | 1906/37963 [5:58:26<103:04:24, 10.29s/it]
  5%|▌         | 1907/37963 [5:58:36<101:03:50, 10.09s/it]
  5%|▌         | 1908/37963 [5:58:46<100:51:42, 10.07s/it]
  5%|▌         | 1909/37963 [5:58:55<99:28:35,  9.93s/it] 
  5%|▌         | 1910/37963 [5:59:05<99:42:08,  9.96s/it]
                                                         
{'loss': '0.1841', 'grad_norm': '4.57', 'learning_rate': '1.998e-05', 'epoch': '0.05031'}

  5%|▌         | 1910/37963 [5:59:05<99:42:08,  9.96s/it]
  5%|▌         | 1911/37963 [5:59:16<101:15:48, 10.11s/it]
  5%|▌         | 1912/37963 [5:59:26<101:42:21, 10.16s/it]
  5%|▌         | 1913/37963 [5:59:36<101:35:25, 10.14s/it]
  5%|▌         | 1914/37963 [5:59:46<100:52:28, 10.07s/it]
  5%|▌         | 1915/37963 [5:59:56<100:59:57, 10.09s/it]
  5%|▌         | 1916/37963 [6:00:06<101:16:41, 10.11s/it]
  5%|▌         | 1917/37963 [6:00:17<101:34:53, 10.15s/it]
  5%|▌         | 1918/37963 [6:00:27<101:26:18, 10.13s/it]
  5%|▌         | 1919/37963 [6:00:37<101:41:04, 10.16s/it]
  5%|▌         | 1920/37963 [6:00:47<101:09:09, 10.10s/it]
                                                          
{'loss': '0.1569', 'grad_norm': '5.255', 'learning_rate': '1.998e-05', 'epoch': '0.05058'}

  5%|▌         | 1920/37963 [6:00:47<101:09:09, 10.10s/it]
  5%|▌         | 1921/37963 [6:00:57<100:11:38, 10.01s/it]
  5%|▌         | 1922/37963 [6:01:07<100:16:53, 10.02s/it]
  5%|▌         | 1923/37963 [6:01:17<100:32:48, 10.04s/it]
  5%|▌         | 1924/37963 [6:01:33<119:06:43, 11.90s/it]
  5%|▌         | 1925/37963 [6:01:50<133:10:41, 13.30s/it]
  5%|▌         | 1926/37963 [6:02:09<150:55:07, 15.08s/it]
  5%|▌         | 1927/37963 [6:02:19<136:20:46, 13.62s/it]
  5%|▌         | 1928/37963 [6:02:29<125:10:18, 12.51s/it]
  5%|▌         | 1929/37963 [6:02:39<117:10:53, 11.71s/it]
  5%|▌         | 1930/37963 [6:02:49<112:32:19, 11.24s/it]
                                                          
{'loss': '0.1828', 'grad_norm': '3.088', 'learning_rate': '1.998e-05', 'epoch': '0.05084'}

  5%|▌         | 1930/37963 [6:02:49<112:32:19, 11.24s/it]
  5%|▌         | 1931/37963 [6:03:06<128:23:45, 12.83s/it]
  5%|▌         | 1932/37963 [6:03:16<121:00:39, 12.09s/it]
  5%|▌         | 1933/37963 [6:03:32<134:29:44, 13.44s/it]
  5%|▌         | 1934/37963 [6:03:43<124:37:39, 12.45s/it]
  5%|▌         | 1935/37963 [6:03:53<117:39:56, 11.76s/it]
  5%|▌         | 1936/37963 [6:04:03<112:53:35, 11.28s/it]
  5%|▌         | 1937/37963 [6:04:19<128:09:17, 12.81s/it]
  5%|▌         | 1938/37963 [6:04:29<120:19:40, 12.02s/it]
  5%|▌         | 1939/37963 [6:04:40<114:24:15, 11.43s/it]
  5%|▌         | 1940/37963 [6:04:50<110:04:31, 11.00s/it]
                                                          
{'loss': '0.1824', 'grad_norm': '1.9', 'learning_rate': '1.998e-05', 'epoch': '0.0511'}

  5%|▌         | 1940/37963 [6:04:50<110:04:31, 11.00s/it]
  5%|▌         | 1941/37963 [6:05:06<127:22:19, 12.73s/it]
  5%|▌         | 1942/37963 [6:05:16<119:05:38, 11.90s/it]
  5%|▌         | 1943/37963 [6:05:26<114:01:29, 11.40s/it]
  5%|▌         | 1944/37963 [6:05:37<110:05:48, 11.00s/it]
  5%|▌         | 1945/37963 [6:05:47<107:07:04, 10.71s/it]
  5%|▌         | 1946/37963 [6:06:03<124:25:44, 12.44s/it]
  5%|▌         | 1947/37963 [6:06:13<117:36:54, 11.76s/it]
  5%|▌         | 1948/37963 [6:06:23<112:43:32, 11.27s/it]
  5%|▌         | 1949/37963 [6:06:33<109:15:16, 10.92s/it]
  5%|▌         | 1950/37963 [6:06:44<106:44:21, 10.67s/it]
                                                          
{'loss': '0.1787', 'grad_norm': '4.775', 'learning_rate': '1.998e-05', 'epoch': '0.05137'}

  5%|▌         | 1950/37963 [6:06:44<106:44:21, 10.67s/it]
  5%|▌         | 1951/37963 [6:06:53<104:27:38, 10.44s/it]
  5%|▌         | 1952/37963 [6:07:04<103:37:59, 10.36s/it]
  5%|▌         | 1953/37963 [6:07:14<102:50:08, 10.28s/it]
  5%|▌         | 1954/37963 [6:07:24<102:26:15, 10.24s/it]
  5%|▌         | 1955/37963 [6:07:34<102:25:43, 10.24s/it]
  5%|▌         | 1956/37963 [6:07:44<102:14:50, 10.22s/it]
  5%|▌         | 1957/37963 [6:07:55<102:58:33, 10.30s/it]
  5%|▌         | 1958/37963 [6:08:05<102:31:35, 10.25s/it]
  5%|▌         | 1959/37963 [6:08:15<102:27:59, 10.25s/it]
  5%|▌         | 1960/37963 [6:08:25<101:25:21, 10.14s/it]
                                                          
{'loss': '0.1895', 'grad_norm': '3.48', 'learning_rate': '1.998e-05', 'epoch': '0.05163'}

  5%|▌         | 1960/37963 [6:08:25<101:25:21, 10.14s/it]
  5%|▌         | 1961/37963 [6:08:35<101:40:43, 10.17s/it]
  5%|▌         | 1962/37963 [6:08:45<100:36:35, 10.06s/it]
  5%|▌         | 1963/37963 [6:08:55<101:01:04, 10.10s/it]
  5%|▌         | 1964/37963 [6:09:05<101:10:45, 10.12s/it]
  5%|▌         | 1965/37963 [6:09:16<101:25:00, 10.14s/it]
  5%|▌         | 1966/37963 [6:09:26<101:19:14, 10.13s/it]
  5%|▌         | 1967/37963 [6:09:36<101:16:36, 10.13s/it]
  5%|▌         | 1968/37963 [6:09:46<101:40:47, 10.17s/it]
  5%|▌         | 1969/37963 [6:09:56<101:47:27, 10.18s/it]
  5%|▌         | 1970/37963 [6:10:06<101:21:44, 10.14s/it]
                                                          
{'loss': '0.1749', 'grad_norm': '4.145', 'learning_rate': '1.997e-05', 'epoch': '0.05189'}

  5%|▌         | 1970/37963 [6:10:06<101:21:44, 10.14s/it]
  5%|▌         | 1971/37963 [6:10:16<101:18:02, 10.13s/it]
  5%|▌         | 1972/37963 [6:10:33<120:12:19, 12.02s/it]
  5%|▌         | 1973/37963 [6:10:43<114:14:28, 11.43s/it]
  5%|▌         | 1974/37963 [6:10:59<129:09:17, 12.92s/it]
  5%|▌         | 1975/37963 [6:11:09<120:47:36, 12.08s/it]
  5%|▌         | 1976/37963 [6:11:20<114:57:27, 11.50s/it]
  5%|▌         | 1977/37963 [6:11:39<138:57:17, 13.90s/it]
  5%|▌         | 1978/37963 [6:11:49<128:10:53, 12.82s/it]
  5%|▌         | 1979/37963 [6:11:59<119:14:27, 11.93s/it]
  5%|▌         | 1980/37963 [6:12:19<142:40:10, 14.27s/it]
                                                          
{'loss': '0.1829', 'grad_norm': '1.981', 'learning_rate': '1.997e-05', 'epoch': '0.05216'}

  5%|▌         | 1980/37963 [6:12:19<142:40:10, 14.27s/it]
  5%|▌         | 1981/37963 [6:12:35<149:15:13, 14.93s/it]
  5%|▌         | 1982/37963 [6:12:46<134:35:57, 13.47s/it]
  5%|▌         | 1983/37963 [6:12:56<124:39:16, 12.47s/it]
  5%|▌         | 1984/37963 [6:13:06<117:29:01, 11.76s/it]
  5%|▌         | 1985/37963 [6:13:16<113:01:23, 11.31s/it]
  5%|▌         | 1986/37963 [6:13:26<109:22:48, 10.94s/it]
  5%|▌         | 1987/37963 [6:13:43<126:10:10, 12.63s/it]
  5%|▌         | 1988/37963 [6:13:52<117:19:59, 11.74s/it]
  5%|▌         | 1989/37963 [6:14:09<131:53:24, 13.20s/it]
  5%|▌         | 1990/37963 [6:14:19<122:05:57, 12.22s/it]
                                                          
{'loss': '0.1672', 'grad_norm': '2.116', 'learning_rate': '1.997e-05', 'epoch': '0.05242'}

  5%|▌         | 1990/37963 [6:14:19<122:05:57, 12.22s/it]
  5%|▌         | 1991/37963 [6:14:28<113:35:59, 11.37s/it]
  5%|▌         | 1992/37963 [6:14:38<109:49:14, 10.99s/it]
  5%|▌         | 1993/37963 [6:14:49<107:12:43, 10.73s/it]
  5%|▌         | 1994/37963 [6:14:59<105:20:49, 10.54s/it]
  5%|▌         | 1995/37963 [6:15:09<104:09:15, 10.42s/it]
  5%|▌         | 1996/37963 [6:15:26<123:34:31, 12.37s/it]
  5%|▌         | 1997/37963 [6:15:36<116:30:15, 11.66s/it]
  5%|▌         | 1998/37963 [6:15:46<112:11:27, 11.23s/it]
  5%|▌         | 1999/37963 [6:15:56<109:35:00, 10.97s/it]
  5%|▌         | 2000/37963 [6:16:06<106:24:46, 10.65s/it]
                                                          
{'loss': '0.1807', 'grad_norm': '5.416', 'learning_rate': '1.997e-05', 'epoch': '0.05268'}

  5%|▌         | 2000/37963 [6:16:06<106:24:46, 10.65s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.46s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.46s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  5%|▌         | 2001/37963 [6:17:07<256:35:11, 25.69s/it]
  5%|▌         | 2002/37963 [6:17:17<209:58:15, 21.02s/it]
  5%|▌         | 2003/37963 [6:17:27<175:33:05, 17.57s/it]
  5%|▌         | 2004/37963 [6:17:37<152:39:33, 15.28s/it]
  5%|▌         | 2005/37963 [6:17:47<137:04:14, 13.72s/it]
  5%|▌         | 2006/37963 [6:17:57<126:44:06, 12.69s/it]
  5%|▌         | 2007/37963 [6:18:07<119:30:58, 11.97s/it]
  5%|▌         | 2008/37963 [6:18:17<113:56:31, 11.41s/it]
  5%|▌         | 2009/37963 [6:18:28<110:27:47, 11.06s/it]
  5%|▌         | 2010/37963 [6:18:38<108:06:23, 10.82s/it]
                                                          
{'loss': '0.1762', 'grad_norm': '0.9909', 'learning_rate': '1.997e-05', 'epoch': '0.05295'}

  5%|▌         | 2010/37963 [6:18:38<108:06:23, 10.82s/it]
  5%|▌         | 2011/37963 [6:18:48<105:37:55, 10.58s/it]
  5%|▌         | 2012/37963 [6:18:58<104:20:56, 10.45s/it]
  5%|▌         | 2013/37963 [6:19:08<103:36:20, 10.37s/it]
  5%|▌         | 2014/37963 [6:19:18<102:54:59, 10.31s/it]
  5%|▌         | 2015/37963 [6:19:28<102:31:34, 10.27s/it]
  5%|▌         | 2016/37963 [6:19:39<102:09:26, 10.23s/it]
  5%|▌         | 2017/37963 [6:19:48<100:38:41, 10.08s/it]
  5%|▌         | 2018/37963 [6:19:59<100:56:32, 10.11s/it]
  5%|▌         | 2019/37963 [6:20:15<120:45:08, 12.09s/it]
  5%|▌         | 2020/37963 [6:20:32<133:26:00, 13.36s/it]
                                                          
{'loss': '0.1899', 'grad_norm': '3.69', 'learning_rate': '1.997e-05', 'epoch': '0.05321'}

  5%|▌         | 2020/37963 [6:20:32<133:26:00, 13.36s/it]
  5%|▌         | 2021/37963 [6:20:41<123:00:42, 12.32s/it]
  5%|▌         | 2022/37963 [6:20:51<115:43:01, 11.59s/it]
  5%|▌         | 2023/37963 [6:21:01<109:51:58, 11.00s/it]
  5%|▌         | 2024/37963 [6:21:18<127:18:35, 12.75s/it]
  5%|▌         | 2025/37963 [6:21:28<118:53:33, 11.91s/it]
  5%|▌         | 2026/37963 [6:21:38<113:06:34, 11.33s/it]
  5%|▌         | 2027/37963 [6:21:48<109:25:06, 10.96s/it]
  5%|▌         | 2028/37963 [6:22:04<126:00:44, 12.62s/it]
  5%|▌         | 2029/37963 [6:22:14<118:31:43, 11.87s/it]
  5%|▌         | 2030/37963 [6:22:34<140:38:09, 14.09s/it]
                                                          
{'loss': '0.1795', 'grad_norm': '2.724', 'learning_rate': '1.997e-05', 'epoch': '0.05347'}

  5%|▌         | 2030/37963 [6:22:34<140:38:09, 14.09s/it]
  5%|▌         | 2031/37963 [6:22:44<128:48:14, 12.90s/it]
  5%|▌         | 2032/37963 [6:22:54<120:46:07, 12.10s/it]
  5%|▌         | 2033/37963 [6:23:04<114:44:56, 11.50s/it]
  5%|▌         | 2034/37963 [6:23:14<110:46:21, 11.10s/it]
  5%|▌         | 2035/37963 [6:23:31<127:09:53, 12.74s/it]
  5%|▌         | 2036/37963 [6:23:41<119:26:35, 11.97s/it]
  5%|▌         | 2037/37963 [6:23:51<114:16:58, 11.45s/it]
  5%|▌         | 2038/37963 [6:24:02<110:35:02, 11.08s/it]
  5%|▌         | 2039/37963 [6:24:11<106:56:24, 10.72s/it]
  5%|▌         | 2040/37963 [6:24:21<104:35:20, 10.48s/it]
                                                          
{'loss': '0.1757', 'grad_norm': '3.107', 'learning_rate': '1.997e-05', 'epoch': '0.05374'}

  5%|▌         | 2040/37963 [6:24:21<104:35:20, 10.48s/it]
  5%|▌         | 2041/37963 [6:24:38<123:47:49, 12.41s/it]
  5%|▌         | 2042/37963 [6:24:48<117:01:34, 11.73s/it]
  5%|▌         | 2043/37963 [6:25:05<130:36:45, 13.09s/it]
  5%|▌         | 2044/37963 [6:25:15<121:31:20, 12.18s/it]
  5%|▌         | 2045/37963 [6:25:25<115:53:59, 11.62s/it]
  5%|▌         | 2046/37963 [6:25:35<111:18:31, 11.16s/it]
  5%|▌         | 2047/37963 [6:25:45<108:11:50, 10.85s/it]
  5%|▌         | 2048/37963 [6:25:55<106:05:16, 10.63s/it]
  5%|▌         | 2049/37963 [6:26:05<104:29:49, 10.47s/it]
  5%|▌         | 2050/37963 [6:26:16<103:51:36, 10.41s/it]
                                                          
{'loss': '0.1696', 'grad_norm': '1.936', 'learning_rate': '1.997e-05', 'epoch': '0.054'}

  5%|▌         | 2050/37963 [6:26:16<103:51:36, 10.41s/it]
  5%|▌         | 2051/37963 [6:26:26<103:01:01, 10.33s/it]
  5%|▌         | 2052/37963 [6:26:36<102:07:23, 10.24s/it]
  5%|▌         | 2053/37963 [6:26:46<101:51:47, 10.21s/it]
  5%|▌         | 2054/37963 [6:26:56<101:53:37, 10.22s/it]
  5%|▌         | 2055/37963 [6:27:06<101:00:10, 10.13s/it]
  5%|▌         | 2056/37963 [6:27:16<100:21:49, 10.06s/it]
  5%|▌         | 2057/37963 [6:27:26<98:45:43,  9.90s/it] 
  5%|▌         | 2058/37963 [6:27:36<98:51:39,  9.91s/it]
  5%|▌         | 2059/37963 [6:27:46<99:24:15,  9.97s/it]
  5%|▌         | 2060/37963 [6:27:56<100:12:27, 10.05s/it]
                                                          
{'loss': '0.1871', 'grad_norm': '2.275', 'learning_rate': '1.997e-05', 'epoch': '0.05426'}

  5%|▌         | 2060/37963 [6:27:56<100:12:27, 10.05s/it]
  5%|▌         | 2061/37963 [6:28:06<99:50:23, 10.01s/it] 
  5%|▌         | 2062/37963 [6:28:16<100:20:34, 10.06s/it]
  5%|▌         | 2063/37963 [6:28:26<100:42:19, 10.10s/it]
  5%|▌         | 2064/37963 [6:28:36<100:20:27, 10.06s/it]
  5%|▌         | 2065/37963 [6:28:46<100:36:23, 10.09s/it]
  5%|▌         | 2066/37963 [6:28:56<100:37:48, 10.09s/it]
  5%|▌         | 2067/37963 [6:29:07<100:45:20, 10.10s/it]
  5%|▌         | 2068/37963 [6:29:17<100:54:10, 10.12s/it]
  5%|▌         | 2069/37963 [6:29:33<120:35:58, 12.10s/it]
  5%|▌         | 2070/37963 [6:29:44<115:02:45, 11.54s/it]
                                                          
{'loss': '0.1848', 'grad_norm': '5.539', 'learning_rate': '1.997e-05', 'epoch': '0.05453'}

  5%|▌         | 2070/37963 [6:29:44<115:02:45, 11.54s/it]
  5%|▌         | 2071/37963 [6:29:54<110:17:58, 11.06s/it]
  5%|▌         | 2072/37963 [6:30:04<107:40:49, 10.80s/it]
  5%|▌         | 2073/37963 [6:30:27<144:17:01, 14.47s/it]
  5%|▌         | 2074/37963 [6:30:47<160:09:09, 16.06s/it]
  5%|▌         | 2075/37963 [6:30:57<142:26:00, 14.29s/it]
  5%|▌         | 2076/37963 [6:31:07<130:03:35, 13.05s/it]
  5%|▌         | 2077/37963 [6:31:23<140:10:49, 14.06s/it]
  5%|▌         | 2078/37963 [6:31:33<128:02:17, 12.84s/it]
  5%|▌         | 2079/37963 [6:31:43<119:09:22, 11.95s/it]
  5%|▌         | 2080/37963 [6:31:53<113:58:44, 11.44s/it]
                                                          
{'loss': '0.1697', 'grad_norm': '4.471', 'learning_rate': '1.997e-05', 'epoch': '0.05479'}

  5%|▌         | 2080/37963 [6:31:53<113:58:44, 11.44s/it]
  5%|▌         | 2081/37963 [6:32:10<128:23:20, 12.88s/it]
  5%|▌         | 2082/37963 [6:32:20<119:40:17, 12.01s/it]
  5%|▌         | 2083/37963 [6:32:30<113:11:29, 11.36s/it]
  5%|▌         | 2084/37963 [6:32:40<109:41:04, 11.01s/it]
  5%|▌         | 2085/37963 [6:32:50<107:12:38, 10.76s/it]
  5%|▌         | 2086/37963 [6:33:00<105:29:27, 10.59s/it]
  5%|▌         | 2087/37963 [6:33:10<104:04:17, 10.44s/it]
  6%|▌         | 2088/37963 [6:33:20<102:06:20, 10.25s/it]
  6%|▌         | 2089/37963 [6:33:30<101:50:36, 10.22s/it]
  6%|▌         | 2090/37963 [6:33:47<120:54:59, 12.13s/it]
                                                          
{'loss': '0.1789', 'grad_norm': '2.437', 'learning_rate': '1.997e-05', 'epoch': '0.05505'}

  6%|▌         | 2090/37963 [6:33:47<120:54:59, 12.13s/it]
  6%|▌         | 2091/37963 [6:33:57<114:55:18, 11.53s/it]
  6%|▌         | 2092/37963 [6:34:13<129:58:13, 13.04s/it]
  6%|▌         | 2093/37963 [6:34:24<121:18:19, 12.17s/it]
  6%|▌         | 2094/37963 [6:34:34<114:49:01, 11.52s/it]
  6%|▌         | 2095/37963 [6:34:44<110:18:18, 11.07s/it]
  6%|▌         | 2096/37963 [6:34:54<107:44:47, 10.81s/it]
  6%|▌         | 2097/37963 [6:35:04<105:40:21, 10.61s/it]
  6%|▌         | 2098/37963 [6:35:14<103:47:56, 10.42s/it]
  6%|▌         | 2099/37963 [6:35:24<102:56:58, 10.33s/it]
  6%|▌         | 2100/37963 [6:35:34<102:16:08, 10.27s/it]
                                                          
{'loss': '0.1893', 'grad_norm': '2.036', 'learning_rate': '1.997e-05', 'epoch': '0.05532'}

  6%|▌         | 2100/37963 [6:35:34<102:16:08, 10.27s/it]
  6%|▌         | 2101/37963 [6:35:44<102:02:07, 10.24s/it]
  6%|▌         | 2102/37963 [6:35:54<100:42:17, 10.11s/it]
  6%|▌         | 2103/37963 [6:36:04<100:53:29, 10.13s/it]
  6%|▌         | 2104/37963 [6:36:14<99:08:10,  9.95s/it] 
  6%|▌         | 2105/37963 [6:36:24<99:25:41,  9.98s/it]
  6%|▌         | 2106/37963 [6:36:34<99:59:28, 10.04s/it]
  6%|▌         | 2107/37963 [6:36:44<100:18:17, 10.07s/it]
  6%|▌         | 2108/37963 [6:36:54<100:00:07, 10.04s/it]
  6%|▌         | 2109/37963 [6:37:04<100:17:32, 10.07s/it]
  6%|▌         | 2110/37963 [6:37:14<99:58:35, 10.04s/it] 
                                                         
{'loss': '0.1688', 'grad_norm': '5.004', 'learning_rate': '1.997e-05', 'epoch': '0.05558'}

  6%|▌         | 2110/37963 [6:37:14<99:58:35, 10.04s/it]
  6%|▌         | 2111/37963 [6:37:24<99:29:22,  9.99s/it]
  6%|▌         | 2112/37963 [6:37:34<99:53:44, 10.03s/it]
  6%|▌         | 2113/37963 [6:37:44<100:01:55, 10.05s/it]
  6%|▌         | 2114/37963 [6:37:55<100:29:23, 10.09s/it]
  6%|▌         | 2115/37963 [6:38:05<100:56:44, 10.14s/it]
  6%|▌         | 2116/37963 [6:38:15<100:52:28, 10.13s/it]
  6%|▌         | 2117/37963 [6:38:25<100:38:49, 10.11s/it]
  6%|▌         | 2118/37963 [6:38:35<98:52:04,  9.93s/it] 
  6%|▌         | 2119/37963 [6:38:51<117:43:09, 11.82s/it]
  6%|▌         | 2120/37963 [6:39:01<112:40:53, 11.32s/it]
                                                          
{'loss': '0.176', 'grad_norm': '2.504', 'learning_rate': '1.997e-05', 'epoch': '0.05584'}

  6%|▌         | 2120/37963 [6:39:01<112:40:53, 11.32s/it]
  6%|▌         | 2121/37963 [6:39:17<127:58:18, 12.85s/it]
  6%|▌         | 2122/37963 [6:39:42<162:09:50, 16.29s/it]
  6%|▌         | 2123/37963 [6:39:52<143:58:25, 14.46s/it]
  6%|▌         | 2124/37963 [6:40:08<150:10:22, 15.08s/it]
  6%|▌         | 2125/37963 [6:40:18<134:42:20, 13.53s/it]
  6%|▌         | 2126/37963 [6:40:28<124:27:20, 12.50s/it]
  6%|▌         | 2127/37963 [6:40:39<117:31:05, 11.81s/it]
  6%|▌         | 2128/37963 [6:40:49<112:45:40, 11.33s/it]
  6%|▌         | 2129/37963 [6:41:05<128:34:13, 12.92s/it]
  6%|▌         | 2130/37963 [6:41:16<120:34:11, 12.11s/it]
                                                          
{'loss': '0.1825', 'grad_norm': '6.56', 'learning_rate': '1.996e-05', 'epoch': '0.05611'}

  6%|▌         | 2130/37963 [6:41:16<120:34:11, 12.11s/it]
  6%|▌         | 2131/37963 [6:41:26<115:06:21, 11.56s/it]
  6%|▌         | 2132/37963 [6:41:36<111:00:36, 11.15s/it]
  6%|▌         | 2133/37963 [6:41:46<107:50:22, 10.84s/it]
  6%|▌         | 2134/37963 [6:41:56<106:07:52, 10.66s/it]
  6%|▌         | 2135/37963 [6:42:07<104:32:34, 10.50s/it]
  6%|▌         | 2136/37963 [6:42:17<103:37:48, 10.41s/it]
  6%|▌         | 2137/37963 [6:42:27<102:52:53, 10.34s/it]
  6%|▌         | 2138/37963 [6:42:37<102:13:15, 10.27s/it]
  6%|▌         | 2139/37963 [6:42:54<121:24:10, 12.20s/it]
  6%|▌         | 2140/37963 [6:43:04<115:32:03, 11.61s/it]
                                                          
{'loss': '0.1777', 'grad_norm': '2.504', 'learning_rate': '1.996e-05', 'epoch': '0.05637'}

  6%|▌         | 2140/37963 [6:43:04<115:32:03, 11.61s/it]
  6%|▌         | 2141/37963 [6:43:14<111:08:09, 11.17s/it]
  6%|▌         | 2142/37963 [6:43:31<126:46:01, 12.74s/it]
  6%|▌         | 2143/37963 [6:43:41<119:08:36, 11.97s/it]
  6%|▌         | 2144/37963 [6:43:51<113:45:26, 11.43s/it]
  6%|▌         | 2145/37963 [6:44:01<110:14:09, 11.08s/it]
  6%|▌         | 2146/37963 [6:44:11<106:57:37, 10.75s/it]
  6%|▌         | 2147/37963 [6:44:21<105:36:47, 10.62s/it]
  6%|▌         | 2148/37963 [6:44:32<104:20:37, 10.49s/it]
  6%|▌         | 2149/37963 [6:44:41<101:30:34, 10.20s/it]
  6%|▌         | 2150/37963 [6:44:51<100:42:32, 10.12s/it]
                                                          
{'loss': '0.1634', 'grad_norm': '2.454', 'learning_rate': '1.996e-05', 'epoch': '0.05663'}

  6%|▌         | 2150/37963 [6:44:51<100:42:32, 10.12s/it]
  6%|▌         | 2151/37963 [6:45:01<100:46:32, 10.13s/it]
  6%|▌         | 2152/37963 [6:45:11<100:47:19, 10.13s/it]
  6%|▌         | 2153/37963 [6:45:22<101:05:15, 10.16s/it]
  6%|▌         | 2154/37963 [6:45:31<99:48:23, 10.03s/it] 
  6%|▌         | 2155/37963 [6:45:41<99:41:37, 10.02s/it]
  6%|▌         | 2156/37963 [6:45:51<99:54:55, 10.05s/it]
  6%|▌         | 2157/37963 [6:46:02<100:29:31, 10.10s/it]
  6%|▌         | 2158/37963 [6:46:11<99:29:55, 10.00s/it] 
  6%|▌         | 2159/37963 [6:46:21<99:18:39,  9.99s/it]
  6%|▌         | 2160/37963 [6:46:32<99:52:44, 10.04s/it]
                                                         
{'loss': '0.1599', 'grad_norm': '2.769', 'learning_rate': '1.996e-05', 'epoch': '0.0569'}

  6%|▌         | 2160/37963 [6:46:32<99:52:44, 10.04s/it]
  6%|▌         | 2161/37963 [6:46:42<100:13:41, 10.08s/it]
  6%|▌         | 2162/37963 [6:46:52<100:04:19, 10.06s/it]
  6%|▌         | 2163/37963 [6:47:02<99:43:41, 10.03s/it] 
  6%|▌         | 2164/37963 [6:47:12<99:48:00, 10.04s/it]
  6%|▌         | 2165/37963 [6:47:22<99:23:08,  9.99s/it]
  6%|▌         | 2166/37963 [6:47:32<99:50:54, 10.04s/it]
  6%|▌         | 2167/37963 [6:47:42<99:56:30, 10.05s/it]
  6%|▌         | 2168/37963 [6:48:05<137:43:46, 13.85s/it]
  6%|▌         | 2169/37963 [6:48:14<125:09:01, 12.59s/it]
  6%|▌         | 2170/37963 [6:48:24<117:01:22, 11.77s/it]
                                                          
{'loss': '0.1532', 'grad_norm': '3.115', 'learning_rate': '1.996e-05', 'epoch': '0.05716'}

  6%|▌         | 2170/37963 [6:48:24<117:01:22, 11.77s/it]
  6%|▌         | 2171/37963 [6:48:41<130:54:17, 13.17s/it]
  6%|▌         | 2172/37963 [6:48:57<140:35:40, 14.14s/it]
  6%|▌         | 2173/37963 [6:49:07<128:50:43, 12.96s/it]
  6%|▌         | 2174/37963 [6:49:17<120:01:03, 12.07s/it]
  6%|▌         | 2175/37963 [6:49:37<142:09:04, 14.30s/it]
  6%|▌         | 2176/37963 [6:49:47<129:35:25, 13.04s/it]
  6%|▌         | 2177/37963 [6:49:57<121:07:17, 12.18s/it]
  6%|▌         | 2178/37963 [6:50:07<114:46:13, 11.55s/it]
  6%|▌         | 2179/37963 [6:50:24<129:57:44, 13.07s/it]
  6%|▌         | 2180/37963 [6:50:34<121:26:57, 12.22s/it]
                                                          
{'loss': '0.1938', 'grad_norm': '2.766', 'learning_rate': '1.996e-05', 'epoch': '0.05742'}

  6%|▌         | 2180/37963 [6:50:34<121:26:57, 12.22s/it]
  6%|▌         | 2181/37963 [6:50:44<115:12:31, 11.59s/it]
  6%|▌         | 2182/37963 [6:50:54<110:50:13, 11.15s/it]
  6%|▌         | 2183/37963 [6:51:04<107:52:05, 10.85s/it]
  6%|▌         | 2184/37963 [6:51:14<105:52:17, 10.65s/it]
  6%|▌         | 2185/37963 [6:51:25<104:38:11, 10.53s/it]
  6%|▌         | 2186/37963 [6:51:41<122:25:30, 12.32s/it]
  6%|▌         | 2187/37963 [6:51:51<114:31:27, 11.52s/it]
  6%|▌         | 2188/37963 [6:52:01<110:27:43, 11.12s/it]
  6%|▌         | 2189/37963 [6:52:11<107:27:39, 10.81s/it]
  6%|▌         | 2190/37963 [6:52:28<124:45:43, 12.56s/it]
                                                          
{'loss': '0.1917', 'grad_norm': '7.738', 'learning_rate': '1.996e-05', 'epoch': '0.05769'}

  6%|▌         | 2190/37963 [6:52:28<124:45:43, 12.56s/it]
  6%|▌         | 2191/37963 [6:52:38<117:22:47, 11.81s/it]
  6%|▌         | 2192/37963 [6:52:48<112:32:18, 11.33s/it]
  6%|▌         | 2193/37963 [6:52:58<108:29:45, 10.92s/it]
  6%|▌         | 2194/37963 [6:53:08<106:07:35, 10.68s/it]
  6%|▌         | 2195/37963 [6:53:18<104:45:34, 10.54s/it]
  6%|▌         | 2196/37963 [6:53:29<103:46:17, 10.44s/it]
  6%|▌         | 2197/37963 [6:53:39<102:55:43, 10.36s/it]
  6%|▌         | 2198/37963 [6:53:48<101:02:45, 10.17s/it]
  6%|▌         | 2199/37963 [6:53:59<101:11:31, 10.19s/it]
  6%|▌         | 2200/37963 [6:54:09<100:07:03, 10.08s/it]
                                                          
{'loss': '0.1671', 'grad_norm': '1.816', 'learning_rate': '1.996e-05', 'epoch': '0.05795'}

  6%|▌         | 2200/37963 [6:54:09<100:07:03, 10.08s/it]
  6%|▌         | 2201/37963 [6:54:18<99:20:25, 10.00s/it] 
  6%|▌         | 2202/37963 [6:54:29<99:59:02, 10.07s/it]
  6%|▌         | 2203/37963 [6:54:39<100:12:33, 10.09s/it]
  6%|▌         | 2204/37963 [6:54:49<100:11:02, 10.09s/it]
  6%|▌         | 2205/37963 [6:54:59<100:09:39, 10.08s/it]
  6%|▌         | 2206/37963 [6:55:09<100:23:23, 10.11s/it]
  6%|▌         | 2207/37963 [6:55:19<100:30:21, 10.12s/it]
  6%|▌         | 2208/37963 [6:55:29<100:49:28, 10.15s/it]
  6%|▌         | 2209/37963 [6:55:40<100:46:57, 10.15s/it]
  6%|▌         | 2210/37963 [6:55:50<101:03:10, 10.18s/it]
                                                          
{'loss': '0.1744', 'grad_norm': '3.92', 'learning_rate': '1.996e-05', 'epoch': '0.05821'}

  6%|▌         | 2210/37963 [6:55:50<101:03:10, 10.18s/it]
  6%|▌         | 2211/37963 [6:56:00<100:57:56, 10.17s/it]
  6%|▌         | 2212/37963 [6:56:10<100:49:43, 10.15s/it]
  6%|▌         | 2213/37963 [6:56:20<100:52:55, 10.16s/it]
  6%|▌         | 2214/37963 [6:56:30<101:15:10, 10.20s/it]
  6%|▌         | 2215/37963 [6:56:41<101:21:49, 10.21s/it]
  6%|▌         | 2216/37963 [6:56:51<100:24:10, 10.11s/it]
  6%|▌         | 2217/37963 [6:57:07<119:32:16, 12.04s/it]
  6%|▌         | 2218/37963 [6:57:24<133:36:32, 13.46s/it]
  6%|▌         | 2219/37963 [6:57:44<152:04:45, 15.32s/it]
  6%|▌         | 2220/37963 [6:57:54<136:18:23, 13.73s/it]
                                                          
{'loss': '0.1668', 'grad_norm': '3.048', 'learning_rate': '1.996e-05', 'epoch': '0.05848'}

  6%|▌         | 2220/37963 [6:57:54<136:18:23, 13.73s/it]
  6%|▌         | 2221/37963 [6:58:17<164:56:00, 16.61s/it]
  6%|▌         | 2222/37963 [6:58:27<145:40:44, 14.67s/it]
  6%|▌         | 2223/37963 [6:58:37<132:07:42, 13.31s/it]
  6%|▌         | 2224/37963 [6:58:47<122:21:45, 12.33s/it]
  6%|▌         | 2225/37963 [6:58:57<114:59:06, 11.58s/it]
  6%|▌         | 2226/37963 [6:59:07<108:56:52, 10.97s/it]
  6%|▌         | 2227/37963 [6:59:17<106:46:39, 10.76s/it]
  6%|▌         | 2228/37963 [6:59:27<104:47:47, 10.56s/it]
  6%|▌         | 2229/37963 [6:59:37<103:15:34, 10.40s/it]
  6%|▌         | 2230/37963 [6:59:54<121:35:02, 12.25s/it]
                                                          
{'loss': '0.1796', 'grad_norm': '4.592', 'learning_rate': '1.996e-05', 'epoch': '0.05874'}

  6%|▌         | 2230/37963 [6:59:54<121:35:02, 12.25s/it]
  6%|▌         | 2231/37963 [7:00:10<133:47:15, 13.48s/it]
  6%|▌         | 2232/37963 [7:00:20<124:14:55, 12.52s/it]
  6%|▌         | 2233/37963 [7:00:30<116:45:06, 11.76s/it]
  6%|▌         | 2234/37963 [7:00:40<111:04:39, 11.19s/it]
  6%|▌         | 2235/37963 [7:00:50<107:49:43, 10.86s/it]
  6%|▌         | 2236/37963 [7:01:00<105:49:00, 10.66s/it]
  6%|▌         | 2237/37963 [7:01:11<104:26:38, 10.52s/it]
  6%|▌         | 2238/37963 [7:01:27<121:15:21, 12.22s/it]
  6%|▌         | 2239/37963 [7:01:37<115:06:23, 11.60s/it]
  6%|▌         | 2240/37963 [7:01:47<110:13:48, 11.11s/it]
                                                          
{'loss': '0.1654', 'grad_norm': '5.715', 'learning_rate': '1.996e-05', 'epoch': '0.05901'}

  6%|▌         | 2240/37963 [7:01:47<110:13:48, 11.11s/it]
  6%|▌         | 2241/37963 [7:01:57<106:35:35, 10.74s/it]
  6%|▌         | 2242/37963 [7:02:07<104:48:49, 10.56s/it]
  6%|▌         | 2243/37963 [7:02:17<103:33:12, 10.44s/it]
  6%|▌         | 2244/37963 [7:02:27<102:43:18, 10.35s/it]
  6%|▌         | 2245/37963 [7:02:37<101:12:25, 10.20s/it]
  6%|▌         | 2246/37963 [7:02:47<101:12:13, 10.20s/it]
  6%|▌         | 2247/37963 [7:02:57<101:01:02, 10.18s/it]
  6%|▌         | 2248/37963 [7:03:07<100:40:47, 10.15s/it]
  6%|▌         | 2249/37963 [7:03:18<100:39:25, 10.15s/it]
  6%|▌         | 2250/37963 [7:03:27<99:47:17, 10.06s/it] 
                                                         
{'loss': '0.179', 'grad_norm': '4.53', 'learning_rate': '1.996e-05', 'epoch': '0.05927'}

  6%|▌         | 2250/37963 [7:03:27<99:47:17, 10.06s/it]
  6%|▌         | 2251/37963 [7:03:38<100:13:50, 10.10s/it]
  6%|▌         | 2252/37963 [7:03:47<98:59:06,  9.98s/it] 
  6%|▌         | 2253/37963 [7:03:57<99:28:01, 10.03s/it]
  6%|▌         | 2254/37963 [7:04:07<99:07:09,  9.99s/it]
  6%|▌         | 2255/37963 [7:04:17<98:22:46,  9.92s/it]
  6%|▌         | 2256/37963 [7:04:27<98:50:45,  9.97s/it]
  6%|▌         | 2257/37963 [7:04:37<98:50:57,  9.97s/it]
  6%|▌         | 2258/37963 [7:04:47<98:30:37,  9.93s/it]
  6%|▌         | 2259/37963 [7:04:57<98:40:15,  9.95s/it]
  6%|▌         | 2260/37963 [7:05:07<98:42:26,  9.95s/it]
                                                         
{'loss': '0.1745', 'grad_norm': '2.182', 'learning_rate': '1.995e-05', 'epoch': '0.05953'}

  6%|▌         | 2260/37963 [7:05:07<98:42:26,  9.95s/it]
  6%|▌         | 2261/37963 [7:05:17<99:28:24, 10.03s/it]
  6%|▌         | 2262/37963 [7:05:27<99:37:29, 10.05s/it]
  6%|▌         | 2263/37963 [7:05:37<99:21:49, 10.02s/it]
  6%|▌         | 2264/37963 [7:05:47<99:41:12, 10.05s/it]
  6%|▌         | 2265/37963 [7:06:10<138:37:22, 13.98s/it]
  6%|▌         | 2266/37963 [7:06:21<127:17:31, 12.84s/it]
  6%|▌         | 2267/37963 [7:06:31<119:43:19, 12.07s/it]
  6%|▌         | 2268/37963 [7:06:47<132:47:03, 13.39s/it]
  6%|▌         | 2269/37963 [7:06:58<123:17:58, 12.44s/it]
  6%|▌         | 2270/37963 [7:07:17<143:40:51, 14.49s/it]
                                                          
{'loss': '0.1688', 'grad_norm': '5.092', 'learning_rate': '1.995e-05', 'epoch': '0.0598'}

  6%|▌         | 2270/37963 [7:07:17<143:40:51, 14.49s/it]
  6%|▌         | 2271/37963 [7:07:27<130:47:04, 13.19s/it]
  6%|▌         | 2272/37963 [7:07:44<140:32:55, 14.18s/it]
  6%|▌         | 2273/37963 [7:07:53<127:05:24, 12.82s/it]
  6%|▌         | 2274/37963 [7:08:03<118:58:12, 12.00s/it]
  6%|▌         | 2275/37963 [7:08:14<113:55:23, 11.49s/it]
  6%|▌         | 2276/37963 [7:08:24<109:28:57, 11.04s/it]
  6%|▌         | 2277/37963 [7:08:34<106:46:39, 10.77s/it]
  6%|▌         | 2278/37963 [7:08:50<123:36:03, 12.47s/it]
  6%|▌         | 2279/37963 [7:09:00<116:55:32, 11.80s/it]
  6%|▌         | 2280/37963 [7:09:11<112:03:18, 11.31s/it]
                                                          
{'loss': '0.1796', 'grad_norm': '3.968', 'learning_rate': '1.995e-05', 'epoch': '0.06006'}

  6%|▌         | 2280/37963 [7:09:11<112:03:18, 11.31s/it]
  6%|▌         | 2281/37963 [7:09:27<127:49:37, 12.90s/it]
  6%|▌         | 2282/37963 [7:09:37<119:21:22, 12.04s/it]
  6%|▌         | 2283/37963 [7:09:47<113:30:22, 11.45s/it]
  6%|▌         | 2284/37963 [7:09:58<110:01:11, 11.10s/it]
  6%|▌         | 2285/37963 [7:10:13<123:44:46, 12.49s/it]
  6%|▌         | 2286/37963 [7:10:23<116:42:27, 11.78s/it]
  6%|▌         | 2287/37963 [7:10:33<110:45:34, 11.18s/it]
  6%|▌         | 2288/37963 [7:10:44<108:17:27, 10.93s/it]
  6%|▌         | 2289/37963 [7:10:54<106:35:31, 10.76s/it]
  6%|▌         | 2290/37963 [7:11:04<105:16:21, 10.62s/it]
                                                          
{'loss': '0.1663', 'grad_norm': '3.598', 'learning_rate': '1.995e-05', 'epoch': '0.06032'}

  6%|▌         | 2290/37963 [7:11:04<105:16:21, 10.62s/it]
  6%|▌         | 2291/37963 [7:11:14<104:03:15, 10.50s/it]
  6%|▌         | 2292/37963 [7:11:25<102:49:39, 10.38s/it]
  6%|▌         | 2293/37963 [7:11:35<102:26:12, 10.34s/it]
  6%|▌         | 2294/37963 [7:11:44<100:38:55, 10.16s/it]
  6%|▌         | 2295/37963 [7:11:55<100:36:52, 10.16s/it]
  6%|▌         | 2296/37963 [7:12:05<100:34:52, 10.15s/it]
  6%|▌         | 2297/37963 [7:12:15<100:28:01, 10.14s/it]
  6%|▌         | 2298/37963 [7:12:25<100:20:07, 10.13s/it]
  6%|▌         | 2299/37963 [7:12:35<99:49:03, 10.08s/it] 
  6%|▌         | 2300/37963 [7:12:45<100:16:47, 10.12s/it]
                                                          
{'loss': '0.169', 'grad_norm': '5.007', 'learning_rate': '1.995e-05', 'epoch': '0.06059'}

  6%|▌         | 2300/37963 [7:12:45<100:16:47, 10.12s/it]
  6%|▌         | 2301/37963 [7:12:55<99:04:32, 10.00s/it] 
  6%|▌         | 2302/37963 [7:13:05<99:47:38, 10.07s/it]
  6%|▌         | 2303/37963 [7:13:15<99:57:33, 10.09s/it]
  6%|▌         | 2304/37963 [7:13:25<99:47:15, 10.07s/it]
  6%|▌         | 2305/37963 [7:13:35<99:52:20, 10.08s/it]
  6%|▌         | 2306/37963 [7:13:46<99:57:56, 10.09s/it]
  6%|▌         | 2307/37963 [7:13:56<99:51:23, 10.08s/it]
  6%|▌         | 2308/37963 [7:14:06<99:56:07, 10.09s/it]
  6%|▌         | 2309/37963 [7:14:16<100:18:26, 10.13s/it]
  6%|▌         | 2310/37963 [7:14:26<100:21:22, 10.13s/it]
                                                          
{'loss': '0.1694', 'grad_norm': '1.89', 'learning_rate': '1.995e-05', 'epoch': '0.06085'}

  6%|▌         | 2310/37963 [7:14:26<100:21:22, 10.13s/it]
  6%|▌         | 2311/37963 [7:14:43<119:12:12, 12.04s/it]
  6%|▌         | 2312/37963 [7:14:53<113:22:52, 11.45s/it]
  6%|▌         | 2313/37963 [7:15:03<109:00:18, 11.01s/it]
  6%|▌         | 2314/37963 [7:15:19<125:40:15, 12.69s/it]
  6%|▌         | 2315/37963 [7:15:29<118:25:08, 11.96s/it]
  6%|▌         | 2316/37963 [7:15:40<113:14:13, 11.44s/it]
  6%|▌         | 2317/37963 [7:15:59<137:16:45, 13.86s/it]
  6%|▌         | 2318/37963 [7:16:10<126:43:42, 12.80s/it]
  6%|▌         | 2319/37963 [7:16:20<119:06:57, 12.03s/it]
  6%|▌         | 2320/37963 [7:16:30<113:04:08, 11.42s/it]
                                                          
{'loss': '0.179', 'grad_norm': '4.135', 'learning_rate': '1.995e-05', 'epoch': '0.06111'}

  6%|▌         | 2320/37963 [7:16:30<113:04:08, 11.42s/it]
  6%|▌         | 2321/37963 [7:16:46<128:28:15, 12.98s/it]
  6%|▌         | 2322/37963 [7:17:03<138:26:14, 13.98s/it]
  6%|▌         | 2323/37963 [7:17:13<127:04:20, 12.84s/it]
  6%|▌         | 2324/37963 [7:17:23<119:12:50, 12.04s/it]
  6%|▌         | 2325/37963 [7:17:33<113:59:18, 11.51s/it]
  6%|▌         | 2326/37963 [7:17:43<109:41:56, 11.08s/it]
  6%|▌         | 2327/37963 [7:18:00<125:13:34, 12.65s/it]
  6%|▌         | 2328/37963 [7:18:10<118:25:16, 11.96s/it]
  6%|▌         | 2329/37963 [7:18:20<111:56:06, 11.31s/it]
  6%|▌         | 2330/37963 [7:18:37<128:03:28, 12.94s/it]
                                                          
{'loss': '0.1751', 'grad_norm': '3.698', 'learning_rate': '1.995e-05', 'epoch': '0.06138'}

  6%|▌         | 2330/37963 [7:18:37<128:03:28, 12.94s/it]
  6%|▌         | 2331/37963 [7:18:47<119:19:18, 12.06s/it]
  6%|▌         | 2332/37963 [7:18:57<113:34:25, 11.47s/it]
  6%|▌         | 2333/37963 [7:19:07<109:15:58, 11.04s/it]
  6%|▌         | 2334/37963 [7:19:23<126:14:15, 12.76s/it]
  6%|▌         | 2335/37963 [7:19:34<118:16:57, 11.95s/it]
  6%|▌         | 2336/37963 [7:19:44<112:42:10, 11.39s/it]
  6%|▌         | 2337/37963 [7:19:54<108:53:36, 11.00s/it]
  6%|▌         | 2338/37963 [7:20:04<106:27:00, 10.76s/it]
  6%|▌         | 2339/37963 [7:20:14<104:49:21, 10.59s/it]
  6%|▌         | 2340/37963 [7:20:24<102:43:44, 10.38s/it]
                                                          
{'loss': '0.1822', 'grad_norm': '7.861', 'learning_rate': '1.995e-05', 'epoch': '0.06164'}

  6%|▌         | 2340/37963 [7:20:24<102:43:44, 10.38s/it]
  6%|▌         | 2341/37963 [7:20:34<102:08:28, 10.32s/it]
  6%|▌         | 2342/37963 [7:20:44<101:50:55, 10.29s/it]
  6%|▌         | 2343/37963 [7:20:55<101:25:02, 10.25s/it]
  6%|▌         | 2344/37963 [7:21:05<100:48:10, 10.19s/it]
  6%|▌         | 2345/37963 [7:21:14<99:39:09, 10.07s/it] 
  6%|▌         | 2346/37963 [7:21:24<99:23:37, 10.05s/it]
  6%|▌         | 2347/37963 [7:21:34<98:24:29,  9.95s/it]
  6%|▌         | 2348/37963 [7:21:44<99:05:44, 10.02s/it]
  6%|▌         | 2349/37963 [7:21:54<99:24:46, 10.05s/it]
  6%|▌         | 2350/37963 [7:22:04<99:20:57, 10.04s/it]
                                                         
{'loss': '0.1875', 'grad_norm': '5.774', 'learning_rate': '1.995e-05', 'epoch': '0.0619'}

  6%|▌         | 2350/37963 [7:22:04<99:20:57, 10.04s/it]
  6%|▌         | 2351/37963 [7:22:15<99:36:56, 10.07s/it]
  6%|▌         | 2352/37963 [7:22:25<99:51:17, 10.09s/it]
  6%|▌         | 2353/37963 [7:22:34<98:47:11,  9.99s/it]
  6%|▌         | 2354/37963 [7:22:44<98:06:38,  9.92s/it]
  6%|▌         | 2355/37963 [7:22:54<98:44:02,  9.98s/it]
  6%|▌         | 2356/37963 [7:23:05<99:25:37, 10.05s/it]
  6%|▌         | 2357/37963 [7:23:15<99:06:54, 10.02s/it]
  6%|▌         | 2358/37963 [7:23:31<118:18:16, 11.96s/it]
  6%|▌         | 2359/37963 [7:23:41<112:01:07, 11.33s/it]
  6%|▌         | 2360/37963 [7:23:51<108:59:31, 11.02s/it]
                                                          
{'loss': '0.1839', 'grad_norm': '3.595', 'learning_rate': '1.995e-05', 'epoch': '0.06217'}

  6%|▌         | 2360/37963 [7:23:51<108:59:31, 11.02s/it]
  6%|▌         | 2361/37963 [7:24:17<153:50:19, 15.56s/it]
  6%|▌         | 2362/37963 [7:24:27<137:47:57, 13.93s/it]
  6%|▌         | 2363/37963 [7:24:38<126:15:27, 12.77s/it]
  6%|▌         | 2364/37963 [7:24:48<118:26:53, 11.98s/it]
  6%|▌         | 2365/37963 [7:24:57<111:48:20, 11.31s/it]
  6%|▌         | 2366/37963 [7:25:14<126:26:17, 12.79s/it]
  6%|▌         | 2367/37963 [7:25:24<118:47:23, 12.01s/it]
  6%|▌         | 2368/37963 [7:25:34<112:30:56, 11.38s/it]
  6%|▌         | 2369/37963 [7:25:44<108:34:09, 10.98s/it]
  6%|▌         | 2370/37963 [7:25:54<105:43:40, 10.69s/it]
                                                          
{'loss': '0.1701', 'grad_norm': '5.446', 'learning_rate': '1.994e-05', 'epoch': '0.06243'}

  6%|▌         | 2370/37963 [7:25:54<105:43:40, 10.69s/it]
  6%|▌         | 2371/37963 [7:26:10<122:58:31, 12.44s/it]
  6%|▌         | 2372/37963 [7:26:20<115:33:30, 11.69s/it]
  6%|▋         | 2373/37963 [7:26:30<110:55:43, 11.22s/it]
  6%|▋         | 2374/37963 [7:26:40<107:22:48, 10.86s/it]
  6%|▋         | 2375/37963 [7:26:57<124:24:33, 12.58s/it]
  6%|▋         | 2376/37963 [7:27:07<116:49:15, 11.82s/it]
  6%|▋         | 2377/37963 [7:27:24<130:48:24, 13.23s/it]
  6%|▋         | 2378/37963 [7:27:34<121:28:43, 12.29s/it]
  6%|▋         | 2379/37963 [7:27:51<135:20:37, 13.69s/it]
  6%|▋         | 2380/37963 [7:28:01<125:34:45, 12.71s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '4.305', 'learning_rate': '1.994e-05', 'epoch': '0.06269'}

  6%|▋         | 2380/37963 [7:28:01<125:34:45, 12.71s/it]
  6%|▋         | 2381/37963 [7:28:11<116:54:59, 11.83s/it]
  6%|▋         | 2382/37963 [7:28:21<112:09:34, 11.35s/it]
  6%|▋         | 2383/37963 [7:28:31<107:49:24, 10.91s/it]
  6%|▋         | 2384/37963 [7:28:41<104:18:50, 10.55s/it]
  6%|▋         | 2385/37963 [7:28:51<103:14:18, 10.45s/it]
  6%|▋         | 2386/37963 [7:29:01<101:57:27, 10.32s/it]
  6%|▋         | 2387/37963 [7:29:11<101:15:45, 10.25s/it]
  6%|▋         | 2388/37963 [7:29:21<100:48:08, 10.20s/it]
  6%|▋         | 2389/37963 [7:29:31<100:20:14, 10.15s/it]
  6%|▋         | 2390/37963 [7:29:41<100:18:45, 10.15s/it]
                                                          
{'loss': '0.1809', 'grad_norm': '5.459', 'learning_rate': '1.994e-05', 'epoch': '0.06296'}

  6%|▋         | 2390/37963 [7:29:41<100:18:45, 10.15s/it]
  6%|▋         | 2391/37963 [7:29:51<100:19:00, 10.15s/it]
  6%|▋         | 2392/37963 [7:30:02<100:26:00, 10.16s/it]
  6%|▋         | 2393/37963 [7:30:12<99:54:38, 10.11s/it] 
  6%|▋         | 2394/37963 [7:30:22<99:54:41, 10.11s/it]
  6%|▋         | 2395/37963 [7:30:32<99:42:32, 10.09s/it]
  6%|▋         | 2396/37963 [7:30:42<100:11:11, 10.14s/it]
  6%|▋         | 2397/37963 [7:30:52<100:26:34, 10.17s/it]
  6%|▋         | 2398/37963 [7:31:02<100:36:39, 10.18s/it]
  6%|▋         | 2399/37963 [7:31:13<100:29:12, 10.17s/it]
  6%|▋         | 2400/37963 [7:31:23<100:33:13, 10.18s/it]
                                                          
{'loss': '0.1661', 'grad_norm': '2.806', 'learning_rate': '1.994e-05', 'epoch': '0.06322'}

  6%|▋         | 2400/37963 [7:31:23<100:33:13, 10.18s/it]
  6%|▋         | 2401/37963 [7:31:33<100:25:39, 10.17s/it]
  6%|▋         | 2402/37963 [7:31:43<100:30:01, 10.17s/it]
  6%|▋         | 2403/37963 [7:31:53<100:21:54, 10.16s/it]
  6%|▋         | 2404/37963 [7:32:03<100:32:26, 10.18s/it]
  6%|▋         | 2405/37963 [7:32:14<100:30:40, 10.18s/it]
  6%|▋         | 2406/37963 [7:32:23<99:34:26, 10.08s/it] 
  6%|▋         | 2407/37963 [7:32:50<147:36:50, 14.95s/it]
  6%|▋         | 2408/37963 [7:33:00<133:19:57, 13.50s/it]
  6%|▋         | 2409/37963 [7:33:16<142:24:55, 14.42s/it]
  6%|▋         | 2410/37963 [7:33:27<130:12:46, 13.19s/it]
                                                          
{'loss': '0.1742', 'grad_norm': '15.25', 'learning_rate': '1.994e-05', 'epoch': '0.06348'}

  6%|▋         | 2410/37963 [7:33:27<130:12:46, 13.19s/it]
  6%|▋         | 2411/37963 [7:33:44<140:50:15, 14.26s/it]
  6%|▋         | 2412/37963 [7:33:53<127:38:50, 12.93s/it]
  6%|▋         | 2413/37963 [7:34:04<119:25:34, 12.09s/it]
  6%|▋         | 2414/37963 [7:34:14<113:54:03, 11.53s/it]
  6%|▋         | 2415/37963 [7:34:24<109:56:19, 11.13s/it]
  6%|▋         | 2416/37963 [7:34:34<106:49:56, 10.82s/it]
  6%|▋         | 2417/37963 [7:34:44<103:39:49, 10.50s/it]
  6%|▋         | 2418/37963 [7:34:54<102:32:32, 10.39s/it]
  6%|▋         | 2419/37963 [7:35:04<101:33:15, 10.29s/it]
  6%|▋         | 2420/37963 [7:35:14<100:58:01, 10.23s/it]
                                                          
{'loss': '0.1724', 'grad_norm': '2.375', 'learning_rate': '1.994e-05', 'epoch': '0.06375'}

  6%|▋         | 2420/37963 [7:35:14<100:58:01, 10.23s/it]
  6%|▋         | 2421/37963 [7:35:31<119:27:51, 12.10s/it]
  6%|▋         | 2422/37963 [7:35:41<113:34:47, 11.50s/it]
  6%|▋         | 2423/37963 [7:35:57<127:30:06, 12.92s/it]
  6%|▋         | 2424/37963 [7:36:07<119:25:51, 12.10s/it]
  6%|▋         | 2425/37963 [7:36:24<132:33:49, 13.43s/it]
  6%|▋         | 2426/37963 [7:36:34<122:59:12, 12.46s/it]
  6%|▋         | 2427/37963 [7:36:50<135:02:56, 13.68s/it]
  6%|▋         | 2428/37963 [7:37:00<124:16:56, 12.59s/it]
  6%|▋         | 2429/37963 [7:37:10<117:04:31, 11.86s/it]
  6%|▋         | 2430/37963 [7:37:20<110:56:19, 11.24s/it]
                                                          
{'loss': '0.1703', 'grad_norm': '3.497', 'learning_rate': '1.994e-05', 'epoch': '0.06401'}

  6%|▋         | 2430/37963 [7:37:20<110:56:19, 11.24s/it]
  6%|▋         | 2431/37963 [7:37:30<107:37:10, 10.90s/it]
  6%|▋         | 2432/37963 [7:37:40<104:43:10, 10.61s/it]
  6%|▋         | 2433/37963 [7:37:51<103:32:26, 10.49s/it]
  6%|▋         | 2434/37963 [7:38:01<102:28:04, 10.38s/it]
  6%|▋         | 2435/37963 [7:38:10<100:37:19, 10.20s/it]
  6%|▋         | 2436/37963 [7:38:20<100:10:33, 10.15s/it]
  6%|▋         | 2437/37963 [7:38:31<100:15:36, 10.16s/it]
  6%|▋         | 2438/37963 [7:38:41<100:07:32, 10.15s/it]
  6%|▋         | 2439/37963 [7:38:51<100:10:51, 10.15s/it]
  6%|▋         | 2440/37963 [7:39:01<100:54:09, 10.23s/it]
                                                          
{'loss': '0.1874', 'grad_norm': '8.579', 'learning_rate': '1.994e-05', 'epoch': '0.06427'}

  6%|▋         | 2440/37963 [7:39:01<100:54:09, 10.23s/it]
  6%|▋         | 2441/37963 [7:39:12<101:10:42, 10.25s/it]
  6%|▋         | 2442/37963 [7:39:22<100:46:23, 10.21s/it]
  6%|▋         | 2443/37963 [7:39:32<100:43:31, 10.21s/it]
  6%|▋         | 2444/37963 [7:39:42<100:26:41, 10.18s/it]
  6%|▋         | 2445/37963 [7:39:52<100:22:34, 10.17s/it]
  6%|▋         | 2446/37963 [7:40:02<99:16:23, 10.06s/it] 
  6%|▋         | 2447/37963 [7:40:12<99:20:26, 10.07s/it]
  6%|▋         | 2448/37963 [7:40:22<99:30:38, 10.09s/it]
  6%|▋         | 2449/37963 [7:40:33<99:58:52, 10.13s/it]
  6%|▋         | 2450/37963 [7:40:43<100:05:45, 10.15s/it]
                                                          
{'loss': '0.1598', 'grad_norm': '2.453', 'learning_rate': '1.994e-05', 'epoch': '0.06454'}

  6%|▋         | 2450/37963 [7:40:43<100:05:45, 10.15s/it]
  6%|▋         | 2451/37963 [7:40:53<99:55:01, 10.13s/it] 
  6%|▋         | 2452/37963 [7:41:03<99:51:03, 10.12s/it]
  6%|▋         | 2453/37963 [7:41:13<99:16:16, 10.06s/it]
  6%|▋         | 2454/37963 [7:41:33<128:11:35, 13.00s/it]
  6%|▋         | 2455/37963 [7:41:49<138:40:36, 14.06s/it]
  6%|▋         | 2456/37963 [7:41:59<127:12:32, 12.90s/it]
  6%|▋         | 2457/37963 [7:42:16<137:39:53, 13.96s/it]
  6%|▋         | 2458/37963 [7:42:26<126:47:04, 12.86s/it]
  6%|▋         | 2459/37963 [7:42:36<117:39:43, 11.93s/it]
  6%|▋         | 2460/37963 [7:42:46<111:12:40, 11.28s/it]
                                                          
{'loss': '0.1607', 'grad_norm': '2.396', 'learning_rate': '1.994e-05', 'epoch': '0.0648'}

  6%|▋         | 2460/37963 [7:42:46<111:12:40, 11.28s/it]
  6%|▋         | 2461/37963 [7:42:56<108:00:37, 10.95s/it]
  6%|▋         | 2462/37963 [7:43:12<123:30:55, 12.53s/it]
  6%|▋         | 2463/37963 [7:43:22<115:37:17, 11.72s/it]
  6%|▋         | 2464/37963 [7:43:32<110:50:04, 11.24s/it]
  6%|▋         | 2465/37963 [7:43:42<107:26:26, 10.90s/it]
  6%|▋         | 2466/37963 [7:43:52<104:36:16, 10.61s/it]
  6%|▋         | 2467/37963 [7:44:02<102:24:55, 10.39s/it]
  7%|▋         | 2468/37963 [7:44:18<118:59:24, 12.07s/it]
  7%|▋         | 2469/37963 [7:44:28<113:28:09, 11.51s/it]
  7%|▋         | 2470/37963 [7:44:45<128:18:52, 13.01s/it]
                                                          
{'loss': '0.1769', 'grad_norm': '2.437', 'learning_rate': '1.994e-05', 'epoch': '0.06506'}

  7%|▋         | 2470/37963 [7:44:45<128:18:52, 13.01s/it]
  7%|▋         | 2471/37963 [7:44:54<118:27:54, 12.02s/it]
  7%|▋         | 2472/37963 [7:45:04<113:05:00, 11.47s/it]
  7%|▋         | 2473/37963 [7:45:14<108:44:08, 11.03s/it]
  7%|▋         | 2474/37963 [7:45:25<106:32:15, 10.81s/it]
  7%|▋         | 2475/37963 [7:45:41<123:42:57, 12.55s/it]
  7%|▋         | 2476/37963 [7:45:52<116:38:45, 11.83s/it]
  7%|▋         | 2477/37963 [7:46:08<129:19:31, 13.12s/it]
  7%|▋         | 2478/37963 [7:46:18<120:46:03, 12.25s/it]
  7%|▋         | 2479/37963 [7:46:28<114:35:30, 11.63s/it]
  7%|▋         | 2480/37963 [7:46:38<109:43:37, 11.13s/it]
                                                          
{'loss': '0.1847', 'grad_norm': '3.999', 'learning_rate': '1.993e-05', 'epoch': '0.06533'}

  7%|▋         | 2480/37963 [7:46:38<109:43:37, 11.13s/it]
  7%|▋         | 2481/37963 [7:46:48<106:50:28, 10.84s/it]
  7%|▋         | 2482/37963 [7:46:59<105:22:04, 10.69s/it]
  7%|▋         | 2483/37963 [7:47:09<103:41:01, 10.52s/it]
  7%|▋         | 2484/37963 [7:47:19<103:13:29, 10.47s/it]
  7%|▋         | 2485/37963 [7:47:29<102:07:11, 10.36s/it]
  7%|▋         | 2486/37963 [7:47:39<101:35:23, 10.31s/it]
  7%|▋         | 2487/37963 [7:47:50<101:17:29, 10.28s/it]
  7%|▋         | 2488/37963 [7:48:00<100:39:09, 10.21s/it]
  7%|▋         | 2489/37963 [7:48:10<100:10:52, 10.17s/it]
  7%|▋         | 2490/37963 [7:48:20<100:13:13, 10.17s/it]
                                                          
{'loss': '0.1834', 'grad_norm': '2.042', 'learning_rate': '1.993e-05', 'epoch': '0.06559'}

  7%|▋         | 2490/37963 [7:48:20<100:13:13, 10.17s/it]
  7%|▋         | 2491/37963 [7:48:30<99:24:41, 10.09s/it] 
  7%|▋         | 2492/37963 [7:48:40<99:13:23, 10.07s/it]
  7%|▋         | 2493/37963 [7:48:49<98:09:39,  9.96s/it]
  7%|▋         | 2494/37963 [7:48:59<97:48:36,  9.93s/it]
  7%|▋         | 2495/37963 [7:49:09<98:10:17,  9.96s/it]
  7%|▋         | 2496/37963 [7:49:19<98:38:33, 10.01s/it]
  7%|▋         | 2497/37963 [7:49:30<98:51:29, 10.03s/it]
  7%|▋         | 2498/37963 [7:49:40<99:08:10, 10.06s/it]
  7%|▋         | 2499/37963 [7:49:49<98:12:36,  9.97s/it]
  7%|▋         | 2500/37963 [7:50:09<127:15:28, 12.92s/it]
                                                          
{'loss': '0.1701', 'grad_norm': '5.565', 'learning_rate': '1.993e-05', 'epoch': '0.06585'}

  7%|▋         | 2500/37963 [7:50:09<127:15:28, 12.92s/it]
  7%|▋         | 2501/37963 [7:50:19<118:47:24, 12.06s/it]
  7%|▋         | 2502/37963 [7:50:36<132:42:18, 13.47s/it]
  7%|▋         | 2503/37963 [7:50:46<122:59:09, 12.49s/it]
  7%|▋         | 2504/37963 [7:51:03<135:28:20, 13.75s/it]
  7%|▋         | 2505/37963 [7:51:13<125:52:50, 12.78s/it]
  7%|▋         | 2506/37963 [7:51:24<118:34:07, 12.04s/it]
  7%|▋         | 2507/37963 [7:51:34<113:10:58, 11.49s/it]
  7%|▋         | 2508/37963 [7:51:44<108:52:49, 11.06s/it]
  7%|▋         | 2509/37963 [7:51:54<106:04:49, 10.77s/it]
  7%|▋         | 2510/37963 [7:52:04<104:12:52, 10.58s/it]
                                                          
{'loss': '0.1774', 'grad_norm': '3.659', 'learning_rate': '1.993e-05', 'epoch': '0.06612'}

  7%|▋         | 2510/37963 [7:52:04<104:12:52, 10.58s/it]
  7%|▋         | 2511/37963 [7:52:14<102:52:32, 10.45s/it]
  7%|▋         | 2512/37963 [7:52:24<101:21:39, 10.29s/it]
  7%|▋         | 2513/37963 [7:52:41<118:55:03, 12.08s/it]
  7%|▋         | 2514/37963 [7:52:51<113:01:43, 11.48s/it]
  7%|▋         | 2515/37963 [7:53:01<109:14:40, 11.09s/it]
  7%|▋         | 2516/37963 [7:53:17<124:58:28, 12.69s/it]
  7%|▋         | 2517/37963 [7:53:27<116:12:58, 11.80s/it]
  7%|▋         | 2518/37963 [7:53:44<130:31:54, 13.26s/it]
  7%|▋         | 2519/37963 [7:53:54<121:27:04, 12.34s/it]
  7%|▋         | 2520/37963 [7:54:04<114:56:15, 11.67s/it]
                                                          
{'loss': '0.181', 'grad_norm': '3.582', 'learning_rate': '1.993e-05', 'epoch': '0.06638'}

  7%|▋         | 2520/37963 [7:54:04<114:56:15, 11.67s/it]
  7%|▋         | 2521/37963 [7:54:14<110:18:49, 11.21s/it]
  7%|▋         | 2522/37963 [7:54:24<106:57:55, 10.87s/it]
  7%|▋         | 2523/37963 [7:54:34<104:40:19, 10.63s/it]
  7%|▋         | 2524/37963 [7:54:51<122:27:33, 12.44s/it]
  7%|▋         | 2525/37963 [7:55:01<115:28:22, 11.73s/it]
  7%|▋         | 2526/37963 [7:55:11<110:21:27, 11.21s/it]
  7%|▋         | 2527/37963 [7:55:21<107:59:40, 10.97s/it]
  7%|▋         | 2528/37963 [7:55:38<124:48:10, 12.68s/it]
  7%|▋         | 2529/37963 [7:55:48<117:35:48, 11.95s/it]
  7%|▋         | 2530/37963 [7:55:58<112:05:39, 11.39s/it]
                                                          
{'loss': '0.1832', 'grad_norm': '2.125', 'learning_rate': '1.993e-05', 'epoch': '0.06664'}

  7%|▋         | 2530/37963 [7:55:58<112:05:39, 11.39s/it]
  7%|▋         | 2531/37963 [7:56:09<108:27:07, 11.02s/it]
  7%|▋         | 2532/37963 [7:56:18<104:52:19, 10.66s/it]
  7%|▋         | 2533/37963 [7:56:29<103:35:40, 10.53s/it]
  7%|▋         | 2534/37963 [7:56:39<101:56:45, 10.36s/it]
  7%|▋         | 2535/37963 [7:56:49<101:13:18, 10.29s/it]
  7%|▋         | 2536/37963 [7:56:59<100:41:37, 10.23s/it]
  7%|▋         | 2537/37963 [7:57:09<100:28:29, 10.21s/it]
  7%|▋         | 2538/37963 [7:57:19<100:18:39, 10.19s/it]
  7%|▋         | 2539/37963 [7:57:29<100:13:50, 10.19s/it]
  7%|▋         | 2540/37963 [7:57:39<99:42:58, 10.13s/it] 
                                                         
{'loss': '0.1687', 'grad_norm': '2.815', 'learning_rate': '1.993e-05', 'epoch': '0.06691'}

  7%|▋         | 2540/37963 [7:57:39<99:42:58, 10.13s/it]
  7%|▋         | 2541/37963 [7:57:49<98:42:22, 10.03s/it]
  7%|▋         | 2542/37963 [7:57:59<98:52:50, 10.05s/it]
  7%|▋         | 2543/37963 [7:58:19<127:09:15, 12.92s/it]
  7%|▋         | 2544/37963 [7:58:29<119:05:06, 12.10s/it]
  7%|▋         | 2545/37963 [7:58:39<112:44:11, 11.46s/it]
  7%|▋         | 2546/37963 [7:58:49<109:09:18, 11.10s/it]
  7%|▋         | 2547/37963 [7:58:59<106:26:42, 10.82s/it]
  7%|▋         | 2548/37963 [7:59:10<104:30:18, 10.62s/it]
  7%|▋         | 2549/37963 [7:59:20<103:10:32, 10.49s/it]
  7%|▋         | 2550/37963 [7:59:36<121:46:16, 12.38s/it]
                                                          
{'loss': '0.1588', 'grad_norm': '1.202', 'learning_rate': '1.993e-05', 'epoch': '0.06717'}

  7%|▋         | 2550/37963 [7:59:36<121:46:16, 12.38s/it]
  7%|▋         | 2551/37963 [7:59:53<134:03:30, 13.63s/it]
  7%|▋         | 2552/37963 [8:00:03<124:02:33, 12.61s/it]
  7%|▋         | 2553/37963 [8:00:13<115:27:21, 11.74s/it]
  7%|▋         | 2554/37963 [8:00:23<109:43:12, 11.16s/it]
  7%|▋         | 2555/37963 [8:00:33<106:43:40, 10.85s/it]
  7%|▋         | 2556/37963 [8:00:43<104:47:22, 10.65s/it]
  7%|▋         | 2557/37963 [8:00:53<103:49:55, 10.56s/it]
  7%|▋         | 2558/37963 [8:01:04<102:44:20, 10.45s/it]
  7%|▋         | 2559/37963 [8:01:14<102:08:44, 10.39s/it]
  7%|▋         | 2560/37963 [8:01:24<101:20:26, 10.30s/it]
                                                          
{'loss': '0.1916', 'grad_norm': '1.241', 'learning_rate': '1.993e-05', 'epoch': '0.06743'}

  7%|▋         | 2560/37963 [8:01:24<101:20:26, 10.30s/it]
  7%|▋         | 2561/37963 [8:01:34<100:59:48, 10.27s/it]
  7%|▋         | 2562/37963 [8:01:44<100:09:50, 10.19s/it]
  7%|▋         | 2563/37963 [8:02:01<119:17:13, 12.13s/it]
  7%|▋         | 2564/37963 [8:02:18<132:45:38, 13.50s/it]
  7%|▋         | 2565/37963 [8:02:28<123:00:16, 12.51s/it]
  7%|▋         | 2566/37963 [8:02:44<133:27:46, 13.57s/it]
  7%|▋         | 2567/37963 [8:02:54<123:11:37, 12.53s/it]
  7%|▋         | 2568/37963 [8:03:04<116:23:05, 11.84s/it]
  7%|▋         | 2569/37963 [8:03:14<111:44:58, 11.37s/it]
  7%|▋         | 2570/37963 [8:03:24<107:51:49, 10.97s/it]
                                                          
{'loss': '0.1825', 'grad_norm': '5.942', 'learning_rate': '1.993e-05', 'epoch': '0.0677'}

  7%|▋         | 2570/37963 [8:03:24<107:51:49, 10.97s/it]
  7%|▋         | 2571/37963 [8:03:34<105:01:51, 10.68s/it]
  7%|▋         | 2572/37963 [8:03:44<102:41:04, 10.45s/it]
  7%|▋         | 2573/37963 [8:03:54<101:48:05, 10.36s/it]
  7%|▋         | 2574/37963 [8:04:11<120:02:01, 12.21s/it]
  7%|▋         | 2575/37963 [8:04:21<114:57:29, 11.69s/it]
  7%|▋         | 2576/37963 [8:04:38<128:46:58, 13.10s/it]
  7%|▋         | 2577/37963 [8:04:48<120:06:32, 12.22s/it]
  7%|▋         | 2578/37963 [8:04:58<113:50:36, 11.58s/it]
  7%|▋         | 2579/37963 [8:05:08<109:01:47, 11.09s/it]
  7%|▋         | 2580/37963 [8:05:18<105:05:33, 10.69s/it]
                                                          
{'loss': '0.1778', 'grad_norm': '2.528', 'learning_rate': '1.992e-05', 'epoch': '0.06796'}

  7%|▋         | 2580/37963 [8:05:18<105:05:33, 10.69s/it]
  7%|▋         | 2581/37963 [8:05:28<102:37:59, 10.44s/it]
  7%|▋         | 2582/37963 [8:05:37<100:34:59, 10.23s/it]
  7%|▋         | 2583/37963 [8:05:48<100:08:46, 10.19s/it]
  7%|▋         | 2584/37963 [8:05:58<100:08:57, 10.19s/it]
  7%|▋         | 2585/37963 [8:06:08<99:52:55, 10.16s/it] 
  7%|▋         | 2586/37963 [8:06:18<99:43:48, 10.15s/it]
  7%|▋         | 2587/37963 [8:06:28<99:36:58, 10.14s/it]
  7%|▋         | 2588/37963 [8:06:38<99:38:00, 10.14s/it]
  7%|▋         | 2589/37963 [8:06:58<128:21:16, 13.06s/it]
  7%|▋         | 2590/37963 [8:07:08<118:56:05, 12.10s/it]
                                                          
{'loss': '0.1888', 'grad_norm': '2.438', 'learning_rate': '1.992e-05', 'epoch': '0.06822'}

  7%|▋         | 2590/37963 [8:07:08<118:56:05, 12.10s/it]
  7%|▋         | 2591/37963 [8:07:18<112:39:04, 11.47s/it]
  7%|▋         | 2592/37963 [8:07:27<106:58:05, 10.89s/it]
  7%|▋         | 2593/37963 [8:07:37<103:32:17, 10.54s/it]
  7%|▋         | 2594/37963 [8:07:47<101:42:36, 10.35s/it]
  7%|▋         | 2595/37963 [8:07:57<101:22:16, 10.32s/it]
  7%|▋         | 2596/37963 [8:08:07<100:39:27, 10.25s/it]
  7%|▋         | 2597/37963 [8:08:18<100:20:34, 10.21s/it]
  7%|▋         | 2598/37963 [8:08:28<100:25:39, 10.22s/it]
  7%|▋         | 2599/37963 [8:08:44<119:16:28, 12.14s/it]
  7%|▋         | 2600/37963 [8:09:01<131:08:08, 13.35s/it]
                                                          
{'loss': '0.1735', 'grad_norm': '3.958', 'learning_rate': '1.992e-05', 'epoch': '0.06849'}

  7%|▋         | 2600/37963 [8:09:01<131:08:08, 13.35s/it]
  7%|▋         | 2601/37963 [8:09:11<121:21:59, 12.36s/it]
  7%|▋         | 2602/37963 [8:09:21<115:16:27, 11.74s/it]
  7%|▋         | 2603/37963 [8:09:31<110:37:36, 11.26s/it]
  7%|▋         | 2604/37963 [8:09:41<106:36:12, 10.85s/it]
  7%|▋         | 2605/37963 [8:09:51<104:19:52, 10.62s/it]
  7%|▋         | 2606/37963 [8:10:01<103:10:50, 10.51s/it]
  7%|▋         | 2607/37963 [8:10:11<100:33:27, 10.24s/it]
  7%|▋         | 2608/37963 [8:10:21<100:00:46, 10.18s/it]
  7%|▋         | 2609/37963 [8:10:38<119:01:45, 12.12s/it]
  7%|▋         | 2610/37963 [8:10:54<132:13:16, 13.46s/it]
                                                          
{'loss': '0.177', 'grad_norm': '4.695', 'learning_rate': '1.992e-05', 'epoch': '0.06875'}

  7%|▋         | 2610/37963 [8:10:54<132:13:16, 13.46s/it]
  7%|▋         | 2611/37963 [8:11:04<121:43:45, 12.40s/it]
  7%|▋         | 2612/37963 [8:11:14<114:56:37, 11.71s/it]
  7%|▋         | 2613/37963 [8:11:24<109:20:47, 11.14s/it]
  7%|▋         | 2614/37963 [8:11:33<104:21:18, 10.63s/it]
  7%|▋         | 2615/37963 [8:11:43<100:36:30, 10.25s/it]
  7%|▋         | 2616/37963 [8:11:53<100:25:41, 10.23s/it]
  7%|▋         | 2617/37963 [8:12:10<119:03:14, 12.13s/it]
  7%|▋         | 2618/37963 [8:12:20<113:00:48, 11.51s/it]
  7%|▋         | 2619/37963 [8:12:30<108:53:37, 11.09s/it]
  7%|▋         | 2620/37963 [8:12:40<106:05:37, 10.81s/it]
                                                          
{'loss': '0.1853', 'grad_norm': '2.205', 'learning_rate': '1.992e-05', 'epoch': '0.06901'}

  7%|▋         | 2620/37963 [8:12:40<106:05:37, 10.81s/it]
  7%|▋         | 2621/37963 [8:12:50<104:32:32, 10.65s/it]
  7%|▋         | 2622/37963 [8:13:07<121:26:20, 12.37s/it]
  7%|▋         | 2623/37963 [8:13:17<115:02:03, 11.72s/it]
  7%|▋         | 2624/37963 [8:13:33<129:28:08, 13.19s/it]
  7%|▋         | 2625/37963 [8:13:43<120:29:56, 12.28s/it]
  7%|▋         | 2626/37963 [8:13:54<114:41:09, 11.68s/it]
  7%|▋         | 2627/37963 [8:14:04<110:00:40, 11.21s/it]
  7%|▋         | 2628/37963 [8:14:14<105:54:49, 10.79s/it]
  7%|▋         | 2629/37963 [8:14:24<103:54:41, 10.59s/it]
  7%|▋         | 2630/37963 [8:14:34<102:29:59, 10.44s/it]
                                                          
{'loss': '0.1675', 'grad_norm': '4.684', 'learning_rate': '1.992e-05', 'epoch': '0.06928'}

  7%|▋         | 2630/37963 [8:14:34<102:29:59, 10.44s/it]
  7%|▋         | 2631/37963 [8:14:44<101:49:34, 10.38s/it]
  7%|▋         | 2632/37963 [8:14:54<100:13:00, 10.21s/it]
  7%|▋         | 2633/37963 [8:15:04<98:46:53, 10.07s/it] 
  7%|▋         | 2634/37963 [8:15:13<97:54:04,  9.98s/it]
  7%|▋         | 2635/37963 [8:15:24<98:28:35, 10.03s/it]
  7%|▋         | 2636/37963 [8:15:34<98:46:06, 10.07s/it]
  7%|▋         | 2637/37963 [8:15:44<99:01:26, 10.09s/it]
  7%|▋         | 2638/37963 [8:15:54<99:48:00, 10.17s/it]
  7%|▋         | 2639/37963 [8:16:04<99:22:37, 10.13s/it]
  7%|▋         | 2640/37963 [8:16:24<126:31:10, 12.89s/it]
                                                          
{'loss': '0.1718', 'grad_norm': '2.076', 'learning_rate': '1.992e-05', 'epoch': '0.06954'}

  7%|▋         | 2640/37963 [8:16:24<126:31:10, 12.89s/it]
  7%|▋         | 2641/37963 [8:16:34<118:57:54, 12.12s/it]
  7%|▋         | 2642/37963 [8:16:44<111:51:14, 11.40s/it]
  7%|▋         | 2643/37963 [8:16:54<108:29:37, 11.06s/it]
  7%|▋         | 2644/37963 [8:17:04<104:20:14, 10.63s/it]
  7%|▋         | 2645/37963 [8:17:20<120:33:30, 12.29s/it]
  7%|▋         | 2646/37963 [8:17:30<114:14:48, 11.65s/it]
  7%|▋         | 2647/37963 [8:17:40<109:20:19, 11.15s/it]
  7%|▋         | 2648/37963 [8:17:50<106:17:03, 10.83s/it]
  7%|▋         | 2649/37963 [8:18:07<123:34:12, 12.60s/it]
  7%|▋         | 2650/37963 [8:18:16<115:05:44, 11.73s/it]
                                                          
{'loss': '0.174', 'grad_norm': '1.36', 'learning_rate': '1.992e-05', 'epoch': '0.06981'}

  7%|▋         | 2650/37963 [8:18:16<115:05:44, 11.73s/it]
  7%|▋         | 2651/37963 [8:18:26<110:09:01, 11.23s/it]
  7%|▋         | 2652/37963 [8:18:37<107:13:23, 10.93s/it]
  7%|▋         | 2653/37963 [8:18:47<104:58:31, 10.70s/it]
  7%|▋         | 2654/37963 [8:18:57<103:25:51, 10.55s/it]
  7%|▋         | 2655/37963 [8:19:07<102:45:27, 10.48s/it]
  7%|▋         | 2656/37963 [8:19:24<120:36:05, 12.30s/it]
  7%|▋         | 2657/37963 [8:19:34<114:12:06, 11.64s/it]
  7%|▋         | 2658/37963 [8:19:51<129:06:05, 13.16s/it]
  7%|▋         | 2659/37963 [8:20:01<120:01:43, 12.24s/it]
  7%|▋         | 2660/37963 [8:20:11<114:19:29, 11.66s/it]
                                                          
{'loss': '0.1741', 'grad_norm': '4.556', 'learning_rate': '1.992e-05', 'epoch': '0.07007'}

  7%|▋         | 2660/37963 [8:20:11<114:19:29, 11.66s/it]
  7%|▋         | 2661/37963 [8:20:21<110:05:04, 11.23s/it]
  7%|▋         | 2662/37963 [8:20:31<106:33:27, 10.87s/it]
  7%|▋         | 2663/37963 [8:20:42<104:27:20, 10.65s/it]
  7%|▋         | 2664/37963 [8:20:51<101:58:54, 10.40s/it]
  7%|▋         | 2665/37963 [8:21:01<101:07:32, 10.31s/it]
  7%|▋         | 2666/37963 [8:21:18<119:48:13, 12.22s/it]
  7%|▋         | 2667/37963 [8:21:35<132:38:14, 13.53s/it]
  7%|▋         | 2668/37963 [8:21:45<122:47:14, 12.52s/it]
  7%|▋         | 2669/37963 [8:21:55<115:37:26, 11.79s/it]
  7%|▋         | 2670/37963 [8:22:05<110:56:04, 11.32s/it]
                                                          
{'loss': '0.1702', 'grad_norm': '6.991', 'learning_rate': '1.991e-05', 'epoch': '0.07033'}

  7%|▋         | 2670/37963 [8:22:05<110:56:04, 11.32s/it]
  7%|▋         | 2671/37963 [8:22:15<107:36:57, 10.98s/it]
  7%|▋         | 2672/37963 [8:22:26<105:29:26, 10.76s/it]
  7%|▋         | 2673/37963 [8:22:35<102:53:04, 10.50s/it]
  7%|▋         | 2674/37963 [8:22:52<120:56:50, 12.34s/it]
  7%|▋         | 2675/37963 [8:23:02<113:40:16, 11.60s/it]
  7%|▋         | 2676/37963 [8:23:12<109:25:56, 11.16s/it]
  7%|▋         | 2677/37963 [8:23:22<105:18:56, 10.74s/it]
  7%|▋         | 2678/37963 [8:23:32<103:47:23, 10.59s/it]
  7%|▋         | 2679/37963 [8:23:42<102:31:31, 10.46s/it]
  7%|▋         | 2680/37963 [8:23:53<101:45:00, 10.38s/it]
                                                          
{'loss': '0.1594', 'grad_norm': '2.772', 'learning_rate': '1.991e-05', 'epoch': '0.0706'}

  7%|▋         | 2680/37963 [8:23:53<101:45:00, 10.38s/it]
  7%|▋         | 2681/37963 [8:24:03<100:51:19, 10.29s/it]
  7%|▋         | 2682/37963 [8:24:13<100:34:30, 10.26s/it]
  7%|▋         | 2683/37963 [8:24:23<100:11:13, 10.22s/it]
  7%|▋         | 2684/37963 [8:24:33<100:06:16, 10.22s/it]
  7%|▋         | 2685/37963 [8:24:43<99:19:09, 10.14s/it] 
  7%|▋         | 2686/37963 [8:24:53<99:17:20, 10.13s/it]
  7%|▋         | 2687/37963 [8:25:03<99:16:59, 10.13s/it]
  7%|▋         | 2688/37963 [8:25:23<128:32:33, 13.12s/it]
  7%|▋         | 2689/37963 [8:25:34<119:46:34, 12.22s/it]
  7%|▋         | 2690/37963 [8:25:43<113:02:45, 11.54s/it]
                                                          
{'loss': '0.1753', 'grad_norm': '3.285', 'learning_rate': '1.991e-05', 'epoch': '0.07086'}

  7%|▋         | 2690/37963 [8:25:43<113:02:45, 11.54s/it]
  7%|▋         | 2691/37963 [8:25:59<125:12:13, 12.78s/it]
  7%|▋         | 2692/37963 [8:26:09<115:46:24, 11.82s/it]
  7%|▋         | 2693/37963 [8:26:19<111:17:02, 11.36s/it]
  7%|▋         | 2694/37963 [8:26:29<107:02:48, 10.93s/it]
  7%|▋         | 2695/37963 [8:26:39<104:38:43, 10.68s/it]
  7%|▋         | 2696/37963 [8:26:49<101:46:37, 10.39s/it]
  7%|▋         | 2697/37963 [8:26:59<101:16:29, 10.34s/it]
  7%|▋         | 2698/37963 [8:27:15<119:14:56, 12.17s/it]
  7%|▋         | 2699/37963 [8:27:25<113:04:53, 11.54s/it]
  7%|▋         | 2700/37963 [8:27:36<109:09:34, 11.14s/it]
                                                          
{'loss': '0.1866', 'grad_norm': '2.579', 'learning_rate': '1.991e-05', 'epoch': '0.07112'}

  7%|▋         | 2700/37963 [8:27:36<109:09:34, 11.14s/it]
  7%|▋         | 2701/37963 [8:27:46<105:24:40, 10.76s/it]
  7%|▋         | 2702/37963 [8:27:56<103:48:32, 10.60s/it]
  7%|▋         | 2703/37963 [8:28:12<120:45:20, 12.33s/it]
  7%|▋         | 2704/37963 [8:28:22<114:39:13, 11.71s/it]
  7%|▋         | 2705/37963 [8:28:39<129:04:39, 13.18s/it]
  7%|▋         | 2706/37963 [8:28:49<120:04:54, 12.26s/it]
  7%|▋         | 2707/37963 [8:28:59<113:59:06, 11.64s/it]
  7%|▋         | 2708/37963 [8:29:09<109:23:37, 11.17s/it]
  7%|▋         | 2709/37963 [8:29:20<106:31:06, 10.88s/it]
  7%|▋         | 2710/37963 [8:29:30<104:15:35, 10.65s/it]
                                                          
{'loss': '0.1682', 'grad_norm': '2.277', 'learning_rate': '1.991e-05', 'epoch': '0.07139'}

  7%|▋         | 2710/37963 [8:29:30<104:15:35, 10.65s/it]
  7%|▋         | 2711/37963 [8:29:47<122:46:17, 12.54s/it]
  7%|▋         | 2712/37963 [8:29:57<115:57:29, 11.84s/it]
  7%|▋         | 2713/37963 [8:30:14<130:00:46, 13.28s/it]
  7%|▋         | 2714/37963 [8:30:24<120:41:12, 12.33s/it]
  7%|▋         | 2715/37963 [8:30:34<114:09:31, 11.66s/it]
  7%|▋         | 2716/37963 [8:30:44<108:51:43, 11.12s/it]
  7%|▋         | 2717/37963 [8:30:54<106:13:55, 10.85s/it]
  7%|▋         | 2718/37963 [8:31:04<103:00:41, 10.52s/it]
  7%|▋         | 2719/37963 [8:31:13<101:16:08, 10.34s/it]
  7%|▋         | 2720/37963 [8:31:23<99:13:32, 10.14s/it] 
                                                         
{'loss': '0.1841', 'grad_norm': '4.048', 'learning_rate': '1.991e-05', 'epoch': '0.07165'}

  7%|▋         | 2720/37963 [8:31:23<99:13:32, 10.14s/it]
  7%|▋         | 2721/37963 [8:31:33<98:47:03, 10.09s/it]
  7%|▋         | 2722/37963 [8:31:50<117:20:36, 11.99s/it]
  7%|▋         | 2723/37963 [8:32:00<111:59:39, 11.44s/it]
  7%|▋         | 2724/37963 [8:32:10<108:14:49, 11.06s/it]
  7%|▋         | 2725/37963 [8:32:20<104:37:23, 10.69s/it]
  7%|▋         | 2726/37963 [8:32:29<101:37:20, 10.38s/it]
  7%|▋         | 2727/37963 [8:32:40<100:56:23, 10.31s/it]
  7%|▋         | 2728/37963 [8:32:50<100:32:22, 10.27s/it]
  7%|▋         | 2729/37963 [8:33:00<99:23:37, 10.16s/it] 
  7%|▋         | 2730/37963 [8:33:10<99:21:15, 10.15s/it]
                                                         
{'loss': '0.1878', 'grad_norm': '2.016', 'learning_rate': '1.991e-05', 'epoch': '0.07191'}

  7%|▋         | 2730/37963 [8:33:10<99:21:15, 10.15s/it]
  7%|▋         | 2731/37963 [8:33:20<99:26:22, 10.16s/it]
  7%|▋         | 2732/37963 [8:33:30<99:30:38, 10.17s/it]
  7%|▋         | 2733/37963 [8:33:40<99:03:35, 10.12s/it]
  7%|▋         | 2734/37963 [8:33:50<98:55:44, 10.11s/it]
  7%|▋         | 2735/37963 [8:34:00<98:38:59, 10.08s/it]
  7%|▋         | 2736/37963 [8:34:10<98:45:42, 10.09s/it]
  7%|▋         | 2737/37963 [8:34:21<99:05:24, 10.13s/it]
  7%|▋         | 2738/37963 [8:34:37<118:13:27, 12.08s/it]
  7%|▋         | 2739/37963 [8:34:47<112:51:52, 11.54s/it]
  7%|▋         | 2740/37963 [8:34:58<108:59:04, 11.14s/it]
                                                          
{'loss': '0.179', 'grad_norm': '3.336', 'learning_rate': '1.991e-05', 'epoch': '0.07218'}

  7%|▋         | 2740/37963 [8:34:58<108:59:04, 11.14s/it]
  7%|▋         | 2741/37963 [8:35:17<132:29:18, 13.54s/it]
  7%|▋         | 2742/37963 [8:35:27<122:23:14, 12.51s/it]
  7%|▋         | 2743/37963 [8:35:37<115:23:34, 11.79s/it]
  7%|▋         | 2744/37963 [8:35:47<110:18:34, 11.28s/it]
  7%|▋         | 2745/37963 [8:35:57<107:10:04, 10.95s/it]
  7%|▋         | 2746/37963 [8:36:07<104:55:17, 10.73s/it]
  7%|▋         | 2747/37963 [8:36:24<121:44:40, 12.45s/it]
  7%|▋         | 2748/37963 [8:36:34<114:53:10, 11.74s/it]
  7%|▋         | 2749/37963 [8:36:44<110:02:23, 11.25s/it]
  7%|▋         | 2750/37963 [8:36:54<106:42:44, 10.91s/it]
                                                          
{'loss': '0.1748', 'grad_norm': '5.115', 'learning_rate': '1.991e-05', 'epoch': '0.07244'}

  7%|▋         | 2750/37963 [8:36:54<106:42:44, 10.91s/it]
  7%|▋         | 2751/37963 [8:37:11<123:02:11, 12.58s/it]
  7%|▋         | 2752/37963 [8:37:27<133:19:56, 13.63s/it]
  7%|▋         | 2753/37963 [8:37:37<123:14:32, 12.60s/it]
  7%|▋         | 2754/37963 [8:37:47<116:01:37, 11.86s/it]
  7%|▋         | 2755/37963 [8:37:57<110:15:15, 11.27s/it]
  7%|▋         | 2756/37963 [8:38:07<106:32:21, 10.89s/it]
  7%|▋         | 2757/37963 [8:38:17<104:21:45, 10.67s/it]
  7%|▋         | 2758/37963 [8:38:27<102:20:47, 10.47s/it]
  7%|▋         | 2759/37963 [8:38:44<119:57:44, 12.27s/it]
  7%|▋         | 2760/37963 [8:39:00<132:55:14, 13.59s/it]
                                                          
{'loss': '0.1748', 'grad_norm': '4.035', 'learning_rate': '1.99e-05', 'epoch': '0.0727'}

  7%|▋         | 2760/37963 [8:39:00<132:55:14, 13.59s/it]
  7%|▋         | 2761/37963 [8:39:11<122:57:13, 12.57s/it]
  7%|▋         | 2762/37963 [8:39:21<115:57:38, 11.86s/it]
  7%|▋         | 2763/37963 [8:39:31<110:21:47, 11.29s/it]
  7%|▋         | 2764/37963 [8:39:41<106:54:36, 10.93s/it]
  7%|▋         | 2765/37963 [8:39:51<104:46:57, 10.72s/it]
  7%|▋         | 2766/37963 [8:40:01<103:09:46, 10.55s/it]
  7%|▋         | 2767/37963 [8:40:11<101:52:45, 10.42s/it]
  7%|▋         | 2768/37963 [8:40:22<101:22:44, 10.37s/it]
  7%|▋         | 2769/37963 [8:40:32<100:26:18, 10.27s/it]
  7%|▋         | 2770/37963 [8:40:42<100:10:16, 10.25s/it]
                                                          
{'loss': '0.1692', 'grad_norm': '3.616', 'learning_rate': '1.99e-05', 'epoch': '0.07297'}

  7%|▋         | 2770/37963 [8:40:42<100:10:16, 10.25s/it]
  7%|▋         | 2771/37963 [8:40:58<118:38:32, 12.14s/it]
  7%|▋         | 2772/37963 [8:41:08<111:38:40, 11.42s/it]
  7%|▋         | 2773/37963 [8:41:18<107:51:36, 11.03s/it]
  7%|▋         | 2774/37963 [8:41:28<105:09:30, 10.76s/it]
  7%|▋         | 2775/37963 [8:41:38<102:37:57, 10.50s/it]
  7%|▋         | 2776/37963 [8:41:48<101:13:25, 10.36s/it]
  7%|▋         | 2777/37963 [8:41:58<99:56:56, 10.23s/it] 
  7%|▋         | 2778/37963 [8:42:08<99:38:16, 10.19s/it]
  7%|▋         | 2779/37963 [8:42:18<98:27:55, 10.07s/it]
  7%|▋         | 2780/37963 [8:42:28<98:37:22, 10.09s/it]
                                                         
{'loss': '0.1657', 'grad_norm': '3.515', 'learning_rate': '1.99e-05', 'epoch': '0.07323'}

  7%|▋         | 2780/37963 [8:42:28<98:37:22, 10.09s/it]
  7%|▋         | 2781/37963 [8:42:38<98:36:39, 10.09s/it]
  7%|▋         | 2782/37963 [8:42:48<98:36:17, 10.09s/it]
  7%|▋         | 2783/37963 [8:42:58<98:03:30, 10.03s/it]
  7%|▋         | 2784/37963 [8:43:08<97:42:29, 10.00s/it]
  7%|▋         | 2785/37963 [8:43:25<117:26:16, 12.02s/it]
  7%|▋         | 2786/37963 [8:43:35<111:49:15, 11.44s/it]
  7%|▋         | 2787/37963 [8:43:45<107:53:40, 11.04s/it]
  7%|▋         | 2788/37963 [8:43:55<105:09:32, 10.76s/it]
  7%|▋         | 2789/37963 [8:44:05<102:01:58, 10.44s/it]
  7%|▋         | 2790/37963 [8:44:25<128:52:22, 13.19s/it]
                                                          
{'loss': '0.1702', 'grad_norm': '4.7', 'learning_rate': '1.99e-05', 'epoch': '0.07349'}

  7%|▋         | 2790/37963 [8:44:25<128:52:22, 13.19s/it]
  7%|▋         | 2791/37963 [8:44:35<119:50:33, 12.27s/it]
  7%|▋         | 2792/37963 [8:44:45<113:42:05, 11.64s/it]
  7%|▋         | 2793/37963 [8:44:55<109:20:48, 11.19s/it]
  7%|▋         | 2794/37963 [8:45:12<125:30:57, 12.85s/it]
  7%|▋         | 2795/37963 [8:45:22<117:31:50, 12.03s/it]
  7%|▋         | 2796/37963 [8:45:32<111:29:54, 11.41s/it]
  7%|▋         | 2797/37963 [8:45:55<146:39:31, 15.01s/it]
  7%|▋         | 2798/37963 [8:46:05<131:30:28, 13.46s/it]
  7%|▋         | 2799/37963 [8:46:15<121:40:14, 12.46s/it]
  7%|▋         | 2800/37963 [8:46:25<114:50:19, 11.76s/it]
                                                          
{'loss': '0.1767', 'grad_norm': '6.425', 'learning_rate': '1.99e-05', 'epoch': '0.07376'}

  7%|▋         | 2800/37963 [8:46:25<114:50:19, 11.76s/it]
  7%|▋         | 2801/37963 [8:46:35<109:39:21, 11.23s/it]
  7%|▋         | 2802/37963 [8:46:45<105:28:12, 10.80s/it]
  7%|▋         | 2803/37963 [8:46:55<103:31:15, 10.60s/it]
  7%|▋         | 2804/37963 [8:47:05<101:45:53, 10.42s/it]
  7%|▋         | 2805/37963 [8:47:15<100:20:54, 10.28s/it]
  7%|▋         | 2806/37963 [8:47:25<99:36:23, 10.20s/it] 
  7%|▋         | 2807/37963 [8:47:35<98:58:36, 10.14s/it]
  7%|▋         | 2808/37963 [8:47:45<98:19:14, 10.07s/it]
  7%|▋         | 2809/37963 [8:47:55<98:36:15, 10.10s/it]
  7%|▋         | 2810/37963 [8:48:12<117:14:14, 12.01s/it]
                                                          
{'loss': '0.1696', 'grad_norm': '3.577', 'learning_rate': '1.99e-05', 'epoch': '0.07402'}

  7%|▋         | 2810/37963 [8:48:12<117:14:14, 12.01s/it]
  7%|▋         | 2811/37963 [8:48:28<129:51:08, 13.30s/it]
  7%|▋         | 2812/37963 [8:48:38<120:38:11, 12.36s/it]
  7%|▋         | 2813/37963 [8:48:48<113:45:24, 11.65s/it]
  7%|▋         | 2814/37963 [8:48:58<109:13:35, 11.19s/it]
  7%|▋         | 2815/37963 [8:49:08<106:13:00, 10.88s/it]
  7%|▋         | 2816/37963 [8:49:18<103:42:44, 10.62s/it]
  7%|▋         | 2817/37963 [8:49:29<102:21:36, 10.48s/it]
  7%|▋         | 2818/37963 [8:49:39<101:23:47, 10.39s/it]
  7%|▋         | 2819/37963 [8:49:49<100:36:39, 10.31s/it]
  7%|▋         | 2820/37963 [8:50:05<118:49:47, 12.17s/it]
                                                          
{'loss': '0.1676', 'grad_norm': '2.727', 'learning_rate': '1.99e-05', 'epoch': '0.07428'}

  7%|▋         | 2820/37963 [8:50:05<118:49:47, 12.17s/it]
  7%|▋         | 2821/37963 [8:50:16<112:43:23, 11.55s/it]
  7%|▋         | 2822/37963 [8:50:26<108:45:00, 11.14s/it]
  7%|▋         | 2823/37963 [8:50:36<105:38:23, 10.82s/it]
  7%|▋         | 2824/37963 [8:50:46<104:02:13, 10.66s/it]
  7%|▋         | 2825/37963 [8:50:56<102:25:21, 10.49s/it]
  7%|▋         | 2826/37963 [8:51:06<101:27:37, 10.40s/it]
  7%|▋         | 2827/37963 [8:51:16<99:40:37, 10.21s/it] 
  7%|▋         | 2828/37963 [8:51:26<99:28:35, 10.19s/it]
  7%|▋         | 2829/37963 [8:51:36<99:21:50, 10.18s/it]
  7%|▋         | 2830/37963 [8:51:47<99:13:08, 10.17s/it]
                                                         
{'loss': '0.1928', 'grad_norm': '5.135', 'learning_rate': '1.99e-05', 'epoch': '0.07455'}

  7%|▋         | 2830/37963 [8:51:47<99:13:08, 10.17s/it]
  7%|▋         | 2831/37963 [8:51:57<99:30:50, 10.20s/it]
  7%|▋         | 2832/37963 [8:52:07<99:29:07, 10.19s/it]
  7%|▋         | 2833/37963 [8:52:17<98:51:08, 10.13s/it]
  7%|▋         | 2834/37963 [8:52:33<116:31:44, 11.94s/it]
  7%|▋         | 2835/37963 [8:52:43<111:05:05, 11.38s/it]
  7%|▋         | 2836/37963 [8:52:53<107:33:17, 11.02s/it]
  7%|▋         | 2837/37963 [8:53:03<103:56:23, 10.65s/it]
  7%|▋         | 2838/37963 [8:53:13<102:25:33, 10.50s/it]
  7%|▋         | 2839/37963 [8:53:24<101:23:34, 10.39s/it]
  7%|▋         | 2840/37963 [8:53:33<99:51:38, 10.24s/it] 
                                                         
{'loss': '0.1752', 'grad_norm': '4.415', 'learning_rate': '1.99e-05', 'epoch': '0.07481'}

  7%|▋         | 2840/37963 [8:53:33<99:51:38, 10.24s/it]
  7%|▋         | 2841/37963 [8:53:43<98:37:40, 10.11s/it]
  7%|▋         | 2842/37963 [8:53:53<98:48:01, 10.13s/it]
  7%|▋         | 2843/37963 [8:54:09<116:15:06, 11.92s/it]
  7%|▋         | 2844/37963 [8:54:29<138:43:14, 14.22s/it]
  7%|▋         | 2845/37963 [8:54:39<127:02:52, 13.02s/it]
  7%|▋         | 2846/37963 [8:55:02<156:34:37, 16.05s/it]
  7%|▋         | 2847/37963 [8:55:13<139:38:30, 14.32s/it]
  8%|▊         | 2848/37963 [8:55:23<127:30:34, 13.07s/it]
  8%|▊         | 2849/37963 [8:55:33<119:20:16, 12.23s/it]
  8%|▊         | 2850/37963 [8:55:43<112:20:53, 11.52s/it]
                                                          
{'loss': '0.1754', 'grad_norm': '2.548', 'learning_rate': '1.989e-05', 'epoch': '0.07507'}

  8%|▊         | 2850/37963 [8:55:43<112:20:53, 11.52s/it]
  8%|▊         | 2851/37963 [8:55:53<108:07:52, 11.09s/it]
  8%|▊         | 2852/37963 [8:56:03<105:14:49, 10.79s/it]
  8%|▊         | 2853/37963 [8:56:13<103:33:34, 10.62s/it]
  8%|▊         | 2854/37963 [8:56:23<101:52:45, 10.45s/it]
  8%|▊         | 2855/37963 [8:56:34<101:05:33, 10.37s/it]
  8%|▊         | 2856/37963 [8:56:44<99:58:27, 10.25s/it] 
  8%|▊         | 2857/37963 [8:56:54<99:42:45, 10.23s/it]
  8%|▊         | 2858/37963 [8:57:04<99:14:04, 10.18s/it]
  8%|▊         | 2859/37963 [8:57:21<119:39:23, 12.27s/it]
  8%|▊         | 2860/37963 [8:57:31<113:32:46, 11.64s/it]
                                                          
{'loss': '0.1855', 'grad_norm': '9.249', 'learning_rate': '1.989e-05', 'epoch': '0.07534'}

  8%|▊         | 2860/37963 [8:57:31<113:32:46, 11.64s/it]
  8%|▊         | 2861/37963 [8:57:41<109:36:36, 11.24s/it]
  8%|▊         | 2862/37963 [8:57:58<124:39:25, 12.78s/it]
  8%|▊         | 2863/37963 [8:58:08<116:31:46, 11.95s/it]
  8%|▊         | 2864/37963 [8:58:18<110:40:43, 11.35s/it]
  8%|▊         | 2865/37963 [8:58:28<107:14:45, 11.00s/it]
  8%|▊         | 2866/37963 [8:58:38<104:56:31, 10.76s/it]
  8%|▊         | 2867/37963 [8:58:48<103:12:14, 10.59s/it]
  8%|▊         | 2868/37963 [8:58:59<102:04:20, 10.47s/it]
  8%|▊         | 2869/37963 [8:59:09<101:27:01, 10.41s/it]
  8%|▊         | 2870/37963 [8:59:19<99:53:10, 10.25s/it] 
                                                         
{'loss': '0.1759', 'grad_norm': '3.361', 'learning_rate': '1.989e-05', 'epoch': '0.0756'}

  8%|▊         | 2870/37963 [8:59:19<99:53:10, 10.25s/it]
  8%|▊         | 2871/37963 [8:59:29<99:32:01, 10.21s/it]
  8%|▊         | 2872/37963 [8:59:39<99:21:01, 10.19s/it]
  8%|▊         | 2873/37963 [8:59:55<117:48:10, 12.09s/it]
  8%|▊         | 2874/37963 [9:00:06<112:40:32, 11.56s/it]
  8%|▊         | 2875/37963 [9:00:16<108:09:03, 11.10s/it]
  8%|▊         | 2876/37963 [9:00:26<105:42:11, 10.85s/it]
  8%|▊         | 2877/37963 [9:00:36<103:55:35, 10.66s/it]
  8%|▊         | 2878/37963 [9:00:46<102:31:45, 10.52s/it]
  8%|▊         | 2879/37963 [9:00:57<101:07:02, 10.38s/it]
  8%|▊         | 2880/37963 [9:01:07<100:31:55, 10.32s/it]
                                                          
{'loss': '0.1927', 'grad_norm': '4.559', 'learning_rate': '1.989e-05', 'epoch': '0.07586'}

  8%|▊         | 2880/37963 [9:01:07<100:31:55, 10.32s/it]
  8%|▊         | 2881/37963 [9:01:23<119:04:13, 12.22s/it]
  8%|▊         | 2882/37963 [9:01:33<112:59:18, 11.59s/it]
  8%|▊         | 2883/37963 [9:01:44<108:42:01, 11.16s/it]
  8%|▊         | 2884/37963 [9:01:54<105:25:20, 10.82s/it]
  8%|▊         | 2885/37963 [9:02:04<103:24:59, 10.61s/it]
  8%|▊         | 2886/37963 [9:02:14<102:01:01, 10.47s/it]
  8%|▊         | 2887/37963 [9:02:24<100:53:21, 10.35s/it]
  8%|▊         | 2888/37963 [9:02:44<129:25:29, 13.28s/it]
  8%|▊         | 2889/37963 [9:02:54<120:12:22, 12.34s/it]
  8%|▊         | 2890/37963 [9:03:04<113:54:41, 11.69s/it]
                                                          
{'loss': '0.1608', 'grad_norm': '2.242', 'learning_rate': '1.989e-05', 'epoch': '0.07613'}

  8%|▊         | 2890/37963 [9:03:04<113:54:41, 11.69s/it]
  8%|▊         | 2891/37963 [9:03:21<127:52:31, 13.13s/it]
  8%|▊         | 2892/37963 [9:03:31<119:04:45, 12.22s/it]
  8%|▊         | 2893/37963 [9:03:41<113:31:24, 11.65s/it]
  8%|▊         | 2894/37963 [9:03:51<108:07:59, 11.10s/it]
  8%|▊         | 2895/37963 [9:04:08<124:54:29, 12.82s/it]
  8%|▊         | 2896/37963 [9:04:18<117:02:13, 12.02s/it]
  8%|▊         | 2897/37963 [9:04:35<130:58:00, 13.45s/it]
  8%|▊         | 2898/37963 [9:04:45<121:43:52, 12.50s/it]
  8%|▊         | 2899/37963 [9:04:55<114:29:13, 11.75s/it]
  8%|▊         | 2900/37963 [9:05:05<109:33:33, 11.25s/it]
                                                          
{'loss': '0.1514', 'grad_norm': '4.637', 'learning_rate': '1.989e-05', 'epoch': '0.07639'}

  8%|▊         | 2900/37963 [9:05:05<109:33:33, 11.25s/it]
  8%|▊         | 2901/37963 [9:05:15<106:19:53, 10.92s/it]
  8%|▊         | 2902/37963 [9:05:26<103:56:01, 10.67s/it]
  8%|▊         | 2903/37963 [9:05:35<101:37:25, 10.43s/it]
  8%|▊         | 2904/37963 [9:05:46<100:46:58, 10.35s/it]
  8%|▊         | 2905/37963 [9:05:56<100:07:36, 10.28s/it]
  8%|▊         | 2906/37963 [9:06:05<98:30:34, 10.12s/it] 
  8%|▊         | 2907/37963 [9:06:16<98:39:58, 10.13s/it]
  8%|▊         | 2908/37963 [9:06:32<117:11:35, 12.04s/it]
  8%|▊         | 2909/37963 [9:06:49<130:59:57, 13.45s/it]
  8%|▊         | 2910/37963 [9:06:59<121:25:01, 12.47s/it]
                                                          
{'loss': '0.1823', 'grad_norm': '2.276', 'learning_rate': '1.989e-05', 'epoch': '0.07665'}

  8%|▊         | 2910/37963 [9:06:59<121:25:01, 12.47s/it]
  8%|▊         | 2911/37963 [9:07:09<114:40:16, 11.78s/it]
  8%|▊         | 2912/37963 [9:07:19<109:20:24, 11.23s/it]
  8%|▊         | 2913/37963 [9:07:29<106:08:28, 10.90s/it]
  8%|▊         | 2914/37963 [9:07:40<104:12:15, 10.70s/it]
  8%|▊         | 2915/37963 [9:07:50<102:40:18, 10.55s/it]
  8%|▊         | 2916/37963 [9:08:00<101:21:09, 10.41s/it]
  8%|▊         | 2917/37963 [9:08:10<99:49:45, 10.25s/it] 
  8%|▊         | 2918/37963 [9:08:19<98:12:38, 10.09s/it]
  8%|▊         | 2919/37963 [9:08:29<97:59:24, 10.07s/it]
  8%|▊         | 2920/37963 [9:08:39<97:08:24,  9.98s/it]
                                                         
{'loss': '0.1756', 'grad_norm': '3.783', 'learning_rate': '1.988e-05', 'epoch': '0.07692'}

  8%|▊         | 2920/37963 [9:08:39<97:08:24,  9.98s/it]
  8%|▊         | 2921/37963 [9:08:49<97:29:54, 10.02s/it]
  8%|▊         | 2922/37963 [9:08:59<97:45:24, 10.04s/it]
  8%|▊         | 2923/37963 [9:09:09<97:55:55, 10.06s/it]
  8%|▊         | 2924/37963 [9:09:26<117:08:06, 12.03s/it]
  8%|▊         | 2925/37963 [9:09:36<111:53:28, 11.50s/it]
  8%|▊         | 2926/37963 [9:09:47<108:48:21, 11.18s/it]
  8%|▊         | 2927/37963 [9:09:57<105:58:36, 10.89s/it]
  8%|▊         | 2928/37963 [9:10:07<103:56:49, 10.68s/it]
  8%|▊         | 2929/37963 [9:10:24<121:44:02, 12.51s/it]
  8%|▊         | 2930/37963 [9:10:34<113:25:52, 11.66s/it]
                                                          
{'loss': '0.168', 'grad_norm': '5.501', 'learning_rate': '1.988e-05', 'epoch': '0.07718'}

  8%|▊         | 2930/37963 [9:10:34<113:25:52, 11.66s/it]
  8%|▊         | 2931/37963 [9:10:53<136:54:13, 14.07s/it]
  8%|▊         | 2932/37963 [9:11:03<123:48:35, 12.72s/it]
  8%|▊         | 2933/37963 [9:11:13<116:27:29, 11.97s/it]
  8%|▊         | 2934/37963 [9:11:23<111:16:10, 11.44s/it]
  8%|▊         | 2935/37963 [9:11:34<107:40:58, 11.07s/it]
  8%|▊         | 2936/37963 [9:11:44<104:55:59, 10.78s/it]
  8%|▊         | 2937/37963 [9:11:54<102:34:46, 10.54s/it]
  8%|▊         | 2938/37963 [9:12:04<101:16:52, 10.41s/it]
  8%|▊         | 2939/37963 [9:12:14<100:38:19, 10.34s/it]
  8%|▊         | 2940/37963 [9:12:31<119:43:07, 12.31s/it]
                                                          
{'loss': '0.1787', 'grad_norm': '1.914', 'learning_rate': '1.988e-05', 'epoch': '0.07744'}

  8%|▊         | 2940/37963 [9:12:31<119:43:07, 12.31s/it]
  8%|▊         | 2941/37963 [9:12:47<131:58:22, 13.57s/it]
  8%|▊         | 2942/37963 [9:12:58<122:17:30, 12.57s/it]
  8%|▊         | 2943/37963 [9:13:08<115:14:44, 11.85s/it]
  8%|▊         | 2944/37963 [9:13:18<109:39:27, 11.27s/it]
  8%|▊         | 2945/37963 [9:13:28<106:28:16, 10.95s/it]
  8%|▊         | 2946/37963 [9:13:38<104:13:26, 10.71s/it]
  8%|▊         | 2947/37963 [9:13:48<102:44:40, 10.56s/it]
  8%|▊         | 2948/37963 [9:14:04<117:41:18, 12.10s/it]
  8%|▊         | 2949/37963 [9:14:14<111:57:49, 11.51s/it]
  8%|▊         | 2950/37963 [9:14:24<108:00:11, 11.10s/it]
                                                          
{'loss': '0.1694', 'grad_norm': '2.13', 'learning_rate': '1.988e-05', 'epoch': '0.07771'}

  8%|▊         | 2950/37963 [9:14:24<108:00:11, 11.10s/it]
  8%|▊         | 2951/37963 [9:14:34<105:13:32, 10.82s/it]
  8%|▊         | 2952/37963 [9:14:45<103:16:00, 10.62s/it]
  8%|▊         | 2953/37963 [9:14:55<101:28:21, 10.43s/it]
  8%|▊         | 2954/37963 [9:15:11<120:05:02, 12.35s/it]
  8%|▊         | 2955/37963 [9:15:21<113:13:01, 11.64s/it]
  8%|▊         | 2956/37963 [9:15:32<109:05:48, 11.22s/it]
  8%|▊         | 2957/37963 [9:15:48<124:33:50, 12.81s/it]
  8%|▊         | 2958/37963 [9:15:58<116:52:23, 12.02s/it]
  8%|▊         | 2959/37963 [9:16:08<111:16:56, 11.44s/it]
  8%|▊         | 2960/37963 [9:16:18<107:01:39, 11.01s/it]
                                                          
{'loss': '0.1702', 'grad_norm': '2.278', 'learning_rate': '1.988e-05', 'epoch': '0.07797'}

  8%|▊         | 2960/37963 [9:16:18<107:01:39, 11.01s/it]
  8%|▊         | 2961/37963 [9:16:28<104:26:26, 10.74s/it]
  8%|▊         | 2962/37963 [9:16:39<102:32:26, 10.55s/it]
  8%|▊         | 2963/37963 [9:16:49<101:16:33, 10.42s/it]
  8%|▊         | 2964/37963 [9:16:59<100:29:10, 10.34s/it]
  8%|▊         | 2965/37963 [9:17:09<99:38:11, 10.25s/it] 
  8%|▊         | 2966/37963 [9:17:19<98:34:01, 10.14s/it]
  8%|▊         | 2967/37963 [9:17:29<98:53:52, 10.17s/it]
  8%|▊         | 2968/37963 [9:17:39<98:27:29, 10.13s/it]
  8%|▊         | 2969/37963 [9:17:49<98:30:33, 10.13s/it]
  8%|▊         | 2970/37963 [9:17:59<98:55:25, 10.18s/it]
                                                         
{'loss': '0.1851', 'grad_norm': '2.505', 'learning_rate': '1.988e-05', 'epoch': '0.07823'}

  8%|▊         | 2970/37963 [9:17:59<98:55:25, 10.18s/it]
  8%|▊         | 2971/37963 [9:18:09<98:22:18, 10.12s/it]
  8%|▊         | 2972/37963 [9:18:26<116:32:40, 11.99s/it]
  8%|▊         | 2973/37963 [9:18:36<111:01:34, 11.42s/it]
  8%|▊         | 2974/37963 [9:18:46<107:02:03, 11.01s/it]
  8%|▊         | 2975/37963 [9:19:03<123:27:58, 12.70s/it]
  8%|▊         | 2976/37963 [9:19:13<115:45:42, 11.91s/it]
  8%|▊         | 2977/37963 [9:19:23<110:38:45, 11.39s/it]
  8%|▊         | 2978/37963 [9:19:42<134:08:32, 13.80s/it]
  8%|▊         | 2979/37963 [9:19:53<123:46:35, 12.74s/it]
  8%|▊         | 2980/37963 [9:20:03<116:29:17, 11.99s/it]
                                                          
{'loss': '0.1834', 'grad_norm': '1.926', 'learning_rate': '1.988e-05', 'epoch': '0.0785'}

  8%|▊         | 2980/37963 [9:20:03<116:29:17, 11.99s/it]
  8%|▊         | 2981/37963 [9:20:13<110:58:33, 11.42s/it]
  8%|▊         | 2982/37963 [9:20:23<107:15:05, 11.04s/it]
  8%|▊         | 2983/37963 [9:20:33<104:31:12, 10.76s/it]
  8%|▊         | 2984/37963 [9:20:43<101:28:19, 10.44s/it]
  8%|▊         | 2985/37963 [9:20:53<100:29:08, 10.34s/it]
  8%|▊         | 2986/37963 [9:21:03<99:42:47, 10.26s/it] 
  8%|▊         | 2987/37963 [9:21:19<117:46:58, 12.12s/it]
  8%|▊         | 2988/37963 [9:21:30<112:22:58, 11.57s/it]
  8%|▊         | 2989/37963 [9:21:40<107:58:52, 11.11s/it]
  8%|▊         | 2990/37963 [9:21:56<123:48:46, 12.74s/it]
                                                          
{'loss': '0.17', 'grad_norm': '4.182', 'learning_rate': '1.988e-05', 'epoch': '0.07876'}

  8%|▊         | 2990/37963 [9:21:56<123:48:46, 12.74s/it]
  8%|▊         | 2991/37963 [9:22:06<114:51:41, 11.82s/it]
  8%|▊         | 2992/37963 [9:22:16<110:19:08, 11.36s/it]
  8%|▊         | 2993/37963 [9:22:26<106:45:59, 10.99s/it]
  8%|▊         | 2994/37963 [9:22:36<103:39:58, 10.67s/it]
  8%|▊         | 2995/37963 [9:22:46<101:29:43, 10.45s/it]
  8%|▊         | 2996/37963 [9:22:56<99:58:10, 10.29s/it] 
  8%|▊         | 2997/37963 [9:23:06<97:14:15, 10.01s/it]
  8%|▊         | 2998/37963 [9:23:22<116:43:40, 12.02s/it]
  8%|▊         | 2999/37963 [9:23:32<111:31:27, 11.48s/it]
  8%|▊         | 3000/37963 [9:23:43<107:40:34, 11.09s/it]
                                                          
{'loss': '0.159', 'grad_norm': '3.188', 'learning_rate': '1.987e-05', 'epoch': '0.07902'}

  8%|▊         | 3000/37963 [9:23:43<107:40:34, 11.09s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.19s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.20s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  8%|▊         | 3001/37963 [9:24:44<253:04:47, 26.06s/it]
  8%|▊         | 3002/37963 [9:24:54<208:35:25, 21.48s/it]
  8%|▊         | 3003/37963 [9:25:04<174:37:25, 17.98s/it]
  8%|▊         | 3004/37963 [9:25:21<169:37:07, 17.47s/it]
  8%|▊         | 3005/37963 [9:25:31<148:26:50, 15.29s/it]
  8%|▊         | 3006/37963 [9:25:41<133:29:06, 13.75s/it]
  8%|▊         | 3007/37963 [9:25:57<139:55:16, 14.41s/it]
  8%|▊         | 3008/37963 [9:26:07<127:21:29, 13.12s/it]
  8%|▊         | 3009/37963 [9:26:17<117:51:27, 12.14s/it]
  8%|▊         | 3010/37963 [9:26:27<111:58:32, 11.53s/it]
                                                          
{'loss': '0.1839', 'grad_norm': '3.445', 'learning_rate': '1.987e-05', 'epoch': '0.07929'}

  8%|▊         | 3010/37963 [9:26:27<111:58:32, 11.53s/it]
  8%|▊         | 3011/37963 [9:26:37<107:43:35, 11.10s/it]
  8%|▊         | 3012/37963 [9:26:47<104:50:03, 10.80s/it]
  8%|▊         | 3013/37963 [9:26:57<102:42:41, 10.58s/it]
  8%|▊         | 3014/37963 [9:27:07<101:13:00, 10.43s/it]
  8%|▊         | 3015/37963 [9:27:17<100:32:17, 10.36s/it]
  8%|▊         | 3016/37963 [9:27:28<99:48:55, 10.28s/it] 
  8%|▊         | 3017/37963 [9:27:38<99:24:53, 10.24s/it]
  8%|▊         | 3018/37963 [9:27:48<99:14:30, 10.22s/it]
  8%|▊         | 3019/37963 [9:27:58<98:52:38, 10.19s/it]
  8%|▊         | 3020/37963 [9:28:14<117:08:34, 12.07s/it]
                                                          
{'loss': '0.1592', 'grad_norm': '4.189', 'learning_rate': '1.987e-05', 'epoch': '0.07955'}

  8%|▊         | 3020/37963 [9:28:14<117:08:34, 12.07s/it]
  8%|▊         | 3021/37963 [9:28:25<111:56:18, 11.53s/it]
  8%|▊         | 3022/37963 [9:28:35<106:56:11, 11.02s/it]
  8%|▊         | 3023/37963 [9:28:54<131:28:07, 13.55s/it]
  8%|▊         | 3024/37963 [9:29:04<121:49:31, 12.55s/it]
  8%|▊         | 3025/37963 [9:29:14<114:44:53, 11.82s/it]
  8%|▊         | 3026/37963 [9:29:25<110:10:15, 11.35s/it]
  8%|▊         | 3027/37963 [9:29:35<106:40:50, 10.99s/it]
  8%|▊         | 3028/37963 [9:29:45<103:23:47, 10.65s/it]
  8%|▊         | 3029/37963 [9:29:55<102:05:53, 10.52s/it]
  8%|▊         | 3030/37963 [9:30:05<100:18:11, 10.34s/it]
                                                          
{'loss': '0.1591', 'grad_norm': '4.648', 'learning_rate': '1.987e-05', 'epoch': '0.07981'}

  8%|▊         | 3030/37963 [9:30:05<100:18:11, 10.34s/it]
  8%|▊         | 3031/37963 [9:30:15<99:45:14, 10.28s/it] 
  8%|▊         | 3032/37963 [9:30:31<117:29:59, 12.11s/it]
  8%|▊         | 3033/37963 [9:30:41<111:11:09, 11.46s/it]
  8%|▊         | 3034/37963 [9:30:51<106:28:43, 10.97s/it]
  8%|▊         | 3035/37963 [9:31:01<103:48:48, 10.70s/it]
  8%|▊         | 3036/37963 [9:31:11<101:40:22, 10.48s/it]
  8%|▊         | 3037/37963 [9:31:21<100:58:10, 10.41s/it]
  8%|▊         | 3038/37963 [9:31:31<100:04:11, 10.32s/it]
  8%|▊         | 3039/37963 [9:31:48<118:28:34, 12.21s/it]
  8%|▊         | 3040/37963 [9:31:58<112:38:33, 11.61s/it]
                                                          
{'loss': '0.1652', 'grad_norm': '2.544', 'learning_rate': '1.987e-05', 'epoch': '0.08008'}

  8%|▊         | 3040/37963 [9:31:58<112:38:33, 11.61s/it]
  8%|▊         | 3041/37963 [9:32:08<108:12:30, 11.15s/it]
  8%|▊         | 3042/37963 [9:32:19<105:36:16, 10.89s/it]
  8%|▊         | 3043/37963 [9:32:29<103:32:19, 10.67s/it]
  8%|▊         | 3044/37963 [9:32:39<102:08:56, 10.53s/it]
  8%|▊         | 3045/37963 [9:32:49<101:07:02, 10.43s/it]
  8%|▊         | 3046/37963 [9:33:06<119:38:57, 12.34s/it]
  8%|▊         | 3047/37963 [9:33:16<111:59:30, 11.55s/it]
  8%|▊         | 3048/37963 [9:33:26<108:26:38, 11.18s/it]
  8%|▊         | 3049/37963 [9:33:36<103:56:52, 10.72s/it]
  8%|▊         | 3050/37963 [9:33:46<102:17:47, 10.55s/it]
                                                          
{'loss': '0.1783', 'grad_norm': '4.835', 'learning_rate': '1.987e-05', 'epoch': '0.08034'}

  8%|▊         | 3050/37963 [9:33:46<102:17:47, 10.55s/it]
  8%|▊         | 3051/37963 [9:33:56<100:52:43, 10.40s/it]
  8%|▊         | 3052/37963 [9:34:12<117:40:12, 12.13s/it]
  8%|▊         | 3053/37963 [9:34:22<111:47:50, 11.53s/it]
  8%|▊         | 3054/37963 [9:34:32<107:36:10, 11.10s/it]
  8%|▊         | 3055/37963 [9:34:42<104:11:34, 10.75s/it]
  8%|▊         | 3056/37963 [9:34:59<121:12:25, 12.50s/it]
  8%|▊         | 3057/37963 [9:35:08<113:06:25, 11.67s/it]
  8%|▊         | 3058/37963 [9:35:19<109:09:31, 11.26s/it]
  8%|▊         | 3059/37963 [9:35:29<105:28:05, 10.88s/it]
  8%|▊         | 3060/37963 [9:35:39<102:52:14, 10.61s/it]
                                                          
{'loss': '0.1788', 'grad_norm': '1.383', 'learning_rate': '1.987e-05', 'epoch': '0.08061'}

  8%|▊         | 3060/37963 [9:35:39<102:52:14, 10.61s/it]
  8%|▊         | 3061/37963 [9:35:49<101:40:16, 10.49s/it]
  8%|▊         | 3062/37963 [9:35:59<100:06:11, 10.33s/it]
  8%|▊         | 3063/37963 [9:36:09<98:27:50, 10.16s/it] 
  8%|▊         | 3064/37963 [9:36:25<116:26:13, 12.01s/it]
  8%|▊         | 3065/37963 [9:36:35<111:04:45, 11.46s/it]
  8%|▊         | 3066/37963 [9:36:45<107:28:31, 11.09s/it]
  8%|▊         | 3067/37963 [9:36:55<103:57:47, 10.73s/it]
  8%|▊         | 3068/37963 [9:37:05<102:13:15, 10.55s/it]
  8%|▊         | 3069/37963 [9:37:15<100:47:54, 10.40s/it]
  8%|▊         | 3070/37963 [9:37:26<100:00:08, 10.32s/it]
                                                          
{'loss': '0.1636', 'grad_norm': '3.21', 'learning_rate': '1.986e-05', 'epoch': '0.08087'}

  8%|▊         | 3070/37963 [9:37:26<100:00:08, 10.32s/it]
  8%|▊         | 3071/37963 [9:37:36<99:23:13, 10.25s/it] 
  8%|▊         | 3072/37963 [9:37:46<98:54:51, 10.21s/it]
  8%|▊         | 3073/37963 [9:38:02<117:45:27, 12.15s/it]
  8%|▊         | 3074/37963 [9:38:13<111:54:33, 11.55s/it]
  8%|▊         | 3075/37963 [9:38:23<107:49:41, 11.13s/it]
  8%|▊         | 3076/37963 [9:38:33<104:49:09, 10.82s/it]
  8%|▊         | 3077/37963 [9:38:53<130:57:07, 13.51s/it]
  8%|▊         | 3078/37963 [9:39:02<119:39:56, 12.35s/it]
  8%|▊         | 3079/37963 [9:39:12<113:09:38, 11.68s/it]
  8%|▊         | 3080/37963 [9:39:23<108:49:25, 11.23s/it]
                                                          
{'loss': '0.1839', 'grad_norm': '2.978', 'learning_rate': '1.986e-05', 'epoch': '0.08113'}

  8%|▊         | 3080/37963 [9:39:23<108:49:25, 11.23s/it]
  8%|▊         | 3081/37963 [9:39:39<124:42:08, 12.87s/it]
  8%|▊         | 3082/37963 [9:39:49<117:06:15, 12.09s/it]
  8%|▊         | 3083/37963 [9:40:00<111:33:11, 11.51s/it]
  8%|▊         | 3084/37963 [9:40:10<107:29:02, 11.09s/it]
  8%|▊         | 3085/37963 [9:40:20<104:31:09, 10.79s/it]
  8%|▊         | 3086/37963 [9:40:30<103:12:45, 10.65s/it]
  8%|▊         | 3087/37963 [9:40:47<120:49:17, 12.47s/it]
  8%|▊         | 3088/37963 [9:40:57<113:47:44, 11.75s/it]
  8%|▊         | 3089/37963 [9:41:07<108:59:32, 11.25s/it]
  8%|▊         | 3090/37963 [9:41:17<104:57:40, 10.84s/it]
                                                          
{'loss': '0.1754', 'grad_norm': '5.177', 'learning_rate': '1.986e-05', 'epoch': '0.0814'}

  8%|▊         | 3090/37963 [9:41:17<104:57:40, 10.84s/it]
  8%|▊         | 3091/37963 [9:41:27<102:40:32, 10.60s/it]
  8%|▊         | 3092/37963 [9:41:37<101:27:10, 10.47s/it]
  8%|▊         | 3093/37963 [9:41:54<119:19:03, 12.32s/it]
  8%|▊         | 3094/37963 [9:42:04<112:58:31, 11.66s/it]
  8%|▊         | 3095/37963 [9:42:14<108:38:00, 11.22s/it]
  8%|▊         | 3096/37963 [9:42:24<105:48:09, 10.92s/it]
  8%|▊         | 3097/37963 [9:42:34<102:59:42, 10.63s/it]
  8%|▊         | 3098/37963 [9:42:45<101:53:24, 10.52s/it]
  8%|▊         | 3099/37963 [9:42:55<100:43:39, 10.40s/it]
  8%|▊         | 3100/37963 [9:43:11<117:56:15, 12.18s/it]
                                                          
{'loss': '0.1897', 'grad_norm': '1.71', 'learning_rate': '1.986e-05', 'epoch': '0.08166'}

  8%|▊         | 3100/37963 [9:43:11<117:56:15, 12.18s/it]
  8%|▊         | 3101/37963 [9:43:21<112:13:09, 11.59s/it]
  8%|▊         | 3102/37963 [9:43:38<126:14:21, 13.04s/it]
  8%|▊         | 3103/37963 [9:43:48<117:34:21, 12.14s/it]
  8%|▊         | 3104/37963 [9:43:58<111:01:30, 11.47s/it]
  8%|▊         | 3105/37963 [9:44:08<106:57:48, 11.05s/it]
  8%|▊         | 3106/37963 [9:44:18<104:42:24, 10.81s/it]
  8%|▊         | 3107/37963 [9:44:28<102:44:09, 10.61s/it]
  8%|▊         | 3108/37963 [9:44:38<101:12:33, 10.45s/it]
  8%|▊         | 3109/37963 [9:44:48<100:44:40, 10.41s/it]
  8%|▊         | 3110/37963 [9:44:59<100:08:41, 10.34s/it]
                                                          
{'loss': '0.1649', 'grad_norm': '3.607', 'learning_rate': '1.986e-05', 'epoch': '0.08192'}

  8%|▊         | 3110/37963 [9:44:59<100:08:41, 10.34s/it]
  8%|▊         | 3111/37963 [9:45:15<118:38:58, 12.26s/it]
  8%|▊         | 3112/37963 [9:45:25<110:51:23, 11.45s/it]
  8%|▊         | 3113/37963 [9:45:35<106:47:26, 11.03s/it]
  8%|▊         | 3114/37963 [9:45:45<104:32:56, 10.80s/it]
  8%|▊         | 3115/37963 [9:45:55<102:57:03, 10.64s/it]
  8%|▊         | 3116/37963 [9:46:06<101:13:54, 10.46s/it]
  8%|▊         | 3117/37963 [9:46:16<100:21:35, 10.37s/it]
  8%|▊         | 3118/37963 [9:46:26<99:42:07, 10.30s/it] 
  8%|▊         | 3119/37963 [9:46:36<99:22:44, 10.27s/it]
  8%|▊         | 3120/37963 [9:46:46<98:58:20, 10.23s/it]
                                                         
{'loss': '0.1694', 'grad_norm': '2.844', 'learning_rate': '1.986e-05', 'epoch': '0.08219'}

  8%|▊         | 3120/37963 [9:46:46<98:58:20, 10.23s/it]
  8%|▊         | 3121/37963 [9:47:03<117:43:19, 12.16s/it]
  8%|▊         | 3122/37963 [9:47:13<112:05:35, 11.58s/it]
  8%|▊         | 3123/37963 [9:47:23<108:02:18, 11.16s/it]
  8%|▊         | 3124/37963 [9:47:33<104:59:07, 10.85s/it]
  8%|▊         | 3125/37963 [9:47:44<103:13:16, 10.67s/it]
  8%|▊         | 3126/37963 [9:48:03<129:48:28, 13.41s/it]
  8%|▊         | 3127/37963 [9:48:14<120:34:23, 12.46s/it]
  8%|▊         | 3128/37963 [9:48:24<114:17:34, 11.81s/it]
  8%|▊         | 3129/37963 [9:48:34<108:35:29, 11.22s/it]
  8%|▊         | 3130/37963 [9:48:50<124:22:34, 12.85s/it]
                                                          
{'loss': '0.179', 'grad_norm': '7.439', 'learning_rate': '1.986e-05', 'epoch': '0.08245'}

  8%|▊         | 3130/37963 [9:48:50<124:22:34, 12.85s/it]
  8%|▊         | 3131/37963 [9:49:00<115:09:11, 11.90s/it]
  8%|▊         | 3132/37963 [9:49:10<109:23:53, 11.31s/it]
  8%|▊         | 3133/37963 [9:49:20<106:06:06, 10.97s/it]
  8%|▊         | 3134/37963 [9:49:37<121:45:39, 12.59s/it]
  8%|▊         | 3135/37963 [9:49:47<114:26:36, 11.83s/it]
  8%|▊         | 3136/37963 [9:49:57<109:24:45, 11.31s/it]
  8%|▊         | 3137/37963 [9:50:07<105:12:29, 10.88s/it]
  8%|▊         | 3138/37963 [9:50:17<102:48:30, 10.63s/it]
  8%|▊         | 3139/37963 [9:50:27<101:43:42, 10.52s/it]
  8%|▊         | 3140/37963 [9:50:37<100:34:57, 10.40s/it]
                                                          
{'loss': '0.1734', 'grad_norm': '3.477', 'learning_rate': '1.985e-05', 'epoch': '0.08271'}

  8%|▊         | 3140/37963 [9:50:37<100:34:57, 10.40s/it]
  8%|▊         | 3141/37963 [9:50:47<99:17:48, 10.27s/it] 
  8%|▊         | 3142/37963 [9:51:03<117:05:02, 12.10s/it]
  8%|▊         | 3143/37963 [9:51:14<111:36:35, 11.54s/it]
  8%|▊         | 3144/37963 [9:51:24<107:39:45, 11.13s/it]
  8%|▊         | 3145/37963 [9:51:34<104:18:58, 10.79s/it]
  8%|▊         | 3146/37963 [9:51:44<102:33:35, 10.60s/it]
  8%|▊         | 3147/37963 [9:51:54<101:05:21, 10.45s/it]
  8%|▊         | 3148/37963 [9:52:04<100:02:33, 10.34s/it]
  8%|▊         | 3149/37963 [9:52:27<137:05:00, 14.18s/it]
  8%|▊         | 3150/37963 [9:52:37<124:39:42, 12.89s/it]
                                                          
{'loss': '0.1806', 'grad_norm': '7.006', 'learning_rate': '1.985e-05', 'epoch': '0.08298'}

  8%|▊         | 3150/37963 [9:52:37<124:39:42, 12.89s/it]
  8%|▊         | 3151/37963 [9:52:47<116:56:18, 12.09s/it]
  8%|▊         | 3152/37963 [9:52:58<111:29:56, 11.53s/it]
  8%|▊         | 3153/37963 [9:53:08<107:12:09, 11.09s/it]
  8%|▊         | 3154/37963 [9:53:18<104:19:58, 10.79s/it]
  8%|▊         | 3155/37963 [9:53:28<103:19:10, 10.69s/it]
  8%|▊         | 3156/37963 [9:53:38<101:35:50, 10.51s/it]
  8%|▊         | 3157/37963 [9:53:48<100:08:13, 10.36s/it]
  8%|▊         | 3158/37963 [9:53:59<99:40:58, 10.31s/it] 
  8%|▊         | 3159/37963 [9:54:08<98:31:26, 10.19s/it]
  8%|▊         | 3160/37963 [9:54:19<98:18:27, 10.17s/it]
                                                         
{'loss': '0.172', 'grad_norm': '6.198', 'learning_rate': '1.985e-05', 'epoch': '0.08324'}

  8%|▊         | 3160/37963 [9:54:19<98:18:27, 10.17s/it]
  8%|▊         | 3161/37963 [9:54:29<98:08:28, 10.15s/it]
  8%|▊         | 3162/37963 [9:54:45<116:54:20, 12.09s/it]
  8%|▊         | 3163/37963 [9:54:55<110:53:20, 11.47s/it]
  8%|▊         | 3164/37963 [9:55:06<107:17:29, 11.10s/it]
  8%|▊         | 3165/37963 [9:55:16<104:21:59, 10.80s/it]
  8%|▊         | 3166/37963 [9:55:26<102:10:52, 10.57s/it]
  8%|▊         | 3167/37963 [9:55:35<99:46:42, 10.32s/it] 
  8%|▊         | 3168/37963 [9:55:45<97:49:55, 10.12s/it]
  8%|▊         | 3169/37963 [9:55:55<97:38:19, 10.10s/it]
  8%|▊         | 3170/37963 [9:56:12<115:57:50, 12.00s/it]
                                                          
{'loss': '0.1635', 'grad_norm': '1.178', 'learning_rate': '1.985e-05', 'epoch': '0.0835'}

  8%|▊         | 3170/37963 [9:56:12<115:57:50, 12.00s/it]
  8%|▊         | 3171/37963 [9:56:21<109:19:40, 11.31s/it]
  8%|▊         | 3172/37963 [9:56:31<105:50:01, 10.95s/it]
  8%|▊         | 3173/37963 [9:56:42<103:37:26, 10.72s/it]
  8%|▊         | 3174/37963 [9:56:52<101:57:49, 10.55s/it]
  8%|▊         | 3175/37963 [9:57:02<100:52:07, 10.44s/it]
  8%|▊         | 3176/37963 [9:57:12<99:54:30, 10.34s/it] 
  8%|▊         | 3177/37963 [9:57:22<99:17:17, 10.28s/it]
  8%|▊         | 3178/37963 [9:57:39<117:39:33, 12.18s/it]
  8%|▊         | 3179/37963 [9:57:49<112:14:16, 11.62s/it]
  8%|▊         | 3180/37963 [9:58:09<136:14:10, 14.10s/it]
                                                          
{'loss': '0.1573', 'grad_norm': '4.086', 'learning_rate': '1.985e-05', 'epoch': '0.08377'}

  8%|▊         | 3180/37963 [9:58:09<136:14:10, 14.10s/it]
  8%|▊         | 3181/37963 [9:58:25<143:05:48, 14.81s/it]
  8%|▊         | 3182/37963 [9:58:36<129:38:02, 13.42s/it]
  8%|▊         | 3183/37963 [9:58:46<120:05:56, 12.43s/it]
  8%|▊         | 3184/37963 [9:58:56<113:27:59, 11.74s/it]
  8%|▊         | 3185/37963 [9:59:06<109:09:55, 11.30s/it]
  8%|▊         | 3186/37963 [9:59:16<105:59:03, 10.97s/it]
  8%|▊         | 3187/37963 [9:59:26<103:04:29, 10.67s/it]
  8%|▊         | 3188/37963 [9:59:36<101:48:02, 10.54s/it]
  8%|▊         | 3189/37963 [9:59:47<100:55:57, 10.45s/it]
  8%|▊         | 3190/37963 [9:59:57<99:42:47, 10.32s/it] 
                                                         
{'loss': '0.1684', 'grad_norm': '3.417', 'learning_rate': '1.985e-05', 'epoch': '0.08403'}

  8%|▊         | 3190/37963 [9:59:57<99:42:47, 10.32s/it]
  8%|▊         | 3191/37963 [10:00:07<99:04:05, 10.26s/it]
  8%|▊         | 3192/37963 [10:00:17<98:34:23, 10.21s/it]
  8%|▊         | 3193/37963 [10:00:27<97:41:55, 10.12s/it]
  8%|▊         | 3194/37963 [10:00:43<116:26:52, 12.06s/it]
  8%|▊         | 3195/37963 [10:00:54<110:45:32, 11.47s/it]
  8%|▊         | 3196/37963 [10:01:03<105:57:35, 10.97s/it]
  8%|▊         | 3197/37963 [10:01:20<121:42:44, 12.60s/it]
  8%|▊         | 3198/37963 [10:01:36<132:55:32, 13.76s/it]
  8%|▊         | 3199/37963 [10:01:46<122:23:45, 12.67s/it]
  8%|▊         | 3200/37963 [10:01:57<115:08:50, 11.92s/it]
                                                           
{'loss': '0.1799', 'grad_norm': '4.391', 'learning_rate': '1.985e-05', 'epoch': '0.08429'}

  8%|▊         | 3200/37963 [10:01:57<115:08:50, 11.92s/it]
  8%|▊         | 3201/37963 [10:02:06<108:49:12, 11.27s/it]
  8%|▊         | 3202/37963 [10:02:16<105:19:53, 10.91s/it]
  8%|▊         | 3203/37963 [10:02:27<103:27:58, 10.72s/it]
  8%|▊         | 3204/37963 [10:02:37<101:20:42, 10.50s/it]
  8%|▊         | 3205/37963 [10:02:47<100:22:43, 10.40s/it]
  8%|▊         | 3206/37963 [10:02:57<98:45:33, 10.23s/it] 
  8%|▊         | 3207/37963 [10:03:07<98:31:34, 10.21s/it]
  8%|▊         | 3208/37963 [10:03:17<97:16:50, 10.08s/it]
  8%|▊         | 3209/37963 [10:03:33<115:50:18, 12.00s/it]
  8%|▊         | 3210/37963 [10:03:43<110:22:07, 11.43s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '2.466', 'learning_rate': '1.984e-05', 'epoch': '0.08456'}

  8%|▊         | 3210/37963 [10:03:43<110:22:07, 11.43s/it]
  8%|▊         | 3211/37963 [10:03:53<106:51:50, 11.07s/it]
  8%|▊         | 3212/37963 [10:04:03<103:20:33, 10.71s/it]
  8%|▊         | 3213/37963 [10:04:13<101:31:24, 10.52s/it]
  8%|▊         | 3214/37963 [10:04:23<100:24:29, 10.40s/it]
  8%|▊         | 3215/37963 [10:04:33<99:27:11, 10.30s/it] 
  8%|▊         | 3216/37963 [10:04:44<98:44:36, 10.23s/it]
  8%|▊         | 3217/37963 [10:04:54<98:35:12, 10.21s/it]
  8%|▊         | 3218/37963 [10:05:04<98:16:06, 10.18s/it]
  8%|▊         | 3219/37963 [10:05:14<98:02:08, 10.16s/it]
  8%|▊         | 3220/37963 [10:05:30<116:33:55, 12.08s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '5.653', 'learning_rate': '1.984e-05', 'epoch': '0.08482'}

  8%|▊         | 3220/37963 [10:05:30<116:33:55, 12.08s/it]
  8%|▊         | 3221/37963 [10:05:41<110:39:51, 11.47s/it]
  8%|▊         | 3222/37963 [10:05:51<106:52:53, 11.08s/it]
  8%|▊         | 3223/37963 [10:06:01<103:53:59, 10.77s/it]
  8%|▊         | 3224/37963 [10:06:11<102:06:59, 10.58s/it]
  8%|▊         | 3225/37963 [10:06:21<100:35:55, 10.43s/it]
  8%|▊         | 3226/37963 [10:06:47<146:36:56, 15.19s/it]
  9%|▊         | 3227/37963 [10:06:57<131:45:19, 13.65s/it]
  9%|▊         | 3228/37963 [10:07:14<140:39:42, 14.58s/it]
  9%|▊         | 3229/37963 [10:07:24<127:43:37, 13.24s/it]
  9%|▊         | 3230/37963 [10:07:34<118:50:41, 12.32s/it]
                                                           
{'loss': '0.1803', 'grad_norm': '3.074', 'learning_rate': '1.984e-05', 'epoch': '0.08508'}

  9%|▊         | 3230/37963 [10:07:34<118:50:41, 12.32s/it]
  9%|▊         | 3231/37963 [10:07:44<111:30:26, 11.56s/it]
  9%|▊         | 3232/37963 [10:07:54<107:39:02, 11.16s/it]
  9%|▊         | 3233/37963 [10:08:04<104:22:23, 10.82s/it]
  9%|▊         | 3234/37963 [10:08:14<101:56:20, 10.57s/it]
  9%|▊         | 3235/37963 [10:08:24<100:23:41, 10.41s/it]
  9%|▊         | 3236/37963 [10:08:34<99:21:03, 10.30s/it] 
  9%|▊         | 3237/37963 [10:08:44<98:01:45, 10.16s/it]
  9%|▊         | 3238/37963 [10:08:54<97:31:05, 10.11s/it]
  9%|▊         | 3239/37963 [10:09:04<97:27:23, 10.10s/it]
  9%|▊         | 3240/37963 [10:09:15<97:38:11, 10.12s/it]
                                                          
{'loss': '0.1625', 'grad_norm': '3.599', 'learning_rate': '1.984e-05', 'epoch': '0.08535'}

  9%|▊         | 3240/37963 [10:09:15<97:38:11, 10.12s/it]
  9%|▊         | 3241/37963 [10:09:24<96:28:39, 10.00s/it]
  9%|▊         | 3242/37963 [10:09:34<96:57:07, 10.05s/it]
  9%|▊         | 3243/37963 [10:09:45<97:29:27, 10.11s/it]
  9%|▊         | 3244/37963 [10:09:55<97:34:34, 10.12s/it]
  9%|▊         | 3245/37963 [10:10:11<116:03:10, 12.03s/it]
  9%|▊         | 3246/37963 [10:10:28<129:20:53, 13.41s/it]
  9%|▊         | 3247/37963 [10:10:45<139:47:52, 14.50s/it]
  9%|▊         | 3248/37963 [10:10:55<126:55:08, 13.16s/it]
  9%|▊         | 3249/37963 [10:11:05<118:28:32, 12.29s/it]
  9%|▊         | 3250/37963 [10:11:15<111:51:11, 11.60s/it]
                                                           
{'loss': '0.1851', 'grad_norm': '3.196', 'learning_rate': '1.984e-05', 'epoch': '0.08561'}

  9%|▊         | 3250/37963 [10:11:15<111:51:11, 11.60s/it]
  9%|▊         | 3251/37963 [10:11:25<107:46:41, 11.18s/it]
  9%|▊         | 3252/37963 [10:11:36<104:59:36, 10.89s/it]
  9%|▊         | 3253/37963 [10:11:46<102:58:01, 10.68s/it]
  9%|▊         | 3254/37963 [10:11:56<101:42:40, 10.55s/it]
  9%|▊         | 3255/37963 [10:12:06<99:44:26, 10.35s/it] 
  9%|▊         | 3256/37963 [10:12:23<118:22:33, 12.28s/it]
  9%|▊         | 3257/37963 [10:12:33<112:12:37, 11.64s/it]
  9%|▊         | 3258/37963 [10:12:43<107:45:47, 11.18s/it]
  9%|▊         | 3259/37963 [10:12:53<104:50:49, 10.88s/it]
  9%|▊         | 3260/37963 [10:13:03<102:54:20, 10.68s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '4.571', 'learning_rate': '1.984e-05', 'epoch': '0.08587'}

  9%|▊         | 3260/37963 [10:13:03<102:54:20, 10.68s/it]
  9%|▊         | 3261/37963 [10:13:13<101:05:19, 10.49s/it]
  9%|▊         | 3262/37963 [10:13:24<100:06:17, 10.39s/it]
  9%|▊         | 3263/37963 [10:13:34<99:13:17, 10.29s/it] 
  9%|▊         | 3264/37963 [10:13:44<98:49:31, 10.25s/it]
  9%|▊         | 3265/37963 [10:13:54<98:45:37, 10.25s/it]
  9%|▊         | 3266/37963 [10:14:04<98:13:58, 10.19s/it]
  9%|▊         | 3267/37963 [10:14:21<116:20:38, 12.07s/it]
  9%|▊         | 3268/37963 [10:14:31<110:09:52, 11.43s/it]
  9%|▊         | 3269/37963 [10:14:41<106:00:19, 11.00s/it]
  9%|▊         | 3270/37963 [10:14:51<103:42:18, 10.76s/it]
                                                           
{'loss': '0.1765', 'grad_norm': '1.666', 'learning_rate': '1.984e-05', 'epoch': '0.08614'}

  9%|▊         | 3270/37963 [10:14:51<103:42:18, 10.76s/it]
  9%|▊         | 3271/37963 [10:15:01<100:57:22, 10.48s/it]
  9%|▊         | 3272/37963 [10:15:10<99:14:19, 10.30s/it] 
  9%|▊         | 3273/37963 [10:15:27<117:07:35, 12.15s/it]
  9%|▊         | 3274/37963 [10:15:46<136:23:34, 14.15s/it]
  9%|▊         | 3275/37963 [10:15:56<124:59:33, 12.97s/it]
  9%|▊         | 3276/37963 [10:16:06<116:50:41, 12.13s/it]
  9%|▊         | 3277/37963 [10:16:23<130:32:37, 13.55s/it]
  9%|▊         | 3278/37963 [10:16:33<120:49:03, 12.54s/it]
  9%|▊         | 3279/37963 [10:16:43<113:43:33, 11.80s/it]
  9%|▊         | 3280/37963 [10:16:53<108:50:50, 11.30s/it]
                                                           
{'loss': '0.1768', 'grad_norm': '2.11', 'learning_rate': '1.983e-05', 'epoch': '0.0864'}

  9%|▊         | 3280/37963 [10:16:53<108:50:50, 11.30s/it]
  9%|▊         | 3281/37963 [10:17:03<104:50:15, 10.88s/it]
  9%|▊         | 3282/37963 [10:17:13<102:23:06, 10.63s/it]
  9%|▊         | 3283/37963 [10:17:23<100:10:44, 10.40s/it]
  9%|▊         | 3284/37963 [10:17:33<99:34:05, 10.34s/it] 
  9%|▊         | 3285/37963 [10:17:43<98:58:46, 10.28s/it]
  9%|▊         | 3286/37963 [10:17:54<98:45:55, 10.25s/it]
  9%|▊         | 3287/37963 [10:18:03<97:28:06, 10.12s/it]
  9%|▊         | 3288/37963 [10:18:14<97:22:03, 10.11s/it]
  9%|▊         | 3289/37963 [10:18:24<97:27:13, 10.12s/it]
  9%|▊         | 3290/37963 [10:18:34<97:33:59, 10.13s/it]
                                                          
{'loss': '0.1714', 'grad_norm': '5.127', 'learning_rate': '1.983e-05', 'epoch': '0.08666'}

  9%|▊         | 3290/37963 [10:18:34<97:33:59, 10.13s/it]
  9%|▊         | 3291/37963 [10:18:44<97:00:53, 10.07s/it]
  9%|▊         | 3292/37963 [10:19:00<114:44:35, 11.91s/it]
  9%|▊         | 3293/37963 [10:19:16<127:14:24, 13.21s/it]
  9%|▊         | 3294/37963 [10:19:33<136:09:42, 14.14s/it]
  9%|▊         | 3295/37963 [10:19:43<124:34:29, 12.94s/it]
  9%|▊         | 3296/37963 [10:19:53<116:29:06, 12.10s/it]
  9%|▊         | 3297/37963 [10:20:03<110:56:24, 11.52s/it]
  9%|▊         | 3298/37963 [10:20:13<105:40:23, 10.97s/it]
  9%|▊         | 3299/37963 [10:20:22<102:10:34, 10.61s/it]
  9%|▊         | 3300/37963 [10:20:32<99:57:47, 10.38s/it] 
                                                          
{'loss': '0.183', 'grad_norm': '5.996', 'learning_rate': '1.983e-05', 'epoch': '0.08693'}

  9%|▊         | 3300/37963 [10:20:32<99:57:47, 10.38s/it]
  9%|▊         | 3301/37963 [10:20:42<99:17:50, 10.31s/it]
  9%|▊         | 3302/37963 [10:20:53<98:44:31, 10.26s/it]
  9%|▊         | 3303/37963 [10:21:02<96:43:08, 10.05s/it]
  9%|▊         | 3304/37963 [10:21:18<113:48:26, 11.82s/it]
  9%|▊         | 3305/37963 [10:21:28<108:42:22, 11.29s/it]
  9%|▊         | 3306/37963 [10:21:38<104:57:37, 10.90s/it]
  9%|▊         | 3307/37963 [10:21:48<102:56:25, 10.69s/it]
  9%|▊         | 3308/37963 [10:21:59<101:46:20, 10.57s/it]
  9%|▊         | 3309/37963 [10:22:09<100:16:25, 10.42s/it]
  9%|▊         | 3310/37963 [10:22:18<97:29:13, 10.13s/it] 
                                                          
{'loss': '0.172', 'grad_norm': '4.853', 'learning_rate': '1.983e-05', 'epoch': '0.08719'}

  9%|▊         | 3310/37963 [10:22:18<97:29:13, 10.13s/it]
  9%|▊         | 3311/37963 [10:22:28<96:55:28, 10.07s/it]
  9%|▊         | 3312/37963 [10:22:38<96:58:52, 10.08s/it]
  9%|▊         | 3313/37963 [10:22:48<96:09:05,  9.99s/it]
  9%|▊         | 3314/37963 [10:23:05<115:34:30, 12.01s/it]
  9%|▊         | 3315/37963 [10:23:15<110:12:33, 11.45s/it]
  9%|▊         | 3316/37963 [10:23:25<106:15:25, 11.04s/it]
  9%|▊         | 3317/37963 [10:23:35<103:10:29, 10.72s/it]
  9%|▊         | 3318/37963 [10:23:45<101:28:25, 10.54s/it]
  9%|▊         | 3319/37963 [10:23:55<100:27:05, 10.44s/it]
  9%|▊         | 3320/37963 [10:24:12<118:13:38, 12.29s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '7.985', 'learning_rate': '1.983e-05', 'epoch': '0.08745'}

  9%|▊         | 3320/37963 [10:24:12<118:13:38, 12.29s/it]
  9%|▊         | 3321/37963 [10:24:31<137:50:28, 14.32s/it]
  9%|▉         | 3322/37963 [10:24:41<125:45:43, 13.07s/it]
  9%|▉         | 3323/37963 [10:24:51<117:16:17, 12.19s/it]
  9%|▉         | 3324/37963 [10:25:07<128:15:37, 13.33s/it]
  9%|▉         | 3325/37963 [10:25:17<118:57:59, 12.36s/it]
  9%|▉         | 3326/37963 [10:25:27<112:23:22, 11.68s/it]
  9%|▉         | 3327/37963 [10:25:37<107:52:21, 11.21s/it]
  9%|▉         | 3328/37963 [10:25:48<104:29:54, 10.86s/it]
  9%|▉         | 3329/37963 [10:25:58<102:42:09, 10.68s/it]
  9%|▉         | 3330/37963 [10:26:08<101:01:33, 10.50s/it]
                                                           
{'loss': '0.1709', 'grad_norm': '3.779', 'learning_rate': '1.983e-05', 'epoch': '0.08772'}

  9%|▉         | 3330/37963 [10:26:08<101:01:33, 10.50s/it]
  9%|▉         | 3331/37963 [10:26:18<100:23:31, 10.44s/it]
  9%|▉         | 3332/37963 [10:26:28<99:13:23, 10.31s/it] 
  9%|▉         | 3333/37963 [10:26:38<98:33:51, 10.25s/it]
  9%|▉         | 3334/37963 [10:26:49<98:38:25, 10.25s/it]
  9%|▉         | 3335/37963 [10:26:59<98:42:37, 10.26s/it]
  9%|▉         | 3336/37963 [10:27:09<98:36:47, 10.25s/it]
  9%|▉         | 3337/37963 [10:27:19<97:47:11, 10.17s/it]
  9%|▉         | 3338/37963 [10:27:29<97:35:56, 10.15s/it]
  9%|▉         | 3339/37963 [10:27:46<115:43:29, 12.03s/it]
  9%|▉         | 3340/37963 [10:27:55<108:47:55, 11.31s/it]
                                                           
{'loss': '0.1674', 'grad_norm': '3.541', 'learning_rate': '1.982e-05', 'epoch': '0.08798'}

  9%|▉         | 3340/37963 [10:27:55<108:47:55, 11.31s/it]
  9%|▉         | 3341/37963 [10:28:18<141:17:19, 14.69s/it]
  9%|▉         | 3342/37963 [10:28:28<128:21:09, 13.35s/it]
  9%|▉         | 3343/37963 [10:28:38<118:11:53, 12.29s/it]
  9%|▉         | 3344/37963 [10:28:47<110:44:14, 11.52s/it]
  9%|▉         | 3345/37963 [10:28:58<106:46:12, 11.10s/it]
  9%|▉         | 3346/37963 [10:29:08<103:58:45, 10.81s/it]
  9%|▉         | 3347/37963 [10:29:18<102:19:55, 10.64s/it]
  9%|▉         | 3348/37963 [10:29:27<98:47:38, 10.27s/it] 
  9%|▉         | 3349/37963 [10:29:38<98:24:17, 10.23s/it]
  9%|▉         | 3350/37963 [10:29:48<98:15:13, 10.22s/it]
                                                          
{'loss': '0.1772', 'grad_norm': '3.806', 'learning_rate': '1.982e-05', 'epoch': '0.08824'}

  9%|▉         | 3350/37963 [10:29:48<98:15:13, 10.22s/it]
  9%|▉         | 3351/37963 [10:29:58<97:44:02, 10.17s/it]
  9%|▉         | 3352/37963 [10:30:08<96:27:25, 10.03s/it]
  9%|▉         | 3353/37963 [10:30:24<114:28:41, 11.91s/it]
  9%|▉         | 3354/37963 [10:30:34<109:30:01, 11.39s/it]
  9%|▉         | 3355/37963 [10:30:44<105:41:43, 10.99s/it]
  9%|▉         | 3356/37963 [10:30:54<103:06:23, 10.73s/it]
  9%|▉         | 3357/37963 [10:31:04<101:16:29, 10.54s/it]
  9%|▉         | 3358/37963 [10:31:14<100:11:16, 10.42s/it]
  9%|▉         | 3359/37963 [10:31:25<99:29:48, 10.35s/it] 
  9%|▉         | 3360/37963 [10:31:34<97:53:18, 10.18s/it]
                                                          
{'loss': '0.1779', 'grad_norm': '1.698', 'learning_rate': '1.982e-05', 'epoch': '0.08851'}

  9%|▉         | 3360/37963 [10:31:34<97:53:18, 10.18s/it]
  9%|▉         | 3361/37963 [10:31:45<97:41:43, 10.16s/it]
  9%|▉         | 3362/37963 [10:32:01<116:43:00, 12.14s/it]
  9%|▉         | 3363/37963 [10:32:11<110:58:52, 11.55s/it]
  9%|▉         | 3364/37963 [10:32:22<106:51:07, 11.12s/it]
  9%|▉         | 3365/37963 [10:32:32<104:09:52, 10.84s/it]
  9%|▉         | 3366/37963 [10:32:42<102:05:36, 10.62s/it]
  9%|▉         | 3367/37963 [10:32:52<99:43:57, 10.38s/it] 
  9%|▉         | 3368/37963 [10:33:02<99:20:03, 10.34s/it]
  9%|▉         | 3369/37963 [10:33:18<117:20:28, 12.21s/it]
  9%|▉         | 3370/37963 [10:33:38<138:00:27, 14.36s/it]
                                                           
{'loss': '0.1752', 'grad_norm': '4.606', 'learning_rate': '1.982e-05', 'epoch': '0.08877'}

  9%|▉         | 3370/37963 [10:33:38<138:00:27, 14.36s/it]
  9%|▉         | 3371/37963 [10:33:48<125:39:34, 13.08s/it]
  9%|▉         | 3372/37963 [10:34:05<135:48:09, 14.13s/it]
  9%|▉         | 3373/37963 [10:34:14<123:28:02, 12.85s/it]
  9%|▉         | 3374/37963 [10:34:24<115:31:12, 12.02s/it]
  9%|▉         | 3375/37963 [10:34:35<110:18:28, 11.48s/it]
  9%|▉         | 3376/37963 [10:34:45<106:28:03, 11.08s/it]
  9%|▉         | 3377/37963 [10:34:55<103:42:06, 10.79s/it]
  9%|▉         | 3378/37963 [10:35:05<102:12:44, 10.64s/it]
  9%|▉         | 3379/37963 [10:35:15<101:03:06, 10.52s/it]
  9%|▉         | 3380/37963 [10:35:25<99:29:43, 10.36s/it] 
                                                          
{'loss': '0.1621', 'grad_norm': '5.573', 'learning_rate': '1.982e-05', 'epoch': '0.08903'}

  9%|▉         | 3380/37963 [10:35:25<99:29:43, 10.36s/it]
  9%|▉         | 3381/37963 [10:35:35<98:04:55, 10.21s/it]
  9%|▉         | 3382/37963 [10:35:45<97:09:47, 10.12s/it]
  9%|▉         | 3383/37963 [10:35:55<96:38:03, 10.06s/it]
  9%|▉         | 3384/37963 [10:36:05<96:48:12, 10.08s/it]
  9%|▉         | 3385/37963 [10:36:15<95:49:41,  9.98s/it]
  9%|▉         | 3386/37963 [10:36:31<114:04:23, 11.88s/it]
  9%|▉         | 3387/37963 [10:36:48<126:53:12, 13.21s/it]
  9%|▉         | 3388/37963 [10:36:58<118:18:21, 12.32s/it]
  9%|▉         | 3389/37963 [10:37:08<111:50:08, 11.64s/it]
  9%|▉         | 3390/37963 [10:37:25<125:55:22, 13.11s/it]
                                                           
{'loss': '0.1667', 'grad_norm': '2.227', 'learning_rate': '1.982e-05', 'epoch': '0.0893'}

  9%|▉         | 3390/37963 [10:37:25<125:55:22, 13.11s/it]
  9%|▉         | 3391/37963 [10:37:35<117:32:28, 12.24s/it]
  9%|▉         | 3392/37963 [10:37:45<110:34:59, 11.52s/it]
  9%|▉         | 3393/37963 [10:37:54<105:39:28, 11.00s/it]
  9%|▉         | 3394/37963 [10:38:04<103:10:32, 10.74s/it]
  9%|▉         | 3395/37963 [10:38:15<101:56:31, 10.62s/it]
  9%|▉         | 3396/37963 [10:38:25<99:35:56, 10.37s/it] 
  9%|▉         | 3397/37963 [10:38:34<98:07:11, 10.22s/it]
  9%|▉         | 3398/37963 [10:38:45<98:06:25, 10.22s/it]
  9%|▉         | 3399/37963 [10:39:01<115:51:44, 12.07s/it]
  9%|▉         | 3400/37963 [10:39:11<110:03:19, 11.46s/it]
                                                           
{'loss': '0.1722', 'grad_norm': '1.964', 'learning_rate': '1.981e-05', 'epoch': '0.08956'}

  9%|▉         | 3400/37963 [10:39:11<110:03:19, 11.46s/it]
  9%|▉         | 3401/37963 [10:39:21<106:56:35, 11.14s/it]
  9%|▉         | 3402/37963 [10:39:32<104:18:37, 10.87s/it]
  9%|▉         | 3403/37963 [10:39:42<102:19:56, 10.66s/it]
  9%|▉         | 3404/37963 [10:39:52<100:50:24, 10.50s/it]
  9%|▉         | 3405/37963 [10:40:02<99:43:01, 10.39s/it] 
  9%|▉         | 3406/37963 [10:40:12<99:14:08, 10.34s/it]
  9%|▉         | 3407/37963 [10:40:22<97:59:27, 10.21s/it]
  9%|▉         | 3408/37963 [10:40:32<97:59:20, 10.21s/it]
  9%|▉         | 3409/37963 [10:40:43<97:42:44, 10.18s/it]
  9%|▉         | 3410/37963 [10:40:58<114:06:14, 11.89s/it]
                                                           
{'loss': '0.1678', 'grad_norm': '4.566', 'learning_rate': '1.981e-05', 'epoch': '0.08982'}

  9%|▉         | 3410/37963 [10:40:58<114:06:14, 11.89s/it]
  9%|▉         | 3411/37963 [10:41:09<109:23:24, 11.40s/it]
  9%|▉         | 3412/37963 [10:41:19<105:15:43, 10.97s/it]
  9%|▉         | 3413/37963 [10:41:29<102:40:21, 10.70s/it]
  9%|▉         | 3414/37963 [10:41:39<101:04:11, 10.53s/it]
  9%|▉         | 3415/37963 [10:41:49<99:05:10, 10.33s/it] 
  9%|▉         | 3416/37963 [10:41:59<98:34:58, 10.27s/it]
  9%|▉         | 3417/37963 [10:42:09<98:22:42, 10.25s/it]
  9%|▉         | 3418/37963 [10:42:26<117:03:29, 12.20s/it]
  9%|▉         | 3419/37963 [10:42:45<138:16:52, 14.41s/it]
  9%|▉         | 3420/37963 [10:42:56<125:47:52, 13.11s/it]
                                                           
{'loss': '0.1713', 'grad_norm': '2.853', 'learning_rate': '1.981e-05', 'epoch': '0.09009'}

  9%|▉         | 3420/37963 [10:42:56<125:47:52, 13.11s/it]
  9%|▉         | 3421/37963 [10:43:12<135:08:02, 14.08s/it]
  9%|▉         | 3422/37963 [10:43:22<123:55:10, 12.92s/it]
  9%|▉         | 3423/37963 [10:43:32<115:47:33, 12.07s/it]
  9%|▉         | 3424/37963 [10:43:42<110:06:18, 11.48s/it]
  9%|▉         | 3425/37963 [10:43:52<105:02:31, 10.95s/it]
  9%|▉         | 3426/37963 [10:44:02<102:16:53, 10.66s/it]
  9%|▉         | 3427/37963 [10:44:12<100:44:54, 10.50s/it]
  9%|▉         | 3428/37963 [10:44:22<99:26:07, 10.37s/it] 
  9%|▉         | 3429/37963 [10:44:32<98:58:44, 10.32s/it]
  9%|▉         | 3430/37963 [10:44:42<98:12:37, 10.24s/it]
                                                          
{'loss': '0.1721', 'grad_norm': '2.504', 'learning_rate': '1.981e-05', 'epoch': '0.09035'}

  9%|▉         | 3430/37963 [10:44:42<98:12:37, 10.24s/it]
  9%|▉         | 3431/37963 [10:44:52<97:47:54, 10.20s/it]
  9%|▉         | 3432/37963 [10:45:02<95:09:26,  9.92s/it]
  9%|▉         | 3433/37963 [10:45:12<96:07:49, 10.02s/it]
  9%|▉         | 3434/37963 [10:45:29<114:45:07, 11.96s/it]
  9%|▉         | 3435/37963 [10:45:39<109:26:59, 11.41s/it]
  9%|▉         | 3436/37963 [10:45:49<105:45:26, 11.03s/it]
  9%|▉         | 3437/37963 [10:45:59<102:11:58, 10.66s/it]
  9%|▉         | 3438/37963 [10:46:15<119:21:14, 12.45s/it]
  9%|▉         | 3439/37963 [10:46:25<112:12:27, 11.70s/it]
  9%|▉         | 3440/37963 [10:46:42<125:55:17, 13.13s/it]
                                                           
{'loss': '0.178', 'grad_norm': '3.774', 'learning_rate': '1.981e-05', 'epoch': '0.09061'}

  9%|▉         | 3440/37963 [10:46:42<125:55:17, 13.13s/it]
  9%|▉         | 3441/37963 [10:46:51<116:07:00, 12.11s/it]
  9%|▉         | 3442/37963 [10:47:02<110:38:53, 11.54s/it]
  9%|▉         | 3443/37963 [10:47:11<104:58:48, 10.95s/it]
  9%|▉         | 3444/37963 [10:47:21<102:46:17, 10.72s/it]
  9%|▉         | 3445/37963 [10:47:31<101:00:08, 10.53s/it]
  9%|▉         | 3446/37963 [10:47:42<99:48:12, 10.41s/it] 
  9%|▉         | 3447/37963 [10:47:52<98:49:13, 10.31s/it]
  9%|▉         | 3448/37963 [10:48:08<115:32:58, 12.05s/it]
  9%|▉         | 3449/37963 [10:48:18<110:17:12, 11.50s/it]
  9%|▉         | 3450/37963 [10:48:28<106:21:19, 11.09s/it]
                                                           
{'loss': '0.1674', 'grad_norm': '3.426', 'learning_rate': '1.981e-05', 'epoch': '0.09088'}

  9%|▉         | 3450/37963 [10:48:28<106:21:19, 11.09s/it]
  9%|▉         | 3451/37963 [10:48:38<103:44:48, 10.82s/it]
  9%|▉         | 3452/37963 [10:48:48<101:39:06, 10.60s/it]
  9%|▉         | 3453/37963 [10:48:58<100:17:57, 10.46s/it]
  9%|▉         | 3454/37963 [10:49:08<98:15:51, 10.25s/it] 
  9%|▉         | 3455/37963 [10:49:18<97:45:33, 10.20s/it]
  9%|▉         | 3456/37963 [10:49:28<97:28:18, 10.17s/it]
  9%|▉         | 3457/37963 [10:49:45<114:40:39, 11.96s/it]
  9%|▉         | 3458/37963 [10:49:55<109:13:26, 11.40s/it]
  9%|▉         | 3459/37963 [10:50:04<104:41:08, 10.92s/it]
  9%|▉         | 3460/37963 [10:50:14<101:48:13, 10.62s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '1.887', 'learning_rate': '1.98e-05', 'epoch': '0.09114'}

  9%|▉         | 3460/37963 [10:50:14<101:48:13, 10.62s/it]
  9%|▉         | 3461/37963 [10:50:25<100:33:27, 10.49s/it]
  9%|▉         | 3462/37963 [10:50:35<99:27:24, 10.38s/it] 
  9%|▉         | 3463/37963 [10:50:44<97:33:43, 10.18s/it]
  9%|▉         | 3464/37963 [10:51:04<124:28:57, 12.99s/it]
  9%|▉         | 3465/37963 [10:51:13<114:24:55, 11.94s/it]
  9%|▉         | 3466/37963 [10:51:24<109:52:03, 11.47s/it]
  9%|▉         | 3467/37963 [10:51:47<142:35:08, 14.88s/it]
  9%|▉         | 3468/37963 [10:51:57<128:55:22, 13.45s/it]
  9%|▉         | 3469/37963 [10:52:07<119:30:07, 12.47s/it]
  9%|▉         | 3470/37963 [10:52:17<112:22:46, 11.73s/it]
                                                           
{'loss': '0.1694', 'grad_norm': '1.181', 'learning_rate': '1.98e-05', 'epoch': '0.09141'}

  9%|▉         | 3470/37963 [10:52:17<112:22:46, 11.73s/it]
  9%|▉         | 3471/37963 [10:52:27<107:19:28, 11.20s/it]
  9%|▉         | 3472/37963 [10:52:37<104:16:01, 10.88s/it]
  9%|▉         | 3473/37963 [10:52:47<102:02:26, 10.65s/it]
  9%|▉         | 3474/37963 [10:52:57<100:23:29, 10.48s/it]
  9%|▉         | 3475/37963 [10:53:07<99:12:06, 10.36s/it] 
  9%|▉         | 3476/37963 [10:53:17<98:37:53, 10.30s/it]
  9%|▉         | 3477/37963 [10:53:28<98:00:13, 10.23s/it]
  9%|▉         | 3478/37963 [10:53:38<97:42:07, 10.20s/it]
  9%|▉         | 3479/37963 [10:53:48<97:33:40, 10.19s/it]
  9%|▉         | 3480/37963 [10:53:58<97:20:37, 10.16s/it]
                                                          
{'loss': '0.186', 'grad_norm': '2.952', 'learning_rate': '1.98e-05', 'epoch': '0.09167'}

  9%|▉         | 3480/37963 [10:53:58<97:20:37, 10.16s/it]
  9%|▉         | 3481/37963 [10:54:15<116:10:22, 12.13s/it]
  9%|▉         | 3482/37963 [10:54:25<110:23:01, 11.52s/it]
  9%|▉         | 3483/37963 [10:54:35<105:38:29, 11.03s/it]
  9%|▉         | 3484/37963 [10:54:45<103:02:44, 10.76s/it]
  9%|▉         | 3485/37963 [10:54:55<100:46:22, 10.52s/it]
  9%|▉         | 3486/37963 [10:55:11<117:46:05, 12.30s/it]
  9%|▉         | 3487/37963 [10:55:27<129:10:25, 13.49s/it]
  9%|▉         | 3488/37963 [10:55:38<119:32:10, 12.48s/it]
  9%|▉         | 3489/37963 [10:55:48<112:50:58, 11.78s/it]
  9%|▉         | 3490/37963 [10:55:58<107:07:48, 11.19s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '3.799', 'learning_rate': '1.98e-05', 'epoch': '0.09193'}

  9%|▉         | 3490/37963 [10:55:58<107:07:48, 11.19s/it]
  9%|▉         | 3491/37963 [10:56:08<104:04:59, 10.87s/it]
  9%|▉         | 3492/37963 [10:56:18<102:04:04, 10.66s/it]
  9%|▉         | 3493/37963 [10:56:28<100:34:45, 10.50s/it]
  9%|▉         | 3494/37963 [10:56:38<98:41:43, 10.31s/it] 
  9%|▉         | 3495/37963 [10:56:48<98:09:11, 10.25s/it]
  9%|▉         | 3496/37963 [10:56:58<97:42:17, 10.21s/it]
  9%|▉         | 3497/37963 [10:57:14<115:40:32, 12.08s/it]
  9%|▉         | 3498/37963 [10:57:25<109:57:00, 11.48s/it]
  9%|▉         | 3499/37963 [10:57:35<105:33:16, 11.03s/it]
  9%|▉         | 3500/37963 [10:57:45<103:16:13, 10.79s/it]
                                                           
{'loss': '0.1812', 'grad_norm': '1.197', 'learning_rate': '1.98e-05', 'epoch': '0.0922'}

  9%|▉         | 3500/37963 [10:57:45<103:16:13, 10.79s/it]
  9%|▉         | 3501/37963 [10:57:55<100:29:35, 10.50s/it]
  9%|▉         | 3502/37963 [10:58:05<99:17:35, 10.37s/it] 
  9%|▉         | 3503/37963 [10:58:15<98:34:43, 10.30s/it]
  9%|▉         | 3504/37963 [10:58:25<98:03:56, 10.25s/it]
  9%|▉         | 3505/37963 [10:58:35<97:19:02, 10.17s/it]
  9%|▉         | 3506/37963 [10:58:52<116:14:25, 12.14s/it]
  9%|▉         | 3507/37963 [10:59:02<110:10:47, 11.51s/it]
  9%|▉         | 3508/37963 [10:59:12<106:28:51, 11.13s/it]
  9%|▉         | 3509/37963 [10:59:22<103:42:53, 10.84s/it]
  9%|▉         | 3510/37963 [10:59:32<101:42:32, 10.63s/it]
                                                           
{'loss': '0.1738', 'grad_norm': '1.927', 'learning_rate': '1.98e-05', 'epoch': '0.09246'}

  9%|▉         | 3510/37963 [10:59:32<101:42:32, 10.63s/it]
  9%|▉         | 3511/37963 [10:59:42<100:21:55, 10.49s/it]
  9%|▉         | 3512/37963 [10:59:53<99:28:13, 10.39s/it] 
  9%|▉         | 3513/37963 [11:00:03<98:58:35, 10.34s/it]
  9%|▉         | 3514/37963 [11:00:23<125:58:07, 13.16s/it]
  9%|▉         | 3515/37963 [11:00:33<117:00:13, 12.23s/it]
  9%|▉         | 3516/37963 [11:00:49<129:24:09, 13.52s/it]
  9%|▉         | 3517/37963 [11:00:59<118:26:34, 12.38s/it]
  9%|▉         | 3518/37963 [11:01:09<112:09:05, 11.72s/it]
  9%|▉         | 3519/37963 [11:01:19<107:29:08, 11.23s/it]
  9%|▉         | 3520/37963 [11:01:36<123:42:06, 12.93s/it]
                                                           
{'loss': '0.1702', 'grad_norm': '1.602', 'learning_rate': '1.979e-05', 'epoch': '0.09272'}

  9%|▉         | 3520/37963 [11:01:36<123:42:06, 12.93s/it]
  9%|▉         | 3521/37963 [11:01:46<116:01:57, 12.13s/it]
  9%|▉         | 3522/37963 [11:01:56<110:05:02, 11.51s/it]
  9%|▉         | 3523/37963 [11:02:07<106:30:03, 11.13s/it]
  9%|▉         | 3524/37963 [11:02:17<103:53:47, 10.86s/it]
  9%|▉         | 3525/37963 [11:02:27<101:10:44, 10.58s/it]
  9%|▉         | 3526/37963 [11:02:36<98:46:35, 10.33s/it] 
  9%|▉         | 3527/37963 [11:02:47<98:31:16, 10.30s/it]
  9%|▉         | 3528/37963 [11:03:03<116:30:09, 12.18s/it]
  9%|▉         | 3529/37963 [11:03:13<110:12:46, 11.52s/it]
  9%|▉         | 3530/37963 [11:03:23<106:21:03, 11.12s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '3.671', 'learning_rate': '1.979e-05', 'epoch': '0.09299'}

  9%|▉         | 3530/37963 [11:03:23<106:21:03, 11.12s/it]
  9%|▉         | 3531/37963 [11:03:33<103:15:48, 10.80s/it]
  9%|▉         | 3532/37963 [11:03:43<100:33:09, 10.51s/it]
  9%|▉         | 3533/37963 [11:03:53<99:25:34, 10.40s/it] 
  9%|▉         | 3534/37963 [11:04:10<116:31:31, 12.18s/it]
  9%|▉         | 3535/37963 [11:04:20<110:25:12, 11.55s/it]
  9%|▉         | 3536/37963 [11:04:30<106:11:33, 11.10s/it]
  9%|▉         | 3537/37963 [11:04:47<122:22:19, 12.80s/it]
  9%|▉         | 3538/37963 [11:04:57<114:43:04, 12.00s/it]
  9%|▉         | 3539/37963 [11:05:07<109:28:24, 11.45s/it]
  9%|▉         | 3540/37963 [11:05:17<105:48:21, 11.07s/it]
                                                           
{'loss': '0.1766', 'grad_norm': '3.021', 'learning_rate': '1.979e-05', 'epoch': '0.09325'}

  9%|▉         | 3540/37963 [11:05:17<105:48:21, 11.07s/it]
  9%|▉         | 3541/37963 [11:05:27<103:07:04, 10.78s/it]
  9%|▉         | 3542/37963 [11:05:37<101:23:34, 10.60s/it]
  9%|▉         | 3543/37963 [11:05:47<99:15:15, 10.38s/it] 
  9%|▉         | 3544/37963 [11:05:57<97:34:47, 10.21s/it]
  9%|▉         | 3545/37963 [11:06:14<115:49:15, 12.11s/it]
  9%|▉         | 3546/37963 [11:06:24<110:35:10, 11.57s/it]
  9%|▉         | 3547/37963 [11:06:34<105:48:13, 11.07s/it]
  9%|▉         | 3548/37963 [11:06:44<103:15:02, 10.80s/it]
  9%|▉         | 3549/37963 [11:06:54<101:30:55, 10.62s/it]
  9%|▉         | 3550/37963 [11:07:04<100:26:05, 10.51s/it]
                                                           
{'loss': '0.1719', 'grad_norm': '1.902', 'learning_rate': '1.979e-05', 'epoch': '0.09351'}

  9%|▉         | 3550/37963 [11:07:04<100:26:05, 10.51s/it]
  9%|▉         | 3551/37963 [11:07:15<99:35:53, 10.42s/it] 
  9%|▉         | 3552/37963 [11:07:25<99:15:01, 10.38s/it]
  9%|▉         | 3553/37963 [11:07:41<116:41:35, 12.21s/it]
  9%|▉         | 3554/37963 [11:07:52<110:55:32, 11.61s/it]
  9%|▉         | 3555/37963 [11:08:02<107:01:59, 11.20s/it]
  9%|▉         | 3556/37963 [11:08:12<104:07:18, 10.89s/it]
  9%|▉         | 3557/37963 [11:08:22<101:51:01, 10.66s/it]
  9%|▉         | 3558/37963 [11:08:32<99:29:11, 10.41s/it] 
  9%|▉         | 3559/37963 [11:08:42<99:15:19, 10.39s/it]
  9%|▉         | 3560/37963 [11:08:52<98:25:33, 10.30s/it]
                                                          
{'loss': '0.1722', 'grad_norm': '2.369', 'learning_rate': '1.979e-05', 'epoch': '0.09378'}

  9%|▉         | 3560/37963 [11:08:52<98:25:33, 10.30s/it]
  9%|▉         | 3561/37963 [11:09:03<98:02:16, 10.26s/it]
  9%|▉         | 3562/37963 [11:09:13<97:10:27, 10.17s/it]
  9%|▉         | 3563/37963 [11:09:23<97:01:19, 10.15s/it]
  9%|▉         | 3564/37963 [11:09:42<123:44:07, 12.95s/it]
  9%|▉         | 3565/37963 [11:09:59<133:58:01, 14.02s/it]
  9%|▉         | 3566/37963 [11:10:09<122:33:48, 12.83s/it]
  9%|▉         | 3567/37963 [11:10:19<115:01:01, 12.04s/it]
  9%|▉         | 3568/37963 [11:10:29<108:48:00, 11.39s/it]
  9%|▉         | 3569/37963 [11:10:45<123:08:34, 12.89s/it]
  9%|▉         | 3570/37963 [11:10:55<114:55:44, 12.03s/it]
                                                           
{'loss': '0.1779', 'grad_norm': '4.297', 'learning_rate': '1.979e-05', 'epoch': '0.09404'}

  9%|▉         | 3570/37963 [11:10:55<114:55:44, 12.03s/it]
  9%|▉         | 3571/37963 [11:11:05<108:54:16, 11.40s/it]
  9%|▉         | 3572/37963 [11:11:15<105:08:43, 11.01s/it]
  9%|▉         | 3573/37963 [11:11:25<102:32:29, 10.73s/it]
  9%|▉         | 3574/37963 [11:11:36<101:06:25, 10.58s/it]
  9%|▉         | 3575/37963 [11:11:46<99:52:12, 10.46s/it] 
  9%|▉         | 3576/37963 [11:12:02<117:17:11, 12.28s/it]
  9%|▉         | 3577/37963 [11:12:12<110:27:40, 11.56s/it]
  9%|▉         | 3578/37963 [11:12:22<106:08:21, 11.11s/it]
  9%|▉         | 3579/37963 [11:12:32<103:23:16, 10.82s/it]
  9%|▉         | 3580/37963 [11:12:42<100:45:52, 10.55s/it]
                                                           
{'loss': '0.1742', 'grad_norm': '1.624', 'learning_rate': '1.978e-05', 'epoch': '0.0943'}

  9%|▉         | 3580/37963 [11:12:42<100:45:52, 10.55s/it]
  9%|▉         | 3581/37963 [11:12:52<99:45:09, 10.44s/it] 
  9%|▉         | 3582/37963 [11:13:09<116:41:44, 12.22s/it]
  9%|▉         | 3583/37963 [11:13:19<110:30:21, 11.57s/it]
  9%|▉         | 3584/37963 [11:13:29<105:52:09, 11.09s/it]
  9%|▉         | 3585/37963 [11:13:39<102:58:36, 10.78s/it]
  9%|▉         | 3586/37963 [11:13:49<100:22:39, 10.51s/it]
  9%|▉         | 3587/37963 [11:14:05<117:36:37, 12.32s/it]
  9%|▉         | 3588/37963 [11:14:16<111:25:56, 11.67s/it]
  9%|▉         | 3589/37963 [11:14:26<107:09:15, 11.22s/it]
  9%|▉         | 3590/37963 [11:14:36<103:12:48, 10.81s/it]
                                                           
{'loss': '0.1688', 'grad_norm': '2.749', 'learning_rate': '1.978e-05', 'epoch': '0.09457'}

  9%|▉         | 3590/37963 [11:14:36<103:12:48, 10.81s/it]
  9%|▉         | 3591/37963 [11:14:46<101:22:25, 10.62s/it]
  9%|▉         | 3592/37963 [11:14:56<100:32:24, 10.53s/it]
  9%|▉         | 3593/37963 [11:15:12<116:38:37, 12.22s/it]
  9%|▉         | 3594/37963 [11:15:22<110:49:20, 11.61s/it]
  9%|▉         | 3595/37963 [11:15:33<106:35:56, 11.17s/it]
  9%|▉         | 3596/37963 [11:15:42<103:06:14, 10.80s/it]
  9%|▉         | 3597/37963 [11:15:53<100:58:13, 10.58s/it]
  9%|▉         | 3598/37963 [11:16:03<99:50:33, 10.46s/it] 
  9%|▉         | 3599/37963 [11:16:13<98:54:37, 10.36s/it]
  9%|▉         | 3600/37963 [11:16:29<116:51:54, 12.24s/it]
                                                           
{'loss': '0.1665', 'grad_norm': '4.271', 'learning_rate': '1.978e-05', 'epoch': '0.09483'}

  9%|▉         | 3600/37963 [11:16:29<116:51:54, 12.24s/it]
  9%|▉         | 3601/37963 [11:16:39<109:56:38, 11.52s/it]
  9%|▉         | 3602/37963 [11:16:49<105:59:12, 11.10s/it]
  9%|▉         | 3603/37963 [11:17:00<103:10:35, 10.81s/it]
  9%|▉         | 3604/37963 [11:17:10<101:34:56, 10.64s/it]
  9%|▉         | 3605/37963 [11:17:20<100:05:41, 10.49s/it]
  9%|▉         | 3606/37963 [11:17:30<99:09:12, 10.39s/it] 
 10%|▉         | 3607/37963 [11:17:40<98:15:13, 10.30s/it]
 10%|▉         | 3608/37963 [11:17:50<97:26:58, 10.21s/it]
 10%|▉         | 3609/37963 [11:18:00<97:18:59, 10.20s/it]
 10%|▉         | 3610/37963 [11:18:11<97:32:33, 10.22s/it]
                                                          
{'loss': '0.1682', 'grad_norm': '3.278', 'learning_rate': '1.978e-05', 'epoch': '0.09509'}

 10%|▉         | 3610/37963 [11:18:11<97:32:33, 10.22s/it]
 10%|▉         | 3611/37963 [11:18:21<96:36:27, 10.12s/it]
 10%|▉         | 3612/37963 [11:18:31<96:38:26, 10.13s/it]
 10%|▉         | 3613/37963 [11:18:50<124:01:50, 13.00s/it]
 10%|▉         | 3614/37963 [11:19:00<115:49:28, 12.14s/it]
 10%|▉         | 3615/37963 [11:19:16<126:50:31, 13.29s/it]
 10%|▉         | 3616/37963 [11:19:26<117:14:30, 12.29s/it]
 10%|▉         | 3617/37963 [11:19:37<111:10:19, 11.65s/it]
 10%|▉         | 3618/37963 [11:19:47<106:40:31, 11.18s/it]
 10%|▉         | 3619/37963 [11:19:57<103:21:41, 10.83s/it]
 10%|▉         | 3620/37963 [11:20:07<101:17:22, 10.62s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '6.536', 'learning_rate': '1.978e-05', 'epoch': '0.09536'}

 10%|▉         | 3620/37963 [11:20:07<101:17:22, 10.62s/it]
 10%|▉         | 3621/37963 [11:20:17<99:02:22, 10.38s/it] 
 10%|▉         | 3622/37963 [11:20:27<98:01:41, 10.28s/it]
 10%|▉         | 3623/37963 [11:20:36<96:29:52, 10.12s/it]
 10%|▉         | 3624/37963 [11:20:53<114:40:35, 12.02s/it]
 10%|▉         | 3625/37963 [11:21:03<109:12:16, 11.45s/it]
 10%|▉         | 3626/37963 [11:21:13<105:11:32, 11.03s/it]
 10%|▉         | 3627/37963 [11:21:23<101:54:29, 10.68s/it]
 10%|▉         | 3628/37963 [11:21:33<100:34:21, 10.54s/it]
 10%|▉         | 3629/37963 [11:21:43<99:33:51, 10.44s/it] 
 10%|▉         | 3630/37963 [11:21:53<98:08:38, 10.29s/it]
                                                          
{'loss': '0.1586', 'grad_norm': '2.406', 'learning_rate': '1.978e-05', 'epoch': '0.09562'}

 10%|▉         | 3630/37963 [11:21:53<98:08:38, 10.29s/it]
 10%|▉         | 3631/37963 [11:22:03<97:35:50, 10.23s/it]
 10%|▉         | 3632/37963 [11:22:13<96:42:43, 10.14s/it]
 10%|▉         | 3633/37963 [11:22:30<115:21:06, 12.10s/it]
 10%|▉         | 3634/37963 [11:22:46<127:51:39, 13.41s/it]
 10%|▉         | 3635/37963 [11:22:57<118:29:30, 12.43s/it]
 10%|▉         | 3636/37963 [11:23:06<111:07:51, 11.65s/it]
 10%|▉         | 3637/37963 [11:23:16<105:55:04, 11.11s/it]
 10%|▉         | 3638/37963 [11:23:26<102:29:38, 10.75s/it]
 10%|▉         | 3639/37963 [11:23:36<100:02:20, 10.49s/it]
 10%|▉         | 3640/37963 [11:23:46<97:35:56, 10.24s/it] 
                                                          
{'loss': '0.1791', 'grad_norm': '1.226', 'learning_rate': '1.977e-05', 'epoch': '0.09588'}

 10%|▉         | 3640/37963 [11:23:46<97:35:56, 10.24s/it]
 10%|▉         | 3641/37963 [11:23:55<96:01:59, 10.07s/it]
 10%|▉         | 3642/37963 [11:24:12<114:50:56, 12.05s/it]
 10%|▉         | 3643/37963 [11:24:22<109:14:51, 11.46s/it]
 10%|▉         | 3644/37963 [11:24:32<105:26:09, 11.06s/it]
 10%|▉         | 3645/37963 [11:24:42<102:39:58, 10.77s/it]
 10%|▉         | 3646/37963 [11:24:52<100:41:54, 10.56s/it]
 10%|▉         | 3647/37963 [11:25:03<99:29:51, 10.44s/it] 
 10%|▉         | 3648/37963 [11:25:13<98:35:02, 10.34s/it]
 10%|▉         | 3649/37963 [11:25:23<98:09:01, 10.30s/it]
 10%|▉         | 3650/37963 [11:25:39<115:58:56, 12.17s/it]
                                                           
{'loss': '0.1769', 'grad_norm': '4.499', 'learning_rate': '1.977e-05', 'epoch': '0.09615'}

 10%|▉         | 3650/37963 [11:25:39<115:58:56, 12.17s/it]
 10%|▉         | 3651/37963 [11:25:50<110:06:37, 11.55s/it]
 10%|▉         | 3652/37963 [11:26:00<105:53:40, 11.11s/it]
 10%|▉         | 3653/37963 [11:26:10<102:32:08, 10.76s/it]
 10%|▉         | 3654/37963 [11:26:20<100:40:47, 10.56s/it]
 10%|▉         | 3655/37963 [11:26:30<99:40:07, 10.46s/it] 
 10%|▉         | 3656/37963 [11:26:40<98:02:25, 10.29s/it]
 10%|▉         | 3657/37963 [11:26:50<96:53:55, 10.17s/it]
 10%|▉         | 3658/37963 [11:27:00<96:40:29, 10.15s/it]
 10%|▉         | 3659/37963 [11:27:10<96:04:26, 10.08s/it]
 10%|▉         | 3660/37963 [11:27:20<96:32:54, 10.13s/it]
                                                          
{'loss': '0.1591', 'grad_norm': '3.266', 'learning_rate': '1.977e-05', 'epoch': '0.09641'}

 10%|▉         | 3660/37963 [11:27:20<96:32:54, 10.13s/it]
 10%|▉         | 3661/37963 [11:27:30<96:29:34, 10.13s/it]
 10%|▉         | 3662/37963 [11:27:47<115:23:32, 12.11s/it]
 10%|▉         | 3663/37963 [11:28:03<126:35:44, 13.29s/it]
 10%|▉         | 3664/37963 [11:28:22<144:41:40, 15.19s/it]
 10%|▉         | 3665/37963 [11:28:33<130:09:43, 13.66s/it]
 10%|▉         | 3666/37963 [11:28:43<119:53:20, 12.58s/it]
 10%|▉         | 3667/37963 [11:28:53<112:48:55, 11.84s/it]
 10%|▉         | 3668/37963 [11:29:03<107:25:32, 11.28s/it]
 10%|▉         | 3669/37963 [11:29:13<104:00:31, 10.92s/it]
 10%|▉         | 3670/37963 [11:29:23<101:36:54, 10.67s/it]
                                                           
{'loss': '0.1854', 'grad_norm': '9.406', 'learning_rate': '1.977e-05', 'epoch': '0.09667'}

 10%|▉         | 3670/37963 [11:29:23<101:36:54, 10.67s/it]
 10%|▉         | 3671/37963 [11:29:33<100:06:26, 10.51s/it]
 10%|▉         | 3672/37963 [11:29:43<99:30:26, 10.45s/it] 
 10%|▉         | 3673/37963 [11:29:54<98:53:33, 10.38s/it]
 10%|▉         | 3674/37963 [11:30:10<116:01:51, 12.18s/it]
 10%|▉         | 3675/37963 [11:30:20<110:22:36, 11.59s/it]
 10%|▉         | 3676/37963 [11:30:30<105:34:01, 11.08s/it]
 10%|▉         | 3677/37963 [11:30:40<102:24:59, 10.75s/it]
 10%|▉         | 3678/37963 [11:30:50<100:40:38, 10.57s/it]
 10%|▉         | 3679/37963 [11:31:00<99:44:15, 10.47s/it] 
 10%|▉         | 3680/37963 [11:31:11<98:50:36, 10.38s/it]
                                                          
{'loss': '0.1821', 'grad_norm': '5.099', 'learning_rate': '1.977e-05', 'epoch': '0.09694'}

 10%|▉         | 3680/37963 [11:31:11<98:50:36, 10.38s/it]
 10%|▉         | 3681/37963 [11:31:33<134:17:11, 14.10s/it]
 10%|▉         | 3682/37963 [11:31:44<123:16:47, 12.95s/it]
 10%|▉         | 3683/37963 [11:31:54<114:39:34, 12.04s/it]
 10%|▉         | 3684/37963 [11:32:04<109:01:31, 11.45s/it]
 10%|▉         | 3685/37963 [11:32:14<105:18:27, 11.06s/it]
 10%|▉         | 3686/37963 [11:32:24<102:36:46, 10.78s/it]
 10%|▉         | 3687/37963 [11:32:34<100:58:34, 10.61s/it]
 10%|▉         | 3688/37963 [11:32:44<99:34:27, 10.46s/it] 
 10%|▉         | 3689/37963 [11:32:54<98:35:54, 10.36s/it]
 10%|▉         | 3690/37963 [11:33:11<116:14:17, 12.21s/it]
                                                           
{'loss': '0.1801', 'grad_norm': '5.382', 'learning_rate': '1.976e-05', 'epoch': '0.0972'}

 10%|▉         | 3690/37963 [11:33:11<116:14:17, 12.21s/it]
 10%|▉         | 3691/37963 [11:33:21<110:18:22, 11.59s/it]
 10%|▉         | 3692/37963 [11:33:31<105:36:21, 11.09s/it]
 10%|▉         | 3693/37963 [11:33:41<102:42:19, 10.79s/it]
 10%|▉         | 3694/37963 [11:33:51<100:56:13, 10.60s/it]
 10%|▉         | 3695/37963 [11:34:01<99:38:28, 10.47s/it] 
 10%|▉         | 3696/37963 [11:34:11<98:35:35, 10.36s/it]
 10%|▉         | 3697/37963 [11:34:22<98:32:38, 10.35s/it]
 10%|▉         | 3698/37963 [11:34:32<97:31:14, 10.25s/it]
 10%|▉         | 3699/37963 [11:34:48<114:48:35, 12.06s/it]
 10%|▉         | 3700/37963 [11:34:58<108:31:03, 11.40s/it]
                                                           
{'loss': '0.1634', 'grad_norm': '2.589', 'learning_rate': '1.976e-05', 'epoch': '0.09746'}

 10%|▉         | 3700/37963 [11:34:58<108:31:03, 11.40s/it]
 10%|▉         | 3701/37963 [11:35:08<104:48:05, 11.01s/it]
 10%|▉         | 3702/37963 [11:35:18<101:24:30, 10.66s/it]
 10%|▉         | 3703/37963 [11:35:28<99:19:31, 10.44s/it] 
 10%|▉         | 3704/37963 [11:35:38<98:31:35, 10.35s/it]
 10%|▉         | 3705/37963 [11:35:48<97:11:04, 10.21s/it]
 10%|▉         | 3706/37963 [11:35:58<96:59:01, 10.19s/it]
 10%|▉         | 3707/37963 [11:36:08<96:51:10, 10.18s/it]
 10%|▉         | 3708/37963 [11:36:18<97:00:51, 10.20s/it]
 10%|▉         | 3709/37963 [11:36:28<96:22:50, 10.13s/it]
 10%|▉         | 3710/37963 [11:36:45<114:40:47, 12.05s/it]
                                                           
{'loss': '0.1764', 'grad_norm': '2.973', 'learning_rate': '1.976e-05', 'epoch': '0.09773'}

 10%|▉         | 3710/37963 [11:36:45<114:40:47, 12.05s/it]
 10%|▉         | 3711/37963 [11:36:55<109:14:43, 11.48s/it]
 10%|▉         | 3712/37963 [11:37:15<132:18:54, 13.91s/it]
 10%|▉         | 3713/37963 [11:37:25<122:03:25, 12.83s/it]
 10%|▉         | 3714/37963 [11:37:35<114:36:01, 12.05s/it]
 10%|▉         | 3715/37963 [11:37:52<127:42:18, 13.42s/it]
 10%|▉         | 3716/37963 [11:38:02<117:42:21, 12.37s/it]
 10%|▉         | 3717/37963 [11:38:12<110:47:27, 11.65s/it]
 10%|▉         | 3718/37963 [11:38:21<105:44:15, 11.12s/it]
 10%|▉         | 3719/37963 [11:38:32<103:07:25, 10.84s/it]
 10%|▉         | 3720/37963 [11:38:42<100:56:49, 10.61s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '1.305', 'learning_rate': '1.976e-05', 'epoch': '0.09799'}

 10%|▉         | 3720/37963 [11:38:42<100:56:49, 10.61s/it]
 10%|▉         | 3721/37963 [11:38:52<99:38:59, 10.48s/it] 
 10%|▉         | 3722/37963 [11:39:08<116:26:26, 12.24s/it]
 10%|▉         | 3723/37963 [11:39:18<110:03:18, 11.57s/it]
 10%|▉         | 3724/37963 [11:39:28<105:58:57, 11.14s/it]
 10%|▉         | 3725/37963 [11:39:39<103:09:55, 10.85s/it]
 10%|▉         | 3726/37963 [11:39:49<101:21:31, 10.66s/it]
 10%|▉         | 3727/37963 [11:39:59<99:12:16, 10.43s/it] 
 10%|▉         | 3728/37963 [11:40:09<98:26:45, 10.35s/it]
 10%|▉         | 3729/37963 [11:40:26<116:57:34, 12.30s/it]
 10%|▉         | 3730/37963 [11:40:42<128:22:52, 13.50s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '3.411', 'learning_rate': '1.976e-05', 'epoch': '0.09825'}

 10%|▉         | 3730/37963 [11:40:42<128:22:52, 13.50s/it]
 10%|▉         | 3731/37963 [11:40:52<118:41:28, 12.48s/it]
 10%|▉         | 3732/37963 [11:41:02<112:01:12, 11.78s/it]
 10%|▉         | 3733/37963 [11:41:12<107:23:43, 11.29s/it]
 10%|▉         | 3734/37963 [11:41:23<104:11:06, 10.96s/it]
 10%|▉         | 3735/37963 [11:41:33<101:43:38, 10.70s/it]
 10%|▉         | 3736/37963 [11:41:43<100:04:29, 10.53s/it]
 10%|▉         | 3737/37963 [11:41:53<98:45:30, 10.39s/it] 
 10%|▉         | 3738/37963 [11:42:03<97:55:17, 10.30s/it]
 10%|▉         | 3739/37963 [11:42:20<116:28:58, 12.25s/it]
 10%|▉         | 3740/37963 [11:42:30<110:13:54, 11.60s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '2.376', 'learning_rate': '1.975e-05', 'epoch': '0.09852'}

 10%|▉         | 3740/37963 [11:42:30<110:13:54, 11.60s/it]
 10%|▉         | 3741/37963 [11:42:40<105:53:14, 11.14s/it]
 10%|▉         | 3742/37963 [11:42:50<102:14:43, 10.76s/it]
 10%|▉         | 3743/37963 [11:43:00<100:37:21, 10.59s/it]
 10%|▉         | 3744/37963 [11:43:10<99:08:18, 10.43s/it] 
 10%|▉         | 3745/37963 [11:43:20<97:25:09, 10.25s/it]
 10%|▉         | 3746/37963 [11:43:36<114:31:55, 12.05s/it]
 10%|▉         | 3747/37963 [11:43:46<109:25:57, 11.51s/it]
 10%|▉         | 3748/37963 [11:43:56<104:48:41, 11.03s/it]
 10%|▉         | 3749/37963 [11:44:06<102:05:33, 10.74s/it]
 10%|▉         | 3750/37963 [11:44:17<100:27:26, 10.57s/it]
                                                           
{'loss': '0.162', 'grad_norm': '2.66', 'learning_rate': '1.975e-05', 'epoch': '0.09878'}

 10%|▉         | 3750/37963 [11:44:17<100:27:26, 10.57s/it]
 10%|▉         | 3751/37963 [11:44:27<99:25:33, 10.46s/it] 
 10%|▉         | 3752/37963 [11:44:37<98:00:26, 10.31s/it]
 10%|▉         | 3753/37963 [11:44:47<97:49:38, 10.29s/it]
 10%|▉         | 3754/37963 [11:44:57<96:49:51, 10.19s/it]
 10%|▉         | 3755/37963 [11:45:07<96:31:23, 10.16s/it]
 10%|▉         | 3756/37963 [11:45:17<96:42:05, 10.18s/it]
 10%|▉         | 3757/37963 [11:45:27<96:36:59, 10.17s/it]
 10%|▉         | 3758/37963 [11:45:37<96:29:59, 10.16s/it]
 10%|▉         | 3759/37963 [11:45:47<96:04:37, 10.11s/it]
 10%|▉         | 3760/37963 [11:46:04<114:38:36, 12.07s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '1.937', 'learning_rate': '1.975e-05', 'epoch': '0.09904'}

 10%|▉         | 3760/37963 [11:46:04<114:38:36, 12.07s/it]
 10%|▉         | 3761/37963 [11:46:14<109:32:51, 11.53s/it]
 10%|▉         | 3762/37963 [11:46:25<105:32:11, 11.11s/it]
 10%|▉         | 3763/37963 [11:46:35<102:42:03, 10.81s/it]
 10%|▉         | 3764/37963 [11:46:54<126:10:40, 13.28s/it]
 10%|▉         | 3765/37963 [11:47:10<134:25:27, 14.15s/it]
 10%|▉         | 3766/37963 [11:47:20<122:50:06, 12.93s/it]
 10%|▉         | 3767/37963 [11:47:30<114:39:13, 12.07s/it]
 10%|▉         | 3768/37963 [11:47:40<109:23:31, 11.52s/it]
 10%|▉         | 3769/37963 [11:47:50<105:27:07, 11.10s/it]
 10%|▉         | 3770/37963 [11:48:07<120:18:57, 12.67s/it]
                                                           
{'loss': '0.1636', 'grad_norm': '2.031', 'learning_rate': '1.975e-05', 'epoch': '0.09931'}

 10%|▉         | 3770/37963 [11:48:07<120:18:57, 12.67s/it]
 10%|▉         | 3771/37963 [11:48:17<112:21:06, 11.83s/it]
 10%|▉         | 3772/37963 [11:48:27<107:30:04, 11.32s/it]
 10%|▉         | 3773/37963 [11:48:37<104:19:15, 10.98s/it]
 10%|▉         | 3774/37963 [11:48:47<102:15:59, 10.77s/it]
 10%|▉         | 3775/37963 [11:48:57<100:00:40, 10.53s/it]
 10%|▉         | 3776/37963 [11:49:14<117:29:53, 12.37s/it]
 10%|▉         | 3777/37963 [11:49:31<129:56:58, 13.68s/it]
 10%|▉         | 3778/37963 [11:49:41<119:37:45, 12.60s/it]
 10%|▉         | 3779/37963 [11:49:51<112:53:13, 11.89s/it]
 10%|▉         | 3780/37963 [11:50:01<108:05:26, 11.38s/it]
                                                           
{'loss': '0.165', 'grad_norm': '2.493', 'learning_rate': '1.975e-05', 'epoch': '0.09957'}

 10%|▉         | 3780/37963 [11:50:01<108:05:26, 11.38s/it]
 10%|▉         | 3781/37963 [11:50:11<104:25:31, 11.00s/it]
 10%|▉         | 3782/37963 [11:50:21<101:55:12, 10.73s/it]
 10%|▉         | 3783/37963 [11:50:31<100:15:53, 10.56s/it]
 10%|▉         | 3784/37963 [11:50:42<99:02:53, 10.43s/it] 
 10%|▉         | 3785/37963 [11:50:52<98:20:23, 10.36s/it]
 10%|▉         | 3786/37963 [11:51:08<114:23:08, 12.05s/it]
 10%|▉         | 3787/37963 [11:51:18<109:00:11, 11.48s/it]
 10%|▉         | 3788/37963 [11:51:28<105:38:37, 11.13s/it]
 10%|▉         | 3789/37963 [11:51:38<103:14:01, 10.87s/it]
 10%|▉         | 3790/37963 [11:51:49<101:15:08, 10.67s/it]
                                                           
{'loss': '0.1726', 'grad_norm': '3.05', 'learning_rate': '1.975e-05', 'epoch': '0.09983'}

 10%|▉         | 3790/37963 [11:51:49<101:15:08, 10.67s/it]
 10%|▉         | 3791/37963 [11:51:59<99:39:17, 10.50s/it] 
 10%|▉         | 3792/37963 [11:52:09<98:44:17, 10.40s/it]
 10%|▉         | 3793/37963 [11:52:19<97:51:43, 10.31s/it]
 10%|▉         | 3794/37963 [11:52:29<97:35:08, 10.28s/it]
 10%|▉         | 3795/37963 [11:52:39<96:59:32, 10.22s/it]
 10%|▉         | 3796/37963 [11:52:56<115:25:30, 12.16s/it]
 10%|█         | 3797/37963 [11:53:06<108:36:06, 11.44s/it]
 10%|█         | 3798/37963 [11:53:16<104:37:32, 11.02s/it]
 10%|█         | 3799/37963 [11:53:26<102:13:37, 10.77s/it]
 10%|█         | 3800/37963 [11:53:36<100:22:29, 10.58s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '3.116', 'learning_rate': '1.974e-05', 'epoch': '0.1001'}

 10%|█         | 3800/37963 [11:53:36<100:22:29, 10.58s/it]
 10%|█         | 3801/37963 [11:53:46<98:09:49, 10.34s/it] 
 10%|█         | 3802/37963 [11:53:56<97:04:38, 10.23s/it]
 10%|█         | 3803/37963 [11:54:06<96:40:22, 10.19s/it]
 10%|█         | 3804/37963 [11:54:16<96:34:57, 10.18s/it]
 10%|█         | 3805/37963 [11:54:26<95:20:30, 10.05s/it]
 10%|█         | 3806/37963 [11:54:36<95:50:07, 10.10s/it]
 10%|█         | 3807/37963 [11:54:53<114:39:47, 12.09s/it]
 10%|█         | 3808/37963 [11:55:03<109:00:04, 11.49s/it]
 10%|█         | 3809/37963 [11:55:14<106:25:52, 11.22s/it]
 10%|█         | 3810/37963 [11:55:33<130:05:11, 13.71s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '2.454', 'learning_rate': '1.974e-05', 'epoch': '0.1004'}

 10%|█         | 3810/37963 [11:55:33<130:05:11, 13.71s/it]
 10%|█         | 3811/37963 [11:55:43<118:47:42, 12.52s/it]
 10%|█         | 3812/37963 [11:55:53<111:36:53, 11.77s/it]
 10%|█         | 3813/37963 [11:56:03<106:14:20, 11.20s/it]
 10%|█         | 3814/37963 [11:56:13<103:14:26, 10.88s/it]
 10%|█         | 3815/37963 [11:56:23<101:01:34, 10.65s/it]
 10%|█         | 3816/37963 [11:56:33<98:42:44, 10.41s/it] 
 10%|█         | 3817/37963 [11:56:42<96:01:22, 10.12s/it]
 10%|█         | 3818/37963 [11:56:59<113:41:27, 11.99s/it]
 10%|█         | 3819/37963 [11:57:15<124:59:48, 13.18s/it]
 10%|█         | 3820/37963 [11:57:25<116:15:40, 12.26s/it]
                                                           
{'loss': '0.1724', 'grad_norm': '3.885', 'learning_rate': '1.974e-05', 'epoch': '0.1006'}

 10%|█         | 3820/37963 [11:57:25<116:15:40, 12.26s/it]
 10%|█         | 3821/37963 [11:57:35<110:27:21, 11.65s/it]
 10%|█         | 3822/37963 [11:57:45<105:37:42, 11.14s/it]
 10%|█         | 3823/37963 [11:57:55<103:02:43, 10.87s/it]
 10%|█         | 3824/37963 [11:58:11<118:48:34, 12.53s/it]
 10%|█         | 3825/37963 [11:58:22<111:51:48, 11.80s/it]
 10%|█         | 3826/37963 [11:58:38<125:06:30, 13.19s/it]
 10%|█         | 3827/37963 [11:58:48<117:04:48, 12.35s/it]
 10%|█         | 3828/37963 [11:58:59<110:58:22, 11.70s/it]
 10%|█         | 3829/37963 [11:59:09<106:17:49, 11.21s/it]
 10%|█         | 3830/37963 [11:59:18<101:57:53, 10.75s/it]
                                                           
{'loss': '0.1783', 'grad_norm': '2.951', 'learning_rate': '1.974e-05', 'epoch': '0.1009'}

 10%|█         | 3830/37963 [11:59:18<101:57:53, 10.75s/it]
 10%|█         | 3831/37963 [11:59:28<99:11:48, 10.46s/it] 
 10%|█         | 3832/37963 [11:59:38<97:58:43, 10.33s/it]
 10%|█         | 3833/37963 [11:59:54<115:02:15, 12.13s/it]
 10%|█         | 3834/37963 [12:00:05<109:26:25, 11.54s/it]
 10%|█         | 3835/37963 [12:00:15<105:39:55, 11.15s/it]
 10%|█         | 3836/37963 [12:00:25<101:39:25, 10.72s/it]
 10%|█         | 3837/37963 [12:00:35<100:10:31, 10.57s/it]
 10%|█         | 3838/37963 [12:00:45<99:18:42, 10.48s/it] 
 10%|█         | 3839/37963 [12:00:55<98:19:58, 10.37s/it]
 10%|█         | 3840/37963 [12:01:05<97:33:22, 10.29s/it]
                                                          
{'loss': '0.1633', 'grad_norm': '4.09', 'learning_rate': '1.974e-05', 'epoch': '0.1012'}

 10%|█         | 3840/37963 [12:01:05<97:33:22, 10.29s/it]
 10%|█         | 3841/37963 [12:01:15<96:36:58, 10.19s/it]
 10%|█         | 3842/37963 [12:01:25<96:30:30, 10.18s/it]
 10%|█         | 3843/37963 [12:01:36<96:22:00, 10.17s/it]
 10%|█         | 3844/37963 [12:01:52<114:59:36, 12.13s/it]
 10%|█         | 3845/37963 [12:02:02<109:23:48, 11.54s/it]
 10%|█         | 3846/37963 [12:02:13<105:14:39, 11.11s/it]
 10%|█         | 3847/37963 [12:02:22<101:41:56, 10.73s/it]
 10%|█         | 3848/37963 [12:02:33<100:13:02, 10.58s/it]
 10%|█         | 3849/37963 [12:02:43<98:28:11, 10.39s/it] 
 10%|█         | 3850/37963 [12:02:53<97:21:33, 10.27s/it]
                                                          
{'loss': '0.1711', 'grad_norm': '2.088', 'learning_rate': '1.973e-05', 'epoch': '0.1014'}

 10%|█         | 3850/37963 [12:02:53<97:21:33, 10.27s/it]
 10%|█         | 3851/37963 [12:03:03<96:44:52, 10.21s/it]
 10%|█         | 3852/37963 [12:03:13<96:29:45, 10.18s/it]
 10%|█         | 3853/37963 [12:03:23<96:16:15, 10.16s/it]
 10%|█         | 3854/37963 [12:03:33<96:17:58, 10.16s/it]
 10%|█         | 3855/37963 [12:03:50<114:27:49, 12.08s/it]
 10%|█         | 3856/37963 [12:04:00<108:49:48, 11.49s/it]
 10%|█         | 3857/37963 [12:04:19<131:51:28, 13.92s/it]
 10%|█         | 3858/37963 [12:04:29<120:51:58, 12.76s/it]
 10%|█         | 3859/37963 [12:04:39<113:06:25, 11.94s/it]
 10%|█         | 3860/37963 [12:04:49<107:55:34, 11.39s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '2.272', 'learning_rate': '1.973e-05', 'epoch': '0.1017'}

 10%|█         | 3860/37963 [12:04:49<107:55:34, 11.39s/it]
 10%|█         | 3861/37963 [12:05:00<104:07:45, 10.99s/it]
 10%|█         | 3862/37963 [12:05:09<101:14:32, 10.69s/it]
 10%|█         | 3863/37963 [12:05:19<99:18:33, 10.48s/it] 
 10%|█         | 3864/37963 [12:05:29<97:53:46, 10.34s/it]
 10%|█         | 3865/37963 [12:05:40<97:08:58, 10.26s/it]
 10%|█         | 3866/37963 [12:05:56<114:36:16, 12.10s/it]
 10%|█         | 3867/37963 [12:06:06<109:44:58, 11.59s/it]
 10%|█         | 3868/37963 [12:06:23<124:19:27, 13.13s/it]
 10%|█         | 3869/37963 [12:06:33<115:30:36, 12.20s/it]
 10%|█         | 3870/37963 [12:06:43<109:30:48, 11.56s/it]
                                                           
{'loss': '0.1777', 'grad_norm': '2.29', 'learning_rate': '1.973e-05', 'epoch': '0.1019'}

 10%|█         | 3870/37963 [12:06:43<109:30:48, 11.56s/it]
 10%|█         | 3871/37963 [12:06:59<122:48:17, 12.97s/it]
 10%|█         | 3872/37963 [12:07:09<114:13:30, 12.06s/it]
 10%|█         | 3873/37963 [12:07:26<127:49:44, 13.50s/it]
 10%|█         | 3874/37963 [12:07:36<117:54:09, 12.45s/it]
 10%|█         | 3875/37963 [12:07:46<111:18:13, 11.75s/it]
 10%|█         | 3876/37963 [12:07:57<106:50:39, 11.28s/it]
 10%|█         | 3877/37963 [12:08:07<103:19:58, 10.91s/it]
 10%|█         | 3878/37963 [12:08:17<100:55:29, 10.66s/it]
 10%|█         | 3879/37963 [12:08:27<99:14:02, 10.48s/it] 
 10%|█         | 3880/37963 [12:08:37<97:46:52, 10.33s/it]
                                                          
{'loss': '0.177', 'grad_norm': '2.951', 'learning_rate': '1.973e-05', 'epoch': '0.1022'}

 10%|█         | 3880/37963 [12:08:37<97:46:52, 10.33s/it]
 10%|█         | 3881/37963 [12:08:47<97:28:41, 10.30s/it]
 10%|█         | 3882/37963 [12:08:57<96:52:28, 10.23s/it]
 10%|█         | 3883/37963 [12:09:13<113:42:05, 12.01s/it]
 10%|█         | 3884/37963 [12:09:23<107:51:51, 11.39s/it]
 10%|█         | 3885/37963 [12:09:33<104:08:31, 11.00s/it]
 10%|█         | 3886/37963 [12:09:43<101:08:45, 10.69s/it]
 10%|█         | 3887/37963 [12:09:53<99:29:02, 10.51s/it] 
 10%|█         | 3888/37963 [12:10:03<98:13:51, 10.38s/it]
 10%|█         | 3889/37963 [12:10:14<97:45:12, 10.33s/it]
 10%|█         | 3890/37963 [12:10:24<97:13:22, 10.27s/it]
                                                          
{'loss': '0.1704', 'grad_norm': '1.475', 'learning_rate': '1.973e-05', 'epoch': '0.1025'}

 10%|█         | 3890/37963 [12:10:24<97:13:22, 10.27s/it]
 10%|█         | 3891/37963 [12:10:34<96:59:01, 10.25s/it]
 10%|█         | 3892/37963 [12:10:44<96:45:10, 10.22s/it]
 10%|█         | 3893/37963 [12:11:01<114:51:24, 12.14s/it]
 10%|█         | 3894/37963 [12:11:11<109:21:57, 11.56s/it]
 10%|█         | 3895/37963 [12:11:21<105:19:54, 11.13s/it]
 10%|█         | 3896/37963 [12:11:31<102:10:52, 10.80s/it]
 10%|█         | 3897/37963 [12:11:41<100:30:59, 10.62s/it]
 10%|█         | 3898/37963 [12:11:51<99:11:26, 10.48s/it] 
 10%|█         | 3899/37963 [12:12:01<98:11:30, 10.38s/it]
 10%|█         | 3900/37963 [12:12:12<97:23:39, 10.29s/it]
                                                          
{'loss': '0.1724', 'grad_norm': '5.406', 'learning_rate': '1.972e-05', 'epoch': '0.1027'}

 10%|█         | 3900/37963 [12:12:12<97:23:39, 10.29s/it]
 10%|█         | 3901/37963 [12:12:22<96:55:39, 10.24s/it]
 10%|█         | 3902/37963 [12:12:31<95:34:28, 10.10s/it]
 10%|█         | 3903/37963 [12:12:42<95:57:32, 10.14s/it]
 10%|█         | 3904/37963 [12:12:59<114:52:00, 12.14s/it]
 10%|█         | 3905/37963 [12:13:09<109:17:59, 11.55s/it]
 10%|█         | 3906/37963 [12:13:28<131:34:25, 13.91s/it]
 10%|█         | 3907/37963 [12:13:38<120:57:29, 12.79s/it]
 10%|█         | 3908/37963 [12:13:49<113:41:09, 12.02s/it]
 10%|█         | 3909/37963 [12:13:59<108:15:16, 11.44s/it]
 10%|█         | 3910/37963 [12:14:09<104:18:40, 11.03s/it]
                                                           
{'loss': '0.1741', 'grad_norm': '2.378', 'learning_rate': '1.972e-05', 'epoch': '0.103'}

 10%|█         | 3910/37963 [12:14:09<104:18:40, 11.03s/it]
 10%|█         | 3911/37963 [12:14:25<118:31:12, 12.53s/it]
 10%|█         | 3912/37963 [12:14:35<111:30:25, 11.79s/it]
 10%|█         | 3913/37963 [12:14:51<123:36:42, 13.07s/it]
 10%|█         | 3914/37963 [12:15:01<115:31:41, 12.21s/it]
 10%|█         | 3915/37963 [12:15:11<109:35:20, 11.59s/it]
 10%|█         | 3916/37963 [12:15:21<105:42:05, 11.18s/it]
 10%|█         | 3917/37963 [12:15:31<101:40:13, 10.75s/it]
 10%|█         | 3918/37963 [12:15:41<100:15:31, 10.60s/it]
 10%|█         | 3919/37963 [12:15:58<117:47:40, 12.46s/it]
 10%|█         | 3920/37963 [12:16:15<129:35:38, 13.70s/it]
                                                           
{'loss': '0.1744', 'grad_norm': '3.069', 'learning_rate': '1.972e-05', 'epoch': '0.1033'}

 10%|█         | 3920/37963 [12:16:15<129:35:38, 13.70s/it]
 10%|█         | 3921/37963 [12:16:25<119:41:12, 12.66s/it]
 10%|█         | 3922/37963 [12:16:35<112:07:45, 11.86s/it]
 10%|█         | 3923/37963 [12:16:45<107:02:32, 11.32s/it]
 10%|█         | 3924/37963 [12:16:55<103:08:02, 10.91s/it]
 10%|█         | 3925/37963 [12:17:05<100:31:12, 10.63s/it]
 10%|█         | 3926/37963 [12:17:15<98:41:53, 10.44s/it] 
 10%|█         | 3927/37963 [12:17:25<97:40:25, 10.33s/it]
 10%|█         | 3928/37963 [12:17:35<96:45:39, 10.23s/it]
 10%|█         | 3929/37963 [12:17:45<94:54:00, 10.04s/it]
 10%|█         | 3930/37963 [12:17:55<95:16:49, 10.08s/it]
                                                          
{'loss': '0.1673', 'grad_norm': '1.743', 'learning_rate': '1.972e-05', 'epoch': '0.1035'}

 10%|█         | 3930/37963 [12:17:55<95:16:49, 10.08s/it]
 10%|█         | 3931/37963 [12:18:05<94:10:09,  9.96s/it]
 10%|█         | 3932/37963 [12:18:21<113:12:03, 11.98s/it]
 10%|█         | 3933/37963 [12:18:31<108:02:09, 11.43s/it]
 10%|█         | 3934/37963 [12:18:41<104:14:32, 11.03s/it]
 10%|█         | 3935/37963 [12:18:52<101:32:48, 10.74s/it]
 10%|█         | 3936/37963 [12:19:02<100:01:21, 10.58s/it]
 10%|█         | 3937/37963 [12:19:12<99:20:03, 10.51s/it] 
 10%|█         | 3938/37963 [12:19:22<97:32:23, 10.32s/it]
 10%|█         | 3939/37963 [12:19:32<96:11:49, 10.18s/it]
 10%|█         | 3940/37963 [12:19:48<113:54:42, 12.05s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '2.526', 'learning_rate': '1.972e-05', 'epoch': '0.1038'}

 10%|█         | 3940/37963 [12:19:48<113:54:42, 12.05s/it]
 10%|█         | 3941/37963 [12:19:58<108:19:26, 11.46s/it]
 10%|█         | 3942/37963 [12:20:08<104:12:47, 11.03s/it]
 10%|█         | 3943/37963 [12:20:19<102:21:34, 10.83s/it]
 10%|█         | 3944/37963 [12:20:29<100:17:27, 10.61s/it]
 10%|█         | 3945/37963 [12:20:39<98:01:03, 10.37s/it] 
 10%|█         | 3946/37963 [12:20:49<97:31:18, 10.32s/it]
 10%|█         | 3947/37963 [12:20:59<97:12:47, 10.29s/it]
 10%|█         | 3948/37963 [12:21:09<96:36:47, 10.23s/it]
 10%|█         | 3949/37963 [12:21:19<95:15:08, 10.08s/it]
 10%|█         | 3950/37963 [12:21:29<95:20:58, 10.09s/it]
                                                          
{'loss': '0.197', 'grad_norm': '1.865', 'learning_rate': '1.971e-05', 'epoch': '0.104'}

 10%|█         | 3950/37963 [12:21:29<95:20:58, 10.09s/it]
 10%|█         | 3951/37963 [12:21:39<95:25:18, 10.10s/it]
 10%|█         | 3952/37963 [12:21:55<113:16:51, 11.99s/it]
 10%|█         | 3953/37963 [12:22:05<107:27:31, 11.37s/it]
 10%|█         | 3954/37963 [12:22:25<130:13:50, 13.79s/it]
 10%|█         | 3955/37963 [12:22:35<119:38:05, 12.66s/it]
 10%|█         | 3956/37963 [12:22:45<112:34:23, 11.92s/it]
 10%|█         | 3957/37963 [12:22:55<107:29:44, 11.38s/it]
 10%|█         | 3958/37963 [12:23:12<122:01:52, 12.92s/it]
 10%|█         | 3959/37963 [12:23:22<114:00:18, 12.07s/it]
 10%|█         | 3960/37963 [12:23:31<107:12:15, 11.35s/it]
                                                           
{'loss': '0.1886', 'grad_norm': '2.655', 'learning_rate': '1.971e-05', 'epoch': '0.1043'}

 10%|█         | 3960/37963 [12:23:31<107:12:15, 11.35s/it]
 10%|█         | 3961/37963 [12:23:42<103:53:31, 11.00s/it]
 10%|█         | 3962/37963 [12:23:52<101:38:29, 10.76s/it]
 10%|█         | 3963/37963 [12:24:08<117:05:25, 12.40s/it]
 10%|█         | 3964/37963 [12:24:18<111:18:24, 11.79s/it]
 10%|█         | 3965/37963 [12:24:29<106:48:25, 11.31s/it]
 10%|█         | 3966/37963 [12:24:45<121:13:50, 12.84s/it]
 10%|█         | 3967/37963 [12:24:55<113:52:25, 12.06s/it]
 10%|█         | 3968/37963 [12:25:05<108:31:46, 11.49s/it]
 10%|█         | 3969/37963 [12:25:22<123:03:22, 13.03s/it]
 10%|█         | 3970/37963 [12:25:32<115:07:13, 12.19s/it]
                                                           
{'loss': '0.1795', 'grad_norm': '4.84', 'learning_rate': '1.971e-05', 'epoch': '0.1046'}

 10%|█         | 3970/37963 [12:25:32<115:07:13, 12.19s/it]
 10%|█         | 3971/37963 [12:25:42<109:14:41, 11.57s/it]
 10%|█         | 3972/37963 [12:25:53<105:19:05, 11.15s/it]
 10%|█         | 3973/37963 [12:26:03<102:44:54, 10.88s/it]
 10%|█         | 3974/37963 [12:26:13<100:56:01, 10.69s/it]
 10%|█         | 3975/37963 [12:26:23<98:23:03, 10.42s/it] 
 10%|█         | 3976/37963 [12:26:33<97:53:02, 10.37s/it]
 10%|█         | 3977/37963 [12:26:43<97:21:41, 10.31s/it]
 10%|█         | 3978/37963 [12:26:54<97:14:19, 10.30s/it]
 10%|█         | 3979/37963 [12:27:04<96:44:33, 10.25s/it]
 10%|█         | 3980/37963 [12:27:20<112:40:01, 11.94s/it]
                                                           
{'loss': '0.173', 'grad_norm': '2.102', 'learning_rate': '1.971e-05', 'epoch': '0.1048'}

 10%|█         | 3980/37963 [12:27:20<112:40:01, 11.94s/it]
 10%|█         | 3981/37963 [12:27:30<107:42:34, 11.41s/it]
 10%|█         | 3982/37963 [12:27:40<104:22:17, 11.06s/it]
 10%|█         | 3983/37963 [12:27:50<101:39:45, 10.77s/it]
 10%|█         | 3984/37963 [12:28:00<99:37:22, 10.55s/it] 
 10%|█         | 3985/37963 [12:28:10<98:18:11, 10.42s/it]
 10%|█         | 3986/37963 [12:28:20<97:45:05, 10.36s/it]
 11%|█         | 3987/37963 [12:28:30<95:52:20, 10.16s/it]
 11%|█         | 3988/37963 [12:28:40<95:47:56, 10.15s/it]
 11%|█         | 3989/37963 [12:28:57<113:57:40, 12.08s/it]
 11%|█         | 3990/37963 [12:29:07<108:13:51, 11.47s/it]
                                                           
{'loss': '0.1769', 'grad_norm': '2.825', 'learning_rate': '1.971e-05', 'epoch': '0.1051'}

 11%|█         | 3990/37963 [12:29:07<108:13:51, 11.47s/it]
 11%|█         | 3991/37963 [12:29:17<104:07:52, 11.03s/it]
 11%|█         | 3992/37963 [12:29:27<101:33:33, 10.76s/it]
 11%|█         | 3993/37963 [12:29:37<99:16:27, 10.52s/it] 
 11%|█         | 3994/37963 [12:29:47<97:57:51, 10.38s/it]
 11%|█         | 3995/37963 [12:29:57<96:33:53, 10.23s/it]
 11%|█         | 3996/37963 [12:30:07<96:08:23, 10.19s/it]
 11%|█         | 3997/37963 [12:30:17<96:15:38, 10.20s/it]
 11%|█         | 3998/37963 [12:30:27<94:57:11, 10.06s/it]
 11%|█         | 3999/37963 [12:30:37<95:05:51, 10.08s/it]
 11%|█         | 4000/37963 [12:30:54<113:55:30, 12.08s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '2.404', 'learning_rate': '1.97e-05', 'epoch': '0.1054'}

 11%|█         | 4000/37963 [12:30:54<113:55:30, 12.08s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.75s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.75s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 11%|█         | 4001/37963 [12:31:49<236:38:41, 25.08s/it]
 11%|█         | 4002/37963 [12:32:09<220:01:54, 23.32s/it]
 11%|█         | 4003/37963 [12:32:18<182:14:06, 19.32s/it]
 11%|█         | 4004/37963 [12:32:35<174:21:31, 18.48s/it]
 11%|█         | 4005/37963 [12:32:45<150:37:35, 15.97s/it]
 11%|█         | 4006/37963 [12:32:55<133:59:03, 14.20s/it]
 11%|█         | 4007/37963 [12:33:05<122:30:15, 12.99s/it]
 11%|█         | 4008/37963 [12:33:16<114:32:40, 12.14s/it]
 11%|█         | 4009/37963 [12:33:26<108:36:55, 11.52s/it]
 11%|█         | 4010/37963 [12:33:36<104:30:20, 11.08s/it]
                                                           
{'loss': '0.1803', 'grad_norm': '2.452', 'learning_rate': '1.97e-05', 'epoch': '0.1056'}

 11%|█         | 4010/37963 [12:33:36<104:30:20, 11.08s/it]
 11%|█         | 4011/37963 [12:33:46<102:06:29, 10.83s/it]
 11%|█         | 4012/37963 [12:34:09<135:42:25, 14.39s/it]
 11%|█         | 4013/37963 [12:34:19<123:33:19, 13.10s/it]
 11%|█         | 4014/37963 [12:34:29<114:19:05, 12.12s/it]
 11%|█         | 4015/37963 [12:34:39<108:31:38, 11.51s/it]
 11%|█         | 4016/37963 [12:34:49<104:47:45, 11.11s/it]
 11%|█         | 4017/37963 [12:34:59<102:04:33, 10.83s/it]
 11%|█         | 4018/37963 [12:35:09<100:27:54, 10.65s/it]
 11%|█         | 4019/37963 [12:35:26<117:04:04, 12.42s/it]
 11%|█         | 4020/37963 [12:35:36<110:34:45, 11.73s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '3.753', 'learning_rate': '1.97e-05', 'epoch': '0.1059'}

 11%|█         | 4020/37963 [12:35:36<110:34:45, 11.73s/it]
 11%|█         | 4021/37963 [12:35:46<106:02:07, 11.25s/it]
 11%|█         | 4022/37963 [12:35:56<102:56:49, 10.92s/it]
 11%|█         | 4023/37963 [12:36:06<100:43:48, 10.68s/it]
 11%|█         | 4024/37963 [12:36:16<99:01:11, 10.50s/it] 
 11%|█         | 4025/37963 [12:36:26<97:59:09, 10.39s/it]
 11%|█         | 4026/37963 [12:36:36<96:51:44, 10.28s/it]
 11%|█         | 4027/37963 [12:36:52<112:44:03, 11.96s/it]
 11%|█         | 4028/37963 [12:37:03<107:42:47, 11.43s/it]
 11%|█         | 4029/37963 [12:37:12<103:18:19, 10.96s/it]
 11%|█         | 4030/37963 [12:37:22<100:08:29, 10.62s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '2.185', 'learning_rate': '1.97e-05', 'epoch': '0.1062'}

 11%|█         | 4030/37963 [12:37:22<100:08:29, 10.62s/it]
 11%|█         | 4031/37963 [12:37:32<98:57:57, 10.50s/it] 
 11%|█         | 4032/37963 [12:37:43<98:00:52, 10.40s/it]
 11%|█         | 4033/37963 [12:37:53<97:07:30, 10.31s/it]
 11%|█         | 4034/37963 [12:38:03<96:41:16, 10.26s/it]
 11%|█         | 4035/37963 [12:38:13<96:28:08, 10.24s/it]
 11%|█         | 4036/37963 [12:38:23<96:27:30, 10.24s/it]
 11%|█         | 4037/37963 [12:38:40<113:24:18, 12.03s/it]
 11%|█         | 4038/37963 [12:38:50<108:10:01, 11.48s/it]
 11%|█         | 4039/37963 [12:39:00<104:08:03, 11.05s/it]
 11%|█         | 4040/37963 [12:39:10<101:35:21, 10.78s/it]
                                                           
{'loss': '0.181', 'grad_norm': '1.053', 'learning_rate': '1.97e-05', 'epoch': '0.1064'}

 11%|█         | 4040/37963 [12:39:10<101:35:21, 10.78s/it]
 11%|█         | 4041/37963 [12:39:20<99:52:19, 10.60s/it] 
 11%|█         | 4042/37963 [12:39:30<99:08:11, 10.52s/it]
 11%|█         | 4043/37963 [12:39:41<98:02:20, 10.41s/it]
 11%|█         | 4044/37963 [12:39:51<97:08:23, 10.31s/it]
 11%|█         | 4045/37963 [12:40:00<95:40:49, 10.16s/it]
 11%|█         | 4046/37963 [12:40:17<113:16:49, 12.02s/it]
 11%|█         | 4047/37963 [12:40:27<108:27:10, 11.51s/it]
 11%|█         | 4048/37963 [12:40:37<104:21:08, 11.08s/it]
 11%|█         | 4049/37963 [12:40:47<101:45:17, 10.80s/it]
 11%|█         | 4050/37963 [12:40:57<99:42:13, 10.58s/it] 
                                                          
{'loss': '0.1539', 'grad_norm': '4.438', 'learning_rate': '1.969e-05', 'epoch': '0.1067'}

 11%|█         | 4050/37963 [12:40:57<99:42:13, 10.58s/it]
 11%|█         | 4051/37963 [12:41:17<124:49:08, 13.25s/it]
 11%|█         | 4052/37963 [12:41:27<115:53:45, 12.30s/it]
 11%|█         | 4053/37963 [12:41:37<109:41:30, 11.65s/it]
 11%|█         | 4054/37963 [12:41:54<123:43:35, 13.14s/it]
 11%|█         | 4055/37963 [12:42:04<114:17:15, 12.13s/it]
 11%|█         | 4056/37963 [12:42:14<108:30:36, 11.52s/it]
 11%|█         | 4057/37963 [12:42:24<104:32:30, 11.10s/it]
 11%|█         | 4058/37963 [12:42:34<101:30:45, 10.78s/it]
 11%|█         | 4059/37963 [12:42:44<99:36:45, 10.58s/it] 
 11%|█         | 4060/37963 [12:43:07<133:48:15, 14.21s/it]
                                                           
{'loss': '0.1817', 'grad_norm': '3.887', 'learning_rate': '1.969e-05', 'epoch': '0.1069'}

 11%|█         | 4060/37963 [12:43:07<133:48:15, 14.21s/it]
 11%|█         | 4061/37963 [12:43:16<121:33:09, 12.91s/it]
 11%|█         | 4062/37963 [12:43:27<113:42:11, 12.07s/it]
 11%|█         | 4063/37963 [12:43:37<108:17:20, 11.50s/it]
 11%|█         | 4064/37963 [12:43:47<104:46:23, 11.13s/it]
 11%|█         | 4065/37963 [12:43:57<102:02:03, 10.84s/it]
 11%|█         | 4066/37963 [12:44:07<98:46:50, 10.49s/it] 
 11%|█         | 4067/37963 [12:44:23<115:32:37, 12.27s/it]
 11%|█         | 4068/37963 [12:44:33<109:18:35, 11.61s/it]
 11%|█         | 4069/37963 [12:44:44<105:22:42, 11.19s/it]
 11%|█         | 4070/37963 [12:44:54<102:27:16, 10.88s/it]
                                                           
{'loss': '0.1762', 'grad_norm': '2.883', 'learning_rate': '1.969e-05', 'epoch': '0.1072'}

 11%|█         | 4070/37963 [12:44:54<102:27:16, 10.88s/it]
 11%|█         | 4071/37963 [12:45:03<99:20:34, 10.55s/it] 
 11%|█         | 4072/37963 [12:45:14<98:27:35, 10.46s/it]
 11%|█         | 4073/37963 [12:45:24<97:01:41, 10.31s/it]
 11%|█         | 4074/37963 [12:45:40<113:16:08, 12.03s/it]
 11%|█         | 4075/37963 [12:45:50<108:12:39, 11.50s/it]
 11%|█         | 4076/37963 [12:46:00<104:18:47, 11.08s/it]
 11%|█         | 4077/37963 [12:46:10<101:31:47, 10.79s/it]
 11%|█         | 4078/37963 [12:46:20<99:46:05, 10.60s/it] 
 11%|█         | 4079/37963 [12:46:31<98:40:19, 10.48s/it]
 11%|█         | 4080/37963 [12:46:41<97:23:15, 10.35s/it]
                                                          
{'loss': '0.1653', 'grad_norm': '2.78', 'learning_rate': '1.969e-05', 'epoch': '0.1075'}

 11%|█         | 4080/37963 [12:46:41<97:23:15, 10.35s/it]
 11%|█         | 4081/37963 [12:46:50<95:40:47, 10.17s/it]
 11%|█         | 4082/37963 [12:47:01<96:15:53, 10.23s/it]
 11%|█         | 4083/37963 [12:47:11<95:54:15, 10.19s/it]
 11%|█         | 4084/37963 [12:47:21<95:35:59, 10.16s/it]
 11%|█         | 4085/37963 [12:47:31<95:09:47, 10.11s/it]
 11%|█         | 4086/37963 [12:47:47<113:13:09, 12.03s/it]
 11%|█         | 4087/37963 [12:47:58<107:55:09, 11.47s/it]
 11%|█         | 4088/37963 [12:48:08<104:06:23, 11.06s/it]
 11%|█         | 4089/37963 [12:48:18<101:21:20, 10.77s/it]
 11%|█         | 4090/37963 [12:48:28<99:29:35, 10.57s/it] 
                                                          
{'loss': '0.1652', 'grad_norm': '2.157', 'learning_rate': '1.968e-05', 'epoch': '0.1077'}

 11%|█         | 4090/37963 [12:48:28<99:29:35, 10.57s/it]
 11%|█         | 4091/37963 [12:48:38<98:19:18, 10.45s/it]
 11%|█         | 4092/37963 [12:48:48<98:00:33, 10.42s/it]
 11%|█         | 4093/37963 [12:48:58<96:23:08, 10.24s/it]
 11%|█         | 4094/37963 [12:49:08<96:06:17, 10.22s/it]
 11%|█         | 4095/37963 [12:49:25<114:27:55, 12.17s/it]
 11%|█         | 4096/37963 [12:49:35<108:08:15, 11.49s/it]
 11%|█         | 4097/37963 [12:49:45<104:10:51, 11.07s/it]
 11%|█         | 4098/37963 [12:49:55<101:46:16, 10.82s/it]
 11%|█         | 4099/37963 [12:50:14<124:53:34, 13.28s/it]
 11%|█         | 4100/37963 [12:50:24<115:52:41, 12.32s/it]
                                                           
{'loss': '0.1839', 'grad_norm': '3.588', 'learning_rate': '1.968e-05', 'epoch': '0.108'}

 11%|█         | 4100/37963 [12:50:24<115:52:41, 12.32s/it]
 11%|█         | 4101/37963 [12:50:35<110:10:56, 11.71s/it]
 11%|█         | 4102/37963 [12:50:51<123:23:25, 13.12s/it]
 11%|█         | 4103/37963 [12:51:01<115:04:55, 12.24s/it]
 11%|█         | 4104/37963 [12:51:11<109:06:59, 11.60s/it]
 11%|█         | 4105/37963 [12:51:21<104:13:15, 11.08s/it]
 11%|█         | 4106/37963 [12:51:31<101:30:09, 10.79s/it]
 11%|█         | 4107/37963 [12:51:48<118:25:04, 12.59s/it]
 11%|█         | 4108/37963 [12:51:58<111:19:25, 11.84s/it]
 11%|█         | 4109/37963 [12:52:08<106:38:47, 11.34s/it]
 11%|█         | 4110/37963 [12:52:19<103:40:55, 11.03s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '3.254', 'learning_rate': '1.968e-05', 'epoch': '0.1083'}

 11%|█         | 4110/37963 [12:52:19<103:40:55, 11.03s/it]
 11%|█         | 4111/37963 [12:52:35<119:29:45, 12.71s/it]
 11%|█         | 4112/37963 [12:52:52<131:04:36, 13.94s/it]
 11%|█         | 4113/37963 [12:53:02<120:04:56, 12.77s/it]
 11%|█         | 4114/37963 [12:53:12<112:39:27, 11.98s/it]
 11%|█         | 4115/37963 [12:53:23<107:45:38, 11.46s/it]
 11%|█         | 4116/37963 [12:53:33<104:13:12, 11.08s/it]
 11%|█         | 4117/37963 [12:53:43<101:14:48, 10.77s/it]
 11%|█         | 4118/37963 [12:53:53<98:49:31, 10.51s/it] 
 11%|█         | 4119/37963 [12:54:03<97:53:12, 10.41s/it]
 11%|█         | 4120/37963 [12:54:13<97:12:59, 10.34s/it]
                                                          
{'loss': '0.1757', 'grad_norm': '0.9968', 'learning_rate': '1.968e-05', 'epoch': '0.1085'}

 11%|█         | 4120/37963 [12:54:13<97:12:59, 10.34s/it]
 11%|█         | 4121/37963 [12:54:23<96:01:13, 10.21s/it]
 11%|█         | 4122/37963 [12:54:40<113:46:32, 12.10s/it]
 11%|█         | 4123/37963 [12:54:50<108:22:48, 11.53s/it]
 11%|█         | 4124/37963 [12:55:00<104:29:12, 11.12s/it]
 11%|█         | 4125/37963 [12:55:10<102:07:23, 10.86s/it]
 11%|█         | 4126/37963 [12:55:20<99:09:38, 10.55s/it] 
 11%|█         | 4127/37963 [12:55:30<97:26:41, 10.37s/it]
 11%|█         | 4128/37963 [12:55:40<96:40:13, 10.29s/it]
 11%|█         | 4129/37963 [12:55:50<96:40:11, 10.29s/it]
 11%|█         | 4130/37963 [12:56:00<96:16:50, 10.24s/it]
                                                          
{'loss': '0.1647', 'grad_norm': '4.25', 'learning_rate': '1.968e-05', 'epoch': '0.1088'}

 11%|█         | 4130/37963 [12:56:00<96:16:50, 10.24s/it]
 11%|█         | 4131/37963 [12:56:11<96:03:56, 10.22s/it]
 11%|█         | 4132/37963 [12:56:21<96:06:21, 10.23s/it]
 11%|█         | 4133/37963 [12:56:31<95:59:52, 10.22s/it]
 11%|█         | 4134/37963 [12:56:48<113:43:14, 12.10s/it]
 11%|█         | 4135/37963 [12:56:58<108:19:38, 11.53s/it]
 11%|█         | 4136/37963 [12:57:08<104:33:09, 11.13s/it]
 11%|█         | 4137/37963 [12:57:18<101:39:06, 10.82s/it]
 11%|█         | 4138/37963 [12:57:28<100:32:45, 10.70s/it]
 11%|█         | 4139/37963 [12:57:38<97:31:02, 10.38s/it] 
 11%|█         | 4140/37963 [12:57:48<96:23:46, 10.26s/it]
                                                          
{'loss': '0.1766', 'grad_norm': '6.09', 'learning_rate': '1.967e-05', 'epoch': '0.1091'}

 11%|█         | 4140/37963 [12:57:48<96:23:46, 10.26s/it]
 11%|█         | 4141/37963 [12:57:58<96:06:48, 10.23s/it]
 11%|█         | 4142/37963 [12:58:08<95:25:02, 10.16s/it]
 11%|█         | 4143/37963 [12:58:18<95:10:06, 10.13s/it]
 11%|█         | 4144/37963 [12:58:35<114:12:20, 12.16s/it]
 11%|█         | 4145/37963 [12:58:45<108:21:55, 11.54s/it]
 11%|█         | 4146/37963 [12:58:55<104:19:41, 11.11s/it]
 11%|█         | 4147/37963 [12:59:05<101:01:12, 10.75s/it]
 11%|█         | 4148/37963 [12:59:25<124:56:34, 13.30s/it]
 11%|█         | 4149/37963 [12:59:34<114:57:47, 12.24s/it]
 11%|█         | 4150/37963 [12:59:45<109:21:37, 11.64s/it]
                                                           
{'loss': '0.1725', 'grad_norm': '1.735', 'learning_rate': '1.967e-05', 'epoch': '0.1093'}

 11%|█         | 4150/37963 [12:59:45<109:21:37, 11.64s/it]
 11%|█         | 4151/37963 [13:00:01<124:12:13, 13.22s/it]
 11%|█         | 4152/37963 [13:00:12<115:16:47, 12.27s/it]
 11%|█         | 4153/37963 [13:00:22<109:15:12, 11.63s/it]
 11%|█         | 4154/37963 [13:00:32<105:03:57, 11.19s/it]
 11%|█         | 4155/37963 [13:00:48<119:40:40, 12.74s/it]
 11%|█         | 4156/37963 [13:00:58<112:23:46, 11.97s/it]
 11%|█         | 4157/37963 [13:01:08<107:08:49, 11.41s/it]
 11%|█         | 4158/37963 [13:01:18<103:08:04, 10.98s/it]
 11%|█         | 4159/37963 [13:01:35<118:26:46, 12.61s/it]
 11%|█         | 4160/37963 [13:01:51<129:18:23, 13.77s/it]
                                                           
{'loss': '0.1721', 'grad_norm': '5.176', 'learning_rate': '1.967e-05', 'epoch': '0.1096'}

 11%|█         | 4160/37963 [13:01:51<129:18:23, 13.77s/it]
 11%|█         | 4161/37963 [13:02:02<119:10:14, 12.69s/it]
 11%|█         | 4162/37963 [13:02:12<112:07:35, 11.94s/it]
 11%|█         | 4163/37963 [13:02:21<105:42:25, 11.26s/it]
 11%|█         | 4164/37963 [13:02:32<102:32:55, 10.92s/it]
 11%|█         | 4165/37963 [13:02:42<100:30:41, 10.71s/it]
 11%|█         | 4166/37963 [13:02:52<98:43:50, 10.52s/it] 
 11%|█         | 4167/37963 [13:03:02<98:00:30, 10.44s/it]
 11%|█         | 4168/37963 [13:03:12<96:57:26, 10.33s/it]
 11%|█         | 4169/37963 [13:03:22<96:38:13, 10.29s/it]
 11%|█         | 4170/37963 [13:03:32<96:14:35, 10.25s/it]
                                                          
{'loss': '0.1677', 'grad_norm': '1.939', 'learning_rate': '1.967e-05', 'epoch': '0.1098'}

 11%|█         | 4170/37963 [13:03:32<96:14:35, 10.25s/it]
 11%|█         | 4171/37963 [13:03:49<114:02:31, 12.15s/it]
 11%|█         | 4172/37963 [13:03:59<108:19:53, 11.54s/it]
 11%|█         | 4173/37963 [13:04:09<104:31:29, 11.14s/it]
 11%|█         | 4174/37963 [13:04:20<101:48:37, 10.85s/it]
 11%|█         | 4175/37963 [13:04:30<99:46:51, 10.63s/it] 
 11%|█         | 4176/37963 [13:04:40<98:14:45, 10.47s/it]
 11%|█         | 4177/37963 [13:04:49<95:40:39, 10.19s/it]
 11%|█         | 4178/37963 [13:04:59<95:13:27, 10.15s/it]
 11%|█         | 4179/37963 [13:05:09<95:07:36, 10.14s/it]
 11%|█         | 4180/37963 [13:05:20<94:53:26, 10.11s/it]
                                                          
{'loss': '0.1628', 'grad_norm': '2.679', 'learning_rate': '1.967e-05', 'epoch': '0.1101'}

 11%|█         | 4180/37963 [13:05:20<94:53:26, 10.11s/it]
 11%|█         | 4181/37963 [13:05:30<94:40:37, 10.09s/it]
 11%|█         | 4182/37963 [13:05:39<93:51:45, 10.00s/it]
 11%|█         | 4183/37963 [13:05:56<112:02:49, 11.94s/it]
 11%|█         | 4184/37963 [13:06:06<106:40:48, 11.37s/it]
 11%|█         | 4185/37963 [13:06:16<103:11:37, 11.00s/it]
 11%|█         | 4186/37963 [13:06:26<100:44:46, 10.74s/it]
 11%|█         | 4187/37963 [13:06:36<98:54:58, 10.54s/it] 
 11%|█         | 4188/37963 [13:06:46<97:35:28, 10.40s/it]
 11%|█         | 4189/37963 [13:06:56<97:02:10, 10.34s/it]
 11%|█         | 4190/37963 [13:07:07<96:31:17, 10.29s/it]
                                                          
{'loss': '0.1708', 'grad_norm': '1.679', 'learning_rate': '1.966e-05', 'epoch': '0.1104'}

 11%|█         | 4190/37963 [13:07:07<96:31:17, 10.29s/it]
 11%|█         | 4191/37963 [13:07:17<95:47:36, 10.21s/it]
 11%|█         | 4192/37963 [13:07:33<113:44:52, 12.13s/it]
 11%|█         | 4193/37963 [13:07:43<108:01:05, 11.52s/it]
 11%|█         | 4194/37963 [13:07:54<104:45:42, 11.17s/it]
 11%|█         | 4195/37963 [13:08:04<101:46:45, 10.85s/it]
 11%|█         | 4196/37963 [13:08:14<99:11:40, 10.58s/it] 
 11%|█         | 4197/37963 [13:08:33<122:31:28, 13.06s/it]
 11%|█         | 4198/37963 [13:08:49<132:08:32, 14.09s/it]
 11%|█         | 4199/37963 [13:08:59<120:44:24, 12.87s/it]
 11%|█         | 4200/37963 [13:09:09<112:24:46, 11.99s/it]
                                                           
{'loss': '0.1759', 'grad_norm': '1.26', 'learning_rate': '1.966e-05', 'epoch': '0.1106'}

 11%|█         | 4200/37963 [13:09:09<112:24:46, 11.99s/it]
 11%|█         | 4201/37963 [13:09:19<107:01:21, 11.41s/it]
 11%|█         | 4202/37963 [13:09:29<103:22:42, 11.02s/it]
 11%|█         | 4203/37963 [13:09:39<100:18:35, 10.70s/it]
 11%|█         | 4204/37963 [13:09:56<116:48:57, 12.46s/it]
 11%|█         | 4205/37963 [13:10:06<110:02:34, 11.74s/it]
 11%|█         | 4206/37963 [13:10:16<105:33:08, 11.26s/it]
 11%|█         | 4207/37963 [13:10:32<120:16:22, 12.83s/it]
 11%|█         | 4208/37963 [13:10:43<112:51:20, 12.04s/it]
 11%|█         | 4209/37963 [13:10:59<125:12:43, 13.35s/it]
 11%|█         | 4210/37963 [13:11:09<116:13:26, 12.40s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '3.179', 'learning_rate': '1.966e-05', 'epoch': '0.1109'}

 11%|█         | 4210/37963 [13:11:09<116:13:26, 12.40s/it]
 11%|█         | 4211/37963 [13:11:19<108:34:19, 11.58s/it]
 11%|█         | 4212/37963 [13:11:29<104:40:44, 11.17s/it]
 11%|█         | 4213/37963 [13:11:39<102:00:35, 10.88s/it]
 11%|█         | 4214/37963 [13:11:49<99:53:35, 10.66s/it] 
 11%|█         | 4215/37963 [13:11:59<97:26:23, 10.39s/it]
 11%|█         | 4216/37963 [13:12:09<95:51:08, 10.23s/it]
 11%|█         | 4217/37963 [13:12:19<95:39:30, 10.20s/it]
 11%|█         | 4218/37963 [13:12:29<94:29:25, 10.08s/it]
 11%|█         | 4219/37963 [13:12:39<93:50:34, 10.01s/it]
 11%|█         | 4220/37963 [13:12:49<94:03:45, 10.04s/it]
                                                          
{'loss': '0.1514', 'grad_norm': '1.43', 'learning_rate': '1.966e-05', 'epoch': '0.1112'}

 11%|█         | 4220/37963 [13:12:49<94:03:45, 10.04s/it]
 11%|█         | 4221/37963 [13:12:59<93:55:06, 10.02s/it]
 11%|█         | 4222/37963 [13:13:15<112:06:20, 11.96s/it]
 11%|█         | 4223/37963 [13:13:25<106:01:25, 11.31s/it]
 11%|█         | 4224/37963 [13:13:35<102:26:06, 10.93s/it]
 11%|█         | 4225/37963 [13:13:45<99:35:06, 10.63s/it] 
 11%|█         | 4226/37963 [13:13:55<98:18:22, 10.49s/it]
 11%|█         | 4227/37963 [13:14:05<96:49:26, 10.33s/it]
 11%|█         | 4228/37963 [13:14:15<96:18:31, 10.28s/it]
 11%|█         | 4229/37963 [13:14:26<95:41:03, 10.21s/it]
 11%|█         | 4230/37963 [13:14:36<95:24:14, 10.18s/it]
                                                          
{'loss': '0.1732', 'grad_norm': '3.22', 'learning_rate': '1.965e-05', 'epoch': '0.1114'}

 11%|█         | 4230/37963 [13:14:36<95:24:14, 10.18s/it]
 11%|█         | 4231/37963 [13:14:46<94:50:18, 10.12s/it]
 11%|█         | 4232/37963 [13:15:02<112:18:33, 11.99s/it]
 11%|█         | 4233/37963 [13:15:12<106:18:55, 11.35s/it]
 11%|█         | 4234/37963 [13:15:22<103:07:34, 11.01s/it]
 11%|█         | 4235/37963 [13:15:32<100:58:41, 10.78s/it]
 11%|█         | 4236/37963 [13:15:42<99:13:32, 10.59s/it] 
 11%|█         | 4237/37963 [13:15:52<97:38:54, 10.42s/it]
 11%|█         | 4238/37963 [13:16:02<96:34:19, 10.31s/it]
 11%|█         | 4239/37963 [13:16:13<95:56:28, 10.24s/it]
 11%|█         | 4240/37963 [13:16:22<94:08:45, 10.05s/it]
                                                          
{'loss': '0.1744', 'grad_norm': '3.532', 'learning_rate': '1.965e-05', 'epoch': '0.1117'}

 11%|█         | 4240/37963 [13:16:22<94:08:45, 10.05s/it]
 11%|█         | 4241/37963 [13:16:39<112:14:58, 11.98s/it]
 11%|█         | 4242/37963 [13:16:49<106:47:41, 11.40s/it]
 11%|█         | 4243/37963 [13:16:59<102:22:34, 10.93s/it]
 11%|█         | 4244/37963 [13:17:09<99:52:45, 10.66s/it] 
 11%|█         | 4245/37963 [13:17:25<116:18:41, 12.42s/it]
 11%|█         | 4246/37963 [13:17:44<135:50:34, 14.50s/it]
 11%|█         | 4247/37963 [13:17:55<123:40:16, 13.20s/it]
 11%|█         | 4248/37963 [13:18:05<115:01:33, 12.28s/it]
 11%|█         | 4249/37963 [13:18:15<109:05:54, 11.65s/it]
 11%|█         | 4250/37963 [13:18:25<104:40:34, 11.18s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '2.859', 'learning_rate': '1.965e-05', 'epoch': '0.112'}

 11%|█         | 4250/37963 [13:18:25<104:40:34, 11.18s/it]
 11%|█         | 4251/37963 [13:18:35<101:28:57, 10.84s/it]
 11%|█         | 4252/37963 [13:18:52<117:30:10, 12.55s/it]
 11%|█         | 4253/37963 [13:19:01<110:02:13, 11.75s/it]
 11%|█         | 4254/37963 [13:19:12<105:30:52, 11.27s/it]
 11%|█         | 4255/37963 [13:19:28<120:35:00, 12.88s/it]
 11%|█         | 4256/37963 [13:19:38<112:14:48, 11.99s/it]
 11%|█         | 4257/37963 [13:19:48<106:47:41, 11.41s/it]
 11%|█         | 4258/37963 [13:20:05<121:08:56, 12.94s/it]
 11%|█         | 4259/37963 [13:20:15<113:12:02, 12.09s/it]
 11%|█         | 4260/37963 [13:20:25<106:48:50, 11.41s/it]
                                                           
{'loss': '0.1679', 'grad_norm': '2.436', 'learning_rate': '1.965e-05', 'epoch': '0.1122'}

 11%|█         | 4260/37963 [13:20:25<106:48:50, 11.41s/it]
 11%|█         | 4261/37963 [13:20:35<102:30:13, 10.95s/it]
 11%|█         | 4262/37963 [13:20:45<100:07:24, 10.70s/it]
 11%|█         | 4263/37963 [13:20:55<98:43:02, 10.55s/it] 
 11%|█         | 4264/37963 [13:21:05<96:30:35, 10.31s/it]
 11%|█         | 4265/37963 [13:21:15<96:01:13, 10.26s/it]
 11%|█         | 4266/37963 [13:21:25<95:06:50, 10.16s/it]
 11%|█         | 4267/37963 [13:21:35<94:28:44, 10.09s/it]
 11%|█         | 4268/37963 [13:21:44<93:37:27, 10.00s/it]
 11%|█         | 4269/37963 [13:21:54<93:07:44,  9.95s/it]
 11%|█         | 4270/37963 [13:22:10<110:42:02, 11.83s/it]
                                                           
{'loss': '0.1775', 'grad_norm': '1.656', 'learning_rate': '1.965e-05', 'epoch': '0.1125'}

 11%|█         | 4270/37963 [13:22:10<110:42:02, 11.83s/it]
 11%|█▏        | 4271/37963 [13:22:20<104:37:18, 11.18s/it]
 11%|█▏        | 4272/37963 [13:22:30<101:09:17, 10.81s/it]
 11%|█▏        | 4273/37963 [13:22:40<98:01:42, 10.48s/it] 
 11%|█▏        | 4274/37963 [13:22:50<97:02:33, 10.37s/it]
 11%|█▏        | 4275/37963 [13:23:00<96:32:19, 10.32s/it]
 11%|█▏        | 4276/37963 [13:23:10<95:50:59, 10.24s/it]
 11%|█▏        | 4277/37963 [13:23:20<95:24:43, 10.20s/it]
 11%|█▏        | 4278/37963 [13:23:30<93:54:44, 10.04s/it]
 11%|█▏        | 4279/37963 [13:23:46<111:12:52, 11.89s/it]
 11%|█▏        | 4280/37963 [13:23:56<105:30:41, 11.28s/it]
                                                           
{'loss': '0.1774', 'grad_norm': '5.259', 'learning_rate': '1.964e-05', 'epoch': '0.1127'}

 11%|█▏        | 4280/37963 [13:23:56<105:30:41, 11.28s/it]
 11%|█▏        | 4281/37963 [13:24:06<101:25:03, 10.84s/it]
 11%|█▏        | 4282/37963 [13:24:16<99:07:29, 10.59s/it] 
 11%|█▏        | 4283/37963 [13:24:26<98:15:11, 10.50s/it]
 11%|█▏        | 4284/37963 [13:24:36<97:32:14, 10.43s/it]
 11%|█▏        | 4285/37963 [13:24:46<96:38:52, 10.33s/it]
 11%|█▏        | 4286/37963 [13:24:57<96:13:30, 10.29s/it]
 11%|█▏        | 4287/37963 [13:25:07<95:47:05, 10.24s/it]
 11%|█▏        | 4288/37963 [13:25:17<95:30:20, 10.21s/it]
 11%|█▏        | 4289/37963 [13:25:27<95:18:45, 10.19s/it]
 11%|█▏        | 4290/37963 [13:25:43<112:47:37, 12.06s/it]
                                                           
{'loss': '0.1762', 'grad_norm': '4.174', 'learning_rate': '1.964e-05', 'epoch': '0.113'}

 11%|█▏        | 4290/37963 [13:25:43<112:47:37, 12.06s/it]
 11%|█▏        | 4291/37963 [13:25:53<107:01:48, 11.44s/it]
 11%|█▏        | 4292/37963 [13:26:10<121:07:56, 12.95s/it]
 11%|█▏        | 4293/37963 [13:26:29<138:56:09, 14.86s/it]
 11%|█▏        | 4294/37963 [13:26:39<126:04:11, 13.48s/it]
 11%|█▏        | 4295/37963 [13:26:49<115:48:51, 12.38s/it]
 11%|█▏        | 4296/37963 [13:26:59<109:19:13, 11.69s/it]
 11%|█▏        | 4297/37963 [13:27:10<104:59:03, 11.23s/it]
 11%|█▏        | 4298/37963 [13:27:19<100:24:04, 10.74s/it]
 11%|█▏        | 4299/37963 [13:27:29<98:44:03, 10.56s/it] 
 11%|█▏        | 4300/37963 [13:27:39<97:43:16, 10.45s/it]
                                                          
{'loss': '0.1546', 'grad_norm': '1.512', 'learning_rate': '1.964e-05', 'epoch': '0.1133'}

 11%|█▏        | 4300/37963 [13:27:39<97:43:16, 10.45s/it]
 11%|█▏        | 4301/37963 [13:27:56<115:02:00, 12.30s/it]
 11%|█▏        | 4302/37963 [13:28:12<125:52:03, 13.46s/it]
 11%|█▏        | 4303/37963 [13:28:22<116:31:12, 12.46s/it]
 11%|█▏        | 4304/37963 [13:28:32<109:42:28, 11.73s/it]
 11%|█▏        | 4305/37963 [13:28:42<104:59:11, 11.23s/it]
 11%|█▏        | 4306/37963 [13:28:52<100:49:32, 10.78s/it]
 11%|█▏        | 4307/37963 [13:29:02<98:58:14, 10.59s/it] 
 11%|█▏        | 4308/37963 [13:29:19<115:55:39, 12.40s/it]
 11%|█▏        | 4309/37963 [13:29:29<109:15:35, 11.69s/it]
 11%|█▏        | 4310/37963 [13:29:39<104:57:48, 11.23s/it]
                                                           
{'loss': '0.175', 'grad_norm': '3.977', 'learning_rate': '1.964e-05', 'epoch': '0.1135'}

 11%|█▏        | 4310/37963 [13:29:39<104:57:48, 11.23s/it]
 11%|█▏        | 4311/37963 [13:29:49<101:45:32, 10.89s/it]
 11%|█▏        | 4312/37963 [13:29:59<99:29:56, 10.64s/it] 
 11%|█▏        | 4313/37963 [13:30:09<97:54:39, 10.47s/it]
 11%|█▏        | 4314/37963 [13:30:19<96:37:41, 10.34s/it]
 11%|█▏        | 4315/37963 [13:30:30<95:59:11, 10.27s/it]
 11%|█▏        | 4316/37963 [13:30:40<95:30:39, 10.22s/it]
 11%|█▏        | 4317/37963 [13:30:50<95:06:53, 10.18s/it]
 11%|█▏        | 4318/37963 [13:31:00<94:35:43, 10.12s/it]
 11%|█▏        | 4319/37963 [13:31:16<111:56:19, 11.98s/it]
 11%|█▏        | 4320/37963 [13:31:26<106:13:47, 11.37s/it]
                                                           
{'loss': '0.1725', 'grad_norm': '3.454', 'learning_rate': '1.963e-05', 'epoch': '0.1138'}

 11%|█▏        | 4320/37963 [13:31:26<106:13:47, 11.37s/it]
 11%|█▏        | 4321/37963 [13:31:36<102:50:28, 11.00s/it]
 11%|█▏        | 4322/37963 [13:31:46<100:21:36, 10.74s/it]
 11%|█▏        | 4323/37963 [13:31:56<98:24:16, 10.53s/it] 
 11%|█▏        | 4324/37963 [13:32:06<97:05:02, 10.39s/it]
 11%|█▏        | 4325/37963 [13:32:16<96:13:28, 10.30s/it]
 11%|█▏        | 4326/37963 [13:32:27<95:48:28, 10.25s/it]
 11%|█▏        | 4327/37963 [13:32:36<94:22:39, 10.10s/it]
 11%|█▏        | 4328/37963 [13:32:46<94:17:47, 10.09s/it]
 11%|█▏        | 4329/37963 [13:33:03<112:47:56, 12.07s/it]
 11%|█▏        | 4330/37963 [13:33:13<107:22:51, 11.49s/it]
                                                           
{'loss': '0.1761', 'grad_norm': '1.888', 'learning_rate': '1.963e-05', 'epoch': '0.1141'}

 11%|█▏        | 4330/37963 [13:33:13<107:22:51, 11.49s/it]
 11%|█▏        | 4331/37963 [13:33:23<103:35:04, 11.09s/it]
 11%|█▏        | 4332/37963 [13:33:33<100:44:28, 10.78s/it]
 11%|█▏        | 4333/37963 [13:33:44<98:47:38, 10.58s/it] 
 11%|█▏        | 4334/37963 [13:33:54<97:21:53, 10.42s/it]
 11%|█▏        | 4335/37963 [13:34:03<95:45:18, 10.25s/it]
 11%|█▏        | 4336/37963 [13:34:14<95:35:02, 10.23s/it]
 11%|█▏        | 4337/37963 [13:34:30<113:14:57, 12.12s/it]
 11%|█▏        | 4338/37963 [13:34:40<107:46:49, 11.54s/it]
 11%|█▏        | 4339/37963 [13:34:51<104:16:29, 11.16s/it]
 11%|█▏        | 4340/37963 [13:35:01<101:20:10, 10.85s/it]
                                                           
{'loss': '0.1762', 'grad_norm': '3.39', 'learning_rate': '1.963e-05', 'epoch': '0.1143'}

 11%|█▏        | 4340/37963 [13:35:01<101:20:10, 10.85s/it]
 11%|█▏        | 4341/37963 [13:35:11<99:44:57, 10.68s/it] 
 11%|█▏        | 4342/37963 [13:35:30<123:57:27, 13.27s/it]
 11%|█▏        | 4343/37963 [13:35:40<115:07:33, 12.33s/it]
 11%|█▏        | 4344/37963 [13:35:50<107:27:28, 11.51s/it]
 11%|█▏        | 4345/37963 [13:36:00<103:51:05, 11.12s/it]
 11%|█▏        | 4346/37963 [13:36:10<100:04:44, 10.72s/it]
 11%|█▏        | 4347/37963 [13:36:20<98:14:46, 10.52s/it] 
 11%|█▏        | 4348/37963 [13:36:30<96:49:43, 10.37s/it]
 11%|█▏        | 4349/37963 [13:36:46<113:10:57, 12.12s/it]
 11%|█▏        | 4350/37963 [13:36:57<107:54:11, 11.56s/it]
                                                           
{'loss': '0.1819', 'grad_norm': '3.196', 'learning_rate': '1.963e-05', 'epoch': '0.1146'}

 11%|█▏        | 4350/37963 [13:36:57<107:54:11, 11.56s/it]
 11%|█▏        | 4351/37963 [13:37:07<103:59:40, 11.14s/it]
 11%|█▏        | 4352/37963 [13:37:16<99:35:30, 10.67s/it] 
 11%|█▏        | 4353/37963 [13:37:33<116:15:48, 12.45s/it]
 11%|█▏        | 4354/37963 [13:37:43<109:46:51, 11.76s/it]
 11%|█▏        | 4355/37963 [13:37:53<105:09:56, 11.27s/it]
 11%|█▏        | 4356/37963 [13:38:03<101:04:34, 10.83s/it]
 11%|█▏        | 4357/37963 [13:38:19<115:39:22, 12.39s/it]
 11%|█▏        | 4358/37963 [13:38:29<109:13:32, 11.70s/it]
 11%|█▏        | 4359/37963 [13:38:39<104:40:38, 11.21s/it]
 11%|█▏        | 4360/37963 [13:38:49<101:43:29, 10.90s/it]
                                                           
{'loss': '0.1744', 'grad_norm': '3.845', 'learning_rate': '1.963e-05', 'epoch': '0.1148'}

 11%|█▏        | 4360/37963 [13:38:49<101:43:29, 10.90s/it]
 11%|█▏        | 4361/37963 [13:38:59<99:09:26, 10.62s/it] 
 11%|█▏        | 4362/37963 [13:39:09<97:23:00, 10.43s/it]
 11%|█▏        | 4363/37963 [13:39:20<97:05:00, 10.40s/it]
 11%|█▏        | 4364/37963 [13:39:30<96:29:13, 10.34s/it]
 11%|█▏        | 4365/37963 [13:39:40<95:58:34, 10.28s/it]
 12%|█▏        | 4366/37963 [13:39:50<95:37:45, 10.25s/it]
 12%|█▏        | 4367/37963 [13:40:07<113:06:24, 12.12s/it]
 12%|█▏        | 4368/37963 [13:40:17<107:21:24, 11.50s/it]
 12%|█▏        | 4369/37963 [13:40:27<103:20:31, 11.07s/it]
 12%|█▏        | 4370/37963 [13:40:37<101:15:20, 10.85s/it]
                                                           
{'loss': '0.1809', 'grad_norm': '6.795', 'learning_rate': '1.962e-05', 'epoch': '0.1151'}

 12%|█▏        | 4370/37963 [13:40:37<101:15:20, 10.85s/it]
 12%|█▏        | 4371/37963 [13:40:47<99:11:17, 10.63s/it] 
 12%|█▏        | 4372/37963 [13:40:57<97:50:17, 10.49s/it]
 12%|█▏        | 4373/37963 [13:41:08<96:52:08, 10.38s/it]
 12%|█▏        | 4374/37963 [13:41:18<96:40:26, 10.36s/it]
 12%|█▏        | 4375/37963 [13:41:28<95:39:14, 10.25s/it]
 12%|█▏        | 4376/37963 [13:41:38<95:18:59, 10.22s/it]
 12%|█▏        | 4377/37963 [13:41:48<94:28:39, 10.13s/it]
 12%|█▏        | 4378/37963 [13:42:05<112:56:10, 12.11s/it]
 12%|█▏        | 4379/37963 [13:42:15<107:19:45, 11.51s/it]
 12%|█▏        | 4380/37963 [13:42:25<103:41:17, 11.12s/it]
                                                           
{'loss': '0.1868', 'grad_norm': '3.198', 'learning_rate': '1.962e-05', 'epoch': '0.1154'}

 12%|█▏        | 4380/37963 [13:42:25<103:41:17, 11.12s/it]
 12%|█▏        | 4381/37963 [13:42:35<100:53:06, 10.81s/it]
 12%|█▏        | 4382/37963 [13:42:45<98:47:17, 10.59s/it] 
 12%|█▏        | 4383/37963 [13:42:55<97:42:50, 10.48s/it]
 12%|█▏        | 4384/37963 [13:43:05<95:31:45, 10.24s/it]
 12%|█▏        | 4385/37963 [13:43:15<95:12:59, 10.21s/it]
 12%|█▏        | 4386/37963 [13:43:32<112:44:34, 12.09s/it]
 12%|█▏        | 4387/37963 [13:43:42<107:31:00, 11.53s/it]
 12%|█▏        | 4388/37963 [13:43:52<103:06:42, 11.06s/it]
 12%|█▏        | 4389/37963 [13:44:02<100:16:48, 10.75s/it]
 12%|█▏        | 4390/37963 [13:44:12<98:33:14, 10.57s/it] 
                                                          
{'loss': '0.1599', 'grad_norm': '2.114', 'learning_rate': '1.962e-05', 'epoch': '0.1156'}

 12%|█▏        | 4390/37963 [13:44:12<98:33:14, 10.57s/it]
 12%|█▏        | 4391/37963 [13:44:37<139:49:01, 14.99s/it]
 12%|█▏        | 4392/37963 [13:44:47<126:22:12, 13.55s/it]
 12%|█▏        | 4393/37963 [13:44:57<116:05:23, 12.45s/it]
 12%|█▏        | 4394/37963 [13:45:08<109:39:41, 11.76s/it]
 12%|█▏        | 4395/37963 [13:45:18<105:17:26, 11.29s/it]
 12%|█▏        | 4396/37963 [13:45:28<101:24:46, 10.88s/it]
 12%|█▏        | 4397/37963 [13:45:38<99:15:42, 10.65s/it] 
 12%|█▏        | 4398/37963 [13:45:55<116:29:38, 12.49s/it]
 12%|█▏        | 4399/37963 [13:46:05<109:22:27, 11.73s/it]
 12%|█▏        | 4400/37963 [13:46:15<104:43:52, 11.23s/it]
                                                           
{'loss': '1.875', 'grad_norm': '83.33', 'learning_rate': '1.962e-05', 'epoch': '0.1159'}

 12%|█▏        | 4400/37963 [13:46:15<104:43:52, 11.23s/it]
 12%|█▏        | 4401/37963 [13:46:25<101:41:20, 10.91s/it]
 12%|█▏        | 4402/37963 [13:46:35<99:37:21, 10.69s/it] 
 12%|█▏        | 4403/37963 [13:46:52<116:51:28, 12.54s/it]
 12%|█▏        | 4404/37963 [13:47:08<128:00:41, 13.73s/it]
 12%|█▏        | 4405/37963 [13:47:18<118:09:41, 12.68s/it]
 12%|█▏        | 4406/37963 [13:47:29<110:48:25, 11.89s/it]
 12%|█▏        | 4407/37963 [13:47:38<105:26:35, 11.31s/it]
 12%|█▏        | 4408/37963 [13:47:49<102:10:49, 10.96s/it]
 12%|█▏        | 4409/37963 [13:47:59<99:42:28, 10.70s/it] 
 12%|█▏        | 4410/37963 [13:48:09<98:21:30, 10.55s/it]
                                                          
{'loss': '0.2996', 'grad_norm': '5.212', 'learning_rate': '1.961e-05', 'epoch': '0.1162'}

 12%|█▏        | 4410/37963 [13:48:09<98:21:30, 10.55s/it]
 12%|█▏        | 4411/37963 [13:48:19<96:14:29, 10.33s/it]
 12%|█▏        | 4412/37963 [13:48:29<95:51:52, 10.29s/it]
 12%|█▏        | 4413/37963 [13:48:39<95:14:28, 10.22s/it]
 12%|█▏        | 4414/37963 [13:48:56<113:03:23, 12.13s/it]
 12%|█▏        | 4415/37963 [13:49:05<106:49:33, 11.46s/it]
 12%|█▏        | 4416/37963 [13:49:16<102:51:08, 11.04s/it]
 12%|█▏        | 4417/37963 [13:49:26<100:05:43, 10.74s/it]
 12%|█▏        | 4418/37963 [13:49:35<97:29:49, 10.46s/it] 
 12%|█▏        | 4419/37963 [13:49:45<96:19:10, 10.34s/it]
 12%|█▏        | 4420/37963 [13:49:56<95:48:29, 10.28s/it]
                                                          
{'loss': '1.83', 'grad_norm': '56.68', 'learning_rate': '1.961e-05', 'epoch': '0.1164'}

 12%|█▏        | 4420/37963 [13:49:56<95:48:29, 10.28s/it]
 12%|█▏        | 4421/37963 [13:50:06<95:09:55, 10.21s/it]
 12%|█▏        | 4422/37963 [13:50:16<94:56:58, 10.19s/it]
 12%|█▏        | 4423/37963 [13:50:26<94:44:20, 10.17s/it]
 12%|█▏        | 4424/37963 [13:50:36<93:47:54, 10.07s/it]
 12%|█▏        | 4425/37963 [13:50:46<93:45:56, 10.06s/it]
 12%|█▏        | 4426/37963 [13:50:56<94:17:50, 10.12s/it]
 12%|█▏        | 4427/37963 [13:51:12<110:42:31, 11.88s/it]
 12%|█▏        | 4428/37963 [13:51:22<105:55:36, 11.37s/it]
 12%|█▏        | 4429/37963 [13:51:32<102:43:34, 11.03s/it]
 12%|█▏        | 4430/37963 [13:51:42<99:42:19, 10.70s/it] 
                                                          
{'loss': '0.757', 'grad_norm': '3.81', 'learning_rate': '1.961e-05', 'epoch': '0.1167'}

 12%|█▏        | 4430/37963 [13:51:42<99:42:19, 10.70s/it]
 12%|█▏        | 4431/37963 [13:51:53<98:11:10, 10.54s/it]
 12%|█▏        | 4432/37963 [13:52:03<96:59:22, 10.41s/it]
 12%|█▏        | 4433/37963 [13:52:13<96:05:58, 10.32s/it]
 12%|█▏        | 4434/37963 [13:52:23<95:44:20, 10.28s/it]
 12%|█▏        | 4435/37963 [13:52:39<112:45:16, 12.11s/it]
 12%|█▏        | 4436/37963 [13:52:49<107:20:39, 11.53s/it]
 12%|█▏        | 4437/37963 [13:53:00<103:18:34, 11.09s/it]
 12%|█▏        | 4438/37963 [13:53:10<100:41:47, 10.81s/it]
 12%|█▏        | 4439/37963 [13:53:29<124:14:10, 13.34s/it]
 12%|█▏        | 4440/37963 [13:53:45<131:54:35, 14.17s/it]
                                                           
{'loss': '0.2508', 'grad_norm': '7.275', 'learning_rate': '1.961e-05', 'epoch': '0.117'}

 12%|█▏        | 4440/37963 [13:53:45<131:54:35, 14.17s/it]
 12%|█▏        | 4441/37963 [13:53:55<120:46:01, 12.97s/it]
 12%|█▏        | 4442/37963 [13:54:05<112:32:00, 12.09s/it]
 12%|█▏        | 4443/37963 [13:54:15<107:01:28, 11.49s/it]
 12%|█▏        | 4444/37963 [13:54:25<102:26:57, 11.00s/it]
 12%|█▏        | 4445/37963 [13:54:35<100:06:32, 10.75s/it]
 12%|█▏        | 4446/37963 [13:54:52<116:20:00, 12.50s/it]
 12%|█▏        | 4447/37963 [13:55:02<109:35:04, 11.77s/it]
 12%|█▏        | 4448/37963 [13:55:12<104:55:25, 11.27s/it]
 12%|█▏        | 4449/37963 [13:55:29<120:33:15, 12.95s/it]
 12%|█▏        | 4450/37963 [13:55:39<112:30:38, 12.09s/it]
                                                           
{'loss': '0.2465', 'grad_norm': '2.895', 'learning_rate': '1.96e-05', 'epoch': '0.1172'}

 12%|█▏        | 4450/37963 [13:55:39<112:30:38, 12.09s/it]
 12%|█▏        | 4451/37963 [13:55:49<106:13:30, 11.41s/it]
 12%|█▏        | 4452/37963 [13:55:59<101:48:01, 10.94s/it]
 12%|█▏        | 4453/37963 [13:56:09<99:08:50, 10.65s/it] 
 12%|█▏        | 4454/37963 [13:56:19<97:28:09, 10.47s/it]
 12%|█▏        | 4455/37963 [13:56:35<114:26:58, 12.30s/it]
 12%|█▏        | 4456/37963 [13:56:45<108:09:00, 11.62s/it]
 12%|█▏        | 4457/37963 [13:56:56<103:55:49, 11.17s/it]
 12%|█▏        | 4458/37963 [13:57:06<100:55:09, 10.84s/it]
 12%|█▏        | 4459/37963 [13:57:16<98:47:22, 10.61s/it] 
 12%|█▏        | 4460/37963 [13:57:26<97:26:27, 10.47s/it]
                                                          
{'loss': '0.2501', 'grad_norm': '3.738', 'learning_rate': '1.96e-05', 'epoch': '0.1175'}

 12%|█▏        | 4460/37963 [13:57:26<97:26:27, 10.47s/it]
 12%|█▏        | 4461/37963 [13:57:42<113:54:29, 12.24s/it]
 12%|█▏        | 4462/37963 [13:57:52<108:07:06, 11.62s/it]
 12%|█▏        | 4463/37963 [13:58:02<102:29:24, 11.01s/it]
 12%|█▏        | 4464/37963 [13:58:12<99:37:24, 10.71s/it] 
 12%|█▏        | 4465/37963 [13:58:22<97:59:44, 10.53s/it]
 12%|█▏        | 4466/37963 [13:58:32<96:53:03, 10.41s/it]
 12%|█▏        | 4467/37963 [13:58:42<96:07:41, 10.33s/it]
 12%|█▏        | 4468/37963 [13:58:52<95:29:57, 10.26s/it]
 12%|█▏        | 4469/37963 [13:59:02<94:17:20, 10.13s/it]
 12%|█▏        | 4470/37963 [13:59:12<94:18:12, 10.14s/it]
                                                          
{'loss': '0.2471', 'grad_norm': '7.582', 'learning_rate': '1.96e-05', 'epoch': '0.1177'}

 12%|█▏        | 4470/37963 [13:59:12<94:18:12, 10.14s/it]
 12%|█▏        | 4471/37963 [13:59:22<93:23:50, 10.04s/it]
 12%|█▏        | 4472/37963 [13:59:32<93:43:28, 10.07s/it]
 12%|█▏        | 4473/37963 [13:59:42<93:30:08, 10.05s/it]
 12%|█▏        | 4474/37963 [13:59:53<94:03:31, 10.11s/it]
 12%|█▏        | 4475/37963 [14:00:03<94:16:19, 10.13s/it]
 12%|█▏        | 4476/37963 [14:00:13<94:04:20, 10.11s/it]
 12%|█▏        | 4477/37963 [14:00:30<112:37:20, 12.11s/it]
 12%|█▏        | 4478/37963 [14:00:40<106:58:23, 11.50s/it]
 12%|█▏        | 4479/37963 [14:00:50<102:47:55, 11.05s/it]
 12%|█▏        | 4480/37963 [14:00:59<98:48:15, 10.62s/it] 
                                                          
{'loss': '0.2365', 'grad_norm': '4.276', 'learning_rate': '1.96e-05', 'epoch': '0.118'}

 12%|█▏        | 4480/37963 [14:00:59<98:48:15, 10.62s/it]
 12%|█▏        | 4481/37963 [14:01:10<97:29:24, 10.48s/it]
 12%|█▏        | 4482/37963 [14:01:26<114:27:34, 12.31s/it]
 12%|█▏        | 4483/37963 [14:01:36<108:12:04, 11.63s/it]
 12%|█▏        | 4484/37963 [14:01:46<104:30:45, 11.24s/it]
 12%|█▏        | 4485/37963 [14:01:57<101:47:18, 10.95s/it]
 12%|█▏        | 4486/37963 [14:02:07<98:53:34, 10.63s/it] 
 12%|█▏        | 4487/37963 [14:02:17<97:31:44, 10.49s/it]
 12%|█▏        | 4488/37963 [14:02:36<121:00:15, 13.01s/it]
 12%|█▏        | 4489/37963 [14:02:46<112:44:35, 12.13s/it]
 12%|█▏        | 4490/37963 [14:02:55<105:46:49, 11.38s/it]
                                                           
{'loss': '0.245', 'grad_norm': '2.98', 'learning_rate': '1.959e-05', 'epoch': '0.1183'}

 12%|█▏        | 4490/37963 [14:02:55<105:46:49, 11.38s/it]
 12%|█▏        | 4491/37963 [14:03:12<119:40:25, 12.87s/it]
 12%|█▏        | 4492/37963 [14:03:22<111:06:16, 11.95s/it]
 12%|█▏        | 4493/37963 [14:03:37<121:51:39, 13.11s/it]
 12%|█▏        | 4494/37963 [14:03:47<113:23:13, 12.20s/it]
 12%|█▏        | 4495/37963 [14:03:57<106:42:23, 11.48s/it]
 12%|█▏        | 4496/37963 [14:04:14<120:53:05, 13.00s/it]
 12%|█▏        | 4497/37963 [14:04:24<112:49:18, 12.14s/it]
 12%|█▏        | 4498/37963 [14:04:33<105:10:34, 11.31s/it]
 12%|█▏        | 4499/37963 [14:04:43<101:53:32, 10.96s/it]
 12%|█▏        | 4500/37963 [14:04:53<99:22:42, 10.69s/it] 
                                                          
{'loss': '0.238', 'grad_norm': '0.3291', 'learning_rate': '1.959e-05', 'epoch': '0.1185'}

 12%|█▏        | 4500/37963 [14:04:53<99:22:42, 10.69s/it]
 12%|█▏        | 4501/37963 [14:05:10<115:28:15, 12.42s/it]
 12%|█▏        | 4502/37963 [14:05:20<108:59:41, 11.73s/it]
 12%|█▏        | 4503/37963 [14:05:30<104:28:44, 11.24s/it]
 12%|█▏        | 4504/37963 [14:05:40<101:17:13, 10.90s/it]
 12%|█▏        | 4505/37963 [14:05:50<97:49:26, 10.53s/it] 
 12%|█▏        | 4506/37963 [14:06:00<96:14:57, 10.36s/it]
 12%|█▏        | 4507/37963 [14:06:10<95:30:47, 10.28s/it]
 12%|█▏        | 4508/37963 [14:06:20<94:09:58, 10.13s/it]
 12%|█▏        | 4509/37963 [14:06:30<94:09:52, 10.13s/it]
 12%|█▏        | 4510/37963 [14:06:46<112:05:14, 12.06s/it]
                                                           
{'loss': '0.2155', 'grad_norm': '2.394', 'learning_rate': '1.959e-05', 'epoch': '0.1188'}

 12%|█▏        | 4510/37963 [14:06:46<112:05:14, 12.06s/it]
 12%|█▏        | 4511/37963 [14:06:57<106:35:06, 11.47s/it]
 12%|█▏        | 4512/37963 [14:07:07<103:07:00, 11.10s/it]
 12%|█▏        | 4513/37963 [14:07:17<99:46:55, 10.74s/it] 
 12%|█▏        | 4514/37963 [14:07:27<97:40:38, 10.51s/it]
 12%|█▏        | 4515/37963 [14:07:37<96:49:07, 10.42s/it]
 12%|█▏        | 4516/37963 [14:07:47<96:13:41, 10.36s/it]
 12%|█▏        | 4517/37963 [14:07:57<95:45:28, 10.31s/it]
 12%|█▏        | 4518/37963 [14:08:07<94:23:52, 10.16s/it]
 12%|█▏        | 4519/37963 [14:08:17<94:22:52, 10.16s/it]
 12%|█▏        | 4520/37963 [14:08:27<94:04:14, 10.13s/it]
                                                          
{'loss': '0.2349', 'grad_norm': '3.505', 'learning_rate': '1.959e-05', 'epoch': '0.1191'}

 12%|█▏        | 4520/37963 [14:08:27<94:04:14, 10.13s/it]
 12%|█▏        | 4521/37963 [14:08:37<94:05:09, 10.13s/it]
 12%|█▏        | 4522/37963 [14:08:48<94:02:22, 10.12s/it]
 12%|█▏        | 4523/37963 [14:09:04<111:53:11, 12.05s/it]
 12%|█▏        | 4524/37963 [14:09:14<106:20:31, 11.45s/it]
 12%|█▏        | 4525/37963 [14:09:24<103:08:40, 11.10s/it]
 12%|█▏        | 4526/37963 [14:09:34<99:25:48, 10.71s/it] 
 12%|█▏        | 4527/37963 [14:09:44<97:48:05, 10.53s/it]
 12%|█▏        | 4528/37963 [14:10:01<114:37:10, 12.34s/it]
 12%|█▏        | 4529/37963 [14:10:11<108:43:13, 11.71s/it]
 12%|█▏        | 4530/37963 [14:10:21<104:07:30, 11.21s/it]
                                                           
{'loss': '0.2345', 'grad_norm': '2.366', 'learning_rate': '1.958e-05', 'epoch': '0.1193'}

 12%|█▏        | 4530/37963 [14:10:21<104:07:30, 11.21s/it]
 12%|█▏        | 4531/37963 [14:10:31<101:04:45, 10.88s/it]
 12%|█▏        | 4532/37963 [14:10:41<99:07:04, 10.67s/it] 
 12%|█▏        | 4533/37963 [14:10:52<97:56:06, 10.55s/it]
 12%|█▏        | 4534/37963 [14:11:02<96:51:59, 10.43s/it]
 12%|█▏        | 4535/37963 [14:11:12<96:06:44, 10.35s/it]
 12%|█▏        | 4536/37963 [14:11:31<120:02:52, 12.93s/it]
 12%|█▏        | 4537/37963 [14:11:41<112:30:16, 12.12s/it]
 12%|█▏        | 4538/37963 [14:11:51<106:43:47, 11.50s/it]
 12%|█▏        | 4539/37963 [14:12:01<101:53:40, 10.97s/it]
 12%|█▏        | 4540/37963 [14:12:11<99:36:14, 10.73s/it] 
                                                          
{'loss': '0.2384', 'grad_norm': '3.05', 'learning_rate': '1.958e-05', 'epoch': '0.1196'}

 12%|█▏        | 4540/37963 [14:12:11<99:36:14, 10.73s/it]
 12%|█▏        | 4541/37963 [14:12:28<115:45:13, 12.47s/it]
 12%|█▏        | 4542/37963 [14:12:38<108:41:16, 11.71s/it]
 12%|█▏        | 4543/37963 [14:12:47<102:57:16, 11.09s/it]
 12%|█▏        | 4544/37963 [14:12:57<100:04:26, 10.78s/it]
 12%|█▏        | 4545/37963 [14:13:14<115:59:06, 12.49s/it]
 12%|█▏        | 4546/37963 [14:13:31<127:43:07, 13.76s/it]
 12%|█▏        | 4547/37963 [14:13:41<117:37:27, 12.67s/it]
 12%|█▏        | 4548/37963 [14:13:51<110:14:01, 11.88s/it]
 12%|█▏        | 4549/37963 [14:14:01<105:15:14, 11.34s/it]
 12%|█▏        | 4550/37963 [14:14:11<101:54:09, 10.98s/it]
                                                           
{'loss': '0.221', 'grad_norm': '6.306', 'learning_rate': '1.958e-05', 'epoch': '0.1199'}

 12%|█▏        | 4550/37963 [14:14:11<101:54:09, 10.98s/it]
 12%|█▏        | 4551/37963 [14:14:21<99:32:10, 10.72s/it] 
 12%|█▏        | 4552/37963 [14:14:31<97:49:49, 10.54s/it]
 12%|█▏        | 4553/37963 [14:14:48<115:26:02, 12.44s/it]
 12%|█▏        | 4554/37963 [14:14:58<109:02:40, 11.75s/it]
 12%|█▏        | 4555/37963 [14:15:08<104:07:38, 11.22s/it]
 12%|█▏        | 4556/37963 [14:15:18<101:14:31, 10.91s/it]
 12%|█▏        | 4557/37963 [14:15:28<99:00:45, 10.67s/it] 
 12%|█▏        | 4558/37963 [14:15:39<97:18:32, 10.49s/it]
 12%|█▏        | 4559/37963 [14:15:49<96:53:10, 10.44s/it]
 12%|█▏        | 4560/37963 [14:15:59<96:06:56, 10.36s/it]
                                                          
{'loss': '0.2227', 'grad_norm': '1.829', 'learning_rate': '1.958e-05', 'epoch': '0.1201'}

 12%|█▏        | 4560/37963 [14:15:59<96:06:56, 10.36s/it]
 12%|█▏        | 4561/37963 [14:16:15<113:04:47, 12.19s/it]
 12%|█▏        | 4562/37963 [14:16:26<107:19:49, 11.57s/it]
 12%|█▏        | 4563/37963 [14:16:36<103:15:42, 11.13s/it]
 12%|█▏        | 4564/37963 [14:16:46<100:28:36, 10.83s/it]
 12%|█▏        | 4565/37963 [14:16:56<97:35:56, 10.52s/it] 
 12%|█▏        | 4566/37963 [14:17:06<96:43:56, 10.43s/it]
 12%|█▏        | 4567/37963 [14:17:16<96:20:03, 10.38s/it]
 12%|█▏        | 4568/37963 [14:17:26<95:51:16, 10.33s/it]
 12%|█▏        | 4569/37963 [14:17:37<95:55:05, 10.34s/it]
 12%|█▏        | 4570/37963 [14:17:47<95:03:35, 10.25s/it]
                                                          
{'loss': '0.2291', 'grad_norm': '2.758', 'learning_rate': '1.957e-05', 'epoch': '0.1204'}

 12%|█▏        | 4570/37963 [14:17:47<95:03:35, 10.25s/it]
 12%|█▏        | 4571/37963 [14:18:03<112:31:49, 12.13s/it]
 12%|█▏        | 4572/37963 [14:18:13<106:50:10, 11.52s/it]
 12%|█▏        | 4573/37963 [14:18:23<101:13:04, 10.91s/it]
 12%|█▏        | 4574/37963 [14:18:33<98:26:11, 10.61s/it] 
 12%|█▏        | 4575/37963 [14:18:43<97:03:53, 10.47s/it]
 12%|█▏        | 4576/37963 [14:18:53<96:07:21, 10.36s/it]
 12%|█▏        | 4577/37963 [14:19:03<95:21:11, 10.28s/it]
 12%|█▏        | 4578/37963 [14:19:20<112:32:46, 12.14s/it]
 12%|█▏        | 4579/37963 [14:19:30<106:49:36, 11.52s/it]
 12%|█▏        | 4580/37963 [14:19:40<102:44:57, 11.08s/it]
                                                           
{'loss': '0.2301', 'grad_norm': '3.029', 'learning_rate': '1.957e-05', 'epoch': '0.1206'}

 12%|█▏        | 4580/37963 [14:19:40<102:44:57, 11.08s/it]
 12%|█▏        | 4581/37963 [14:19:50<100:17:14, 10.82s/it]
 12%|█▏        | 4582/37963 [14:20:00<98:04:30, 10.58s/it] 
 12%|█▏        | 4583/37963 [14:20:10<96:40:19, 10.43s/it]
 12%|█▏        | 4584/37963 [14:20:30<122:14:44, 13.18s/it]
 12%|█▏        | 4585/37963 [14:20:40<113:08:06, 12.20s/it]
 12%|█▏        | 4586/37963 [14:20:50<107:11:50, 11.56s/it]
 12%|█▏        | 4587/37963 [14:21:06<120:51:03, 13.04s/it]
 12%|█▏        | 4588/37963 [14:21:16<112:45:44, 12.16s/it]
 12%|█▏        | 4589/37963 [14:21:26<105:56:42, 11.43s/it]
 12%|█▏        | 4590/37963 [14:21:36<102:17:08, 11.03s/it]
                                                           
{'loss': '0.2168', 'grad_norm': '2.444', 'learning_rate': '1.957e-05', 'epoch': '0.1209'}

 12%|█▏        | 4590/37963 [14:21:36<102:17:08, 11.03s/it]
 12%|█▏        | 4591/37963 [14:21:46<99:39:13, 10.75s/it] 
 12%|█▏        | 4592/37963 [14:21:56<96:55:46, 10.46s/it]
 12%|█▏        | 4593/37963 [14:22:19<130:59:37, 14.13s/it]
 12%|█▏        | 4594/37963 [14:22:29<119:44:05, 12.92s/it]
 12%|█▏        | 4595/37963 [14:22:39<112:05:02, 12.09s/it]
 12%|█▏        | 4596/37963 [14:22:49<106:57:08, 11.54s/it]
 12%|█▏        | 4597/37963 [14:22:59<102:21:06, 11.04s/it]
 12%|█▏        | 4598/37963 [14:23:09<99:40:26, 10.75s/it] 
 12%|█▏        | 4599/37963 [14:23:19<98:03:58, 10.58s/it]
 12%|█▏        | 4600/37963 [14:23:29<96:56:52, 10.46s/it]
                                                          
{'loss': '0.2323', 'grad_norm': '0.9146', 'learning_rate': '1.957e-05', 'epoch': '0.1212'}

 12%|█▏        | 4600/37963 [14:23:29<96:56:52, 10.46s/it]
 12%|█▏        | 4601/37963 [14:23:40<96:26:01, 10.41s/it]
 12%|█▏        | 4602/37963 [14:23:50<95:12:12, 10.27s/it]
 12%|█▏        | 4603/37963 [14:24:06<111:48:05, 12.06s/it]
 12%|█▏        | 4604/37963 [14:24:16<106:17:27, 11.47s/it]
 12%|█▏        | 4605/37963 [14:24:26<102:26:09, 11.05s/it]
 12%|█▏        | 4606/37963 [14:24:36<99:50:02, 10.77s/it] 
 12%|█▏        | 4607/37963 [14:24:46<97:49:47, 10.56s/it]
 12%|█▏        | 4608/37963 [14:24:56<96:24:59, 10.41s/it]
 12%|█▏        | 4609/37963 [14:25:12<112:28:51, 12.14s/it]
 12%|█▏        | 4610/37963 [14:25:23<106:55:23, 11.54s/it]
                                                           
{'loss': '0.2236', 'grad_norm': '2.785', 'learning_rate': '1.956e-05', 'epoch': '0.1214'}

 12%|█▏        | 4610/37963 [14:25:23<106:55:23, 11.54s/it]
 12%|█▏        | 4611/37963 [14:25:33<102:58:36, 11.12s/it]
 12%|█▏        | 4612/37963 [14:25:43<100:12:24, 10.82s/it]
 12%|█▏        | 4613/37963 [14:25:53<98:05:33, 10.59s/it] 
 12%|█▏        | 4614/37963 [14:26:03<96:42:31, 10.44s/it]
 12%|█▏        | 4615/37963 [14:26:13<96:08:03, 10.38s/it]
 12%|█▏        | 4616/37963 [14:26:23<93:51:40, 10.13s/it]
 12%|█▏        | 4617/37963 [14:26:33<94:03:55, 10.16s/it]
 12%|█▏        | 4618/37963 [14:26:43<93:38:05, 10.11s/it]
 12%|█▏        | 4619/37963 [14:26:53<93:15:15, 10.07s/it]
 12%|█▏        | 4620/37963 [14:27:03<93:18:45, 10.07s/it]
                                                          
{'loss': '0.2157', 'grad_norm': '3.759', 'learning_rate': '1.956e-05', 'epoch': '0.1217'}

 12%|█▏        | 4620/37963 [14:27:03<93:18:45, 10.07s/it]
 12%|█▏        | 4621/37963 [14:27:13<93:23:50, 10.08s/it]
 12%|█▏        | 4622/37963 [14:27:30<111:07:18, 12.00s/it]
 12%|█▏        | 4623/37963 [14:27:40<105:51:50, 11.43s/it]
 12%|█▏        | 4624/37963 [14:27:50<102:22:17, 11.05s/it]
 12%|█▏        | 4625/37963 [14:28:07<117:51:06, 12.73s/it]
 12%|█▏        | 4626/37963 [14:28:16<109:37:55, 11.84s/it]
 12%|█▏        | 4627/37963 [14:28:26<104:55:04, 11.33s/it]
 12%|█▏        | 4628/37963 [14:28:37<101:46:01, 10.99s/it]
 12%|█▏        | 4629/37963 [14:28:46<98:00:23, 10.58s/it] 
 12%|█▏        | 4630/37963 [14:28:56<96:49:14, 10.46s/it]
                                                          
{'loss': '0.2127', 'grad_norm': '3.713', 'learning_rate': '1.956e-05', 'epoch': '0.122'}

 12%|█▏        | 4630/37963 [14:28:56<96:49:14, 10.46s/it]
 12%|█▏        | 4631/37963 [14:29:07<96:26:30, 10.42s/it]
 12%|█▏        | 4632/37963 [14:29:26<121:54:37, 13.17s/it]
 12%|█▏        | 4633/37963 [14:29:37<113:36:50, 12.27s/it]
 12%|█▏        | 4634/37963 [14:29:47<107:34:02, 11.62s/it]
 12%|█▏        | 4635/37963 [14:29:57<103:16:16, 11.16s/it]
 12%|█▏        | 4636/37963 [14:30:13<118:00:15, 12.75s/it]
 12%|█▏        | 4637/37963 [14:30:23<110:29:02, 11.93s/it]
 12%|█▏        | 4638/37963 [14:30:33<105:22:24, 11.38s/it]
 12%|█▏        | 4639/37963 [14:30:43<101:39:25, 10.98s/it]
 12%|█▏        | 4640/37963 [14:31:00<117:10:10, 12.66s/it]
                                                           
{'loss': '0.1986', 'grad_norm': '2.182', 'learning_rate': '1.956e-05', 'epoch': '0.1222'}

 12%|█▏        | 4640/37963 [14:31:00<117:10:10, 12.66s/it]
 12%|█▏        | 4641/37963 [14:31:10<109:20:38, 11.81s/it]
 12%|█▏        | 4642/37963 [14:31:20<103:39:26, 11.20s/it]
 12%|█▏        | 4643/37963 [14:31:30<100:30:22, 10.86s/it]
 12%|█▏        | 4644/37963 [14:31:40<98:17:14, 10.62s/it] 
 12%|█▏        | 4645/37963 [14:31:50<96:49:48, 10.46s/it]
 12%|█▏        | 4646/37963 [14:32:00<95:52:14, 10.36s/it]
 12%|█▏        | 4647/37963 [14:32:10<95:03:04, 10.27s/it]
 12%|█▏        | 4648/37963 [14:32:20<94:44:13, 10.24s/it]
 12%|█▏        | 4649/37963 [14:32:30<94:13:44, 10.18s/it]
 12%|█▏        | 4650/37963 [14:32:47<112:04:28, 12.11s/it]
                                                           
{'loss': '0.2011', 'grad_norm': '9.184', 'learning_rate': '1.955e-05', 'epoch': '0.1225'}

 12%|█▏        | 4650/37963 [14:32:47<112:04:28, 12.11s/it]
 12%|█▏        | 4651/37963 [14:32:57<106:22:41, 11.50s/it]
 12%|█▏        | 4652/37963 [14:33:07<102:22:03, 11.06s/it]
 12%|█▏        | 4653/37963 [14:33:17<99:32:59, 10.76s/it] 
 12%|█▏        | 4654/37963 [14:33:27<96:42:34, 10.45s/it]
 12%|█▏        | 4655/37963 [14:33:37<95:56:58, 10.37s/it]
 12%|█▏        | 4656/37963 [14:33:47<95:26:26, 10.32s/it]
 12%|█▏        | 4657/37963 [14:33:57<94:45:34, 10.24s/it]
 12%|█▏        | 4658/37963 [14:34:07<94:26:16, 10.21s/it]
 12%|█▏        | 4659/37963 [14:34:17<94:06:58, 10.17s/it]
 12%|█▏        | 4660/37963 [14:34:34<111:53:02, 12.09s/it]
                                                           
{'loss': '0.2228', 'grad_norm': '1.634', 'learning_rate': '1.955e-05', 'epoch': '0.1228'}

 12%|█▏        | 4660/37963 [14:34:34<111:53:02, 12.09s/it]
 12%|█▏        | 4661/37963 [14:34:44<106:32:26, 11.52s/it]
 12%|█▏        | 4662/37963 [14:34:54<102:46:11, 11.11s/it]
 12%|█▏        | 4663/37963 [14:35:04<100:16:08, 10.84s/it]
 12%|█▏        | 4664/37963 [14:35:15<98:15:48, 10.62s/it] 
 12%|█▏        | 4665/37963 [14:35:25<96:49:23, 10.47s/it]
 12%|█▏        | 4666/37963 [14:35:35<95:46:47, 10.36s/it]
 12%|█▏        | 4667/37963 [14:35:45<94:30:57, 10.22s/it]
 12%|█▏        | 4668/37963 [14:35:55<94:16:37, 10.19s/it]
 12%|█▏        | 4669/37963 [14:36:05<94:10:14, 10.18s/it]
 12%|█▏        | 4670/37963 [14:36:15<93:43:41, 10.13s/it]
                                                          
{'loss': '0.218', 'grad_norm': '1.404', 'learning_rate': '1.955e-05', 'epoch': '0.123'}

 12%|█▏        | 4670/37963 [14:36:15<93:43:41, 10.13s/it]
 12%|█▏        | 4671/37963 [14:36:31<110:55:56, 12.00s/it]
 12%|█▏        | 4672/37963 [14:36:42<106:10:04, 11.48s/it]
 12%|█▏        | 4673/37963 [14:36:52<102:39:05, 11.10s/it]
 12%|█▏        | 4674/37963 [14:37:08<117:44:01, 12.73s/it]
 12%|█▏        | 4675/37963 [14:37:19<110:40:25, 11.97s/it]
 12%|█▏        | 4676/37963 [14:37:28<104:50:50, 11.34s/it]
 12%|█▏        | 4677/37963 [14:37:39<101:39:03, 10.99s/it]
 12%|█▏        | 4678/37963 [14:37:49<99:14:38, 10.73s/it] 
 12%|█▏        | 4679/37963 [14:37:59<97:30:02, 10.55s/it]
 12%|█▏        | 4680/37963 [14:38:17<118:25:46, 12.81s/it]
                                                           
{'loss': '0.1993', 'grad_norm': '4.01', 'learning_rate': '1.955e-05', 'epoch': '0.1233'}

 12%|█▏        | 4680/37963 [14:38:17<118:25:46, 12.81s/it]
 12%|█▏        | 4681/37963 [14:38:27<111:26:19, 12.05s/it]
 12%|█▏        | 4682/37963 [14:38:37<105:38:11, 11.43s/it]
 12%|█▏        | 4683/37963 [14:38:47<101:58:54, 11.03s/it]
 12%|█▏        | 4684/37963 [14:38:58<99:59:06, 10.82s/it] 
 12%|█▏        | 4685/37963 [14:39:14<115:35:09, 12.50s/it]
 12%|█▏        | 4686/37963 [14:39:24<108:03:30, 11.69s/it]
 12%|█▏        | 4687/37963 [14:39:41<121:55:19, 13.19s/it]
 12%|█▏        | 4688/37963 [14:39:50<112:43:44, 12.20s/it]
 12%|█▏        | 4689/37963 [14:40:07<125:01:07, 13.53s/it]
 12%|█▏        | 4690/37963 [14:40:17<115:40:10, 12.51s/it]
                                                           
{'loss': '0.1999', 'grad_norm': '3.614', 'learning_rate': '1.954e-05', 'epoch': '0.1235'}

 12%|█▏        | 4690/37963 [14:40:17<115:40:10, 12.51s/it]
 12%|█▏        | 4691/37963 [14:40:27<109:10:41, 11.81s/it]
 12%|█▏        | 4692/37963 [14:40:37<104:11:30, 11.27s/it]
 12%|█▏        | 4693/37963 [14:40:47<100:39:44, 10.89s/it]
 12%|█▏        | 4694/37963 [14:40:57<98:27:00, 10.65s/it] 
 12%|█▏        | 4695/37963 [14:41:08<96:58:49, 10.49s/it]
 12%|█▏        | 4696/37963 [14:41:17<95:20:49, 10.32s/it]
 12%|█▏        | 4697/37963 [14:41:28<94:35:00, 10.24s/it]
 12%|█▏        | 4698/37963 [14:41:37<92:29:56, 10.01s/it]
 12%|█▏        | 4699/37963 [14:41:47<92:16:34,  9.99s/it]
 12%|█▏        | 4700/37963 [14:42:04<110:47:16, 11.99s/it]
                                                           
{'loss': '0.193', 'grad_norm': '1.712', 'learning_rate': '1.954e-05', 'epoch': '0.1238'}

 12%|█▏        | 4700/37963 [14:42:04<110:47:16, 11.99s/it]
 12%|█▏        | 4701/37963 [14:42:14<106:04:41, 11.48s/it]
 12%|█▏        | 4702/37963 [14:42:24<102:42:43, 11.12s/it]
 12%|█▏        | 4703/37963 [14:42:34<99:01:39, 10.72s/it] 
 12%|█▏        | 4704/37963 [14:42:44<97:33:48, 10.56s/it]
 12%|█▏        | 4705/37963 [14:42:54<96:32:31, 10.45s/it]
 12%|█▏        | 4706/37963 [14:43:04<95:05:47, 10.29s/it]
 12%|█▏        | 4707/37963 [14:43:14<94:36:15, 10.24s/it]
 12%|█▏        | 4708/37963 [14:43:24<94:08:04, 10.19s/it]
 12%|█▏        | 4709/37963 [14:43:35<94:03:35, 10.18s/it]
 12%|█▏        | 4710/37963 [14:43:51<112:21:59, 12.16s/it]
                                                           
{'loss': '0.2162', 'grad_norm': '3.74', 'learning_rate': '1.954e-05', 'epoch': '0.1241'}

 12%|█▏        | 4710/37963 [14:43:51<112:21:59, 12.16s/it]
 12%|█▏        | 4711/37963 [14:44:02<106:39:55, 11.55s/it]
 12%|█▏        | 4712/37963 [14:44:12<103:16:49, 11.18s/it]
 12%|█▏        | 4713/37963 [14:44:22<100:28:36, 10.88s/it]
 12%|█▏        | 4714/37963 [14:44:32<96:51:08, 10.49s/it] 
 12%|█▏        | 4715/37963 [14:44:42<95:46:24, 10.37s/it]
 12%|█▏        | 4716/37963 [14:44:52<94:18:03, 10.21s/it]
 12%|█▏        | 4717/37963 [14:45:02<93:57:38, 10.17s/it]
 12%|█▏        | 4718/37963 [14:45:11<92:34:05, 10.02s/it]
 12%|█▏        | 4719/37963 [14:45:28<110:01:27, 11.91s/it]
 12%|█▏        | 4720/37963 [14:45:38<104:43:06, 11.34s/it]
                                                           
{'loss': '0.2149', 'grad_norm': '5.014', 'learning_rate': '1.954e-05', 'epoch': '0.1243'}

 12%|█▏        | 4720/37963 [14:45:38<104:43:06, 11.34s/it]
 12%|█▏        | 4721/37963 [14:45:48<101:10:40, 10.96s/it]
 12%|█▏        | 4722/37963 [14:45:58<98:56:19, 10.72s/it] 
 12%|█▏        | 4723/37963 [14:46:14<114:42:55, 12.42s/it]
 12%|█▏        | 4724/37963 [14:46:24<108:26:49, 11.75s/it]
 12%|█▏        | 4725/37963 [14:46:35<104:24:15, 11.31s/it]
 12%|█▏        | 4726/37963 [14:46:45<101:18:58, 10.97s/it]
 12%|█▏        | 4727/37963 [14:46:55<99:09:29, 10.74s/it] 
 12%|█▏        | 4728/37963 [14:47:05<97:46:03, 10.59s/it]
 12%|█▏        | 4729/37963 [14:47:23<117:16:19, 12.70s/it]
 12%|█▏        | 4730/37963 [14:47:39<126:21:56, 13.69s/it]
                                                           
{'loss': '0.1992', 'grad_norm': '1.246', 'learning_rate': '1.953e-05', 'epoch': '0.1246'}

 12%|█▏        | 4730/37963 [14:47:39<126:21:56, 13.69s/it]
 12%|█▏        | 4731/37963 [14:47:49<116:16:12, 12.60s/it]
 12%|█▏        | 4732/37963 [14:47:59<109:25:13, 11.85s/it]
 12%|█▏        | 4733/37963 [14:48:16<122:24:58, 13.26s/it]
 12%|█▏        | 4734/37963 [14:48:26<114:08:09, 12.37s/it]
 12%|█▏        | 4735/37963 [14:48:36<107:37:26, 11.66s/it]
 12%|█▏        | 4736/37963 [14:48:46<102:56:59, 11.15s/it]
 12%|█▏        | 4737/37963 [14:49:02<117:22:40, 12.72s/it]
 12%|█▏        | 4738/37963 [14:49:12<109:45:30, 11.89s/it]
 12%|█▏        | 4739/37963 [14:49:22<104:34:56, 11.33s/it]
 12%|█▏        | 4740/37963 [14:49:32<100:56:35, 10.94s/it]
                                                           
{'loss': '0.2057', 'grad_norm': '2.302', 'learning_rate': '1.953e-05', 'epoch': '0.1249'}

 12%|█▏        | 4740/37963 [14:49:32<100:56:35, 10.94s/it]
 12%|█▏        | 4741/37963 [14:49:42<97:36:48, 10.58s/it] 
 12%|█▏        | 4742/37963 [14:49:52<95:29:20, 10.35s/it]
 12%|█▏        | 4743/37963 [14:50:02<94:57:49, 10.29s/it]
 12%|█▏        | 4744/37963 [14:50:12<93:54:30, 10.18s/it]
 12%|█▏        | 4745/37963 [14:50:22<93:36:05, 10.14s/it]
 13%|█▎        | 4746/37963 [14:50:32<93:36:34, 10.15s/it]
 13%|█▎        | 4747/37963 [14:50:42<92:07:12,  9.98s/it]
 13%|█▎        | 4748/37963 [14:50:58<109:55:48, 11.91s/it]
 13%|█▎        | 4749/37963 [14:51:08<104:24:37, 11.32s/it]
 13%|█▎        | 4750/37963 [14:51:18<100:57:31, 10.94s/it]
                                                           
{'loss': '0.2214', 'grad_norm': '4.569', 'learning_rate': '1.953e-05', 'epoch': '0.1251'}

 13%|█▎        | 4750/37963 [14:51:18<100:57:31, 10.94s/it]
 13%|█▎        | 4751/37963 [14:51:28<98:35:19, 10.69s/it] 
 13%|█▎        | 4752/37963 [14:51:38<96:49:21, 10.50s/it]
 13%|█▎        | 4753/37963 [14:51:48<95:49:32, 10.39s/it]
 13%|█▎        | 4754/37963 [14:51:58<94:04:23, 10.20s/it]
 13%|█▎        | 4755/37963 [14:52:08<93:48:20, 10.17s/it]
 13%|█▎        | 4756/37963 [14:52:18<92:13:51, 10.00s/it]
 13%|█▎        | 4757/37963 [14:52:34<110:06:24, 11.94s/it]
 13%|█▎        | 4758/37963 [14:52:44<104:32:57, 11.33s/it]
 13%|█▎        | 4759/37963 [14:52:54<101:10:32, 10.97s/it]
 13%|█▎        | 4760/37963 [14:53:04<98:36:30, 10.69s/it] 
                                                          
{'loss': '0.1834', 'grad_norm': '5.815', 'learning_rate': '1.953e-05', 'epoch': '0.1254'}

 13%|█▎        | 4760/37963 [14:53:04<98:36:30, 10.69s/it]
 13%|█▎        | 4761/37963 [14:53:14<96:42:30, 10.49s/it]
 13%|█▎        | 4762/37963 [14:53:25<95:43:15, 10.38s/it]
 13%|█▎        | 4763/37963 [14:53:35<94:44:48, 10.27s/it]
 13%|█▎        | 4764/37963 [14:53:45<94:15:18, 10.22s/it]
 13%|█▎        | 4765/37963 [14:53:55<93:16:35, 10.11s/it]
 13%|█▎        | 4766/37963 [14:54:11<111:17:25, 12.07s/it]
 13%|█▎        | 4767/37963 [14:54:21<105:59:47, 11.49s/it]
 13%|█▎        | 4768/37963 [14:54:31<101:59:49, 11.06s/it]
 13%|█▎        | 4769/37963 [14:54:42<99:36:55, 10.80s/it] 
 13%|█▎        | 4770/37963 [14:54:52<97:26:06, 10.57s/it]
                                                          
{'loss': '0.2103', 'grad_norm': '1.668', 'learning_rate': '1.952e-05', 'epoch': '0.1256'}

 13%|█▎        | 4770/37963 [14:54:52<97:26:06, 10.57s/it]
 13%|█▎        | 4771/37963 [14:55:02<96:03:08, 10.42s/it]
 13%|█▎        | 4772/37963 [14:55:18<113:09:35, 12.27s/it]
 13%|█▎        | 4773/37963 [14:55:28<107:17:03, 11.64s/it]
 13%|█▎        | 4774/37963 [14:55:39<103:00:09, 11.17s/it]
 13%|█▎        | 4775/37963 [14:55:49<100:53:05, 10.94s/it]
 13%|█▎        | 4776/37963 [14:55:58<96:25:57, 10.46s/it] 
 13%|█▎        | 4777/37963 [14:56:16<116:50:05, 12.67s/it]
 13%|█▎        | 4778/37963 [14:56:26<109:53:32, 11.92s/it]
 13%|█▎        | 4779/37963 [14:56:43<122:46:31, 13.32s/it]
 13%|█▎        | 4780/37963 [14:56:53<114:09:19, 12.38s/it]
                                                           
{'loss': '0.2049', 'grad_norm': '1.434', 'learning_rate': '1.952e-05', 'epoch': '0.1259'}

 13%|█▎        | 4780/37963 [14:56:53<114:09:19, 12.38s/it]
 13%|█▎        | 4781/37963 [14:57:09<125:07:52, 13.58s/it]
 13%|█▎        | 4782/37963 [14:57:19<114:35:31, 12.43s/it]
 13%|█▎        | 4783/37963 [14:57:29<108:08:45, 11.73s/it]
 13%|█▎        | 4784/37963 [14:57:39<103:06:04, 11.19s/it]
 13%|█▎        | 4785/37963 [14:57:49<100:17:47, 10.88s/it]
 13%|█▎        | 4786/37963 [14:58:06<116:48:33, 12.67s/it]
 13%|█▎        | 4787/37963 [14:58:16<108:38:30, 11.79s/it]
 13%|█▎        | 4788/37963 [14:58:26<103:11:18, 11.20s/it]
 13%|█▎        | 4789/37963 [14:58:36<100:00:31, 10.85s/it]
 13%|█▎        | 4790/37963 [14:58:46<97:51:27, 10.62s/it] 
                                                          
{'loss': '0.2001', 'grad_norm': '1.399', 'learning_rate': '1.952e-05', 'epoch': '0.1262'}

 13%|█▎        | 4790/37963 [14:58:46<97:51:27, 10.62s/it]
 13%|█▎        | 4791/37963 [14:58:56<96:17:49, 10.45s/it]
 13%|█▎        | 4792/37963 [14:59:06<95:34:52, 10.37s/it]
 13%|█▎        | 4793/37963 [14:59:16<95:07:50, 10.32s/it]
 13%|█▎        | 4794/37963 [14:59:26<94:08:47, 10.22s/it]
 13%|█▎        | 4795/37963 [14:59:43<111:34:24, 12.11s/it]
 13%|█▎        | 4796/37963 [14:59:53<105:29:21, 11.45s/it]
 13%|█▎        | 4797/37963 [15:00:03<101:40:50, 11.04s/it]
 13%|█▎        | 4798/37963 [15:00:13<99:13:40, 10.77s/it] 
 13%|█▎        | 4799/37963 [15:00:23<97:49:58, 10.62s/it]
 13%|█▎        | 4800/37963 [15:00:33<96:37:02, 10.49s/it]
                                                          
{'loss': '0.19', 'grad_norm': '1.101', 'learning_rate': '1.952e-05', 'epoch': '0.1264'}

 13%|█▎        | 4800/37963 [15:00:33<96:37:02, 10.49s/it]
 13%|█▎        | 4801/37963 [15:00:43<94:45:21, 10.29s/it]
 13%|█▎        | 4802/37963 [15:00:53<94:09:37, 10.22s/it]
 13%|█▎        | 4803/37963 [15:01:04<94:03:06, 10.21s/it]
 13%|█▎        | 4804/37963 [15:01:14<93:32:42, 10.16s/it]
 13%|█▎        | 4805/37963 [15:01:24<93:16:54, 10.13s/it]
 13%|█▎        | 4806/37963 [15:01:40<110:59:19, 12.05s/it]
 13%|█▎        | 4807/37963 [15:01:50<105:45:57, 11.48s/it]
 13%|█▎        | 4808/37963 [15:02:00<101:38:23, 11.04s/it]
 13%|█▎        | 4809/37963 [15:02:10<98:43:53, 10.72s/it] 
 13%|█▎        | 4810/37963 [15:02:20<96:20:11, 10.46s/it]
                                                          
{'loss': '0.1923', 'grad_norm': '1.973', 'learning_rate': '1.951e-05', 'epoch': '0.1267'}

 13%|█▎        | 4810/37963 [15:02:20<96:20:11, 10.46s/it]
 13%|█▎        | 4811/37963 [15:02:30<95:29:52, 10.37s/it]
 13%|█▎        | 4812/37963 [15:02:40<94:41:55, 10.28s/it]
 13%|█▎        | 4813/37963 [15:02:51<94:35:58, 10.27s/it]
 13%|█▎        | 4814/37963 [15:03:01<94:00:53, 10.21s/it]
 13%|█▎        | 4815/37963 [15:03:11<93:44:14, 10.18s/it]
 13%|█▎        | 4816/37963 [15:03:27<111:41:00, 12.13s/it]
 13%|█▎        | 4817/37963 [15:03:38<105:59:22, 11.51s/it]
 13%|█▎        | 4818/37963 [15:03:48<102:06:07, 11.09s/it]
 13%|█▎        | 4819/37963 [15:04:04<117:03:27, 12.71s/it]
 13%|█▎        | 4820/37963 [15:04:14<109:56:17, 11.94s/it]
                                                           
{'loss': '0.2093', 'grad_norm': '2.014', 'learning_rate': '1.951e-05', 'epoch': '0.127'}

 13%|█▎        | 4820/37963 [15:04:14<109:56:17, 11.94s/it]
 13%|█▎        | 4821/37963 [15:04:24<104:41:28, 11.37s/it]
 13%|█▎        | 4822/37963 [15:04:34<101:17:29, 11.00s/it]
 13%|█▎        | 4823/37963 [15:04:45<99:13:49, 10.78s/it] 
 13%|█▎        | 4824/37963 [15:05:03<118:42:03, 12.89s/it]
 13%|█▎        | 4825/37963 [15:05:12<109:43:57, 11.92s/it]
 13%|█▎        | 4826/37963 [15:05:22<104:38:02, 11.37s/it]
 13%|█▎        | 4827/37963 [15:05:39<118:42:50, 12.90s/it]
 13%|█▎        | 4828/37963 [15:05:55<128:41:24, 13.98s/it]
 13%|█▎        | 4829/37963 [15:06:05<117:32:57, 12.77s/it]
 13%|█▎        | 4830/37963 [15:06:15<110:23:30, 11.99s/it]
                                                           
{'loss': '0.1858', 'grad_norm': '1.428', 'learning_rate': '1.951e-05', 'epoch': '0.1272'}

 13%|█▎        | 4830/37963 [15:06:15<110:23:30, 11.99s/it]
 13%|█▎        | 4831/37963 [15:06:26<105:12:53, 11.43s/it]
 13%|█▎        | 4832/37963 [15:06:36<101:38:21, 11.04s/it]
 13%|█▎        | 4833/37963 [15:06:46<99:04:43, 10.77s/it] 
 13%|█▎        | 4834/37963 [15:07:02<113:44:20, 12.36s/it]
 13%|█▎        | 4835/37963 [15:07:12<106:25:02, 11.56s/it]
 13%|█▎        | 4836/37963 [15:07:22<102:14:04, 11.11s/it]
 13%|█▎        | 4837/37963 [15:07:32<99:19:26, 10.79s/it] 
 13%|█▎        | 4838/37963 [15:07:42<97:14:54, 10.57s/it]
 13%|█▎        | 4839/37963 [15:07:51<94:54:56, 10.32s/it]
 13%|█▎        | 4840/37963 [15:08:01<94:08:20, 10.23s/it]
                                                          
{'loss': '0.1865', 'grad_norm': '1.105', 'learning_rate': '1.951e-05', 'epoch': '0.1275'}

 13%|█▎        | 4840/37963 [15:08:01<94:08:20, 10.23s/it]
 13%|█▎        | 4841/37963 [15:08:18<111:49:56, 12.15s/it]
 13%|█▎        | 4842/37963 [15:08:28<106:03:14, 11.53s/it]
 13%|█▎        | 4843/37963 [15:08:38<102:11:24, 11.11s/it]
 13%|█▎        | 4844/37963 [15:08:48<98:25:42, 10.70s/it] 
 13%|█▎        | 4845/37963 [15:08:58<96:35:40, 10.50s/it]
 13%|█▎        | 4846/37963 [15:09:08<95:10:30, 10.35s/it]
 13%|█▎        | 4847/37963 [15:09:18<94:33:21, 10.28s/it]
 13%|█▎        | 4848/37963 [15:09:28<94:23:17, 10.26s/it]
 13%|█▎        | 4849/37963 [15:09:38<93:49:14, 10.20s/it]
 13%|█▎        | 4850/37963 [15:09:48<92:57:54, 10.11s/it]
                                                          
{'loss': '0.2068', 'grad_norm': '1.535', 'learning_rate': '1.95e-05', 'epoch': '0.1278'}

 13%|█▎        | 4850/37963 [15:09:48<92:57:54, 10.11s/it]
 13%|█▎        | 4851/37963 [15:09:58<92:54:22, 10.10s/it]
 13%|█▎        | 4852/37963 [15:10:15<111:01:34, 12.07s/it]
 13%|█▎        | 4853/37963 [15:10:25<105:10:12, 11.43s/it]
 13%|█▎        | 4854/37963 [15:10:35<101:26:33, 11.03s/it]
 13%|█▎        | 4855/37963 [15:10:45<98:38:56, 10.73s/it] 
 13%|█▎        | 4856/37963 [15:10:55<97:15:27, 10.58s/it]
 13%|█▎        | 4857/37963 [15:11:06<96:03:46, 10.45s/it]
 13%|█▎        | 4858/37963 [15:11:16<95:00:31, 10.33s/it]
 13%|█▎        | 4859/37963 [15:11:25<93:30:27, 10.17s/it]
 13%|█▎        | 4860/37963 [15:11:35<92:19:40, 10.04s/it]
                                                          
{'loss': '0.1884', 'grad_norm': '2.351', 'learning_rate': '1.95e-05', 'epoch': '0.128'}

 13%|█▎        | 4860/37963 [15:11:35<92:19:40, 10.04s/it]
 13%|█▎        | 4861/37963 [15:11:45<92:30:38, 10.06s/it]
 13%|█▎        | 4862/37963 [15:11:55<92:28:32, 10.06s/it]
 13%|█▎        | 4863/37963 [15:12:05<91:15:13,  9.92s/it]
 13%|█▎        | 4864/37963 [15:12:15<91:38:41,  9.97s/it]
 13%|█▎        | 4865/37963 [15:12:32<110:56:53, 12.07s/it]
 13%|█▎        | 4866/37963 [15:12:42<105:32:37, 11.48s/it]
 13%|█▎        | 4867/37963 [15:12:59<119:40:24, 13.02s/it]
 13%|█▎        | 4868/37963 [15:13:09<111:28:47, 12.13s/it]
 13%|█▎        | 4869/37963 [15:13:19<105:59:12, 11.53s/it]
 13%|█▎        | 4870/37963 [15:13:29<101:48:40, 11.08s/it]
                                                           
{'loss': '0.2015', 'grad_norm': '1.019', 'learning_rate': '1.95e-05', 'epoch': '0.1283'}

 13%|█▎        | 4870/37963 [15:13:29<101:48:40, 11.08s/it]
 13%|█▎        | 4871/37963 [15:13:39<99:19:20, 10.81s/it] 
 13%|█▎        | 4872/37963 [15:13:56<115:40:16, 12.58s/it]
 13%|█▎        | 4873/37963 [15:14:14<130:11:56, 14.16s/it]
 13%|█▎        | 4874/37963 [15:14:24<119:03:12, 12.95s/it]
 13%|█▎        | 4875/37963 [15:14:33<109:58:50, 11.97s/it]
 13%|█▎        | 4876/37963 [15:14:50<122:17:37, 13.31s/it]
 13%|█▎        | 4877/37963 [15:15:00<112:49:52, 12.28s/it]
 13%|█▎        | 4878/37963 [15:15:10<106:50:25, 11.63s/it]
 13%|█▎        | 4879/37963 [15:15:20<102:44:07, 11.18s/it]
 13%|█▎        | 4880/37963 [15:15:30<99:54:29, 10.87s/it] 
                                                          
{'loss': '0.1942', 'grad_norm': '4.483', 'learning_rate': '1.95e-05', 'epoch': '0.1285'}

 13%|█▎        | 4880/37963 [15:15:30<99:54:29, 10.87s/it]
 13%|█▎        | 4881/37963 [15:15:40<97:40:50, 10.63s/it]
 13%|█▎        | 4882/37963 [15:15:50<95:58:48, 10.44s/it]
 13%|█▎        | 4883/37963 [15:16:07<113:17:17, 12.33s/it]
 13%|█▎        | 4884/37963 [15:16:17<107:00:28, 11.65s/it]
 13%|█▎        | 4885/37963 [15:16:27<102:35:00, 11.16s/it]
 13%|█▎        | 4886/37963 [15:16:37<99:18:08, 10.81s/it] 
 13%|█▎        | 4887/37963 [15:16:47<97:32:24, 10.62s/it]
 13%|█▎        | 4888/37963 [15:16:57<94:48:41, 10.32s/it]
 13%|█▎        | 4889/37963 [15:17:07<93:31:04, 10.18s/it]
 13%|█▎        | 4890/37963 [15:17:23<111:29:22, 12.14s/it]
                                                           
{'loss': '0.2124', 'grad_norm': '4.805', 'learning_rate': '1.949e-05', 'epoch': '0.1288'}

 13%|█▎        | 4890/37963 [15:17:23<111:29:22, 12.14s/it]
 13%|█▎        | 4891/37963 [15:17:33<105:46:46, 11.51s/it]
 13%|█▎        | 4892/37963 [15:17:44<102:05:03, 11.11s/it]
 13%|█▎        | 4893/37963 [15:17:54<99:23:20, 10.82s/it] 
 13%|█▎        | 4894/37963 [15:18:04<97:45:31, 10.64s/it]
 13%|█▎        | 4895/37963 [15:18:14<96:15:34, 10.48s/it]
 13%|█▎        | 4896/37963 [15:18:24<95:30:50, 10.40s/it]
 13%|█▎        | 4897/37963 [15:18:34<94:44:30, 10.31s/it]
 13%|█▎        | 4898/37963 [15:18:44<93:07:53, 10.14s/it]
 13%|█▎        | 4899/37963 [15:19:01<111:03:10, 12.09s/it]
 13%|█▎        | 4900/37963 [15:19:11<105:32:39, 11.49s/it]
                                                           
{'loss': '0.1985', 'grad_norm': '3.429', 'learning_rate': '1.949e-05', 'epoch': '0.1291'}

 13%|█▎        | 4900/37963 [15:19:11<105:32:39, 11.49s/it]
 13%|█▎        | 4901/37963 [15:19:21<100:42:09, 10.97s/it]
 13%|█▎        | 4902/37963 [15:19:31<98:32:03, 10.73s/it] 
 13%|█▎        | 4903/37963 [15:19:41<96:28:22, 10.51s/it]
 13%|█▎        | 4904/37963 [15:19:51<95:34:16, 10.41s/it]
 13%|█▎        | 4905/37963 [15:20:01<94:44:55, 10.32s/it]
 13%|█▎        | 4906/37963 [15:20:11<94:39:21, 10.31s/it]
 13%|█▎        | 4907/37963 [15:20:21<93:23:08, 10.17s/it]
 13%|█▎        | 4908/37963 [15:20:31<93:11:50, 10.15s/it]
 13%|█▎        | 4909/37963 [15:20:42<93:30:03, 10.18s/it]
 13%|█▎        | 4910/37963 [15:20:52<93:06:54, 10.14s/it]
                                                          
{'loss': '0.1902', 'grad_norm': '4.898', 'learning_rate': '1.949e-05', 'epoch': '0.1293'}

 13%|█▎        | 4910/37963 [15:20:52<93:06:54, 10.14s/it]
 13%|█▎        | 4911/37963 [15:21:02<92:45:52, 10.10s/it]
 13%|█▎        | 4912/37963 [15:21:18<109:17:57, 11.91s/it]
 13%|█▎        | 4913/37963 [15:21:28<104:23:43, 11.37s/it]
 13%|█▎        | 4914/37963 [15:21:44<118:28:10, 12.90s/it]
 13%|█▎        | 4915/37963 [15:21:54<110:45:51, 12.07s/it]
 13%|█▎        | 4916/37963 [15:22:05<105:45:41, 11.52s/it]
 13%|█▎        | 4917/37963 [15:22:24<127:24:35, 13.88s/it]
 13%|█▎        | 4918/37963 [15:22:34<117:22:16, 12.79s/it]
 13%|█▎        | 4919/37963 [15:22:44<110:10:58, 12.00s/it]
 13%|█▎        | 4920/37963 [15:23:03<126:57:19, 13.83s/it]
                                                           
{'loss': '0.2059', 'grad_norm': '6.311', 'learning_rate': '1.948e-05', 'epoch': '0.1296'}

 13%|█▎        | 4920/37963 [15:23:03<126:57:19, 13.83s/it]
 13%|█▎        | 4921/37963 [15:23:12<115:57:19, 12.63s/it]
 13%|█▎        | 4922/37963 [15:23:22<108:58:42, 11.87s/it]
 13%|█▎        | 4923/37963 [15:23:39<121:02:49, 13.19s/it]
 13%|█▎        | 4924/37963 [15:23:49<113:02:59, 12.32s/it]
 13%|█▎        | 4925/37963 [15:23:59<107:19:28, 11.69s/it]
 13%|█▎        | 4926/37963 [15:24:09<102:46:39, 11.20s/it]
 13%|█▎        | 4927/37963 [15:24:20<100:00:39, 10.90s/it]
 13%|█▎        | 4928/37963 [15:24:30<98:18:24, 10.71s/it] 
 13%|█▎        | 4929/37963 [15:24:40<96:35:16, 10.53s/it]
 13%|█▎        | 4930/37963 [15:24:56<112:06:20, 12.22s/it]
                                                           
{'loss': '0.1912', 'grad_norm': '4.724', 'learning_rate': '1.948e-05', 'epoch': '0.1299'}

 13%|█▎        | 4930/37963 [15:24:56<112:06:20, 12.22s/it]
 13%|█▎        | 4931/37963 [15:25:06<106:53:51, 11.65s/it]
 13%|█▎        | 4932/37963 [15:25:16<102:34:47, 11.18s/it]
 13%|█▎        | 4933/37963 [15:25:27<99:38:20, 10.86s/it] 
 13%|█▎        | 4934/37963 [15:25:36<96:18:49, 10.50s/it]
 13%|█▎        | 4935/37963 [15:25:46<95:04:03, 10.36s/it]
 13%|█▎        | 4936/37963 [15:26:03<111:55:37, 12.20s/it]
 13%|█▎        | 4937/37963 [15:26:13<105:48:02, 11.53s/it]
 13%|█▎        | 4938/37963 [15:26:23<101:53:40, 11.11s/it]
 13%|█▎        | 4939/37963 [15:26:33<99:14:39, 10.82s/it] 
 13%|█▎        | 4940/37963 [15:26:43<97:19:26, 10.61s/it]
                                                          
{'loss': '0.1885', 'grad_norm': '1.935', 'learning_rate': '1.948e-05', 'epoch': '0.1301'}

 13%|█▎        | 4940/37963 [15:26:43<97:19:26, 10.61s/it]
 13%|█▎        | 4941/37963 [15:26:53<96:17:58, 10.50s/it]
 13%|█▎        | 4942/37963 [15:27:03<94:36:21, 10.31s/it]
 13%|█▎        | 4943/37963 [15:27:13<93:53:58, 10.24s/it]
 13%|█▎        | 4944/37963 [15:27:24<93:50:15, 10.23s/it]
 13%|█▎        | 4945/37963 [15:27:34<93:23:54, 10.18s/it]
 13%|█▎        | 4946/37963 [15:27:49<108:59:41, 11.88s/it]
 13%|█▎        | 4947/37963 [15:28:00<104:22:25, 11.38s/it]
 13%|█▎        | 4948/37963 [15:28:10<101:00:31, 11.01s/it]
 13%|█▎        | 4949/37963 [15:28:20<98:19:46, 10.72s/it] 
 13%|█▎        | 4950/37963 [15:28:30<96:28:45, 10.52s/it]
                                                          
{'loss': '0.1941', 'grad_norm': '1.211', 'learning_rate': '1.948e-05', 'epoch': '0.1304'}

 13%|█▎        | 4950/37963 [15:28:30<96:28:45, 10.52s/it]
 13%|█▎        | 4951/37963 [15:28:40<95:24:46, 10.40s/it]
 13%|█▎        | 4952/37963 [15:28:50<94:23:28, 10.29s/it]
 13%|█▎        | 4953/37963 [15:29:00<93:28:55, 10.19s/it]
 13%|█▎        | 4954/37963 [15:29:10<93:14:24, 10.17s/it]
 13%|█▎        | 4955/37963 [15:29:20<92:50:09, 10.13s/it]
 13%|█▎        | 4956/37963 [15:29:30<92:52:11, 10.13s/it]
 13%|█▎        | 4957/37963 [15:29:40<92:41:17, 10.11s/it]
 13%|█▎        | 4958/37963 [15:29:50<92:30:25, 10.09s/it]
 13%|█▎        | 4959/37963 [15:30:07<110:29:57, 12.05s/it]
 13%|█▎        | 4960/37963 [15:30:17<104:59:05, 11.45s/it]
                                                           
{'loss': '0.2028', 'grad_norm': '1.135', 'learning_rate': '1.947e-05', 'epoch': '0.1307'}

 13%|█▎        | 4960/37963 [15:30:17<104:59:05, 11.45s/it]
 13%|█▎        | 4961/37963 [15:30:27<101:16:08, 11.05s/it]
 13%|█▎        | 4962/37963 [15:30:44<116:20:39, 12.69s/it]
 13%|█▎        | 4963/37963 [15:30:54<109:25:13, 11.94s/it]
 13%|█▎        | 4964/37963 [15:31:04<103:22:40, 11.28s/it]
 13%|█▎        | 4965/37963 [15:31:14<100:10:43, 10.93s/it]
 13%|█▎        | 4966/37963 [15:31:24<98:02:19, 10.70s/it] 
 13%|█▎        | 4967/37963 [15:31:40<113:03:17, 12.33s/it]
 13%|█▎        | 4968/37963 [15:31:58<128:27:55, 14.02s/it]
 13%|█▎        | 4969/37963 [15:32:08<118:03:19, 12.88s/it]
 13%|█▎        | 4970/37963 [15:32:18<110:06:16, 12.01s/it]
                                                           
{'loss': '0.1979', 'grad_norm': '4.57', 'learning_rate': '1.947e-05', 'epoch': '0.1309'}

 13%|█▎        | 4970/37963 [15:32:18<110:06:16, 12.01s/it]
 13%|█▎        | 4971/37963 [15:32:28<104:31:30, 11.41s/it]
 13%|█▎        | 4972/37963 [15:32:38<101:12:20, 11.04s/it]
 13%|█▎        | 4973/37963 [15:32:49<98:36:49, 10.76s/it] 
 13%|█▎        | 4974/37963 [15:33:05<114:11:44, 12.46s/it]
 13%|█▎        | 4975/37963 [15:33:15<107:02:16, 11.68s/it]
 13%|█▎        | 4976/37963 [15:33:25<102:33:35, 11.19s/it]
 13%|█▎        | 4977/37963 [15:33:35<99:35:15, 10.87s/it] 
 13%|█▎        | 4978/37963 [15:33:51<113:42:28, 12.41s/it]
 13%|█▎        | 4979/37963 [15:34:01<107:24:10, 11.72s/it]
 13%|█▎        | 4980/37963 [15:34:11<102:09:40, 11.15s/it]
                                                           
{'loss': '0.2004', 'grad_norm': '1.728', 'learning_rate': '1.947e-05', 'epoch': '0.1312'}

 13%|█▎        | 4980/37963 [15:34:11<102:09:40, 11.15s/it]
 13%|█▎        | 4981/37963 [15:34:21<99:28:45, 10.86s/it] 
 13%|█▎        | 4982/37963 [15:34:31<96:43:46, 10.56s/it]
 13%|█▎        | 4983/37963 [15:34:41<95:20:03, 10.41s/it]
 13%|█▎        | 4984/37963 [15:34:51<94:36:48, 10.33s/it]
 13%|█▎        | 4985/37963 [15:35:08<111:33:55, 12.18s/it]
 13%|█▎        | 4986/37963 [15:35:18<105:19:46, 11.50s/it]
 13%|█▎        | 4987/37963 [15:35:27<100:15:08, 10.94s/it]
 13%|█▎        | 4988/37963 [15:35:37<97:50:11, 10.68s/it] 
 13%|█▎        | 4989/37963 [15:35:47<96:08:35, 10.50s/it]
 13%|█▎        | 4990/37963 [15:35:58<95:27:39, 10.42s/it]
                                                          
{'loss': '0.1822', 'grad_norm': '1.651', 'learning_rate': '1.947e-05', 'epoch': '0.1314'}

 13%|█▎        | 4990/37963 [15:35:58<95:27:39, 10.42s/it]
 13%|█▎        | 4991/37963 [15:36:08<94:37:19, 10.33s/it]
 13%|█▎        | 4992/37963 [15:36:18<93:41:52, 10.23s/it]
 13%|█▎        | 4993/37963 [15:36:28<93:46:55, 10.24s/it]
 13%|█▎        | 4994/37963 [15:36:38<92:26:10, 10.09s/it]
 13%|█▎        | 4995/37963 [15:36:54<109:43:28, 11.98s/it]
 13%|█▎        | 4996/37963 [15:37:04<104:08:26, 11.37s/it]
 13%|█▎        | 4997/37963 [15:37:14<100:41:36, 11.00s/it]
 13%|█▎        | 4998/37963 [15:37:24<98:10:41, 10.72s/it] 
 13%|█▎        | 4999/37963 [15:37:34<96:18:38, 10.52s/it]
 13%|█▎        | 5000/37963 [15:37:44<95:06:59, 10.39s/it]
                                                          
{'loss': '0.1938', 'grad_norm': '1.191', 'learning_rate': '1.946e-05', 'epoch': '0.1317'}

 13%|█▎        | 5000/37963 [15:37:44<95:06:59, 10.39s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.59s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.59s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 13%|█▎        | 5001/37963 [15:38:42<225:49:30, 24.66s/it]
 13%|█▎        | 5002/37963 [15:38:53<186:17:19, 20.35s/it]
 13%|█▎        | 5003/37963 [15:39:03<157:58:13, 17.25s/it]
 13%|█▎        | 5004/37963 [15:39:13<138:15:54, 15.10s/it]
 13%|█▎        | 5005/37963 [15:39:22<123:14:14, 13.46s/it]
 13%|█▎        | 5006/37963 [15:39:32<113:01:34, 12.35s/it]
 13%|█▎        | 5007/37963 [15:39:49<124:21:19, 13.58s/it]
 13%|█▎        | 5008/37963 [15:39:59<114:54:50, 12.55s/it]
 13%|█▎        | 5009/37963 [15:40:16<127:02:50, 13.88s/it]
 13%|█▎        | 5010/37963 [15:40:26<116:29:12, 12.73s/it]
                                                           
{'loss': '0.1918', 'grad_norm': '1.951', 'learning_rate': '1.946e-05', 'epoch': '0.132'}

 13%|█▎        | 5010/37963 [15:40:26<116:29:12, 12.73s/it]
 13%|█▎        | 5011/37963 [15:40:36<109:13:41, 11.93s/it]
 13%|█▎        | 5012/37963 [15:40:46<104:18:11, 11.40s/it]
 13%|█▎        | 5013/37963 [15:40:56<100:58:46, 11.03s/it]
 13%|█▎        | 5014/37963 [15:41:13<115:35:41, 12.63s/it]
 13%|█▎        | 5015/37963 [15:41:22<108:15:36, 11.83s/it]
 13%|█▎        | 5016/37963 [15:41:40<124:10:45, 13.57s/it]
 13%|█▎        | 5017/37963 [15:41:50<114:44:44, 12.54s/it]
 13%|█▎        | 5018/37963 [15:42:00<107:40:44, 11.77s/it]
 13%|█▎        | 5019/37963 [15:42:10<103:09:57, 11.27s/it]
 13%|█▎        | 5020/37963 [15:42:20<99:57:05, 10.92s/it] 
                                                          
{'loss': '0.1781', 'grad_norm': '1.138', 'learning_rate': '1.946e-05', 'epoch': '0.1322'}

 13%|█▎        | 5020/37963 [15:42:20<99:57:05, 10.92s/it]
 13%|█▎        | 5021/37963 [15:42:31<97:48:01, 10.69s/it]
 13%|█▎        | 5022/37963 [15:42:41<96:35:44, 10.56s/it]
 13%|█▎        | 5023/37963 [15:42:57<112:55:22, 12.34s/it]
 13%|█▎        | 5024/37963 [15:43:07<106:46:35, 11.67s/it]
 13%|█▎        | 5025/37963 [15:43:17<101:54:24, 11.14s/it]
 13%|█▎        | 5026/37963 [15:43:27<98:59:57, 10.82s/it] 
 13%|█▎        | 5027/37963 [15:43:44<115:31:00, 12.63s/it]
 13%|█▎        | 5028/37963 [15:43:54<108:04:43, 11.81s/it]
 13%|█▎        | 5029/37963 [15:44:04<103:06:37, 11.27s/it]
 13%|█▎        | 5030/37963 [15:44:14<99:46:38, 10.91s/it] 
                                                          
{'loss': '0.1887', 'grad_norm': '4.134', 'learning_rate': '1.945e-05', 'epoch': '0.1325'}

 13%|█▎        | 5030/37963 [15:44:14<99:46:38, 10.91s/it]
 13%|█▎        | 5031/37963 [15:44:24<97:30:23, 10.66s/it]
 13%|█▎        | 5032/37963 [15:44:34<95:52:42, 10.48s/it]
 13%|█▎        | 5033/37963 [15:44:51<112:18:43, 12.28s/it]
 13%|█▎        | 5034/37963 [15:45:01<106:10:53, 11.61s/it]
 13%|█▎        | 5035/37963 [15:45:11<102:16:47, 11.18s/it]
 13%|█▎        | 5036/37963 [15:45:21<99:22:20, 10.86s/it] 
 13%|█▎        | 5037/37963 [15:45:31<97:39:25, 10.68s/it]
 13%|█▎        | 5038/37963 [15:45:42<96:17:17, 10.53s/it]
 13%|█▎        | 5039/37963 [15:45:52<95:10:23, 10.41s/it]
 13%|█▎        | 5040/37963 [15:46:01<93:07:36, 10.18s/it]
                                                          
{'loss': '0.1952', 'grad_norm': '0.7272', 'learning_rate': '1.945e-05', 'epoch': '0.1328'}

 13%|█▎        | 5040/37963 [15:46:01<93:07:36, 10.18s/it]
 13%|█▎        | 5041/37963 [15:46:12<93:15:10, 10.20s/it]
 13%|█▎        | 5042/37963 [15:46:28<109:11:03, 11.94s/it]
 13%|█▎        | 5043/37963 [15:46:38<104:52:44, 11.47s/it]
 13%|█▎        | 5044/37963 [15:46:48<101:13:17, 11.07s/it]
 13%|█▎        | 5045/37963 [15:46:58<97:34:12, 10.67s/it] 
 13%|█▎        | 5046/37963 [15:47:08<94:57:37, 10.39s/it]
 13%|█▎        | 5047/37963 [15:47:18<94:30:07, 10.34s/it]
 13%|█▎        | 5048/37963 [15:47:28<93:52:00, 10.27s/it]
 13%|█▎        | 5049/37963 [15:47:38<93:31:50, 10.23s/it]
 13%|█▎        | 5050/37963 [15:47:48<93:17:50, 10.20s/it]
                                                          
{'loss': '0.1935', 'grad_norm': '1.57', 'learning_rate': '1.945e-05', 'epoch': '0.133'}

 13%|█▎        | 5050/37963 [15:47:48<93:17:50, 10.20s/it]
 13%|█▎        | 5051/37963 [15:47:58<93:15:23, 10.20s/it]
 13%|█▎        | 5052/37963 [15:48:09<93:01:34, 10.18s/it]
 13%|█▎        | 5053/37963 [15:48:19<92:55:13, 10.16s/it]
 13%|█▎        | 5054/37963 [15:48:29<92:08:53, 10.08s/it]
 13%|█▎        | 5055/37963 [15:48:45<109:32:10, 11.98s/it]
 13%|█▎        | 5056/37963 [15:48:55<103:19:42, 11.30s/it]
 13%|█▎        | 5057/37963 [15:49:05<99:38:35, 10.90s/it] 
 13%|█▎        | 5058/37963 [15:49:21<114:44:27, 12.55s/it]
 13%|█▎        | 5059/37963 [15:49:31<107:59:43, 11.82s/it]
 13%|█▎        | 5060/37963 [15:49:41<103:55:09, 11.37s/it]
                                                           
{'loss': '0.1885', 'grad_norm': '1.658', 'learning_rate': '1.945e-05', 'epoch': '0.1333'}

 13%|█▎        | 5060/37963 [15:49:41<103:55:09, 11.37s/it]
 13%|█▎        | 5061/37963 [15:49:52<100:29:47, 11.00s/it]
 13%|█▎        | 5062/37963 [15:50:02<98:04:13, 10.73s/it] 
 13%|█▎        | 5063/37963 [15:50:22<124:04:05, 13.58s/it]
 13%|█▎        | 5064/37963 [15:50:32<114:29:00, 12.53s/it]
 13%|█▎        | 5065/37963 [15:50:42<107:57:46, 11.81s/it]
 13%|█▎        | 5066/37963 [15:50:52<102:35:33, 11.23s/it]
 13%|█▎        | 5067/37963 [15:51:02<99:43:55, 10.91s/it] 
 13%|█▎        | 5068/37963 [15:51:12<97:34:21, 10.68s/it]
 13%|█▎        | 5069/37963 [15:51:23<96:15:14, 10.53s/it]
 13%|█▎        | 5070/37963 [15:51:33<95:05:10, 10.41s/it]
                                                          
{'loss': '0.1828', 'grad_norm': '1.723', 'learning_rate': '1.944e-05', 'epoch': '0.1336'}

 13%|█▎        | 5070/37963 [15:51:33<95:05:10, 10.41s/it]
 13%|█▎        | 5071/37963 [15:51:49<112:28:59, 12.31s/it]
 13%|█▎        | 5072/37963 [15:51:59<106:15:45, 11.63s/it]
 13%|█▎        | 5073/37963 [15:52:10<102:15:30, 11.19s/it]
 13%|█▎        | 5074/37963 [15:52:20<99:18:15, 10.87s/it] 
 13%|█▎        | 5075/37963 [15:52:36<114:27:10, 12.53s/it]
 13%|█▎        | 5076/37963 [15:52:46<107:54:29, 11.81s/it]
 13%|█▎        | 5077/37963 [15:52:56<103:24:48, 11.32s/it]
 13%|█▎        | 5078/37963 [15:53:07<100:25:41, 10.99s/it]
 13%|█▎        | 5079/37963 [15:53:17<97:18:38, 10.65s/it] 
 13%|█▎        | 5080/37963 [15:53:26<95:12:18, 10.42s/it]
                                                          
{'loss': '0.197', 'grad_norm': '1.863', 'learning_rate': '1.944e-05', 'epoch': '0.1338'}

 13%|█▎        | 5080/37963 [15:53:26<95:12:18, 10.42s/it]
 13%|█▎        | 5081/37963 [15:53:43<111:06:45, 12.16s/it]
 13%|█▎        | 5082/37963 [15:53:53<105:20:24, 11.53s/it]
 13%|█▎        | 5083/37963 [15:54:03<101:18:50, 11.09s/it]
 13%|█▎        | 5084/37963 [15:54:13<97:58:45, 10.73s/it] 
 13%|█▎        | 5085/37963 [15:54:23<95:43:29, 10.48s/it]
 13%|█▎        | 5086/37963 [15:54:33<94:37:25, 10.36s/it]
 13%|█▎        | 5087/37963 [15:54:43<93:57:19, 10.29s/it]
 13%|█▎        | 5088/37963 [15:54:53<93:27:37, 10.23s/it]
 13%|█▎        | 5089/37963 [15:55:03<93:19:23, 10.22s/it]
 13%|█▎        | 5090/37963 [15:55:13<92:55:26, 10.18s/it]
                                                          
{'loss': '0.1779', 'grad_norm': '1.724', 'learning_rate': '1.944e-05', 'epoch': '0.1341'}

 13%|█▎        | 5090/37963 [15:55:13<92:55:26, 10.18s/it]
 13%|█▎        | 5091/37963 [15:55:30<110:17:01, 12.08s/it]
 13%|█▎        | 5092/37963 [15:55:40<105:00:26, 11.50s/it]
 13%|█▎        | 5093/37963 [15:55:50<100:51:12, 11.05s/it]
 13%|█▎        | 5094/37963 [15:56:00<98:40:02, 10.81s/it] 
 13%|█▎        | 5095/37963 [15:56:10<96:39:04, 10.59s/it]
 13%|█▎        | 5096/37963 [15:56:20<95:11:33, 10.43s/it]
 13%|█▎        | 5097/37963 [15:56:30<94:13:53, 10.32s/it]
 13%|█▎        | 5098/37963 [15:56:40<93:37:22, 10.26s/it]
 13%|█▎        | 5099/37963 [15:56:50<93:14:58, 10.21s/it]
 13%|█▎        | 5100/37963 [15:57:00<92:25:47, 10.13s/it]
                                                          
{'loss': '0.1881', 'grad_norm': '3.227', 'learning_rate': '1.943e-05', 'epoch': '0.1343'}

 13%|█▎        | 5100/37963 [15:57:00<92:25:47, 10.13s/it]
 13%|█▎        | 5101/37963 [15:57:10<92:25:22, 10.12s/it]
 13%|█▎        | 5102/37963 [15:57:21<92:32:04, 10.14s/it]
 13%|█▎        | 5103/37963 [15:57:31<92:21:10, 10.12s/it]
 13%|█▎        | 5104/37963 [15:57:41<92:18:03, 10.11s/it]
 13%|█▎        | 5105/37963 [15:57:57<110:01:32, 12.05s/it]
 13%|█▎        | 5106/37963 [15:58:14<122:38:36, 13.44s/it]
 13%|█▎        | 5107/37963 [15:58:24<112:40:31, 12.35s/it]
 13%|█▎        | 5108/37963 [15:58:34<106:26:17, 11.66s/it]
 13%|█▎        | 5109/37963 [15:58:44<102:06:57, 11.19s/it]
 13%|█▎        | 5110/37963 [15:58:54<98:32:33, 10.80s/it] 
                                                          
{'loss': '0.194', 'grad_norm': '3.19', 'learning_rate': '1.943e-05', 'epoch': '0.1346'}

 13%|█▎        | 5110/37963 [15:58:54<98:32:33, 10.80s/it]
 13%|█▎        | 5111/37963 [15:59:10<113:26:59, 12.43s/it]
 13%|█▎        | 5112/37963 [15:59:28<127:54:16, 14.02s/it]
 13%|█▎        | 5113/37963 [15:59:38<116:34:34, 12.78s/it]
 13%|█▎        | 5114/37963 [15:59:48<109:07:49, 11.96s/it]
 13%|█▎        | 5115/37963 [15:59:58<104:14:28, 11.42s/it]
 13%|█▎        | 5116/37963 [16:00:08<100:28:56, 11.01s/it]
 13%|█▎        | 5117/37963 [16:00:18<97:50:24, 10.72s/it] 
 13%|█▎        | 5118/37963 [16:00:34<113:11:52, 12.41s/it]
 13%|█▎        | 5119/37963 [16:00:44<106:48:11, 11.71s/it]
 13%|█▎        | 5120/37963 [16:00:54<100:48:47, 11.05s/it]
                                                           
{'loss': '0.1829', 'grad_norm': '3.925', 'learning_rate': '1.943e-05', 'epoch': '0.1349'}

 13%|█▎        | 5120/37963 [16:00:54<100:48:47, 11.05s/it]
 13%|█▎        | 5121/37963 [16:01:04<98:10:34, 10.76s/it] 
 13%|█▎        | 5122/37963 [16:01:14<96:37:44, 10.59s/it]
 13%|█▎        | 5123/37963 [16:01:25<95:34:30, 10.48s/it]
 13%|█▎        | 5124/37963 [16:01:41<111:47:38, 12.26s/it]
 13%|█▎        | 5125/37963 [16:01:51<105:45:41, 11.59s/it]
 14%|█▎        | 5126/37963 [16:02:01<101:00:23, 11.07s/it]
 14%|█▎        | 5127/37963 [16:02:11<98:13:37, 10.77s/it] 
 14%|█▎        | 5128/37963 [16:02:27<113:06:45, 12.40s/it]
 14%|█▎        | 5129/37963 [16:02:37<106:37:13, 11.69s/it]
 14%|█▎        | 5130/37963 [16:02:47<101:44:01, 11.15s/it]
                                                           
{'loss': '0.1804', 'grad_norm': '4.052', 'learning_rate': '1.943e-05', 'epoch': '0.1351'}

 14%|█▎        | 5130/37963 [16:02:47<101:44:01, 11.15s/it]
 14%|█▎        | 5131/37963 [16:02:57<99:02:12, 10.86s/it] 
 14%|█▎        | 5132/37963 [16:03:07<97:13:04, 10.66s/it]
 14%|█▎        | 5133/37963 [16:03:18<95:45:24, 10.50s/it]
 14%|█▎        | 5134/37963 [16:03:28<94:56:34, 10.41s/it]
 14%|█▎        | 5135/37963 [16:03:38<94:04:30, 10.32s/it]
 14%|█▎        | 5136/37963 [16:03:48<93:38:09, 10.27s/it]
 14%|█▎        | 5137/37963 [16:03:58<93:00:18, 10.20s/it]
 14%|█▎        | 5138/37963 [16:04:08<92:32:36, 10.15s/it]
 14%|█▎        | 5139/37963 [16:04:18<91:28:18, 10.03s/it]
 14%|█▎        | 5140/37963 [16:04:34<108:49:26, 11.94s/it]
                                                           
{'loss': '0.1886', 'grad_norm': '1.475', 'learning_rate': '1.942e-05', 'epoch': '0.1354'}

 14%|█▎        | 5140/37963 [16:04:34<108:49:26, 11.94s/it]
 14%|█▎        | 5141/37963 [16:04:44<103:47:29, 11.38s/it]
 14%|█▎        | 5142/37963 [16:04:54<100:31:49, 11.03s/it]
 14%|█▎        | 5143/37963 [16:05:05<98:00:04, 10.75s/it] 
 14%|█▎        | 5144/37963 [16:05:15<96:19:03, 10.57s/it]
 14%|█▎        | 5145/37963 [16:05:25<94:48:42, 10.40s/it]
 14%|█▎        | 5146/37963 [16:05:35<93:47:41, 10.29s/it]
 14%|█▎        | 5147/37963 [16:05:45<93:14:44, 10.23s/it]
 14%|█▎        | 5148/37963 [16:05:55<93:10:07, 10.22s/it]
 14%|█▎        | 5149/37963 [16:06:05<92:21:46, 10.13s/it]
 14%|█▎        | 5150/37963 [16:06:15<92:13:50, 10.12s/it]
                                                          
{'loss': '0.1906', 'grad_norm': '2.005', 'learning_rate': '1.942e-05', 'epoch': '0.1357'}

 14%|█▎        | 5150/37963 [16:06:15<92:13:50, 10.12s/it]
 14%|█▎        | 5151/37963 [16:06:25<91:48:58, 10.07s/it]
 14%|█▎        | 5152/37963 [16:06:42<109:48:00, 12.05s/it]
 14%|█▎        | 5153/37963 [16:06:52<104:41:32, 11.49s/it]
 14%|█▎        | 5154/37963 [16:07:02<100:45:12, 11.06s/it]
 14%|█▎        | 5155/37963 [16:07:18<115:44:55, 12.70s/it]
 14%|█▎        | 5156/37963 [16:07:29<108:52:04, 11.95s/it]
 14%|█▎        | 5157/37963 [16:07:39<103:36:08, 11.37s/it]
 14%|█▎        | 5158/37963 [16:07:49<100:18:06, 11.01s/it]
 14%|█▎        | 5159/37963 [16:07:59<97:58:47, 10.75s/it] 
 14%|█▎        | 5160/37963 [16:08:16<113:51:48, 12.50s/it]
                                                           
{'loss': '0.1859', 'grad_norm': '1.777', 'learning_rate': '1.942e-05', 'epoch': '0.1359'}

 14%|█▎        | 5160/37963 [16:08:16<113:51:48, 12.50s/it]
 14%|█▎        | 5161/37963 [16:08:34<129:16:42, 14.19s/it]
 14%|█▎        | 5162/37963 [16:08:44<117:59:29, 12.95s/it]
 14%|█▎        | 5163/37963 [16:08:54<110:21:03, 12.11s/it]
 14%|█▎        | 5164/37963 [16:09:04<104:32:07, 11.47s/it]
 14%|█▎        | 5165/37963 [16:09:14<100:53:15, 11.07s/it]
 14%|█▎        | 5166/37963 [16:09:30<115:07:54, 12.64s/it]
 14%|█▎        | 5167/37963 [16:09:40<107:48:12, 11.83s/it]
 14%|█▎        | 5168/37963 [16:09:50<103:16:29, 11.34s/it]
 14%|█▎        | 5169/37963 [16:10:00<98:49:20, 10.85s/it] 
 14%|█▎        | 5170/37963 [16:10:10<96:41:31, 10.61s/it]
                                                          
{'loss': '0.2038', 'grad_norm': '1.821', 'learning_rate': '1.941e-05', 'epoch': '0.1362'}

 14%|█▎        | 5170/37963 [16:10:10<96:41:31, 10.61s/it]
 14%|█▎        | 5171/37963 [16:10:20<95:16:37, 10.46s/it]
 14%|█▎        | 5172/37963 [16:10:37<111:44:43, 12.27s/it]
 14%|█▎        | 5173/37963 [16:10:47<105:56:55, 11.63s/it]
 14%|█▎        | 5174/37963 [16:10:57<101:55:59, 11.19s/it]
 14%|█▎        | 5175/37963 [16:11:07<99:00:05, 10.87s/it] 
 14%|█▎        | 5176/37963 [16:11:17<97:10:14, 10.67s/it]
 14%|█▎        | 5177/37963 [16:11:28<95:43:07, 10.51s/it]
 14%|█▎        | 5178/37963 [16:11:44<112:33:21, 12.36s/it]
 14%|█▎        | 5179/37963 [16:11:54<106:46:25, 11.72s/it]
 14%|█▎        | 5180/37963 [16:12:05<102:40:11, 11.27s/it]
                                                           
{'loss': '0.1866', 'grad_norm': '2.824', 'learning_rate': '1.941e-05', 'epoch': '0.1364'}

 14%|█▎        | 5180/37963 [16:12:05<102:40:11, 11.27s/it]
 14%|█▎        | 5181/37963 [16:12:15<99:31:03, 10.93s/it] 
 14%|█▎        | 5182/37963 [16:12:25<97:17:37, 10.68s/it]
 14%|█▎        | 5183/37963 [16:12:35<95:41:53, 10.51s/it]
 14%|█▎        | 5184/37963 [16:12:45<94:41:12, 10.40s/it]
 14%|█▎        | 5185/37963 [16:12:55<93:40:15, 10.29s/it]
 14%|█▎        | 5186/37963 [16:13:05<92:47:19, 10.19s/it]
 14%|█▎        | 5187/37963 [16:13:15<92:24:10, 10.15s/it]
 14%|█▎        | 5188/37963 [16:13:32<109:45:29, 12.06s/it]
 14%|█▎        | 5189/37963 [16:13:42<104:17:50, 11.46s/it]
 14%|█▎        | 5190/37963 [16:13:52<100:44:08, 11.07s/it]
                                                           
{'loss': '0.1939', 'grad_norm': '1.291', 'learning_rate': '1.941e-05', 'epoch': '0.1367'}

 14%|█▎        | 5190/37963 [16:13:52<100:44:08, 11.07s/it]
 14%|█▎        | 5191/37963 [16:14:02<97:43:14, 10.73s/it] 
 14%|█▎        | 5192/37963 [16:14:12<95:56:53, 10.54s/it]
 14%|█▎        | 5193/37963 [16:14:22<94:41:39, 10.40s/it]
 14%|█▎        | 5194/37963 [16:14:32<93:58:13, 10.32s/it]
 14%|█▎        | 5195/37963 [16:14:42<93:16:15, 10.25s/it]
 14%|█▎        | 5196/37963 [16:14:52<92:07:53, 10.12s/it]
 14%|█▎        | 5197/37963 [16:15:02<91:49:49, 10.09s/it]
 14%|█▎        | 5198/37963 [16:15:12<92:02:54, 10.11s/it]
 14%|█▎        | 5199/37963 [16:15:22<92:08:38, 10.12s/it]
 14%|█▎        | 5200/37963 [16:15:33<92:24:49, 10.15s/it]
                                                          
{'loss': '0.1911', 'grad_norm': '2.689', 'learning_rate': '1.941e-05', 'epoch': '0.137'}

 14%|█▎        | 5200/37963 [16:15:33<92:24:49, 10.15s/it]
 14%|█▎        | 5201/37963 [16:15:49<109:22:00, 12.02s/it]
 14%|█▎        | 5202/37963 [16:15:59<104:45:26, 11.51s/it]
 14%|█▎        | 5203/37963 [16:16:16<118:14:05, 12.99s/it]
 14%|█▎        | 5204/37963 [16:16:26<110:15:38, 12.12s/it]
 14%|█▎        | 5205/37963 [16:16:36<104:38:24, 11.50s/it]
 14%|█▎        | 5206/37963 [16:16:46<101:00:38, 11.10s/it]
 14%|█▎        | 5207/37963 [16:16:56<97:46:08, 10.75s/it] 
 14%|█▎        | 5208/37963 [16:17:06<96:07:58, 10.57s/it]
 14%|█▎        | 5209/37963 [16:17:16<94:13:53, 10.36s/it]
 14%|█▎        | 5210/37963 [16:17:34<115:21:12, 12.68s/it]
                                                           
{'loss': '0.187', 'grad_norm': '5.991', 'learning_rate': '1.94e-05', 'epoch': '0.1372'}

 14%|█▎        | 5210/37963 [16:17:34<115:21:12, 12.68s/it]
 14%|█▎        | 5211/37963 [16:17:51<125:57:06, 13.84s/it]
 14%|█▎        | 5212/37963 [16:18:01<115:43:58, 12.72s/it]
 14%|█▎        | 5213/37963 [16:18:17<126:02:35, 13.86s/it]
 14%|█▎        | 5214/37963 [16:18:27<114:38:24, 12.60s/it]
 14%|█▎        | 5215/37963 [16:18:37<108:07:51, 11.89s/it]
 14%|█▎        | 5216/37963 [16:18:47<103:06:07, 11.33s/it]
 14%|█▎        | 5217/37963 [16:18:57<99:21:00, 10.92s/it] 
 14%|█▎        | 5218/37963 [16:19:07<97:13:54, 10.69s/it]
 14%|█▎        | 5219/37963 [16:19:17<95:22:28, 10.49s/it]
 14%|█▍        | 5220/37963 [16:19:27<93:44:56, 10.31s/it]
                                                          
{'loss': '0.1942', 'grad_norm': '1.803', 'learning_rate': '1.94e-05', 'epoch': '0.1375'}

 14%|█▍        | 5220/37963 [16:19:27<93:44:56, 10.31s/it]
 14%|█▍        | 5221/37963 [16:19:37<93:02:13, 10.23s/it]
 14%|█▍        | 5222/37963 [16:19:48<93:24:05, 10.27s/it]
 14%|█▍        | 5223/37963 [16:20:04<109:43:28, 12.07s/it]
 14%|█▍        | 5224/37963 [16:20:20<120:48:00, 13.28s/it]
 14%|█▍        | 5225/37963 [16:20:30<112:11:04, 12.34s/it]
 14%|█▍        | 5226/37963 [16:20:40<106:12:40, 11.68s/it]
 14%|█▍        | 5227/37963 [16:20:51<102:14:08, 11.24s/it]
 14%|█▍        | 5228/37963 [16:21:01<98:58:45, 10.89s/it] 
 14%|█▍        | 5229/37963 [16:21:11<96:59:25, 10.67s/it]
 14%|█▍        | 5230/37963 [16:21:21<95:36:05, 10.51s/it]
                                                          
{'loss': '0.1974', 'grad_norm': '1.542', 'learning_rate': '1.94e-05', 'epoch': '0.1378'}

 14%|█▍        | 5230/37963 [16:21:21<95:36:05, 10.51s/it]
 14%|█▍        | 5231/37963 [16:21:31<94:32:43, 10.40s/it]
 14%|█▍        | 5232/37963 [16:21:41<93:32:29, 10.29s/it]
 14%|█▍        | 5233/37963 [16:21:51<93:15:19, 10.26s/it]
 14%|█▍        | 5234/37963 [16:22:02<93:10:52, 10.25s/it]
 14%|█▍        | 5235/37963 [16:22:12<92:50:43, 10.21s/it]
 14%|█▍        | 5236/37963 [16:22:21<91:18:20, 10.04s/it]
 14%|█▍        | 5237/37963 [16:22:38<109:32:24, 12.05s/it]
 14%|█▍        | 5238/37963 [16:22:48<104:27:37, 11.49s/it]
 14%|█▍        | 5239/37963 [16:22:58<100:43:41, 11.08s/it]
 14%|█▍        | 5240/37963 [16:23:08<97:15:02, 10.70s/it] 
                                                          
{'loss': '0.1781', 'grad_norm': '4.078', 'learning_rate': '1.939e-05', 'epoch': '0.138'}

 14%|█▍        | 5240/37963 [16:23:08<97:15:02, 10.70s/it]
 14%|█▍        | 5241/37963 [16:23:18<95:44:27, 10.53s/it]
 14%|█▍        | 5242/37963 [16:23:28<94:35:37, 10.41s/it]
 14%|█▍        | 5243/37963 [16:23:39<94:06:23, 10.35s/it]
 14%|█▍        | 5244/37963 [16:23:49<93:05:39, 10.24s/it]
 14%|█▍        | 5245/37963 [16:23:59<92:11:46, 10.14s/it]
 14%|█▍        | 5246/37963 [16:24:08<91:30:34, 10.07s/it]
 14%|█▍        | 5247/37963 [16:24:19<91:45:18, 10.10s/it]
 14%|█▍        | 5248/37963 [16:24:35<108:46:25, 11.97s/it]
 14%|█▍        | 5249/37963 [16:24:45<104:31:31, 11.50s/it]
 14%|█▍        | 5250/37963 [16:24:55<100:51:06, 11.10s/it]
                                                           
{'loss': '0.1869', 'grad_norm': '2.766', 'learning_rate': '1.939e-05', 'epoch': '0.1383'}

 14%|█▍        | 5250/37963 [16:24:55<100:51:06, 11.10s/it]
 14%|█▍        | 5251/37963 [16:25:06<98:02:51, 10.79s/it] 
 14%|█▍        | 5252/37963 [16:25:22<113:27:38, 12.49s/it]
 14%|█▍        | 5253/37963 [16:25:32<107:10:40, 11.80s/it]
 14%|█▍        | 5254/37963 [16:25:42<102:28:19, 11.28s/it]
 14%|█▍        | 5255/37963 [16:25:52<99:17:12, 10.93s/it] 
 14%|█▍        | 5256/37963 [16:26:02<96:57:39, 10.67s/it]
 14%|█▍        | 5257/37963 [16:26:12<94:39:46, 10.42s/it]
 14%|█▍        | 5258/37963 [16:26:22<93:36:55, 10.30s/it]
 14%|█▍        | 5259/37963 [16:26:40<114:37:22, 12.62s/it]
 14%|█▍        | 5260/37963 [16:26:57<126:42:07, 13.95s/it]
                                                           
{'loss': '0.1927', 'grad_norm': '2.068', 'learning_rate': '1.939e-05', 'epoch': '0.1386'}

 14%|█▍        | 5260/37963 [16:26:57<126:42:07, 13.95s/it]
 14%|█▍        | 5261/37963 [16:27:14<133:24:53, 14.69s/it]
 14%|█▍        | 5262/37963 [16:27:24<119:54:57, 13.20s/it]
 14%|█▍        | 5263/37963 [16:27:34<111:30:02, 12.28s/it]
 14%|█▍        | 5264/37963 [16:27:44<105:37:52, 11.63s/it]
 14%|█▍        | 5265/37963 [16:27:53<100:19:38, 11.05s/it]
 14%|█▍        | 5266/37963 [16:28:03<97:16:15, 10.71s/it] 
 14%|█▍        | 5267/37963 [16:28:14<95:45:20, 10.54s/it]
 14%|█▍        | 5268/37963 [16:28:23<94:04:39, 10.36s/it]
 14%|█▍        | 5269/37963 [16:28:34<93:23:04, 10.28s/it]
 14%|█▍        | 5270/37963 [16:28:50<109:12:09, 12.02s/it]
                                                           
{'loss': '0.1892', 'grad_norm': '2.582', 'learning_rate': '1.939e-05', 'epoch': '0.1388'}

 14%|█▍        | 5270/37963 [16:28:50<109:12:09, 12.02s/it]
 14%|█▍        | 5271/37963 [16:29:00<103:53:23, 11.44s/it]
 14%|█▍        | 5272/37963 [16:29:10<100:16:15, 11.04s/it]
 14%|█▍        | 5273/37963 [16:29:20<98:03:23, 10.80s/it] 
 14%|█▍        | 5274/37963 [16:29:36<113:08:23, 12.46s/it]
 14%|█▍        | 5275/37963 [16:29:47<106:45:20, 11.76s/it]
 14%|█▍        | 5276/37963 [16:29:57<102:03:20, 11.24s/it]
 14%|█▍        | 5277/37963 [16:30:07<98:59:46, 10.90s/it] 
 14%|█▍        | 5278/37963 [16:30:16<95:38:43, 10.53s/it]
 14%|█▍        | 5279/37963 [16:30:26<94:36:01, 10.42s/it]
 14%|█▍        | 5280/37963 [16:30:37<93:46:57, 10.33s/it]
                                                          
{'loss': '0.182', 'grad_norm': '1.954', 'learning_rate': '1.938e-05', 'epoch': '0.1391'}

 14%|█▍        | 5280/37963 [16:30:37<93:46:57, 10.33s/it]
 14%|█▍        | 5281/37963 [16:30:47<93:07:08, 10.26s/it]
 14%|█▍        | 5282/37963 [16:30:57<92:51:13, 10.23s/it]
 14%|█▍        | 5283/37963 [16:31:07<92:44:58, 10.22s/it]
 14%|█▍        | 5284/37963 [16:31:17<92:19:33, 10.17s/it]
 14%|█▍        | 5285/37963 [16:31:27<92:10:14, 10.15s/it]
 14%|█▍        | 5286/37963 [16:31:37<92:04:47, 10.14s/it]
 14%|█▍        | 5287/37963 [16:31:54<109:07:55, 12.02s/it]
 14%|█▍        | 5288/37963 [16:32:04<103:10:53, 11.37s/it]
 14%|█▍        | 5289/37963 [16:32:14<99:12:19, 10.93s/it] 
 14%|█▍        | 5290/37963 [16:32:24<97:09:13, 10.70s/it]
                                                          
{'loss': '0.1801', 'grad_norm': '1.466', 'learning_rate': '1.938e-05', 'epoch': '0.1393'}

 14%|█▍        | 5290/37963 [16:32:24<97:09:13, 10.70s/it]
 14%|█▍        | 5291/37963 [16:32:34<95:37:19, 10.54s/it]
 14%|█▍        | 5292/37963 [16:32:44<95:35:38, 10.53s/it]
 14%|█▍        | 5293/37963 [16:32:54<94:17:03, 10.39s/it]
 14%|█▍        | 5294/37963 [16:33:11<111:15:52, 12.26s/it]
 14%|█▍        | 5295/37963 [16:33:21<105:21:45, 11.61s/it]
 14%|█▍        | 5296/37963 [16:33:31<101:18:55, 11.17s/it]
 14%|█▍        | 5297/37963 [16:33:41<98:29:52, 10.86s/it] 
 14%|█▍        | 5298/37963 [16:33:52<96:42:13, 10.66s/it]
 14%|█▍        | 5299/37963 [16:34:02<95:24:02, 10.51s/it]
 14%|█▍        | 5300/37963 [16:34:18<111:29:31, 12.29s/it]
                                                           
{'loss': '0.1856', 'grad_norm': '2.904', 'learning_rate': '1.938e-05', 'epoch': '0.1396'}

 14%|█▍        | 5300/37963 [16:34:18<111:29:31, 12.29s/it]
 14%|█▍        | 5301/37963 [16:34:28<104:28:08, 11.51s/it]
 14%|█▍        | 5302/37963 [16:34:38<100:08:30, 11.04s/it]
 14%|█▍        | 5303/37963 [16:34:48<97:34:35, 10.76s/it] 
 14%|█▍        | 5304/37963 [16:34:58<95:46:13, 10.56s/it]
 14%|█▍        | 5305/37963 [16:35:08<94:34:09, 10.42s/it]
 14%|█▍        | 5306/37963 [16:35:18<93:51:35, 10.35s/it]
 14%|█▍        | 5307/37963 [16:35:42<130:08:46, 14.35s/it]
 14%|█▍        | 5308/37963 [16:35:52<118:46:48, 13.09s/it]
 14%|█▍        | 5309/37963 [16:36:02<110:58:32, 12.23s/it]
 14%|█▍        | 5310/37963 [16:36:12<105:03:42, 11.58s/it]
                                                           
{'loss': '0.1864', 'grad_norm': '1.686', 'learning_rate': '1.937e-05', 'epoch': '0.1399'}

 14%|█▍        | 5310/37963 [16:36:12<105:03:42, 11.58s/it]
 14%|█▍        | 5311/37963 [16:36:23<101:05:01, 11.14s/it]
 14%|█▍        | 5312/37963 [16:36:39<115:30:46, 12.74s/it]
 14%|█▍        | 5313/37963 [16:36:49<108:38:15, 11.98s/it]
 14%|█▍        | 5314/37963 [16:36:59<103:12:37, 11.38s/it]
 14%|█▍        | 5315/37963 [16:37:09<99:36:20, 10.98s/it] 
 14%|█▍        | 5316/37963 [16:37:19<97:28:23, 10.75s/it]
 14%|█▍        | 5317/37963 [16:37:30<95:36:52, 10.54s/it]
 14%|█▍        | 5318/37963 [16:37:40<94:05:05, 10.38s/it]
 14%|█▍        | 5319/37963 [16:37:50<93:09:20, 10.27s/it]
 14%|█▍        | 5320/37963 [16:38:00<92:32:19, 10.21s/it]
                                                          
{'loss': '0.1902', 'grad_norm': '2.768', 'learning_rate': '1.937e-05', 'epoch': '0.1401'}

 14%|█▍        | 5320/37963 [16:38:00<92:32:19, 10.21s/it]
 14%|█▍        | 5321/37963 [16:38:10<92:04:09, 10.15s/it]
 14%|█▍        | 5322/37963 [16:38:26<109:02:11, 12.03s/it]
 14%|█▍        | 5323/37963 [16:38:43<122:03:48, 13.46s/it]
 14%|█▍        | 5324/37963 [16:38:53<112:59:23, 12.46s/it]
 14%|█▍        | 5325/37963 [16:39:03<105:01:54, 11.59s/it]
 14%|█▍        | 5326/37963 [16:39:13<101:21:31, 11.18s/it]
 14%|█▍        | 5327/37963 [16:39:23<98:09:35, 10.83s/it] 
 14%|█▍        | 5328/37963 [16:39:33<95:40:30, 10.55s/it]
 14%|█▍        | 5329/37963 [16:39:43<94:27:18, 10.42s/it]
 14%|█▍        | 5330/37963 [16:39:53<93:18:46, 10.29s/it]
                                                          
{'loss': '0.1936', 'grad_norm': '5.336', 'learning_rate': '1.937e-05', 'epoch': '0.1404'}

 14%|█▍        | 5330/37963 [16:39:53<93:18:46, 10.29s/it]
 14%|█▍        | 5331/37963 [16:40:03<92:52:20, 10.25s/it]
 14%|█▍        | 5332/37963 [16:40:13<92:16:54, 10.18s/it]
 14%|█▍        | 5333/37963 [16:40:23<91:25:45, 10.09s/it]
 14%|█▍        | 5334/37963 [16:40:39<108:32:41, 11.98s/it]
 14%|█▍        | 5335/37963 [16:40:49<103:56:38, 11.47s/it]
 14%|█▍        | 5336/37963 [16:40:59<99:50:58, 11.02s/it] 
 14%|█▍        | 5337/37963 [16:41:10<98:14:36, 10.84s/it]
 14%|█▍        | 5338/37963 [16:41:20<96:18:34, 10.63s/it]
 14%|█▍        | 5339/37963 [16:41:30<94:21:39, 10.41s/it]
 14%|█▍        | 5340/37963 [16:41:40<93:40:26, 10.34s/it]
                                                          
{'loss': '0.1881', 'grad_norm': '1.005', 'learning_rate': '1.936e-05', 'epoch': '0.1407'}

 14%|█▍        | 5340/37963 [16:41:40<93:40:26, 10.34s/it]
 14%|█▍        | 5341/37963 [16:41:50<92:36:26, 10.22s/it]
 14%|█▍        | 5342/37963 [16:42:06<109:26:03, 12.08s/it]
 14%|█▍        | 5343/37963 [16:42:16<103:48:21, 11.46s/it]
 14%|█▍        | 5344/37963 [16:42:27<100:16:31, 11.07s/it]
 14%|█▍        | 5345/37963 [16:42:37<97:46:45, 10.79s/it] 
 14%|█▍        | 5346/37963 [16:42:47<96:08:13, 10.61s/it]
 14%|█▍        | 5347/37963 [16:42:57<94:43:53, 10.46s/it]
 14%|█▍        | 5348/37963 [16:43:14<111:39:05, 12.32s/it]
 14%|█▍        | 5349/37963 [16:43:24<105:53:28, 11.69s/it]
 14%|█▍        | 5350/37963 [16:43:34<100:36:10, 11.11s/it]
                                                           
{'loss': '0.1777', 'grad_norm': '3.559', 'learning_rate': '1.936e-05', 'epoch': '0.1409'}

 14%|█▍        | 5350/37963 [16:43:34<100:36:10, 11.11s/it]
 14%|█▍        | 5351/37963 [16:43:44<98:09:09, 10.83s/it] 
 14%|█▍        | 5352/37963 [16:43:54<96:26:40, 10.65s/it]
 14%|█▍        | 5353/37963 [16:44:04<94:56:08, 10.48s/it]
 14%|█▍        | 5354/37963 [16:44:14<93:24:26, 10.31s/it]
 14%|█▍        | 5355/37963 [16:44:24<91:53:45, 10.15s/it]
 14%|█▍        | 5356/37963 [16:44:33<90:34:10, 10.00s/it]
 14%|█▍        | 5357/37963 [16:44:51<111:33:12, 12.32s/it]
 14%|█▍        | 5358/37963 [16:45:08<124:11:07, 13.71s/it]
 14%|█▍        | 5359/37963 [16:45:18<114:21:33, 12.63s/it]
 14%|█▍        | 5360/37963 [16:45:28<107:36:08, 11.88s/it]
                                                           
{'loss': '0.1924', 'grad_norm': '0.9747', 'learning_rate': '1.936e-05', 'epoch': '0.1412'}

 14%|█▍        | 5360/37963 [16:45:28<107:36:08, 11.88s/it]
 14%|█▍        | 5361/37963 [16:45:39<102:42:49, 11.34s/it]
 14%|█▍        | 5362/37963 [16:45:55<116:51:18, 12.90s/it]
 14%|█▍        | 5363/37963 [16:46:05<109:42:02, 12.11s/it]
 14%|█▍        | 5364/37963 [16:46:15<104:23:13, 11.53s/it]
 14%|█▍        | 5365/37963 [16:46:26<100:24:26, 11.09s/it]
 14%|█▍        | 5366/37963 [16:46:35<97:04:15, 10.72s/it] 
 14%|█▍        | 5367/37963 [16:46:52<113:29:09, 12.53s/it]
 14%|█▍        | 5368/37963 [16:47:02<107:17:57, 11.85s/it]
 14%|█▍        | 5369/37963 [16:47:12<102:07:53, 11.28s/it]
 14%|█▍        | 5370/37963 [16:47:23<99:12:45, 10.96s/it] 
                                                          
{'loss': '0.1818', 'grad_norm': '1.248', 'learning_rate': '1.936e-05', 'epoch': '0.1415'}

 14%|█▍        | 5370/37963 [16:47:23<99:12:45, 10.96s/it]
 14%|█▍        | 5371/37963 [16:47:33<96:52:38, 10.70s/it]
 14%|█▍        | 5372/37963 [16:47:50<113:31:18, 12.54s/it]
 14%|█▍        | 5373/37963 [16:48:00<107:01:15, 11.82s/it]
 14%|█▍        | 5374/37963 [16:48:09<101:13:34, 11.18s/it]
 14%|█▍        | 5375/37963 [16:48:19<98:21:50, 10.87s/it] 
 14%|█▍        | 5376/37963 [16:48:29<93:41:18, 10.35s/it]
 14%|█▍        | 5377/37963 [16:48:39<92:54:30, 10.26s/it]
 14%|█▍        | 5378/37963 [16:48:49<92:08:18, 10.18s/it]
 14%|█▍        | 5379/37963 [16:48:59<91:44:19, 10.14s/it]
 14%|█▍        | 5380/37963 [16:49:09<91:48:01, 10.14s/it]
                                                          
{'loss': '0.1805', 'grad_norm': '1.993', 'learning_rate': '1.935e-05', 'epoch': '0.1417'}

 14%|█▍        | 5380/37963 [16:49:09<91:48:01, 10.14s/it]
 14%|█▍        | 5381/37963 [16:49:18<89:43:42,  9.91s/it]
 14%|█▍        | 5382/37963 [16:49:28<90:07:13,  9.96s/it]
 14%|█▍        | 5383/37963 [16:49:45<107:24:16, 11.87s/it]
 14%|█▍        | 5384/37963 [16:49:55<102:48:01, 11.36s/it]
 14%|█▍        | 5385/37963 [16:50:05<99:20:23, 10.98s/it] 
 14%|█▍        | 5386/37963 [16:50:15<97:07:22, 10.73s/it]
 14%|█▍        | 5387/37963 [16:50:25<95:22:31, 10.54s/it]
 14%|█▍        | 5388/37963 [16:50:35<94:06:47, 10.40s/it]
 14%|█▍        | 5389/37963 [16:50:52<111:17:28, 12.30s/it]
 14%|█▍        | 5390/37963 [16:51:02<104:38:27, 11.57s/it]
                                                           
{'loss': '0.1916', 'grad_norm': '1.434', 'learning_rate': '1.935e-05', 'epoch': '0.142'}

 14%|█▍        | 5390/37963 [16:51:02<104:38:27, 11.57s/it]
 14%|█▍        | 5391/37963 [16:51:12<100:41:56, 11.13s/it]
 14%|█▍        | 5392/37963 [16:51:22<98:06:00, 10.84s/it] 
 14%|█▍        | 5393/37963 [16:51:32<96:03:25, 10.62s/it]
 14%|█▍        | 5394/37963 [16:51:42<94:48:21, 10.48s/it]
 14%|█▍        | 5395/37963 [16:51:59<111:27:04, 12.32s/it]
 14%|█▍        | 5396/37963 [16:52:09<105:30:28, 11.66s/it]
 14%|█▍        | 5397/37963 [16:52:19<101:28:09, 11.22s/it]
 14%|█▍        | 5398/37963 [16:52:29<98:24:19, 10.88s/it] 
 14%|█▍        | 5399/37963 [16:52:39<94:38:06, 10.46s/it]
 14%|█▍        | 5400/37963 [16:52:48<92:18:05, 10.20s/it]
                                                          
{'loss': '0.1825', 'grad_norm': '2.263', 'learning_rate': '1.935e-05', 'epoch': '0.1422'}

 14%|█▍        | 5400/37963 [16:52:48<92:18:05, 10.20s/it]
 14%|█▍        | 5401/37963 [16:52:58<91:15:35, 10.09s/it]
 14%|█▍        | 5402/37963 [16:53:08<91:01:24, 10.06s/it]
 14%|█▍        | 5403/37963 [16:53:18<90:23:22,  9.99s/it]
 14%|█▍        | 5404/37963 [16:53:28<90:37:32, 10.02s/it]
 14%|█▍        | 5405/37963 [16:53:52<128:49:47, 14.24s/it]
 14%|█▍        | 5406/37963 [16:54:02<117:33:31, 13.00s/it]
 14%|█▍        | 5407/37963 [16:54:12<109:19:57, 12.09s/it]
 14%|█▍        | 5408/37963 [16:54:22<103:57:24, 11.50s/it]
 14%|█▍        | 5409/37963 [16:54:33<100:05:39, 11.07s/it]
 14%|█▍        | 5410/37963 [16:54:49<114:25:09, 12.65s/it]
                                                           
{'loss': '0.1762', 'grad_norm': '4.39', 'learning_rate': '1.934e-05', 'epoch': '0.1425'}

 14%|█▍        | 5410/37963 [16:54:49<114:25:09, 12.65s/it]
 14%|█▍        | 5411/37963 [16:54:59<107:38:19, 11.90s/it]
 14%|█▍        | 5412/37963 [16:55:09<102:49:48, 11.37s/it]
 14%|█▍        | 5413/37963 [16:55:19<99:26:38, 11.00s/it] 
 14%|█▍        | 5414/37963 [16:55:29<97:07:24, 10.74s/it]
 14%|█▍        | 5415/37963 [16:55:40<95:20:30, 10.55s/it]
 14%|█▍        | 5416/37963 [16:55:50<94:13:41, 10.42s/it]
 14%|█▍        | 5417/37963 [16:56:06<110:33:10, 12.23s/it]
 14%|█▍        | 5418/37963 [16:56:23<122:17:48, 13.53s/it]
 14%|█▍        | 5419/37963 [16:56:33<112:50:02, 12.48s/it]
 14%|█▍        | 5420/37963 [16:56:43<106:25:13, 11.77s/it]
                                                           
{'loss': '0.194', 'grad_norm': '1.255', 'learning_rate': '1.934e-05', 'epoch': '0.1428'}

 14%|█▍        | 5420/37963 [16:56:43<106:25:13, 11.77s/it]
 14%|█▍        | 5421/37963 [16:56:53<101:33:20, 11.23s/it]
 14%|█▍        | 5422/37963 [16:57:03<98:31:51, 10.90s/it] 
 14%|█▍        | 5423/37963 [16:57:13<96:16:33, 10.65s/it]
 14%|█▍        | 5424/37963 [16:57:23<94:30:07, 10.46s/it]
 14%|█▍        | 5425/37963 [16:57:33<93:02:13, 10.29s/it]
 14%|█▍        | 5426/37963 [16:57:43<93:00:19, 10.29s/it]
 14%|█▍        | 5427/37963 [16:57:53<92:40:49, 10.25s/it]
 14%|█▍        | 5428/37963 [16:58:03<92:16:52, 10.21s/it]
 14%|█▍        | 5429/37963 [16:58:14<91:51:30, 10.16s/it]
 14%|█▍        | 5430/37963 [16:58:24<91:38:15, 10.14s/it]
                                                          
{'loss': '0.1847', 'grad_norm': '2.52', 'learning_rate': '1.934e-05', 'epoch': '0.143'}

 14%|█▍        | 5430/37963 [16:58:24<91:38:15, 10.14s/it]
 14%|█▍        | 5431/37963 [16:58:40<107:34:15, 11.90s/it]
 14%|█▍        | 5432/37963 [16:58:49<102:03:21, 11.29s/it]
 14%|█▍        | 5433/37963 [16:59:00<99:09:29, 10.97s/it] 
 14%|█▍        | 5434/37963 [16:59:10<96:36:26, 10.69s/it]
 14%|█▍        | 5435/37963 [16:59:20<95:07:35, 10.53s/it]
 14%|█▍        | 5436/37963 [16:59:30<94:33:48, 10.47s/it]
 14%|█▍        | 5437/37963 [16:59:47<111:37:20, 12.35s/it]
 14%|█▍        | 5438/37963 [16:59:57<105:25:45, 11.67s/it]
 14%|█▍        | 5439/37963 [17:00:07<100:44:54, 11.15s/it]
 14%|█▍        | 5440/37963 [17:00:17<98:01:45, 10.85s/it] 
                                                          
{'loss': '0.1876', 'grad_norm': '2.66', 'learning_rate': '1.933e-05', 'epoch': '0.1433'}

 14%|█▍        | 5440/37963 [17:00:17<98:01:45, 10.85s/it]
 14%|█▍        | 5441/37963 [17:00:27<96:03:52, 10.63s/it]
 14%|█▍        | 5442/37963 [17:00:37<94:13:04, 10.43s/it]
 14%|█▍        | 5443/37963 [17:00:54<111:11:13, 12.31s/it]
 14%|█▍        | 5444/37963 [17:01:04<104:46:32, 11.60s/it]
 14%|█▍        | 5445/37963 [17:01:14<100:26:19, 11.12s/it]
 14%|█▍        | 5446/37963 [17:01:24<97:44:59, 10.82s/it] 
 14%|█▍        | 5447/37963 [17:01:34<95:54:35, 10.62s/it]
 14%|█▍        | 5448/37963 [17:01:44<92:54:18, 10.29s/it]
 14%|█▍        | 5449/37963 [17:01:54<92:40:41, 10.26s/it]
 14%|█▍        | 5450/37963 [17:02:03<90:41:11, 10.04s/it]
                                                          
{'loss': '0.1833', 'grad_norm': '1.842', 'learning_rate': '1.933e-05', 'epoch': '0.1436'}

 14%|█▍        | 5450/37963 [17:02:03<90:41:11, 10.04s/it]
 14%|█▍        | 5451/37963 [17:02:14<90:55:45, 10.07s/it]
 14%|█▍        | 5452/37963 [17:02:23<90:00:31,  9.97s/it]
 14%|█▍        | 5453/37963 [17:02:40<107:41:27, 11.93s/it]
 14%|█▍        | 5454/37963 [17:02:50<102:43:46, 11.38s/it]
 14%|█▍        | 5455/37963 [17:03:08<121:01:02, 13.40s/it]
 14%|█▍        | 5456/37963 [17:03:18<111:49:03, 12.38s/it]
 14%|█▍        | 5457/37963 [17:03:35<123:37:21, 13.69s/it]
 14%|█▍        | 5458/37963 [17:03:45<114:02:39, 12.63s/it]
 14%|█▍        | 5459/37963 [17:03:55<107:10:39, 11.87s/it]
 14%|█▍        | 5460/37963 [17:04:05<101:37:06, 11.26s/it]
                                                           
{'loss': '0.1882', 'grad_norm': '2.21', 'learning_rate': '1.933e-05', 'epoch': '0.1438'}

 14%|█▍        | 5460/37963 [17:04:05<101:37:06, 11.26s/it]
 14%|█▍        | 5461/37963 [17:04:15<99:15:52, 10.99s/it] 
 14%|█▍        | 5462/37963 [17:04:25<96:44:26, 10.72s/it]
 14%|█▍        | 5463/37963 [17:04:35<95:14:26, 10.55s/it]
 14%|█▍        | 5464/37963 [17:04:46<94:29:47, 10.47s/it]
 14%|█▍        | 5465/37963 [17:04:56<93:14:16, 10.33s/it]
 14%|█▍        | 5466/37963 [17:05:12<110:16:16, 12.22s/it]
 14%|█▍        | 5467/37963 [17:05:22<104:49:01, 11.61s/it]
 14%|█▍        | 5468/37963 [17:05:39<118:24:21, 13.12s/it]
 14%|█▍        | 5469/37963 [17:05:49<110:00:27, 12.19s/it]
 14%|█▍        | 5470/37963 [17:06:00<105:08:12, 11.65s/it]
                                                           
{'loss': '0.1918', 'grad_norm': '2.459', 'learning_rate': '1.933e-05', 'epoch': '0.1441'}

 14%|█▍        | 5470/37963 [17:06:00<105:08:12, 11.65s/it]
 14%|█▍        | 5471/37963 [17:06:10<100:57:01, 11.18s/it]
 14%|█▍        | 5472/37963 [17:06:19<97:18:38, 10.78s/it] 
 14%|█▍        | 5473/37963 [17:06:30<95:37:37, 10.60s/it]
 14%|█▍        | 5474/37963 [17:06:40<94:09:54, 10.43s/it]
 14%|█▍        | 5475/37963 [17:06:50<93:11:28, 10.33s/it]
 14%|█▍        | 5476/37963 [17:06:59<91:17:12, 10.12s/it]
 14%|█▍        | 5477/37963 [17:07:10<91:34:46, 10.15s/it]
 14%|█▍        | 5478/37963 [17:07:26<107:25:24, 11.90s/it]
 14%|█▍        | 5479/37963 [17:07:36<102:41:02, 11.38s/it]
 14%|█▍        | 5480/37963 [17:07:46<99:29:40, 11.03s/it] 
                                                          
{'loss': '0.1853', 'grad_norm': '0.804', 'learning_rate': '1.932e-05', 'epoch': '0.1444'}

 14%|█▍        | 5480/37963 [17:07:46<99:29:40, 11.03s/it]
 14%|█▍        | 5481/37963 [17:07:56<97:09:04, 10.77s/it]
 14%|█▍        | 5482/37963 [17:08:06<95:09:57, 10.55s/it]
 14%|█▍        | 5483/37963 [17:08:16<94:10:42, 10.44s/it]
 14%|█▍        | 5484/37963 [17:08:26<91:42:23, 10.16s/it]
 14%|█▍        | 5485/37963 [17:08:35<90:10:29, 10.00s/it]
 14%|█▍        | 5486/37963 [17:08:46<90:21:50, 10.02s/it]
 14%|█▍        | 5487/37963 [17:09:02<107:33:39, 11.92s/it]
 14%|█▍        | 5488/37963 [17:09:12<102:16:53, 11.34s/it]
 14%|█▍        | 5489/37963 [17:09:22<99:38:12, 11.05s/it] 
 14%|█▍        | 5490/37963 [17:09:32<96:48:12, 10.73s/it]
                                                          
{'loss': '0.1816', 'grad_norm': '1.372', 'learning_rate': '1.932e-05', 'epoch': '0.1446'}

 14%|█▍        | 5490/37963 [17:09:32<96:48:12, 10.73s/it]
 14%|█▍        | 5491/37963 [17:09:42<95:00:51, 10.53s/it]
 14%|█▍        | 5492/37963 [17:09:59<111:59:50, 12.42s/it]
 14%|█▍        | 5493/37963 [17:10:09<105:35:42, 11.71s/it]
 14%|█▍        | 5494/37963 [17:10:19<101:21:08, 11.24s/it]
 14%|█▍        | 5495/37963 [17:10:29<97:48:14, 10.84s/it] 
 14%|█▍        | 5496/37963 [17:10:39<95:17:56, 10.57s/it]
 14%|█▍        | 5497/37963 [17:10:49<93:25:24, 10.36s/it]
 14%|█▍        | 5498/37963 [17:10:59<92:52:51, 10.30s/it]
 14%|█▍        | 5499/37963 [17:11:09<92:24:26, 10.25s/it]
 14%|█▍        | 5500/37963 [17:11:20<92:21:13, 10.24s/it]
                                                          
{'loss': '0.1878', 'grad_norm': '0.7093', 'learning_rate': '1.932e-05', 'epoch': '0.1449'}

 14%|█▍        | 5500/37963 [17:11:20<92:21:13, 10.24s/it]
 14%|█▍        | 5501/37963 [17:11:36<108:07:26, 11.99s/it]
 14%|█▍        | 5502/37963 [17:11:53<122:49:19, 13.62s/it]
 14%|█▍        | 5503/37963 [17:12:03<112:38:26, 12.49s/it]
 14%|█▍        | 5504/37963 [17:12:13<105:22:29, 11.69s/it]
 15%|█▍        | 5505/37963 [17:12:29<118:14:57, 13.12s/it]
 15%|█▍        | 5506/37963 [17:12:39<110:16:49, 12.23s/it]
 15%|█▍        | 5507/37963 [17:12:49<103:53:21, 11.52s/it]
 15%|█▍        | 5508/37963 [17:12:59<100:03:40, 11.10s/it]
 15%|█▍        | 5509/37963 [17:13:09<97:01:20, 10.76s/it] 
 15%|█▍        | 5510/37963 [17:13:20<95:33:38, 10.60s/it]
                                                          
{'loss': '0.197', 'grad_norm': '2.411', 'learning_rate': '1.931e-05', 'epoch': '0.1451'}

 15%|█▍        | 5510/37963 [17:13:20<95:33:38, 10.60s/it]
 15%|█▍        | 5511/37963 [17:13:30<94:10:21, 10.45s/it]
 15%|█▍        | 5512/37963 [17:13:40<93:44:35, 10.40s/it]
 15%|█▍        | 5513/37963 [17:13:57<110:48:47, 12.29s/it]
 15%|█▍        | 5514/37963 [17:14:07<105:02:09, 11.65s/it]
 15%|█▍        | 5515/37963 [17:14:17<102:00:05, 11.32s/it]
 15%|█▍        | 5516/37963 [17:14:28<99:40:53, 11.06s/it] 
 15%|█▍        | 5517/37963 [17:14:44<114:52:29, 12.75s/it]
 15%|█▍        | 5518/37963 [17:14:54<107:09:48, 11.89s/it]
 15%|█▍        | 5519/37963 [17:15:05<102:30:00, 11.37s/it]
 15%|█▍        | 5520/37963 [17:15:15<99:04:49, 10.99s/it] 
                                                          
{'loss': '0.1864', 'grad_norm': '2.608', 'learning_rate': '1.931e-05', 'epoch': '0.1454'}

 15%|█▍        | 5520/37963 [17:15:15<99:04:49, 10.99s/it]
 15%|█▍        | 5521/37963 [17:15:25<96:50:40, 10.75s/it]
 15%|█▍        | 5522/37963 [17:15:35<94:46:25, 10.52s/it]
 15%|█▍        | 5523/37963 [17:15:45<93:41:32, 10.40s/it]
 15%|█▍        | 5524/37963 [17:15:55<93:17:57, 10.35s/it]
 15%|█▍        | 5525/37963 [17:16:05<92:31:19, 10.27s/it]
 15%|█▍        | 5526/37963 [17:16:16<92:36:21, 10.28s/it]
 15%|█▍        | 5527/37963 [17:16:32<109:05:46, 12.11s/it]
 15%|█▍        | 5528/37963 [17:16:42<103:45:30, 11.52s/it]
 15%|█▍        | 5529/37963 [17:16:52<99:33:14, 11.05s/it] 
 15%|█▍        | 5530/37963 [17:17:02<96:41:36, 10.73s/it]
                                                          
{'loss': '0.1875', 'grad_norm': '2.481', 'learning_rate': '1.931e-05', 'epoch': '0.1457'}

 15%|█▍        | 5530/37963 [17:17:02<96:41:36, 10.73s/it]
 15%|█▍        | 5531/37963 [17:17:12<94:34:47, 10.50s/it]
 15%|█▍        | 5532/37963 [17:17:21<91:58:46, 10.21s/it]
 15%|█▍        | 5533/37963 [17:17:31<90:53:51, 10.09s/it]
 15%|█▍        | 5534/37963 [17:17:41<90:47:51, 10.08s/it]
 15%|█▍        | 5535/37963 [17:17:58<107:20:11, 11.92s/it]
 15%|█▍        | 5536/37963 [17:18:08<102:39:44, 11.40s/it]
 15%|█▍        | 5537/37963 [17:18:18<98:52:17, 10.98s/it] 
 15%|█▍        | 5538/37963 [17:18:28<96:55:02, 10.76s/it]
 15%|█▍        | 5539/37963 [17:18:38<95:44:57, 10.63s/it]
 15%|█▍        | 5540/37963 [17:18:48<94:19:20, 10.47s/it]
                                                          
{'loss': '0.1953', 'grad_norm': '2.105', 'learning_rate': '1.93e-05', 'epoch': '0.1459'}

 15%|█▍        | 5540/37963 [17:18:48<94:19:20, 10.47s/it]
 15%|█▍        | 5541/37963 [17:18:59<93:22:48, 10.37s/it]
 15%|█▍        | 5542/37963 [17:19:15<109:26:16, 12.15s/it]
 15%|█▍        | 5543/37963 [17:19:25<104:32:03, 11.61s/it]
 15%|█▍        | 5544/37963 [17:19:35<100:12:13, 11.13s/it]
 15%|█▍        | 5545/37963 [17:19:45<97:28:01, 10.82s/it] 
 15%|█▍        | 5546/37963 [17:19:55<95:23:57, 10.59s/it]
 15%|█▍        | 5547/37963 [17:20:05<93:56:31, 10.43s/it]
 15%|█▍        | 5548/37963 [17:20:15<92:54:55, 10.32s/it]
 15%|█▍        | 5549/37963 [17:20:26<92:13:16, 10.24s/it]
 15%|█▍        | 5550/37963 [17:20:42<109:16:02, 12.14s/it]
                                                           
{'loss': '0.1858', 'grad_norm': '2.049', 'learning_rate': '1.93e-05', 'epoch': '0.1462'}

 15%|█▍        | 5550/37963 [17:20:42<109:16:02, 12.14s/it]
 15%|█▍        | 5551/37963 [17:21:00<124:56:04, 13.88s/it]
 15%|█▍        | 5552/37963 [17:21:17<132:27:56, 14.71s/it]
 15%|█▍        | 5553/37963 [17:21:27<119:57:37, 13.32s/it]
 15%|█▍        | 5554/37963 [17:21:37<111:06:50, 12.34s/it]
 15%|█▍        | 5555/37963 [17:21:47<105:12:58, 11.69s/it]
 15%|█▍        | 5556/37963 [17:21:57<100:22:02, 11.15s/it]
 15%|█▍        | 5557/37963 [17:22:07<97:23:56, 10.82s/it] 
 15%|█▍        | 5558/37963 [17:22:17<95:13:17, 10.58s/it]
 15%|█▍        | 5559/37963 [17:22:27<93:22:51, 10.37s/it]
 15%|█▍        | 5560/37963 [17:22:37<92:37:00, 10.29s/it]
                                                          
{'loss': '0.1734', 'grad_norm': '1.989', 'learning_rate': '1.93e-05', 'epoch': '0.1465'}

 15%|█▍        | 5560/37963 [17:22:37<92:37:00, 10.29s/it]
 15%|█▍        | 5561/37963 [17:22:47<92:17:04, 10.25s/it]
 15%|█▍        | 5562/37963 [17:22:57<91:48:55, 10.20s/it]
 15%|█▍        | 5563/37963 [17:23:13<107:59:32, 12.00s/it]
 15%|█▍        | 5564/37963 [17:23:23<102:49:01, 11.42s/it]
 15%|█▍        | 5565/37963 [17:23:34<99:11:20, 11.02s/it] 
 15%|█▍        | 5566/37963 [17:23:44<96:22:23, 10.71s/it]
 15%|█▍        | 5567/37963 [17:24:00<111:38:39, 12.41s/it]
 15%|█▍        | 5568/37963 [17:24:10<104:44:39, 11.64s/it]
 15%|█▍        | 5569/37963 [17:24:20<100:01:25, 11.12s/it]
 15%|█▍        | 5570/37963 [17:24:29<95:44:24, 10.64s/it] 
                                                          
{'loss': '0.1814', 'grad_norm': '4.229', 'learning_rate': '1.929e-05', 'epoch': '0.1467'}

 15%|█▍        | 5570/37963 [17:24:29<95:44:24, 10.64s/it]
 15%|█▍        | 5571/37963 [17:24:39<94:08:11, 10.46s/it]
 15%|█▍        | 5572/37963 [17:24:49<93:23:36, 10.38s/it]
 15%|█▍        | 5573/37963 [17:24:59<92:28:28, 10.28s/it]
 15%|█▍        | 5574/37963 [17:25:09<91:45:49, 10.20s/it]
 15%|█▍        | 5575/37963 [17:25:20<91:28:43, 10.17s/it]
 15%|█▍        | 5576/37963 [17:25:36<107:56:04, 12.00s/it]
 15%|█▍        | 5577/37963 [17:25:46<102:41:18, 11.41s/it]
 15%|█▍        | 5578/37963 [17:25:56<98:02:09, 10.90s/it] 
 15%|█▍        | 5579/37963 [17:26:06<95:27:48, 10.61s/it]
 15%|█▍        | 5580/37963 [17:26:15<93:38:07, 10.41s/it]
                                                          
{'loss': '0.1971', 'grad_norm': '3.623', 'learning_rate': '1.929e-05', 'epoch': '0.147'}

 15%|█▍        | 5580/37963 [17:26:15<93:38:07, 10.41s/it]
 15%|█▍        | 5581/37963 [17:26:26<92:40:23, 10.30s/it]
 15%|█▍        | 5582/37963 [17:26:36<92:06:02, 10.24s/it]
 15%|█▍        | 5583/37963 [17:26:46<91:29:16, 10.17s/it]
 15%|█▍        | 5584/37963 [17:27:02<107:57:30, 12.00s/it]
 15%|█▍        | 5585/37963 [17:27:12<102:42:43, 11.42s/it]
 15%|█▍        | 5586/37963 [17:27:22<98:40:12, 10.97s/it] 
 15%|█▍        | 5587/37963 [17:27:32<96:15:37, 10.70s/it]
 15%|█▍        | 5588/37963 [17:27:42<94:35:41, 10.52s/it]
 15%|█▍        | 5589/37963 [17:27:52<93:10:35, 10.36s/it]
 15%|█▍        | 5590/37963 [17:28:09<110:06:57, 12.25s/it]
                                                           
{'loss': '0.1829', 'grad_norm': '1.4', 'learning_rate': '1.929e-05', 'epoch': '0.1472'}

 15%|█▍        | 5590/37963 [17:28:09<110:06:57, 12.25s/it]
 15%|█▍        | 5591/37963 [17:28:18<103:20:04, 11.49s/it]
 15%|█▍        | 5592/37963 [17:28:28<99:11:16, 11.03s/it] 
 15%|█▍        | 5593/37963 [17:28:38<95:37:47, 10.64s/it]
 15%|█▍        | 5594/37963 [17:28:48<94:18:15, 10.49s/it]
 15%|█▍        | 5595/37963 [17:28:58<92:20:12, 10.27s/it]
 15%|█▍        | 5596/37963 [17:29:08<90:44:10, 10.09s/it]
 15%|█▍        | 5597/37963 [17:29:18<90:39:48, 10.08s/it]
 15%|█▍        | 5598/37963 [17:29:28<89:58:20, 10.01s/it]
 15%|█▍        | 5599/37963 [17:29:58<145:35:57, 16.20s/it]
 15%|█▍        | 5600/37963 [17:30:08<129:23:18, 14.39s/it]
                                                           
{'loss': '0.1854', 'grad_norm': '4.022', 'learning_rate': '1.928e-05', 'epoch': '0.1475'}

 15%|█▍        | 5600/37963 [17:30:08<129:23:18, 14.39s/it]
 15%|█▍        | 5601/37963 [17:30:18<117:48:09, 13.10s/it]
 15%|█▍        | 5602/37963 [17:30:29<109:46:33, 12.21s/it]
 15%|█▍        | 5603/37963 [17:30:39<103:54:20, 11.56s/it]
 15%|█▍        | 5604/37963 [17:30:49<100:18:07, 11.16s/it]
 15%|█▍        | 5605/37963 [17:30:59<97:04:32, 10.80s/it] 
 15%|█▍        | 5606/37963 [17:31:08<93:49:47, 10.44s/it]
 15%|█▍        | 5607/37963 [17:31:19<92:53:40, 10.34s/it]
 15%|█▍        | 5608/37963 [17:31:29<92:04:14, 10.24s/it]
 15%|█▍        | 5609/37963 [17:31:39<91:34:06, 10.19s/it]
 15%|█▍        | 5610/37963 [17:31:48<90:21:43, 10.05s/it]
                                                          
{'loss': '0.1894', 'grad_norm': '3.866', 'learning_rate': '1.928e-05', 'epoch': '0.1478'}

 15%|█▍        | 5610/37963 [17:31:48<90:21:43, 10.05s/it]
 15%|█▍        | 5611/37963 [17:31:58<90:26:52, 10.06s/it]
 15%|█▍        | 5612/37963 [17:32:15<108:10:50, 12.04s/it]
 15%|█▍        | 5613/37963 [17:32:25<103:07:09, 11.48s/it]
 15%|█▍        | 5614/37963 [17:32:35<99:17:15, 11.05s/it] 
 15%|█▍        | 5615/37963 [17:32:46<97:15:58, 10.82s/it]
 15%|█▍        | 5616/37963 [17:33:02<112:34:56, 12.53s/it]
 15%|█▍        | 5617/37963 [17:33:12<106:06:10, 11.81s/it]
 15%|█▍        | 5618/37963 [17:33:22<101:28:20, 11.29s/it]
 15%|█▍        | 5619/37963 [17:33:33<98:36:59, 10.98s/it] 
 15%|█▍        | 5620/37963 [17:33:43<96:24:59, 10.73s/it]
                                                          
{'loss': '0.1765', 'grad_norm': '1.8', 'learning_rate': '1.928e-05', 'epoch': '0.148'}

 15%|█▍        | 5620/37963 [17:33:43<96:24:59, 10.73s/it]
 15%|█▍        | 5621/37963 [17:33:53<95:30:29, 10.63s/it]
 15%|█▍        | 5622/37963 [17:34:03<92:58:49, 10.35s/it]
 15%|█▍        | 5623/37963 [17:34:19<109:12:35, 12.16s/it]
 15%|█▍        | 5624/37963 [17:34:29<104:04:17, 11.59s/it]
 15%|█▍        | 5625/37963 [17:34:40<100:04:29, 11.14s/it]
 15%|█▍        | 5626/37963 [17:34:50<97:16:31, 10.83s/it] 
 15%|█▍        | 5627/37963 [17:35:00<95:38:11, 10.65s/it]
 15%|█▍        | 5628/37963 [17:35:10<94:08:02, 10.48s/it]
 15%|█▍        | 5629/37963 [17:35:20<93:02:37, 10.36s/it]
 15%|█▍        | 5630/37963 [17:35:30<92:09:50, 10.26s/it]
                                                          
{'loss': '0.1812', 'grad_norm': '3.502', 'learning_rate': '1.928e-05', 'epoch': '0.1483'}

 15%|█▍        | 5630/37963 [17:35:30<92:09:50, 10.26s/it]
 15%|█▍        | 5631/37963 [17:35:40<91:39:16, 10.21s/it]
 15%|█▍        | 5632/37963 [17:35:56<106:55:16, 11.91s/it]
 15%|█▍        | 5633/37963 [17:36:06<102:30:03, 11.41s/it]
 15%|█▍        | 5634/37963 [17:36:17<99:41:48, 11.10s/it] 
 15%|█▍        | 5635/37963 [17:36:27<97:08:08, 10.82s/it]
 15%|█▍        | 5636/37963 [17:36:37<95:17:09, 10.61s/it]
 15%|█▍        | 5637/37963 [17:36:47<94:16:04, 10.50s/it]
 15%|█▍        | 5638/37963 [17:37:04<110:12:13, 12.27s/it]
 15%|█▍        | 5639/37963 [17:37:14<104:27:15, 11.63s/it]
 15%|█▍        | 5640/37963 [17:37:24<99:40:45, 11.10s/it] 
                                                          
{'loss': '0.1827', 'grad_norm': '4.625', 'learning_rate': '1.927e-05', 'epoch': '0.1486'}

 15%|█▍        | 5640/37963 [17:37:24<99:40:45, 11.10s/it]
 15%|█▍        | 5641/37963 [17:37:34<96:47:19, 10.78s/it]
 15%|█▍        | 5642/37963 [17:37:44<95:06:18, 10.59s/it]
 15%|█▍        | 5643/37963 [17:37:54<93:24:43, 10.40s/it]
 15%|█▍        | 5644/37963 [17:38:04<92:36:40, 10.32s/it]
 15%|█▍        | 5645/37963 [17:38:14<92:20:47, 10.29s/it]
 15%|█▍        | 5646/37963 [17:38:24<91:57:59, 10.24s/it]
 15%|█▍        | 5647/37963 [17:38:40<108:02:22, 12.04s/it]
 15%|█▍        | 5648/37963 [17:38:58<123:53:04, 13.80s/it]
 15%|█▍        | 5649/37963 [17:39:08<113:51:21, 12.68s/it]
 15%|█▍        | 5650/37963 [17:39:25<124:06:52, 13.83s/it]
                                                           
{'loss': '0.1755', 'grad_norm': '4.877', 'learning_rate': '1.927e-05', 'epoch': '0.1488'}

 15%|█▍        | 5650/37963 [17:39:25<124:06:52, 13.83s/it]
 15%|█▍        | 5651/37963 [17:39:35<112:52:46, 12.58s/it]
 15%|█▍        | 5652/37963 [17:39:45<106:35:47, 11.88s/it]
 15%|█▍        | 5653/37963 [17:39:55<102:13:58, 11.39s/it]
 15%|█▍        | 5654/37963 [17:40:05<98:57:51, 11.03s/it] 
 15%|█▍        | 5655/37963 [17:40:15<96:04:11, 10.70s/it]
 15%|█▍        | 5656/37963 [17:40:25<94:09:05, 10.49s/it]
 15%|█▍        | 5657/37963 [17:40:35<92:57:39, 10.36s/it]
 15%|█▍        | 5658/37963 [17:40:46<93:02:25, 10.37s/it]
 15%|█▍        | 5659/37963 [17:40:56<92:22:41, 10.29s/it]
 15%|█▍        | 5660/37963 [17:41:12<108:39:43, 12.11s/it]
                                                           
{'loss': '0.2011', 'grad_norm': '1.317', 'learning_rate': '1.927e-05', 'epoch': '0.1491'}

 15%|█▍        | 5660/37963 [17:41:12<108:39:43, 12.11s/it]
 15%|█▍        | 5661/37963 [17:41:22<102:46:36, 11.45s/it]
 15%|█▍        | 5662/37963 [17:41:32<99:11:02, 11.05s/it] 
 15%|█▍        | 5663/37963 [17:41:42<97:03:34, 10.82s/it]
 15%|█▍        | 5664/37963 [17:41:59<112:53:09, 12.58s/it]
 15%|█▍        | 5665/37963 [17:42:09<106:15:12, 11.84s/it]
 15%|█▍        | 5666/37963 [17:42:19<101:29:19, 11.31s/it]
 15%|█▍        | 5667/37963 [17:42:29<97:44:58, 10.90s/it] 
 15%|█▍        | 5668/37963 [17:42:39<96:00:07, 10.70s/it]
 15%|█▍        | 5669/37963 [17:42:50<94:31:25, 10.54s/it]
 15%|█▍        | 5670/37963 [17:43:00<93:18:38, 10.40s/it]
                                                          
{'loss': '0.1974', 'grad_norm': '6.758', 'learning_rate': '1.926e-05', 'epoch': '0.1494'}

 15%|█▍        | 5670/37963 [17:43:00<93:18:38, 10.40s/it]
 15%|█▍        | 5671/37963 [17:43:16<108:32:39, 12.10s/it]
 15%|█▍        | 5672/37963 [17:43:26<103:29:27, 11.54s/it]
 15%|█▍        | 5673/37963 [17:43:36<99:42:16, 11.12s/it] 
 15%|█▍        | 5674/37963 [17:43:46<97:36:45, 10.88s/it]
 15%|█▍        | 5675/37963 [17:43:57<95:30:33, 10.65s/it]
 15%|█▍        | 5676/37963 [17:44:07<93:59:22, 10.48s/it]
 15%|█▍        | 5677/37963 [17:44:17<93:02:56, 10.38s/it]
 15%|█▍        | 5678/37963 [17:44:27<91:40:32, 10.22s/it]
 15%|█▍        | 5679/37963 [17:44:37<91:38:13, 10.22s/it]
 15%|█▍        | 5680/37963 [17:44:54<108:56:16, 12.15s/it]
                                                           
{'loss': '0.1831', 'grad_norm': '1.526', 'learning_rate': '1.926e-05', 'epoch': '0.1496'}

 15%|█▍        | 5680/37963 [17:44:54<108:56:16, 12.15s/it]
 15%|█▍        | 5681/37963 [17:45:03<101:58:14, 11.37s/it]
 15%|█▍        | 5682/37963 [17:45:13<99:06:40, 11.05s/it] 
 15%|█▍        | 5683/37963 [17:45:24<96:37:38, 10.78s/it]
 15%|█▍        | 5684/37963 [17:45:34<95:15:49, 10.62s/it]
 15%|█▍        | 5685/37963 [17:45:44<93:57:02, 10.48s/it]
 15%|█▍        | 5686/37963 [17:45:54<92:36:24, 10.33s/it]
 15%|█▍        | 5687/37963 [17:46:11<109:37:14, 12.23s/it]
 15%|█▍        | 5688/37963 [17:46:21<103:56:39, 11.59s/it]
 15%|█▍        | 5689/37963 [17:46:31<99:20:26, 11.08s/it] 
 15%|█▍        | 5690/37963 [17:46:41<96:56:46, 10.81s/it]
                                                          
{'loss': '0.1825', 'grad_norm': '2.035', 'learning_rate': '1.926e-05', 'epoch': '0.1499'}

 15%|█▍        | 5690/37963 [17:46:41<96:56:46, 10.81s/it]
 15%|█▍        | 5691/37963 [17:46:51<94:59:57, 10.60s/it]
 15%|█▍        | 5692/37963 [17:47:01<93:48:00, 10.46s/it]
 15%|█▍        | 5693/37963 [17:47:11<92:14:05, 10.29s/it]
 15%|█▍        | 5694/37963 [17:47:21<91:43:15, 10.23s/it]
 15%|█▌        | 5695/37963 [17:47:31<91:48:10, 10.24s/it]
 15%|█▌        | 5696/37963 [17:47:49<112:50:22, 12.59s/it]
 15%|█▌        | 5697/37963 [17:48:05<120:58:43, 13.50s/it]
 15%|█▌        | 5698/37963 [17:48:22<130:02:28, 14.51s/it]
 15%|█▌        | 5699/37963 [17:48:32<118:13:18, 13.19s/it]
 15%|█▌        | 5700/37963 [17:48:42<109:40:49, 12.24s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '3.228', 'learning_rate': '1.925e-05', 'epoch': '0.1501'}

 15%|█▌        | 5700/37963 [17:48:42<109:40:49, 12.24s/it]
 15%|█▌        | 5701/37963 [17:48:52<104:04:51, 11.61s/it]
 15%|█▌        | 5702/37963 [17:49:02<100:10:06, 11.18s/it]
 15%|█▌        | 5703/37963 [17:49:12<97:10:26, 10.84s/it] 
 15%|█▌        | 5704/37963 [17:49:22<95:05:13, 10.61s/it]
 15%|█▌        | 5705/37963 [17:49:32<93:39:58, 10.45s/it]
 15%|█▌        | 5706/37963 [17:49:49<110:27:49, 12.33s/it]
 15%|█▌        | 5707/37963 [17:49:59<104:15:11, 11.64s/it]
 15%|█▌        | 5708/37963 [17:50:09<100:10:05, 11.18s/it]
 15%|█▌        | 5709/37963 [17:50:19<97:20:28, 10.86s/it] 
 15%|█▌        | 5710/37963 [17:50:30<95:21:05, 10.64s/it]
                                                          
{'loss': '0.1777', 'grad_norm': '6.54', 'learning_rate': '1.925e-05', 'epoch': '0.1504'}

 15%|█▌        | 5710/37963 [17:50:30<95:21:05, 10.64s/it]
 15%|█▌        | 5711/37963 [17:50:40<94:11:08, 10.51s/it]
 15%|█▌        | 5712/37963 [17:50:50<93:20:07, 10.42s/it]
 15%|█▌        | 5713/37963 [17:51:06<109:33:23, 12.23s/it]
 15%|█▌        | 5714/37963 [17:51:17<104:01:04, 11.61s/it]
 15%|█▌        | 5715/37963 [17:51:27<100:04:29, 11.17s/it]
 15%|█▌        | 5716/37963 [17:51:37<96:59:05, 10.83s/it] 
 15%|█▌        | 5717/37963 [17:51:47<95:10:08, 10.62s/it]
 15%|█▌        | 5718/37963 [17:51:57<94:02:10, 10.50s/it]
 15%|█▌        | 5719/37963 [17:52:07<92:00:11, 10.27s/it]
 15%|█▌        | 5720/37963 [17:52:24<109:04:02, 12.18s/it]
                                                           
{'loss': '0.1795', 'grad_norm': '5.594', 'learning_rate': '1.925e-05', 'epoch': '0.1507'}

 15%|█▌        | 5720/37963 [17:52:24<109:04:02, 12.18s/it]
 15%|█▌        | 5721/37963 [17:52:34<103:24:13, 11.55s/it]
 15%|█▌        | 5722/37963 [17:52:44<99:32:13, 11.11s/it] 
 15%|█▌        | 5723/37963 [17:52:54<96:46:58, 10.81s/it]
 15%|█▌        | 5724/37963 [17:53:04<94:57:13, 10.60s/it]
 15%|█▌        | 5725/37963 [17:53:14<92:44:01, 10.36s/it]
 15%|█▌        | 5726/37963 [17:53:24<92:24:11, 10.32s/it]
 15%|█▌        | 5727/37963 [17:53:34<90:30:42, 10.11s/it]
 15%|█▌        | 5728/37963 [17:53:50<107:15:52, 11.98s/it]
 15%|█▌        | 5729/37963 [17:54:00<102:47:05, 11.48s/it]
 15%|█▌        | 5730/37963 [17:54:10<99:34:09, 11.12s/it] 
                                                          
{'loss': '0.186', 'grad_norm': '2.451', 'learning_rate': '1.924e-05', 'epoch': '0.1509'}

 15%|█▌        | 5730/37963 [17:54:10<99:34:09, 11.12s/it]
 15%|█▌        | 5731/37963 [17:54:20<96:25:56, 10.77s/it]
 15%|█▌        | 5732/37963 [17:54:30<94:26:33, 10.55s/it]
 15%|█▌        | 5733/37963 [17:54:41<93:21:45, 10.43s/it]
 15%|█▌        | 5734/37963 [17:54:51<92:13:34, 10.30s/it]
 15%|█▌        | 5735/37963 [17:55:01<91:43:58, 10.25s/it]
 15%|█▌        | 5736/37963 [17:55:17<109:11:17, 12.20s/it]
 15%|█▌        | 5737/37963 [17:55:28<103:23:42, 11.55s/it]
 15%|█▌        | 5738/37963 [17:55:37<98:33:04, 11.01s/it] 
 15%|█▌        | 5739/37963 [17:55:47<95:19:27, 10.65s/it]
 15%|█▌        | 5740/37963 [17:55:57<94:14:26, 10.53s/it]
                                                          
{'loss': '0.1875', 'grad_norm': '5.047', 'learning_rate': '1.924e-05', 'epoch': '0.1512'}

 15%|█▌        | 5740/37963 [17:55:57<94:14:26, 10.53s/it]
 15%|█▌        | 5741/37963 [17:56:07<93:04:10, 10.40s/it]
 15%|█▌        | 5742/37963 [17:56:18<92:33:19, 10.34s/it]
 15%|█▌        | 5743/37963 [17:56:36<113:25:00, 12.67s/it]
 15%|█▌        | 5744/37963 [17:56:46<106:49:21, 11.94s/it]
 15%|█▌        | 5745/37963 [17:56:56<102:06:19, 11.41s/it]
 15%|█▌        | 5746/37963 [17:57:13<116:00:11, 12.96s/it]
 15%|█▌        | 5747/37963 [17:57:23<108:32:13, 12.13s/it]
 15%|█▌        | 5748/37963 [17:57:33<102:58:08, 11.51s/it]
 15%|█▌        | 5749/37963 [17:57:49<116:02:36, 12.97s/it]
 15%|█▌        | 5750/37963 [17:57:59<108:04:06, 12.08s/it]
                                                           
{'loss': '0.1777', 'grad_norm': '4.306', 'learning_rate': '1.924e-05', 'epoch': '0.1515'}

 15%|█▌        | 5750/37963 [17:57:59<108:04:06, 12.08s/it]
 15%|█▌        | 5751/37963 [17:58:09<102:30:21, 11.46s/it]
 15%|█▌        | 5752/37963 [17:58:20<99:07:13, 11.08s/it] 
 15%|█▌        | 5753/37963 [17:58:29<95:41:18, 10.69s/it]
 15%|█▌        | 5754/37963 [17:58:46<111:55:14, 12.51s/it]
 15%|█▌        | 5755/37963 [17:58:56<105:26:07, 11.78s/it]
 15%|█▌        | 5756/37963 [17:59:06<101:00:16, 11.29s/it]
 15%|█▌        | 5757/37963 [17:59:16<97:37:21, 10.91s/it] 
 15%|█▌        | 5758/37963 [17:59:27<95:40:30, 10.69s/it]
 15%|█▌        | 5759/37963 [17:59:37<94:03:10, 10.51s/it]
 15%|█▌        | 5760/37963 [17:59:47<93:05:58, 10.41s/it]
                                                          
{'loss': '0.1764', 'grad_norm': '4.241', 'learning_rate': '1.923e-05', 'epoch': '0.1517'}

 15%|█▌        | 5760/37963 [17:59:47<93:05:58, 10.41s/it]
 15%|█▌        | 5761/37963 [17:59:57<92:34:29, 10.35s/it]
 15%|█▌        | 5762/37963 [18:00:13<108:40:28, 12.15s/it]
 15%|█▌        | 5763/37963 [18:00:23<102:53:38, 11.50s/it]
 15%|█▌        | 5764/37963 [18:00:34<99:21:29, 11.11s/it] 
 15%|█▌        | 5765/37963 [18:00:43<96:13:17, 10.76s/it]
 15%|█▌        | 5766/37963 [18:00:53<94:12:47, 10.53s/it]
 15%|█▌        | 5767/37963 [18:01:04<93:10:36, 10.42s/it]
 15%|█▌        | 5768/37963 [18:01:20<109:21:42, 12.23s/it]
 15%|█▌        | 5769/37963 [18:01:30<103:55:23, 11.62s/it]
 15%|█▌        | 5770/37963 [18:01:40<100:02:49, 11.19s/it]
                                                           
{'loss': '0.181', 'grad_norm': '1.758', 'learning_rate': '1.923e-05', 'epoch': '0.152'}

 15%|█▌        | 5770/37963 [18:01:40<100:02:49, 11.19s/it]
 15%|█▌        | 5771/37963 [18:01:50<96:08:23, 10.75s/it] 
 15%|█▌        | 5772/37963 [18:02:00<94:22:07, 10.55s/it]
 15%|█▌        | 5773/37963 [18:02:10<93:10:24, 10.42s/it]
 15%|█▌        | 5774/37963 [18:02:20<92:14:08, 10.32s/it]
 15%|█▌        | 5775/37963 [18:02:30<90:47:27, 10.15s/it]
 15%|█▌        | 5776/37963 [18:02:40<90:27:36, 10.12s/it]
 15%|█▌        | 5777/37963 [18:02:57<108:22:46, 12.12s/it]
 15%|█▌        | 5778/37963 [18:03:07<102:57:52, 11.52s/it]
 15%|█▌        | 5779/37963 [18:03:17<99:05:19, 11.08s/it] 
 15%|█▌        | 5780/37963 [18:03:27<96:39:17, 10.81s/it]
                                                          
{'loss': '0.1856', 'grad_norm': '2.747', 'learning_rate': '1.923e-05', 'epoch': '0.1523'}

 15%|█▌        | 5780/37963 [18:03:27<96:39:17, 10.81s/it]
 15%|█▌        | 5781/37963 [18:03:37<94:24:59, 10.56s/it]
 15%|█▌        | 5782/37963 [18:03:47<92:40:09, 10.37s/it]
 15%|█▌        | 5783/37963 [18:03:57<92:05:13, 10.30s/it]
 15%|█▌        | 5784/37963 [18:04:14<108:28:56, 12.14s/it]
 15%|█▌        | 5785/37963 [18:04:24<103:13:55, 11.55s/it]
 15%|█▌        | 5786/37963 [18:04:34<99:16:00, 11.11s/it] 
 15%|█▌        | 5787/37963 [18:04:44<96:57:45, 10.85s/it]
 15%|█▌        | 5788/37963 [18:04:55<95:16:37, 10.66s/it]
 15%|█▌        | 5789/37963 [18:05:05<93:43:07, 10.49s/it]
 15%|█▌        | 5790/37963 [18:05:15<92:23:11, 10.34s/it]
                                                          
{'loss': '0.1698', 'grad_norm': '2.268', 'learning_rate': '1.922e-05', 'epoch': '0.1525'}

 15%|█▌        | 5790/37963 [18:05:15<92:23:11, 10.34s/it]
 15%|█▌        | 5791/37963 [18:05:32<112:25:55, 12.58s/it]
 15%|█▌        | 5792/37963 [18:05:43<105:55:02, 11.85s/it]
 15%|█▌        | 5793/37963 [18:05:53<101:25:34, 11.35s/it]
 15%|█▌        | 5794/37963 [18:06:03<98:04:09, 10.97s/it] 
 15%|█▌        | 5795/37963 [18:06:26<130:15:00, 14.58s/it]
 15%|█▌        | 5796/37963 [18:06:36<118:08:54, 13.22s/it]
 15%|█▌        | 5797/37963 [18:06:46<110:01:34, 12.31s/it]
 15%|█▌        | 5798/37963 [18:06:56<104:01:22, 11.64s/it]
 15%|█▌        | 5799/37963 [18:07:06<100:13:57, 11.22s/it]
 15%|█▌        | 5800/37963 [18:07:17<97:20:51, 10.90s/it] 
                                                          
{'loss': '0.1856', 'grad_norm': '7.324', 'learning_rate': '1.922e-05', 'epoch': '0.1528'}

 15%|█▌        | 5800/37963 [18:07:17<97:20:51, 10.90s/it]
 15%|█▌        | 5801/37963 [18:07:27<95:12:13, 10.66s/it]
 15%|█▌        | 5802/37963 [18:07:43<110:20:53, 12.35s/it]
 15%|█▌        | 5803/37963 [18:07:53<104:32:37, 11.70s/it]
 15%|█▌        | 5804/37963 [18:08:03<99:14:31, 11.11s/it] 
 15%|█▌        | 5805/37963 [18:08:13<96:47:12, 10.84s/it]
 15%|█▌        | 5806/37963 [18:08:23<94:12:33, 10.55s/it]
 15%|█▌        | 5807/37963 [18:08:33<92:45:12, 10.38s/it]
 15%|█▌        | 5808/37963 [18:08:43<91:54:50, 10.29s/it]
 15%|█▌        | 5809/37963 [18:08:53<90:56:58, 10.18s/it]
 15%|█▌        | 5810/37963 [18:09:03<90:38:25, 10.15s/it]
                                                          
{'loss': '0.1761', 'grad_norm': '3.028', 'learning_rate': '1.922e-05', 'epoch': '0.153'}

 15%|█▌        | 5810/37963 [18:09:03<90:38:25, 10.15s/it]
 15%|█▌        | 5811/37963 [18:09:20<108:15:41, 12.12s/it]
 15%|█▌        | 5812/37963 [18:09:30<102:24:45, 11.47s/it]
 15%|█▌        | 5813/37963 [18:09:40<98:52:05, 11.07s/it] 
 15%|█▌        | 5814/37963 [18:09:56<113:32:35, 12.71s/it]
 15%|█▌        | 5815/37963 [18:10:07<106:59:51, 11.98s/it]
 15%|█▌        | 5816/37963 [18:10:17<101:21:21, 11.35s/it]
 15%|█▌        | 5817/37963 [18:10:27<98:19:56, 11.01s/it] 
 15%|█▌        | 5818/37963 [18:10:37<95:41:09, 10.72s/it]
 15%|█▌        | 5819/37963 [18:10:47<94:06:52, 10.54s/it]
 15%|█▌        | 5820/37963 [18:10:57<93:04:10, 10.42s/it]
                                                          
{'loss': '0.1757', 'grad_norm': '1.225', 'learning_rate': '1.921e-05', 'epoch': '0.1533'}

 15%|█▌        | 5820/37963 [18:10:57<93:04:10, 10.42s/it]
 15%|█▌        | 5821/37963 [18:11:07<92:06:39, 10.32s/it]
 15%|█▌        | 5822/37963 [18:11:17<91:30:09, 10.25s/it]
 15%|█▌        | 5823/37963 [18:11:27<91:05:21, 10.20s/it]
 15%|█▌        | 5824/37963 [18:11:37<90:03:21, 10.09s/it]
 15%|█▌        | 5825/37963 [18:11:54<107:55:28, 12.09s/it]
 15%|█▌        | 5826/37963 [18:12:04<102:40:51, 11.50s/it]
 15%|█▌        | 5827/37963 [18:12:14<99:03:56, 11.10s/it] 
 15%|█▌        | 5828/37963 [18:12:24<96:17:13, 10.79s/it]
 15%|█▌        | 5829/37963 [18:12:34<94:14:31, 10.56s/it]
 15%|█▌        | 5830/37963 [18:12:44<92:45:34, 10.39s/it]
                                                          
{'loss': '0.1801', 'grad_norm': '2.003', 'learning_rate': '1.921e-05', 'epoch': '0.1536'}

 15%|█▌        | 5830/37963 [18:12:44<92:45:34, 10.39s/it]
 15%|█▌        | 5831/37963 [18:12:54<92:06:26, 10.32s/it]
 15%|█▌        | 5832/37963 [18:13:11<109:23:01, 12.26s/it]
 15%|█▌        | 5833/37963 [18:13:21<103:18:05, 11.57s/it]
 15%|█▌        | 5834/37963 [18:13:31<99:21:58, 11.13s/it] 
 15%|█▌        | 5835/37963 [18:13:41<96:43:58, 10.84s/it]
 15%|█▌        | 5836/37963 [18:13:51<94:01:44, 10.54s/it]
 15%|█▌        | 5837/37963 [18:14:02<93:06:52, 10.43s/it]
 15%|█▌        | 5838/37963 [18:14:12<92:12:37, 10.33s/it]
 15%|█▌        | 5839/37963 [18:14:22<91:17:14, 10.23s/it]
 15%|█▌        | 5840/37963 [18:14:40<113:19:11, 12.70s/it]
                                                           
{'loss': '0.1683', 'grad_norm': '3.667', 'learning_rate': '1.921e-05', 'epoch': '0.1538'}

 15%|█▌        | 5840/37963 [18:14:40<113:19:11, 12.70s/it]
 15%|█▌        | 5841/37963 [18:14:50<106:19:21, 11.92s/it]
 15%|█▌        | 5842/37963 [18:15:00<101:15:45, 11.35s/it]
 15%|█▌        | 5843/37963 [18:15:17<114:50:11, 12.87s/it]
 15%|█▌        | 5844/37963 [18:15:33<124:29:02, 13.95s/it]
 15%|█▌        | 5845/37963 [18:15:43<113:35:12, 12.73s/it]
 15%|█▌        | 5846/37963 [18:15:53<106:07:47, 11.90s/it]
 15%|█▌        | 5847/37963 [18:16:03<100:02:59, 11.21s/it]
 15%|█▌        | 5848/37963 [18:16:19<113:42:21, 12.75s/it]
 15%|█▌        | 5849/37963 [18:16:29<106:53:41, 11.98s/it]
 15%|█▌        | 5850/37963 [18:16:39<101:45:32, 11.41s/it]
                                                           
{'loss': '0.1769', 'grad_norm': '1.523', 'learning_rate': '1.92e-05', 'epoch': '0.1541'}

 15%|█▌        | 5850/37963 [18:16:39<101:45:32, 11.41s/it]
 15%|█▌        | 5851/37963 [18:16:49<97:58:54, 10.98s/it] 
 15%|█▌        | 5852/37963 [18:16:59<95:24:17, 10.70s/it]
 15%|█▌        | 5853/37963 [18:17:09<93:44:39, 10.51s/it]
 15%|█▌        | 5854/37963 [18:17:19<91:39:42, 10.28s/it]
 15%|█▌        | 5855/37963 [18:17:29<91:15:38, 10.23s/it]
 15%|█▌        | 5856/37963 [18:17:39<91:00:20, 10.20s/it]
 15%|█▌        | 5857/37963 [18:17:49<90:05:43, 10.10s/it]
 15%|█▌        | 5858/37963 [18:18:05<106:32:30, 11.95s/it]
 15%|█▌        | 5859/37963 [18:18:15<101:25:28, 11.37s/it]
 15%|█▌        | 5860/37963 [18:18:25<97:55:33, 10.98s/it] 
                                                          
{'loss': '0.1781', 'grad_norm': '1.27', 'learning_rate': '1.92e-05', 'epoch': '0.1544'}

 15%|█▌        | 5860/37963 [18:18:25<97:55:33, 10.98s/it]
 15%|█▌        | 5861/37963 [18:18:36<95:52:29, 10.75s/it]
 15%|█▌        | 5862/37963 [18:18:52<109:34:40, 12.29s/it]
 15%|█▌        | 5863/37963 [18:19:02<104:07:46, 11.68s/it]
 15%|█▌        | 5864/37963 [18:19:12<99:33:44, 11.17s/it] 
 15%|█▌        | 5865/37963 [18:19:22<96:39:29, 10.84s/it]
 15%|█▌        | 5866/37963 [18:19:32<93:54:00, 10.53s/it]
 15%|█▌        | 5867/37963 [18:19:41<91:45:14, 10.29s/it]
 15%|█▌        | 5868/37963 [18:19:52<91:28:28, 10.26s/it]
 15%|█▌        | 5869/37963 [18:20:02<90:54:31, 10.20s/it]
 15%|█▌        | 5870/37963 [18:20:12<90:35:35, 10.16s/it]
                                                          
{'loss': '0.1743', 'grad_norm': '1.417', 'learning_rate': '1.92e-05', 'epoch': '0.1546'}

 15%|█▌        | 5870/37963 [18:20:12<90:35:35, 10.16s/it]
 15%|█▌        | 5871/37963 [18:20:22<90:13:24, 10.12s/it]
 15%|█▌        | 5872/37963 [18:20:38<106:47:17, 11.98s/it]
 15%|█▌        | 5873/37963 [18:20:48<101:20:47, 11.37s/it]
 15%|█▌        | 5874/37963 [18:20:58<96:52:03, 10.87s/it] 
 15%|█▌        | 5875/37963 [18:21:07<93:32:55, 10.50s/it]
 15%|█▌        | 5876/37963 [18:21:17<92:24:06, 10.37s/it]
 15%|█▌        | 5877/37963 [18:21:28<91:51:13, 10.31s/it]
 15%|█▌        | 5878/37963 [18:21:37<90:28:25, 10.15s/it]
 15%|█▌        | 5879/37963 [18:21:47<89:58:23, 10.10s/it]
 15%|█▌        | 5880/37963 [18:21:57<90:03:55, 10.11s/it]
                                                          
{'loss': '0.1743', 'grad_norm': '3.782', 'learning_rate': '1.919e-05', 'epoch': '0.1549'}

 15%|█▌        | 5880/37963 [18:21:57<90:03:55, 10.11s/it]
 15%|█▌        | 5881/37963 [18:22:14<107:34:59, 12.07s/it]
 15%|█▌        | 5882/37963 [18:22:24<102:26:52, 11.50s/it]
 15%|█▌        | 5883/37963 [18:22:34<99:01:24, 11.11s/it] 
 15%|█▌        | 5884/37963 [18:22:45<96:33:35, 10.84s/it]
 16%|█▌        | 5885/37963 [18:23:03<115:37:57, 12.98s/it]
 16%|█▌        | 5886/37963 [18:23:13<107:57:00, 12.12s/it]
 16%|█▌        | 5887/37963 [18:23:23<102:46:17, 11.53s/it]
 16%|█▌        | 5888/37963 [18:23:33<98:01:32, 11.00s/it] 
 16%|█▌        | 5889/37963 [18:23:43<95:06:38, 10.68s/it]
 16%|█▌        | 5890/37963 [18:23:53<94:06:47, 10.56s/it]
                                                          
{'loss': '0.1721', 'grad_norm': '4.977', 'learning_rate': '1.919e-05', 'epoch': '0.1552'}

 16%|█▌        | 5890/37963 [18:23:53<94:06:47, 10.56s/it]
 16%|█▌        | 5891/37963 [18:24:03<92:09:57, 10.35s/it]
 16%|█▌        | 5892/37963 [18:24:19<108:28:45, 12.18s/it]
 16%|█▌        | 5893/37963 [18:24:35<119:13:22, 13.38s/it]
 16%|█▌        | 5894/37963 [18:24:46<110:38:27, 12.42s/it]
 16%|█▌        | 5895/37963 [18:24:55<104:01:09, 11.68s/it]
 16%|█▌        | 5896/37963 [18:25:12<117:12:52, 13.16s/it]
 16%|█▌        | 5897/37963 [18:25:22<109:02:53, 12.24s/it]
 16%|█▌        | 5898/37963 [18:25:32<103:13:20, 11.59s/it]
 16%|█▌        | 5899/37963 [18:25:42<98:31:44, 11.06s/it] 
 16%|█▌        | 5900/37963 [18:25:52<95:53:06, 10.77s/it]
                                                          
{'loss': '0.1766', 'grad_norm': '1.539', 'learning_rate': '1.919e-05', 'epoch': '0.1554'}

 16%|█▌        | 5900/37963 [18:25:52<95:53:06, 10.77s/it]
 16%|█▌        | 5901/37963 [18:26:02<94:22:10, 10.60s/it]
 16%|█▌        | 5902/37963 [18:26:13<93:10:43, 10.46s/it]
 16%|█▌        | 5903/37963 [18:26:23<92:15:53, 10.36s/it]
 16%|█▌        | 5904/37963 [18:26:33<91:47:37, 10.31s/it]
 16%|█▌        | 5905/37963 [18:26:43<91:10:11, 10.24s/it]
 16%|█▌        | 5906/37963 [18:26:53<91:04:56, 10.23s/it]
 16%|█▌        | 5907/37963 [18:27:10<108:22:12, 12.17s/it]
 16%|█▌        | 5908/37963 [18:27:20<102:39:37, 11.53s/it]
 16%|█▌        | 5909/37963 [18:27:30<97:55:08, 11.00s/it] 
 16%|█▌        | 5910/37963 [18:27:46<112:52:51, 12.68s/it]
                                                           
{'loss': '0.1823', 'grad_norm': '5.22', 'learning_rate': '1.918e-05', 'epoch': '0.1557'}

 16%|█▌        | 5910/37963 [18:27:46<112:52:51, 12.68s/it]
 16%|█▌        | 5911/37963 [18:27:57<106:38:28, 11.98s/it]
 16%|█▌        | 5912/37963 [18:28:06<101:15:27, 11.37s/it]
 16%|█▌        | 5913/37963 [18:28:17<97:37:19, 10.97s/it] 
 16%|█▌        | 5914/37963 [18:28:27<95:26:53, 10.72s/it]
 16%|█▌        | 5915/37963 [18:28:37<94:12:07, 10.58s/it]
 16%|█▌        | 5916/37963 [18:28:47<92:57:37, 10.44s/it]
 16%|█▌        | 5917/37963 [18:28:57<92:19:38, 10.37s/it]
 16%|█▌        | 5918/37963 [18:29:07<91:54:39, 10.33s/it]
 16%|█▌        | 5919/37963 [18:29:18<91:25:40, 10.27s/it]
 16%|█▌        | 5920/37963 [18:29:34<108:19:39, 12.17s/it]
                                                           
{'loss': '0.1826', 'grad_norm': '1.668', 'learning_rate': '1.918e-05', 'epoch': '0.1559'}

 16%|█▌        | 5920/37963 [18:29:34<108:19:39, 12.17s/it]
 16%|█▌        | 5921/37963 [18:29:45<103:30:54, 11.63s/it]
 16%|█▌        | 5922/37963 [18:29:54<98:38:25, 11.08s/it] 
 16%|█▌        | 5923/37963 [18:30:04<95:16:32, 10.71s/it]
 16%|█▌        | 5924/37963 [18:30:15<94:30:02, 10.62s/it]
 16%|█▌        | 5925/37963 [18:30:24<91:27:03, 10.28s/it]
 16%|█▌        | 5926/37963 [18:30:34<89:50:52, 10.10s/it]
 16%|█▌        | 5927/37963 [18:30:44<89:55:24, 10.11s/it]
 16%|█▌        | 5928/37963 [18:30:54<89:40:50, 10.08s/it]
 16%|█▌        | 5929/37963 [18:31:10<106:13:21, 11.94s/it]
 16%|█▌        | 5930/37963 [18:31:20<100:47:16, 11.33s/it]
                                                           
{'loss': '0.1858', 'grad_norm': '0.6901', 'learning_rate': '1.918e-05', 'epoch': '0.1562'}

 16%|█▌        | 5930/37963 [18:31:20<100:47:16, 11.33s/it]
 16%|█▌        | 5931/37963 [18:31:30<98:10:46, 11.03s/it] 
 16%|█▌        | 5932/37963 [18:31:41<95:45:09, 10.76s/it]
 16%|█▌        | 5933/37963 [18:31:51<93:52:34, 10.55s/it]
 16%|█▌        | 5934/37963 [18:32:01<92:36:33, 10.41s/it]
 16%|█▌        | 5935/37963 [18:32:18<111:40:23, 12.55s/it]
 16%|█▌        | 5936/37963 [18:32:28<105:10:09, 11.82s/it]
 16%|█▌        | 5937/37963 [18:32:39<100:57:03, 11.35s/it]
 16%|█▌        | 5938/37963 [18:32:49<97:30:08, 10.96s/it] 
 16%|█▌        | 5939/37963 [18:32:59<95:28:31, 10.73s/it]
 16%|█▌        | 5940/37963 [18:33:09<93:25:52, 10.50s/it]
                                                          
{'loss': '0.1931', 'grad_norm': '2.293', 'learning_rate': '1.917e-05', 'epoch': '0.1565'}

 16%|█▌        | 5940/37963 [18:33:09<93:25:52, 10.50s/it]
 16%|█▌        | 5941/37963 [18:33:19<91:39:36, 10.30s/it]
 16%|█▌        | 5942/37963 [18:33:29<91:10:30, 10.25s/it]
 16%|█▌        | 5943/37963 [18:33:45<107:32:13, 12.09s/it]
 16%|█▌        | 5944/37963 [18:34:02<120:29:05, 13.55s/it]
 16%|█▌        | 5945/37963 [18:34:19<128:53:52, 14.49s/it]
 16%|█▌        | 5946/37963 [18:34:29<117:05:40, 13.17s/it]
 16%|█▌        | 5947/37963 [18:34:39<109:01:46, 12.26s/it]
 16%|█▌        | 5948/37963 [18:34:49<103:16:06, 11.61s/it]
 16%|█▌        | 5949/37963 [18:34:59<99:39:15, 11.21s/it] 
 16%|█▌        | 5950/37963 [18:35:09<96:34:54, 10.86s/it]
                                                          
{'loss': '0.1915', 'grad_norm': '2.522', 'learning_rate': '1.917e-05', 'epoch': '0.1567'}

 16%|█▌        | 5950/37963 [18:35:09<96:34:54, 10.86s/it]
 16%|█▌        | 5951/37963 [18:35:20<94:40:45, 10.65s/it]
 16%|█▌        | 5952/37963 [18:35:30<93:22:20, 10.50s/it]
 16%|█▌        | 5953/37963 [18:35:40<91:59:44, 10.35s/it]
 16%|█▌        | 5954/37963 [18:35:56<108:36:27, 12.21s/it]
 16%|█▌        | 5955/37963 [18:36:06<101:52:12, 11.46s/it]
 16%|█▌        | 5956/37963 [18:36:16<98:01:55, 11.03s/it] 
 16%|█▌        | 5957/37963 [18:36:26<95:40:44, 10.76s/it]
 16%|█▌        | 5958/37963 [18:36:43<111:10:19, 12.50s/it]
 16%|█▌        | 5959/37963 [18:36:53<104:44:45, 11.78s/it]
 16%|█▌        | 5960/37963 [18:37:03<100:06:32, 11.26s/it]
                                                           
{'loss': '0.1756', 'grad_norm': '2.817', 'learning_rate': '1.917e-05', 'epoch': '0.157'}

 16%|█▌        | 5960/37963 [18:37:03<100:06:32, 11.26s/it]
 16%|█▌        | 5961/37963 [18:37:13<97:14:26, 10.94s/it] 
 16%|█▌        | 5962/37963 [18:37:23<94:55:04, 10.68s/it]
 16%|█▌        | 5963/37963 [18:37:33<93:06:43, 10.48s/it]
 16%|█▌        | 5964/37963 [18:37:43<92:36:29, 10.42s/it]
 16%|█▌        | 5965/37963 [18:37:54<91:51:16, 10.33s/it]
 16%|█▌        | 5966/37963 [18:38:04<91:05:01, 10.25s/it]
 16%|█▌        | 5967/37963 [18:38:14<90:07:26, 10.14s/it]
 16%|█▌        | 5968/37963 [18:38:30<106:51:16, 12.02s/it]
 16%|█▌        | 5969/37963 [18:38:40<101:47:13, 11.45s/it]
 16%|█▌        | 5970/37963 [18:38:50<98:10:23, 11.05s/it] 
                                                          
{'loss': '0.1864', 'grad_norm': '1.799', 'learning_rate': '1.916e-05', 'epoch': '0.1573'}

 16%|█▌        | 5970/37963 [18:38:50<98:10:23, 11.05s/it]
 16%|█▌        | 5971/37963 [18:39:00<95:34:21, 10.75s/it]
 16%|█▌        | 5972/37963 [18:39:10<93:52:27, 10.56s/it]
 16%|█▌        | 5973/37963 [18:39:20<92:43:02, 10.43s/it]
 16%|█▌        | 5974/37963 [18:39:30<90:32:44, 10.19s/it]
 16%|█▌        | 5975/37963 [18:39:40<90:11:57, 10.15s/it]
 16%|█▌        | 5976/37963 [18:39:50<90:20:03, 10.17s/it]
 16%|█▌        | 5977/37963 [18:40:07<107:09:18, 12.06s/it]
 16%|█▌        | 5978/37963 [18:40:17<101:10:43, 11.39s/it]
 16%|█▌        | 5979/37963 [18:40:27<97:54:25, 11.02s/it] 
 16%|█▌        | 5980/37963 [18:40:37<95:17:28, 10.73s/it]
                                                          
{'loss': '0.1803', 'grad_norm': '1.274', 'learning_rate': '1.916e-05', 'epoch': '0.1575'}

 16%|█▌        | 5980/37963 [18:40:37<95:17:28, 10.73s/it]
 16%|█▌        | 5981/37963 [18:40:47<93:27:23, 10.52s/it]
 16%|█▌        | 5982/37963 [18:40:57<90:59:27, 10.24s/it]
 16%|█▌        | 5983/37963 [18:41:14<111:11:17, 12.52s/it]
 16%|█▌        | 5984/37963 [18:41:24<104:45:09, 11.79s/it]
 16%|█▌        | 5985/37963 [18:41:35<100:12:31, 11.28s/it]
 16%|█▌        | 5986/37963 [18:41:45<97:09:23, 10.94s/it] 
 16%|█▌        | 5987/37963 [18:41:55<94:56:33, 10.69s/it]
 16%|█▌        | 5988/37963 [18:42:05<93:52:54, 10.57s/it]
 16%|█▌        | 5989/37963 [18:42:15<92:46:13, 10.45s/it]
 16%|█▌        | 5990/37963 [18:42:25<91:56:48, 10.35s/it]
                                                          
{'loss': '0.1795', 'grad_norm': '2.916', 'learning_rate': '1.916e-05', 'epoch': '0.1578'}

 16%|█▌        | 5990/37963 [18:42:25<91:56:48, 10.35s/it]
 16%|█▌        | 5991/37963 [18:42:48<125:23:21, 14.12s/it]
 16%|█▌        | 5992/37963 [18:42:58<114:53:59, 12.94s/it]
 16%|█▌        | 5993/37963 [18:43:15<123:18:59, 13.89s/it]
 16%|█▌        | 5994/37963 [18:43:25<112:52:16, 12.71s/it]
 16%|█▌        | 5995/37963 [18:43:35<105:43:08, 11.91s/it]
 16%|█▌        | 5996/37963 [18:43:44<100:02:56, 11.27s/it]
 16%|█▌        | 5997/37963 [18:43:54<96:05:19, 10.82s/it] 
 16%|█▌        | 5998/37963 [18:44:04<93:53:46, 10.57s/it]
 16%|█▌        | 5999/37963 [18:44:14<92:47:24, 10.45s/it]
 16%|█▌        | 6000/37963 [18:44:31<108:40:25, 12.24s/it]
                                                           
{'loss': '0.1922', 'grad_norm': '1.347', 'learning_rate': '1.915e-05', 'epoch': '0.158'}

 16%|█▌        | 6000/37963 [18:44:31<108:40:25, 12.24s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.93s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.93s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 16%|█▌        | 6001/37963 [18:45:36<249:59:11, 28.16s/it]
 16%|█▌        | 6002/37963 [18:45:47<203:50:37, 22.96s/it]
 16%|█▌        | 6003/37963 [18:45:57<169:55:24, 19.14s/it]
 16%|█▌        | 6004/37963 [18:46:07<145:37:07, 16.40s/it]
 16%|█▌        | 6005/37963 [18:46:17<129:04:05, 14.54s/it]
 16%|█▌        | 6006/37963 [18:46:34<134:21:47, 15.14s/it]
 16%|█▌        | 6007/37963 [18:46:44<121:16:28, 13.66s/it]
 16%|█▌        | 6008/37963 [18:46:54<111:20:24, 12.54s/it]
 16%|█▌        | 6009/37963 [18:47:04<104:25:34, 11.76s/it]
 16%|█▌        | 6010/37963 [18:47:14<99:50:49, 11.25s/it] 
                                                          
{'loss': '0.1858', 'grad_norm': '6.66', 'learning_rate': '1.915e-05', 'epoch': '0.1583'}

 16%|█▌        | 6010/37963 [18:47:14<99:50:49, 11.25s/it]
 16%|█▌        | 6011/37963 [18:47:24<96:39:27, 10.89s/it]
 16%|█▌        | 6012/37963 [18:47:34<94:34:47, 10.66s/it]
 16%|█▌        | 6013/37963 [18:47:44<93:06:05, 10.49s/it]
 16%|█▌        | 6014/37963 [18:47:54<92:13:53, 10.39s/it]
 16%|█▌        | 6015/37963 [18:48:04<91:21:03, 10.29s/it]
 16%|█▌        | 6016/37963 [18:48:15<91:01:31, 10.26s/it]
 16%|█▌        | 6017/37963 [18:48:31<107:54:09, 12.16s/it]
 16%|█▌        | 6018/37963 [18:48:41<102:07:13, 11.51s/it]
 16%|█▌        | 6019/37963 [18:48:51<97:52:37, 11.03s/it] 
 16%|█▌        | 6020/37963 [18:49:01<95:06:53, 10.72s/it]
                                                          
{'loss': '0.1904', 'grad_norm': '2.026', 'learning_rate': '1.915e-05', 'epoch': '0.1586'}

 16%|█▌        | 6020/37963 [18:49:01<95:06:53, 10.72s/it]
 16%|█▌        | 6021/37963 [18:49:11<93:29:36, 10.54s/it]
 16%|█▌        | 6022/37963 [18:49:21<92:11:27, 10.39s/it]
 16%|█▌        | 6023/37963 [18:49:38<108:30:00, 12.23s/it]
 16%|█▌        | 6024/37963 [18:49:48<103:01:43, 11.61s/it]
 16%|█▌        | 6025/37963 [18:49:58<99:00:51, 11.16s/it] 
 16%|█▌        | 6026/37963 [18:50:08<96:03:41, 10.83s/it]
 16%|█▌        | 6027/37963 [18:50:18<93:15:59, 10.51s/it]
 16%|█▌        | 6028/37963 [18:50:28<91:31:56, 10.32s/it]
 16%|█▌        | 6029/37963 [18:50:38<90:53:32, 10.25s/it]
 16%|█▌        | 6030/37963 [18:50:55<110:13:48, 12.43s/it]
                                                           
{'loss': '0.1785', 'grad_norm': '2.211', 'learning_rate': '1.914e-05', 'epoch': '0.1588'}

 16%|█▌        | 6030/37963 [18:50:55<110:13:48, 12.43s/it]
 16%|█▌        | 6031/37963 [18:51:05<104:09:28, 11.74s/it]
 16%|█▌        | 6032/37963 [18:51:15<99:17:43, 11.19s/it] 
 16%|█▌        | 6033/37963 [18:51:25<96:23:32, 10.87s/it]
 16%|█▌        | 6034/37963 [18:51:35<93:06:51, 10.50s/it]
 16%|█▌        | 6035/37963 [18:51:45<92:00:59, 10.38s/it]
 16%|█▌        | 6036/37963 [18:51:55<91:23:36, 10.31s/it]
 16%|█▌        | 6037/37963 [18:52:05<90:11:22, 10.17s/it]
 16%|█▌        | 6038/37963 [18:52:15<90:05:09, 10.16s/it]
 16%|█▌        | 6039/37963 [18:52:32<107:08:37, 12.08s/it]
 16%|█▌        | 6040/37963 [18:52:42<101:54:48, 11.49s/it]
                                                           
{'loss': '0.1762', 'grad_norm': '2.98', 'learning_rate': '1.914e-05', 'epoch': '0.1591'}

 16%|█▌        | 6040/37963 [18:52:42<101:54:48, 11.49s/it]
 16%|█▌        | 6041/37963 [18:52:52<97:28:52, 10.99s/it] 
 16%|█▌        | 6042/37963 [18:53:08<111:07:04, 12.53s/it]
 16%|█▌        | 6043/37963 [18:53:24<121:09:40, 13.66s/it]
 16%|█▌        | 6044/37963 [18:53:34<110:59:40, 12.52s/it]
 16%|█▌        | 6045/37963 [18:53:44<104:19:49, 11.77s/it]
 16%|█▌        | 6046/37963 [18:53:54<98:40:33, 11.13s/it] 
 16%|█▌        | 6047/37963 [18:54:10<111:46:46, 12.61s/it]
 16%|█▌        | 6048/37963 [18:54:20<104:19:57, 11.77s/it]
 16%|█▌        | 6049/37963 [18:54:30<100:23:27, 11.32s/it]
 16%|█▌        | 6050/37963 [18:54:40<97:07:01, 10.96s/it] 
                                                          
{'loss': '0.1829', 'grad_norm': '3.883', 'learning_rate': '1.914e-05', 'epoch': '0.1594'}

 16%|█▌        | 6050/37963 [18:54:40<97:07:01, 10.96s/it]
 16%|█▌        | 6051/37963 [18:54:50<93:52:56, 10.59s/it]
 16%|█▌        | 6052/37963 [18:55:00<91:46:54, 10.35s/it]
 16%|█▌        | 6053/37963 [18:55:10<91:01:00, 10.27s/it]
 16%|█▌        | 6054/37963 [18:55:26<107:14:02, 12.10s/it]
 16%|█▌        | 6055/37963 [18:55:36<102:04:46, 11.52s/it]
 16%|█▌        | 6056/37963 [18:55:46<98:11:10, 11.08s/it] 
 16%|█▌        | 6057/37963 [18:55:56<94:54:38, 10.71s/it]
 16%|█▌        | 6058/37963 [18:56:06<93:16:06, 10.52s/it]
 16%|█▌        | 6059/37963 [18:56:16<91:35:27, 10.33s/it]
 16%|█▌        | 6060/37963 [18:56:26<90:53:08, 10.26s/it]
                                                          
{'loss': '0.1821', 'grad_norm': '1.824', 'learning_rate': '1.913e-05', 'epoch': '0.1596'}

 16%|█▌        | 6060/37963 [18:56:26<90:53:08, 10.26s/it]
 16%|█▌        | 6061/37963 [18:56:36<89:47:52, 10.13s/it]
 16%|█▌        | 6062/37963 [18:56:46<89:29:59, 10.10s/it]
 16%|█▌        | 6063/37963 [18:56:56<88:50:11, 10.03s/it]
 16%|█▌        | 6064/37963 [18:57:06<88:58:23, 10.04s/it]
 16%|█▌        | 6065/37963 [18:57:16<88:56:09, 10.04s/it]
 16%|█▌        | 6066/37963 [18:57:32<106:08:22, 11.98s/it]
 16%|█▌        | 6067/37963 [18:57:43<101:23:59, 11.44s/it]
 16%|█▌        | 6068/37963 [18:57:53<97:51:32, 11.05s/it] 
 16%|█▌        | 6069/37963 [18:58:03<95:28:15, 10.78s/it]
 16%|█▌        | 6070/37963 [18:58:13<93:53:06, 10.60s/it]
                                                          
{'loss': '0.174', 'grad_norm': '1.422', 'learning_rate': '1.913e-05', 'epoch': '0.1599'}

 16%|█▌        | 6070/37963 [18:58:13<93:53:06, 10.60s/it]
 16%|█▌        | 6071/37963 [18:58:23<92:50:13, 10.48s/it]
 16%|█▌        | 6072/37963 [18:58:40<108:34:13, 12.26s/it]
 16%|█▌        | 6073/37963 [18:58:50<102:23:57, 11.56s/it]
 16%|█▌        | 6074/37963 [18:59:00<98:20:44, 11.10s/it] 
 16%|█▌        | 6075/37963 [18:59:10<95:10:15, 10.74s/it]
 16%|█▌        | 6076/37963 [18:59:20<93:23:12, 10.54s/it]
 16%|█▌        | 6077/37963 [18:59:30<92:08:25, 10.40s/it]
 16%|█▌        | 6078/37963 [18:59:40<91:24:57, 10.32s/it]
 16%|█▌        | 6079/37963 [18:59:57<110:32:20, 12.48s/it]
 16%|█▌        | 6080/37963 [19:00:08<104:15:19, 11.77s/it]
                                                           
{'loss': '0.1859', 'grad_norm': '3.418', 'learning_rate': '1.912e-05', 'epoch': '0.1602'}

 16%|█▌        | 6080/37963 [19:00:08<104:15:19, 11.77s/it]
 16%|█▌        | 6081/37963 [19:00:17<99:23:51, 11.22s/it] 
 16%|█▌        | 6082/37963 [19:00:28<96:23:21, 10.88s/it]
 16%|█▌        | 6083/37963 [19:00:38<94:41:47, 10.69s/it]
 16%|█▌        | 6084/37963 [19:00:48<93:16:33, 10.53s/it]
 16%|█▌        | 6085/37963 [19:00:58<91:17:28, 10.31s/it]
 16%|█▌        | 6086/37963 [19:01:08<90:44:03, 10.25s/it]
 16%|█▌        | 6087/37963 [19:01:24<107:41:43, 12.16s/it]
 16%|█▌        | 6088/37963 [19:01:35<102:03:53, 11.53s/it]
 16%|█▌        | 6089/37963 [19:01:51<115:31:27, 13.05s/it]
 16%|█▌        | 6090/37963 [19:02:07<124:06:52, 14.02s/it]
                                                           
{'loss': '0.1815', 'grad_norm': '4', 'learning_rate': '1.912e-05', 'epoch': '0.1604'}

 16%|█▌        | 6090/37963 [19:02:07<124:06:52, 14.02s/it]
 16%|█▌        | 6091/37963 [19:02:17<113:18:13, 12.80s/it]
 16%|█▌        | 6092/37963 [19:02:27<106:06:58, 11.99s/it]
 16%|█▌        | 6093/37963 [19:02:37<99:47:41, 11.27s/it] 
 16%|█▌        | 6094/37963 [19:02:47<96:16:22, 10.88s/it]
 16%|█▌        | 6095/37963 [19:02:57<94:00:24, 10.62s/it]
 16%|█▌        | 6096/37963 [19:03:14<109:43:58, 12.40s/it]
 16%|█▌        | 6097/37963 [19:03:24<103:35:34, 11.70s/it]
 16%|█▌        | 6098/37963 [19:03:34<99:20:41, 11.22s/it] 
 16%|█▌        | 6099/37963 [19:03:44<96:20:44, 10.89s/it]
 16%|█▌        | 6100/37963 [19:03:54<94:34:39, 10.69s/it]
                                                          
{'loss': '0.1774', 'grad_norm': '3.044', 'learning_rate': '1.912e-05', 'epoch': '0.1607'}

 16%|█▌        | 6100/37963 [19:03:54<94:34:39, 10.69s/it]
 16%|█▌        | 6101/37963 [19:04:04<92:47:52, 10.48s/it]
 16%|█▌        | 6102/37963 [19:04:14<91:38:18, 10.35s/it]
 16%|█▌        | 6103/37963 [19:04:31<108:15:37, 12.23s/it]
 16%|█▌        | 6104/37963 [19:04:41<102:30:36, 11.58s/it]
 16%|█▌        | 6105/37963 [19:04:51<98:28:03, 11.13s/it] 
 16%|█▌        | 6106/37963 [19:05:01<95:53:12, 10.84s/it]
 16%|█▌        | 6107/37963 [19:05:11<93:51:38, 10.61s/it]
 16%|█▌        | 6108/37963 [19:05:21<92:28:41, 10.45s/it]
 16%|█▌        | 6109/37963 [19:05:31<91:36:13, 10.35s/it]
 16%|█▌        | 6110/37963 [19:05:41<90:46:24, 10.26s/it]
                                                          
{'loss': '0.1894', 'grad_norm': '2.271', 'learning_rate': '1.911e-05', 'epoch': '0.1609'}

 16%|█▌        | 6110/37963 [19:05:41<90:46:24, 10.26s/it]
 16%|█▌        | 6111/37963 [19:05:51<90:01:03, 10.17s/it]
 16%|█▌        | 6112/37963 [19:06:01<89:44:18, 10.14s/it]
 16%|█▌        | 6113/37963 [19:06:11<89:29:05, 10.11s/it]
 16%|█▌        | 6114/37963 [19:06:28<106:33:34, 12.04s/it]
 16%|█▌        | 6115/37963 [19:06:38<101:33:41, 11.48s/it]
 16%|█▌        | 6116/37963 [19:06:48<97:59:17, 11.08s/it] 
 16%|█▌        | 6117/37963 [19:06:58<94:46:44, 10.71s/it]
 16%|█▌        | 6118/37963 [19:07:08<93:01:28, 10.52s/it]
 16%|█▌        | 6119/37963 [19:07:25<109:08:50, 12.34s/it]
 16%|█▌        | 6120/37963 [19:07:35<103:04:00, 11.65s/it]
                                                           
{'loss': '0.1856', 'grad_norm': '1.767', 'learning_rate': '1.911e-05', 'epoch': '0.1612'}

 16%|█▌        | 6120/37963 [19:07:35<103:04:00, 11.65s/it]
 16%|█▌        | 6121/37963 [19:07:45<99:00:38, 11.19s/it] 
 16%|█▌        | 6122/37963 [19:07:55<94:50:37, 10.72s/it]
 16%|█▌        | 6123/37963 [19:08:05<92:53:55, 10.50s/it]
 16%|█▌        | 6124/37963 [19:08:15<91:48:55, 10.38s/it]
 16%|█▌        | 6125/37963 [19:08:25<90:48:05, 10.27s/it]
 16%|█▌        | 6126/37963 [19:08:42<108:28:22, 12.27s/it]
 16%|█▌        | 6127/37963 [19:08:52<102:05:21, 11.54s/it]
 16%|█▌        | 6128/37963 [19:09:02<98:24:19, 11.13s/it] 
 16%|█▌        | 6129/37963 [19:09:12<95:39:29, 10.82s/it]
 16%|█▌        | 6130/37963 [19:09:21<92:42:48, 10.48s/it]
                                                          
{'loss': '0.1725', 'grad_norm': '2.276', 'learning_rate': '1.911e-05', 'epoch': '0.1615'}

 16%|█▌        | 6130/37963 [19:09:21<92:42:48, 10.48s/it]
 16%|█▌        | 6131/37963 [19:09:31<91:18:06, 10.33s/it]
 16%|█▌        | 6132/37963 [19:09:41<89:47:35, 10.16s/it]
 16%|█▌        | 6133/37963 [19:09:51<89:36:36, 10.13s/it]
 16%|█▌        | 6134/37963 [19:10:08<106:15:05, 12.02s/it]
 16%|█▌        | 6135/37963 [19:10:18<101:16:35, 11.46s/it]
 16%|█▌        | 6136/37963 [19:10:28<97:54:45, 11.08s/it] 
 16%|█▌        | 6137/37963 [19:10:38<95:25:25, 10.79s/it]
 16%|█▌        | 6138/37963 [19:11:01<126:53:03, 14.35s/it]
 16%|█▌        | 6139/37963 [19:11:10<114:21:39, 12.94s/it]
 16%|█▌        | 6140/37963 [19:11:20<105:42:46, 11.96s/it]
                                                           
{'loss': '0.1872', 'grad_norm': '1.733', 'learning_rate': '1.91e-05', 'epoch': '0.1617'}

 16%|█▌        | 6140/37963 [19:11:20<105:42:46, 11.96s/it]
 16%|█▌        | 6141/37963 [19:11:30<99:42:52, 11.28s/it] 
 16%|█▌        | 6142/37963 [19:11:40<95:48:04, 10.84s/it]
 16%|█▌        | 6143/37963 [19:11:50<93:45:51, 10.61s/it]
 16%|█▌        | 6144/37963 [19:12:00<92:46:19, 10.50s/it]
 16%|█▌        | 6145/37963 [19:12:17<108:57:04, 12.33s/it]
 16%|█▌        | 6146/37963 [19:12:26<101:59:27, 11.54s/it]
 16%|█▌        | 6147/37963 [19:12:36<98:04:54, 11.10s/it] 
 16%|█▌        | 6148/37963 [19:12:46<95:07:12, 10.76s/it]
 16%|█▌        | 6149/37963 [19:12:56<92:08:44, 10.43s/it]
 16%|█▌        | 6150/37963 [19:13:12<108:02:04, 12.23s/it]
                                                           
{'loss': '0.1676', 'grad_norm': '3.622', 'learning_rate': '1.91e-05', 'epoch': '0.162'}

 16%|█▌        | 6150/37963 [19:13:12<108:02:04, 12.23s/it]
 16%|█▌        | 6151/37963 [19:13:22<101:18:50, 11.47s/it]
 16%|█▌        | 6152/37963 [19:13:32<96:26:59, 10.92s/it] 
 16%|█▌        | 6153/37963 [19:13:42<94:01:13, 10.64s/it]
 16%|█▌        | 6154/37963 [19:13:51<91:47:29, 10.39s/it]
 16%|█▌        | 6155/37963 [19:14:02<91:07:11, 10.31s/it]
 16%|█▌        | 6156/37963 [19:14:12<90:15:49, 10.22s/it]
 16%|█▌        | 6157/37963 [19:14:22<89:45:43, 10.16s/it]
 16%|█▌        | 6158/37963 [19:14:32<89:20:40, 10.11s/it]
 16%|█▌        | 6159/37963 [19:14:42<89:12:33, 10.10s/it]
 16%|█▌        | 6160/37963 [19:14:52<88:33:22, 10.02s/it]
                                                          
{'loss': '0.1773', 'grad_norm': '3.56', 'learning_rate': '1.91e-05', 'epoch': '0.1623'}

 16%|█▌        | 6160/37963 [19:14:52<88:33:22, 10.02s/it]
 16%|█▌        | 6161/37963 [19:15:08<104:26:04, 11.82s/it]
 16%|█▌        | 6162/37963 [19:15:17<98:58:22, 11.20s/it] 
 16%|█▌        | 6163/37963 [19:15:27<95:49:22, 10.85s/it]
 16%|█▌        | 6164/37963 [19:15:37<93:02:56, 10.53s/it]
 16%|█▌        | 6165/37963 [19:15:47<91:38:28, 10.38s/it]
 16%|█▌        | 6166/37963 [19:15:57<89:48:33, 10.17s/it]
 16%|█▌        | 6167/37963 [19:16:07<89:21:19, 10.12s/it]
 16%|█▌        | 6168/37963 [19:16:23<104:45:37, 11.86s/it]
 16%|█▋        | 6169/37963 [19:16:33<99:52:30, 11.31s/it] 
 16%|█▋        | 6170/37963 [19:16:43<96:34:17, 10.94s/it]
                                                          
{'loss': '0.179', 'grad_norm': '3.402', 'learning_rate': '1.909e-05', 'epoch': '0.1625'}

 16%|█▋        | 6170/37963 [19:16:43<96:34:17, 10.94s/it]
 16%|█▋        | 6171/37963 [19:16:53<94:35:20, 10.71s/it]
 16%|█▋        | 6172/37963 [19:17:03<92:55:02, 10.52s/it]
 16%|█▋        | 6173/37963 [19:17:13<90:59:31, 10.30s/it]
 16%|█▋        | 6174/37963 [19:17:23<90:28:32, 10.25s/it]
 16%|█▋        | 6175/37963 [19:17:40<108:46:34, 12.32s/it]
 16%|█▋        | 6176/37963 [19:17:50<103:15:30, 11.69s/it]
 16%|█▋        | 6177/37963 [19:18:00<98:34:55, 11.17s/it] 
 16%|█▋        | 6178/37963 [19:18:10<94:48:38, 10.74s/it]
 16%|█▋        | 6179/37963 [19:18:20<92:55:11, 10.52s/it]
 16%|█▋        | 6180/37963 [19:18:37<108:43:08, 12.31s/it]
                                                           
{'loss': '0.1904', 'grad_norm': '1.904', 'learning_rate': '1.909e-05', 'epoch': '0.1628'}

 16%|█▋        | 6180/37963 [19:18:37<108:43:08, 12.31s/it]
 16%|█▋        | 6181/37963 [19:18:47<102:56:24, 11.66s/it]
 16%|█▋        | 6182/37963 [19:18:57<98:23:23, 11.15s/it] 
 16%|█▋        | 6183/37963 [19:19:06<94:20:03, 10.69s/it]
 16%|█▋        | 6184/37963 [19:19:16<92:56:03, 10.53s/it]
 16%|█▋        | 6185/37963 [19:19:33<108:16:49, 12.27s/it]
 16%|█▋        | 6186/37963 [19:19:43<102:37:00, 11.63s/it]
 16%|█▋        | 6187/37963 [19:19:59<115:10:43, 13.05s/it]
 16%|█▋        | 6188/37963 [19:20:09<107:19:30, 12.16s/it]
 16%|█▋        | 6189/37963 [19:20:19<102:00:39, 11.56s/it]
 16%|█▋        | 6190/37963 [19:20:30<98:18:06, 11.14s/it] 
                                                          
{'loss': '0.1797', 'grad_norm': '0.6519', 'learning_rate': '1.909e-05', 'epoch': '0.1631'}

 16%|█▋        | 6190/37963 [19:20:30<98:18:06, 11.14s/it]
 16%|█▋        | 6191/37963 [19:20:40<95:43:09, 10.85s/it]
 16%|█▋        | 6192/37963 [19:20:56<110:32:33, 12.53s/it]
 16%|█▋        | 6193/37963 [19:21:06<104:00:40, 11.79s/it]
 16%|█▋        | 6194/37963 [19:21:16<99:41:03, 11.30s/it] 
 16%|█▋        | 6195/37963 [19:21:27<96:35:24, 10.95s/it]
 16%|█▋        | 6196/37963 [19:21:37<93:51:04, 10.64s/it]
 16%|█▋        | 6197/37963 [19:21:47<92:20:16, 10.46s/it]
 16%|█▋        | 6198/37963 [19:21:57<91:19:58, 10.35s/it]
 16%|█▋        | 6199/37963 [19:22:13<107:03:32, 12.13s/it]
 16%|█▋        | 6200/37963 [19:22:23<101:40:39, 11.52s/it]
                                                           
{'loss': '0.1904', 'grad_norm': '8.393', 'learning_rate': '1.908e-05', 'epoch': '0.1633'}

 16%|█▋        | 6200/37963 [19:22:23<101:40:39, 11.52s/it]
 16%|█▋        | 6201/37963 [19:22:33<97:58:43, 11.11s/it] 
 16%|█▋        | 6202/37963 [19:22:43<95:27:07, 10.82s/it]
 16%|█▋        | 6203/37963 [19:22:54<93:44:02, 10.62s/it]
 16%|█▋        | 6204/37963 [19:23:03<91:34:23, 10.38s/it]
 16%|█▋        | 6205/37963 [19:23:13<90:37:16, 10.27s/it]
 16%|█▋        | 6206/37963 [19:23:23<90:01:57, 10.21s/it]
 16%|█▋        | 6207/37963 [19:23:33<87:34:43,  9.93s/it]
 16%|█▋        | 6208/37963 [19:23:43<88:06:44,  9.99s/it]
 16%|█▋        | 6209/37963 [19:23:53<88:07:46,  9.99s/it]
 16%|█▋        | 6210/37963 [19:24:09<105:17:29, 11.94s/it]
                                                           
{'loss': '0.1862', 'grad_norm': '3.348', 'learning_rate': '1.908e-05', 'epoch': '0.1636'}

 16%|█▋        | 6210/37963 [19:24:09<105:17:29, 11.94s/it]
 16%|█▋        | 6211/37963 [19:24:19<100:35:52, 11.41s/it]
 16%|█▋        | 6212/37963 [19:24:30<97:06:50, 11.01s/it] 
 16%|█▋        | 6213/37963 [19:24:40<94:25:26, 10.71s/it]
 16%|█▋        | 6214/37963 [19:24:50<92:38:16, 10.50s/it]
 16%|█▋        | 6215/37963 [19:25:00<91:45:26, 10.40s/it]
 16%|█▋        | 6216/37963 [19:25:10<90:44:48, 10.29s/it]
 16%|█▋        | 6217/37963 [19:25:26<106:33:53, 12.08s/it]
 16%|█▋        | 6218/37963 [19:25:36<101:00:27, 11.45s/it]
 16%|█▋        | 6219/37963 [19:25:46<97:17:59, 11.03s/it] 
 16%|█▋        | 6220/37963 [19:25:56<94:52:01, 10.76s/it]
                                                          
{'loss': '0.1865', 'grad_norm': '1.091', 'learning_rate': '1.908e-05', 'epoch': '0.1638'}

 16%|█▋        | 6220/37963 [19:25:56<94:52:01, 10.76s/it]
 16%|█▋        | 6221/37963 [19:26:06<92:54:23, 10.54s/it]
 16%|█▋        | 6222/37963 [19:26:16<91:01:29, 10.32s/it]
 16%|█▋        | 6223/37963 [19:26:26<90:18:48, 10.24s/it]
 16%|█▋        | 6224/37963 [19:26:43<107:50:09, 12.23s/it]
 16%|█▋        | 6225/37963 [19:26:53<102:45:14, 11.66s/it]
 16%|█▋        | 6226/37963 [19:27:03<98:36:05, 11.18s/it] 
 16%|█▋        | 6227/37963 [19:27:13<95:48:53, 10.87s/it]
 16%|█▋        | 6228/37963 [19:27:23<93:11:21, 10.57s/it]
 16%|█▋        | 6229/37963 [19:27:33<91:52:53, 10.42s/it]
 16%|█▋        | 6230/37963 [19:27:44<90:58:37, 10.32s/it]
                                                          
{'loss': '0.1763', 'grad_norm': '1.524', 'learning_rate': '1.907e-05', 'epoch': '0.1641'}

 16%|█▋        | 6230/37963 [19:27:44<90:58:37, 10.32s/it]
 16%|█▋        | 6231/37963 [19:28:00<107:56:31, 12.25s/it]
 16%|█▋        | 6232/37963 [19:28:10<102:30:27, 11.63s/it]
 16%|█▋        | 6233/37963 [19:28:27<114:59:15, 13.05s/it]
 16%|█▋        | 6234/37963 [19:28:37<107:28:13, 12.19s/it]
 16%|█▋        | 6235/37963 [19:28:53<118:41:00, 13.47s/it]
 16%|█▋        | 6236/37963 [19:29:03<109:25:35, 12.42s/it]
 16%|█▋        | 6237/37963 [19:29:13<103:12:34, 11.71s/it]
 16%|█▋        | 6238/37963 [19:29:23<97:31:58, 11.07s/it] 
 16%|█▋        | 6239/37963 [19:29:39<111:33:45, 12.66s/it]
 16%|█▋        | 6240/37963 [19:29:49<104:26:46, 11.85s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '0.972', 'learning_rate': '1.907e-05', 'epoch': '0.1644'}

 16%|█▋        | 6240/37963 [19:29:49<104:26:46, 11.85s/it]
 16%|█▋        | 6241/37963 [19:30:00<100:21:36, 11.39s/it]
 16%|█▋        | 6242/37963 [19:30:10<96:57:58, 11.00s/it] 
 16%|█▋        | 6243/37963 [19:30:20<94:24:16, 10.71s/it]
 16%|█▋        | 6244/37963 [19:30:30<92:40:44, 10.52s/it]
 16%|█▋        | 6245/37963 [19:30:40<91:48:57, 10.42s/it]
 16%|█▋        | 6246/37963 [19:30:50<90:30:49, 10.27s/it]
 16%|█▋        | 6247/37963 [19:31:06<106:28:36, 12.09s/it]
 16%|█▋        | 6248/37963 [19:31:17<101:22:48, 11.51s/it]
 16%|█▋        | 6249/37963 [19:31:26<95:48:19, 10.88s/it] 
 16%|█▋        | 6250/37963 [19:31:36<93:36:33, 10.63s/it]
                                                          
{'loss': '0.1839', 'grad_norm': '5.048', 'learning_rate': '1.906e-05', 'epoch': '0.1646'}

 16%|█▋        | 6250/37963 [19:31:36<93:36:33, 10.63s/it]
 16%|█▋        | 6251/37963 [19:31:46<91:49:56, 10.42s/it]
 16%|█▋        | 6252/37963 [19:31:56<90:29:36, 10.27s/it]
 16%|█▋        | 6253/37963 [19:32:06<89:08:36, 10.12s/it]
 16%|█▋        | 6254/37963 [19:32:16<89:08:55, 10.12s/it]
 16%|█▋        | 6255/37963 [19:32:26<89:17:09, 10.14s/it]
 16%|█▋        | 6256/37963 [19:32:36<89:17:32, 10.14s/it]
 16%|█▋        | 6257/37963 [19:32:46<89:07:25, 10.12s/it]
 16%|█▋        | 6258/37963 [19:33:03<105:43:13, 12.00s/it]
 16%|█▋        | 6259/37963 [19:33:12<100:14:45, 11.38s/it]
 16%|█▋        | 6260/37963 [19:33:23<96:52:27, 11.00s/it] 
                                                          
{'loss': '0.1774', 'grad_norm': '3.088', 'learning_rate': '1.906e-05', 'epoch': '0.1649'}

 16%|█▋        | 6260/37963 [19:33:23<96:52:27, 11.00s/it]
 16%|█▋        | 6261/37963 [19:33:33<94:33:06, 10.74s/it]
 16%|█▋        | 6262/37963 [19:33:42<91:52:05, 10.43s/it]
 16%|█▋        | 6263/37963 [19:33:52<90:40:23, 10.30s/it]
 17%|█▋        | 6264/37963 [19:34:03<90:15:45, 10.25s/it]
 17%|█▋        | 6265/37963 [19:34:13<89:45:28, 10.19s/it]
 17%|█▋        | 6266/37963 [19:34:29<105:41:24, 12.00s/it]
 17%|█▋        | 6267/37963 [19:34:39<101:33:39, 11.54s/it]
 17%|█▋        | 6268/37963 [19:34:49<97:41:49, 11.10s/it] 
 17%|█▋        | 6269/37963 [19:34:59<93:43:46, 10.65s/it]
 17%|█▋        | 6270/37963 [19:35:09<92:05:02, 10.46s/it]
                                                          
{'loss': '0.1928', 'grad_norm': '1.238', 'learning_rate': '1.906e-05', 'epoch': '0.1652'}

 17%|█▋        | 6270/37963 [19:35:09<92:05:02, 10.46s/it]
 17%|█▋        | 6271/37963 [19:35:19<90:27:20, 10.28s/it]
 17%|█▋        | 6272/37963 [19:35:29<89:57:18, 10.22s/it]
 17%|█▋        | 6273/37963 [19:35:46<108:09:14, 12.29s/it]
 17%|█▋        | 6274/37963 [19:35:56<101:41:08, 11.55s/it]
 17%|█▋        | 6275/37963 [19:36:06<97:30:54, 11.08s/it] 
 17%|█▋        | 6276/37963 [19:36:16<94:12:28, 10.70s/it]
 17%|█▋        | 6277/37963 [19:36:26<92:37:28, 10.52s/it]
 17%|█▋        | 6278/37963 [19:36:36<91:42:02, 10.42s/it]
 17%|█▋        | 6279/37963 [19:36:46<90:59:39, 10.34s/it]
 17%|█▋        | 6280/37963 [19:37:03<107:21:22, 12.20s/it]
                                                           
{'loss': '0.1902', 'grad_norm': '1.831', 'learning_rate': '1.905e-05', 'epoch': '0.1654'}

 17%|█▋        | 6280/37963 [19:37:03<107:21:22, 12.20s/it]
 17%|█▋        | 6281/37963 [19:37:19<118:09:35, 13.43s/it]
 17%|█▋        | 6282/37963 [19:37:29<108:58:17, 12.38s/it]
 17%|█▋        | 6283/37963 [19:37:39<103:06:47, 11.72s/it]
 17%|█▋        | 6284/37963 [19:37:56<116:08:02, 13.20s/it]
 17%|█▋        | 6285/37963 [19:38:06<108:23:47, 12.32s/it]
 17%|█▋        | 6286/37963 [19:38:16<101:57:03, 11.59s/it]
 17%|█▋        | 6287/37963 [19:38:25<95:19:59, 10.83s/it] 
 17%|█▋        | 6288/37963 [19:38:35<92:45:27, 10.54s/it]
 17%|█▋        | 6289/37963 [19:38:51<107:35:55, 12.23s/it]
 17%|█▋        | 6290/37963 [19:39:01<101:57:39, 11.59s/it]
                                                           
{'loss': '0.1811', 'grad_norm': '3.809', 'learning_rate': '1.905e-05', 'epoch': '0.1657'}

 17%|█▋        | 6290/37963 [19:39:01<101:57:39, 11.59s/it]
 17%|█▋        | 6291/37963 [19:39:11<97:52:35, 11.13s/it] 
 17%|█▋        | 6292/37963 [19:39:21<95:22:03, 10.84s/it]
 17%|█▋        | 6293/37963 [19:39:31<93:23:59, 10.62s/it]
 17%|█▋        | 6294/37963 [19:39:41<91:52:33, 10.44s/it]
 17%|█▋        | 6295/37963 [19:39:51<91:00:56, 10.35s/it]
 17%|█▋        | 6296/37963 [19:40:08<106:41:24, 12.13s/it]
 17%|█▋        | 6297/37963 [19:40:17<100:06:02, 11.38s/it]
 17%|█▋        | 6298/37963 [19:40:27<96:41:34, 10.99s/it] 
 17%|█▋        | 6299/37963 [19:40:38<94:12:40, 10.71s/it]
 17%|█▋        | 6300/37963 [19:40:48<92:32:18, 10.52s/it]
                                                          
{'loss': '0.1756', 'grad_norm': '4.885', 'learning_rate': '1.905e-05', 'epoch': '0.166'}

 17%|█▋        | 6300/37963 [19:40:48<92:32:18, 10.52s/it]
 17%|█▋        | 6301/37963 [19:40:58<91:32:44, 10.41s/it]
 17%|█▋        | 6302/37963 [19:41:08<90:32:11, 10.29s/it]
 17%|█▋        | 6303/37963 [19:41:18<89:13:03, 10.14s/it]
 17%|█▋        | 6304/37963 [19:41:28<89:16:01, 10.15s/it]
 17%|█▋        | 6305/37963 [19:41:38<88:37:59, 10.08s/it]
 17%|█▋        | 6306/37963 [19:41:48<88:32:08, 10.07s/it]
 17%|█▋        | 6307/37963 [19:42:04<105:52:09, 12.04s/it]
 17%|█▋        | 6308/37963 [19:42:14<100:52:36, 11.47s/it]
 17%|█▋        | 6309/37963 [19:42:24<97:02:07, 11.04s/it] 
 17%|█▋        | 6310/37963 [19:42:34<94:01:56, 10.69s/it]
                                                          
{'loss': '0.181', 'grad_norm': '2.549', 'learning_rate': '1.904e-05', 'epoch': '0.1662'}

 17%|█▋        | 6310/37963 [19:42:34<94:01:56, 10.69s/it]
 17%|█▋        | 6311/37963 [19:42:45<92:40:36, 10.54s/it]
 17%|█▋        | 6312/37963 [19:42:55<91:20:55, 10.39s/it]
 17%|█▋        | 6313/37963 [19:43:05<90:50:33, 10.33s/it]
 17%|█▋        | 6314/37963 [19:43:15<90:11:41, 10.26s/it]
 17%|█▋        | 6315/37963 [19:43:31<105:51:57, 12.04s/it]
 17%|█▋        | 6316/37963 [19:43:41<100:47:31, 11.47s/it]
 17%|█▋        | 6317/37963 [19:43:51<97:10:39, 11.05s/it] 
 17%|█▋        | 6318/37963 [19:44:01<94:28:03, 10.75s/it]
 17%|█▋        | 6319/37963 [19:44:11<92:44:51, 10.55s/it]
 17%|█▋        | 6320/37963 [19:44:22<91:38:58, 10.43s/it]
                                                          
{'loss': '0.1726', 'grad_norm': '2.547', 'learning_rate': '1.904e-05', 'epoch': '0.1665'}

 17%|█▋        | 6320/37963 [19:44:22<91:38:58, 10.43s/it]
 17%|█▋        | 6321/37963 [19:44:32<90:39:38, 10.31s/it]
 17%|█▋        | 6322/37963 [19:44:49<108:49:54, 12.38s/it]
 17%|█▋        | 6323/37963 [19:44:59<102:53:51, 11.71s/it]
 17%|█▋        | 6324/37963 [19:45:09<98:32:15, 11.21s/it] 
 17%|█▋        | 6325/37963 [19:45:19<95:24:15, 10.86s/it]
 17%|█▋        | 6326/37963 [19:45:29<93:02:01, 10.59s/it]
 17%|█▋        | 6327/37963 [19:45:45<108:20:27, 12.33s/it]
 17%|█▋        | 6328/37963 [19:45:56<102:35:07, 11.67s/it]
 17%|█▋        | 6329/37963 [19:46:05<96:49:55, 11.02s/it] 
 17%|█▋        | 6330/37963 [19:46:22<111:11:59, 12.66s/it]
                                                           
{'loss': '0.1816', 'grad_norm': '2.58', 'learning_rate': '1.904e-05', 'epoch': '0.1667'}

 17%|█▋        | 6330/37963 [19:46:22<111:11:59, 12.66s/it]
 17%|█▋        | 6331/37963 [19:46:31<104:08:21, 11.85s/it]
 17%|█▋        | 6332/37963 [19:46:47<114:43:49, 13.06s/it]
 17%|█▋        | 6333/37963 [19:46:57<106:33:18, 12.13s/it]
 17%|█▋        | 6334/37963 [19:47:07<100:56:46, 11.49s/it]
 17%|█▋        | 6335/37963 [19:47:17<97:07:26, 11.05s/it] 
 17%|█▋        | 6336/37963 [19:47:27<94:37:57, 10.77s/it]
 17%|█▋        | 6337/37963 [19:47:37<92:24:33, 10.52s/it]
 17%|█▋        | 6338/37963 [19:47:47<91:02:55, 10.36s/it]
 17%|█▋        | 6339/37963 [19:47:58<90:19:06, 10.28s/it]
 17%|█▋        | 6340/37963 [19:48:08<89:46:33, 10.22s/it]
                                                          
{'loss': '0.1694', 'grad_norm': '2.657', 'learning_rate': '1.903e-05', 'epoch': '0.167'}

 17%|█▋        | 6340/37963 [19:48:08<89:46:33, 10.22s/it]
 17%|█▋        | 6341/37963 [19:48:24<106:53:06, 12.17s/it]
 17%|█▋        | 6342/37963 [19:48:34<100:21:50, 11.43s/it]
 17%|█▋        | 6343/37963 [19:48:44<97:09:37, 11.06s/it] 
 17%|█▋        | 6344/37963 [19:48:54<94:38:40, 10.78s/it]
 17%|█▋        | 6345/37963 [19:49:11<109:26:09, 12.46s/it]
 17%|█▋        | 6346/37963 [19:49:20<101:38:22, 11.57s/it]
 17%|█▋        | 6347/37963 [19:49:30<97:49:03, 11.14s/it] 
 17%|█▋        | 6348/37963 [19:49:41<95:28:06, 10.87s/it]
 17%|█▋        | 6349/37963 [19:49:51<93:50:23, 10.69s/it]
 17%|█▋        | 6350/37963 [19:50:01<92:05:49, 10.49s/it]
                                                          
{'loss': '0.1674', 'grad_norm': '1.094', 'learning_rate': '1.903e-05', 'epoch': '0.1673'}

 17%|█▋        | 6350/37963 [19:50:01<92:05:49, 10.49s/it]
 17%|█▋        | 6351/37963 [19:50:11<90:56:09, 10.36s/it]
 17%|█▋        | 6352/37963 [19:50:20<88:39:58, 10.10s/it]
 17%|█▋        | 6353/37963 [19:50:30<87:52:27, 10.01s/it]
 17%|█▋        | 6354/37963 [19:50:40<88:09:13, 10.04s/it]
 17%|█▋        | 6355/37963 [19:50:50<88:08:57, 10.04s/it]
 17%|█▋        | 6356/37963 [19:51:07<106:13:12, 12.10s/it]
 17%|█▋        | 6357/37963 [19:51:17<99:24:16, 11.32s/it] 
 17%|█▋        | 6358/37963 [19:51:27<96:10:13, 10.95s/it]
 17%|█▋        | 6359/37963 [19:51:37<93:49:27, 10.69s/it]
 17%|█▋        | 6360/37963 [19:51:47<92:16:23, 10.51s/it]
                                                          
{'loss': '0.1652', 'grad_norm': '2.8', 'learning_rate': '1.902e-05', 'epoch': '0.1675'}

 17%|█▋        | 6360/37963 [19:51:47<92:16:23, 10.51s/it]
 17%|█▋        | 6361/37963 [19:51:57<90:42:51, 10.33s/it]
 17%|█▋        | 6362/37963 [19:52:07<90:40:02, 10.33s/it]
 17%|█▋        | 6363/37963 [19:52:17<89:54:11, 10.24s/it]
 17%|█▋        | 6364/37963 [19:52:34<106:49:35, 12.17s/it]
 17%|█▋        | 6365/37963 [19:52:44<101:19:24, 11.54s/it]
 17%|█▋        | 6366/37963 [19:52:54<97:20:19, 11.09s/it] 
 17%|█▋        | 6367/37963 [19:53:04<94:43:01, 10.79s/it]
 17%|█▋        | 6368/37963 [19:53:14<92:46:43, 10.57s/it]
 17%|█▋        | 6369/37963 [19:53:24<91:33:36, 10.43s/it]
 17%|█▋        | 6370/37963 [19:53:41<109:05:06, 12.43s/it]
                                                           
{'loss': '0.1725', 'grad_norm': '2.023', 'learning_rate': '1.902e-05', 'epoch': '0.1678'}

 17%|█▋        | 6370/37963 [19:53:41<109:05:06, 12.43s/it]
 17%|█▋        | 6371/37963 [19:53:52<103:04:44, 11.75s/it]
 17%|█▋        | 6372/37963 [19:54:02<98:45:30, 11.25s/it] 
 17%|█▋        | 6373/37963 [19:54:12<95:31:35, 10.89s/it]
 17%|█▋        | 6374/37963 [19:54:22<93:32:56, 10.66s/it]
 17%|█▋        | 6375/37963 [19:54:32<92:14:54, 10.51s/it]
 17%|█▋        | 6376/37963 [19:54:48<106:47:26, 12.17s/it]
 17%|█▋        | 6377/37963 [19:54:58<101:40:21, 11.59s/it]
 17%|█▋        | 6378/37963 [19:55:15<115:06:02, 13.12s/it]
 17%|█▋        | 6379/37963 [19:55:25<106:42:51, 12.16s/it]
 17%|█▋        | 6380/37963 [19:55:35<101:14:51, 11.54s/it]
                                                           
{'loss': '0.168', 'grad_norm': '3.178', 'learning_rate': '1.902e-05', 'epoch': '0.1681'}

 17%|█▋        | 6380/37963 [19:55:35<101:14:51, 11.54s/it]
 17%|█▋        | 6381/37963 [19:55:45<97:23:23, 11.10s/it] 
 17%|█▋        | 6382/37963 [19:56:02<111:52:34, 12.75s/it]
 17%|█▋        | 6383/37963 [19:56:12<104:45:32, 11.94s/it]
 17%|█▋        | 6384/37963 [19:56:22<99:29:37, 11.34s/it] 
 17%|█▋        | 6385/37963 [19:56:32<95:59:28, 10.94s/it]
 17%|█▋        | 6386/37963 [19:56:42<93:28:00, 10.66s/it]
 17%|█▋        | 6387/37963 [19:56:51<91:04:42, 10.38s/it]
 17%|█▋        | 6388/37963 [19:57:02<90:20:16, 10.30s/it]
 17%|█▋        | 6389/37963 [19:57:12<89:40:14, 10.22s/it]
 17%|█▋        | 6390/37963 [19:57:28<106:59:51, 12.20s/it]
                                                           
{'loss': '0.1557', 'grad_norm': '1.777', 'learning_rate': '1.901e-05', 'epoch': '0.1683'}

 17%|█▋        | 6390/37963 [19:57:28<106:59:51, 12.20s/it]
 17%|█▋        | 6391/37963 [19:57:39<101:32:18, 11.58s/it]
 17%|█▋        | 6392/37963 [19:57:48<97:02:29, 11.07s/it] 
 17%|█▋        | 6393/37963 [19:57:58<94:14:18, 10.75s/it]
 17%|█▋        | 6394/37963 [19:58:08<92:24:28, 10.54s/it]
 17%|█▋        | 6395/37963 [19:58:25<107:28:52, 12.26s/it]
 17%|█▋        | 6396/37963 [19:58:35<101:14:04, 11.55s/it]
 17%|█▋        | 6397/37963 [19:58:44<96:50:23, 11.04s/it] 
 17%|█▋        | 6398/37963 [19:58:54<93:54:09, 10.71s/it]
 17%|█▋        | 6399/37963 [19:59:04<91:47:15, 10.47s/it]
 17%|█▋        | 6400/37963 [19:59:14<90:35:36, 10.33s/it]
                                                          
{'loss': '0.1757', 'grad_norm': '3.798', 'learning_rate': '1.901e-05', 'epoch': '0.1686'}

 17%|█▋        | 6400/37963 [19:59:14<90:35:36, 10.33s/it]
 17%|█▋        | 6401/37963 [19:59:24<89:12:43, 10.18s/it]
 17%|█▋        | 6402/37963 [19:59:34<87:51:48, 10.02s/it]
 17%|█▋        | 6403/37963 [19:59:50<104:17:43, 11.90s/it]
 17%|█▋        | 6404/37963 [20:00:00<99:31:24, 11.35s/it] 
 17%|█▋        | 6405/37963 [20:00:10<96:16:02, 10.98s/it]
 17%|█▋        | 6406/37963 [20:00:20<93:53:16, 10.71s/it]
 17%|█▋        | 6407/37963 [20:00:30<92:03:18, 10.50s/it]
 17%|█▋        | 6408/37963 [20:00:40<90:46:57, 10.36s/it]
 17%|█▋        | 6409/37963 [20:00:51<90:16:15, 10.30s/it]
 17%|█▋        | 6410/37963 [20:01:01<89:44:36, 10.24s/it]
                                                          
{'loss': '0.1598', 'grad_norm': '1.551', 'learning_rate': '1.901e-05', 'epoch': '0.1688'}

 17%|█▋        | 6410/37963 [20:01:01<89:44:36, 10.24s/it]
 17%|█▋        | 6411/37963 [20:01:11<89:06:53, 10.17s/it]
 17%|█▋        | 6412/37963 [20:01:21<89:00:42, 10.16s/it]
 17%|█▋        | 6413/37963 [20:01:37<105:18:05, 12.02s/it]
 17%|█▋        | 6414/37963 [20:01:47<99:16:56, 11.33s/it] 
 17%|█▋        | 6415/37963 [20:01:57<95:59:44, 10.95s/it]
 17%|█▋        | 6416/37963 [20:02:07<93:46:29, 10.70s/it]
 17%|█▋        | 6417/37963 [20:02:17<92:23:36, 10.54s/it]
 17%|█▋        | 6418/37963 [20:02:27<90:59:27, 10.38s/it]
 17%|█▋        | 6419/37963 [20:02:44<107:40:59, 12.29s/it]
 17%|█▋        | 6420/37963 [20:02:54<101:38:21, 11.60s/it]
                                                           
{'loss': '0.174', 'grad_norm': '1.545', 'learning_rate': '1.9e-05', 'epoch': '0.1691'}

 17%|█▋        | 6420/37963 [20:02:54<101:38:21, 11.60s/it]
 17%|█▋        | 6421/37963 [20:03:04<97:28:39, 11.13s/it] 
 17%|█▋        | 6422/37963 [20:03:14<94:26:39, 10.78s/it]
 17%|█▋        | 6423/37963 [20:03:24<92:32:37, 10.56s/it]
 17%|█▋        | 6424/37963 [20:03:40<107:42:05, 12.29s/it]
 17%|█▋        | 6425/37963 [20:03:50<101:51:37, 11.63s/it]
 17%|█▋        | 6426/37963 [20:04:07<113:54:08, 13.00s/it]
 17%|█▋        | 6427/37963 [20:04:17<106:16:48, 12.13s/it]
 17%|█▋        | 6428/37963 [20:04:27<101:07:35, 11.54s/it]
 17%|█▋        | 6429/37963 [20:04:37<97:17:11, 11.11s/it] 
 17%|█▋        | 6430/37963 [20:04:53<111:00:34, 12.67s/it]
                                                           
{'loss': '0.1805', 'grad_norm': '4.809', 'learning_rate': '1.9e-05', 'epoch': '0.1694'}

 17%|█▋        | 6430/37963 [20:04:53<111:00:34, 12.67s/it]
 17%|█▋        | 6431/37963 [20:05:04<104:30:27, 11.93s/it]
 17%|█▋        | 6432/37963 [20:05:14<99:26:01, 11.35s/it] 
 17%|█▋        | 6433/37963 [20:05:24<96:09:33, 10.98s/it]
 17%|█▋        | 6434/37963 [20:05:33<92:25:06, 10.55s/it]
 17%|█▋        | 6435/37963 [20:05:43<91:05:40, 10.40s/it]
 17%|█▋        | 6436/37963 [20:05:53<90:06:03, 10.29s/it]
 17%|█▋        | 6437/37963 [20:06:03<88:54:14, 10.15s/it]
 17%|█▋        | 6438/37963 [20:06:20<105:29:59, 12.05s/it]
 17%|█▋        | 6439/37963 [20:06:30<100:05:32, 11.43s/it]
 17%|█▋        | 6440/37963 [20:06:40<96:17:24, 11.00s/it] 
                                                          
{'loss': '0.1804', 'grad_norm': '1.843', 'learning_rate': '1.9e-05', 'epoch': '0.1696'}

 17%|█▋        | 6440/37963 [20:06:40<96:17:24, 11.00s/it]
 17%|█▋        | 6441/37963 [20:06:50<93:59:04, 10.73s/it]
 17%|█▋        | 6442/37963 [20:07:00<91:43:39, 10.48s/it]
 17%|█▋        | 6443/37963 [20:07:16<106:13:37, 12.13s/it]
 17%|█▋        | 6444/37963 [20:07:26<101:01:12, 11.54s/it]
 17%|█▋        | 6445/37963 [20:07:36<97:06:47, 11.09s/it] 
 17%|█▋        | 6446/37963 [20:07:46<94:30:54, 10.80s/it]
 17%|█▋        | 6447/37963 [20:07:56<92:54:20, 10.61s/it]
 17%|█▋        | 6448/37963 [20:08:06<91:26:22, 10.45s/it]
 17%|█▋        | 6449/37963 [20:08:16<90:28:38, 10.34s/it]
 17%|█▋        | 6450/37963 [20:08:26<89:21:19, 10.21s/it]
                                                          
{'loss': '0.1791', 'grad_norm': '3.457', 'learning_rate': '1.899e-05', 'epoch': '0.1699'}

 17%|█▋        | 6450/37963 [20:08:26<89:21:19, 10.21s/it]
 17%|█▋        | 6451/37963 [20:08:36<89:16:18, 10.20s/it]
 17%|█▋        | 6452/37963 [20:08:53<105:41:29, 12.07s/it]
 17%|█▋        | 6453/37963 [20:09:03<100:33:06, 11.49s/it]
 17%|█▋        | 6454/37963 [20:09:13<97:03:28, 11.09s/it] 
 17%|█▋        | 6455/37963 [20:09:23<94:23:28, 10.78s/it]
 17%|█▋        | 6456/37963 [20:09:33<92:29:16, 10.57s/it]
 17%|█▋        | 6457/37963 [20:09:43<91:18:24, 10.43s/it]
 17%|█▋        | 6458/37963 [20:09:53<88:48:34, 10.15s/it]
 17%|█▋        | 6459/37963 [20:10:03<88:07:14, 10.07s/it]
 17%|█▋        | 6460/37963 [20:10:12<87:39:42, 10.02s/it]
                                                          
{'loss': '0.1964', 'grad_norm': '1.982', 'learning_rate': '1.899e-05', 'epoch': '0.1702'}

 17%|█▋        | 6460/37963 [20:10:12<87:39:42, 10.02s/it]
 17%|█▋        | 6461/37963 [20:10:23<87:53:12, 10.04s/it]
 17%|█▋        | 6462/37963 [20:10:39<105:16:01, 12.03s/it]
 17%|█▋        | 6463/37963 [20:10:49<99:39:42, 11.39s/it] 
 17%|█▋        | 6464/37963 [20:10:59<96:10:55, 10.99s/it]
 17%|█▋        | 6465/37963 [20:11:09<93:36:33, 10.70s/it]
 17%|█▋        | 6466/37963 [20:11:19<91:52:43, 10.50s/it]
 17%|█▋        | 6467/37963 [20:11:29<90:48:28, 10.38s/it]
 17%|█▋        | 6468/37963 [20:11:46<108:18:39, 12.38s/it]
 17%|█▋        | 6469/37963 [20:11:56<102:14:22, 11.69s/it]
 17%|█▋        | 6470/37963 [20:12:06<97:37:28, 11.16s/it] 
                                                          
{'loss': '0.192', 'grad_norm': '5.034', 'learning_rate': '1.898e-05', 'epoch': '0.1704'}

 17%|█▋        | 6470/37963 [20:12:06<97:37:28, 11.16s/it]
 17%|█▋        | 6471/37963 [20:12:16<94:46:13, 10.83s/it]
 17%|█▋        | 6472/37963 [20:12:33<109:35:45, 12.53s/it]
 17%|█▋        | 6473/37963 [20:12:43<102:38:32, 11.73s/it]
 17%|█▋        | 6474/37963 [20:12:53<98:08:12, 11.22s/it] 
 17%|█▋        | 6475/37963 [20:13:03<95:07:25, 10.88s/it]
 17%|█▋        | 6476/37963 [20:13:20<110:14:04, 12.60s/it]
 17%|█▋        | 6477/37963 [20:13:30<103:38:24, 11.85s/it]
 17%|█▋        | 6478/37963 [20:13:46<114:34:11, 13.10s/it]
 17%|█▋        | 6479/37963 [20:13:56<107:02:52, 12.24s/it]
 17%|█▋        | 6480/37963 [20:14:06<100:19:03, 11.47s/it]
                                                           
{'loss': '0.1826', 'grad_norm': '4.706', 'learning_rate': '1.898e-05', 'epoch': '0.1707'}

 17%|█▋        | 6480/37963 [20:14:06<100:19:03, 11.47s/it]
 17%|█▋        | 6481/37963 [20:14:16<96:30:57, 11.04s/it] 
 17%|█▋        | 6482/37963 [20:14:26<93:52:39, 10.74s/it]
 17%|█▋        | 6483/37963 [20:14:36<92:15:58, 10.55s/it]
 17%|█▋        | 6484/37963 [20:14:46<90:57:54, 10.40s/it]
 17%|█▋        | 6485/37963 [20:14:55<88:49:24, 10.16s/it]
 17%|█▋        | 6486/37963 [20:15:06<88:53:45, 10.17s/it]
 17%|█▋        | 6487/37963 [20:15:22<105:11:41, 12.03s/it]
 17%|█▋        | 6488/37963 [20:15:32<99:03:50, 11.33s/it] 
 17%|█▋        | 6489/37963 [20:15:41<94:43:39, 10.83s/it]
 17%|█▋        | 6490/37963 [20:15:51<92:43:08, 10.61s/it]
                                                          
{'loss': '0.1821', 'grad_norm': '3.52', 'learning_rate': '1.898e-05', 'epoch': '0.171'}

 17%|█▋        | 6490/37963 [20:15:51<92:43:08, 10.61s/it]
 17%|█▋        | 6491/37963 [20:16:08<107:42:43, 12.32s/it]
 17%|█▋        | 6492/37963 [20:16:18<101:50:18, 11.65s/it]
 17%|█▋        | 6493/37963 [20:16:27<96:27:12, 11.03s/it] 
 17%|█▋        | 6494/37963 [20:16:37<93:50:08, 10.73s/it]
 17%|█▋        | 6495/37963 [20:16:47<91:56:30, 10.52s/it]
 17%|█▋        | 6496/37963 [20:16:58<90:40:11, 10.37s/it]
 17%|█▋        | 6497/37963 [20:17:07<89:29:19, 10.24s/it]
 17%|█▋        | 6498/37963 [20:17:17<88:10:18, 10.09s/it]
 17%|█▋        | 6499/37963 [20:17:27<87:40:05, 10.03s/it]
 17%|█▋        | 6500/37963 [20:17:37<87:30:12, 10.01s/it]
                                                          
{'loss': '0.18', 'grad_norm': '2.361', 'learning_rate': '1.897e-05', 'epoch': '0.1712'}

 17%|█▋        | 6500/37963 [20:17:37<87:30:12, 10.01s/it]
 17%|█▋        | 6501/37963 [20:17:53<103:57:03, 11.89s/it]
 17%|█▋        | 6502/37963 [20:18:03<99:11:22, 11.35s/it] 
 17%|█▋        | 6503/37963 [20:18:13<95:37:59, 10.94s/it]
 17%|█▋        | 6504/37963 [20:18:23<93:04:20, 10.65s/it]
 17%|█▋        | 6505/37963 [20:18:33<91:34:04, 10.48s/it]
 17%|█▋        | 6506/37963 [20:18:43<88:51:29, 10.17s/it]
 17%|█▋        | 6507/37963 [20:18:53<87:41:48, 10.04s/it]
 17%|█▋        | 6508/37963 [20:19:03<87:52:14, 10.06s/it]
 17%|█▋        | 6509/37963 [20:19:13<88:02:16, 10.08s/it]
 17%|█▋        | 6510/37963 [20:19:23<87:25:12, 10.01s/it]
                                                          
{'loss': '0.1774', 'grad_norm': '6.306', 'learning_rate': '1.897e-05', 'epoch': '0.1715'}

 17%|█▋        | 6510/37963 [20:19:23<87:25:12, 10.01s/it]
 17%|█▋        | 6511/37963 [20:19:39<104:27:13, 11.96s/it]
 17%|█▋        | 6512/37963 [20:19:49<99:47:15, 11.42s/it] 
 17%|█▋        | 6513/37963 [20:19:59<95:38:24, 10.95s/it]
 17%|█▋        | 6514/37963 [20:20:16<110:39:50, 12.67s/it]
 17%|█▋        | 6515/37963 [20:20:26<102:43:30, 11.76s/it]
 17%|█▋        | 6516/37963 [20:20:36<98:25:00, 11.27s/it] 
 17%|█▋        | 6517/37963 [20:20:46<95:12:30, 10.90s/it]
 17%|█▋        | 6518/37963 [20:21:02<109:53:21, 12.58s/it]
 17%|█▋        | 6519/37963 [20:21:12<102:16:42, 11.71s/it]
 17%|█▋        | 6520/37963 [20:21:22<98:00:04, 11.22s/it] 
                                                          
{'loss': '0.1836', 'grad_norm': '0.7152', 'learning_rate': '1.897e-05', 'epoch': '0.1717'}

 17%|█▋        | 6520/37963 [20:21:22<98:00:04, 11.22s/it]
 17%|█▋        | 6521/37963 [20:21:32<95:13:46, 10.90s/it]
 17%|█▋        | 6522/37963 [20:21:42<92:20:51, 10.57s/it]
 17%|█▋        | 6523/37963 [20:21:52<91:09:13, 10.44s/it]
 17%|█▋        | 6524/37963 [20:22:02<90:07:00, 10.32s/it]
 17%|█▋        | 6525/37963 [20:22:18<106:01:27, 12.14s/it]
 17%|█▋        | 6526/37963 [20:22:34<115:40:15, 13.25s/it]
 17%|█▋        | 6527/37963 [20:22:45<107:51:11, 12.35s/it]
 17%|█▋        | 6528/37963 [20:22:54<101:10:43, 11.59s/it]
 17%|█▋        | 6529/37963 [20:23:04<97:04:25, 11.12s/it] 
 17%|█▋        | 6530/37963 [20:23:14<94:12:33, 10.79s/it]
                                                          
{'loss': '0.1872', 'grad_norm': '1.758', 'learning_rate': '1.896e-05', 'epoch': '0.172'}

 17%|█▋        | 6530/37963 [20:23:14<94:12:33, 10.79s/it]
 17%|█▋        | 6531/37963 [20:23:25<92:36:27, 10.61s/it]
 17%|█▋        | 6532/37963 [20:23:35<91:13:49, 10.45s/it]
 17%|█▋        | 6533/37963 [20:23:45<90:02:57, 10.31s/it]
 17%|█▋        | 6534/37963 [20:23:54<88:26:55, 10.13s/it]
 17%|█▋        | 6535/37963 [20:24:04<87:29:51, 10.02s/it]
 17%|█▋        | 6536/37963 [20:24:20<103:46:12, 11.89s/it]
 17%|█▋        | 6537/37963 [20:24:31<99:17:43, 11.37s/it] 
 17%|█▋        | 6538/37963 [20:24:40<95:30:52, 10.94s/it]
 17%|█▋        | 6539/37963 [20:24:50<92:07:13, 10.55s/it]
 17%|█▋        | 6540/37963 [20:25:00<90:58:20, 10.42s/it]
                                                          
{'loss': '0.1834', 'grad_norm': '1.915', 'learning_rate': '1.896e-05', 'epoch': '0.1723'}

 17%|█▋        | 6540/37963 [20:25:00<90:58:20, 10.42s/it]
 17%|█▋        | 6541/37963 [20:25:18<111:07:59, 12.73s/it]
 17%|█▋        | 6542/37963 [20:25:28<104:10:57, 11.94s/it]
 17%|█▋        | 6543/37963 [20:25:38<98:31:27, 11.29s/it] 
 17%|█▋        | 6544/37963 [20:25:48<94:22:24, 10.81s/it]
 17%|█▋        | 6545/37963 [20:25:58<92:54:41, 10.65s/it]
 17%|█▋        | 6546/37963 [20:26:08<91:41:38, 10.51s/it]
 17%|█▋        | 6547/37963 [20:26:19<90:42:53, 10.40s/it]
 17%|█▋        | 6548/37963 [20:26:29<89:57:15, 10.31s/it]
 17%|█▋        | 6549/37963 [20:26:38<88:35:48, 10.15s/it]
 17%|█▋        | 6550/37963 [20:26:55<104:47:33, 12.01s/it]
                                                           
{'loss': '0.1705', 'grad_norm': '1.67', 'learning_rate': '1.895e-05', 'epoch': '0.1725'}

 17%|█▋        | 6550/37963 [20:26:55<104:47:33, 12.01s/it]
 17%|█▋        | 6551/37963 [20:27:05<99:27:35, 11.40s/it] 
 17%|█▋        | 6552/37963 [20:27:15<95:42:20, 10.97s/it]
 17%|█▋        | 6553/37963 [20:27:25<92:53:19, 10.65s/it]
 17%|█▋        | 6554/37963 [20:27:35<91:25:18, 10.48s/it]
 17%|█▋        | 6555/37963 [20:27:45<89:49:02, 10.29s/it]
 17%|█▋        | 6556/37963 [20:27:55<89:03:38, 10.21s/it]
 17%|█▋        | 6557/37963 [20:28:05<88:56:48, 10.20s/it]
 17%|█▋        | 6558/37963 [20:28:15<87:57:26, 10.08s/it]
 17%|█▋        | 6559/37963 [20:28:25<88:00:57, 10.09s/it]
 17%|█▋        | 6560/37963 [20:28:35<88:05:42, 10.10s/it]
                                                          
{'loss': '0.1956', 'grad_norm': '1.428', 'learning_rate': '1.895e-05', 'epoch': '0.1728'}

 17%|█▋        | 6560/37963 [20:28:35<88:05:42, 10.10s/it]
 17%|█▋        | 6561/37963 [20:28:52<105:52:52, 12.14s/it]
 17%|█▋        | 6562/37963 [20:29:02<100:30:19, 11.52s/it]
 17%|█▋        | 6563/37963 [20:29:19<114:53:48, 13.17s/it]
 17%|█▋        | 6564/37963 [20:29:29<107:05:05, 12.28s/it]
 17%|█▋        | 6565/37963 [20:29:39<101:40:44, 11.66s/it]
 17%|█▋        | 6566/37963 [20:29:49<97:11:44, 11.14s/it] 
 17%|█▋        | 6567/37963 [20:29:59<94:46:09, 10.87s/it]
 17%|█▋        | 6568/37963 [20:30:09<92:39:46, 10.63s/it]
 17%|█▋        | 6569/37963 [20:30:26<107:58:28, 12.38s/it]
 17%|█▋        | 6570/37963 [20:30:36<101:57:50, 11.69s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '2.17', 'learning_rate': '1.895e-05', 'epoch': '0.1731'}

 17%|█▋        | 6570/37963 [20:30:36<101:57:50, 11.69s/it]
 17%|█▋        | 6571/37963 [20:30:53<114:50:48, 13.17s/it]
 17%|█▋        | 6572/37963 [20:31:03<107:03:45, 12.28s/it]
 17%|█▋        | 6573/37963 [20:31:13<100:54:04, 11.57s/it]
 17%|█▋        | 6574/37963 [20:31:29<113:53:43, 13.06s/it]
 17%|█▋        | 6575/37963 [20:31:39<105:07:11, 12.06s/it]
 17%|█▋        | 6576/37963 [20:31:49<100:01:18, 11.47s/it]
 17%|█▋        | 6577/37963 [20:31:59<96:23:18, 11.06s/it] 
 17%|█▋        | 6578/37963 [20:32:09<93:54:48, 10.77s/it]
 17%|█▋        | 6579/37963 [20:32:19<92:03:13, 10.56s/it]
 17%|█▋        | 6580/37963 [20:32:29<90:44:19, 10.41s/it]
                                                          
{'loss': '0.183', 'grad_norm': '1.689', 'learning_rate': '1.894e-05', 'epoch': '0.1733'}

 17%|█▋        | 6580/37963 [20:32:29<90:44:19, 10.41s/it]
 17%|█▋        | 6581/37963 [20:32:39<89:50:11, 10.31s/it]
 17%|█▋        | 6582/37963 [20:32:50<89:15:04, 10.24s/it]
 17%|█▋        | 6583/37963 [20:33:00<88:42:58, 10.18s/it]
 17%|█▋        | 6584/37963 [20:33:10<88:40:26, 10.17s/it]
 17%|█▋        | 6585/37963 [20:33:26<104:53:10, 12.03s/it]
 17%|█▋        | 6586/37963 [20:33:36<99:44:23, 11.44s/it] 
 17%|█▋        | 6587/37963 [20:33:46<95:34:29, 10.97s/it]
 17%|█▋        | 6588/37963 [20:33:56<93:07:02, 10.68s/it]
 17%|█▋        | 6589/37963 [20:34:13<110:20:26, 12.66s/it]
 17%|█▋        | 6590/37963 [20:34:23<103:29:38, 11.88s/it]
                                                           
{'loss': '0.1853', 'grad_norm': '3.725', 'learning_rate': '1.894e-05', 'epoch': '0.1736'}

 17%|█▋        | 6590/37963 [20:34:23<103:29:38, 11.88s/it]
 17%|█▋        | 6591/37963 [20:34:33<98:46:14, 11.33s/it] 
 17%|█▋        | 6592/37963 [20:34:43<95:18:45, 10.94s/it]
 17%|█▋        | 6593/37963 [20:34:54<93:06:07, 10.68s/it]
 17%|█▋        | 6594/37963 [20:35:03<90:43:09, 10.41s/it]
 17%|█▋        | 6595/37963 [20:35:13<90:08:55, 10.35s/it]
 17%|█▋        | 6596/37963 [20:35:24<89:36:52, 10.29s/it]
 17%|█▋        | 6597/37963 [20:35:40<106:01:17, 12.17s/it]
 17%|█▋        | 6598/37963 [20:35:50<100:22:43, 11.52s/it]
 17%|█▋        | 6599/37963 [20:36:00<96:31:09, 11.08s/it] 
 17%|█▋        | 6600/37963 [20:36:10<93:49:40, 10.77s/it]
                                                          
{'loss': '0.1904', 'grad_norm': '1.833', 'learning_rate': '1.893e-05', 'epoch': '0.1739'}

 17%|█▋        | 6600/37963 [20:36:10<93:49:40, 10.77s/it]
 17%|█▋        | 6601/37963 [20:36:20<92:04:03, 10.57s/it]
 17%|█▋        | 6602/37963 [20:36:30<90:20:18, 10.37s/it]
 17%|█▋        | 6603/37963 [20:36:40<89:26:29, 10.27s/it]
 17%|█▋        | 6604/37963 [20:36:50<88:15:28, 10.13s/it]
 17%|█▋        | 6605/37963 [20:37:00<87:47:41, 10.08s/it]
 17%|█▋        | 6606/37963 [20:37:10<87:58:07, 10.10s/it]
 17%|█▋        | 6607/37963 [20:37:20<86:32:22,  9.94s/it]
 17%|█▋        | 6608/37963 [20:37:30<86:58:58,  9.99s/it]
 17%|█▋        | 6609/37963 [20:37:46<103:00:14, 11.83s/it]
 17%|█▋        | 6610/37963 [20:37:56<98:33:28, 11.32s/it] 
                                                          
{'loss': '0.1674', 'grad_norm': '1.741', 'learning_rate': '1.893e-05', 'epoch': '0.1741'}

 17%|█▋        | 6610/37963 [20:37:56<98:33:28, 11.32s/it]
 17%|█▋        | 6611/37963 [20:38:06<95:32:19, 10.97s/it]
 17%|█▋        | 6612/37963 [20:38:23<111:20:18, 12.78s/it]
 17%|█▋        | 6613/37963 [20:38:33<104:20:56, 11.98s/it]
 17%|█▋        | 6614/37963 [20:38:44<99:27:51, 11.42s/it] 
 17%|█▋        | 6615/37963 [20:38:54<96:08:38, 11.04s/it]
 17%|█▋        | 6616/37963 [20:39:04<93:41:05, 10.76s/it]
 17%|█▋        | 6617/37963 [20:39:14<92:15:04, 10.59s/it]
 17%|█▋        | 6618/37963 [20:39:24<90:46:39, 10.43s/it]
 17%|█▋        | 6619/37963 [20:39:40<106:19:44, 12.21s/it]
 17%|█▋        | 6620/37963 [20:39:51<100:44:51, 11.57s/it]
                                                           
{'loss': '0.1769', 'grad_norm': '4.218', 'learning_rate': '1.893e-05', 'epoch': '0.1744'}

 17%|█▋        | 6620/37963 [20:39:51<100:44:51, 11.57s/it]
 17%|█▋        | 6621/37963 [20:40:01<96:52:58, 11.13s/it] 
 17%|█▋        | 6622/37963 [20:40:10<93:32:24, 10.74s/it]
 17%|█▋        | 6623/37963 [20:40:27<109:32:19, 12.58s/it]
 17%|█▋        | 6624/37963 [20:40:37<103:07:01, 11.85s/it]
 17%|█▋        | 6625/37963 [20:40:47<98:03:47, 11.27s/it] 
 17%|█▋        | 6626/37963 [20:40:58<95:11:08, 10.93s/it]
 17%|█▋        | 6627/37963 [20:41:08<93:18:58, 10.72s/it]
 17%|█▋        | 6628/37963 [20:41:18<91:48:19, 10.55s/it]
 17%|█▋        | 6629/37963 [20:41:28<89:56:42, 10.33s/it]
 17%|█▋        | 6630/37963 [20:41:38<89:16:21, 10.26s/it]
                                                          
{'loss': '0.1781', 'grad_norm': '2.106', 'learning_rate': '1.892e-05', 'epoch': '0.1746'}

 17%|█▋        | 6630/37963 [20:41:38<89:16:21, 10.26s/it]
 17%|█▋        | 6631/37963 [20:41:48<88:10:42, 10.13s/it]
 17%|█▋        | 6632/37963 [20:42:04<104:45:17, 12.04s/it]
 17%|█▋        | 6633/37963 [20:42:14<99:29:08, 11.43s/it] 
 17%|█▋        | 6634/37963 [20:42:24<95:21:40, 10.96s/it]
 17%|█▋        | 6635/37963 [20:42:34<92:50:15, 10.67s/it]
 17%|█▋        | 6636/37963 [20:42:51<110:14:40, 12.67s/it]
 17%|█▋        | 6637/37963 [20:43:01<103:29:28, 11.89s/it]
 17%|█▋        | 6638/37963 [20:43:11<98:20:17, 11.30s/it] 
 17%|█▋        | 6639/37963 [20:43:21<95:04:09, 10.93s/it]
 17%|█▋        | 6640/37963 [20:43:31<92:46:56, 10.66s/it]
                                                          
{'loss': '0.1896', 'grad_norm': '5.358', 'learning_rate': '1.892e-05', 'epoch': '0.1749'}

 17%|█▋        | 6640/37963 [20:43:31<92:46:56, 10.66s/it]
 17%|█▋        | 6641/37963 [20:43:42<91:13:54, 10.49s/it]
 17%|█▋        | 6642/37963 [20:43:51<89:08:42, 10.25s/it]
 17%|█▋        | 6643/37963 [20:44:01<88:44:02, 10.20s/it]
 18%|█▊        | 6644/37963 [20:44:11<87:27:07, 10.05s/it]
 18%|█▊        | 6645/37963 [20:44:27<102:18:28, 11.76s/it]
 18%|█▊        | 6646/37963 [20:44:37<98:34:20, 11.33s/it] 
 18%|█▊        | 6647/37963 [20:44:47<95:34:28, 10.99s/it]
 18%|█▊        | 6648/37963 [20:44:57<92:48:50, 10.67s/it]
 18%|█▊        | 6649/37963 [20:45:07<91:17:48, 10.50s/it]
 18%|█▊        | 6650/37963 [20:45:17<90:19:39, 10.38s/it]
                                                          
{'loss': '0.1653', 'grad_norm': '0.9909', 'learning_rate': '1.892e-05', 'epoch': '0.1752'}

 18%|█▊        | 6650/37963 [20:45:17<90:19:39, 10.38s/it]
 18%|█▊        | 6651/37963 [20:45:28<89:42:50, 10.31s/it]
 18%|█▊        | 6652/37963 [20:45:38<88:49:09, 10.21s/it]
 18%|█▊        | 6653/37963 [20:45:47<87:58:12, 10.11s/it]
 18%|█▊        | 6654/37963 [20:45:57<87:32:34, 10.07s/it]
 18%|█▊        | 6655/37963 [20:46:08<87:43:44, 10.09s/it]
 18%|█▊        | 6656/37963 [20:46:18<87:45:39, 10.09s/it]
 18%|█▊        | 6657/37963 [20:46:34<104:49:47, 12.05s/it]
 18%|█▊        | 6658/37963 [20:46:44<99:33:09, 11.45s/it] 
 18%|█▊        | 6659/37963 [20:46:54<95:26:30, 10.98s/it]
 18%|█▊        | 6660/37963 [20:47:04<93:05:02, 10.71s/it]
                                                          
{'loss': '0.184', 'grad_norm': '4.065', 'learning_rate': '1.891e-05', 'epoch': '0.1754'}

 18%|█▊        | 6660/37963 [20:47:04<93:05:02, 10.71s/it]
 18%|█▊        | 6661/37963 [20:47:21<108:00:29, 12.42s/it]
 18%|█▊        | 6662/37963 [20:47:31<102:09:59, 11.75s/it]
 18%|█▊        | 6663/37963 [20:47:41<98:14:06, 11.30s/it] 
 18%|█▊        | 6664/37963 [20:47:51<94:53:18, 10.91s/it]
 18%|█▊        | 6665/37963 [20:48:01<93:10:59, 10.72s/it]
 18%|█▊        | 6666/37963 [20:48:11<90:59:01, 10.47s/it]
 18%|█▊        | 6667/37963 [20:48:27<106:00:06, 12.19s/it]
 18%|█▊        | 6668/37963 [20:48:44<116:55:52, 13.45s/it]
 18%|█▊        | 6669/37963 [20:48:54<107:05:56, 12.32s/it]
 18%|█▊        | 6670/37963 [20:49:04<101:24:19, 11.67s/it]
                                                           
{'loss': '0.1722', 'grad_norm': '1.066', 'learning_rate': '1.891e-05', 'epoch': '0.1757'}

 18%|█▊        | 6670/37963 [20:49:04<101:24:19, 11.67s/it]
 18%|█▊        | 6671/37963 [20:49:20<114:04:09, 13.12s/it]
 18%|█▊        | 6672/37963 [20:49:30<105:57:25, 12.19s/it]
 18%|█▊        | 6673/37963 [20:49:40<100:08:57, 11.52s/it]
 18%|█▊        | 6674/37963 [20:49:50<96:52:35, 11.15s/it] 
 18%|█▊        | 6675/37963 [20:50:01<94:14:21, 10.84s/it]
 18%|█▊        | 6676/37963 [20:50:11<92:18:55, 10.62s/it]
 18%|█▊        | 6677/37963 [20:50:27<107:24:29, 12.36s/it]
 18%|█▊        | 6678/37963 [20:50:37<101:31:30, 11.68s/it]
 18%|█▊        | 6679/37963 [20:50:47<97:19:58, 11.20s/it] 
 18%|█▊        | 6680/37963 [20:50:57<94:28:05, 10.87s/it]
                                                          
{'loss': '0.1776', 'grad_norm': '3.162', 'learning_rate': '1.89e-05', 'epoch': '0.176'}

 18%|█▊        | 6680/37963 [20:50:57<94:28:05, 10.87s/it]
 18%|█▊        | 6681/37963 [20:51:07<92:15:54, 10.62s/it]
 18%|█▊        | 6682/37963 [20:51:18<91:32:31, 10.54s/it]
 18%|█▊        | 6683/37963 [20:51:35<109:02:34, 12.55s/it]
 18%|█▊        | 6684/37963 [20:51:45<101:52:14, 11.72s/it]
 18%|█▊        | 6685/37963 [20:51:54<96:28:46, 11.10s/it] 
 18%|█▊        | 6686/37963 [20:52:04<93:02:21, 10.71s/it]
 18%|█▊        | 6687/37963 [20:52:14<91:31:54, 10.54s/it]
 18%|█▊        | 6688/37963 [20:52:24<89:03:20, 10.25s/it]
 18%|█▊        | 6689/37963 [20:52:34<88:21:19, 10.17s/it]
 18%|█▊        | 6690/37963 [20:52:44<88:06:50, 10.14s/it]
                                                          
{'loss': '0.1826', 'grad_norm': '3.434', 'learning_rate': '1.89e-05', 'epoch': '0.1762'}

 18%|█▊        | 6690/37963 [20:52:44<88:06:50, 10.14s/it]
 18%|█▊        | 6691/37963 [20:52:54<87:54:56, 10.12s/it]
 18%|█▊        | 6692/37963 [20:53:04<87:05:56, 10.03s/it]
 18%|█▊        | 6693/37963 [20:53:14<87:12:48, 10.04s/it]
 18%|█▊        | 6694/37963 [20:53:31<104:38:42, 12.05s/it]
 18%|█▊        | 6695/37963 [20:53:40<98:29:52, 11.34s/it] 
 18%|█▊        | 6696/37963 [20:53:50<94:47:28, 10.91s/it]
 18%|█▊        | 6697/37963 [20:54:00<92:01:20, 10.60s/it]
 18%|█▊        | 6698/37963 [20:54:10<90:38:06, 10.44s/it]
 18%|█▊        | 6699/37963 [20:54:20<89:43:26, 10.33s/it]
 18%|█▊        | 6700/37963 [20:54:30<89:02:58, 10.25s/it]
                                                          
{'loss': '0.1836', 'grad_norm': '1.772', 'learning_rate': '1.89e-05', 'epoch': '0.1765'}

 18%|█▊        | 6700/37963 [20:54:30<89:02:58, 10.25s/it]
 18%|█▊        | 6701/37963 [20:54:40<88:34:07, 10.20s/it]
 18%|█▊        | 6702/37963 [20:54:50<88:00:24, 10.13s/it]
 18%|█▊        | 6703/37963 [20:55:00<87:14:40, 10.05s/it]
 18%|█▊        | 6704/37963 [20:55:10<87:20:27, 10.06s/it]
 18%|█▊        | 6705/37963 [20:55:27<104:06:11, 11.99s/it]
 18%|█▊        | 6706/37963 [20:55:37<99:38:34, 11.48s/it] 
 18%|█▊        | 6707/37963 [20:55:47<96:00:54, 11.06s/it]
 18%|█▊        | 6708/37963 [20:55:57<93:13:37, 10.74s/it]
 18%|█▊        | 6709/37963 [20:56:14<109:12:14, 12.58s/it]
 18%|█▊        | 6710/37963 [20:56:24<102:51:06, 11.85s/it]
                                                           
{'loss': '0.1884', 'grad_norm': '1.559', 'learning_rate': '1.889e-05', 'epoch': '0.1768'}

 18%|█▊        | 6710/37963 [20:56:24<102:51:06, 11.85s/it]
 18%|█▊        | 6711/37963 [20:56:34<97:35:20, 11.24s/it] 
 18%|█▊        | 6712/37963 [20:56:44<94:33:29, 10.89s/it]
 18%|█▊        | 6713/37963 [20:56:54<92:29:16, 10.65s/it]
 18%|█▊        | 6714/37963 [20:57:04<90:49:54, 10.46s/it]
 18%|█▊        | 6715/37963 [20:57:14<89:33:06, 10.32s/it]
 18%|█▊        | 6716/37963 [20:57:37<122:48:53, 14.15s/it]
 18%|█▊        | 6717/37963 [20:57:47<111:02:59, 12.79s/it]
 18%|█▊        | 6718/37963 [20:57:57<103:56:03, 11.98s/it]
 18%|█▊        | 6719/37963 [20:58:07<99:31:50, 11.47s/it] 
 18%|█▊        | 6720/37963 [20:58:17<96:02:26, 11.07s/it]
                                                          
{'loss': '0.171', 'grad_norm': '4.726', 'learning_rate': '1.889e-05', 'epoch': '0.177'}

 18%|█▊        | 6720/37963 [20:58:17<96:02:26, 11.07s/it]
 18%|█▊        | 6721/37963 [20:58:34<109:30:15, 12.62s/it]
 18%|█▊        | 6722/37963 [20:58:44<102:40:00, 11.83s/it]
 18%|█▊        | 6723/37963 [20:58:54<98:19:45, 11.33s/it] 
 18%|█▊        | 6724/37963 [20:59:04<95:12:05, 10.97s/it]
 18%|█▊        | 6725/37963 [20:59:14<92:55:49, 10.71s/it]
 18%|█▊        | 6726/37963 [20:59:31<109:11:36, 12.58s/it]
 18%|█▊        | 6727/37963 [20:59:41<101:52:17, 11.74s/it]
 18%|█▊        | 6728/37963 [20:59:50<96:18:46, 11.10s/it] 
 18%|█▊        | 6729/37963 [21:00:00<93:41:10, 10.80s/it]
 18%|█▊        | 6730/37963 [21:00:10<91:33:20, 10.55s/it]
                                                          
{'loss': '0.1815', 'grad_norm': '2.152', 'learning_rate': '1.888e-05', 'epoch': '0.1773'}

 18%|█▊        | 6730/37963 [21:00:10<91:33:20, 10.55s/it]
 18%|█▊        | 6731/37963 [21:00:20<89:58:16, 10.37s/it]
 18%|█▊        | 6732/37963 [21:00:37<107:07:02, 12.35s/it]
 18%|█▊        | 6733/37963 [21:00:48<101:30:27, 11.70s/it]
 18%|█▊        | 6734/37963 [21:00:57<96:50:38, 11.16s/it] 
 18%|█▊        | 6735/37963 [21:01:07<92:42:14, 10.69s/it]
 18%|█▊        | 6736/37963 [21:01:17<90:34:08, 10.44s/it]
 18%|█▊        | 6737/37963 [21:01:27<89:45:59, 10.35s/it]
 18%|█▊        | 6738/37963 [21:01:37<89:23:47, 10.31s/it]
 18%|█▊        | 6739/37963 [21:01:47<88:54:15, 10.25s/it]
 18%|█▊        | 6740/37963 [21:01:57<87:28:43, 10.09s/it]
                                                          
{'loss': '0.1708', 'grad_norm': '3.933', 'learning_rate': '1.888e-05', 'epoch': '0.1775'}

 18%|█▊        | 6740/37963 [21:01:57<87:28:43, 10.09s/it]
 18%|█▊        | 6741/37963 [21:02:07<87:36:59, 10.10s/it]
 18%|█▊        | 6742/37963 [21:02:24<104:02:30, 12.00s/it]
 18%|█▊        | 6743/37963 [21:02:33<98:11:53, 11.32s/it] 
 18%|█▊        | 6744/37963 [21:02:43<94:46:58, 10.93s/it]
 18%|█▊        | 6745/37963 [21:02:54<92:49:48, 10.71s/it]
 18%|█▊        | 6746/37963 [21:03:04<90:57:00, 10.49s/it]
 18%|█▊        | 6747/37963 [21:03:14<89:44:32, 10.35s/it]
 18%|█▊        | 6748/37963 [21:03:24<89:07:07, 10.28s/it]
 18%|█▊        | 6749/37963 [21:03:34<89:03:27, 10.27s/it]
 18%|█▊        | 6750/37963 [21:03:44<88:14:07, 10.18s/it]
                                                          
{'loss': '0.1921', 'grad_norm': '2.186', 'learning_rate': '1.888e-05', 'epoch': '0.1778'}

 18%|█▊        | 6750/37963 [21:03:44<88:14:07, 10.18s/it]
 18%|█▊        | 6751/37963 [21:03:54<88:35:23, 10.22s/it]
 18%|█▊        | 6752/37963 [21:04:04<88:14:38, 10.18s/it]
 18%|█▊        | 6753/37963 [21:04:21<104:03:27, 12.00s/it]
 18%|█▊        | 6754/37963 [21:04:31<98:39:22, 11.38s/it] 
 18%|█▊        | 6755/37963 [21:04:41<95:15:07, 10.99s/it]
 18%|█▊        | 6756/37963 [21:04:51<93:28:22, 10.78s/it]
 18%|█▊        | 6757/37963 [21:05:01<91:49:57, 10.59s/it]
 18%|█▊        | 6758/37963 [21:05:18<109:07:32, 12.59s/it]
 18%|█▊        | 6759/37963 [21:05:28<102:48:00, 11.86s/it]
 18%|█▊        | 6760/37963 [21:05:39<98:09:38, 11.33s/it] 
                                                          
{'loss': '0.1792', 'grad_norm': '1.225', 'learning_rate': '1.887e-05', 'epoch': '0.1781'}

 18%|█▊        | 6760/37963 [21:05:39<98:09:38, 11.33s/it]
 18%|█▊        | 6761/37963 [21:05:49<94:48:11, 10.94s/it]
 18%|█▊        | 6762/37963 [21:05:59<92:23:57, 10.66s/it]
 18%|█▊        | 6763/37963 [21:06:08<90:07:23, 10.40s/it]
 18%|█▊        | 6764/37963 [21:06:25<105:44:35, 12.20s/it]
 18%|█▊        | 6765/37963 [21:06:35<100:21:50, 11.58s/it]
 18%|█▊        | 6766/37963 [21:06:51<112:31:44, 12.99s/it]
 18%|█▊        | 6767/37963 [21:07:01<104:53:12, 12.10s/it]
 18%|█▊        | 6768/37963 [21:07:11<99:42:43, 11.51s/it] 
 18%|█▊        | 6769/37963 [21:07:21<96:03:29, 11.09s/it]
 18%|█▊        | 6770/37963 [21:07:38<110:05:08, 12.71s/it]
                                                           
{'loss': '0.1765', 'grad_norm': '1.422', 'learning_rate': '1.887e-05', 'epoch': '0.1783'}

 18%|█▊        | 6770/37963 [21:07:38<110:05:08, 12.71s/it]
 18%|█▊        | 6771/37963 [21:07:48<103:46:32, 11.98s/it]
 18%|█▊        | 6772/37963 [21:07:58<98:44:47, 11.40s/it] 
 18%|█▊        | 6773/37963 [21:08:08<95:18:38, 11.00s/it]
 18%|█▊        | 6774/37963 [21:08:25<109:02:07, 12.59s/it]
 18%|█▊        | 6775/37963 [21:08:34<101:24:52, 11.71s/it]
 18%|█▊        | 6776/37963 [21:08:44<97:17:12, 11.23s/it] 
 18%|█▊        | 6777/37963 [21:08:54<93:09:43, 10.75s/it]
 18%|█▊        | 6778/37963 [21:09:04<91:02:50, 10.51s/it]
 18%|█▊        | 6779/37963 [21:09:14<89:41:36, 10.35s/it]
 18%|█▊        | 6780/37963 [21:09:31<106:15:35, 12.27s/it]
                                                           
{'loss': '0.1849', 'grad_norm': '2.863', 'learning_rate': '1.886e-05', 'epoch': '0.1786'}

 18%|█▊        | 6780/37963 [21:09:31<106:15:35, 12.27s/it]
 18%|█▊        | 6781/37963 [21:09:41<100:37:31, 11.62s/it]
 18%|█▊        | 6782/37963 [21:09:51<96:39:36, 11.16s/it] 
 18%|█▊        | 6783/37963 [21:10:01<94:12:16, 10.88s/it]
 18%|█▊        | 6784/37963 [21:10:11<92:00:30, 10.62s/it]
 18%|█▊        | 6785/37963 [21:10:21<90:32:28, 10.45s/it]
 18%|█▊        | 6786/37963 [21:10:31<89:40:47, 10.36s/it]
 18%|█▊        | 6787/37963 [21:10:41<89:15:13, 10.31s/it]
 18%|█▊        | 6788/37963 [21:10:52<88:57:11, 10.27s/it]
 18%|█▊        | 6789/37963 [21:11:02<87:51:55, 10.15s/it]
 18%|█▊        | 6790/37963 [21:11:18<104:05:17, 12.02s/it]
                                                           
{'loss': '0.1856', 'grad_norm': '6.221', 'learning_rate': '1.886e-05', 'epoch': '0.1789'}

 18%|█▊        | 6790/37963 [21:11:18<104:05:17, 12.02s/it]
 18%|█▊        | 6791/37963 [21:11:28<99:00:02, 11.43s/it] 
 18%|█▊        | 6792/37963 [21:11:38<95:21:49, 11.01s/it]
 18%|█▊        | 6793/37963 [21:11:48<91:41:42, 10.59s/it]
 18%|█▊        | 6794/37963 [21:11:58<90:01:25, 10.40s/it]
 18%|█▊        | 6795/37963 [21:12:08<89:14:41, 10.31s/it]
 18%|█▊        | 6796/37963 [21:12:18<88:42:53, 10.25s/it]
 18%|█▊        | 6797/37963 [21:12:28<88:34:26, 10.23s/it]
 18%|█▊        | 6798/37963 [21:12:38<87:15:28, 10.08s/it]
 18%|█▊        | 6799/37963 [21:12:54<104:23:31, 12.06s/it]
 18%|█▊        | 6800/37963 [21:13:05<99:30:58, 11.50s/it] 
                                                          
{'loss': '0.1809', 'grad_norm': '2.41', 'learning_rate': '1.886e-05', 'epoch': '0.1791'}

 18%|█▊        | 6800/37963 [21:13:05<99:30:58, 11.50s/it]
 18%|█▊        | 6801/37963 [21:13:15<95:40:01, 11.05s/it]
 18%|█▊        | 6802/37963 [21:13:25<93:11:14, 10.77s/it]
 18%|█▊        | 6803/37963 [21:13:35<91:23:52, 10.56s/it]
 18%|█▊        | 6804/37963 [21:13:45<90:08:56, 10.42s/it]
 18%|█▊        | 6805/37963 [21:14:01<105:25:16, 12.18s/it]
 18%|█▊        | 6806/37963 [21:14:11<100:18:28, 11.59s/it]
 18%|█▊        | 6807/37963 [21:14:21<96:00:55, 11.09s/it] 
 18%|█▊        | 6808/37963 [21:14:31<93:15:12, 10.78s/it]
 18%|█▊        | 6809/37963 [21:14:41<91:10:15, 10.54s/it]
 18%|█▊        | 6810/37963 [21:14:51<90:10:48, 10.42s/it]
                                                          
{'loss': '0.1736', 'grad_norm': '1.645', 'learning_rate': '1.885e-05', 'epoch': '0.1794'}

 18%|█▊        | 6810/37963 [21:14:51<90:10:48, 10.42s/it]
 18%|█▊        | 6811/37963 [21:15:02<89:16:59, 10.32s/it]
 18%|█▊        | 6812/37963 [21:15:18<105:32:29, 12.20s/it]
 18%|█▊        | 6813/37963 [21:15:28<98:54:31, 11.43s/it] 
 18%|█▊        | 6814/37963 [21:15:38<95:28:36, 11.03s/it]
 18%|█▊        | 6815/37963 [21:15:54<107:59:05, 12.48s/it]
 18%|█▊        | 6816/37963 [21:16:04<102:01:51, 11.79s/it]
 18%|█▊        | 6817/37963 [21:16:14<97:02:47, 11.22s/it] 
 18%|█▊        | 6818/37963 [21:16:30<109:47:33, 12.69s/it]
 18%|█▊        | 6819/37963 [21:16:40<102:55:14, 11.90s/it]
 18%|█▊        | 6820/37963 [21:16:50<98:37:41, 11.40s/it] 
                                                          
{'loss': '0.1765', 'grad_norm': '2.231', 'learning_rate': '1.885e-05', 'epoch': '0.1796'}

 18%|█▊        | 6820/37963 [21:16:50<98:37:41, 11.40s/it]
 18%|█▊        | 6821/37963 [21:17:00<94:06:27, 10.88s/it]
 18%|█▊        | 6822/37963 [21:17:16<108:28:57, 12.54s/it]
 18%|█▊        | 6823/37963 [21:17:26<101:43:50, 11.76s/it]
 18%|█▊        | 6824/37963 [21:17:36<97:17:09, 11.25s/it] 
 18%|█▊        | 6825/37963 [21:17:46<94:03:05, 10.87s/it]
 18%|█▊        | 6826/37963 [21:17:56<91:56:54, 10.63s/it]
 18%|█▊        | 6827/37963 [21:18:13<106:43:57, 12.34s/it]
 18%|█▊        | 6828/37963 [21:18:22<99:32:36, 11.51s/it] 
 18%|█▊        | 6829/37963 [21:18:32<95:42:51, 11.07s/it]
 18%|█▊        | 6830/37963 [21:18:42<93:19:49, 10.79s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '1.535', 'learning_rate': '1.884e-05', 'epoch': '0.1799'}

 18%|█▊        | 6830/37963 [21:18:42<93:19:49, 10.79s/it]
 18%|█▊        | 6831/37963 [21:18:53<92:15:44, 10.67s/it]
 18%|█▊        | 6832/37963 [21:19:03<90:41:40, 10.49s/it]
 18%|█▊        | 6833/37963 [21:19:13<89:36:47, 10.36s/it]
 18%|█▊        | 6834/37963 [21:19:23<88:57:52, 10.29s/it]
 18%|█▊        | 6835/37963 [21:19:33<88:19:50, 10.22s/it]
 18%|█▊        | 6836/37963 [21:19:43<87:56:15, 10.17s/it]
 18%|█▊        | 6837/37963 [21:19:53<87:29:21, 10.12s/it]
 18%|█▊        | 6838/37963 [21:20:03<87:36:52, 10.13s/it]
 18%|█▊        | 6839/37963 [21:20:20<104:17:56, 12.06s/it]
 18%|█▊        | 6840/37963 [21:20:30<99:41:20, 11.53s/it] 
                                                          
{'loss': '0.1764', 'grad_norm': '2.31', 'learning_rate': '1.884e-05', 'epoch': '0.1802'}

 18%|█▊        | 6840/37963 [21:20:30<99:41:20, 11.53s/it]
 18%|█▊        | 6841/37963 [21:20:40<95:22:08, 11.03s/it]
 18%|█▊        | 6842/37963 [21:20:50<92:57:15, 10.75s/it]
 18%|█▊        | 6843/37963 [21:21:00<91:12:21, 10.55s/it]
 18%|█▊        | 6844/37963 [21:21:10<89:06:40, 10.31s/it]
 18%|█▊        | 6845/37963 [21:21:19<86:56:51, 10.06s/it]
 18%|█▊        | 6846/37963 [21:21:29<86:36:29, 10.02s/it]
 18%|█▊        | 6847/37963 [21:21:39<85:52:24,  9.94s/it]
 18%|█▊        | 6848/37963 [21:21:49<85:55:28,  9.94s/it]
 18%|█▊        | 6849/37963 [21:22:06<102:57:32, 11.91s/it]
 18%|█▊        | 6850/37963 [21:22:15<97:38:30, 11.30s/it] 
                                                          
{'loss': '0.1796', 'grad_norm': '3.439', 'learning_rate': '1.884e-05', 'epoch': '0.1804'}

 18%|█▊        | 6850/37963 [21:22:15<97:38:30, 11.30s/it]
 18%|█▊        | 6851/37963 [21:22:26<94:34:37, 10.94s/it]
 18%|█▊        | 6852/37963 [21:22:36<92:03:43, 10.65s/it]
 18%|█▊        | 6853/37963 [21:22:45<89:38:20, 10.37s/it]
 18%|█▊        | 6854/37963 [21:23:02<106:16:14, 12.30s/it]
 18%|█▊        | 6855/37963 [21:23:12<100:39:10, 11.65s/it]
 18%|█▊        | 6856/37963 [21:23:22<96:21:54, 11.15s/it] 
 18%|█▊        | 6857/37963 [21:23:32<93:39:00, 10.84s/it]
 18%|█▊        | 6858/37963 [21:23:42<91:31:32, 10.59s/it]
 18%|█▊        | 6859/37963 [21:23:52<90:13:11, 10.44s/it]
 18%|█▊        | 6860/37963 [21:24:08<104:27:46, 12.09s/it]
                                                           
{'loss': '0.1791', 'grad_norm': '2.345', 'learning_rate': '1.883e-05', 'epoch': '0.1807'}

 18%|█▊        | 6860/37963 [21:24:08<104:27:46, 12.09s/it]
 18%|█▊        | 6861/37963 [21:24:18<98:53:55, 11.45s/it] 
 18%|█▊        | 6862/37963 [21:24:28<94:22:09, 10.92s/it]
 18%|█▊        | 6863/37963 [21:24:38<91:19:57, 10.57s/it]
 18%|█▊        | 6864/37963 [21:24:47<89:03:50, 10.31s/it]
 18%|█▊        | 6865/37963 [21:25:04<104:32:08, 12.10s/it]
 18%|█▊        | 6866/37963 [21:25:20<116:17:56, 13.46s/it]
 18%|█▊        | 6867/37963 [21:25:30<107:16:33, 12.42s/it]
 18%|█▊        | 6868/37963 [21:25:40<101:21:00, 11.73s/it]
 18%|█▊        | 6869/37963 [21:25:51<97:03:41, 11.24s/it] 
 18%|█▊        | 6870/37963 [21:26:01<94:17:45, 10.92s/it]
                                                          
{'loss': '0.1756', 'grad_norm': '2.714', 'learning_rate': '1.883e-05', 'epoch': '0.181'}

 18%|█▊        | 6870/37963 [21:26:01<94:17:45, 10.92s/it]
 18%|█▊        | 6871/37963 [21:26:11<92:22:51, 10.70s/it]
 18%|█▊        | 6872/37963 [21:26:21<90:44:04, 10.51s/it]
 18%|█▊        | 6873/37963 [21:26:37<104:41:55, 12.12s/it]
 18%|█▊        | 6874/37963 [21:26:47<99:28:47, 11.52s/it] 
 18%|█▊        | 6875/37963 [21:26:57<95:29:56, 11.06s/it]
 18%|█▊        | 6876/37963 [21:27:14<110:35:38, 12.81s/it]
 18%|█▊        | 6877/37963 [21:27:24<103:37:42, 12.00s/it]
 18%|█▊        | 6878/37963 [21:27:34<97:21:40, 11.28s/it] 
 18%|█▊        | 6879/37963 [21:27:44<94:12:38, 10.91s/it]
 18%|█▊        | 6880/37963 [21:27:54<92:08:37, 10.67s/it]
                                                          
{'loss': '0.1718', 'grad_norm': '0.8445', 'learning_rate': '1.882e-05', 'epoch': '0.1812'}

 18%|█▊        | 6880/37963 [21:27:54<92:08:37, 10.67s/it]
 18%|█▊        | 6881/37963 [21:28:04<90:40:43, 10.50s/it]
 18%|█▊        | 6882/37963 [21:28:14<89:26:47, 10.36s/it]
 18%|█▊        | 6883/37963 [21:28:24<88:41:41, 10.27s/it]
 18%|█▊        | 6884/37963 [21:28:34<88:10:33, 10.21s/it]
 18%|█▊        | 6885/37963 [21:28:44<87:57:09, 10.19s/it]
 18%|█▊        | 6886/37963 [21:29:01<104:20:20, 12.09s/it]
 18%|█▊        | 6887/37963 [21:29:11<99:31:58, 11.53s/it] 
 18%|█▊        | 6888/37963 [21:29:21<96:05:19, 11.13s/it]
 18%|█▊        | 6889/37963 [21:29:31<92:31:26, 10.72s/it]
 18%|█▊        | 6890/37963 [21:29:41<90:29:45, 10.48s/it]
                                                          
{'loss': '0.1762', 'grad_norm': '4.265', 'learning_rate': '1.882e-05', 'epoch': '0.1815'}

 18%|█▊        | 6890/37963 [21:29:41<90:29:45, 10.48s/it]
 18%|█▊        | 6891/37963 [21:29:51<90:06:09, 10.44s/it]
 18%|█▊        | 6892/37963 [21:30:01<89:01:45, 10.32s/it]
 18%|█▊        | 6893/37963 [21:30:11<88:28:49, 10.25s/it]
 18%|█▊        | 6894/37963 [21:30:21<87:54:18, 10.19s/it]
 18%|█▊        | 6895/37963 [21:30:31<87:41:26, 10.16s/it]
 18%|█▊        | 6896/37963 [21:30:41<87:34:53, 10.15s/it]
 18%|█▊        | 6897/37963 [21:30:52<87:39:54, 10.16s/it]
 18%|█▊        | 6898/37963 [21:31:02<87:29:32, 10.14s/it]
 18%|█▊        | 6899/37963 [21:31:11<86:17:08, 10.00s/it]
 18%|█▊        | 6900/37963 [21:31:21<85:32:39,  9.91s/it]
                                                          
{'loss': '0.1865', 'grad_norm': '1.903', 'learning_rate': '1.882e-05', 'epoch': '0.1818'}

 18%|█▊        | 6900/37963 [21:31:21<85:32:39,  9.91s/it]
 18%|█▊        | 6901/37963 [21:31:38<103:26:36, 11.99s/it]
 18%|█▊        | 6902/37963 [21:31:54<114:50:51, 13.31s/it]
 18%|█▊        | 6903/37963 [21:32:05<106:46:10, 12.38s/it]
 18%|█▊        | 6904/37963 [21:32:15<100:42:02, 11.67s/it]
 18%|█▊        | 6905/37963 [21:32:25<96:33:19, 11.19s/it] 
 18%|█▊        | 6906/37963 [21:32:35<93:39:58, 10.86s/it]
 18%|█▊        | 6907/37963 [21:32:45<91:47:33, 10.64s/it]
 18%|█▊        | 6908/37963 [21:33:01<106:01:09, 12.29s/it]
 18%|█▊        | 6909/37963 [21:33:11<100:10:28, 11.61s/it]
 18%|█▊        | 6910/37963 [21:33:21<96:22:22, 11.17s/it] 
                                                          
{'loss': '0.1823', 'grad_norm': '1.918', 'learning_rate': '1.881e-05', 'epoch': '0.182'}

 18%|█▊        | 6910/37963 [21:33:21<96:22:22, 11.17s/it]
 18%|█▊        | 6911/37963 [21:33:31<92:40:47, 10.74s/it]
 18%|█▊        | 6912/37963 [21:33:41<90:58:54, 10.55s/it]
 18%|█▊        | 6913/37963 [21:33:57<106:01:58, 12.29s/it]
 18%|█▊        | 6914/37963 [21:34:14<116:44:02, 13.53s/it]
 18%|█▊        | 6915/37963 [21:34:24<107:26:02, 12.46s/it]
 18%|█▊        | 6916/37963 [21:34:34<101:17:58, 11.75s/it]
 18%|█▊        | 6917/37963 [21:34:44<97:23:37, 11.29s/it] 
 18%|█▊        | 6918/37963 [21:34:54<94:15:07, 10.93s/it]
 18%|█▊        | 6919/37963 [21:35:04<92:07:55, 10.68s/it]
 18%|█▊        | 6920/37963 [21:35:20<106:22:54, 12.34s/it]
                                                           
{'loss': '0.1738', 'grad_norm': '1.304', 'learning_rate': '1.881e-05', 'epoch': '0.1823'}

 18%|█▊        | 6920/37963 [21:35:20<106:22:54, 12.34s/it]
 18%|█▊        | 6921/37963 [21:35:31<100:30:02, 11.66s/it]
 18%|█▊        | 6922/37963 [21:35:40<95:19:12, 11.05s/it] 
 18%|█▊        | 6923/37963 [21:35:50<92:22:11, 10.71s/it]
 18%|█▊        | 6924/37963 [21:36:07<107:29:24, 12.47s/it]
 18%|█▊        | 6925/37963 [21:36:17<101:08:49, 11.73s/it]
 18%|█▊        | 6926/37963 [21:36:27<97:04:10, 11.26s/it] 
 18%|█▊        | 6927/37963 [21:36:37<94:16:50, 10.94s/it]
 18%|█▊        | 6928/37963 [21:36:47<92:26:44, 10.72s/it]
 18%|█▊        | 6929/37963 [21:36:57<90:57:10, 10.55s/it]
 18%|█▊        | 6930/37963 [21:37:07<89:42:39, 10.41s/it]
                                                          
{'loss': '0.1778', 'grad_norm': '1.159', 'learning_rate': '1.88e-05', 'epoch': '0.1825'}

 18%|█▊        | 6930/37963 [21:37:07<89:42:39, 10.41s/it]
 18%|█▊        | 6931/37963 [21:37:18<89:02:59, 10.33s/it]
 18%|█▊        | 6932/37963 [21:37:28<88:37:23, 10.28s/it]
 18%|█▊        | 6933/37963 [21:37:38<88:07:20, 10.22s/it]
 18%|█▊        | 6934/37963 [21:37:54<104:11:59, 12.09s/it]
 18%|█▊        | 6935/37963 [21:38:04<98:49:59, 11.47s/it] 
 18%|█▊        | 6936/37963 [21:38:14<95:19:48, 11.06s/it]
 18%|█▊        | 6937/37963 [21:38:25<93:02:33, 10.80s/it]
 18%|█▊        | 6938/37963 [21:38:35<91:09:26, 10.58s/it]
 18%|█▊        | 6939/37963 [21:38:45<89:59:35, 10.44s/it]
 18%|█▊        | 6940/37963 [21:38:55<89:14:18, 10.36s/it]
                                                          
{'loss': '0.1782', 'grad_norm': '2.035', 'learning_rate': '1.88e-05', 'epoch': '0.1828'}

 18%|█▊        | 6940/37963 [21:38:55<89:14:18, 10.36s/it]
 18%|█▊        | 6941/37963 [21:39:05<88:53:47, 10.32s/it]
 18%|█▊        | 6942/37963 [21:39:15<88:16:09, 10.24s/it]
 18%|█▊        | 6943/37963 [21:39:25<87:17:38, 10.13s/it]
 18%|█▊        | 6944/37963 [21:39:35<87:37:31, 10.17s/it]
 18%|█▊        | 6945/37963 [21:39:46<87:26:24, 10.15s/it]
 18%|█▊        | 6946/37963 [21:39:56<87:23:19, 10.14s/it]
 18%|█▊        | 6947/37963 [21:40:05<86:25:10, 10.03s/it]
 18%|█▊        | 6948/37963 [21:40:16<86:36:46, 10.05s/it]
 18%|█▊        | 6949/37963 [21:40:32<103:23:02, 12.00s/it]
 18%|█▊        | 6950/37963 [21:40:42<97:58:52, 11.37s/it] 
                                                          
{'loss': '0.1695', 'grad_norm': '1.349', 'learning_rate': '1.88e-05', 'epoch': '0.1831'}

 18%|█▊        | 6950/37963 [21:40:42<97:58:52, 11.37s/it]
 18%|█▊        | 6951/37963 [21:40:52<94:44:12, 11.00s/it]
 18%|█▊        | 6952/37963 [21:41:09<109:01:31, 12.66s/it]
 18%|█▊        | 6953/37963 [21:41:18<101:43:53, 11.81s/it]
 18%|█▊        | 6954/37963 [21:41:29<97:20:38, 11.30s/it] 
 18%|█▊        | 6955/37963 [21:41:45<110:35:40, 12.84s/it]
 18%|█▊        | 6956/37963 [21:41:55<103:25:14, 12.01s/it]
 18%|█▊        | 6957/37963 [21:42:05<98:37:04, 11.45s/it] 
 18%|█▊        | 6958/37963 [21:42:15<95:00:34, 11.03s/it]
 18%|█▊        | 6959/37963 [21:42:25<92:26:09, 10.73s/it]
 18%|█▊        | 6960/37963 [21:42:35<89:21:50, 10.38s/it]
                                                          
{'loss': '0.1722', 'grad_norm': '2.983', 'learning_rate': '1.879e-05', 'epoch': '0.1833'}

 18%|█▊        | 6960/37963 [21:42:35<89:21:50, 10.38s/it]
 18%|█▊        | 6961/37963 [21:42:45<88:20:38, 10.26s/it]
 18%|█▊        | 6962/37963 [21:43:08<120:55:24, 14.04s/it]
 18%|█▊        | 6963/37963 [21:43:18<110:18:57, 12.81s/it]
 18%|█▊        | 6964/37963 [21:43:27<102:24:50, 11.89s/it]
 18%|█▊        | 6965/37963 [21:43:37<97:46:07, 11.35s/it] 
 18%|█▊        | 6966/37963 [21:43:47<94:09:41, 10.94s/it]
 18%|█▊        | 6967/37963 [21:43:58<92:04:47, 10.69s/it]
 18%|█▊        | 6968/37963 [21:44:14<107:14:22, 12.46s/it]
 18%|█▊        | 6969/37963 [21:44:24<101:08:21, 11.75s/it]
 18%|█▊        | 6970/37963 [21:44:34<96:58:02, 11.26s/it] 
                                                          
{'loss': '0.1785', 'grad_norm': '4.532', 'learning_rate': '1.879e-05', 'epoch': '0.1836'}

 18%|█▊        | 6970/37963 [21:44:34<96:58:02, 11.26s/it]
 18%|█▊        | 6971/37963 [21:44:44<92:56:20, 10.80s/it]
 18%|█▊        | 6972/37963 [21:45:01<109:12:49, 12.69s/it]
 18%|█▊        | 6973/37963 [21:45:11<102:30:10, 11.91s/it]
 18%|█▊        | 6974/37963 [21:45:21<96:57:43, 11.26s/it] 
 18%|█▊        | 6975/37963 [21:45:31<94:05:14, 10.93s/it]
 18%|█▊        | 6976/37963 [21:45:41<91:48:07, 10.67s/it]
 18%|█▊        | 6977/37963 [21:45:51<90:33:26, 10.52s/it]
 18%|█▊        | 6978/37963 [21:46:01<88:39:02, 10.30s/it]
 18%|█▊        | 6979/37963 [21:46:11<88:02:00, 10.23s/it]
 18%|█▊        | 6980/37963 [21:46:21<87:50:52, 10.21s/it]
                                                          
{'loss': '0.19', 'grad_norm': '2.466', 'learning_rate': '1.878e-05', 'epoch': '0.1839'}

 18%|█▊        | 6980/37963 [21:46:21<87:50:52, 10.21s/it]
 18%|█▊        | 6981/37963 [21:46:31<87:24:09, 10.16s/it]
 18%|█▊        | 6982/37963 [21:46:42<87:14:24, 10.14s/it]
 18%|█▊        | 6983/37963 [21:46:58<103:46:02, 12.06s/it]
 18%|█▊        | 6984/37963 [21:47:08<98:54:10, 11.49s/it] 
 18%|█▊        | 6985/37963 [21:47:18<95:08:32, 11.06s/it]
 18%|█▊        | 6986/37963 [21:47:29<93:00:54, 10.81s/it]
 18%|█▊        | 6987/37963 [21:47:38<90:03:43, 10.47s/it]
 18%|█▊        | 6988/37963 [21:47:48<89:13:30, 10.37s/it]
 18%|█▊        | 6989/37963 [21:47:58<88:29:33, 10.29s/it]
 18%|█▊        | 6990/37963 [21:48:08<87:25:12, 10.16s/it]
                                                          
{'loss': '0.1912', 'grad_norm': '4.874', 'learning_rate': '1.878e-05', 'epoch': '0.1841'}

 18%|█▊        | 6990/37963 [21:48:08<87:25:12, 10.16s/it]
 18%|█▊        | 6991/37963 [21:48:18<87:18:59, 10.15s/it]
 18%|█▊        | 6992/37963 [21:48:29<87:11:08, 10.13s/it]
 18%|█▊        | 6993/37963 [21:48:39<87:08:53, 10.13s/it]
 18%|█▊        | 6994/37963 [21:48:49<86:58:24, 10.11s/it]
 18%|█▊        | 6995/37963 [21:48:59<87:33:11, 10.18s/it]
 18%|█▊        | 6996/37963 [21:49:09<87:38:48, 10.19s/it]
 18%|█▊        | 6997/37963 [21:49:19<87:38:34, 10.19s/it]
 18%|█▊        | 6998/37963 [21:49:36<104:21:31, 12.13s/it]
 18%|█▊        | 6999/37963 [21:49:46<99:16:41, 11.54s/it] 
 18%|█▊        | 7000/37963 [21:50:03<112:37:41, 13.10s/it]
                                                           
{'loss': '0.1844', 'grad_norm': '1.929', 'learning_rate': '1.878e-05', 'epoch': '0.1844'}

 18%|█▊        | 7000/37963 [21:50:03<112:37:41, 13.10s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.82s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.82s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 18%|█▊        | 7001/37963 [21:51:07<243:11:33, 28.28s/it]
 18%|█▊        | 7002/37963 [21:51:23<212:29:34, 24.71s/it]
 18%|█▊        | 7003/37963 [21:51:33<174:32:12, 20.29s/it]
 18%|█▊        | 7004/37963 [21:51:43<147:14:03, 17.12s/it]
 18%|█▊        | 7005/37963 [21:51:53<128:38:57, 14.96s/it]
 18%|█▊        | 7006/37963 [21:52:03<115:40:40, 13.45s/it]
 18%|█▊        | 7007/37963 [21:52:13<106:36:55, 12.40s/it]
 18%|█▊        | 7008/37963 [21:52:23<100:33:52, 11.70s/it]
 18%|█▊        | 7009/37963 [21:52:33<96:22:31, 11.21s/it] 
 18%|█▊        | 7010/37963 [21:52:49<109:39:55, 12.75s/it]
                                                           
{'loss': '0.1769', 'grad_norm': '3.456', 'learning_rate': '1.877e-05', 'epoch': '0.1847'}

 18%|█▊        | 7010/37963 [21:52:49<109:39:55, 12.75s/it]
 18%|█▊        | 7011/37963 [21:53:05<118:56:23, 13.83s/it]
 18%|█▊        | 7012/37963 [21:53:16<109:16:52, 12.71s/it]
 18%|█▊        | 7013/37963 [21:53:26<102:24:31, 11.91s/it]
 18%|█▊        | 7014/37963 [21:53:36<97:28:22, 11.34s/it] 
 18%|█▊        | 7015/37963 [21:53:46<94:14:42, 10.96s/it]
 18%|█▊        | 7016/37963 [21:54:02<108:44:01, 12.65s/it]
 18%|█▊        | 7017/37963 [21:54:12<102:12:09, 11.89s/it]
 18%|█▊        | 7018/37963 [21:54:22<97:23:44, 11.33s/it] 
 18%|█▊        | 7019/37963 [21:54:33<94:19:34, 10.97s/it]
 18%|█▊        | 7020/37963 [21:54:42<91:37:08, 10.66s/it]
                                                          
{'loss': '0.1804', 'grad_norm': '4.426', 'learning_rate': '1.877e-05', 'epoch': '0.1849'}

 18%|█▊        | 7020/37963 [21:54:42<91:37:08, 10.66s/it]
 18%|█▊        | 7021/37963 [21:54:53<90:15:47, 10.50s/it]
 18%|█▊        | 7022/37963 [21:55:10<106:52:17, 12.43s/it]
 18%|█▊        | 7023/37963 [21:55:20<100:55:40, 11.74s/it]
 19%|█▊        | 7024/37963 [21:55:30<96:37:32, 11.24s/it] 
 19%|█▊        | 7025/37963 [21:55:40<93:28:15, 10.88s/it]
 19%|█▊        | 7026/37963 [21:55:50<91:31:53, 10.65s/it]
 19%|█▊        | 7027/37963 [21:56:00<90:01:27, 10.48s/it]
 19%|█▊        | 7028/37963 [21:56:10<89:17:00, 10.39s/it]
 19%|█▊        | 7029/37963 [21:56:20<88:58:26, 10.35s/it]
 19%|█▊        | 7030/37963 [21:56:31<88:25:33, 10.29s/it]
                                                          
{'loss': '0.1863', 'grad_norm': '3.185', 'learning_rate': '1.876e-05', 'epoch': '0.1852'}

 19%|█▊        | 7030/37963 [21:56:31<88:25:33, 10.29s/it]
 19%|█▊        | 7031/37963 [21:56:41<88:00:25, 10.24s/it]
 19%|█▊        | 7032/37963 [21:56:57<103:18:17, 12.02s/it]
 19%|█▊        | 7033/37963 [21:57:07<98:23:06, 11.45s/it] 
 19%|█▊        | 7034/37963 [21:57:17<94:57:05, 11.05s/it]
 19%|█▊        | 7035/37963 [21:57:27<92:44:45, 10.80s/it]
 19%|█▊        | 7036/37963 [21:57:37<90:47:36, 10.57s/it]
 19%|█▊        | 7037/37963 [21:57:48<90:05:10, 10.49s/it]
 19%|█▊        | 7038/37963 [21:57:58<89:06:18, 10.37s/it]
 19%|█▊        | 7039/37963 [21:58:08<88:32:33, 10.31s/it]
 19%|█▊        | 7040/37963 [21:58:18<87:56:48, 10.24s/it]
                                                          
{'loss': '0.1781', 'grad_norm': '1.492', 'learning_rate': '1.876e-05', 'epoch': '0.1854'}

 19%|█▊        | 7040/37963 [21:58:18<87:56:48, 10.24s/it]
 19%|█▊        | 7041/37963 [21:58:28<87:27:49, 10.18s/it]
 19%|█▊        | 7042/37963 [21:58:38<87:19:20, 10.17s/it]
 19%|█▊        | 7043/37963 [21:58:55<103:50:13, 12.09s/it]
 19%|█▊        | 7044/37963 [21:59:04<97:40:39, 11.37s/it] 
 19%|█▊        | 7045/37963 [21:59:15<94:38:11, 11.02s/it]
 19%|█▊        | 7046/37963 [21:59:24<91:32:43, 10.66s/it]
 19%|█▊        | 7047/37963 [21:59:34<88:52:19, 10.35s/it]
 19%|█▊        | 7048/37963 [21:59:51<105:18:17, 12.26s/it]
 19%|█▊        | 7049/37963 [22:00:01<99:39:19, 11.61s/it] 
 19%|█▊        | 7050/37963 [22:00:11<95:16:33, 11.10s/it]
                                                          
{'loss': '0.1606', 'grad_norm': '2.559', 'learning_rate': '1.876e-05', 'epoch': '0.1857'}

 19%|█▊        | 7050/37963 [22:00:11<95:16:33, 11.10s/it]
 19%|█▊        | 7051/37963 [22:00:20<91:11:17, 10.62s/it]
 19%|█▊        | 7052/37963 [22:00:37<107:31:58, 12.52s/it]
 19%|█▊        | 7053/37963 [22:00:47<101:19:00, 11.80s/it]
 19%|█▊        | 7054/37963 [22:00:58<97:07:01, 11.31s/it] 
 19%|█▊        | 7055/37963 [22:01:08<93:43:16, 10.92s/it]
 19%|█▊        | 7056/37963 [22:01:18<91:45:02, 10.69s/it]
 19%|█▊        | 7057/37963 [22:01:28<90:39:38, 10.56s/it]
 19%|█▊        | 7058/37963 [22:01:51<121:44:45, 14.18s/it]
 19%|█▊        | 7059/37963 [22:02:01<111:17:55, 12.97s/it]
 19%|█▊        | 7060/37963 [22:02:11<103:35:06, 12.07s/it]
                                                           
{'loss': '0.1853', 'grad_norm': '2.109', 'learning_rate': '1.875e-05', 'epoch': '0.186'}

 19%|█▊        | 7060/37963 [22:02:11<103:35:06, 12.07s/it]
 19%|█▊        | 7061/37963 [22:02:21<98:27:53, 11.47s/it] 
 19%|█▊        | 7062/37963 [22:02:30<93:31:52, 10.90s/it]
 19%|█▊        | 7063/37963 [22:02:40<91:37:13, 10.67s/it]
 19%|█▊        | 7064/37963 [22:02:57<106:28:55, 12.41s/it]
 19%|█▊        | 7065/37963 [22:03:07<100:26:19, 11.70s/it]
 19%|█▊        | 7066/37963 [22:03:17<96:11:15, 11.21s/it] 
 19%|█▊        | 7067/37963 [22:03:27<93:16:42, 10.87s/it]
 19%|█▊        | 7068/37963 [22:03:37<90:39:58, 10.56s/it]
 19%|█▊        | 7069/37963 [22:03:47<89:45:39, 10.46s/it]
 19%|█▊        | 7070/37963 [22:04:04<106:09:17, 12.37s/it]
                                                           
{'loss': '0.1766', 'grad_norm': '3.89', 'learning_rate': '1.875e-05', 'epoch': '0.1862'}

 19%|█▊        | 7070/37963 [22:04:04<106:09:17, 12.37s/it]
 19%|█▊        | 7071/37963 [22:04:14<100:34:05, 11.72s/it]
 19%|█▊        | 7072/37963 [22:04:24<96:23:41, 11.23s/it] 
 19%|█▊        | 7073/37963 [22:04:34<93:40:42, 10.92s/it]
 19%|█▊        | 7074/37963 [22:04:44<90:33:56, 10.56s/it]
 19%|█▊        | 7075/37963 [22:04:54<89:13:09, 10.40s/it]
 19%|█▊        | 7076/37963 [22:05:04<88:35:17, 10.33s/it]
 19%|█▊        | 7077/37963 [22:05:14<86:57:37, 10.14s/it]
 19%|█▊        | 7078/37963 [22:05:24<85:57:41, 10.02s/it]
 19%|█▊        | 7079/37963 [22:05:40<102:50:57, 11.99s/it]
 19%|█▊        | 7080/37963 [22:05:51<98:11:08, 11.45s/it] 
                                                          
{'loss': '0.1676', 'grad_norm': '1.232', 'learning_rate': '1.874e-05', 'epoch': '0.1865'}

 19%|█▊        | 7080/37963 [22:05:51<98:11:08, 11.45s/it]
 19%|█▊        | 7081/37963 [22:06:01<94:47:21, 11.05s/it]
 19%|█▊        | 7082/37963 [22:06:11<92:18:47, 10.76s/it]
 19%|█▊        | 7083/37963 [22:06:21<90:39:37, 10.57s/it]
 19%|█▊        | 7084/37963 [22:06:31<89:01:18, 10.38s/it]
 19%|█▊        | 7085/37963 [22:06:41<88:10:50, 10.28s/it]
 19%|█▊        | 7086/37963 [22:06:51<88:10:43, 10.28s/it]
 19%|█▊        | 7087/37963 [22:07:01<87:51:43, 10.24s/it]
 19%|█▊        | 7088/37963 [22:07:11<87:32:57, 10.21s/it]
 19%|█▊        | 7089/37963 [22:07:22<87:28:38, 10.20s/it]
 19%|█▊        | 7090/37963 [22:07:31<86:20:21, 10.07s/it]
                                                          
{'loss': '0.1902', 'grad_norm': '1.683', 'learning_rate': '1.874e-05', 'epoch': '0.1868'}

 19%|█▊        | 7090/37963 [22:07:31<86:20:21, 10.07s/it]
 19%|█▊        | 7091/37963 [22:07:41<86:06:05, 10.04s/it]
 19%|█▊        | 7092/37963 [22:07:58<102:58:44, 12.01s/it]
 19%|█▊        | 7093/37963 [22:08:08<98:08:14, 11.44s/it] 
 19%|█▊        | 7094/37963 [22:08:18<93:43:57, 10.93s/it]
 19%|█▊        | 7095/37963 [22:08:35<109:29:58, 12.77s/it]
 19%|█▊        | 7096/37963 [22:08:44<101:19:38, 11.82s/it]
 19%|█▊        | 7097/37963 [22:08:54<96:25:19, 11.25s/it] 
 19%|█▊        | 7098/37963 [22:09:04<93:24:50, 10.90s/it]
 19%|█▊        | 7099/37963 [22:09:21<107:25:36, 12.53s/it]
 19%|█▊        | 7100/37963 [22:09:31<101:20:05, 11.82s/it]
                                                           
{'loss': '0.167', 'grad_norm': '3.809', 'learning_rate': '1.873e-05', 'epoch': '0.187'}

 19%|█▊        | 7100/37963 [22:09:31<101:20:05, 11.82s/it]
 19%|█▊        | 7101/37963 [22:09:41<97:00:34, 11.32s/it] 
 19%|█▊        | 7102/37963 [22:09:51<93:48:08, 10.94s/it]
 19%|█▊        | 7103/37963 [22:10:01<91:38:45, 10.69s/it]
 19%|█▊        | 7104/37963 [22:10:11<89:53:48, 10.49s/it]
 19%|█▊        | 7105/37963 [22:10:21<88:52:33, 10.37s/it]
 19%|█▊        | 7106/37963 [22:10:38<105:11:17, 12.27s/it]
 19%|█▊        | 7107/37963 [22:10:54<115:37:55, 13.49s/it]
 19%|█▊        | 7108/37963 [22:11:05<107:10:34, 12.50s/it]
 19%|█▊        | 7109/37963 [22:11:15<100:34:43, 11.74s/it]
 19%|█▊        | 7110/37963 [22:11:25<96:27:35, 11.26s/it] 
                                                          
{'loss': '0.1809', 'grad_norm': '5.24', 'learning_rate': '1.873e-05', 'epoch': '0.1873'}

 19%|█▊        | 7110/37963 [22:11:25<96:27:35, 11.26s/it]
 19%|█▊        | 7111/37963 [22:11:41<109:58:02, 12.83s/it]
 19%|█▊        | 7112/37963 [22:11:51<102:09:02, 11.92s/it]
 19%|█▊        | 7113/37963 [22:12:01<97:36:49, 11.39s/it] 
 19%|█▊        | 7114/37963 [22:12:11<94:24:47, 11.02s/it]
 19%|█▊        | 7115/37963 [22:12:21<91:49:57, 10.72s/it]
 19%|█▊        | 7116/37963 [22:12:31<89:10:27, 10.41s/it]
 19%|█▊        | 7117/37963 [22:12:41<87:53:41, 10.26s/it]
 19%|█▊        | 7118/37963 [22:12:51<86:36:55, 10.11s/it]
 19%|█▉        | 7119/37963 [22:13:08<104:48:22, 12.23s/it]
 19%|█▉        | 7120/37963 [22:13:18<98:51:50, 11.54s/it] 
                                                          
{'loss': '0.2056', 'grad_norm': '2.908', 'learning_rate': '1.873e-05', 'epoch': '0.1876'}

 19%|█▉        | 7120/37963 [22:13:18<98:51:50, 11.54s/it]
 19%|█▉        | 7121/37963 [22:13:28<94:46:59, 11.06s/it]
 19%|█▉        | 7122/37963 [22:13:38<92:14:17, 10.77s/it]
 19%|█▉        | 7123/37963 [22:13:48<90:31:43, 10.57s/it]
 19%|█▉        | 7124/37963 [22:13:58<89:42:47, 10.47s/it]
 19%|█▉        | 7125/37963 [22:14:08<88:26:10, 10.32s/it]
 19%|█▉        | 7126/37963 [22:14:18<88:11:50, 10.30s/it]
 19%|█▉        | 7127/37963 [22:14:29<87:42:06, 10.24s/it]
 19%|█▉        | 7128/37963 [22:14:45<103:53:44, 12.13s/it]
 19%|█▉        | 7129/37963 [22:14:55<98:47:15, 11.53s/it] 
 19%|█▉        | 7130/37963 [22:15:06<95:41:36, 11.17s/it]
                                                          
{'loss': '0.1826', 'grad_norm': '1.428', 'learning_rate': '1.872e-05', 'epoch': '0.1878'}

 19%|█▉        | 7130/37963 [22:15:06<95:41:36, 11.17s/it]
 19%|█▉        | 7131/37963 [22:15:16<93:00:43, 10.86s/it]
 19%|█▉        | 7132/37963 [22:15:26<90:59:41, 10.63s/it]
 19%|█▉        | 7133/37963 [22:15:35<88:45:46, 10.36s/it]
 19%|█▉        | 7134/37963 [22:15:46<88:08:23, 10.29s/it]
 19%|█▉        | 7135/37963 [22:15:56<87:28:56, 10.22s/it]
 19%|█▉        | 7136/37963 [22:16:06<87:05:00, 10.17s/it]
 19%|█▉        | 7137/37963 [22:16:16<87:03:52, 10.17s/it]
 19%|█▉        | 7138/37963 [22:16:26<86:49:39, 10.14s/it]
 19%|█▉        | 7139/37963 [22:16:36<85:48:16, 10.02s/it]
 19%|█▉        | 7140/37963 [22:16:52<102:38:34, 11.99s/it]
                                                           
{'loss': '0.1887', 'grad_norm': '2.556', 'learning_rate': '1.872e-05', 'epoch': '0.1881'}

 19%|█▉        | 7140/37963 [22:16:52<102:38:34, 11.99s/it]
 19%|█▉        | 7141/37963 [22:17:02<97:41:10, 11.41s/it] 
 19%|█▉        | 7142/37963 [22:17:12<94:28:10, 11.03s/it]
 19%|█▉        | 7143/37963 [22:17:23<92:00:22, 10.75s/it]
 19%|█▉        | 7144/37963 [22:17:40<108:14:17, 12.64s/it]
 19%|█▉        | 7145/37963 [22:17:50<101:38:08, 11.87s/it]
 19%|█▉        | 7146/37963 [22:17:59<96:12:16, 11.24s/it] 
 19%|█▉        | 7147/37963 [22:18:10<93:08:53, 10.88s/it]
 19%|█▉        | 7148/37963 [22:18:26<107:37:19, 12.57s/it]
 19%|█▉        | 7149/37963 [22:18:36<99:39:47, 11.64s/it] 
 19%|█▉        | 7150/37963 [22:18:45<95:02:15, 11.10s/it]
                                                          
{'loss': '0.1687', 'grad_norm': '1.668', 'learning_rate': '1.871e-05', 'epoch': '0.1883'}

 19%|█▉        | 7150/37963 [22:18:45<95:02:15, 11.10s/it]
 19%|█▉        | 7151/37963 [22:18:55<91:16:07, 10.66s/it]
 19%|█▉        | 7152/37963 [22:19:05<89:05:55, 10.41s/it]
 19%|█▉        | 7153/37963 [22:19:15<88:38:13, 10.36s/it]
 19%|█▉        | 7154/37963 [22:19:31<104:09:04, 12.17s/it]
 19%|█▉        | 7155/37963 [22:19:42<98:43:43, 11.54s/it] 
 19%|█▉        | 7156/37963 [22:19:58<111:09:03, 12.99s/it]
 19%|█▉        | 7157/37963 [22:20:08<103:50:10, 12.13s/it]
 19%|█▉        | 7158/37963 [22:20:18<98:19:24, 11.49s/it] 
 19%|█▉        | 7159/37963 [22:20:28<94:55:42, 11.09s/it]
 19%|█▉        | 7160/37963 [22:20:38<92:20:21, 10.79s/it]
                                                          
{'loss': '0.1893', 'grad_norm': '2.188', 'learning_rate': '1.871e-05', 'epoch': '0.1886'}

 19%|█▉        | 7160/37963 [22:20:38<92:20:21, 10.79s/it]
 19%|█▉        | 7161/37963 [22:20:48<90:41:45, 10.60s/it]
 19%|█▉        | 7162/37963 [22:21:05<106:14:06, 12.42s/it]
 19%|█▉        | 7163/37963 [22:21:15<100:24:02, 11.74s/it]
 19%|█▉        | 7164/37963 [22:21:25<96:07:10, 11.24s/it] 
 19%|█▉        | 7165/37963 [22:21:35<92:14:16, 10.78s/it]
 19%|█▉        | 7166/37963 [22:21:52<108:45:13, 12.71s/it]
 19%|█▉        | 7167/37963 [22:22:02<101:31:37, 11.87s/it]
 19%|█▉        | 7168/37963 [22:22:12<97:03:07, 11.35s/it] 
 19%|█▉        | 7169/37963 [22:22:22<93:53:52, 10.98s/it]
 19%|█▉        | 7170/37963 [22:22:32<91:22:28, 10.68s/it]
                                                          
{'loss': '0.1765', 'grad_norm': '5.312', 'learning_rate': '1.871e-05', 'epoch': '0.1889'}

 19%|█▉        | 7170/37963 [22:22:32<91:22:28, 10.68s/it]
 19%|█▉        | 7171/37963 [22:22:42<89:32:48, 10.47s/it]
 19%|█▉        | 7172/37963 [22:22:53<88:52:59, 10.39s/it]
 19%|█▉        | 7173/37963 [22:23:02<87:35:51, 10.24s/it]
 19%|█▉        | 7174/37963 [22:23:13<87:08:15, 10.19s/it]
 19%|█▉        | 7175/37963 [22:23:23<86:52:50, 10.16s/it]
 19%|█▉        | 7176/37963 [22:23:33<86:34:11, 10.12s/it]
 19%|█▉        | 7177/37963 [22:23:49<103:18:22, 12.08s/it]
 19%|█▉        | 7178/37963 [22:23:59<97:46:20, 11.43s/it] 
 19%|█▉        | 7179/37963 [22:24:09<94:09:42, 11.01s/it]
 19%|█▉        | 7180/37963 [22:24:19<92:00:41, 10.76s/it]
                                                          
{'loss': '0.1705', 'grad_norm': '3.584', 'learning_rate': '1.87e-05', 'epoch': '0.1891'}

 19%|█▉        | 7180/37963 [22:24:19<92:00:41, 10.76s/it]
 19%|█▉        | 7181/37963 [22:24:30<90:29:31, 10.58s/it]
 19%|█▉        | 7182/37963 [22:24:40<89:05:46, 10.42s/it]
 19%|█▉        | 7183/37963 [22:24:50<88:15:08, 10.32s/it]
 19%|█▉        | 7184/37963 [22:25:00<87:00:50, 10.18s/it]
 19%|█▉        | 7185/37963 [22:25:10<86:33:54, 10.13s/it]
 19%|█▉        | 7186/37963 [22:25:19<85:33:33, 10.01s/it]
 19%|█▉        | 7187/37963 [22:25:29<84:51:37,  9.93s/it]
 19%|█▉        | 7188/37963 [22:25:39<85:08:19,  9.96s/it]
 19%|█▉        | 7189/37963 [22:25:56<101:44:57, 11.90s/it]
 19%|█▉        | 7190/37963 [22:26:06<97:32:00, 11.41s/it] 
                                                          
{'loss': '0.1853', 'grad_norm': '3.875', 'learning_rate': '1.87e-05', 'epoch': '0.1894'}

 19%|█▉        | 7190/37963 [22:26:06<97:32:00, 11.41s/it]
 19%|█▉        | 7191/37963 [22:26:16<93:15:20, 10.91s/it]
 19%|█▉        | 7192/37963 [22:26:33<108:55:35, 12.74s/it]
 19%|█▉        | 7193/37963 [22:26:42<101:22:05, 11.86s/it]
 19%|█▉        | 7194/37963 [22:26:52<96:14:00, 11.26s/it] 
 19%|█▉        | 7195/37963 [22:27:02<93:10:11, 10.90s/it]
 19%|█▉        | 7196/37963 [22:27:12<91:28:54, 10.70s/it]
 19%|█▉        | 7197/37963 [22:27:29<106:30:20, 12.46s/it]
 19%|█▉        | 7198/37963 [22:27:39<100:52:35, 11.80s/it]
 19%|█▉        | 7199/37963 [22:27:49<96:36:28, 11.31s/it] 
 19%|█▉        | 7200/37963 [22:28:00<93:40:59, 10.96s/it]
                                                          
{'loss': '0.1688', 'grad_norm': '2.43', 'learning_rate': '1.869e-05', 'epoch': '0.1897'}

 19%|█▉        | 7200/37963 [22:28:00<93:40:59, 10.96s/it]
 19%|█▉        | 7201/37963 [22:28:10<91:37:21, 10.72s/it]
 19%|█▉        | 7202/37963 [22:28:20<89:54:35, 10.52s/it]
 19%|█▉        | 7203/37963 [22:28:43<121:06:52, 14.17s/it]
 19%|█▉        | 7204/37963 [22:28:53<110:54:24, 12.98s/it]
 19%|█▉        | 7205/37963 [22:29:03<103:46:01, 12.15s/it]
 19%|█▉        | 7206/37963 [22:29:13<98:26:05, 11.52s/it] 
 19%|█▉        | 7207/37963 [22:29:23<94:16:17, 11.03s/it]
 19%|█▉        | 7208/37963 [22:29:39<108:30:46, 12.70s/it]
 19%|█▉        | 7209/37963 [22:29:50<101:54:48, 11.93s/it]
 19%|█▉        | 7210/37963 [22:29:59<96:03:46, 11.25s/it] 
                                                          
{'loss': '0.1803', 'grad_norm': '2.895', 'learning_rate': '1.869e-05', 'epoch': '0.1899'}

 19%|█▉        | 7210/37963 [22:29:59<96:03:46, 11.25s/it]
 19%|█▉        | 7211/37963 [22:30:09<93:26:39, 10.94s/it]
 19%|█▉        | 7212/37963 [22:30:20<91:11:12, 10.68s/it]
 19%|█▉        | 7213/37963 [22:30:30<89:42:09, 10.50s/it]
 19%|█▉        | 7214/37963 [22:30:47<106:21:27, 12.45s/it]
 19%|█▉        | 7215/37963 [22:30:57<100:32:22, 11.77s/it]
 19%|█▉        | 7216/37963 [22:31:06<94:48:59, 11.10s/it] 
 19%|█▉        | 7217/37963 [22:31:16<91:55:53, 10.76s/it]
 19%|█▉        | 7218/37963 [22:31:26<89:56:16, 10.53s/it]
 19%|█▉        | 7219/37963 [22:31:36<88:36:23, 10.38s/it]
 19%|█▉        | 7220/37963 [22:31:46<87:48:39, 10.28s/it]
                                                          
{'loss': '0.1783', 'grad_norm': '1.145', 'learning_rate': '1.868e-05', 'epoch': '0.1902'}

 19%|█▉        | 7220/37963 [22:31:46<87:48:39, 10.28s/it]
 19%|█▉        | 7221/37963 [22:31:57<87:22:42, 10.23s/it]
 19%|█▉        | 7222/37963 [22:32:06<86:14:51, 10.10s/it]
 19%|█▉        | 7223/37963 [22:32:16<86:19:18, 10.11s/it]
 19%|█▉        | 7224/37963 [22:32:27<86:12:55, 10.10s/it]
 19%|█▉        | 7225/37963 [22:32:43<102:37:05, 12.02s/it]
 19%|█▉        | 7226/37963 [22:32:53<97:14:23, 11.39s/it] 
 19%|█▉        | 7227/37963 [22:33:03<93:51:44, 10.99s/it]
 19%|█▉        | 7228/37963 [22:33:13<91:51:25, 10.76s/it]
 19%|█▉        | 7229/37963 [22:33:23<89:59:59, 10.54s/it]
 19%|█▉        | 7230/37963 [22:33:33<88:06:51, 10.32s/it]
                                                          
{'loss': '0.177', 'grad_norm': '1.574', 'learning_rate': '1.868e-05', 'epoch': '0.1904'}

 19%|█▉        | 7230/37963 [22:33:33<88:06:51, 10.32s/it]
 19%|█▉        | 7231/37963 [22:33:43<87:22:25, 10.24s/it]
 19%|█▉        | 7232/37963 [22:33:53<85:29:23, 10.01s/it]
 19%|█▉        | 7233/37963 [22:34:02<85:02:24,  9.96s/it]
 19%|█▉        | 7234/37963 [22:34:12<85:07:07,  9.97s/it]
 19%|█▉        | 7235/37963 [22:34:22<85:05:39,  9.97s/it]
 19%|█▉        | 7236/37963 [22:34:39<102:26:24, 12.00s/it]
 19%|█▉        | 7237/37963 [22:34:49<97:02:14, 11.37s/it] 
 19%|█▉        | 7238/37963 [22:34:59<93:41:15, 10.98s/it]
 19%|█▉        | 7239/37963 [22:35:09<90:15:28, 10.58s/it]
 19%|█▉        | 7240/37963 [22:35:26<106:31:54, 12.48s/it]
                                                           
{'loss': '0.1745', 'grad_norm': '2.371', 'learning_rate': '1.868e-05', 'epoch': '0.1907'}

 19%|█▉        | 7240/37963 [22:35:26<106:31:54, 12.48s/it]
 19%|█▉        | 7241/37963 [22:35:36<99:46:54, 11.69s/it] 
 19%|█▉        | 7242/37963 [22:35:46<95:44:28, 11.22s/it]
 19%|█▉        | 7243/37963 [22:35:56<92:53:25, 10.89s/it]
 19%|█▉        | 7244/37963 [22:36:12<107:31:05, 12.60s/it]
 19%|█▉        | 7245/37963 [22:36:22<101:08:01, 11.85s/it]
 19%|█▉        | 7246/37963 [22:36:32<96:20:29, 11.29s/it] 
 19%|█▉        | 7247/37963 [22:36:43<93:12:53, 10.93s/it]
 19%|█▉        | 7248/37963 [22:36:53<91:13:15, 10.69s/it]
 19%|█▉        | 7249/37963 [22:37:03<90:06:42, 10.56s/it]
 19%|█▉        | 7250/37963 [22:37:13<88:16:26, 10.35s/it]
                                                          
{'loss': '0.1751', 'grad_norm': '1.569', 'learning_rate': '1.867e-05', 'epoch': '0.191'}

 19%|█▉        | 7250/37963 [22:37:13<88:16:26, 10.35s/it]
 19%|█▉        | 7251/37963 [22:37:29<104:19:12, 12.23s/it]
 19%|█▉        | 7252/37963 [22:37:46<114:25:18, 13.41s/it]
 19%|█▉        | 7253/37963 [22:37:56<105:53:27, 12.41s/it]
 19%|█▉        | 7254/37963 [22:38:06<100:01:10, 11.73s/it]
 19%|█▉        | 7255/37963 [22:38:16<95:50:11, 11.24s/it] 
 19%|█▉        | 7256/37963 [22:38:32<109:12:50, 12.80s/it]
 19%|█▉        | 7257/37963 [22:38:42<102:21:18, 12.00s/it]
 19%|█▉        | 7258/37963 [22:38:53<97:25:41, 11.42s/it] 
 19%|█▉        | 7259/37963 [22:39:03<93:57:25, 11.02s/it]
 19%|█▉        | 7260/37963 [22:39:13<91:50:53, 10.77s/it]
                                                          
{'loss': '0.1765', 'grad_norm': '4.709', 'learning_rate': '1.867e-05', 'epoch': '0.1912'}

 19%|█▉        | 7260/37963 [22:39:13<91:50:53, 10.77s/it]
 19%|█▉        | 7261/37963 [22:39:23<90:17:48, 10.59s/it]
 19%|█▉        | 7262/37963 [22:39:33<89:14:43, 10.46s/it]
 19%|█▉        | 7263/37963 [22:39:50<106:46:54, 12.52s/it]
 19%|█▉        | 7264/37963 [22:40:01<100:40:47, 11.81s/it]
 19%|█▉        | 7265/37963 [22:40:11<96:11:57, 11.28s/it] 
 19%|█▉        | 7266/37963 [22:40:20<91:40:52, 10.75s/it]
 19%|█▉        | 7267/37963 [22:40:30<89:57:59, 10.55s/it]
 19%|█▉        | 7268/37963 [22:40:40<88:52:19, 10.42s/it]
 19%|█▉        | 7269/37963 [22:40:50<88:00:48, 10.32s/it]
 19%|█▉        | 7270/37963 [22:41:01<87:38:30, 10.28s/it]
                                                          
{'loss': '0.1748', 'grad_norm': '3.156', 'learning_rate': '1.866e-05', 'epoch': '0.1915'}

 19%|█▉        | 7270/37963 [22:41:01<87:38:30, 10.28s/it]
 19%|█▉        | 7271/37963 [22:41:11<87:00:38, 10.21s/it]
 19%|█▉        | 7272/37963 [22:41:21<86:43:25, 10.17s/it]
 19%|█▉        | 7273/37963 [22:41:31<85:39:53, 10.05s/it]
 19%|█▉        | 7274/37963 [22:41:47<101:20:48, 11.89s/it]
 19%|█▉        | 7275/37963 [22:41:57<96:28:21, 11.32s/it] 
 19%|█▉        | 7276/37963 [22:42:07<93:12:40, 10.93s/it]
 19%|█▉        | 7277/37963 [22:42:16<89:50:52, 10.54s/it]
 19%|█▉        | 7278/37963 [22:42:26<88:04:29, 10.33s/it]
 19%|█▉        | 7279/37963 [22:42:36<87:17:46, 10.24s/it]
 19%|█▉        | 7280/37963 [22:42:46<87:07:35, 10.22s/it]
                                                          
{'loss': '0.1758', 'grad_norm': '1.854', 'learning_rate': '1.866e-05', 'epoch': '0.1918'}

 19%|█▉        | 7280/37963 [22:42:46<87:07:35, 10.22s/it]
 19%|█▉        | 7281/37963 [22:42:56<86:17:57, 10.13s/it]
 19%|█▉        | 7282/37963 [22:43:06<86:18:02, 10.13s/it]
 19%|█▉        | 7283/37963 [22:43:16<86:00:18, 10.09s/it]
 19%|█▉        | 7284/37963 [22:43:26<85:50:43, 10.07s/it]
 19%|█▉        | 7285/37963 [22:43:43<102:15:40, 12.00s/it]
 19%|█▉        | 7286/37963 [22:43:53<96:42:56, 11.35s/it] 
 19%|█▉        | 7287/37963 [22:44:03<93:07:45, 10.93s/it]
 19%|█▉        | 7288/37963 [22:44:13<91:20:05, 10.72s/it]
 19%|█▉        | 7289/37963 [22:44:30<107:25:12, 12.61s/it]
 19%|█▉        | 7290/37963 [22:44:40<100:24:37, 11.78s/it]
                                                           
{'loss': '0.1809', 'grad_norm': '1.778', 'learning_rate': '1.865e-05', 'epoch': '0.192'}

 19%|█▉        | 7290/37963 [22:44:40<100:24:37, 11.78s/it]
 19%|█▉        | 7291/37963 [22:44:50<96:01:16, 11.27s/it] 
 19%|█▉        | 7292/37963 [22:45:06<109:14:54, 12.82s/it]
 19%|█▉        | 7293/37963 [22:45:16<102:12:45, 12.00s/it]
 19%|█▉        | 7294/37963 [22:45:26<97:00:05, 11.39s/it] 
 19%|█▉        | 7295/37963 [22:45:36<93:36:33, 10.99s/it]
 19%|█▉        | 7296/37963 [22:45:46<91:06:52, 10.70s/it]
 19%|█▉        | 7297/37963 [22:45:56<88:43:06, 10.42s/it]
 19%|█▉        | 7298/37963 [22:46:06<86:51:56, 10.20s/it]
 19%|█▉        | 7299/37963 [22:46:22<103:05:00, 12.10s/it]
 19%|█▉        | 7300/37963 [22:46:33<97:52:16, 11.49s/it] 
                                                          
{'loss': '0.1775', 'grad_norm': '1.604', 'learning_rate': '1.865e-05', 'epoch': '0.1923'}

 19%|█▉        | 7300/37963 [22:46:33<97:52:16, 11.49s/it]
 19%|█▉        | 7301/37963 [22:46:43<94:22:52, 11.08s/it]
 19%|█▉        | 7302/37963 [22:46:53<91:13:22, 10.71s/it]
 19%|█▉        | 7303/37963 [22:47:09<106:18:49, 12.48s/it]
 19%|█▉        | 7304/37963 [22:47:19<100:25:39, 11.79s/it]
 19%|█▉        | 7305/37963 [22:47:36<111:43:53, 13.12s/it]
 19%|█▉        | 7306/37963 [22:47:46<104:06:53, 12.23s/it]
 19%|█▉        | 7307/37963 [22:47:55<97:57:05, 11.50s/it] 
 19%|█▉        | 7308/37963 [22:48:05<93:24:32, 10.97s/it]
 19%|█▉        | 7309/37963 [22:48:15<91:06:44, 10.70s/it]
 19%|█▉        | 7310/37963 [22:48:25<89:25:53, 10.50s/it]
                                                          
{'loss': '0.1674', 'grad_norm': '2.904', 'learning_rate': '1.865e-05', 'epoch': '0.1926'}

 19%|█▉        | 7310/37963 [22:48:25<89:25:53, 10.50s/it]
 19%|█▉        | 7311/37963 [22:48:42<106:20:03, 12.49s/it]
 19%|█▉        | 7312/37963 [22:48:53<100:12:54, 11.77s/it]
 19%|█▉        | 7313/37963 [22:49:03<95:43:19, 11.24s/it] 
 19%|█▉        | 7314/37963 [22:49:12<91:34:32, 10.76s/it]
 19%|█▉        | 7315/37963 [22:49:22<89:46:49, 10.55s/it]
 19%|█▉        | 7316/37963 [22:49:32<88:38:50, 10.41s/it]
 19%|█▉        | 7317/37963 [22:49:42<87:53:02, 10.32s/it]
 19%|█▉        | 7318/37963 [22:49:53<87:14:26, 10.25s/it]
 19%|█▉        | 7319/37963 [22:50:03<87:23:27, 10.27s/it]
 19%|█▉        | 7320/37963 [22:50:13<87:06:52, 10.23s/it]
                                                          
{'loss': '0.1568', 'grad_norm': '5.994', 'learning_rate': '1.864e-05', 'epoch': '0.1928'}

 19%|█▉        | 7320/37963 [22:50:13<87:06:52, 10.23s/it]
 19%|█▉        | 7321/37963 [22:50:23<86:49:10, 10.20s/it]
 19%|█▉        | 7322/37963 [22:50:40<103:01:44, 12.10s/it]
 19%|█▉        | 7323/37963 [22:50:50<98:01:33, 11.52s/it] 
 19%|█▉        | 7324/37963 [22:51:00<94:30:49, 11.11s/it]
 19%|█▉        | 7325/37963 [22:51:10<91:56:59, 10.80s/it]
 19%|█▉        | 7326/37963 [22:51:20<90:09:53, 10.59s/it]
 19%|█▉        | 7327/37963 [22:51:30<88:46:29, 10.43s/it]
 19%|█▉        | 7328/37963 [22:51:40<87:58:53, 10.34s/it]
 19%|█▉        | 7329/37963 [22:51:51<87:37:00, 10.30s/it]
 19%|█▉        | 7330/37963 [22:52:01<87:08:03, 10.24s/it]
                                                          
{'loss': '0.1786', 'grad_norm': '1.083', 'learning_rate': '1.864e-05', 'epoch': '0.1931'}

 19%|█▉        | 7330/37963 [22:52:01<87:08:03, 10.24s/it]
 19%|█▉        | 7331/37963 [22:52:11<86:47:40, 10.20s/it]
 19%|█▉        | 7332/37963 [22:52:21<86:26:17, 10.16s/it]
 19%|█▉        | 7333/37963 [22:52:37<102:31:27, 12.05s/it]
 19%|█▉        | 7334/37963 [22:52:47<97:23:29, 11.45s/it] 
 19%|█▉        | 7335/37963 [22:53:04<111:11:19, 13.07s/it]
 19%|█▉        | 7336/37963 [22:53:14<104:02:36, 12.23s/it]
 19%|█▉        | 7337/37963 [22:53:25<98:35:11, 11.59s/it] 
 19%|█▉        | 7338/37963 [22:53:35<94:36:05, 11.12s/it]
 19%|█▉        | 7339/37963 [22:53:45<91:50:38, 10.80s/it]
 19%|█▉        | 7340/37963 [22:54:01<107:14:57, 12.61s/it]
                                                           
{'loss': '0.1792', 'grad_norm': '0.5503', 'learning_rate': '1.863e-05', 'epoch': '0.1933'}

 19%|█▉        | 7340/37963 [22:54:01<107:14:57, 12.61s/it]
 19%|█▉        | 7341/37963 [22:54:11<100:31:36, 11.82s/it]
 19%|█▉        | 7342/37963 [22:54:21<95:59:34, 11.29s/it] 
 19%|█▉        | 7343/37963 [22:54:32<92:55:29, 10.93s/it]
 19%|█▉        | 7344/37963 [22:54:42<90:42:01, 10.66s/it]
 19%|█▉        | 7345/37963 [22:54:52<89:15:54, 10.50s/it]
 19%|█▉        | 7346/37963 [22:55:08<104:28:41, 12.28s/it]
 19%|█▉        | 7347/37963 [22:55:18<99:08:26, 11.66s/it] 
 19%|█▉        | 7348/37963 [22:55:28<95:14:47, 11.20s/it]
 19%|█▉        | 7349/37963 [22:55:39<92:25:34, 10.87s/it]
 19%|█▉        | 7350/37963 [22:55:48<89:57:07, 10.58s/it]
                                                          
{'loss': '0.1711', 'grad_norm': '3.408', 'learning_rate': '1.863e-05', 'epoch': '0.1936'}

 19%|█▉        | 7350/37963 [22:55:48<89:57:07, 10.58s/it]
 19%|█▉        | 7351/37963 [22:55:59<89:04:22, 10.48s/it]
 19%|█▉        | 7352/37963 [22:56:09<87:32:34, 10.30s/it]
 19%|█▉        | 7353/37963 [22:56:32<120:39:58, 14.19s/it]
 19%|█▉        | 7354/37963 [22:56:42<110:06:37, 12.95s/it]
 19%|█▉        | 7355/37963 [22:56:52<102:24:58, 12.05s/it]
 19%|█▉        | 7356/37963 [22:57:02<97:16:19, 11.44s/it] 
 19%|█▉        | 7357/37963 [22:57:11<92:11:36, 10.84s/it]
 19%|█▉        | 7358/37963 [22:57:28<108:11:09, 12.73s/it]
 19%|█▉        | 7359/37963 [22:57:38<101:22:21, 11.92s/it]
 19%|█▉        | 7360/37963 [22:57:49<96:35:18, 11.36s/it] 
                                                          
{'loss': '0.1525', 'grad_norm': '3.206', 'learning_rate': '1.862e-05', 'epoch': '0.1939'}

 19%|█▉        | 7360/37963 [22:57:49<96:35:18, 11.36s/it]
 19%|█▉        | 7361/37963 [22:57:59<93:40:26, 11.02s/it]
 19%|█▉        | 7362/37963 [22:58:09<91:39:58, 10.78s/it]
 19%|█▉        | 7363/37963 [22:58:19<89:11:03, 10.49s/it]
 19%|█▉        | 7364/37963 [22:58:29<88:10:18, 10.37s/it]
 19%|█▉        | 7365/37963 [22:58:39<87:33:32, 10.30s/it]
 19%|█▉        | 7366/37963 [22:58:49<87:00:13, 10.24s/it]
 19%|█▉        | 7367/37963 [22:58:59<86:38:15, 10.19s/it]
 19%|█▉        | 7368/37963 [22:59:09<86:35:15, 10.19s/it]
 19%|█▉        | 7369/37963 [22:59:20<86:25:39, 10.17s/it]
 19%|█▉        | 7370/37963 [22:59:36<102:36:03, 12.07s/it]
                                                           
{'loss': '0.1729', 'grad_norm': '3.955', 'learning_rate': '1.862e-05', 'epoch': '0.1941'}

 19%|█▉        | 7370/37963 [22:59:36<102:36:03, 12.07s/it]
 19%|█▉        | 7371/37963 [22:59:46<97:48:08, 11.51s/it] 
 19%|█▉        | 7372/37963 [22:59:56<94:22:48, 11.11s/it]
 19%|█▉        | 7373/37963 [23:00:06<91:37:34, 10.78s/it]
 19%|█▉        | 7374/37963 [23:00:17<89:56:30, 10.59s/it]
 19%|█▉        | 7375/37963 [23:00:27<88:30:28, 10.42s/it]
 19%|█▉        | 7376/37963 [23:00:37<87:37:38, 10.31s/it]
 19%|█▉        | 7377/37963 [23:00:47<86:52:25, 10.23s/it]
 19%|█▉        | 7378/37963 [23:00:57<86:06:52, 10.14s/it]
 19%|█▉        | 7379/37963 [23:01:07<85:57:52, 10.12s/it]
 19%|█▉        | 7380/37963 [23:01:23<102:17:48, 12.04s/it]
                                                           
{'loss': '0.1753', 'grad_norm': '3.492', 'learning_rate': '1.862e-05', 'epoch': '0.1944'}

 19%|█▉        | 7380/37963 [23:01:23<102:17:48, 12.04s/it]
 19%|█▉        | 7381/37963 [23:01:33<97:10:47, 11.44s/it] 
 19%|█▉        | 7382/37963 [23:01:43<92:53:33, 10.94s/it]
 19%|█▉        | 7383/37963 [23:02:00<108:15:34, 12.74s/it]
 19%|█▉        | 7384/37963 [23:02:10<101:27:24, 11.94s/it]
 19%|█▉        | 7385/37963 [23:02:20<96:08:08, 11.32s/it] 
 19%|█▉        | 7386/37963 [23:02:30<92:50:59, 10.93s/it]
 19%|█▉        | 7387/37963 [23:02:47<107:48:52, 12.69s/it]
 19%|█▉        | 7388/37963 [23:02:57<101:00:03, 11.89s/it]
 19%|█▉        | 7389/37963 [23:03:07<96:31:27, 11.37s/it] 
 19%|█▉        | 7390/37963 [23:03:17<93:28:50, 11.01s/it]
                                                          
{'loss': '0.178', 'grad_norm': '1.49', 'learning_rate': '1.861e-05', 'epoch': '0.1947'}

 19%|█▉        | 7390/37963 [23:03:17<93:28:50, 11.01s/it]
 19%|█▉        | 7391/37963 [23:03:27<90:08:08, 10.61s/it]
 19%|█▉        | 7392/37963 [23:03:37<89:03:39, 10.49s/it]
 19%|█▉        | 7393/37963 [23:03:47<87:22:23, 10.29s/it]
 19%|█▉        | 7394/37963 [23:03:57<86:27:07, 10.18s/it]
 19%|█▉        | 7395/37963 [23:04:13<102:11:54, 12.04s/it]
 19%|█▉        | 7396/37963 [23:04:23<97:11:22, 11.45s/it] 
 19%|█▉        | 7397/37963 [23:04:33<93:32:45, 11.02s/it]
 19%|█▉        | 7398/37963 [23:04:43<91:08:40, 10.74s/it]
 19%|█▉        | 7399/37963 [23:04:53<88:11:16, 10.39s/it]
 19%|█▉        | 7400/37963 [23:05:09<103:11:44, 12.16s/it]
                                                           
{'loss': '0.1625', 'grad_norm': '1.426', 'learning_rate': '1.861e-05', 'epoch': '0.1949'}

 19%|█▉        | 7400/37963 [23:05:09<103:11:44, 12.16s/it]
 19%|█▉        | 7401/37963 [23:05:25<113:18:48, 13.35s/it]
 19%|█▉        | 7402/37963 [23:05:35<103:32:08, 12.20s/it]
 20%|█▉        | 7403/37963 [23:05:45<98:16:41, 11.58s/it] 
 20%|█▉        | 7404/37963 [23:05:55<94:31:41, 11.14s/it]
 20%|█▉        | 7405/37963 [23:06:12<109:17:31, 12.88s/it]
 20%|█▉        | 7406/37963 [23:06:22<102:25:50, 12.07s/it]
 20%|█▉        | 7407/37963 [23:06:32<96:59:19, 11.43s/it] 
 20%|█▉        | 7408/37963 [23:06:42<93:36:25, 11.03s/it]
 20%|█▉        | 7409/37963 [23:06:52<89:55:01, 10.59s/it]
 20%|█▉        | 7410/37963 [23:07:02<88:33:52, 10.44s/it]
                                                          
{'loss': '0.1724', 'grad_norm': '1.977', 'learning_rate': '1.86e-05', 'epoch': '0.1952'}

 20%|█▉        | 7410/37963 [23:07:02<88:33:52, 10.44s/it]
 20%|█▉        | 7411/37963 [23:07:12<87:42:35, 10.34s/it]
 20%|█▉        | 7412/37963 [23:07:22<87:05:40, 10.26s/it]
 20%|█▉        | 7413/37963 [23:07:32<86:29:45, 10.19s/it]
 20%|█▉        | 7414/37963 [23:07:42<85:00:15, 10.02s/it]
 20%|█▉        | 7415/37963 [23:07:52<85:22:12, 10.06s/it]
 20%|█▉        | 7416/37963 [23:08:02<85:23:22, 10.06s/it]
 20%|█▉        | 7417/37963 [23:08:11<83:36:54,  9.85s/it]
 20%|█▉        | 7418/37963 [23:08:21<83:37:14,  9.86s/it]
 20%|█▉        | 7419/37963 [23:08:38<100:52:19, 11.89s/it]
 20%|█▉        | 7420/37963 [23:08:47<95:07:43, 11.21s/it] 
                                                          
{'loss': '0.1626', 'grad_norm': '1.913', 'learning_rate': '1.86e-05', 'epoch': '0.1955'}

 20%|█▉        | 7420/37963 [23:08:47<95:07:43, 11.21s/it]
 20%|█▉        | 7421/37963 [23:08:57<92:20:00, 10.88s/it]
 20%|█▉        | 7422/37963 [23:09:07<90:12:21, 10.63s/it]
 20%|█▉        | 7423/37963 [23:09:17<88:21:19, 10.42s/it]
 20%|█▉        | 7424/37963 [23:09:27<87:22:30, 10.30s/it]
 20%|█▉        | 7425/37963 [23:09:37<86:27:48, 10.19s/it]
 20%|█▉        | 7426/37963 [23:09:47<84:59:50, 10.02s/it]
 20%|█▉        | 7427/37963 [23:09:57<84:59:16, 10.02s/it]
 20%|█▉        | 7428/37963 [23:10:13<101:17:12, 11.94s/it]
 20%|█▉        | 7429/37963 [23:10:30<114:12:54, 13.47s/it]
 20%|█▉        | 7430/37963 [23:10:40<104:24:53, 12.31s/it]
                                                           
{'loss': '0.1841', 'grad_norm': '1.131', 'learning_rate': '1.859e-05', 'epoch': '0.1957'}

 20%|█▉        | 7430/37963 [23:10:40<104:24:53, 12.31s/it]
 20%|█▉        | 7431/37963 [23:10:50<98:20:55, 11.60s/it] 
 20%|█▉        | 7432/37963 [23:11:00<94:49:13, 11.18s/it]
 20%|█▉        | 7433/37963 [23:11:10<91:32:46, 10.79s/it]
 20%|█▉        | 7434/37963 [23:11:20<89:41:10, 10.58s/it]
 20%|█▉        | 7435/37963 [23:11:30<88:42:29, 10.46s/it]
 20%|█▉        | 7436/37963 [23:11:47<103:58:50, 12.26s/it]
 20%|█▉        | 7437/37963 [23:11:57<98:23:49, 11.60s/it] 
 20%|█▉        | 7438/37963 [23:12:07<94:33:03, 11.15s/it]
 20%|█▉        | 7439/37963 [23:12:17<91:47:47, 10.83s/it]
 20%|█▉        | 7440/37963 [23:12:27<89:57:10, 10.61s/it]
                                                          
{'loss': '0.1835', 'grad_norm': '1.402', 'learning_rate': '1.859e-05', 'epoch': '0.196'}

 20%|█▉        | 7440/37963 [23:12:27<89:57:10, 10.61s/it]
 20%|█▉        | 7441/37963 [23:12:37<88:31:15, 10.44s/it]
 20%|█▉        | 7442/37963 [23:12:54<103:46:49, 12.24s/it]
 20%|█▉        | 7443/37963 [23:13:03<97:37:07, 11.51s/it] 
 20%|█▉        | 7444/37963 [23:13:13<93:45:29, 11.06s/it]
 20%|█▉        | 7445/37963 [23:13:24<91:32:42, 10.80s/it]
 20%|█▉        | 7446/37963 [23:13:34<89:28:54, 10.56s/it]
 20%|█▉        | 7447/37963 [23:13:44<88:19:58, 10.42s/it]
 20%|█▉        | 7448/37963 [23:14:00<103:58:29, 12.27s/it]
 20%|█▉        | 7449/37963 [23:14:17<115:11:35, 13.59s/it]
 20%|█▉        | 7450/37963 [23:14:27<106:12:57, 12.53s/it]
                                                           
{'loss': '0.1671', 'grad_norm': '0.9121', 'learning_rate': '1.859e-05', 'epoch': '0.1962'}

 20%|█▉        | 7450/37963 [23:14:27<106:12:57, 12.53s/it]
 20%|█▉        | 7451/37963 [23:14:37<100:03:00, 11.80s/it]
 20%|█▉        | 7452/37963 [23:14:47<94:51:33, 11.19s/it] 
 20%|█▉        | 7453/37963 [23:14:57<92:03:16, 10.86s/it]
 20%|█▉        | 7454/37963 [23:15:14<106:40:24, 12.59s/it]
 20%|█▉        | 7455/37963 [23:15:24<100:19:50, 11.84s/it]
 20%|█▉        | 7456/37963 [23:15:33<94:54:52, 11.20s/it] 
 20%|█▉        | 7457/37963 [23:15:44<92:05:43, 10.87s/it]
 20%|█▉        | 7458/37963 [23:15:54<90:07:30, 10.64s/it]
 20%|█▉        | 7459/37963 [23:16:04<88:43:32, 10.47s/it]
 20%|█▉        | 7460/37963 [23:16:14<87:39:00, 10.34s/it]
                                                          
{'loss': '0.1731', 'grad_norm': '1.254', 'learning_rate': '1.858e-05', 'epoch': '0.1965'}

 20%|█▉        | 7460/37963 [23:16:14<87:39:00, 10.34s/it]
 20%|█▉        | 7461/37963 [23:16:24<86:52:58, 10.25s/it]
 20%|█▉        | 7462/37963 [23:16:34<86:18:01, 10.19s/it]
 20%|█▉        | 7463/37963 [23:16:44<86:08:18, 10.17s/it]
 20%|█▉        | 7464/37963 [23:16:54<84:42:38, 10.00s/it]
 20%|█▉        | 7465/37963 [23:17:03<84:32:33,  9.98s/it]
 20%|█▉        | 7466/37963 [23:17:13<84:06:04,  9.93s/it]
 20%|█▉        | 7467/37963 [23:17:30<100:35:02, 11.87s/it]
 20%|█▉        | 7468/37963 [23:17:40<95:44:15, 11.30s/it] 
 20%|█▉        | 7469/37963 [23:17:50<92:03:20, 10.87s/it]
 20%|█▉        | 7470/37963 [23:18:00<89:59:25, 10.62s/it]
                                                          
{'loss': '0.1805', 'grad_norm': '5.017', 'learning_rate': '1.858e-05', 'epoch': '0.1968'}

 20%|█▉        | 7470/37963 [23:18:00<89:59:25, 10.62s/it]
 20%|█▉        | 7471/37963 [23:18:09<87:05:15, 10.28s/it]
 20%|█▉        | 7472/37963 [23:18:19<86:29:27, 10.21s/it]
 20%|█▉        | 7473/37963 [23:18:29<86:12:05, 10.18s/it]
 20%|█▉        | 7474/37963 [23:18:39<85:58:26, 10.15s/it]
 20%|█▉        | 7475/37963 [23:18:49<85:43:38, 10.12s/it]
 20%|█▉        | 7476/37963 [23:19:06<102:17:37, 12.08s/it]
 20%|█▉        | 7477/37963 [23:19:16<96:57:02, 11.45s/it] 
 20%|█▉        | 7478/37963 [23:19:26<94:02:02, 11.10s/it]
 20%|█▉        | 7479/37963 [23:19:43<107:59:47, 12.75s/it]
 20%|█▉        | 7480/37963 [23:19:53<100:46:20, 11.90s/it]
                                                           
{'loss': '0.1663', 'grad_norm': '1.584', 'learning_rate': '1.857e-05', 'epoch': '0.197'}

 20%|█▉        | 7480/37963 [23:19:53<100:46:20, 11.90s/it]
 20%|█▉        | 7481/37963 [23:20:03<96:05:35, 11.35s/it] 
 20%|█▉        | 7482/37963 [23:20:13<92:53:00, 10.97s/it]
 20%|█▉        | 7483/37963 [23:20:23<90:24:19, 10.68s/it]
 20%|█▉        | 7484/37963 [23:20:33<88:50:31, 10.49s/it]
 20%|█▉        | 7485/37963 [23:20:49<103:00:51, 12.17s/it]
 20%|█▉        | 7486/37963 [23:20:59<97:41:49, 11.54s/it] 
 20%|█▉        | 7487/37963 [23:21:09<92:40:36, 10.95s/it]
 20%|█▉        | 7488/37963 [23:21:19<90:20:30, 10.67s/it]
 20%|█▉        | 7489/37963 [23:21:29<88:03:21, 10.40s/it]
 20%|█▉        | 7490/37963 [23:21:39<87:16:41, 10.31s/it]
                                                          
{'loss': '0.1595', 'grad_norm': '1.269', 'learning_rate': '1.857e-05', 'epoch': '0.1973'}

 20%|█▉        | 7490/37963 [23:21:39<87:16:41, 10.31s/it]
 20%|█▉        | 7491/37963 [23:21:55<102:02:10, 12.05s/it]
 20%|█▉        | 7492/37963 [23:22:05<97:00:56, 11.46s/it] 
 20%|█▉        | 7493/37963 [23:22:15<93:12:30, 11.01s/it]
 20%|█▉        | 7494/37963 [23:22:24<89:47:13, 10.61s/it]
 20%|█▉        | 7495/37963 [23:22:34<88:09:37, 10.42s/it]
 20%|█▉        | 7496/37963 [23:22:51<104:16:37, 12.32s/it]
 20%|█▉        | 7497/37963 [23:23:08<115:15:11, 13.62s/it]
 20%|█▉        | 7498/37963 [23:23:18<106:16:16, 12.56s/it]
 20%|█▉        | 7499/37963 [23:23:28<99:58:17, 11.81s/it] 
 20%|█▉        | 7500/37963 [23:23:38<95:45:28, 11.32s/it]
                                                          
{'loss': '0.1804', 'grad_norm': '1.591', 'learning_rate': '1.856e-05', 'epoch': '0.1976'}

 20%|█▉        | 7500/37963 [23:23:38<95:45:28, 11.32s/it]
 20%|█▉        | 7501/37963 [23:23:55<109:27:43, 12.94s/it]
 20%|█▉        | 7502/37963 [23:24:05<102:19:37, 12.09s/it]
 20%|█▉        | 7503/37963 [23:24:15<96:47:20, 11.44s/it] 
 20%|█▉        | 7504/37963 [23:24:25<92:15:53, 10.90s/it]
 20%|█▉        | 7505/37963 [23:24:35<90:20:52, 10.68s/it]
 20%|█▉        | 7506/37963 [23:24:45<88:56:58, 10.51s/it]
 20%|█▉        | 7507/37963 [23:24:55<88:12:47, 10.43s/it]
 20%|█▉        | 7508/37963 [23:25:05<87:29:37, 10.34s/it]
 20%|█▉        | 7509/37963 [23:25:15<87:02:08, 10.29s/it]
 20%|█▉        | 7510/37963 [23:25:25<86:34:20, 10.23s/it]
                                                          
{'loss': '0.1716', 'grad_norm': '3.628', 'learning_rate': '1.856e-05', 'epoch': '0.1978'}

 20%|█▉        | 7510/37963 [23:25:25<86:34:20, 10.23s/it]
 20%|█▉        | 7511/37963 [23:25:36<86:28:29, 10.22s/it]
 20%|█▉        | 7512/37963 [23:25:46<86:25:48, 10.22s/it]
 20%|█▉        | 7513/37963 [23:25:56<85:59:40, 10.17s/it]
 20%|█▉        | 7514/37963 [23:26:06<86:10:34, 10.19s/it]
 20%|█▉        | 7515/37963 [23:26:23<102:03:48, 12.07s/it]
 20%|█▉        | 7516/37963 [23:26:33<97:07:45, 11.48s/it] 
 20%|█▉        | 7517/37963 [23:26:43<93:49:43, 11.09s/it]
 20%|█▉        | 7518/37963 [23:26:53<91:08:15, 10.78s/it]
 20%|█▉        | 7519/37963 [23:27:03<89:20:58, 10.57s/it]
 20%|█▉        | 7520/37963 [23:27:13<88:14:37, 10.44s/it]
                                                          
{'loss': '0.1556', 'grad_norm': '1.351', 'learning_rate': '1.855e-05', 'epoch': '0.1981'}

 20%|█▉        | 7520/37963 [23:27:13<88:14:37, 10.44s/it]
 20%|█▉        | 7521/37963 [23:27:23<86:26:50, 10.22s/it]
 20%|█▉        | 7522/37963 [23:27:33<86:22:24, 10.21s/it]
 20%|█▉        | 7523/37963 [23:27:43<85:57:05, 10.17s/it]
 20%|█▉        | 7524/37963 [23:27:53<85:40:50, 10.13s/it]
 20%|█▉        | 7525/37963 [23:28:10<103:00:09, 12.18s/it]
 20%|█▉        | 7526/37963 [23:28:26<112:50:18, 13.35s/it]
 20%|█▉        | 7527/37963 [23:28:36<104:28:55, 12.36s/it]
 20%|█▉        | 7528/37963 [23:28:46<97:08:58, 11.49s/it] 
 20%|█▉        | 7529/37963 [23:28:56<93:42:50, 11.09s/it]
 20%|█▉        | 7530/37963 [23:29:06<91:45:53, 10.86s/it]
                                                          
{'loss': '0.1666', 'grad_norm': '2.28', 'learning_rate': '1.855e-05', 'epoch': '0.1984'}

 20%|█▉        | 7530/37963 [23:29:06<91:45:53, 10.86s/it]
 20%|█▉        | 7531/37963 [23:29:16<89:47:05, 10.62s/it]
 20%|█▉        | 7532/37963 [23:29:26<88:06:54, 10.42s/it]
 20%|█▉        | 7533/37963 [23:29:36<86:36:20, 10.25s/it]
 20%|█▉        | 7534/37963 [23:29:52<102:13:44, 12.09s/it]
 20%|█▉        | 7535/37963 [23:30:03<96:57:10, 11.47s/it] 
 20%|█▉        | 7536/37963 [23:30:13<93:29:38, 11.06s/it]
 20%|█▉        | 7537/37963 [23:30:23<91:04:05, 10.78s/it]
 20%|█▉        | 7538/37963 [23:30:33<89:10:22, 10.55s/it]
 20%|█▉        | 7539/37963 [23:30:49<103:28:48, 12.24s/it]
 20%|█▉        | 7540/37963 [23:30:59<97:10:33, 11.50s/it] 
                                                          
{'loss': '0.1714', 'grad_norm': '1.261', 'learning_rate': '1.855e-05', 'epoch': '0.1986'}

 20%|█▉        | 7540/37963 [23:30:59<97:10:33, 11.50s/it]
 20%|█▉        | 7541/37963 [23:31:09<93:39:44, 11.08s/it]
 20%|█▉        | 7542/37963 [23:31:19<91:23:57, 10.82s/it]
 20%|█▉        | 7543/37963 [23:31:29<89:33:53, 10.60s/it]
 20%|█▉        | 7544/37963 [23:31:39<88:06:19, 10.43s/it]
 20%|█▉        | 7545/37963 [23:32:02<119:34:53, 14.15s/it]
 20%|█▉        | 7546/37963 [23:32:12<109:24:51, 12.95s/it]
 20%|█▉        | 7547/37963 [23:32:22<102:22:22, 12.12s/it]
 20%|█▉        | 7548/37963 [23:32:32<97:14:54, 11.51s/it] 
 20%|█▉        | 7549/37963 [23:32:42<93:15:56, 11.04s/it]
 20%|█▉        | 7550/37963 [23:32:52<89:55:46, 10.64s/it]
                                                          
{'loss': '0.1818', 'grad_norm': '2.193', 'learning_rate': '1.854e-05', 'epoch': '0.1989'}

 20%|█▉        | 7550/37963 [23:32:52<89:55:46, 10.64s/it]
 20%|█▉        | 7551/37963 [23:33:02<88:26:25, 10.47s/it]
 20%|█▉        | 7552/37963 [23:33:19<105:17:48, 12.46s/it]
 20%|█▉        | 7553/37963 [23:33:29<99:23:14, 11.77s/it] 
 20%|█▉        | 7554/37963 [23:33:39<95:08:17, 11.26s/it]
 20%|█▉        | 7555/37963 [23:33:50<92:16:32, 10.92s/it]
 20%|█▉        | 7556/37963 [23:34:00<90:22:45, 10.70s/it]
 20%|█▉        | 7557/37963 [23:34:10<88:51:27, 10.52s/it]
 20%|█▉        | 7558/37963 [23:34:19<86:17:48, 10.22s/it]
 20%|█▉        | 7559/37963 [23:34:29<85:57:02, 10.18s/it]
 20%|█▉        | 7560/37963 [23:34:39<84:52:31, 10.05s/it]
                                                          
{'loss': '0.1783', 'grad_norm': '1.4', 'learning_rate': '1.854e-05', 'epoch': '0.1991'}

 20%|█▉        | 7560/37963 [23:34:39<84:52:31, 10.05s/it]
 20%|█▉        | 7561/37963 [23:34:49<84:58:53, 10.06s/it]
 20%|█▉        | 7562/37963 [23:34:59<85:10:08, 10.09s/it]
 20%|█▉        | 7563/37963 [23:35:10<85:08:25, 10.08s/it]
 20%|█▉        | 7564/37963 [23:35:26<101:16:29, 11.99s/it]
 20%|█▉        | 7565/37963 [23:35:36<96:03:37, 11.38s/it] 
 20%|█▉        | 7566/37963 [23:35:46<91:53:15, 10.88s/it]
 20%|█▉        | 7567/37963 [23:35:56<89:49:37, 10.64s/it]
 20%|█▉        | 7568/37963 [23:36:06<88:33:46, 10.49s/it]
 20%|█▉        | 7569/37963 [23:36:16<87:34:05, 10.37s/it]
 20%|█▉        | 7570/37963 [23:36:26<85:59:00, 10.18s/it]
                                                          
{'loss': '0.1786', 'grad_norm': '1.389', 'learning_rate': '1.853e-05', 'epoch': '0.1994'}

 20%|█▉        | 7570/37963 [23:36:26<85:59:00, 10.18s/it]
 20%|█▉        | 7571/37963 [23:36:36<85:46:04, 10.16s/it]
 20%|█▉        | 7572/37963 [23:36:46<85:37:17, 10.14s/it]
 20%|█▉        | 7573/37963 [23:37:03<103:20:12, 12.24s/it]
 20%|█▉        | 7574/37963 [23:37:20<114:18:07, 13.54s/it]
 20%|█▉        | 7575/37963 [23:37:30<105:42:17, 12.52s/it]
 20%|█▉        | 7576/37963 [23:37:40<99:40:46, 11.81s/it] 
 20%|█▉        | 7577/37963 [23:37:50<95:12:39, 11.28s/it]
 20%|█▉        | 7578/37963 [23:38:00<91:49:56, 10.88s/it]
 20%|█▉        | 7579/37963 [23:38:10<89:46:41, 10.64s/it]
 20%|█▉        | 7580/37963 [23:38:26<103:55:55, 12.31s/it]
                                                           
{'loss': '0.1665', 'grad_norm': '1.277', 'learning_rate': '1.853e-05', 'epoch': '0.1997'}

 20%|█▉        | 7580/37963 [23:38:26<103:55:55, 12.31s/it]
 20%|█▉        | 7581/37963 [23:38:36<97:28:24, 11.55s/it] 
 20%|█▉        | 7582/37963 [23:38:46<93:36:50, 11.09s/it]
 20%|█▉        | 7583/37963 [23:38:56<90:57:42, 10.78s/it]
 20%|█▉        | 7584/37963 [23:39:06<89:09:22, 10.57s/it]
 20%|█▉        | 7585/37963 [23:39:16<87:50:43, 10.41s/it]
 20%|█▉        | 7586/37963 [23:39:32<102:45:25, 12.18s/it]
 20%|█▉        | 7587/37963 [23:39:42<97:17:51, 11.53s/it] 
 20%|█▉        | 7588/37963 [23:39:53<93:43:07, 11.11s/it]
 20%|█▉        | 7589/37963 [23:40:03<91:10:41, 10.81s/it]
 20%|█▉        | 7590/37963 [23:40:12<88:21:41, 10.47s/it]
                                                          
{'loss': '0.1717', 'grad_norm': '1.253', 'learning_rate': '1.852e-05', 'epoch': '0.1999'}

 20%|█▉        | 7590/37963 [23:40:12<88:21:41, 10.47s/it]
 20%|█▉        | 7591/37963 [23:40:23<87:40:03, 10.39s/it]
 20%|█▉        | 7592/37963 [23:40:39<103:20:20, 12.25s/it]
 20%|██        | 7593/37963 [23:40:49<97:27:30, 11.55s/it] 
 20%|██        | 7594/37963 [23:41:05<109:41:45, 13.00s/it]
 20%|██        | 7595/37963 [23:41:16<102:15:36, 12.12s/it]
 20%|██        | 7596/37963 [23:41:26<96:56:28, 11.49s/it] 
 20%|██        | 7597/37963 [23:41:36<93:27:55, 11.08s/it]
 20%|██        | 7598/37963 [23:41:46<91:17:21, 10.82s/it]
 20%|██        | 7599/37963 [23:41:56<89:18:57, 10.59s/it]
 20%|██        | 7600/37963 [23:42:06<88:08:04, 10.45s/it]
                                                          
{'loss': '0.165', 'grad_norm': '0.8074', 'learning_rate': '1.852e-05', 'epoch': '0.2002'}

 20%|██        | 7600/37963 [23:42:06<88:08:04, 10.45s/it]
 20%|██        | 7601/37963 [23:42:16<87:01:05, 10.32s/it]
 20%|██        | 7602/37963 [23:42:33<103:36:43, 12.29s/it]
 20%|██        | 7603/37963 [23:42:43<98:03:27, 11.63s/it] 
 20%|██        | 7604/37963 [23:42:53<93:21:57, 11.07s/it]
 20%|██        | 7605/37963 [23:43:03<90:53:23, 10.78s/it]
 20%|██        | 7606/37963 [23:43:13<89:00:25, 10.56s/it]
 20%|██        | 7607/37963 [23:43:23<87:51:56, 10.42s/it]
 20%|██        | 7608/37963 [23:43:33<87:04:30, 10.33s/it]
 20%|██        | 7609/37963 [23:43:43<86:33:45, 10.27s/it]
 20%|██        | 7610/37963 [23:43:53<86:05:55, 10.21s/it]
                                                          
{'loss': '0.1862', 'grad_norm': '1.842', 'learning_rate': '1.851e-05', 'epoch': '0.2005'}

 20%|██        | 7610/37963 [23:43:53<86:05:55, 10.21s/it]
 20%|██        | 7611/37963 [23:44:04<86:05:00, 10.21s/it]
 20%|██        | 7612/37963 [23:44:13<85:01:19, 10.08s/it]
 20%|██        | 7613/37963 [23:44:30<101:48:50, 12.08s/it]
 20%|██        | 7614/37963 [23:44:40<96:41:35, 11.47s/it] 
 20%|██        | 7615/37963 [23:44:50<93:14:14, 11.06s/it]
 20%|██        | 7616/37963 [23:45:00<90:53:07, 10.78s/it]
 20%|██        | 7617/37963 [23:45:11<89:14:26, 10.59s/it]
 20%|██        | 7618/37963 [23:45:20<87:36:35, 10.39s/it]
 20%|██        | 7619/37963 [23:45:30<86:18:55, 10.24s/it]
 20%|██        | 7620/37963 [23:45:47<103:41:16, 12.30s/it]
                                                           
{'loss': '0.1764', 'grad_norm': '1.624', 'learning_rate': '1.851e-05', 'epoch': '0.2007'}

 20%|██        | 7620/37963 [23:45:47<103:41:16, 12.30s/it]
 20%|██        | 7621/37963 [23:45:58<98:03:31, 11.63s/it] 
 20%|██        | 7622/37963 [23:46:08<93:51:51, 11.14s/it]
 20%|██        | 7623/37963 [23:46:18<91:03:51, 10.81s/it]
 20%|██        | 7624/37963 [23:46:34<105:59:32, 12.58s/it]
 20%|██        | 7625/37963 [23:46:45<100:09:00, 11.88s/it]
 20%|██        | 7626/37963 [23:46:55<95:27:51, 11.33s/it] 
 20%|██        | 7627/37963 [23:47:05<92:19:42, 10.96s/it]
 20%|██        | 7628/37963 [23:47:21<105:51:40, 12.56s/it]
 20%|██        | 7629/37963 [23:47:31<99:45:04, 11.84s/it] 
 20%|██        | 7630/37963 [23:47:41<95:17:18, 11.31s/it]
                                                          
{'loss': '0.1663', 'grad_norm': '5.774', 'learning_rate': '1.851e-05', 'epoch': '0.201'}

 20%|██        | 7630/37963 [23:47:41<95:17:18, 11.31s/it]
 20%|██        | 7631/37963 [23:47:51<92:11:30, 10.94s/it]
 20%|██        | 7632/37963 [23:48:02<90:21:18, 10.72s/it]
 20%|██        | 7633/37963 [23:48:12<88:42:53, 10.53s/it]
 20%|██        | 7634/37963 [23:48:22<87:28:44, 10.38s/it]
 20%|██        | 7635/37963 [23:48:38<103:13:39, 12.25s/it]
 20%|██        | 7636/37963 [23:48:48<97:53:10, 11.62s/it] 
 20%|██        | 7637/37963 [23:48:58<94:03:53, 11.17s/it]
 20%|██        | 7638/37963 [23:49:09<91:12:18, 10.83s/it]
 20%|██        | 7639/37963 [23:49:19<89:31:09, 10.63s/it]
 20%|██        | 7640/37963 [23:49:29<88:16:08, 10.48s/it]
                                                          
{'loss': '0.166', 'grad_norm': '3.363', 'learning_rate': '1.85e-05', 'epoch': '0.2012'}

 20%|██        | 7640/37963 [23:49:29<88:16:08, 10.48s/it]
 20%|██        | 7641/37963 [23:49:45<103:38:58, 12.31s/it]
 20%|██        | 7642/37963 [23:50:02<114:57:39, 13.65s/it]
 20%|██        | 7643/37963 [23:50:12<106:05:07, 12.60s/it]
 20%|██        | 7644/37963 [23:50:22<99:47:06, 11.85s/it] 
 20%|██        | 7645/37963 [23:50:32<95:19:51, 11.32s/it]
 20%|██        | 7646/37963 [23:50:43<92:06:28, 10.94s/it]
 20%|██        | 7647/37963 [23:50:53<89:58:23, 10.68s/it]
 20%|██        | 7648/37963 [23:51:03<88:44:57, 10.54s/it]
 20%|██        | 7649/37963 [23:51:19<104:12:31, 12.38s/it]
 20%|██        | 7650/37963 [23:51:30<98:15:24, 11.67s/it] 
                                                          
{'loss': '0.167', 'grad_norm': '1.928', 'learning_rate': '1.85e-05', 'epoch': '0.2015'}

 20%|██        | 7650/37963 [23:51:30<98:15:24, 11.67s/it]
 20%|██        | 7651/37963 [23:51:40<94:06:30, 11.18s/it]
 20%|██        | 7652/37963 [23:51:50<91:27:30, 10.86s/it]
 20%|██        | 7653/37963 [23:51:59<88:29:54, 10.51s/it]
 20%|██        | 7654/37963 [23:52:09<87:30:39, 10.39s/it]
 20%|██        | 7655/37963 [23:52:20<86:50:41, 10.32s/it]
 20%|██        | 7656/37963 [23:52:29<85:36:59, 10.17s/it]
 20%|██        | 7657/37963 [23:52:40<85:36:49, 10.17s/it]
 20%|██        | 7658/37963 [23:52:50<85:34:30, 10.17s/it]
 20%|██        | 7659/37963 [23:53:00<84:35:42, 10.05s/it]
 20%|██        | 7660/37963 [23:53:09<84:11:51, 10.00s/it]
                                                          
{'loss': '0.1753', 'grad_norm': '1.716', 'learning_rate': '1.849e-05', 'epoch': '0.2018'}

 20%|██        | 7660/37963 [23:53:09<84:11:51, 10.00s/it]
 20%|██        | 7661/37963 [23:53:26<100:16:58, 11.91s/it]
 20%|██        | 7662/37963 [23:53:36<95:33:52, 11.35s/it] 
 20%|██        | 7663/37963 [23:53:45<90:58:19, 10.81s/it]
 20%|██        | 7664/37963 [23:53:55<88:48:55, 10.55s/it]
 20%|██        | 7665/37963 [23:54:05<87:34:38, 10.41s/it]
 20%|██        | 7666/37963 [23:54:15<86:14:48, 10.25s/it]
 20%|██        | 7667/37963 [23:54:32<103:01:34, 12.24s/it]
 20%|██        | 7668/37963 [23:54:42<97:36:58, 11.60s/it] 
 20%|██        | 7669/37963 [23:54:53<94:05:32, 11.18s/it]
 20%|██        | 7670/37963 [23:55:02<90:34:09, 10.76s/it]
                                                          
{'loss': '0.1665', 'grad_norm': '1.773', 'learning_rate': '1.849e-05', 'epoch': '0.202'}

 20%|██        | 7670/37963 [23:55:02<90:34:09, 10.76s/it]
 20%|██        | 7671/37963 [23:55:12<89:01:50, 10.58s/it]
 20%|██        | 7672/37963 [23:55:29<104:18:26, 12.40s/it]
 20%|██        | 7673/37963 [23:55:39<98:05:13, 11.66s/it] 
 20%|██        | 7674/37963 [23:55:49<93:32:34, 11.12s/it]
 20%|██        | 7675/37963 [23:55:58<89:34:00, 10.65s/it]
 20%|██        | 7676/37963 [23:56:15<104:12:26, 12.39s/it]
 20%|██        | 7677/37963 [23:56:25<97:58:27, 11.65s/it] 
 20%|██        | 7678/37963 [23:56:35<94:13:22, 11.20s/it]
 20%|██        | 7679/37963 [23:56:45<91:33:41, 10.88s/it]
 20%|██        | 7680/37963 [23:57:01<104:04:00, 12.37s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '0.9272', 'learning_rate': '1.848e-05', 'epoch': '0.2023'}

 20%|██        | 7680/37963 [23:57:01<104:04:00, 12.37s/it]
 20%|██        | 7681/37963 [23:57:11<98:30:18, 11.71s/it] 
 20%|██        | 7682/37963 [23:57:21<94:42:12, 11.26s/it]
 20%|██        | 7683/37963 [23:57:31<91:21:48, 10.86s/it]
 20%|██        | 7684/37963 [23:57:41<89:22:09, 10.63s/it]
 20%|██        | 7685/37963 [23:57:51<88:10:48, 10.48s/it]
 20%|██        | 7686/37963 [23:58:01<86:36:09, 10.30s/it]
 20%|██        | 7687/37963 [23:58:11<85:39:23, 10.19s/it]
 20%|██        | 7688/37963 [23:58:21<85:33:42, 10.17s/it]
 20%|██        | 7689/37963 [23:58:38<101:29:05, 12.07s/it]
 20%|██        | 7690/37963 [23:58:54<112:16:31, 13.35s/it]
                                                           
{'loss': '0.1742', 'grad_norm': '0.8454', 'learning_rate': '1.848e-05', 'epoch': '0.2026'}

 20%|██        | 7690/37963 [23:58:54<112:16:31, 13.35s/it]
 20%|██        | 7691/37963 [23:59:04<103:47:15, 12.34s/it]
 20%|██        | 7692/37963 [23:59:14<98:20:33, 11.70s/it] 
 20%|██        | 7693/37963 [23:59:25<94:17:50, 11.21s/it]
 20%|██        | 7694/37963 [23:59:35<91:33:21, 10.89s/it]
 20%|██        | 7695/37963 [23:59:45<89:48:25, 10.68s/it]
 20%|██        | 7696/37963 [23:59:55<88:16:10, 10.50s/it]
 20%|██        | 7697/37963 [24:00:05<87:06:47, 10.36s/it]
 20%|██        | 7698/37963 [24:00:15<86:27:01, 10.28s/it]
 20%|██        | 7699/37963 [24:00:32<102:57:04, 12.25s/it]
 20%|██        | 7700/37963 [24:00:42<97:27:32, 11.59s/it] 
                                                          
{'loss': '0.1706', 'grad_norm': '0.9777', 'learning_rate': '1.847e-05', 'epoch': '0.2028'}

 20%|██        | 7700/37963 [24:00:42<97:27:32, 11.59s/it]
 20%|██        | 7701/37963 [24:00:52<93:10:44, 11.08s/it]
 20%|██        | 7702/37963 [24:01:02<90:47:47, 10.80s/it]
 20%|██        | 7703/37963 [24:01:12<89:07:15, 10.60s/it]
 20%|██        | 7704/37963 [24:01:22<87:57:20, 10.46s/it]
 20%|██        | 7705/37963 [24:01:32<86:12:43, 10.26s/it]
 20%|██        | 7706/37963 [24:01:42<85:47:57, 10.21s/it]
 20%|██        | 7707/37963 [24:01:52<85:19:16, 10.15s/it]
 20%|██        | 7708/37963 [24:02:08<100:34:18, 11.97s/it]
 20%|██        | 7709/37963 [24:02:18<95:19:05, 11.34s/it] 
 20%|██        | 7710/37963 [24:02:28<92:02:55, 10.95s/it]
                                                          
{'loss': '0.1797', 'grad_norm': '4.17', 'learning_rate': '1.847e-05', 'epoch': '0.2031'}

 20%|██        | 7710/37963 [24:02:28<92:02:55, 10.95s/it]
 20%|██        | 7711/37963 [24:02:38<89:18:21, 10.63s/it]
 20%|██        | 7712/37963 [24:02:48<88:07:02, 10.49s/it]
 20%|██        | 7713/37963 [24:02:58<87:02:40, 10.36s/it]
 20%|██        | 7714/37963 [24:03:09<86:38:46, 10.31s/it]
 20%|██        | 7715/37963 [24:03:19<86:14:37, 10.26s/it]
 20%|██        | 7716/37963 [24:03:36<103:33:49, 12.33s/it]
 20%|██        | 7717/37963 [24:03:46<96:51:45, 11.53s/it] 
 20%|██        | 7718/37963 [24:03:56<93:06:00, 11.08s/it]
 20%|██        | 7719/37963 [24:04:06<90:33:09, 10.78s/it]
 20%|██        | 7720/37963 [24:04:16<88:47:03, 10.57s/it]
                                                          
{'loss': '0.1653', 'grad_norm': '2.155', 'learning_rate': '1.847e-05', 'epoch': '0.2034'}

 20%|██        | 7720/37963 [24:04:16<88:47:03, 10.57s/it]
 20%|██        | 7721/37963 [24:04:32<102:42:04, 12.23s/it]
 20%|██        | 7722/37963 [24:04:42<97:11:13, 11.57s/it] 
 20%|██        | 7723/37963 [24:04:52<93:38:57, 11.15s/it]
 20%|██        | 7724/37963 [24:05:02<90:26:39, 10.77s/it]
 20%|██        | 7725/37963 [24:05:18<104:49:19, 12.48s/it]
 20%|██        | 7726/37963 [24:05:28<98:13:09, 11.69s/it] 
 20%|██        | 7727/37963 [24:05:38<94:10:05, 11.21s/it]
 20%|██        | 7728/37963 [24:05:48<91:33:26, 10.90s/it]
 20%|██        | 7729/37963 [24:06:05<105:40:44, 12.58s/it]
 20%|██        | 7730/37963 [24:06:15<99:22:33, 11.83s/it] 
                                                          
{'loss': '0.1806', 'grad_norm': '1.852', 'learning_rate': '1.846e-05', 'epoch': '0.2036'}

 20%|██        | 7730/37963 [24:06:15<99:22:33, 11.83s/it]
 20%|██        | 7731/37963 [24:06:25<94:54:53, 11.30s/it]
 20%|██        | 7732/37963 [24:06:35<91:38:11, 10.91s/it]
 20%|██        | 7733/37963 [24:06:45<89:34:06, 10.67s/it]
 20%|██        | 7734/37963 [24:06:55<88:08:44, 10.50s/it]
 20%|██        | 7735/37963 [24:07:05<86:52:16, 10.35s/it]
 20%|██        | 7736/37963 [24:07:15<86:07:45, 10.26s/it]
 20%|██        | 7737/37963 [24:07:32<101:37:42, 12.10s/it]
 20%|██        | 7738/37963 [24:07:42<96:38:45, 11.51s/it] 
 20%|██        | 7739/37963 [24:07:58<108:46:17, 12.96s/it]
 20%|██        | 7740/37963 [24:08:08<101:45:28, 12.12s/it]
                                                           
{'loss': '0.1774', 'grad_norm': '1.906', 'learning_rate': '1.846e-05', 'epoch': '0.2039'}

 20%|██        | 7740/37963 [24:08:08<101:45:28, 12.12s/it]
 20%|██        | 7741/37963 [24:08:18<95:47:25, 11.41s/it] 
 20%|██        | 7742/37963 [24:08:28<92:28:19, 11.02s/it]
 20%|██        | 7743/37963 [24:08:38<89:39:16, 10.68s/it]
 20%|██        | 7744/37963 [24:08:48<87:43:36, 10.45s/it]
 20%|██        | 7745/37963 [24:08:58<86:13:03, 10.27s/it]
 20%|██        | 7746/37963 [24:09:08<85:48:05, 10.22s/it]
 20%|██        | 7747/37963 [24:09:18<84:57:42, 10.12s/it]
 20%|██        | 7748/37963 [24:09:28<85:01:48, 10.13s/it]
 20%|██        | 7749/37963 [24:09:45<102:43:39, 12.24s/it]
 20%|██        | 7750/37963 [24:09:55<97:14:50, 11.59s/it] 
                                                          
{'loss': '0.1659', 'grad_norm': '3.481', 'learning_rate': '1.845e-05', 'epoch': '0.2041'}

 20%|██        | 7750/37963 [24:09:55<97:14:50, 11.59s/it]
 20%|██        | 7751/37963 [24:10:05<93:30:19, 11.14s/it]
 20%|██        | 7752/37963 [24:10:15<90:05:28, 10.74s/it]
 20%|██        | 7753/37963 [24:10:25<88:32:08, 10.55s/it]
 20%|██        | 7754/37963 [24:10:35<87:12:46, 10.39s/it]
 20%|██        | 7755/37963 [24:10:51<100:22:14, 11.96s/it]
 20%|██        | 7756/37963 [24:11:01<95:06:45, 11.34s/it] 
 20%|██        | 7757/37963 [24:11:11<91:59:41, 10.96s/it]
 20%|██        | 7758/37963 [24:11:21<89:48:07, 10.70s/it]
 20%|██        | 7759/37963 [24:11:31<88:09:50, 10.51s/it]
 20%|██        | 7760/37963 [24:11:41<87:05:37, 10.38s/it]
                                                          
{'loss': '0.1713', 'grad_norm': '1.905', 'learning_rate': '1.845e-05', 'epoch': '0.2044'}

 20%|██        | 7760/37963 [24:11:41<87:05:37, 10.38s/it]
 20%|██        | 7761/37963 [24:11:51<86:25:32, 10.30s/it]
 20%|██        | 7762/37963 [24:12:01<85:58:16, 10.25s/it]
 20%|██        | 7763/37963 [24:12:11<85:25:57, 10.18s/it]
 20%|██        | 7764/37963 [24:12:28<100:56:41, 12.03s/it]
 20%|██        | 7765/37963 [24:12:38<96:03:43, 11.45s/it] 
 20%|██        | 7766/37963 [24:12:48<92:47:48, 11.06s/it]
 20%|██        | 7767/37963 [24:12:58<90:30:28, 10.79s/it]
 20%|██        | 7768/37963 [24:13:08<87:48:59, 10.47s/it]
 20%|██        | 7769/37963 [24:13:24<103:07:31, 12.30s/it]
 20%|██        | 7770/37963 [24:13:35<97:24:19, 11.61s/it] 
                                                          
{'loss': '0.1689', 'grad_norm': '2.646', 'learning_rate': '1.844e-05', 'epoch': '0.2047'}

 20%|██        | 7770/37963 [24:13:35<97:24:19, 11.61s/it]
 20%|██        | 7771/37963 [24:13:45<93:45:33, 11.18s/it]
 20%|██        | 7772/37963 [24:13:54<90:05:10, 10.74s/it]
 20%|██        | 7773/37963 [24:14:04<88:15:05, 10.52s/it]
 20%|██        | 7774/37963 [24:14:21<104:00:18, 12.40s/it]
 20%|██        | 7775/37963 [24:14:31<98:10:45, 11.71s/it] 
 20%|██        | 7776/37963 [24:14:41<93:48:14, 11.19s/it]
 20%|██        | 7777/37963 [24:14:51<91:13:13, 10.88s/it]
 20%|██        | 7778/37963 [24:15:08<104:50:34, 12.50s/it]
 20%|██        | 7779/37963 [24:15:18<98:51:14, 11.79s/it] 
 20%|██        | 7780/37963 [24:15:28<94:24:50, 11.26s/it]
                                                          
{'loss': '0.182', 'grad_norm': '2.28', 'learning_rate': '1.844e-05', 'epoch': '0.2049'}

 20%|██        | 7780/37963 [24:15:28<94:24:50, 11.26s/it]
 20%|██        | 7781/37963 [24:15:38<91:07:12, 10.87s/it]
 20%|██        | 7782/37963 [24:15:48<89:06:21, 10.63s/it]
 21%|██        | 7783/37963 [24:15:58<87:56:16, 10.49s/it]
 21%|██        | 7784/37963 [24:16:08<86:38:27, 10.34s/it]
 21%|██        | 7785/37963 [24:16:25<102:25:20, 12.22s/it]
 21%|██        | 7786/37963 [24:16:41<113:15:51, 13.51s/it]
 21%|██        | 7787/37963 [24:16:51<104:25:19, 12.46s/it]
 21%|██        | 7788/37963 [24:17:01<97:23:45, 11.62s/it] 
 21%|██        | 7789/37963 [24:17:11<92:51:24, 11.08s/it]
 21%|██        | 7790/37963 [24:17:20<89:33:49, 10.69s/it]
                                                          
{'loss': '0.1746', 'grad_norm': '1.572', 'learning_rate': '1.843e-05', 'epoch': '0.2052'}

 21%|██        | 7790/37963 [24:17:20<89:33:49, 10.69s/it]
 21%|██        | 7791/37963 [24:17:30<87:48:47, 10.48s/it]
 21%|██        | 7792/37963 [24:17:40<86:16:15, 10.29s/it]
 21%|██        | 7793/37963 [24:17:50<85:51:00, 10.24s/it]
 21%|██        | 7794/37963 [24:18:01<85:38:22, 10.22s/it]
 21%|██        | 7795/37963 [24:18:11<85:23:47, 10.19s/it]
 21%|██        | 7796/37963 [24:18:21<84:38:36, 10.10s/it]
 21%|██        | 7797/37963 [24:18:31<84:48:51, 10.12s/it]
 21%|██        | 7798/37963 [24:18:48<102:03:04, 12.18s/it]
 21%|██        | 7799/37963 [24:18:58<96:51:52, 11.56s/it] 
 21%|██        | 7800/37963 [24:19:08<93:06:57, 11.11s/it]
                                                          
{'loss': '0.175', 'grad_norm': '3.645', 'learning_rate': '1.843e-05', 'epoch': '0.2055'}

 21%|██        | 7800/37963 [24:19:08<93:06:57, 11.11s/it]
 21%|██        | 7801/37963 [24:19:18<90:25:27, 10.79s/it]
 21%|██        | 7802/37963 [24:19:28<88:31:32, 10.57s/it]
 21%|██        | 7803/37963 [24:19:45<103:29:09, 12.35s/it]
 21%|██        | 7804/37963 [24:19:55<97:47:57, 11.67s/it] 
 21%|██        | 7805/37963 [24:20:05<94:03:15, 11.23s/it]
 21%|██        | 7806/37963 [24:20:15<90:21:32, 10.79s/it]
 21%|██        | 7807/37963 [24:20:25<88:40:31, 10.59s/it]
 21%|██        | 7808/37963 [24:20:35<87:38:50, 10.46s/it]
 21%|██        | 7809/37963 [24:20:45<85:51:58, 10.25s/it]
 21%|██        | 7810/37963 [24:20:55<85:00:05, 10.15s/it]
                                                          
{'loss': '0.1704', 'grad_norm': '5.806', 'learning_rate': '1.842e-05', 'epoch': '0.2057'}

 21%|██        | 7810/37963 [24:20:55<85:00:05, 10.15s/it]
 21%|██        | 7811/37963 [24:21:05<85:10:50, 10.17s/it]
 21%|██        | 7812/37963 [24:21:15<85:06:11, 10.16s/it]
 21%|██        | 7813/37963 [24:21:25<84:49:21, 10.13s/it]
 21%|██        | 7814/37963 [24:21:42<102:21:26, 12.22s/it]
 21%|██        | 7815/37963 [24:21:52<95:59:05, 11.46s/it] 
 21%|██        | 7816/37963 [24:22:02<92:29:46, 11.05s/it]
 21%|██        | 7817/37963 [24:22:18<105:33:35, 12.61s/it]
 21%|██        | 7818/37963 [24:22:28<99:44:53, 11.91s/it] 
 21%|██        | 7819/37963 [24:22:38<94:48:54, 11.32s/it]
 21%|██        | 7820/37963 [24:22:48<91:30:04, 10.93s/it]
                                                          
{'loss': '0.1684', 'grad_norm': '3.414', 'learning_rate': '1.842e-05', 'epoch': '0.206'}

 21%|██        | 7820/37963 [24:22:48<91:30:04, 10.93s/it]
 21%|██        | 7821/37963 [24:23:05<106:12:15, 12.68s/it]
 21%|██        | 7822/37963 [24:23:15<99:41:56, 11.91s/it] 
 21%|██        | 7823/37963 [24:23:25<95:11:04, 11.37s/it]
 21%|██        | 7824/37963 [24:23:36<92:27:46, 11.04s/it]
 21%|██        | 7825/37963 [24:23:46<89:58:51, 10.75s/it]
 21%|██        | 7826/37963 [24:24:02<104:59:17, 12.54s/it]
 21%|██        | 7827/37963 [24:24:12<97:49:10, 11.69s/it] 
 21%|██        | 7828/37963 [24:24:22<93:16:15, 11.14s/it]
 21%|██        | 7829/37963 [24:24:32<90:31:55, 10.82s/it]
 21%|██        | 7830/37963 [24:24:42<88:43:15, 10.60s/it]
                                                          
{'loss': '0.1775', 'grad_norm': '1.309', 'learning_rate': '1.841e-05', 'epoch': '0.2063'}

 21%|██        | 7830/37963 [24:24:42<88:43:15, 10.60s/it]
 21%|██        | 7831/37963 [24:24:58<102:29:04, 12.24s/it]
 21%|██        | 7832/37963 [24:25:08<97:03:45, 11.60s/it] 
 21%|██        | 7833/37963 [24:25:18<93:26:05, 11.16s/it]
 21%|██        | 7834/37963 [24:25:35<106:20:23, 12.71s/it]
 21%|██        | 7835/37963 [24:25:45<100:02:06, 11.95s/it]
 21%|██        | 7836/37963 [24:25:55<95:33:00, 11.42s/it] 
 21%|██        | 7837/37963 [24:26:05<92:28:32, 11.05s/it]
 21%|██        | 7838/37963 [24:26:15<90:19:47, 10.79s/it]
 21%|██        | 7839/37963 [24:26:25<88:27:28, 10.57s/it]
 21%|██        | 7840/37963 [24:26:36<87:22:35, 10.44s/it]
                                                          
{'loss': '0.1641', 'grad_norm': '5.771', 'learning_rate': '1.841e-05', 'epoch': '0.2065'}

 21%|██        | 7840/37963 [24:26:36<87:22:35, 10.44s/it]
 21%|██        | 7841/37963 [24:26:46<86:46:11, 10.37s/it]
 21%|██        | 7842/37963 [24:26:56<86:12:28, 10.30s/it]
 21%|██        | 7843/37963 [24:27:06<85:52:02, 10.26s/it]
 21%|██        | 7844/37963 [24:27:16<85:27:01, 10.21s/it]
 21%|██        | 7845/37963 [24:27:26<85:16:03, 10.19s/it]
 21%|██        | 7846/37963 [24:27:36<85:01:53, 10.16s/it]
 21%|██        | 7847/37963 [24:27:47<85:00:38, 10.16s/it]
 21%|██        | 7848/37963 [24:28:04<102:24:51, 12.24s/it]
 21%|██        | 7849/37963 [24:28:13<96:09:35, 11.50s/it] 
 21%|██        | 7850/37963 [24:28:23<92:07:37, 11.01s/it]
                                                          
{'loss': '0.1713', 'grad_norm': '2.163', 'learning_rate': '1.841e-05', 'epoch': '0.2068'}

 21%|██        | 7850/37963 [24:28:23<92:07:37, 11.01s/it]
 21%|██        | 7851/37963 [24:28:34<89:57:39, 10.76s/it]
 21%|██        | 7852/37963 [24:28:50<104:30:18, 12.49s/it]
 21%|██        | 7853/37963 [24:29:00<98:31:57, 11.78s/it] 
 21%|██        | 7854/37963 [24:29:10<94:16:05, 11.27s/it]
 21%|██        | 7855/37963 [24:29:20<90:44:56, 10.85s/it]
 21%|██        | 7856/37963 [24:29:30<88:56:20, 10.63s/it]
 21%|██        | 7857/37963 [24:29:40<87:27:28, 10.46s/it]
 21%|██        | 7858/37963 [24:29:50<86:25:32, 10.33s/it]
 21%|██        | 7859/37963 [24:30:00<85:43:27, 10.25s/it]
 21%|██        | 7860/37963 [24:30:11<85:19:01, 10.20s/it]
                                                          
{'loss': '0.1786', 'grad_norm': '1.616', 'learning_rate': '1.84e-05', 'epoch': '0.207'}

 21%|██        | 7860/37963 [24:30:11<85:19:01, 10.20s/it]
 21%|██        | 7861/37963 [24:30:21<85:08:15, 10.18s/it]
 21%|██        | 7862/37963 [24:30:31<84:31:18, 10.11s/it]
 21%|██        | 7863/37963 [24:30:48<102:01:40, 12.20s/it]
 21%|██        | 7864/37963 [24:30:58<96:48:12, 11.58s/it] 
 21%|██        | 7865/37963 [24:31:08<92:59:01, 11.12s/it]
 21%|██        | 7866/37963 [24:31:18<89:29:46, 10.70s/it]
 21%|██        | 7867/37963 [24:31:34<103:52:23, 12.43s/it]
 21%|██        | 7868/37963 [24:31:44<98:03:01, 11.73s/it] 
 21%|██        | 7869/37963 [24:31:54<94:07:59, 11.26s/it]
 21%|██        | 7870/37963 [24:32:11<106:39:56, 12.76s/it]
                                                           
{'loss': '0.1678', 'grad_norm': '2.67', 'learning_rate': '1.84e-05', 'epoch': '0.2073'}

 21%|██        | 7870/37963 [24:32:11<106:39:56, 12.76s/it]
 21%|██        | 7871/37963 [24:32:21<100:00:46, 11.96s/it]
 21%|██        | 7872/37963 [24:32:31<95:15:23, 11.40s/it] 
 21%|██        | 7873/37963 [24:32:41<92:11:26, 11.03s/it]
 21%|██        | 7874/37963 [24:32:57<105:14:47, 12.59s/it]
 21%|██        | 7875/37963 [24:33:07<98:50:09, 11.83s/it] 
 21%|██        | 7876/37963 [24:33:17<94:19:22, 11.29s/it]
 21%|██        | 7877/37963 [24:33:27<90:35:34, 10.84s/it]
 21%|██        | 7878/37963 [24:33:37<88:57:26, 10.64s/it]
 21%|██        | 7879/37963 [24:33:47<87:46:46, 10.50s/it]
 21%|██        | 7880/37963 [24:33:58<86:51:31, 10.39s/it]
                                                          
{'loss': '0.1754', 'grad_norm': '3.346', 'learning_rate': '1.839e-05', 'epoch': '0.2076'}

 21%|██        | 7880/37963 [24:33:58<86:51:31, 10.39s/it]
 21%|██        | 7881/37963 [24:34:14<100:57:58, 12.08s/it]
 21%|██        | 7882/37963 [24:34:30<112:06:32, 13.42s/it]
 21%|██        | 7883/37963 [24:34:40<104:01:33, 12.45s/it]
 21%|██        | 7884/37963 [24:34:50<97:35:39, 11.68s/it] 
 21%|██        | 7885/37963 [24:35:00<93:24:12, 11.18s/it]
 21%|██        | 7886/37963 [24:35:10<90:40:33, 10.85s/it]
 21%|██        | 7887/37963 [24:35:20<88:01:28, 10.54s/it]
 21%|██        | 7888/37963 [24:35:30<86:46:30, 10.39s/it]
 21%|██        | 7889/37963 [24:35:40<84:44:48, 10.14s/it]
 21%|██        | 7890/37963 [24:35:50<84:34:21, 10.12s/it]
                                                          
{'loss': '0.1666', 'grad_norm': '1.56', 'learning_rate': '1.839e-05', 'epoch': '0.2078'}

 21%|██        | 7890/37963 [24:35:50<84:34:21, 10.12s/it]
 21%|██        | 7891/37963 [24:36:00<84:49:27, 10.15s/it]
 21%|██        | 7892/37963 [24:36:10<83:28:57,  9.99s/it]
 21%|██        | 7893/37963 [24:36:19<82:22:17,  9.86s/it]
 21%|██        | 7894/37963 [24:36:36<100:11:09, 11.99s/it]
 21%|██        | 7895/37963 [24:36:46<95:23:23, 11.42s/it] 
 21%|██        | 7896/37963 [24:36:56<92:05:17, 11.03s/it]
 21%|██        | 7897/37963 [24:37:07<90:02:01, 10.78s/it]
 21%|██        | 7898/37963 [24:37:17<88:20:56, 10.58s/it]
 21%|██        | 7899/37963 [24:37:27<87:15:00, 10.45s/it]
 21%|██        | 7900/37963 [24:37:37<86:41:56, 10.38s/it]
                                                          
{'loss': '0.159', 'grad_norm': '4.665', 'learning_rate': '1.838e-05', 'epoch': '0.2081'}

 21%|██        | 7900/37963 [24:37:37<86:41:56, 10.38s/it]
 21%|██        | 7901/37963 [24:37:47<85:06:57, 10.19s/it]
 21%|██        | 7902/37963 [24:38:03<100:22:36, 12.02s/it]
 21%|██        | 7903/37963 [24:38:13<95:34:48, 11.45s/it] 
 21%|██        | 7904/37963 [24:38:23<92:11:36, 11.04s/it]
 21%|██        | 7905/37963 [24:38:34<90:19:37, 10.82s/it]
 21%|██        | 7906/37963 [24:38:44<88:37:03, 10.61s/it]
 21%|██        | 7907/37963 [24:38:53<86:24:10, 10.35s/it]
 21%|██        | 7908/37963 [24:39:03<85:42:49, 10.27s/it]
 21%|██        | 7909/37963 [24:39:14<85:11:40, 10.20s/it]
 21%|██        | 7910/37963 [24:39:23<83:30:34, 10.00s/it]
                                                          
{'loss': '0.17', 'grad_norm': '2.075', 'learning_rate': '1.838e-05', 'epoch': '0.2084'}

 21%|██        | 7910/37963 [24:39:23<83:30:34, 10.00s/it]
 21%|██        | 7911/37963 [24:39:33<83:48:16, 10.04s/it]
 21%|██        | 7912/37963 [24:39:50<101:24:20, 12.15s/it]
 21%|██        | 7913/37963 [24:40:00<96:11:51, 11.52s/it] 
 21%|██        | 7914/37963 [24:40:10<92:30:14, 11.08s/it]
 21%|██        | 7915/37963 [24:40:27<105:59:10, 12.70s/it]
 21%|██        | 7916/37963 [24:40:37<99:27:01, 11.92s/it] 
 21%|██        | 7917/37963 [24:40:47<94:40:31, 11.34s/it]
 21%|██        | 7918/37963 [24:41:03<106:32:19, 12.77s/it]
 21%|██        | 7919/37963 [24:41:13<99:38:34, 11.94s/it] 
 21%|██        | 7920/37963 [24:41:23<94:58:08, 11.38s/it]
                                                          
{'loss': '0.1611', 'grad_norm': '6.225', 'learning_rate': '1.837e-05', 'epoch': '0.2086'}

 21%|██        | 7920/37963 [24:41:23<94:58:08, 11.38s/it]
 21%|██        | 7921/37963 [24:41:33<91:26:53, 10.96s/it]
 21%|██        | 7922/37963 [24:41:43<88:45:26, 10.64s/it]
 21%|██        | 7923/37963 [24:41:59<102:33:55, 12.29s/it]
 21%|██        | 7924/37963 [24:42:09<97:12:27, 11.65s/it] 
 21%|██        | 7925/37963 [24:42:20<93:44:16, 11.23s/it]
 21%|██        | 7926/37963 [24:42:30<91:06:31, 10.92s/it]
 21%|██        | 7927/37963 [24:42:40<89:05:14, 10.68s/it]
 21%|██        | 7928/37963 [24:42:50<86:42:40, 10.39s/it]
 21%|██        | 7929/37963 [24:43:06<101:44:52, 12.20s/it]
 21%|██        | 7930/37963 [24:43:16<95:51:37, 11.49s/it] 
                                                          
{'loss': '0.1678', 'grad_norm': '4.352', 'learning_rate': '1.837e-05', 'epoch': '0.2089'}

 21%|██        | 7930/37963 [24:43:16<95:51:37, 11.49s/it]
 21%|██        | 7931/37963 [24:43:26<92:21:43, 11.07s/it]
 21%|██        | 7932/37963 [24:43:43<106:28:22, 12.76s/it]
 21%|██        | 7933/37963 [24:43:53<99:18:35, 11.91s/it] 
 21%|██        | 7934/37963 [24:44:03<94:44:14, 11.36s/it]
 21%|██        | 7935/37963 [24:44:12<90:30:29, 10.85s/it]
 21%|██        | 7936/37963 [24:44:22<88:40:55, 10.63s/it]
 21%|██        | 7937/37963 [24:44:33<87:22:30, 10.48s/it]
 21%|██        | 7938/37963 [24:44:42<85:44:12, 10.28s/it]
 21%|██        | 7939/37963 [24:44:52<84:39:31, 10.15s/it]
 21%|██        | 7940/37963 [24:45:02<84:32:55, 10.14s/it]
                                                          
{'loss': '0.1706', 'grad_norm': '2.057', 'learning_rate': '1.836e-05', 'epoch': '0.2092'}

 21%|██        | 7940/37963 [24:45:02<84:32:55, 10.14s/it]
 21%|██        | 7941/37963 [24:45:12<84:22:48, 10.12s/it]
 21%|██        | 7942/37963 [24:45:29<100:41:17, 12.07s/it]
 21%|██        | 7943/37963 [24:45:39<96:00:36, 11.51s/it] 
 21%|██        | 7944/37963 [24:45:49<92:29:42, 11.09s/it]
 21%|██        | 7945/37963 [24:45:59<89:31:06, 10.74s/it]
 21%|██        | 7946/37963 [24:46:09<88:00:42, 10.56s/it]
 21%|██        | 7947/37963 [24:46:19<86:41:34, 10.40s/it]
 21%|██        | 7948/37963 [24:46:29<85:58:08, 10.31s/it]
 21%|██        | 7949/37963 [24:46:40<85:33:10, 10.26s/it]
 21%|██        | 7950/37963 [24:46:50<85:06:21, 10.21s/it]
                                                          
{'loss': '0.1692', 'grad_norm': '5.149', 'learning_rate': '1.836e-05', 'epoch': '0.2094'}

 21%|██        | 7950/37963 [24:46:50<85:06:21, 10.21s/it]
 21%|██        | 7951/37963 [24:47:06<100:31:49, 12.06s/it]
 21%|██        | 7952/37963 [24:47:16<95:27:40, 11.45s/it] 
 21%|██        | 7953/37963 [24:47:26<91:39:51, 11.00s/it]
 21%|██        | 7954/37963 [24:47:36<88:25:59, 10.61s/it]
 21%|██        | 7955/37963 [24:47:46<87:14:22, 10.47s/it]
 21%|██        | 7956/37963 [24:47:56<86:19:46, 10.36s/it]
 21%|██        | 7957/37963 [24:48:06<84:40:49, 10.16s/it]
 21%|██        | 7958/37963 [24:48:16<84:04:11, 10.09s/it]
 21%|██        | 7959/37963 [24:48:26<84:01:47, 10.08s/it]
 21%|██        | 7960/37963 [24:48:43<100:53:00, 12.10s/it]
                                                           
{'loss': '0.1753', 'grad_norm': '0.754', 'learning_rate': '1.835e-05', 'epoch': '0.2097'}

 21%|██        | 7960/37963 [24:48:43<100:53:00, 12.10s/it]
 21%|██        | 7961/37963 [24:48:53<95:40:41, 11.48s/it] 
 21%|██        | 7962/37963 [24:49:03<92:24:04, 11.09s/it]
 21%|██        | 7963/37963 [24:49:19<104:33:58, 12.55s/it]
 21%|██        | 7964/37963 [24:49:29<98:00:52, 11.76s/it] 
 21%|██        | 7965/37963 [24:49:38<93:17:33, 11.20s/it]
 21%|██        | 7966/37963 [24:49:55<107:05:56, 12.85s/it]
 21%|██        | 7967/37963 [24:50:05<100:09:43, 12.02s/it]
 21%|██        | 7968/37963 [24:50:15<95:10:07, 11.42s/it] 
 21%|██        | 7969/37963 [24:50:25<91:13:54, 10.95s/it]
 21%|██        | 7970/37963 [24:50:35<88:36:59, 10.64s/it]
                                                          
{'loss': '0.1582', 'grad_norm': '3.227', 'learning_rate': '1.835e-05', 'epoch': '0.2099'}

 21%|██        | 7970/37963 [24:50:35<88:36:59, 10.64s/it]
 21%|██        | 7971/37963 [24:50:45<86:02:42, 10.33s/it]
 21%|██        | 7972/37963 [24:50:55<85:14:01, 10.23s/it]
 21%|██        | 7973/37963 [24:51:05<84:34:17, 10.15s/it]
 21%|██        | 7974/37963 [24:51:21<99:56:52, 12.00s/it]
 21%|██        | 7975/37963 [24:51:31<95:19:53, 11.44s/it]
 21%|██        | 7976/37963 [24:51:41<91:50:31, 11.03s/it]
 21%|██        | 7977/37963 [24:51:51<89:39:39, 10.76s/it]
 21%|██        | 7978/37963 [24:52:07<102:57:42, 12.36s/it]
 21%|██        | 7979/37963 [24:52:17<96:44:40, 11.62s/it] 
 21%|██        | 7980/37963 [24:52:33<108:05:36, 12.98s/it]
                                                           
{'loss': '0.1676', 'grad_norm': '2.324', 'learning_rate': '1.835e-05', 'epoch': '0.2102'}

 21%|██        | 7980/37963 [24:52:33<108:05:36, 12.98s/it]
 21%|██        | 7981/37963 [24:52:44<101:08:54, 12.15s/it]
 21%|██        | 7982/37963 [24:52:54<96:36:25, 11.60s/it] 
 21%|██        | 7983/37963 [24:53:04<92:53:52, 11.16s/it]
 21%|██        | 7984/37963 [24:53:14<90:19:51, 10.85s/it]
 21%|██        | 7985/37963 [24:53:24<88:32:22, 10.63s/it]
 21%|██        | 7986/37963 [24:53:34<86:55:37, 10.44s/it]
 21%|██        | 7987/37963 [24:53:44<86:13:30, 10.36s/it]
 21%|██        | 7988/37963 [24:53:54<84:51:25, 10.19s/it]
 21%|██        | 7989/37963 [24:54:04<84:44:08, 10.18s/it]
 21%|██        | 7990/37963 [24:54:15<84:48:15, 10.19s/it]
                                                          
{'loss': '0.174', 'grad_norm': '2.079', 'learning_rate': '1.834e-05', 'epoch': '0.2105'}

 21%|██        | 7990/37963 [24:54:15<84:48:15, 10.19s/it]
 21%|██        | 7991/37963 [24:54:25<84:28:29, 10.15s/it]
 21%|██        | 7992/37963 [24:54:41<100:50:33, 12.11s/it]
 21%|██        | 7993/37963 [24:54:51<95:46:38, 11.50s/it] 
 21%|██        | 7994/37963 [24:55:01<92:04:45, 11.06s/it]
 21%|██        | 7995/37963 [24:55:12<89:34:12, 10.76s/it]
 21%|██        | 7996/37963 [24:55:21<86:25:46, 10.38s/it]
 21%|██        | 7997/37963 [24:55:31<84:38:03, 10.17s/it]
 21%|██        | 7998/37963 [24:55:41<84:22:36, 10.14s/it]
 21%|██        | 7999/37963 [24:55:57<100:20:27, 12.06s/it]
 21%|██        | 8000/37963 [24:56:07<95:32:26, 11.48s/it] 
                                                          
{'loss': '0.1812', 'grad_norm': '4.157', 'learning_rate': '1.834e-05', 'epoch': '0.2107'}

 21%|██        | 8000/37963 [24:56:07<95:32:26, 11.48s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.59s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.59s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 21%|██        | 8001/37963 [24:57:08<218:35:53, 26.27s/it]
 21%|██        | 8002/37963 [24:57:18<177:34:45, 21.34s/it]
 21%|██        | 8003/37963 [24:57:28<148:36:02, 17.86s/it]
 21%|██        | 8004/37963 [24:57:39<131:55:44, 15.85s/it]
 21%|██        | 8005/37963 [24:57:56<133:42:04, 16.07s/it]
 21%|██        | 8006/37963 [24:58:06<119:08:10, 14.32s/it]
 21%|██        | 8007/37963 [24:58:16<108:31:31, 13.04s/it]
 21%|██        | 8008/37963 [24:58:26<100:43:34, 12.11s/it]
 21%|██        | 8009/37963 [24:58:42<112:11:55, 13.48s/it]
 21%|██        | 8010/37963 [24:58:52<103:24:49, 12.43s/it]
                                                           
{'loss': '0.1757', 'grad_norm': '0.6622', 'learning_rate': '1.833e-05', 'epoch': '0.211'}

 21%|██        | 8010/37963 [24:58:52<103:24:49, 12.43s/it]
 21%|██        | 8011/37963 [24:59:03<97:42:17, 11.74s/it] 
 21%|██        | 8012/37963 [24:59:12<93:07:48, 11.19s/it]
 21%|██        | 8013/37963 [24:59:29<106:17:58, 12.78s/it]
 21%|██        | 8014/37963 [24:59:39<99:34:06, 11.97s/it] 
 21%|██        | 8015/37963 [24:59:49<95:03:28, 11.43s/it]
 21%|██        | 8016/37963 [24:59:59<92:01:45, 11.06s/it]
 21%|██        | 8017/37963 [25:00:10<89:46:33, 10.79s/it]
 21%|██        | 8018/37963 [25:00:20<87:50:40, 10.56s/it]
 21%|██        | 8019/37963 [25:00:29<86:00:42, 10.34s/it]
 21%|██        | 8020/37963 [25:00:40<85:23:42, 10.27s/it]
                                                          
{'loss': '0.1799', 'grad_norm': '3.095', 'learning_rate': '1.833e-05', 'epoch': '0.2113'}

 21%|██        | 8020/37963 [25:00:40<85:23:42, 10.27s/it]
 21%|██        | 8021/37963 [25:00:50<84:58:26, 10.22s/it]
 21%|██        | 8022/37963 [25:01:06<100:40:04, 12.10s/it]
 21%|██        | 8023/37963 [25:01:16<95:42:34, 11.51s/it] 
 21%|██        | 8024/37963 [25:01:26<92:13:17, 11.09s/it]
 21%|██        | 8025/37963 [25:01:36<89:47:53, 10.80s/it]
 21%|██        | 8026/37963 [25:01:47<88:13:32, 10.61s/it]
 21%|██        | 8027/37963 [25:02:03<102:43:26, 12.35s/it]
 21%|██        | 8028/37963 [25:02:19<112:39:30, 13.55s/it]
 21%|██        | 8029/37963 [25:02:29<103:23:12, 12.43s/it]
 21%|██        | 8030/37963 [25:02:39<97:36:28, 11.74s/it] 
                                                          
{'loss': '0.1901', 'grad_norm': '1.767', 'learning_rate': '1.832e-05', 'epoch': '0.2115'}

 21%|██        | 8030/37963 [25:02:39<97:36:28, 11.74s/it]
 21%|██        | 8031/37963 [25:02:49<93:38:20, 11.26s/it]
 21%|██        | 8032/37963 [25:03:00<91:00:02, 10.95s/it]
 21%|██        | 8033/37963 [25:03:10<88:27:01, 10.64s/it]
 21%|██        | 8034/37963 [25:03:20<86:57:15, 10.46s/it]
 21%|██        | 8035/37963 [25:03:30<86:12:15, 10.37s/it]
 21%|██        | 8036/37963 [25:03:40<85:28:25, 10.28s/it]
 21%|██        | 8037/37963 [25:03:50<84:57:30, 10.22s/it]
 21%|██        | 8038/37963 [25:04:00<84:37:02, 10.18s/it]
 21%|██        | 8039/37963 [25:04:10<82:49:53,  9.97s/it]
 21%|██        | 8040/37963 [25:04:27<101:09:44, 12.17s/it]
                                                           
{'loss': '0.1684', 'grad_norm': '2.791', 'learning_rate': '1.832e-05', 'epoch': '0.2118'}

 21%|██        | 8040/37963 [25:04:27<101:09:44, 12.17s/it]
 21%|██        | 8041/37963 [25:04:37<96:04:34, 11.56s/it] 
 21%|██        | 8042/37963 [25:04:47<92:31:50, 11.13s/it]
 21%|██        | 8043/37963 [25:04:57<88:42:03, 10.67s/it]
 21%|██        | 8044/37963 [25:05:07<87:06:32, 10.48s/it]
 21%|██        | 8045/37963 [25:05:17<85:59:36, 10.35s/it]
 21%|██        | 8046/37963 [25:05:27<85:12:25, 10.25s/it]
 21%|██        | 8047/37963 [25:05:37<84:25:58, 10.16s/it]
 21%|██        | 8048/37963 [25:05:53<100:45:28, 12.13s/it]
 21%|██        | 8049/37963 [25:06:04<95:36:45, 11.51s/it] 
 21%|██        | 8050/37963 [25:06:14<92:24:55, 11.12s/it]
                                                          
{'loss': '0.1731', 'grad_norm': '1.818', 'learning_rate': '1.831e-05', 'epoch': '0.212'}

 21%|██        | 8050/37963 [25:06:14<92:24:55, 11.12s/it]
 21%|██        | 8051/37963 [25:06:24<90:19:28, 10.87s/it]
 21%|██        | 8052/37963 [25:06:34<87:37:35, 10.55s/it]
 21%|██        | 8053/37963 [25:06:44<86:13:24, 10.38s/it]
 21%|██        | 8054/37963 [25:07:01<101:58:04, 12.27s/it]
 21%|██        | 8055/37963 [25:07:10<95:34:40, 11.50s/it] 
 21%|██        | 8056/37963 [25:07:20<91:09:59, 10.97s/it]
 21%|██        | 8057/37963 [25:07:30<89:06:49, 10.73s/it]
 21%|██        | 8058/37963 [25:07:47<103:32:42, 12.46s/it]
 21%|██        | 8059/37963 [25:07:57<97:46:12, 11.77s/it] 
 21%|██        | 8060/37963 [25:08:07<93:22:28, 11.24s/it]
                                                          
{'loss': '0.1609', 'grad_norm': '1.119', 'learning_rate': '1.831e-05', 'epoch': '0.2123'}

 21%|██        | 8060/37963 [25:08:07<93:22:28, 11.24s/it]
 21%|██        | 8061/37963 [25:08:23<106:34:03, 12.83s/it]
 21%|██        | 8062/37963 [25:08:33<99:06:49, 11.93s/it] 
 21%|██        | 8063/37963 [25:08:43<93:36:10, 11.27s/it]
 21%|██        | 8064/37963 [25:08:53<90:41:36, 10.92s/it]
 21%|██        | 8065/37963 [25:09:03<88:33:30, 10.66s/it]
 21%|██        | 8066/37963 [25:09:13<87:04:09, 10.48s/it]
 21%|██        | 8067/37963 [25:09:23<86:05:18, 10.37s/it]
 21%|██▏       | 8068/37963 [25:09:33<85:31:03, 10.30s/it]
 21%|██▏       | 8069/37963 [25:09:43<84:44:42, 10.21s/it]
 21%|██▏       | 8070/37963 [25:09:59<99:08:10, 11.94s/it]
                                                          
{'loss': '0.1529', 'grad_norm': '1.559', 'learning_rate': '1.83e-05', 'epoch': '0.2126'}

 21%|██▏       | 8070/37963 [25:09:59<99:08:10, 11.94s/it]
 21%|██▏       | 8071/37963 [25:10:09<94:18:48, 11.36s/it]
 21%|██▏       | 8072/37963 [25:10:19<91:20:04, 11.00s/it]
 21%|██▏       | 8073/37963 [25:10:30<89:10:54, 10.74s/it]
 21%|██▏       | 8074/37963 [25:10:40<87:25:51, 10.53s/it]
 21%|██▏       | 8075/37963 [25:10:56<102:12:56, 12.31s/it]
 21%|██▏       | 8076/37963 [25:11:13<113:12:25, 13.64s/it]
 21%|██▏       | 8077/37963 [25:11:23<104:09:08, 12.55s/it]
 21%|██▏       | 8078/37963 [25:11:33<97:32:22, 11.75s/it] 
 21%|██▏       | 8079/37963 [25:11:43<93:13:49, 11.23s/it]
 21%|██▏       | 8080/37963 [25:11:53<90:33:37, 10.91s/it]
                                                          
{'loss': '0.1792', 'grad_norm': '0.8829', 'learning_rate': '1.83e-05', 'epoch': '0.2128'}

 21%|██▏       | 8080/37963 [25:11:53<90:33:37, 10.91s/it]
 21%|██▏       | 8081/37963 [25:12:03<88:29:02, 10.66s/it]
 21%|██▏       | 8082/37963 [25:12:13<86:54:09, 10.47s/it]
 21%|██▏       | 8083/37963 [25:12:23<85:22:53, 10.29s/it]
 21%|██▏       | 8084/37963 [25:12:33<85:02:59, 10.25s/it]
 21%|██▏       | 8085/37963 [25:12:43<84:22:16, 10.17s/it]
 21%|██▏       | 8086/37963 [25:12:53<83:32:00, 10.07s/it]
 21%|██▏       | 8087/37963 [25:13:03<83:28:14, 10.06s/it]
 21%|██▏       | 8088/37963 [25:13:20<100:33:57, 12.12s/it]
 21%|██▏       | 8089/37963 [25:13:30<95:26:39, 11.50s/it] 
 21%|██▏       | 8090/37963 [25:13:40<91:47:26, 11.06s/it]
                                                          
{'loss': '0.174', 'grad_norm': '2.098', 'learning_rate': '1.829e-05', 'epoch': '0.2131'}

 21%|██▏       | 8090/37963 [25:13:40<91:47:26, 11.06s/it]
 21%|██▏       | 8091/37963 [25:13:50<89:14:26, 10.75s/it]
 21%|██▏       | 8092/37963 [25:14:00<87:30:50, 10.55s/it]
 21%|██▏       | 8093/37963 [25:14:10<86:34:05, 10.43s/it]
 21%|██▏       | 8094/37963 [25:14:20<85:38:05, 10.32s/it]
 21%|██▏       | 8095/37963 [25:14:30<84:01:12, 10.13s/it]
 21%|██▏       | 8096/37963 [25:14:46<99:39:00, 12.01s/it]
 21%|██▏       | 8097/37963 [25:14:56<94:32:10, 11.40s/it]
 21%|██▏       | 8098/37963 [25:15:06<91:08:05, 10.99s/it]
 21%|██▏       | 8099/37963 [25:15:17<89:06:50, 10.74s/it]
 21%|██▏       | 8100/37963 [25:15:26<86:47:31, 10.46s/it]
                                                          
{'loss': '0.1918', 'grad_norm': '1.072', 'learning_rate': '1.829e-05', 'epoch': '0.2134'}

 21%|██▏       | 8100/37963 [25:15:26<86:47:31, 10.46s/it]
 21%|██▏       | 8101/37963 [25:15:36<85:41:04, 10.33s/it]
 21%|██▏       | 8102/37963 [25:15:53<101:14:25, 12.21s/it]
 21%|██▏       | 8103/37963 [25:16:03<95:14:19, 11.48s/it] 
 21%|██▏       | 8104/37963 [25:16:13<91:57:38, 11.09s/it]
 21%|██▏       | 8105/37963 [25:16:23<89:07:14, 10.75s/it]
 21%|██▏       | 8106/37963 [25:16:33<87:37:50, 10.57s/it]
 21%|██▏       | 8107/37963 [25:16:50<102:28:37, 12.36s/it]
 21%|██▏       | 8108/37963 [25:17:00<96:43:45, 11.66s/it] 
 21%|██▏       | 8109/37963 [25:17:16<109:40:10, 13.22s/it]
 21%|██▏       | 8110/37963 [25:17:26<101:28:19, 12.24s/it]
                                                           
{'loss': '0.1774', 'grad_norm': '3.122', 'learning_rate': '1.828e-05', 'epoch': '0.2136'}

 21%|██▏       | 8110/37963 [25:17:26<101:28:19, 12.24s/it]
 21%|██▏       | 8111/37963 [25:17:36<96:09:00, 11.60s/it] 
 21%|██▏       | 8112/37963 [25:17:47<92:33:13, 11.16s/it]
 21%|██▏       | 8113/37963 [25:17:57<89:47:32, 10.83s/it]
 21%|██▏       | 8114/37963 [25:18:07<87:58:08, 10.61s/it]
 21%|██▏       | 8115/37963 [25:18:17<86:44:25, 10.46s/it]
 21%|██▏       | 8116/37963 [25:18:27<85:50:24, 10.35s/it]
 21%|██▏       | 8117/37963 [25:18:43<100:06:16, 12.07s/it]
 21%|██▏       | 8118/37963 [25:18:53<95:04:02, 11.47s/it] 
 21%|██▏       | 8119/37963 [25:19:03<91:50:44, 11.08s/it]
 21%|██▏       | 8120/37963 [25:19:13<88:48:20, 10.71s/it]
                                                          
{'loss': '0.1549', 'grad_norm': '0.6742', 'learning_rate': '1.828e-05', 'epoch': '0.2139'}

 21%|██▏       | 8120/37963 [25:19:13<88:48:20, 10.71s/it]
 21%|██▏       | 8121/37963 [25:19:23<87:14:01, 10.52s/it]
 21%|██▏       | 8122/37963 [25:19:33<85:14:14, 10.28s/it]
 21%|██▏       | 8123/37963 [25:19:42<83:20:40, 10.05s/it]
 21%|██▏       | 8124/37963 [25:19:59<99:35:25, 12.02s/it]
 21%|██▏       | 8125/37963 [25:20:09<94:27:44, 11.40s/it]
 21%|██▏       | 8126/37963 [25:20:25<106:35:28, 12.86s/it]
 21%|██▏       | 8127/37963 [25:20:35<99:55:09, 12.06s/it] 
 21%|██▏       | 8128/37963 [25:20:46<95:02:41, 11.47s/it]
 21%|██▏       | 8129/37963 [25:20:56<91:52:12, 11.09s/it]
 21%|██▏       | 8130/37963 [25:21:06<89:00:29, 10.74s/it]
                                                          
{'loss': '0.1648', 'grad_norm': '1.307', 'learning_rate': '1.827e-05', 'epoch': '0.2142'}

 21%|██▏       | 8130/37963 [25:21:06<89:00:29, 10.74s/it]
 21%|██▏       | 8131/37963 [25:21:16<87:20:21, 10.54s/it]
 21%|██▏       | 8132/37963 [25:21:26<86:08:28, 10.40s/it]
 21%|██▏       | 8133/37963 [25:21:36<85:36:32, 10.33s/it]
 21%|██▏       | 8134/37963 [25:21:46<83:42:21, 10.10s/it]
 21%|██▏       | 8135/37963 [25:21:55<82:37:38,  9.97s/it]
 21%|██▏       | 8136/37963 [25:22:05<82:59:49, 10.02s/it]
 21%|██▏       | 8137/37963 [25:22:15<83:10:57, 10.04s/it]
 21%|██▏       | 8138/37963 [25:22:33<100:36:48, 12.14s/it]
 21%|██▏       | 8139/37963 [25:22:43<95:30:12, 11.53s/it] 
 21%|██▏       | 8140/37963 [25:22:53<92:06:22, 11.12s/it]
                                                          
{'loss': '0.1805', 'grad_norm': '4.178', 'learning_rate': '1.827e-05', 'epoch': '0.2144'}

 21%|██▏       | 8140/37963 [25:22:53<92:06:22, 11.12s/it]
 21%|██▏       | 8141/37963 [25:23:03<89:47:40, 10.84s/it]
 21%|██▏       | 8142/37963 [25:23:13<88:15:04, 10.65s/it]
 21%|██▏       | 8143/37963 [25:23:29<101:45:31, 12.28s/it]
 21%|██▏       | 8144/37963 [25:23:39<96:37:53, 11.67s/it] 
 21%|██▏       | 8145/37963 [25:23:49<91:57:06, 11.10s/it]
 21%|██▏       | 8146/37963 [25:23:59<89:20:27, 10.79s/it]
 21%|██▏       | 8147/37963 [25:24:09<87:41:58, 10.59s/it]
 21%|██▏       | 8148/37963 [25:24:20<86:24:35, 10.43s/it]
 21%|██▏       | 8149/37963 [25:24:30<85:35:51, 10.34s/it]
 21%|██▏       | 8150/37963 [25:24:47<102:40:01, 12.40s/it]
                                                           
{'loss': '0.168', 'grad_norm': '3.234', 'learning_rate': '1.826e-05', 'epoch': '0.2147'}

 21%|██▏       | 8150/37963 [25:24:47<102:40:01, 12.40s/it]
 21%|██▏       | 8151/37963 [25:24:57<96:47:23, 11.69s/it] 
 21%|██▏       | 8152/37963 [25:25:07<92:59:35, 11.23s/it]
 21%|██▏       | 8153/37963 [25:25:17<89:16:03, 10.78s/it]
 21%|██▏       | 8154/37963 [25:25:26<86:33:15, 10.45s/it]
 21%|██▏       | 8155/37963 [25:25:42<100:04:28, 12.09s/it]
 21%|██▏       | 8156/37963 [25:25:53<95:19:20, 11.51s/it] 
 21%|██▏       | 8157/37963 [25:26:09<107:38:40, 13.00s/it]
 21%|██▏       | 8158/37963 [25:26:19<100:24:34, 12.13s/it]
 21%|██▏       | 8159/37963 [25:26:29<95:32:50, 11.54s/it] 
 21%|██▏       | 8160/37963 [25:26:39<91:52:49, 11.10s/it]
                                                          
{'loss': '0.1643', 'grad_norm': '0.9188', 'learning_rate': '1.826e-05', 'epoch': '0.2149'}

 21%|██▏       | 8160/37963 [25:26:39<91:52:49, 11.10s/it]
 21%|██▏       | 8161/37963 [25:26:49<87:49:11, 10.61s/it]
 21%|██▏       | 8162/37963 [25:26:59<86:20:42, 10.43s/it]
 22%|██▏       | 8163/37963 [25:27:09<85:33:20, 10.34s/it]
 22%|██▏       | 8164/37963 [25:27:19<84:54:12, 10.26s/it]
 22%|██▏       | 8165/37963 [25:27:35<100:19:54, 12.12s/it]
 22%|██▏       | 8166/37963 [25:27:46<95:11:50, 11.50s/it] 
 22%|██▏       | 8167/37963 [25:27:56<91:41:22, 11.08s/it]
 22%|██▏       | 8168/37963 [25:28:06<89:09:20, 10.77s/it]
 22%|██▏       | 8169/37963 [25:28:16<87:28:21, 10.57s/it]
 22%|██▏       | 8170/37963 [25:28:26<85:37:58, 10.35s/it]
                                                          
{'loss': '0.1649', 'grad_norm': '1.964', 'learning_rate': '1.825e-05', 'epoch': '0.2152'}

 22%|██▏       | 8170/37963 [25:28:26<85:37:58, 10.35s/it]
 22%|██▏       | 8171/37963 [25:28:42<100:46:44, 12.18s/it]
 22%|██▏       | 8172/37963 [25:28:52<95:34:35, 11.55s/it] 
 22%|██▏       | 8173/37963 [25:29:02<91:48:07, 11.09s/it]
 22%|██▏       | 8174/37963 [25:29:19<105:15:58, 12.72s/it]
 22%|██▏       | 8175/37963 [25:29:28<97:46:26, 11.82s/it] 
 22%|██▏       | 8176/37963 [25:29:38<93:19:50, 11.28s/it]
 22%|██▏       | 8177/37963 [25:29:48<90:01:15, 10.88s/it]
 22%|██▏       | 8178/37963 [25:29:58<87:11:04, 10.54s/it]
 22%|██▏       | 8179/37963 [25:30:08<86:04:04, 10.40s/it]
 22%|██▏       | 8180/37963 [25:30:18<85:13:17, 10.30s/it]
                                                          
{'loss': '0.1636', 'grad_norm': '1.339', 'learning_rate': '1.825e-05', 'epoch': '0.2155'}

 22%|██▏       | 8180/37963 [25:30:18<85:13:17, 10.30s/it]
 22%|██▏       | 8181/37963 [25:30:28<84:47:50, 10.25s/it]
 22%|██▏       | 8182/37963 [25:30:38<84:21:37, 10.20s/it]
 22%|██▏       | 8183/37963 [25:30:48<83:31:52, 10.10s/it]
 22%|██▏       | 8184/37963 [25:30:58<83:03:25, 10.04s/it]
 22%|██▏       | 8185/37963 [25:31:08<83:05:18, 10.04s/it]
 22%|██▏       | 8186/37963 [25:31:18<82:21:40,  9.96s/it]
 22%|██▏       | 8187/37963 [25:31:35<100:09:39, 12.11s/it]
 22%|██▏       | 8188/37963 [25:31:45<95:23:48, 11.53s/it] 
 22%|██▏       | 8189/37963 [25:31:55<91:41:03, 11.09s/it]
 22%|██▏       | 8190/37963 [25:32:06<89:15:42, 10.79s/it]
                                                          
{'loss': '0.1753', 'grad_norm': '4.125', 'learning_rate': '1.825e-05', 'epoch': '0.2157'}

 22%|██▏       | 8190/37963 [25:32:06<89:15:42, 10.79s/it]
 22%|██▏       | 8191/37963 [25:32:22<103:19:26, 12.49s/it]
 22%|██▏       | 8192/37963 [25:32:32<96:04:50, 11.62s/it] 
 22%|██▏       | 8193/37963 [25:32:42<92:06:03, 11.14s/it]
 22%|██▏       | 8194/37963 [25:32:52<89:39:05, 10.84s/it]
 22%|██▏       | 8195/37963 [25:33:02<87:42:24, 10.61s/it]
 22%|██▏       | 8196/37963 [25:33:12<86:28:43, 10.46s/it]
 22%|██▏       | 8197/37963 [25:33:22<84:58:05, 10.28s/it]
 22%|██▏       | 8198/37963 [25:33:39<101:45:31, 12.31s/it]
 22%|██▏       | 8199/37963 [25:33:49<96:24:26, 11.66s/it] 
 22%|██▏       | 8200/37963 [25:33:59<92:24:39, 11.18s/it]
                                                          
{'loss': '0.1816', 'grad_norm': '3.52', 'learning_rate': '1.824e-05', 'epoch': '0.216'}

 22%|██▏       | 8200/37963 [25:33:59<92:24:39, 11.18s/it]
 22%|██▏       | 8201/37963 [25:34:09<89:34:44, 10.84s/it]
 22%|██▏       | 8202/37963 [25:34:19<86:47:54, 10.50s/it]
 22%|██▏       | 8203/37963 [25:34:29<86:08:45, 10.42s/it]
 22%|██▏       | 8204/37963 [25:34:39<84:20:43, 10.20s/it]
 22%|██▏       | 8205/37963 [25:35:02<115:47:41, 14.01s/it]
 22%|██▏       | 8206/37963 [25:35:12<106:10:03, 12.84s/it]
 22%|██▏       | 8207/37963 [25:35:22<99:42:40, 12.06s/it] 
 22%|██▏       | 8208/37963 [25:35:32<94:50:16, 11.47s/it]
 22%|██▏       | 8209/37963 [25:35:42<91:22:08, 11.05s/it]
 22%|██▏       | 8210/37963 [25:35:52<88:27:22, 10.70s/it]
                                                          
{'loss': '0.179', 'grad_norm': '3.826', 'learning_rate': '1.824e-05', 'epoch': '0.2163'}

 22%|██▏       | 8210/37963 [25:35:52<88:27:22, 10.70s/it]
 22%|██▏       | 8211/37963 [25:36:02<86:30:34, 10.47s/it]
 22%|██▏       | 8212/37963 [25:36:12<85:23:22, 10.33s/it]
 22%|██▏       | 8213/37963 [25:36:28<100:31:04, 12.16s/it]
 22%|██▏       | 8214/37963 [25:36:38<94:49:55, 11.48s/it] 
 22%|██▏       | 8215/37963 [25:36:48<90:43:06, 10.98s/it]
 22%|██▏       | 8216/37963 [25:36:58<88:45:16, 10.74s/it]
 22%|██▏       | 8217/37963 [25:37:08<87:07:54, 10.55s/it]
 22%|██▏       | 8218/37963 [25:37:18<85:37:44, 10.36s/it]
 22%|██▏       | 8219/37963 [25:37:28<84:52:10, 10.27s/it]
 22%|██▏       | 8220/37963 [25:37:45<100:55:46, 12.22s/it]
                                                           
{'loss': '0.1754', 'grad_norm': '1.227', 'learning_rate': '1.823e-05', 'epoch': '0.2165'}

 22%|██▏       | 8220/37963 [25:37:45<100:55:46, 12.22s/it]
 22%|██▏       | 8221/37963 [25:37:55<95:40:08, 11.58s/it] 
 22%|██▏       | 8222/37963 [25:38:12<107:51:47, 13.06s/it]
 22%|██▏       | 8223/37963 [25:38:22<101:20:20, 12.27s/it]
 22%|██▏       | 8224/37963 [25:38:32<95:01:38, 11.50s/it] 
 22%|██▏       | 8225/37963 [25:38:42<91:23:59, 11.06s/it]
 22%|██▏       | 8226/37963 [25:38:52<88:51:43, 10.76s/it]
 22%|██▏       | 8227/37963 [25:39:02<86:55:11, 10.52s/it]
 22%|██▏       | 8228/37963 [25:39:12<85:45:36, 10.38s/it]
 22%|██▏       | 8229/37963 [25:39:22<84:53:15, 10.28s/it]
 22%|██▏       | 8230/37963 [25:39:32<84:26:14, 10.22s/it]
                                                          
{'loss': '0.1626', 'grad_norm': '1.632', 'learning_rate': '1.823e-05', 'epoch': '0.2168'}

 22%|██▏       | 8230/37963 [25:39:32<84:26:14, 10.22s/it]
 22%|██▏       | 8231/37963 [25:39:42<83:54:03, 10.16s/it]
 22%|██▏       | 8232/37963 [25:39:52<83:41:44, 10.13s/it]
 22%|██▏       | 8233/37963 [25:40:02<83:36:07, 10.12s/it]
 22%|██▏       | 8234/37963 [25:40:19<100:50:50, 12.21s/it]
 22%|██▏       | 8235/37963 [25:40:29<95:30:33, 11.57s/it] 
 22%|██▏       | 8236/37963 [25:40:39<91:49:46, 11.12s/it]
 22%|██▏       | 8237/37963 [25:40:50<89:29:18, 10.84s/it]
 22%|██▏       | 8238/37963 [25:41:00<87:29:28, 10.60s/it]
 22%|██▏       | 8239/37963 [25:41:10<86:00:24, 10.42s/it]
 22%|██▏       | 8240/37963 [25:41:26<100:52:52, 12.22s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '0.7443', 'learning_rate': '1.822e-05', 'epoch': '0.2171'}

 22%|██▏       | 8240/37963 [25:41:26<100:52:52, 12.22s/it]
 22%|██▏       | 8241/37963 [25:41:36<95:22:25, 11.55s/it] 
 22%|██▏       | 8242/37963 [25:41:46<91:43:43, 11.11s/it]
 22%|██▏       | 8243/37963 [25:41:56<89:13:58, 10.81s/it]
 22%|██▏       | 8244/37963 [25:42:06<87:19:09, 10.58s/it]
 22%|██▏       | 8245/37963 [25:42:16<85:35:12, 10.37s/it]
 22%|██▏       | 8246/37963 [25:42:33<102:37:46, 12.43s/it]
 22%|██▏       | 8247/37963 [25:42:43<96:38:28, 11.71s/it] 
 22%|██▏       | 8248/37963 [25:42:54<92:45:15, 11.24s/it]
 22%|██▏       | 8249/37963 [25:43:04<89:48:34, 10.88s/it]
 22%|██▏       | 8250/37963 [25:43:13<86:30:45, 10.48s/it]
                                                          
{'loss': '0.1585', 'grad_norm': '1.591', 'learning_rate': '1.822e-05', 'epoch': '0.2173'}

 22%|██▏       | 8250/37963 [25:43:13<86:30:45, 10.48s/it]
 22%|██▏       | 8251/37963 [25:43:23<84:58:19, 10.30s/it]
 22%|██▏       | 8252/37963 [25:43:39<100:06:10, 12.13s/it]
 22%|██▏       | 8253/37963 [25:43:50<94:59:39, 11.51s/it] 
 22%|██▏       | 8254/37963 [25:44:06<107:21:04, 13.01s/it]
 22%|██▏       | 8255/37963 [25:44:16<99:26:47, 12.05s/it] 
 22%|██▏       | 8256/37963 [25:44:26<94:50:01, 11.49s/it]
 22%|██▏       | 8257/37963 [25:44:36<91:43:15, 11.12s/it]
 22%|██▏       | 8258/37963 [25:44:46<89:20:41, 10.83s/it]
 22%|██▏       | 8259/37963 [25:44:57<87:27:31, 10.60s/it]
 22%|██▏       | 8260/37963 [25:45:06<85:32:19, 10.37s/it]
                                                          
{'loss': '0.1778', 'grad_norm': '1.74', 'learning_rate': '1.821e-05', 'epoch': '0.2176'}

 22%|██▏       | 8260/37963 [25:45:06<85:32:19, 10.37s/it]
 22%|██▏       | 8261/37963 [25:45:16<84:48:02, 10.28s/it]
 22%|██▏       | 8262/37963 [25:45:26<84:16:45, 10.22s/it]
 22%|██▏       | 8263/37963 [25:45:42<98:25:19, 11.93s/it]
 22%|██▏       | 8264/37963 [25:45:53<94:10:05, 11.41s/it]
 22%|██▏       | 8265/37963 [25:46:03<90:27:46, 10.97s/it]
 22%|██▏       | 8266/37963 [25:46:13<88:03:22, 10.67s/it]
 22%|██▏       | 8267/37963 [25:46:23<86:40:57, 10.51s/it]
 22%|██▏       | 8268/37963 [25:46:39<101:08:14, 12.26s/it]
 22%|██▏       | 8269/37963 [25:46:49<94:56:21, 11.51s/it] 
 22%|██▏       | 8270/37963 [25:46:58<90:31:51, 10.98s/it]
                                                          
{'loss': '0.1603', 'grad_norm': '1.018', 'learning_rate': '1.821e-05', 'epoch': '0.2178'}

 22%|██▏       | 8270/37963 [25:46:58<90:31:51, 10.98s/it]
 22%|██▏       | 8271/37963 [25:47:15<103:24:18, 12.54s/it]
 22%|██▏       | 8272/37963 [25:47:25<97:33:57, 11.83s/it] 
 22%|██▏       | 8273/37963 [25:47:35<93:14:59, 11.31s/it]
 22%|██▏       | 8274/37963 [25:47:45<90:16:04, 10.95s/it]
 22%|██▏       | 8275/37963 [25:47:55<87:53:54, 10.66s/it]
 22%|██▏       | 8276/37963 [25:48:05<86:00:05, 10.43s/it]
 22%|██▏       | 8277/37963 [25:48:15<85:10:50, 10.33s/it]
 22%|██▏       | 8278/37963 [25:48:25<84:55:01, 10.30s/it]
 22%|██▏       | 8279/37963 [25:48:35<84:43:04, 10.27s/it]
 22%|██▏       | 8280/37963 [25:48:46<84:20:19, 10.23s/it]
                                                          
{'loss': '0.1603', 'grad_norm': '2.555', 'learning_rate': '1.82e-05', 'epoch': '0.2181'}

 22%|██▏       | 8280/37963 [25:48:46<84:20:19, 10.23s/it]
 22%|██▏       | 8281/37963 [25:48:56<83:41:37, 10.15s/it]
 22%|██▏       | 8282/37963 [25:49:13<101:13:29, 12.28s/it]
 22%|██▏       | 8283/37963 [25:49:23<95:19:56, 11.56s/it] 
 22%|██▏       | 8284/37963 [25:49:33<91:45:25, 11.13s/it]
 22%|██▏       | 8285/37963 [25:49:43<89:34:31, 10.87s/it]
 22%|██▏       | 8286/37963 [25:49:53<87:30:30, 10.62s/it]
 22%|██▏       | 8287/37963 [25:50:10<102:42:01, 12.46s/it]
 22%|██▏       | 8288/37963 [25:50:20<96:12:29, 11.67s/it] 
 22%|██▏       | 8289/37963 [25:50:30<92:02:31, 11.17s/it]
 22%|██▏       | 8290/37963 [25:50:40<89:13:31, 10.83s/it]
                                                          
{'loss': '0.1715', 'grad_norm': '0.7442', 'learning_rate': '1.82e-05', 'epoch': '0.2184'}

 22%|██▏       | 8290/37963 [25:50:40<89:13:31, 10.83s/it]
 22%|██▏       | 8291/37963 [25:50:50<87:23:39, 10.60s/it]
 22%|██▏       | 8292/37963 [25:51:00<85:15:27, 10.34s/it]
 22%|██▏       | 8293/37963 [25:51:10<84:34:41, 10.26s/it]
 22%|██▏       | 8294/37963 [25:51:20<84:11:55, 10.22s/it]
 22%|██▏       | 8295/37963 [25:51:29<83:04:10, 10.08s/it]
 22%|██▏       | 8296/37963 [25:51:46<100:08:38, 12.15s/it]
 22%|██▏       | 8297/37963 [25:51:57<95:30:48, 11.59s/it] 
 22%|██▏       | 8298/37963 [25:52:07<91:53:16, 11.15s/it]
 22%|██▏       | 8299/37963 [25:52:17<89:32:05, 10.87s/it]
 22%|██▏       | 8300/37963 [25:52:34<103:34:17, 12.57s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '1.892', 'learning_rate': '1.819e-05', 'epoch': '0.2186'}

 22%|██▏       | 8300/37963 [25:52:34<103:34:17, 12.57s/it]
 22%|██▏       | 8301/37963 [25:52:44<97:25:28, 11.82s/it] 
 22%|██▏       | 8302/37963 [25:52:54<93:25:59, 11.34s/it]
 22%|██▏       | 8303/37963 [25:53:04<90:44:09, 11.01s/it]
 22%|██▏       | 8304/37963 [25:53:21<104:14:19, 12.65s/it]
 22%|██▏       | 8305/37963 [25:53:31<97:51:17, 11.88s/it] 
 22%|██▏       | 8306/37963 [25:53:41<93:13:27, 11.32s/it]
 22%|██▏       | 8307/37963 [25:53:51<90:13:11, 10.95s/it]
 22%|██▏       | 8308/37963 [25:54:01<87:37:30, 10.64s/it]
 22%|██▏       | 8309/37963 [25:54:10<85:26:05, 10.37s/it]
 22%|██▏       | 8310/37963 [25:54:21<84:44:42, 10.29s/it]
                                                          
{'loss': '0.1661', 'grad_norm': '0.7959', 'learning_rate': '1.819e-05', 'epoch': '0.2189'}

 22%|██▏       | 8310/37963 [25:54:21<84:44:42, 10.29s/it]
 22%|██▏       | 8311/37963 [25:54:37<100:44:38, 12.23s/it]
 22%|██▏       | 8312/37963 [25:54:48<95:51:12, 11.64s/it] 
 22%|██▏       | 8313/37963 [25:54:58<91:58:54, 11.17s/it]
 22%|██▏       | 8314/37963 [25:55:08<89:24:02, 10.86s/it]
 22%|██▏       | 8315/37963 [25:55:18<87:01:48, 10.57s/it]
 22%|██▏       | 8316/37963 [25:55:34<100:59:58, 12.26s/it]
 22%|██▏       | 8317/37963 [25:55:44<96:00:25, 11.66s/it] 
 22%|██▏       | 8318/37963 [25:55:54<91:48:42, 11.15s/it]
 22%|██▏       | 8319/37963 [25:56:04<89:09:33, 10.83s/it]
 22%|██▏       | 8320/37963 [25:56:21<103:31:00, 12.57s/it]
                                                           
{'loss': '0.17', 'grad_norm': '2.158', 'learning_rate': '1.818e-05', 'epoch': '0.2192'}

 22%|██▏       | 8320/37963 [25:56:21<103:31:00, 12.57s/it]
 22%|██▏       | 8321/37963 [25:56:31<96:58:06, 11.78s/it] 
 22%|██▏       | 8322/37963 [25:56:41<92:59:08, 11.29s/it]
 22%|██▏       | 8323/37963 [25:56:51<90:05:09, 10.94s/it]
 22%|██▏       | 8324/37963 [25:57:01<88:11:12, 10.71s/it]
 22%|██▏       | 8325/37963 [25:57:11<86:39:21, 10.53s/it]
 22%|██▏       | 8326/37963 [25:57:21<85:33:47, 10.39s/it]
 22%|██▏       | 8327/37963 [25:57:31<83:20:07, 10.12s/it]
 22%|██▏       | 8328/37963 [25:57:41<82:47:36, 10.06s/it]
 22%|██▏       | 8329/37963 [25:57:58<100:23:44, 12.20s/it]
 22%|██▏       | 8330/37963 [25:58:08<94:06:40, 11.43s/it] 
                                                          
{'loss': '0.1619', 'grad_norm': '2.59', 'learning_rate': '1.818e-05', 'epoch': '0.2194'}

 22%|██▏       | 8330/37963 [25:58:08<94:06:40, 11.43s/it]
 22%|██▏       | 8331/37963 [25:58:18<90:45:21, 11.03s/it]
 22%|██▏       | 8332/37963 [25:58:27<87:28:41, 10.63s/it]
 22%|██▏       | 8333/37963 [25:58:38<86:14:40, 10.48s/it]
 22%|██▏       | 8334/37963 [25:58:48<85:30:00, 10.39s/it]
 22%|██▏       | 8335/37963 [25:59:04<100:49:12, 12.25s/it]
 22%|██▏       | 8336/37963 [25:59:14<95:30:37, 11.61s/it] 
 22%|██▏       | 8337/37963 [25:59:24<91:36:15, 11.13s/it]
 22%|██▏       | 8338/37963 [25:59:34<88:33:57, 10.76s/it]
 22%|██▏       | 8339/37963 [25:59:44<86:51:40, 10.56s/it]
 22%|██▏       | 8340/37963 [25:59:54<85:45:58, 10.42s/it]
                                                          
{'loss': '0.1848', 'grad_norm': '3.547', 'learning_rate': '1.817e-05', 'epoch': '0.2197'}

 22%|██▏       | 8340/37963 [25:59:54<85:45:58, 10.42s/it]
 22%|██▏       | 8341/37963 [26:00:05<85:12:38, 10.36s/it]
 22%|██▏       | 8342/37963 [26:00:14<83:11:47, 10.11s/it]
 22%|██▏       | 8343/37963 [26:00:24<83:03:59, 10.10s/it]
 22%|██▏       | 8344/37963 [26:00:41<98:16:40, 11.95s/it]
 22%|██▏       | 8345/37963 [26:00:51<93:57:41, 11.42s/it]
 22%|██▏       | 8346/37963 [26:01:01<89:58:53, 10.94s/it]
 22%|██▏       | 8347/37963 [26:01:11<87:55:49, 10.69s/it]
 22%|██▏       | 8348/37963 [26:01:21<85:50:25, 10.43s/it]
 22%|██▏       | 8349/37963 [26:01:37<100:29:27, 12.22s/it]
 22%|██▏       | 8350/37963 [26:01:47<94:45:04, 11.52s/it] 
                                                          
{'loss': '0.1827', 'grad_norm': '1.443', 'learning_rate': '1.817e-05', 'epoch': '0.22'}

 22%|██▏       | 8350/37963 [26:01:47<94:45:04, 11.52s/it]
 22%|██▏       | 8351/37963 [26:01:57<91:16:23, 11.10s/it]
 22%|██▏       | 8352/37963 [26:02:07<88:53:06, 10.81s/it]
 22%|██▏       | 8353/37963 [26:02:24<103:28:40, 12.58s/it]
 22%|██▏       | 8354/37963 [26:02:34<97:15:05, 11.82s/it] 
 22%|██▏       | 8355/37963 [26:02:44<92:58:49, 11.31s/it]
 22%|██▏       | 8356/37963 [26:02:54<89:34:03, 10.89s/it]
 22%|██▏       | 8357/37963 [26:03:04<87:18:32, 10.62s/it]
 22%|██▏       | 8358/37963 [26:03:14<86:00:38, 10.46s/it]
 22%|██▏       | 8359/37963 [26:03:24<84:56:55, 10.33s/it]
 22%|██▏       | 8360/37963 [26:03:34<83:47:21, 10.19s/it]
                                                          
{'loss': '0.1764', 'grad_norm': '2.595', 'learning_rate': '1.816e-05', 'epoch': '0.2202'}

 22%|██▏       | 8360/37963 [26:03:34<83:47:21, 10.19s/it]
 22%|██▏       | 8361/37963 [26:03:50<99:50:39, 12.14s/it]
 22%|██▏       | 8362/37963 [26:04:00<94:24:28, 11.48s/it]
 22%|██▏       | 8363/37963 [26:04:11<90:58:36, 11.06s/it]
 22%|██▏       | 8364/37963 [26:04:27<104:45:14, 12.74s/it]
 22%|██▏       | 8365/37963 [26:04:37<98:05:40, 11.93s/it] 
 22%|██▏       | 8366/37963 [26:04:47<92:36:01, 11.26s/it]
 22%|██▏       | 8367/37963 [26:04:57<89:20:18, 10.87s/it]
 22%|██▏       | 8368/37963 [26:05:07<87:15:36, 10.61s/it]
 22%|██▏       | 8369/37963 [26:05:17<85:24:43, 10.39s/it]
 22%|██▏       | 8370/37963 [26:05:33<100:57:55, 12.28s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '1.535', 'learning_rate': '1.816e-05', 'epoch': '0.2205'}

 22%|██▏       | 8370/37963 [26:05:33<100:57:55, 12.28s/it]
 22%|██▏       | 8371/37963 [26:05:44<95:29:41, 11.62s/it] 
 22%|██▏       | 8372/37963 [26:05:54<91:39:43, 11.15s/it]
 22%|██▏       | 8373/37963 [26:06:03<88:19:16, 10.75s/it]
 22%|██▏       | 8374/37963 [26:06:13<86:44:31, 10.55s/it]
 22%|██▏       | 8375/37963 [26:06:23<85:11:17, 10.36s/it]
 22%|██▏       | 8376/37963 [26:06:40<101:11:04, 12.31s/it]
 22%|██▏       | 8377/37963 [26:06:50<95:53:26, 11.67s/it] 
 22%|██▏       | 8378/37963 [26:07:00<91:34:21, 11.14s/it]
 22%|██▏       | 8379/37963 [26:07:10<88:56:46, 10.82s/it]
 22%|██▏       | 8380/37963 [26:07:20<85:59:00, 10.46s/it]
                                                          
{'loss': '0.1672', 'grad_norm': '1.846', 'learning_rate': '1.815e-05', 'epoch': '0.2207'}

 22%|██▏       | 8380/37963 [26:07:20<85:59:00, 10.46s/it]
 22%|██▏       | 8381/37963 [26:07:30<85:23:41, 10.39s/it]
 22%|██▏       | 8382/37963 [26:07:40<84:41:26, 10.31s/it]
 22%|██▏       | 8383/37963 [26:07:57<100:30:14, 12.23s/it]
 22%|██▏       | 8384/37963 [26:08:07<94:56:38, 11.56s/it] 
 22%|██▏       | 8385/37963 [26:08:17<91:27:12, 11.13s/it]
 22%|██▏       | 8386/37963 [26:08:27<88:54:20, 10.82s/it]
 22%|██▏       | 8387/37963 [26:08:37<86:27:04, 10.52s/it]
 22%|██▏       | 8388/37963 [26:08:47<85:31:08, 10.41s/it]
 22%|██▏       | 8389/37963 [26:08:57<84:59:33, 10.35s/it]
 22%|██▏       | 8390/37963 [26:09:08<84:22:50, 10.27s/it]
                                                          
{'loss': '0.1818', 'grad_norm': '0.7883', 'learning_rate': '1.815e-05', 'epoch': '0.221'}

 22%|██▏       | 8390/37963 [26:09:08<84:22:50, 10.27s/it]
 22%|██▏       | 8391/37963 [26:09:18<84:15:30, 10.26s/it]
 22%|██▏       | 8392/37963 [26:09:28<83:13:56, 10.13s/it]
 22%|██▏       | 8393/37963 [26:09:44<99:47:10, 12.15s/it]
 22%|██▏       | 8394/37963 [26:09:55<94:49:08, 11.54s/it]
 22%|██▏       | 8395/37963 [26:10:05<91:14:21, 11.11s/it]
 22%|██▏       | 8396/37963 [26:10:15<88:38:21, 10.79s/it]
 22%|██▏       | 8397/37963 [26:10:31<102:30:03, 12.48s/it]
 22%|██▏       | 8398/37963 [26:10:41<96:13:31, 11.72s/it] 
 22%|██▏       | 8399/37963 [26:10:51<92:15:17, 11.23s/it]
 22%|██▏       | 8400/37963 [26:11:08<105:11:21, 12.81s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '0.9892', 'learning_rate': '1.814e-05', 'epoch': '0.2213'}

 22%|██▏       | 8400/37963 [26:11:08<105:11:21, 12.81s/it]
 22%|██▏       | 8401/37963 [26:11:18<98:28:30, 11.99s/it] 
 22%|██▏       | 8402/37963 [26:11:28<93:45:08, 11.42s/it]
 22%|██▏       | 8403/37963 [26:11:38<90:23:25, 11.01s/it]
 22%|██▏       | 8404/37963 [26:11:48<88:10:25, 10.74s/it]
 22%|██▏       | 8405/37963 [26:11:58<86:34:38, 10.54s/it]
 22%|██▏       | 8406/37963 [26:12:08<85:36:19, 10.43s/it]
 22%|██▏       | 8407/37963 [26:12:18<83:50:30, 10.21s/it]
 22%|██▏       | 8408/37963 [26:12:28<83:44:44, 10.20s/it]
 22%|██▏       | 8409/37963 [26:12:38<83:08:55, 10.13s/it]
 22%|██▏       | 8410/37963 [26:12:55<99:12:33, 12.09s/it]
                                                          
{'loss': '0.1839', 'grad_norm': '2.036', 'learning_rate': '1.814e-05', 'epoch': '0.2215'}

 22%|██▏       | 8410/37963 [26:12:55<99:12:33, 12.09s/it]
 22%|██▏       | 8411/37963 [26:13:05<94:15:37, 11.48s/it]
 22%|██▏       | 8412/37963 [26:13:21<106:26:40, 12.97s/it]
 22%|██▏       | 8413/37963 [26:13:31<99:19:30, 12.10s/it] 
 22%|██▏       | 8414/37963 [26:13:41<93:56:56, 11.45s/it]
 22%|██▏       | 8415/37963 [26:13:51<90:41:35, 11.05s/it]
 22%|██▏       | 8416/37963 [26:14:01<88:06:58, 10.74s/it]
 22%|██▏       | 8417/37963 [26:14:12<86:37:23, 10.55s/it]
 22%|██▏       | 8418/37963 [26:14:21<84:42:02, 10.32s/it]
 22%|██▏       | 8419/37963 [26:14:38<99:52:33, 12.17s/it]
 22%|██▏       | 8420/37963 [26:14:48<94:50:48, 11.56s/it]
                                                          
{'loss': '0.1628', 'grad_norm': '0.9216', 'learning_rate': '1.813e-05', 'epoch': '0.2218'}

 22%|██▏       | 8420/37963 [26:14:48<94:50:48, 11.56s/it]
 22%|██▏       | 8421/37963 [26:14:58<91:04:13, 11.10s/it]
 22%|██▏       | 8422/37963 [26:15:08<88:39:41, 10.80s/it]
 22%|██▏       | 8423/37963 [26:15:18<87:02:20, 10.61s/it]
 22%|██▏       | 8424/37963 [26:15:28<86:08:58, 10.50s/it]
 22%|██▏       | 8425/37963 [26:15:45<102:01:28, 12.43s/it]
 22%|██▏       | 8426/37963 [26:15:56<96:26:19, 11.75s/it] 
 22%|██▏       | 8427/37963 [26:16:06<92:20:38, 11.26s/it]
 22%|██▏       | 8428/37963 [26:16:16<89:07:28, 10.86s/it]
 22%|██▏       | 8429/37963 [26:16:26<87:14:26, 10.63s/it]
 22%|██▏       | 8430/37963 [26:16:36<85:54:20, 10.47s/it]
                                                          
{'loss': '0.1752', 'grad_norm': '1.037', 'learning_rate': '1.813e-05', 'epoch': '0.2221'}

 22%|██▏       | 8430/37963 [26:16:36<85:54:20, 10.47s/it]
 22%|██▏       | 8431/37963 [26:16:53<101:24:44, 12.36s/it]
 22%|██▏       | 8432/37963 [26:17:03<95:46:42, 11.68s/it] 
 22%|██▏       | 8433/37963 [26:17:13<91:17:02, 11.13s/it]
 22%|██▏       | 8434/37963 [26:17:23<88:42:26, 10.81s/it]
 22%|██▏       | 8435/37963 [26:17:33<87:06:59, 10.62s/it]
 22%|██▏       | 8436/37963 [26:17:42<84:36:09, 10.31s/it]
 22%|██▏       | 8437/37963 [26:17:52<83:58:33, 10.24s/it]
 22%|██▏       | 8438/37963 [26:18:03<83:37:15, 10.20s/it]
 22%|██▏       | 8439/37963 [26:18:12<82:53:31, 10.11s/it]
 22%|██▏       | 8440/37963 [26:18:23<82:47:02, 10.09s/it]
                                                          
{'loss': '0.1752', 'grad_norm': '3.445', 'learning_rate': '1.812e-05', 'epoch': '0.2223'}

 22%|██▏       | 8440/37963 [26:18:23<82:47:02, 10.09s/it]
 22%|██▏       | 8441/37963 [26:18:32<82:31:20, 10.06s/it]
 22%|██▏       | 8442/37963 [26:18:49<99:33:45, 12.14s/it]
 22%|██▏       | 8443/37963 [26:19:00<94:53:25, 11.57s/it]
 22%|██▏       | 8444/37963 [26:19:10<91:08:14, 11.11s/it]
 22%|██▏       | 8445/37963 [26:19:20<88:30:55, 10.80s/it]
 22%|██▏       | 8446/37963 [26:19:30<86:43:55, 10.58s/it]
 22%|██▏       | 8447/37963 [26:19:47<101:56:08, 12.43s/it]
 22%|██▏       | 8448/37963 [26:19:57<95:47:37, 11.68s/it] 
 22%|██▏       | 8449/37963 [26:20:13<108:16:08, 13.21s/it]
 22%|██▏       | 8450/37963 [26:20:24<100:46:06, 12.29s/it]
                                                           
{'loss': '0.166', 'grad_norm': '3.609', 'learning_rate': '1.812e-05', 'epoch': '0.2226'}

 22%|██▏       | 8450/37963 [26:20:24<100:46:06, 12.29s/it]
 22%|██▏       | 8451/37963 [26:20:34<95:35:20, 11.66s/it] 
 22%|██▏       | 8452/37963 [26:20:43<90:58:50, 11.10s/it]
 22%|██▏       | 8453/37963 [26:20:54<88:26:05, 10.79s/it]
 22%|██▏       | 8454/37963 [26:21:03<86:05:59, 10.50s/it]
 22%|██▏       | 8455/37963 [26:21:13<85:03:48, 10.38s/it]
 22%|██▏       | 8456/37963 [26:21:24<84:36:07, 10.32s/it]
 22%|██▏       | 8457/37963 [26:21:34<84:08:54, 10.27s/it]
 22%|██▏       | 8458/37963 [26:21:50<99:20:26, 12.12s/it]
 22%|██▏       | 8459/37963 [26:22:00<94:11:43, 11.49s/it]
 22%|██▏       | 8460/37963 [26:22:10<90:43:01, 11.07s/it]
                                                          
{'loss': '0.1654', 'grad_norm': '2.037', 'learning_rate': '1.811e-05', 'epoch': '0.2228'}

 22%|██▏       | 8460/37963 [26:22:10<90:43:01, 11.07s/it]
 22%|██▏       | 8461/37963 [26:22:27<103:48:05, 12.67s/it]
 22%|██▏       | 8462/37963 [26:22:37<97:40:37, 11.92s/it] 
 22%|██▏       | 8463/37963 [26:22:47<93:16:18, 11.38s/it]
 22%|██▏       | 8464/37963 [26:22:57<88:57:53, 10.86s/it]
 22%|██▏       | 8465/37963 [26:23:07<87:02:05, 10.62s/it]
 22%|██▏       | 8466/37963 [26:23:23<101:40:24, 12.41s/it]
 22%|██▏       | 8467/37963 [26:23:33<96:08:21, 11.73s/it] 
 22%|██▏       | 8468/37963 [26:23:43<91:50:31, 11.21s/it]
 22%|██▏       | 8469/37963 [26:23:54<89:10:00, 10.88s/it]
 22%|██▏       | 8470/37963 [26:24:04<87:25:15, 10.67s/it]
                                                          
{'loss': '0.1699', 'grad_norm': '0.7842', 'learning_rate': '1.811e-05', 'epoch': '0.2231'}

 22%|██▏       | 8470/37963 [26:24:04<87:25:15, 10.67s/it]
 22%|██▏       | 8471/37963 [26:24:14<85:52:45, 10.48s/it]
 22%|██▏       | 8472/37963 [26:24:24<84:51:37, 10.36s/it]
 22%|██▏       | 8473/37963 [26:24:34<84:22:38, 10.30s/it]
 22%|██▏       | 8474/37963 [26:24:51<99:45:01, 12.18s/it]
 22%|██▏       | 8475/37963 [26:25:01<94:33:45, 11.54s/it]
 22%|██▏       | 8476/37963 [26:25:11<90:35:05, 11.06s/it]
 22%|██▏       | 8477/37963 [26:25:20<87:39:17, 10.70s/it]
 22%|██▏       | 8478/37963 [26:25:30<85:48:20, 10.48s/it]
 22%|██▏       | 8479/37963 [26:25:40<84:46:22, 10.35s/it]
 22%|██▏       | 8480/37963 [26:25:57<99:09:41, 12.11s/it]
                                                          
{'loss': '0.1761', 'grad_norm': '4.4', 'learning_rate': '1.81e-05', 'epoch': '0.2234'}

 22%|██▏       | 8480/37963 [26:25:57<99:09:41, 12.11s/it]
 22%|██▏       | 8481/37963 [26:26:07<93:39:10, 11.44s/it]
 22%|██▏       | 8482/37963 [26:26:17<90:24:09, 11.04s/it]
 22%|██▏       | 8483/37963 [26:26:27<87:36:33, 10.70s/it]
 22%|██▏       | 8484/37963 [26:26:36<85:33:52, 10.45s/it]
 22%|██▏       | 8485/37963 [26:26:46<83:31:59, 10.20s/it]
 22%|██▏       | 8486/37963 [26:26:56<82:24:16, 10.06s/it]
 22%|██▏       | 8487/37963 [26:27:06<82:32:46, 10.08s/it]
 22%|██▏       | 8488/37963 [26:27:16<82:00:07, 10.02s/it]
 22%|██▏       | 8489/37963 [26:27:26<82:07:24, 10.03s/it]
 22%|██▏       | 8490/37963 [26:27:43<100:07:23, 12.23s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '2.054', 'learning_rate': '1.81e-05', 'epoch': '0.2236'}

 22%|██▏       | 8490/37963 [26:27:43<100:07:23, 12.23s/it]
 22%|██▏       | 8491/37963 [26:27:53<94:52:41, 11.59s/it] 
 22%|██▏       | 8492/37963 [26:28:03<90:47:50, 11.09s/it]
 22%|██▏       | 8493/37963 [26:28:13<88:17:38, 10.79s/it]
 22%|██▏       | 8494/37963 [26:28:23<86:46:29, 10.60s/it]
 22%|██▏       | 8495/37963 [26:28:47<117:37:28, 14.37s/it]
 22%|██▏       | 8496/37963 [26:28:57<106:50:57, 13.05s/it]
 22%|██▏       | 8497/37963 [26:29:06<98:17:37, 12.01s/it] 
 22%|██▏       | 8498/37963 [26:29:16<93:46:34, 11.46s/it]
 22%|██▏       | 8499/37963 [26:29:26<88:56:11, 10.87s/it]
 22%|██▏       | 8500/37963 [26:29:36<87:04:58, 10.64s/it]
                                                          
{'loss': '0.1661', 'grad_norm': '2.763', 'learning_rate': '1.809e-05', 'epoch': '0.2239'}

 22%|██▏       | 8500/37963 [26:29:36<87:04:58, 10.64s/it]
 22%|██▏       | 8501/37963 [26:29:46<85:03:12, 10.39s/it]
 22%|██▏       | 8502/37963 [26:29:56<84:20:45, 10.31s/it]
 22%|██▏       | 8503/37963 [26:30:06<84:03:45, 10.27s/it]
 22%|██▏       | 8504/37963 [26:30:16<83:34:11, 10.21s/it]
 22%|██▏       | 8505/37963 [26:30:26<83:29:21, 10.20s/it]
 22%|██▏       | 8506/37963 [26:30:43<98:38:23, 12.05s/it]
 22%|██▏       | 8507/37963 [26:30:53<93:46:51, 11.46s/it]
 22%|██▏       | 8508/37963 [26:31:03<90:17:57, 11.04s/it]
 22%|██▏       | 8509/37963 [26:31:19<103:41:17, 12.67s/it]
 22%|██▏       | 8510/37963 [26:31:29<97:19:23, 11.90s/it] 
                                                          
{'loss': '0.1721', 'grad_norm': '1.564', 'learning_rate': '1.809e-05', 'epoch': '0.2242'}

 22%|██▏       | 8510/37963 [26:31:29<97:19:23, 11.90s/it]
 22%|██▏       | 8511/37963 [26:31:39<92:46:23, 11.34s/it]
 22%|██▏       | 8512/37963 [26:31:50<89:40:19, 10.96s/it]
 22%|██▏       | 8513/37963 [26:32:00<87:34:48, 10.71s/it]
 22%|██▏       | 8514/37963 [26:32:10<85:43:21, 10.48s/it]
 22%|██▏       | 8515/37963 [26:32:26<100:26:52, 12.28s/it]
 22%|██▏       | 8516/37963 [26:32:36<94:31:34, 11.56s/it] 
 22%|██▏       | 8517/37963 [26:32:46<90:58:55, 11.12s/it]
 22%|██▏       | 8518/37963 [26:32:56<88:30:04, 10.82s/it]
 22%|██▏       | 8519/37963 [26:33:06<86:42:35, 10.60s/it]
 22%|██▏       | 8520/37963 [26:33:16<84:13:26, 10.30s/it]
                                                          
{'loss': '0.1745', 'grad_norm': '3.073', 'learning_rate': '1.808e-05', 'epoch': '0.2244'}

 22%|██▏       | 8520/37963 [26:33:16<84:13:26, 10.30s/it]
 22%|██▏       | 8521/37963 [26:33:26<82:47:53, 10.12s/it]
 22%|██▏       | 8522/37963 [26:33:36<82:42:34, 10.11s/it]
 22%|██▏       | 8523/37963 [26:33:52<98:31:52, 12.05s/it]
 22%|██▏       | 8524/37963 [26:34:02<93:19:54, 11.41s/it]
 22%|██▏       | 8525/37963 [26:34:12<90:12:17, 11.03s/it]
 22%|██▏       | 8526/37963 [26:34:22<87:48:50, 10.74s/it]
 22%|██▏       | 8527/37963 [26:34:32<85:34:13, 10.47s/it]
 22%|██▏       | 8528/37963 [26:34:49<100:14:44, 12.26s/it]
 22%|██▏       | 8529/37963 [26:34:58<93:34:01, 11.44s/it] 
 22%|██▏       | 8530/37963 [26:35:08<90:10:48, 11.03s/it]
                                                          
{'loss': '0.1674', 'grad_norm': '1.129', 'learning_rate': '1.808e-05', 'epoch': '0.2247'}

 22%|██▏       | 8530/37963 [26:35:08<90:10:48, 11.03s/it]
 22%|██▏       | 8531/37963 [26:35:18<87:58:51, 10.76s/it]
 22%|██▏       | 8532/37963 [26:35:29<86:35:33, 10.59s/it]
 22%|██▏       | 8533/37963 [26:35:39<85:01:21, 10.40s/it]
 22%|██▏       | 8534/37963 [26:35:48<83:51:39, 10.26s/it]
 22%|██▏       | 8535/37963 [26:35:59<83:32:03, 10.22s/it]
 22%|██▏       | 8536/37963 [26:36:09<83:11:55, 10.18s/it]
 22%|██▏       | 8537/37963 [26:36:19<82:29:40, 10.09s/it]
 22%|██▏       | 8538/37963 [26:36:29<82:24:44, 10.08s/it]
 22%|██▏       | 8539/37963 [26:36:45<97:32:49, 11.93s/it]
 22%|██▏       | 8540/37963 [26:36:55<92:58:48, 11.38s/it]
                                                          
{'loss': '0.1556', 'grad_norm': '2.151', 'learning_rate': '1.807e-05', 'epoch': '0.225'}

 22%|██▏       | 8540/37963 [26:36:55<92:58:48, 11.38s/it]
 22%|██▏       | 8541/37963 [26:37:05<89:54:34, 11.00s/it]
 23%|██▎       | 8542/37963 [26:37:15<87:06:53, 10.66s/it]
 23%|██▎       | 8543/37963 [26:37:38<117:27:02, 14.37s/it]
 23%|██▎       | 8544/37963 [26:37:48<107:11:43, 13.12s/it]
 23%|██▎       | 8545/37963 [26:37:58<99:48:16, 12.21s/it] 
 23%|██▎       | 8546/37963 [26:38:08<94:29:52, 11.56s/it]
 23%|██▎       | 8547/37963 [26:38:18<90:55:42, 11.13s/it]
 23%|██▎       | 8548/37963 [26:38:28<87:50:19, 10.75s/it]
 23%|██▎       | 8549/37963 [26:38:38<86:03:18, 10.53s/it]
 23%|██▎       | 8550/37963 [26:38:48<85:00:35, 10.40s/it]
                                                          
{'loss': '0.1708', 'grad_norm': '2.798', 'learning_rate': '1.807e-05', 'epoch': '0.2252'}

 23%|██▎       | 8550/37963 [26:38:48<85:00:35, 10.40s/it]
 23%|██▎       | 8551/37963 [26:38:58<84:10:51, 10.30s/it]
 23%|██▎       | 8552/37963 [26:39:09<83:43:54, 10.25s/it]
 23%|██▎       | 8553/37963 [26:39:19<83:16:04, 10.19s/it]
 23%|██▎       | 8554/37963 [26:39:29<82:56:32, 10.15s/it]
 23%|██▎       | 8555/37963 [26:39:39<82:40:01, 10.12s/it]
 23%|██▎       | 8556/37963 [26:39:55<98:13:38, 12.02s/it]
 23%|██▎       | 8557/37963 [26:40:06<93:55:33, 11.50s/it]
 23%|██▎       | 8558/37963 [26:40:22<106:17:20, 13.01s/it]
 23%|██▎       | 8559/37963 [26:40:32<99:05:35, 12.13s/it] 
 23%|██▎       | 8560/37963 [26:40:42<93:13:21, 11.41s/it]
                                                          
{'loss': '0.1732', 'grad_norm': '2.321', 'learning_rate': '1.806e-05', 'epoch': '0.2255'}

 23%|██▎       | 8560/37963 [26:40:42<93:13:21, 11.41s/it]
 23%|██▎       | 8561/37963 [26:40:52<90:03:10, 11.03s/it]
 23%|██▎       | 8562/37963 [26:41:02<87:55:34, 10.77s/it]
 23%|██▎       | 8563/37963 [26:41:12<86:05:31, 10.54s/it]
 23%|██▎       | 8564/37963 [26:41:22<85:04:25, 10.42s/it]
 23%|██▎       | 8565/37963 [26:41:39<100:25:47, 12.30s/it]
 23%|██▎       | 8566/37963 [26:41:49<94:54:15, 11.62s/it] 
 23%|██▎       | 8567/37963 [26:41:59<91:18:13, 11.18s/it]
 23%|██▎       | 8568/37963 [26:42:09<88:38:00, 10.85s/it]
 23%|██▎       | 8569/37963 [26:42:19<86:51:59, 10.64s/it]
 23%|██▎       | 8570/37963 [26:42:30<85:51:21, 10.52s/it]
                                                          
{'loss': '0.1609', 'grad_norm': '1.121', 'learning_rate': '1.806e-05', 'epoch': '0.2257'}

 23%|██▎       | 8570/37963 [26:42:30<85:51:21, 10.52s/it]
 23%|██▎       | 8571/37963 [26:42:40<84:51:45, 10.39s/it]
 23%|██▎       | 8572/37963 [26:42:50<83:58:39, 10.29s/it]
 23%|██▎       | 8573/37963 [26:43:07<101:10:16, 12.39s/it]
 23%|██▎       | 8574/37963 [26:43:17<94:59:23, 11.64s/it] 
 23%|██▎       | 8575/37963 [26:43:27<91:18:29, 11.19s/it]
 23%|██▎       | 8576/37963 [26:43:37<88:36:56, 10.86s/it]
 23%|██▎       | 8577/37963 [26:43:54<102:34:36, 12.57s/it]
 23%|██▎       | 8578/37963 [26:44:04<96:27:18, 11.82s/it] 
 23%|██▎       | 8579/37963 [26:44:13<91:00:27, 11.15s/it]
 23%|██▎       | 8580/37963 [26:44:23<88:24:35, 10.83s/it]
                                                          
{'loss': '0.1727', 'grad_norm': '1.732', 'learning_rate': '1.805e-05', 'epoch': '0.226'}

 23%|██▎       | 8580/37963 [26:44:23<88:24:35, 10.83s/it]
 23%|██▎       | 8581/37963 [26:44:34<86:49:13, 10.64s/it]
 23%|██▎       | 8582/37963 [26:44:44<85:15:38, 10.45s/it]
 23%|██▎       | 8583/37963 [26:44:54<84:21:06, 10.34s/it]
 23%|██▎       | 8584/37963 [26:45:04<83:38:51, 10.25s/it]
 23%|██▎       | 8585/37963 [26:45:14<82:48:38, 10.15s/it]
 23%|██▎       | 8586/37963 [26:45:31<99:30:54, 12.20s/it]
 23%|██▎       | 8587/37963 [26:45:41<94:38:54, 11.60s/it]
 23%|██▎       | 8588/37963 [26:45:51<90:19:11, 11.07s/it]
 23%|██▎       | 8589/37963 [26:46:01<87:53:48, 10.77s/it]
 23%|██▎       | 8590/37963 [26:46:11<85:43:14, 10.51s/it]
                                                          
{'loss': '0.1586', 'grad_norm': '1.317', 'learning_rate': '1.805e-05', 'epoch': '0.2263'}

 23%|██▎       | 8590/37963 [26:46:11<85:43:14, 10.51s/it]
 23%|██▎       | 8591/37963 [26:46:27<100:45:49, 12.35s/it]
 23%|██▎       | 8592/37963 [26:46:38<95:47:54, 11.74s/it] 
 23%|██▎       | 8593/37963 [26:46:48<91:44:57, 11.25s/it]
 23%|██▎       | 8594/37963 [26:46:58<88:41:24, 10.87s/it]
 23%|██▎       | 8595/37963 [26:47:08<86:32:25, 10.61s/it]
 23%|██▎       | 8596/37963 [26:47:18<85:19:14, 10.46s/it]
 23%|██▎       | 8597/37963 [26:47:28<83:24:03, 10.22s/it]
 23%|██▎       | 8598/37963 [26:47:38<82:58:13, 10.17s/it]
 23%|██▎       | 8599/37963 [26:47:48<83:10:45, 10.20s/it]
 23%|██▎       | 8600/37963 [26:47:58<82:56:37, 10.17s/it]
                                                          
{'loss': '0.1841', 'grad_norm': '1.79', 'learning_rate': '1.804e-05', 'epoch': '0.2265'}

 23%|██▎       | 8600/37963 [26:47:58<82:56:37, 10.17s/it]
 23%|██▎       | 8601/37963 [26:48:08<82:53:13, 10.16s/it]
 23%|██▎       | 8602/37963 [26:48:18<82:00:38, 10.06s/it]
 23%|██▎       | 8603/37963 [26:48:34<97:09:42, 11.91s/it]
 23%|██▎       | 8604/37963 [26:48:44<92:16:23, 11.31s/it]
 23%|██▎       | 8605/37963 [26:48:54<89:22:56, 10.96s/it]
 23%|██▎       | 8606/37963 [26:49:11<103:04:00, 12.64s/it]
 23%|██▎       | 8607/37963 [26:49:21<96:54:45, 11.88s/it] 
 23%|██▎       | 8608/37963 [26:49:31<92:26:24, 11.34s/it]
 23%|██▎       | 8609/37963 [26:49:41<89:08:17, 10.93s/it]
 23%|██▎       | 8610/37963 [26:49:51<87:14:07, 10.70s/it]
                                                          
{'loss': '0.1661', 'grad_norm': '0.8585', 'learning_rate': '1.804e-05', 'epoch': '0.2268'}

 23%|██▎       | 8610/37963 [26:49:51<87:14:07, 10.70s/it]
 23%|██▎       | 8611/37963 [26:50:01<85:47:21, 10.52s/it]
 23%|██▎       | 8612/37963 [26:50:11<84:55:47, 10.42s/it]
 23%|██▎       | 8613/37963 [26:50:28<99:23:01, 12.19s/it]
 23%|██▎       | 8614/37963 [26:50:38<93:51:39, 11.51s/it]
 23%|██▎       | 8615/37963 [26:50:47<89:37:31, 10.99s/it]
 23%|██▎       | 8616/37963 [26:50:58<87:48:10, 10.77s/it]
 23%|██▎       | 8617/37963 [26:51:08<86:09:42, 10.57s/it]
 23%|██▎       | 8618/37963 [26:51:18<85:06:57, 10.44s/it]
 23%|██▎       | 8619/37963 [26:51:28<83:06:51, 10.20s/it]
 23%|██▎       | 8620/37963 [26:51:38<83:02:48, 10.19s/it]
                                                          
{'loss': '0.161', 'grad_norm': '2.455', 'learning_rate': '1.803e-05', 'epoch': '0.2271'}

 23%|██▎       | 8620/37963 [26:51:38<83:02:48, 10.19s/it]
 23%|██▎       | 8621/37963 [26:51:55<99:28:24, 12.20s/it]
 23%|██▎       | 8622/37963 [26:52:05<94:17:10, 11.57s/it]
 23%|██▎       | 8623/37963 [26:52:14<89:49:14, 11.02s/it]
 23%|██▎       | 8624/37963 [26:52:25<87:36:17, 10.75s/it]
 23%|██▎       | 8625/37963 [26:52:35<85:57:36, 10.55s/it]
 23%|██▎       | 8626/37963 [26:52:51<100:09:03, 12.29s/it]
 23%|██▎       | 8627/37963 [26:53:01<93:55:23, 11.53s/it] 
 23%|██▎       | 8628/37963 [26:53:10<88:51:30, 10.90s/it]
 23%|██▎       | 8629/37963 [26:53:20<86:48:28, 10.65s/it]
 23%|██▎       | 8630/37963 [26:53:30<85:41:53, 10.52s/it]
                                                          
{'loss': '0.1601', 'grad_norm': '2.893', 'learning_rate': '1.803e-05', 'epoch': '0.2273'}

 23%|██▎       | 8630/37963 [26:53:30<85:41:53, 10.52s/it]
 23%|██▎       | 8631/37963 [26:53:41<84:40:17, 10.39s/it]
 23%|██▎       | 8632/37963 [26:53:50<83:02:28, 10.19s/it]
 23%|██▎       | 8633/37963 [26:54:00<81:55:37, 10.06s/it]
 23%|██▎       | 8634/37963 [26:54:10<81:40:34, 10.03s/it]
 23%|██▎       | 8635/37963 [26:54:20<81:16:19,  9.98s/it]
 23%|██▎       | 8636/37963 [26:54:30<81:09:05,  9.96s/it]
 23%|██▎       | 8637/37963 [26:54:40<81:22:34,  9.99s/it]
 23%|██▎       | 8638/37963 [26:55:03<114:16:36, 14.03s/it]
 23%|██▎       | 8639/37963 [26:55:20<120:31:11, 14.80s/it]
 23%|██▎       | 8640/37963 [26:55:30<109:10:02, 13.40s/it]
                                                           
{'loss': '0.1718', 'grad_norm': '1.388', 'learning_rate': '1.802e-05', 'epoch': '0.2276'}

 23%|██▎       | 8640/37963 [26:55:30<109:10:02, 13.40s/it]
 23%|██▎       | 8641/37963 [26:55:40<101:14:31, 12.43s/it]
 23%|██▎       | 8642/37963 [26:55:50<95:28:56, 11.72s/it] 
 23%|██▎       | 8643/37963 [26:56:00<91:33:23, 11.24s/it]
 23%|██▎       | 8644/37963 [26:56:10<88:40:33, 10.89s/it]
 23%|██▎       | 8645/37963 [26:56:20<86:34:39, 10.63s/it]
 23%|██▎       | 8646/37963 [26:56:30<84:14:35, 10.34s/it]
 23%|██▎       | 8647/37963 [26:56:40<82:40:28, 10.15s/it]
 23%|██▎       | 8648/37963 [26:56:50<81:48:05, 10.05s/it]
 23%|██▎       | 8649/37963 [26:57:00<81:51:15, 10.05s/it]
 23%|██▎       | 8650/37963 [26:57:09<80:30:37,  9.89s/it]
                                                          
{'loss': '0.179', 'grad_norm': '2.581', 'learning_rate': '1.802e-05', 'epoch': '0.2279'}

 23%|██▎       | 8650/37963 [26:57:09<80:30:37,  9.89s/it]
 23%|██▎       | 8651/37963 [26:57:19<80:31:20,  9.89s/it]
 23%|██▎       | 8652/37963 [26:57:35<95:38:42, 11.75s/it]
 23%|██▎       | 8653/37963 [26:57:45<91:37:23, 11.25s/it]
 23%|██▎       | 8654/37963 [26:57:55<88:36:55, 10.88s/it]
 23%|██▎       | 8655/37963 [26:58:12<102:15:14, 12.56s/it]
 23%|██▎       | 8656/37963 [26:58:22<96:15:35, 11.82s/it] 
 23%|██▎       | 8657/37963 [26:58:32<92:24:00, 11.35s/it]
 23%|██▎       | 8658/37963 [26:58:42<89:08:26, 10.95s/it]
 23%|██▎       | 8659/37963 [26:58:52<87:02:34, 10.69s/it]
 23%|██▎       | 8660/37963 [26:59:09<101:03:03, 12.41s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '1.472', 'learning_rate': '1.801e-05', 'epoch': '0.2281'}

 23%|██▎       | 8660/37963 [26:59:09<101:03:03, 12.41s/it]
 23%|██▎       | 8661/37963 [26:59:19<95:13:40, 11.70s/it] 
 23%|██▎       | 8662/37963 [26:59:29<91:07:07, 11.20s/it]
 23%|██▎       | 8663/37963 [26:59:38<87:23:06, 10.74s/it]
 23%|██▎       | 8664/37963 [26:59:48<85:29:33, 10.50s/it]
 23%|██▎       | 8665/37963 [26:59:58<84:31:52, 10.39s/it]
 23%|██▎       | 8666/37963 [27:00:08<83:01:22, 10.20s/it]
 23%|██▎       | 8667/37963 [27:00:18<82:46:00, 10.17s/it]
 23%|██▎       | 8668/37963 [27:00:28<82:34:20, 10.15s/it]
 23%|██▎       | 8669/37963 [27:00:45<99:30:48, 12.23s/it]
 23%|██▎       | 8670/37963 [27:00:55<92:55:07, 11.42s/it]
                                                          
{'loss': '0.1697', 'grad_norm': '1.055', 'learning_rate': '1.801e-05', 'epoch': '0.2284'}

 23%|██▎       | 8670/37963 [27:00:55<92:55:07, 11.42s/it]
 23%|██▎       | 8671/37963 [27:01:05<89:47:04, 11.03s/it]
 23%|██▎       | 8672/37963 [27:01:15<87:20:01, 10.73s/it]
 23%|██▎       | 8673/37963 [27:01:25<85:39:27, 10.53s/it]
 23%|██▎       | 8674/37963 [27:01:35<84:23:34, 10.37s/it]
 23%|██▎       | 8675/37963 [27:01:51<98:40:59, 12.13s/it]
 23%|██▎       | 8676/37963 [27:02:02<93:59:37, 11.55s/it]
 23%|██▎       | 8677/37963 [27:02:12<90:01:28, 11.07s/it]
 23%|██▎       | 8678/37963 [27:02:22<87:33:29, 10.76s/it]
 23%|██▎       | 8679/37963 [27:02:32<85:59:50, 10.57s/it]
 23%|██▎       | 8680/37963 [27:02:42<84:58:28, 10.45s/it]
                                                          
{'loss': '0.1687', 'grad_norm': '2.009', 'learning_rate': '1.8e-05', 'epoch': '0.2286'}

 23%|██▎       | 8680/37963 [27:02:42<84:58:28, 10.45s/it]
 23%|██▎       | 8681/37963 [27:02:52<84:01:56, 10.33s/it]
 23%|██▎       | 8682/37963 [27:03:02<83:28:28, 10.26s/it]
 23%|██▎       | 8683/37963 [27:03:12<83:06:56, 10.22s/it]
 23%|██▎       | 8684/37963 [27:03:22<82:49:44, 10.18s/it]
 23%|██▎       | 8685/37963 [27:03:32<82:34:18, 10.15s/it]
 23%|██▎       | 8686/37963 [27:03:55<113:55:32, 14.01s/it]
 23%|██▎       | 8687/37963 [27:04:12<120:54:33, 14.87s/it]
 23%|██▎       | 8688/37963 [27:04:22<109:26:09, 13.46s/it]
 23%|██▎       | 8689/37963 [27:04:32<100:36:09, 12.37s/it]
 23%|██▎       | 8690/37963 [27:04:42<95:04:20, 11.69s/it] 
                                                          
{'loss': '0.172', 'grad_norm': '2.21', 'learning_rate': '1.8e-05', 'epoch': '0.2289'}

 23%|██▎       | 8690/37963 [27:04:42<95:04:20, 11.69s/it]
 23%|██▎       | 8691/37963 [27:04:53<91:23:33, 11.24s/it]
 23%|██▎       | 8692/37963 [27:05:02<87:30:11, 10.76s/it]
 23%|██▎       | 8693/37963 [27:05:12<85:55:04, 10.57s/it]
 23%|██▎       | 8694/37963 [27:05:22<84:23:57, 10.38s/it]
 23%|██▎       | 8695/37963 [27:05:32<82:31:37, 10.15s/it]
 23%|██▎       | 8696/37963 [27:05:42<82:20:23, 10.13s/it]
 23%|██▎       | 8697/37963 [27:05:52<82:10:20, 10.11s/it]
 23%|██▎       | 8698/37963 [27:06:02<81:07:09,  9.98s/it]
 23%|██▎       | 8699/37963 [27:06:12<81:03:54,  9.97s/it]
 23%|██▎       | 8700/37963 [27:06:28<96:40:02, 11.89s/it]
                                                          
{'loss': '0.1663', 'grad_norm': '1.047', 'learning_rate': '1.799e-05', 'epoch': '0.2292'}

 23%|██▎       | 8700/37963 [27:06:28<96:40:02, 11.89s/it]
 23%|██▎       | 8701/37963 [27:06:38<91:51:49, 11.30s/it]
 23%|██▎       | 8702/37963 [27:06:55<104:39:02, 12.88s/it]
 23%|██▎       | 8703/37963 [27:07:05<98:01:21, 12.06s/it] 
 23%|██▎       | 8704/37963 [27:07:15<93:10:47, 11.46s/it]
 23%|██▎       | 8705/37963 [27:07:25<89:52:50, 11.06s/it]
 23%|██▎       | 8706/37963 [27:07:35<87:23:30, 10.75s/it]
 23%|██▎       | 8707/37963 [27:07:45<85:55:17, 10.57s/it]
 23%|██▎       | 8708/37963 [27:08:01<99:17:28, 12.22s/it]
 23%|██▎       | 8709/37963 [27:08:11<94:26:30, 11.62s/it]
 23%|██▎       | 8710/37963 [27:08:22<90:50:34, 11.18s/it]
                                                          
{'loss': '0.1664', 'grad_norm': '1.331', 'learning_rate': '1.799e-05', 'epoch': '0.2294'}

 23%|██▎       | 8710/37963 [27:08:22<90:50:34, 11.18s/it]
 23%|██▎       | 8711/37963 [27:08:31<87:44:28, 10.80s/it]
 23%|██▎       | 8712/37963 [27:08:41<85:52:46, 10.57s/it]
 23%|██▎       | 8713/37963 [27:08:52<84:37:39, 10.42s/it]
 23%|██▎       | 8714/37963 [27:09:01<82:28:19, 10.15s/it]
 23%|██▎       | 8715/37963 [27:09:11<82:39:36, 10.17s/it]
 23%|██▎       | 8716/37963 [27:09:28<99:19:48, 12.23s/it]
 23%|██▎       | 8717/37963 [27:09:38<94:14:34, 11.60s/it]
 23%|██▎       | 8718/37963 [27:09:48<90:21:24, 11.12s/it]
 23%|██▎       | 8719/37963 [27:09:58<87:25:49, 10.76s/it]
 23%|██▎       | 8720/37963 [27:10:08<85:50:16, 10.57s/it]
                                                          
{'loss': '0.1638', 'grad_norm': '1.179', 'learning_rate': '1.798e-05', 'epoch': '0.2297'}

 23%|██▎       | 8720/37963 [27:10:08<85:50:16, 10.57s/it]
 23%|██▎       | 8721/37963 [27:10:18<84:23:07, 10.39s/it]
 23%|██▎       | 8722/37963 [27:10:28<83:01:41, 10.22s/it]
 23%|██▎       | 8723/37963 [27:10:38<82:34:33, 10.17s/it]
 23%|██▎       | 8724/37963 [27:10:55<98:10:17, 12.09s/it]
 23%|██▎       | 8725/37963 [27:11:05<93:29:28, 11.51s/it]
 23%|██▎       | 8726/37963 [27:11:15<89:36:26, 11.03s/it]
 23%|██▎       | 8727/37963 [27:11:25<87:46:37, 10.81s/it]
 23%|██▎       | 8728/37963 [27:11:35<86:16:43, 10.62s/it]
 23%|██▎       | 8729/37963 [27:11:45<84:39:26, 10.43s/it]
 23%|██▎       | 8730/37963 [27:11:55<83:46:05, 10.32s/it]
                                                          
{'loss': '0.1689', 'grad_norm': '1.123', 'learning_rate': '1.798e-05', 'epoch': '0.23'}

 23%|██▎       | 8730/37963 [27:11:55<83:46:05, 10.32s/it]
 23%|██▎       | 8731/37963 [27:12:06<83:18:47, 10.26s/it]
 23%|██▎       | 8732/37963 [27:12:16<82:53:40, 10.21s/it]
 23%|██▎       | 8733/37963 [27:12:26<82:08:46, 10.12s/it]
 23%|██▎       | 8734/37963 [27:12:49<113:29:42, 13.98s/it]
 23%|██▎       | 8735/37963 [27:13:05<120:11:29, 14.80s/it]
 23%|██▎       | 8736/37963 [27:13:15<108:40:08, 13.39s/it]
 23%|██▎       | 8737/37963 [27:13:25<100:17:08, 12.35s/it]
 23%|██▎       | 8738/37963 [27:13:35<94:41:21, 11.66s/it] 
 23%|██▎       | 8739/37963 [27:13:46<91:05:12, 11.22s/it]
 23%|██▎       | 8740/37963 [27:13:56<88:08:55, 10.86s/it]
                                                          
{'loss': '0.1715', 'grad_norm': '1.728', 'learning_rate': '1.797e-05', 'epoch': '0.2302'}

 23%|██▎       | 8740/37963 [27:13:56<88:08:55, 10.86s/it]
 23%|██▎       | 8741/37963 [27:14:06<86:01:33, 10.60s/it]
 23%|██▎       | 8742/37963 [27:14:16<84:45:51, 10.44s/it]
 23%|██▎       | 8743/37963 [27:14:26<83:48:05, 10.32s/it]
 23%|██▎       | 8744/37963 [27:14:36<83:03:50, 10.23s/it]
 23%|██▎       | 8745/37963 [27:14:46<82:50:06, 10.21s/it]
 23%|██▎       | 8746/37963 [27:14:56<82:28:24, 10.16s/it]
 23%|██▎       | 8747/37963 [27:15:06<82:18:08, 10.14s/it]
 23%|██▎       | 8748/37963 [27:15:22<96:41:32, 11.91s/it]
 23%|██▎       | 8749/37963 [27:15:38<107:29:11, 13.25s/it]
 23%|██▎       | 8750/37963 [27:15:49<100:04:25, 12.33s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '1.937', 'learning_rate': '1.797e-05', 'epoch': '0.2305'}

 23%|██▎       | 8750/37963 [27:15:49<100:04:25, 12.33s/it]
 23%|██▎       | 8751/37963 [27:15:59<94:16:35, 11.62s/it] 
 23%|██▎       | 8752/37963 [27:16:09<90:30:23, 11.15s/it]
 23%|██▎       | 8753/37963 [27:16:19<87:54:20, 10.83s/it]
 23%|██▎       | 8754/37963 [27:16:29<86:32:47, 10.67s/it]
 23%|██▎       | 8755/37963 [27:16:46<100:47:42, 12.42s/it]
 23%|██▎       | 8756/37963 [27:16:56<95:30:30, 11.77s/it] 
 23%|██▎       | 8757/37963 [27:17:06<91:50:02, 11.32s/it]
 23%|██▎       | 8758/37963 [27:17:16<89:01:59, 10.97s/it]
 23%|██▎       | 8759/37963 [27:17:26<86:41:32, 10.69s/it]
 23%|██▎       | 8760/37963 [27:17:36<85:12:33, 10.50s/it]
                                                          
{'loss': '0.1684', 'grad_norm': '1.302', 'learning_rate': '1.796e-05', 'epoch': '0.2308'}

 23%|██▎       | 8760/37963 [27:17:36<85:12:33, 10.50s/it]
 23%|██▎       | 8761/37963 [27:17:46<83:19:11, 10.27s/it]
 23%|██▎       | 8762/37963 [27:17:56<82:46:17, 10.20s/it]
 23%|██▎       | 8763/37963 [27:18:06<82:43:08, 10.20s/it]
 23%|██▎       | 8764/37963 [27:18:16<82:22:22, 10.16s/it]
 23%|██▎       | 8765/37963 [27:18:33<98:39:33, 12.16s/it]
 23%|██▎       | 8766/37963 [27:18:43<93:41:49, 11.55s/it]
 23%|██▎       | 8767/37963 [27:18:53<90:07:38, 11.11s/it]
 23%|██▎       | 8768/37963 [27:19:03<87:07:42, 10.74s/it]
 23%|██▎       | 8769/37963 [27:19:13<84:34:25, 10.43s/it]
 23%|██▎       | 8770/37963 [27:19:23<84:02:08, 10.36s/it]
                                                          
{'loss': '0.1725', 'grad_norm': '1.39', 'learning_rate': '1.796e-05', 'epoch': '0.231'}

 23%|██▎       | 8770/37963 [27:19:23<84:02:08, 10.36s/it]
 23%|██▎       | 8771/37963 [27:19:33<83:18:21, 10.27s/it]
 23%|██▎       | 8772/37963 [27:19:43<82:50:18, 10.22s/it]
 23%|██▎       | 8773/37963 [27:20:00<97:47:07, 12.06s/it]
 23%|██▎       | 8774/37963 [27:20:10<93:07:21, 11.49s/it]
 23%|██▎       | 8775/37963 [27:20:20<89:59:11, 11.10s/it]
 23%|██▎       | 8776/37963 [27:20:30<87:30:51, 10.79s/it]
 23%|██▎       | 8777/37963 [27:20:40<85:55:21, 10.60s/it]
 23%|██▎       | 8778/37963 [27:20:50<84:39:33, 10.44s/it]
 23%|██▎       | 8779/37963 [27:21:00<83:50:49, 10.34s/it]
 23%|██▎       | 8780/37963 [27:21:11<83:22:53, 10.29s/it]
                                                          
{'loss': '0.1603', 'grad_norm': '1.303', 'learning_rate': '1.795e-05', 'epoch': '0.2313'}

 23%|██▎       | 8780/37963 [27:21:11<83:22:53, 10.29s/it]
 23%|██▎       | 8781/37963 [27:21:21<82:40:58, 10.20s/it]
 23%|██▎       | 8782/37963 [27:21:38<99:01:08, 12.22s/it]
 23%|██▎       | 8783/37963 [27:21:54<108:58:22, 13.44s/it]
 23%|██▎       | 8784/37963 [27:22:04<100:49:57, 12.44s/it]
 23%|██▎       | 8785/37963 [27:22:21<112:25:34, 13.87s/it]
 23%|██▎       | 8786/37963 [27:22:31<102:14:38, 12.62s/it]
 23%|██▎       | 8787/37963 [27:22:40<94:52:44, 11.71s/it] 
 23%|██▎       | 8788/37963 [27:22:50<90:49:34, 11.21s/it]
 23%|██▎       | 8789/37963 [27:23:00<87:58:41, 10.86s/it]
 23%|██▎       | 8790/37963 [27:23:10<85:04:03, 10.50s/it]
                                                          
{'loss': '0.1786', 'grad_norm': '0.9715', 'learning_rate': '1.794e-05', 'epoch': '0.2315'}

 23%|██▎       | 8790/37963 [27:23:10<85:04:03, 10.50s/it]
 23%|██▎       | 8791/37963 [27:23:20<83:57:33, 10.36s/it]
 23%|██▎       | 8792/37963 [27:23:30<83:25:06, 10.29s/it]
 23%|██▎       | 8793/37963 [27:23:40<82:56:06, 10.24s/it]
 23%|██▎       | 8794/37963 [27:23:51<82:37:44, 10.20s/it]
 23%|██▎       | 8795/37963 [27:24:01<82:27:09, 10.18s/it]
 23%|██▎       | 8796/37963 [27:24:11<82:11:49, 10.15s/it]
 23%|██▎       | 8797/37963 [27:24:21<81:59:43, 10.12s/it]
 23%|██▎       | 8798/37963 [27:24:37<96:36:52, 11.93s/it]
 23%|██▎       | 8799/37963 [27:24:54<108:26:29, 13.39s/it]
 23%|██▎       | 8800/37963 [27:25:04<100:31:57, 12.41s/it]
                                                           
{'loss': '0.166', 'grad_norm': '3.321', 'learning_rate': '1.794e-05', 'epoch': '0.2318'}

 23%|██▎       | 8800/37963 [27:25:04<100:31:57, 12.41s/it]
 23%|██▎       | 8801/37963 [27:25:14<94:57:41, 11.72s/it] 
 23%|██▎       | 8802/37963 [27:25:24<90:55:39, 11.23s/it]
 23%|██▎       | 8803/37963 [27:25:41<104:25:27, 12.89s/it]
 23%|██▎       | 8804/37963 [27:25:51<97:51:36, 12.08s/it] 
 23%|██▎       | 8805/37963 [27:26:01<93:05:07, 11.49s/it]
 23%|██▎       | 8806/37963 [27:26:11<88:43:27, 10.95s/it]
 23%|██▎       | 8807/37963 [27:26:21<86:41:05, 10.70s/it]
 23%|██▎       | 8808/37963 [27:26:31<84:35:32, 10.45s/it]
 23%|██▎       | 8809/37963 [27:26:41<83:46:14, 10.34s/it]
 23%|██▎       | 8810/37963 [27:26:51<82:37:34, 10.20s/it]
                                                          
{'loss': '0.1965', 'grad_norm': '2.596', 'learning_rate': '1.793e-05', 'epoch': '0.2321'}

 23%|██▎       | 8810/37963 [27:26:51<82:37:34, 10.20s/it]
 23%|██▎       | 8811/37963 [27:27:01<82:11:33, 10.15s/it]
 23%|██▎       | 8812/37963 [27:27:11<81:58:48, 10.12s/it]
 23%|██▎       | 8813/37963 [27:27:21<81:36:27, 10.08s/it]
 23%|██▎       | 8814/37963 [27:27:38<98:20:32, 12.15s/it]
 23%|██▎       | 8815/37963 [27:27:48<94:00:41, 11.61s/it]
 23%|██▎       | 8816/37963 [27:27:58<90:14:04, 11.15s/it]
 23%|██▎       | 8817/37963 [27:28:08<86:56:29, 10.74s/it]
 23%|██▎       | 8818/37963 [27:28:18<85:35:10, 10.57s/it]
 23%|██▎       | 8819/37963 [27:28:28<82:50:26, 10.23s/it]
 23%|██▎       | 8820/37963 [27:28:38<82:12:58, 10.16s/it]
                                                          
{'loss': '0.1638', 'grad_norm': '1.42', 'learning_rate': '1.793e-05', 'epoch': '0.2323'}

 23%|██▎       | 8820/37963 [27:28:38<82:12:58, 10.16s/it]
 23%|██▎       | 8821/37963 [27:28:54<97:41:20, 12.07s/it]
 23%|██▎       | 8822/37963 [27:29:04<93:11:44, 11.51s/it]
 23%|██▎       | 8823/37963 [27:29:15<89:51:23, 11.10s/it]
 23%|██▎       | 8824/37963 [27:29:25<87:26:00, 10.80s/it]
 23%|██▎       | 8825/37963 [27:29:35<85:59:05, 10.62s/it]
 23%|██▎       | 8826/37963 [27:29:45<84:54:18, 10.49s/it]
 23%|██▎       | 8827/37963 [27:29:55<83:14:32, 10.29s/it]
 23%|██▎       | 8828/37963 [27:30:05<82:20:59, 10.18s/it]
 23%|██▎       | 8829/37963 [27:30:21<96:38:13, 11.94s/it]
 23%|██▎       | 8830/37963 [27:30:31<92:15:34, 11.40s/it]
                                                          
{'loss': '0.1582', 'grad_norm': '1.462', 'learning_rate': '1.792e-05', 'epoch': '0.2326'}

 23%|██▎       | 8830/37963 [27:30:31<92:15:34, 11.40s/it]
 23%|██▎       | 8831/37963 [27:30:41<88:27:25, 10.93s/it]
 23%|██▎       | 8832/37963 [27:30:51<86:36:39, 10.70s/it]
 23%|██▎       | 8833/37963 [27:31:14<116:53:55, 14.45s/it]
 23%|██▎       | 8834/37963 [27:31:24<106:19:19, 13.14s/it]
 23%|██▎       | 8835/37963 [27:31:34<99:00:47, 12.24s/it] 
 23%|██▎       | 8836/37963 [27:31:44<93:08:59, 11.51s/it]
 23%|██▎       | 8837/37963 [27:31:55<90:23:05, 11.17s/it]
 23%|██▎       | 8838/37963 [27:32:04<87:15:39, 10.79s/it]
 23%|██▎       | 8839/37963 [27:32:15<85:35:49, 10.58s/it]
 23%|██▎       | 8840/37963 [27:32:24<83:42:02, 10.35s/it]
                                                          
{'loss': '0.1657', 'grad_norm': '6.334', 'learning_rate': '1.792e-05', 'epoch': '0.2329'}

 23%|██▎       | 8840/37963 [27:32:24<83:42:02, 10.35s/it]
 23%|██▎       | 8841/37963 [27:32:34<83:06:49, 10.27s/it]
 23%|██▎       | 8842/37963 [27:32:44<82:16:02, 10.17s/it]
 23%|██▎       | 8843/37963 [27:32:54<81:51:22, 10.12s/it]
 23%|██▎       | 8844/37963 [27:33:05<82:00:11, 10.14s/it]
 23%|██▎       | 8845/37963 [27:33:15<82:06:33, 10.15s/it]
 23%|██▎       | 8846/37963 [27:33:25<81:56:41, 10.13s/it]
 23%|██▎       | 8847/37963 [27:33:41<96:54:49, 11.98s/it]
 23%|██▎       | 8848/37963 [27:33:58<108:45:42, 13.45s/it]
 23%|██▎       | 8849/37963 [27:34:08<100:42:21, 12.45s/it]
 23%|██▎       | 8850/37963 [27:34:18<94:56:53, 11.74s/it] 
                                                          
{'loss': '0.1714', 'grad_norm': '1.402', 'learning_rate': '1.791e-05', 'epoch': '0.2331'}

 23%|██▎       | 8850/37963 [27:34:18<94:56:53, 11.74s/it]
 23%|██▎       | 8851/37963 [27:34:34<105:22:56, 13.03s/it]
 23%|██▎       | 8852/37963 [27:34:44<98:13:47, 12.15s/it] 
 23%|██▎       | 8853/37963 [27:34:54<93:12:23, 11.53s/it]
 23%|██▎       | 8854/37963 [27:35:04<89:40:54, 11.09s/it]
 23%|██▎       | 8855/37963 [27:35:14<87:02:32, 10.77s/it]
 23%|██▎       | 8856/37963 [27:35:24<84:44:23, 10.48s/it]
 23%|██▎       | 8857/37963 [27:35:34<83:33:43, 10.34s/it]
 23%|██▎       | 8858/37963 [27:35:44<82:48:36, 10.24s/it]
 23%|██▎       | 8859/37963 [27:35:54<82:23:41, 10.19s/it]
 23%|██▎       | 8860/37963 [27:36:05<82:26:19, 10.20s/it]
                                                          
{'loss': '0.1744', 'grad_norm': '3.456', 'learning_rate': '1.791e-05', 'epoch': '0.2334'}

 23%|██▎       | 8860/37963 [27:36:05<82:26:19, 10.20s/it]
 23%|██▎       | 8861/37963 [27:36:21<97:43:49, 12.09s/it]
 23%|██▎       | 8862/37963 [27:36:31<92:59:43, 11.50s/it]
 23%|██▎       | 8863/37963 [27:36:42<90:03:08, 11.14s/it]
 23%|██▎       | 8864/37963 [27:36:52<87:55:46, 10.88s/it]
 23%|██▎       | 8865/37963 [27:37:02<86:00:22, 10.64s/it]
 23%|██▎       | 8866/37963 [27:37:12<84:50:36, 10.50s/it]
 23%|██▎       | 8867/37963 [27:37:22<83:52:56, 10.38s/it]
 23%|██▎       | 8868/37963 [27:37:32<83:39:50, 10.35s/it]
 23%|██▎       | 8869/37963 [27:37:49<98:17:11, 12.16s/it]
 23%|██▎       | 8870/37963 [27:37:59<93:17:22, 11.54s/it]
                                                          
{'loss': '0.1716', 'grad_norm': '2.348', 'learning_rate': '1.79e-05', 'epoch': '0.2336'}

 23%|██▎       | 8870/37963 [27:37:59<93:17:22, 11.54s/it]
 23%|██▎       | 8871/37963 [27:38:09<89:44:53, 11.11s/it]
 23%|██▎       | 8872/37963 [27:38:19<86:07:32, 10.66s/it]
 23%|██▎       | 8873/37963 [27:38:29<84:52:32, 10.50s/it]
 23%|██▎       | 8874/37963 [27:38:39<83:44:23, 10.36s/it]
 23%|██▎       | 8875/37963 [27:38:49<83:13:15, 10.30s/it]
 23%|██▎       | 8876/37963 [27:39:05<98:13:15, 12.16s/it]
 23%|██▎       | 8877/37963 [27:39:15<92:58:46, 11.51s/it]
 23%|██▎       | 8878/37963 [27:39:26<89:45:34, 11.11s/it]
 23%|██▎       | 8879/37963 [27:39:36<87:13:21, 10.80s/it]
 23%|██▎       | 8880/37963 [27:39:46<85:09:03, 10.54s/it]
                                                          
{'loss': '0.172', 'grad_norm': '5.273', 'learning_rate': '1.79e-05', 'epoch': '0.2339'}

 23%|██▎       | 8880/37963 [27:39:46<85:09:03, 10.54s/it]
 23%|██▎       | 8881/37963 [27:40:09<115:49:31, 14.34s/it]
 23%|██▎       | 8882/37963 [27:40:19<105:15:32, 13.03s/it]
 23%|██▎       | 8883/37963 [27:40:29<98:08:59, 12.15s/it] 
 23%|██▎       | 8884/37963 [27:40:39<92:31:34, 11.45s/it]
 23%|██▎       | 8885/37963 [27:40:49<89:10:23, 11.04s/it]
 23%|██▎       | 8886/37963 [27:40:58<85:45:00, 10.62s/it]
 23%|██▎       | 8887/37963 [27:41:09<84:29:10, 10.46s/it]
 23%|██▎       | 8888/37963 [27:41:18<83:02:44, 10.28s/it]
 23%|██▎       | 8889/37963 [27:41:28<82:33:47, 10.22s/it]
 23%|██▎       | 8890/37963 [27:41:38<81:50:13, 10.13s/it]
                                                          
{'loss': '0.1643', 'grad_norm': '5.241', 'learning_rate': '1.789e-05', 'epoch': '0.2342'}

 23%|██▎       | 8890/37963 [27:41:38<81:50:13, 10.13s/it]
 23%|██▎       | 8891/37963 [27:41:49<81:51:14, 10.14s/it]
 23%|██▎       | 8892/37963 [27:41:58<81:11:35, 10.05s/it]
 23%|██▎       | 8893/37963 [27:42:08<79:26:41,  9.84s/it]
 23%|██▎       | 8894/37963 [27:42:17<78:59:33,  9.78s/it]
 23%|██▎       | 8895/37963 [27:42:27<79:46:28,  9.88s/it]
 23%|██▎       | 8896/37963 [27:42:50<111:14:39, 13.78s/it]
 23%|██▎       | 8897/37963 [27:43:01<102:25:47, 12.69s/it]
 23%|██▎       | 8898/37963 [27:43:10<95:50:39, 11.87s/it] 
 23%|██▎       | 8899/37963 [27:43:21<91:39:29, 11.35s/it]
 23%|██▎       | 8900/37963 [27:43:37<103:55:27, 12.87s/it]
                                                           
{'loss': '0.1758', 'grad_norm': '1.16', 'learning_rate': '1.789e-05', 'epoch': '0.2344'}

 23%|██▎       | 8900/37963 [27:43:37<103:55:27, 12.87s/it]
 23%|██▎       | 8901/37963 [27:43:47<97:11:19, 12.04s/it] 
 23%|██▎       | 8902/37963 [27:43:57<92:52:30, 11.51s/it]
 23%|██▎       | 8903/37963 [27:44:08<89:38:10, 11.10s/it]
 23%|██▎       | 8904/37963 [27:44:18<87:14:34, 10.81s/it]
 23%|██▎       | 8905/37963 [27:44:28<85:32:10, 10.60s/it]
 23%|██▎       | 8906/37963 [27:44:38<84:12:31, 10.43s/it]
 23%|██▎       | 8907/37963 [27:44:48<83:20:48, 10.33s/it]
 23%|██▎       | 8908/37963 [27:44:58<82:57:25, 10.28s/it]
 23%|██▎       | 8909/37963 [27:45:08<82:31:02, 10.22s/it]
 23%|██▎       | 8910/37963 [27:45:25<98:48:42, 12.24s/it]
                                                          
{'loss': '0.1781', 'grad_norm': '4.818', 'learning_rate': '1.788e-05', 'epoch': '0.2347'}

 23%|██▎       | 8910/37963 [27:45:25<98:48:42, 12.24s/it]
 23%|██▎       | 8911/37963 [27:45:35<93:42:50, 11.61s/it]
 23%|██▎       | 8912/37963 [27:45:45<90:04:45, 11.16s/it]
 23%|██▎       | 8913/37963 [27:45:55<87:31:49, 10.85s/it]
 23%|██▎       | 8914/37963 [27:46:06<85:42:00, 10.62s/it]
 23%|██▎       | 8915/37963 [27:46:16<84:16:28, 10.44s/it]
 23%|██▎       | 8916/37963 [27:46:26<83:18:11, 10.32s/it]
 23%|██▎       | 8917/37963 [27:46:35<81:55:30, 10.15s/it]
 23%|██▎       | 8918/37963 [27:46:52<96:54:43, 12.01s/it]
 23%|██▎       | 8919/37963 [27:47:02<92:08:49, 11.42s/it]
 23%|██▎       | 8920/37963 [27:47:12<88:47:47, 11.01s/it]
                                                          
{'loss': '0.1722', 'grad_norm': '3.217', 'learning_rate': '1.788e-05', 'epoch': '0.235'}

 23%|██▎       | 8920/37963 [27:47:12<88:47:47, 11.01s/it]
 23%|██▎       | 8921/37963 [27:47:22<86:28:03, 10.72s/it]
 24%|██▎       | 8922/37963 [27:47:32<84:54:41, 10.53s/it]
 24%|██▎       | 8923/37963 [27:47:48<98:56:44, 12.27s/it]
 24%|██▎       | 8924/37963 [27:47:58<92:30:08, 11.47s/it]
 24%|██▎       | 8925/37963 [27:48:07<87:57:39, 10.91s/it]
 24%|██▎       | 8926/37963 [27:48:18<86:04:42, 10.67s/it]
 24%|██▎       | 8927/37963 [27:48:27<83:42:20, 10.38s/it]
 24%|██▎       | 8928/37963 [27:48:37<82:59:00, 10.29s/it]
 24%|██▎       | 8929/37963 [27:48:54<98:47:44, 12.25s/it]
 24%|██▎       | 8930/37963 [27:49:11<110:46:48, 13.74s/it]
                                                           
{'loss': '0.1665', 'grad_norm': '1.585', 'learning_rate': '1.787e-05', 'epoch': '0.2352'}

 24%|██▎       | 8930/37963 [27:49:11<110:46:48, 13.74s/it]
 24%|██▎       | 8931/37963 [27:49:22<102:02:10, 12.65s/it]
 24%|██▎       | 8932/37963 [27:49:32<95:52:20, 11.89s/it] 
 24%|██▎       | 8933/37963 [27:49:42<91:32:08, 11.35s/it]
 24%|██▎       | 8934/37963 [27:49:51<87:36:31, 10.86s/it]
 24%|██▎       | 8935/37963 [27:50:02<85:36:17, 10.62s/it]
 24%|██▎       | 8936/37963 [27:50:11<83:59:36, 10.42s/it]
 24%|██▎       | 8937/37963 [27:50:22<83:05:50, 10.31s/it]
 24%|██▎       | 8938/37963 [27:50:31<81:40:41, 10.13s/it]
 24%|██▎       | 8939/37963 [27:50:41<81:14:27, 10.08s/it]
 24%|██▎       | 8940/37963 [27:50:51<81:27:23, 10.10s/it]
                                                          
{'loss': '0.1605', 'grad_norm': '6.035', 'learning_rate': '1.787e-05', 'epoch': '0.2355'}

 24%|██▎       | 8940/37963 [27:50:51<81:27:23, 10.10s/it]
 24%|██▎       | 8941/37963 [27:51:08<97:15:24, 12.06s/it]
 24%|██▎       | 8942/37963 [27:51:18<91:54:26, 11.40s/it]
 24%|██▎       | 8943/37963 [27:51:34<104:05:33, 12.91s/it]
 24%|██▎       | 8944/37963 [27:51:44<96:55:08, 12.02s/it] 
 24%|██▎       | 8945/37963 [27:51:54<92:12:41, 11.44s/it]
 24%|██▎       | 8946/37963 [27:52:04<88:07:10, 10.93s/it]
 24%|██▎       | 8947/37963 [27:52:21<101:49:53, 12.63s/it]
 24%|██▎       | 8948/37963 [27:52:31<95:46:26, 11.88s/it] 
 24%|██▎       | 8949/37963 [27:52:41<91:27:11, 11.35s/it]
 24%|██▎       | 8950/37963 [27:52:50<87:03:49, 10.80s/it]
                                                          
{'loss': '0.183', 'grad_norm': '2.056', 'learning_rate': '1.786e-05', 'epoch': '0.2358'}

 24%|██▎       | 8950/37963 [27:52:50<87:03:49, 10.80s/it]
 24%|██▎       | 8951/37963 [27:53:01<85:19:47, 10.59s/it]
 24%|██▎       | 8952/37963 [27:53:10<82:46:40, 10.27s/it]
 24%|██▎       | 8953/37963 [27:53:20<82:17:19, 10.21s/it]
 24%|██▎       | 8954/37963 [27:53:30<81:34:12, 10.12s/it]
 24%|██▎       | 8955/37963 [27:53:40<81:23:30, 10.10s/it]
 24%|██▎       | 8956/37963 [27:53:50<81:23:01, 10.10s/it]
 24%|██▎       | 8957/37963 [27:54:00<81:08:21, 10.07s/it]
 24%|██▎       | 8958/37963 [27:54:17<96:46:13, 12.01s/it]
 24%|██▎       | 8959/37963 [27:54:27<92:23:04, 11.47s/it]
 24%|██▎       | 8960/37963 [27:54:37<88:58:34, 11.04s/it]
                                                          
{'loss': '0.1618', 'grad_norm': '3.612', 'learning_rate': '1.786e-05', 'epoch': '0.236'}

 24%|██▎       | 8960/37963 [27:54:37<88:58:34, 11.04s/it]
 24%|██▎       | 8961/37963 [27:54:47<86:08:59, 10.69s/it]
 24%|██▎       | 8962/37963 [27:54:57<84:42:45, 10.52s/it]
 24%|██▎       | 8963/37963 [27:55:07<83:18:59, 10.34s/it]
 24%|██▎       | 8964/37963 [27:55:17<82:09:06, 10.20s/it]
 24%|██▎       | 8965/37963 [27:55:27<81:45:25, 10.15s/it]
 24%|██▎       | 8966/37963 [27:55:37<81:46:31, 10.15s/it]
 24%|██▎       | 8967/37963 [27:55:53<96:54:11, 12.03s/it]
 24%|██▎       | 8968/37963 [27:56:03<90:44:44, 11.27s/it]
 24%|██▎       | 8969/37963 [27:56:13<87:50:15, 10.91s/it]
 24%|██▎       | 8970/37963 [27:56:23<85:29:48, 10.62s/it]
                                                          
{'loss': '0.177', 'grad_norm': '2.572', 'learning_rate': '1.785e-05', 'epoch': '0.2363'}

 24%|██▎       | 8970/37963 [27:56:23<85:29:48, 10.62s/it]
 24%|██▎       | 8971/37963 [27:56:40<100:07:18, 12.43s/it]
 24%|██▎       | 8972/37963 [27:56:50<94:40:59, 11.76s/it] 
 24%|██▎       | 8973/37963 [27:57:00<91:21:35, 11.35s/it]
 24%|██▎       | 8974/37963 [27:57:10<87:49:53, 10.91s/it]
 24%|██▎       | 8975/37963 [27:57:20<85:45:42, 10.65s/it]
 24%|██▎       | 8976/37963 [27:57:30<84:09:19, 10.45s/it]
 24%|██▎       | 8977/37963 [27:57:53<115:02:03, 14.29s/it]
 24%|██▎       | 8978/37963 [27:58:03<104:05:20, 12.93s/it]
 24%|██▎       | 8979/37963 [27:58:13<97:18:54, 12.09s/it] 
 24%|██▎       | 8980/37963 [27:58:23<92:40:00, 11.51s/it]
                                                          
{'loss': '0.1877', 'grad_norm': '2.76', 'learning_rate': '1.785e-05', 'epoch': '0.2365'}

 24%|██▎       | 8980/37963 [27:58:23<92:40:00, 11.51s/it]
 24%|██▎       | 8981/37963 [27:58:33<89:13:07, 11.08s/it]
 24%|██▎       | 8982/37963 [27:58:44<86:56:45, 10.80s/it]
 24%|██▎       | 8983/37963 [27:58:54<85:29:08, 10.62s/it]
 24%|██▎       | 8984/37963 [27:59:04<84:01:39, 10.44s/it]
 24%|██▎       | 8985/37963 [27:59:14<82:54:23, 10.30s/it]
 24%|██▎       | 8986/37963 [27:59:24<82:41:16, 10.27s/it]
 24%|██▎       | 8987/37963 [27:59:33<80:36:10, 10.01s/it]
 24%|██▎       | 8988/37963 [27:59:44<80:58:30, 10.06s/it]
 24%|██▎       | 8989/37963 [28:00:00<96:05:58, 11.94s/it]
 24%|██▎       | 8990/37963 [28:00:10<91:21:28, 11.35s/it]
                                                          
{'loss': '0.172', 'grad_norm': '0.965', 'learning_rate': '1.784e-05', 'epoch': '0.2368'}

 24%|██▎       | 8990/37963 [28:00:10<91:21:28, 11.35s/it]
 24%|██▎       | 8991/37963 [28:00:20<87:23:38, 10.86s/it]
 24%|██▎       | 8992/37963 [28:00:29<84:58:08, 10.56s/it]
 24%|██▎       | 8993/37963 [28:00:46<98:52:29, 12.29s/it]
 24%|██▎       | 8994/37963 [28:00:56<93:01:41, 11.56s/it]
 24%|██▎       | 8995/37963 [28:01:12<105:22:32, 13.10s/it]
 24%|██▎       | 8996/37963 [28:01:22<97:41:58, 12.14s/it] 
 24%|██▎       | 8997/37963 [28:01:32<92:37:36, 11.51s/it]
 24%|██▎       | 8998/37963 [28:01:42<88:29:34, 11.00s/it]
 24%|██▎       | 8999/37963 [28:01:52<86:29:17, 10.75s/it]
 24%|██▎       | 9000/37963 [28:02:02<85:02:46, 10.57s/it]
                                                          
{'loss': '0.1694', 'grad_norm': '5.327', 'learning_rate': '1.783e-05', 'epoch': '0.2371'}

 24%|██▎       | 9000/37963 [28:02:02<85:02:46, 10.57s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.28s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.28s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 24%|██▎       | 9001/37963 [28:03:02<204:18:06, 25.39s/it]
 24%|██▎       | 9002/37963 [28:03:13<167:40:02, 20.84s/it]
 24%|██▎       | 9003/37963 [28:03:24<144:22:28, 17.95s/it]
 24%|██▎       | 9004/37963 [28:03:34<126:59:44, 15.79s/it]
 24%|██▎       | 9005/37963 [28:03:45<113:22:07, 14.09s/it]
 24%|██▎       | 9006/37963 [28:04:02<120:42:22, 15.01s/it]
 24%|██▎       | 9007/37963 [28:04:12<108:48:16, 13.53s/it]
 24%|██▎       | 9008/37963 [28:04:21<99:24:58, 12.36s/it] 
 24%|██▎       | 9009/37963 [28:04:32<93:56:54, 11.68s/it]
 24%|██▎       | 9010/37963 [28:04:42<90:05:40, 11.20s/it]
                                                          
{'loss': '0.1726', 'grad_norm': '1.836', 'learning_rate': '1.783e-05', 'epoch': '0.2373'}

 24%|██▎       | 9010/37963 [28:04:42<90:05:40, 11.20s/it]
 24%|██▎       | 9011/37963 [28:04:52<87:36:40, 10.89s/it]
 24%|██▎       | 9012/37963 [28:05:02<85:13:11, 10.60s/it]
 24%|██▎       | 9013/37963 [28:05:12<83:56:17, 10.44s/it]
 24%|██▎       | 9014/37963 [28:05:22<82:37:18, 10.27s/it]
 24%|██▎       | 9015/37963 [28:05:32<82:20:46, 10.24s/it]
 24%|██▎       | 9016/37963 [28:05:48<97:34:57, 12.14s/it]
 24%|██▍       | 9017/37963 [28:06:05<109:10:58, 13.58s/it]
 24%|██▍       | 9018/37963 [28:06:16<101:03:44, 12.57s/it]
 24%|██▍       | 9019/37963 [28:06:26<94:52:36, 11.80s/it] 
 24%|██▍       | 9020/37963 [28:06:36<90:42:54, 11.28s/it]
                                                          
{'loss': '0.1671', 'grad_norm': '2.894', 'learning_rate': '1.782e-05', 'epoch': '0.2376'}

 24%|██▍       | 9020/37963 [28:06:36<90:42:54, 11.28s/it]
 24%|██▍       | 9021/37963 [28:06:46<87:52:11, 10.93s/it]
 24%|██▍       | 9022/37963 [28:06:56<85:09:02, 10.59s/it]
 24%|██▍       | 9023/37963 [28:07:06<84:12:44, 10.48s/it]
 24%|██▍       | 9024/37963 [28:07:22<99:00:35, 12.32s/it]
 24%|██▍       | 9025/37963 [28:07:39<110:01:21, 13.69s/it]
 24%|██▍       | 9026/37963 [28:07:49<101:20:21, 12.61s/it]
 24%|██▍       | 9027/37963 [28:07:59<95:10:32, 11.84s/it] 
 24%|██▍       | 9028/37963 [28:08:09<90:57:22, 11.32s/it]
 24%|██▍       | 9029/37963 [28:08:20<87:59:25, 10.95s/it]
 24%|██▍       | 9030/37963 [28:08:30<85:45:41, 10.67s/it]
                                                          
{'loss': '0.1727', 'grad_norm': '4.427', 'learning_rate': '1.782e-05', 'epoch': '0.2379'}

 24%|██▍       | 9030/37963 [28:08:30<85:45:41, 10.67s/it]
 24%|██▍       | 9031/37963 [28:08:40<84:21:30, 10.50s/it]
 24%|██▍       | 9032/37963 [28:08:50<83:20:31, 10.37s/it]
 24%|██▍       | 9033/37963 [28:09:00<82:37:10, 10.28s/it]
 24%|██▍       | 9034/37963 [28:09:10<82:03:23, 10.21s/it]
 24%|██▍       | 9035/37963 [28:09:20<81:38:44, 10.16s/it]
 24%|██▍       | 9036/37963 [28:09:36<96:05:04, 11.96s/it]
 24%|██▍       | 9037/37963 [28:09:46<91:07:18, 11.34s/it]
 24%|██▍       | 9038/37963 [28:09:56<88:09:19, 10.97s/it]
 24%|██▍       | 9039/37963 [28:10:06<86:04:21, 10.71s/it]
 24%|██▍       | 9040/37963 [28:10:23<99:32:20, 12.39s/it]
                                                          
{'loss': '0.15', 'grad_norm': '0.9221', 'learning_rate': '1.781e-05', 'epoch': '0.2381'}

 24%|██▍       | 9040/37963 [28:10:23<99:32:20, 12.39s/it]
 24%|██▍       | 9041/37963 [28:10:32<93:21:40, 11.62s/it]
 24%|██▍       | 9042/37963 [28:10:49<105:02:11, 13.07s/it]
 24%|██▍       | 9043/37963 [28:10:59<97:59:12, 12.20s/it] 
 24%|██▍       | 9044/37963 [28:11:09<92:41:01, 11.54s/it]
 24%|██▍       | 9045/37963 [28:11:19<88:47:41, 11.05s/it]
 24%|██▍       | 9046/37963 [28:11:29<86:35:35, 10.78s/it]
 24%|██▍       | 9047/37963 [28:11:39<84:52:22, 10.57s/it]
 24%|██▍       | 9048/37963 [28:11:49<83:44:53, 10.43s/it]
 24%|██▍       | 9049/37963 [28:11:59<82:05:47, 10.22s/it]
 24%|██▍       | 9050/37963 [28:12:09<81:44:24, 10.18s/it]
                                                          
{'loss': '0.1731', 'grad_norm': '1.994', 'learning_rate': '1.781e-05', 'epoch': '0.2384'}

 24%|██▍       | 9050/37963 [28:12:09<81:44:24, 10.18s/it]
 24%|██▍       | 9051/37963 [28:12:19<81:36:37, 10.16s/it]
 24%|██▍       | 9052/37963 [28:12:29<80:45:27, 10.06s/it]
 24%|██▍       | 9053/37963 [28:12:39<79:39:10,  9.92s/it]
 24%|██▍       | 9054/37963 [28:12:56<96:46:25, 12.05s/it]
 24%|██▍       | 9055/37963 [28:13:06<92:25:49, 11.51s/it]
 24%|██▍       | 9056/37963 [28:13:16<88:56:49, 11.08s/it]
 24%|██▍       | 9057/37963 [28:13:26<86:14:02, 10.74s/it]
 24%|██▍       | 9058/37963 [28:13:36<84:26:34, 10.52s/it]
 24%|██▍       | 9059/37963 [28:13:46<82:48:42, 10.31s/it]
 24%|██▍       | 9060/37963 [28:13:56<82:22:04, 10.26s/it]
                                                          
{'loss': '0.165', 'grad_norm': '1.43', 'learning_rate': '1.78e-05', 'epoch': '0.2387'}

 24%|██▍       | 9060/37963 [28:13:56<82:22:04, 10.26s/it]
 24%|██▍       | 9061/37963 [28:14:06<81:21:07, 10.13s/it]
 24%|██▍       | 9062/37963 [28:14:16<81:21:01, 10.13s/it]
 24%|██▍       | 9063/37963 [28:14:26<80:49:12, 10.07s/it]
 24%|██▍       | 9064/37963 [28:14:42<96:46:32, 12.06s/it]
 24%|██▍       | 9065/37963 [28:14:52<92:05:01, 11.47s/it]
 24%|██▍       | 9066/37963 [28:15:03<88:34:41, 11.04s/it]
 24%|██▍       | 9067/37963 [28:15:20<102:58:22, 12.83s/it]
 24%|██▍       | 9068/37963 [28:15:30<96:11:39, 11.98s/it] 
 24%|██▍       | 9069/37963 [28:15:40<91:28:45, 11.40s/it]
 24%|██▍       | 9070/37963 [28:15:50<88:21:46, 11.01s/it]
                                                          
{'loss': '0.1662', 'grad_norm': '2.477', 'learning_rate': '1.78e-05', 'epoch': '0.2389'}

 24%|██▍       | 9070/37963 [28:15:50<88:21:46, 11.01s/it]
 24%|██▍       | 9071/37963 [28:16:00<86:04:58, 10.73s/it]
 24%|██▍       | 9072/37963 [28:16:16<99:56:42, 12.45s/it]
 24%|██▍       | 9073/37963 [28:16:26<94:16:14, 11.75s/it]
 24%|██▍       | 9074/37963 [28:16:43<105:38:22, 13.16s/it]
 24%|██▍       | 9075/37963 [28:16:53<97:43:42, 12.18s/it] 
 24%|██▍       | 9076/37963 [28:17:03<92:41:17, 11.55s/it]
 24%|██▍       | 9077/37963 [28:17:12<88:10:11, 10.99s/it]
 24%|██▍       | 9078/37963 [28:17:23<86:10:14, 10.74s/it]
 24%|██▍       | 9079/37963 [28:17:33<84:29:44, 10.53s/it]
 24%|██▍       | 9080/37963 [28:17:43<83:35:18, 10.42s/it]
                                                          
{'loss': '0.1655', 'grad_norm': '3.393', 'learning_rate': '1.779e-05', 'epoch': '0.2392'}

 24%|██▍       | 9080/37963 [28:17:43<83:35:18, 10.42s/it]
 24%|██▍       | 9081/37963 [28:17:53<82:23:02, 10.27s/it]
 24%|██▍       | 9082/37963 [28:18:03<82:08:29, 10.24s/it]
 24%|██▍       | 9083/37963 [28:18:13<81:20:20, 10.14s/it]
 24%|██▍       | 9084/37963 [28:18:23<81:14:19, 10.13s/it]
 24%|██▍       | 9085/37963 [28:18:33<80:58:04, 10.09s/it]
 24%|██▍       | 9086/37963 [28:18:49<96:37:02, 12.04s/it]
 24%|██▍       | 9087/37963 [28:19:06<107:28:16, 13.40s/it]
 24%|██▍       | 9088/37963 [28:19:16<99:26:10, 12.40s/it] 
 24%|██▍       | 9089/37963 [28:19:26<93:44:17, 11.69s/it]
 24%|██▍       | 9090/37963 [28:19:36<89:13:39, 11.13s/it]
                                                          
{'loss': '0.1749', 'grad_norm': '1.605', 'learning_rate': '1.779e-05', 'epoch': '0.2394'}

 24%|██▍       | 9090/37963 [28:19:36<89:13:39, 11.13s/it]
 24%|██▍       | 9091/37963 [28:19:52<101:07:46, 12.61s/it]
 24%|██▍       | 9092/37963 [28:20:02<95:04:53, 11.86s/it] 
 24%|██▍       | 9093/37963 [28:20:12<90:51:29, 11.33s/it]
 24%|██▍       | 9094/37963 [28:20:22<88:01:29, 10.98s/it]
 24%|██▍       | 9095/37963 [28:20:32<85:47:26, 10.70s/it]
 24%|██▍       | 9096/37963 [28:20:42<83:08:13, 10.37s/it]
 24%|██▍       | 9097/37963 [28:20:52<82:41:44, 10.31s/it]
 24%|██▍       | 9098/37963 [28:21:02<82:26:08, 10.28s/it]
 24%|██▍       | 9099/37963 [28:21:12<81:56:16, 10.22s/it]
 24%|██▍       | 9100/37963 [28:21:23<82:06:22, 10.24s/it]
                                                          
{'loss': '0.1715', 'grad_norm': '1.747', 'learning_rate': '1.778e-05', 'epoch': '0.2397'}

 24%|██▍       | 9100/37963 [28:21:23<82:06:22, 10.24s/it]
 24%|██▍       | 9101/37963 [28:21:33<81:11:20, 10.13s/it]
 24%|██▍       | 9102/37963 [28:21:43<81:07:22, 10.12s/it]
 24%|██▍       | 9103/37963 [28:21:53<81:01:08, 10.11s/it]
 24%|██▍       | 9104/37963 [28:22:10<97:37:18, 12.18s/it]
 24%|██▍       | 9105/37963 [28:22:20<91:34:55, 11.42s/it]
 24%|██▍       | 9106/37963 [28:22:30<88:24:25, 11.03s/it]
 24%|██▍       | 9107/37963 [28:22:40<86:07:54, 10.75s/it]
 24%|██▍       | 9108/37963 [28:22:50<84:47:50, 10.58s/it]
 24%|██▍       | 9109/37963 [28:23:00<82:49:29, 10.33s/it]
 24%|██▍       | 9110/37963 [28:23:10<82:09:37, 10.25s/it]
                                                          
{'loss': '0.1651', 'grad_norm': '1.574', 'learning_rate': '1.778e-05', 'epoch': '0.24'}

 24%|██▍       | 9110/37963 [28:23:10<82:09:37, 10.25s/it]
 24%|██▍       | 9111/37963 [28:23:20<81:59:47, 10.23s/it]
 24%|██▍       | 9112/37963 [28:23:30<81:48:58, 10.21s/it]
 24%|██▍       | 9113/37963 [28:23:47<96:52:42, 12.09s/it]
 24%|██▍       | 9114/37963 [28:23:57<92:23:14, 11.53s/it]
 24%|██▍       | 9115/37963 [28:24:07<89:03:24, 11.11s/it]
 24%|██▍       | 9116/37963 [28:24:23<101:44:09, 12.70s/it]
 24%|██▍       | 9117/37963 [28:24:33<95:38:15, 11.94s/it] 
 24%|██▍       | 9118/37963 [28:24:43<90:02:04, 11.24s/it]
 24%|██▍       | 9119/37963 [28:24:53<87:14:25, 10.89s/it]
 24%|██▍       | 9120/37963 [28:25:09<100:11:41, 12.51s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '1.401', 'learning_rate': '1.777e-05', 'epoch': '0.2402'}

 24%|██▍       | 9120/37963 [28:25:09<100:11:41, 12.51s/it]
 24%|██▍       | 9121/37963 [28:25:20<94:32:04, 11.80s/it] 
 24%|██▍       | 9122/37963 [28:25:30<90:33:22, 11.30s/it]
 24%|██▍       | 9123/37963 [28:25:40<87:42:14, 10.95s/it]
 24%|██▍       | 9124/37963 [28:25:57<101:46:03, 12.70s/it]
 24%|██▍       | 9125/37963 [28:26:06<94:07:57, 11.75s/it] 
 24%|██▍       | 9126/37963 [28:26:16<90:04:28, 11.24s/it]
 24%|██▍       | 9127/37963 [28:26:26<86:35:03, 10.81s/it]
 24%|██▍       | 9128/37963 [28:26:36<85:03:04, 10.62s/it]
 24%|██▍       | 9129/37963 [28:26:46<83:43:12, 10.45s/it]
 24%|██▍       | 9130/37963 [28:26:56<83:06:01, 10.38s/it]
                                                          
{'loss': '0.1658', 'grad_norm': '2.826', 'learning_rate': '1.777e-05', 'epoch': '0.2405'}

 24%|██▍       | 9130/37963 [28:26:56<83:06:01, 10.38s/it]
 24%|██▍       | 9131/37963 [28:27:06<82:18:56, 10.28s/it]
 24%|██▍       | 9132/37963 [28:27:17<81:48:48, 10.22s/it]
 24%|██▍       | 9133/37963 [28:27:27<81:23:13, 10.16s/it]
 24%|██▍       | 9134/37963 [28:27:37<81:11:56, 10.14s/it]
 24%|██▍       | 9135/37963 [28:27:53<96:41:59, 12.08s/it]
 24%|██▍       | 9136/37963 [28:28:03<91:52:05, 11.47s/it]
 24%|██▍       | 9137/37963 [28:28:13<88:12:03, 11.02s/it]
 24%|██▍       | 9138/37963 [28:28:24<86:18:00, 10.78s/it]
 24%|██▍       | 9139/37963 [28:28:34<84:31:13, 10.56s/it]
 24%|██▍       | 9140/37963 [28:28:50<99:14:37, 12.40s/it]
                                                          
{'loss': '0.1764', 'grad_norm': '1.757', 'learning_rate': '1.776e-05', 'epoch': '0.2408'}

 24%|██▍       | 9140/37963 [28:28:50<99:14:37, 12.40s/it]
 24%|██▍       | 9141/37963 [28:29:00<93:40:34, 11.70s/it]
 24%|██▍       | 9142/37963 [28:29:11<90:06:00, 11.25s/it]
 24%|██▍       | 9143/37963 [28:29:20<86:54:45, 10.86s/it]
 24%|██▍       | 9144/37963 [28:29:31<85:19:01, 10.66s/it]
 24%|██▍       | 9145/37963 [28:29:41<83:36:03, 10.44s/it]
 24%|██▍       | 9146/37963 [28:29:50<81:41:18, 10.21s/it]
 24%|██▍       | 9147/37963 [28:30:00<81:35:26, 10.19s/it]
 24%|██▍       | 9148/37963 [28:30:10<80:27:44, 10.05s/it]
 24%|██▍       | 9149/37963 [28:30:20<80:58:41, 10.12s/it]
 24%|██▍       | 9150/37963 [28:30:37<95:58:48, 11.99s/it]
                                                          
{'loss': '0.164', 'grad_norm': '1.32', 'learning_rate': '1.775e-05', 'epoch': '0.241'}

 24%|██▍       | 9150/37963 [28:30:37<95:58:48, 11.99s/it]
 24%|██▍       | 9151/37963 [28:30:47<91:10:17, 11.39s/it]
 24%|██▍       | 9152/37963 [28:30:57<88:09:39, 11.02s/it]
 24%|██▍       | 9153/37963 [28:31:07<85:42:23, 10.71s/it]
 24%|██▍       | 9154/37963 [28:31:17<84:08:45, 10.51s/it]
 24%|██▍       | 9155/37963 [28:31:27<82:09:58, 10.27s/it]
 24%|██▍       | 9156/37963 [28:31:37<81:53:20, 10.23s/it]
 24%|██▍       | 9157/37963 [28:31:47<81:26:12, 10.18s/it]
 24%|██▍       | 9158/37963 [28:31:57<80:32:40, 10.07s/it]
 24%|██▍       | 9159/37963 [28:32:07<80:13:42, 10.03s/it]
 24%|██▍       | 9160/37963 [28:32:23<96:32:32, 12.07s/it]
                                                          
{'loss': '0.1623', 'grad_norm': '3.009', 'learning_rate': '1.775e-05', 'epoch': '0.2413'}

 24%|██▍       | 9160/37963 [28:32:23<96:32:32, 12.07s/it]
 24%|██▍       | 9161/37963 [28:32:34<92:05:38, 11.51s/it]
 24%|██▍       | 9162/37963 [28:32:44<88:26:11, 11.05s/it]
 24%|██▍       | 9163/37963 [28:32:53<85:30:10, 10.69s/it]
 24%|██▍       | 9164/37963 [28:33:03<83:51:10, 10.48s/it]
 24%|██▍       | 9165/37963 [28:33:13<82:46:45, 10.35s/it]
 24%|██▍       | 9166/37963 [28:33:30<96:35:18, 12.07s/it]
 24%|██▍       | 9167/37963 [28:33:40<91:47:58, 11.48s/it]
 24%|██▍       | 9168/37963 [28:33:50<88:21:14, 11.05s/it]
 24%|██▍       | 9169/37963 [28:34:00<86:03:53, 10.76s/it]
 24%|██▍       | 9170/37963 [28:34:16<99:29:19, 12.44s/it]
                                                          
{'loss': '0.1775', 'grad_norm': '0.884', 'learning_rate': '1.774e-05', 'epoch': '0.2416'}

 24%|██▍       | 9170/37963 [28:34:16<99:29:19, 12.44s/it]
 24%|██▍       | 9171/37963 [28:34:26<93:52:57, 11.74s/it]
 24%|██▍       | 9172/37963 [28:34:36<90:00:04, 11.25s/it]
 24%|██▍       | 9173/37963 [28:34:53<103:35:07, 12.95s/it]
 24%|██▍       | 9174/37963 [28:35:03<96:43:35, 12.10s/it] 
 24%|██▍       | 9175/37963 [28:35:13<91:31:50, 11.45s/it]
 24%|██▍       | 9176/37963 [28:35:23<88:00:58, 11.01s/it]
 24%|██▍       | 9177/37963 [28:35:33<85:55:10, 10.75s/it]
 24%|██▍       | 9178/37963 [28:35:43<84:13:57, 10.53s/it]
 24%|██▍       | 9179/37963 [28:35:54<83:15:47, 10.41s/it]
 24%|██▍       | 9180/37963 [28:36:04<82:25:11, 10.31s/it]
                                                          
{'loss': '0.173', 'grad_norm': '2.991', 'learning_rate': '1.774e-05', 'epoch': '0.2418'}

 24%|██▍       | 9180/37963 [28:36:04<82:25:11, 10.31s/it]
 24%|██▍       | 9181/37963 [28:36:14<81:36:00, 10.21s/it]
 24%|██▍       | 9182/37963 [28:36:30<96:00:47, 12.01s/it]
 24%|██▍       | 9183/37963 [28:36:40<90:58:31, 11.38s/it]
 24%|██▍       | 9184/37963 [28:36:56<103:28:29, 12.94s/it]
 24%|██▍       | 9185/37963 [28:37:07<96:58:14, 12.13s/it] 
 24%|██▍       | 9186/37963 [28:37:17<92:19:40, 11.55s/it]
 24%|██▍       | 9187/37963 [28:37:27<88:48:58, 11.11s/it]
 24%|██▍       | 9188/37963 [28:37:43<101:21:57, 12.68s/it]
 24%|██▍       | 9189/37963 [28:37:53<95:03:19, 11.89s/it] 
 24%|██▍       | 9190/37963 [28:38:04<91:01:13, 11.39s/it]
                                                          
{'loss': '0.1596', 'grad_norm': '1.57', 'learning_rate': '1.773e-05', 'epoch': '0.2421'}

 24%|██▍       | 9190/37963 [28:38:04<91:01:13, 11.39s/it]
 24%|██▍       | 9191/37963 [28:38:14<87:46:56, 10.98s/it]
 24%|██▍       | 9192/37963 [28:38:24<85:37:54, 10.71s/it]
 24%|██▍       | 9193/37963 [28:38:34<84:20:07, 10.55s/it]
 24%|██▍       | 9194/37963 [28:38:44<83:09:46, 10.41s/it]
 24%|██▍       | 9195/37963 [28:38:54<82:12:23, 10.29s/it]
 24%|██▍       | 9196/37963 [28:39:04<80:37:06, 10.09s/it]
 24%|██▍       | 9197/37963 [28:39:14<80:27:21, 10.07s/it]
 24%|██▍       | 9198/37963 [28:39:30<96:26:25, 12.07s/it]
 24%|██▍       | 9199/37963 [28:39:40<91:15:10, 11.42s/it]
 24%|██▍       | 9200/37963 [28:39:50<88:17:43, 11.05s/it]
                                                          
{'loss': '0.1572', 'grad_norm': '1.214', 'learning_rate': '1.773e-05', 'epoch': '0.2423'}

 24%|██▍       | 9200/37963 [28:39:50<88:17:43, 11.05s/it]
 24%|██▍       | 9201/37963 [28:40:00<85:29:55, 10.70s/it]
 24%|██▍       | 9202/37963 [28:40:10<84:07:29, 10.53s/it]
 24%|██▍       | 9203/37963 [28:40:20<82:07:24, 10.28s/it]
 24%|██▍       | 9204/37963 [28:40:30<81:34:45, 10.21s/it]
 24%|██▍       | 9205/37963 [28:40:40<81:04:59, 10.15s/it]
 24%|██▍       | 9206/37963 [28:40:50<81:10:20, 10.16s/it]
 24%|██▍       | 9207/37963 [28:41:00<80:58:33, 10.14s/it]
 24%|██▍       | 9208/37963 [28:41:17<96:25:16, 12.07s/it]
 24%|██▍       | 9209/37963 [28:41:27<92:04:57, 11.53s/it]
 24%|██▍       | 9210/37963 [28:41:37<88:31:51, 11.08s/it]
                                                          
{'loss': '0.1831', 'grad_norm': '1.32', 'learning_rate': '1.772e-05', 'epoch': '0.2426'}

 24%|██▍       | 9210/37963 [28:41:37<88:31:51, 11.08s/it]
 24%|██▍       | 9211/37963 [28:41:47<86:05:22, 10.78s/it]
 24%|██▍       | 9212/37963 [28:41:57<83:42:38, 10.48s/it]
 24%|██▍       | 9213/37963 [28:42:07<82:38:02, 10.35s/it]
 24%|██▍       | 9214/37963 [28:42:17<82:23:33, 10.32s/it]
 24%|██▍       | 9215/37963 [28:42:28<81:59:04, 10.27s/it]
 24%|██▍       | 9216/37963 [28:42:44<96:15:32, 12.05s/it]
 24%|██▍       | 9217/37963 [28:42:54<91:27:07, 11.45s/it]
 24%|██▍       | 9218/37963 [28:43:10<102:24:20, 12.83s/it]
 24%|██▍       | 9219/37963 [28:43:20<95:49:31, 12.00s/it] 
 24%|██▍       | 9220/37963 [28:43:30<90:03:52, 11.28s/it]
                                                          
{'loss': '0.1591', 'grad_norm': '2.257', 'learning_rate': '1.772e-05', 'epoch': '0.2429'}

 24%|██▍       | 9220/37963 [28:43:30<90:03:52, 11.28s/it]
 24%|██▍       | 9221/37963 [28:43:40<87:06:13, 10.91s/it]
 24%|██▍       | 9222/37963 [28:43:57<101:35:09, 12.72s/it]
 24%|██▍       | 9223/37963 [28:44:07<95:21:09, 11.94s/it] 
 24%|██▍       | 9224/37963 [28:44:17<90:48:48, 11.38s/it]
 24%|██▍       | 9225/37963 [28:44:27<87:38:36, 10.98s/it]
 24%|██▍       | 9226/37963 [28:44:37<85:18:53, 10.69s/it]
 24%|██▍       | 9227/37963 [28:44:47<83:55:15, 10.51s/it]
 24%|██▍       | 9228/37963 [28:44:57<82:46:20, 10.37s/it]
 24%|██▍       | 9229/37963 [28:45:07<81:59:19, 10.27s/it]
 24%|██▍       | 9230/37963 [28:45:17<81:40:50, 10.23s/it]
                                                          
{'loss': '0.1847', 'grad_norm': '3.176', 'learning_rate': '1.771e-05', 'epoch': '0.2431'}

 24%|██▍       | 9230/37963 [28:45:17<81:40:50, 10.23s/it]
 24%|██▍       | 9231/37963 [28:45:33<95:53:51, 12.02s/it]
 24%|██▍       | 9232/37963 [28:45:50<106:30:42, 13.35s/it]
 24%|██▍       | 9233/37963 [28:46:00<98:57:45, 12.40s/it] 
 24%|██▍       | 9234/37963 [28:46:10<92:29:37, 11.59s/it]
 24%|██▍       | 9235/37963 [28:46:20<88:44:09, 11.12s/it]
 24%|██▍       | 9236/37963 [28:46:36<102:00:09, 12.78s/it]
 24%|██▍       | 9237/37963 [28:46:46<95:34:46, 11.98s/it] 
 24%|██▍       | 9238/37963 [28:46:56<91:00:12, 11.41s/it]
 24%|██▍       | 9239/37963 [28:47:06<87:33:06, 10.97s/it]
 24%|██▍       | 9240/37963 [28:47:16<84:47:04, 10.63s/it]
                                                          
{'loss': '0.1713', 'grad_norm': '3.275', 'learning_rate': '1.771e-05', 'epoch': '0.2434'}

 24%|██▍       | 9240/37963 [28:47:16<84:47:04, 10.63s/it]
 24%|██▍       | 9241/37963 [28:47:26<83:33:35, 10.47s/it]
 24%|██▍       | 9242/37963 [28:47:36<82:33:29, 10.35s/it]
 24%|██▍       | 9243/37963 [28:47:47<82:12:45, 10.31s/it]
 24%|██▍       | 9244/37963 [28:47:57<81:43:22, 10.24s/it]
 24%|██▍       | 9245/37963 [28:48:07<81:26:29, 10.21s/it]
 24%|██▍       | 9246/37963 [28:48:17<81:18:01, 10.19s/it]
 24%|██▍       | 9247/37963 [28:48:34<97:14:38, 12.19s/it]
 24%|██▍       | 9248/37963 [28:48:44<92:01:36, 11.54s/it]
 24%|██▍       | 9249/37963 [28:48:54<89:05:49, 11.17s/it]
 24%|██▍       | 9250/37963 [28:49:04<86:16:24, 10.82s/it]
                                                          
{'loss': '0.1698', 'grad_norm': '1.167', 'learning_rate': '1.77e-05', 'epoch': '0.2437'}

 24%|██▍       | 9250/37963 [28:49:04<86:16:24, 10.82s/it]
 24%|██▍       | 9251/37963 [28:49:14<84:38:11, 10.61s/it]
 24%|██▍       | 9252/37963 [28:49:24<83:30:28, 10.47s/it]
 24%|██▍       | 9253/37963 [28:49:35<82:32:43, 10.35s/it]
 24%|██▍       | 9254/37963 [28:49:45<81:53:16, 10.27s/it]
 24%|██▍       | 9255/37963 [28:50:01<96:34:14, 12.11s/it]
 24%|██▍       | 9256/37963 [28:50:11<91:56:45, 11.53s/it]
 24%|██▍       | 9257/37963 [28:50:21<87:58:11, 11.03s/it]
 24%|██▍       | 9258/37963 [28:50:31<85:38:14, 10.74s/it]
 24%|██▍       | 9259/37963 [28:50:41<84:13:48, 10.56s/it]
 24%|██▍       | 9260/37963 [28:50:51<82:55:43, 10.40s/it]
                                                          
{'loss': '0.1675', 'grad_norm': '0.7784', 'learning_rate': '1.769e-05', 'epoch': '0.2439'}

 24%|██▍       | 9260/37963 [28:50:51<82:55:43, 10.40s/it]
 24%|██▍       | 9261/37963 [28:51:01<81:11:49, 10.18s/it]
 24%|██▍       | 9262/37963 [28:51:11<80:52:03, 10.14s/it]
 24%|██▍       | 9263/37963 [28:51:21<80:49:56, 10.14s/it]
 24%|██▍       | 9264/37963 [28:51:38<95:50:56, 12.02s/it]
 24%|██▍       | 9265/37963 [28:51:48<91:10:10, 11.44s/it]
 24%|██▍       | 9266/37963 [28:52:04<103:17:35, 12.96s/it]
 24%|██▍       | 9267/37963 [28:52:14<95:45:32, 12.01s/it] 
 24%|██▍       | 9268/37963 [28:52:24<91:14:43, 11.45s/it]
 24%|██▍       | 9269/37963 [28:52:34<87:18:03, 10.95s/it]
 24%|██▍       | 9270/37963 [28:52:44<84:20:58, 10.58s/it]
                                                          
{'loss': '0.1568', 'grad_norm': '1.658', 'learning_rate': '1.769e-05', 'epoch': '0.2442'}

 24%|██▍       | 9270/37963 [28:52:44<84:20:58, 10.58s/it]
 24%|██▍       | 9271/37963 [28:53:00<98:43:36, 12.39s/it]
 24%|██▍       | 9272/37963 [28:53:10<93:21:43, 11.71s/it]
 24%|██▍       | 9273/37963 [28:53:20<89:26:25, 11.22s/it]
 24%|██▍       | 9274/37963 [28:53:30<86:30:16, 10.85s/it]
 24%|██▍       | 9275/37963 [28:53:41<84:42:55, 10.63s/it]
 24%|██▍       | 9276/37963 [28:53:50<82:27:59, 10.35s/it]
 24%|██▍       | 9277/37963 [28:54:00<81:43:16, 10.26s/it]
 24%|██▍       | 9278/37963 [28:54:10<81:16:00, 10.20s/it]
 24%|██▍       | 9279/37963 [28:54:27<96:29:34, 12.11s/it]
 24%|██▍       | 9280/37963 [28:54:37<91:33:51, 11.49s/it]
                                                          
{'loss': '0.1573', 'grad_norm': '1.429', 'learning_rate': '1.768e-05', 'epoch': '0.2444'}

 24%|██▍       | 9280/37963 [28:54:37<91:33:51, 11.49s/it]
 24%|██▍       | 9281/37963 [28:54:47<87:55:43, 11.04s/it]
 24%|██▍       | 9282/37963 [28:55:10<115:52:44, 14.54s/it]
 24%|██▍       | 9283/37963 [28:55:20<105:12:14, 13.21s/it]
 24%|██▍       | 9284/37963 [28:55:29<96:52:30, 12.16s/it] 
 24%|██▍       | 9285/37963 [28:55:40<91:50:26, 11.53s/it]
 24%|██▍       | 9286/37963 [28:55:50<88:12:39, 11.07s/it]
 24%|██▍       | 9287/37963 [28:55:59<85:31:45, 10.74s/it]
 24%|██▍       | 9288/37963 [28:56:09<83:46:18, 10.52s/it]
 24%|██▍       | 9289/37963 [28:56:19<82:12:03, 10.32s/it]
 24%|██▍       | 9290/37963 [28:56:30<82:15:49, 10.33s/it]
                                                          
{'loss': '0.1742', 'grad_norm': '4.178', 'learning_rate': '1.768e-05', 'epoch': '0.2447'}

 24%|██▍       | 9290/37963 [28:56:30<82:15:49, 10.33s/it]
 24%|██▍       | 9291/37963 [28:56:40<81:52:57, 10.28s/it]
 24%|██▍       | 9292/37963 [28:56:50<80:27:32, 10.10s/it]
 24%|██▍       | 9293/37963 [28:57:00<80:27:52, 10.10s/it]
 24%|██▍       | 9294/37963 [28:57:09<78:58:45,  9.92s/it]
 24%|██▍       | 9295/37963 [28:57:26<96:19:39, 12.10s/it]
 24%|██▍       | 9296/37963 [28:57:36<90:33:41, 11.37s/it]
 24%|██▍       | 9297/37963 [28:57:46<87:27:10, 10.98s/it]
 24%|██▍       | 9298/37963 [28:57:56<85:21:33, 10.72s/it]
 24%|██▍       | 9299/37963 [28:58:06<83:54:43, 10.54s/it]
 24%|██▍       | 9300/37963 [28:58:16<81:54:32, 10.29s/it]
                                                          
{'loss': '0.1634', 'grad_norm': '3.23', 'learning_rate': '1.767e-05', 'epoch': '0.245'}

 24%|██▍       | 9300/37963 [28:58:16<81:54:32, 10.29s/it]
 25%|██▍       | 9301/37963 [28:58:26<81:27:17, 10.23s/it]
 25%|██▍       | 9302/37963 [28:58:42<96:06:05, 12.07s/it]
 25%|██▍       | 9303/37963 [28:58:53<91:23:10, 11.48s/it]
 25%|██▍       | 9304/37963 [28:59:03<87:55:41, 11.05s/it]
 25%|██▍       | 9305/37963 [28:59:13<85:38:34, 10.76s/it]
 25%|██▍       | 9306/37963 [28:59:23<84:00:53, 10.55s/it]
 25%|██▍       | 9307/37963 [28:59:33<82:48:32, 10.40s/it]
 25%|██▍       | 9308/37963 [28:59:43<82:02:21, 10.31s/it]
 25%|██▍       | 9309/37963 [28:59:53<81:31:16, 10.24s/it]
 25%|██▍       | 9310/37963 [29:00:03<81:15:09, 10.21s/it]
                                                          
{'loss': '0.159', 'grad_norm': '1.945', 'learning_rate': '1.767e-05', 'epoch': '0.2452'}

 25%|██▍       | 9310/37963 [29:00:03<81:15:09, 10.21s/it]
 25%|██▍       | 9311/37963 [29:00:13<80:46:44, 10.15s/it]
 25%|██▍       | 9312/37963 [29:00:29<95:04:50, 11.95s/it]
 25%|██▍       | 9313/37963 [29:00:45<104:46:21, 13.17s/it]
 25%|██▍       | 9314/37963 [29:00:55<97:30:06, 12.25s/it] 
 25%|██▍       | 9315/37963 [29:01:06<92:22:33, 11.61s/it]
 25%|██▍       | 9316/37963 [29:01:16<88:45:29, 11.15s/it]
 25%|██▍       | 9317/37963 [29:01:26<86:11:57, 10.83s/it]
 25%|██▍       | 9318/37963 [29:01:36<84:24:43, 10.61s/it]
 25%|██▍       | 9319/37963 [29:01:46<83:21:00, 10.48s/it]
 25%|██▍       | 9320/37963 [29:02:03<98:44:17, 12.41s/it]
                                                          
{'loss': '0.1587', 'grad_norm': '1.031', 'learning_rate': '1.766e-05', 'epoch': '0.2455'}

 25%|██▍       | 9320/37963 [29:02:03<98:44:17, 12.41s/it]
 25%|██▍       | 9321/37963 [29:02:13<93:13:42, 11.72s/it]
 25%|██▍       | 9322/37963 [29:02:23<89:19:30, 11.23s/it]
 25%|██▍       | 9323/37963 [29:02:33<86:35:10, 10.88s/it]
 25%|██▍       | 9324/37963 [29:02:43<84:40:34, 10.64s/it]
 25%|██▍       | 9325/37963 [29:02:53<83:27:43, 10.49s/it]
 25%|██▍       | 9326/37963 [29:03:03<82:30:46, 10.37s/it]
 25%|██▍       | 9327/37963 [29:03:14<82:04:55, 10.32s/it]
 25%|██▍       | 9328/37963 [29:03:30<96:25:59, 12.12s/it]
 25%|██▍       | 9329/37963 [29:03:40<91:27:30, 11.50s/it]
 25%|██▍       | 9330/37963 [29:03:50<88:03:37, 11.07s/it]
                                                          
{'loss': '0.1655', 'grad_norm': '1.006', 'learning_rate': '1.766e-05', 'epoch': '0.2458'}

 25%|██▍       | 9330/37963 [29:03:50<88:03:37, 11.07s/it]
 25%|██▍       | 9331/37963 [29:04:13<116:23:18, 14.63s/it]
 25%|██▍       | 9332/37963 [29:04:23<105:39:17, 13.28s/it]
 25%|██▍       | 9333/37963 [29:04:33<98:00:54, 12.32s/it] 
 25%|██▍       | 9334/37963 [29:04:43<92:17:39, 11.61s/it]
 25%|██▍       | 9335/37963 [29:04:53<88:46:47, 11.16s/it]
 25%|██▍       | 9336/37963 [29:05:03<85:54:11, 10.80s/it]
 25%|██▍       | 9337/37963 [29:05:13<84:07:38, 10.58s/it]
 25%|██▍       | 9338/37963 [29:05:23<82:56:49, 10.43s/it]
 25%|██▍       | 9339/37963 [29:05:34<82:07:23, 10.33s/it]
 25%|██▍       | 9340/37963 [29:05:44<81:32:47, 10.26s/it]
                                                          
{'loss': '0.1636', 'grad_norm': '1.111', 'learning_rate': '1.765e-05', 'epoch': '0.246'}

 25%|██▍       | 9340/37963 [29:05:44<81:32:47, 10.26s/it]
 25%|██▍       | 9341/37963 [29:05:54<80:55:05, 10.18s/it]
 25%|██▍       | 9342/37963 [29:06:04<80:39:08, 10.14s/it]
 25%|██▍       | 9343/37963 [29:06:14<80:41:54, 10.15s/it]
 25%|██▍       | 9344/37963 [29:06:31<96:58:34, 12.20s/it]
 25%|██▍       | 9345/37963 [29:06:41<91:57:14, 11.57s/it]
 25%|██▍       | 9346/37963 [29:06:51<88:34:59, 11.14s/it]
 25%|██▍       | 9347/37963 [29:07:01<85:15:01, 10.72s/it]
 25%|██▍       | 9348/37963 [29:07:11<84:05:10, 10.58s/it]
 25%|██▍       | 9349/37963 [29:07:21<83:07:20, 10.46s/it]
 25%|██▍       | 9350/37963 [29:07:38<98:04:44, 12.34s/it]
                                                          
{'loss': '0.1686', 'grad_norm': '6.711', 'learning_rate': '1.765e-05', 'epoch': '0.2463'}

 25%|██▍       | 9350/37963 [29:07:38<98:04:44, 12.34s/it]
 25%|██▍       | 9351/37963 [29:07:48<92:55:45, 11.69s/it]
 25%|██▍       | 9352/37963 [29:07:58<89:14:50, 11.23s/it]
 25%|██▍       | 9353/37963 [29:08:08<86:34:24, 10.89s/it]
 25%|██▍       | 9354/37963 [29:08:19<84:48:31, 10.67s/it]
 25%|██▍       | 9355/37963 [29:08:29<83:38:11, 10.52s/it]
 25%|██▍       | 9356/37963 [29:08:39<82:43:31, 10.41s/it]
 25%|██▍       | 9357/37963 [29:08:49<82:02:47, 10.33s/it]
 25%|██▍       | 9358/37963 [29:08:59<81:29:17, 10.26s/it]
 25%|██▍       | 9359/37963 [29:09:09<81:03:22, 10.20s/it]
 25%|██▍       | 9360/37963 [29:09:19<80:42:07, 10.16s/it]
                                                          
{'loss': '0.1641', 'grad_norm': '3.165', 'learning_rate': '1.764e-05', 'epoch': '0.2466'}

 25%|██▍       | 9360/37963 [29:09:19<80:42:07, 10.16s/it]
 25%|██▍       | 9361/37963 [29:09:36<96:10:49, 12.11s/it]
 25%|██▍       | 9362/37963 [29:09:52<105:48:24, 13.32s/it]
 25%|██▍       | 9363/37963 [29:10:02<97:40:18, 12.29s/it] 
 25%|██▍       | 9364/37963 [29:10:12<92:40:00, 11.66s/it]
 25%|██▍       | 9365/37963 [29:10:22<89:18:56, 11.24s/it]
 25%|██▍       | 9366/37963 [29:10:33<86:50:22, 10.93s/it]
 25%|██▍       | 9367/37963 [29:10:43<84:49:58, 10.68s/it]
 25%|██▍       | 9368/37963 [29:10:59<99:26:06, 12.52s/it]
 25%|██▍       | 9369/37963 [29:11:10<93:39:12, 11.79s/it]
 25%|██▍       | 9370/37963 [29:11:19<88:18:20, 11.12s/it]
                                                          
{'loss': '0.1815', 'grad_norm': '1.367', 'learning_rate': '1.763e-05', 'epoch': '0.2468'}

 25%|██▍       | 9370/37963 [29:11:19<88:18:20, 11.12s/it]
 25%|██▍       | 9371/37963 [29:11:29<85:52:29, 10.81s/it]
 25%|██▍       | 9372/37963 [29:11:39<83:18:30, 10.49s/it]
 25%|██▍       | 9373/37963 [29:11:49<81:39:22, 10.28s/it]
 25%|██▍       | 9374/37963 [29:11:59<80:30:06, 10.14s/it]
 25%|██▍       | 9375/37963 [29:12:09<80:35:59, 10.15s/it]
 25%|██▍       | 9376/37963 [29:12:19<80:15:03, 10.11s/it]
 25%|██▍       | 9377/37963 [29:12:35<95:54:31, 12.08s/it]
 25%|██▍       | 9378/37963 [29:12:52<106:35:25, 13.42s/it]
 25%|██▍       | 9379/37963 [29:13:02<98:45:10, 12.44s/it] 
 25%|██▍       | 9380/37963 [29:13:19<108:31:28, 13.67s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '1.967', 'learning_rate': '1.763e-05', 'epoch': '0.2471'}

 25%|██▍       | 9380/37963 [29:13:19<108:31:28, 13.67s/it]
 25%|██▍       | 9381/37963 [29:13:29<100:04:48, 12.61s/it]
 25%|██▍       | 9382/37963 [29:13:39<94:15:11, 11.87s/it] 
 25%|██▍       | 9383/37963 [29:13:49<89:53:06, 11.32s/it]
 25%|██▍       | 9384/37963 [29:13:59<87:06:14, 10.97s/it]
 25%|██▍       | 9385/37963 [29:14:09<84:41:10, 10.67s/it]
 25%|██▍       | 9386/37963 [29:14:19<83:08:07, 10.47s/it]
 25%|██▍       | 9387/37963 [29:14:29<82:24:03, 10.38s/it]
 25%|██▍       | 9388/37963 [29:14:39<81:50:06, 10.31s/it]
 25%|██▍       | 9389/37963 [29:14:49<80:45:18, 10.17s/it]
 25%|██▍       | 9390/37963 [29:14:59<80:47:06, 10.18s/it]
                                                          
{'loss': '0.1627', 'grad_norm': '1.017', 'learning_rate': '1.762e-05', 'epoch': '0.2473'}

 25%|██▍       | 9390/37963 [29:14:59<80:47:06, 10.18s/it]
 25%|██▍       | 9391/37963 [29:15:16<96:49:41, 12.20s/it]
 25%|██▍       | 9392/37963 [29:15:26<91:27:19, 11.52s/it]
 25%|██▍       | 9393/37963 [29:15:36<88:07:20, 11.10s/it]
 25%|██▍       | 9394/37963 [29:15:47<85:37:08, 10.79s/it]
 25%|██▍       | 9395/37963 [29:15:57<83:52:07, 10.57s/it]
 25%|██▍       | 9396/37963 [29:16:07<82:54:46, 10.45s/it]
 25%|██▍       | 9397/37963 [29:16:17<81:57:33, 10.33s/it]
 25%|██▍       | 9398/37963 [29:16:27<81:27:16, 10.27s/it]
 25%|██▍       | 9399/37963 [29:16:37<81:03:18, 10.22s/it]
 25%|██▍       | 9400/37963 [29:16:54<96:11:31, 12.12s/it]
                                                          
{'loss': '0.1677', 'grad_norm': '4.412', 'learning_rate': '1.762e-05', 'epoch': '0.2476'}

 25%|██▍       | 9400/37963 [29:16:54<96:11:31, 12.12s/it]
 25%|██▍       | 9401/37963 [29:17:04<91:12:54, 11.50s/it]
 25%|██▍       | 9402/37963 [29:17:14<87:46:26, 11.06s/it]
 25%|██▍       | 9403/37963 [29:17:24<85:27:07, 10.77s/it]
 25%|██▍       | 9404/37963 [29:17:34<83:53:13, 10.57s/it]
 25%|██▍       | 9405/37963 [29:17:44<82:08:24, 10.35s/it]
 25%|██▍       | 9406/37963 [29:17:53<80:34:33, 10.16s/it]
 25%|██▍       | 9407/37963 [29:18:03<80:23:53, 10.14s/it]
 25%|██▍       | 9408/37963 [29:18:20<95:17:45, 12.01s/it]
 25%|██▍       | 9409/37963 [29:18:36<105:04:30, 13.25s/it]
 25%|██▍       | 9410/37963 [29:18:46<97:46:22, 12.33s/it] 
                                                          
{'loss': '0.1493', 'grad_norm': '1.633', 'learning_rate': '1.761e-05', 'epoch': '0.2479'}

 25%|██▍       | 9410/37963 [29:18:46<97:46:22, 12.33s/it]
 25%|██▍       | 9411/37963 [29:18:56<92:35:44, 11.68s/it]
 25%|██▍       | 9412/37963 [29:19:06<88:57:19, 11.22s/it]
 25%|██▍       | 9413/37963 [29:19:17<86:13:45, 10.87s/it]
 25%|██▍       | 9414/37963 [29:19:27<84:19:09, 10.63s/it]
 25%|██▍       | 9415/37963 [29:19:37<82:39:14, 10.42s/it]
 25%|██▍       | 9416/37963 [29:19:47<81:52:13, 10.32s/it]
 25%|██▍       | 9417/37963 [29:20:04<98:20:21, 12.40s/it]
 25%|██▍       | 9418/37963 [29:20:14<92:56:57, 11.72s/it]
 25%|██▍       | 9419/37963 [29:20:24<89:09:51, 11.25s/it]
 25%|██▍       | 9420/37963 [29:20:34<86:55:59, 10.96s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '1.842', 'learning_rate': '1.761e-05', 'epoch': '0.2481'}

 25%|██▍       | 9420/37963 [29:20:35<86:55:59, 10.96s/it]
 25%|██▍       | 9421/37963 [29:20:45<85:00:20, 10.72s/it]
 25%|██▍       | 9422/37963 [29:20:55<83:25:32, 10.52s/it]
 25%|██▍       | 9423/37963 [29:21:05<82:16:21, 10.38s/it]
 25%|██▍       | 9424/37963 [29:21:15<81:42:47, 10.31s/it]
 25%|██▍       | 9425/37963 [29:21:31<96:16:21, 12.14s/it]
 25%|██▍       | 9426/37963 [29:21:48<106:18:02, 13.41s/it]
 25%|██▍       | 9427/37963 [29:21:58<98:12:44, 12.39s/it] 
 25%|██▍       | 9428/37963 [29:22:08<92:49:22, 11.71s/it]
 25%|██▍       | 9429/37963 [29:22:24<104:16:06, 13.16s/it]
 25%|██▍       | 9430/37963 [29:22:34<97:02:04, 12.24s/it] 
                                                          
{'loss': '0.1785', 'grad_norm': '3.788', 'learning_rate': '1.76e-05', 'epoch': '0.2484'}

 25%|██▍       | 9430/37963 [29:22:34<97:02:04, 12.24s/it]
 25%|██▍       | 9431/37963 [29:22:44<91:41:06, 11.57s/it]
 25%|██▍       | 9432/37963 [29:22:55<88:48:37, 11.21s/it]
 25%|██▍       | 9433/37963 [29:23:05<85:35:01, 10.80s/it]
 25%|██▍       | 9434/37963 [29:23:15<83:57:17, 10.59s/it]
 25%|██▍       | 9435/37963 [29:23:25<82:27:50, 10.41s/it]
 25%|██▍       | 9436/37963 [29:23:35<81:58:02, 10.34s/it]
 25%|██▍       | 9437/37963 [29:23:45<81:20:13, 10.26s/it]
 25%|██▍       | 9438/37963 [29:23:55<80:44:16, 10.19s/it]
 25%|██▍       | 9439/37963 [29:24:05<80:30:44, 10.16s/it]
 25%|██▍       | 9440/37963 [29:24:22<96:50:55, 12.22s/it]
                                                          
{'loss': '0.165', 'grad_norm': '1.125', 'learning_rate': '1.76e-05', 'epoch': '0.2487'}

 25%|██▍       | 9440/37963 [29:24:22<96:50:55, 12.22s/it]
 25%|██▍       | 9441/37963 [29:24:32<91:45:25, 11.58s/it]
 25%|██▍       | 9442/37963 [29:24:42<87:48:19, 11.08s/it]
 25%|██▍       | 9443/37963 [29:24:52<85:21:04, 10.77s/it]
 25%|██▍       | 9444/37963 [29:25:02<83:51:50, 10.59s/it]
 25%|██▍       | 9445/37963 [29:25:13<82:59:14, 10.48s/it]
 25%|██▍       | 9446/37963 [29:25:23<81:58:01, 10.35s/it]
 25%|██▍       | 9447/37963 [29:25:33<81:44:19, 10.32s/it]
 25%|██▍       | 9448/37963 [29:25:49<96:00:49, 12.12s/it]
 25%|██▍       | 9449/37963 [29:25:59<91:16:28, 11.52s/it]
 25%|██▍       | 9450/37963 [29:26:10<88:00:16, 11.11s/it]
                                                          
{'loss': '0.1721', 'grad_norm': '3.312', 'learning_rate': '1.759e-05', 'epoch': '0.2489'}

 25%|██▍       | 9450/37963 [29:26:10<88:00:16, 11.11s/it]
 25%|██▍       | 9451/37963 [29:26:20<85:37:37, 10.81s/it]
 25%|██▍       | 9452/37963 [29:26:30<83:51:21, 10.59s/it]
 25%|██▍       | 9453/37963 [29:26:40<82:15:56, 10.39s/it]
 25%|██▍       | 9454/37963 [29:26:49<80:38:36, 10.18s/it]
 25%|██▍       | 9455/37963 [29:26:59<79:58:35, 10.10s/it]
 25%|██▍       | 9456/37963 [29:27:16<95:28:10, 12.06s/it]
 25%|██▍       | 9457/37963 [29:27:26<90:56:15, 11.48s/it]
 25%|██▍       | 9458/37963 [29:27:36<87:41:43, 11.08s/it]
 25%|██▍       | 9459/37963 [29:27:46<85:13:27, 10.76s/it]
 25%|██▍       | 9460/37963 [29:27:56<83:31:15, 10.55s/it]
                                                          
{'loss': '0.1637', 'grad_norm': '0.8784', 'learning_rate': '1.758e-05', 'epoch': '0.2492'}

 25%|██▍       | 9460/37963 [29:27:56<83:31:15, 10.55s/it]
 25%|██▍       | 9461/37963 [29:28:06<81:43:06, 10.32s/it]
 25%|██▍       | 9462/37963 [29:28:16<80:14:41, 10.14s/it]
 25%|██▍       | 9463/37963 [29:28:26<80:14:27, 10.14s/it]
 25%|██▍       | 9464/37963 [29:28:36<80:18:18, 10.14s/it]
 25%|██▍       | 9465/37963 [29:28:53<96:14:15, 12.16s/it]
 25%|██▍       | 9466/37963 [29:29:03<91:07:42, 11.51s/it]
 25%|██▍       | 9467/37963 [29:29:13<87:51:34, 11.10s/it]
 25%|██▍       | 9468/37963 [29:29:23<85:33:13, 10.81s/it]
 25%|██▍       | 9469/37963 [29:29:33<84:02:29, 10.62s/it]
 25%|██▍       | 9470/37963 [29:29:43<82:42:21, 10.45s/it]
                                                          
{'loss': '0.1707', 'grad_norm': '1.005', 'learning_rate': '1.758e-05', 'epoch': '0.2495'}

 25%|██▍       | 9470/37963 [29:29:43<82:42:21, 10.45s/it]
 25%|██▍       | 9471/37963 [29:29:53<81:58:15, 10.36s/it]
 25%|██▍       | 9472/37963 [29:30:04<81:24:19, 10.29s/it]
 25%|██▍       | 9473/37963 [29:30:26<110:12:38, 13.93s/it]
 25%|██▍       | 9474/37963 [29:30:36<101:22:15, 12.81s/it]
 25%|██▍       | 9475/37963 [29:30:46<95:02:41, 12.01s/it] 
 25%|██▍       | 9476/37963 [29:30:56<89:59:07, 11.37s/it]
 25%|██▍       | 9477/37963 [29:31:13<102:08:50, 12.91s/it]
 25%|██▍       | 9478/37963 [29:31:22<94:25:31, 11.93s/it] 
 25%|██▍       | 9479/37963 [29:31:32<89:58:45, 11.37s/it]
 25%|██▍       | 9480/37963 [29:31:43<86:53:14, 10.98s/it]
                                                          
{'loss': '0.1651', 'grad_norm': '1.251', 'learning_rate': '1.757e-05', 'epoch': '0.2497'}

 25%|██▍       | 9480/37963 [29:31:43<86:53:14, 10.98s/it]
 25%|██▍       | 9481/37963 [29:31:53<84:35:35, 10.69s/it]
 25%|██▍       | 9482/37963 [29:32:03<83:03:30, 10.50s/it]
 25%|██▍       | 9483/37963 [29:32:13<82:12:35, 10.39s/it]
 25%|██▍       | 9484/37963 [29:32:22<80:39:38, 10.20s/it]
 25%|██▍       | 9485/37963 [29:32:33<80:32:01, 10.18s/it]
 25%|██▍       | 9486/37963 [29:32:43<80:15:27, 10.15s/it]
 25%|██▍       | 9487/37963 [29:32:52<79:24:43, 10.04s/it]
 25%|██▍       | 9488/37963 [29:33:03<79:34:14, 10.06s/it]
 25%|██▍       | 9489/37963 [29:33:19<94:48:52, 11.99s/it]
 25%|██▍       | 9490/37963 [29:33:29<89:24:45, 11.30s/it]
                                                          
{'loss': '0.1648', 'grad_norm': '2.997', 'learning_rate': '1.757e-05', 'epoch': '0.25'}

 25%|██▍       | 9490/37963 [29:33:29<89:24:45, 11.30s/it]
 25%|██▌       | 9491/37963 [29:33:39<86:24:33, 10.93s/it]
 25%|██▌       | 9492/37963 [29:33:49<84:22:58, 10.67s/it]
 25%|██▌       | 9493/37963 [29:33:59<83:11:48, 10.52s/it]
 25%|██▌       | 9494/37963 [29:34:09<81:31:26, 10.31s/it]
 25%|██▌       | 9495/37963 [29:34:19<80:59:43, 10.24s/it]
 25%|██▌       | 9496/37963 [29:34:38<101:57:34, 12.89s/it]
 25%|██▌       | 9497/37963 [29:34:48<96:00:11, 12.14s/it] 
 25%|██▌       | 9498/37963 [29:34:58<90:45:00, 11.48s/it]
 25%|██▌       | 9499/37963 [29:35:09<87:35:53, 11.08s/it]
 25%|██▌       | 9500/37963 [29:35:19<85:20:32, 10.79s/it]
                                                          
{'loss': '0.1588', 'grad_norm': '0.511', 'learning_rate': '1.756e-05', 'epoch': '0.2502'}

 25%|██▌       | 9500/37963 [29:35:19<85:20:32, 10.79s/it]
 25%|██▌       | 9501/37963 [29:35:29<83:49:24, 10.60s/it]
 25%|██▌       | 9502/37963 [29:35:39<82:47:01, 10.47s/it]
 25%|██▌       | 9503/37963 [29:35:49<81:42:08, 10.33s/it]
 25%|██▌       | 9504/37963 [29:36:05<96:13:50, 12.17s/it]
 25%|██▌       | 9505/37963 [29:36:15<90:34:09, 11.46s/it]
 25%|██▌       | 9506/37963 [29:36:31<101:56:31, 12.90s/it]
 25%|██▌       | 9507/37963 [29:36:42<95:16:44, 12.05s/it] 
 25%|██▌       | 9508/37963 [29:36:52<90:33:19, 11.46s/it]
 25%|██▌       | 9509/37963 [29:37:02<87:37:52, 11.09s/it]
 25%|██▌       | 9510/37963 [29:37:12<84:55:52, 10.75s/it]
                                                          
{'loss': '0.1623', 'grad_norm': '1.077', 'learning_rate': '1.756e-05', 'epoch': '0.2505'}

 25%|██▌       | 9510/37963 [29:37:12<84:55:52, 10.75s/it]
 25%|██▌       | 9511/37963 [29:37:22<83:27:15, 10.56s/it]
 25%|██▌       | 9512/37963 [29:37:32<81:37:36, 10.33s/it]
 25%|██▌       | 9513/37963 [29:37:49<97:36:46, 12.35s/it]
 25%|██▌       | 9514/37963 [29:37:59<92:14:31, 11.67s/it]
 25%|██▌       | 9515/37963 [29:38:09<88:08:24, 11.15s/it]
 25%|██▌       | 9516/37963 [29:38:19<85:41:44, 10.84s/it]
 25%|██▌       | 9517/37963 [29:38:29<82:48:16, 10.48s/it]
 25%|██▌       | 9518/37963 [29:38:39<81:54:28, 10.37s/it]
 25%|██▌       | 9519/37963 [29:38:49<81:12:31, 10.28s/it]
 25%|██▌       | 9520/37963 [29:38:58<79:18:25, 10.04s/it]
                                                          
{'loss': '0.1644', 'grad_norm': '2.461', 'learning_rate': '1.755e-05', 'epoch': '0.2508'}

 25%|██▌       | 9520/37963 [29:38:58<79:18:25, 10.04s/it]
 25%|██▌       | 9521/37963 [29:39:21<108:34:17, 13.74s/it]
 25%|██▌       | 9522/37963 [29:39:31<99:49:59, 12.64s/it] 
 25%|██▌       | 9523/37963 [29:39:41<93:50:21, 11.88s/it]
 25%|██▌       | 9524/37963 [29:39:51<89:01:18, 11.27s/it]
 25%|██▌       | 9525/37963 [29:40:01<86:14:21, 10.92s/it]
 25%|██▌       | 9526/37963 [29:40:17<98:24:02, 12.46s/it]
 25%|██▌       | 9527/37963 [29:40:27<92:39:57, 11.73s/it]
 25%|██▌       | 9528/37963 [29:40:37<88:42:40, 11.23s/it]
 25%|██▌       | 9529/37963 [29:40:47<86:00:59, 10.89s/it]
 25%|██▌       | 9530/37963 [29:40:57<82:46:07, 10.48s/it]
                                                          
{'loss': '0.1769', 'grad_norm': '4.658', 'learning_rate': '1.755e-05', 'epoch': '0.251'}

 25%|██▌       | 9530/37963 [29:40:57<82:46:07, 10.48s/it]
 25%|██▌       | 9531/37963 [29:41:07<81:47:07, 10.36s/it]
 25%|██▌       | 9532/37963 [29:41:17<81:12:49, 10.28s/it]
 25%|██▌       | 9533/37963 [29:41:27<80:37:41, 10.21s/it]
 25%|██▌       | 9534/37963 [29:41:37<79:46:32, 10.10s/it]
 25%|██▌       | 9535/37963 [29:41:47<79:37:02, 10.08s/it]
 25%|██▌       | 9536/37963 [29:41:57<79:25:21, 10.06s/it]
 25%|██▌       | 9537/37963 [29:42:14<96:08:14, 12.18s/it]
 25%|██▌       | 9538/37963 [29:42:23<90:07:15, 11.41s/it]
 25%|██▌       | 9539/37963 [29:42:34<87:11:27, 11.04s/it]
 25%|██▌       | 9540/37963 [29:42:44<85:05:40, 10.78s/it]
                                                          
{'loss': '0.1699', 'grad_norm': '1.583', 'learning_rate': '1.754e-05', 'epoch': '0.2513'}

 25%|██▌       | 9540/37963 [29:42:44<85:05:40, 10.78s/it]
 25%|██▌       | 9541/37963 [29:42:54<83:14:21, 10.54s/it]
 25%|██▌       | 9542/37963 [29:43:04<81:34:02, 10.33s/it]
 25%|██▌       | 9543/37963 [29:43:14<80:45:52, 10.23s/it]
 25%|██▌       | 9544/37963 [29:43:30<96:10:40, 12.18s/it]
 25%|██▌       | 9545/37963 [29:43:41<91:33:38, 11.60s/it]
 25%|██▌       | 9546/37963 [29:43:50<86:59:26, 11.02s/it]
 25%|██▌       | 9547/37963 [29:44:00<84:34:44, 10.72s/it]
 25%|██▌       | 9548/37963 [29:44:10<83:09:50, 10.54s/it]
 25%|██▌       | 9549/37963 [29:44:20<81:00:01, 10.26s/it]
 25%|██▌       | 9550/37963 [29:44:30<80:40:40, 10.22s/it]
                                                          
{'loss': '0.1768', 'grad_norm': '1.221', 'learning_rate': '1.753e-05', 'epoch': '0.2516'}

 25%|██▌       | 9550/37963 [29:44:30<80:40:40, 10.22s/it]
 25%|██▌       | 9551/37963 [29:44:40<79:42:16, 10.10s/it]
 25%|██▌       | 9552/37963 [29:44:56<94:40:03, 12.00s/it]
 25%|██▌       | 9553/37963 [29:45:06<90:23:39, 11.45s/it]
 25%|██▌       | 9554/37963 [29:45:17<87:03:10, 11.03s/it]
 25%|██▌       | 9555/37963 [29:45:33<100:21:20, 12.72s/it]
 25%|██▌       | 9556/37963 [29:45:43<94:11:14, 11.94s/it] 
 25%|██▌       | 9557/37963 [29:45:53<89:20:36, 11.32s/it]
 25%|██▌       | 9558/37963 [29:46:03<86:25:24, 10.95s/it]
 25%|██▌       | 9559/37963 [29:46:13<84:19:26, 10.69s/it]
 25%|██▌       | 9560/37963 [29:46:23<82:53:34, 10.51s/it]
                                                          
{'loss': '0.1638', 'grad_norm': '4.005', 'learning_rate': '1.753e-05', 'epoch': '0.2518'}

 25%|██▌       | 9560/37963 [29:46:23<82:53:34, 10.51s/it]
 25%|██▌       | 9561/37963 [29:46:40<96:43:11, 12.26s/it]
 25%|██▌       | 9562/37963 [29:46:50<91:38:23, 11.62s/it]
 25%|██▌       | 9563/37963 [29:47:00<87:39:36, 11.11s/it]
 25%|██▌       | 9564/37963 [29:47:10<84:52:37, 10.76s/it]
 25%|██▌       | 9565/37963 [29:47:20<83:03:03, 10.53s/it]
 25%|██▌       | 9566/37963 [29:47:30<81:53:58, 10.38s/it]
 25%|██▌       | 9567/37963 [29:47:40<81:22:08, 10.32s/it]
 25%|██▌       | 9568/37963 [29:47:50<80:51:07, 10.25s/it]
 25%|██▌       | 9569/37963 [29:48:06<94:52:25, 12.03s/it]
 25%|██▌       | 9570/37963 [29:48:16<90:19:54, 11.45s/it]
                                                          
{'loss': '0.1613', 'grad_norm': '2.021', 'learning_rate': '1.752e-05', 'epoch': '0.2521'}

 25%|██▌       | 9570/37963 [29:48:16<90:19:54, 11.45s/it]
 25%|██▌       | 9571/37963 [29:48:26<86:54:39, 11.02s/it]
 25%|██▌       | 9572/37963 [29:48:43<100:33:32, 12.75s/it]
 25%|██▌       | 9573/37963 [29:48:53<94:19:20, 11.96s/it] 
 25%|██▌       | 9574/37963 [29:49:10<105:04:24, 13.32s/it]
 25%|██▌       | 9575/37963 [29:49:20<97:22:14, 12.35s/it] 
 25%|██▌       | 9576/37963 [29:49:30<92:00:42, 11.67s/it]
 25%|██▌       | 9577/37963 [29:49:40<88:14:37, 11.19s/it]
 25%|██▌       | 9578/37963 [29:49:50<85:40:43, 10.87s/it]
 25%|██▌       | 9579/37963 [29:50:00<83:47:35, 10.63s/it]
 25%|██▌       | 9580/37963 [29:50:10<82:23:19, 10.45s/it]
                                                          
{'loss': '0.1712', 'grad_norm': '2.328', 'learning_rate': '1.752e-05', 'epoch': '0.2524'}

 25%|██▌       | 9580/37963 [29:50:10<82:23:19, 10.45s/it]
 25%|██▌       | 9581/37963 [29:50:20<80:53:48, 10.26s/it]
 25%|██▌       | 9582/37963 [29:50:30<80:04:35, 10.16s/it]
 25%|██▌       | 9583/37963 [29:50:40<79:38:43, 10.10s/it]
 25%|██▌       | 9584/37963 [29:50:50<79:43:10, 10.11s/it]
 25%|██▌       | 9585/37963 [29:51:07<96:31:26, 12.24s/it]
 25%|██▌       | 9586/37963 [29:51:17<91:33:15, 11.61s/it]
 25%|██▌       | 9587/37963 [29:51:27<87:56:01, 11.16s/it]
 25%|██▌       | 9588/37963 [29:51:37<84:51:18, 10.77s/it]
 25%|██▌       | 9589/37963 [29:51:47<83:15:08, 10.56s/it]
 25%|██▌       | 9590/37963 [29:51:58<82:11:02, 10.43s/it]
                                                          
{'loss': '0.1695', 'grad_norm': '0.7696', 'learning_rate': '1.751e-05', 'epoch': '0.2526'}

 25%|██▌       | 9590/37963 [29:51:58<82:11:02, 10.43s/it]
 25%|██▌       | 9591/37963 [29:52:08<81:25:56, 10.33s/it]
 25%|██▌       | 9592/37963 [29:52:18<81:27:05, 10.34s/it]
 25%|██▌       | 9593/37963 [29:52:34<95:51:01, 12.16s/it]
 25%|██▌       | 9594/37963 [29:52:44<90:48:28, 11.52s/it]
 25%|██▌       | 9595/37963 [29:52:55<87:32:07, 11.11s/it]
 25%|██▌       | 9596/37963 [29:53:05<85:02:48, 10.79s/it]
 25%|██▌       | 9597/37963 [29:53:15<83:05:10, 10.54s/it]
 25%|██▌       | 9598/37963 [29:53:25<81:50:53, 10.39s/it]
 25%|██▌       | 9599/37963 [29:53:35<80:59:23, 10.28s/it]
 25%|██▌       | 9600/37963 [29:53:45<80:40:35, 10.24s/it]
                                                          
{'loss': '0.1674', 'grad_norm': '4.734', 'learning_rate': '1.751e-05', 'epoch': '0.2529'}

 25%|██▌       | 9600/37963 [29:53:45<80:40:35, 10.24s/it]
 25%|██▌       | 9601/37963 [29:54:01<95:39:59, 12.14s/it]
 25%|██▌       | 9602/37963 [29:54:11<89:51:58, 11.41s/it]
 25%|██▌       | 9603/37963 [29:54:27<101:24:30, 12.87s/it]
 25%|██▌       | 9604/37963 [29:54:37<94:23:15, 11.98s/it] 
 25%|██▌       | 9605/37963 [29:54:47<89:56:30, 11.42s/it]
 25%|██▌       | 9606/37963 [29:54:57<86:42:44, 11.01s/it]
 25%|██▌       | 9607/37963 [29:55:07<83:47:02, 10.64s/it]
 25%|██▌       | 9608/37963 [29:55:17<81:49:56, 10.39s/it]
 25%|██▌       | 9609/37963 [29:55:27<81:18:55, 10.32s/it]
 25%|██▌       | 9610/37963 [29:55:44<97:07:16, 12.33s/it]
                                                          
{'loss': '0.163', 'grad_norm': '3.973', 'learning_rate': '1.75e-05', 'epoch': '0.2531'}

 25%|██▌       | 9610/37963 [29:55:44<97:07:16, 12.33s/it]
 25%|██▌       | 9611/37963 [29:55:54<92:05:04, 11.69s/it]
 25%|██▌       | 9612/37963 [29:56:04<87:08:21, 11.06s/it]
 25%|██▌       | 9613/37963 [29:56:14<85:00:02, 10.79s/it]
 25%|██▌       | 9614/37963 [29:56:24<82:10:32, 10.44s/it]
 25%|██▌       | 9615/37963 [29:56:34<81:11:10, 10.31s/it]
 25%|██▌       | 9616/37963 [29:56:50<94:49:12, 12.04s/it]
 25%|██▌       | 9617/37963 [29:57:00<90:59:01, 11.56s/it]
 25%|██▌       | 9618/37963 [29:57:11<87:48:53, 11.15s/it]
 25%|██▌       | 9619/37963 [29:57:21<85:23:59, 10.85s/it]
 25%|██▌       | 9620/37963 [29:57:37<99:16:45, 12.61s/it]
                                                          
{'loss': '0.1777', 'grad_norm': '2.811', 'learning_rate': '1.75e-05', 'epoch': '0.2534'}

 25%|██▌       | 9620/37963 [29:57:37<99:16:45, 12.61s/it]
 25%|██▌       | 9621/37963 [29:57:48<93:28:52, 11.87s/it]
 25%|██▌       | 9622/37963 [29:58:04<104:50:56, 13.32s/it]
 25%|██▌       | 9623/37963 [29:58:14<96:57:00, 12.32s/it] 
 25%|██▌       | 9624/37963 [29:58:24<91:15:57, 11.59s/it]
 25%|██▌       | 9625/37963 [29:58:34<87:31:19, 11.12s/it]
 25%|██▌       | 9626/37963 [29:58:44<85:10:28, 10.82s/it]
 25%|██▌       | 9627/37963 [29:58:54<82:25:44, 10.47s/it]
 25%|██▌       | 9628/37963 [29:59:04<81:33:30, 10.36s/it]
 25%|██▌       | 9629/37963 [29:59:14<80:49:57, 10.27s/it]
 25%|██▌       | 9630/37963 [29:59:24<80:10:00, 10.19s/it]
                                                          
{'loss': '0.1617', 'grad_norm': '4.048', 'learning_rate': '1.749e-05', 'epoch': '0.2537'}

 25%|██▌       | 9630/37963 [29:59:24<80:10:00, 10.19s/it]
 25%|██▌       | 9631/37963 [29:59:34<79:53:11, 10.15s/it]
 25%|██▌       | 9632/37963 [29:59:44<79:45:45, 10.14s/it]
 25%|██▌       | 9633/37963 [29:59:54<78:42:29, 10.00s/it]
 25%|██▌       | 9634/37963 [30:00:11<95:18:05, 12.11s/it]
 25%|██▌       | 9635/37963 [30:00:21<90:44:30, 11.53s/it]
 25%|██▌       | 9636/37963 [30:00:31<87:26:53, 11.11s/it]
 25%|██▌       | 9637/37963 [30:00:41<85:04:08, 10.81s/it]
 25%|██▌       | 9638/37963 [30:00:51<83:00:12, 10.55s/it]
 25%|██▌       | 9639/37963 [30:01:01<82:06:41, 10.44s/it]
 25%|██▌       | 9640/37963 [30:01:18<96:13:11, 12.23s/it]
                                                          
{'loss': '0.1753', 'grad_norm': '1.142', 'learning_rate': '1.748e-05', 'epoch': '0.2539'}

 25%|██▌       | 9640/37963 [30:01:18<96:13:11, 12.23s/it]
 25%|██▌       | 9641/37963 [30:01:28<91:03:06, 11.57s/it]
 25%|██▌       | 9642/37963 [30:01:38<87:36:40, 11.14s/it]
 25%|██▌       | 9643/37963 [30:01:48<85:05:54, 10.82s/it]
 25%|██▌       | 9644/37963 [30:01:58<82:48:40, 10.53s/it]
 25%|██▌       | 9645/37963 [30:02:08<80:58:05, 10.29s/it]
 25%|██▌       | 9646/37963 [30:02:18<80:33:18, 10.24s/it]
 25%|██▌       | 9647/37963 [30:02:28<80:11:17, 10.19s/it]
 25%|██▌       | 9648/37963 [30:02:45<95:38:59, 12.16s/it]
 25%|██▌       | 9649/37963 [30:02:55<90:35:34, 11.52s/it]
 25%|██▌       | 9650/37963 [30:03:11<102:55:29, 13.09s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '2.038', 'learning_rate': '1.748e-05', 'epoch': '0.2542'}

 25%|██▌       | 9650/37963 [30:03:11<102:55:29, 13.09s/it]
 25%|██▌       | 9651/37963 [30:03:21<95:12:25, 12.11s/it] 
 25%|██▌       | 9652/37963 [30:03:31<90:48:29, 11.55s/it]
 25%|██▌       | 9653/37963 [30:03:42<87:18:17, 11.10s/it]
 25%|██▌       | 9654/37963 [30:03:52<85:12:20, 10.84s/it]
 25%|██▌       | 9655/37963 [30:04:02<83:34:14, 10.63s/it]
 25%|██▌       | 9656/37963 [30:04:12<82:17:35, 10.47s/it]
 25%|██▌       | 9657/37963 [30:04:29<97:23:47, 12.39s/it]
 25%|██▌       | 9658/37963 [30:04:39<91:45:55, 11.67s/it]
 25%|██▌       | 9659/37963 [30:04:49<87:35:36, 11.14s/it]
 25%|██▌       | 9660/37963 [30:04:59<84:57:08, 10.81s/it]
                                                          
{'loss': '0.1708', 'grad_norm': '0.8224', 'learning_rate': '1.747e-05', 'epoch': '0.2545'}

 25%|██▌       | 9660/37963 [30:04:59<84:57:08, 10.81s/it]
 25%|██▌       | 9661/37963 [30:05:09<82:55:55, 10.55s/it]
 25%|██▌       | 9662/37963 [30:05:19<81:48:13, 10.41s/it]
 25%|██▌       | 9663/37963 [30:05:29<80:50:46, 10.28s/it]
 25%|██▌       | 9664/37963 [30:05:39<80:31:44, 10.24s/it]
 25%|██▌       | 9665/37963 [30:05:56<95:27:55, 12.14s/it]
 25%|██▌       | 9666/37963 [30:06:06<90:20:25, 11.49s/it]
 25%|██▌       | 9667/37963 [30:06:16<86:59:48, 11.07s/it]
 25%|██▌       | 9668/37963 [30:06:33<100:47:52, 12.82s/it]
 25%|██▌       | 9669/37963 [30:06:43<94:29:24, 12.02s/it] 
 25%|██▌       | 9670/37963 [30:06:53<89:52:12, 11.44s/it]
                                                          
{'loss': '0.1654', 'grad_norm': '4.377', 'learning_rate': '1.747e-05', 'epoch': '0.2547'}

 25%|██▌       | 9670/37963 [30:06:53<89:52:12, 11.44s/it]
 25%|██▌       | 9671/37963 [30:07:09<102:03:39, 12.99s/it]
 25%|██▌       | 9672/37963 [30:07:19<95:14:19, 12.12s/it] 
 25%|██▌       | 9673/37963 [30:07:30<90:34:23, 11.53s/it]
 25%|██▌       | 9674/37963 [30:07:40<86:59:35, 11.07s/it]
 25%|██▌       | 9675/37963 [30:07:50<84:37:15, 10.77s/it]
 25%|██▌       | 9676/37963 [30:08:00<83:03:17, 10.57s/it]
 25%|██▌       | 9677/37963 [30:08:10<81:24:59, 10.36s/it]
 25%|██▌       | 9678/37963 [30:08:20<80:42:19, 10.27s/it]
 25%|██▌       | 9679/37963 [30:08:30<80:12:15, 10.21s/it]
 25%|██▌       | 9680/37963 [30:08:40<79:53:05, 10.17s/it]
                                                          
{'loss': '0.1629', 'grad_norm': '0.8484', 'learning_rate': '1.746e-05', 'epoch': '0.255'}

 25%|██▌       | 9680/37963 [30:08:40<79:53:05, 10.17s/it]
 26%|██▌       | 9681/37963 [30:08:50<79:37:30, 10.14s/it]
 26%|██▌       | 9682/37963 [30:09:07<96:00:22, 12.22s/it]
 26%|██▌       | 9683/37963 [30:09:17<91:11:28, 11.61s/it]
 26%|██▌       | 9684/37963 [30:09:27<87:34:19, 11.15s/it]
 26%|██▌       | 9685/37963 [30:09:37<85:06:03, 10.83s/it]
 26%|██▌       | 9686/37963 [30:09:47<83:17:16, 10.60s/it]
 26%|██▌       | 9687/37963 [30:09:57<82:00:36, 10.44s/it]
 26%|██▌       | 9688/37963 [30:10:14<96:13:53, 12.25s/it]
 26%|██▌       | 9689/37963 [30:10:24<91:14:54, 11.62s/it]
 26%|██▌       | 9690/37963 [30:10:34<87:22:50, 11.13s/it]
                                                          
{'loss': '0.1794', 'grad_norm': '3.825', 'learning_rate': '1.746e-05', 'epoch': '0.2552'}

 26%|██▌       | 9690/37963 [30:10:34<87:22:50, 11.13s/it]
 26%|██▌       | 9691/37963 [30:10:44<84:30:47, 10.76s/it]
 26%|██▌       | 9692/37963 [30:10:54<81:43:41, 10.41s/it]
 26%|██▌       | 9693/37963 [30:11:04<80:53:56, 10.30s/it]
 26%|██▌       | 9694/37963 [30:11:14<80:20:56, 10.23s/it]
 26%|██▌       | 9695/37963 [30:11:30<95:15:22, 12.13s/it]
 26%|██▌       | 9696/37963 [30:11:40<90:26:50, 11.52s/it]
 26%|██▌       | 9697/37963 [30:11:50<87:05:32, 11.09s/it]
 26%|██▌       | 9698/37963 [30:12:07<99:58:54, 12.73s/it]
 26%|██▌       | 9699/37963 [30:12:17<93:07:35, 11.86s/it]
 26%|██▌       | 9700/37963 [30:12:27<89:00:48, 11.34s/it]
                                                          
{'loss': '0.1723', 'grad_norm': '1.272', 'learning_rate': '1.745e-05', 'epoch': '0.2555'}

 26%|██▌       | 9700/37963 [30:12:27<89:00:48, 11.34s/it]
 26%|██▌       | 9701/37963 [30:12:37<85:55:30, 10.95s/it]
 26%|██▌       | 9702/37963 [30:12:47<83:58:14, 10.70s/it]
 26%|██▌       | 9703/37963 [30:12:57<82:04:22, 10.46s/it]
 26%|██▌       | 9704/37963 [30:13:07<81:19:49, 10.36s/it]
 26%|██▌       | 9705/37963 [30:13:24<97:04:00, 12.37s/it]
 26%|██▌       | 9706/37963 [30:13:34<91:32:19, 11.66s/it]
 26%|██▌       | 9707/37963 [30:13:44<87:44:22, 11.18s/it]
 26%|██▌       | 9708/37963 [30:13:54<85:10:41, 10.85s/it]
 26%|██▌       | 9709/37963 [30:14:04<83:22:14, 10.62s/it]
 26%|██▌       | 9710/37963 [30:14:15<82:08:42, 10.47s/it]
                                                          
{'loss': '0.1465', 'grad_norm': '1.778', 'learning_rate': '1.744e-05', 'epoch': '0.2558'}

 26%|██▌       | 9710/37963 [30:14:15<82:08:42, 10.47s/it]
 26%|██▌       | 9711/37963 [30:14:25<81:29:49, 10.38s/it]
 26%|██▌       | 9712/37963 [30:14:35<80:53:43, 10.31s/it]
 26%|██▌       | 9713/37963 [30:14:45<80:31:51, 10.26s/it]
 26%|██▌       | 9714/37963 [30:15:02<95:17:05, 12.14s/it]
 26%|██▌       | 9715/37963 [30:15:12<90:28:19, 11.53s/it]
 26%|██▌       | 9716/37963 [30:15:22<87:17:37, 11.13s/it]
 26%|██▌       | 9717/37963 [30:15:38<100:20:53, 12.79s/it]
 26%|██▌       | 9718/37963 [30:15:49<93:58:52, 11.98s/it] 
 26%|██▌       | 9719/37963 [30:16:05<104:27:13, 13.31s/it]
 26%|██▌       | 9720/37963 [30:16:15<97:12:23, 12.39s/it] 
                                                          
{'loss': '0.1823', 'grad_norm': '0.8415', 'learning_rate': '1.744e-05', 'epoch': '0.256'}

 26%|██▌       | 9720/37963 [30:16:15<97:12:23, 12.39s/it]
 26%|██▌       | 9721/37963 [30:16:25<91:14:28, 11.63s/it]
 26%|██▌       | 9722/37963 [30:16:35<86:58:43, 11.09s/it]
 26%|██▌       | 9723/37963 [30:16:45<84:35:49, 10.78s/it]
 26%|██▌       | 9724/37963 [30:16:55<82:28:41, 10.51s/it]
 26%|██▌       | 9725/37963 [30:17:05<81:24:42, 10.38s/it]
 26%|██▌       | 9726/37963 [30:17:15<80:06:08, 10.21s/it]
 26%|██▌       | 9727/37963 [30:17:25<79:47:05, 10.17s/it]
 26%|██▌       | 9728/37963 [30:17:35<79:32:18, 10.14s/it]
 26%|██▌       | 9729/37963 [30:17:45<79:32:03, 10.14s/it]
 26%|██▌       | 9730/37963 [30:17:55<78:58:17, 10.07s/it]
                                                          
{'loss': '0.1673', 'grad_norm': '2.786', 'learning_rate': '1.743e-05', 'epoch': '0.2563'}

 26%|██▌       | 9730/37963 [30:17:55<78:58:17, 10.07s/it]
 26%|██▌       | 9731/37963 [30:18:12<95:37:57, 12.19s/it]
 26%|██▌       | 9732/37963 [30:18:22<90:43:26, 11.57s/it]
 26%|██▌       | 9733/37963 [30:18:32<87:09:34, 11.11s/it]
 26%|██▌       | 9734/37963 [30:18:42<84:23:28, 10.76s/it]
 26%|██▌       | 9735/37963 [30:18:52<82:44:52, 10.55s/it]
 26%|██▌       | 9736/37963 [30:19:08<96:03:15, 12.25s/it]
 26%|██▌       | 9737/37963 [30:19:19<91:00:22, 11.61s/it]
 26%|██▌       | 9738/37963 [30:19:29<87:26:41, 11.15s/it]
 26%|██▌       | 9739/37963 [30:19:39<84:49:52, 10.82s/it]
 26%|██▌       | 9740/37963 [30:19:49<83:38:13, 10.67s/it]
                                                          
{'loss': '0.1711', 'grad_norm': '2.525', 'learning_rate': '1.743e-05', 'epoch': '0.2566'}

 26%|██▌       | 9740/37963 [30:19:49<83:38:13, 10.67s/it]
 26%|██▌       | 9741/37963 [30:19:59<81:27:58, 10.39s/it]
 26%|██▌       | 9742/37963 [30:20:09<80:47:56, 10.31s/it]
 26%|██▌       | 9743/37963 [30:20:25<95:30:51, 12.18s/it]
 26%|██▌       | 9744/37963 [30:20:35<90:23:02, 11.53s/it]
 26%|██▌       | 9745/37963 [30:20:45<86:50:10, 11.08s/it]
 26%|██▌       | 9746/37963 [30:20:56<84:41:17, 10.80s/it]
 26%|██▌       | 9747/37963 [30:21:12<98:08:23, 12.52s/it]
 26%|██▌       | 9748/37963 [30:21:22<92:22:26, 11.79s/it]
 26%|██▌       | 9749/37963 [30:21:32<87:16:25, 11.14s/it]
 26%|██▌       | 9750/37963 [30:21:42<84:37:49, 10.80s/it]
                                                          
{'loss': '0.1479', 'grad_norm': '1.474', 'learning_rate': '1.742e-05', 'epoch': '0.2568'}

 26%|██▌       | 9750/37963 [30:21:42<84:37:49, 10.80s/it]
 26%|██▌       | 9751/37963 [30:21:52<82:52:29, 10.58s/it]
 26%|██▌       | 9752/37963 [30:22:02<81:01:54, 10.34s/it]
 26%|██▌       | 9753/37963 [30:22:19<96:52:32, 12.36s/it]
 26%|██▌       | 9754/37963 [30:22:29<91:32:27, 11.68s/it]
 26%|██▌       | 9755/37963 [30:22:39<87:50:35, 11.21s/it]
 26%|██▌       | 9756/37963 [30:22:49<85:10:49, 10.87s/it]
 26%|██▌       | 9757/37963 [30:22:59<82:31:41, 10.53s/it]
 26%|██▌       | 9758/37963 [30:23:09<80:45:51, 10.31s/it]
 26%|██▌       | 9759/37963 [30:23:19<80:10:19, 10.23s/it]
 26%|██▌       | 9760/37963 [30:23:29<79:46:01, 10.18s/it]
                                                          
{'loss': '0.1568', 'grad_norm': '3.526', 'learning_rate': '1.742e-05', 'epoch': '0.2571'}

 26%|██▌       | 9760/37963 [30:23:29<79:46:01, 10.18s/it]
 26%|██▌       | 9761/37963 [30:23:39<79:25:04, 10.14s/it]
 26%|██▌       | 9762/37963 [30:23:49<79:13:47, 10.11s/it]
 26%|██▌       | 9763/37963 [30:24:04<91:57:21, 11.74s/it]
 26%|██▌       | 9764/37963 [30:24:15<88:54:51, 11.35s/it]
 26%|██▌       | 9765/37963 [30:24:31<100:58:36, 12.89s/it]
 26%|██▌       | 9766/37963 [30:24:41<93:45:22, 11.97s/it] 
 26%|██▌       | 9767/37963 [30:24:58<104:57:15, 13.40s/it]
 26%|██▌       | 9768/37963 [30:25:08<97:17:49, 12.42s/it] 
 26%|██▌       | 9769/37963 [30:25:18<92:03:42, 11.76s/it]
 26%|██▌       | 9770/37963 [30:25:28<88:06:30, 11.25s/it]
                                                          
{'loss': '0.1401', 'grad_norm': '1.514', 'learning_rate': '1.741e-05', 'epoch': '0.2574'}

 26%|██▌       | 9770/37963 [30:25:28<88:06:30, 11.25s/it]
 26%|██▌       | 9771/37963 [30:25:38<85:11:21, 10.88s/it]
 26%|██▌       | 9772/37963 [30:25:48<83:18:23, 10.64s/it]
 26%|██▌       | 9773/37963 [30:25:58<81:54:48, 10.46s/it]
 26%|██▌       | 9774/37963 [30:26:08<80:58:32, 10.34s/it]
 26%|██▌       | 9775/37963 [30:26:19<80:23:20, 10.27s/it]
 26%|██▌       | 9776/37963 [30:26:29<80:04:03, 10.23s/it]
 26%|██▌       | 9777/37963 [30:26:39<79:44:39, 10.19s/it]
 26%|██▌       | 9778/37963 [30:26:49<79:32:37, 10.16s/it]
 26%|██▌       | 9779/37963 [30:27:06<95:54:03, 12.25s/it]
 26%|██▌       | 9780/37963 [30:27:16<90:55:26, 11.61s/it]
                                                          
{'loss': '0.1631', 'grad_norm': '1.569', 'learning_rate': '1.74e-05', 'epoch': '0.2576'}

 26%|██▌       | 9780/37963 [30:27:16<90:55:26, 11.61s/it]
 26%|██▌       | 9781/37963 [30:27:26<87:11:56, 11.14s/it]
 26%|██▌       | 9782/37963 [30:27:36<84:37:48, 10.81s/it]
 26%|██▌       | 9783/37963 [30:27:46<82:35:11, 10.55s/it]
 26%|██▌       | 9784/37963 [30:28:03<96:59:34, 12.39s/it]
 26%|██▌       | 9785/37963 [30:28:13<91:04:01, 11.63s/it]
 26%|██▌       | 9786/37963 [30:28:22<86:34:14, 11.06s/it]
 26%|██▌       | 9787/37963 [30:28:33<84:19:04, 10.77s/it]
 26%|██▌       | 9788/37963 [30:28:43<82:35:13, 10.55s/it]
 26%|██▌       | 9789/37963 [30:28:53<81:41:52, 10.44s/it]
 26%|██▌       | 9790/37963 [30:29:03<80:53:33, 10.34s/it]
                                                          
{'loss': '0.1533', 'grad_norm': '2.592', 'learning_rate': '1.74e-05', 'epoch': '0.2579'}

 26%|██▌       | 9790/37963 [30:29:03<80:53:33, 10.34s/it]
 26%|██▌       | 9791/37963 [30:29:13<80:17:41, 10.26s/it]
 26%|██▌       | 9792/37963 [30:29:30<95:18:44, 12.18s/it]
 26%|██▌       | 9793/37963 [30:29:40<90:17:26, 11.54s/it]
 26%|██▌       | 9794/37963 [30:29:56<101:26:49, 12.96s/it]
 26%|██▌       | 9795/37963 [30:30:06<94:49:33, 12.12s/it] 
 26%|██▌       | 9796/37963 [30:30:16<89:45:48, 11.47s/it]
 26%|██▌       | 9797/37963 [30:30:26<86:26:55, 11.05s/it]
 26%|██▌       | 9798/37963 [30:30:36<83:43:55, 10.70s/it]
 26%|██▌       | 9799/37963 [30:30:46<81:49:06, 10.46s/it]
 26%|██▌       | 9800/37963 [30:30:56<80:16:28, 10.26s/it]
                                                          
{'loss': '0.1704', 'grad_norm': '3.167', 'learning_rate': '1.739e-05', 'epoch': '0.2581'}

 26%|██▌       | 9800/37963 [30:30:56<80:16:28, 10.26s/it]
 26%|██▌       | 9801/37963 [30:31:05<79:10:28, 10.12s/it]
 26%|██▌       | 9802/37963 [30:31:15<77:58:58,  9.97s/it]
 26%|██▌       | 9803/37963 [30:31:32<93:33:29, 11.96s/it]
 26%|██▌       | 9804/37963 [30:31:42<89:10:34, 11.40s/it]
 26%|██▌       | 9805/37963 [30:31:52<86:08:34, 11.01s/it]
 26%|██▌       | 9806/37963 [30:32:01<82:39:07, 10.57s/it]
 26%|██▌       | 9807/37963 [30:32:11<81:18:35, 10.40s/it]
 26%|██▌       | 9808/37963 [30:32:22<80:41:23, 10.32s/it]
 26%|██▌       | 9809/37963 [30:32:31<79:43:09, 10.19s/it]
 26%|██▌       | 9810/37963 [30:32:48<94:18:08, 12.06s/it]
                                                          
{'loss': '0.1598', 'grad_norm': '2.94', 'learning_rate': '1.739e-05', 'epoch': '0.2584'}

 26%|██▌       | 9810/37963 [30:32:48<94:18:08, 12.06s/it]
 26%|██▌       | 9811/37963 [30:33:04<104:30:52, 13.37s/it]
 26%|██▌       | 9812/37963 [30:33:14<96:25:22, 12.33s/it] 
 26%|██▌       | 9813/37963 [30:33:24<90:45:42, 11.61s/it]
 26%|██▌       | 9814/37963 [30:33:34<86:48:39, 11.10s/it]
 26%|██▌       | 9815/37963 [30:33:44<84:37:51, 10.82s/it]
 26%|██▌       | 9816/37963 [30:34:01<97:27:43, 12.47s/it]
 26%|██▌       | 9817/37963 [30:34:11<91:58:14, 11.76s/it]
 26%|██▌       | 9818/37963 [30:34:21<88:06:47, 11.27s/it]
 26%|██▌       | 9819/37963 [30:34:31<85:23:51, 10.92s/it]
 26%|██▌       | 9820/37963 [30:34:41<83:32:54, 10.69s/it]
                                                          
{'loss': '0.1569', 'grad_norm': '2.387', 'learning_rate': '1.738e-05', 'epoch': '0.2587'}

 26%|██▌       | 9820/37963 [30:34:41<83:32:54, 10.69s/it]
 26%|██▌       | 9821/37963 [30:34:51<82:14:22, 10.52s/it]
 26%|██▌       | 9822/37963 [30:35:01<81:28:52, 10.42s/it]
 26%|██▌       | 9823/37963 [30:35:11<80:27:40, 10.29s/it]
 26%|██▌       | 9824/37963 [30:35:21<79:54:39, 10.22s/it]
 26%|██▌       | 9825/37963 [30:35:31<79:39:06, 10.19s/it]
 26%|██▌       | 9826/37963 [30:35:42<79:23:51, 10.16s/it]
 26%|██▌       | 9827/37963 [30:35:52<79:15:42, 10.14s/it]
 26%|██▌       | 9828/37963 [30:36:02<78:47:13, 10.08s/it]
 26%|██▌       | 9829/37963 [30:36:19<95:10:20, 12.18s/it]
 26%|██▌       | 9830/37963 [30:36:29<90:15:56, 11.55s/it]
                                                          
{'loss': '0.1662', 'grad_norm': '1.622', 'learning_rate': '1.738e-05', 'epoch': '0.2589'}

 26%|██▌       | 9830/37963 [30:36:29<90:15:56, 11.55s/it]
 26%|██▌       | 9831/37963 [30:36:39<86:42:27, 11.10s/it]
 26%|██▌       | 9832/37963 [30:36:48<83:19:55, 10.66s/it]
 26%|██▌       | 9833/37963 [30:37:05<96:46:30, 12.39s/it]
 26%|██▌       | 9834/37963 [30:37:15<91:29:23, 11.71s/it]
 26%|██▌       | 9835/37963 [30:37:24<86:05:29, 11.02s/it]
 26%|██▌       | 9836/37963 [30:37:35<84:03:51, 10.76s/it]
 26%|██▌       | 9837/37963 [30:37:45<82:29:25, 10.56s/it]
 26%|██▌       | 9838/37963 [30:37:55<81:15:32, 10.40s/it]
 26%|██▌       | 9839/37963 [30:38:11<95:31:14, 12.23s/it]
 26%|██▌       | 9840/37963 [30:38:21<90:00:10, 11.52s/it]
                                                          
{'loss': '0.1663', 'grad_norm': '1.632', 'learning_rate': '1.737e-05', 'epoch': '0.2592'}

 26%|██▌       | 9840/37963 [30:38:21<90:00:10, 11.52s/it]
 26%|██▌       | 9841/37963 [30:38:31<86:33:20, 11.08s/it]
 26%|██▌       | 9842/37963 [30:38:48<99:01:20, 12.68s/it]
 26%|██▌       | 9843/37963 [30:38:58<93:08:52, 11.93s/it]
 26%|██▌       | 9844/37963 [30:39:08<88:58:22, 11.39s/it]
 26%|██▌       | 9845/37963 [30:39:18<85:27:42, 10.94s/it]
 26%|██▌       | 9846/37963 [30:39:28<83:32:42, 10.70s/it]
 26%|██▌       | 9847/37963 [30:39:38<81:56:50, 10.49s/it]
 26%|██▌       | 9848/37963 [30:39:48<80:52:10, 10.35s/it]
 26%|██▌       | 9849/37963 [30:39:58<80:15:47, 10.28s/it]
 26%|██▌       | 9850/37963 [30:40:08<79:52:35, 10.23s/it]
                                                          
{'loss': '0.1688', 'grad_norm': '2.097', 'learning_rate': '1.736e-05', 'epoch': '0.2595'}

 26%|██▌       | 9850/37963 [30:40:08<79:52:35, 10.23s/it]
 26%|██▌       | 9851/37963 [30:40:18<79:35:34, 10.19s/it]
 26%|██▌       | 9852/37963 [30:40:28<79:31:18, 10.18s/it]
 26%|██▌       | 9853/37963 [30:40:45<95:11:50, 12.19s/it]
 26%|██▌       | 9854/37963 [30:40:55<90:26:37, 11.58s/it]
 26%|██▌       | 9855/37963 [30:41:05<86:50:17, 11.12s/it]
 26%|██▌       | 9856/37963 [30:41:16<84:23:04, 10.81s/it]
 26%|██▌       | 9857/37963 [30:41:26<82:44:07, 10.60s/it]
 26%|██▌       | 9858/37963 [30:41:36<81:37:11, 10.45s/it]
 26%|██▌       | 9859/37963 [30:41:52<96:14:57, 12.33s/it]
 26%|██▌       | 9860/37963 [30:42:09<105:21:54, 13.50s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '2.333', 'learning_rate': '1.736e-05', 'epoch': '0.2597'}

 26%|██▌       | 9860/37963 [30:42:09<105:21:54, 13.50s/it]
 26%|██▌       | 9861/37963 [30:42:19<97:27:43, 12.49s/it] 
 26%|██▌       | 9862/37963 [30:42:29<91:55:45, 11.78s/it]
 26%|██▌       | 9863/37963 [30:42:46<103:22:25, 13.24s/it]
 26%|██▌       | 9864/37963 [30:42:56<95:54:50, 12.29s/it] 
 26%|██▌       | 9865/37963 [30:43:06<90:48:23, 11.63s/it]
 26%|██▌       | 9866/37963 [30:43:15<85:51:32, 11.00s/it]
 26%|██▌       | 9867/37963 [30:43:25<83:14:43, 10.67s/it]
 26%|██▌       | 9868/37963 [30:43:35<81:50:20, 10.49s/it]
 26%|██▌       | 9869/37963 [30:43:45<81:00:16, 10.38s/it]
 26%|██▌       | 9870/37963 [30:43:55<80:20:17, 10.30s/it]
                                                          
{'loss': '0.1709', 'grad_norm': '0.9655', 'learning_rate': '1.735e-05', 'epoch': '0.26'}

 26%|██▌       | 9870/37963 [30:43:55<80:20:17, 10.30s/it]
 26%|██▌       | 9871/37963 [30:44:06<79:56:11, 10.24s/it]
 26%|██▌       | 9872/37963 [30:44:16<79:12:51, 10.15s/it]
 26%|██▌       | 9873/37963 [30:44:26<78:57:20, 10.12s/it]
 26%|██▌       | 9874/37963 [30:44:35<78:05:23, 10.01s/it]
 26%|██▌       | 9875/37963 [30:44:45<78:17:53, 10.04s/it]
 26%|██▌       | 9876/37963 [30:44:55<78:19:46, 10.04s/it]
 26%|██▌       | 9877/37963 [30:45:13<94:56:07, 12.17s/it]
 26%|██▌       | 9878/37963 [30:45:23<90:05:45, 11.55s/it]
 26%|██▌       | 9879/37963 [30:45:33<86:44:20, 11.12s/it]
 26%|██▌       | 9880/37963 [30:45:43<83:56:56, 10.76s/it]
                                                          
{'loss': '0.1731', 'grad_norm': '0.7603', 'learning_rate': '1.735e-05', 'epoch': '0.2603'}

 26%|██▌       | 9880/37963 [30:45:43<83:56:56, 10.76s/it]
 26%|██▌       | 9881/37963 [30:45:59<97:40:22, 12.52s/it]
 26%|██▌       | 9882/37963 [30:46:09<91:51:06, 11.78s/it]
 26%|██▌       | 9883/37963 [30:46:20<87:58:21, 11.28s/it]
 26%|██▌       | 9884/37963 [30:46:29<84:43:46, 10.86s/it]
 26%|██▌       | 9885/37963 [30:46:40<82:54:26, 10.63s/it]
 26%|██▌       | 9886/37963 [30:46:49<80:46:20, 10.36s/it]
 26%|██▌       | 9887/37963 [30:47:06<94:54:29, 12.17s/it]
 26%|██▌       | 9888/37963 [30:47:16<90:27:53, 11.60s/it]
 26%|██▌       | 9889/37963 [30:47:26<86:14:30, 11.06s/it]
 26%|██▌       | 9890/37963 [30:47:42<98:24:45, 12.62s/it]
                                                          
{'loss': '0.1676', 'grad_norm': '1.015', 'learning_rate': '1.734e-05', 'epoch': '0.2605'}

 26%|██▌       | 9890/37963 [30:47:42<98:24:45, 12.62s/it]
 26%|██▌       | 9891/37963 [30:47:52<92:47:33, 11.90s/it]
 26%|██▌       | 9892/37963 [30:48:02<88:12:41, 11.31s/it]
 26%|██▌       | 9893/37963 [30:48:12<85:22:09, 10.95s/it]
 26%|██▌       | 9894/37963 [30:48:22<83:20:34, 10.69s/it]
 26%|██▌       | 9895/37963 [30:48:32<81:46:24, 10.49s/it]
 26%|██▌       | 9896/37963 [30:48:42<80:45:51, 10.36s/it]
 26%|██▌       | 9897/37963 [30:48:52<80:03:10, 10.27s/it]
 26%|██▌       | 9898/37963 [30:49:02<79:29:12, 10.20s/it]
 26%|██▌       | 9899/37963 [30:49:12<79:03:20, 10.14s/it]
 26%|██▌       | 9900/37963 [30:49:29<94:51:06, 12.17s/it]
                                                          
{'loss': '0.1765', 'grad_norm': '2.453', 'learning_rate': '1.733e-05', 'epoch': '0.2608'}

 26%|██▌       | 9900/37963 [30:49:29<94:51:06, 12.17s/it]
 26%|██▌       | 9901/37963 [30:49:39<89:59:14, 11.54s/it]
 26%|██▌       | 9902/37963 [30:49:49<85:32:10, 10.97s/it]
 26%|██▌       | 9903/37963 [30:49:59<83:31:42, 10.72s/it]
 26%|██▌       | 9904/37963 [30:50:09<81:24:54, 10.45s/it]
 26%|██▌       | 9905/37963 [30:50:19<80:27:18, 10.32s/it]
 26%|██▌       | 9906/37963 [30:50:29<79:29:06, 10.20s/it]
 26%|██▌       | 9907/37963 [30:50:39<78:58:45, 10.13s/it]
 26%|██▌       | 9908/37963 [30:50:55<93:42:52, 12.03s/it]
 26%|██▌       | 9909/37963 [30:51:12<104:13:48, 13.38s/it]
 26%|██▌       | 9910/37963 [30:51:22<96:16:32, 12.35s/it] 
                                                          
{'loss': '0.1702', 'grad_norm': '1.871', 'learning_rate': '1.733e-05', 'epoch': '0.261'}

 26%|██▌       | 9910/37963 [30:51:22<96:16:32, 12.35s/it]
 26%|██▌       | 9911/37963 [30:51:32<91:01:18, 11.68s/it]
 26%|██▌       | 9912/37963 [30:51:49<102:17:51, 13.13s/it]
 26%|██▌       | 9913/37963 [30:51:59<95:35:43, 12.27s/it] 
 26%|██▌       | 9914/37963 [30:52:09<90:33:46, 11.62s/it]
 26%|██▌       | 9915/37963 [30:52:19<86:07:32, 11.05s/it]
 26%|██▌       | 9916/37963 [30:52:29<84:14:26, 10.81s/it]
 26%|██▌       | 9917/37963 [30:52:39<82:56:03, 10.65s/it]
 26%|██▌       | 9918/37963 [30:52:49<81:14:04, 10.43s/it]
 26%|██▌       | 9919/37963 [30:52:59<80:32:28, 10.34s/it]
 26%|██▌       | 9920/37963 [30:53:09<79:55:21, 10.26s/it]
                                                          
{'loss': '0.1644', 'grad_norm': '1.36', 'learning_rate': '1.732e-05', 'epoch': '0.2613'}

 26%|██▌       | 9920/37963 [30:53:09<79:55:21, 10.26s/it]
 26%|██▌       | 9921/37963 [30:53:19<78:21:45, 10.06s/it]
 26%|██▌       | 9922/37963 [30:53:29<77:53:59, 10.00s/it]
 26%|██▌       | 9923/37963 [30:53:39<77:38:48,  9.97s/it]
 26%|██▌       | 9924/37963 [30:53:49<77:56:57, 10.01s/it]
 26%|██▌       | 9925/37963 [30:54:06<94:07:24, 12.09s/it]
 26%|██▌       | 9926/37963 [30:54:16<89:19:54, 11.47s/it]
 26%|██▌       | 9927/37963 [30:54:25<85:22:51, 10.96s/it]
 26%|██▌       | 9928/37963 [30:54:42<97:15:04, 12.49s/it]
 26%|██▌       | 9929/37963 [30:54:51<91:23:26, 11.74s/it]
 26%|██▌       | 9930/37963 [30:55:01<87:01:18, 11.18s/it]
                                                          
{'loss': '0.183', 'grad_norm': '2.757', 'learning_rate': '1.732e-05', 'epoch': '0.2616'}

 26%|██▌       | 9930/37963 [30:55:01<87:01:18, 11.18s/it]
 26%|██▌       | 9931/37963 [30:55:11<84:33:47, 10.86s/it]
 26%|██▌       | 9932/37963 [30:55:22<82:39:42, 10.62s/it]
 26%|██▌       | 9933/37963 [30:55:38<96:15:30, 12.36s/it]
 26%|██▌       | 9934/37963 [30:55:48<90:58:18, 11.68s/it]
 26%|██▌       | 9935/37963 [30:55:58<86:26:02, 11.10s/it]
 26%|██▌       | 9936/37963 [30:56:07<83:06:04, 10.67s/it]
 26%|██▌       | 9937/37963 [30:56:18<81:39:45, 10.49s/it]
 26%|██▌       | 9938/37963 [30:56:28<80:48:09, 10.38s/it]
 26%|██▌       | 9939/37963 [30:56:44<94:48:36, 12.18s/it]
 26%|██▌       | 9940/37963 [30:56:54<89:44:31, 11.53s/it]
                                                          
{'loss': '0.1619', 'grad_norm': '0.7415', 'learning_rate': '1.731e-05', 'epoch': '0.2618'}

 26%|██▌       | 9940/37963 [30:56:54<89:44:31, 11.53s/it]
 26%|██▌       | 9941/37963 [30:57:04<86:07:48, 11.07s/it]
 26%|██▌       | 9942/37963 [30:57:14<83:36:19, 10.74s/it]
 26%|██▌       | 9943/37963 [30:57:24<81:25:46, 10.46s/it]
 26%|██▌       | 9944/37963 [30:57:34<80:34:33, 10.35s/it]
 26%|██▌       | 9945/37963 [30:57:44<79:50:37, 10.26s/it]
 26%|██▌       | 9946/37963 [30:57:54<79:30:06, 10.22s/it]
 26%|██▌       | 9947/37963 [30:58:04<79:12:09, 10.18s/it]
 26%|██▌       | 9948/37963 [30:58:21<95:24:48, 12.26s/it]
 26%|██▌       | 9949/37963 [30:58:31<90:19:39, 11.61s/it]
 26%|██▌       | 9950/37963 [30:58:41<85:42:19, 11.01s/it]
                                                          
{'loss': '0.1683', 'grad_norm': '2.881', 'learning_rate': '1.731e-05', 'epoch': '0.2621'}

 26%|██▌       | 9950/37963 [30:58:41<85:42:19, 11.01s/it]
 26%|██▌       | 9951/37963 [30:58:51<83:24:29, 10.72s/it]
 26%|██▌       | 9952/37963 [30:59:01<82:05:04, 10.55s/it]
 26%|██▌       | 9953/37963 [30:59:11<79:57:26, 10.28s/it]
 26%|██▌       | 9954/37963 [30:59:21<79:28:14, 10.21s/it]
 26%|██▌       | 9955/37963 [30:59:31<79:15:18, 10.19s/it]
 26%|██▌       | 9956/37963 [30:59:47<93:16:15, 11.99s/it]
 26%|██▌       | 9957/37963 [31:00:04<104:06:31, 13.38s/it]
 26%|██▌       | 9958/37963 [31:00:14<96:19:07, 12.38s/it] 
 26%|██▌       | 9959/37963 [31:00:24<91:08:24, 11.72s/it]
 26%|██▌       | 9960/37963 [31:00:41<102:28:44, 13.17s/it]
                                                           
{'loss': '0.1711', 'grad_norm': '1.976', 'learning_rate': '1.73e-05', 'epoch': '0.2624'}

 26%|██▌       | 9960/37963 [31:00:41<102:28:44, 13.17s/it]
 26%|██▌       | 9961/37963 [31:00:51<95:21:05, 12.26s/it] 
 26%|██▌       | 9962/37963 [31:01:01<90:23:57, 11.62s/it]
 26%|██▌       | 9963/37963 [31:01:11<86:55:41, 11.18s/it]
 26%|██▌       | 9964/37963 [31:01:21<84:25:54, 10.86s/it]
 26%|██▌       | 9965/37963 [31:01:31<82:35:27, 10.62s/it]
 26%|██▋       | 9966/37963 [31:01:41<80:59:57, 10.42s/it]
 26%|██▋       | 9967/37963 [31:01:51<80:15:23, 10.32s/it]
 26%|██▋       | 9968/37963 [31:02:01<79:19:43, 10.20s/it]
 26%|██▋       | 9969/37963 [31:02:11<78:58:42, 10.16s/it]
 26%|██▋       | 9970/37963 [31:02:21<78:48:03, 10.13s/it]
                                                          
{'loss': '0.1622', 'grad_norm': '1.353', 'learning_rate': '1.729e-05', 'epoch': '0.2626'}

 26%|██▋       | 9970/37963 [31:02:21<78:48:03, 10.13s/it]
 26%|██▋       | 9971/37963 [31:02:31<78:08:34, 10.05s/it]
 26%|██▋       | 9972/37963 [31:02:49<95:10:15, 12.24s/it]
 26%|██▋       | 9973/37963 [31:02:58<89:45:59, 11.55s/it]
 26%|██▋       | 9974/37963 [31:03:08<85:55:45, 11.05s/it]
 26%|██▋       | 9975/37963 [31:03:18<83:41:23, 10.76s/it]
 26%|██▋       | 9976/37963 [31:03:35<97:20:56, 12.52s/it]
 26%|██▋       | 9977/37963 [31:03:45<90:29:30, 11.64s/it]
 26%|██▋       | 9978/37963 [31:03:55<87:01:08, 11.19s/it]
 26%|██▋       | 9979/37963 [31:04:05<84:47:13, 10.91s/it]
 26%|██▋       | 9980/37963 [31:04:15<83:04:53, 10.69s/it]
                                                          
{'loss': '0.1642', 'grad_norm': '2.237', 'learning_rate': '1.729e-05', 'epoch': '0.2629'}

 26%|██▋       | 9980/37963 [31:04:15<83:04:53, 10.69s/it]
 26%|██▋       | 9981/37963 [31:04:25<81:22:06, 10.47s/it]
 26%|██▋       | 9982/37963 [31:04:35<79:35:42, 10.24s/it]
 26%|██▋       | 9983/37963 [31:04:51<94:20:37, 12.14s/it]
 26%|██▋       | 9984/37963 [31:05:02<89:40:29, 11.54s/it]
 26%|██▋       | 9985/37963 [31:05:12<86:18:06, 11.10s/it]
 26%|██▋       | 9986/37963 [31:05:28<98:18:03, 12.65s/it]
 26%|██▋       | 9987/37963 [31:05:38<92:19:17, 11.88s/it]
 26%|██▋       | 9988/37963 [31:05:48<88:12:39, 11.35s/it]
 26%|██▋       | 9989/37963 [31:05:58<85:16:15, 10.97s/it]
 26%|██▋       | 9990/37963 [31:06:08<82:54:17, 10.67s/it]
                                                          
{'loss': '0.1682', 'grad_norm': '3.787', 'learning_rate': '1.728e-05', 'epoch': '0.2632'}

 26%|██▋       | 9990/37963 [31:06:08<82:54:17, 10.67s/it]
 26%|██▋       | 9991/37963 [31:06:18<81:24:25, 10.48s/it]
 26%|██▋       | 9992/37963 [31:06:28<80:10:07, 10.32s/it]
 26%|██▋       | 9993/37963 [31:06:38<79:41:24, 10.26s/it]
 26%|██▋       | 9994/37963 [31:06:48<79:27:51, 10.23s/it]
 26%|██▋       | 9995/37963 [31:06:58<78:57:29, 10.16s/it]
 26%|██▋       | 9996/37963 [31:07:15<94:53:22, 12.21s/it]
 26%|██▋       | 9997/37963 [31:07:26<90:10:54, 11.61s/it]
 26%|██▋       | 9998/37963 [31:07:36<86:28:17, 11.13s/it]
 26%|██▋       | 9999/37963 [31:07:45<83:03:10, 10.69s/it]
 26%|██▋       | 10000/37963 [31:07:55<80:33:11, 10.37s/it]
                                                           
{'loss': '0.1803', 'grad_norm': '8.55', 'learning_rate': '1.728e-05', 'epoch': '0.2634'}

 26%|██▋       | 10000/37963 [31:07:55<80:33:11, 10.37s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.49s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.49s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 26%|██▋       | 10001/37963 [31:08:56<198:09:31, 25.51s/it]
 26%|██▋       | 10002/37963 [31:09:05<161:05:38, 20.74s/it]
 26%|██▋       | 10003/37963 [31:09:29<167:39:08, 21.59s/it]
 26%|██▋       | 10004/37963 [31:09:39<140:58:52, 18.15s/it]
 26%|██▋       | 10005/37963 [31:09:49<122:15:23, 15.74s/it]
 26%|██▋       | 10006/37963 [31:09:59<109:10:54, 14.06s/it]
 26%|██▋       | 10007/37963 [31:10:09<99:54:00, 12.86s/it] 
 26%|██▋       | 10008/37963 [31:10:19<93:17:10, 12.01s/it]
 26%|██▋       | 10009/37963 [31:10:36<103:41:04, 13.35s/it]
 26%|██▋       | 10010/37963 [31:10:46<95:50:47, 12.34s/it] 
                                                           
{'loss': '0.1862', 'grad_norm': '2.825', 'learning_rate': '1.727e-05', 'epoch': '0.2637'}

 26%|██▋       | 10010/37963 [31:10:46<95:50:47, 12.34s/it]
 26%|██▋       | 10011/37963 [31:10:56<89:56:45, 11.58s/it]
 26%|██▋       | 10012/37963 [31:11:06<86:27:40, 11.14s/it]
 26%|██▋       | 10013/37963 [31:11:16<83:55:15, 10.81s/it]
 26%|██▋       | 10014/37963 [31:11:26<82:24:16, 10.61s/it]
 26%|██▋       | 10015/37963 [31:11:36<80:08:00, 10.32s/it]
 26%|██▋       | 10016/37963 [31:11:46<79:38:09, 10.26s/it]
 26%|██▋       | 10017/37963 [31:11:56<78:40:16, 10.13s/it]
 26%|██▋       | 10018/37963 [31:12:06<78:52:07, 10.16s/it]
 26%|██▋       | 10019/37963 [31:12:23<95:03:52, 12.25s/it]
 26%|██▋       | 10020/37963 [31:12:33<89:27:20, 11.52s/it]
                                                           
{'loss': '0.1723', 'grad_norm': '1.404', 'learning_rate': '1.726e-05', 'epoch': '0.2639'}

 26%|██▋       | 10020/37963 [31:12:33<89:27:20, 11.52s/it]
 26%|██▋       | 10021/37963 [31:12:43<86:11:10, 11.10s/it]
 26%|██▋       | 10022/37963 [31:12:53<83:47:33, 10.80s/it]
 26%|██▋       | 10023/37963 [31:13:03<81:46:59, 10.54s/it]
 26%|██▋       | 10024/37963 [31:13:19<95:09:21, 12.26s/it]
 26%|██▋       | 10025/37963 [31:13:29<90:01:23, 11.60s/it]
 26%|██▋       | 10026/37963 [31:13:39<86:22:54, 11.13s/it]
 26%|██▋       | 10027/37963 [31:13:49<83:32:35, 10.77s/it]
 26%|██▋       | 10028/37963 [31:13:59<81:29:32, 10.50s/it]
 26%|██▋       | 10029/37963 [31:14:09<80:29:20, 10.37s/it]
 26%|██▋       | 10030/37963 [31:14:19<79:55:47, 10.30s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '1.005', 'learning_rate': '1.726e-05', 'epoch': '0.2642'}

 26%|██▋       | 10030/37963 [31:14:19<79:55:47, 10.30s/it]
 26%|██▋       | 10031/37963 [31:14:42<109:48:30, 14.15s/it]
 26%|██▋       | 10032/37963 [31:14:53<100:31:23, 12.96s/it]
 26%|██▋       | 10033/37963 [31:15:03<93:29:59, 12.05s/it] 
 26%|██▋       | 10034/37963 [31:15:13<89:02:16, 11.48s/it]
 26%|██▋       | 10035/37963 [31:15:23<85:59:46, 11.09s/it]
 26%|██▋       | 10036/37963 [31:15:33<83:43:54, 10.79s/it]
 26%|██▋       | 10037/37963 [31:15:43<81:27:25, 10.50s/it]
 26%|██▋       | 10038/37963 [31:15:53<80:34:47, 10.39s/it]
 26%|██▋       | 10039/37963 [31:16:03<80:08:11, 10.33s/it]
 26%|██▋       | 10040/37963 [31:16:13<79:34:22, 10.26s/it]
                                                           
{'loss': '0.178', 'grad_norm': '1.565', 'learning_rate': '1.725e-05', 'epoch': '0.2645'}

 26%|██▋       | 10040/37963 [31:16:13<79:34:22, 10.26s/it]
 26%|██▋       | 10041/37963 [31:16:23<79:12:55, 10.21s/it]
 26%|██▋       | 10042/37963 [31:16:33<79:04:49, 10.20s/it]
 26%|██▋       | 10043/37963 [31:16:50<94:42:38, 12.21s/it]
 26%|██▋       | 10044/37963 [31:17:00<89:43:04, 11.57s/it]
 26%|██▋       | 10045/37963 [31:17:10<85:26:37, 11.02s/it]
 26%|██▋       | 10046/37963 [31:17:20<81:54:05, 10.56s/it]
 26%|██▋       | 10047/37963 [31:17:30<80:57:58, 10.44s/it]
 26%|██▋       | 10048/37963 [31:17:40<79:33:54, 10.26s/it]
 26%|██▋       | 10049/37963 [31:17:50<79:30:27, 10.25s/it]
 26%|██▋       | 10050/37963 [31:18:00<79:07:52, 10.21s/it]
                                                           
{'loss': '0.1733', 'grad_norm': '1.609', 'learning_rate': '1.725e-05', 'epoch': '0.2647'}

 26%|██▋       | 10050/37963 [31:18:00<79:07:52, 10.21s/it]
 26%|██▋       | 10051/37963 [31:18:10<78:31:43, 10.13s/it]
 26%|██▋       | 10052/37963 [31:18:27<94:25:52, 12.18s/it]
 26%|██▋       | 10053/37963 [31:18:43<104:30:33, 13.48s/it]
 26%|██▋       | 10054/37963 [31:18:53<96:01:04, 12.39s/it] 
 26%|██▋       | 10055/37963 [31:19:03<90:40:34, 11.70s/it]
 26%|██▋       | 10056/37963 [31:19:14<87:06:21, 11.24s/it]
 26%|██▋       | 10057/37963 [31:19:30<99:38:56, 12.86s/it]
 26%|██▋       | 10058/37963 [31:19:40<93:25:58, 12.05s/it]
 26%|██▋       | 10059/37963 [31:19:50<88:48:18, 11.46s/it]
 26%|██▋       | 10060/37963 [31:20:01<85:41:22, 11.06s/it]
                                                           
{'loss': '0.1712', 'grad_norm': '1.066', 'learning_rate': '1.724e-05', 'epoch': '0.265'}

 26%|██▋       | 10060/37963 [31:20:01<85:41:22, 11.06s/it]
 27%|██▋       | 10061/37963 [31:20:11<83:17:04, 10.75s/it]
 27%|██▋       | 10062/37963 [31:20:21<82:03:43, 10.59s/it]
 27%|██▋       | 10063/37963 [31:20:31<81:05:13, 10.46s/it]
 27%|██▋       | 10064/37963 [31:20:41<80:01:13, 10.33s/it]
 27%|██▋       | 10065/37963 [31:20:51<79:24:54, 10.25s/it]
 27%|██▋       | 10066/37963 [31:21:01<78:53:20, 10.18s/it]
 27%|██▋       | 10067/37963 [31:21:18<94:25:39, 12.19s/it]
 27%|██▋       | 10068/37963 [31:21:28<89:27:48, 11.55s/it]
 27%|██▋       | 10069/37963 [31:21:38<86:08:06, 11.12s/it]
 27%|██▋       | 10070/37963 [31:21:48<84:01:38, 10.84s/it]
                                                           
{'loss': '0.169', 'grad_norm': '1.29', 'learning_rate': '1.724e-05', 'epoch': '0.2653'}

 27%|██▋       | 10070/37963 [31:21:48<84:01:38, 10.84s/it]
 27%|██▋       | 10071/37963 [31:21:58<80:55:43, 10.45s/it]
 27%|██▋       | 10072/37963 [31:22:14<94:34:21, 12.21s/it]
 27%|██▋       | 10073/37963 [31:22:24<89:51:50, 11.60s/it]
 27%|██▋       | 10074/37963 [31:22:34<85:14:19, 11.00s/it]
 27%|██▋       | 10075/37963 [31:22:44<83:11:31, 10.74s/it]
 27%|██▋       | 10076/37963 [31:22:54<81:37:56, 10.54s/it]
 27%|██▋       | 10077/37963 [31:23:10<95:11:33, 12.29s/it]
 27%|██▋       | 10078/37963 [31:23:21<90:30:31, 11.68s/it]
 27%|██▋       | 10079/37963 [31:23:31<87:03:06, 11.24s/it]
 27%|██▋       | 10080/37963 [31:23:47<98:38:06, 12.73s/it]
                                                           
{'loss': '0.1803', 'grad_norm': '1.781', 'learning_rate': '1.723e-05', 'epoch': '0.2655'}

 27%|██▋       | 10080/37963 [31:23:47<98:38:06, 12.73s/it]
 27%|██▋       | 10081/37963 [31:23:57<92:33:10, 11.95s/it]
 27%|██▋       | 10082/37963 [31:24:07<88:11:01, 11.39s/it]
 27%|██▋       | 10083/37963 [31:24:17<85:10:11, 11.00s/it]
 27%|██▋       | 10084/37963 [31:24:27<82:22:16, 10.64s/it]
 27%|██▋       | 10085/37963 [31:24:37<81:25:46, 10.52s/it]
 27%|██▋       | 10086/37963 [31:24:48<80:17:50, 10.37s/it]
 27%|██▋       | 10087/37963 [31:24:58<79:35:18, 10.28s/it]
 27%|██▋       | 10088/37963 [31:25:07<78:44:20, 10.17s/it]
 27%|██▋       | 10089/37963 [31:25:18<78:40:49, 10.16s/it]
 27%|██▋       | 10090/37963 [31:25:34<92:53:55, 12.00s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '3.207', 'learning_rate': '1.722e-05', 'epoch': '0.2658'}

 27%|██▋       | 10090/37963 [31:25:34<92:53:55, 12.00s/it]
 27%|██▋       | 10091/37963 [31:25:44<88:39:59, 11.45s/it]
 27%|██▋       | 10092/37963 [31:25:54<85:44:52, 11.08s/it]
 27%|██▋       | 10093/37963 [31:26:04<83:32:41, 10.79s/it]
 27%|██▋       | 10094/37963 [31:26:14<81:15:47, 10.50s/it]
 27%|██▋       | 10095/37963 [31:26:24<80:25:46, 10.39s/it]
 27%|██▋       | 10096/37963 [31:26:34<79:21:20, 10.25s/it]
 27%|██▋       | 10097/37963 [31:26:44<79:08:43, 10.22s/it]
 27%|██▋       | 10098/37963 [31:26:55<79:18:46, 10.25s/it]
 27%|██▋       | 10099/37963 [31:27:11<93:57:13, 12.14s/it]
 27%|██▋       | 10100/37963 [31:27:21<89:13:45, 11.53s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '1.154', 'learning_rate': '1.722e-05', 'epoch': '0.266'}

 27%|██▋       | 10100/37963 [31:27:21<89:13:45, 11.53s/it]
 27%|██▋       | 10101/37963 [31:27:38<101:02:46, 13.06s/it]
 27%|██▋       | 10102/37963 [31:27:48<94:02:18, 12.15s/it] 
 27%|██▋       | 10103/37963 [31:27:58<89:37:59, 11.58s/it]
 27%|██▋       | 10104/37963 [31:28:15<101:20:33, 13.10s/it]
 27%|██▋       | 10105/37963 [31:28:25<94:45:06, 12.24s/it] 
 27%|██▋       | 10106/37963 [31:28:35<89:47:22, 11.60s/it]
 27%|██▋       | 10107/37963 [31:28:45<86:04:39, 11.12s/it]
 27%|██▋       | 10108/37963 [31:28:56<84:05:58, 10.87s/it]
 27%|██▋       | 10109/37963 [31:29:06<82:37:41, 10.68s/it]
 27%|██▋       | 10110/37963 [31:29:16<81:12:25, 10.50s/it]
                                                           
{'loss': '0.1713', 'grad_norm': '2.58', 'learning_rate': '1.721e-05', 'epoch': '0.2663'}

 27%|██▋       | 10110/37963 [31:29:16<81:12:25, 10.50s/it]
 27%|██▋       | 10111/37963 [31:29:26<80:10:41, 10.36s/it]
 27%|██▋       | 10112/37963 [31:29:36<79:46:33, 10.31s/it]
 27%|██▋       | 10113/37963 [31:29:46<79:17:30, 10.25s/it]
 27%|██▋       | 10114/37963 [31:29:56<78:45:10, 10.18s/it]
 27%|██▋       | 10115/37963 [31:30:06<78:48:56, 10.19s/it]
 27%|██▋       | 10116/37963 [31:30:24<95:07:44, 12.30s/it]
 27%|██▋       | 10117/37963 [31:30:34<89:26:56, 11.56s/it]
 27%|██▋       | 10118/37963 [31:30:44<85:56:26, 11.11s/it]
 27%|██▋       | 10119/37963 [31:30:54<83:59:35, 10.86s/it]
 27%|██▋       | 10120/37963 [31:31:04<82:25:24, 10.66s/it]
                                                           
{'loss': '0.1734', 'grad_norm': '1.146', 'learning_rate': '1.721e-05', 'epoch': '0.2666'}

 27%|██▋       | 10120/37963 [31:31:04<82:25:24, 10.66s/it]
 27%|██▋       | 10121/37963 [31:31:21<96:24:13, 12.47s/it]
 27%|██▋       | 10122/37963 [31:31:30<89:57:08, 11.63s/it]
 27%|██▋       | 10123/37963 [31:31:41<86:22:37, 11.17s/it]
 27%|██▋       | 10124/37963 [31:31:51<83:56:07, 10.85s/it]
 27%|██▋       | 10125/37963 [31:32:01<82:07:23, 10.62s/it]
 27%|██▋       | 10126/37963 [31:32:17<95:43:46, 12.38s/it]
 27%|██▋       | 10127/37963 [31:32:27<90:28:15, 11.70s/it]
 27%|██▋       | 10128/37963 [31:32:37<86:54:12, 11.24s/it]
 27%|██▋       | 10129/37963 [31:32:54<98:58:57, 12.80s/it]
 27%|██▋       | 10130/37963 [31:33:04<92:35:14, 11.98s/it]
                                                           
{'loss': '0.169', 'grad_norm': '2.905', 'learning_rate': '1.72e-05', 'epoch': '0.2668'}

 27%|██▋       | 10130/37963 [31:33:04<92:35:14, 11.98s/it]
 27%|██▋       | 10131/37963 [31:33:14<88:18:16, 11.42s/it]
 27%|██▋       | 10132/37963 [31:33:24<85:13:07, 11.02s/it]
 27%|██▋       | 10133/37963 [31:33:34<83:00:12, 10.74s/it]
 27%|██▋       | 10134/37963 [31:33:44<81:28:58, 10.54s/it]
 27%|██▋       | 10135/37963 [31:33:54<80:25:07, 10.40s/it]
 27%|██▋       | 10136/37963 [31:34:04<78:35:21, 10.17s/it]
 27%|██▋       | 10137/37963 [31:34:14<78:46:34, 10.19s/it]
 27%|██▋       | 10138/37963 [31:34:31<94:20:20, 12.21s/it]
 27%|██▋       | 10139/37963 [31:34:41<89:30:28, 11.58s/it]
 27%|██▋       | 10140/37963 [31:34:51<86:01:59, 11.13s/it]
                                                           
{'loss': '0.1653', 'grad_norm': '2.962', 'learning_rate': '1.719e-05', 'epoch': '0.2671'}

 27%|██▋       | 10140/37963 [31:34:51<86:01:59, 11.13s/it]
 27%|██▋       | 10141/37963 [31:35:01<83:33:07, 10.81s/it]
 27%|██▋       | 10142/37963 [31:35:11<81:38:24, 10.56s/it]
 27%|██▋       | 10143/37963 [31:35:22<80:29:58, 10.42s/it]
 27%|██▋       | 10144/37963 [31:35:32<79:42:35, 10.32s/it]
 27%|██▋       | 10145/37963 [31:35:42<79:10:52, 10.25s/it]
 27%|██▋       | 10146/37963 [31:35:52<78:53:15, 10.21s/it]
 27%|██▋       | 10147/37963 [31:36:02<78:45:24, 10.19s/it]
 27%|██▋       | 10148/37963 [31:36:19<94:15:46, 12.20s/it]
 27%|██▋       | 10149/37963 [31:36:36<104:33:06, 13.53s/it]
 27%|██▋       | 10150/37963 [31:36:52<110:53:16, 14.35s/it]
                                                            
{'loss': '0.1691', 'grad_norm': '1.275', 'learning_rate': '1.719e-05', 'epoch': '0.2674'}

 27%|██▋       | 10150/37963 [31:36:52<110:53:16, 14.35s/it]
 27%|██▋       | 10151/37963 [31:37:02<101:23:33, 13.12s/it]
 27%|██▋       | 10152/37963 [31:37:12<93:32:36, 12.11s/it] 
 27%|██▋       | 10153/37963 [31:37:22<88:51:49, 11.50s/it]
 27%|██▋       | 10154/37963 [31:37:32<85:33:57, 11.08s/it]
 27%|██▋       | 10155/37963 [31:37:42<83:12:32, 10.77s/it]
 27%|██▋       | 10156/37963 [31:37:52<81:17:46, 10.52s/it]
 27%|██▋       | 10157/37963 [31:38:02<80:16:08, 10.39s/it]
 27%|██▋       | 10158/37963 [31:38:12<79:30:47, 10.29s/it]
 27%|██▋       | 10159/37963 [31:38:22<78:59:45, 10.23s/it]
 27%|██▋       | 10160/37963 [31:38:32<78:53:14, 10.21s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '3.51', 'learning_rate': '1.718e-05', 'epoch': '0.2676'}

 27%|██▋       | 10160/37963 [31:38:32<78:53:14, 10.21s/it]
 27%|██▋       | 10161/37963 [31:38:42<78:16:15, 10.14s/it]
 27%|██▋       | 10162/37963 [31:38:52<77:28:05, 10.03s/it]
 27%|██▋       | 10163/37963 [31:39:02<77:31:13, 10.04s/it]
 27%|██▋       | 10164/37963 [31:39:12<77:34:44, 10.05s/it]
 27%|██▋       | 10165/37963 [31:39:29<93:01:59, 12.05s/it]
 27%|██▋       | 10166/37963 [31:39:39<89:10:36, 11.55s/it]
 27%|██▋       | 10167/37963 [31:39:49<85:36:11, 11.09s/it]
 27%|██▋       | 10168/37963 [31:39:59<83:16:37, 10.79s/it]
 27%|██▋       | 10169/37963 [31:40:16<96:27:23, 12.49s/it]
 27%|██▋       | 10170/37963 [31:40:26<90:19:14, 11.70s/it]
                                                           
{'loss': '0.17', 'grad_norm': '2.756', 'learning_rate': '1.718e-05', 'epoch': '0.2679'}

 27%|██▋       | 10170/37963 [31:40:26<90:19:14, 11.70s/it]
 27%|██▋       | 10171/37963 [31:40:36<86:18:50, 11.18s/it]
 27%|██▋       | 10172/37963 [31:40:46<83:55:47, 10.87s/it]
 27%|██▋       | 10173/37963 [31:40:56<81:17:05, 10.53s/it]
 27%|██▋       | 10174/37963 [31:41:06<79:50:49, 10.34s/it]
 27%|██▋       | 10175/37963 [31:41:22<94:03:56, 12.19s/it]
 27%|██▋       | 10176/37963 [31:41:32<89:08:33, 11.55s/it]
 27%|██▋       | 10177/37963 [31:41:48<99:49:07, 12.93s/it]
 27%|██▋       | 10178/37963 [31:41:58<92:12:25, 11.95s/it]
 27%|██▋       | 10179/37963 [31:42:08<88:00:30, 11.40s/it]
 27%|██▋       | 10180/37963 [31:42:18<84:50:49, 10.99s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '3.421', 'learning_rate': '1.717e-05', 'epoch': '0.2682'}

 27%|██▋       | 10180/37963 [31:42:18<84:50:49, 10.99s/it]
 27%|██▋       | 10181/37963 [31:42:28<82:32:16, 10.70s/it]
 27%|██▋       | 10182/37963 [31:42:38<80:48:03, 10.47s/it]
 27%|██▋       | 10183/37963 [31:42:48<79:49:30, 10.34s/it]
 27%|██▋       | 10184/37963 [31:42:58<79:27:08, 10.30s/it]
 27%|██▋       | 10185/37963 [31:43:08<79:17:08, 10.28s/it]
 27%|██▋       | 10186/37963 [31:43:18<77:49:29, 10.09s/it]
 27%|██▋       | 10187/37963 [31:43:35<93:13:02, 12.08s/it]
 27%|██▋       | 10188/37963 [31:43:45<88:42:16, 11.50s/it]
 27%|██▋       | 10189/37963 [31:43:55<85:32:03, 11.09s/it]
 27%|██▋       | 10190/37963 [31:44:05<83:05:31, 10.77s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '1.371', 'learning_rate': '1.716e-05', 'epoch': '0.2684'}

 27%|██▋       | 10190/37963 [31:44:05<83:05:31, 10.77s/it]
 27%|██▋       | 10191/37963 [31:44:15<81:36:19, 10.58s/it]
 27%|██▋       | 10192/37963 [31:44:25<80:02:48, 10.38s/it]
 27%|██▋       | 10193/37963 [31:44:35<79:22:54, 10.29s/it]
 27%|██▋       | 10194/37963 [31:44:45<78:49:44, 10.22s/it]
 27%|██▋       | 10195/37963 [31:45:02<92:53:09, 12.04s/it]
 27%|██▋       | 10196/37963 [31:45:12<88:21:04, 11.45s/it]
 27%|██▋       | 10197/37963 [31:45:34<113:56:57, 14.77s/it]
 27%|██▋       | 10198/37963 [31:45:44<103:02:45, 13.36s/it]
 27%|██▋       | 10199/37963 [31:45:54<95:17:22, 12.36s/it] 
 27%|██▋       | 10200/37963 [31:46:04<90:01:23, 11.67s/it]
                                                           
{'loss': '0.1678', 'grad_norm': '2.022', 'learning_rate': '1.716e-05', 'epoch': '0.2687'}

 27%|██▋       | 10200/37963 [31:46:04<90:01:23, 11.67s/it]
 27%|██▋       | 10201/37963 [31:46:14<86:24:33, 11.21s/it]
 27%|██▋       | 10202/37963 [31:46:24<83:20:05, 10.81s/it]
 27%|██▋       | 10203/37963 [31:46:34<80:46:42, 10.48s/it]
 27%|██▋       | 10204/37963 [31:46:44<79:23:00, 10.30s/it]
 27%|██▋       | 10205/37963 [31:46:54<78:49:37, 10.22s/it]
 27%|██▋       | 10206/37963 [31:47:04<78:39:02, 10.20s/it]
 27%|██▋       | 10207/37963 [31:47:14<77:34:20, 10.06s/it]
 27%|██▋       | 10208/37963 [31:47:24<77:52:03, 10.10s/it]
 27%|██▋       | 10209/37963 [31:47:34<77:35:29, 10.06s/it]
 27%|██▋       | 10210/37963 [31:47:44<77:39:34, 10.07s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '0.753', 'learning_rate': '1.715e-05', 'epoch': '0.2689'}

 27%|██▋       | 10210/37963 [31:47:44<77:39:34, 10.07s/it]
 27%|██▋       | 10211/37963 [31:47:54<76:20:59,  9.90s/it]
 27%|██▋       | 10212/37963 [31:48:04<76:59:42,  9.99s/it]
 27%|██▋       | 10213/37963 [31:48:14<77:02:18,  9.99s/it]
 27%|██▋       | 10214/37963 [31:48:24<76:51:53,  9.97s/it]
 27%|██▋       | 10215/37963 [31:48:41<92:53:13, 12.05s/it]
 27%|██▋       | 10216/37963 [31:48:51<88:19:09, 11.46s/it]
 27%|██▋       | 10217/37963 [31:49:07<98:39:48, 12.80s/it]
 27%|██▋       | 10218/37963 [31:49:17<92:18:03, 11.98s/it]
 27%|██▋       | 10219/37963 [31:49:26<87:14:18, 11.32s/it]
 27%|██▋       | 10220/37963 [31:49:37<84:15:03, 10.93s/it]
                                                           
{'loss': '0.1676', 'grad_norm': '5.402', 'learning_rate': '1.715e-05', 'epoch': '0.2692'}

 27%|██▋       | 10220/37963 [31:49:37<84:15:03, 10.93s/it]
 27%|██▋       | 10221/37963 [31:49:47<82:05:55, 10.65s/it]
 27%|██▋       | 10222/37963 [31:49:56<79:25:00, 10.31s/it]
 27%|██▋       | 10223/37963 [31:50:06<78:54:32, 10.24s/it]
 27%|██▋       | 10224/37963 [31:50:29<108:44:59, 14.11s/it]
 27%|██▋       | 10225/37963 [31:50:39<99:23:10, 12.90s/it] 
 27%|██▋       | 10226/37963 [31:50:50<93:12:07, 12.10s/it]
 27%|██▋       | 10227/37963 [31:51:00<88:59:20, 11.55s/it]
 27%|██▋       | 10228/37963 [31:51:10<85:30:39, 11.10s/it]
 27%|██▋       | 10229/37963 [31:51:20<82:27:05, 10.70s/it]
 27%|██▋       | 10230/37963 [31:51:30<81:01:43, 10.52s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '1.783', 'learning_rate': '1.714e-05', 'epoch': '0.2695'}

 27%|██▋       | 10230/37963 [31:51:30<81:01:43, 10.52s/it]
 27%|██▋       | 10231/37963 [31:51:40<79:49:25, 10.36s/it]
 27%|██▋       | 10232/37963 [31:51:49<78:05:04, 10.14s/it]
 27%|██▋       | 10233/37963 [31:51:59<78:01:38, 10.13s/it]
 27%|██▋       | 10234/37963 [31:52:10<77:53:18, 10.11s/it]
 27%|██▋       | 10235/37963 [31:52:26<93:31:34, 12.14s/it]
 27%|██▋       | 10236/37963 [31:52:36<88:16:54, 11.46s/it]
 27%|██▋       | 10237/37963 [31:52:46<85:01:40, 11.04s/it]
 27%|██▋       | 10238/37963 [31:52:56<82:55:55, 10.77s/it]
 27%|██▋       | 10239/37963 [31:53:07<81:16:36, 10.55s/it]
 27%|██▋       | 10240/37963 [31:53:17<80:11:17, 10.41s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '0.9303', 'learning_rate': '1.713e-05', 'epoch': '0.2697'}

 27%|██▋       | 10240/37963 [31:53:17<80:11:17, 10.41s/it]
 27%|██▋       | 10241/37963 [31:53:27<79:29:45, 10.32s/it]
 27%|██▋       | 10242/37963 [31:53:37<79:03:27, 10.27s/it]
 27%|██▋       | 10243/37963 [31:53:47<78:04:35, 10.14s/it]
 27%|██▋       | 10244/37963 [31:54:03<92:32:59, 12.02s/it]
 27%|██▋       | 10245/37963 [31:54:20<102:50:37, 13.36s/it]
 27%|██▋       | 10246/37963 [31:54:36<110:08:11, 14.31s/it]
 27%|██▋       | 10247/37963 [31:54:46<100:30:00, 13.05s/it]
 27%|██▋       | 10248/37963 [31:54:56<93:44:49, 12.18s/it] 
 27%|██▋       | 10249/37963 [31:55:06<88:54:09, 11.55s/it]
 27%|██▋       | 10250/37963 [31:55:17<85:30:10, 11.11s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '1.381', 'learning_rate': '1.713e-05', 'epoch': '0.27'}

 27%|██▋       | 10250/37963 [31:55:17<85:30:10, 11.11s/it]
 27%|██▋       | 10251/37963 [31:55:27<83:15:06, 10.82s/it]
 27%|██▋       | 10252/37963 [31:55:37<81:38:55, 10.61s/it]
 27%|██▋       | 10253/37963 [31:55:46<79:17:59, 10.30s/it]
 27%|██▋       | 10254/37963 [31:55:56<78:27:50, 10.19s/it]
 27%|██▋       | 10255/37963 [31:56:06<78:19:17, 10.18s/it]
 27%|██▋       | 10256/37963 [31:56:17<78:41:35, 10.22s/it]
 27%|██▋       | 10257/37963 [31:56:27<78:14:11, 10.17s/it]
 27%|██▋       | 10258/37963 [31:56:37<78:13:58, 10.17s/it]
 27%|██▋       | 10259/37963 [31:56:47<77:10:31, 10.03s/it]
 27%|██▋       | 10260/37963 [31:56:57<77:23:46, 10.06s/it]
                                                           
{'loss': '0.1703', 'grad_norm': '1.68', 'learning_rate': '1.712e-05', 'epoch': '0.2703'}

 27%|██▋       | 10260/37963 [31:56:57<77:23:46, 10.06s/it]
 27%|██▋       | 10261/37963 [31:57:07<77:35:02, 10.08s/it]
 27%|██▋       | 10262/37963 [31:57:17<77:38:22, 10.09s/it]
 27%|██▋       | 10263/37963 [31:57:27<77:40:10, 10.09s/it]
 27%|██▋       | 10264/37963 [31:57:44<93:57:57, 12.21s/it]
 27%|██▋       | 10265/37963 [31:58:01<103:34:46, 13.46s/it]
 27%|██▋       | 10266/37963 [31:58:11<95:25:56, 12.40s/it] 
 27%|██▋       | 10267/37963 [31:58:21<90:00:29, 11.70s/it]
 27%|██▋       | 10268/37963 [31:58:31<86:08:59, 11.20s/it]
 27%|██▋       | 10269/37963 [31:58:41<84:04:06, 10.93s/it]
 27%|██▋       | 10270/37963 [31:58:51<82:05:57, 10.67s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '5.952', 'learning_rate': '1.712e-05', 'epoch': '0.2705'}

 27%|██▋       | 10270/37963 [31:58:51<82:05:57, 10.67s/it]
 27%|██▋       | 10271/37963 [31:59:08<95:47:05, 12.45s/it]
 27%|██▋       | 10272/37963 [31:59:18<89:49:45, 11.68s/it]
 27%|██▋       | 10273/37963 [31:59:34<101:08:55, 13.15s/it]
 27%|██▋       | 10274/37963 [31:59:44<93:00:24, 12.09s/it] 
 27%|██▋       | 10275/37963 [31:59:54<88:37:25, 11.52s/it]
 27%|██▋       | 10276/37963 [32:00:04<84:58:20, 11.05s/it]
 27%|██▋       | 10277/37963 [32:00:14<82:53:58, 10.78s/it]
 27%|██▋       | 10278/37963 [32:00:24<81:15:16, 10.57s/it]
 27%|██▋       | 10279/37963 [32:00:34<78:44:54, 10.24s/it]
 27%|██▋       | 10280/37963 [32:00:44<78:28:12, 10.20s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '1.849', 'learning_rate': '1.711e-05', 'epoch': '0.2708'}

 27%|██▋       | 10280/37963 [32:00:44<78:28:12, 10.20s/it]
 27%|██▋       | 10281/37963 [32:00:54<78:25:49, 10.20s/it]
 27%|██▋       | 10282/37963 [32:01:04<78:14:22, 10.18s/it]
 27%|██▋       | 10283/37963 [32:01:14<77:52:14, 10.13s/it]
 27%|██▋       | 10284/37963 [32:01:32<94:52:42, 12.34s/it]
 27%|██▋       | 10285/37963 [32:01:42<89:42:35, 11.67s/it]
 27%|██▋       | 10286/37963 [32:01:52<86:31:11, 11.25s/it]
 27%|██▋       | 10287/37963 [32:02:02<83:48:19, 10.90s/it]
 27%|██▋       | 10288/37963 [32:02:12<82:00:18, 10.67s/it]
 27%|██▋       | 10289/37963 [32:02:22<80:34:45, 10.48s/it]
 27%|██▋       | 10290/37963 [32:02:32<79:49:59, 10.39s/it]
                                                           
{'loss': '0.1749', 'grad_norm': '4.688', 'learning_rate': '1.71e-05', 'epoch': '0.2711'}

 27%|██▋       | 10290/37963 [32:02:32<79:49:59, 10.39s/it]
 27%|██▋       | 10291/37963 [32:02:49<93:38:22, 12.18s/it]
 27%|██▋       | 10292/37963 [32:03:05<103:28:30, 13.46s/it]
 27%|██▋       | 10293/37963 [32:03:15<95:04:05, 12.37s/it] 
 27%|██▋       | 10294/37963 [32:03:31<104:20:11, 13.58s/it]
 27%|██▋       | 10295/37963 [32:03:42<96:33:51, 12.56s/it] 
 27%|██▋       | 10296/37963 [32:03:52<90:45:12, 11.81s/it]
 27%|██▋       | 10297/37963 [32:04:02<86:44:00, 11.29s/it]
 27%|██▋       | 10298/37963 [32:04:12<83:50:29, 10.91s/it]
 27%|██▋       | 10299/37963 [32:04:22<82:22:15, 10.72s/it]
 27%|██▋       | 10300/37963 [32:04:32<80:53:31, 10.53s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '2.449', 'learning_rate': '1.71e-05', 'epoch': '0.2713'}

 27%|██▋       | 10300/37963 [32:04:32<80:53:31, 10.53s/it]
 27%|██▋       | 10301/37963 [32:04:42<80:02:48, 10.42s/it]
 27%|██▋       | 10302/37963 [32:04:52<79:23:55, 10.33s/it]
 27%|██▋       | 10303/37963 [32:05:03<79:00:05, 10.28s/it]
 27%|██▋       | 10304/37963 [32:05:13<78:35:31, 10.23s/it]
 27%|██▋       | 10305/37963 [32:05:23<78:12:26, 10.18s/it]
 27%|██▋       | 10306/37963 [32:05:33<78:03:35, 10.16s/it]
 27%|██▋       | 10307/37963 [32:05:43<77:58:26, 10.15s/it]
 27%|██▋       | 10308/37963 [32:05:53<77:31:49, 10.09s/it]
 27%|██▋       | 10309/37963 [32:06:03<77:23:32, 10.07s/it]
 27%|██▋       | 10310/37963 [32:06:13<77:28:50, 10.09s/it]
                                                           
{'loss': '0.1557', 'grad_norm': '1.803', 'learning_rate': '1.709e-05', 'epoch': '0.2716'}

 27%|██▋       | 10310/37963 [32:06:13<77:28:50, 10.09s/it]
 27%|██▋       | 10311/37963 [32:06:23<77:23:32, 10.08s/it]
 27%|██▋       | 10312/37963 [32:06:46<107:54:26, 14.05s/it]
 27%|██▋       | 10313/37963 [32:06:56<97:47:40, 12.73s/it] 
 27%|██▋       | 10314/37963 [32:07:06<91:53:47, 11.97s/it]
 27%|██▋       | 10315/37963 [32:07:16<87:31:07, 11.40s/it]
 27%|██▋       | 10316/37963 [32:07:26<84:24:37, 10.99s/it]
 27%|██▋       | 10317/37963 [32:07:36<82:01:04, 10.68s/it]
 27%|██▋       | 10318/37963 [32:07:53<95:26:12, 12.43s/it]
 27%|██▋       | 10319/37963 [32:08:03<90:05:57, 11.73s/it]
 27%|██▋       | 10320/37963 [32:08:13<85:30:46, 11.14s/it]
                                                           
{'loss': '0.167', 'grad_norm': '1.492', 'learning_rate': '1.709e-05', 'epoch': '0.2718'}

 27%|██▋       | 10320/37963 [32:08:13<85:30:46, 11.14s/it]
 27%|██▋       | 10321/37963 [32:08:29<98:28:06, 12.82s/it]
 27%|██▋       | 10322/37963 [32:08:39<91:30:25, 11.92s/it]
 27%|██▋       | 10323/37963 [32:08:49<87:03:07, 11.34s/it]
 27%|██▋       | 10324/37963 [32:08:59<82:50:58, 10.79s/it]
 27%|██▋       | 10325/37963 [32:09:08<80:13:49, 10.45s/it]
 27%|██▋       | 10326/37963 [32:09:19<79:27:06, 10.35s/it]
 27%|██▋       | 10327/37963 [32:09:29<78:54:53, 10.28s/it]
 27%|██▋       | 10328/37963 [32:09:39<77:57:57, 10.16s/it]
 27%|██▋       | 10329/37963 [32:09:49<77:48:57, 10.14s/it]
 27%|██▋       | 10330/37963 [32:09:59<77:35:50, 10.11s/it]
                                                           
{'loss': '0.1643', 'grad_norm': '3.104', 'learning_rate': '1.708e-05', 'epoch': '0.2721'}

 27%|██▋       | 10330/37963 [32:09:59<77:35:50, 10.11s/it]
 27%|██▋       | 10331/37963 [32:10:16<93:22:11, 12.16s/it]
 27%|██▋       | 10332/37963 [32:10:26<88:31:11, 11.53s/it]
 27%|██▋       | 10333/37963 [32:10:36<85:10:54, 11.10s/it]
 27%|██▋       | 10334/37963 [32:10:46<83:15:03, 10.85s/it]
 27%|██▋       | 10335/37963 [32:10:56<81:37:10, 10.64s/it]
 27%|██▋       | 10336/37963 [32:11:06<80:11:16, 10.45s/it]
 27%|██▋       | 10337/37963 [32:11:16<79:24:39, 10.35s/it]
 27%|██▋       | 10338/37963 [32:11:33<93:18:38, 12.16s/it]
 27%|██▋       | 10339/37963 [32:11:43<88:48:51, 11.57s/it]
 27%|██▋       | 10340/37963 [32:11:59<100:12:15, 13.06s/it]
                                                            
{'loss': '0.1703', 'grad_norm': '0.668', 'learning_rate': '1.707e-05', 'epoch': '0.2724'}

 27%|██▋       | 10340/37963 [32:11:59<100:12:15, 13.06s/it]
 27%|██▋       | 10341/37963 [32:12:10<93:22:32, 12.17s/it] 
 27%|██▋       | 10342/37963 [32:12:26<103:20:27, 13.47s/it]
 27%|██▋       | 10343/37963 [32:12:36<95:35:06, 12.46s/it] 
 27%|██▋       | 10344/37963 [32:12:46<90:25:39, 11.79s/it]
 27%|██▋       | 10345/37963 [32:12:56<86:25:08, 11.26s/it]
 27%|██▋       | 10346/37963 [32:13:06<83:41:05, 10.91s/it]
 27%|██▋       | 10347/37963 [32:13:16<81:30:26, 10.63s/it]
 27%|██▋       | 10348/37963 [32:13:26<80:10:43, 10.45s/it]
 27%|██▋       | 10349/37963 [32:13:37<79:33:07, 10.37s/it]
 27%|██▋       | 10350/37963 [32:13:47<79:05:37, 10.31s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '2.061', 'learning_rate': '1.707e-05', 'epoch': '0.2726'}

 27%|██▋       | 10350/37963 [32:13:47<79:05:37, 10.31s/it]
 27%|██▋       | 10351/37963 [32:13:57<78:41:37, 10.26s/it]
 27%|██▋       | 10352/37963 [32:14:07<78:24:04, 10.22s/it]
 27%|██▋       | 10353/37963 [32:14:17<77:48:10, 10.14s/it]
 27%|██▋       | 10354/37963 [32:14:27<77:04:41, 10.05s/it]
 27%|██▋       | 10355/37963 [32:14:37<77:25:45, 10.10s/it]
 27%|██▋       | 10356/37963 [32:14:47<77:40:26, 10.13s/it]
 27%|██▋       | 10357/37963 [32:14:57<77:14:21, 10.07s/it]
 27%|██▋       | 10358/37963 [32:15:07<77:29:08, 10.10s/it]
 27%|██▋       | 10359/37963 [32:15:18<77:41:41, 10.13s/it]
 27%|██▋       | 10360/37963 [32:15:34<91:59:48, 12.00s/it]
                                                           
{'loss': '0.1787', 'grad_norm': '2.514', 'learning_rate': '1.706e-05', 'epoch': '0.2729'}

 27%|██▋       | 10360/37963 [32:15:34<91:59:48, 12.00s/it]
 27%|██▋       | 10361/37963 [32:15:44<86:45:42, 11.32s/it]
 27%|██▋       | 10362/37963 [32:16:01<100:35:23, 13.12s/it]
 27%|██▋       | 10363/37963 [32:16:11<93:32:40, 12.20s/it] 
 27%|██▋       | 10364/37963 [32:16:21<88:35:23, 11.56s/it]
 27%|██▋       | 10365/37963 [32:16:31<84:47:26, 11.06s/it]
 27%|██▋       | 10366/37963 [32:16:41<82:23:02, 10.75s/it]
 27%|██▋       | 10367/37963 [32:17:04<110:15:53, 14.38s/it]
 27%|██▋       | 10368/37963 [32:17:14<100:24:29, 13.10s/it]
 27%|██▋       | 10369/37963 [32:17:24<93:33:23, 12.21s/it] 
 27%|██▋       | 10370/37963 [32:17:34<88:17:34, 11.52s/it]
                                                           
{'loss': '0.1674', 'grad_norm': '2.296', 'learning_rate': '1.706e-05', 'epoch': '0.2732'}

 27%|██▋       | 10370/37963 [32:17:34<88:17:34, 11.52s/it]
 27%|██▋       | 10371/37963 [32:17:44<84:46:36, 11.06s/it]
 27%|██▋       | 10372/37963 [32:17:54<82:33:39, 10.77s/it]
 27%|██▋       | 10373/37963 [32:18:04<80:54:38, 10.56s/it]
 27%|██▋       | 10374/37963 [32:18:14<80:13:42, 10.47s/it]
 27%|██▋       | 10375/37963 [32:18:25<79:19:09, 10.35s/it]
 27%|██▋       | 10376/37963 [32:18:35<78:47:40, 10.28s/it]
 27%|██▋       | 10377/37963 [32:18:45<78:33:26, 10.25s/it]
 27%|██▋       | 10378/37963 [32:18:55<77:33:27, 10.12s/it]
 27%|██▋       | 10379/37963 [32:19:04<76:47:36, 10.02s/it]
 27%|██▋       | 10380/37963 [32:19:21<92:34:04, 12.08s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '2.212', 'learning_rate': '1.705e-05', 'epoch': '0.2734'}

 27%|██▋       | 10380/37963 [32:19:21<92:34:04, 12.08s/it]
 27%|██▋       | 10381/37963 [32:19:31<88:04:58, 11.50s/it]
 27%|██▋       | 10382/37963 [32:19:42<85:01:20, 11.10s/it]
 27%|██▋       | 10383/37963 [32:19:52<82:43:01, 10.80s/it]
 27%|██▋       | 10384/37963 [32:20:02<81:18:38, 10.61s/it]
 27%|██▋       | 10385/37963 [32:20:12<79:23:04, 10.36s/it]
 27%|██▋       | 10386/37963 [32:20:22<78:45:49, 10.28s/it]
 27%|██▋       | 10387/37963 [32:20:38<93:01:09, 12.14s/it]
 27%|██▋       | 10388/37963 [32:20:55<102:51:09, 13.43s/it]
 27%|██▋       | 10389/37963 [32:21:05<95:18:21, 12.44s/it] 
 27%|██▋       | 10390/37963 [32:21:15<89:44:46, 11.72s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '1.438', 'learning_rate': '1.704e-05', 'epoch': '0.2737'}

 27%|██▋       | 10390/37963 [32:21:15<89:44:46, 11.72s/it]
 27%|██▋       | 10391/37963 [32:21:32<101:19:43, 13.23s/it]
 27%|██▋       | 10392/37963 [32:21:42<94:01:41, 12.28s/it] 
 27%|██▋       | 10393/37963 [32:21:52<88:41:34, 11.58s/it]
 27%|██▋       | 10394/37963 [32:22:02<85:24:49, 11.15s/it]
 27%|██▋       | 10395/37963 [32:22:12<82:54:08, 10.83s/it]
 27%|██▋       | 10396/37963 [32:22:22<80:50:50, 10.56s/it]
 27%|██▋       | 10397/37963 [32:22:32<79:32:28, 10.39s/it]
 27%|██▋       | 10398/37963 [32:22:42<78:49:24, 10.29s/it]
 27%|██▋       | 10399/37963 [32:22:52<78:17:33, 10.23s/it]
 27%|██▋       | 10400/37963 [32:23:02<77:21:38, 10.10s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '3.534', 'learning_rate': '1.704e-05', 'epoch': '0.274'}

 27%|██▋       | 10400/37963 [32:23:02<77:21:38, 10.10s/it]
 27%|██▋       | 10401/37963 [32:23:12<77:16:48, 10.09s/it]
 27%|██▋       | 10402/37963 [32:23:22<77:39:23, 10.14s/it]
 27%|██▋       | 10403/37963 [32:23:32<77:26:24, 10.12s/it]
 27%|██▋       | 10404/37963 [32:23:42<77:29:46, 10.12s/it]
 27%|██▋       | 10405/37963 [32:23:52<76:55:21, 10.05s/it]
 27%|██▋       | 10406/37963 [32:24:02<76:41:34, 10.02s/it]
 27%|██▋       | 10407/37963 [32:24:12<76:51:51, 10.04s/it]
 27%|██▋       | 10408/37963 [32:24:29<91:24:37, 11.94s/it]
 27%|██▋       | 10409/37963 [32:24:39<87:15:22, 11.40s/it]
 27%|██▋       | 10410/37963 [32:24:56<99:43:36, 13.03s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '2.203', 'learning_rate': '1.703e-05', 'epoch': '0.2742'}

 27%|██▋       | 10410/37963 [32:24:56<99:43:36, 13.03s/it]
 27%|██▋       | 10411/37963 [32:25:05<92:33:22, 12.09s/it]
 27%|██▋       | 10412/37963 [32:25:16<87:55:00, 11.49s/it]
 27%|██▋       | 10413/37963 [32:25:26<84:31:53, 11.05s/it]
 27%|██▋       | 10414/37963 [32:25:35<81:07:52, 10.60s/it]
 27%|██▋       | 10415/37963 [32:25:45<80:31:07, 10.52s/it]
 27%|██▋       | 10416/37963 [32:26:02<94:09:33, 12.31s/it]
 27%|██▋       | 10417/37963 [32:26:12<88:38:12, 11.58s/it]
 27%|██▋       | 10418/37963 [32:26:28<98:40:14, 12.90s/it]
 27%|██▋       | 10419/37963 [32:26:38<92:38:21, 12.11s/it]
 27%|██▋       | 10420/37963 [32:26:48<87:54:31, 11.49s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '4.664', 'learning_rate': '1.703e-05', 'epoch': '0.2745'}

 27%|██▋       | 10420/37963 [32:26:48<87:54:31, 11.49s/it]
 27%|██▋       | 10421/37963 [32:26:58<84:47:06, 11.08s/it]
 27%|██▋       | 10422/37963 [32:27:08<82:23:26, 10.77s/it]
 27%|██▋       | 10423/37963 [32:27:18<80:26:54, 10.52s/it]
 27%|██▋       | 10424/37963 [32:27:28<79:38:43, 10.41s/it]
 27%|██▋       | 10425/37963 [32:27:38<78:53:54, 10.31s/it]
 27%|██▋       | 10426/37963 [32:27:48<78:16:26, 10.23s/it]
 27%|██▋       | 10427/37963 [32:28:05<92:16:08, 12.06s/it]
 27%|██▋       | 10428/37963 [32:28:15<87:57:53, 11.50s/it]
 27%|██▋       | 10429/37963 [32:28:25<84:01:51, 10.99s/it]
 27%|██▋       | 10430/37963 [32:28:35<82:07:14, 10.74s/it]
                                                           
{'loss': '0.1719', 'grad_norm': '1.712', 'learning_rate': '1.702e-05', 'epoch': '0.2747'}

 27%|██▋       | 10430/37963 [32:28:35<82:07:14, 10.74s/it]
 27%|██▋       | 10431/37963 [32:28:44<79:22:35, 10.38s/it]
 27%|██▋       | 10432/37963 [32:28:55<78:41:32, 10.29s/it]
 27%|██▋       | 10433/37963 [32:29:05<78:24:15, 10.25s/it]
 27%|██▋       | 10434/37963 [32:29:21<92:53:53, 12.15s/it]
 27%|██▋       | 10435/37963 [32:29:31<87:32:12, 11.45s/it]
 27%|██▋       | 10436/37963 [32:29:41<84:33:05, 11.06s/it]
 27%|██▋       | 10437/37963 [32:29:57<96:22:04, 12.60s/it]
 27%|██▋       | 10438/37963 [32:30:13<104:01:17, 13.61s/it]
 27%|██▋       | 10439/37963 [32:30:24<96:04:57, 12.57s/it] 
 28%|██▊       | 10440/37963 [32:30:34<90:23:40, 11.82s/it]
                                                           
{'loss': '0.1759', 'grad_norm': '1.296', 'learning_rate': '1.701e-05', 'epoch': '0.275'}

 28%|██▊       | 10440/37963 [32:30:34<90:23:40, 11.82s/it]
 28%|██▊       | 10441/37963 [32:30:44<86:32:31, 11.32s/it]
 28%|██▊       | 10442/37963 [32:30:54<83:02:23, 10.86s/it]
 28%|██▊       | 10443/37963 [32:31:04<81:14:53, 10.63s/it]
 28%|██▊       | 10444/37963 [32:31:13<78:54:03, 10.32s/it]
 28%|██▊       | 10445/37963 [32:31:23<78:25:47, 10.26s/it]
 28%|██▊       | 10446/37963 [32:31:34<78:12:46, 10.23s/it]
 28%|██▊       | 10447/37963 [32:31:44<77:49:42, 10.18s/it]
 28%|██▊       | 10448/37963 [32:31:54<77:27:01, 10.13s/it]
 28%|██▊       | 10449/37963 [32:32:04<77:16:00, 10.11s/it]
 28%|██▊       | 10450/37963 [32:32:14<77:03:00, 10.08s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '1.116', 'learning_rate': '1.701e-05', 'epoch': '0.2753'}

 28%|██▊       | 10450/37963 [32:32:14<77:03:00, 10.08s/it]
 28%|██▊       | 10451/37963 [32:32:24<76:57:53, 10.07s/it]
 28%|██▊       | 10452/37963 [32:32:34<77:20:27, 10.12s/it]
 28%|██▊       | 10453/37963 [32:32:44<77:03:13, 10.08s/it]
 28%|██▊       | 10454/37963 [32:32:54<76:47:26, 10.05s/it]
 28%|██▊       | 10455/37963 [32:33:11<91:41:20, 12.00s/it]
 28%|██▊       | 10456/37963 [32:33:21<87:10:44, 11.41s/it]
 28%|██▊       | 10457/37963 [32:33:31<84:11:50, 11.02s/it]
 28%|██▊       | 10458/37963 [32:33:48<97:35:45, 12.77s/it]
 28%|██▊       | 10459/37963 [32:33:58<91:57:18, 12.04s/it]
 28%|██▊       | 10460/37963 [32:34:08<86:42:43, 11.35s/it]
                                                           
{'loss': '0.1728', 'grad_norm': '1.79', 'learning_rate': '1.7e-05', 'epoch': '0.2755'}

 28%|██▊       | 10460/37963 [32:34:08<86:42:43, 11.35s/it]
 28%|██▊       | 10461/37963 [32:34:18<83:33:05, 10.94s/it]
 28%|██▊       | 10462/37963 [32:34:28<81:40:52, 10.69s/it]
 28%|██▊       | 10463/37963 [32:34:38<80:28:06, 10.53s/it]
 28%|██▊       | 10464/37963 [32:34:55<94:36:06, 12.38s/it]
 28%|██▊       | 10465/37963 [32:35:05<89:29:23, 11.72s/it]
 28%|██▊       | 10466/37963 [32:35:21<100:01:43, 13.10s/it]
 28%|██▊       | 10467/37963 [32:35:31<93:07:42, 12.19s/it] 
 28%|██▊       | 10468/37963 [32:35:41<88:18:52, 11.56s/it]
 28%|██▊       | 10469/37963 [32:35:51<84:53:46, 11.12s/it]
 28%|██▊       | 10470/37963 [32:36:01<82:43:52, 10.83s/it]
                                                           
{'loss': '0.179', 'grad_norm': '2.212', 'learning_rate': '1.7e-05', 'epoch': '0.2758'}

 28%|██▊       | 10470/37963 [32:36:01<82:43:52, 10.83s/it]
 28%|██▊       | 10471/37963 [32:36:11<80:50:59, 10.59s/it]
 28%|██▊       | 10472/37963 [32:36:22<79:37:41, 10.43s/it]
 28%|██▊       | 10473/37963 [32:36:31<78:31:14, 10.28s/it]
 28%|██▊       | 10474/37963 [32:36:41<77:39:17, 10.17s/it]
 28%|██▊       | 10475/37963 [32:36:51<77:26:27, 10.14s/it]
 28%|██▊       | 10476/37963 [32:37:01<76:39:26, 10.04s/it]
 28%|██▊       | 10477/37963 [32:37:11<76:40:12, 10.04s/it]
 28%|██▊       | 10478/37963 [32:37:28<92:31:12, 12.12s/it]
 28%|██▊       | 10479/37963 [32:37:38<87:41:17, 11.49s/it]
 28%|██▊       | 10480/37963 [32:37:48<83:58:53, 11.00s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '1.806', 'learning_rate': '1.699e-05', 'epoch': '0.2761'}

 28%|██▊       | 10480/37963 [32:37:48<83:58:53, 11.00s/it]
 28%|██▊       | 10481/37963 [32:37:58<81:55:48, 10.73s/it]
 28%|██▊       | 10482/37963 [32:38:08<80:24:45, 10.53s/it]
 28%|██▊       | 10483/37963 [32:38:18<78:14:11, 10.25s/it]
 28%|██▊       | 10484/37963 [32:38:35<92:51:50, 12.17s/it]
 28%|██▊       | 10485/37963 [32:38:51<103:28:25, 13.56s/it]
 28%|██▊       | 10486/37963 [32:39:01<95:32:40, 12.52s/it] 
 28%|██▊       | 10487/37963 [32:39:11<89:39:35, 11.75s/it]
 28%|██▊       | 10488/37963 [32:39:28<99:53:38, 13.09s/it]
 28%|██▊       | 10489/37963 [32:39:37<92:23:47, 12.11s/it]
 28%|██▊       | 10490/37963 [32:39:48<88:01:18, 11.53s/it]
                                                           
{'loss': '0.1707', 'grad_norm': '4.309', 'learning_rate': '1.698e-05', 'epoch': '0.2763'}

 28%|██▊       | 10490/37963 [32:39:48<88:01:18, 11.53s/it]
 28%|██▊       | 10491/37963 [32:39:58<84:46:54, 11.11s/it]
 28%|██▊       | 10492/37963 [32:40:08<82:22:00, 10.79s/it]
 28%|██▊       | 10493/37963 [32:40:18<80:36:26, 10.56s/it]
 28%|██▊       | 10494/37963 [32:40:28<79:45:27, 10.45s/it]
 28%|██▊       | 10495/37963 [32:40:38<79:03:11, 10.36s/it]
 28%|██▊       | 10496/37963 [32:40:48<78:00:53, 10.23s/it]
 28%|██▊       | 10497/37963 [32:40:58<77:43:59, 10.19s/it]
 28%|██▊       | 10498/37963 [32:41:08<77:27:47, 10.15s/it]
 28%|██▊       | 10499/37963 [32:41:18<77:00:25, 10.09s/it]
 28%|██▊       | 10500/37963 [32:41:28<76:02:56,  9.97s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '1.964', 'learning_rate': '1.698e-05', 'epoch': '0.2766'}

 28%|██▊       | 10500/37963 [32:41:28<76:02:56,  9.97s/it]
 28%|██▊       | 10501/37963 [32:41:38<75:54:25,  9.95s/it]
 28%|██▊       | 10502/37963 [32:41:54<90:22:20, 11.85s/it]
 28%|██▊       | 10503/37963 [32:42:04<86:26:50, 11.33s/it]
 28%|██▊       | 10504/37963 [32:42:14<83:31:03, 10.95s/it]
 28%|██▊       | 10505/37963 [32:42:24<81:40:32, 10.71s/it]
 28%|██▊       | 10506/37963 [32:42:41<94:44:28, 12.42s/it]
 28%|██▊       | 10507/37963 [32:42:51<89:28:17, 11.73s/it]
 28%|██▊       | 10508/37963 [32:43:01<85:35:40, 11.22s/it]
 28%|██▊       | 10509/37963 [32:43:11<81:48:14, 10.73s/it]
 28%|██▊       | 10510/37963 [32:43:20<79:50:46, 10.47s/it]
                                                           
{'loss': '0.1618', 'grad_norm': '2.3', 'learning_rate': '1.697e-05', 'epoch': '0.2768'}

 28%|██▊       | 10510/37963 [32:43:20<79:50:46, 10.47s/it]
 28%|██▊       | 10511/37963 [32:43:30<78:53:23, 10.35s/it]
 28%|██▊       | 10512/37963 [32:43:47<92:11:23, 12.09s/it]
 28%|██▊       | 10513/37963 [32:43:57<87:09:45, 11.43s/it]
 28%|██▊       | 10514/37963 [32:44:13<97:48:23, 12.83s/it]
 28%|██▊       | 10515/37963 [32:44:23<91:28:33, 12.00s/it]
 28%|██▊       | 10516/37963 [32:44:33<87:12:07, 11.44s/it]
 28%|██▊       | 10517/37963 [32:44:43<84:06:58, 11.03s/it]
 28%|██▊       | 10518/37963 [32:44:53<81:41:31, 10.72s/it]
 28%|██▊       | 10519/37963 [32:45:03<80:11:46, 10.52s/it]
 28%|██▊       | 10520/37963 [32:45:13<78:47:08, 10.34s/it]
                                                           
{'loss': '0.17', 'grad_norm': '1.265', 'learning_rate': '1.697e-05', 'epoch': '0.2771'}

 28%|██▊       | 10520/37963 [32:45:13<78:47:08, 10.34s/it]
 28%|██▊       | 10521/37963 [32:45:23<78:08:25, 10.25s/it]
 28%|██▊       | 10522/37963 [32:45:33<77:53:09, 10.22s/it]
 28%|██▊       | 10523/37963 [32:45:43<77:32:39, 10.17s/it]
 28%|██▊       | 10524/37963 [32:45:53<76:40:34, 10.06s/it]
 28%|██▊       | 10525/37963 [32:46:03<76:45:35, 10.07s/it]
 28%|██▊       | 10526/37963 [32:46:13<75:29:17,  9.90s/it]
 28%|██▊       | 10527/37963 [32:46:23<75:50:22,  9.95s/it]
 28%|██▊       | 10528/37963 [32:46:39<91:25:53, 12.00s/it]
 28%|██▊       | 10529/37963 [32:46:49<86:56:07, 11.41s/it]
 28%|██▊       | 10530/37963 [32:47:00<84:06:21, 11.04s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '1.787', 'learning_rate': '1.696e-05', 'epoch': '0.2774'}

 28%|██▊       | 10530/37963 [32:47:00<84:06:21, 11.04s/it]
 28%|██▊       | 10531/37963 [32:47:10<81:41:52, 10.72s/it]
 28%|██▊       | 10532/37963 [32:47:26<94:59:15, 12.47s/it]
 28%|██▊       | 10533/37963 [32:47:43<104:15:33, 13.68s/it]
 28%|██▊       | 10534/37963 [32:47:52<94:37:12, 12.42s/it] 
 28%|██▊       | 10535/37963 [32:48:02<88:10:59, 11.57s/it]
 28%|██▊       | 10536/37963 [32:48:12<84:49:13, 11.13s/it]
 28%|██▊       | 10537/37963 [32:48:22<82:30:17, 10.83s/it]
 28%|██▊       | 10538/37963 [32:48:38<95:25:44, 12.53s/it]
 28%|██▊       | 10539/37963 [32:48:49<90:04:29, 11.82s/it]
 28%|██▊       | 10540/37963 [32:48:59<86:08:50, 11.31s/it]
                                                           
{'loss': '0.1771', 'grad_norm': '1.604', 'learning_rate': '1.695e-05', 'epoch': '0.2776'}

 28%|██▊       | 10540/37963 [32:48:59<86:08:50, 11.31s/it]
 28%|██▊       | 10541/37963 [32:49:09<83:32:01, 10.97s/it]
 28%|██▊       | 10542/37963 [32:49:19<81:44:40, 10.73s/it]
 28%|██▊       | 10543/37963 [32:49:29<79:52:38, 10.49s/it]
 28%|██▊       | 10544/37963 [32:49:39<79:20:02, 10.42s/it]
 28%|██▊       | 10545/37963 [32:49:49<77:26:56, 10.17s/it]
 28%|██▊       | 10546/37963 [32:49:59<77:33:32, 10.18s/it]
 28%|██▊       | 10547/37963 [32:50:09<77:21:34, 10.16s/it]
 28%|██▊       | 10548/37963 [32:50:19<76:11:04, 10.00s/it]
 28%|██▊       | 10549/37963 [32:50:29<76:23:23, 10.03s/it]
 28%|██▊       | 10550/37963 [32:50:45<91:03:51, 11.96s/it]
                                                           
{'loss': '0.1768', 'grad_norm': '3.674', 'learning_rate': '1.695e-05', 'epoch': '0.2779'}

 28%|██▊       | 10550/37963 [32:50:45<91:03:51, 11.96s/it]
 28%|██▊       | 10551/37963 [32:50:55<86:49:51, 11.40s/it]
 28%|██▊       | 10552/37963 [32:51:06<83:52:18, 11.02s/it]
 28%|██▊       | 10553/37963 [32:51:23<97:33:08, 12.81s/it]
 28%|██▊       | 10554/37963 [32:51:32<90:52:35, 11.94s/it]
 28%|██▊       | 10555/37963 [32:51:42<86:39:12, 11.38s/it]
 28%|██▊       | 10556/37963 [32:51:53<83:36:50, 10.98s/it]
 28%|██▊       | 10557/37963 [32:52:03<81:17:02, 10.68s/it]
 28%|██▊       | 10558/37963 [32:52:13<79:52:19, 10.49s/it]
 28%|██▊       | 10559/37963 [32:52:29<93:24:19, 12.27s/it]
 28%|██▊       | 10560/37963 [32:52:39<88:17:40, 11.60s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '2.564', 'learning_rate': '1.694e-05', 'epoch': '0.2782'}

 28%|██▊       | 10560/37963 [32:52:39<88:17:40, 11.60s/it]
 28%|██▊       | 10561/37963 [32:52:55<99:01:09, 13.01s/it]
 28%|██▊       | 10562/37963 [32:53:06<92:36:49, 12.17s/it]
 28%|██▊       | 10563/37963 [32:53:16<87:37:16, 11.51s/it]
 28%|██▊       | 10564/37963 [32:53:26<84:36:55, 11.12s/it]
 28%|██▊       | 10565/37963 [32:53:36<82:24:28, 10.83s/it]
 28%|██▊       | 10566/37963 [32:53:46<80:00:58, 10.51s/it]
 28%|██▊       | 10567/37963 [32:53:56<78:49:12, 10.36s/it]
 28%|██▊       | 10568/37963 [32:54:06<78:10:22, 10.27s/it]
 28%|██▊       | 10569/37963 [32:54:16<77:44:30, 10.22s/it]
 28%|██▊       | 10570/37963 [32:54:26<77:40:19, 10.21s/it]
                                                           
{'loss': '0.1703', 'grad_norm': '2.076', 'learning_rate': '1.693e-05', 'epoch': '0.2784'}

 28%|██▊       | 10570/37963 [32:54:26<77:40:19, 10.21s/it]
 28%|██▊       | 10571/37963 [32:54:36<77:18:47, 10.16s/it]
 28%|██▊       | 10572/37963 [32:54:46<77:07:35, 10.14s/it]
 28%|██▊       | 10573/37963 [32:54:56<77:02:47, 10.13s/it]
 28%|██▊       | 10574/37963 [32:55:06<77:00:27, 10.12s/it]
 28%|██▊       | 10575/37963 [32:55:23<92:10:44, 12.12s/it]
 28%|██▊       | 10576/37963 [32:55:33<87:38:05, 11.52s/it]
 28%|██▊       | 10577/37963 [32:55:43<84:30:04, 11.11s/it]
 28%|██▊       | 10578/37963 [32:55:54<82:32:45, 10.85s/it]
 28%|██▊       | 10579/37963 [32:56:03<80:02:59, 10.52s/it]
 28%|██▊       | 10580/37963 [32:56:20<93:38:20, 12.31s/it]
                                                           
{'loss': '0.1741', 'grad_norm': '1.518', 'learning_rate': '1.693e-05', 'epoch': '0.2787'}

 28%|██▊       | 10580/37963 [32:56:20<93:38:20, 12.31s/it]
 28%|██▊       | 10581/37963 [32:56:37<104:19:45, 13.72s/it]
 28%|██▊       | 10582/37963 [32:56:47<96:34:14, 12.70s/it] 
 28%|██▊       | 10583/37963 [32:56:57<89:33:48, 11.78s/it]
 28%|██▊       | 10584/37963 [32:57:07<85:57:52, 11.30s/it]
 28%|██▊       | 10585/37963 [32:57:17<82:32:59, 10.85s/it]
 28%|██▊       | 10586/37963 [32:57:27<80:07:14, 10.54s/it]
 28%|██▊       | 10587/37963 [32:57:37<79:16:23, 10.42s/it]
 28%|██▊       | 10588/37963 [32:57:53<93:31:41, 12.30s/it]
 28%|██▊       | 10589/37963 [32:58:03<88:21:05, 11.62s/it]
 28%|██▊       | 10590/37963 [32:58:14<84:53:25, 11.16s/it]
                                                           
{'loss': '0.167', 'grad_norm': '2.443', 'learning_rate': '1.692e-05', 'epoch': '0.279'}

 28%|██▊       | 10590/37963 [32:58:14<84:53:25, 11.16s/it]
 28%|██▊       | 10591/37963 [32:58:24<82:26:35, 10.84s/it]
 28%|██▊       | 10592/37963 [32:58:34<80:22:55, 10.57s/it]
 28%|██▊       | 10593/37963 [32:58:44<79:24:15, 10.44s/it]
 28%|██▊       | 10594/37963 [32:58:54<78:44:59, 10.36s/it]
 28%|██▊       | 10595/37963 [32:59:04<78:10:00, 10.28s/it]
 28%|██▊       | 10596/37963 [32:59:14<77:40:29, 10.22s/it]
 28%|██▊       | 10597/37963 [32:59:24<76:50:23, 10.11s/it]
 28%|██▊       | 10598/37963 [32:59:34<76:44:08, 10.09s/it]
 28%|██▊       | 10599/37963 [32:59:51<91:43:08, 12.07s/it]
 28%|██▊       | 10600/37963 [33:00:01<87:29:51, 11.51s/it]
                                                           
{'loss': '0.159', 'grad_norm': '3.799', 'learning_rate': '1.692e-05', 'epoch': '0.2792'}

 28%|██▊       | 10600/37963 [33:00:01<87:29:51, 11.51s/it]
 28%|██▊       | 10601/37963 [33:00:11<84:27:10, 11.11s/it]
 28%|██▊       | 10602/37963 [33:00:21<82:17:44, 10.83s/it]
 28%|██▊       | 10603/37963 [33:00:38<96:08:43, 12.65s/it]
 28%|██▊       | 10604/37963 [33:00:48<90:31:55, 11.91s/it]
 28%|██▊       | 10605/37963 [33:00:58<86:23:43, 11.37s/it]
 28%|██▊       | 10606/37963 [33:01:08<82:17:58, 10.83s/it]
 28%|██▊       | 10607/37963 [33:01:18<80:38:34, 10.61s/it]
 28%|██▊       | 10608/37963 [33:01:34<93:17:47, 12.28s/it]
 28%|██▊       | 10609/37963 [33:01:51<103:20:22, 13.60s/it]
 28%|██▊       | 10610/37963 [33:02:01<94:35:27, 12.45s/it] 
                                                           
{'loss': '0.1693', 'grad_norm': '2.791', 'learning_rate': '1.691e-05', 'epoch': '0.2795'}

 28%|██▊       | 10610/37963 [33:02:01<94:35:27, 12.45s/it]
 28%|██▊       | 10611/37963 [33:02:11<89:30:36, 11.78s/it]
 28%|██▊       | 10612/37963 [33:02:21<85:56:42, 11.31s/it]
 28%|██▊       | 10613/37963 [33:02:31<83:03:51, 10.93s/it]
 28%|██▊       | 10614/37963 [33:02:41<81:04:22, 10.67s/it]
 28%|██▊       | 10615/37963 [33:02:51<79:54:21, 10.52s/it]
 28%|██▊       | 10616/37963 [33:03:02<79:26:45, 10.46s/it]
 28%|██▊       | 10617/37963 [33:03:12<78:06:13, 10.28s/it]
 28%|██▊       | 10618/37963 [33:03:22<77:53:22, 10.25s/it]
 28%|██▊       | 10619/37963 [33:03:32<77:46:26, 10.24s/it]
 28%|██▊       | 10620/37963 [33:03:42<77:34:54, 10.21s/it]
                                                           
{'loss': '0.1789', 'grad_norm': '1.795', 'learning_rate': '1.69e-05', 'epoch': '0.2797'}

 28%|██▊       | 10620/37963 [33:03:42<77:34:54, 10.21s/it]
 28%|██▊       | 10621/37963 [33:03:52<75:45:20,  9.97s/it]
 28%|██▊       | 10622/37963 [33:04:02<75:55:44, 10.00s/it]
 28%|██▊       | 10623/37963 [33:04:18<90:30:50, 11.92s/it]
 28%|██▊       | 10624/37963 [33:04:28<86:35:18, 11.40s/it]
 28%|██▊       | 10625/37963 [33:04:38<83:48:23, 11.04s/it]
 28%|██▊       | 10626/37963 [33:04:49<81:42:40, 10.76s/it]
 28%|██▊       | 10627/37963 [33:04:58<78:49:09, 10.38s/it]
 28%|██▊       | 10628/37963 [33:05:21<106:37:18, 14.04s/it]
 28%|██▊       | 10629/37963 [33:05:31<97:55:51, 12.90s/it] 
 28%|██▊       | 10630/37963 [33:05:41<91:27:46, 12.05s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '1.759', 'learning_rate': '1.69e-05', 'epoch': '0.28'}

 28%|██▊       | 10630/37963 [33:05:41<91:27:46, 12.05s/it]
 28%|██▊       | 10631/37963 [33:05:51<87:00:14, 11.46s/it]
 28%|██▊       | 10632/37963 [33:06:01<83:24:36, 10.99s/it]
 28%|██▊       | 10633/37963 [33:06:11<81:16:20, 10.71s/it]
 28%|██▊       | 10634/37963 [33:06:21<78:49:26, 10.38s/it]
 28%|██▊       | 10635/37963 [33:06:31<78:14:56, 10.31s/it]
 28%|██▊       | 10636/37963 [33:06:40<76:37:07, 10.09s/it]
 28%|██▊       | 10637/37963 [33:06:57<91:17:41, 12.03s/it]
 28%|██▊       | 10638/37963 [33:07:07<86:34:03, 11.41s/it]
 28%|██▊       | 10639/37963 [33:07:17<83:28:37, 11.00s/it]
 28%|██▊       | 10640/37963 [33:07:27<81:13:53, 10.70s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '2.716', 'learning_rate': '1.689e-05', 'epoch': '0.2803'}

 28%|██▊       | 10640/37963 [33:07:27<81:13:53, 10.70s/it]
 28%|██▊       | 10641/37963 [33:07:37<79:53:55, 10.53s/it]
 28%|██▊       | 10642/37963 [33:07:47<79:17:04, 10.45s/it]
 28%|██▊       | 10643/37963 [33:07:57<78:41:56, 10.37s/it]
 28%|██▊       | 10644/37963 [33:08:08<78:21:05, 10.32s/it]
 28%|██▊       | 10645/37963 [33:08:18<78:03:29, 10.29s/it]
 28%|██▊       | 10646/37963 [33:08:28<77:31:39, 10.22s/it]
 28%|██▊       | 10647/37963 [33:08:38<77:03:07, 10.15s/it]
 28%|██▊       | 10648/37963 [33:08:55<92:09:27, 12.15s/it]
 28%|██▊       | 10649/37963 [33:09:04<86:51:41, 11.45s/it]
 28%|██▊       | 10650/37963 [33:09:15<83:41:18, 11.03s/it]
                                                           
{'loss': '0.1658', 'grad_norm': '1.405', 'learning_rate': '1.689e-05', 'epoch': '0.2805'}

 28%|██▊       | 10650/37963 [33:09:15<83:41:18, 11.03s/it]
 28%|██▊       | 10651/37963 [33:09:32<97:14:44, 12.82s/it]
 28%|██▊       | 10652/37963 [33:09:42<91:09:33, 12.02s/it]
 28%|██▊       | 10653/37963 [33:09:52<86:25:53, 11.39s/it]
 28%|██▊       | 10654/37963 [33:10:02<83:39:12, 11.03s/it]
 28%|██▊       | 10655/37963 [33:10:11<80:23:28, 10.60s/it]
 28%|██▊       | 10656/37963 [33:10:21<78:22:18, 10.33s/it]
 28%|██▊       | 10657/37963 [33:10:44<106:29:42, 14.04s/it]
 28%|██▊       | 10658/37963 [33:10:54<97:30:21, 12.86s/it] 
 28%|██▊       | 10659/37963 [33:11:04<90:19:08, 11.91s/it]
 28%|██▊       | 10660/37963 [33:11:14<86:12:49, 11.37s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '3.036', 'learning_rate': '1.688e-05', 'epoch': '0.2808'}

 28%|██▊       | 10660/37963 [33:11:14<86:12:49, 11.37s/it]
 28%|██▊       | 10661/37963 [33:11:24<83:10:45, 10.97s/it]
 28%|██▊       | 10662/37963 [33:11:34<81:10:56, 10.70s/it]
 28%|██▊       | 10663/37963 [33:11:44<79:47:40, 10.52s/it]
 28%|██▊       | 10664/37963 [33:11:54<78:45:38, 10.39s/it]
 28%|██▊       | 10665/37963 [33:12:04<78:08:48, 10.31s/it]
 28%|██▊       | 10666/37963 [33:12:14<77:47:57, 10.26s/it]
 28%|██▊       | 10667/37963 [33:12:24<77:25:25, 10.21s/it]
 28%|██▊       | 10668/37963 [33:12:34<77:11:43, 10.18s/it]
 28%|██▊       | 10669/37963 [33:12:45<77:07:59, 10.17s/it]
 28%|██▊       | 10670/37963 [33:12:55<76:58:19, 10.15s/it]
                                                           
{'loss': '0.1705', 'grad_norm': '2.137', 'learning_rate': '1.687e-05', 'epoch': '0.2811'}

 28%|██▊       | 10670/37963 [33:12:55<76:58:19, 10.15s/it]
 28%|██▊       | 10671/37963 [33:13:12<92:39:39, 12.22s/it]
 28%|██▊       | 10672/37963 [33:13:21<86:54:01, 11.46s/it]
 28%|██▊       | 10673/37963 [33:13:31<83:00:14, 10.95s/it]
 28%|██▊       | 10674/37963 [33:13:41<80:48:46, 10.66s/it]
 28%|██▊       | 10675/37963 [33:13:58<94:38:15, 12.49s/it]
 28%|██▊       | 10676/37963 [33:14:08<88:24:29, 11.66s/it]
 28%|██▊       | 10677/37963 [33:14:17<83:49:22, 11.06s/it]
 28%|██▊       | 10678/37963 [33:14:34<96:39:01, 12.75s/it]
 28%|██▊       | 10679/37963 [33:14:44<90:37:11, 11.96s/it]
 28%|██▊       | 10680/37963 [33:14:54<86:34:33, 11.42s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '3.686', 'learning_rate': '1.687e-05', 'epoch': '0.2813'}

 28%|██▊       | 10680/37963 [33:14:54<86:34:33, 11.42s/it]
 28%|██▊       | 10681/37963 [33:15:04<83:11:16, 10.98s/it]
 28%|██▊       | 10682/37963 [33:15:14<79:47:46, 10.53s/it]
 28%|██▊       | 10683/37963 [33:15:23<77:54:49, 10.28s/it]
 28%|██▊       | 10684/37963 [33:15:34<77:45:57, 10.26s/it]
 28%|██▊       | 10685/37963 [33:15:50<91:26:22, 12.07s/it]
 28%|██▊       | 10686/37963 [33:16:00<86:08:57, 11.37s/it]
 28%|██▊       | 10687/37963 [33:16:10<83:13:05, 10.98s/it]
 28%|██▊       | 10688/37963 [33:16:20<81:07:29, 10.71s/it]
 28%|██▊       | 10689/37963 [33:16:30<79:38:01, 10.51s/it]
 28%|██▊       | 10690/37963 [33:16:40<78:10:12, 10.32s/it]
                                                           
{'loss': '0.1762', 'grad_norm': '3.861', 'learning_rate': '1.686e-05', 'epoch': '0.2816'}

 28%|██▊       | 10690/37963 [33:16:40<78:10:12, 10.32s/it]
 28%|██▊       | 10691/37963 [33:16:50<77:34:04, 10.24s/it]
 28%|██▊       | 10692/37963 [33:17:00<76:36:16, 10.11s/it]
 28%|██▊       | 10693/37963 [33:17:10<76:26:30, 10.09s/it]
 28%|██▊       | 10694/37963 [33:17:20<76:33:21, 10.11s/it]
 28%|██▊       | 10695/37963 [33:17:30<76:27:51, 10.10s/it]
 28%|██▊       | 10696/37963 [33:17:46<91:10:50, 12.04s/it]
 28%|██▊       | 10697/37963 [33:17:56<86:03:25, 11.36s/it]
 28%|██▊       | 10698/37963 [33:18:06<83:08:09, 10.98s/it]
 28%|██▊       | 10699/37963 [33:18:23<96:03:35, 12.68s/it]
 28%|██▊       | 10700/37963 [33:18:33<90:20:31, 11.93s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '1.56', 'learning_rate': '1.685e-05', 'epoch': '0.2819'}

 28%|██▊       | 10700/37963 [33:18:33<90:20:31, 11.93s/it]
 28%|██▊       | 10701/37963 [33:18:43<85:53:22, 11.34s/it]
 28%|██▊       | 10702/37963 [33:18:53<83:13:44, 10.99s/it]
 28%|██▊       | 10703/37963 [33:19:03<81:15:49, 10.73s/it]
 28%|██▊       | 10704/37963 [33:19:13<79:01:29, 10.44s/it]
 28%|██▊       | 10705/37963 [33:19:23<78:18:09, 10.34s/it]
 28%|██▊       | 10706/37963 [33:19:46<106:33:20, 14.07s/it]
 28%|██▊       | 10707/37963 [33:19:56<97:48:03, 12.92s/it] 
 28%|██▊       | 10708/37963 [33:20:06<90:36:03, 11.97s/it]
 28%|██▊       | 10709/37963 [33:20:16<86:26:08, 11.42s/it]
 28%|██▊       | 10710/37963 [33:20:26<83:04:18, 10.97s/it]
                                                           
{'loss': '0.1672', 'grad_norm': '0.818', 'learning_rate': '1.685e-05', 'epoch': '0.2821'}

 28%|██▊       | 10710/37963 [33:20:26<83:04:18, 10.97s/it]
 28%|██▊       | 10711/37963 [33:20:36<81:04:36, 10.71s/it]
 28%|██▊       | 10712/37963 [33:20:46<79:24:50, 10.49s/it]
 28%|██▊       | 10713/37963 [33:20:56<78:24:43, 10.36s/it]
 28%|██▊       | 10714/37963 [33:21:06<77:58:35, 10.30s/it]
 28%|██▊       | 10715/37963 [33:21:16<77:05:52, 10.19s/it]
 28%|██▊       | 10716/37963 [33:21:26<76:57:08, 10.17s/it]
 28%|██▊       | 10717/37963 [33:21:36<75:51:02, 10.02s/it]
 28%|██▊       | 10718/37963 [33:21:46<75:30:34,  9.98s/it]
 28%|██▊       | 10719/37963 [33:21:56<75:46:53, 10.01s/it]
 28%|██▊       | 10720/37963 [33:22:13<90:29:35, 11.96s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '1.34', 'learning_rate': '1.684e-05', 'epoch': '0.2824'}

 28%|██▊       | 10720/37963 [33:22:13<90:29:35, 11.96s/it]
 28%|██▊       | 10721/37963 [33:22:23<86:25:16, 11.42s/it]
 28%|██▊       | 10722/37963 [33:22:33<83:14:54, 11.00s/it]
 28%|██▊       | 10723/37963 [33:22:43<81:14:21, 10.74s/it]
 28%|██▊       | 10724/37963 [33:23:00<94:48:46, 12.53s/it]
 28%|██▊       | 10725/37963 [33:23:16<103:46:18, 13.72s/it]
 28%|██▊       | 10726/37963 [33:23:26<94:54:12, 12.54s/it] 
 28%|██▊       | 10727/37963 [33:23:36<89:15:06, 11.80s/it]
 28%|██▊       | 10728/37963 [33:23:46<85:17:13, 11.27s/it]
 28%|██▊       | 10729/37963 [33:23:56<82:29:21, 10.90s/it]
 28%|██▊       | 10730/37963 [33:24:06<80:38:18, 10.66s/it]
                                                           
{'loss': '0.152', 'grad_norm': '1.303', 'learning_rate': '1.684e-05', 'epoch': '0.2826'}

 28%|██▊       | 10730/37963 [33:24:06<80:38:18, 10.66s/it]
 28%|██▊       | 10731/37963 [33:24:16<78:15:59, 10.35s/it]
 28%|██▊       | 10732/37963 [33:24:26<77:04:20, 10.19s/it]
 28%|██▊       | 10733/37963 [33:24:35<75:54:29, 10.04s/it]
 28%|██▊       | 10734/37963 [33:24:52<91:11:06, 12.06s/it]
 28%|██▊       | 10735/37963 [33:25:02<86:46:13, 11.47s/it]
 28%|██▊       | 10736/37963 [33:25:12<83:23:24, 11.03s/it]
 28%|██▊       | 10737/37963 [33:25:22<81:16:16, 10.75s/it]
 28%|██▊       | 10738/37963 [33:25:32<79:01:04, 10.45s/it]
 28%|██▊       | 10739/37963 [33:25:42<78:10:40, 10.34s/it]
 28%|██▊       | 10740/37963 [33:25:52<77:38:54, 10.27s/it]
                                                           
{'loss': '0.1678', 'grad_norm': '1.817', 'learning_rate': '1.683e-05', 'epoch': '0.2829'}

 28%|██▊       | 10740/37963 [33:25:52<77:38:54, 10.27s/it]
 28%|██▊       | 10741/37963 [33:26:02<77:05:34, 10.20s/it]
 28%|██▊       | 10742/37963 [33:26:12<76:50:00, 10.16s/it]
 28%|██▊       | 10743/37963 [33:26:22<75:39:49, 10.01s/it]
 28%|██▊       | 10744/37963 [33:26:38<90:31:05, 11.97s/it]
 28%|██▊       | 10745/37963 [33:26:49<86:27:39, 11.44s/it]
 28%|██▊       | 10746/37963 [33:27:06<99:02:05, 13.10s/it]
 28%|██▊       | 10747/37963 [33:27:16<92:21:06, 12.22s/it]
 28%|██▊       | 10748/37963 [33:27:26<87:10:38, 11.53s/it]
 28%|██▊       | 10749/37963 [33:27:36<83:46:10, 11.08s/it]
 28%|██▊       | 10750/37963 [33:27:46<81:13:07, 10.74s/it]
                                                           
{'loss': '0.1783', 'grad_norm': '1.49', 'learning_rate': '1.682e-05', 'epoch': '0.2832'}

 28%|██▊       | 10750/37963 [33:27:46<81:13:07, 10.74s/it]
 28%|██▊       | 10751/37963 [33:27:56<79:39:06, 10.54s/it]
 28%|██▊       | 10752/37963 [33:28:06<78:31:16, 10.39s/it]
 28%|██▊       | 10753/37963 [33:28:15<76:49:11, 10.16s/it]
 28%|██▊       | 10754/37963 [33:28:25<76:26:53, 10.11s/it]
 28%|██▊       | 10755/37963 [33:28:48<104:47:32, 13.87s/it]
 28%|██▊       | 10756/37963 [33:28:58<96:05:48, 12.72s/it] 
 28%|██▊       | 10757/37963 [33:29:08<90:12:42, 11.94s/it]
 28%|██▊       | 10758/37963 [33:29:18<86:02:27, 11.39s/it]
 28%|██▊       | 10759/37963 [33:29:28<82:47:46, 10.96s/it]
 28%|██▊       | 10760/37963 [33:29:38<80:46:32, 10.69s/it]
                                                           
{'loss': '0.1688', 'grad_norm': '1.039', 'learning_rate': '1.682e-05', 'epoch': '0.2834'}

 28%|██▊       | 10760/37963 [33:29:38<80:46:32, 10.69s/it]
 28%|██▊       | 10761/37963 [33:29:49<79:33:58, 10.53s/it]
 28%|██▊       | 10762/37963 [33:29:58<78:08:49, 10.34s/it]
 28%|██▊       | 10763/37963 [33:30:08<77:24:56, 10.25s/it]
 28%|██▊       | 10764/37963 [33:30:18<76:35:21, 10.14s/it]
 28%|██▊       | 10765/37963 [33:30:28<76:27:29, 10.12s/it]
 28%|██▊       | 10766/37963 [33:30:38<75:37:45, 10.01s/it]
 28%|██▊       | 10767/37963 [33:30:48<75:54:46, 10.05s/it]
 28%|██▊       | 10768/37963 [33:30:58<76:15:51, 10.10s/it]
 28%|██▊       | 10769/37963 [33:31:16<92:15:30, 12.21s/it]
 28%|██▊       | 10770/37963 [33:31:26<87:30:27, 11.58s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '3.44', 'learning_rate': '1.681e-05', 'epoch': '0.2837'}

 28%|██▊       | 10770/37963 [33:31:26<87:30:27, 11.58s/it]
 28%|██▊       | 10771/37963 [33:31:36<84:03:40, 11.13s/it]
 28%|██▊       | 10772/37963 [33:31:53<97:14:10, 12.87s/it]
 28%|██▊       | 10773/37963 [33:32:09<104:26:02, 13.83s/it]
 28%|██▊       | 10774/37963 [33:32:19<96:15:16, 12.74s/it] 
 28%|██▊       | 10775/37963 [33:32:29<90:42:29, 12.01s/it]
 28%|██▊       | 10776/37963 [33:32:39<86:20:06, 11.43s/it]
 28%|██▊       | 10777/37963 [33:32:50<83:40:57, 11.08s/it]
 28%|██▊       | 10778/37963 [33:33:00<81:49:57, 10.84s/it]
 28%|██▊       | 10779/37963 [33:33:10<80:06:52, 10.61s/it]
 28%|██▊       | 10780/37963 [33:33:20<79:24:12, 10.52s/it]
                                                           
{'loss': '0.1745', 'grad_norm': '1.154', 'learning_rate': '1.68e-05', 'epoch': '0.284'}

 28%|██▊       | 10780/37963 [33:33:20<79:24:12, 10.52s/it]
 28%|██▊       | 10781/37963 [33:33:30<78:31:00, 10.40s/it]
 28%|██▊       | 10782/37963 [33:33:47<92:01:28, 12.19s/it]
 28%|██▊       | 10783/37963 [33:33:57<87:23:56, 11.58s/it]
 28%|██▊       | 10784/37963 [33:34:07<83:53:17, 11.11s/it]
 28%|██▊       | 10785/37963 [33:34:17<81:52:33, 10.85s/it]
 28%|██▊       | 10786/37963 [33:34:27<80:10:21, 10.62s/it]
 28%|██▊       | 10787/37963 [33:34:37<78:58:01, 10.46s/it]
 28%|██▊       | 10788/37963 [33:34:48<78:15:31, 10.37s/it]
 28%|██▊       | 10789/37963 [33:34:58<77:45:06, 10.30s/it]
 28%|██▊       | 10790/37963 [33:35:07<76:02:03, 10.07s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '3.358', 'learning_rate': '1.68e-05', 'epoch': '0.2842'}

 28%|██▊       | 10790/37963 [33:35:07<76:02:03, 10.07s/it]
 28%|██▊       | 10791/37963 [33:35:17<75:24:00,  9.99s/it]
 28%|██▊       | 10792/37963 [33:35:33<89:56:14, 11.92s/it]
 28%|██▊       | 10793/37963 [33:35:43<85:39:36, 11.35s/it]
 28%|██▊       | 10794/37963 [33:35:54<82:42:01, 10.96s/it]
 28%|██▊       | 10795/37963 [33:36:11<96:31:55, 12.79s/it]
 28%|██▊       | 10796/37963 [33:36:21<90:16:27, 11.96s/it]
 28%|██▊       | 10797/37963 [33:36:31<85:59:51, 11.40s/it]
 28%|██▊       | 10798/37963 [33:36:41<83:08:02, 11.02s/it]
 28%|██▊       | 10799/37963 [33:36:51<80:54:18, 10.72s/it]
 28%|██▊       | 10800/37963 [33:37:01<79:27:32, 10.53s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '2.419', 'learning_rate': '1.679e-05', 'epoch': '0.2845'}

 28%|██▊       | 10800/37963 [33:37:01<79:27:32, 10.53s/it]
 28%|██▊       | 10801/37963 [33:37:11<78:30:20, 10.41s/it]
 28%|██▊       | 10802/37963 [33:37:21<77:14:38, 10.24s/it]
 28%|██▊       | 10803/37963 [33:37:37<91:00:46, 12.06s/it]
 28%|██▊       | 10804/37963 [33:37:54<100:46:08, 13.36s/it]
 28%|██▊       | 10805/37963 [33:38:04<93:13:37, 12.36s/it] 
 28%|██▊       | 10806/37963 [33:38:14<88:04:43, 11.68s/it]
 28%|██▊       | 10807/37963 [33:38:24<84:43:02, 11.23s/it]
 28%|██▊       | 10808/37963 [33:38:34<81:31:29, 10.81s/it]
 28%|██▊       | 10809/37963 [33:38:43<79:02:38, 10.48s/it]
 28%|██▊       | 10810/37963 [33:38:53<76:57:29, 10.20s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '1.86', 'learning_rate': '1.679e-05', 'epoch': '0.2848'}

 28%|██▊       | 10810/37963 [33:38:53<76:57:29, 10.20s/it]
 28%|██▊       | 10811/37963 [33:39:03<77:00:21, 10.21s/it]
 28%|██▊       | 10812/37963 [33:39:13<76:29:18, 10.14s/it]
 28%|██▊       | 10813/37963 [33:39:23<76:26:14, 10.14s/it]
 28%|██▊       | 10814/37963 [33:39:34<76:44:15, 10.18s/it]
 28%|██▊       | 10815/37963 [33:39:43<75:32:38, 10.02s/it]
 28%|██▊       | 10816/37963 [33:39:53<75:57:20, 10.07s/it]
 28%|██▊       | 10817/37963 [33:40:10<90:58:46, 12.07s/it]
 28%|██▊       | 10818/37963 [33:40:20<86:30:11, 11.47s/it]
 28%|██▊       | 10819/37963 [33:40:37<97:44:35, 12.96s/it]
 29%|██▊       | 10820/37963 [33:40:47<90:48:17, 12.04s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '5.322', 'learning_rate': '1.678e-05', 'epoch': '0.285'}

 29%|██▊       | 10820/37963 [33:40:47<90:48:17, 12.04s/it]
 29%|██▊       | 10821/37963 [33:40:57<86:28:50, 11.47s/it]
 29%|██▊       | 10822/37963 [33:41:07<83:32:58, 11.08s/it]
 29%|██▊       | 10823/37963 [33:41:23<95:51:12, 12.71s/it]
 29%|██▊       | 10824/37963 [33:41:34<90:04:08, 11.95s/it]
 29%|██▊       | 10825/37963 [33:41:44<85:57:35, 11.40s/it]
 29%|██▊       | 10826/37963 [33:41:54<82:27:00, 10.94s/it]
 29%|██▊       | 10827/37963 [33:42:04<80:39:46, 10.70s/it]
 29%|██▊       | 10828/37963 [33:42:14<79:09:57, 10.50s/it]
 29%|██▊       | 10829/37963 [33:42:24<78:13:18, 10.38s/it]
 29%|██▊       | 10830/37963 [33:42:34<77:33:24, 10.29s/it]
                                                           
{'loss': '0.1891', 'grad_norm': '5.742', 'learning_rate': '1.677e-05', 'epoch': '0.2853'}

 29%|██▊       | 10830/37963 [33:42:34<77:33:24, 10.29s/it]
 29%|██▊       | 10831/37963 [33:42:44<76:57:48, 10.21s/it]
 29%|██▊       | 10832/37963 [33:43:00<90:52:29, 12.06s/it]
 29%|██▊       | 10833/37963 [33:43:10<86:35:57, 11.49s/it]
 29%|██▊       | 10834/37963 [33:43:20<83:05:05, 11.03s/it]
 29%|██▊       | 10835/37963 [33:43:30<80:50:58, 10.73s/it]
 29%|██▊       | 10836/37963 [33:43:41<79:16:41, 10.52s/it]
 29%|██▊       | 10837/37963 [33:43:50<77:45:47, 10.32s/it]
 29%|██▊       | 10838/37963 [33:44:00<77:17:10, 10.26s/it]
 29%|██▊       | 10839/37963 [33:44:17<91:16:08, 12.11s/it]
 29%|██▊       | 10840/37963 [33:44:27<86:28:58, 11.48s/it]
                                                           
{'loss': '0.1669', 'grad_norm': '4.821', 'learning_rate': '1.677e-05', 'epoch': '0.2855'}

 29%|██▊       | 10840/37963 [33:44:27<86:28:58, 11.48s/it]
 29%|██▊       | 10841/37963 [33:44:37<83:20:11, 11.06s/it]
 29%|██▊       | 10842/37963 [33:44:47<81:13:04, 10.78s/it]
 29%|██▊       | 10843/37963 [33:45:04<94:18:33, 12.52s/it]
 29%|██▊       | 10844/37963 [33:45:14<88:53:04, 11.80s/it]
 29%|██▊       | 10845/37963 [33:45:24<85:35:35, 11.36s/it]
 29%|██▊       | 10846/37963 [33:45:34<82:59:07, 11.02s/it]
 29%|██▊       | 10847/37963 [33:45:45<81:25:46, 10.81s/it]
 29%|██▊       | 10848/37963 [33:45:55<79:40:31, 10.58s/it]
 29%|██▊       | 10849/37963 [33:46:05<78:43:14, 10.45s/it]
 29%|██▊       | 10850/37963 [33:46:22<92:43:22, 12.31s/it]
                                                           
{'loss': '0.166', 'grad_norm': '3.203', 'learning_rate': '1.676e-05', 'epoch': '0.2858'}

 29%|██▊       | 10850/37963 [33:46:22<92:43:22, 12.31s/it]
 29%|██▊       | 10851/37963 [33:46:32<87:30:19, 11.62s/it]
 29%|██▊       | 10852/37963 [33:46:48<97:35:22, 12.96s/it]
 29%|██▊       | 10853/37963 [33:46:58<90:41:43, 12.04s/it]
 29%|██▊       | 10854/37963 [33:47:08<86:21:45, 11.47s/it]
 29%|██▊       | 10855/37963 [33:47:18<83:08:40, 11.04s/it]
 29%|██▊       | 10856/37963 [33:47:28<80:36:53, 10.71s/it]
 29%|██▊       | 10857/37963 [33:47:38<78:57:58, 10.49s/it]
 29%|██▊       | 10858/37963 [33:47:48<77:59:23, 10.36s/it]
 29%|██▊       | 10859/37963 [33:47:58<76:50:09, 10.21s/it]
 29%|██▊       | 10860/37963 [33:48:07<76:00:46, 10.10s/it]
                                                           
{'loss': '0.1665', 'grad_norm': '1.19', 'learning_rate': '1.675e-05', 'epoch': '0.2861'}

 29%|██▊       | 10860/37963 [33:48:07<76:00:46, 10.10s/it]
 29%|██▊       | 10861/37963 [33:48:17<76:04:02, 10.10s/it]
 29%|██▊       | 10862/37963 [33:48:28<75:59:56, 10.10s/it]
 29%|██▊       | 10863/37963 [33:48:37<75:19:59, 10.01s/it]
 29%|██▊       | 10864/37963 [33:48:47<75:35:59, 10.04s/it]
 29%|██▊       | 10865/37963 [33:49:04<90:05:07, 11.97s/it]
 29%|██▊       | 10866/37963 [33:49:14<86:04:13, 11.43s/it]
 29%|██▊       | 10867/37963 [33:49:31<98:33:50, 13.10s/it]
 29%|██▊       | 10868/37963 [33:49:41<91:54:57, 12.21s/it]
 29%|██▊       | 10869/37963 [33:49:51<87:08:34, 11.58s/it]
 29%|██▊       | 10870/37963 [33:50:01<83:30:28, 11.10s/it]
                                                           
{'loss': '0.1693', 'grad_norm': '0.8007', 'learning_rate': '1.675e-05', 'epoch': '0.2863'}

 29%|██▊       | 10870/37963 [33:50:01<83:30:28, 11.10s/it]
 29%|██▊       | 10871/37963 [33:50:11<81:06:10, 10.78s/it]
 29%|██▊       | 10872/37963 [33:50:21<79:32:50, 10.57s/it]
 29%|██▊       | 10873/37963 [33:50:38<92:52:45, 12.34s/it]
 29%|██▊       | 10874/37963 [33:50:48<87:09:15, 11.58s/it]
 29%|██▊       | 10875/37963 [33:50:57<82:24:29, 10.95s/it]
 29%|██▊       | 10876/37963 [33:51:07<80:41:41, 10.72s/it]
 29%|██▊       | 10877/37963 [33:51:17<78:37:48, 10.45s/it]
 29%|██▊       | 10878/37963 [33:51:27<77:59:20, 10.37s/it]
 29%|██▊       | 10879/37963 [33:51:37<76:07:28, 10.12s/it]
 29%|██▊       | 10880/37963 [33:51:47<75:36:50, 10.05s/it]
                                                           
{'loss': '0.1719', 'grad_norm': '2.363', 'learning_rate': '1.674e-05', 'epoch': '0.2866'}

 29%|██▊       | 10880/37963 [33:51:47<75:36:50, 10.05s/it]
 29%|██▊       | 10881/37963 [33:52:03<89:43:42, 11.93s/it]
 29%|██▊       | 10882/37963 [33:52:13<85:24:58, 11.35s/it]
 29%|██▊       | 10883/37963 [33:52:23<82:59:19, 11.03s/it]
 29%|██▊       | 10884/37963 [33:52:34<80:53:48, 10.75s/it]
 29%|██▊       | 10885/37963 [33:52:44<79:33:25, 10.58s/it]
 29%|██▊       | 10886/37963 [33:52:54<78:33:24, 10.44s/it]
 29%|██▊       | 10887/37963 [33:53:04<77:11:07, 10.26s/it]
 29%|██▊       | 10888/37963 [33:53:20<91:20:12, 12.14s/it]
 29%|██▊       | 10889/37963 [33:53:37<100:54:35, 13.42s/it]
 29%|██▊       | 10890/37963 [33:53:47<93:30:15, 12.43s/it] 
                                                           
{'loss': '0.1682', 'grad_norm': '1.817', 'learning_rate': '1.674e-05', 'epoch': '0.2869'}

 29%|██▊       | 10890/37963 [33:53:47<93:30:15, 12.43s/it]
 29%|██▊       | 10891/37963 [33:53:57<88:14:54, 11.74s/it]
 29%|██▊       | 10892/37963 [33:54:07<83:51:26, 11.15s/it]
 29%|██▊       | 10893/37963 [33:54:17<81:28:01, 10.83s/it]
 29%|██▊       | 10894/37963 [33:54:27<79:41:21, 10.60s/it]
 29%|██▊       | 10895/37963 [33:54:37<78:45:38, 10.48s/it]
 29%|██▊       | 10896/37963 [33:54:47<77:53:38, 10.36s/it]
 29%|██▊       | 10897/37963 [33:54:57<76:38:43, 10.19s/it]
 29%|██▊       | 10898/37963 [33:55:13<90:57:23, 12.10s/it]
 29%|██▊       | 10899/37963 [33:55:23<85:35:59, 11.39s/it]
 29%|██▊       | 10900/37963 [33:55:40<97:26:55, 12.96s/it]
                                                           
{'loss': '0.1743', 'grad_norm': '1.624', 'learning_rate': '1.673e-05', 'epoch': '0.2871'}

 29%|██▊       | 10900/37963 [33:55:40<97:26:55, 12.96s/it]
 29%|██▊       | 10901/37963 [33:55:50<90:53:45, 12.09s/it]
 29%|██▊       | 10902/37963 [33:56:00<86:29:08, 11.51s/it]
 29%|██▊       | 10903/37963 [33:56:10<83:15:01, 11.08s/it]
 29%|██▊       | 10904/37963 [33:56:20<80:03:19, 10.65s/it]
 29%|██▊       | 10905/37963 [33:56:29<77:56:51, 10.37s/it]
 29%|██▊       | 10906/37963 [33:56:39<77:13:31, 10.28s/it]
 29%|██▊       | 10907/37963 [33:56:49<76:27:53, 10.17s/it]
 29%|██▊       | 10908/37963 [33:56:59<76:15:59, 10.15s/it]
 29%|██▊       | 10909/37963 [33:57:10<75:58:32, 10.11s/it]
 29%|██▊       | 10910/37963 [33:57:20<75:55:35, 10.10s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '1.9', 'learning_rate': '1.672e-05', 'epoch': '0.2874'}

 29%|██▊       | 10910/37963 [33:57:20<75:55:35, 10.10s/it]
 29%|██▊       | 10911/37963 [33:57:30<76:02:13, 10.12s/it]
 29%|██▊       | 10912/37963 [33:57:46<90:41:18, 12.07s/it]
 29%|██▊       | 10913/37963 [33:57:56<85:30:50, 11.38s/it]
 29%|██▊       | 10914/37963 [33:58:13<98:13:19, 13.07s/it]
 29%|██▉       | 10915/37963 [33:58:23<90:56:35, 12.10s/it]
 29%|██▉       | 10916/37963 [33:58:33<86:22:26, 11.50s/it]
 29%|██▉       | 10917/37963 [33:58:43<83:13:17, 11.08s/it]
 29%|██▉       | 10918/37963 [33:58:53<81:09:44, 10.80s/it]
 29%|██▉       | 10919/37963 [33:59:03<79:35:25, 10.59s/it]
 29%|██▉       | 10920/37963 [33:59:20<92:40:29, 12.34s/it]
                                                           
{'loss': '0.1663', 'grad_norm': '5.588', 'learning_rate': '1.672e-05', 'epoch': '0.2876'}

 29%|██▉       | 10920/37963 [33:59:20<92:40:29, 12.34s/it]
 29%|██▉       | 10921/37963 [33:59:29<86:33:54, 11.52s/it]
 29%|██▉       | 10922/37963 [33:59:40<83:18:45, 11.09s/it]
 29%|██▉       | 10923/37963 [33:59:50<81:00:55, 10.79s/it]
 29%|██▉       | 10924/37963 [33:59:59<78:51:49, 10.50s/it]
 29%|██▉       | 10925/37963 [34:00:10<78:08:27, 10.40s/it]
 29%|██▉       | 10926/37963 [34:00:20<77:34:50, 10.33s/it]
 29%|██▉       | 10927/37963 [34:00:30<77:06:29, 10.27s/it]
 29%|██▉       | 10928/37963 [34:00:40<76:26:02, 10.18s/it]
 29%|██▉       | 10929/37963 [34:00:56<90:21:51, 12.03s/it]
 29%|██▉       | 10930/37963 [34:01:06<86:06:35, 11.47s/it]
                                                           
{'loss': '0.164', 'grad_norm': '1.926', 'learning_rate': '1.671e-05', 'epoch': '0.2879'}

 29%|██▉       | 10930/37963 [34:01:06<86:06:35, 11.47s/it]
 29%|██▉       | 10931/37963 [34:01:16<82:33:23, 10.99s/it]
 29%|██▉       | 10932/37963 [34:01:27<81:07:28, 10.80s/it]
 29%|██▉       | 10933/37963 [34:01:37<79:05:20, 10.53s/it]
 29%|██▉       | 10934/37963 [34:01:47<77:58:12, 10.38s/it]
 29%|██▉       | 10935/37963 [34:01:57<77:22:42, 10.31s/it]
 29%|██▉       | 10936/37963 [34:02:13<91:08:18, 12.14s/it]
 29%|██▉       | 10937/37963 [34:02:23<86:01:51, 11.46s/it]
 29%|██▉       | 10938/37963 [34:02:40<98:58:16, 13.18s/it]
 29%|██▉       | 10939/37963 [34:02:50<91:17:25, 12.16s/it]
 29%|██▉       | 10940/37963 [34:03:00<85:55:06, 11.45s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '6.21', 'learning_rate': '1.67e-05', 'epoch': '0.2882'}

 29%|██▉       | 10940/37963 [34:03:00<85:55:06, 11.45s/it]
 29%|██▉       | 10941/37963 [34:03:10<83:10:11, 11.08s/it]
 29%|██▉       | 10942/37963 [34:03:20<80:50:15, 10.77s/it]
 29%|██▉       | 10943/37963 [34:03:30<79:18:01, 10.57s/it]
 29%|██▉       | 10944/37963 [34:03:40<78:26:06, 10.45s/it]
 29%|██▉       | 10945/37963 [34:03:50<77:45:11, 10.36s/it]
 29%|██▉       | 10946/37963 [34:04:01<77:14:44, 10.29s/it]
 29%|██▉       | 10947/37963 [34:04:23<105:13:12, 14.02s/it]
 29%|██▉       | 10948/37963 [34:04:34<96:36:46, 12.87s/it] 
 29%|██▉       | 10949/37963 [34:04:44<90:11:36, 12.02s/it]
 29%|██▉       | 10950/37963 [34:04:54<85:53:04, 11.45s/it]
                                                           
{'loss': '0.1556', 'grad_norm': '1.869', 'learning_rate': '1.67e-05', 'epoch': '0.2884'}

 29%|██▉       | 10950/37963 [34:04:54<85:53:04, 11.45s/it]
 29%|██▉       | 10951/37963 [34:05:04<82:57:47, 11.06s/it]
 29%|██▉       | 10952/37963 [34:05:14<80:39:30, 10.75s/it]
 29%|██▉       | 10953/37963 [34:05:24<78:54:47, 10.52s/it]
 29%|██▉       | 10954/37963 [34:05:34<77:22:41, 10.31s/it]
 29%|██▉       | 10955/37963 [34:05:44<76:19:35, 10.17s/it]
 29%|██▉       | 10956/37963 [34:05:54<76:28:52, 10.19s/it]
 29%|██▉       | 10957/37963 [34:06:03<75:19:48, 10.04s/it]
 29%|██▉       | 10958/37963 [34:06:14<75:35:45, 10.08s/it]
 29%|██▉       | 10959/37963 [34:06:23<75:07:52, 10.02s/it]
 29%|██▉       | 10960/37963 [34:06:40<89:16:43, 11.90s/it]
                                                           
{'loss': '0.147', 'grad_norm': '2.777', 'learning_rate': '1.669e-05', 'epoch': '0.2887'}

 29%|██▉       | 10960/37963 [34:06:40<89:16:43, 11.90s/it]
 29%|██▉       | 10961/37963 [34:06:50<85:12:21, 11.36s/it]
 29%|██▉       | 10962/37963 [34:07:00<82:46:55, 11.04s/it]
 29%|██▉       | 10963/37963 [34:07:17<95:59:54, 12.80s/it]
 29%|██▉       | 10964/37963 [34:07:27<89:42:10, 11.96s/it]
 29%|██▉       | 10965/37963 [34:07:37<85:08:02, 11.35s/it]
 29%|██▉       | 10966/37963 [34:07:47<81:48:00, 10.91s/it]
 29%|██▉       | 10967/37963 [34:07:57<79:31:16, 10.60s/it]
 29%|██▉       | 10968/37963 [34:08:07<78:16:37, 10.44s/it]
 29%|██▉       | 10969/37963 [34:08:23<92:03:51, 12.28s/it]
 29%|██▉       | 10970/37963 [34:08:33<86:59:26, 11.60s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '2.12', 'learning_rate': '1.668e-05', 'epoch': '0.289'}

 29%|██▉       | 10970/37963 [34:08:33<86:59:26, 11.60s/it]
 29%|██▉       | 10971/37963 [34:08:43<82:29:48, 11.00s/it]
 29%|██▉       | 10972/37963 [34:08:53<80:31:51, 10.74s/it]
 29%|██▉       | 10973/37963 [34:09:03<78:59:37, 10.54s/it]
 29%|██▉       | 10974/37963 [34:09:13<78:15:13, 10.44s/it]
 29%|██▉       | 10975/37963 [34:09:24<77:36:27, 10.35s/it]
 29%|██▉       | 10976/37963 [34:09:34<76:48:50, 10.25s/it]
 29%|██▉       | 10977/37963 [34:09:44<76:33:22, 10.21s/it]
 29%|██▉       | 10978/37963 [34:10:00<89:11:31, 11.90s/it]
 29%|██▉       | 10979/37963 [34:10:10<85:21:07, 11.39s/it]
 29%|██▉       | 10980/37963 [34:10:20<82:29:39, 11.01s/it]
                                                           
{'loss': '0.168', 'grad_norm': '1.331', 'learning_rate': '1.668e-05', 'epoch': '0.2892'}

 29%|██▉       | 10980/37963 [34:10:20<82:29:39, 11.01s/it]
 29%|██▉       | 10981/37963 [34:10:30<80:29:51, 10.74s/it]
 29%|██▉       | 10982/37963 [34:10:40<78:01:40, 10.41s/it]
 29%|██▉       | 10983/37963 [34:10:50<77:12:23, 10.30s/it]
 29%|██▉       | 10984/37963 [34:11:06<90:05:26, 12.02s/it]
 29%|██▉       | 10985/37963 [34:11:16<85:46:59, 11.45s/it]
 29%|██▉       | 10986/37963 [34:11:33<97:59:28, 13.08s/it]
 29%|██▉       | 10987/37963 [34:11:43<91:09:57, 12.17s/it]
 29%|██▉       | 10988/37963 [34:11:53<86:44:28, 11.58s/it]
 29%|██▉       | 10989/37963 [34:12:03<82:55:08, 11.07s/it]
 29%|██▉       | 10990/37963 [34:12:13<80:33:46, 10.75s/it]
                                                           
{'loss': '0.1791', 'grad_norm': '1.66', 'learning_rate': '1.667e-05', 'epoch': '0.2895'}

 29%|██▉       | 10990/37963 [34:12:13<80:33:46, 10.75s/it]
 29%|██▉       | 10991/37963 [34:12:23<79:22:27, 10.59s/it]
 29%|██▉       | 10992/37963 [34:12:33<78:16:49, 10.45s/it]
 29%|██▉       | 10993/37963 [34:12:43<77:23:09, 10.33s/it]
 29%|██▉       | 10994/37963 [34:12:53<77:00:13, 10.28s/it]
 29%|██▉       | 10995/37963 [34:13:09<90:07:06, 12.03s/it]
 29%|██▉       | 10996/37963 [34:13:19<85:02:58, 11.35s/it]
 29%|██▉       | 10997/37963 [34:13:36<96:07:50, 12.83s/it]
 29%|██▉       | 10998/37963 [34:13:46<90:18:33, 12.06s/it]
 29%|██▉       | 10999/37963 [34:13:56<85:59:01, 11.48s/it]
 29%|██▉       | 11000/37963 [34:14:06<82:33:43, 11.02s/it]
                                                           
{'loss': '0.1712', 'grad_norm': '2.069', 'learning_rate': '1.667e-05', 'epoch': '0.2898'}

 29%|██▉       | 11000/37963 [34:14:06<82:33:43, 11.02s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.81s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.81s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 29%|██▉       | 11001/37963 [34:15:10<201:37:27, 26.92s/it]
 29%|██▉       | 11002/37963 [34:15:20<163:10:42, 21.79s/it]
 29%|██▉       | 11003/37963 [34:15:30<137:00:20, 18.29s/it]
 29%|██▉       | 11004/37963 [34:15:40<118:43:28, 15.85s/it]
 29%|██▉       | 11005/37963 [34:15:50<105:18:51, 14.06s/it]
 29%|██▉       | 11006/37963 [34:16:00<96:26:53, 12.88s/it] 
 29%|██▉       | 11007/37963 [34:16:10<90:27:42, 12.08s/it]
 29%|██▉       | 11008/37963 [34:16:27<100:44:26, 13.45s/it]
 29%|██▉       | 11009/37963 [34:16:37<92:38:31, 12.37s/it] 
 29%|██▉       | 11010/37963 [34:16:47<87:46:43, 11.72s/it]
                                                           
{'loss': '0.1577', 'grad_norm': '1.201', 'learning_rate': '1.666e-05', 'epoch': '0.29'}

 29%|██▉       | 11010/37963 [34:16:47<87:46:43, 11.72s/it]
 29%|██▉       | 11011/37963 [34:16:57<83:44:18, 11.19s/it]
 29%|██▉       | 11012/37963 [34:17:14<97:02:03, 12.96s/it]
 29%|██▉       | 11013/37963 [34:17:24<90:33:03, 12.10s/it]
 29%|██▉       | 11014/37963 [34:17:34<86:02:09, 11.49s/it]
 29%|██▉       | 11015/37963 [34:17:44<82:57:09, 11.08s/it]
 29%|██▉       | 11016/37963 [34:17:54<80:40:00, 10.78s/it]
 29%|██▉       | 11017/37963 [34:18:11<92:48:02, 12.40s/it]
 29%|██▉       | 11018/37963 [34:18:21<87:51:04, 11.74s/it]
 29%|██▉       | 11019/37963 [34:18:31<84:37:45, 11.31s/it]
 29%|██▉       | 11020/37963 [34:18:41<81:32:28, 10.90s/it]
                                                           
{'loss': '0.1709', 'grad_norm': '1.241', 'learning_rate': '1.665e-05', 'epoch': '0.2903'}

 29%|██▉       | 11020/37963 [34:18:41<81:32:28, 10.90s/it]
 29%|██▉       | 11021/37963 [34:18:51<79:25:03, 10.61s/it]
 29%|██▉       | 11022/37963 [34:19:01<77:19:45, 10.33s/it]
 29%|██▉       | 11023/37963 [34:19:11<77:00:21, 10.29s/it]
 29%|██▉       | 11024/37963 [34:19:21<76:41:42, 10.25s/it]
 29%|██▉       | 11025/37963 [34:19:31<76:26:00, 10.21s/it]
 29%|██▉       | 11026/37963 [34:19:41<76:14:58, 10.19s/it]
 29%|██▉       | 11027/37963 [34:19:51<75:59:21, 10.16s/it]
 29%|██▉       | 11028/37963 [34:20:07<89:31:28, 11.97s/it]
 29%|██▉       | 11029/37963 [34:20:18<85:21:22, 11.41s/it]
 29%|██▉       | 11030/37963 [34:20:34<95:51:55, 12.81s/it]
                                                           
{'loss': '0.1625', 'grad_norm': '0.802', 'learning_rate': '1.665e-05', 'epoch': '0.2905'}

 29%|██▉       | 11030/37963 [34:20:34<95:51:55, 12.81s/it]
 29%|██▉       | 11031/37963 [34:20:44<89:47:41, 12.00s/it]
 29%|██▉       | 11032/37963 [34:20:54<85:08:13, 11.38s/it]
 29%|██▉       | 11033/37963 [34:21:04<82:28:30, 11.03s/it]
 29%|██▉       | 11034/37963 [34:21:21<96:30:34, 12.90s/it]
 29%|██▉       | 11035/37963 [34:21:31<90:30:58, 12.10s/it]
 29%|██▉       | 11036/37963 [34:21:42<86:09:53, 11.52s/it]
 29%|██▉       | 11037/37963 [34:21:52<83:02:34, 11.10s/it]
 29%|██▉       | 11038/37963 [34:22:02<80:39:45, 10.78s/it]
 29%|██▉       | 11039/37963 [34:22:12<78:58:39, 10.56s/it]
 29%|██▉       | 11040/37963 [34:22:22<77:50:44, 10.41s/it]
                                                           
{'loss': '0.1766', 'grad_norm': '2.515', 'learning_rate': '1.664e-05', 'epoch': '0.2908'}

 29%|██▉       | 11040/37963 [34:22:22<77:50:44, 10.41s/it]
 29%|██▉       | 11041/37963 [34:22:32<77:09:17, 10.32s/it]
 29%|██▉       | 11042/37963 [34:22:48<90:27:01, 12.10s/it]
 29%|██▉       | 11043/37963 [34:22:58<85:51:08, 11.48s/it]
 29%|██▉       | 11044/37963 [34:23:08<83:04:11, 11.11s/it]
 29%|██▉       | 11045/37963 [34:23:18<80:15:26, 10.73s/it]
 29%|██▉       | 11046/37963 [34:23:28<77:35:56, 10.38s/it]
 29%|██▉       | 11047/37963 [34:23:45<91:47:15, 12.28s/it]
 29%|██▉       | 11048/37963 [34:23:55<86:58:25, 11.63s/it]
 29%|██▉       | 11049/37963 [34:24:05<83:30:26, 11.17s/it]
 29%|██▉       | 11050/37963 [34:24:15<80:31:04, 10.77s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '3.794', 'learning_rate': '1.663e-05', 'epoch': '0.2911'}

 29%|██▉       | 11050/37963 [34:24:15<80:31:04, 10.77s/it]
 29%|██▉       | 11051/37963 [34:24:24<78:14:53, 10.47s/it]
 29%|██▉       | 11052/37963 [34:24:35<77:26:35, 10.36s/it]
 29%|██▉       | 11053/37963 [34:24:45<76:50:54, 10.28s/it]
 29%|██▉       | 11054/37963 [34:24:55<76:22:41, 10.22s/it]
 29%|██▉       | 11055/37963 [34:25:11<90:17:34, 12.08s/it]
 29%|██▉       | 11056/37963 [34:25:21<85:52:21, 11.49s/it]
 29%|██▉       | 11057/37963 [34:25:31<82:42:51, 11.07s/it]
 29%|██▉       | 11058/37963 [34:25:41<80:22:17, 10.75s/it]
 29%|██▉       | 11059/37963 [34:25:51<78:52:31, 10.55s/it]
 29%|██▉       | 11060/37963 [34:26:02<77:56:22, 10.43s/it]
                                                           
{'loss': '0.1713', 'grad_norm': '2.931', 'learning_rate': '1.663e-05', 'epoch': '0.2913'}

 29%|██▉       | 11060/37963 [34:26:02<77:56:22, 10.43s/it]
 29%|██▉       | 11061/37963 [34:26:19<93:07:00, 12.46s/it]
 29%|██▉       | 11062/37963 [34:26:29<87:28:11, 11.71s/it]
 29%|██▉       | 11063/37963 [34:26:39<83:41:00, 11.20s/it]
 29%|██▉       | 11064/37963 [34:26:55<95:15:12, 12.75s/it]
 29%|██▉       | 11065/37963 [34:27:05<88:24:17, 11.83s/it]
 29%|██▉       | 11066/37963 [34:27:15<84:25:11, 11.30s/it]
 29%|██▉       | 11067/37963 [34:27:25<81:45:23, 10.94s/it]
 29%|██▉       | 11068/37963 [34:27:35<79:34:32, 10.65s/it]
 29%|██▉       | 11069/37963 [34:27:45<78:37:00, 10.52s/it]
 29%|██▉       | 11070/37963 [34:27:55<77:35:22, 10.39s/it]
                                                           
{'loss': '0.1765', 'grad_norm': '1.421', 'learning_rate': '1.662e-05', 'epoch': '0.2916'}

 29%|██▉       | 11070/37963 [34:27:55<77:35:22, 10.39s/it]
 29%|██▉       | 11071/37963 [34:28:05<76:04:06, 10.18s/it]
 29%|██▉       | 11072/37963 [34:28:15<75:23:12, 10.09s/it]
 29%|██▉       | 11073/37963 [34:28:25<75:15:37, 10.08s/it]
 29%|██▉       | 11074/37963 [34:28:35<75:16:48, 10.08s/it]
 29%|██▉       | 11075/37963 [34:28:51<88:40:09, 11.87s/it]
 29%|██▉       | 11076/37963 [34:29:01<83:42:50, 11.21s/it]
 29%|██▉       | 11077/37963 [34:29:11<81:27:11, 10.91s/it]
 29%|██▉       | 11078/37963 [34:29:27<94:19:46, 12.63s/it]
 29%|██▉       | 11079/37963 [34:29:37<88:14:34, 11.82s/it]
 29%|██▉       | 11080/37963 [34:29:47<84:09:09, 11.27s/it]
                                                           
{'loss': '0.1743', 'grad_norm': '2.512', 'learning_rate': '1.661e-05', 'epoch': '0.2919'}

 29%|██▉       | 11080/37963 [34:29:47<84:09:09, 11.27s/it]
 29%|██▉       | 11081/37963 [34:29:57<81:03:05, 10.85s/it]
 29%|██▉       | 11082/37963 [34:30:14<94:59:35, 12.72s/it]
 29%|██▉       | 11083/37963 [34:30:25<89:13:57, 11.95s/it]
 29%|██▉       | 11084/37963 [34:30:34<84:41:23, 11.34s/it]
 29%|██▉       | 11085/37963 [34:30:44<80:47:56, 10.82s/it]
 29%|██▉       | 11086/37963 [34:30:54<78:27:35, 10.51s/it]
 29%|██▉       | 11087/37963 [34:31:04<77:19:06, 10.36s/it]
 29%|██▉       | 11088/37963 [34:31:20<91:11:10, 12.21s/it]
 29%|██▉       | 11089/37963 [34:31:30<86:22:45, 11.57s/it]
 29%|██▉       | 11090/37963 [34:31:41<83:04:13, 11.13s/it]
                                                           
{'loss': '0.1595', 'grad_norm': '3.21', 'learning_rate': '1.661e-05', 'epoch': '0.2921'}

 29%|██▉       | 11090/37963 [34:31:41<83:04:13, 11.13s/it]
 29%|██▉       | 11091/37963 [34:31:51<80:41:03, 10.81s/it]
 29%|██▉       | 11092/37963 [34:32:01<78:57:17, 10.58s/it]
 29%|██▉       | 11093/37963 [34:32:11<77:22:51, 10.37s/it]
 29%|██▉       | 11094/37963 [34:32:27<91:15:42, 12.23s/it]
 29%|██▉       | 11095/37963 [34:32:37<86:14:42, 11.56s/it]
 29%|██▉       | 11096/37963 [34:32:47<83:07:05, 11.14s/it]
 29%|██▉       | 11097/37963 [34:32:57<81:03:13, 10.86s/it]
 29%|██▉       | 11098/37963 [34:33:07<79:01:34, 10.59s/it]
 29%|██▉       | 11099/37963 [34:33:18<78:07:42, 10.47s/it]
 29%|██▉       | 11100/37963 [34:33:28<77:20:29, 10.36s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '2.397', 'learning_rate': '1.66e-05', 'epoch': '0.2924'}

 29%|██▉       | 11100/37963 [34:33:28<77:20:29, 10.36s/it]
 29%|██▉       | 11101/37963 [34:33:38<76:37:44, 10.27s/it]
 29%|██▉       | 11102/37963 [34:33:48<76:26:06, 10.24s/it]
 29%|██▉       | 11103/37963 [34:34:04<89:33:13, 12.00s/it]
 29%|██▉       | 11104/37963 [34:34:14<85:09:09, 11.41s/it]
 29%|██▉       | 11105/37963 [34:34:24<81:51:08, 10.97s/it]
 29%|██▉       | 11106/37963 [34:34:34<79:34:20, 10.67s/it]
 29%|██▉       | 11107/37963 [34:34:44<78:09:01, 10.48s/it]
 29%|██▉       | 11108/37963 [34:35:01<93:37:40, 12.55s/it]
 29%|██▉       | 11109/37963 [34:35:11<87:49:39, 11.77s/it]
 29%|██▉       | 11110/37963 [34:35:21<83:55:58, 11.25s/it]
                                                           
{'loss': '0.1676', 'grad_norm': '1.011', 'learning_rate': '1.66e-05', 'epoch': '0.2927'}

 29%|██▉       | 11110/37963 [34:35:21<83:55:58, 11.25s/it]
 29%|██▉       | 11111/37963 [34:35:31<81:17:24, 10.90s/it]
 29%|██▉       | 11112/37963 [34:35:41<79:10:29, 10.62s/it]
 29%|██▉       | 11113/37963 [34:35:57<91:11:56, 12.23s/it]
 29%|██▉       | 11114/37963 [34:36:08<86:39:03, 11.62s/it]
 29%|██▉       | 11115/37963 [34:36:17<81:50:14, 10.97s/it]
 29%|██▉       | 11116/37963 [34:36:27<79:55:53, 10.72s/it]
 29%|██▉       | 11117/37963 [34:36:37<78:26:08, 10.52s/it]
 29%|██▉       | 11118/37963 [34:36:47<77:25:31, 10.38s/it]
 29%|██▉       | 11119/37963 [34:36:57<76:33:00, 10.27s/it]
 29%|██▉       | 11120/37963 [34:37:07<76:11:21, 10.22s/it]
                                                           
{'loss': '0.1748', 'grad_norm': '1.048', 'learning_rate': '1.659e-05', 'epoch': '0.2929'}

 29%|██▉       | 11120/37963 [34:37:07<76:11:21, 10.22s/it]
 29%|██▉       | 11121/37963 [34:37:17<74:52:54, 10.04s/it]
 29%|██▉       | 11122/37963 [34:37:27<74:56:44, 10.05s/it]
 29%|██▉       | 11123/37963 [34:37:37<74:06:08,  9.94s/it]
 29%|██▉       | 11124/37963 [34:37:53<88:45:48, 11.91s/it]
 29%|██▉       | 11125/37963 [34:38:03<84:25:14, 11.32s/it]
 29%|██▉       | 11126/37963 [34:38:13<81:48:12, 10.97s/it]
 29%|██▉       | 11127/37963 [34:38:30<94:17:06, 12.65s/it]
 29%|██▉       | 11128/37963 [34:38:40<88:39:38, 11.89s/it]
 29%|██▉       | 11129/37963 [34:38:57<100:16:21, 13.45s/it]
 29%|██▉       | 11130/37963 [34:39:07<92:56:28, 12.47s/it] 
                                                           
{'loss': '0.1631', 'grad_norm': '2.952', 'learning_rate': '1.658e-05', 'epoch': '0.2932'}

 29%|██▉       | 11130/37963 [34:39:07<92:56:28, 12.47s/it]
 29%|██▉       | 11131/37963 [34:39:17<87:00:34, 11.67s/it]
 29%|██▉       | 11132/37963 [34:39:27<83:28:58, 11.20s/it]
 29%|██▉       | 11133/37963 [34:39:37<81:07:00, 10.88s/it]
 29%|██▉       | 11134/37963 [34:39:47<77:59:20, 10.46s/it]
 29%|██▉       | 11135/37963 [34:39:57<77:12:57, 10.36s/it]
 29%|██▉       | 11136/37963 [34:40:14<91:06:40, 12.23s/it]
 29%|██▉       | 11137/37963 [34:40:24<86:17:04, 11.58s/it]
 29%|██▉       | 11138/37963 [34:40:34<83:01:06, 11.14s/it]
 29%|██▉       | 11139/37963 [34:40:44<80:59:34, 10.87s/it]
 29%|██▉       | 11140/37963 [34:40:54<79:16:58, 10.64s/it]
                                                           
{'loss': '0.1702', 'grad_norm': '1.885', 'learning_rate': '1.658e-05', 'epoch': '0.2934'}

 29%|██▉       | 11140/37963 [34:40:54<79:16:58, 10.64s/it]
 29%|██▉       | 11141/37963 [34:41:04<78:03:29, 10.48s/it]
 29%|██▉       | 11142/37963 [34:41:21<91:58:10, 12.34s/it]
 29%|██▉       | 11143/37963 [34:41:31<86:40:16, 11.63s/it]
 29%|██▉       | 11144/37963 [34:41:41<82:58:18, 11.14s/it]
 29%|██▉       | 11145/37963 [34:41:51<80:24:23, 10.79s/it]
 29%|██▉       | 11146/37963 [34:42:01<78:44:39, 10.57s/it]
 29%|██▉       | 11147/37963 [34:42:11<77:33:06, 10.41s/it]
 29%|██▉       | 11148/37963 [34:42:21<76:48:29, 10.31s/it]
 29%|██▉       | 11149/37963 [34:42:31<76:15:59, 10.24s/it]
 29%|██▉       | 11150/37963 [34:42:41<76:17:35, 10.24s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '1.89', 'learning_rate': '1.657e-05', 'epoch': '0.2937'}

 29%|██▉       | 11150/37963 [34:42:41<76:17:35, 10.24s/it]
 29%|██▉       | 11151/37963 [34:42:52<76:19:09, 10.25s/it]
 29%|██▉       | 11152/37963 [34:43:02<75:55:32, 10.19s/it]
 29%|██▉       | 11153/37963 [34:43:18<89:39:21, 12.04s/it]
 29%|██▉       | 11154/37963 [34:43:28<85:28:20, 11.48s/it]
 29%|██▉       | 11155/37963 [34:43:45<97:10:02, 13.05s/it]
 29%|██▉       | 11156/37963 [34:43:55<90:18:28, 12.13s/it]
 29%|██▉       | 11157/37963 [34:44:05<86:03:16, 11.56s/it]
 29%|██▉       | 11158/37963 [34:44:15<82:24:41, 11.07s/it]
 29%|██▉       | 11159/37963 [34:44:25<80:06:21, 10.76s/it]
 29%|██▉       | 11160/37963 [34:44:35<78:49:57, 10.59s/it]
                                                           
{'loss': '0.1652', 'grad_norm': '1.863', 'learning_rate': '1.656e-05', 'epoch': '0.294'}

 29%|██▉       | 11160/37963 [34:44:35<78:49:57, 10.59s/it]
 29%|██▉       | 11161/37963 [34:44:45<77:39:55, 10.43s/it]
 29%|██▉       | 11162/37963 [34:45:01<90:07:19, 12.11s/it]
 29%|██▉       | 11163/37963 [34:45:12<85:51:06, 11.53s/it]
 29%|██▉       | 11164/37963 [34:45:22<82:39:47, 11.10s/it]
 29%|██▉       | 11165/37963 [34:45:31<79:20:44, 10.66s/it]
 29%|██▉       | 11166/37963 [34:45:41<77:52:53, 10.46s/it]
 29%|██▉       | 11167/37963 [34:45:52<77:33:56, 10.42s/it]
 29%|██▉       | 11168/37963 [34:46:02<76:51:54, 10.33s/it]
 29%|██▉       | 11169/37963 [34:46:12<76:30:52, 10.28s/it]
 29%|██▉       | 11170/37963 [34:46:22<76:00:50, 10.21s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '3.285', 'learning_rate': '1.656e-05', 'epoch': '0.2942'}

 29%|██▉       | 11170/37963 [34:46:22<76:00:50, 10.21s/it]
 29%|██▉       | 11171/37963 [34:46:32<75:26:10, 10.14s/it]
 29%|██▉       | 11172/37963 [34:46:42<74:52:52, 10.06s/it]
 29%|██▉       | 11173/37963 [34:46:59<89:51:28, 12.07s/it]
 29%|██▉       | 11174/37963 [34:47:16<100:43:06, 13.53s/it]
 29%|██▉       | 11175/37963 [34:47:26<93:04:53, 12.51s/it] 
 29%|██▉       | 11176/37963 [34:47:36<87:43:24, 11.79s/it]
 29%|██▉       | 11177/37963 [34:47:53<98:57:35, 13.30s/it]
 29%|██▉       | 11178/37963 [34:48:03<91:56:19, 12.36s/it]
 29%|██▉       | 11179/37963 [34:48:13<86:54:25, 11.68s/it]
 29%|██▉       | 11180/37963 [34:48:23<83:22:48, 11.21s/it]
                                                           
{'loss': '0.1727', 'grad_norm': '2.738', 'learning_rate': '1.655e-05', 'epoch': '0.2945'}

 29%|██▉       | 11180/37963 [34:48:23<83:22:48, 11.21s/it]
 29%|██▉       | 11181/37963 [34:48:33<80:56:18, 10.88s/it]
 29%|██▉       | 11182/37963 [34:48:43<78:23:59, 10.54s/it]
 29%|██▉       | 11183/37963 [34:48:53<77:36:55, 10.43s/it]
 29%|██▉       | 11184/37963 [34:49:03<76:43:46, 10.32s/it]
 29%|██▉       | 11185/37963 [34:49:13<76:27:22, 10.28s/it]
 29%|██▉       | 11186/37963 [34:49:30<90:26:28, 12.16s/it]
 29%|██▉       | 11187/37963 [34:49:40<85:12:41, 11.46s/it]
 29%|██▉       | 11188/37963 [34:49:49<81:37:22, 10.97s/it]
 29%|██▉       | 11189/37963 [34:50:06<93:59:56, 12.64s/it]
 29%|██▉       | 11190/37963 [34:50:16<88:31:26, 11.90s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '3.257', 'learning_rate': '1.654e-05', 'epoch': '0.2948'}

 29%|██▉       | 11190/37963 [34:50:16<88:31:26, 11.90s/it]
 29%|██▉       | 11191/37963 [34:50:26<83:46:32, 11.27s/it]
 29%|██▉       | 11192/37963 [34:50:36<81:12:59, 10.92s/it]
 29%|██▉       | 11193/37963 [34:50:46<78:59:01, 10.62s/it]
 29%|██▉       | 11194/37963 [34:50:56<77:50:48, 10.47s/it]
 29%|██▉       | 11195/37963 [34:51:06<77:11:37, 10.38s/it]
 29%|██▉       | 11196/37963 [34:51:16<75:53:26, 10.21s/it]
 29%|██▉       | 11197/37963 [34:51:26<75:28:11, 10.15s/it]
 29%|██▉       | 11198/37963 [34:51:36<74:16:03,  9.99s/it]
 29%|██▉       | 11199/37963 [34:51:46<73:54:11,  9.94s/it]
 30%|██▉       | 11200/37963 [34:51:56<74:18:46, 10.00s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '1.265', 'learning_rate': '1.654e-05', 'epoch': '0.295'}

 30%|██▉       | 11200/37963 [34:51:56<74:18:46, 10.00s/it]
 30%|██▉       | 11201/37963 [34:52:06<74:33:47, 10.03s/it]
 30%|██▉       | 11202/37963 [34:52:23<89:43:13, 12.07s/it]
 30%|██▉       | 11203/37963 [34:52:33<85:14:46, 11.47s/it]
 30%|██▉       | 11204/37963 [34:52:43<82:12:25, 11.06s/it]
 30%|██▉       | 11205/37963 [34:53:00<95:10:02, 12.80s/it]
 30%|██▉       | 11206/37963 [34:53:10<89:11:29, 12.00s/it]
 30%|██▉       | 11207/37963 [34:53:20<85:04:40, 11.45s/it]
 30%|██▉       | 11208/37963 [34:53:30<82:15:21, 11.07s/it]
 30%|██▉       | 11209/37963 [34:53:40<80:10:11, 10.79s/it]
 30%|██▉       | 11210/37963 [34:53:57<92:40:25, 12.47s/it]
                                                           
{'loss': '0.1653', 'grad_norm': '1.637', 'learning_rate': '1.653e-05', 'epoch': '0.2953'}

 30%|██▉       | 11210/37963 [34:53:57<92:40:25, 12.47s/it]
 30%|██▉       | 11211/37963 [34:54:06<86:03:16, 11.58s/it]
 30%|██▉       | 11212/37963 [34:54:16<82:35:18, 11.11s/it]
 30%|██▉       | 11213/37963 [34:54:26<79:44:28, 10.73s/it]
 30%|██▉       | 11214/37963 [34:54:36<78:13:45, 10.53s/it]
 30%|██▉       | 11215/37963 [34:54:46<76:58:18, 10.36s/it]
 30%|██▉       | 11216/37963 [34:54:56<76:23:36, 10.28s/it]
 30%|██▉       | 11217/37963 [34:55:06<75:44:09, 10.19s/it]
 30%|██▉       | 11218/37963 [34:55:16<75:47:01, 10.20s/it]
 30%|██▉       | 11219/37963 [34:55:26<74:35:37, 10.04s/it]
 30%|██▉       | 11220/37963 [34:55:36<74:43:16, 10.06s/it]
                                                           
{'loss': '0.173', 'grad_norm': '4.036', 'learning_rate': '1.652e-05', 'epoch': '0.2956'}

 30%|██▉       | 11220/37963 [34:55:36<74:43:16, 10.06s/it]
 30%|██▉       | 11221/37963 [34:55:53<89:24:05, 12.04s/it]
 30%|██▉       | 11222/37963 [34:56:10<100:01:27, 13.47s/it]
 30%|██▉       | 11223/37963 [34:56:20<92:24:05, 12.44s/it] 
 30%|██▉       | 11224/37963 [34:56:29<86:32:23, 11.65s/it]
 30%|██▉       | 11225/37963 [34:56:47<98:47:45, 13.30s/it]
 30%|██▉       | 11226/37963 [34:56:57<91:36:50, 12.34s/it]
 30%|██▉       | 11227/37963 [34:57:07<86:38:02, 11.67s/it]
 30%|██▉       | 11228/37963 [34:57:17<82:56:10, 11.17s/it]
 30%|██▉       | 11229/37963 [34:57:27<80:27:08, 10.83s/it]
 30%|██▉       | 11230/37963 [34:57:37<78:43:04, 10.60s/it]
                                                           
{'loss': '0.1775', 'grad_norm': '5.237', 'learning_rate': '1.652e-05', 'epoch': '0.2958'}

 30%|██▉       | 11230/37963 [34:57:37<78:43:04, 10.60s/it]
 30%|██▉       | 11231/37963 [34:57:47<77:23:05, 10.42s/it]
 30%|██▉       | 11232/37963 [34:58:03<90:48:15, 12.23s/it]
 30%|██▉       | 11233/37963 [34:58:13<86:13:01, 11.61s/it]
 30%|██▉       | 11234/37963 [34:58:23<82:35:28, 11.12s/it]
 30%|██▉       | 11235/37963 [34:58:33<80:09:19, 10.80s/it]
 30%|██▉       | 11236/37963 [34:58:44<78:49:54, 10.62s/it]
 30%|██▉       | 11237/37963 [34:58:54<77:39:24, 10.46s/it]
 30%|██▉       | 11238/37963 [34:59:10<90:58:41, 12.26s/it]
 30%|██▉       | 11239/37963 [34:59:20<86:08:25, 11.60s/it]
 30%|██▉       | 11240/37963 [34:59:30<82:41:45, 11.14s/it]
                                                           
{'loss': '0.1768', 'grad_norm': '2.557', 'learning_rate': '1.651e-05', 'epoch': '0.2961'}

 30%|██▉       | 11240/37963 [34:59:30<82:41:45, 11.14s/it]
 30%|██▉       | 11241/37963 [34:59:40<80:24:15, 10.83s/it]
 30%|██▉       | 11242/37963 [34:59:51<79:04:26, 10.65s/it]
 30%|██▉       | 11243/37963 [35:00:01<78:08:56, 10.53s/it]
 30%|██▉       | 11244/37963 [35:00:11<77:11:28, 10.40s/it]
 30%|██▉       | 11245/37963 [35:00:21<76:41:05, 10.33s/it]
 30%|██▉       | 11246/37963 [35:00:31<75:45:58, 10.21s/it]
 30%|██▉       | 11247/37963 [35:00:41<75:25:10, 10.16s/it]
 30%|██▉       | 11248/37963 [35:00:51<75:15:22, 10.14s/it]
 30%|██▉       | 11249/37963 [35:01:01<74:13:40, 10.00s/it]
 30%|██▉       | 11250/37963 [35:01:11<74:23:09, 10.02s/it]
                                                           
{'loss': '0.1669', 'grad_norm': '3.547', 'learning_rate': '1.651e-05', 'epoch': '0.2963'}

 30%|██▉       | 11250/37963 [35:01:11<74:23:09, 10.02s/it]
 30%|██▉       | 11251/37963 [35:01:34<103:27:40, 13.94s/it]
 30%|██▉       | 11252/37963 [35:01:44<94:59:35, 12.80s/it] 
 30%|██▉       | 11253/37963 [35:01:54<89:00:35, 12.00s/it]
 30%|██▉       | 11254/37963 [35:02:04<84:44:34, 11.42s/it]
 30%|██▉       | 11255/37963 [35:02:15<81:47:18, 11.02s/it]
 30%|██▉       | 11256/37963 [35:02:25<79:48:19, 10.76s/it]
 30%|██▉       | 11257/37963 [35:02:41<92:39:16, 12.49s/it]
 30%|██▉       | 11258/37963 [35:02:51<87:10:26, 11.75s/it]
 30%|██▉       | 11259/37963 [35:03:01<83:31:44, 11.26s/it]
 30%|██▉       | 11260/37963 [35:03:12<81:04:45, 10.93s/it]
                                                           
{'loss': '0.1687', 'grad_norm': '2.484', 'learning_rate': '1.65e-05', 'epoch': '0.2966'}

 30%|██▉       | 11260/37963 [35:03:12<81:04:45, 10.93s/it]
 30%|██▉       | 11261/37963 [35:03:22<79:12:33, 10.68s/it]
 30%|██▉       | 11262/37963 [35:03:32<77:52:40, 10.50s/it]
 30%|██▉       | 11263/37963 [35:03:42<76:59:25, 10.38s/it]
 30%|██▉       | 11264/37963 [35:03:52<76:24:05, 10.30s/it]
 30%|██▉       | 11265/37963 [35:04:02<76:03:17, 10.26s/it]
 30%|██▉       | 11266/37963 [35:04:12<75:48:43, 10.22s/it]
 30%|██▉       | 11267/37963 [35:04:22<75:11:51, 10.14s/it]
 30%|██▉       | 11268/37963 [35:04:32<75:00:55, 10.12s/it]
 30%|██▉       | 11269/37963 [35:04:43<75:35:45, 10.20s/it]
 30%|██▉       | 11270/37963 [35:04:59<89:02:30, 12.01s/it]
                                                           
{'loss': '0.167', 'grad_norm': '1.82', 'learning_rate': '1.649e-05', 'epoch': '0.2969'}

 30%|██▉       | 11270/37963 [35:04:59<89:02:30, 12.01s/it]
 30%|██▉       | 11271/37963 [35:05:15<99:05:27, 13.36s/it]
 30%|██▉       | 11272/37963 [35:05:32<105:59:37, 14.30s/it]
 30%|██▉       | 11273/37963 [35:05:42<96:46:18, 13.05s/it] 
 30%|██▉       | 11274/37963 [35:05:52<90:22:35, 12.19s/it]
 30%|██▉       | 11275/37963 [35:06:02<84:58:55, 11.46s/it]
 30%|██▉       | 11276/37963 [35:06:12<82:00:14, 11.06s/it]
 30%|██▉       | 11277/37963 [35:06:22<79:44:35, 10.76s/it]
 30%|██▉       | 11278/37963 [35:06:32<78:26:21, 10.58s/it]
 30%|██▉       | 11279/37963 [35:06:42<77:28:17, 10.45s/it]
 30%|██▉       | 11280/37963 [35:06:59<91:55:33, 12.40s/it]
                                                           
{'loss': '0.164', 'grad_norm': '1.399', 'learning_rate': '1.649e-05', 'epoch': '0.2971'}

 30%|██▉       | 11280/37963 [35:06:59<91:55:33, 12.40s/it]
 30%|██▉       | 11281/37963 [35:07:10<86:52:18, 11.72s/it]
 30%|██▉       | 11282/37963 [35:07:19<82:53:59, 11.19s/it]
 30%|██▉       | 11283/37963 [35:07:30<80:33:43, 10.87s/it]
 30%|██▉       | 11284/37963 [35:07:40<78:57:51, 10.66s/it]
 30%|██▉       | 11285/37963 [35:07:56<90:54:59, 12.27s/it]
 30%|██▉       | 11286/37963 [35:08:06<86:10:39, 11.63s/it]
 30%|██▉       | 11287/37963 [35:08:16<82:54:19, 11.19s/it]
 30%|██▉       | 11288/37963 [35:08:26<80:24:27, 10.85s/it]
 30%|██▉       | 11289/37963 [35:08:36<78:39:04, 10.61s/it]
 30%|██▉       | 11290/37963 [35:08:46<77:27:54, 10.46s/it]
                                                           
{'loss': '0.1761', 'grad_norm': '0.6029', 'learning_rate': '1.648e-05', 'epoch': '0.2974'}

 30%|██▉       | 11290/37963 [35:08:46<77:27:54, 10.46s/it]
 30%|██▉       | 11291/37963 [35:08:56<76:23:32, 10.31s/it]
 30%|██▉       | 11292/37963 [35:09:06<75:20:51, 10.17s/it]
 30%|██▉       | 11293/37963 [35:09:16<74:03:24, 10.00s/it]
 30%|██▉       | 11294/37963 [35:09:26<73:38:10,  9.94s/it]
 30%|██▉       | 11295/37963 [35:09:36<74:19:20, 10.03s/it]
 30%|██▉       | 11296/37963 [35:09:46<74:31:22, 10.06s/it]
 30%|██▉       | 11297/37963 [35:09:56<74:04:19, 10.00s/it]
 30%|██▉       | 11298/37963 [35:10:12<88:40:25, 11.97s/it]
 30%|██▉       | 11299/37963 [35:10:29<99:46:46, 13.47s/it]
 30%|██▉       | 11300/37963 [35:10:39<92:00:35, 12.42s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '1.396', 'learning_rate': '1.647e-05', 'epoch': '0.2977'}

 30%|██▉       | 11300/37963 [35:10:39<92:00:35, 12.42s/it]
 30%|██▉       | 11301/37963 [35:10:49<86:45:49, 11.72s/it]
 30%|██▉       | 11302/37963 [35:10:59<83:13:03, 11.24s/it]
 30%|██▉       | 11303/37963 [35:11:09<79:44:05, 10.77s/it]
 30%|██▉       | 11304/37963 [35:11:19<77:42:50, 10.49s/it]
 30%|██▉       | 11305/37963 [35:11:29<76:45:25, 10.37s/it]
 30%|██▉       | 11306/37963 [35:11:45<89:52:14, 12.14s/it]
 30%|██▉       | 11307/37963 [35:11:55<85:15:16, 11.51s/it]
 30%|██▉       | 11308/37963 [35:12:05<82:07:24, 11.09s/it]
 30%|██▉       | 11309/37963 [35:12:16<79:48:30, 10.78s/it]
 30%|██▉       | 11310/37963 [35:12:26<78:27:10, 10.60s/it]
                                                           
{'loss': '0.1726', 'grad_norm': '3.409', 'learning_rate': '1.647e-05', 'epoch': '0.2979'}

 30%|██▉       | 11310/37963 [35:12:26<78:27:10, 10.60s/it]
 30%|██▉       | 11311/37963 [35:12:35<76:34:56, 10.34s/it]
 30%|██▉       | 11312/37963 [35:12:46<76:18:46, 10.31s/it]
 30%|██▉       | 11313/37963 [35:12:56<75:58:34, 10.26s/it]
 30%|██▉       | 11314/37963 [35:13:06<75:49:02, 10.24s/it]
 30%|██▉       | 11315/37963 [35:13:16<75:37:10, 10.22s/it]
 30%|██▉       | 11316/37963 [35:13:26<75:31:36, 10.20s/it]
 30%|██▉       | 11317/37963 [35:13:36<75:20:41, 10.18s/it]
 30%|██▉       | 11318/37963 [35:13:47<75:13:11, 10.16s/it]
 30%|██▉       | 11319/37963 [35:14:03<88:50:10, 12.00s/it]
 30%|██▉       | 11320/37963 [35:14:26<113:47:05, 15.37s/it]
                                                            
{'loss': '0.1745', 'grad_norm': '1.579', 'learning_rate': '1.646e-05', 'epoch': '0.2982'}

 30%|██▉       | 11320/37963 [35:14:26<113:47:05, 15.37s/it]
 30%|██▉       | 11321/37963 [35:14:36<101:38:54, 13.74s/it]
 30%|██▉       | 11322/37963 [35:14:46<93:32:00, 12.64s/it] 
 30%|██▉       | 11323/37963 [35:14:56<88:03:16, 11.90s/it]
 30%|██▉       | 11324/37963 [35:15:06<83:54:33, 11.34s/it]
 30%|██▉       | 11325/37963 [35:15:16<81:04:06, 10.96s/it]
 30%|██▉       | 11326/37963 [35:15:26<78:57:22, 10.67s/it]
 30%|██▉       | 11327/37963 [35:15:43<91:36:19, 12.38s/it]
 30%|██▉       | 11328/37963 [35:15:53<86:02:22, 11.63s/it]
 30%|██▉       | 11329/37963 [35:16:03<82:37:59, 11.17s/it]
 30%|██▉       | 11330/37963 [35:16:13<80:14:18, 10.85s/it]
                                                           
{'loss': '0.1645', 'grad_norm': '3.121', 'learning_rate': '1.645e-05', 'epoch': '0.2984'}

 30%|██▉       | 11330/37963 [35:16:13<80:14:18, 10.85s/it]
 30%|██▉       | 11331/37963 [35:16:23<78:42:26, 10.64s/it]
 30%|██▉       | 11332/37963 [35:16:33<77:25:32, 10.47s/it]
 30%|██▉       | 11333/37963 [35:16:43<76:44:49, 10.38s/it]
 30%|██▉       | 11334/37963 [35:16:59<89:43:12, 12.13s/it]
 30%|██▉       | 11335/37963 [35:17:10<85:10:52, 11.52s/it]
 30%|██▉       | 11336/37963 [35:17:20<82:16:17, 11.12s/it]
 30%|██▉       | 11337/37963 [35:17:30<79:43:51, 10.78s/it]
 30%|██▉       | 11338/37963 [35:17:40<77:47:17, 10.52s/it]
 30%|██▉       | 11339/37963 [35:17:50<77:11:39, 10.44s/it]
 30%|██▉       | 11340/37963 [35:18:00<76:43:46, 10.38s/it]
                                                           
{'loss': '0.1696', 'grad_norm': '1.314', 'learning_rate': '1.645e-05', 'epoch': '0.2987'}

 30%|██▉       | 11340/37963 [35:18:00<76:43:46, 10.38s/it]
 30%|██▉       | 11341/37963 [35:18:10<76:05:52, 10.29s/it]
 30%|██▉       | 11342/37963 [35:18:20<75:34:51, 10.22s/it]
 30%|██▉       | 11343/37963 [35:18:30<74:03:50, 10.02s/it]
 30%|██▉       | 11344/37963 [35:18:39<73:19:03,  9.92s/it]
 30%|██▉       | 11345/37963 [35:18:50<73:53:55,  9.99s/it]
 30%|██▉       | 11346/37963 [35:19:13<103:09:45, 13.95s/it]
 30%|██▉       | 11347/37963 [35:19:23<93:55:44, 12.70s/it] 
 30%|██▉       | 11348/37963 [35:19:33<88:13:39, 11.93s/it]
 30%|██▉       | 11349/37963 [35:19:43<84:13:54, 11.39s/it]
 30%|██▉       | 11350/37963 [35:19:53<80:55:04, 10.95s/it]
                                                           
{'loss': '0.1667', 'grad_norm': '2.867', 'learning_rate': '1.644e-05', 'epoch': '0.299'}

 30%|██▉       | 11350/37963 [35:19:53<80:55:04, 10.95s/it]
 30%|██▉       | 11351/37963 [35:20:03<79:02:03, 10.69s/it]
 30%|██▉       | 11352/37963 [35:20:13<77:48:16, 10.53s/it]
 30%|██▉       | 11353/37963 [35:20:23<76:48:59, 10.39s/it]
 30%|██▉       | 11354/37963 [35:20:33<75:03:34, 10.16s/it]
 30%|██▉       | 11355/37963 [35:20:49<88:45:39, 12.01s/it]
 30%|██▉       | 11356/37963 [35:20:59<84:38:20, 11.45s/it]
 30%|██▉       | 11357/37963 [35:21:09<81:57:00, 11.09s/it]
 30%|██▉       | 11358/37963 [35:21:20<79:45:08, 10.79s/it]
 30%|██▉       | 11359/37963 [35:21:30<78:03:57, 10.56s/it]
 30%|██▉       | 11360/37963 [35:21:40<77:09:35, 10.44s/it]
                                                           
{'loss': '0.1776', 'grad_norm': '1.068', 'learning_rate': '1.643e-05', 'epoch': '0.2992'}

 30%|██▉       | 11360/37963 [35:21:40<77:09:35, 10.44s/it]
 30%|██▉       | 11361/37963 [35:21:50<76:24:56, 10.34s/it]
 30%|██▉       | 11362/37963 [35:22:00<75:56:16, 10.28s/it]
 30%|██▉       | 11363/37963 [35:22:10<75:42:55, 10.25s/it]
 30%|██▉       | 11364/37963 [35:22:20<75:34:28, 10.23s/it]
 30%|██▉       | 11365/37963 [35:22:30<75:23:25, 10.20s/it]
 30%|██▉       | 11366/37963 [35:22:41<74:59:03, 10.15s/it]
 30%|██▉       | 11367/37963 [35:23:03<103:21:16, 13.99s/it]
 30%|██▉       | 11368/37963 [35:23:13<94:18:30, 12.77s/it] 
 30%|██▉       | 11369/37963 [35:23:23<88:28:13, 11.98s/it]
 30%|██▉       | 11370/37963 [35:23:33<83:07:58, 11.25s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '2.85', 'learning_rate': '1.643e-05', 'epoch': '0.2995'}

 30%|██▉       | 11370/37963 [35:23:33<83:07:58, 11.25s/it]
 30%|██▉       | 11371/37963 [35:23:43<80:35:23, 10.91s/it]
 30%|██▉       | 11372/37963 [35:23:53<78:58:58, 10.69s/it]
 30%|██▉       | 11373/37963 [35:24:04<77:55:31, 10.55s/it]
 30%|██▉       | 11374/37963 [35:24:14<77:06:55, 10.44s/it]
 30%|██▉       | 11375/37963 [35:24:30<90:49:55, 12.30s/it]
 30%|██▉       | 11376/37963 [35:24:40<85:39:35, 11.60s/it]
 30%|██▉       | 11377/37963 [35:24:51<82:41:31, 11.20s/it]
 30%|██▉       | 11378/37963 [35:25:00<79:18:29, 10.74s/it]
 30%|██▉       | 11379/37963 [35:25:10<78:00:29, 10.56s/it]
 30%|██▉       | 11380/37963 [35:25:21<76:52:54, 10.41s/it]
                                                           
{'loss': '0.154', 'grad_norm': '1.702', 'learning_rate': '1.642e-05', 'epoch': '0.2998'}

 30%|██▉       | 11380/37963 [35:25:21<76:52:54, 10.41s/it]
 30%|██▉       | 11381/37963 [35:25:30<75:54:56, 10.28s/it]
 30%|██▉       | 11382/37963 [35:25:40<74:31:33, 10.09s/it]
 30%|██▉       | 11383/37963 [35:25:57<88:46:50, 12.02s/it]
 30%|██▉       | 11384/37963 [35:26:07<84:23:03, 11.43s/it]
 30%|██▉       | 11385/37963 [35:26:17<81:07:46, 10.99s/it]
 30%|██▉       | 11386/37963 [35:26:27<79:07:17, 10.72s/it]
 30%|██▉       | 11387/37963 [35:26:37<77:53:52, 10.55s/it]
 30%|██▉       | 11388/37963 [35:26:47<76:30:16, 10.36s/it]
 30%|███       | 11389/37963 [35:26:57<75:56:01, 10.29s/it]
 30%|███       | 11390/37963 [35:27:07<75:08:35, 10.18s/it]
                                                           
{'loss': '0.1556', 'grad_norm': '1.124', 'learning_rate': '1.641e-05', 'epoch': '0.3'}

 30%|███       | 11390/37963 [35:27:07<75:08:35, 10.18s/it]
 30%|███       | 11391/37963 [35:27:17<74:49:54, 10.14s/it]
 30%|███       | 11392/37963 [35:27:27<74:37:39, 10.11s/it]
 30%|███       | 11393/37963 [35:27:37<74:53:02, 10.15s/it]
 30%|███       | 11394/37963 [35:27:47<74:38:28, 10.11s/it]
 30%|███       | 11395/37963 [35:28:10<103:37:36, 14.04s/it]
 30%|███       | 11396/37963 [35:28:21<95:24:24, 12.93s/it] 
 30%|███       | 11397/37963 [35:28:31<89:05:25, 12.07s/it]
 30%|███       | 11398/37963 [35:28:41<84:54:09, 11.51s/it]
 30%|███       | 11399/37963 [35:28:51<81:40:20, 11.07s/it]
 30%|███       | 11400/37963 [35:29:01<79:23:13, 10.76s/it]
                                                           
{'loss': '0.1633', 'grad_norm': '1.666', 'learning_rate': '1.641e-05', 'epoch': '0.3003'}

 30%|███       | 11400/37963 [35:29:01<79:23:13, 10.76s/it]
 30%|███       | 11401/37963 [35:29:11<77:53:17, 10.56s/it]
 30%|███       | 11402/37963 [35:29:21<76:54:24, 10.42s/it]
 30%|███       | 11403/37963 [35:29:31<75:58:53, 10.30s/it]
 30%|███       | 11404/37963 [35:29:41<75:19:07, 10.21s/it]
 30%|███       | 11405/37963 [35:29:51<75:10:00, 10.19s/it]
 30%|███       | 11406/37963 [35:30:08<88:38:43, 12.02s/it]
 30%|███       | 11407/37963 [35:30:17<83:26:51, 11.31s/it]
 30%|███       | 11408/37963 [35:30:27<80:33:10, 10.92s/it]
 30%|███       | 11409/37963 [35:30:37<78:23:16, 10.63s/it]
 30%|███       | 11410/37963 [35:30:47<76:58:05, 10.44s/it]
                                                           
{'loss': '0.1685', 'grad_norm': '0.8648', 'learning_rate': '1.64e-05', 'epoch': '0.3006'}

 30%|███       | 11410/37963 [35:30:47<76:58:05, 10.44s/it]
 30%|███       | 11411/37963 [35:30:58<76:33:51, 10.38s/it]
 30%|███       | 11412/37963 [35:31:08<76:01:31, 10.31s/it]
 30%|███       | 11413/37963 [35:31:18<75:39:54, 10.26s/it]
 30%|███       | 11414/37963 [35:31:28<74:15:33, 10.07s/it]
 30%|███       | 11415/37963 [35:31:38<74:32:31, 10.11s/it]
 30%|███       | 11416/37963 [35:32:08<118:06:04, 16.02s/it]
 30%|███       | 11417/37963 [35:32:18<105:08:48, 14.26s/it]
 30%|███       | 11418/37963 [35:32:28<95:47:24, 12.99s/it] 
 30%|███       | 11419/37963 [35:32:38<89:23:01, 12.12s/it]
 30%|███       | 11420/37963 [35:32:48<85:02:11, 11.53s/it]
                                                           
{'loss': '0.1744', 'grad_norm': '2.338', 'learning_rate': '1.639e-05', 'epoch': '0.3008'}

 30%|███       | 11420/37963 [35:32:48<85:02:11, 11.53s/it]
 30%|███       | 11421/37963 [35:32:58<81:54:47, 11.11s/it]
 30%|███       | 11422/37963 [35:33:08<80:06:09, 10.87s/it]
 30%|███       | 11423/37963 [35:33:25<92:35:26, 12.56s/it]
 30%|███       | 11424/37963 [35:33:35<86:55:10, 11.79s/it]
 30%|███       | 11425/37963 [35:33:45<83:04:49, 11.27s/it]
 30%|███       | 11426/37963 [35:33:55<80:08:39, 10.87s/it]
 30%|███       | 11427/37963 [35:34:05<78:25:01, 10.64s/it]
 30%|███       | 11428/37963 [35:34:15<76:36:37, 10.39s/it]
 30%|███       | 11429/37963 [35:34:25<76:07:43, 10.33s/it]
 30%|███       | 11430/37963 [35:34:41<89:33:42, 12.15s/it]
                                                           
{'loss': '0.162', 'grad_norm': '0.9871', 'learning_rate': '1.639e-05', 'epoch': '0.3011'}

 30%|███       | 11430/37963 [35:34:41<89:33:42, 12.15s/it]
 30%|███       | 11431/37963 [35:34:51<85:02:51, 11.54s/it]
 30%|███       | 11432/37963 [35:35:02<81:49:29, 11.10s/it]
 30%|███       | 11433/37963 [35:35:11<79:09:07, 10.74s/it]
 30%|███       | 11434/37963 [35:35:22<77:46:59, 10.56s/it]
 30%|███       | 11435/37963 [35:35:32<77:03:12, 10.46s/it]
 30%|███       | 11436/37963 [35:35:42<76:19:40, 10.36s/it]
 30%|███       | 11437/37963 [35:35:52<75:49:00, 10.29s/it]
 30%|███       | 11438/37963 [35:36:02<75:04:22, 10.19s/it]
 30%|███       | 11439/37963 [35:36:12<74:53:32, 10.16s/it]
 30%|███       | 11440/37963 [35:36:22<74:35:26, 10.12s/it]
                                                           
{'loss': '0.1708', 'grad_norm': '2.465', 'learning_rate': '1.638e-05', 'epoch': '0.3013'}

 30%|███       | 11440/37963 [35:36:22<74:35:26, 10.12s/it]
 30%|███       | 11441/37963 [35:36:32<74:38:19, 10.13s/it]
 30%|███       | 11442/37963 [35:36:42<74:33:11, 10.12s/it]
 30%|███       | 11443/37963 [35:36:53<74:36:57, 10.13s/it]
 30%|███       | 11444/37963 [35:37:16<103:48:50, 14.09s/it]
 30%|███       | 11445/37963 [35:37:26<95:09:31, 12.92s/it] 
 30%|███       | 11446/37963 [35:37:36<88:56:25, 12.07s/it]
 30%|███       | 11447/37963 [35:37:46<84:34:37, 11.48s/it]
 30%|███       | 11448/37963 [35:37:56<81:28:52, 11.06s/it]
 30%|███       | 11449/37963 [35:38:06<79:04:22, 10.74s/it]
 30%|███       | 11450/37963 [35:38:16<77:31:04, 10.53s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '1.13', 'learning_rate': '1.637e-05', 'epoch': '0.3016'}

 30%|███       | 11450/37963 [35:38:16<77:31:04, 10.53s/it]
 30%|███       | 11451/37963 [35:38:26<76:29:48, 10.39s/it]
 30%|███       | 11452/37963 [35:38:37<75:53:19, 10.31s/it]
 30%|███       | 11453/37963 [35:38:53<88:50:04, 12.06s/it]
 30%|███       | 11454/37963 [35:39:03<84:29:02, 11.47s/it]
 30%|███       | 11455/37963 [35:39:13<81:14:01, 11.03s/it]
 30%|███       | 11456/37963 [35:39:23<78:55:21, 10.72s/it]
 30%|███       | 11457/37963 [35:39:33<76:55:24, 10.45s/it]
 30%|███       | 11458/37963 [35:39:43<76:20:59, 10.37s/it]
 30%|███       | 11459/37963 [35:39:53<75:21:56, 10.24s/it]
 30%|███       | 11460/37963 [35:40:03<75:09:12, 10.21s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '1.042', 'learning_rate': '1.637e-05', 'epoch': '0.3019'}

 30%|███       | 11460/37963 [35:40:03<75:09:12, 10.21s/it]
 30%|███       | 11461/37963 [35:40:13<74:50:42, 10.17s/it]
 30%|███       | 11462/37963 [35:40:29<88:16:24, 11.99s/it]
 30%|███       | 11463/37963 [35:40:45<97:41:20, 13.27s/it]
 30%|███       | 11464/37963 [35:41:02<105:58:40, 14.40s/it]
 30%|███       | 11465/37963 [35:41:13<96:57:23, 13.17s/it] 
 30%|███       | 11466/37963 [35:41:23<90:13:31, 12.26s/it]
 30%|███       | 11467/37963 [35:41:33<85:29:31, 11.62s/it]
 30%|███       | 11468/37963 [35:41:43<81:18:10, 11.05s/it]
 30%|███       | 11469/37963 [35:41:53<79:00:44, 10.74s/it]
 30%|███       | 11470/37963 [35:42:03<77:38:25, 10.55s/it]
                                                           
{'loss': '0.1855', 'grad_norm': '2.823', 'learning_rate': '1.636e-05', 'epoch': '0.3021'}

 30%|███       | 11470/37963 [35:42:03<77:38:25, 10.55s/it]
 30%|███       | 11471/37963 [35:42:13<76:50:07, 10.44s/it]
 30%|███       | 11472/37963 [35:42:23<76:04:06, 10.34s/it]
 30%|███       | 11473/37963 [35:42:40<90:50:15, 12.34s/it]
 30%|███       | 11474/37963 [35:42:50<86:09:18, 11.71s/it]
 30%|███       | 11475/37963 [35:43:00<82:30:16, 11.21s/it]
 30%|███       | 11476/37963 [35:43:11<80:10:00, 10.90s/it]
 30%|███       | 11477/37963 [35:43:21<78:21:09, 10.65s/it]
 30%|███       | 11478/37963 [35:43:37<90:20:02, 12.28s/it]
 30%|███       | 11479/37963 [35:43:47<85:27:25, 11.62s/it]
 30%|███       | 11480/37963 [35:43:57<81:08:00, 11.03s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '4.281', 'learning_rate': '1.635e-05', 'epoch': '0.3024'}

 30%|███       | 11480/37963 [35:43:57<81:08:00, 11.03s/it]
 30%|███       | 11481/37963 [35:44:07<79:11:05, 10.76s/it]
 30%|███       | 11482/37963 [35:44:17<77:59:38, 10.60s/it]
 30%|███       | 11483/37963 [35:44:27<76:07:18, 10.35s/it]
 30%|███       | 11484/37963 [35:44:37<75:35:50, 10.28s/it]
 30%|███       | 11485/37963 [35:44:47<75:29:47, 10.26s/it]
 30%|███       | 11486/37963 [35:44:57<75:21:22, 10.25s/it]
 30%|███       | 11487/37963 [35:45:07<75:08:10, 10.22s/it]
 30%|███       | 11488/37963 [35:45:17<74:39:23, 10.15s/it]
 30%|███       | 11489/37963 [35:45:27<74:37:25, 10.15s/it]
 30%|███       | 11490/37963 [35:45:38<74:24:25, 10.12s/it]
                                                           
{'loss': '0.1644', 'grad_norm': '2.939', 'learning_rate': '1.635e-05', 'epoch': '0.3027'}

 30%|███       | 11490/37963 [35:45:38<74:24:25, 10.12s/it]
 30%|███       | 11491/37963 [35:45:48<74:34:11, 10.14s/it]
 30%|███       | 11492/37963 [35:46:04<88:51:48, 12.09s/it]
 30%|███       | 11493/37963 [35:46:21<99:39:52, 13.55s/it]
 30%|███       | 11494/37963 [35:46:31<91:18:01, 12.42s/it]
 30%|███       | 11495/37963 [35:46:41<85:10:17, 11.58s/it]
 30%|███       | 11496/37963 [35:46:51<81:45:52, 11.12s/it]
 30%|███       | 11497/37963 [35:47:01<79:25:02, 10.80s/it]
 30%|███       | 11498/37963 [35:47:11<77:52:39, 10.59s/it]
 30%|███       | 11499/37963 [35:47:21<76:59:28, 10.47s/it]
 30%|███       | 11500/37963 [35:47:31<75:38:37, 10.29s/it]
                                                           
{'loss': '0.1671', 'grad_norm': '1.82', 'learning_rate': '1.634e-05', 'epoch': '0.3029'}

 30%|███       | 11500/37963 [35:47:31<75:38:37, 10.29s/it]
 30%|███       | 11501/37963 [35:47:47<88:50:36, 12.09s/it]
 30%|███       | 11502/37963 [35:47:57<84:30:41, 11.50s/it]
 30%|███       | 11503/37963 [35:48:07<80:48:11, 10.99s/it]
 30%|███       | 11504/37963 [35:48:17<78:07:18, 10.63s/it]
 30%|███       | 11505/37963 [35:48:27<76:54:46, 10.47s/it]
 30%|███       | 11506/37963 [35:48:37<75:48:04, 10.31s/it]
 30%|███       | 11507/37963 [35:48:47<75:01:55, 10.21s/it]
 30%|███       | 11508/37963 [35:48:57<73:53:09, 10.05s/it]
 30%|███       | 11509/37963 [35:49:07<73:55:54, 10.06s/it]
 30%|███       | 11510/37963 [35:49:17<73:59:01, 10.07s/it]
                                                           
{'loss': '0.1752', 'grad_norm': '2.497', 'learning_rate': '1.634e-05', 'epoch': '0.3032'}

 30%|███       | 11510/37963 [35:49:17<73:59:01, 10.07s/it]
 30%|███       | 11511/37963 [35:49:32<86:06:31, 11.72s/it]
 30%|███       | 11512/37963 [35:49:56<112:19:53, 15.29s/it]
 30%|███       | 11513/37963 [35:50:06<100:49:17, 13.72s/it]
 30%|███       | 11514/37963 [35:50:16<92:30:59, 12.59s/it] 
 30%|███       | 11515/37963 [35:50:26<87:03:39, 11.85s/it]
 30%|███       | 11516/37963 [35:50:36<83:35:32, 11.38s/it]
 30%|███       | 11517/37963 [35:50:46<80:27:24, 10.95s/it]
 30%|███       | 11518/37963 [35:50:56<78:13:07, 10.65s/it]
 30%|███       | 11519/37963 [35:51:06<76:32:44, 10.42s/it]
 30%|███       | 11520/37963 [35:51:16<75:37:51, 10.30s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '4.936', 'learning_rate': '1.633e-05', 'epoch': '0.3035'}

 30%|███       | 11520/37963 [35:51:16<75:37:51, 10.30s/it]
 30%|███       | 11521/37963 [35:51:26<75:02:40, 10.22s/it]
 30%|███       | 11522/37963 [35:51:43<89:19:42, 12.16s/it]
 30%|███       | 11523/37963 [35:51:53<84:23:00, 11.49s/it]
 30%|███       | 11524/37963 [35:52:03<81:10:43, 11.05s/it]
 30%|███       | 11525/37963 [35:52:13<78:56:24, 10.75s/it]
 30%|███       | 11526/37963 [35:52:23<77:36:12, 10.57s/it]
 30%|███       | 11527/37963 [35:52:40<91:17:49, 12.43s/it]
 30%|███       | 11528/37963 [35:52:50<86:04:52, 11.72s/it]
 30%|███       | 11529/37963 [35:53:00<82:35:55, 11.25s/it]
 30%|███       | 11530/37963 [35:53:10<80:02:17, 10.90s/it]
                                                           
{'loss': '0.1552', 'grad_norm': '1.699', 'learning_rate': '1.632e-05', 'epoch': '0.3037'}

 30%|███       | 11530/37963 [35:53:10<80:02:17, 10.90s/it]
 30%|███       | 11531/37963 [35:53:20<78:30:15, 10.69s/it]
 30%|███       | 11532/37963 [35:53:31<77:21:26, 10.54s/it]
 30%|███       | 11533/37963 [35:53:41<77:02:10, 10.49s/it]
 30%|███       | 11534/37963 [35:53:51<76:09:31, 10.37s/it]
 30%|███       | 11535/37963 [35:54:01<74:40:52, 10.17s/it]
 30%|███       | 11536/37963 [35:54:11<74:21:58, 10.13s/it]
 30%|███       | 11537/37963 [35:54:21<74:01:29, 10.08s/it]
 30%|███       | 11538/37963 [35:54:31<73:58:36, 10.08s/it]
 30%|███       | 11539/37963 [35:54:41<74:04:51, 10.09s/it]
 30%|███       | 11540/37963 [35:54:51<74:01:34, 10.09s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '2.491', 'learning_rate': '1.632e-05', 'epoch': '0.304'}

 30%|███       | 11540/37963 [35:54:51<74:01:34, 10.09s/it]
 30%|███       | 11541/37963 [35:55:01<73:12:56,  9.98s/it]
 30%|███       | 11542/37963 [35:55:24<102:56:22, 14.03s/it]
 30%|███       | 11543/37963 [35:55:34<93:30:18, 12.74s/it] 
 30%|███       | 11544/37963 [35:55:44<86:43:33, 11.82s/it]
 30%|███       | 11545/37963 [35:55:54<82:51:12, 11.29s/it]
 30%|███       | 11546/37963 [35:56:04<79:57:16, 10.90s/it]
 30%|███       | 11547/37963 [35:56:13<77:28:32, 10.56s/it]
 30%|███       | 11548/37963 [35:56:23<75:36:25, 10.30s/it]
 30%|███       | 11549/37963 [35:56:33<75:10:41, 10.25s/it]
 30%|███       | 11550/37963 [35:56:43<74:41:31, 10.18s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '1.776', 'learning_rate': '1.631e-05', 'epoch': '0.3042'}

 30%|███       | 11550/37963 [35:56:43<74:41:31, 10.18s/it]
 30%|███       | 11551/37963 [35:57:00<89:12:00, 12.16s/it]
 30%|███       | 11552/37963 [35:57:10<84:51:32, 11.57s/it]
 30%|███       | 11553/37963 [35:57:20<81:06:51, 11.06s/it]
 30%|███       | 11554/37963 [35:57:30<79:01:08, 10.77s/it]
 30%|███       | 11555/37963 [35:57:40<77:34:07, 10.57s/it]
 30%|███       | 11556/37963 [35:57:50<76:08:00, 10.38s/it]
 30%|███       | 11557/37963 [35:58:00<75:41:31, 10.32s/it]
 30%|███       | 11558/37963 [35:58:11<75:26:34, 10.29s/it]
 30%|███       | 11559/37963 [35:58:21<74:59:53, 10.23s/it]
 30%|███       | 11560/37963 [35:58:37<88:52:08, 12.12s/it]
                                                           
{'loss': '0.1824', 'grad_norm': '1.601', 'learning_rate': '1.63e-05', 'epoch': '0.3045'}

 30%|███       | 11560/37963 [35:58:37<88:52:08, 12.12s/it]
 30%|███       | 11561/37963 [35:59:01<114:15:16, 15.58s/it]
 30%|███       | 11562/37963 [35:59:11<102:07:13, 13.92s/it]
 30%|███       | 11563/37963 [35:59:21<93:55:45, 12.81s/it] 
 30%|███       | 11564/37963 [35:59:31<88:01:35, 12.00s/it]
 30%|███       | 11565/37963 [35:59:41<83:46:07, 11.42s/it]
 30%|███       | 11566/37963 [35:59:51<80:11:16, 10.94s/it]
 30%|███       | 11567/37963 [36:00:01<78:15:01, 10.67s/it]
 30%|███       | 11568/37963 [36:00:11<76:40:25, 10.46s/it]
 30%|███       | 11569/37963 [36:00:21<75:42:02, 10.33s/it]
 30%|███       | 11570/37963 [36:00:38<89:25:08, 12.20s/it]
                                                           
{'loss': '0.1751', 'grad_norm': '2.045', 'learning_rate': '1.63e-05', 'epoch': '0.3048'}

 30%|███       | 11570/37963 [36:00:38<89:25:08, 12.20s/it]
 30%|███       | 11571/37963 [36:00:48<84:30:51, 11.53s/it]
 30%|███       | 11572/37963 [36:00:58<81:18:51, 11.09s/it]
 30%|███       | 11573/37963 [36:01:08<78:35:53, 10.72s/it]
 30%|███       | 11574/37963 [36:01:18<77:18:41, 10.55s/it]
 30%|███       | 11575/37963 [36:01:34<90:14:22, 12.31s/it]
 30%|███       | 11576/37963 [36:01:45<85:51:39, 11.71s/it]
 30%|███       | 11577/37963 [36:01:54<81:45:20, 11.15s/it]
 30%|███       | 11578/37963 [36:02:05<79:33:16, 10.85s/it]
 31%|███       | 11579/37963 [36:02:15<77:44:59, 10.61s/it]
 31%|███       | 11580/37963 [36:02:25<76:36:12, 10.45s/it]
                                                           
{'loss': '0.1734', 'grad_norm': '1.175', 'learning_rate': '1.629e-05', 'epoch': '0.305'}

 31%|███       | 11580/37963 [36:02:25<76:36:12, 10.45s/it]
 31%|███       | 11581/37963 [36:02:35<76:00:31, 10.37s/it]
 31%|███       | 11582/37963 [36:02:45<75:25:56, 10.29s/it]
 31%|███       | 11583/37963 [36:02:55<74:20:02, 10.14s/it]
 31%|███       | 11584/37963 [36:03:05<74:09:13, 10.12s/it]
 31%|███       | 11585/37963 [36:03:15<74:09:23, 10.12s/it]
 31%|███       | 11586/37963 [36:03:25<73:58:45, 10.10s/it]
 31%|███       | 11587/37963 [36:03:35<73:02:48,  9.97s/it]
 31%|███       | 11588/37963 [36:03:45<73:08:49,  9.98s/it]
 31%|███       | 11589/37963 [36:03:54<72:13:19,  9.86s/it]
 31%|███       | 11590/37963 [36:04:17<101:15:55, 13.82s/it]
                                                            
{'loss': '0.1768', 'grad_norm': '3.659', 'learning_rate': '1.628e-05', 'epoch': '0.3053'}

 31%|███       | 11590/37963 [36:04:17<101:15:55, 13.82s/it]
 31%|███       | 11591/37963 [36:04:27<93:07:10, 12.71s/it] 
 31%|███       | 11592/37963 [36:04:37<87:01:47, 11.88s/it]
 31%|███       | 11593/37963 [36:04:47<82:51:25, 11.31s/it]
 31%|███       | 11594/37963 [36:04:57<79:56:18, 10.91s/it]
 31%|███       | 11595/37963 [36:05:07<77:54:44, 10.64s/it]
 31%|███       | 11596/37963 [36:05:18<76:46:08, 10.48s/it]
 31%|███       | 11597/37963 [36:05:27<75:12:43, 10.27s/it]
 31%|███       | 11598/37963 [36:05:37<73:53:20, 10.09s/it]
 31%|███       | 11599/37963 [36:05:47<73:14:32, 10.00s/it]
 31%|███       | 11600/37963 [36:06:03<87:05:47, 11.89s/it]
                                                           
{'loss': '0.1633', 'grad_norm': '1.63', 'learning_rate': '1.628e-05', 'epoch': '0.3056'}

 31%|███       | 11600/37963 [36:06:03<87:05:47, 11.89s/it]
 31%|███       | 11601/37963 [36:06:13<83:05:21, 11.35s/it]
 31%|███       | 11602/37963 [36:06:23<80:18:04, 10.97s/it]
 31%|███       | 11603/37963 [36:06:33<78:20:30, 10.70s/it]
 31%|███       | 11604/37963 [36:06:43<76:22:44, 10.43s/it]
 31%|███       | 11605/37963 [36:06:53<75:16:16, 10.28s/it]
 31%|███       | 11606/37963 [36:07:03<74:49:22, 10.22s/it]
 31%|███       | 11607/37963 [36:07:19<87:43:15, 11.98s/it]
 31%|███       | 11608/37963 [36:07:29<82:36:02, 11.28s/it]
 31%|███       | 11609/37963 [36:07:45<94:11:01, 12.87s/it]
 31%|███       | 11610/37963 [36:07:56<88:08:37, 12.04s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '1.141', 'learning_rate': '1.627e-05', 'epoch': '0.3058'}

 31%|███       | 11610/37963 [36:07:56<88:08:37, 12.04s/it]
 31%|███       | 11611/37963 [36:08:13<99:13:44, 13.56s/it]
 31%|███       | 11612/37963 [36:08:23<92:03:59, 12.58s/it]
 31%|███       | 11613/37963 [36:08:33<86:24:33, 11.81s/it]
 31%|███       | 11614/37963 [36:08:43<83:03:57, 11.35s/it]
 31%|███       | 11615/37963 [36:08:53<80:32:45, 11.01s/it]
 31%|███       | 11616/37963 [36:09:03<78:34:03, 10.74s/it]
 31%|███       | 11617/37963 [36:09:14<77:16:33, 10.56s/it]
 31%|███       | 11618/37963 [36:09:24<76:23:35, 10.44s/it]
 31%|███       | 11619/37963 [36:09:40<88:21:45, 12.08s/it]
 31%|███       | 11620/37963 [36:09:50<84:08:24, 11.50s/it]
                                                           
{'loss': '0.1768', 'grad_norm': '1.421', 'learning_rate': '1.626e-05', 'epoch': '0.3061'}

 31%|███       | 11620/37963 [36:09:50<84:08:24, 11.50s/it]
 31%|███       | 11621/37963 [36:10:00<81:02:40, 11.08s/it]
 31%|███       | 11622/37963 [36:10:17<93:14:33, 12.74s/it]
 31%|███       | 11623/37963 [36:10:27<87:21:53, 11.94s/it]
 31%|███       | 11624/37963 [36:10:37<83:22:38, 11.40s/it]
 31%|███       | 11625/37963 [36:10:46<79:41:21, 10.89s/it]
 31%|███       | 11626/37963 [36:10:57<78:00:12, 10.66s/it]
 31%|███       | 11627/37963 [36:11:07<76:35:56, 10.47s/it]
 31%|███       | 11628/37963 [36:11:17<75:50:40, 10.37s/it]
 31%|███       | 11629/37963 [36:11:27<74:40:55, 10.21s/it]
 31%|███       | 11630/37963 [36:11:37<74:22:20, 10.17s/it]
                                                           
{'loss': '0.1679', 'grad_norm': '1.069', 'learning_rate': '1.626e-05', 'epoch': '0.3064'}

 31%|███       | 11630/37963 [36:11:37<74:22:20, 10.17s/it]
 31%|███       | 11631/37963 [36:11:47<73:57:13, 10.11s/it]
 31%|███       | 11632/37963 [36:11:57<73:37:44, 10.07s/it]
 31%|███       | 11633/37963 [36:12:07<73:33:44, 10.06s/it]
 31%|███       | 11634/37963 [36:12:17<73:44:21, 10.08s/it]
 31%|███       | 11635/37963 [36:12:27<73:32:05, 10.05s/it]
 31%|███       | 11636/37963 [36:12:37<73:37:33, 10.07s/it]
 31%|███       | 11637/37963 [36:12:47<73:23:22, 10.04s/it]
 31%|███       | 11638/37963 [36:13:03<86:49:05, 11.87s/it]
 31%|███       | 11639/37963 [36:13:13<82:49:32, 11.33s/it]
 31%|███       | 11640/37963 [36:13:30<94:57:04, 12.99s/it]
                                                           
{'loss': '0.1735', 'grad_norm': '3.055', 'learning_rate': '1.625e-05', 'epoch': '0.3066'}

 31%|███       | 11640/37963 [36:13:30<94:57:04, 12.99s/it]
 31%|███       | 11641/37963 [36:13:40<88:35:12, 12.12s/it]
 31%|███       | 11642/37963 [36:13:50<83:49:37, 11.47s/it]
 31%|███       | 11643/37963 [36:14:00<80:45:38, 11.05s/it]
 31%|███       | 11644/37963 [36:14:10<78:49:07, 10.78s/it]
 31%|███       | 11645/37963 [36:14:20<76:26:22, 10.46s/it]
 31%|███       | 11646/37963 [36:14:30<75:34:57, 10.34s/it]
 31%|███       | 11647/37963 [36:14:40<74:49:52, 10.24s/it]
 31%|███       | 11648/37963 [36:14:57<89:19:45, 12.22s/it]
 31%|███       | 11649/37963 [36:15:07<84:08:37, 11.51s/it]
 31%|███       | 11650/37963 [36:15:16<80:28:35, 11.01s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '1.904', 'learning_rate': '1.624e-05', 'epoch': '0.3069'}

 31%|███       | 11650/37963 [36:15:16<80:28:35, 11.01s/it]
 31%|███       | 11651/37963 [36:15:27<78:19:32, 10.72s/it]
 31%|███       | 11652/37963 [36:15:37<76:52:57, 10.52s/it]
 31%|███       | 11653/37963 [36:15:47<76:00:11, 10.40s/it]
 31%|███       | 11654/37963 [36:15:57<75:27:40, 10.33s/it]
 31%|███       | 11655/37963 [36:16:13<87:55:36, 12.03s/it]
 31%|███       | 11656/37963 [36:16:23<83:32:26, 11.43s/it]
 31%|███       | 11657/37963 [36:16:39<93:41:08, 12.82s/it]
 31%|███       | 11658/37963 [36:16:55<101:15:52, 13.86s/it]
 31%|███       | 11659/37963 [36:17:05<93:03:04, 12.74s/it] 
 31%|███       | 11660/37963 [36:17:15<86:54:01, 11.89s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '2.002', 'learning_rate': '1.624e-05', 'epoch': '0.3071'}

 31%|███       | 11660/37963 [36:17:15<86:54:01, 11.89s/it]
 31%|███       | 11661/37963 [36:17:25<82:24:32, 11.28s/it]
 31%|███       | 11662/37963 [36:17:35<79:47:06, 10.92s/it]
 31%|███       | 11663/37963 [36:17:45<77:36:10, 10.62s/it]
 31%|███       | 11664/37963 [36:17:55<76:19:56, 10.45s/it]
 31%|███       | 11665/37963 [36:18:05<75:04:07, 10.28s/it]
 31%|███       | 11666/37963 [36:18:15<74:44:48, 10.23s/it]
 31%|███       | 11667/37963 [36:18:25<74:25:47, 10.19s/it]
 31%|███       | 11668/37963 [36:18:42<88:43:36, 12.15s/it]
 31%|███       | 11669/37963 [36:18:59<98:34:23, 13.50s/it]
 31%|███       | 11670/37963 [36:19:09<90:46:01, 12.43s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '1.655', 'learning_rate': '1.623e-05', 'epoch': '0.3074'}

 31%|███       | 11670/37963 [36:19:09<90:46:01, 12.43s/it]
 31%|███       | 11671/37963 [36:19:19<85:41:49, 11.73s/it]
 31%|███       | 11672/37963 [36:19:29<82:07:47, 11.25s/it]
 31%|███       | 11673/37963 [36:19:39<79:32:53, 10.89s/it]
 31%|███       | 11674/37963 [36:19:49<77:38:59, 10.63s/it]
 31%|███       | 11675/37963 [36:19:59<76:20:42, 10.46s/it]
 31%|███       | 11676/37963 [36:20:09<75:24:53, 10.33s/it]
 31%|███       | 11677/37963 [36:20:19<75:09:15, 10.29s/it]
 31%|███       | 11678/37963 [36:20:29<74:52:24, 10.25s/it]
 31%|███       | 11679/37963 [36:20:39<74:20:04, 10.18s/it]
 31%|███       | 11680/37963 [36:20:49<74:03:21, 10.14s/it]
                                                           
{'loss': '0.1552', 'grad_norm': '3.222', 'learning_rate': '1.622e-05', 'epoch': '0.3077'}

 31%|███       | 11680/37963 [36:20:49<74:03:21, 10.14s/it]
 31%|███       | 11681/37963 [36:21:00<74:04:15, 10.15s/it]
 31%|███       | 11682/37963 [36:21:09<72:56:45,  9.99s/it]
 31%|███       | 11683/37963 [36:21:19<73:37:47, 10.09s/it]
 31%|███       | 11684/37963 [36:21:30<73:45:02, 10.10s/it]
 31%|███       | 11685/37963 [36:21:40<73:38:02, 10.09s/it]
 31%|███       | 11686/37963 [36:21:57<88:26:58, 12.12s/it]
 31%|███       | 11687/37963 [36:22:14<99:23:05, 13.62s/it]
 31%|███       | 11688/37963 [36:22:24<91:14:34, 12.50s/it]
 31%|███       | 11689/37963 [36:22:34<85:56:18, 11.78s/it]
 31%|███       | 11690/37963 [36:22:44<82:17:08, 11.28s/it]
                                                           
{'loss': '0.1709', 'grad_norm': '3.145', 'learning_rate': '1.622e-05', 'epoch': '0.3079'}

 31%|███       | 11690/37963 [36:22:44<82:17:08, 11.28s/it]
 31%|███       | 11691/37963 [36:22:54<79:46:03, 10.93s/it]
 31%|███       | 11692/37963 [36:23:04<77:48:59, 10.66s/it]
 31%|███       | 11693/37963 [36:23:14<76:24:44, 10.47s/it]
 31%|███       | 11694/37963 [36:23:24<75:28:14, 10.34s/it]
 31%|███       | 11695/37963 [36:23:40<88:32:23, 12.13s/it]
 31%|███       | 11696/37963 [36:23:50<84:04:30, 11.52s/it]
 31%|███       | 11697/37963 [36:24:00<80:49:39, 11.08s/it]
 31%|███       | 11698/37963 [36:24:10<78:36:05, 10.77s/it]
 31%|███       | 11699/37963 [36:24:20<76:24:47, 10.47s/it]
 31%|███       | 11700/37963 [36:24:30<75:30:18, 10.35s/it]
                                                           
{'loss': '0.171', 'grad_norm': '1.853', 'learning_rate': '1.621e-05', 'epoch': '0.3082'}

 31%|███       | 11700/37963 [36:24:30<75:30:18, 10.35s/it]
 31%|███       | 11701/37963 [36:24:40<74:57:49, 10.28s/it]
 31%|███       | 11702/37963 [36:24:50<73:54:22, 10.13s/it]
 31%|███       | 11703/37963 [36:25:07<88:09:42, 12.09s/it]
 31%|███       | 11704/37963 [36:25:17<83:54:16, 11.50s/it]
 31%|███       | 11705/37963 [36:25:40<109:57:06, 15.07s/it]
 31%|███       | 11706/37963 [36:25:51<99:07:12, 13.59s/it] 
 31%|███       | 11707/37963 [36:26:00<90:52:15, 12.46s/it]
 31%|███       | 11708/37963 [36:26:10<85:32:12, 11.73s/it]
 31%|███       | 11709/37963 [36:26:20<81:55:01, 11.23s/it]
 31%|███       | 11710/37963 [36:26:31<79:27:17, 10.90s/it]
                                                           
{'loss': '0.1521', 'grad_norm': '1.435', 'learning_rate': '1.62e-05', 'epoch': '0.3085'}

 31%|███       | 11710/37963 [36:26:31<79:27:17, 10.90s/it]
 31%|███       | 11711/37963 [36:26:41<77:22:13, 10.61s/it]
 31%|███       | 11712/37963 [36:26:51<76:18:09, 10.46s/it]
 31%|███       | 11713/37963 [36:27:01<75:26:41, 10.35s/it]
 31%|███       | 11714/37963 [36:27:11<74:52:15, 10.27s/it]
 31%|███       | 11715/37963 [36:27:27<88:54:56, 12.20s/it]
 31%|███       | 11716/37963 [36:27:38<84:12:58, 11.55s/it]
 31%|███       | 11717/37963 [36:27:54<95:19:52, 13.08s/it]
 31%|███       | 11718/37963 [36:28:04<88:47:59, 12.18s/it]
 31%|███       | 11719/37963 [36:28:14<84:04:42, 11.53s/it]
 31%|███       | 11720/37963 [36:28:24<80:53:50, 11.10s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '1.467', 'learning_rate': '1.62e-05', 'epoch': '0.3087'}

 31%|███       | 11720/37963 [36:28:24<80:53:50, 11.10s/it]
 31%|███       | 11721/37963 [36:28:34<78:11:44, 10.73s/it]
 31%|███       | 11722/37963 [36:28:44<76:55:00, 10.55s/it]
 31%|███       | 11723/37963 [36:28:55<76:29:00, 10.49s/it]
 31%|███       | 11724/37963 [36:29:05<75:07:37, 10.31s/it]
 31%|███       | 11725/37963 [36:29:15<74:25:47, 10.21s/it]
 31%|███       | 11726/37963 [36:29:25<73:57:14, 10.15s/it]
 31%|███       | 11727/37963 [36:29:34<73:16:51, 10.06s/it]
 31%|███       | 11728/37963 [36:29:45<73:33:11, 10.09s/it]
 31%|███       | 11729/37963 [36:29:55<73:52:17, 10.14s/it]
 31%|███       | 11730/37963 [36:30:05<73:59:20, 10.15s/it]
                                                           
{'loss': '0.1762', 'grad_norm': '1.704', 'learning_rate': '1.619e-05', 'epoch': '0.309'}

 31%|███       | 11730/37963 [36:30:05<73:59:20, 10.15s/it]
 31%|███       | 11731/37963 [36:30:15<72:51:30, 10.00s/it]
 31%|███       | 11732/37963 [36:30:25<73:13:54, 10.05s/it]
 31%|███       | 11733/37963 [36:30:35<73:13:32, 10.05s/it]
 31%|███       | 11734/37963 [36:30:45<73:29:06, 10.09s/it]
 31%|███       | 11735/37963 [36:31:01<86:49:22, 11.92s/it]
 31%|███       | 11736/37963 [36:31:18<97:53:45, 13.44s/it]
 31%|███       | 11737/37963 [36:31:28<90:27:39, 12.42s/it]
 31%|███       | 11738/37963 [36:31:38<84:29:35, 11.60s/it]
 31%|███       | 11739/37963 [36:31:48<81:22:31, 11.17s/it]
 31%|███       | 11740/37963 [36:31:58<78:59:17, 10.84s/it]
                                                           
{'loss': '0.1577', 'grad_norm': '2.513', 'learning_rate': '1.618e-05', 'epoch': '0.3092'}

 31%|███       | 11740/37963 [36:31:58<78:59:17, 10.84s/it]
 31%|███       | 11741/37963 [36:32:08<77:33:25, 10.65s/it]
 31%|███       | 11742/37963 [36:32:24<89:02:34, 12.23s/it]
 31%|███       | 11743/37963 [36:32:35<84:49:55, 11.65s/it]
 31%|███       | 11744/37963 [36:32:45<81:29:02, 11.19s/it]
 31%|███       | 11745/37963 [36:32:54<77:50:05, 10.69s/it]
 31%|███       | 11746/37963 [36:33:04<76:40:38, 10.53s/it]
 31%|███       | 11747/37963 [36:33:14<75:23:04, 10.35s/it]
 31%|███       | 11748/37963 [36:33:25<75:10:12, 10.32s/it]
 31%|███       | 11749/37963 [36:33:35<74:27:47, 10.23s/it]
 31%|███       | 11750/37963 [36:33:45<74:02:37, 10.17s/it]
                                                           
{'loss': '0.1595', 'grad_norm': '1.638', 'learning_rate': '1.618e-05', 'epoch': '0.3095'}

 31%|███       | 11750/37963 [36:33:45<74:02:37, 10.17s/it]
 31%|███       | 11751/37963 [36:34:01<87:30:36, 12.02s/it]
 31%|███       | 11752/37963 [36:34:11<83:00:16, 11.40s/it]
 31%|███       | 11753/37963 [36:34:21<80:04:39, 11.00s/it]
 31%|███       | 11754/37963 [36:34:38<92:14:35, 12.67s/it]
 31%|███       | 11755/37963 [36:34:48<86:39:20, 11.90s/it]
 31%|███       | 11756/37963 [36:35:04<97:12:58, 13.35s/it]
 31%|███       | 11757/37963 [36:35:15<90:07:18, 12.38s/it]
 31%|███       | 11758/37963 [36:35:25<84:57:33, 11.67s/it]
 31%|███       | 11759/37963 [36:35:35<81:41:11, 11.22s/it]
 31%|███       | 11760/37963 [36:35:45<79:19:34, 10.90s/it]
                                                           
{'loss': '0.1753', 'grad_norm': '2.216', 'learning_rate': '1.617e-05', 'epoch': '0.3098'}

 31%|███       | 11760/37963 [36:35:45<79:19:34, 10.90s/it]
 31%|███       | 11761/37963 [36:35:55<77:25:01, 10.64s/it]
 31%|███       | 11762/37963 [36:36:05<75:13:18, 10.34s/it]
 31%|███       | 11763/37963 [36:36:28<103:42:14, 14.25s/it]
 31%|███       | 11764/37963 [36:36:38<94:43:03, 13.02s/it] 
 31%|███       | 11765/37963 [36:36:48<88:33:27, 12.17s/it]
 31%|███       | 11766/37963 [36:36:58<84:00:16, 11.54s/it]
 31%|███       | 11767/37963 [36:37:08<80:31:53, 11.07s/it]
 31%|███       | 11768/37963 [36:37:18<78:26:35, 10.78s/it]
 31%|███       | 11769/37963 [36:37:28<76:25:11, 10.50s/it]
 31%|███       | 11770/37963 [36:37:38<74:53:36, 10.29s/it]
                                                           
{'loss': '0.1685', 'grad_norm': '3.503', 'learning_rate': '1.616e-05', 'epoch': '0.31'}

 31%|███       | 11770/37963 [36:37:38<74:53:36, 10.29s/it]
 31%|███       | 11771/37963 [36:37:48<74:26:15, 10.23s/it]
 31%|███       | 11772/37963 [36:37:58<74:16:03, 10.21s/it]
 31%|███       | 11773/37963 [36:38:08<73:25:11, 10.09s/it]
 31%|███       | 11774/37963 [36:38:18<73:19:17, 10.08s/it]
 31%|███       | 11775/37963 [36:38:28<73:17:16, 10.07s/it]
 31%|███       | 11776/37963 [36:38:38<72:51:54, 10.02s/it]
 31%|███       | 11777/37963 [36:38:48<72:37:51,  9.99s/it]
 31%|███       | 11778/37963 [36:38:58<72:13:13,  9.93s/it]
 31%|███       | 11779/37963 [36:39:08<72:30:20,  9.97s/it]
 31%|███       | 11780/37963 [36:39:18<72:49:48, 10.01s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '2.663', 'learning_rate': '1.616e-05', 'epoch': '0.3103'}

 31%|███       | 11780/37963 [36:39:18<72:49:48, 10.01s/it]
 31%|███       | 11781/37963 [36:39:28<72:54:48, 10.03s/it]
 31%|███       | 11782/37963 [36:39:38<72:58:03, 10.03s/it]
 31%|███       | 11783/37963 [36:39:48<73:15:18, 10.07s/it]
 31%|███       | 11784/37963 [36:40:05<87:38:53, 12.05s/it]
 31%|███       | 11785/37963 [36:40:21<97:10:01, 13.36s/it]
 31%|███       | 11786/37963 [36:40:31<88:44:30, 12.20s/it]
 31%|███       | 11787/37963 [36:40:41<84:02:59, 11.56s/it]
 31%|███       | 11788/37963 [36:40:51<80:49:06, 11.12s/it]
 31%|███       | 11789/37963 [36:41:01<78:10:54, 10.75s/it]
 31%|███       | 11790/37963 [36:41:17<90:48:24, 12.49s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '1.092', 'learning_rate': '1.615e-05', 'epoch': '0.3106'}

 31%|███       | 11790/37963 [36:41:17<90:48:24, 12.49s/it]
 31%|███       | 11791/37963 [36:41:28<85:35:08, 11.77s/it]
 31%|███       | 11792/37963 [36:41:38<82:09:23, 11.30s/it]
 31%|███       | 11793/37963 [36:41:48<78:58:17, 10.86s/it]
 31%|███       | 11794/37963 [36:41:58<77:03:40, 10.60s/it]
 31%|███       | 11795/37963 [36:42:08<76:04:48, 10.47s/it]
 31%|███       | 11796/37963 [36:42:17<74:04:30, 10.19s/it]
 31%|███       | 11797/37963 [36:42:27<73:58:06, 10.18s/it]
 31%|███       | 11798/37963 [36:42:37<73:41:53, 10.14s/it]
 31%|███       | 11799/37963 [36:42:48<74:03:42, 10.19s/it]
 31%|███       | 11800/37963 [36:43:04<87:41:58, 12.07s/it]
                                                           
{'loss': '0.162', 'grad_norm': '1.39', 'learning_rate': '1.614e-05', 'epoch': '0.3108'}

 31%|███       | 11800/37963 [36:43:04<87:41:58, 12.07s/it]
 31%|███       | 11801/37963 [36:43:14<83:33:24, 11.50s/it]
 31%|███       | 11802/37963 [36:43:32<96:17:49, 13.25s/it]
 31%|███       | 11803/37963 [36:43:42<89:13:10, 12.28s/it]
 31%|███       | 11804/37963 [36:43:58<98:30:40, 13.56s/it]
 31%|███       | 11805/37963 [36:44:08<90:49:51, 12.50s/it]
 31%|███       | 11806/37963 [36:44:18<85:39:40, 11.79s/it]
 31%|███       | 11807/37963 [36:44:28<80:37:20, 11.10s/it]
 31%|███       | 11808/37963 [36:44:38<78:20:51, 10.78s/it]
 31%|███       | 11809/37963 [36:44:48<76:47:29, 10.57s/it]
 31%|███       | 11810/37963 [36:44:58<75:36:59, 10.41s/it]
                                                           
{'loss': '0.1731', 'grad_norm': '2.388', 'learning_rate': '1.614e-05', 'epoch': '0.3111'}

 31%|███       | 11810/37963 [36:44:58<75:36:59, 10.41s/it]
 31%|███       | 11811/37963 [36:45:21<102:04:12, 14.05s/it]
 31%|███       | 11812/37963 [36:45:31<93:31:03, 12.87s/it] 
 31%|███       | 11813/37963 [36:45:41<87:29:52, 12.05s/it]
 31%|███       | 11814/37963 [36:45:51<83:01:49, 11.43s/it]
 31%|███       | 11815/37963 [36:46:01<80:05:26, 11.03s/it]
 31%|███       | 11816/37963 [36:46:11<77:28:49, 10.67s/it]
 31%|███       | 11817/37963 [36:46:21<76:33:03, 10.54s/it]
 31%|███       | 11818/37963 [36:46:31<75:45:27, 10.43s/it]
 31%|███       | 11819/37963 [36:46:41<75:02:40, 10.33s/it]
 31%|███       | 11820/37963 [36:46:51<74:27:08, 10.25s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '0.776', 'learning_rate': '1.613e-05', 'epoch': '0.3114'}

 31%|███       | 11820/37963 [36:46:51<74:27:08, 10.25s/it]
 31%|███       | 11821/37963 [36:47:01<73:12:32, 10.08s/it]
 31%|███       | 11822/37963 [36:47:11<72:52:42, 10.04s/it]
 31%|███       | 11823/37963 [36:47:21<73:07:11, 10.07s/it]
 31%|███       | 11824/37963 [36:47:31<72:52:42, 10.04s/it]
 31%|███       | 11825/37963 [36:47:41<73:02:04, 10.06s/it]
 31%|███       | 11826/37963 [36:47:51<72:24:24,  9.97s/it]
 31%|███       | 11827/37963 [36:48:01<72:37:38, 10.00s/it]
 31%|███       | 11828/37963 [36:48:11<72:44:15, 10.02s/it]
 31%|███       | 11829/37963 [36:48:21<73:02:47, 10.06s/it]
 31%|███       | 11830/37963 [36:48:38<87:07:47, 12.00s/it]
                                                           
{'loss': '0.171', 'grad_norm': '1.564', 'learning_rate': '1.612e-05', 'epoch': '0.3116'}

 31%|███       | 11830/37963 [36:48:38<87:07:47, 12.00s/it]
 31%|███       | 11831/37963 [36:48:48<82:49:05, 11.41s/it]
 31%|███       | 11832/37963 [36:48:58<79:55:23, 11.01s/it]
 31%|███       | 11833/37963 [36:49:08<78:00:18, 10.75s/it]
 31%|███       | 11834/37963 [36:49:24<89:53:10, 12.38s/it]
 31%|███       | 11835/37963 [36:49:34<84:51:21, 11.69s/it]
 31%|███       | 11836/37963 [36:49:44<80:30:36, 11.09s/it]
 31%|███       | 11837/37963 [36:50:00<91:50:56, 12.66s/it]
 31%|███       | 11838/37963 [36:50:10<86:14:27, 11.88s/it]
 31%|███       | 11839/37963 [36:50:20<82:09:56, 11.32s/it]
 31%|███       | 11840/37963 [36:50:30<79:24:13, 10.94s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '2.299', 'learning_rate': '1.611e-05', 'epoch': '0.3119'}

 31%|███       | 11840/37963 [36:50:30<79:24:13, 10.94s/it]
 31%|███       | 11841/37963 [36:50:40<76:44:41, 10.58s/it]
 31%|███       | 11842/37963 [36:50:50<75:38:11, 10.42s/it]
 31%|███       | 11843/37963 [36:51:00<74:49:24, 10.31s/it]
 31%|███       | 11844/37963 [36:51:10<74:31:14, 10.27s/it]
 31%|███       | 11845/37963 [36:51:21<74:10:38, 10.22s/it]
 31%|███       | 11846/37963 [36:51:31<73:52:28, 10.18s/it]
 31%|███       | 11847/37963 [36:51:41<73:17:14, 10.10s/it]
 31%|███       | 11848/37963 [36:51:51<73:19:50, 10.11s/it]
 31%|███       | 11849/37963 [36:52:07<86:52:04, 11.98s/it]
 31%|███       | 11850/37963 [36:52:24<97:29:06, 13.44s/it]
                                                           
{'loss': '0.1777', 'grad_norm': '1.071', 'learning_rate': '1.611e-05', 'epoch': '0.3121'}

 31%|███       | 11850/37963 [36:52:24<97:29:06, 13.44s/it]
 31%|███       | 11851/37963 [36:52:34<90:22:07, 12.46s/it]
 31%|███       | 11852/37963 [36:52:44<85:15:47, 11.76s/it]
 31%|███       | 11853/37963 [36:53:01<95:43:52, 13.20s/it]
 31%|███       | 11854/37963 [36:53:11<88:46:43, 12.24s/it]
 31%|███       | 11855/37963 [36:53:21<84:07:53, 11.60s/it]
 31%|███       | 11856/37963 [36:53:31<80:56:44, 11.16s/it]
 31%|███       | 11857/37963 [36:53:41<77:36:11, 10.70s/it]
 31%|███       | 11858/37963 [36:53:57<90:26:05, 12.47s/it]
 31%|███       | 11859/37963 [36:54:07<85:19:49, 11.77s/it]
 31%|███       | 11860/37963 [36:54:24<95:23:42, 13.16s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '2.564', 'learning_rate': '1.61e-05', 'epoch': '0.3124'}

 31%|███       | 11860/37963 [36:54:24<95:23:42, 13.16s/it]
 31%|███       | 11861/37963 [36:54:34<88:36:10, 12.22s/it]
 31%|███       | 11862/37963 [36:54:44<84:00:48, 11.59s/it]
 31%|███       | 11863/37963 [36:54:54<80:51:25, 11.15s/it]
 31%|███▏      | 11864/37963 [36:55:04<78:33:49, 10.84s/it]
 31%|███▏      | 11865/37963 [36:55:14<76:45:46, 10.59s/it]
 31%|███▏      | 11866/37963 [36:55:24<75:48:54, 10.46s/it]
 31%|███▏      | 11867/37963 [36:55:34<74:01:40, 10.21s/it]
 31%|███▏      | 11868/37963 [36:55:44<73:46:57, 10.18s/it]
 31%|███▏      | 11869/37963 [36:55:54<73:57:03, 10.20s/it]
 31%|███▏      | 11870/37963 [36:56:04<73:40:44, 10.17s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '2.139', 'learning_rate': '1.609e-05', 'epoch': '0.3127'}

 31%|███▏      | 11870/37963 [36:56:04<73:40:44, 10.17s/it]
 31%|███▏      | 11871/37963 [36:56:15<73:54:52, 10.20s/it]
 31%|███▏      | 11872/37963 [36:56:25<73:39:55, 10.16s/it]
 31%|███▏      | 11873/37963 [36:56:35<73:36:34, 10.16s/it]
 31%|███▏      | 11874/37963 [36:56:45<73:32:26, 10.15s/it]
 31%|███▏      | 11875/37963 [36:56:55<73:18:06, 10.12s/it]
 31%|███▏      | 11876/37963 [36:57:05<72:51:12, 10.05s/it]
 31%|███▏      | 11877/37963 [36:57:15<72:54:22, 10.06s/it]
 31%|███▏      | 11878/37963 [36:57:25<72:47:54, 10.05s/it]
 31%|███▏      | 11879/37963 [36:57:42<88:09:18, 12.17s/it]
 31%|███▏      | 11880/37963 [36:57:52<83:47:48, 11.57s/it]
                                                           
{'loss': '0.1634', 'grad_norm': '1.468', 'learning_rate': '1.609e-05', 'epoch': '0.3129'}

 31%|███▏      | 11880/37963 [36:57:52<83:47:48, 11.57s/it]
 31%|███▏      | 11881/37963 [36:58:09<94:12:10, 13.00s/it]
 31%|███▏      | 11882/37963 [36:58:19<87:54:54, 12.14s/it]
 31%|███▏      | 11883/37963 [36:58:29<83:05:31, 11.47s/it]
 31%|███▏      | 11884/37963 [36:58:39<80:02:14, 11.05s/it]
 31%|███▏      | 11885/37963 [36:58:49<77:54:16, 10.75s/it]
 31%|███▏      | 11886/37963 [36:59:05<90:22:11, 12.48s/it]
 31%|███▏      | 11887/37963 [36:59:15<85:17:32, 11.78s/it]
 31%|███▏      | 11888/37963 [36:59:25<81:17:57, 11.22s/it]
 31%|███▏      | 11889/37963 [36:59:35<78:30:19, 10.84s/it]
 31%|███▏      | 11890/37963 [36:59:45<76:51:22, 10.61s/it]
                                                           
{'loss': '0.166', 'grad_norm': '4.133', 'learning_rate': '1.608e-05', 'epoch': '0.3132'}

 31%|███▏      | 11890/37963 [36:59:45<76:51:22, 10.61s/it]
 31%|███▏      | 11891/37963 [36:59:56<75:51:55, 10.48s/it]
 31%|███▏      | 11892/37963 [37:00:06<75:09:22, 10.38s/it]
 31%|███▏      | 11893/37963 [37:00:16<74:42:28, 10.32s/it]
 31%|███▏      | 11894/37963 [37:00:26<73:33:22, 10.16s/it]
 31%|███▏      | 11895/37963 [37:00:36<73:24:19, 10.14s/it]
 31%|███▏      | 11896/37963 [37:00:46<73:41:06, 10.18s/it]
 31%|███▏      | 11897/37963 [37:01:10<102:49:30, 14.20s/it]
 31%|███▏      | 11898/37963 [37:01:20<93:50:21, 12.96s/it] 
 31%|███▏      | 11899/37963 [37:01:29<86:45:46, 11.98s/it]
 31%|███▏      | 11900/37963 [37:01:39<82:32:50, 11.40s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '2.315', 'learning_rate': '1.607e-05', 'epoch': '0.3135'}

 31%|███▏      | 11900/37963 [37:01:39<82:32:50, 11.40s/it]
 31%|███▏      | 11901/37963 [37:01:49<79:21:49, 10.96s/it]
 31%|███▏      | 11902/37963 [37:02:06<91:54:46, 12.70s/it]
 31%|███▏      | 11903/37963 [37:02:16<85:39:38, 11.83s/it]
 31%|███▏      | 11904/37963 [37:02:26<80:59:44, 11.19s/it]
 31%|███▏      | 11905/37963 [37:02:36<78:17:38, 10.82s/it]
 31%|███▏      | 11906/37963 [37:02:46<76:48:08, 10.61s/it]
 31%|███▏      | 11907/37963 [37:03:02<89:30:16, 12.37s/it]
 31%|███▏      | 11908/37963 [37:03:12<84:30:56, 11.68s/it]
 31%|███▏      | 11909/37963 [37:03:29<94:48:04, 13.10s/it]
 31%|███▏      | 11910/37963 [37:03:38<87:09:11, 12.04s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '1.263', 'learning_rate': '1.607e-05', 'epoch': '0.3137'}

 31%|███▏      | 11910/37963 [37:03:38<87:09:11, 12.04s/it]
 31%|███▏      | 11911/37963 [37:03:48<82:54:17, 11.46s/it]
 31%|███▏      | 11912/37963 [37:03:58<79:57:28, 11.05s/it]
 31%|███▏      | 11913/37963 [37:04:09<77:51:27, 10.76s/it]
 31%|███▏      | 11914/37963 [37:04:19<76:18:23, 10.55s/it]
 31%|███▏      | 11915/37963 [37:04:28<74:04:00, 10.24s/it]
 31%|███▏      | 11916/37963 [37:04:38<72:37:51, 10.04s/it]
 31%|███▏      | 11917/37963 [37:04:48<72:45:33, 10.06s/it]
 31%|███▏      | 11918/37963 [37:04:58<72:24:34, 10.01s/it]
 31%|███▏      | 11919/37963 [37:05:08<72:35:45, 10.03s/it]
 31%|███▏      | 11920/37963 [37:05:18<71:59:38,  9.95s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '1.155', 'learning_rate': '1.606e-05', 'epoch': '0.314'}

 31%|███▏      | 11920/37963 [37:05:18<71:59:38,  9.95s/it]
 31%|███▏      | 11921/37963 [37:05:28<72:28:27, 10.02s/it]
 31%|███▏      | 11922/37963 [37:05:38<72:07:58,  9.97s/it]
 31%|███▏      | 11923/37963 [37:05:48<72:02:15,  9.96s/it]
 31%|███▏      | 11924/37963 [37:05:58<72:28:49, 10.02s/it]
 31%|███▏      | 11925/37963 [37:06:08<72:48:29, 10.07s/it]
 31%|███▏      | 11926/37963 [37:06:18<72:58:18, 10.09s/it]
 31%|███▏      | 11927/37963 [37:06:35<87:54:37, 12.16s/it]
 31%|███▏      | 11928/37963 [37:06:45<82:35:28, 11.42s/it]
 31%|███▏      | 11929/37963 [37:07:01<93:41:04, 12.95s/it]
 31%|███▏      | 11930/37963 [37:07:11<87:24:42, 12.09s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '2.114', 'learning_rate': '1.605e-05', 'epoch': '0.3143'}

 31%|███▏      | 11930/37963 [37:07:11<87:24:42, 12.09s/it]
 31%|███▏      | 11931/37963 [37:07:21<83:05:29, 11.49s/it]
 31%|███▏      | 11932/37963 [37:07:31<80:04:53, 11.07s/it]
 31%|███▏      | 11933/37963 [37:07:47<90:21:21, 12.50s/it]
 31%|███▏      | 11934/37963 [37:07:57<85:10:13, 11.78s/it]
 31%|███▏      | 11935/37963 [37:08:07<81:01:46, 11.21s/it]
 31%|███▏      | 11936/37963 [37:08:17<78:31:39, 10.86s/it]
 31%|███▏      | 11937/37963 [37:08:27<76:29:38, 10.58s/it]
 31%|███▏      | 11938/37963 [37:08:37<74:09:33, 10.26s/it]
 31%|███▏      | 11939/37963 [37:08:47<73:21:05, 10.15s/it]
 31%|███▏      | 11940/37963 [37:08:57<73:05:25, 10.11s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '1.775', 'learning_rate': '1.605e-05', 'epoch': '0.3145'}

 31%|███▏      | 11940/37963 [37:08:57<73:05:25, 10.11s/it]
 31%|███▏      | 11941/37963 [37:09:07<72:58:42, 10.10s/it]
 31%|███▏      | 11942/37963 [37:09:17<73:07:03, 10.12s/it]
 31%|███▏      | 11943/37963 [37:09:27<73:03:28, 10.11s/it]
 31%|███▏      | 11944/37963 [37:09:37<73:19:48, 10.15s/it]
 31%|███▏      | 11945/37963 [37:09:47<73:24:01, 10.16s/it]
 31%|███▏      | 11946/37963 [37:10:11<101:39:25, 14.07s/it]
 31%|███▏      | 11947/37963 [37:10:21<93:00:22, 12.87s/it] 
 31%|███▏      | 11948/37963 [37:10:31<86:53:18, 12.02s/it]
 31%|███▏      | 11949/37963 [37:10:41<82:19:42, 11.39s/it]
 31%|███▏      | 11950/37963 [37:10:57<92:56:52, 12.86s/it]
                                                           
{'loss': '0.1745', 'grad_norm': '1.583', 'learning_rate': '1.604e-05', 'epoch': '0.3148'}

 31%|███▏      | 11950/37963 [37:10:57<92:56:52, 12.86s/it]
 31%|███▏      | 11951/37963 [37:11:07<87:16:00, 12.08s/it]
 31%|███▏      | 11952/37963 [37:11:17<82:30:32, 11.42s/it]
 31%|███▏      | 11953/37963 [37:11:27<79:31:19, 11.01s/it]
 31%|███▏      | 11954/37963 [37:11:37<77:44:21, 10.76s/it]
 31%|███▏      | 11955/37963 [37:11:54<90:27:16, 12.52s/it]
 31%|███▏      | 11956/37963 [37:12:04<85:18:13, 11.81s/it]
 31%|███▏      | 11957/37963 [37:12:21<95:44:58, 13.25s/it]
 31%|███▏      | 11958/37963 [37:12:31<88:58:35, 12.32s/it]
 32%|███▏      | 11959/37963 [37:12:41<84:08:01, 11.65s/it]
 32%|███▏      | 11960/37963 [37:12:51<80:13:04, 11.11s/it]
                                                           
{'loss': '0.1528', 'grad_norm': '1.787', 'learning_rate': '1.603e-05', 'epoch': '0.315'}

 32%|███▏      | 11960/37963 [37:12:51<80:13:04, 11.11s/it]
 32%|███▏      | 11961/37963 [37:13:01<78:06:40, 10.81s/it]
 32%|███▏      | 11962/37963 [37:13:11<76:27:40, 10.59s/it]
 32%|███▏      | 11963/37963 [37:13:21<75:22:10, 10.44s/it]
 32%|███▏      | 11964/37963 [37:13:30<73:14:29, 10.14s/it]
 32%|███▏      | 11965/37963 [37:13:40<72:30:03, 10.04s/it]
 32%|███▏      | 11966/37963 [37:13:50<72:41:41, 10.07s/it]
 32%|███▏      | 11967/37963 [37:14:00<72:39:15, 10.06s/it]
 32%|███▏      | 11968/37963 [37:14:10<72:31:52, 10.04s/it]
 32%|███▏      | 11969/37963 [37:14:20<72:09:08,  9.99s/it]
 32%|███▏      | 11970/37963 [37:14:30<72:26:59, 10.03s/it]
                                                           
{'loss': '0.1687', 'grad_norm': '1.744', 'learning_rate': '1.603e-05', 'epoch': '0.3153'}

 32%|███▏      | 11970/37963 [37:14:30<72:26:59, 10.03s/it]
 32%|███▏      | 11971/37963 [37:14:40<72:15:38, 10.01s/it]
 32%|███▏      | 11972/37963 [37:14:50<72:01:01,  9.98s/it]
 32%|███▏      | 11973/37963 [37:15:00<72:19:47, 10.02s/it]
 32%|███▏      | 11974/37963 [37:15:11<72:28:49, 10.04s/it]
 32%|███▏      | 11975/37963 [37:15:34<100:57:16, 13.98s/it]
 32%|███▏      | 11976/37963 [37:15:44<91:59:00, 12.74s/it] 
 32%|███▏      | 11977/37963 [37:15:54<86:11:25, 11.94s/it]
 32%|███▏      | 11978/37963 [37:16:04<82:03:16, 11.37s/it]
 32%|███▏      | 11979/37963 [37:16:14<79:19:08, 10.99s/it]
 32%|███▏      | 11980/37963 [37:16:24<77:00:41, 10.67s/it]
                                                           
{'loss': '0.168', 'grad_norm': '1.478', 'learning_rate': '1.602e-05', 'epoch': '0.3156'}

 32%|███▏      | 11980/37963 [37:16:24<77:00:41, 10.67s/it]
 32%|███▏      | 11981/37963 [37:16:40<89:59:31, 12.47s/it]
 32%|███▏      | 11982/37963 [37:16:51<85:01:53, 11.78s/it]
 32%|███▏      | 11983/37963 [37:17:01<81:28:32, 11.29s/it]
 32%|███▏      | 11984/37963 [37:17:11<78:55:37, 10.94s/it]
 32%|███▏      | 11985/37963 [37:17:21<77:10:07, 10.69s/it]
 32%|███▏      | 11986/37963 [37:17:31<76:01:17, 10.54s/it]
 32%|███▏      | 11987/37963 [37:17:41<74:31:14, 10.33s/it]
 32%|███▏      | 11988/37963 [37:17:51<74:02:57, 10.26s/it]
 32%|███▏      | 11989/37963 [37:18:01<73:40:25, 10.21s/it]
 32%|███▏      | 11990/37963 [37:18:11<73:24:28, 10.17s/it]
                                                           
{'loss': '0.1625', 'grad_norm': '1.751', 'learning_rate': '1.601e-05', 'epoch': '0.3158'}

 32%|███▏      | 11990/37963 [37:18:11<73:24:28, 10.17s/it]
 32%|███▏      | 11991/37963 [37:18:21<73:10:40, 10.14s/it]
 32%|███▏      | 11992/37963 [37:18:31<73:08:49, 10.14s/it]
 32%|███▏      | 11993/37963 [37:18:48<87:49:52, 12.18s/it]
 32%|███▏      | 11994/37963 [37:19:05<97:11:44, 13.47s/it]
 32%|███▏      | 11995/37963 [37:19:15<89:10:39, 12.36s/it]
 32%|███▏      | 11996/37963 [37:19:25<84:09:19, 11.67s/it]
 32%|███▏      | 11997/37963 [37:19:34<79:57:29, 11.09s/it]
 32%|███▏      | 11998/37963 [37:19:50<90:28:31, 12.54s/it]
 32%|███▏      | 11999/37963 [37:20:00<85:10:37, 11.81s/it]
 32%|███▏      | 12000/37963 [37:20:11<81:31:46, 11.30s/it]
                                                           
{'loss': '0.171', 'grad_norm': '2.982', 'learning_rate': '1.601e-05', 'epoch': '0.3161'}

 32%|███▏      | 12000/37963 [37:20:11<81:31:46, 11.30s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.24s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.24s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 32%|███▏      | 12001/37963 [37:21:18<202:27:47, 28.07s/it]
 32%|███▏      | 12002/37963 [37:21:28<163:32:05, 22.68s/it]
 32%|███▏      | 12003/37963 [37:21:38<135:49:19, 18.84s/it]
 32%|███▏      | 12004/37963 [37:21:48<116:28:59, 16.15s/it]
 32%|███▏      | 12005/37963 [37:21:58<103:13:03, 14.31s/it]
 32%|███▏      | 12006/37963 [37:22:14<107:00:08, 14.84s/it]
 32%|███▏      | 12007/37963 [37:22:24<97:06:46, 13.47s/it] 
 32%|███▏      | 12008/37963 [37:22:34<89:51:02, 12.46s/it]
 32%|███▏      | 12009/37963 [37:22:44<84:59:44, 11.79s/it]
 32%|███▏      | 12010/37963 [37:22:54<81:10:35, 11.26s/it]
                                                           
{'loss': '0.1698', 'grad_norm': '1.301', 'learning_rate': '1.6e-05', 'epoch': '0.3164'}

 32%|███▏      | 12010/37963 [37:22:54<81:10:35, 11.26s/it]
 32%|███▏      | 12011/37963 [37:23:04<78:33:07, 10.90s/it]
 32%|███▏      | 12012/37963 [37:23:14<76:24:53, 10.60s/it]
 32%|███▏      | 12013/37963 [37:23:24<75:23:12, 10.46s/it]
 32%|███▏      | 12014/37963 [37:23:34<74:29:56, 10.34s/it]
 32%|███▏      | 12015/37963 [37:23:44<73:49:25, 10.24s/it]
 32%|███▏      | 12016/37963 [37:23:55<73:31:19, 10.20s/it]
 32%|███▏      | 12017/37963 [37:24:05<73:23:08, 10.18s/it]
 32%|███▏      | 12018/37963 [37:24:15<73:10:45, 10.15s/it]
 32%|███▏      | 12019/37963 [37:24:25<72:59:35, 10.13s/it]
 32%|███▏      | 12020/37963 [37:24:35<73:03:24, 10.14s/it]
                                                           
{'loss': '0.1708', 'grad_norm': '1.946', 'learning_rate': '1.599e-05', 'epoch': '0.3166'}

 32%|███▏      | 12020/37963 [37:24:35<73:03:24, 10.14s/it]
 32%|███▏      | 12021/37963 [37:24:45<73:09:47, 10.15s/it]
 32%|███▏      | 12022/37963 [37:25:02<86:55:55, 12.06s/it]
 32%|███▏      | 12023/37963 [37:25:12<82:43:55, 11.48s/it]
 32%|███▏      | 12024/37963 [37:25:22<79:17:28, 11.00s/it]
 32%|███▏      | 12025/37963 [37:25:38<90:07:40, 12.51s/it]
 32%|███▏      | 12026/37963 [37:25:48<84:31:00, 11.73s/it]
 32%|███▏      | 12027/37963 [37:25:57<79:54:08, 11.09s/it]
 32%|███▏      | 12028/37963 [37:26:07<77:37:57, 10.78s/it]
 32%|███▏      | 12029/37963 [37:26:24<89:45:07, 12.46s/it]
 32%|███▏      | 12030/37963 [37:26:33<83:48:28, 11.63s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '1.184', 'learning_rate': '1.599e-05', 'epoch': '0.3169'}

 32%|███▏      | 12030/37963 [37:26:33<83:48:28, 11.63s/it]
 32%|███▏      | 12031/37963 [37:26:43<80:24:12, 11.16s/it]
 32%|███▏      | 12032/37963 [37:26:54<78:11:37, 10.86s/it]
 32%|███▏      | 12033/37963 [37:27:04<76:30:36, 10.62s/it]
 32%|███▏      | 12034/37963 [37:27:14<75:12:37, 10.44s/it]
 32%|███▏      | 12035/37963 [37:27:24<74:27:22, 10.34s/it]
 32%|███▏      | 12036/37963 [37:27:34<73:54:59, 10.26s/it]
 32%|███▏      | 12037/37963 [37:27:43<72:25:05, 10.06s/it]
 32%|███▏      | 12038/37963 [37:27:54<72:21:28, 10.05s/it]
 32%|███▏      | 12039/37963 [37:28:03<72:07:25, 10.02s/it]
 32%|███▏      | 12040/37963 [37:28:14<72:13:25, 10.03s/it]
                                                           
{'loss': '0.1697', 'grad_norm': '1.878', 'learning_rate': '1.598e-05', 'epoch': '0.3172'}

 32%|███▏      | 12040/37963 [37:28:14<72:13:25, 10.03s/it]
 32%|███▏      | 12041/37963 [37:28:30<86:15:33, 11.98s/it]
 32%|███▏      | 12042/37963 [37:28:47<97:07:29, 13.49s/it]
 32%|███▏      | 12043/37963 [37:28:57<89:43:02, 12.46s/it]
 32%|███▏      | 12044/37963 [37:29:07<84:52:03, 11.79s/it]
 32%|███▏      | 12045/37963 [37:29:17<81:15:43, 11.29s/it]
 32%|███▏      | 12046/37963 [37:29:34<92:49:59, 12.89s/it]
 32%|███▏      | 12047/37963 [37:29:44<86:39:58, 12.04s/it]
 32%|███▏      | 12048/37963 [37:29:54<82:42:20, 11.49s/it]
 32%|███▏      | 12049/37963 [37:30:05<79:55:20, 11.10s/it]
 32%|███▏      | 12050/37963 [37:30:21<92:08:31, 12.80s/it]
                                                           
{'loss': '0.1669', 'grad_norm': '1.662', 'learning_rate': '1.597e-05', 'epoch': '0.3174'}

 32%|███▏      | 12050/37963 [37:30:21<92:08:31, 12.80s/it]
 32%|███▏      | 12051/37963 [37:30:31<85:52:30, 11.93s/it]
 32%|███▏      | 12052/37963 [37:30:41<81:35:04, 11.34s/it]
 32%|███▏      | 12053/37963 [37:30:51<78:59:10, 10.97s/it]
 32%|███▏      | 12054/37963 [37:31:08<90:47:49, 12.62s/it]
 32%|███▏      | 12055/37963 [37:31:18<85:41:24, 11.91s/it]
 32%|███▏      | 12056/37963 [37:31:28<81:39:34, 11.35s/it]
 32%|███▏      | 12057/37963 [37:31:37<77:32:48, 10.78s/it]
 32%|███▏      | 12058/37963 [37:31:48<76:23:52, 10.62s/it]
 32%|███▏      | 12059/37963 [37:31:57<74:29:56, 10.35s/it]
 32%|███▏      | 12060/37963 [37:32:08<73:59:37, 10.28s/it]
                                                           
{'loss': '0.1588', 'grad_norm': '2.026', 'learning_rate': '1.597e-05', 'epoch': '0.3177'}

 32%|███▏      | 12060/37963 [37:32:08<73:59:37, 10.28s/it]
 32%|███▏      | 12061/37963 [37:32:17<72:56:23, 10.14s/it]
 32%|███▏      | 12062/37963 [37:32:27<72:39:54, 10.10s/it]
 32%|███▏      | 12063/37963 [37:32:37<71:24:09,  9.92s/it]
 32%|███▏      | 12064/37963 [37:32:47<71:57:17, 10.00s/it]
 32%|███▏      | 12065/37963 [37:32:57<72:12:34, 10.04s/it]
 32%|███▏      | 12066/37963 [37:33:07<72:15:40, 10.05s/it]
 32%|███▏      | 12067/37963 [37:33:17<72:23:24, 10.06s/it]
 32%|███▏      | 12068/37963 [37:33:27<72:19:02, 10.05s/it]
 32%|███▏      | 12069/37963 [37:33:44<86:58:07, 12.09s/it]
 32%|███▏      | 12070/37963 [37:33:54<82:42:29, 11.50s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '1.071', 'learning_rate': '1.596e-05', 'epoch': '0.3179'}

 32%|███▏      | 12070/37963 [37:33:54<82:42:29, 11.50s/it]
 32%|███▏      | 12071/37963 [37:34:04<79:43:29, 11.08s/it]
 32%|███▏      | 12072/37963 [37:34:15<77:32:01, 10.78s/it]
 32%|███▏      | 12073/37963 [37:34:24<75:34:34, 10.51s/it]
 32%|███▏      | 12074/37963 [37:34:41<88:19:22, 12.28s/it]
 32%|███▏      | 12075/37963 [37:34:51<83:43:14, 11.64s/it]
 32%|███▏      | 12076/37963 [37:35:01<79:24:25, 11.04s/it]
 32%|███▏      | 12077/37963 [37:35:17<91:01:08, 12.66s/it]
 32%|███▏      | 12078/37963 [37:35:27<85:09:01, 11.84s/it]
 32%|███▏      | 12079/37963 [37:35:37<81:29:27, 11.33s/it]
 32%|███▏      | 12080/37963 [37:35:47<78:34:17, 10.93s/it]
                                                           
{'loss': '0.1703', 'grad_norm': '1.16', 'learning_rate': '1.595e-05', 'epoch': '0.3182'}

 32%|███▏      | 12080/37963 [37:35:47<78:34:17, 10.93s/it]
 32%|███▏      | 12081/37963 [37:35:57<76:49:04, 10.68s/it]
 32%|███▏      | 12082/37963 [37:36:07<74:51:30, 10.41s/it]
 32%|███▏      | 12083/37963 [37:36:17<74:07:08, 10.31s/it]
 32%|███▏      | 12084/37963 [37:36:27<73:39:41, 10.25s/it]
 32%|███▏      | 12085/37963 [37:36:37<72:43:49, 10.12s/it]
 32%|███▏      | 12086/37963 [37:36:47<72:02:46, 10.02s/it]
 32%|███▏      | 12087/37963 [37:36:57<72:02:59, 10.02s/it]
 32%|███▏      | 12088/37963 [37:37:07<72:07:08, 10.03s/it]
 32%|███▏      | 12089/37963 [37:37:23<86:01:51, 11.97s/it]
 32%|███▏      | 12090/37963 [37:37:40<96:48:00, 13.47s/it]
                                                           
{'loss': '0.1702', 'grad_norm': '3.59', 'learning_rate': '1.594e-05', 'epoch': '0.3185'}

 32%|███▏      | 12090/37963 [37:37:40<96:48:00, 13.47s/it]
 32%|███▏      | 12091/37963 [37:37:50<88:45:07, 12.35s/it]
 32%|███▏      | 12092/37963 [37:38:00<84:12:07, 11.72s/it]
 32%|███▏      | 12093/37963 [37:38:11<80:51:02, 11.25s/it]
 32%|███▏      | 12094/37963 [37:38:20<78:00:21, 10.86s/it]
 32%|███▏      | 12095/37963 [37:38:37<90:10:38, 12.55s/it]
 32%|███▏      | 12096/37963 [37:38:47<85:01:51, 11.83s/it]
 32%|███▏      | 12097/37963 [37:39:04<94:52:54, 13.21s/it]
 32%|███▏      | 12098/37963 [37:39:14<88:16:20, 12.29s/it]
 32%|███▏      | 12099/37963 [37:39:24<83:22:11, 11.60s/it]
 32%|███▏      | 12100/37963 [37:39:34<79:54:25, 11.12s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '0.7049', 'learning_rate': '1.594e-05', 'epoch': '0.3187'}

 32%|███▏      | 12100/37963 [37:39:34<79:54:25, 11.12s/it]
 32%|███▏      | 12101/37963 [37:39:50<91:41:09, 12.76s/it]
 32%|███▏      | 12102/37963 [37:40:00<85:56:55, 11.96s/it]
 32%|███▏      | 12103/37963 [37:40:10<81:59:10, 11.41s/it]
 32%|███▏      | 12104/37963 [37:40:21<79:14:53, 11.03s/it]
 32%|███▏      | 12105/37963 [37:40:31<77:24:13, 10.78s/it]
 32%|███▏      | 12106/37963 [37:40:41<75:57:10, 10.57s/it]
 32%|███▏      | 12107/37963 [37:40:51<74:44:16, 10.41s/it]
 32%|███▏      | 12108/37963 [37:41:01<74:13:01, 10.33s/it]
 32%|███▏      | 12109/37963 [37:41:11<73:33:17, 10.24s/it]
 32%|███▏      | 12110/37963 [37:41:21<73:13:47, 10.20s/it]
                                                           
{'loss': '0.1625', 'grad_norm': '1.613', 'learning_rate': '1.593e-05', 'epoch': '0.319'}

 32%|███▏      | 12110/37963 [37:41:21<73:13:47, 10.20s/it]
 32%|███▏      | 12111/37963 [37:41:31<73:00:23, 10.17s/it]
 32%|███▏      | 12112/37963 [37:41:41<71:57:07, 10.02s/it]
 32%|███▏      | 12113/37963 [37:41:51<72:09:15, 10.05s/it]
 32%|███▏      | 12114/37963 [37:42:01<71:39:07,  9.98s/it]
 32%|███▏      | 12115/37963 [37:42:11<71:44:39,  9.99s/it]
 32%|███▏      | 12116/37963 [37:42:21<71:57:13, 10.02s/it]
 32%|███▏      | 12117/37963 [37:42:31<71:17:53,  9.93s/it]
 32%|███▏      | 12118/37963 [37:42:48<86:20:45, 12.03s/it]
 32%|███▏      | 12119/37963 [37:42:58<81:51:03, 11.40s/it]
 32%|███▏      | 12120/37963 [37:43:08<78:50:01, 10.98s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '0.9562', 'learning_rate': '1.592e-05', 'epoch': '0.3193'}

 32%|███▏      | 12120/37963 [37:43:08<78:50:01, 10.98s/it]
 32%|███▏      | 12121/37963 [37:43:18<76:57:13, 10.72s/it]
 32%|███▏      | 12122/37963 [37:43:28<75:41:31, 10.54s/it]
 32%|███▏      | 12123/37963 [37:43:38<74:41:56, 10.41s/it]
 32%|███▏      | 12124/37963 [37:43:48<74:24:05, 10.37s/it]
 32%|███▏      | 12125/37963 [37:44:05<87:20:55, 12.17s/it]
 32%|███▏      | 12126/37963 [37:44:21<96:47:16, 13.49s/it]
 32%|███▏      | 12127/37963 [37:44:31<89:22:49, 12.45s/it]
 32%|███▏      | 12128/37963 [37:44:41<84:18:14, 11.75s/it]
 32%|███▏      | 12129/37963 [37:44:51<80:20:43, 11.20s/it]
 32%|███▏      | 12130/37963 [37:45:01<77:49:04, 10.84s/it]
                                                           
{'loss': '0.1722', 'grad_norm': '1.589', 'learning_rate': '1.592e-05', 'epoch': '0.3195'}

 32%|███▏      | 12130/37963 [37:45:01<77:49:04, 10.84s/it]
 32%|███▏      | 12131/37963 [37:45:11<76:06:38, 10.61s/it]
 32%|███▏      | 12132/37963 [37:45:21<74:37:06, 10.40s/it]
 32%|███▏      | 12133/37963 [37:45:32<74:32:57, 10.39s/it]
 32%|███▏      | 12134/37963 [37:45:42<73:45:46, 10.28s/it]
 32%|███▏      | 12135/37963 [37:45:52<73:23:20, 10.23s/it]
 32%|███▏      | 12136/37963 [37:46:02<73:04:44, 10.19s/it]
 32%|███▏      | 12137/37963 [37:46:18<85:47:31, 11.96s/it]
 32%|███▏      | 12138/37963 [37:46:35<96:42:34, 13.48s/it]
 32%|███▏      | 12139/37963 [37:46:45<89:23:09, 12.46s/it]
 32%|███▏      | 12140/37963 [37:46:55<84:39:34, 11.80s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '0.9082', 'learning_rate': '1.591e-05', 'epoch': '0.3198'}

 32%|███▏      | 12140/37963 [37:46:55<84:39:34, 11.80s/it]
 32%|███▏      | 12141/37963 [37:47:05<80:59:15, 11.29s/it]
 32%|███▏      | 12142/37963 [37:47:15<78:26:03, 10.94s/it]
 32%|███▏      | 12143/37963 [37:47:32<90:06:20, 12.56s/it]
 32%|███▏      | 12144/37963 [37:47:42<84:47:12, 11.82s/it]
 32%|███▏      | 12145/37963 [37:47:58<94:58:11, 13.24s/it]
 32%|███▏      | 12146/37963 [37:48:09<88:41:03, 12.37s/it]
 32%|███▏      | 12147/37963 [37:48:19<83:50:00, 11.69s/it]
 32%|███▏      | 12148/37963 [37:48:29<79:55:34, 11.15s/it]
 32%|███▏      | 12149/37963 [37:48:39<77:41:48, 10.84s/it]
 32%|███▏      | 12150/37963 [37:48:49<76:34:45, 10.68s/it]
                                                           
{'loss': '0.1683', 'grad_norm': '3.255', 'learning_rate': '1.59e-05', 'epoch': '0.32'}

 32%|███▏      | 12150/37963 [37:48:49<76:34:45, 10.68s/it]
 32%|███▏      | 12151/37963 [37:49:05<88:00:46, 12.28s/it]
 32%|███▏      | 12152/37963 [37:49:15<83:19:58, 11.62s/it]
 32%|███▏      | 12153/37963 [37:49:25<80:10:42, 11.18s/it]
 32%|███▏      | 12154/37963 [37:49:35<76:58:19, 10.74s/it]
 32%|███▏      | 12155/37963 [37:49:45<75:33:50, 10.54s/it]
 32%|███▏      | 12156/37963 [37:49:55<73:33:41, 10.26s/it]
 32%|███▏      | 12157/37963 [37:50:05<73:02:31, 10.19s/it]
 32%|███▏      | 12158/37963 [37:50:15<73:00:52, 10.19s/it]
 32%|███▏      | 12159/37963 [37:50:25<72:36:19, 10.13s/it]
 32%|███▏      | 12160/37963 [37:50:35<72:22:10, 10.10s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '1.597', 'learning_rate': '1.59e-05', 'epoch': '0.3203'}

 32%|███▏      | 12160/37963 [37:50:35<72:22:10, 10.10s/it]
 32%|███▏      | 12161/37963 [37:50:45<71:43:36, 10.01s/it]
 32%|███▏      | 12162/37963 [37:50:55<71:50:54, 10.02s/it]
 32%|███▏      | 12163/37963 [37:51:05<72:16:25, 10.08s/it]
 32%|███▏      | 12164/37963 [37:51:15<71:49:23, 10.02s/it]
 32%|███▏      | 12165/37963 [37:51:25<71:47:25, 10.02s/it]
 32%|███▏      | 12166/37963 [37:51:42<86:19:34, 12.05s/it]
 32%|███▏      | 12167/37963 [37:51:52<82:11:01, 11.47s/it]
 32%|███▏      | 12168/37963 [37:52:02<79:09:30, 11.05s/it]
 32%|███▏      | 12169/37963 [37:52:12<76:59:57, 10.75s/it]
 32%|███▏      | 12170/37963 [37:52:22<75:20:08, 10.51s/it]
                                                           
{'loss': '0.1675', 'grad_norm': '1.585', 'learning_rate': '1.589e-05', 'epoch': '0.3206'}

 32%|███▏      | 12170/37963 [37:52:22<75:20:08, 10.51s/it]
 32%|███▏      | 12171/37963 [37:52:38<87:40:02, 12.24s/it]
 32%|███▏      | 12172/37963 [37:52:48<83:06:31, 11.60s/it]
 32%|███▏      | 12173/37963 [37:52:59<79:55:28, 11.16s/it]
 32%|███▏      | 12174/37963 [37:53:09<77:31:43, 10.82s/it]
 32%|███▏      | 12175/37963 [37:53:25<89:33:08, 12.50s/it]
 32%|███▏      | 12176/37963 [37:53:35<84:15:52, 11.76s/it]
 32%|███▏      | 12177/37963 [37:53:45<80:42:38, 11.27s/it]
 32%|███▏      | 12178/37963 [37:53:55<78:06:03, 10.90s/it]
 32%|███▏      | 12179/37963 [37:54:05<75:58:47, 10.61s/it]
 32%|███▏      | 12180/37963 [37:54:15<74:14:27, 10.37s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '4.376', 'learning_rate': '1.588e-05', 'epoch': '0.3208'}

 32%|███▏      | 12180/37963 [37:54:15<74:14:27, 10.37s/it]
 32%|███▏      | 12181/37963 [37:54:25<72:47:36, 10.16s/it]
 32%|███▏      | 12182/37963 [37:54:35<72:47:16, 10.16s/it]
 32%|███▏      | 12183/37963 [37:54:44<71:49:56, 10.03s/it]
 32%|███▏      | 12184/37963 [37:54:55<71:59:11, 10.05s/it]
 32%|███▏      | 12185/37963 [37:55:11<85:28:28, 11.94s/it]
 32%|███▏      | 12186/37963 [37:55:28<96:41:25, 13.50s/it]
 32%|███▏      | 12187/37963 [37:55:38<89:16:52, 12.47s/it]
 32%|███▏      | 12188/37963 [37:55:48<84:36:03, 11.82s/it]
 32%|███▏      | 12189/37963 [37:55:58<80:10:03, 11.20s/it]
 32%|███▏      | 12190/37963 [37:56:08<77:46:35, 10.86s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '1.263', 'learning_rate': '1.588e-05', 'epoch': '0.3211'}

 32%|███▏      | 12190/37963 [37:56:08<77:46:35, 10.86s/it]
 32%|███▏      | 12191/37963 [37:56:25<90:26:45, 12.63s/it]
 32%|███▏      | 12192/37963 [37:56:35<84:53:49, 11.86s/it]
 32%|███▏      | 12193/37963 [37:56:52<95:06:03, 13.29s/it]
 32%|███▏      | 12194/37963 [37:57:02<87:44:40, 12.26s/it]
 32%|███▏      | 12195/37963 [37:57:12<83:08:04, 11.61s/it]
 32%|███▏      | 12196/37963 [37:57:21<79:08:26, 11.06s/it]
 32%|███▏      | 12197/37963 [37:57:32<77:03:14, 10.77s/it]
 32%|███▏      | 12198/37963 [37:57:42<75:27:54, 10.54s/it]
 32%|███▏      | 12199/37963 [37:57:58<88:28:58, 12.36s/it]
 32%|███▏      | 12200/37963 [37:58:08<83:30:47, 11.67s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '0.8395', 'learning_rate': '1.587e-05', 'epoch': '0.3214'}

 32%|███▏      | 12200/37963 [37:58:08<83:30:47, 11.67s/it]
 32%|███▏      | 12201/37963 [37:58:18<80:08:58, 11.20s/it]
 32%|███▏      | 12202/37963 [37:58:28<77:39:44, 10.85s/it]
 32%|███▏      | 12203/37963 [37:58:38<75:22:12, 10.53s/it]
 32%|███▏      | 12204/37963 [37:58:48<74:29:17, 10.41s/it]
 32%|███▏      | 12205/37963 [37:58:58<73:44:30, 10.31s/it]
 32%|███▏      | 12206/37963 [37:59:08<72:56:20, 10.19s/it]
 32%|███▏      | 12207/37963 [37:59:18<72:52:17, 10.19s/it]
 32%|███▏      | 12208/37963 [37:59:29<72:44:09, 10.17s/it]
 32%|███▏      | 12209/37963 [37:59:38<72:01:19, 10.07s/it]
 32%|███▏      | 12210/37963 [37:59:48<71:54:55, 10.05s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '2.167', 'learning_rate': '1.586e-05', 'epoch': '0.3216'}

 32%|███▏      | 12210/37963 [37:59:48<71:54:55, 10.05s/it]
 32%|███▏      | 12211/37963 [37:59:58<71:58:11, 10.06s/it]
 32%|███▏      | 12212/37963 [38:00:08<71:37:35, 10.01s/it]
 32%|███▏      | 12213/37963 [38:00:18<71:43:40, 10.03s/it]
 32%|███▏      | 12214/37963 [38:00:29<71:51:06, 10.05s/it]
 32%|███▏      | 12215/37963 [38:00:46<86:50:13, 12.14s/it]
 32%|███▏      | 12216/37963 [38:00:56<82:20:08, 11.51s/it]
 32%|███▏      | 12217/37963 [38:01:06<79:20:36, 11.09s/it]
 32%|███▏      | 12218/37963 [38:01:16<77:17:10, 10.81s/it]
 32%|███▏      | 12219/37963 [38:01:26<75:44:14, 10.59s/it]
 32%|███▏      | 12220/37963 [38:01:36<73:48:08, 10.32s/it]
                                                           
{'loss': '0.1825', 'grad_norm': '1.271', 'learning_rate': '1.586e-05', 'epoch': '0.3219'}

 32%|███▏      | 12220/37963 [38:01:36<73:48:08, 10.32s/it]
 32%|███▏      | 12221/37963 [38:01:52<87:11:34, 12.19s/it]
 32%|███▏      | 12222/37963 [38:02:02<82:35:05, 11.55s/it]
 32%|███▏      | 12223/37963 [38:02:19<92:56:21, 13.00s/it]
 32%|███▏      | 12224/37963 [38:02:29<86:51:07, 12.15s/it]
 32%|███▏      | 12225/37963 [38:02:39<82:22:49, 11.52s/it]
 32%|███▏      | 12226/37963 [38:02:49<79:14:06, 11.08s/it]
 32%|███▏      | 12227/37963 [38:02:59<76:28:42, 10.70s/it]
 32%|███▏      | 12228/37963 [38:03:09<75:14:51, 10.53s/it]
 32%|███▏      | 12229/37963 [38:03:19<73:39:07, 10.30s/it]
 32%|███▏      | 12230/37963 [38:03:29<73:08:52, 10.23s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '0.6336', 'learning_rate': '1.585e-05', 'epoch': '0.3222'}

 32%|███▏      | 12230/37963 [38:03:29<73:08:52, 10.23s/it]
 32%|███▏      | 12231/37963 [38:03:38<72:11:46, 10.10s/it]
 32%|███▏      | 12232/37963 [38:03:49<72:15:27, 10.11s/it]
 32%|███▏      | 12233/37963 [38:04:05<86:26:54, 12.10s/it]
 32%|███▏      | 12234/37963 [38:04:16<82:18:51, 11.52s/it]
 32%|███▏      | 12235/37963 [38:04:33<94:19:51, 13.20s/it]
 32%|███▏      | 12236/37963 [38:04:43<87:45:20, 12.28s/it]
 32%|███▏      | 12237/37963 [38:04:53<83:18:29, 11.66s/it]
 32%|███▏      | 12238/37963 [38:05:03<80:06:31, 11.21s/it]
 32%|███▏      | 12239/37963 [38:05:20<91:24:57, 12.79s/it]
 32%|███▏      | 12240/37963 [38:05:36<99:25:14, 13.91s/it]
                                                           
{'loss': '0.1636', 'grad_norm': '3.43', 'learning_rate': '1.584e-05', 'epoch': '0.3224'}

 32%|███▏      | 12240/37963 [38:05:36<99:25:14, 13.91s/it]
 32%|███▏      | 12241/37963 [38:05:46<90:59:01, 12.73s/it]
 32%|███▏      | 12242/37963 [38:05:56<85:21:46, 11.95s/it]
 32%|███▏      | 12243/37963 [38:06:06<80:44:01, 11.30s/it]
 32%|███▏      | 12244/37963 [38:06:16<77:35:56, 10.86s/it]
 32%|███▏      | 12245/37963 [38:06:26<75:56:45, 10.63s/it]
 32%|███▏      | 12246/37963 [38:06:36<74:09:35, 10.38s/it]
 32%|███▏      | 12247/37963 [38:06:45<72:26:50, 10.14s/it]
 32%|███▏      | 12248/37963 [38:07:02<85:56:43, 12.03s/it]
 32%|███▏      | 12249/37963 [38:07:12<81:40:37, 11.43s/it]
 32%|███▏      | 12250/37963 [38:07:22<78:52:42, 11.04s/it]
                                                           
{'loss': '0.1693', 'grad_norm': '1.368', 'learning_rate': '1.583e-05', 'epoch': '0.3227'}

 32%|███▏      | 12250/37963 [38:07:22<78:52:42, 11.04s/it]
 32%|███▏      | 12251/37963 [38:07:32<76:57:03, 10.77s/it]
 32%|███▏      | 12252/37963 [38:07:42<75:21:48, 10.55s/it]
 32%|███▏      | 12253/37963 [38:07:52<74:21:14, 10.41s/it]
 32%|███▏      | 12254/37963 [38:08:02<73:21:39, 10.27s/it]
 32%|███▏      | 12255/37963 [38:08:12<73:08:59, 10.24s/it]
 32%|███▏      | 12256/37963 [38:08:22<72:42:27, 10.18s/it]
 32%|███▏      | 12257/37963 [38:08:32<72:04:57, 10.09s/it]
 32%|███▏      | 12258/37963 [38:08:42<72:08:00, 10.10s/it]
 32%|███▏      | 12259/37963 [38:08:53<72:11:36, 10.11s/it]
 32%|███▏      | 12260/37963 [38:09:02<71:38:57, 10.04s/it]
                                                           
{'loss': '0.1731', 'grad_norm': '3.211', 'learning_rate': '1.583e-05', 'epoch': '0.3229'}

 32%|███▏      | 12260/37963 [38:09:02<71:38:57, 10.04s/it]
 32%|███▏      | 12261/37963 [38:09:12<70:31:59,  9.88s/it]
 32%|███▏      | 12262/37963 [38:09:22<71:01:33,  9.95s/it]
 32%|███▏      | 12263/37963 [38:09:32<71:17:20,  9.99s/it]
 32%|███▏      | 12264/37963 [38:09:49<86:59:48, 12.19s/it]
 32%|███▏      | 12265/37963 [38:09:59<82:20:49, 11.54s/it]
 32%|███▏      | 12266/37963 [38:10:10<79:23:56, 11.12s/it]
 32%|███▏      | 12267/37963 [38:10:20<77:11:28, 10.81s/it]
 32%|███▏      | 12268/37963 [38:10:30<75:38:05, 10.60s/it]
 32%|███▏      | 12269/37963 [38:10:46<86:56:45, 12.18s/it]
 32%|███▏      | 12270/37963 [38:10:56<82:20:22, 11.54s/it]
                                                           
{'loss': '0.15', 'grad_norm': '2.291', 'learning_rate': '1.582e-05', 'epoch': '0.3232'}

 32%|███▏      | 12270/37963 [38:10:56<82:20:22, 11.54s/it]
 32%|███▏      | 12271/37963 [38:11:12<92:56:48, 13.02s/it]
 32%|███▏      | 12272/37963 [38:11:22<86:44:18, 12.15s/it]
 32%|███▏      | 12273/37963 [38:11:32<82:20:49, 11.54s/it]
 32%|███▏      | 12274/37963 [38:11:43<79:16:07, 11.11s/it]
 32%|███▏      | 12275/37963 [38:11:53<77:09:35, 10.81s/it]
 32%|███▏      | 12276/37963 [38:12:03<75:29:36, 10.58s/it]
 32%|███▏      | 12277/37963 [38:12:13<74:19:20, 10.42s/it]
 32%|███▏      | 12278/37963 [38:12:23<73:38:10, 10.32s/it]
 32%|███▏      | 12279/37963 [38:12:33<73:05:22, 10.24s/it]
 32%|███▏      | 12280/37963 [38:12:42<71:38:53, 10.04s/it]
                                                           
{'loss': '0.1595', 'grad_norm': '1.014', 'learning_rate': '1.581e-05', 'epoch': '0.3235'}

 32%|███▏      | 12280/37963 [38:12:42<71:38:53, 10.04s/it]
 32%|███▏      | 12281/37963 [38:12:52<71:01:28,  9.96s/it]
 32%|███▏      | 12282/37963 [38:13:09<85:41:23, 12.01s/it]
 32%|███▏      | 12283/37963 [38:13:26<97:10:00, 13.62s/it]
 32%|███▏      | 12284/37963 [38:13:36<89:35:54, 12.56s/it]
 32%|███▏      | 12285/37963 [38:13:47<84:19:16, 11.82s/it]
 32%|███▏      | 12286/37963 [38:14:03<94:11:41, 13.21s/it]
 32%|███▏      | 12287/37963 [38:14:13<87:03:43, 12.21s/it]
 32%|███▏      | 12288/37963 [38:14:23<82:27:17, 11.56s/it]
 32%|███▏      | 12289/37963 [38:14:39<92:35:43, 12.98s/it]
 32%|███▏      | 12290/37963 [38:14:49<85:25:20, 11.98s/it]
                                                           
{'loss': '0.178', 'grad_norm': '2.332', 'learning_rate': '1.581e-05', 'epoch': '0.3237'}

 32%|███▏      | 12290/37963 [38:14:49<85:25:20, 11.98s/it]
 32%|███▏      | 12291/37963 [38:14:59<81:26:50, 11.42s/it]
 32%|███▏      | 12292/37963 [38:15:09<78:39:39, 11.03s/it]
 32%|███▏      | 12293/37963 [38:15:19<76:47:50, 10.77s/it]
 32%|███▏      | 12294/37963 [38:15:29<75:11:18, 10.54s/it]
 32%|███▏      | 12295/37963 [38:15:39<73:54:31, 10.37s/it]
 32%|███▏      | 12296/37963 [38:15:56<87:22:39, 12.26s/it]
 32%|███▏      | 12297/37963 [38:16:06<82:07:49, 11.52s/it]
 32%|███▏      | 12298/37963 [38:16:16<79:10:22, 11.11s/it]
 32%|███▏      | 12299/37963 [38:16:26<77:00:18, 10.80s/it]
 32%|███▏      | 12300/37963 [38:16:36<75:20:32, 10.57s/it]
                                                           
{'loss': '0.1748', 'grad_norm': '0.7802', 'learning_rate': '1.58e-05', 'epoch': '0.324'}

 32%|███▏      | 12300/37963 [38:16:36<75:20:32, 10.57s/it]
 32%|███▏      | 12301/37963 [38:16:46<74:01:23, 10.38s/it]
 32%|███▏      | 12302/37963 [38:16:56<72:47:50, 10.21s/it]
 32%|███▏      | 12303/37963 [38:17:06<72:38:54, 10.19s/it]
 32%|███▏      | 12304/37963 [38:17:16<72:22:30, 10.15s/it]
 32%|███▏      | 12305/37963 [38:17:26<72:17:30, 10.14s/it]
 32%|███▏      | 12306/37963 [38:17:36<72:06:38, 10.12s/it]
 32%|███▏      | 12307/37963 [38:17:46<71:53:46, 10.09s/it]
 32%|███▏      | 12308/37963 [38:17:56<71:31:45, 10.04s/it]
 32%|███▏      | 12309/37963 [38:18:06<71:39:23, 10.06s/it]
 32%|███▏      | 12310/37963 [38:18:16<71:05:46,  9.98s/it]
                                                           
{'loss': '0.1732', 'grad_norm': '1.112', 'learning_rate': '1.579e-05', 'epoch': '0.3243'}

 32%|███▏      | 12310/37963 [38:18:16<71:05:46,  9.98s/it]
 32%|███▏      | 12311/37963 [38:18:26<71:33:40, 10.04s/it]
 32%|███▏      | 12312/37963 [38:18:43<85:25:21, 11.99s/it]
 32%|███▏      | 12313/37963 [38:18:53<81:30:08, 11.44s/it]
 32%|███▏      | 12314/37963 [38:19:03<78:27:39, 11.01s/it]
 32%|███▏      | 12315/37963 [38:19:13<76:25:51, 10.73s/it]
 32%|███▏      | 12316/37963 [38:19:23<74:27:27, 10.45s/it]
 32%|███▏      | 12317/37963 [38:19:33<73:43:11, 10.35s/it]
 32%|███▏      | 12318/37963 [38:19:43<72:49:02, 10.22s/it]
 32%|███▏      | 12319/37963 [38:20:06<99:40:54, 13.99s/it]
 32%|███▏      | 12320/37963 [38:20:16<91:10:13, 12.80s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '2.712', 'learning_rate': '1.579e-05', 'epoch': '0.3245'}

 32%|███▏      | 12320/37963 [38:20:16<91:10:13, 12.80s/it]
 32%|███▏      | 12321/37963 [38:20:26<85:23:40, 11.99s/it]
 32%|███▏      | 12322/37963 [38:20:36<81:29:08, 11.44s/it]
 32%|███▏      | 12323/37963 [38:20:46<78:41:03, 11.05s/it]
 32%|███▏      | 12324/37963 [38:20:56<76:30:47, 10.74s/it]
 32%|███▏      | 12325/37963 [38:21:06<75:00:54, 10.53s/it]
 32%|███▏      | 12326/37963 [38:21:16<74:22:13, 10.44s/it]
 32%|███▏      | 12327/37963 [38:21:26<73:23:25, 10.31s/it]
 32%|███▏      | 12328/37963 [38:21:36<73:00:18, 10.25s/it]
 32%|███▏      | 12329/37963 [38:21:53<87:15:37, 12.25s/it]
 32%|███▏      | 12330/37963 [38:22:03<82:36:26, 11.60s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '1.193', 'learning_rate': '1.578e-05', 'epoch': '0.3248'}

 32%|███▏      | 12330/37963 [38:22:03<82:36:26, 11.60s/it]
 32%|███▏      | 12331/37963 [38:22:19<92:12:04, 12.95s/it]
 32%|███▏      | 12332/37963 [38:22:30<86:24:11, 12.14s/it]
 32%|███▏      | 12333/37963 [38:22:46<95:49:29, 13.46s/it]
 32%|███▏      | 12334/37963 [38:22:56<88:38:50, 12.45s/it]
 32%|███▏      | 12335/37963 [38:23:06<83:36:48, 11.75s/it]
 32%|███▏      | 12336/37963 [38:23:16<79:54:07, 11.22s/it]
 32%|███▏      | 12337/37963 [38:23:27<77:38:15, 10.91s/it]
 33%|███▎      | 12338/37963 [38:23:37<75:54:24, 10.66s/it]
 33%|███▎      | 12339/37963 [38:23:53<88:33:02, 12.44s/it]
 33%|███▎      | 12340/37963 [38:24:03<83:25:09, 11.72s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '1.61', 'learning_rate': '1.577e-05', 'epoch': '0.3251'}

 33%|███▎      | 12340/37963 [38:24:03<83:25:09, 11.72s/it]
 33%|███▎      | 12341/37963 [38:24:13<79:54:00, 11.23s/it]
 33%|███▎      | 12342/37963 [38:24:23<77:01:02, 10.82s/it]
 33%|███▎      | 12343/37963 [38:24:33<75:29:14, 10.61s/it]
 33%|███▎      | 12344/37963 [38:24:43<74:18:53, 10.44s/it]
 33%|███▎      | 12345/37963 [38:24:53<72:56:15, 10.25s/it]
 33%|███▎      | 12346/37963 [38:25:10<85:45:38, 12.05s/it]
 33%|███▎      | 12347/37963 [38:25:20<81:34:04, 11.46s/it]
 33%|███▎      | 12348/37963 [38:25:29<78:07:23, 10.98s/it]
 33%|███▎      | 12349/37963 [38:25:39<75:29:28, 10.61s/it]
 33%|███▎      | 12350/37963 [38:25:49<73:42:25, 10.36s/it]
                                                           
{'loss': '0.1772', 'grad_norm': '1.184', 'learning_rate': '1.576e-05', 'epoch': '0.3253'}

 33%|███▎      | 12350/37963 [38:25:49<73:42:25, 10.36s/it]
 33%|███▎      | 12351/37963 [38:25:59<73:08:57, 10.28s/it]
 33%|███▎      | 12352/37963 [38:26:09<72:33:43, 10.20s/it]
 33%|███▎      | 12353/37963 [38:26:19<72:20:30, 10.17s/it]
 33%|███▎      | 12354/37963 [38:26:29<72:05:33, 10.13s/it]
 33%|███▎      | 12355/37963 [38:26:39<71:19:34, 10.03s/it]
 33%|███▎      | 12356/37963 [38:26:49<71:21:00, 10.03s/it]
 33%|███▎      | 12357/37963 [38:26:59<71:21:54, 10.03s/it]
 33%|███▎      | 12358/37963 [38:27:09<71:22:43, 10.04s/it]
 33%|███▎      | 12359/37963 [38:27:19<71:35:25, 10.07s/it]
 33%|███▎      | 12360/37963 [38:27:29<71:33:18, 10.06s/it]
                                                           
{'loss': '0.165', 'grad_norm': '1.748', 'learning_rate': '1.576e-05', 'epoch': '0.3256'}

 33%|███▎      | 12360/37963 [38:27:29<71:33:18, 10.06s/it]
 33%|███▎      | 12361/37963 [38:27:46<86:10:33, 12.12s/it]
 33%|███▎      | 12362/37963 [38:27:56<81:59:11, 11.53s/it]
 33%|███▎      | 12363/37963 [38:28:06<78:47:01, 11.08s/it]
 33%|███▎      | 12364/37963 [38:28:17<76:38:47, 10.78s/it]
 33%|███▎      | 12365/37963 [38:28:27<75:02:13, 10.55s/it]
 33%|███▎      | 12366/37963 [38:28:37<73:58:17, 10.40s/it]
 33%|███▎      | 12367/37963 [38:28:53<85:56:35, 12.09s/it]
 33%|███▎      | 12368/37963 [38:29:09<95:49:08, 13.48s/it]
 33%|███▎      | 12369/37963 [38:29:19<88:22:48, 12.43s/it]
 33%|███▎      | 12370/37963 [38:29:30<83:38:03, 11.76s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '1.036', 'learning_rate': '1.575e-05', 'epoch': '0.3258'}

 33%|███▎      | 12370/37963 [38:29:30<83:38:03, 11.76s/it]
 33%|███▎      | 12371/37963 [38:29:39<79:41:12, 11.21s/it]
 33%|███▎      | 12372/37963 [38:29:50<77:26:12, 10.89s/it]
 33%|███▎      | 12373/37963 [38:30:00<75:28:57, 10.62s/it]
 33%|███▎      | 12374/37963 [38:30:10<73:59:55, 10.41s/it]
 33%|███▎      | 12375/37963 [38:30:19<72:56:20, 10.26s/it]
 33%|███▎      | 12376/37963 [38:30:37<88:27:50, 12.45s/it]
 33%|███▎      | 12377/37963 [38:30:47<83:23:07, 11.73s/it]
 33%|███▎      | 12378/37963 [38:30:57<80:02:08, 11.26s/it]
 33%|███▎      | 12379/37963 [38:31:14<91:01:12, 12.81s/it]
 33%|███▎      | 12380/37963 [38:31:24<85:14:56, 12.00s/it]
                                                           
{'loss': '0.1733', 'grad_norm': '2.413', 'learning_rate': '1.574e-05', 'epoch': '0.3261'}

 33%|███▎      | 12380/37963 [38:31:24<85:14:56, 12.00s/it]
 33%|███▎      | 12381/37963 [38:31:40<95:10:43, 13.39s/it]
 33%|███▎      | 12382/37963 [38:31:51<88:20:29, 12.43s/it]
 33%|███▎      | 12383/37963 [38:32:01<83:04:56, 11.69s/it]
 33%|███▎      | 12384/37963 [38:32:11<79:29:46, 11.19s/it]
 33%|███▎      | 12385/37963 [38:32:21<76:56:14, 10.83s/it]
 33%|███▎      | 12386/37963 [38:32:31<75:22:48, 10.61s/it]
 33%|███▎      | 12387/37963 [38:32:41<74:25:55, 10.48s/it]
 33%|███▎      | 12388/37963 [38:32:57<87:33:54, 12.33s/it]
 33%|███▎      | 12389/37963 [38:33:08<82:48:05, 11.66s/it]
 33%|███▎      | 12390/37963 [38:33:18<79:32:30, 11.20s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '1.504', 'learning_rate': '1.574e-05', 'epoch': '0.3264'}

 33%|███▎      | 12390/37963 [38:33:18<79:32:30, 11.20s/it]
 33%|███▎      | 12391/37963 [38:33:27<75:52:27, 10.68s/it]
 33%|███▎      | 12392/37963 [38:33:37<74:40:38, 10.51s/it]
 33%|███▎      | 12393/37963 [38:33:47<73:39:45, 10.37s/it]
 33%|███▎      | 12394/37963 [38:33:57<73:08:50, 10.30s/it]
 33%|███▎      | 12395/37963 [38:34:14<85:52:12, 12.09s/it]
 33%|███▎      | 12396/37963 [38:34:24<81:48:37, 11.52s/it]
 33%|███▎      | 12397/37963 [38:34:34<78:51:42, 11.10s/it]
 33%|███▎      | 12398/37963 [38:34:44<77:03:02, 10.85s/it]
 33%|███▎      | 12399/37963 [38:34:54<75:05:33, 10.57s/it]
 33%|███▎      | 12400/37963 [38:35:04<74:08:39, 10.44s/it]
                                                           
{'loss': '0.153', 'grad_norm': '1.573', 'learning_rate': '1.573e-05', 'epoch': '0.3266'}

 33%|███▎      | 12400/37963 [38:35:04<74:08:39, 10.44s/it]
 33%|███▎      | 12401/37963 [38:35:14<73:18:35, 10.32s/it]
 33%|███▎      | 12402/37963 [38:35:25<73:09:23, 10.30s/it]
 33%|███▎      | 12403/37963 [38:35:35<72:29:37, 10.21s/it]
 33%|███▎      | 12404/37963 [38:35:45<72:09:54, 10.16s/it]
 33%|███▎      | 12405/37963 [38:35:55<71:51:14, 10.12s/it]
 33%|███▎      | 12406/37963 [38:36:05<71:33:57, 10.08s/it]
 33%|███▎      | 12407/37963 [38:36:15<71:10:35, 10.03s/it]
 33%|███▎      | 12408/37963 [38:36:25<71:13:19, 10.03s/it]
 33%|███▎      | 12409/37963 [38:36:34<69:58:42,  9.86s/it]
 33%|███▎      | 12410/37963 [38:36:51<85:23:44, 12.03s/it]
                                                           
{'loss': '0.1746', 'grad_norm': '3.042', 'learning_rate': '1.572e-05', 'epoch': '0.3269'}

 33%|███▎      | 12410/37963 [38:36:51<85:23:44, 12.03s/it]
 33%|███▎      | 12411/37963 [38:37:01<81:14:00, 11.44s/it]
 33%|███▎      | 12412/37963 [38:37:11<77:40:45, 10.94s/it]
 33%|███▎      | 12413/37963 [38:37:21<75:20:28, 10.62s/it]
 33%|███▎      | 12414/37963 [38:37:31<74:27:01, 10.49s/it]
 33%|███▎      | 12415/37963 [38:37:48<88:01:12, 12.40s/it]
 33%|███▎      | 12416/37963 [38:37:58<82:39:07, 11.65s/it]
 33%|███▎      | 12417/37963 [38:38:08<79:25:29, 11.19s/it]
 33%|███▎      | 12418/37963 [38:38:18<76:59:29, 10.85s/it]
 33%|███▎      | 12419/37963 [38:38:28<75:18:31, 10.61s/it]
 33%|███▎      | 12420/37963 [38:38:45<88:19:21, 12.45s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '1.916', 'learning_rate': '1.572e-05', 'epoch': '0.3272'}

 33%|███▎      | 12420/37963 [38:38:45<88:19:21, 12.45s/it]
 33%|███▎      | 12421/37963 [38:38:55<83:18:53, 11.74s/it]
 33%|███▎      | 12422/37963 [38:39:05<79:40:52, 11.23s/it]
 33%|███▎      | 12423/37963 [38:39:22<91:56:32, 12.96s/it]
 33%|███▎      | 12424/37963 [38:39:32<85:50:49, 12.10s/it]
 33%|███▎      | 12425/37963 [38:39:42<81:37:16, 11.51s/it]
 33%|███▎      | 12426/37963 [38:39:59<91:57:44, 12.96s/it]
 33%|███▎      | 12427/37963 [38:40:08<84:25:20, 11.90s/it]
 33%|███▎      | 12428/37963 [38:40:25<94:24:01, 13.31s/it]
 33%|███▎      | 12429/37963 [38:40:35<87:33:16, 12.34s/it]
 33%|███▎      | 12430/37963 [38:40:45<82:18:17, 11.60s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '3.546', 'learning_rate': '1.571e-05', 'epoch': '0.3274'}

 33%|███▎      | 12430/37963 [38:40:45<82:18:17, 11.60s/it]
 33%|███▎      | 12431/37963 [38:40:55<79:00:25, 11.14s/it]
 33%|███▎      | 12432/37963 [38:41:05<76:59:25, 10.86s/it]
 33%|███▎      | 12433/37963 [38:41:15<74:49:05, 10.55s/it]
 33%|███▎      | 12434/37963 [38:41:24<73:10:37, 10.32s/it]
 33%|███▎      | 12435/37963 [38:41:34<72:08:25, 10.17s/it]
 33%|███▎      | 12436/37963 [38:41:44<71:35:36, 10.10s/it]
 33%|███▎      | 12437/37963 [38:42:01<85:02:29, 11.99s/it]
 33%|███▎      | 12438/37963 [38:42:10<80:01:58, 11.29s/it]
 33%|███▎      | 12439/37963 [38:42:20<77:24:28, 10.92s/it]
 33%|███▎      | 12440/37963 [38:42:30<75:18:53, 10.62s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '1.528', 'learning_rate': '1.57e-05', 'epoch': '0.3277'}

 33%|███▎      | 12440/37963 [38:42:30<75:18:53, 10.62s/it]
 33%|███▎      | 12441/37963 [38:42:40<74:09:06, 10.46s/it]
 33%|███▎      | 12442/37963 [38:42:50<73:31:42, 10.37s/it]
 33%|███▎      | 12443/37963 [38:43:00<72:52:11, 10.28s/it]
 33%|███▎      | 12444/37963 [38:43:17<86:03:07, 12.14s/it]
 33%|███▎      | 12445/37963 [38:43:27<81:52:16, 11.55s/it]
 33%|███▎      | 12446/37963 [38:43:37<78:44:26, 11.11s/it]
 33%|███▎      | 12447/37963 [38:43:47<76:31:39, 10.80s/it]
 33%|███▎      | 12448/37963 [38:43:57<74:54:29, 10.57s/it]
 33%|███▎      | 12449/37963 [38:44:08<74:03:06, 10.45s/it]
 33%|███▎      | 12450/37963 [38:44:18<73:06:43, 10.32s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '3.976', 'learning_rate': '1.57e-05', 'epoch': '0.328'}

 33%|███▎      | 12450/37963 [38:44:18<73:06:43, 10.32s/it]
 33%|███▎      | 12451/37963 [38:44:28<72:56:19, 10.29s/it]
 33%|███▎      | 12452/37963 [38:44:38<72:22:00, 10.21s/it]
 33%|███▎      | 12453/37963 [38:44:48<72:12:20, 10.19s/it]
 33%|███▎      | 12454/37963 [38:44:58<72:00:57, 10.16s/it]
 33%|███▎      | 12455/37963 [38:45:08<71:46:02, 10.13s/it]
 33%|███▎      | 12456/37963 [38:45:24<85:08:59, 12.02s/it]
 33%|███▎      | 12457/37963 [38:45:35<80:54:04, 11.42s/it]
 33%|███▎      | 12458/37963 [38:45:45<78:16:01, 11.05s/it]
 33%|███▎      | 12459/37963 [38:45:55<75:41:06, 10.68s/it]
 33%|███▎      | 12460/37963 [38:46:04<74:01:06, 10.45s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '4.796', 'learning_rate': '1.569e-05', 'epoch': '0.3282'}

 33%|███▎      | 12460/37963 [38:46:04<74:01:06, 10.45s/it]
 33%|███▎      | 12461/37963 [38:46:21<86:27:20, 12.20s/it]
 33%|███▎      | 12462/37963 [38:46:30<81:02:10, 11.44s/it]
 33%|███▎      | 12463/37963 [38:46:40<77:54:47, 11.00s/it]
 33%|███▎      | 12464/37963 [38:46:51<76:19:57, 10.78s/it]
 33%|███▎      | 12465/37963 [38:47:00<73:46:37, 10.42s/it]
 33%|███▎      | 12466/37963 [38:47:10<73:14:03, 10.34s/it]
 33%|███▎      | 12467/37963 [38:47:27<86:25:31, 12.20s/it]
 33%|███▎      | 12468/37963 [38:47:37<81:55:33, 11.57s/it]
 33%|███▎      | 12469/37963 [38:47:47<78:00:18, 11.02s/it]
 33%|███▎      | 12470/37963 [38:47:56<75:13:58, 10.62s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '1.402', 'learning_rate': '1.568e-05', 'epoch': '0.3285'}

 33%|███▎      | 12470/37963 [38:47:56<75:13:58, 10.62s/it]
 33%|███▎      | 12471/37963 [38:48:06<73:45:26, 10.42s/it]
 33%|███▎      | 12472/37963 [38:48:16<73:08:30, 10.33s/it]
 33%|███▎      | 12473/37963 [38:48:33<86:35:57, 12.23s/it]
 33%|███▎      | 12474/37963 [38:48:43<81:39:09, 11.53s/it]
 33%|███▎      | 12475/37963 [38:48:59<91:16:57, 12.89s/it]
 33%|███▎      | 12476/37963 [38:49:15<97:42:09, 13.80s/it]
 33%|███▎      | 12477/37963 [38:49:25<89:48:30, 12.69s/it]
 33%|███▎      | 12478/37963 [38:49:35<84:20:12, 11.91s/it]
 33%|███▎      | 12479/37963 [38:49:45<80:31:36, 11.38s/it]
 33%|███▎      | 12480/37963 [38:49:55<77:13:29, 10.91s/it]
                                                           
{'loss': '0.1448', 'grad_norm': '3.742', 'learning_rate': '1.567e-05', 'epoch': '0.3287'}

 33%|███▎      | 12480/37963 [38:49:55<77:13:29, 10.91s/it]
 33%|███▎      | 12481/37963 [38:50:05<75:14:38, 10.63s/it]
 33%|███▎      | 12482/37963 [38:50:15<74:21:28, 10.51s/it]
 33%|███▎      | 12483/37963 [38:50:25<72:52:57, 10.30s/it]
 33%|███▎      | 12484/37963 [38:50:35<71:57:15, 10.17s/it]
 33%|███▎      | 12485/37963 [38:50:45<71:44:40, 10.14s/it]
 33%|███▎      | 12486/37963 [38:50:55<71:04:16, 10.04s/it]
 33%|███▎      | 12487/37963 [38:51:05<71:16:37, 10.07s/it]
 33%|███▎      | 12488/37963 [38:51:22<85:34:33, 12.09s/it]
 33%|███▎      | 12489/37963 [38:51:32<81:30:20, 11.52s/it]
 33%|███▎      | 12490/37963 [38:51:42<78:29:17, 11.09s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '1.986', 'learning_rate': '1.567e-05', 'epoch': '0.329'}

 33%|███▎      | 12490/37963 [38:51:42<78:29:17, 11.09s/it]
 33%|███▎      | 12491/37963 [38:51:52<75:36:25, 10.69s/it]
 33%|███▎      | 12492/37963 [38:52:02<74:14:30, 10.49s/it]
 33%|███▎      | 12493/37963 [38:52:12<73:21:13, 10.37s/it]
 33%|███▎      | 12494/37963 [38:52:28<86:04:18, 12.17s/it]
 33%|███▎      | 12495/37963 [38:52:39<81:54:38, 11.58s/it]
 33%|███▎      | 12496/37963 [38:52:49<78:57:50, 11.16s/it]
 33%|███▎      | 12497/37963 [38:52:59<77:08:59, 10.91s/it]
 33%|███▎      | 12498/37963 [38:53:09<75:05:09, 10.61s/it]
 33%|███▎      | 12499/37963 [38:53:19<73:56:11, 10.45s/it]
 33%|███▎      | 12500/37963 [38:53:29<73:02:29, 10.33s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '2.032', 'learning_rate': '1.566e-05', 'epoch': '0.3293'}

 33%|███▎      | 12500/37963 [38:53:29<73:02:29, 10.33s/it]
 33%|███▎      | 12501/37963 [38:53:39<72:39:49, 10.27s/it]
 33%|███▎      | 12502/37963 [38:53:49<72:24:19, 10.24s/it]
 33%|███▎      | 12503/37963 [38:54:00<72:03:13, 10.19s/it]
 33%|███▎      | 12504/37963 [38:54:10<71:56:45, 10.17s/it]
 33%|███▎      | 12505/37963 [38:54:20<71:55:47, 10.17s/it]
 33%|███▎      | 12506/37963 [38:54:37<86:33:19, 12.24s/it]
 33%|███▎      | 12507/37963 [38:54:47<82:06:25, 11.61s/it]
 33%|███▎      | 12508/37963 [38:54:57<79:01:30, 11.18s/it]
 33%|███▎      | 12509/37963 [38:55:13<89:36:29, 12.67s/it]
 33%|███▎      | 12510/37963 [38:55:23<84:10:40, 11.91s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '1.592', 'learning_rate': '1.565e-05', 'epoch': '0.3295'}

 33%|███▎      | 12510/37963 [38:55:24<84:10:40, 11.91s/it]
 33%|███▎      | 12511/37963 [38:55:34<80:14:43, 11.35s/it]
 33%|███▎      | 12512/37963 [38:55:44<77:27:52, 10.96s/it]
 33%|███▎      | 12513/37963 [38:55:53<75:11:32, 10.64s/it]
 33%|███▎      | 12514/37963 [38:56:03<73:55:20, 10.46s/it]
 33%|███▎      | 12515/37963 [38:56:14<73:00:09, 10.33s/it]
 33%|███▎      | 12516/37963 [38:56:30<85:51:08, 12.15s/it]
 33%|███▎      | 12517/37963 [38:56:39<80:12:05, 11.35s/it]
 33%|███▎      | 12518/37963 [38:56:49<76:38:20, 10.84s/it]
 33%|███▎      | 12519/37963 [38:56:59<74:43:44, 10.57s/it]
 33%|███▎      | 12520/37963 [38:57:16<88:14:36, 12.49s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '1.779', 'learning_rate': '1.565e-05', 'epoch': '0.3298'}

 33%|███▎      | 12520/37963 [38:57:16<88:14:36, 12.49s/it]
 33%|███▎      | 12521/37963 [38:57:26<83:07:41, 11.76s/it]
 33%|███▎      | 12522/37963 [38:57:36<79:45:25, 11.29s/it]
 33%|███▎      | 12523/37963 [38:57:46<76:59:25, 10.89s/it]
 33%|███▎      | 12524/37963 [38:58:03<88:59:34, 12.59s/it]
 33%|███▎      | 12525/37963 [38:58:19<97:16:06, 13.77s/it]
 33%|███▎      | 12526/37963 [38:58:29<89:25:55, 12.66s/it]
 33%|███▎      | 12527/37963 [38:58:39<83:53:40, 11.87s/it]
 33%|███▎      | 12528/37963 [38:58:49<79:47:09, 11.29s/it]
 33%|███▎      | 12529/37963 [38:58:59<77:09:07, 10.92s/it]
 33%|███▎      | 12530/37963 [38:59:09<75:23:46, 10.67s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '0.9788', 'learning_rate': '1.564e-05', 'epoch': '0.3301'}

 33%|███▎      | 12530/37963 [38:59:09<75:23:46, 10.67s/it]
 33%|███▎      | 12531/37963 [38:59:20<74:10:56, 10.50s/it]
 33%|███▎      | 12532/37963 [38:59:29<72:39:28, 10.29s/it]
 33%|███▎      | 12533/37963 [38:59:39<72:04:04, 10.20s/it]
 33%|███▎      | 12534/37963 [38:59:49<71:52:51, 10.18s/it]
 33%|███▎      | 12535/37963 [38:59:59<71:33:35, 10.13s/it]
 33%|███▎      | 12536/37963 [39:00:16<85:13:05, 12.07s/it]
 33%|███▎      | 12537/37963 [39:00:26<80:55:16, 11.46s/it]
 33%|███▎      | 12538/37963 [39:00:36<78:01:58, 11.05s/it]
 33%|███▎      | 12539/37963 [39:00:46<74:55:21, 10.61s/it]
 33%|███▎      | 12540/37963 [39:01:02<87:48:15, 12.43s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '2.891', 'learning_rate': '1.563e-05', 'epoch': '0.3303'}

 33%|███▎      | 12540/37963 [39:01:02<87:48:15, 12.43s/it]
 33%|███▎      | 12541/37963 [39:01:13<82:54:09, 11.74s/it]
 33%|███▎      | 12542/37963 [39:01:22<78:32:40, 11.12s/it]
 33%|███▎      | 12543/37963 [39:01:32<76:18:33, 10.81s/it]
 33%|███▎      | 12544/37963 [39:01:42<74:02:28, 10.49s/it]
 33%|███▎      | 12545/37963 [39:01:52<72:54:46, 10.33s/it]
 33%|███▎      | 12546/37963 [39:02:02<71:53:21, 10.18s/it]
 33%|███▎      | 12547/37963 [39:02:12<71:47:33, 10.17s/it]
 33%|███▎      | 12548/37963 [39:02:22<71:41:14, 10.15s/it]
 33%|███▎      | 12549/37963 [39:02:32<71:14:16, 10.09s/it]
 33%|███▎      | 12550/37963 [39:02:42<70:12:37,  9.95s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '1.233', 'learning_rate': '1.562e-05', 'epoch': '0.3306'}

 33%|███▎      | 12550/37963 [39:02:42<70:12:37,  9.95s/it]
 33%|███▎      | 12551/37963 [39:02:52<70:25:18,  9.98s/it]
 33%|███▎      | 12552/37963 [39:03:02<70:45:30, 10.02s/it]
 33%|███▎      | 12553/37963 [39:03:18<84:12:33, 11.93s/it]
 33%|███▎      | 12554/37963 [39:03:28<80:26:48, 11.40s/it]
 33%|███▎      | 12555/37963 [39:03:38<77:40:52, 11.01s/it]
 33%|███▎      | 12556/37963 [39:03:48<75:14:35, 10.66s/it]
 33%|███▎      | 12557/37963 [39:03:58<74:05:09, 10.50s/it]
 33%|███▎      | 12558/37963 [39:04:09<73:12:27, 10.37s/it]
 33%|███▎      | 12559/37963 [39:04:25<86:22:16, 12.24s/it]
 33%|███▎      | 12560/37963 [39:04:35<81:57:46, 11.62s/it]
                                                           
{'loss': '0.1506', 'grad_norm': '2.37', 'learning_rate': '1.562e-05', 'epoch': '0.3308'}

 33%|███▎      | 12560/37963 [39:04:35<81:57:46, 11.62s/it]
 33%|███▎      | 12561/37963 [39:04:45<78:17:38, 11.10s/it]
 33%|███▎      | 12562/37963 [39:04:55<76:13:08, 10.80s/it]
 33%|███▎      | 12563/37963 [39:05:11<87:35:59, 12.42s/it]
 33%|███▎      | 12564/37963 [39:05:22<83:03:10, 11.77s/it]
 33%|███▎      | 12565/37963 [39:05:32<79:29:34, 11.27s/it]
 33%|███▎      | 12566/37963 [39:05:42<76:56:04, 10.91s/it]
 33%|███▎      | 12567/37963 [39:05:59<89:18:58, 12.66s/it]
 33%|███▎      | 12568/37963 [39:06:09<83:50:37, 11.89s/it]
 33%|███▎      | 12569/37963 [39:06:19<80:06:40, 11.36s/it]
 33%|███▎      | 12570/37963 [39:06:29<77:25:52, 10.98s/it]
                                                           
{'loss': '0.152', 'grad_norm': '2.092', 'learning_rate': '1.561e-05', 'epoch': '0.3311'}

 33%|███▎      | 12570/37963 [39:06:29<77:25:52, 10.98s/it]
 33%|███▎      | 12571/37963 [39:06:39<75:32:34, 10.71s/it]
 33%|███▎      | 12572/37963 [39:06:56<88:13:08, 12.51s/it]
 33%|███▎      | 12573/37963 [39:07:12<95:29:20, 13.54s/it]
 33%|███▎      | 12574/37963 [39:07:22<88:17:20, 12.52s/it]
 33%|███▎      | 12575/37963 [39:07:32<82:59:19, 11.77s/it]
 33%|███▎      | 12576/37963 [39:07:42<79:20:47, 11.25s/it]
 33%|███▎      | 12577/37963 [39:07:52<77:00:07, 10.92s/it]
 33%|███▎      | 12578/37963 [39:08:02<75:06:55, 10.65s/it]
 33%|███▎      | 12579/37963 [39:08:12<73:59:07, 10.49s/it]
 33%|███▎      | 12580/37963 [39:08:22<73:00:13, 10.35s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '2.023', 'learning_rate': '1.56e-05', 'epoch': '0.3314'}

 33%|███▎      | 12580/37963 [39:08:22<73:00:13, 10.35s/it]
 33%|███▎      | 12581/37963 [39:08:32<71:36:25, 10.16s/it]
 33%|███▎      | 12582/37963 [39:08:42<71:19:53, 10.12s/it]
 33%|███▎      | 12583/37963 [39:08:52<71:33:52, 10.15s/it]
 33%|███▎      | 12584/37963 [39:09:02<71:27:36, 10.14s/it]
 33%|███▎      | 12585/37963 [39:09:12<71:26:15, 10.13s/it]
 33%|███▎      | 12586/37963 [39:09:22<70:33:35, 10.01s/it]
 33%|███▎      | 12587/37963 [39:09:38<83:59:50, 11.92s/it]
 33%|███▎      | 12588/37963 [39:09:55<93:09:29, 13.22s/it]
 33%|███▎      | 12589/37963 [39:10:05<86:30:19, 12.27s/it]
 33%|███▎      | 12590/37963 [39:10:15<81:55:45, 11.62s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '3.077', 'learning_rate': '1.56e-05', 'epoch': '0.3316'}

 33%|███▎      | 12590/37963 [39:10:15<81:55:45, 11.62s/it]
 33%|███▎      | 12591/37963 [39:10:25<78:34:51, 11.15s/it]
 33%|███▎      | 12592/37963 [39:10:35<75:53:10, 10.77s/it]
 33%|███▎      | 12593/37963 [39:10:45<74:34:49, 10.58s/it]
 33%|███▎      | 12594/37963 [39:10:55<72:36:13, 10.30s/it]
 33%|███▎      | 12595/37963 [39:11:05<72:06:27, 10.23s/it]
 33%|███▎      | 12596/37963 [39:11:15<71:23:48, 10.13s/it]
 33%|███▎      | 12597/37963 [39:11:25<71:20:14, 10.12s/it]
 33%|███▎      | 12598/37963 [39:11:35<70:49:54, 10.05s/it]
 33%|███▎      | 12599/37963 [39:11:45<70:56:35, 10.07s/it]
 33%|███▎      | 12600/37963 [39:11:55<70:57:54, 10.07s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '0.7008', 'learning_rate': '1.559e-05', 'epoch': '0.3319'}

 33%|███▎      | 12600/37963 [39:11:55<70:57:54, 10.07s/it]
 33%|███▎      | 12601/37963 [39:12:05<70:54:36, 10.07s/it]
 33%|███▎      | 12602/37963 [39:12:22<86:08:01, 12.23s/it]
 33%|███▎      | 12603/37963 [39:12:32<81:31:32, 11.57s/it]
 33%|███▎      | 12604/37963 [39:12:42<77:53:21, 11.06s/it]
 33%|███▎      | 12605/37963 [39:12:52<75:56:43, 10.78s/it]
 33%|███▎      | 12606/37963 [39:13:02<74:24:34, 10.56s/it]
 33%|███▎      | 12607/37963 [39:13:19<86:36:06, 12.30s/it]
 33%|███▎      | 12608/37963 [39:13:29<82:28:32, 11.71s/it]
 33%|███▎      | 12609/37963 [39:13:39<78:54:16, 11.20s/it]
 33%|███▎      | 12610/37963 [39:13:49<76:38:59, 10.88s/it]
                                                           
{'loss': '0.1754', 'grad_norm': '2.269', 'learning_rate': '1.558e-05', 'epoch': '0.3322'}

 33%|███▎      | 12610/37963 [39:13:49<76:38:59, 10.88s/it]
 33%|███▎      | 12611/37963 [39:14:06<88:29:46, 12.57s/it]
 33%|███▎      | 12612/37963 [39:14:16<83:21:27, 11.84s/it]
 33%|███▎      | 12613/37963 [39:14:26<79:23:20, 11.27s/it]
 33%|███▎      | 12614/37963 [39:14:36<76:54:37, 10.92s/it]
 33%|███▎      | 12615/37963 [39:14:46<75:28:15, 10.72s/it]
 33%|███▎      | 12616/37963 [39:15:03<89:11:00, 12.67s/it]
 33%|███▎      | 12617/37963 [39:15:13<83:54:10, 11.92s/it]
 33%|███▎      | 12618/37963 [39:15:23<79:59:05, 11.36s/it]
 33%|███▎      | 12619/37963 [39:15:34<77:46:08, 11.05s/it]
 33%|███▎      | 12620/37963 [39:15:50<89:30:40, 12.72s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '1.947', 'learning_rate': '1.558e-05', 'epoch': '0.3324'}

 33%|███▎      | 12620/37963 [39:15:50<89:30:40, 12.72s/it]
 33%|███▎      | 12621/37963 [39:16:07<96:59:05, 13.78s/it]
 33%|███▎      | 12622/37963 [39:16:17<89:22:49, 12.70s/it]
 33%|███▎      | 12623/37963 [39:16:27<83:38:39, 11.88s/it]
 33%|███▎      | 12624/37963 [39:16:37<80:13:02, 11.40s/it]
 33%|███▎      | 12625/37963 [39:16:47<78:01:22, 11.09s/it]
 33%|███▎      | 12626/37963 [39:16:58<76:05:17, 10.81s/it]
 33%|███▎      | 12627/37963 [39:17:08<74:34:41, 10.60s/it]
 33%|███▎      | 12628/37963 [39:17:18<73:29:04, 10.44s/it]
 33%|███▎      | 12629/37963 [39:17:28<72:10:18, 10.26s/it]
 33%|███▎      | 12630/37963 [39:17:38<71:41:09, 10.19s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '1.862', 'learning_rate': '1.557e-05', 'epoch': '0.3327'}

 33%|███▎      | 12630/37963 [39:17:38<71:41:09, 10.19s/it]
 33%|███▎      | 12631/37963 [39:17:47<69:45:00,  9.91s/it]
 33%|███▎      | 12632/37963 [39:17:57<69:52:15,  9.93s/it]
 33%|███▎      | 12633/37963 [39:18:07<70:16:11,  9.99s/it]
 33%|███▎      | 12634/37963 [39:18:23<83:55:30, 11.93s/it]
 33%|███▎      | 12635/37963 [39:18:34<80:09:09, 11.39s/it]
 33%|███▎      | 12636/37963 [39:18:50<91:12:57, 12.97s/it]
 33%|███▎      | 12637/37963 [39:19:00<84:46:56, 12.05s/it]
 33%|███▎      | 12638/37963 [39:19:10<80:30:17, 11.44s/it]
 33%|███▎      | 12639/37963 [39:19:20<77:09:06, 10.97s/it]
 33%|███▎      | 12640/37963 [39:19:30<75:01:10, 10.67s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '2.863', 'learning_rate': '1.556e-05', 'epoch': '0.333'}

 33%|███▎      | 12640/37963 [39:19:30<75:01:10, 10.67s/it]
 33%|███▎      | 12641/37963 [39:19:40<73:53:13, 10.50s/it]
 33%|███▎      | 12642/37963 [39:19:50<73:04:18, 10.39s/it]
 33%|███▎      | 12643/37963 [39:20:00<72:19:24, 10.28s/it]
 33%|███▎      | 12644/37963 [39:20:10<71:14:30, 10.13s/it]
 33%|███▎      | 12645/37963 [39:20:20<71:06:39, 10.11s/it]
 33%|███▎      | 12646/37963 [39:20:30<70:17:36, 10.00s/it]
 33%|███▎      | 12647/37963 [39:20:40<69:57:43,  9.95s/it]
 33%|███▎      | 12648/37963 [39:20:50<70:01:37,  9.96s/it]
 33%|███▎      | 12649/37963 [39:21:06<84:25:09, 12.01s/it]
 33%|███▎      | 12650/37963 [39:21:17<80:29:05, 11.45s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '1.107', 'learning_rate': '1.555e-05', 'epoch': '0.3332'}

 33%|███▎      | 12650/37963 [39:21:17<80:29:05, 11.45s/it]
 33%|███▎      | 12651/37963 [39:21:26<76:55:10, 10.94s/it]
 33%|███▎      | 12652/37963 [39:21:36<74:23:45, 10.58s/it]
 33%|███▎      | 12653/37963 [39:21:46<72:17:46, 10.28s/it]
 33%|███▎      | 12654/37963 [39:21:56<72:02:33, 10.25s/it]
 33%|███▎      | 12655/37963 [39:22:12<85:04:51, 12.10s/it]
 33%|███▎      | 12656/37963 [39:22:22<80:55:26, 11.51s/it]
 33%|███▎      | 12657/37963 [39:22:32<77:49:46, 11.07s/it]
 33%|███▎      | 12658/37963 [39:22:42<75:25:42, 10.73s/it]
 33%|███▎      | 12659/37963 [39:22:52<74:05:06, 10.54s/it]
 33%|███▎      | 12660/37963 [39:23:09<86:41:37, 12.33s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '1.334', 'learning_rate': '1.555e-05', 'epoch': '0.3335'}

 33%|███▎      | 12660/37963 [39:23:09<86:41:37, 12.33s/it]
 33%|███▎      | 12661/37963 [39:23:19<81:52:26, 11.65s/it]
 33%|███▎      | 12662/37963 [39:23:29<78:30:49, 11.17s/it]
 33%|███▎      | 12663/37963 [39:23:39<76:06:58, 10.83s/it]
 33%|███▎      | 12664/37963 [39:23:56<89:43:52, 12.77s/it]
 33%|███▎      | 12665/37963 [39:24:07<84:16:41, 11.99s/it]
 33%|███▎      | 12666/37963 [39:24:17<80:18:39, 11.43s/it]
 33%|███▎      | 12667/37963 [39:24:27<77:24:12, 11.02s/it]
 33%|███▎      | 12668/37963 [39:24:43<88:52:16, 12.65s/it]
 33%|███▎      | 12669/37963 [39:25:00<97:11:31, 13.83s/it]
 33%|███▎      | 12670/37963 [39:25:10<89:00:59, 12.67s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '2.356', 'learning_rate': '1.554e-05', 'epoch': '0.3337'}

 33%|███▎      | 12670/37963 [39:25:10<89:00:59, 12.67s/it]
 33%|███▎      | 12671/37963 [39:25:20<83:41:24, 11.91s/it]
 33%|███▎      | 12672/37963 [39:25:30<79:56:35, 11.38s/it]
 33%|███▎      | 12673/37963 [39:25:40<77:13:07, 10.99s/it]
 33%|███▎      | 12674/37963 [39:25:50<75:14:03, 10.71s/it]
 33%|███▎      | 12675/37963 [39:26:00<74:22:46, 10.59s/it]
 33%|███▎      | 12676/37963 [39:26:10<73:15:26, 10.43s/it]
 33%|███▎      | 12677/37963 [39:26:20<71:59:16, 10.25s/it]
 33%|███▎      | 12678/37963 [39:26:31<72:04:10, 10.26s/it]
 33%|███▎      | 12679/37963 [39:26:40<70:42:32, 10.07s/it]
 33%|███▎      | 12680/37963 [39:26:50<69:25:43,  9.89s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '1.175', 'learning_rate': '1.553e-05', 'epoch': '0.334'}

 33%|███▎      | 12680/37963 [39:26:50<69:25:43,  9.89s/it]
 33%|███▎      | 12681/37963 [39:27:00<69:40:01,  9.92s/it]
 33%|███▎      | 12682/37963 [39:27:10<69:56:36,  9.96s/it]
 33%|███▎      | 12683/37963 [39:27:26<83:51:26, 11.94s/it]
 33%|███▎      | 12684/37963 [39:27:43<93:13:47, 13.28s/it]
 33%|███▎      | 12685/37963 [39:27:53<86:37:22, 12.34s/it]
 33%|███▎      | 12686/37963 [39:28:03<81:25:47, 11.60s/it]
 33%|███▎      | 12687/37963 [39:28:13<77:59:46, 11.11s/it]
 33%|███▎      | 12688/37963 [39:28:22<75:11:23, 10.71s/it]
 33%|███▎      | 12689/37963 [39:28:33<73:57:31, 10.53s/it]
 33%|███▎      | 12690/37963 [39:28:43<73:09:37, 10.42s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '2.988', 'learning_rate': '1.553e-05', 'epoch': '0.3343'}

 33%|███▎      | 12690/37963 [39:28:43<73:09:37, 10.42s/it]
 33%|███▎      | 12691/37963 [39:28:53<72:27:29, 10.32s/it]
 33%|███▎      | 12692/37963 [39:29:03<71:53:56, 10.24s/it]
 33%|███▎      | 12693/37963 [39:29:13<71:32:12, 10.19s/it]
 33%|███▎      | 12694/37963 [39:29:23<71:14:57, 10.15s/it]
 33%|███▎      | 12695/37963 [39:29:33<71:02:29, 10.12s/it]
 33%|███▎      | 12696/37963 [39:29:50<85:14:16, 12.14s/it]
 33%|███▎      | 12697/37963 [39:30:00<80:32:27, 11.48s/it]
 33%|███▎      | 12698/37963 [39:30:09<76:34:59, 10.91s/it]
 33%|███▎      | 12699/37963 [39:30:20<74:50:49, 10.67s/it]
 33%|███▎      | 12700/37963 [39:30:30<73:41:21, 10.50s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '1.754', 'learning_rate': '1.552e-05', 'epoch': '0.3345'}

 33%|███▎      | 12700/37963 [39:30:30<73:41:21, 10.50s/it]
 33%|███▎      | 12701/37963 [39:30:40<72:58:35, 10.40s/it]
 33%|███▎      | 12702/37963 [39:30:50<72:24:55, 10.32s/it]
 33%|███▎      | 12703/37963 [39:31:00<71:58:34, 10.26s/it]
 33%|███▎      | 12704/37963 [39:31:10<71:33:31, 10.20s/it]
 33%|███▎      | 12705/37963 [39:31:20<71:19:18, 10.17s/it]
 33%|███▎      | 12706/37963 [39:31:37<84:28:48, 12.04s/it]
 33%|███▎      | 12707/37963 [39:31:53<93:52:24, 13.38s/it]
 33%|███▎      | 12708/37963 [39:32:03<87:02:11, 12.41s/it]
 33%|███▎      | 12709/37963 [39:32:13<82:20:40, 11.74s/it]
 33%|███▎      | 12710/37963 [39:32:24<79:04:05, 11.27s/it]
                                                           
{'loss': '0.1648', 'grad_norm': '1.062', 'learning_rate': '1.551e-05', 'epoch': '0.3348'}

 33%|███▎      | 12710/37963 [39:32:24<79:04:05, 11.27s/it]
 33%|███▎      | 12711/37963 [39:32:34<77:06:14, 10.99s/it]
 33%|███▎      | 12712/37963 [39:32:44<75:11:08, 10.72s/it]
 33%|███▎      | 12713/37963 [39:32:54<74:06:17, 10.57s/it]
 33%|███▎      | 12714/37963 [39:33:04<73:10:58, 10.43s/it]
 33%|███▎      | 12715/37963 [39:33:21<86:55:35, 12.39s/it]
 33%|███▎      | 12716/37963 [39:33:38<95:35:51, 13.63s/it]
 33%|███▎      | 12717/37963 [39:33:48<88:01:16, 12.55s/it]
 34%|███▎      | 12718/37963 [39:34:04<96:03:39, 13.70s/it]
 34%|███▎      | 12719/37963 [39:34:14<88:20:50, 12.60s/it]
 34%|███▎      | 12720/37963 [39:34:24<83:08:23, 11.86s/it]
                                                           
{'loss': '0.1651', 'grad_norm': '1.87', 'learning_rate': '1.55e-05', 'epoch': '0.3351'}

 34%|███▎      | 12720/37963 [39:34:24<83:08:23, 11.86s/it]
 34%|███▎      | 12721/37963 [39:34:34<78:38:23, 11.22s/it]
 34%|███▎      | 12722/37963 [39:34:44<76:14:26, 10.87s/it]
 34%|███▎      | 12723/37963 [39:34:54<74:51:29, 10.68s/it]
 34%|███▎      | 12724/37963 [39:35:04<73:28:09, 10.48s/it]
 34%|███▎      | 12725/37963 [39:35:14<72:13:26, 10.30s/it]
 34%|███▎      | 12726/37963 [39:35:24<71:09:04, 10.15s/it]
 34%|███▎      | 12727/37963 [39:35:34<70:14:22, 10.02s/it]
 34%|███▎      | 12728/37963 [39:35:44<70:29:30, 10.06s/it]
 34%|███▎      | 12729/37963 [39:35:54<70:05:07, 10.00s/it]
 34%|███▎      | 12730/37963 [39:36:10<83:44:12, 11.95s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '2.428', 'learning_rate': '1.55e-05', 'epoch': '0.3353'}

 34%|███▎      | 12730/37963 [39:36:10<83:44:12, 11.95s/it]
 34%|███▎      | 12731/37963 [39:36:20<79:49:34, 11.39s/it]
 34%|███▎      | 12732/37963 [39:36:37<90:11:29, 12.87s/it]
 34%|███▎      | 12733/37963 [39:36:47<84:17:08, 12.03s/it]
 34%|███▎      | 12734/37963 [39:36:57<80:07:07, 11.43s/it]
 34%|███▎      | 12735/37963 [39:37:07<77:11:37, 11.02s/it]
 34%|███▎      | 12736/37963 [39:37:17<75:08:04, 10.72s/it]
 34%|███▎      | 12737/37963 [39:37:27<73:55:17, 10.55s/it]
 34%|███▎      | 12738/37963 [39:37:37<72:35:56, 10.36s/it]
 34%|███▎      | 12739/37963 [39:37:47<71:41:09, 10.23s/it]
 34%|███▎      | 12740/37963 [39:37:57<71:13:21, 10.17s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '0.8485', 'learning_rate': '1.549e-05', 'epoch': '0.3356'}

 34%|███▎      | 12740/37963 [39:37:57<71:13:21, 10.17s/it]
 34%|███▎      | 12741/37963 [39:38:07<71:09:14, 10.16s/it]
 34%|███▎      | 12742/37963 [39:38:17<71:04:38, 10.15s/it]
 34%|███▎      | 12743/37963 [39:38:34<85:10:57, 12.16s/it]
 34%|███▎      | 12744/37963 [39:38:44<80:47:11, 11.53s/it]
 34%|███▎      | 12745/37963 [39:38:54<77:46:26, 11.10s/it]
 34%|███▎      | 12746/37963 [39:39:04<75:42:38, 10.81s/it]
 34%|███▎      | 12747/37963 [39:39:14<74:12:03, 10.59s/it]
 34%|███▎      | 12748/37963 [39:39:25<73:14:47, 10.46s/it]
 34%|███▎      | 12749/37963 [39:39:35<72:06:03, 10.29s/it]
 34%|███▎      | 12750/37963 [39:39:45<71:41:02, 10.24s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '2.789', 'learning_rate': '1.548e-05', 'epoch': '0.3359'}

 34%|███▎      | 12750/37963 [39:39:45<71:41:02, 10.24s/it]
 34%|███▎      | 12751/37963 [39:39:54<70:52:46, 10.12s/it]
 34%|███▎      | 12752/37963 [39:40:04<70:15:58, 10.03s/it]
 34%|███▎      | 12753/37963 [39:40:14<69:45:00,  9.96s/it]
 34%|███▎      | 12754/37963 [39:40:24<69:56:46,  9.99s/it]
 34%|███▎      | 12755/37963 [39:40:41<84:00:06, 12.00s/it]
 34%|███▎      | 12756/37963 [39:40:51<79:59:31, 11.42s/it]
 34%|███▎      | 12757/37963 [39:41:01<77:10:53, 11.02s/it]
 34%|███▎      | 12758/37963 [39:41:11<75:11:00, 10.74s/it]
 34%|███▎      | 12759/37963 [39:41:21<73:47:05, 10.54s/it]
 34%|███▎      | 12760/37963 [39:41:31<72:50:07, 10.40s/it]
                                                           
{'loss': '0.1503', 'grad_norm': '2.127', 'learning_rate': '1.548e-05', 'epoch': '0.3361'}

 34%|███▎      | 12760/37963 [39:41:31<72:50:07, 10.40s/it]
 34%|███▎      | 12761/37963 [39:41:41<72:10:38, 10.31s/it]
 34%|███▎      | 12762/37963 [39:41:51<71:24:46, 10.20s/it]
 34%|███▎      | 12763/37963 [39:42:15<99:02:29, 14.15s/it]
 34%|███▎      | 12764/37963 [39:42:25<90:45:56, 12.97s/it]
 34%|███▎      | 12765/37963 [39:42:35<84:33:08, 12.08s/it]
 34%|███▎      | 12766/37963 [39:42:52<94:18:16, 13.47s/it]
 34%|███▎      | 12767/37963 [39:43:01<86:43:19, 12.39s/it]
 34%|███▎      | 12768/37963 [39:43:12<82:03:11, 11.72s/it]
 34%|███▎      | 12769/37963 [39:43:22<78:38:15, 11.24s/it]
 34%|███▎      | 12770/37963 [39:43:32<76:13:08, 10.89s/it]
                                                           
{'loss': '0.1775', 'grad_norm': '3.235', 'learning_rate': '1.547e-05', 'epoch': '0.3364'}

 34%|███▎      | 12770/37963 [39:43:32<76:13:08, 10.89s/it]
 34%|███▎      | 12771/37963 [39:43:42<74:44:31, 10.68s/it]
 34%|███▎      | 12772/37963 [39:43:52<73:15:08, 10.47s/it]
 34%|███▎      | 12773/37963 [39:44:02<72:37:00, 10.38s/it]
 34%|███▎      | 12774/37963 [39:44:12<71:40:41, 10.24s/it]
 34%|███▎      | 12775/37963 [39:44:22<71:22:20, 10.20s/it]
 34%|███▎      | 12776/37963 [39:44:32<71:07:16, 10.17s/it]
 34%|███▎      | 12777/37963 [39:44:42<71:00:42, 10.15s/it]
 34%|███▎      | 12778/37963 [39:44:59<84:25:39, 12.07s/it]
 34%|███▎      | 12779/37963 [39:45:15<93:10:15, 13.32s/it]
 34%|███▎      | 12780/37963 [39:45:25<86:26:16, 12.36s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '2.861', 'learning_rate': '1.546e-05', 'epoch': '0.3366'}

 34%|███▎      | 12780/37963 [39:45:25<86:26:16, 12.36s/it]
 34%|███▎      | 12781/37963 [39:45:35<81:14:56, 11.62s/it]
 34%|███▎      | 12782/37963 [39:45:45<78:10:19, 11.18s/it]
 34%|███▎      | 12783/37963 [39:45:55<76:00:49, 10.87s/it]
 34%|███▎      | 12784/37963 [39:46:06<74:37:53, 10.67s/it]
 34%|███▎      | 12785/37963 [39:46:16<73:19:49, 10.48s/it]
 34%|███▎      | 12786/37963 [39:46:25<71:51:31, 10.27s/it]
 34%|███▎      | 12787/37963 [39:46:35<71:14:09, 10.19s/it]
 34%|███▎      | 12788/37963 [39:46:45<70:39:05, 10.10s/it]
 34%|███▎      | 12789/37963 [39:46:55<70:37:47, 10.10s/it]
 34%|███▎      | 12790/37963 [39:47:06<70:32:35, 10.09s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '1.61', 'learning_rate': '1.545e-05', 'epoch': '0.3369'}

 34%|███▎      | 12790/37963 [39:47:06<70:32:35, 10.09s/it]
 34%|███▎      | 12791/37963 [39:47:22<84:57:04, 12.15s/it]
 34%|███▎      | 12792/37963 [39:47:33<80:54:30, 11.57s/it]
 34%|███▎      | 12793/37963 [39:47:43<77:30:08, 11.08s/it]
 34%|███▎      | 12794/37963 [39:47:53<75:06:30, 10.74s/it]
 34%|███▎      | 12795/37963 [39:48:03<73:40:31, 10.54s/it]
 34%|███▎      | 12796/37963 [39:48:13<72:38:29, 10.39s/it]
 34%|███▎      | 12797/37963 [39:48:23<72:04:59, 10.31s/it]
 34%|███▎      | 12798/37963 [39:48:33<71:13:43, 10.19s/it]
 34%|███▎      | 12799/37963 [39:48:43<70:21:50, 10.07s/it]
 34%|███▎      | 12800/37963 [39:48:53<70:29:39, 10.09s/it]
                                                           
{'loss': '0.1736', 'grad_norm': '2.809', 'learning_rate': '1.545e-05', 'epoch': '0.3372'}

 34%|███▎      | 12800/37963 [39:48:53<70:29:39, 10.09s/it]
 34%|███▎      | 12801/37963 [39:49:02<69:57:36, 10.01s/it]
 34%|███▎      | 12802/37963 [39:49:13<70:03:00, 10.02s/it]
 34%|███▎      | 12803/37963 [39:49:28<82:21:26, 11.78s/it]
 34%|███▎      | 12804/37963 [39:49:45<92:02:14, 13.17s/it]
 34%|███▎      | 12805/37963 [39:49:55<85:20:51, 12.21s/it]
 34%|███▎      | 12806/37963 [39:50:05<80:45:44, 11.56s/it]
 34%|███▎      | 12807/37963 [39:50:15<77:46:23, 11.13s/it]
 34%|███▎      | 12808/37963 [39:50:25<74:56:13, 10.72s/it]
 34%|███▎      | 12809/37963 [39:50:35<73:03:25, 10.46s/it]
 34%|███▎      | 12810/37963 [39:50:45<72:13:41, 10.34s/it]
                                                           
{'loss': '0.1663', 'grad_norm': '1.847', 'learning_rate': '1.544e-05', 'epoch': '0.3374'}

 34%|███▎      | 12810/37963 [39:50:45<72:13:41, 10.34s/it]
 34%|███▎      | 12811/37963 [39:51:08<98:49:08, 14.14s/it]
 34%|███▎      | 12812/37963 [39:51:18<90:10:17, 12.91s/it]
 34%|███▍      | 12813/37963 [39:51:28<84:11:13, 12.05s/it]
 34%|███▍      | 12814/37963 [39:51:38<80:07:30, 11.47s/it]
 34%|███▍      | 12815/37963 [39:51:54<90:46:22, 12.99s/it]
 34%|███▍      | 12816/37963 [39:52:05<84:47:45, 12.14s/it]
 34%|███▍      | 12817/37963 [39:52:15<80:30:22, 11.53s/it]
 34%|███▍      | 12818/37963 [39:52:25<77:38:58, 11.12s/it]
 34%|███▍      | 12819/37963 [39:52:35<75:29:11, 10.81s/it]
 34%|███▍      | 12820/37963 [39:52:45<73:48:33, 10.57s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '1.5', 'learning_rate': '1.543e-05', 'epoch': '0.3377'}

 34%|███▍      | 12820/37963 [39:52:45<73:48:33, 10.57s/it]
 34%|███▍      | 12821/37963 [39:52:55<72:35:30, 10.39s/it]
 34%|███▍      | 12822/37963 [39:53:05<71:13:53, 10.20s/it]
 34%|███▍      | 12823/37963 [39:53:15<71:06:55, 10.18s/it]
 34%|███▍      | 12824/37963 [39:53:25<70:23:45, 10.08s/it]
 34%|███▍      | 12825/37963 [39:53:35<70:32:44, 10.10s/it]
 34%|███▍      | 12826/37963 [39:53:51<83:57:56, 12.03s/it]
 34%|███▍      | 12827/37963 [39:54:01<79:52:52, 11.44s/it]
 34%|███▍      | 12828/37963 [39:54:18<90:12:55, 12.92s/it]
 34%|███▍      | 12829/37963 [39:54:28<84:39:22, 12.13s/it]
 34%|███▍      | 12830/37963 [39:54:38<79:34:41, 11.40s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '2.397', 'learning_rate': '1.543e-05', 'epoch': '0.338'}

 34%|███▍      | 12830/37963 [39:54:38<79:34:41, 11.40s/it]
 34%|███▍      | 12831/37963 [39:54:48<76:54:04, 11.02s/it]
 34%|███▍      | 12832/37963 [39:54:58<75:04:41, 10.75s/it]
 34%|███▍      | 12833/37963 [39:55:08<73:38:40, 10.55s/it]
 34%|███▍      | 12834/37963 [39:55:18<71:57:01, 10.31s/it]
 34%|███▍      | 12835/37963 [39:55:28<71:36:57, 10.26s/it]
 34%|███▍      | 12836/37963 [39:55:38<71:16:49, 10.21s/it]
 34%|███▍      | 12837/37963 [39:55:55<85:12:48, 12.21s/it]
 34%|███▍      | 12838/37963 [39:56:04<79:39:14, 11.41s/it]
 34%|███▍      | 12839/37963 [39:56:14<75:35:03, 10.83s/it]
 34%|███▍      | 12840/37963 [39:56:24<72:59:11, 10.46s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '1.285', 'learning_rate': '1.542e-05', 'epoch': '0.3382'}

 34%|███▍      | 12840/37963 [39:56:24<72:59:11, 10.46s/it]
 34%|███▍      | 12841/37963 [39:56:34<72:17:31, 10.36s/it]
 34%|███▍      | 12842/37963 [39:56:44<71:27:18, 10.24s/it]
 34%|███▍      | 12843/37963 [39:56:54<70:57:16, 10.17s/it]
 34%|███▍      | 12844/37963 [39:57:04<70:54:26, 10.16s/it]
 34%|███▍      | 12845/37963 [39:57:14<70:47:06, 10.15s/it]
 34%|███▍      | 12846/37963 [39:57:24<69:44:48, 10.00s/it]
 34%|███▍      | 12847/37963 [39:57:34<69:56:42, 10.03s/it]
 34%|███▍      | 12848/37963 [39:57:44<70:02:24, 10.04s/it]
 34%|███▍      | 12849/37963 [39:57:54<70:10:30, 10.06s/it]
 34%|███▍      | 12850/37963 [39:58:04<69:55:50, 10.02s/it]
                                                           
{'loss': '0.1552', 'grad_norm': '2.322', 'learning_rate': '1.541e-05', 'epoch': '0.3385'}

 34%|███▍      | 12850/37963 [39:58:04<69:55:50, 10.02s/it]
 34%|███▍      | 12851/37963 [39:58:20<83:13:13, 11.93s/it]
 34%|███▍      | 12852/37963 [39:58:37<92:45:49, 13.30s/it]
 34%|███▍      | 12853/37963 [39:58:47<86:04:33, 12.34s/it]
 34%|███▍      | 12854/37963 [39:58:57<81:23:12, 11.67s/it]
 34%|███▍      | 12855/37963 [39:59:07<78:11:10, 11.21s/it]
 34%|███▍      | 12856/37963 [39:59:17<75:48:50, 10.87s/it]
 34%|███▍      | 12857/37963 [39:59:27<74:02:25, 10.62s/it]
 34%|███▍      | 12858/37963 [39:59:37<73:04:45, 10.48s/it]
 34%|███▍      | 12859/37963 [39:59:54<85:28:46, 12.26s/it]
 34%|███▍      | 12860/37963 [40:00:04<81:17:15, 11.66s/it]
                                                           
{'loss': '0.1658', 'grad_norm': '1.694', 'learning_rate': '1.54e-05', 'epoch': '0.3388'}

 34%|███▍      | 12860/37963 [40:00:04<81:17:15, 11.66s/it]
 34%|███▍      | 12861/37963 [40:00:21<92:28:15, 13.26s/it]
 34%|███▍      | 12862/37963 [40:00:31<85:45:42, 12.30s/it]
 34%|███▍      | 12863/37963 [40:00:41<81:12:58, 11.65s/it]
 34%|███▍      | 12864/37963 [40:00:58<92:03:24, 13.20s/it]
 34%|███▍      | 12865/37963 [40:01:08<85:32:19, 12.27s/it]
 34%|███▍      | 12866/37963 [40:01:18<80:55:07, 11.61s/it]
 34%|███▍      | 12867/37963 [40:01:28<77:53:02, 11.17s/it]
 34%|███▍      | 12868/37963 [40:01:38<74:06:40, 10.63s/it]
 34%|███▍      | 12869/37963 [40:01:48<73:12:31, 10.50s/it]
 34%|███▍      | 12870/37963 [40:01:58<72:21:13, 10.38s/it]
                                                           
{'loss': '0.166', 'grad_norm': '2.937', 'learning_rate': '1.54e-05', 'epoch': '0.339'}

 34%|███▍      | 12870/37963 [40:01:58<72:21:13, 10.38s/it]
 34%|███▍      | 12871/37963 [40:02:08<71:26:08, 10.25s/it]
 34%|███▍      | 12872/37963 [40:02:18<70:58:56, 10.18s/it]
 34%|███▍      | 12873/37963 [40:02:28<70:42:37, 10.15s/it]
 34%|███▍      | 12874/37963 [40:02:44<83:47:00, 12.02s/it]
 34%|███▍      | 12875/37963 [40:02:54<79:50:09, 11.46s/it]
 34%|███▍      | 12876/37963 [40:03:05<77:02:21, 11.06s/it]
 34%|███▍      | 12877/37963 [40:03:21<88:14:36, 12.66s/it]
 34%|███▍      | 12878/37963 [40:03:31<82:56:21, 11.90s/it]
 34%|███▍      | 12879/37963 [40:03:41<79:03:48, 11.35s/it]
 34%|███▍      | 12880/37963 [40:03:51<75:19:30, 10.81s/it]
                                                           
{'loss': '0.1678', 'grad_norm': '1.271', 'learning_rate': '1.539e-05', 'epoch': '0.3393'}

 34%|███▍      | 12880/37963 [40:03:51<75:19:30, 10.81s/it]
 34%|███▍      | 12881/37963 [40:04:01<73:48:30, 10.59s/it]
 34%|███▍      | 12882/37963 [40:04:11<72:00:21, 10.34s/it]
 34%|███▍      | 12883/37963 [40:04:21<71:29:00, 10.26s/it]
 34%|███▍      | 12884/37963 [40:04:31<71:16:35, 10.23s/it]
 34%|███▍      | 12885/37963 [40:04:41<70:56:22, 10.18s/it]
 34%|███▍      | 12886/37963 [40:04:58<84:35:41, 12.14s/it]
 34%|███▍      | 12887/37963 [40:05:08<80:31:35, 11.56s/it]
 34%|███▍      | 12888/37963 [40:05:18<77:05:59, 11.07s/it]
 34%|███▍      | 12889/37963 [40:05:28<74:58:15, 10.76s/it]
 34%|███▍      | 12890/37963 [40:05:38<73:28:36, 10.55s/it]
                                                           
{'loss': '0.16', 'grad_norm': '0.8417', 'learning_rate': '1.538e-05', 'epoch': '0.3395'}

 34%|███▍      | 12890/37963 [40:05:38<73:28:36, 10.55s/it]
 34%|███▍      | 12891/37963 [40:05:48<72:14:41, 10.37s/it]
 34%|███▍      | 12892/37963 [40:05:58<71:53:11, 10.32s/it]
 34%|███▍      | 12893/37963 [40:06:08<71:17:39, 10.24s/it]
 34%|███▍      | 12894/37963 [40:06:18<71:17:51, 10.24s/it]
 34%|███▍      | 12895/37963 [40:06:28<71:10:27, 10.22s/it]
 34%|███▍      | 12896/37963 [40:06:39<70:59:04, 10.19s/it]
 34%|███▍      | 12897/37963 [40:06:49<71:00:43, 10.20s/it]
 34%|███▍      | 12898/37963 [40:06:59<70:10:47, 10.08s/it]
 34%|███▍      | 12899/37963 [40:07:09<70:12:15, 10.08s/it]
 34%|███▍      | 12900/37963 [40:07:25<84:04:32, 12.08s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '1.679', 'learning_rate': '1.538e-05', 'epoch': '0.3398'}

 34%|███▍      | 12900/37963 [40:07:25<84:04:32, 12.08s/it]
 34%|███▍      | 12901/37963 [40:07:42<93:46:47, 13.47s/it]
 34%|███▍      | 12902/37963 [40:07:52<86:42:43, 12.46s/it]
 34%|███▍      | 12903/37963 [40:08:02<81:49:37, 11.75s/it]
 34%|███▍      | 12904/37963 [40:08:13<78:34:51, 11.29s/it]
 34%|███▍      | 12905/37963 [40:08:23<76:17:51, 10.96s/it]
 34%|███▍      | 12906/37963 [40:08:33<74:12:00, 10.66s/it]
 34%|███▍      | 12907/37963 [40:08:43<73:05:58, 10.50s/it]
 34%|███▍      | 12908/37963 [40:09:00<86:20:18, 12.41s/it]
 34%|███▍      | 12909/37963 [40:09:10<81:27:26, 11.70s/it]
 34%|███▍      | 12910/37963 [40:09:20<78:11:01, 11.23s/it]
                                                           
{'loss': '0.1685', 'grad_norm': '3.39', 'learning_rate': '1.537e-05', 'epoch': '0.3401'}

 34%|███▍      | 12910/37963 [40:09:20<78:11:01, 11.23s/it]
 34%|███▍      | 12911/37963 [40:09:37<89:39:26, 12.88s/it]
 34%|███▍      | 12912/37963 [40:09:47<84:12:47, 12.10s/it]
 34%|███▍      | 12913/37963 [40:09:57<80:03:27, 11.51s/it]
 34%|███▍      | 12914/37963 [40:10:07<77:24:08, 11.12s/it]
 34%|███▍      | 12915/37963 [40:10:17<75:12:12, 10.81s/it]
 34%|███▍      | 12916/37963 [40:10:28<74:05:46, 10.65s/it]
 34%|███▍      | 12917/37963 [40:10:38<72:43:48, 10.45s/it]
 34%|███▍      | 12918/37963 [40:10:48<72:06:19, 10.36s/it]
 34%|███▍      | 12919/37963 [40:10:58<71:23:36, 10.26s/it]
 34%|███▍      | 12920/37963 [40:11:08<70:23:21, 10.12s/it]
                                                           
{'loss': '0.1676', 'grad_norm': '3.011', 'learning_rate': '1.536e-05', 'epoch': '0.3403'}

 34%|███▍      | 12920/37963 [40:11:08<70:23:21, 10.12s/it]
 34%|███▍      | 12921/37963 [40:11:18<70:12:24, 10.09s/it]
 34%|███▍      | 12922/37963 [40:11:34<82:57:43, 11.93s/it]
 34%|███▍      | 12923/37963 [40:11:50<92:31:38, 13.30s/it]
 34%|███▍      | 12924/37963 [40:12:00<85:01:44, 12.23s/it]
 34%|███▍      | 12925/37963 [40:12:10<80:28:45, 11.57s/it]
 34%|███▍      | 12926/37963 [40:12:20<77:27:15, 11.14s/it]
 34%|███▍      | 12927/37963 [40:12:30<74:54:01, 10.77s/it]
 34%|███▍      | 12928/37963 [40:12:40<73:21:44, 10.55s/it]
 34%|███▍      | 12929/37963 [40:12:50<72:05:34, 10.37s/it]
 34%|███▍      | 12930/37963 [40:13:00<71:10:21, 10.24s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '1.135', 'learning_rate': '1.535e-05', 'epoch': '0.3406'}

 34%|███▍      | 12930/37963 [40:13:00<71:10:21, 10.24s/it]
 34%|███▍      | 12931/37963 [40:13:10<70:23:38, 10.12s/it]
 34%|███▍      | 12932/37963 [40:13:20<70:30:29, 10.14s/it]
 34%|███▍      | 12933/37963 [40:13:30<69:33:30, 10.00s/it]
 34%|███▍      | 12934/37963 [40:13:47<84:22:50, 12.14s/it]
 34%|███▍      | 12935/37963 [40:13:57<79:37:06, 11.45s/it]
 34%|███▍      | 12936/37963 [40:14:07<76:16:51, 10.97s/it]
 34%|███▍      | 12937/37963 [40:14:17<74:32:20, 10.72s/it]
 34%|███▍      | 12938/37963 [40:14:27<73:07:23, 10.52s/it]
 34%|███▍      | 12939/37963 [40:14:37<72:29:54, 10.43s/it]
 34%|███▍      | 12940/37963 [40:14:47<71:45:50, 10.32s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '3.767', 'learning_rate': '1.535e-05', 'epoch': '0.3409'}

 34%|███▍      | 12940/37963 [40:14:47<71:45:50, 10.32s/it]
 34%|███▍      | 12941/37963 [40:14:57<71:24:19, 10.27s/it]
 34%|███▍      | 12942/37963 [40:15:07<71:18:28, 10.26s/it]
 34%|███▍      | 12943/37963 [40:15:18<71:16:08, 10.25s/it]
 34%|███▍      | 12944/37963 [40:15:28<70:58:14, 10.21s/it]
 34%|███▍      | 12945/37963 [40:15:38<70:47:25, 10.19s/it]
 34%|███▍      | 12946/37963 [40:15:48<70:35:56, 10.16s/it]
 34%|███▍      | 12947/37963 [40:16:05<84:11:52, 12.12s/it]
 34%|███▍      | 12948/37963 [40:16:21<92:46:38, 13.35s/it]
 34%|███▍      | 12949/37963 [40:16:31<85:56:52, 12.37s/it]
 34%|███▍      | 12950/37963 [40:16:41<81:15:50, 11.70s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '3.469', 'learning_rate': '1.534e-05', 'epoch': '0.3411'}

 34%|███▍      | 12950/37963 [40:16:41<81:15:50, 11.70s/it]
 34%|███▍      | 12951/37963 [40:16:51<77:23:52, 11.14s/it]
 34%|███▍      | 12952/37963 [40:17:01<74:07:57, 10.67s/it]
 34%|███▍      | 12953/37963 [40:17:11<73:01:04, 10.51s/it]
 34%|███▍      | 12954/37963 [40:17:21<72:07:55, 10.38s/it]
 34%|███▍      | 12955/37963 [40:17:31<71:23:26, 10.28s/it]
 34%|███▍      | 12956/37963 [40:17:54<98:43:21, 14.21s/it]
 34%|███▍      | 12957/37963 [40:18:04<90:05:43, 12.97s/it]
 34%|███▍      | 12958/37963 [40:18:14<84:09:22, 12.12s/it]
 34%|███▍      | 12959/37963 [40:18:30<91:51:50, 13.23s/it]
 34%|███▍      | 12960/37963 [40:18:40<85:25:50, 12.30s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '1.451', 'learning_rate': '1.533e-05', 'epoch': '0.3414'}

 34%|███▍      | 12960/37963 [40:18:40<85:25:50, 12.30s/it]
 34%|███▍      | 12961/37963 [40:18:51<81:00:24, 11.66s/it]
 34%|███▍      | 12962/37963 [40:19:01<77:42:21, 11.19s/it]
 34%|███▍      | 12963/37963 [40:19:11<75:22:27, 10.85s/it]
 34%|███▍      | 12964/37963 [40:19:21<73:41:11, 10.61s/it]
 34%|███▍      | 12965/37963 [40:19:30<71:56:23, 10.36s/it]
 34%|███▍      | 12966/37963 [40:19:40<70:56:38, 10.22s/it]
 34%|███▍      | 12967/37963 [40:19:51<70:48:43, 10.20s/it]
 34%|███▍      | 12968/37963 [40:20:01<70:22:43, 10.14s/it]
 34%|███▍      | 12969/37963 [40:20:10<70:01:21, 10.09s/it]
 34%|███▍      | 12970/37963 [40:20:27<83:46:41, 12.07s/it]
                                                           
{'loss': '0.1625', 'grad_norm': '1.883', 'learning_rate': '1.532e-05', 'epoch': '0.3416'}

 34%|███▍      | 12970/37963 [40:20:27<83:46:41, 12.07s/it]
 34%|███▍      | 12971/37963 [40:20:44<93:08:11, 13.42s/it]
 34%|███▍      | 12972/37963 [40:20:54<86:13:41, 12.42s/it]
 34%|███▍      | 12973/37963 [40:21:04<81:16:06, 11.71s/it]
 34%|███▍      | 12974/37963 [40:21:14<77:58:54, 11.23s/it]
 34%|███▍      | 12975/37963 [40:21:24<75:35:19, 10.89s/it]
 34%|███▍      | 12976/37963 [40:21:34<73:59:05, 10.66s/it]
 34%|███▍      | 12977/37963 [40:21:44<72:11:05, 10.40s/it]
 34%|███▍      | 12978/37963 [40:21:54<71:35:53, 10.32s/it]
 34%|███▍      | 12979/37963 [40:22:04<71:11:30, 10.26s/it]
 34%|███▍      | 12980/37963 [40:22:14<70:57:42, 10.23s/it]
                                                           
{'loss': '0.161', 'grad_norm': '2.493', 'learning_rate': '1.532e-05', 'epoch': '0.3419'}

 34%|███▍      | 12980/37963 [40:22:14<70:57:42, 10.23s/it]
 34%|███▍      | 12981/37963 [40:22:25<70:43:10, 10.19s/it]
 34%|███▍      | 12982/37963 [40:22:42<84:58:42, 12.25s/it]
 34%|███▍      | 12983/37963 [40:22:52<80:32:41, 11.61s/it]
 34%|███▍      | 12984/37963 [40:23:02<77:27:45, 11.16s/it]
 34%|███▍      | 12985/37963 [40:23:12<75:20:04, 10.86s/it]
 34%|███▍      | 12986/37963 [40:23:22<73:45:07, 10.63s/it]
 34%|███▍      | 12987/37963 [40:23:32<72:37:57, 10.47s/it]
 34%|███▍      | 12988/37963 [40:23:42<71:49:12, 10.35s/it]
 34%|███▍      | 12989/37963 [40:23:52<70:40:08, 10.19s/it]
 34%|███▍      | 12990/37963 [40:24:02<70:05:24, 10.10s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '2.042', 'learning_rate': '1.531e-05', 'epoch': '0.3422'}

 34%|███▍      | 12990/37963 [40:24:02<70:05:24, 10.10s/it]
 34%|███▍      | 12991/37963 [40:24:12<70:05:38, 10.10s/it]
 34%|███▍      | 12992/37963 [40:24:22<70:07:59, 10.11s/it]
 34%|███▍      | 12993/37963 [40:24:32<69:51:17, 10.07s/it]
 34%|███▍      | 12994/37963 [40:24:42<69:40:24, 10.05s/it]
 34%|███▍      | 12995/37963 [40:24:59<82:51:00, 11.95s/it]
 34%|███▍      | 12996/37963 [40:25:09<79:05:06, 11.40s/it]
 34%|███▍      | 12997/37963 [40:25:25<89:27:46, 12.90s/it]
 34%|███▍      | 12998/37963 [40:25:35<83:37:07, 12.06s/it]
 34%|███▍      | 12999/37963 [40:25:45<79:44:33, 11.50s/it]
 34%|███▍      | 13000/37963 [40:25:55<76:50:21, 11.08s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '2.283', 'learning_rate': '1.53e-05', 'epoch': '0.3424'}

 34%|███▍      | 13000/37963 [40:25:55<76:50:21, 11.08s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.90s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.90s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 34%|███▍      | 13001/37963 [40:26:56<179:06:30, 25.83s/it]
 34%|███▍      | 13002/37963 [40:27:06<147:36:52, 21.29s/it]
 34%|███▍      | 13003/37963 [40:27:16<124:01:28, 17.89s/it]
 34%|███▍      | 13004/37963 [40:27:26<107:42:27, 15.54s/it]
 34%|███▍      | 13005/37963 [40:27:43<109:38:07, 15.81s/it]
 34%|███▍      | 13006/37963 [40:27:53<97:39:48, 14.09s/it] 
 34%|███▍      | 13007/37963 [40:28:17<118:28:08, 17.09s/it]
 34%|███▍      | 13008/37963 [40:28:27<103:18:39, 14.90s/it]
 34%|███▍      | 13009/37963 [40:28:37<93:16:36, 13.46s/it] 
 34%|███▍      | 13010/37963 [40:28:47<86:10:19, 12.43s/it]
                                                           
{'loss': '0.16', 'grad_norm': '3.474', 'learning_rate': '1.53e-05', 'epoch': '0.3427'}

 34%|███▍      | 13010/37963 [40:28:47<86:10:19, 12.43s/it]
 34%|███▍      | 13011/37963 [40:28:57<80:42:58, 11.65s/it]
 34%|███▍      | 13012/37963 [40:29:06<76:15:27, 11.00s/it]
 34%|███▍      | 13013/37963 [40:29:16<73:48:20, 10.65s/it]
 34%|███▍      | 13014/37963 [40:29:26<72:50:24, 10.51s/it]
 34%|███▍      | 13015/37963 [40:29:36<71:45:59, 10.36s/it]
 34%|███▍      | 13016/37963 [40:29:53<84:59:24, 12.26s/it]
 34%|███▍      | 13017/37963 [40:30:03<80:38:35, 11.64s/it]
 34%|███▍      | 13018/37963 [40:30:20<90:48:05, 13.10s/it]
 34%|███▍      | 13019/37963 [40:30:30<84:45:44, 12.23s/it]
 34%|███▍      | 13020/37963 [40:30:40<80:14:46, 11.58s/it]
                                                           
{'loss': '0.165', 'grad_norm': '2.058', 'learning_rate': '1.529e-05', 'epoch': '0.343'}

 34%|███▍      | 13020/37963 [40:30:40<80:14:46, 11.58s/it]
 34%|███▍      | 13021/37963 [40:30:50<77:16:42, 11.15s/it]
 34%|███▍      | 13022/37963 [40:31:00<75:04:42, 10.84s/it]
 34%|███▍      | 13023/37963 [40:31:10<73:31:32, 10.61s/it]
 34%|███▍      | 13024/37963 [40:31:20<72:30:28, 10.47s/it]
 34%|███▍      | 13025/37963 [40:31:30<71:37:07, 10.34s/it]
 34%|███▍      | 13026/37963 [40:31:40<70:23:00, 10.16s/it]
 34%|███▍      | 13027/37963 [40:31:50<69:33:26, 10.04s/it]
 34%|███▍      | 13028/37963 [40:32:00<68:59:56,  9.96s/it]
 34%|███▍      | 13029/37963 [40:32:10<69:14:14, 10.00s/it]
 34%|███▍      | 13030/37963 [40:32:27<84:22:27, 12.18s/it]
                                                           
{'loss': '0.188', 'grad_norm': '3.01', 'learning_rate': '1.528e-05', 'epoch': '0.3432'}

 34%|███▍      | 13030/37963 [40:32:27<84:22:27, 12.18s/it]
 34%|███▍      | 13031/37963 [40:32:37<79:57:23, 11.55s/it]
 34%|███▍      | 13032/37963 [40:32:47<76:57:20, 11.11s/it]
 34%|███▍      | 13033/37963 [40:32:57<74:52:16, 10.81s/it]
 34%|███▍      | 13034/37963 [40:33:08<73:33:30, 10.62s/it]
 34%|███▍      | 13035/37963 [40:33:18<72:20:54, 10.45s/it]
 34%|███▍      | 13036/37963 [40:33:28<71:21:38, 10.31s/it]
 34%|███▍      | 13037/37963 [40:33:38<70:59:21, 10.25s/it]
 34%|███▍      | 13038/37963 [40:33:48<70:26:30, 10.17s/it]
 34%|███▍      | 13039/37963 [40:33:58<69:52:48, 10.09s/it]
 34%|███▍      | 13040/37963 [40:34:08<69:53:01, 10.09s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '2.159', 'learning_rate': '1.527e-05', 'epoch': '0.3435'}

 34%|███▍      | 13040/37963 [40:34:08<69:53:01, 10.09s/it]
 34%|███▍      | 13041/37963 [40:34:18<69:46:50, 10.08s/it]
 34%|███▍      | 13042/37963 [40:34:28<69:49:57, 10.09s/it]
 34%|███▍      | 13043/37963 [40:34:38<69:38:12, 10.06s/it]
 34%|███▍      | 13044/37963 [40:34:48<69:40:07, 10.06s/it]
 34%|███▍      | 13045/37963 [40:35:11<96:24:39, 13.93s/it]
 34%|███▍      | 13046/37963 [40:35:21<88:46:02, 12.83s/it]
 34%|███▍      | 13047/37963 [40:35:31<83:21:54, 12.05s/it]
 34%|███▍      | 13048/37963 [40:35:41<79:26:51, 11.48s/it]
 34%|███▍      | 13049/37963 [40:35:51<76:25:49, 11.04s/it]
 34%|███▍      | 13050/37963 [40:36:01<74:07:47, 10.71s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '5.049', 'learning_rate': '1.527e-05', 'epoch': '0.3438'}

 34%|███▍      | 13050/37963 [40:36:01<74:07:47, 10.71s/it]
 34%|███▍      | 13051/37963 [40:36:11<72:32:08, 10.48s/it]
 34%|███▍      | 13052/37963 [40:36:28<84:59:38, 12.28s/it]
 34%|███▍      | 13053/37963 [40:36:38<80:44:44, 11.67s/it]
 34%|███▍      | 13054/37963 [40:36:48<77:44:22, 11.24s/it]
 34%|███▍      | 13055/37963 [40:37:11<101:42:15, 14.70s/it]
 34%|███▍      | 13056/37963 [40:37:21<92:06:30, 13.31s/it] 
 34%|███▍      | 13057/37963 [40:37:31<85:40:06, 12.38s/it]
 34%|███▍      | 13058/37963 [40:37:41<80:50:54, 11.69s/it]
 34%|███▍      | 13059/37963 [40:37:51<77:26:03, 11.19s/it]
 34%|███▍      | 13060/37963 [40:38:02<75:28:16, 10.91s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '2.799', 'learning_rate': '1.526e-05', 'epoch': '0.344'}

 34%|███▍      | 13060/37963 [40:38:02<75:28:16, 10.91s/it]
 34%|███▍      | 13061/37963 [40:38:12<73:49:16, 10.67s/it]
 34%|███▍      | 13062/37963 [40:38:22<72:50:36, 10.53s/it]
 34%|███▍      | 13063/37963 [40:38:32<71:56:25, 10.40s/it]
 34%|███▍      | 13064/37963 [40:38:42<71:16:48, 10.31s/it]
 34%|███▍      | 13065/37963 [40:38:59<83:58:13, 12.14s/it]
 34%|███▍      | 13066/37963 [40:39:09<79:35:01, 11.51s/it]
 34%|███▍      | 13067/37963 [40:39:25<90:02:03, 13.02s/it]
 34%|███▍      | 13068/37963 [40:39:35<83:45:07, 12.11s/it]
 34%|███▍      | 13069/37963 [40:39:45<79:26:45, 11.49s/it]
 34%|███▍      | 13070/37963 [40:39:55<76:29:58, 11.06s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '2.841', 'learning_rate': '1.525e-05', 'epoch': '0.3443'}

 34%|███▍      | 13070/37963 [40:39:55<76:29:58, 11.06s/it]
 34%|███▍      | 13071/37963 [40:40:06<74:37:56, 10.79s/it]
 34%|███▍      | 13072/37963 [40:40:16<73:15:40, 10.60s/it]
 34%|███▍      | 13073/37963 [40:40:26<71:50:00, 10.39s/it]
 34%|███▍      | 13074/37963 [40:40:36<71:14:07, 10.30s/it]
 34%|███▍      | 13075/37963 [40:40:46<71:08:08, 10.29s/it]
 34%|███▍      | 13076/37963 [40:40:56<70:55:11, 10.26s/it]
 34%|███▍      | 13077/37963 [40:41:06<70:36:04, 10.21s/it]
 34%|███▍      | 13078/37963 [40:41:23<84:11:12, 12.18s/it]
 34%|███▍      | 13079/37963 [40:41:33<79:53:28, 11.56s/it]
 34%|███▍      | 13080/37963 [40:41:43<76:17:18, 11.04s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '2.57', 'learning_rate': '1.525e-05', 'epoch': '0.3445'}

 34%|███▍      | 13080/37963 [40:41:43<76:17:18, 11.04s/it]
 34%|███▍      | 13081/37963 [40:41:53<74:19:45, 10.75s/it]
 34%|███▍      | 13082/37963 [40:42:03<72:57:50, 10.56s/it]
 34%|███▍      | 13083/37963 [40:42:13<72:03:30, 10.43s/it]
 34%|███▍      | 13084/37963 [40:42:23<71:17:44, 10.32s/it]
 34%|███▍      | 13085/37963 [40:42:33<70:45:53, 10.24s/it]
 34%|███▍      | 13086/37963 [40:42:43<70:30:38, 10.20s/it]
 34%|███▍      | 13087/37963 [40:42:53<69:18:51, 10.03s/it]
 34%|███▍      | 13088/37963 [40:43:03<69:33:14, 10.07s/it]
 34%|███▍      | 13089/37963 [40:43:13<69:42:26, 10.09s/it]
 34%|███▍      | 13090/37963 [40:43:24<69:48:00, 10.10s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '0.7803', 'learning_rate': '1.524e-05', 'epoch': '0.3448'}

 34%|███▍      | 13090/37963 [40:43:24<69:48:00, 10.10s/it]
 34%|███▍      | 13091/37963 [40:43:40<82:01:21, 11.87s/it]
 34%|███▍      | 13092/37963 [40:43:50<78:27:48, 11.36s/it]
 34%|███▍      | 13093/37963 [40:43:59<75:14:18, 10.89s/it]
 34%|███▍      | 13094/37963 [40:44:16<87:09:03, 12.62s/it]
 34%|███▍      | 13095/37963 [40:44:26<81:49:52, 11.85s/it]
 34%|███▍      | 13096/37963 [40:44:36<78:22:17, 11.35s/it]
 34%|███▍      | 13097/37963 [40:44:46<75:49:19, 10.98s/it]
 35%|███▍      | 13098/37963 [40:44:56<73:53:02, 10.70s/it]
 35%|███▍      | 13099/37963 [40:45:07<72:35:15, 10.51s/it]
 35%|███▍      | 13100/37963 [40:45:16<71:04:59, 10.29s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '0.8685', 'learning_rate': '1.523e-05', 'epoch': '0.3451'}

 35%|███▍      | 13100/37963 [40:45:16<71:04:59, 10.29s/it]
 35%|███▍      | 13101/37963 [40:45:33<84:15:45, 12.20s/it]
 35%|███▍      | 13102/37963 [40:45:43<80:02:58, 11.59s/it]
 35%|███▍      | 13103/37963 [40:45:53<77:04:48, 11.16s/it]
 35%|███▍      | 13104/37963 [40:46:10<87:56:52, 12.74s/it]
 35%|███▍      | 13105/37963 [40:46:26<94:52:11, 13.74s/it]
 35%|███▍      | 13106/37963 [40:46:36<87:23:38, 12.66s/it]
 35%|███▍      | 13107/37963 [40:46:46<81:36:46, 11.82s/it]
 35%|███▍      | 13108/37963 [40:46:56<77:43:12, 11.26s/it]
 35%|███▍      | 13109/37963 [40:47:06<75:28:45, 10.93s/it]
 35%|███▍      | 13110/37963 [40:47:16<73:47:10, 10.69s/it]
                                                           
{'loss': '0.152', 'grad_norm': '1.986', 'learning_rate': '1.522e-05', 'epoch': '0.3453'}

 35%|███▍      | 13110/37963 [40:47:16<73:47:10, 10.69s/it]
 35%|███▍      | 13111/37963 [40:47:26<72:42:17, 10.53s/it]
 35%|███▍      | 13112/37963 [40:47:36<70:59:09, 10.28s/it]
 35%|███▍      | 13113/37963 [40:47:53<84:31:52, 12.25s/it]
 35%|███▍      | 13114/37963 [40:48:03<80:00:50, 11.59s/it]
 35%|███▍      | 13115/37963 [40:48:19<89:57:08, 13.03s/it]
 35%|███▍      | 13116/37963 [40:48:29<83:52:35, 12.15s/it]
 35%|███▍      | 13117/37963 [40:48:39<79:39:48, 11.54s/it]
 35%|███▍      | 13118/37963 [40:48:50<77:02:13, 11.16s/it]
 35%|███▍      | 13119/37963 [40:49:00<74:43:03, 10.83s/it]
 35%|███▍      | 13120/37963 [40:49:10<73:11:23, 10.61s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '3.246', 'learning_rate': '1.522e-05', 'epoch': '0.3456'}

 35%|███▍      | 13120/37963 [40:49:10<73:11:23, 10.61s/it]
 35%|███▍      | 13121/37963 [40:49:20<72:22:12, 10.49s/it]
 35%|███▍      | 13122/37963 [40:49:30<71:40:24, 10.39s/it]
 35%|███▍      | 13123/37963 [40:49:40<71:07:20, 10.31s/it]
 35%|███▍      | 13124/37963 [40:49:50<70:09:57, 10.17s/it]
 35%|███▍      | 13125/37963 [40:50:00<69:54:52, 10.13s/it]
 35%|███▍      | 13126/37963 [40:50:10<69:51:19, 10.13s/it]
 35%|███▍      | 13127/37963 [40:50:27<83:24:21, 12.09s/it]
 35%|███▍      | 13128/37963 [40:50:37<79:21:43, 11.50s/it]
 35%|███▍      | 13129/37963 [40:50:47<76:20:54, 11.07s/it]
 35%|███▍      | 13130/37963 [40:50:57<74:15:24, 10.76s/it]
                                                           
{'loss': '0.1766', 'grad_norm': '2.982', 'learning_rate': '1.521e-05', 'epoch': '0.3459'}

 35%|███▍      | 13130/37963 [40:50:57<74:15:24, 10.76s/it]
 35%|███▍      | 13131/37963 [40:51:07<72:46:00, 10.55s/it]
 35%|███▍      | 13132/37963 [40:51:17<71:42:49, 10.40s/it]
 35%|███▍      | 13133/37963 [40:51:27<71:00:12, 10.29s/it]
 35%|███▍      | 13134/37963 [40:51:37<70:24:41, 10.21s/it]
 35%|███▍      | 13135/37963 [40:51:48<70:19:03, 10.20s/it]
 35%|███▍      | 13136/37963 [40:51:58<70:25:47, 10.21s/it]
 35%|███▍      | 13137/37963 [40:52:08<70:18:19, 10.19s/it]
 35%|███▍      | 13138/37963 [40:52:18<70:19:20, 10.20s/it]
 35%|███▍      | 13139/37963 [40:52:28<69:27:36, 10.07s/it]
 35%|███▍      | 13140/37963 [40:52:44<82:38:29, 11.99s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '1.315', 'learning_rate': '1.52e-05', 'epoch': '0.3461'}

 35%|███▍      | 13140/37963 [40:52:44<82:38:29, 11.99s/it]
 35%|███▍      | 13141/37963 [40:52:54<78:40:19, 11.41s/it]
 35%|███▍      | 13142/37963 [40:53:11<89:15:51, 12.95s/it]
 35%|███▍      | 13143/37963 [40:53:21<83:12:05, 12.07s/it]
 35%|███▍      | 13144/37963 [40:53:31<78:01:50, 11.32s/it]
 35%|███▍      | 13145/37963 [40:53:41<75:28:10, 10.95s/it]
 35%|███▍      | 13146/37963 [40:53:51<73:39:32, 10.69s/it]
 35%|███▍      | 13147/37963 [40:54:01<71:58:05, 10.44s/it]
 35%|███▍      | 13148/37963 [40:54:11<70:54:00, 10.29s/it]
 35%|███▍      | 13149/37963 [40:54:21<70:17:22, 10.20s/it]
 35%|███▍      | 13150/37963 [40:54:37<82:49:02, 12.02s/it]
                                                           
{'loss': '0.1675', 'grad_norm': '1.676', 'learning_rate': '1.519e-05', 'epoch': '0.3464'}

 35%|███▍      | 13150/37963 [40:54:37<82:49:02, 12.02s/it]
 35%|███▍      | 13151/37963 [40:54:47<78:56:15, 11.45s/it]
 35%|███▍      | 13152/37963 [40:54:57<76:04:02, 11.04s/it]
 35%|███▍      | 13153/37963 [40:55:14<88:18:45, 12.81s/it]
 35%|███▍      | 13154/37963 [40:55:24<82:44:12, 12.01s/it]
 35%|███▍      | 13155/37963 [40:55:34<78:41:20, 11.42s/it]
 35%|███▍      | 13156/37963 [40:55:44<76:08:24, 11.05s/it]
 35%|███▍      | 13157/37963 [40:55:54<74:04:36, 10.75s/it]
 35%|███▍      | 13158/37963 [40:56:04<72:41:34, 10.55s/it]
 35%|███▍      | 13159/37963 [40:56:15<71:41:02, 10.40s/it]
 35%|███▍      | 13160/37963 [40:56:31<84:43:39, 12.30s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '1.407', 'learning_rate': '1.519e-05', 'epoch': '0.3467'}

 35%|███▍      | 13160/37963 [40:56:31<84:43:39, 12.30s/it]
 35%|███▍      | 13161/37963 [40:56:41<79:34:02, 11.55s/it]
 35%|███▍      | 13162/37963 [40:56:51<76:41:45, 11.13s/it]
 35%|███▍      | 13163/37963 [40:57:01<74:15:07, 10.78s/it]
 35%|███▍      | 13164/37963 [40:57:18<85:53:43, 12.47s/it]
 35%|███▍      | 13165/37963 [40:57:27<80:25:08, 11.67s/it]
 35%|███▍      | 13166/37963 [40:57:37<77:05:48, 11.19s/it]
 35%|███▍      | 13167/37963 [40:57:48<74:56:38, 10.88s/it]
 35%|███▍      | 13168/37963 [40:57:57<72:45:57, 10.56s/it]
 35%|███▍      | 13169/37963 [40:58:08<71:48:42, 10.43s/it]
 35%|███▍      | 13170/37963 [40:58:18<71:06:44, 10.33s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '1.015', 'learning_rate': '1.518e-05', 'epoch': '0.3469'}

 35%|███▍      | 13170/37963 [40:58:18<71:06:44, 10.33s/it]
 35%|███▍      | 13171/37963 [40:58:28<70:30:52, 10.24s/it]
 35%|███▍      | 13172/37963 [40:58:38<70:05:06, 10.18s/it]
 35%|███▍      | 13173/37963 [40:58:48<70:00:28, 10.17s/it]
 35%|███▍      | 13174/37963 [40:58:58<69:28:15, 10.09s/it]
 35%|███▍      | 13175/37963 [40:59:08<69:19:23, 10.07s/it]
 35%|███▍      | 13176/37963 [40:59:25<84:02:58, 12.21s/it]
 35%|███▍      | 13177/37963 [40:59:35<79:20:25, 11.52s/it]
 35%|███▍      | 13178/37963 [40:59:45<76:30:05, 11.11s/it]
 35%|███▍      | 13179/37963 [40:59:55<73:49:32, 10.72s/it]
 35%|███▍      | 13180/37963 [41:00:05<72:28:29, 10.53s/it]
                                                           
{'loss': '0.1631', 'grad_norm': '3.029', 'learning_rate': '1.517e-05', 'epoch': '0.3472'}

 35%|███▍      | 13180/37963 [41:00:05<72:28:29, 10.53s/it]
 35%|███▍      | 13181/37963 [41:00:15<71:59:24, 10.46s/it]
 35%|███▍      | 13182/37963 [41:00:25<71:14:39, 10.35s/it]
 35%|███▍      | 13183/37963 [41:00:35<70:40:28, 10.27s/it]
 35%|███▍      | 13184/37963 [41:00:45<70:17:40, 10.21s/it]
 35%|███▍      | 13185/37963 [41:00:56<69:55:45, 10.16s/it]
 35%|███▍      | 13186/37963 [41:01:05<68:35:45,  9.97s/it]
 35%|███▍      | 13187/37963 [41:01:15<68:46:48,  9.99s/it]
 35%|███▍      | 13188/37963 [41:01:25<69:09:57, 10.05s/it]
 35%|███▍      | 13189/37963 [41:01:42<82:42:26, 12.02s/it]
 35%|███▍      | 13190/37963 [41:01:52<78:44:56, 11.44s/it]
                                                           
{'loss': '0.1698', 'grad_norm': '2.444', 'learning_rate': '1.517e-05', 'epoch': '0.3474'}

 35%|███▍      | 13190/37963 [41:01:52<78:44:56, 11.44s/it]
 35%|███▍      | 13191/37963 [41:02:08<88:48:54, 12.91s/it]
 35%|███▍      | 13192/37963 [41:02:18<82:56:57, 12.06s/it]
 35%|███▍      | 13193/37963 [41:02:28<78:34:06, 11.42s/it]
 35%|███▍      | 13194/37963 [41:02:38<75:11:32, 10.93s/it]
 35%|███▍      | 13195/37963 [41:02:48<73:07:46, 10.63s/it]
 35%|███▍      | 13196/37963 [41:02:58<72:11:25, 10.49s/it]
 35%|███▍      | 13197/37963 [41:03:15<84:59:56, 12.36s/it]
 35%|███▍      | 13198/37963 [41:03:24<79:13:21, 11.52s/it]
 35%|███▍      | 13199/37963 [41:03:34<75:55:25, 11.04s/it]
 35%|███▍      | 13200/37963 [41:03:45<74:12:54, 10.79s/it]
                                                           
{'loss': '0.1721', 'grad_norm': '3.458', 'learning_rate': '1.516e-05', 'epoch': '0.3477'}

 35%|███▍      | 13200/37963 [41:03:45<74:12:54, 10.79s/it]
 35%|███▍      | 13201/37963 [41:04:02<87:39:11, 12.74s/it]
 35%|███▍      | 13202/37963 [41:04:18<94:00:35, 13.67s/it]
 35%|███▍      | 13203/37963 [41:04:28<86:34:36, 12.59s/it]
 35%|███▍      | 13204/37963 [41:04:38<80:39:47, 11.73s/it]
 35%|███▍      | 13205/37963 [41:04:47<76:28:07, 11.12s/it]
 35%|███▍      | 13206/37963 [41:04:57<73:39:52, 10.71s/it]
 35%|███▍      | 13207/37963 [41:05:07<72:27:50, 10.54s/it]
 35%|███▍      | 13208/37963 [41:05:17<71:47:54, 10.44s/it]
 35%|███▍      | 13209/37963 [41:05:34<84:43:38, 12.32s/it]
 35%|███▍      | 13210/37963 [41:05:44<80:14:42, 11.67s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '2.702', 'learning_rate': '1.515e-05', 'epoch': '0.348'}

 35%|███▍      | 13210/37963 [41:05:44<80:14:42, 11.67s/it]
 35%|███▍      | 13211/37963 [41:05:54<77:05:57, 11.21s/it]
 35%|███▍      | 13212/37963 [41:06:11<87:55:16, 12.79s/it]
 35%|███▍      | 13213/37963 [41:06:21<81:58:42, 11.92s/it]
 35%|███▍      | 13214/37963 [41:06:31<78:20:16, 11.40s/it]
 35%|███▍      | 13215/37963 [41:06:41<75:52:24, 11.04s/it]
 35%|███▍      | 13216/37963 [41:06:51<73:43:04, 10.72s/it]
 35%|███▍      | 13217/37963 [41:07:00<70:57:11, 10.32s/it]
 35%|███▍      | 13218/37963 [41:07:10<70:02:16, 10.19s/it]
 35%|███▍      | 13219/37963 [41:07:20<69:41:44, 10.14s/it]
 35%|███▍      | 13220/37963 [41:07:30<69:05:35, 10.05s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '1.29', 'learning_rate': '1.514e-05', 'epoch': '0.3482'}

 35%|███▍      | 13220/37963 [41:07:30<69:05:35, 10.05s/it]
 35%|███▍      | 13221/37963 [41:07:40<69:14:18, 10.07s/it]
 35%|███▍      | 13222/37963 [41:07:50<69:15:26, 10.08s/it]
 35%|███▍      | 13223/37963 [41:08:07<83:06:01, 12.09s/it]
 35%|███▍      | 13224/37963 [41:08:18<79:26:16, 11.56s/it]
 35%|███▍      | 13225/37963 [41:08:28<76:27:18, 11.13s/it]
 35%|███▍      | 13226/37963 [41:08:38<74:10:57, 10.80s/it]
 35%|███▍      | 13227/37963 [41:08:48<72:58:43, 10.62s/it]
 35%|███▍      | 13228/37963 [41:08:58<71:36:54, 10.42s/it]
 35%|███▍      | 13229/37963 [41:09:08<70:58:40, 10.33s/it]
 35%|███▍      | 13230/37963 [41:09:18<70:34:00, 10.27s/it]
                                                           
{'loss': '0.1736', 'grad_norm': '2.171', 'learning_rate': '1.514e-05', 'epoch': '0.3485'}

 35%|███▍      | 13230/37963 [41:09:18<70:34:00, 10.27s/it]
 35%|███▍      | 13231/37963 [41:09:28<69:22:17, 10.10s/it]
 35%|███▍      | 13232/37963 [41:09:38<69:19:39, 10.09s/it]
 35%|███▍      | 13233/37963 [41:09:48<68:48:43, 10.02s/it]
 35%|███▍      | 13234/37963 [41:09:58<68:33:23,  9.98s/it]
 35%|███▍      | 13235/37963 [41:10:08<68:57:36, 10.04s/it]
 35%|███▍      | 13236/37963 [41:10:18<69:16:16, 10.09s/it]
 35%|███▍      | 13237/37963 [41:10:28<69:10:56, 10.07s/it]
 35%|███▍      | 13238/37963 [41:10:44<81:28:52, 11.86s/it]
 35%|███▍      | 13239/37963 [41:11:01<91:08:42, 13.27s/it]
 35%|███▍      | 13240/37963 [41:11:11<84:35:05, 12.32s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '1.008', 'learning_rate': '1.513e-05', 'epoch': '0.3488'}

 35%|███▍      | 13240/37963 [41:11:11<84:35:05, 12.32s/it]
 35%|███▍      | 13241/37963 [41:11:21<80:03:17, 11.66s/it]
 35%|███▍      | 13242/37963 [41:11:31<76:47:39, 11.18s/it]
 35%|███▍      | 13243/37963 [41:11:41<74:35:03, 10.86s/it]
 35%|███▍      | 13244/37963 [41:11:51<73:13:20, 10.66s/it]
 35%|███▍      | 13245/37963 [41:12:01<72:07:23, 10.50s/it]
 35%|███▍      | 13246/37963 [41:12:18<84:46:59, 12.35s/it]
 35%|███▍      | 13247/37963 [41:12:28<80:09:23, 11.68s/it]
 35%|███▍      | 13248/37963 [41:12:45<90:43:49, 13.22s/it]
 35%|███▍      | 13249/37963 [41:12:55<84:23:16, 12.29s/it]
 35%|███▍      | 13250/37963 [41:13:05<79:54:26, 11.64s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '2.141', 'learning_rate': '1.512e-05', 'epoch': '0.349'}

 35%|███▍      | 13250/37963 [41:13:05<79:54:26, 11.64s/it]
 35%|███▍      | 13251/37963 [41:13:22<90:01:20, 13.11s/it]
 35%|███▍      | 13252/37963 [41:13:32<83:53:16, 12.22s/it]
 35%|███▍      | 13253/37963 [41:13:42<79:25:17, 11.57s/it]
 35%|███▍      | 13254/37963 [41:13:52<76:22:58, 11.13s/it]
 35%|███▍      | 13255/37963 [41:14:02<74:06:33, 10.80s/it]
 35%|███▍      | 13256/37963 [41:14:18<85:14:44, 12.42s/it]
 35%|███▍      | 13257/37963 [41:14:29<80:52:38, 11.78s/it]
 35%|███▍      | 13258/37963 [41:14:38<76:35:58, 11.16s/it]
 35%|███▍      | 13259/37963 [41:14:48<74:22:42, 10.84s/it]
 35%|███▍      | 13260/37963 [41:15:05<86:17:20, 12.58s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '2.888', 'learning_rate': '1.511e-05', 'epoch': '0.3493'}

 35%|███▍      | 13260/37963 [41:15:05<86:17:20, 12.58s/it]
 35%|███▍      | 13261/37963 [41:15:15<81:07:04, 11.82s/it]
 35%|███▍      | 13262/37963 [41:15:25<77:27:20, 11.29s/it]
 35%|███▍      | 13263/37963 [41:15:35<75:01:56, 10.94s/it]
 35%|███▍      | 13264/37963 [41:15:45<73:15:44, 10.68s/it]
 35%|███▍      | 13265/37963 [41:15:55<71:46:36, 10.46s/it]
 35%|███▍      | 13266/37963 [41:16:05<70:40:13, 10.30s/it]
 35%|███▍      | 13267/37963 [41:16:15<69:15:46, 10.10s/it]
 35%|███▍      | 13268/37963 [41:16:25<69:14:19, 10.09s/it]
 35%|███▍      | 13269/37963 [41:16:35<68:56:39, 10.05s/it]
 35%|███▍      | 13270/37963 [41:16:45<69:14:45, 10.10s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '1.951', 'learning_rate': '1.511e-05', 'epoch': '0.3496'}

 35%|███▍      | 13270/37963 [41:16:45<69:14:45, 10.10s/it]
 35%|███▍      | 13271/37963 [41:16:55<69:19:32, 10.11s/it]
 35%|███▍      | 13272/37963 [41:17:12<83:05:37, 12.12s/it]
 35%|███▍      | 13273/37963 [41:17:22<79:17:40, 11.56s/it]
 35%|███▍      | 13274/37963 [41:17:32<75:45:29, 11.05s/it]
 35%|███▍      | 13275/37963 [41:17:42<73:42:45, 10.75s/it]
 35%|███▍      | 13276/37963 [41:17:52<72:16:47, 10.54s/it]
 35%|███▍      | 13277/37963 [41:18:02<71:27:46, 10.42s/it]
 35%|███▍      | 13278/37963 [41:18:12<70:42:32, 10.31s/it]
 35%|███▍      | 13279/37963 [41:18:22<70:12:20, 10.24s/it]
 35%|███▍      | 13280/37963 [41:18:33<69:54:45, 10.20s/it]
                                                           
{'loss': '0.1535', 'grad_norm': '1.487', 'learning_rate': '1.51e-05', 'epoch': '0.3498'}

 35%|███▍      | 13280/37963 [41:18:33<69:54:45, 10.20s/it]
 35%|███▍      | 13281/37963 [41:18:43<69:36:35, 10.15s/it]
 35%|███▍      | 13282/37963 [41:18:53<69:50:35, 10.19s/it]
 35%|███▍      | 13283/37963 [41:19:03<69:41:55, 10.17s/it]
 35%|███▍      | 13284/37963 [41:19:20<82:50:17, 12.08s/it]
 35%|███▍      | 13285/37963 [41:19:30<78:41:20, 11.48s/it]
 35%|███▍      | 13286/37963 [41:19:40<75:43:17, 11.05s/it]
 35%|███▍      | 13287/37963 [41:19:49<73:14:05, 10.68s/it]
 35%|███▌      | 13288/37963 [41:20:06<85:14:42, 12.44s/it]
 35%|███▌      | 13289/37963 [41:20:16<80:38:35, 11.77s/it]
 35%|███▌      | 13290/37963 [41:20:26<77:10:15, 11.26s/it]
                                                           
{'loss': '0.1855', 'grad_norm': '4.05', 'learning_rate': '1.509e-05', 'epoch': '0.3501'}

 35%|███▌      | 13290/37963 [41:20:27<77:10:15, 11.26s/it]
 35%|███▌      | 13291/37963 [41:20:36<74:42:28, 10.90s/it]
 35%|███▌      | 13292/37963 [41:20:46<73:05:38, 10.67s/it]
 35%|███▌      | 13293/37963 [41:20:56<71:47:36, 10.48s/it]
 35%|███▌      | 13294/37963 [41:21:07<71:03:01, 10.37s/it]
 35%|███▌      | 13295/37963 [41:21:30<98:15:06, 14.34s/it]
 35%|███▌      | 13296/37963 [41:21:40<89:09:09, 13.01s/it]
 35%|███▌      | 13297/37963 [41:21:50<83:10:10, 12.14s/it]
 35%|███▌      | 13298/37963 [41:22:07<92:08:29, 13.45s/it]
 35%|███▌      | 13299/37963 [41:22:17<85:13:31, 12.44s/it]
 35%|███▌      | 13300/37963 [41:22:27<80:16:34, 11.72s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '3.675', 'learning_rate': '1.508e-05', 'epoch': '0.3503'}

 35%|███▌      | 13300/37963 [41:22:27<80:16:34, 11.72s/it]
 35%|███▌      | 13301/37963 [41:22:36<75:51:54, 11.07s/it]
 35%|███▌      | 13302/37963 [41:22:47<73:55:36, 10.79s/it]
 35%|███▌      | 13303/37963 [41:22:57<72:38:38, 10.60s/it]
 35%|███▌      | 13304/37963 [41:23:07<71:39:10, 10.46s/it]
 35%|███▌      | 13305/37963 [41:23:17<71:12:44, 10.40s/it]
 35%|███▌      | 13306/37963 [41:23:34<84:02:10, 12.27s/it]
 35%|███▌      | 13307/37963 [41:23:43<78:51:04, 11.51s/it]
 35%|███▌      | 13308/37963 [41:24:00<88:58:45, 12.99s/it]
 35%|███▌      | 13309/37963 [41:24:10<82:56:54, 12.11s/it]
 35%|███▌      | 13310/37963 [41:24:20<78:56:23, 11.53s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '1.794', 'learning_rate': '1.508e-05', 'epoch': '0.3506'}

 35%|███▌      | 13310/37963 [41:24:20<78:56:23, 11.53s/it]
 35%|███▌      | 13311/37963 [41:24:30<76:31:03, 11.17s/it]
 35%|███▌      | 13312/37963 [41:24:41<74:10:29, 10.83s/it]
 35%|███▌      | 13313/37963 [41:24:51<72:41:54, 10.62s/it]
 35%|███▌      | 13314/37963 [41:25:00<70:55:50, 10.36s/it]
 35%|███▌      | 13315/37963 [41:25:10<70:18:36, 10.27s/it]
 35%|███▌      | 13316/37963 [41:25:21<69:53:24, 10.21s/it]
 35%|███▌      | 13317/37963 [41:25:30<69:14:50, 10.11s/it]
 35%|███▌      | 13318/37963 [41:25:40<68:57:40, 10.07s/it]
 35%|███▌      | 13319/37963 [41:25:50<68:12:33,  9.96s/it]
 35%|███▌      | 13320/37963 [41:26:00<68:33:39, 10.02s/it]
                                                           
{'loss': '0.1528', 'grad_norm': '0.9686', 'learning_rate': '1.507e-05', 'epoch': '0.3509'}

 35%|███▌      | 13320/37963 [41:26:00<68:33:39, 10.02s/it]
 35%|███▌      | 13321/37963 [41:26:17<82:23:47, 12.04s/it]
 35%|███▌      | 13322/37963 [41:26:27<78:21:38, 11.45s/it]
 35%|███▌      | 13323/37963 [41:26:37<74:32:11, 10.89s/it]
 35%|███▌      | 13324/37963 [41:26:47<72:29:09, 10.59s/it]
 35%|███▌      | 13325/37963 [41:26:56<70:51:21, 10.35s/it]
 35%|███▌      | 13326/37963 [41:27:06<70:14:09, 10.26s/it]
 35%|███▌      | 13327/37963 [41:27:17<70:05:27, 10.24s/it]
 35%|███▌      | 13328/37963 [41:27:27<69:50:43, 10.21s/it]
 35%|███▌      | 13329/37963 [41:27:37<69:33:40, 10.17s/it]
 35%|███▌      | 13330/37963 [41:27:47<69:02:44, 10.09s/it]
                                                           
{'loss': '0.1791', 'grad_norm': '1.556', 'learning_rate': '1.506e-05', 'epoch': '0.3511'}

 35%|███▌      | 13330/37963 [41:27:47<69:02:44, 10.09s/it]
 35%|███▌      | 13331/37963 [41:27:57<68:55:35, 10.07s/it]
 35%|███▌      | 13332/37963 [41:28:13<81:57:22, 11.98s/it]
 35%|███▌      | 13333/37963 [41:28:23<77:42:23, 11.36s/it]
 35%|███▌      | 13334/37963 [41:28:33<75:06:09, 10.98s/it]
 35%|███▌      | 13335/37963 [41:28:50<86:16:22, 12.61s/it]
 35%|███▌      | 13336/37963 [41:29:00<81:02:01, 11.85s/it]
 35%|███▌      | 13337/37963 [41:29:10<77:24:48, 11.32s/it]
 35%|███▌      | 13338/37963 [41:29:19<73:55:49, 10.81s/it]
 35%|███▌      | 13339/37963 [41:29:29<72:25:37, 10.59s/it]
 35%|███▌      | 13340/37963 [41:29:39<70:42:17, 10.34s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '1.645', 'learning_rate': '1.506e-05', 'epoch': '0.3514'}

 35%|███▌      | 13340/37963 [41:29:39<70:42:17, 10.34s/it]
 35%|███▌      | 13341/37963 [41:29:49<70:21:25, 10.29s/it]
 35%|███▌      | 13342/37963 [41:29:59<69:40:50, 10.19s/it]
 35%|███▌      | 13343/37963 [41:30:09<69:23:47, 10.15s/it]
 35%|███▌      | 13344/37963 [41:30:26<82:43:43, 12.10s/it]
 35%|███▌      | 13345/37963 [41:30:50<106:38:46, 15.60s/it]
 35%|███▌      | 13346/37963 [41:30:59<94:36:36, 13.84s/it] 
 35%|███▌      | 13347/37963 [41:31:10<87:00:06, 12.72s/it]
 35%|███▌      | 13348/37963 [41:31:19<80:51:54, 11.83s/it]
 35%|███▌      | 13349/37963 [41:31:29<77:24:43, 11.32s/it]
 35%|███▌      | 13350/37963 [41:31:40<74:56:44, 10.96s/it]
                                                           
{'loss': '0.1643', 'grad_norm': '1.666', 'learning_rate': '1.505e-05', 'epoch': '0.3517'}

 35%|███▌      | 13350/37963 [41:31:40<74:56:44, 10.96s/it]
 35%|███▌      | 13351/37963 [41:31:50<73:22:09, 10.73s/it]
 35%|███▌      | 13352/37963 [41:32:00<72:04:25, 10.54s/it]
 35%|███▌      | 13353/37963 [41:32:10<70:48:52, 10.36s/it]
 35%|███▌      | 13354/37963 [41:32:26<83:09:29, 12.17s/it]
 35%|███▌      | 13355/37963 [41:32:36<78:49:53, 11.53s/it]
 35%|███▌      | 13356/37963 [41:32:46<75:56:13, 11.11s/it]
 35%|███▌      | 13357/37963 [41:33:03<86:42:38, 12.69s/it]
 35%|███▌      | 13358/37963 [41:33:12<80:24:44, 11.77s/it]
 35%|███▌      | 13359/37963 [41:33:22<76:54:43, 11.25s/it]
 35%|███▌      | 13360/37963 [41:33:33<74:32:04, 10.91s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '1.179', 'learning_rate': '1.504e-05', 'epoch': '0.3519'}

 35%|███▌      | 13360/37963 [41:33:33<74:32:04, 10.91s/it]
 35%|███▌      | 13361/37963 [41:33:42<72:17:00, 10.58s/it]
 35%|███▌      | 13362/37963 [41:33:52<71:10:02, 10.41s/it]
 35%|███▌      | 13363/37963 [41:34:03<70:35:04, 10.33s/it]
 35%|███▌      | 13364/37963 [41:34:12<69:40:48, 10.20s/it]
 35%|███▌      | 13365/37963 [41:34:23<69:36:59, 10.19s/it]
 35%|███▌      | 13366/37963 [41:34:33<69:22:59, 10.15s/it]
 35%|███▌      | 13367/37963 [41:34:43<69:19:22, 10.15s/it]
 35%|███▌      | 13368/37963 [41:34:53<68:55:55, 10.09s/it]
 35%|███▌      | 13369/37963 [41:35:03<69:06:17, 10.12s/it]
 35%|███▌      | 13370/37963 [41:35:13<68:45:43, 10.07s/it]
                                                           
{'loss': '0.163', 'grad_norm': '2.551', 'learning_rate': '1.503e-05', 'epoch': '0.3522'}

 35%|███▌      | 13370/37963 [41:35:13<68:45:43, 10.07s/it]
 35%|███▌      | 13371/37963 [41:35:30<83:11:31, 12.18s/it]
 35%|███▌      | 13372/37963 [41:35:40<79:00:28, 11.57s/it]
 35%|███▌      | 13373/37963 [41:35:50<75:53:50, 11.11s/it]
 35%|███▌      | 13374/37963 [41:36:00<73:56:00, 10.82s/it]
 35%|███▌      | 13375/37963 [41:36:10<72:33:39, 10.62s/it]
 35%|███▌      | 13376/37963 [41:36:21<71:36:47, 10.49s/it]
 35%|███▌      | 13377/37963 [41:36:31<70:53:58, 10.38s/it]
 35%|███▌      | 13378/37963 [41:36:41<70:14:40, 10.29s/it]
 35%|███▌      | 13379/37963 [41:36:51<69:49:39, 10.23s/it]
 35%|███▌      | 13380/37963 [41:37:01<69:45:28, 10.22s/it]
                                                           
{'loss': '0.1765', 'grad_norm': '0.6258', 'learning_rate': '1.503e-05', 'epoch': '0.3524'}

 35%|███▌      | 13380/37963 [41:37:01<69:45:28, 10.22s/it]
 35%|███▌      | 13381/37963 [41:37:18<82:27:20, 12.08s/it]
 35%|███▌      | 13382/37963 [41:37:28<78:41:45, 11.53s/it]
 35%|███▌      | 13383/37963 [41:37:44<88:54:45, 13.02s/it]
 35%|███▌      | 13384/37963 [41:37:55<83:12:46, 12.19s/it]
 35%|███▌      | 13385/37963 [41:38:05<79:11:33, 11.60s/it]
 35%|███▌      | 13386/37963 [41:38:14<75:15:54, 11.02s/it]
 35%|███▌      | 13387/37963 [41:38:25<73:28:13, 10.76s/it]
 35%|███▌      | 13388/37963 [41:38:35<72:14:53, 10.58s/it]
 35%|███▌      | 13389/37963 [41:38:45<71:27:00, 10.47s/it]
 35%|███▌      | 13390/37963 [41:38:55<70:33:46, 10.34s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '3.208', 'learning_rate': '1.502e-05', 'epoch': '0.3527'}

 35%|███▌      | 13390/37963 [41:38:55<70:33:46, 10.34s/it]
 35%|███▌      | 13391/37963 [41:39:04<68:46:12, 10.08s/it]
 35%|███▌      | 13392/37963 [41:39:14<68:42:18, 10.07s/it]
 35%|███▌      | 13393/37963 [41:39:38<96:26:04, 14.13s/it]
 35%|███▌      | 13394/37963 [41:39:48<88:23:39, 12.95s/it]
 35%|███▌      | 13395/37963 [41:39:58<82:41:03, 12.12s/it]
 35%|███▌      | 13396/37963 [41:40:15<90:45:19, 13.30s/it]
 35%|███▌      | 13397/37963 [41:40:25<84:09:22, 12.33s/it]
 35%|███▌      | 13398/37963 [41:40:35<79:38:42, 11.67s/it]
 35%|███▌      | 13399/37963 [41:40:45<76:24:28, 11.20s/it]
 35%|███▌      | 13400/37963 [41:40:55<74:23:43, 10.90s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '1.75', 'learning_rate': '1.501e-05', 'epoch': '0.353'}

 35%|███▌      | 13400/37963 [41:40:55<74:23:43, 10.90s/it]
 35%|███▌      | 13401/37963 [41:41:12<86:00:24, 12.61s/it]
 35%|███▌      | 13402/37963 [41:41:22<81:10:00, 11.90s/it]
 35%|███▌      | 13403/37963 [41:41:32<77:34:42, 11.37s/it]
 35%|███▌      | 13404/37963 [41:41:42<74:56:27, 10.99s/it]
 35%|███▌      | 13405/37963 [41:41:58<86:01:09, 12.61s/it]
 35%|███▌      | 13406/37963 [41:42:09<80:53:31, 11.86s/it]
 35%|███▌      | 13407/37963 [41:42:19<77:08:31, 11.31s/it]
 35%|███▌      | 13408/37963 [41:42:28<73:25:50, 10.77s/it]
 35%|███▌      | 13409/37963 [41:42:38<72:03:35, 10.57s/it]
 35%|███▌      | 13410/37963 [41:42:48<71:13:52, 10.44s/it]
                                                           
{'loss': '0.1671', 'grad_norm': '3.709', 'learning_rate': '1.5e-05', 'epoch': '0.3532'}

 35%|███▌      | 13410/37963 [41:42:48<71:13:52, 10.44s/it]
 35%|███▌      | 13411/37963 [41:42:58<70:03:30, 10.27s/it]
 35%|███▌      | 13412/37963 [41:43:08<69:37:32, 10.21s/it]
 35%|███▌      | 13413/37963 [41:43:18<69:31:00, 10.19s/it]
 35%|███▌      | 13414/37963 [41:43:29<69:19:33, 10.17s/it]
 35%|███▌      | 13415/37963 [41:43:38<68:34:42, 10.06s/it]
 35%|███▌      | 13416/37963 [41:43:48<68:30:50, 10.05s/it]
 35%|███▌      | 13417/37963 [41:43:58<68:31:17, 10.05s/it]
 35%|███▌      | 13418/37963 [41:44:09<68:42:10, 10.08s/it]
 35%|███▌      | 13419/37963 [41:44:25<82:22:44, 12.08s/it]
 35%|███▌      | 13420/37963 [41:44:35<78:16:49, 11.48s/it]
                                                           
{'loss': '0.1679', 'grad_norm': '4.003', 'learning_rate': '1.5e-05', 'epoch': '0.3535'}

 35%|███▌      | 13420/37963 [41:44:35<78:16:49, 11.48s/it]
 35%|███▌      | 13421/37963 [41:44:45<74:43:07, 10.96s/it]
 35%|███▌      | 13422/37963 [41:44:55<72:00:38, 10.56s/it]
 35%|███▌      | 13423/37963 [41:45:05<70:41:58, 10.37s/it]
 35%|███▌      | 13424/37963 [41:45:15<70:07:57, 10.29s/it]
 35%|███▌      | 13425/37963 [41:45:25<69:49:23, 10.24s/it]
 35%|███▌      | 13426/37963 [41:45:35<69:32:03, 10.20s/it]
 35%|███▌      | 13427/37963 [41:45:45<69:28:32, 10.19s/it]
 35%|███▌      | 13428/37963 [41:45:55<68:33:32, 10.06s/it]
 35%|███▌      | 13429/37963 [41:46:11<80:51:15, 11.86s/it]
 35%|███▌      | 13430/37963 [41:46:21<77:08:48, 11.32s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '1.476', 'learning_rate': '1.499e-05', 'epoch': '0.3538'}

 35%|███▌      | 13430/37963 [41:46:21<77:08:48, 11.32s/it]
 35%|███▌      | 13431/37963 [41:46:31<74:22:40, 10.91s/it]
 35%|███▌      | 13432/37963 [41:46:41<72:57:07, 10.71s/it]
 35%|███▌      | 13433/37963 [41:46:58<84:21:16, 12.38s/it]
 35%|███▌      | 13434/37963 [41:47:08<79:41:40, 11.70s/it]
 35%|███▌      | 13435/37963 [41:47:18<76:02:49, 11.16s/it]
 35%|███▌      | 13436/37963 [41:47:28<73:53:35, 10.85s/it]
 35%|███▌      | 13437/37963 [41:47:38<72:23:44, 10.63s/it]
 35%|███▌      | 13438/37963 [41:47:48<71:30:35, 10.50s/it]
 35%|███▌      | 13439/37963 [41:47:58<70:50:35, 10.40s/it]
 35%|███▌      | 13440/37963 [41:48:15<83:19:33, 12.23s/it]
                                                           
{'loss': '0.1577', 'grad_norm': '4.347', 'learning_rate': '1.498e-05', 'epoch': '0.354'}

 35%|███▌      | 13440/37963 [41:48:15<83:19:33, 12.23s/it]
 35%|███▌      | 13441/37963 [41:48:32<93:07:27, 13.67s/it]
 35%|███▌      | 13442/37963 [41:48:41<85:01:03, 12.48s/it]
 35%|███▌      | 13443/37963 [41:48:52<80:12:08, 11.78s/it]
 35%|███▌      | 13444/37963 [41:49:08<88:54:11, 13.05s/it]
 35%|███▌      | 13445/37963 [41:49:18<82:47:55, 12.16s/it]
 35%|███▌      | 13446/37963 [41:49:28<78:17:22, 11.50s/it]
 35%|███▌      | 13447/37963 [41:49:38<75:26:51, 11.08s/it]
 35%|███▌      | 13448/37963 [41:49:48<73:30:16, 10.79s/it]
 35%|███▌      | 13449/37963 [41:49:58<71:57:59, 10.57s/it]
 35%|███▌      | 13450/37963 [41:50:14<83:18:02, 12.23s/it]
                                                           
{'loss': '0.1657', 'grad_norm': '2.863', 'learning_rate': '1.497e-05', 'epoch': '0.3543'}

 35%|███▌      | 13450/37963 [41:50:14<83:18:02, 12.23s/it]
 35%|███▌      | 13451/37963 [41:50:24<79:06:30, 11.62s/it]
 35%|███▌      | 13452/37963 [41:50:34<76:04:43, 11.17s/it]
 35%|███▌      | 13453/37963 [41:50:50<86:09:15, 12.65s/it]
 35%|███▌      | 13454/37963 [41:51:00<80:46:49, 11.87s/it]
 35%|███▌      | 13455/37963 [41:51:10<76:36:31, 11.25s/it]
 35%|███▌      | 13456/37963 [41:51:20<73:57:46, 10.86s/it]
 35%|███▌      | 13457/37963 [41:51:30<72:25:37, 10.64s/it]
 35%|███▌      | 13458/37963 [41:51:41<71:23:47, 10.49s/it]
 35%|███▌      | 13459/37963 [41:51:51<70:26:12, 10.35s/it]
 35%|███▌      | 13460/37963 [41:52:00<68:51:55, 10.12s/it]
                                                           
{'loss': '0.1545', 'grad_norm': '2.777', 'learning_rate': '1.497e-05', 'epoch': '0.3546'}

 35%|███▌      | 13460/37963 [41:52:00<68:51:55, 10.12s/it]
 35%|███▌      | 13461/37963 [41:52:10<68:44:28, 10.10s/it]
 35%|███▌      | 13462/37963 [41:52:20<68:28:06, 10.06s/it]
 35%|███▌      | 13463/37963 [41:52:30<68:26:24, 10.06s/it]
 35%|███▌      | 13464/37963 [41:52:40<68:27:58, 10.06s/it]
 35%|███▌      | 13465/37963 [41:52:50<68:44:30, 10.10s/it]
 35%|███▌      | 13466/37963 [41:53:01<68:54:39, 10.13s/it]
 35%|███▌      | 13467/37963 [41:53:18<82:47:08, 12.17s/it]
 35%|███▌      | 13468/37963 [41:53:27<77:56:53, 11.46s/it]
 35%|███▌      | 13469/37963 [41:53:37<75:05:34, 11.04s/it]
 35%|███▌      | 13470/37963 [41:53:48<73:12:27, 10.76s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '3.305', 'learning_rate': '1.496e-05', 'epoch': '0.3548'}

 35%|███▌      | 13470/37963 [41:53:48<73:12:27, 10.76s/it]
 35%|███▌      | 13471/37963 [41:53:57<71:17:09, 10.48s/it]
 35%|███▌      | 13472/37963 [41:54:08<70:38:07, 10.38s/it]
 35%|███▌      | 13473/37963 [41:54:17<68:47:37, 10.11s/it]
 35%|███▌      | 13474/37963 [41:54:27<68:40:34, 10.10s/it]
 35%|███▌      | 13475/37963 [41:54:37<68:47:21, 10.11s/it]
 35%|███▌      | 13476/37963 [41:54:47<69:08:01, 10.16s/it]
 36%|███▌      | 13477/37963 [41:55:04<82:21:43, 12.11s/it]
 36%|███▌      | 13478/37963 [41:55:14<78:33:40, 11.55s/it]
 36%|███▌      | 13479/37963 [41:55:24<74:59:02, 11.03s/it]
 36%|███▌      | 13480/37963 [41:55:34<72:05:08, 10.60s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '1.943', 'learning_rate': '1.495e-05', 'epoch': '0.3551'}

 36%|███▌      | 13480/37963 [41:55:34<72:05:08, 10.60s/it]
 36%|███▌      | 13481/37963 [41:55:50<84:01:40, 12.36s/it]
 36%|███▌      | 13482/37963 [41:56:01<79:59:47, 11.76s/it]
 36%|███▌      | 13483/37963 [41:56:11<76:26:33, 11.24s/it]
 36%|███▌      | 13484/37963 [41:56:20<73:16:04, 10.78s/it]
 36%|███▌      | 13485/37963 [41:56:30<71:49:31, 10.56s/it]
 36%|███▌      | 13486/37963 [41:56:40<70:35:15, 10.38s/it]
 36%|███▌      | 13487/37963 [41:56:51<70:05:57, 10.31s/it]
 36%|███▌      | 13488/37963 [41:57:07<82:47:54, 12.18s/it]
 36%|███▌      | 13489/37963 [41:57:17<78:45:20, 11.58s/it]
 36%|███▌      | 13490/37963 [41:57:41<102:45:36, 15.12s/it]
                                                            
{'loss': '0.154', 'grad_norm': '1.154', 'learning_rate': '1.494e-05', 'epoch': '0.3553'}

 36%|███▌      | 13490/37963 [41:57:41<102:45:36, 15.12s/it]
 36%|███▌      | 13491/37963 [41:57:51<92:35:08, 13.62s/it] 
 36%|███▌      | 13492/37963 [41:58:01<85:24:01, 12.56s/it]
 36%|███▌      | 13493/37963 [41:58:11<79:32:41, 11.70s/it]
 36%|███▌      | 13494/37963 [41:58:21<76:13:23, 11.21s/it]
 36%|███▌      | 13495/37963 [41:58:31<73:51:28, 10.87s/it]
 36%|███▌      | 13496/37963 [41:58:41<72:07:30, 10.61s/it]
 36%|███▌      | 13497/37963 [41:58:50<70:27:52, 10.37s/it]
 36%|███▌      | 13498/37963 [41:59:01<70:00:03, 10.30s/it]
 36%|███▌      | 13499/37963 [41:59:17<82:46:59, 12.18s/it]
 36%|███▌      | 13500/37963 [41:59:27<78:29:15, 11.55s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '1.036', 'learning_rate': '1.494e-05', 'epoch': '0.3556'}

 36%|███▌      | 13500/37963 [41:59:27<78:29:15, 11.55s/it]
 36%|███▌      | 13501/37963 [41:59:37<75:34:43, 11.12s/it]
 36%|███▌      | 13502/37963 [41:59:47<72:39:24, 10.69s/it]
 36%|███▌      | 13503/37963 [42:00:04<84:48:04, 12.48s/it]
 36%|███▌      | 13504/37963 [42:00:14<80:00:06, 11.78s/it]
 36%|███▌      | 13505/37963 [42:00:24<76:34:09, 11.27s/it]
 36%|███▌      | 13506/37963 [42:00:34<74:20:05, 10.94s/it]
 36%|███▌      | 13507/37963 [42:00:44<72:43:56, 10.71s/it]
 36%|███▌      | 13508/37963 [42:00:54<71:41:29, 10.55s/it]
 36%|███▌      | 13509/37963 [42:01:05<70:41:31, 10.41s/it]
 36%|███▌      | 13510/37963 [42:01:15<69:46:32, 10.27s/it]
                                                           
{'loss': '0.1577', 'grad_norm': '2.234', 'learning_rate': '1.493e-05', 'epoch': '0.3559'}

 36%|███▌      | 13510/37963 [42:01:15<69:46:32, 10.27s/it]
 36%|███▌      | 13511/37963 [42:01:24<68:52:58, 10.14s/it]
 36%|███▌      | 13512/37963 [42:01:34<68:50:55, 10.14s/it]
 36%|███▌      | 13513/37963 [42:01:45<69:08:35, 10.18s/it]
 36%|███▌      | 13514/37963 [42:01:55<68:56:05, 10.15s/it]
 36%|███▌      | 13515/37963 [42:02:11<81:54:40, 12.06s/it]
 36%|███▌      | 13516/37963 [42:02:22<78:17:59, 11.53s/it]
 36%|███▌      | 13517/37963 [42:02:32<75:30:21, 11.12s/it]
 36%|███▌      | 13518/37963 [42:02:42<72:37:14, 10.69s/it]
 36%|███▌      | 13519/37963 [42:02:51<70:45:34, 10.42s/it]
 36%|███▌      | 13520/37963 [42:03:01<70:12:04, 10.34s/it]
                                                           
{'loss': '0.156', 'grad_norm': '1.342', 'learning_rate': '1.492e-05', 'epoch': '0.3561'}

 36%|███▌      | 13520/37963 [42:03:01<70:12:04, 10.34s/it]
 36%|███▌      | 13521/37963 [42:03:11<69:38:26, 10.26s/it]
 36%|███▌      | 13522/37963 [42:03:22<69:38:18, 10.26s/it]
 36%|███▌      | 13523/37963 [42:03:32<69:16:12, 10.20s/it]
 36%|███▌      | 13524/37963 [42:03:42<68:52:03, 10.14s/it]
 36%|███▌      | 13525/37963 [42:03:58<81:24:19, 11.99s/it]
 36%|███▌      | 13526/37963 [42:04:08<77:20:01, 11.39s/it]
 36%|███▌      | 13527/37963 [42:04:18<74:49:26, 11.02s/it]
 36%|███▌      | 13528/37963 [42:04:35<85:48:41, 12.64s/it]
 36%|███▌      | 13529/37963 [42:04:45<80:44:06, 11.90s/it]
 36%|███▌      | 13530/37963 [42:04:55<76:52:11, 11.33s/it]
                                                           
{'loss': '0.1669', 'grad_norm': '2.629', 'learning_rate': '1.491e-05', 'epoch': '0.3564'}

 36%|███▌      | 13530/37963 [42:04:55<76:52:11, 11.33s/it]
 36%|███▌      | 13531/37963 [42:05:05<74:29:34, 10.98s/it]
 36%|███▌      | 13532/37963 [42:05:15<72:29:32, 10.68s/it]
 36%|███▌      | 13533/37963 [42:05:25<70:51:36, 10.44s/it]
 36%|███▌      | 13534/37963 [42:05:35<69:58:37, 10.31s/it]
 36%|███▌      | 13535/37963 [42:05:45<69:34:53, 10.25s/it]
 36%|███▌      | 13536/37963 [42:05:55<69:14:37, 10.21s/it]
 36%|███▌      | 13537/37963 [42:06:12<82:16:47, 12.13s/it]
 36%|███▌      | 13538/37963 [42:06:35<104:19:34, 15.38s/it]
 36%|███▌      | 13539/37963 [42:06:45<93:35:43, 13.80s/it] 
 36%|███▌      | 13540/37963 [42:06:55<86:07:23, 12.69s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '1.774', 'learning_rate': '1.491e-05', 'epoch': '0.3567'}

 36%|███▌      | 13540/37963 [42:06:55<86:07:23, 12.69s/it]
 36%|███▌      | 13541/37963 [42:07:05<80:18:18, 11.84s/it]
 36%|███▌      | 13542/37963 [42:07:15<76:39:38, 11.30s/it]
 36%|███▌      | 13543/37963 [42:07:25<74:26:14, 10.97s/it]
 36%|███▌      | 13544/37963 [42:07:35<72:40:48, 10.71s/it]
 36%|███▌      | 13545/37963 [42:07:45<71:16:59, 10.51s/it]
 36%|███▌      | 13546/37963 [42:07:55<70:18:45, 10.37s/it]
 36%|███▌      | 13547/37963 [42:08:05<69:21:01, 10.23s/it]
 36%|███▌      | 13548/37963 [42:08:15<69:06:10, 10.19s/it]
 36%|███▌      | 13549/37963 [42:08:32<82:05:26, 12.10s/it]
 36%|███▌      | 13550/37963 [42:08:42<78:13:20, 11.53s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '0.7902', 'learning_rate': '1.49e-05', 'epoch': '0.3569'}

 36%|███▌      | 13550/37963 [42:08:42<78:13:20, 11.53s/it]
 36%|███▌      | 13551/37963 [42:08:52<75:16:43, 11.10s/it]
 36%|███▌      | 13552/37963 [42:09:02<73:32:35, 10.85s/it]
 36%|███▌      | 13553/37963 [42:09:18<84:10:39, 12.41s/it]
 36%|███▌      | 13554/37963 [42:09:28<79:18:07, 11.70s/it]
 36%|███▌      | 13555/37963 [42:09:39<76:04:46, 11.22s/it]
 36%|███▌      | 13556/37963 [42:09:49<73:48:38, 10.89s/it]
 36%|███▌      | 13557/37963 [42:09:59<72:16:46, 10.66s/it]
 36%|███▌      | 13558/37963 [42:10:09<71:03:14, 10.48s/it]
 36%|███▌      | 13559/37963 [42:10:19<70:08:25, 10.35s/it]
 36%|███▌      | 13560/37963 [42:10:29<69:36:21, 10.27s/it]
                                                           
{'loss': '0.1527', 'grad_norm': '3.518', 'learning_rate': '1.489e-05', 'epoch': '0.3572'}

 36%|███▌      | 13560/37963 [42:10:29<69:36:21, 10.27s/it]
 36%|███▌      | 13561/37963 [42:10:39<69:58:50, 10.32s/it]
 36%|███▌      | 13562/37963 [42:10:50<69:37:36, 10.27s/it]
 36%|███▌      | 13563/37963 [42:11:00<69:30:13, 10.25s/it]
 36%|███▌      | 13564/37963 [42:11:09<67:56:56, 10.03s/it]
 36%|███▌      | 13565/37963 [42:11:26<81:33:53, 12.04s/it]
 36%|███▌      | 13566/37963 [42:11:36<76:56:38, 11.35s/it]
 36%|███▌      | 13567/37963 [42:11:45<73:08:25, 10.79s/it]
 36%|███▌      | 13568/37963 [42:11:55<71:42:28, 10.58s/it]
 36%|███▌      | 13569/37963 [42:12:05<70:45:56, 10.44s/it]
 36%|███▌      | 13570/37963 [42:12:16<70:03:52, 10.34s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '0.8082', 'learning_rate': '1.488e-05', 'epoch': '0.3575'}

 36%|███▌      | 13570/37963 [42:12:16<70:03:52, 10.34s/it]
 36%|███▌      | 13571/37963 [42:12:26<69:43:38, 10.29s/it]
 36%|███▌      | 13572/37963 [42:12:36<69:16:04, 10.22s/it]
 36%|███▌      | 13573/37963 [42:12:52<82:14:17, 12.14s/it]
 36%|███▌      | 13574/37963 [42:13:03<78:09:33, 11.54s/it]
 36%|███▌      | 13575/37963 [42:13:13<75:19:07, 11.12s/it]
 36%|███▌      | 13576/37963 [42:13:22<72:27:39, 10.70s/it]
 36%|███▌      | 13577/37963 [42:13:39<84:54:42, 12.54s/it]
 36%|███▌      | 13578/37963 [42:13:49<80:09:04, 11.83s/it]
 36%|███▌      | 13579/37963 [42:13:59<76:24:20, 11.28s/it]
 36%|███▌      | 13580/37963 [42:14:10<74:02:25, 10.93s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '1.05', 'learning_rate': '1.488e-05', 'epoch': '0.3577'}

 36%|███▌      | 13580/37963 [42:14:10<74:02:25, 10.93s/it]
 36%|███▌      | 13581/37963 [42:14:20<72:42:22, 10.74s/it]
 36%|███▌      | 13582/37963 [42:14:30<71:27:35, 10.55s/it]
 36%|███▌      | 13583/37963 [42:14:40<70:24:19, 10.40s/it]
 36%|███▌      | 13584/37963 [42:14:56<81:48:14, 12.08s/it]
 36%|███▌      | 13585/37963 [42:15:12<89:41:31, 13.25s/it]
 36%|███▌      | 13586/37963 [42:15:29<97:16:27, 14.37s/it]
 36%|███▌      | 13587/37963 [42:15:39<88:37:04, 13.09s/it]
 36%|███▌      | 13588/37963 [42:15:49<82:36:33, 12.20s/it]
 36%|███▌      | 13589/37963 [42:15:59<78:02:20, 11.53s/it]
 36%|███▌      | 13590/37963 [42:16:09<75:24:23, 11.14s/it]
                                                           
{'loss': '0.1687', 'grad_norm': '1.429', 'learning_rate': '1.487e-05', 'epoch': '0.358'}

 36%|███▌      | 13590/37963 [42:16:09<75:24:23, 11.14s/it]
 36%|███▌      | 13591/37963 [42:16:19<73:12:45, 10.81s/it]
 36%|███▌      | 13592/37963 [42:16:29<71:40:40, 10.59s/it]
 36%|███▌      | 13593/37963 [42:16:40<70:40:43, 10.44s/it]
 36%|███▌      | 13594/37963 [42:16:50<69:53:45, 10.33s/it]
 36%|███▌      | 13595/37963 [42:17:00<69:41:37, 10.30s/it]
 36%|███▌      | 13596/37963 [42:17:10<69:19:37, 10.24s/it]
 36%|███▌      | 13597/37963 [42:17:20<68:58:55, 10.19s/it]
 36%|███▌      | 13598/37963 [42:17:36<81:38:34, 12.06s/it]
 36%|███▌      | 13599/37963 [42:17:47<78:03:10, 11.53s/it]
 36%|███▌      | 13600/37963 [42:17:57<75:31:39, 11.16s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '2.005', 'learning_rate': '1.486e-05', 'epoch': '0.3582'}

 36%|███▌      | 13600/37963 [42:17:57<75:31:39, 11.16s/it]
 36%|███▌      | 13601/37963 [42:18:14<86:23:24, 12.77s/it]
 36%|███▌      | 13602/37963 [42:18:24<81:00:33, 11.97s/it]
 36%|███▌      | 13603/37963 [42:18:34<77:22:52, 11.44s/it]
 36%|███▌      | 13604/37963 [42:18:44<74:32:03, 11.02s/it]
 36%|███▌      | 13605/37963 [42:18:54<72:43:06, 10.75s/it]
 36%|███▌      | 13606/37963 [42:19:04<71:19:42, 10.54s/it]
 36%|███▌      | 13607/37963 [42:19:14<70:26:57, 10.41s/it]
 36%|███▌      | 13608/37963 [42:19:24<69:48:52, 10.32s/it]
 36%|███▌      | 13609/37963 [42:19:34<68:18:34, 10.10s/it]
 36%|███▌      | 13610/37963 [42:19:44<68:22:47, 10.11s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '2.119', 'learning_rate': '1.485e-05', 'epoch': '0.3585'}

 36%|███▌      | 13610/37963 [42:19:44<68:22:47, 10.11s/it]
 36%|███▌      | 13611/37963 [42:19:54<68:08:16, 10.07s/it]
 36%|███▌      | 13612/37963 [42:20:04<68:10:10, 10.08s/it]
 36%|███▌      | 13613/37963 [42:20:20<81:01:15, 11.98s/it]
 36%|███▌      | 13614/37963 [42:20:30<77:01:48, 11.39s/it]
 36%|███▌      | 13615/37963 [42:20:40<73:35:46, 10.88s/it]
 36%|███▌      | 13616/37963 [42:20:50<72:06:56, 10.66s/it]
 36%|███▌      | 13617/37963 [42:21:01<71:06:21, 10.51s/it]
 36%|███▌      | 13618/37963 [42:21:10<69:30:30, 10.28s/it]
 36%|███▌      | 13619/37963 [42:21:20<68:07:33, 10.07s/it]
 36%|███▌      | 13620/37963 [42:21:30<68:13:29, 10.09s/it]
                                                           
{'loss': '0.1588', 'grad_norm': '3.715', 'learning_rate': '1.485e-05', 'epoch': '0.3588'}

 36%|███▌      | 13620/37963 [42:21:30<68:13:29, 10.09s/it]
 36%|███▌      | 13621/37963 [42:21:47<81:30:40, 12.05s/it]
 36%|███▌      | 13622/37963 [42:21:57<77:25:35, 11.45s/it]
 36%|███▌      | 13623/37963 [42:22:07<74:38:01, 11.04s/it]
 36%|███▌      | 13624/37963 [42:22:16<72:03:29, 10.66s/it]
 36%|███▌      | 13625/37963 [42:22:33<84:06:10, 12.44s/it]
 36%|███▌      | 13626/37963 [42:22:43<79:25:07, 11.75s/it]
 36%|███▌      | 13627/37963 [42:22:53<75:45:38, 11.21s/it]
 36%|███▌      | 13628/37963 [42:23:03<73:25:18, 10.86s/it]
 36%|███▌      | 13629/37963 [42:23:13<71:54:12, 10.64s/it]
 36%|███▌      | 13630/37963 [42:23:23<70:51:30, 10.48s/it]
                                                           
{'loss': '0.1692', 'grad_norm': '0.7716', 'learning_rate': '1.484e-05', 'epoch': '0.359'}

 36%|███▌      | 13630/37963 [42:23:23<70:51:30, 10.48s/it]
 36%|███▌      | 13631/37963 [42:23:33<69:34:34, 10.29s/it]
 36%|███▌      | 13632/37963 [42:23:50<81:49:32, 12.11s/it]
 36%|███▌      | 13633/37963 [42:24:06<89:48:51, 13.29s/it]
 36%|███▌      | 13634/37963 [42:24:23<97:04:55, 14.37s/it]
 36%|███▌      | 13635/37963 [42:24:33<88:18:33, 13.07s/it]
 36%|███▌      | 13636/37963 [42:24:43<82:17:49, 12.18s/it]
 36%|███▌      | 13637/37963 [42:24:53<78:02:09, 11.55s/it]
 36%|███▌      | 13638/37963 [42:25:03<74:45:04, 11.06s/it]
 36%|███▌      | 13639/37963 [42:25:13<73:01:58, 10.81s/it]
 36%|███▌      | 13640/37963 [42:25:23<71:35:52, 10.60s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '2.797', 'learning_rate': '1.483e-05', 'epoch': '0.3593'}

 36%|███▌      | 13640/37963 [42:25:23<71:35:52, 10.60s/it]
 36%|███▌      | 13641/37963 [42:25:33<70:24:45, 10.42s/it]
 36%|███▌      | 13642/37963 [42:25:43<69:09:09, 10.24s/it]
 36%|███▌      | 13643/37963 [42:25:53<68:50:15, 10.19s/it]
 36%|███▌      | 13644/37963 [42:26:03<68:33:02, 10.15s/it]
 36%|███▌      | 13645/37963 [42:26:20<81:31:24, 12.07s/it]
 36%|███▌      | 13646/37963 [42:26:30<77:44:10, 11.51s/it]
 36%|███▌      | 13647/37963 [42:26:40<74:46:42, 11.07s/it]
 36%|███▌      | 13648/37963 [42:26:50<72:41:40, 10.76s/it]
 36%|███▌      | 13649/37963 [42:27:00<71:14:33, 10.55s/it]
 36%|███▌      | 13650/37963 [42:27:16<83:23:48, 12.35s/it]
                                                           
{'loss': '0.1384', 'grad_norm': '1.202', 'learning_rate': '1.483e-05', 'epoch': '0.3596'}

 36%|███▌      | 13650/37963 [42:27:16<83:23:48, 12.35s/it]
 36%|███▌      | 13651/37963 [42:27:26<78:16:51, 11.59s/it]
 36%|███▌      | 13652/37963 [42:27:36<74:38:35, 11.05s/it]
 36%|███▌      | 13653/37963 [42:27:46<72:41:01, 10.76s/it]
 36%|███▌      | 13654/37963 [42:27:56<71:09:55, 10.54s/it]
 36%|███▌      | 13655/37963 [42:28:06<69:49:56, 10.34s/it]
 36%|███▌      | 13656/37963 [42:28:16<69:20:13, 10.27s/it]
 36%|███▌      | 13657/37963 [42:28:26<69:03:28, 10.23s/it]
 36%|███▌      | 13658/37963 [42:28:37<69:05:23, 10.23s/it]
 36%|███▌      | 13659/37963 [42:28:47<68:46:10, 10.19s/it]
 36%|███▌      | 13660/37963 [42:29:04<82:32:46, 12.23s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '2.555', 'learning_rate': '1.482e-05', 'epoch': '0.3598'}

 36%|███▌      | 13660/37963 [42:29:04<82:32:46, 12.23s/it]
 36%|███▌      | 13661/37963 [42:29:13<77:42:56, 11.51s/it]
 36%|███▌      | 13662/37963 [42:29:23<74:36:59, 11.05s/it]
 36%|███▌      | 13663/37963 [42:29:33<72:15:22, 10.70s/it]
 36%|███▌      | 13664/37963 [42:29:43<70:20:55, 10.42s/it]
 36%|███▌      | 13665/37963 [42:29:53<69:41:20, 10.33s/it]
 36%|███▌      | 13666/37963 [42:30:03<69:06:59, 10.24s/it]
 36%|███▌      | 13667/37963 [42:30:13<68:52:00, 10.20s/it]
 36%|███▌      | 13668/37963 [42:30:23<68:47:32, 10.19s/it]
 36%|███▌      | 13669/37963 [42:30:34<68:50:04, 10.20s/it]
 36%|███▌      | 13670/37963 [42:30:44<68:25:10, 10.14s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '0.933', 'learning_rate': '1.481e-05', 'epoch': '0.3601'}

 36%|███▌      | 13670/37963 [42:30:44<68:25:10, 10.14s/it]
 36%|███▌      | 13671/37963 [42:31:07<94:07:41, 13.95s/it]
 36%|███▌      | 13672/37963 [42:31:17<86:28:36, 12.82s/it]
 36%|███▌      | 13673/37963 [42:31:27<81:01:18, 12.01s/it]
 36%|███▌      | 13674/37963 [42:31:37<77:30:50, 11.49s/it]
 36%|███▌      | 13675/37963 [42:31:47<74:52:21, 11.10s/it]
 36%|███▌      | 13676/37963 [42:31:57<73:00:01, 10.82s/it]
 36%|███▌      | 13677/37963 [42:32:08<71:36:04, 10.61s/it]
 36%|███▌      | 13678/37963 [42:32:18<70:19:25, 10.42s/it]
 36%|███▌      | 13679/37963 [42:32:28<69:53:22, 10.36s/it]
 36%|███▌      | 13680/37963 [42:32:44<81:22:11, 12.06s/it]
                                                           
{'loss': '0.169', 'grad_norm': '1.419', 'learning_rate': '1.48e-05', 'epoch': '0.3604'}

 36%|███▌      | 13680/37963 [42:32:44<81:22:11, 12.06s/it]
 36%|███▌      | 13681/37963 [42:33:00<90:05:31, 13.36s/it]
 36%|███▌      | 13682/37963 [42:33:17<96:36:55, 14.32s/it]
 36%|███▌      | 13683/37963 [42:33:27<88:19:28, 13.10s/it]
 36%|███▌      | 13684/37963 [42:33:37<81:28:43, 12.08s/it]
 36%|███▌      | 13685/37963 [42:33:47<77:16:14, 11.46s/it]
 36%|███▌      | 13686/37963 [42:33:57<74:35:59, 11.06s/it]
 36%|███▌      | 13687/37963 [42:34:07<72:38:31, 10.77s/it]
 36%|███▌      | 13688/37963 [42:34:17<71:24:30, 10.59s/it]
 36%|███▌      | 13689/37963 [42:34:27<70:23:49, 10.44s/it]
 36%|███▌      | 13690/37963 [42:34:37<69:48:55, 10.35s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '2.554', 'learning_rate': '1.48e-05', 'epoch': '0.3606'}

 36%|███▌      | 13690/37963 [42:34:37<69:48:55, 10.35s/it]
 36%|███▌      | 13691/37963 [42:34:48<69:22:35, 10.29s/it]
 36%|███▌      | 13692/37963 [42:34:58<68:59:22, 10.23s/it]
 36%|███▌      | 13693/37963 [42:35:08<68:57:31, 10.23s/it]
 36%|███▌      | 13694/37963 [42:35:24<81:54:10, 12.15s/it]
 36%|███▌      | 13695/37963 [42:35:35<77:51:48, 11.55s/it]
 36%|███▌      | 13696/37963 [42:35:45<74:32:56, 11.06s/it]
 36%|███▌      | 13697/37963 [42:35:55<72:39:29, 10.78s/it]
 36%|███▌      | 13698/37963 [42:36:05<70:58:25, 10.53s/it]
 36%|███▌      | 13699/37963 [42:36:21<82:59:48, 12.31s/it]
 36%|███▌      | 13700/37963 [42:36:31<78:38:12, 11.67s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '1.506', 'learning_rate': '1.479e-05', 'epoch': '0.3609'}

 36%|███▌      | 13700/37963 [42:36:31<78:38:12, 11.67s/it]
 36%|███▌      | 13701/37963 [42:36:41<75:23:16, 11.19s/it]
 36%|███▌      | 13702/37963 [42:36:51<73:14:53, 10.87s/it]
 36%|███▌      | 13703/37963 [42:37:01<71:30:03, 10.61s/it]
 36%|███▌      | 13704/37963 [42:37:12<70:40:50, 10.49s/it]
 36%|███▌      | 13705/37963 [42:37:22<70:12:21, 10.42s/it]
 36%|███▌      | 13706/37963 [42:37:32<69:30:51, 10.32s/it]
 36%|███▌      | 13707/37963 [42:37:42<69:00:54, 10.24s/it]
 36%|███▌      | 13708/37963 [42:37:59<81:50:00, 12.15s/it]
 36%|███▌      | 13709/37963 [42:38:09<77:43:54, 11.54s/it]
 36%|███▌      | 13710/37963 [42:38:19<74:57:11, 11.13s/it]
                                                           
{'loss': '0.1556', 'grad_norm': '3.835', 'learning_rate': '1.478e-05', 'epoch': '0.3611'}

 36%|███▌      | 13710/37963 [42:38:19<74:57:11, 11.13s/it]
 36%|███▌      | 13711/37963 [42:38:29<73:08:36, 10.86s/it]
 36%|███▌      | 13712/37963 [42:38:39<71:55:58, 10.68s/it]
 36%|███▌      | 13713/37963 [42:38:50<70:44:02, 10.50s/it]
 36%|███▌      | 13714/37963 [42:39:00<69:49:55, 10.37s/it]
 36%|███▌      | 13715/37963 [42:39:10<69:20:11, 10.29s/it]
 36%|███▌      | 13716/37963 [42:39:20<69:01:07, 10.25s/it]
 36%|███▌      | 13717/37963 [42:39:30<68:48:33, 10.22s/it]
 36%|███▌      | 13718/37963 [42:39:40<68:38:18, 10.19s/it]
 36%|███▌      | 13719/37963 [42:39:57<81:27:37, 12.10s/it]
 36%|███▌      | 13720/37963 [42:40:07<77:23:52, 11.49s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '1.242', 'learning_rate': '1.477e-05', 'epoch': '0.3614'}

 36%|███▌      | 13720/37963 [42:40:07<77:23:52, 11.49s/it]
 36%|███▌      | 13721/37963 [42:40:23<87:50:26, 13.04s/it]
 36%|███▌      | 13722/37963 [42:40:33<81:52:36, 12.16s/it]
 36%|███▌      | 13723/37963 [42:40:44<77:44:18, 11.55s/it]
 36%|███▌      | 13724/37963 [42:40:54<74:42:53, 11.10s/it]
 36%|███▌      | 13725/37963 [42:41:04<72:37:41, 10.79s/it]
 36%|███▌      | 13726/37963 [42:41:14<70:44:15, 10.51s/it]
 36%|███▌      | 13727/37963 [42:41:29<81:21:13, 12.08s/it]
 36%|███▌      | 13728/37963 [42:41:46<90:21:33, 13.42s/it]
 36%|███▌      | 13729/37963 [42:41:56<83:36:10, 12.42s/it]
 36%|███▌      | 13730/37963 [42:42:06<79:03:13, 11.74s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '1.331', 'learning_rate': '1.477e-05', 'epoch': '0.3617'}

 36%|███▌      | 13730/37963 [42:42:06<79:03:13, 11.74s/it]
 36%|███▌      | 13731/37963 [42:42:16<75:17:17, 11.19s/it]
 36%|███▌      | 13732/37963 [42:42:33<86:40:46, 12.88s/it]
 36%|███▌      | 13733/37963 [42:42:43<81:28:37, 12.11s/it]
 36%|███▌      | 13734/37963 [42:42:53<77:06:04, 11.46s/it]
 36%|███▌      | 13735/37963 [42:43:03<73:53:23, 10.98s/it]
 36%|███▌      | 13736/37963 [42:43:13<72:16:08, 10.74s/it]
 36%|███▌      | 13737/37963 [42:43:23<70:51:52, 10.53s/it]
 36%|███▌      | 13738/37963 [42:43:33<69:59:48, 10.40s/it]
 36%|███▌      | 13739/37963 [42:43:43<68:46:44, 10.22s/it]
 36%|███▌      | 13740/37963 [42:43:53<68:30:02, 10.18s/it]
                                                           
{'loss': '0.1738', 'grad_norm': '2.757', 'learning_rate': '1.476e-05', 'epoch': '0.3619'}

 36%|███▌      | 13740/37963 [42:43:53<68:30:02, 10.18s/it]
 36%|███▌      | 13741/37963 [42:44:03<68:27:27, 10.17s/it]
 36%|███▌      | 13742/37963 [42:44:13<68:01:11, 10.11s/it]
 36%|███▌      | 13743/37963 [42:44:30<80:39:37, 11.99s/it]
 36%|███▌      | 13744/37963 [42:44:40<76:42:10, 11.40s/it]
 36%|███▌      | 13745/37963 [42:44:50<74:18:58, 11.05s/it]
 36%|███▌      | 13746/37963 [42:45:00<71:44:14, 10.66s/it]
 36%|███▌      | 13747/37963 [42:45:10<70:31:39, 10.48s/it]
 36%|███▌      | 13748/37963 [42:45:26<81:59:00, 12.19s/it]
 36%|███▌      | 13749/37963 [42:45:36<77:26:48, 11.51s/it]
 36%|███▌      | 13750/37963 [42:45:46<74:12:50, 11.03s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '2.158', 'learning_rate': '1.475e-05', 'epoch': '0.3622'}

 36%|███▌      | 13750/37963 [42:45:46<74:12:50, 11.03s/it]
 36%|███▌      | 13751/37963 [42:45:56<72:14:56, 10.74s/it]
 36%|███▌      | 13752/37963 [42:46:06<71:05:50, 10.57s/it]
 36%|███▌      | 13753/37963 [42:46:16<70:06:05, 10.42s/it]
 36%|███▌      | 13754/37963 [42:46:26<68:47:08, 10.23s/it]
 36%|███▌      | 13755/37963 [42:46:36<68:35:45, 10.20s/it]
 36%|███▌      | 13756/37963 [42:46:52<80:51:27, 12.02s/it]
 36%|███▌      | 13757/37963 [42:47:02<76:56:30, 11.44s/it]
 36%|███▌      | 13758/37963 [42:47:12<73:07:25, 10.88s/it]
 36%|███▌      | 13759/37963 [42:47:22<71:33:20, 10.64s/it]
 36%|███▌      | 13760/37963 [42:47:32<70:31:40, 10.49s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '3.915', 'learning_rate': '1.474e-05', 'epoch': '0.3625'}

 36%|███▌      | 13760/37963 [42:47:32<70:31:40, 10.49s/it]
 36%|███▌      | 13761/37963 [42:47:42<69:40:40, 10.36s/it]
 36%|███▋      | 13762/37963 [42:47:52<68:45:29, 10.23s/it]
 36%|███▋      | 13763/37963 [42:48:02<68:03:12, 10.12s/it]
 36%|███▋      | 13764/37963 [42:48:12<67:35:05, 10.05s/it]
 36%|███▋      | 13765/37963 [42:48:22<67:39:43, 10.07s/it]
 36%|███▋      | 13766/37963 [42:48:32<66:55:02,  9.96s/it]
 36%|███▋      | 13767/37963 [42:48:42<67:09:31,  9.99s/it]
 36%|███▋      | 13768/37963 [42:48:58<80:13:41, 11.94s/it]
 36%|███▋      | 13769/37963 [42:49:08<76:09:55, 11.33s/it]
 36%|███▋      | 13770/37963 [42:49:25<86:52:25, 12.93s/it]
                                                           
{'loss': '0.1669', 'grad_norm': '1.927', 'learning_rate': '1.474e-05', 'epoch': '0.3627'}

 36%|███▋      | 13770/37963 [42:49:25<86:52:25, 12.93s/it]
 36%|███▋      | 13771/37963 [42:49:35<81:11:39, 12.08s/it]
 36%|███▋      | 13772/37963 [42:49:45<76:36:13, 11.40s/it]
 36%|███▋      | 13773/37963 [42:49:55<73:45:31, 10.98s/it]
 36%|███▋      | 13774/37963 [42:50:05<72:00:47, 10.72s/it]
 36%|███▋      | 13775/37963 [42:50:21<83:47:37, 12.47s/it]
 36%|███▋      | 13776/37963 [42:50:31<78:59:40, 11.76s/it]
 36%|███▋      | 13777/37963 [42:50:42<75:36:02, 11.25s/it]
 36%|███▋      | 13778/37963 [42:50:58<86:18:54, 12.85s/it]
 36%|███▋      | 13779/37963 [42:51:15<94:34:49, 14.08s/it]
 36%|███▋      | 13780/37963 [42:51:25<86:44:59, 12.91s/it]
                                                           
{'loss': '0.1749', 'grad_norm': '2.397', 'learning_rate': '1.473e-05', 'epoch': '0.363'}

 36%|███▋      | 13780/37963 [42:51:25<86:44:59, 12.91s/it]
 36%|███▋      | 13781/37963 [42:51:35<81:00:18, 12.06s/it]
 36%|███▋      | 13782/37963 [42:51:45<77:01:08, 11.47s/it]
 36%|███▋      | 13783/37963 [42:51:55<73:05:52, 10.88s/it]
 36%|███▋      | 13784/37963 [42:52:05<71:26:55, 10.64s/it]
 36%|███▋      | 13785/37963 [42:52:15<70:22:21, 10.48s/it]
 36%|███▋      | 13786/37963 [42:52:25<69:39:24, 10.37s/it]
 36%|███▋      | 13787/37963 [42:52:35<69:10:21, 10.30s/it]
 36%|███▋      | 13788/37963 [42:52:46<68:56:22, 10.27s/it]
 36%|███▋      | 13789/37963 [42:52:56<68:35:46, 10.22s/it]
 36%|███▋      | 13790/37963 [42:53:06<68:33:03, 10.21s/it]
                                                           
{'loss': '0.1658', 'grad_norm': '4.181', 'learning_rate': '1.472e-05', 'epoch': '0.3632'}

 36%|███▋      | 13790/37963 [42:53:06<68:33:03, 10.21s/it]
 36%|███▋      | 13791/37963 [42:53:23<81:35:35, 12.15s/it]
 36%|███▋      | 13792/37963 [42:53:32<76:51:03, 11.45s/it]
 36%|███▋      | 13793/37963 [42:53:42<72:50:59, 10.85s/it]
 36%|███▋      | 13794/37963 [42:53:52<71:23:48, 10.63s/it]
 36%|███▋      | 13795/37963 [42:54:08<82:55:12, 12.35s/it]
 36%|███▋      | 13796/37963 [42:54:18<78:34:06, 11.70s/it]
 36%|███▋      | 13797/37963 [42:54:29<75:20:27, 11.22s/it]
 36%|███▋      | 13798/37963 [42:54:38<72:26:53, 10.79s/it]
 36%|███▋      | 13799/37963 [42:54:48<70:59:50, 10.58s/it]
 36%|███▋      | 13800/37963 [42:54:58<68:59:15, 10.28s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '2.473', 'learning_rate': '1.471e-05', 'epoch': '0.3635'}

 36%|███▋      | 13800/37963 [42:54:58<68:59:15, 10.28s/it]
 36%|███▋      | 13801/37963 [42:55:08<68:45:58, 10.25s/it]
 36%|███▋      | 13802/37963 [42:55:18<68:47:34, 10.25s/it]
 36%|███▋      | 13803/37963 [42:55:28<67:58:05, 10.13s/it]
 36%|███▋      | 13804/37963 [42:55:45<81:02:38, 12.08s/it]
 36%|███▋      | 13805/37963 [42:55:55<76:59:42, 11.47s/it]
 36%|███▋      | 13806/37963 [42:56:05<73:59:25, 11.03s/it]
 36%|███▋      | 13807/37963 [42:56:15<71:46:32, 10.70s/it]
 36%|███▋      | 13808/37963 [42:56:25<69:44:23, 10.39s/it]
 36%|███▋      | 13809/37963 [42:56:35<69:04:45, 10.30s/it]
 36%|███▋      | 13810/37963 [42:56:45<68:39:26, 10.23s/it]
                                                           
{'loss': '0.1759', 'grad_norm': '2.929', 'learning_rate': '1.471e-05', 'epoch': '0.3638'}

 36%|███▋      | 13810/37963 [42:56:45<68:39:26, 10.23s/it]
 36%|███▋      | 13811/37963 [42:56:55<68:22:00, 10.19s/it]
 36%|███▋      | 13812/37963 [42:57:05<67:22:51, 10.04s/it]
 36%|███▋      | 13813/37963 [42:57:15<67:27:09, 10.06s/it]
 36%|███▋      | 13814/37963 [42:57:24<66:39:33,  9.94s/it]
 36%|███▋      | 13815/37963 [42:57:34<66:53:56,  9.97s/it]
 36%|███▋      | 13816/37963 [42:57:51<79:39:36, 11.88s/it]
 36%|███▋      | 13817/37963 [42:58:01<76:01:23, 11.33s/it]
 36%|███▋      | 13818/37963 [42:58:11<73:25:29, 10.95s/it]
 36%|███▋      | 13819/37963 [42:58:21<71:40:41, 10.69s/it]
 36%|███▋      | 13820/37963 [42:58:31<70:38:47, 10.53s/it]
                                                           
{'loss': '0.1722', 'grad_norm': '3.171', 'learning_rate': '1.47e-05', 'epoch': '0.364'}

 36%|███▋      | 13820/37963 [42:58:31<70:38:47, 10.53s/it]
 36%|███▋      | 13821/37963 [42:58:48<83:14:29, 12.41s/it]
 36%|███▋      | 13822/37963 [42:58:58<77:47:01, 11.60s/it]
 36%|███▋      | 13823/37963 [42:59:14<87:19:31, 13.02s/it]
 36%|███▋      | 13824/37963 [42:59:24<81:26:07, 12.14s/it]
 36%|███▋      | 13825/37963 [42:59:34<76:36:31, 11.43s/it]
 36%|███▋      | 13826/37963 [42:59:50<86:53:27, 12.96s/it]
 36%|███▋      | 13827/37963 [43:00:07<94:50:51, 14.15s/it]
 36%|███▋      | 13828/37963 [43:00:17<86:50:07, 12.95s/it]
 36%|███▋      | 13829/37963 [43:00:27<80:47:56, 12.05s/it]
 36%|███▋      | 13830/37963 [43:00:37<76:28:49, 11.41s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '1.279', 'learning_rate': '1.469e-05', 'epoch': '0.3643'}

 36%|███▋      | 13830/37963 [43:00:37<76:28:49, 11.41s/it]
 36%|███▋      | 13831/37963 [43:00:47<73:53:11, 11.02s/it]
 36%|███▋      | 13832/37963 [43:00:57<71:58:31, 10.74s/it]
 36%|███▋      | 13833/37963 [43:01:07<70:37:32, 10.54s/it]
 36%|███▋      | 13834/37963 [43:01:17<69:35:52, 10.38s/it]
 36%|███▋      | 13835/37963 [43:01:28<69:12:08, 10.33s/it]
 36%|███▋      | 13836/37963 [43:01:38<68:37:24, 10.24s/it]
 36%|███▋      | 13837/37963 [43:01:48<68:02:34, 10.15s/it]
 36%|███▋      | 13838/37963 [43:01:58<67:50:53, 10.12s/it]
 36%|███▋      | 13839/37963 [43:02:15<81:16:35, 12.13s/it]
 36%|███▋      | 13840/37963 [43:02:24<75:53:02, 11.32s/it]
                                                           
{'loss': '0.1696', 'grad_norm': '1.243', 'learning_rate': '1.468e-05', 'epoch': '0.3646'}

 36%|███▋      | 13840/37963 [43:02:24<75:53:02, 11.32s/it]
 36%|███▋      | 13841/37963 [43:02:34<73:34:41, 10.98s/it]
 36%|███▋      | 13842/37963 [43:02:44<71:46:48, 10.71s/it]
 36%|███▋      | 13843/37963 [43:02:54<70:42:33, 10.55s/it]
 36%|███▋      | 13844/37963 [43:03:11<82:26:39, 12.31s/it]
 36%|███▋      | 13845/37963 [43:03:21<78:07:18, 11.66s/it]
 36%|███▋      | 13846/37963 [43:03:31<74:51:37, 11.17s/it]
 36%|███▋      | 13847/37963 [43:03:41<72:36:01, 10.84s/it]
 36%|███▋      | 13848/37963 [43:03:51<71:06:09, 10.61s/it]
 36%|███▋      | 13849/37963 [43:04:01<70:00:34, 10.45s/it]
 36%|███▋      | 13850/37963 [43:04:11<69:08:45, 10.32s/it]
                                                           
{'loss': '0.1752', 'grad_norm': '1.441', 'learning_rate': '1.467e-05', 'epoch': '0.3648'}

 36%|███▋      | 13850/37963 [43:04:11<69:08:45, 10.32s/it]
 36%|███▋      | 13851/37963 [43:04:21<68:35:20, 10.24s/it]
 36%|███▋      | 13852/37963 [43:04:31<67:45:50, 10.12s/it]
 36%|███▋      | 13853/37963 [43:04:48<81:31:06, 12.17s/it]
 36%|███▋      | 13854/37963 [43:04:58<77:19:30, 11.55s/it]
 36%|███▋      | 13855/37963 [43:05:08<74:20:47, 11.10s/it]
 36%|███▋      | 13856/37963 [43:05:18<72:19:56, 10.80s/it]
 37%|███▋      | 13857/37963 [43:05:28<70:52:11, 10.58s/it]
 37%|███▋      | 13858/37963 [43:05:38<69:45:11, 10.42s/it]
 37%|███▋      | 13859/37963 [43:05:48<68:59:53, 10.31s/it]
 37%|███▋      | 13860/37963 [43:05:58<67:17:21, 10.05s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '2.479', 'learning_rate': '1.467e-05', 'epoch': '0.3651'}

 37%|███▋      | 13860/37963 [43:05:58<67:17:21, 10.05s/it]
 37%|███▋      | 13861/37963 [43:06:08<67:26:36, 10.07s/it]
 37%|███▋      | 13862/37963 [43:06:18<67:28:33, 10.08s/it]
 37%|███▋      | 13863/37963 [43:06:28<67:15:44, 10.05s/it]
 37%|███▋      | 13864/37963 [43:06:45<80:05:26, 11.96s/it]
 37%|███▋      | 13865/37963 [43:06:55<76:26:09, 11.42s/it]
 37%|███▋      | 13866/37963 [43:07:05<73:44:14, 11.02s/it]
 37%|███▋      | 13867/37963 [43:07:15<71:51:43, 10.74s/it]
 37%|███▋      | 13868/37963 [43:07:24<69:19:16, 10.36s/it]
 37%|███▋      | 13869/37963 [43:07:34<68:49:57, 10.28s/it]
 37%|███▋      | 13870/37963 [43:07:51<81:19:06, 12.15s/it]
                                                           
{'loss': '0.16', 'grad_norm': '1.243', 'learning_rate': '1.466e-05', 'epoch': '0.3654'}

 37%|███▋      | 13870/37963 [43:07:51<81:19:06, 12.15s/it]
 37%|███▋      | 13871/37963 [43:08:01<77:24:43, 11.57s/it]
 37%|███▋      | 13872/37963 [43:08:17<86:53:42, 12.99s/it]
 37%|███▋      | 13873/37963 [43:08:28<81:12:54, 12.14s/it]
 37%|███▋      | 13874/37963 [43:08:44<90:16:03, 13.49s/it]
 37%|███▋      | 13875/37963 [43:08:54<83:26:50, 12.47s/it]
 37%|███▋      | 13876/37963 [43:09:04<78:34:47, 11.74s/it]
 37%|███▋      | 13877/37963 [43:09:14<75:06:32, 11.23s/it]
 37%|███▋      | 13878/37963 [43:09:32<87:46:52, 13.12s/it]
 37%|███▋      | 13879/37963 [43:09:42<81:20:51, 12.16s/it]
 37%|███▋      | 13880/37963 [43:09:52<77:14:55, 11.55s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '3.113', 'learning_rate': '1.465e-05', 'epoch': '0.3656'}

 37%|███▋      | 13880/37963 [43:09:52<77:14:55, 11.55s/it]
 37%|███▋      | 13881/37963 [43:10:02<74:19:34, 11.11s/it]
 37%|███▋      | 13882/37963 [43:10:12<72:20:58, 10.82s/it]
 37%|███▋      | 13883/37963 [43:10:22<70:51:19, 10.59s/it]
 37%|███▋      | 13884/37963 [43:10:32<69:53:02, 10.45s/it]
 37%|███▋      | 13885/37963 [43:10:42<69:05:05, 10.33s/it]
 37%|███▋      | 13886/37963 [43:10:53<68:32:53, 10.25s/it]
 37%|███▋      | 13887/37963 [43:11:09<81:23:41, 12.17s/it]
 37%|███▋      | 13888/37963 [43:11:19<77:21:02, 11.57s/it]
 37%|███▋      | 13889/37963 [43:11:29<74:25:06, 11.13s/it]
 37%|███▋      | 13890/37963 [43:11:40<72:23:14, 10.83s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '1.829', 'learning_rate': '1.464e-05', 'epoch': '0.3659'}

 37%|███▋      | 13890/37963 [43:11:40<72:23:14, 10.83s/it]
 37%|███▋      | 13891/37963 [43:11:56<82:57:23, 12.41s/it]
 37%|███▋      | 13892/37963 [43:12:06<78:39:54, 11.76s/it]
 37%|███▋      | 13893/37963 [43:12:16<75:18:51, 11.26s/it]
 37%|███▋      | 13894/37963 [43:12:26<72:52:19, 10.90s/it]
 37%|███▋      | 13895/37963 [43:12:36<70:50:23, 10.60s/it]
 37%|███▋      | 13896/37963 [43:12:46<69:47:58, 10.44s/it]
 37%|███▋      | 13897/37963 [43:12:55<67:44:11, 10.13s/it]
 37%|███▋      | 13898/37963 [43:13:06<67:48:03, 10.14s/it]
 37%|███▋      | 13899/37963 [43:13:16<67:57:10, 10.17s/it]
 37%|███▋      | 13900/37963 [43:13:26<67:54:22, 10.16s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '2.29', 'learning_rate': '1.464e-05', 'epoch': '0.3661'}

 37%|███▋      | 13900/37963 [43:13:26<67:54:22, 10.16s/it]
 37%|███▋      | 13901/37963 [43:13:43<81:05:45, 12.13s/it]
 37%|███▋      | 13902/37963 [43:13:53<76:36:51, 11.46s/it]
 37%|███▋      | 13903/37963 [43:14:03<73:44:15, 11.03s/it]
 37%|███▋      | 13904/37963 [43:14:13<71:30:57, 10.70s/it]
 37%|███▋      | 13905/37963 [43:14:23<70:26:41, 10.54s/it]
 37%|███▋      | 13906/37963 [43:14:33<69:34:12, 10.41s/it]
 37%|███▋      | 13907/37963 [43:14:43<68:10:53, 10.20s/it]
 37%|███▋      | 13908/37963 [43:14:53<67:54:18, 10.16s/it]
 37%|███▋      | 13909/37963 [43:15:03<67:43:34, 10.14s/it]
 37%|███▋      | 13910/37963 [43:15:13<67:03:27, 10.04s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '0.718', 'learning_rate': '1.463e-05', 'epoch': '0.3664'}

 37%|███▋      | 13910/37963 [43:15:13<67:03:27, 10.04s/it]
 37%|███▋      | 13911/37963 [43:15:23<67:08:03, 10.05s/it]
 37%|███▋      | 13912/37963 [43:15:33<67:16:06, 10.07s/it]
 37%|███▋      | 13913/37963 [43:15:49<80:28:49, 12.05s/it]
 37%|███▋      | 13914/37963 [43:15:59<76:21:32, 11.43s/it]
 37%|███▋      | 13915/37963 [43:16:09<73:35:57, 11.02s/it]
 37%|███▋      | 13916/37963 [43:16:20<71:45:11, 10.74s/it]
 37%|███▋      | 13917/37963 [43:16:29<69:54:41, 10.47s/it]
 37%|███▋      | 13918/37963 [43:16:46<81:58:32, 12.27s/it]
 37%|███▋      | 13919/37963 [43:16:56<77:35:08, 11.62s/it]
 37%|███▋      | 13920/37963 [43:17:12<86:50:34, 13.00s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '3.111', 'learning_rate': '1.462e-05', 'epoch': '0.3667'}

 37%|███▋      | 13920/37963 [43:17:12<86:50:34, 13.00s/it]
 37%|███▋      | 13921/37963 [43:17:22<81:09:38, 12.15s/it]
 37%|███▋      | 13922/37963 [43:17:32<77:06:30, 11.55s/it]
 37%|███▋      | 13923/37963 [43:17:42<73:06:40, 10.95s/it]
 37%|███▋      | 13924/37963 [43:17:58<83:55:22, 12.57s/it]
 37%|███▋      | 13925/37963 [43:18:15<92:53:12, 13.91s/it]
 37%|███▋      | 13926/37963 [43:18:26<85:22:06, 12.79s/it]
 37%|███▋      | 13927/37963 [43:18:36<79:52:55, 11.96s/it]
 37%|███▋      | 13928/37963 [43:18:46<75:53:17, 11.37s/it]
 37%|███▋      | 13929/37963 [43:18:55<72:14:02, 10.82s/it]
 37%|███▋      | 13930/37963 [43:19:05<70:44:30, 10.60s/it]
                                                           
{'loss': '0.1707', 'grad_norm': '1.019', 'learning_rate': '1.461e-05', 'epoch': '0.3669'}

 37%|███▋      | 13930/37963 [43:19:05<70:44:30, 10.60s/it]
 37%|███▋      | 13931/37963 [43:19:15<69:52:17, 10.47s/it]
 37%|███▋      | 13932/37963 [43:19:26<69:17:02, 10.38s/it]
 37%|███▋      | 13933/37963 [43:19:36<68:53:18, 10.32s/it]
 37%|███▋      | 13934/37963 [43:19:46<68:45:12, 10.30s/it]
 37%|███▋      | 13935/37963 [43:19:56<68:32:15, 10.27s/it]
 37%|███▋      | 13936/37963 [43:20:06<68:15:08, 10.23s/it]
 37%|███▋      | 13937/37963 [43:20:23<80:45:11, 12.10s/it]
 37%|███▋      | 13938/37963 [43:20:33<76:43:45, 11.50s/it]
 37%|███▋      | 13939/37963 [43:20:49<86:26:43, 12.95s/it]
 37%|███▋      | 13940/37963 [43:20:59<80:28:05, 12.06s/it]
                                                           
{'loss': '0.169', 'grad_norm': '0.8419', 'learning_rate': '1.461e-05', 'epoch': '0.3672'}

 37%|███▋      | 13940/37963 [43:20:59<80:28:05, 12.06s/it]
 37%|███▋      | 13941/37963 [43:21:09<76:32:54, 11.47s/it]
 37%|███▋      | 13942/37963 [43:21:19<73:57:31, 11.08s/it]
 37%|███▋      | 13943/37963 [43:21:29<71:48:59, 10.76s/it]
 37%|███▋      | 13944/37963 [43:21:40<70:30:37, 10.57s/it]
 37%|███▋      | 13945/37963 [43:21:49<68:51:41, 10.32s/it]
 37%|███▋      | 13946/37963 [43:21:59<67:30:59, 10.12s/it]
 37%|███▋      | 13947/37963 [43:22:09<67:28:27, 10.11s/it]
 37%|███▋      | 13948/37963 [43:22:19<67:26:38, 10.11s/it]
 37%|███▋      | 13949/37963 [43:22:36<81:13:31, 12.18s/it]
 37%|███▋      | 13950/37963 [43:22:46<77:02:40, 11.55s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '2.658', 'learning_rate': '1.46e-05', 'epoch': '0.3675'}

 37%|███▋      | 13950/37963 [43:22:46<77:02:40, 11.55s/it]
 37%|███▋      | 13951/37963 [43:22:56<73:35:20, 11.03s/it]
 37%|███▋      | 13952/37963 [43:23:06<71:52:50, 10.78s/it]
 37%|███▋      | 13953/37963 [43:23:16<70:27:53, 10.57s/it]
 37%|███▋      | 13954/37963 [43:23:26<69:30:07, 10.42s/it]
 37%|███▋      | 13955/37963 [43:23:37<68:56:20, 10.34s/it]
 37%|███▋      | 13956/37963 [43:23:47<68:51:56, 10.33s/it]
 37%|███▋      | 13957/37963 [43:23:57<67:44:48, 10.16s/it]
 37%|███▋      | 13958/37963 [43:24:06<66:59:02, 10.05s/it]
 37%|███▋      | 13959/37963 [43:24:16<66:43:21, 10.01s/it]
 37%|███▋      | 13960/37963 [43:24:26<66:54:47, 10.04s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '1.797', 'learning_rate': '1.459e-05', 'epoch': '0.3677'}

 37%|███▋      | 13960/37963 [43:24:26<66:54:47, 10.04s/it]
 37%|███▋      | 13961/37963 [43:24:43<79:50:54, 11.98s/it]
 37%|███▋      | 13962/37963 [43:24:53<76:07:41, 11.42s/it]
 37%|███▋      | 13963/37963 [43:25:03<72:54:49, 10.94s/it]
 37%|███▋      | 13964/37963 [43:25:13<71:04:49, 10.66s/it]
 37%|███▋      | 13965/37963 [43:25:29<82:51:54, 12.43s/it]
 37%|███▋      | 13966/37963 [43:25:40<78:35:52, 11.79s/it]
 37%|███▋      | 13967/37963 [43:25:50<75:23:28, 11.31s/it]
 37%|███▋      | 13968/37963 [43:26:00<73:09:16, 10.98s/it]
 37%|███▋      | 13969/37963 [43:26:10<71:33:05, 10.74s/it]
 37%|███▋      | 13970/37963 [43:26:27<83:15:56, 12.49s/it]
                                                           
{'loss': '0.1697', 'grad_norm': '1.52', 'learning_rate': '1.458e-05', 'epoch': '0.368'}

 37%|███▋      | 13970/37963 [43:26:27<83:15:56, 12.49s/it]
 37%|███▋      | 13971/37963 [43:26:37<78:24:11, 11.76s/it]
 37%|███▋      | 13972/37963 [43:26:53<86:49:54, 13.03s/it]
 37%|███▋      | 13973/37963 [43:27:10<94:42:41, 14.21s/it]
 37%|███▋      | 13974/37963 [43:27:20<86:39:38, 13.01s/it]
 37%|███▋      | 13975/37963 [43:27:30<80:45:57, 12.12s/it]
 37%|███▋      | 13976/37963 [43:27:40<76:00:19, 11.41s/it]
 37%|███▋      | 13977/37963 [43:27:50<72:41:34, 10.91s/it]
 37%|███▋      | 13978/37963 [43:28:00<71:03:47, 10.67s/it]
 37%|███▋      | 13979/37963 [43:28:10<69:31:33, 10.44s/it]
 37%|███▋      | 13980/37963 [43:28:20<68:45:18, 10.32s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '0.7373', 'learning_rate': '1.458e-05', 'epoch': '0.3683'}

 37%|███▋      | 13980/37963 [43:28:20<68:45:18, 10.32s/it]
 37%|███▋      | 13981/37963 [43:28:30<68:13:47, 10.24s/it]
 37%|███▋      | 13982/37963 [43:28:40<67:36:22, 10.15s/it]
 37%|███▋      | 13983/37963 [43:28:50<67:19:33, 10.11s/it]
 37%|███▋      | 13984/37963 [43:29:06<80:02:32, 12.02s/it]
 37%|███▋      | 13985/37963 [43:29:16<76:14:30, 11.45s/it]
 37%|███▋      | 13986/37963 [43:29:26<72:55:02, 10.95s/it]
 37%|███▋      | 13987/37963 [43:29:43<84:01:10, 12.62s/it]
 37%|███▋      | 13988/37963 [43:29:52<78:28:07, 11.78s/it]
 37%|███▋      | 13989/37963 [43:30:03<75:03:13, 11.27s/it]
 37%|███▋      | 13990/37963 [43:30:13<72:46:28, 10.93s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '1.986', 'learning_rate': '1.457e-05', 'epoch': '0.3685'}

 37%|███▋      | 13990/37963 [43:30:13<72:46:28, 10.93s/it]
 37%|███▋      | 13991/37963 [43:30:23<70:59:11, 10.66s/it]
 37%|███▋      | 13992/37963 [43:30:33<69:29:42, 10.44s/it]
 37%|███▋      | 13993/37963 [43:30:43<68:38:16, 10.31s/it]
 37%|███▋      | 13994/37963 [43:30:53<68:11:50, 10.24s/it]
 37%|███▋      | 13995/37963 [43:31:02<66:56:33, 10.05s/it]
 37%|███▋      | 13996/37963 [43:31:12<65:58:07,  9.91s/it]
 37%|███▋      | 13997/37963 [43:31:22<66:18:28,  9.96s/it]
 37%|███▋      | 13998/37963 [43:31:39<79:55:59, 12.01s/it]
 37%|███▋      | 13999/37963 [43:31:49<76:04:27, 11.43s/it]
 37%|███▋      | 14000/37963 [43:31:59<72:34:44, 10.90s/it]
                                                           
{'loss': '0.1625', 'grad_norm': '0.9307', 'learning_rate': '1.456e-05', 'epoch': '0.3688'}

 37%|███▋      | 14000/37963 [43:31:59<72:34:44, 10.90s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.89s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.89s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 37%|███▋      | 14001/37963 [43:32:58<169:15:44, 25.43s/it]
 37%|███▋      | 14002/37963 [43:33:08<138:13:47, 20.77s/it]
 37%|███▋      | 14003/37963 [43:33:18<116:45:18, 17.54s/it]
 37%|███▋      | 14004/37963 [43:33:28<101:46:44, 15.29s/it]
 37%|███▋      | 14005/37963 [43:33:38<91:52:44, 13.81s/it] 
 37%|███▋      | 14006/37963 [43:33:48<84:05:36, 12.64s/it]
 37%|███▋      | 14007/37963 [43:33:58<78:53:11, 11.85s/it]
 37%|███▋      | 14008/37963 [43:34:08<75:30:18, 11.35s/it]
 37%|███▋      | 14009/37963 [43:34:18<72:35:54, 10.91s/it]
 37%|███▋      | 14010/37963 [43:34:28<70:54:16, 10.66s/it]
                                                           
{'loss': '0.1713', 'grad_norm': '2.054', 'learning_rate': '1.455e-05', 'epoch': '0.369'}

 37%|███▋      | 14010/37963 [43:34:28<70:54:16, 10.66s/it]
 37%|███▋      | 14011/37963 [43:34:45<82:51:51, 12.45s/it]
 37%|███▋      | 14012/37963 [43:34:55<77:55:42, 11.71s/it]
 37%|███▋      | 14013/37963 [43:35:05<74:44:48, 11.24s/it]
 37%|███▋      | 14014/37963 [43:35:15<72:25:10, 10.89s/it]
 37%|███▋      | 14015/37963 [43:35:32<84:11:51, 12.66s/it]
 37%|███▋      | 14016/37963 [43:35:42<78:26:56, 11.79s/it]
 37%|███▋      | 14017/37963 [43:35:52<75:20:16, 11.33s/it]
 37%|███▋      | 14018/37963 [43:36:02<72:53:00, 10.96s/it]
 37%|███▋      | 14019/37963 [43:36:32<111:18:49, 16.74s/it]
 37%|███▋      | 14020/37963 [43:36:42<98:01:14, 14.74s/it] 
                                                           
{'loss': '0.1472', 'grad_norm': '0.7723', 'learning_rate': '1.455e-05', 'epoch': '0.3693'}

 37%|███▋      | 14020/37963 [43:36:42<98:01:14, 14.74s/it]
 37%|███▋      | 14021/37963 [43:36:52<88:39:57, 13.33s/it]
 37%|███▋      | 14022/37963 [43:37:02<81:51:26, 12.31s/it]
 37%|███▋      | 14023/37963 [43:37:12<77:22:27, 11.64s/it]
 37%|███▋      | 14024/37963 [43:37:22<74:14:20, 11.16s/it]
 37%|███▋      | 14025/37963 [43:37:32<71:48:14, 10.80s/it]
 37%|███▋      | 14026/37963 [43:37:42<69:25:17, 10.44s/it]
 37%|███▋      | 14027/37963 [43:37:52<68:24:42, 10.29s/it]
 37%|███▋      | 14028/37963 [43:38:02<67:44:30, 10.19s/it]
 37%|███▋      | 14029/37963 [43:38:12<67:13:12, 10.11s/it]
 37%|███▋      | 14030/37963 [43:38:22<66:48:16, 10.05s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '1.428', 'learning_rate': '1.454e-05', 'epoch': '0.3696'}

 37%|███▋      | 14030/37963 [43:38:22<66:48:16, 10.05s/it]
 37%|███▋      | 14031/37963 [43:38:38<78:54:57, 11.87s/it]
 37%|███▋      | 14032/37963 [43:38:47<74:39:11, 11.23s/it]
 37%|███▋      | 14033/37963 [43:38:57<72:16:29, 10.87s/it]
 37%|███▋      | 14034/37963 [43:39:08<70:36:27, 10.62s/it]
 37%|███▋      | 14035/37963 [43:39:24<81:54:33, 12.32s/it]
 37%|███▋      | 14036/37963 [43:39:34<77:19:21, 11.63s/it]
 37%|███▋      | 14037/37963 [43:39:44<74:13:20, 11.17s/it]
 37%|███▋      | 14038/37963 [43:39:54<71:55:04, 10.82s/it]
 37%|███▋      | 14039/37963 [43:40:04<70:24:23, 10.59s/it]
 37%|███▋      | 14040/37963 [43:40:14<69:26:03, 10.45s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '3.563', 'learning_rate': '1.453e-05', 'epoch': '0.3698'}

 37%|███▋      | 14040/37963 [43:40:14<69:26:03, 10.45s/it]
 37%|███▋      | 14041/37963 [43:40:24<69:18:14, 10.43s/it]
 37%|███▋      | 14042/37963 [43:40:35<68:32:45, 10.32s/it]
 37%|███▋      | 14043/37963 [43:40:45<68:30:56, 10.31s/it]
 37%|███▋      | 14044/37963 [43:40:55<67:54:29, 10.22s/it]
 37%|███▋      | 14045/37963 [43:41:11<80:07:04, 12.06s/it]
 37%|███▋      | 14046/37963 [43:41:21<75:21:36, 11.34s/it]
 37%|███▋      | 14047/37963 [43:41:30<71:56:28, 10.83s/it]
 37%|███▋      | 14048/37963 [43:41:40<69:46:34, 10.50s/it]
 37%|███▋      | 14049/37963 [43:41:50<69:11:59, 10.42s/it]
 37%|███▋      | 14050/37963 [43:42:00<68:25:55, 10.30s/it]
                                                           
{'loss': '0.1775', 'grad_norm': '1.06', 'learning_rate': '1.452e-05', 'epoch': '0.3701'}

 37%|███▋      | 14050/37963 [43:42:00<68:25:55, 10.30s/it]
 37%|███▋      | 14051/37963 [43:42:11<68:00:32, 10.24s/it]
 37%|███▋      | 14052/37963 [43:42:21<67:41:44, 10.19s/it]
 37%|███▋      | 14053/37963 [43:42:31<67:34:58, 10.18s/it]
 37%|███▋      | 14054/37963 [43:42:41<67:18:49, 10.14s/it]
 37%|███▋      | 14055/37963 [43:42:51<67:17:13, 10.13s/it]
 37%|███▋      | 14056/37963 [43:43:01<67:13:22, 10.12s/it]
 37%|███▋      | 14057/37963 [43:43:11<67:08:55, 10.11s/it]
 37%|███▋      | 14058/37963 [43:43:21<67:05:35, 10.10s/it]
 37%|███▋      | 14059/37963 [43:43:31<67:13:57, 10.13s/it]
 37%|███▋      | 14060/37963 [43:43:48<80:12:22, 12.08s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '1.671', 'learning_rate': '1.452e-05', 'epoch': '0.3704'}

 37%|███▋      | 14060/37963 [43:43:48<80:12:22, 12.08s/it]
 37%|███▋      | 14061/37963 [43:43:58<76:30:14, 11.52s/it]
 37%|███▋      | 14062/37963 [43:44:08<73:53:09, 11.13s/it]
 37%|███▋      | 14063/37963 [43:44:18<71:34:21, 10.78s/it]
 37%|███▋      | 14064/37963 [43:44:35<83:27:54, 12.57s/it]
 37%|███▋      | 14065/37963 [43:44:45<78:46:02, 11.87s/it]
 37%|███▋      | 14066/37963 [43:45:08<100:49:08, 15.19s/it]
 37%|███▋      | 14067/37963 [43:45:25<104:20:30, 15.72s/it]
 37%|███▋      | 14068/37963 [43:45:35<93:14:53, 14.05s/it] 
 37%|███▋      | 14069/37963 [43:45:45<84:41:25, 12.76s/it]
 37%|███▋      | 14070/37963 [43:45:55<79:14:33, 11.94s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '1.599', 'learning_rate': '1.451e-05', 'epoch': '0.3706'}

 37%|███▋      | 14070/37963 [43:45:55<79:14:33, 11.94s/it]
 37%|███▋      | 14071/37963 [43:46:05<75:33:52, 11.39s/it]
 37%|███▋      | 14072/37963 [43:46:16<73:12:04, 11.03s/it]
 37%|███▋      | 14073/37963 [43:46:26<71:23:27, 10.76s/it]
 37%|███▋      | 14074/37963 [43:46:36<69:57:01, 10.54s/it]
 37%|███▋      | 14075/37963 [43:46:46<69:04:39, 10.41s/it]
 37%|███▋      | 14076/37963 [43:46:56<68:21:12, 10.30s/it]
 37%|███▋      | 14077/37963 [43:47:12<80:53:25, 12.19s/it]
 37%|███▋      | 14078/37963 [43:47:23<76:49:41, 11.58s/it]
 37%|███▋      | 14079/37963 [43:47:33<73:48:33, 11.13s/it]
 37%|███▋      | 14080/37963 [43:47:43<71:41:49, 10.81s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '1.117', 'learning_rate': '1.45e-05', 'epoch': '0.3709'}

 37%|███▋      | 14080/37963 [43:47:43<71:41:49, 10.81s/it]
 37%|███▋      | 14081/37963 [43:47:53<70:16:55, 10.59s/it]
 37%|███▋      | 14082/37963 [43:48:03<69:25:03, 10.46s/it]
 37%|███▋      | 14083/37963 [43:48:13<68:44:42, 10.36s/it]
 37%|███▋      | 14084/37963 [43:48:29<80:31:34, 12.14s/it]
 37%|███▋      | 14085/37963 [43:48:40<76:35:12, 11.55s/it]
 37%|███▋      | 14086/37963 [43:48:50<73:55:25, 11.15s/it]
 37%|███▋      | 14087/37963 [43:49:00<71:56:24, 10.85s/it]
 37%|███▋      | 14088/37963 [43:49:10<70:33:19, 10.64s/it]
 37%|███▋      | 14089/37963 [43:49:20<69:23:06, 10.46s/it]
 37%|███▋      | 14090/37963 [43:49:30<68:09:52, 10.28s/it]
                                                           
{'loss': '0.159', 'grad_norm': '1.464', 'learning_rate': '1.449e-05', 'epoch': '0.3712'}

 37%|███▋      | 14090/37963 [43:49:30<68:09:52, 10.28s/it]
 37%|███▋      | 14091/37963 [43:49:40<67:41:45, 10.21s/it]
 37%|███▋      | 14092/37963 [43:49:50<67:26:03, 10.17s/it]
 37%|███▋      | 14093/37963 [43:50:00<66:52:30, 10.09s/it]
 37%|███▋      | 14094/37963 [43:50:10<66:14:03,  9.99s/it]
 37%|███▋      | 14095/37963 [43:50:27<80:31:13, 12.14s/it]
 37%|███▋      | 14096/37963 [43:50:37<75:37:40, 11.41s/it]
 37%|███▋      | 14097/37963 [43:50:46<72:18:17, 10.91s/it]
 37%|███▋      | 14098/37963 [43:50:56<70:45:53, 10.67s/it]
 37%|███▋      | 14099/37963 [43:51:07<69:47:42, 10.53s/it]
 37%|███▋      | 14100/37963 [43:51:17<69:05:19, 10.42s/it]
                                                           
{'loss': '0.1577', 'grad_norm': '1.22', 'learning_rate': '1.449e-05', 'epoch': '0.3714'}

 37%|███▋      | 14100/37963 [43:51:17<69:05:19, 10.42s/it]
 37%|███▋      | 14101/37963 [43:51:27<68:37:35, 10.35s/it]
 37%|███▋      | 14102/37963 [43:51:37<67:48:00, 10.23s/it]
 37%|███▋      | 14103/37963 [43:51:47<67:19:54, 10.16s/it]
 37%|███▋      | 14104/37963 [43:51:57<67:05:18, 10.12s/it]
 37%|███▋      | 14105/37963 [43:52:07<66:34:08, 10.04s/it]
 37%|███▋      | 14106/37963 [43:52:17<66:47:16, 10.08s/it]
 37%|███▋      | 14107/37963 [43:52:27<67:14:51, 10.15s/it]
 37%|███▋      | 14108/37963 [43:52:38<67:18:29, 10.16s/it]
 37%|███▋      | 14109/37963 [43:52:54<79:03:34, 11.93s/it]
 37%|███▋      | 14110/37963 [43:53:04<75:29:09, 11.39s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '2.449', 'learning_rate': '1.448e-05', 'epoch': '0.3717'}

 37%|███▋      | 14110/37963 [43:53:04<75:29:09, 11.39s/it]
 37%|███▋      | 14111/37963 [43:53:14<73:00:07, 11.02s/it]
 37%|███▋      | 14112/37963 [43:53:30<83:58:07, 12.67s/it]
 37%|███▋      | 14113/37963 [43:53:47<91:15:49, 13.78s/it]
 37%|███▋      | 14114/37963 [43:54:03<96:16:07, 14.53s/it]
 37%|███▋      | 14115/37963 [43:54:13<87:35:16, 13.22s/it]
 37%|███▋      | 14116/37963 [43:54:30<93:42:03, 14.15s/it]
 37%|███▋      | 14117/37963 [43:54:40<85:51:19, 12.96s/it]
 37%|███▋      | 14118/37963 [43:54:50<79:58:08, 12.07s/it]
 37%|███▋      | 14119/37963 [43:55:00<75:57:16, 11.47s/it]
 37%|███▋      | 14120/37963 [43:55:10<72:47:51, 10.99s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '1.621', 'learning_rate': '1.447e-05', 'epoch': '0.3719'}

 37%|███▋      | 14120/37963 [43:55:10<72:47:51, 10.99s/it]
 37%|███▋      | 14121/37963 [43:55:20<70:48:33, 10.69s/it]
 37%|███▋      | 14122/37963 [43:55:30<69:40:55, 10.52s/it]
 37%|███▋      | 14123/37963 [43:55:40<68:20:57, 10.32s/it]
 37%|███▋      | 14124/37963 [43:55:56<80:07:03, 12.10s/it]
 37%|███▋      | 14125/37963 [43:56:06<76:10:27, 11.50s/it]
 37%|███▋      | 14126/37963 [43:56:16<73:17:44, 11.07s/it]
 37%|███▋      | 14127/37963 [43:56:26<71:37:07, 10.82s/it]
 37%|███▋      | 14128/37963 [43:56:36<68:53:38, 10.41s/it]
 37%|███▋      | 14129/37963 [43:56:46<68:16:41, 10.31s/it]
 37%|███▋      | 14130/37963 [43:56:56<67:06:24, 10.14s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '4.701', 'learning_rate': '1.446e-05', 'epoch': '0.3722'}

 37%|███▋      | 14130/37963 [43:56:56<67:06:24, 10.14s/it]
 37%|███▋      | 14131/37963 [43:57:12<79:05:17, 11.95s/it]
 37%|███▋      | 14132/37963 [43:57:22<75:21:56, 11.39s/it]
 37%|███▋      | 14133/37963 [43:57:32<72:48:37, 11.00s/it]
 37%|███▋      | 14134/37963 [43:57:42<70:43:11, 10.68s/it]
 37%|███▋      | 14135/37963 [43:57:52<68:58:16, 10.42s/it]
 37%|███▋      | 14136/37963 [43:58:01<67:32:12, 10.20s/it]
 37%|███▋      | 14137/37963 [43:58:11<67:25:04, 10.19s/it]
 37%|███▋      | 14138/37963 [43:58:21<66:46:08, 10.09s/it]
 37%|███▋      | 14139/37963 [43:58:31<66:48:23, 10.09s/it]
 37%|███▋      | 14140/37963 [43:58:42<66:54:53, 10.11s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '1.841', 'learning_rate': '1.445e-05', 'epoch': '0.3725'}

 37%|███▋      | 14140/37963 [43:58:42<66:54:53, 10.11s/it]
 37%|███▋      | 14141/37963 [43:58:52<66:53:45, 10.11s/it]
 37%|███▋      | 14142/37963 [43:59:02<66:46:20, 10.09s/it]
 37%|███▋      | 14143/37963 [43:59:19<80:42:33, 12.20s/it]
 37%|███▋      | 14144/37963 [43:59:29<76:17:15, 11.53s/it]
 37%|███▋      | 14145/37963 [43:59:39<73:28:24, 11.11s/it]
 37%|███▋      | 14146/37963 [43:59:49<71:10:36, 10.76s/it]
 37%|███▋      | 14147/37963 [43:59:59<69:58:28, 10.58s/it]
 37%|███▋      | 14148/37963 [44:00:09<68:37:28, 10.37s/it]
 37%|███▋      | 14149/37963 [44:00:19<67:12:00, 10.16s/it]
 37%|███▋      | 14150/37963 [44:00:29<66:57:12, 10.12s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '1.776', 'learning_rate': '1.445e-05', 'epoch': '0.3727'}

 37%|███▋      | 14150/37963 [44:00:29<66:57:12, 10.12s/it]
 37%|███▋      | 14151/37963 [44:00:39<66:54:34, 10.12s/it]
 37%|███▋      | 14152/37963 [44:00:49<66:38:51, 10.08s/it]
 37%|███▋      | 14153/37963 [44:00:59<66:46:08, 10.10s/it]
 37%|███▋      | 14154/37963 [44:01:09<66:55:41, 10.12s/it]
 37%|███▋      | 14155/37963 [44:01:19<66:48:36, 10.10s/it]
 37%|███▋      | 14156/37963 [44:01:29<66:37:10, 10.07s/it]
 37%|███▋      | 14157/37963 [44:01:46<79:18:54, 11.99s/it]
 37%|███▋      | 14158/37963 [44:01:55<74:57:04, 11.33s/it]
 37%|███▋      | 14159/37963 [44:02:05<72:21:20, 10.94s/it]
 37%|███▋      | 14160/37963 [44:02:16<70:40:17, 10.69s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '1.349', 'learning_rate': '1.444e-05', 'epoch': '0.373'}

 37%|███▋      | 14160/37963 [44:02:16<70:40:17, 10.69s/it]
 37%|███▋      | 14161/37963 [44:02:32<82:06:49, 12.42s/it]
 37%|███▋      | 14162/37963 [44:02:48<89:58:00, 13.61s/it]
 37%|███▋      | 14163/37963 [44:03:12<109:01:52, 16.49s/it]
 37%|███▋      | 14164/37963 [44:03:21<95:56:34, 14.51s/it] 
 37%|███▋      | 14165/37963 [44:03:31<86:52:59, 13.14s/it]
 37%|███▋      | 14166/37963 [44:03:41<80:32:30, 12.18s/it]
 37%|███▋      | 14167/37963 [44:03:51<75:33:00, 11.43s/it]
 37%|███▋      | 14168/37963 [44:04:01<72:50:43, 11.02s/it]
 37%|███▋      | 14169/37963 [44:04:11<70:35:57, 10.68s/it]
 37%|███▋      | 14170/37963 [44:04:21<69:33:18, 10.52s/it]
                                                           
{'loss': '0.1671', 'grad_norm': '2.433', 'learning_rate': '1.443e-05', 'epoch': '0.3733'}

 37%|███▋      | 14170/37963 [44:04:21<69:33:18, 10.52s/it]
 37%|███▋      | 14171/37963 [44:04:31<68:40:13, 10.39s/it]
 37%|███▋      | 14172/37963 [44:04:41<68:18:05, 10.34s/it]
 37%|███▋      | 14173/37963 [44:04:52<67:45:23, 10.25s/it]
 37%|███▋      | 14174/37963 [44:05:08<80:26:03, 12.17s/it]
 37%|███▋      | 14175/37963 [44:05:18<76:27:05, 11.57s/it]
 37%|███▋      | 14176/37963 [44:05:28<73:24:53, 11.11s/it]
 37%|███▋      | 14177/37963 [44:05:38<71:23:27, 10.80s/it]
 37%|███▋      | 14178/37963 [44:05:55<81:59:44, 12.41s/it]
 37%|███▋      | 14179/37963 [44:06:05<77:07:28, 11.67s/it]
 37%|███▋      | 14180/37963 [44:06:14<73:29:05, 11.12s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '1.645', 'learning_rate': '1.442e-05', 'epoch': '0.3735'}

 37%|███▋      | 14180/37963 [44:06:14<73:29:05, 11.12s/it]
 37%|███▋      | 14181/37963 [44:06:25<71:31:21, 10.83s/it]
 37%|███▋      | 14182/37963 [44:06:35<70:04:18, 10.61s/it]
 37%|███▋      | 14183/37963 [44:06:45<69:04:14, 10.46s/it]
 37%|███▋      | 14184/37963 [44:06:55<68:25:33, 10.36s/it]
 37%|███▋      | 14185/37963 [44:07:05<68:10:54, 10.32s/it]
 37%|███▋      | 14186/37963 [44:07:15<67:39:04, 10.24s/it]
 37%|███▋      | 14187/37963 [44:07:25<67:21:01, 10.20s/it]
 37%|███▋      | 14188/37963 [44:07:35<67:02:03, 10.15s/it]
 37%|███▋      | 14189/37963 [44:07:45<67:00:10, 10.15s/it]
 37%|███▋      | 14190/37963 [44:07:56<66:52:20, 10.13s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '1.332', 'learning_rate': '1.442e-05', 'epoch': '0.3738'}

 37%|███▋      | 14190/37963 [44:07:56<66:52:20, 10.13s/it]
 37%|███▋      | 14191/37963 [44:08:06<66:53:55, 10.13s/it]
 37%|███▋      | 14192/37963 [44:08:23<81:07:11, 12.29s/it]
 37%|███▋      | 14193/37963 [44:08:33<76:17:05, 11.55s/it]
 37%|███▋      | 14194/37963 [44:08:43<73:23:43, 11.12s/it]
 37%|███▋      | 14195/37963 [44:08:53<71:19:30, 10.80s/it]
 37%|███▋      | 14196/37963 [44:09:03<69:43:29, 10.56s/it]
 37%|███▋      | 14197/37963 [44:09:13<68:42:36, 10.41s/it]
 37%|███▋      | 14198/37963 [44:09:23<67:47:31, 10.27s/it]
 37%|███▋      | 14199/37963 [44:09:33<67:38:23, 10.25s/it]
 37%|███▋      | 14200/37963 [44:09:43<67:26:50, 10.22s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '2.808', 'learning_rate': '1.441e-05', 'epoch': '0.374'}

 37%|███▋      | 14200/37963 [44:09:43<67:26:50, 10.22s/it]
 37%|███▋      | 14201/37963 [44:09:53<66:11:04, 10.03s/it]
 37%|███▋      | 14202/37963 [44:10:03<65:23:52,  9.91s/it]
 37%|███▋      | 14203/37963 [44:10:13<66:00:13, 10.00s/it]
 37%|███▋      | 14204/37963 [44:10:23<66:14:31, 10.04s/it]
 37%|███▋      | 14205/37963 [44:10:33<66:23:05, 10.06s/it]
 37%|███▋      | 14206/37963 [44:10:43<66:31:37, 10.08s/it]
 37%|███▋      | 14207/37963 [44:11:00<79:15:29, 12.01s/it]
 37%|███▋      | 14208/37963 [44:11:10<75:22:06, 11.42s/it]
 37%|███▋      | 14209/37963 [44:11:33<99:22:12, 15.06s/it]
 37%|███▋      | 14210/37963 [44:11:50<102:22:34, 15.52s/it]
                                                            
{'loss': '0.1604', 'grad_norm': '3.173', 'learning_rate': '1.44e-05', 'epoch': '0.3743'}

 37%|███▋      | 14210/37963 [44:11:50<102:22:34, 15.52s/it]
 37%|███▋      | 14211/37963 [44:12:07<104:53:41, 15.90s/it]
 37%|███▋      | 14212/37963 [44:12:17<93:21:15, 14.15s/it] 
 37%|███▋      | 14213/37963 [44:12:27<84:58:20, 12.88s/it]
 37%|███▋      | 14214/37963 [44:12:37<79:23:48, 12.04s/it]
 37%|███▋      | 14215/37963 [44:12:47<75:12:46, 11.40s/it]
 37%|███▋      | 14216/37963 [44:12:57<72:38:46, 11.01s/it]
 37%|███▋      | 14217/37963 [44:13:07<70:28:01, 10.68s/it]
 37%|███▋      | 14218/37963 [44:13:17<69:20:25, 10.51s/it]
 37%|███▋      | 14219/37963 [44:13:27<68:29:53, 10.39s/it]
 37%|███▋      | 14220/37963 [44:13:37<68:00:55, 10.31s/it]
                                                           
{'loss': '0.1702', 'grad_norm': '1.388', 'learning_rate': '1.439e-05', 'epoch': '0.3746'}

 37%|███▋      | 14220/37963 [44:13:37<68:00:55, 10.31s/it]
 37%|███▋      | 14221/37963 [44:13:47<67:40:10, 10.26s/it]
 37%|███▋      | 14222/37963 [44:14:04<80:12:50, 12.16s/it]
 37%|███▋      | 14223/37963 [44:14:14<76:05:39, 11.54s/it]
 37%|███▋      | 14224/37963 [44:14:24<73:11:52, 11.10s/it]
 37%|███▋      | 14225/37963 [44:14:34<71:05:53, 10.78s/it]
 37%|███▋      | 14226/37963 [44:14:44<69:35:55, 10.56s/it]
 37%|███▋      | 14227/37963 [44:14:54<68:33:43, 10.40s/it]
 37%|███▋      | 14228/37963 [44:15:10<80:36:56, 12.23s/it]
 37%|███▋      | 14229/37963 [44:15:21<76:26:20, 11.59s/it]
 37%|███▋      | 14230/37963 [44:15:30<72:48:22, 11.04s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '3.396', 'learning_rate': '1.439e-05', 'epoch': '0.3748'}

 37%|███▋      | 14230/37963 [44:15:30<72:48:22, 11.04s/it]
 37%|███▋      | 14231/37963 [44:15:40<70:58:06, 10.77s/it]
 37%|███▋      | 14232/37963 [44:15:51<69:39:03, 10.57s/it]
 37%|███▋      | 14233/37963 [44:16:00<68:10:00, 10.34s/it]
 37%|███▋      | 14234/37963 [44:16:10<67:44:59, 10.28s/it]
 37%|███▋      | 14235/37963 [44:16:20<66:16:48, 10.06s/it]
 37%|███▋      | 14236/37963 [44:16:30<66:27:58, 10.08s/it]
 38%|███▊      | 14237/37963 [44:16:40<66:32:58, 10.10s/it]
 38%|███▊      | 14238/37963 [44:16:50<66:43:39, 10.13s/it]
 38%|███▊      | 14239/37963 [44:17:01<66:33:03, 10.10s/it]
 38%|███▊      | 14240/37963 [44:17:17<79:51:52, 12.12s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '1.142', 'learning_rate': '1.438e-05', 'epoch': '0.3751'}

 38%|███▊      | 14240/37963 [44:17:17<79:51:52, 12.12s/it]
 38%|███▊      | 14241/37963 [44:17:27<75:20:49, 11.43s/it]
 38%|███▊      | 14242/37963 [44:17:37<72:02:31, 10.93s/it]
 38%|███▊      | 14243/37963 [44:17:47<70:04:27, 10.64s/it]
 38%|███▊      | 14244/37963 [44:17:57<69:15:45, 10.51s/it]
 38%|███▊      | 14245/37963 [44:18:07<68:18:09, 10.37s/it]
 38%|███▊      | 14246/37963 [44:18:17<67:35:21, 10.26s/it]
 38%|███▊      | 14247/37963 [44:18:27<67:19:34, 10.22s/it]
 38%|███▊      | 14248/37963 [44:18:37<67:08:56, 10.19s/it]
 38%|███▊      | 14249/37963 [44:18:47<66:46:09, 10.14s/it]
 38%|███▊      | 14250/37963 [44:18:57<66:33:07, 10.10s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '0.8839', 'learning_rate': '1.437e-05', 'epoch': '0.3754'}

 38%|███▊      | 14250/37963 [44:18:57<66:33:07, 10.10s/it]
 38%|███▊      | 14251/37963 [44:19:08<66:34:13, 10.11s/it]
 38%|███▊      | 14252/37963 [44:19:18<66:30:05, 10.10s/it]
 38%|███▊      | 14253/37963 [44:19:28<66:38:22, 10.12s/it]
 38%|███▊      | 14254/37963 [44:19:44<79:16:00, 12.04s/it]
 38%|███▊      | 14255/37963 [44:19:54<75:26:59, 11.46s/it]
 38%|███▊      | 14256/37963 [44:20:04<72:01:27, 10.94s/it]
 38%|███▊      | 14257/37963 [44:20:14<70:36:03, 10.72s/it]
 38%|███▊      | 14258/37963 [44:20:50<120:47:14, 18.34s/it]
 38%|███▊      | 14259/37963 [44:21:00<103:39:31, 15.74s/it]
 38%|███▊      | 14260/37963 [44:21:10<92:25:25, 14.04s/it] 
                                                           
{'loss': '0.1613', 'grad_norm': '1.885', 'learning_rate': '1.436e-05', 'epoch': '0.3756'}

 38%|███▊      | 14260/37963 [44:21:10<92:25:25, 14.04s/it]
 38%|███▊      | 14261/37963 [44:21:20<84:35:35, 12.85s/it]
 38%|███▊      | 14262/37963 [44:21:30<78:24:10, 11.91s/it]
 38%|███▊      | 14263/37963 [44:21:40<74:44:08, 11.35s/it]
 38%|███▊      | 14264/37963 [44:21:50<72:08:14, 10.96s/it]
 38%|███▊      | 14265/37963 [44:22:00<69:53:47, 10.62s/it]
 38%|███▊      | 14266/37963 [44:22:10<68:55:09, 10.47s/it]
 38%|███▊      | 14267/37963 [44:22:20<67:48:04, 10.30s/it]
 38%|███▊      | 14268/37963 [44:22:30<67:14:27, 10.22s/it]
 38%|███▊      | 14269/37963 [44:22:46<79:38:24, 12.10s/it]
 38%|███▊      | 14270/37963 [44:22:57<75:42:41, 11.50s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '1.178', 'learning_rate': '1.436e-05', 'epoch': '0.3759'}

 38%|███▊      | 14270/37963 [44:22:57<75:42:41, 11.50s/it]
 38%|███▊      | 14271/37963 [44:23:07<73:11:43, 11.12s/it]
 38%|███▊      | 14272/37963 [44:23:17<70:59:28, 10.79s/it]
 38%|███▊      | 14273/37963 [44:23:27<69:36:11, 10.58s/it]
 38%|███▊      | 14274/37963 [44:23:37<68:56:19, 10.48s/it]
 38%|███▊      | 14275/37963 [44:23:47<68:08:26, 10.36s/it]
 38%|███▊      | 14276/37963 [44:24:04<79:53:06, 12.14s/it]
 38%|███▊      | 14277/37963 [44:24:14<75:55:17, 11.54s/it]
 38%|███▊      | 14278/37963 [44:24:24<72:43:06, 11.05s/it]
 38%|███▊      | 14279/37963 [44:24:34<70:48:33, 10.76s/it]
 38%|███▊      | 14280/37963 [44:24:43<68:46:16, 10.45s/it]
                                                           
{'loss': '0.1787', 'grad_norm': '1.254', 'learning_rate': '1.435e-05', 'epoch': '0.3762'}

 38%|███▊      | 14280/37963 [44:24:43<68:46:16, 10.45s/it]
 38%|███▊      | 14281/37963 [44:24:54<68:13:53, 10.37s/it]
 38%|███▊      | 14282/37963 [44:25:04<67:29:51, 10.26s/it]
 38%|███▊      | 14283/37963 [44:25:14<67:02:17, 10.19s/it]
 38%|███▊      | 14284/37963 [44:25:24<66:46:39, 10.15s/it]
 38%|███▊      | 14285/37963 [44:25:34<66:34:24, 10.12s/it]
 38%|███▊      | 14286/37963 [44:25:43<65:26:30,  9.95s/it]
 38%|███▊      | 14287/37963 [44:25:53<65:46:57, 10.00s/it]
 38%|███▊      | 14288/37963 [44:26:10<79:33:31, 12.10s/it]
 38%|███▊      | 14289/37963 [44:26:20<75:19:23, 11.45s/it]
 38%|███▊      | 14290/37963 [44:26:31<72:48:05, 11.07s/it]
                                                           
{'loss': '0.1464', 'grad_norm': '2.24', 'learning_rate': '1.434e-05', 'epoch': '0.3764'}

 38%|███▊      | 14290/37963 [44:26:31<72:48:05, 11.07s/it]
 38%|███▊      | 14291/37963 [44:26:41<70:53:51, 10.78s/it]
 38%|███▊      | 14292/37963 [44:26:51<69:26:16, 10.56s/it]
 38%|███▊      | 14293/37963 [44:27:01<68:28:57, 10.42s/it]
 38%|███▊      | 14294/37963 [44:27:11<67:48:00, 10.31s/it]
 38%|███▊      | 14295/37963 [44:27:21<67:19:56, 10.24s/it]
 38%|███▊      | 14296/37963 [44:27:31<67:01:57, 10.20s/it]
 38%|███▊      | 14297/37963 [44:27:41<66:46:28, 10.16s/it]
 38%|███▊      | 14298/37963 [44:27:51<66:39:17, 10.14s/it]
 38%|███▊      | 14299/37963 [44:28:01<66:33:15, 10.12s/it]
 38%|███▊      | 14300/37963 [44:28:11<66:39:30, 10.14s/it]
                                                           
{'loss': '0.1728', 'grad_norm': '4.476', 'learning_rate': '1.433e-05', 'epoch': '0.3767'}

 38%|███▊      | 14300/37963 [44:28:11<66:39:30, 10.14s/it]
 38%|███▊      | 14301/37963 [44:28:22<66:38:19, 10.14s/it]
 38%|███▊      | 14302/37963 [44:28:38<78:51:50, 12.00s/it]
 38%|███▊      | 14303/37963 [44:28:48<75:06:27, 11.43s/it]
 38%|███▊      | 14304/37963 [44:28:58<72:29:09, 11.03s/it]
 38%|███▊      | 14305/37963 [44:29:08<70:20:02, 10.70s/it]
 38%|███▊      | 14306/37963 [44:29:37<106:25:48, 16.20s/it]
 38%|███▊      | 14307/37963 [44:29:54<108:29:48, 16.51s/it]
 38%|███▊      | 14308/37963 [44:30:04<95:45:16, 14.57s/it] 
 38%|███▊      | 14309/37963 [44:30:15<87:06:05, 13.26s/it]
 38%|███▊      | 14310/37963 [44:30:25<80:43:10, 12.29s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '1.35', 'learning_rate': '1.432e-05', 'epoch': '0.3769'}

 38%|███▊      | 14310/37963 [44:30:25<80:43:10, 12.29s/it]
 38%|███▊      | 14311/37963 [44:30:34<75:43:04, 11.52s/it]
 38%|███▊      | 14312/37963 [44:30:44<72:49:44, 11.09s/it]
 38%|███▊      | 14313/37963 [44:30:54<70:45:07, 10.77s/it]
 38%|███▊      | 14314/37963 [44:31:04<68:33:02, 10.44s/it]
 38%|███▊      | 14315/37963 [44:31:14<67:30:00, 10.28s/it]
 38%|███▊      | 14316/37963 [44:31:24<67:22:22, 10.26s/it]
 38%|███▊      | 14317/37963 [44:31:40<79:01:53, 12.03s/it]
 38%|███▊      | 14318/37963 [44:31:50<75:21:21, 11.47s/it]
 38%|███▊      | 14319/37963 [44:32:01<72:28:04, 11.03s/it]
 38%|███▊      | 14320/37963 [44:32:11<70:43:09, 10.77s/it]
                                                           
{'loss': '0.158', 'grad_norm': '1.423', 'learning_rate': '1.432e-05', 'epoch': '0.3772'}

 38%|███▊      | 14320/37963 [44:32:11<70:43:09, 10.77s/it]
 38%|███▊      | 14321/37963 [44:32:21<69:19:04, 10.56s/it]
 38%|███▊      | 14322/37963 [44:32:31<68:19:06, 10.40s/it]
 38%|███▊      | 14323/37963 [44:32:41<67:31:45, 10.28s/it]
 38%|███▊      | 14324/37963 [44:32:51<67:03:03, 10.21s/it]
 38%|███▊      | 14325/37963 [44:33:07<79:07:37, 12.05s/it]
 38%|███▊      | 14326/37963 [44:33:17<75:07:36, 11.44s/it]
 38%|███▊      | 14327/37963 [44:33:27<72:20:19, 11.02s/it]
 38%|███▊      | 14328/37963 [44:33:37<70:27:50, 10.73s/it]
 38%|███▊      | 14329/37963 [44:33:47<69:15:41, 10.55s/it]
 38%|███▊      | 14330/37963 [44:33:57<67:11:11, 10.23s/it]
                                                           
{'loss': '0.1414', 'grad_norm': '1.181', 'learning_rate': '1.431e-05', 'epoch': '0.3775'}

 38%|███▊      | 14330/37963 [44:33:57<67:11:11, 10.23s/it]
 38%|███▊      | 14331/37963 [44:34:07<66:52:28, 10.19s/it]
 38%|███▊      | 14332/37963 [44:34:17<66:52:25, 10.19s/it]
 38%|███▊      | 14333/37963 [44:34:27<66:18:08, 10.10s/it]
 38%|███▊      | 14334/37963 [44:34:37<66:30:57, 10.13s/it]
 38%|███▊      | 14335/37963 [44:34:47<66:38:53, 10.15s/it]
 38%|███▊      | 14336/37963 [44:35:04<79:47:57, 12.16s/it]
 38%|███▊      | 14337/37963 [44:35:14<75:43:53, 11.54s/it]
 38%|███▊      | 14338/37963 [44:35:24<72:16:22, 11.01s/it]
 38%|███▊      | 14339/37963 [44:35:34<70:01:09, 10.67s/it]
 38%|███▊      | 14340/37963 [44:35:44<68:44:30, 10.48s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '0.9674', 'learning_rate': '1.43e-05', 'epoch': '0.3777'}

 38%|███▊      | 14340/37963 [44:35:44<68:44:30, 10.48s/it]
 38%|███▊      | 14341/37963 [44:35:54<67:58:47, 10.36s/it]
 38%|███▊      | 14342/37963 [44:36:04<66:44:19, 10.17s/it]
 38%|███▊      | 14343/37963 [44:36:14<66:48:55, 10.18s/it]
 38%|███▊      | 14344/37963 [44:36:24<66:07:01, 10.08s/it]
 38%|███▊      | 14345/37963 [44:36:34<66:07:43, 10.08s/it]
 38%|███▊      | 14346/37963 [44:36:44<65:53:18, 10.04s/it]
 38%|███▊      | 14347/37963 [44:36:54<65:42:21, 10.02s/it]
 38%|███▊      | 14348/37963 [44:37:04<65:42:01, 10.02s/it]
 38%|███▊      | 14349/37963 [44:37:14<65:45:32, 10.03s/it]
 38%|███▊      | 14350/37963 [44:37:30<78:26:39, 11.96s/it]
                                                           
{'loss': '0.1576', 'grad_norm': '3.174', 'learning_rate': '1.429e-05', 'epoch': '0.378'}

 38%|███▊      | 14350/37963 [44:37:30<78:26:39, 11.96s/it]
 38%|███▊      | 14351/37963 [44:37:41<74:50:11, 11.41s/it]
 38%|███▊      | 14352/37963 [44:37:51<72:31:13, 11.06s/it]
 38%|███▊      | 14353/37963 [44:38:01<70:33:26, 10.76s/it]
 38%|███▊      | 14354/37963 [44:38:24<94:55:05, 14.47s/it]
 38%|███▊      | 14355/37963 [44:38:47<111:20:38, 16.98s/it]
 38%|███▊      | 14356/37963 [44:38:57<97:54:45, 14.93s/it] 
 38%|███▊      | 14357/37963 [44:39:07<87:42:33, 13.38s/it]
 38%|███▊      | 14358/37963 [44:39:17<81:18:38, 12.40s/it]
 38%|███▊      | 14359/37963 [44:39:26<75:39:44, 11.54s/it]
 38%|███▊      | 14360/37963 [44:39:37<72:49:16, 11.11s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '2.148', 'learning_rate': '1.429e-05', 'epoch': '0.3783'}

 38%|███▊      | 14360/37963 [44:39:37<72:49:16, 11.11s/it]
 38%|███▊      | 14361/37963 [44:39:46<69:59:25, 10.68s/it]
 38%|███▊      | 14362/37963 [44:39:56<68:50:15, 10.50s/it]
 38%|███▊      | 14363/37963 [44:40:06<68:00:14, 10.37s/it]
 38%|███▊      | 14364/37963 [44:40:16<67:31:20, 10.30s/it]
 38%|███▊      | 14365/37963 [44:40:33<79:52:04, 12.18s/it]
 38%|███▊      | 14366/37963 [44:40:43<75:52:11, 11.57s/it]
 38%|███▊      | 14367/37963 [44:40:53<72:35:58, 11.08s/it]
 38%|███▊      | 14368/37963 [44:41:03<70:10:16, 10.71s/it]
 38%|███▊      | 14369/37963 [44:41:13<67:52:16, 10.36s/it]
 38%|███▊      | 14370/37963 [44:41:23<67:38:31, 10.32s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '1.204', 'learning_rate': '1.428e-05', 'epoch': '0.3785'}

 38%|███▊      | 14370/37963 [44:41:23<67:38:31, 10.32s/it]
 38%|███▊      | 14371/37963 [44:41:33<67:11:40, 10.25s/it]
 38%|███▊      | 14372/37963 [44:41:43<66:45:41, 10.19s/it]
 38%|███▊      | 14373/37963 [44:41:59<78:40:52, 12.01s/it]
 38%|███▊      | 14374/37963 [44:42:09<75:08:23, 11.47s/it]
 38%|███▊      | 14375/37963 [44:42:19<72:05:35, 11.00s/it]
 38%|███▊      | 14376/37963 [44:42:29<70:15:46, 10.72s/it]
 38%|███▊      | 14377/37963 [44:42:39<69:02:26, 10.54s/it]
 38%|███▊      | 14378/37963 [44:42:49<67:32:23, 10.31s/it]
 38%|███▊      | 14379/37963 [44:42:59<67:26:31, 10.29s/it]
 38%|███▊      | 14380/37963 [44:43:09<66:44:03, 10.19s/it]
                                                           
{'loss': '0.1689', 'grad_norm': '1.988', 'learning_rate': '1.427e-05', 'epoch': '0.3788'}

 38%|███▊      | 14380/37963 [44:43:09<66:44:03, 10.19s/it]
 38%|███▊      | 14381/37963 [44:43:20<66:37:14, 10.17s/it]
 38%|███▊      | 14382/37963 [44:43:30<66:16:05, 10.12s/it]
 38%|███▊      | 14383/37963 [44:43:40<66:06:43, 10.09s/it]
 38%|███▊      | 14384/37963 [44:43:50<66:00:19, 10.08s/it]
 38%|███▊      | 14385/37963 [44:44:06<78:30:15, 11.99s/it]
 38%|███▊      | 14386/37963 [44:44:16<74:43:23, 11.41s/it]
 38%|███▊      | 14387/37963 [44:44:26<72:02:21, 11.00s/it]
 38%|███▊      | 14388/37963 [44:44:36<70:10:56, 10.72s/it]
 38%|███▊      | 14389/37963 [44:44:46<69:08:36, 10.56s/it]
 38%|███▊      | 14390/37963 [44:44:57<68:22:28, 10.44s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '3.097', 'learning_rate': '1.426e-05', 'epoch': '0.3791'}

 38%|███▊      | 14390/37963 [44:44:57<68:22:28, 10.44s/it]
 38%|███▊      | 14391/37963 [44:45:06<67:02:56, 10.24s/it]
 38%|███▊      | 14392/37963 [44:45:16<66:50:22, 10.21s/it]
 38%|███▊      | 14393/37963 [44:45:26<66:09:19, 10.10s/it]
 38%|███▊      | 14394/37963 [44:45:36<65:59:26, 10.08s/it]
 38%|███▊      | 14395/37963 [44:45:46<65:39:19, 10.03s/it]
 38%|███▊      | 14396/37963 [44:45:56<65:45:47, 10.05s/it]
 38%|███▊      | 14397/37963 [44:46:06<65:21:11,  9.98s/it]
 38%|███▊      | 14398/37963 [44:46:23<78:21:45, 11.97s/it]
 38%|███▊      | 14399/37963 [44:46:33<74:29:15, 11.38s/it]
 38%|███▊      | 14400/37963 [44:46:43<71:39:40, 10.95s/it]
                                                           
{'loss': '0.1602', 'grad_norm': '1.865', 'learning_rate': '1.426e-05', 'epoch': '0.3793'}

 38%|███▊      | 14400/37963 [44:46:43<71:39:40, 10.95s/it]
 38%|███▊      | 14401/37963 [44:46:53<69:27:46, 10.61s/it]
 38%|███▊      | 14402/37963 [44:47:16<94:40:16, 14.47s/it]
 38%|███▊      | 14403/37963 [44:47:33<98:57:03, 15.12s/it]
 38%|███▊      | 14404/37963 [44:47:49<101:54:51, 15.57s/it]
 38%|███▊      | 14405/37963 [44:47:59<91:13:22, 13.94s/it] 
 38%|███▊      | 14406/37963 [44:48:09<83:33:17, 12.77s/it]
 38%|███▊      | 14407/37963 [44:48:20<78:21:24, 11.98s/it]
 38%|███▊      | 14408/37963 [44:48:29<74:03:30, 11.32s/it]
 38%|███▊      | 14409/37963 [44:48:39<70:39:32, 10.80s/it]
 38%|███▊      | 14410/37963 [44:48:49<68:24:19, 10.46s/it]
                                                           
{'loss': '0.1582', 'grad_norm': '1.883', 'learning_rate': '1.425e-05', 'epoch': '0.3796'}

 38%|███▊      | 14410/37963 [44:48:49<68:24:19, 10.46s/it]
 38%|███▊      | 14411/37963 [44:48:59<67:30:36, 10.32s/it]
 38%|███▊      | 14412/37963 [44:49:09<66:59:16, 10.24s/it]
 38%|███▊      | 14413/37963 [44:49:19<66:41:10, 10.19s/it]
 38%|███▊      | 14414/37963 [44:49:35<78:21:58, 11.98s/it]
 38%|███▊      | 14415/37963 [44:49:45<74:45:10, 11.43s/it]
 38%|███▊      | 14416/37963 [44:49:55<72:04:17, 11.02s/it]
 38%|███▊      | 14417/37963 [44:50:05<70:03:21, 10.71s/it]
 38%|███▊      | 14418/37963 [44:50:15<68:51:00, 10.53s/it]
 38%|███▊      | 14419/37963 [44:50:25<68:09:52, 10.42s/it]
 38%|███▊      | 14420/37963 [44:50:36<67:33:25, 10.33s/it]
                                                           
{'loss': '0.1694', 'grad_norm': '0.6862', 'learning_rate': '1.424e-05', 'epoch': '0.3798'}

 38%|███▊      | 14420/37963 [44:50:36<67:33:25, 10.33s/it]
 38%|███▊      | 14421/37963 [44:50:52<80:13:35, 12.27s/it]
 38%|███▊      | 14422/37963 [44:51:02<76:06:11, 11.64s/it]
 38%|███▊      | 14423/37963 [44:51:12<72:35:40, 11.10s/it]
 38%|███▊      | 14424/37963 [44:51:22<70:31:19, 10.79s/it]
 38%|███▊      | 14425/37963 [44:51:32<69:02:53, 10.56s/it]
 38%|███▊      | 14426/37963 [44:51:43<68:09:55, 10.43s/it]
 38%|███▊      | 14427/37963 [44:51:53<67:26:11, 10.31s/it]
 38%|███▊      | 14428/37963 [44:52:02<66:31:24, 10.18s/it]
 38%|███▊      | 14429/37963 [44:52:12<65:56:41, 10.09s/it]
 38%|███▊      | 14430/37963 [44:52:22<66:00:21, 10.10s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '3.483', 'learning_rate': '1.423e-05', 'epoch': '0.3801'}

 38%|███▊      | 14430/37963 [44:52:22<66:00:21, 10.10s/it]
 38%|███▊      | 14431/37963 [44:52:33<66:02:13, 10.10s/it]
 38%|███▊      | 14432/37963 [44:52:43<65:56:22, 10.09s/it]
 38%|███▊      | 14433/37963 [44:53:00<79:27:44, 12.16s/it]
 38%|███▊      | 14434/37963 [44:53:09<74:58:24, 11.47s/it]
 38%|███▊      | 14435/37963 [44:53:20<72:18:39, 11.06s/it]
 38%|███▊      | 14436/37963 [44:53:30<70:23:15, 10.77s/it]
 38%|███▊      | 14437/37963 [44:53:40<68:57:48, 10.55s/it]
 38%|███▊      | 14438/37963 [44:53:50<68:11:05, 10.43s/it]
 38%|███▊      | 14439/37963 [44:54:00<67:05:57, 10.27s/it]
 38%|███▊      | 14440/37963 [44:54:10<66:41:03, 10.21s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '1.31', 'learning_rate': '1.422e-05', 'epoch': '0.3804'}

 38%|███▊      | 14440/37963 [44:54:10<66:41:03, 10.21s/it]
 38%|███▊      | 14441/37963 [44:54:20<66:08:53, 10.12s/it]
 38%|███▊      | 14442/37963 [44:54:30<66:15:45, 10.14s/it]
 38%|███▊      | 14443/37963 [44:54:40<66:17:56, 10.15s/it]
 38%|███▊      | 14444/37963 [44:54:50<65:49:59, 10.08s/it]
 38%|███▊      | 14445/37963 [44:55:00<65:51:37, 10.08s/it]
 38%|███▊      | 14446/37963 [44:55:17<78:21:07, 11.99s/it]
 38%|███▊      | 14447/37963 [44:55:27<74:51:39, 11.46s/it]
 38%|███▊      | 14448/37963 [44:55:43<83:33:43, 12.79s/it]
 38%|███▊      | 14449/37963 [44:55:53<78:09:55, 11.97s/it]
 38%|███▊      | 14450/37963 [44:56:09<87:17:36, 13.37s/it]
                                                           
{'loss': '0.1618', 'grad_norm': '2.288', 'learning_rate': '1.422e-05', 'epoch': '0.3806'}

 38%|███▊      | 14450/37963 [44:56:09<87:17:36, 13.37s/it]
 38%|███▊      | 14451/37963 [44:56:19<80:16:07, 12.29s/it]
 38%|███▊      | 14452/37963 [44:56:29<75:54:39, 11.62s/it]
 38%|███▊      | 14453/37963 [44:56:46<85:11:27, 13.04s/it]
 38%|███▊      | 14454/37963 [44:56:56<79:27:06, 12.17s/it]
 38%|███▊      | 14455/37963 [44:57:06<75:23:19, 11.54s/it]
 38%|███▊      | 14456/37963 [44:57:16<72:26:24, 11.09s/it]
 38%|███▊      | 14457/37963 [44:57:26<70:23:04, 10.78s/it]
 38%|███▊      | 14458/37963 [44:57:36<68:43:55, 10.53s/it]
 38%|███▊      | 14459/37963 [44:57:46<67:49:25, 10.39s/it]
 38%|███▊      | 14460/37963 [44:57:56<67:17:42, 10.31s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '1.723', 'learning_rate': '1.421e-05', 'epoch': '0.3809'}

 38%|███▊      | 14460/37963 [44:57:56<67:17:42, 10.31s/it]
 38%|███▊      | 14461/37963 [44:58:06<67:10:29, 10.29s/it]
 38%|███▊      | 14462/37963 [44:58:16<66:45:21, 10.23s/it]
 38%|███▊      | 14463/37963 [44:58:26<66:23:41, 10.17s/it]
 38%|███▊      | 14464/37963 [44:58:43<79:30:35, 12.18s/it]
 38%|███▊      | 14465/37963 [44:58:53<75:29:31, 11.57s/it]
 38%|███▊      | 14466/37963 [44:59:03<72:36:34, 11.12s/it]
 38%|███▊      | 14467/37963 [44:59:13<69:51:55, 10.70s/it]
 38%|███▊      | 14468/37963 [44:59:23<68:34:41, 10.51s/it]
 38%|███▊      | 14469/37963 [44:59:33<67:45:56, 10.38s/it]
 38%|███▊      | 14470/37963 [44:59:49<79:10:19, 12.13s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '3.112', 'learning_rate': '1.42e-05', 'epoch': '0.3812'}

 38%|███▊      | 14470/37963 [44:59:49<79:10:19, 12.13s/it]
 38%|███▊      | 14471/37963 [44:59:59<74:12:27, 11.37s/it]
 38%|███▊      | 14472/37963 [45:00:09<71:38:02, 10.98s/it]
 38%|███▊      | 14473/37963 [45:00:19<70:02:19, 10.73s/it]
 38%|███▊      | 14474/37963 [45:00:29<68:45:51, 10.54s/it]
 38%|███▊      | 14475/37963 [45:00:39<67:47:03, 10.39s/it]
 38%|███▊      | 14476/37963 [45:00:50<67:10:44, 10.30s/it]
 38%|███▊      | 14477/37963 [45:01:00<66:40:44, 10.22s/it]
 38%|███▊      | 14478/37963 [45:01:09<65:55:08, 10.10s/it]
 38%|███▊      | 14479/37963 [45:01:19<65:55:20, 10.11s/it]
 38%|███▊      | 14480/37963 [45:01:36<79:18:52, 12.16s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '1.323', 'learning_rate': '1.419e-05', 'epoch': '0.3814'}

 38%|███▊      | 14480/37963 [45:01:36<79:18:52, 12.16s/it]
 38%|███▊      | 14481/37963 [45:01:46<75:10:07, 11.52s/it]
 38%|███▊      | 14482/37963 [45:01:57<72:24:45, 11.10s/it]
 38%|███▊      | 14483/37963 [45:02:07<70:29:25, 10.81s/it]
 38%|███▊      | 14484/37963 [45:02:16<68:15:51, 10.47s/it]
 38%|███▊      | 14485/37963 [45:02:27<67:37:20, 10.37s/it]
 38%|███▊      | 14486/37963 [45:02:37<67:04:21, 10.29s/it]
 38%|███▊      | 14487/37963 [45:02:47<66:38:36, 10.22s/it]
 38%|███▊      | 14488/37963 [45:02:57<66:08:22, 10.14s/it]
 38%|███▊      | 14489/37963 [45:03:07<65:56:48, 10.11s/it]
 38%|███▊      | 14490/37963 [45:03:17<66:00:11, 10.12s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '1.395', 'learning_rate': '1.419e-05', 'epoch': '0.3817'}

 38%|███▊      | 14490/37963 [45:03:17<66:00:11, 10.12s/it]
 38%|███▊      | 14491/37963 [45:03:27<66:02:32, 10.13s/it]
 38%|███▊      | 14492/37963 [45:03:43<77:56:25, 11.95s/it]
 38%|███▊      | 14493/37963 [45:03:53<74:19:59, 11.40s/it]
 38%|███▊      | 14494/37963 [45:04:03<71:16:53, 10.93s/it]
 38%|███▊      | 14495/37963 [45:04:13<69:40:05, 10.69s/it]
 38%|███▊      | 14496/37963 [45:04:30<81:11:47, 12.46s/it]
 38%|███▊      | 14497/37963 [45:04:47<90:02:34, 13.81s/it]
 38%|███▊      | 14498/37963 [45:05:03<95:09:14, 14.60s/it]
 38%|███▊      | 14499/37963 [45:05:13<86:17:18, 13.24s/it]
 38%|███▊      | 14500/37963 [45:05:23<79:17:08, 12.17s/it]
                                                           
{'loss': '0.154', 'grad_norm': '4.205', 'learning_rate': '1.418e-05', 'epoch': '0.382'}

 38%|███▊      | 14500/37963 [45:05:23<79:17:08, 12.17s/it]
 38%|███▊      | 14501/37963 [45:05:40<88:03:04, 13.51s/it]
 38%|███▊      | 14502/37963 [45:05:50<81:28:59, 12.50s/it]
 38%|███▊      | 14503/37963 [45:06:00<76:03:55, 11.67s/it]
 38%|███▊      | 14504/37963 [45:06:09<71:52:03, 11.03s/it]
 38%|███▊      | 14505/37963 [45:06:19<70:11:41, 10.77s/it]
 38%|███▊      | 14506/37963 [45:06:29<68:45:15, 10.55s/it]
 38%|███▊      | 14507/37963 [45:06:39<67:16:35, 10.33s/it]
 38%|███▊      | 14508/37963 [45:06:49<66:55:46, 10.27s/it]
 38%|███▊      | 14509/37963 [45:06:59<66:28:52, 10.20s/it]
 38%|███▊      | 14510/37963 [45:07:09<66:06:05, 10.15s/it]
                                                           
{'loss': '0.1498', 'grad_norm': '5.702', 'learning_rate': '1.417e-05', 'epoch': '0.3822'}

 38%|███▊      | 14510/37963 [45:07:09<66:06:05, 10.15s/it]
 38%|███▊      | 14511/37963 [45:07:19<65:55:40, 10.12s/it]
 38%|███▊      | 14512/37963 [45:07:36<78:11:30, 12.00s/it]
 38%|███▊      | 14513/37963 [45:07:46<73:58:38, 11.36s/it]
 38%|███▊      | 14514/37963 [45:07:56<71:10:40, 10.93s/it]
 38%|███▊      | 14515/37963 [45:08:05<68:50:37, 10.57s/it]
 38%|███▊      | 14516/37963 [45:08:15<67:22:02, 10.34s/it]
 38%|███▊      | 14517/37963 [45:08:25<66:52:51, 10.27s/it]
 38%|███▊      | 14518/37963 [45:08:35<66:39:52, 10.24s/it]
 38%|███▊      | 14519/37963 [45:08:52<78:25:30, 12.04s/it]
 38%|███▊      | 14520/37963 [45:09:02<74:34:17, 11.45s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '2.64', 'learning_rate': '1.416e-05', 'epoch': '0.3825'}

 38%|███▊      | 14520/37963 [45:09:02<74:34:17, 11.45s/it]
 38%|███▊      | 14521/37963 [45:09:12<71:28:36, 10.98s/it]
 38%|███▊      | 14522/37963 [45:09:22<69:38:13, 10.69s/it]
 38%|███▊      | 14523/37963 [45:09:32<68:19:41, 10.49s/it]
 38%|███▊      | 14524/37963 [45:09:41<67:11:35, 10.32s/it]
 38%|███▊      | 14525/37963 [45:09:52<66:39:26, 10.24s/it]
 38%|███▊      | 14526/37963 [45:10:08<78:50:50, 12.11s/it]
 38%|███▊      | 14527/37963 [45:10:18<74:59:39, 11.52s/it]
 38%|███▊      | 14528/37963 [45:10:28<72:18:17, 11.11s/it]
 38%|███▊      | 14529/37963 [45:10:38<70:15:43, 10.79s/it]
 38%|███▊      | 14530/37963 [45:10:48<68:56:27, 10.59s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '2.346', 'learning_rate': '1.415e-05', 'epoch': '0.3827'}

 38%|███▊      | 14530/37963 [45:10:48<68:56:27, 10.59s/it]
 38%|███▊      | 14531/37963 [45:10:59<67:53:20, 10.43s/it]
 38%|███▊      | 14532/37963 [45:11:08<66:33:27, 10.23s/it]
 38%|███▊      | 14533/37963 [45:11:18<66:20:57, 10.19s/it]
 38%|███▊      | 14534/37963 [45:11:28<65:58:12, 10.14s/it]
 38%|███▊      | 14535/37963 [45:11:38<65:28:47, 10.06s/it]
 38%|███▊      | 14536/37963 [45:11:48<65:37:36, 10.08s/it]
 38%|███▊      | 14537/37963 [45:11:58<65:29:27, 10.06s/it]
 38%|███▊      | 14538/37963 [45:12:08<64:51:42,  9.97s/it]
 38%|███▊      | 14539/37963 [45:12:18<65:03:38, 10.00s/it]
 38%|███▊      | 14540/37963 [45:12:35<77:22:38, 11.89s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '0.9004', 'learning_rate': '1.415e-05', 'epoch': '0.383'}

 38%|███▊      | 14540/37963 [45:12:35<77:22:38, 11.89s/it]
 38%|███▊      | 14541/37963 [45:12:44<73:08:22, 11.24s/it]
 38%|███▊      | 14542/37963 [45:12:54<70:23:26, 10.82s/it]
 38%|███▊      | 14543/37963 [45:13:04<68:53:54, 10.59s/it]
 38%|███▊      | 14544/37963 [45:13:21<80:27:16, 12.37s/it]
 38%|███▊      | 14545/37963 [45:13:37<88:36:30, 13.62s/it]
 38%|███▊      | 14546/37963 [45:13:54<95:18:29, 14.65s/it]
 38%|███▊      | 14547/37963 [45:14:04<86:25:45, 13.29s/it]
 38%|███▊      | 14548/37963 [45:14:15<80:17:21, 12.34s/it]
 38%|███▊      | 14549/37963 [45:14:31<88:10:12, 13.56s/it]
 38%|███▊      | 14550/37963 [45:14:41<81:34:00, 12.54s/it]
                                                           
{'loss': '0.175', 'grad_norm': '0.7988', 'learning_rate': '1.414e-05', 'epoch': '0.3833'}

 38%|███▊      | 14550/37963 [45:14:41<81:34:00, 12.54s/it]
 38%|███▊      | 14551/37963 [45:14:51<75:34:04, 11.62s/it]
 38%|███▊      | 14552/37963 [45:15:01<72:35:40, 11.16s/it]
 38%|███▊      | 14553/37963 [45:15:11<70:24:20, 10.83s/it]
 38%|███▊      | 14554/37963 [45:15:21<68:57:40, 10.61s/it]
 38%|███▊      | 14555/37963 [45:15:31<67:50:09, 10.43s/it]
 38%|███▊      | 14556/37963 [45:15:41<67:01:39, 10.31s/it]
 38%|███▊      | 14557/37963 [45:15:51<66:34:33, 10.24s/it]
 38%|███▊      | 14558/37963 [45:16:01<65:59:46, 10.15s/it]
 38%|███▊      | 14559/37963 [45:16:11<65:28:11, 10.07s/it]
 38%|███▊      | 14560/37963 [45:16:27<77:49:27, 11.97s/it]
                                                           
{'loss': '0.1873', 'grad_norm': '1.599', 'learning_rate': '1.413e-05', 'epoch': '0.3835'}

 38%|███▊      | 14560/37963 [45:16:27<77:49:27, 11.97s/it]
 38%|███▊      | 14561/37963 [45:16:37<73:51:43, 11.36s/it]
 38%|███▊      | 14562/37963 [45:16:47<71:20:25, 10.97s/it]
 38%|███▊      | 14563/37963 [45:16:57<69:38:00, 10.71s/it]
 38%|███▊      | 14564/37963 [45:17:07<68:34:27, 10.55s/it]
 38%|███▊      | 14565/37963 [45:17:18<67:56:13, 10.45s/it]
 38%|███▊      | 14566/37963 [45:17:27<66:33:33, 10.24s/it]
 38%|███▊      | 14567/37963 [45:17:44<78:30:34, 12.08s/it]
 38%|███▊      | 14568/37963 [45:17:54<74:28:36, 11.46s/it]
 38%|███▊      | 14569/37963 [45:18:04<72:04:51, 11.09s/it]
 38%|███▊      | 14570/37963 [45:18:14<70:02:35, 10.78s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '0.9367', 'learning_rate': '1.412e-05', 'epoch': '0.3838'}

 38%|███▊      | 14570/37963 [45:18:14<70:02:35, 10.78s/it]
 38%|███▊      | 14571/37963 [45:18:24<68:43:22, 10.58s/it]
 38%|███▊      | 14572/37963 [45:18:34<67:42:39, 10.42s/it]
 38%|███▊      | 14573/37963 [45:18:44<67:02:36, 10.32s/it]
 38%|███▊      | 14574/37963 [45:19:02<80:30:27, 12.39s/it]
 38%|███▊      | 14575/37963 [45:19:12<75:58:38, 11.69s/it]
 38%|███▊      | 14576/37963 [45:19:22<72:58:36, 11.23s/it]
 38%|███▊      | 14577/37963 [45:19:32<70:40:55, 10.88s/it]
 38%|███▊      | 14578/37963 [45:19:42<69:08:56, 10.65s/it]
 38%|███▊      | 14579/37963 [45:19:52<68:06:05, 10.48s/it]
 38%|███▊      | 14580/37963 [45:20:02<66:55:58, 10.30s/it]
                                                           
{'loss': '0.1702', 'grad_norm': '1.692', 'learning_rate': '1.412e-05', 'epoch': '0.3841'}

 38%|███▊      | 14580/37963 [45:20:02<66:55:58, 10.30s/it]
 38%|███▊      | 14581/37963 [45:20:12<66:04:59, 10.17s/it]
 38%|███▊      | 14582/37963 [45:20:22<65:59:24, 10.16s/it]
 38%|███▊      | 14583/37963 [45:20:32<66:09:48, 10.19s/it]
 38%|███▊      | 14584/37963 [45:20:42<66:02:12, 10.17s/it]
 38%|███▊      | 14585/37963 [45:20:52<65:59:52, 10.16s/it]
 38%|███▊      | 14586/37963 [45:21:03<65:49:03, 10.14s/it]
 38%|███▊      | 14587/37963 [45:21:13<65:37:57, 10.11s/it]
 38%|███▊      | 14588/37963 [45:21:23<65:35:44, 10.10s/it]
 38%|███▊      | 14589/37963 [45:21:39<77:13:31, 11.89s/it]
 38%|███▊      | 14590/37963 [45:21:49<73:40:48, 11.35s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '4.726', 'learning_rate': '1.411e-05', 'epoch': '0.3843'}

 38%|███▊      | 14590/37963 [45:21:49<73:40:48, 11.35s/it]
 38%|███▊      | 14591/37963 [45:21:59<71:12:37, 10.97s/it]
 38%|███▊      | 14592/37963 [45:22:09<69:38:09, 10.73s/it]
 38%|███▊      | 14593/37963 [45:22:32<93:00:05, 14.33s/it]
 38%|███▊      | 14594/37963 [45:22:42<84:43:45, 13.05s/it]
 38%|███▊      | 14595/37963 [45:22:52<78:31:02, 12.10s/it]
 38%|███▊      | 14596/37963 [45:23:02<74:43:28, 11.51s/it]
 38%|███▊      | 14597/37963 [45:23:19<84:44:08, 13.06s/it]
 38%|███▊      | 14598/37963 [45:23:29<79:08:38, 12.19s/it]
 38%|███▊      | 14599/37963 [45:23:39<75:01:30, 11.56s/it]
 38%|███▊      | 14600/37963 [45:23:49<72:07:29, 11.11s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '3.401', 'learning_rate': '1.41e-05', 'epoch': '0.3846'}

 38%|███▊      | 14600/37963 [45:23:49<72:07:29, 11.11s/it]
 38%|███▊      | 14601/37963 [45:23:59<70:09:56, 10.81s/it]
 38%|███▊      | 14602/37963 [45:24:09<68:14:28, 10.52s/it]
 38%|███▊      | 14603/37963 [45:24:19<67:07:10, 10.34s/it]
 38%|███▊      | 14604/37963 [45:24:28<65:39:25, 10.12s/it]
 38%|███▊      | 14605/37963 [45:24:38<65:19:31, 10.07s/it]
 38%|███▊      | 14606/37963 [45:24:54<77:09:40, 11.89s/it]
 38%|███▊      | 14607/37963 [45:25:04<73:29:38, 11.33s/it]
 38%|███▊      | 14608/37963 [45:25:14<70:39:42, 10.89s/it]
 38%|███▊      | 14609/37963 [45:25:24<69:06:46, 10.65s/it]
 38%|███▊      | 14610/37963 [45:25:34<67:44:41, 10.44s/it]
                                                           
{'loss': '0.1595', 'grad_norm': '0.951', 'learning_rate': '1.409e-05', 'epoch': '0.3848'}

 38%|███▊      | 14610/37963 [45:25:34<67:44:41, 10.44s/it]
 38%|███▊      | 14611/37963 [45:25:44<67:01:45, 10.33s/it]
 38%|███▊      | 14612/37963 [45:25:55<66:40:34, 10.28s/it]
 38%|███▊      | 14613/37963 [45:26:04<65:28:08, 10.09s/it]
 38%|███▊      | 14614/37963 [45:26:14<65:22:32, 10.08s/it]
 38%|███▊      | 14615/37963 [45:26:30<76:46:46, 11.84s/it]
 39%|███▊      | 14616/37963 [45:26:40<73:26:40, 11.32s/it]
 39%|███▊      | 14617/37963 [45:26:50<71:00:15, 10.95s/it]
 39%|███▊      | 14618/37963 [45:27:00<68:30:40, 10.57s/it]
 39%|███▊      | 14619/37963 [45:27:10<67:11:14, 10.36s/it]
 39%|███▊      | 14620/37963 [45:27:20<66:11:47, 10.21s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '1.88', 'learning_rate': '1.408e-05', 'epoch': '0.3851'}

 39%|███▊      | 14620/37963 [45:27:20<66:11:47, 10.21s/it]
 39%|███▊      | 14621/37963 [45:27:36<78:14:04, 12.07s/it]
 39%|███▊      | 14622/37963 [45:27:46<74:40:08, 11.52s/it]
 39%|███▊      | 14623/37963 [45:27:57<71:59:20, 11.10s/it]
 39%|███▊      | 14624/37963 [45:28:07<70:06:52, 10.82s/it]
 39%|███▊      | 14625/37963 [45:28:17<68:44:04, 10.60s/it]
 39%|███▊      | 14626/37963 [45:28:27<67:43:23, 10.45s/it]
 39%|███▊      | 14627/37963 [45:28:37<66:58:52, 10.33s/it]
 39%|███▊      | 14628/37963 [45:28:47<65:26:22, 10.10s/it]
 39%|███▊      | 14629/37963 [45:28:57<65:33:31, 10.11s/it]
 39%|███▊      | 14630/37963 [45:29:07<65:20:21, 10.08s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '1.703', 'learning_rate': '1.408e-05', 'epoch': '0.3854'}

 39%|███▊      | 14630/37963 [45:29:07<65:20:21, 10.08s/it]
 39%|███▊      | 14631/37963 [45:29:16<64:39:13,  9.98s/it]
 39%|███▊      | 14632/37963 [45:29:27<65:00:24, 10.03s/it]
 39%|███▊      | 14633/37963 [45:29:37<64:59:34, 10.03s/it]
 39%|███▊      | 14634/37963 [45:29:47<65:09:13, 10.05s/it]
 39%|███▊      | 14635/37963 [45:29:57<65:02:52, 10.04s/it]
 39%|███▊      | 14636/37963 [45:30:07<65:08:21, 10.05s/it]
 39%|███▊      | 14637/37963 [45:30:17<65:05:55, 10.05s/it]
 39%|███▊      | 14638/37963 [45:30:33<77:29:54, 11.96s/it]
 39%|███▊      | 14639/37963 [45:30:50<86:23:39, 13.33s/it]
 39%|███▊      | 14640/37963 [45:31:00<80:00:45, 12.35s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '0.8113', 'learning_rate': '1.407e-05', 'epoch': '0.3856'}

 39%|███▊      | 14640/37963 [45:31:00<80:00:45, 12.35s/it]
 39%|███▊      | 14641/37963 [45:31:17<89:11:09, 13.77s/it]
 39%|███▊      | 14642/37963 [45:31:27<82:00:33, 12.66s/it]
 39%|███▊      | 14643/37963 [45:31:44<90:19:12, 13.94s/it]
 39%|███▊      | 14644/37963 [45:31:54<82:26:24, 12.73s/it]
 39%|███▊      | 14645/37963 [45:32:11<90:10:15, 13.92s/it]
 39%|███▊      | 14646/37963 [45:32:21<82:56:13, 12.80s/it]
 39%|███▊      | 14647/37963 [45:32:31<78:01:16, 12.05s/it]
 39%|███▊      | 14648/37963 [45:32:41<74:11:14, 11.46s/it]
 39%|███▊      | 14649/37963 [45:32:51<71:05:54, 10.98s/it]
 39%|███▊      | 14650/37963 [45:33:01<69:03:15, 10.66s/it]
                                                           
{'loss': '0.1679', 'grad_norm': '2.048', 'learning_rate': '1.406e-05', 'epoch': '0.3859'}

 39%|███▊      | 14650/37963 [45:33:01<69:03:15, 10.66s/it]
 39%|███▊      | 14651/37963 [45:33:11<67:38:07, 10.44s/it]
 39%|███▊      | 14652/37963 [45:33:21<66:57:10, 10.34s/it]
 39%|███▊      | 14653/37963 [45:33:31<65:43:42, 10.15s/it]
 39%|███▊      | 14654/37963 [45:33:41<65:32:50, 10.12s/it]
 39%|███▊      | 14655/37963 [45:33:57<78:13:01, 12.08s/it]
 39%|███▊      | 14656/37963 [45:34:08<74:42:28, 11.54s/it]
 39%|███▊      | 14657/37963 [45:34:18<71:58:17, 11.12s/it]
 39%|███▊      | 14658/37963 [45:34:28<70:05:41, 10.83s/it]
 39%|███▊      | 14659/37963 [45:34:38<68:33:08, 10.59s/it]
 39%|███▊      | 14660/37963 [45:34:48<67:31:26, 10.43s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '2.047', 'learning_rate': '1.405e-05', 'epoch': '0.3862'}

 39%|███▊      | 14660/37963 [45:34:48<67:31:26, 10.43s/it]
 39%|███▊      | 14661/37963 [45:34:58<66:44:45, 10.31s/it]
 39%|███▊      | 14662/37963 [45:35:08<65:56:06, 10.19s/it]
 39%|███▊      | 14663/37963 [45:35:18<65:34:44, 10.13s/it]
 39%|███▊      | 14664/37963 [45:35:35<78:14:23, 12.09s/it]
 39%|███▊      | 14665/37963 [45:35:45<74:26:51, 11.50s/it]
 39%|███▊      | 14666/37963 [45:35:55<71:25:49, 11.04s/it]
 39%|███▊      | 14667/37963 [45:36:05<69:25:22, 10.73s/it]
 39%|███▊      | 14668/37963 [45:36:15<67:54:27, 10.49s/it]
 39%|███▊      | 14669/37963 [45:36:25<67:13:24, 10.39s/it]
 39%|███▊      | 14670/37963 [45:36:35<66:37:00, 10.30s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '1.903', 'learning_rate': '1.405e-05', 'epoch': '0.3864'}

 39%|███▊      | 14670/37963 [45:36:35<66:37:00, 10.30s/it]
 39%|███▊      | 14671/37963 [45:36:52<79:42:52, 12.32s/it]
 39%|███▊      | 14672/37963 [45:37:02<75:32:17, 11.68s/it]
 39%|███▊      | 14673/37963 [45:37:12<72:15:36, 11.17s/it]
 39%|███▊      | 14674/37963 [45:37:22<70:14:02, 10.86s/it]
 39%|███▊      | 14675/37963 [45:37:32<68:43:40, 10.62s/it]
 39%|███▊      | 14676/37963 [45:37:42<67:48:52, 10.48s/it]
 39%|███▊      | 14677/37963 [45:37:52<66:29:58, 10.28s/it]
 39%|███▊      | 14678/37963 [45:38:02<65:32:13, 10.13s/it]
 39%|███▊      | 14679/37963 [45:38:12<65:21:57, 10.11s/it]
 39%|███▊      | 14680/37963 [45:38:22<65:20:37, 10.10s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '1.239', 'learning_rate': '1.404e-05', 'epoch': '0.3867'}

 39%|███▊      | 14680/37963 [45:38:22<65:20:37, 10.10s/it]
 39%|███▊      | 14681/37963 [45:38:32<64:50:22, 10.03s/it]
 39%|███▊      | 14682/37963 [45:38:42<65:04:32, 10.06s/it]
 39%|███▊      | 14683/37963 [45:38:52<65:12:58, 10.09s/it]
 39%|███▊      | 14684/37963 [45:39:02<65:16:38, 10.09s/it]
 39%|███▊      | 14685/37963 [45:39:12<64:46:06, 10.02s/it]
 39%|███▊      | 14686/37963 [45:39:29<77:13:57, 11.94s/it]
 39%|███▊      | 14687/37963 [45:39:45<85:43:43, 13.26s/it]
 39%|███▊      | 14688/37963 [45:39:55<79:26:06, 12.29s/it]
 39%|███▊      | 14689/37963 [45:40:11<87:01:28, 13.46s/it]
 39%|███▊      | 14690/37963 [45:40:21<80:36:40, 12.47s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '1.787', 'learning_rate': '1.403e-05', 'epoch': '0.387'}

 39%|███▊      | 14690/37963 [45:40:21<80:36:40, 12.47s/it]
 39%|███▊      | 14691/37963 [45:40:32<75:59:47, 11.76s/it]
 39%|███▊      | 14692/37963 [45:40:48<85:28:50, 13.22s/it]
 39%|███▊      | 14693/37963 [45:40:58<79:29:47, 12.30s/it]
 39%|███▊      | 14694/37963 [45:41:15<88:24:20, 13.68s/it]
 39%|███▊      | 14695/37963 [45:41:25<81:06:58, 12.55s/it]
 39%|███▊      | 14696/37963 [45:41:35<75:35:03, 11.69s/it]
 39%|███▊      | 14697/37963 [45:41:45<72:39:25, 11.24s/it]
 39%|███▊      | 14698/37963 [45:41:55<70:17:11, 10.88s/it]
 39%|███▊      | 14699/37963 [45:42:05<68:15:47, 10.56s/it]
 39%|███▊      | 14700/37963 [45:42:15<67:15:59, 10.41s/it]
                                                           
{'loss': '0.148', 'grad_norm': '1.707', 'learning_rate': '1.402e-05', 'epoch': '0.3872'}

 39%|███▊      | 14700/37963 [45:42:15<67:15:59, 10.41s/it]
 39%|███▊      | 14701/37963 [45:42:25<66:39:00, 10.31s/it]
 39%|███▊      | 14702/37963 [45:42:35<66:15:45, 10.26s/it]
 39%|███▊      | 14703/37963 [45:42:51<77:26:57, 11.99s/it]
 39%|███▊      | 14704/37963 [45:43:01<74:01:50, 11.46s/it]
 39%|███▊      | 14705/37963 [45:43:11<71:19:13, 11.04s/it]
 39%|███▊      | 14706/37963 [45:43:22<69:47:54, 10.80s/it]
 39%|███▊      | 14707/37963 [45:43:32<68:39:38, 10.63s/it]
 39%|███▊      | 14708/37963 [45:43:42<67:18:15, 10.42s/it]
 39%|███▊      | 14709/37963 [45:43:52<66:41:23, 10.32s/it]
 39%|███▊      | 14710/37963 [45:44:02<66:09:32, 10.24s/it]
                                                           
{'loss': '0.1644', 'grad_norm': '1.194', 'learning_rate': '1.401e-05', 'epoch': '0.3875'}

 39%|███▊      | 14710/37963 [45:44:02<66:09:32, 10.24s/it]
 39%|███▉      | 14711/37963 [45:44:12<65:51:51, 10.20s/it]
 39%|███▉      | 14712/37963 [45:44:22<65:37:22, 10.16s/it]
 39%|███▉      | 14713/37963 [45:44:39<78:09:03, 12.10s/it]
 39%|███▉      | 14714/37963 [45:44:49<74:24:20, 11.52s/it]
 39%|███▉      | 14715/37963 [45:44:59<71:04:44, 11.01s/it]
 39%|███▉      | 14716/37963 [45:45:08<68:30:18, 10.61s/it]
 39%|███▉      | 14717/37963 [45:45:19<67:26:35, 10.44s/it]
 39%|███▉      | 14718/37963 [45:45:29<66:41:08, 10.33s/it]
 39%|███▉      | 14719/37963 [45:45:46<80:04:41, 12.40s/it]
 39%|███▉      | 14720/37963 [45:45:56<75:35:58, 11.71s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '2.773', 'learning_rate': '1.401e-05', 'epoch': '0.3877'}

 39%|███▉      | 14720/37963 [45:45:56<75:35:58, 11.71s/it]
 39%|███▉      | 14721/37963 [45:46:06<72:15:13, 11.19s/it]
 39%|███▉      | 14722/37963 [45:46:16<70:09:34, 10.87s/it]
 39%|███▉      | 14723/37963 [45:46:26<68:09:14, 10.56s/it]
 39%|███▉      | 14724/37963 [45:46:36<66:34:02, 10.31s/it]
 39%|███▉      | 14725/37963 [45:46:46<66:09:26, 10.25s/it]
 39%|███▉      | 14726/37963 [45:46:56<66:03:05, 10.23s/it]
 39%|███▉      | 14727/37963 [45:47:06<65:08:22, 10.09s/it]
 39%|███▉      | 14728/37963 [45:47:16<65:06:52, 10.09s/it]
 39%|███▉      | 14729/37963 [45:47:25<64:20:45,  9.97s/it]
 39%|███▉      | 14730/37963 [45:47:35<64:26:50,  9.99s/it]
                                                           
{'loss': '0.162', 'grad_norm': '2.944', 'learning_rate': '1.4e-05', 'epoch': '0.388'}

 39%|███▉      | 14730/37963 [45:47:35<64:26:50,  9.99s/it]
 39%|███▉      | 14731/37963 [45:47:45<64:25:23,  9.98s/it]
 39%|███▉      | 14732/37963 [45:48:02<76:48:00, 11.90s/it]
 39%|███▉      | 14733/37963 [45:48:12<73:03:06, 11.32s/it]
 39%|███▉      | 14734/37963 [45:48:22<70:11:14, 10.88s/it]
 39%|███▉      | 14735/37963 [45:48:32<68:35:56, 10.63s/it]
 39%|███▉      | 14736/37963 [45:48:48<79:29:21, 12.32s/it]
 39%|███▉      | 14737/37963 [45:48:58<74:52:36, 11.61s/it]
 39%|███▉      | 14738/37963 [45:49:15<84:42:51, 13.13s/it]
 39%|███▉      | 14739/37963 [45:49:25<78:36:33, 12.19s/it]
 39%|███▉      | 14740/37963 [45:49:35<74:39:50, 11.57s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '2.521', 'learning_rate': '1.399e-05', 'epoch': '0.3883'}

 39%|███▉      | 14740/37963 [45:49:35<74:39:50, 11.57s/it]
 39%|███▉      | 14741/37963 [45:49:45<71:49:05, 11.13s/it]
 39%|███▉      | 14742/37963 [45:50:01<81:42:22, 12.67s/it]
 39%|███▉      | 14743/37963 [45:50:11<76:46:14, 11.90s/it]
 39%|███▉      | 14744/37963 [45:50:28<86:48:57, 13.46s/it]
 39%|███▉      | 14745/37963 [45:50:38<80:23:19, 12.46s/it]
 39%|███▉      | 14746/37963 [45:50:48<74:59:55, 11.63s/it]
 39%|███▉      | 14747/37963 [45:50:58<72:07:07, 11.18s/it]
 39%|███▉      | 14748/37963 [45:51:08<69:16:33, 10.74s/it]
 39%|███▉      | 14749/37963 [45:51:18<68:11:48, 10.58s/it]
 39%|███▉      | 14750/37963 [45:51:28<67:13:03, 10.42s/it]
                                                           
{'loss': '0.1771', 'grad_norm': '0.9936', 'learning_rate': '1.398e-05', 'epoch': '0.3885'}

 39%|███▉      | 14750/37963 [45:51:28<67:13:03, 10.42s/it]
 39%|███▉      | 14751/37963 [45:51:38<66:29:04, 10.31s/it]
 39%|███▉      | 14752/37963 [45:51:55<78:28:30, 12.17s/it]
 39%|███▉      | 14753/37963 [45:52:05<74:20:47, 11.53s/it]
 39%|███▉      | 14754/37963 [45:52:14<70:47:35, 10.98s/it]
 39%|███▉      | 14755/37963 [45:52:25<68:59:42, 10.70s/it]
 39%|███▉      | 14756/37963 [45:52:35<67:56:09, 10.54s/it]
 39%|███▉      | 14757/37963 [45:52:45<67:01:30, 10.40s/it]
 39%|███▉      | 14758/37963 [45:52:55<66:21:31, 10.29s/it]
 39%|███▉      | 14759/37963 [45:53:05<65:54:15, 10.22s/it]
 39%|███▉      | 14760/37963 [45:53:15<65:37:12, 10.18s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '3.609', 'learning_rate': '1.398e-05', 'epoch': '0.3888'}

 39%|███▉      | 14760/37963 [45:53:15<65:37:12, 10.18s/it]
 39%|███▉      | 14761/37963 [45:53:31<77:47:10, 12.07s/it]
 39%|███▉      | 14762/37963 [45:53:42<73:57:51, 11.48s/it]
 39%|███▉      | 14763/37963 [45:53:52<71:12:50, 11.05s/it]
 39%|███▉      | 14764/37963 [45:54:02<69:27:18, 10.78s/it]
 39%|███▉      | 14765/37963 [45:54:12<68:20:05, 10.60s/it]
 39%|███▉      | 14766/37963 [45:54:29<80:22:14, 12.47s/it]
 39%|███▉      | 14767/37963 [45:54:39<75:43:43, 11.75s/it]
 39%|███▉      | 14768/37963 [45:54:49<72:30:19, 11.25s/it]
 39%|███▉      | 14769/37963 [45:54:59<70:06:39, 10.88s/it]
 39%|███▉      | 14770/37963 [45:55:09<68:39:41, 10.66s/it]
                                                           
{'loss': '0.1625', 'grad_norm': '2.116', 'learning_rate': '1.397e-05', 'epoch': '0.3891'}

 39%|███▉      | 14770/37963 [45:55:09<68:39:41, 10.66s/it]
 39%|███▉      | 14771/37963 [45:55:19<67:11:40, 10.43s/it]
 39%|███▉      | 14772/37963 [45:55:29<66:30:27, 10.32s/it]
 39%|███▉      | 14773/37963 [45:55:39<65:44:15, 10.21s/it]
 39%|███▉      | 14774/37963 [45:55:49<65:39:29, 10.19s/it]
 39%|███▉      | 14775/37963 [45:55:59<64:49:28, 10.06s/it]
 39%|███▉      | 14776/37963 [45:56:09<64:27:27, 10.01s/it]
 39%|███▉      | 14777/37963 [45:56:19<64:40:20, 10.04s/it]
 39%|███▉      | 14778/37963 [45:56:29<64:19:31,  9.99s/it]
 39%|███▉      | 14779/37963 [45:56:45<76:45:41, 11.92s/it]
 39%|███▉      | 14780/37963 [45:56:55<73:11:16, 11.37s/it]
                                                           
{'loss': '0.5233', 'grad_norm': '6.249', 'learning_rate': '1.396e-05', 'epoch': '0.3893'}

 39%|███▉      | 14780/37963 [45:56:55<73:11:16, 11.37s/it]
 39%|███▉      | 14781/37963 [45:57:05<70:47:10, 10.99s/it]
 39%|███▉      | 14782/37963 [45:57:15<69:01:42, 10.72s/it]
 39%|███▉      | 14783/37963 [45:57:25<67:43:42, 10.52s/it]
 39%|███▉      | 14784/37963 [45:57:42<79:12:07, 12.30s/it]
 39%|███▉      | 14785/37963 [45:57:52<75:08:17, 11.67s/it]
 39%|███▉      | 14786/37963 [45:58:02<71:45:58, 11.15s/it]
 39%|███▉      | 14787/37963 [45:58:19<82:08:33, 12.76s/it]
 39%|███▉      | 14788/37963 [45:58:29<77:25:30, 12.03s/it]
 39%|███▉      | 14789/37963 [45:58:39<73:38:07, 11.44s/it]
 39%|███▉      | 14790/37963 [45:58:55<82:57:53, 12.89s/it]
                                                           
{'loss': '0.1864', 'grad_norm': '3.279', 'learning_rate': '1.395e-05', 'epoch': '0.3896'}

 39%|███▉      | 14790/37963 [45:58:55<82:57:53, 12.89s/it]
 39%|███▉      | 14791/37963 [45:59:12<90:56:15, 14.13s/it]
 39%|███▉      | 14792/37963 [45:59:22<83:11:21, 12.92s/it]
 39%|███▉      | 14793/37963 [45:59:32<77:37:52, 12.06s/it]
 39%|███▉      | 14794/37963 [45:59:42<73:20:53, 11.40s/it]
 39%|███▉      | 14795/37963 [45:59:52<70:34:53, 10.97s/it]
 39%|███▉      | 14796/37963 [46:00:02<68:50:34, 10.70s/it]
 39%|███▉      | 14797/37963 [46:00:12<67:16:59, 10.46s/it]
 39%|███▉      | 14798/37963 [46:00:22<66:31:34, 10.34s/it]
 39%|███▉      | 14799/37963 [46:00:39<78:12:47, 12.16s/it]
 39%|███▉      | 14800/37963 [46:00:49<74:04:03, 11.51s/it]
                                                           
{'loss': '0.157', 'grad_norm': '1.269', 'learning_rate': '1.394e-05', 'epoch': '0.3899'}

 39%|███▉      | 14800/37963 [46:00:49<74:04:03, 11.51s/it]
 39%|███▉      | 14801/37963 [46:00:59<71:28:58, 11.11s/it]
 39%|███▉      | 14802/37963 [46:01:09<69:27:29, 10.80s/it]
 39%|███▉      | 14803/37963 [46:01:19<68:16:07, 10.61s/it]
 39%|███▉      | 14804/37963 [46:01:29<67:12:16, 10.45s/it]
 39%|███▉      | 14805/37963 [46:01:39<66:26:29, 10.33s/it]
 39%|███▉      | 14806/37963 [46:01:49<66:12:06, 10.29s/it]
 39%|███▉      | 14807/37963 [46:01:59<65:33:12, 10.19s/it]
 39%|███▉      | 14808/37963 [46:02:09<64:47:39, 10.07s/it]
 39%|███▉      | 14809/37963 [46:02:19<65:07:29, 10.13s/it]
 39%|███▉      | 14810/37963 [46:02:36<77:22:52, 12.03s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '2.122', 'learning_rate': '1.394e-05', 'epoch': '0.3901'}

 39%|███▉      | 14810/37963 [46:02:36<77:22:52, 12.03s/it]
 39%|███▉      | 14811/37963 [46:02:46<73:21:41, 11.41s/it]
 39%|███▉      | 14812/37963 [46:02:56<70:32:45, 10.97s/it]
 39%|███▉      | 14813/37963 [46:03:06<68:39:03, 10.68s/it]
 39%|███▉      | 14814/37963 [46:03:16<67:22:44, 10.48s/it]
 39%|███▉      | 14815/37963 [46:03:26<66:26:34, 10.33s/it]
 39%|███▉      | 14816/37963 [46:03:36<65:45:03, 10.23s/it]
 39%|███▉      | 14817/37963 [46:03:53<79:02:22, 12.29s/it]
 39%|███▉      | 14818/37963 [46:04:03<74:46:11, 11.63s/it]
 39%|███▉      | 14819/37963 [46:04:13<71:49:09, 11.17s/it]
 39%|███▉      | 14820/37963 [46:04:23<69:40:55, 10.84s/it]
                                                           
{'loss': '0.1665', 'grad_norm': '4.944', 'learning_rate': '1.393e-05', 'epoch': '0.3904'}

 39%|███▉      | 14820/37963 [46:04:23<69:40:55, 10.84s/it]
 39%|███▉      | 14821/37963 [46:04:33<68:08:53, 10.60s/it]
 39%|███▉      | 14822/37963 [46:04:43<67:10:24, 10.45s/it]
 39%|███▉      | 14823/37963 [46:04:53<65:54:49, 10.25s/it]
 39%|███▉      | 14824/37963 [46:05:03<65:18:07, 10.16s/it]
 39%|███▉      | 14825/37963 [46:05:13<65:11:38, 10.14s/it]
 39%|███▉      | 14826/37963 [46:05:23<65:07:19, 10.13s/it]
 39%|███▉      | 14827/37963 [46:05:40<77:20:11, 12.03s/it]
 39%|███▉      | 14828/37963 [46:05:50<73:36:11, 11.45s/it]
 39%|███▉      | 14829/37963 [46:06:00<70:55:36, 11.04s/it]
 39%|███▉      | 14830/37963 [46:06:10<68:54:54, 10.72s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '3.694', 'learning_rate': '1.392e-05', 'epoch': '0.3906'}

 39%|███▉      | 14830/37963 [46:06:10<68:54:54, 10.72s/it]
 39%|███▉      | 14831/37963 [46:06:20<67:43:22, 10.54s/it]
 39%|███▉      | 14832/37963 [46:06:30<66:51:04, 10.40s/it]
 39%|███▉      | 14833/37963 [46:06:47<78:52:52, 12.28s/it]
 39%|███▉      | 14834/37963 [46:06:57<74:49:40, 11.65s/it]
 39%|███▉      | 14835/37963 [46:07:14<84:30:37, 13.15s/it]
 39%|███▉      | 14836/37963 [46:07:24<78:25:26, 12.21s/it]
 39%|███▉      | 14837/37963 [46:07:33<73:30:41, 11.44s/it]
 39%|███▉      | 14838/37963 [46:07:50<83:10:15, 12.95s/it]
 39%|███▉      | 14839/37963 [46:08:07<91:15:19, 14.21s/it]
 39%|███▉      | 14840/37963 [46:08:16<82:31:15, 12.85s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '1.135', 'learning_rate': '1.391e-05', 'epoch': '0.3909'}

 39%|███▉      | 14840/37963 [46:08:16<82:31:15, 12.85s/it]
 39%|███▉      | 14841/37963 [46:08:26<76:59:27, 11.99s/it]
 39%|███▉      | 14842/37963 [46:08:37<73:23:39, 11.43s/it]
 39%|███▉      | 14843/37963 [46:08:47<70:50:26, 11.03s/it]
 39%|███▉      | 14844/37963 [46:08:57<68:59:24, 10.74s/it]
 39%|███▉      | 14845/37963 [46:09:07<67:33:44, 10.52s/it]
 39%|███▉      | 14846/37963 [46:09:17<67:12:30, 10.47s/it]
 39%|███▉      | 14847/37963 [46:09:34<78:39:49, 12.25s/it]
 39%|███▉      | 14848/37963 [46:09:44<74:22:47, 11.58s/it]
 39%|███▉      | 14849/37963 [46:09:54<71:27:08, 11.13s/it]
 39%|███▉      | 14850/37963 [46:10:04<69:18:55, 10.80s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '1.845', 'learning_rate': '1.39e-05', 'epoch': '0.3912'}

 39%|███▉      | 14850/37963 [46:10:04<69:18:55, 10.80s/it]
 39%|███▉      | 14851/37963 [46:10:14<68:01:09, 10.59s/it]
 39%|███▉      | 14852/37963 [46:10:24<67:10:05, 10.46s/it]
 39%|███▉      | 14853/37963 [46:10:34<66:24:53, 10.35s/it]
 39%|███▉      | 14854/37963 [46:10:44<65:50:48, 10.26s/it]
 39%|███▉      | 14855/37963 [46:10:54<65:28:40, 10.20s/it]
 39%|███▉      | 14856/37963 [46:11:04<65:13:19, 10.16s/it]
 39%|███▉      | 14857/37963 [46:11:21<77:19:51, 12.05s/it]
 39%|███▉      | 14858/37963 [46:11:31<73:41:41, 11.48s/it]
 39%|███▉      | 14859/37963 [46:11:41<71:04:37, 11.08s/it]
 39%|███▉      | 14860/37963 [46:11:51<69:09:31, 10.78s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '2.516', 'learning_rate': '1.39e-05', 'epoch': '0.3914'}

 39%|███▉      | 14860/37963 [46:11:51<69:09:31, 10.78s/it]
 39%|███▉      | 14861/37963 [46:12:01<67:56:52, 10.59s/it]
 39%|███▉      | 14862/37963 [46:12:11<66:35:16, 10.38s/it]
 39%|███▉      | 14863/37963 [46:12:21<66:01:40, 10.29s/it]
 39%|███▉      | 14864/37963 [46:12:31<65:11:40, 10.16s/it]
 39%|███▉      | 14865/37963 [46:12:41<64:59:45, 10.13s/it]
 39%|███▉      | 14866/37963 [46:12:51<64:47:11, 10.10s/it]
 39%|███▉      | 14867/37963 [46:13:08<77:58:47, 12.15s/it]
 39%|███▉      | 14868/37963 [46:13:18<73:43:06, 11.49s/it]
 39%|███▉      | 14869/37963 [46:13:28<71:07:03, 11.09s/it]
 39%|███▉      | 14870/37963 [46:13:38<69:11:53, 10.79s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '3.511', 'learning_rate': '1.389e-05', 'epoch': '0.3917'}

 39%|███▉      | 14870/37963 [46:13:38<69:11:53, 10.79s/it]
 39%|███▉      | 14871/37963 [46:13:48<67:58:14, 10.60s/it]
 39%|███▉      | 14872/37963 [46:13:58<65:46:06, 10.25s/it]
 39%|███▉      | 14873/37963 [46:14:08<65:36:08, 10.23s/it]
 39%|███▉      | 14874/37963 [46:14:18<65:34:28, 10.22s/it]
 39%|███▉      | 14875/37963 [46:14:28<65:21:28, 10.19s/it]
 39%|███▉      | 14876/37963 [46:14:44<76:53:37, 11.99s/it]
 39%|███▉      | 14877/37963 [46:14:55<73:18:51, 11.43s/it]
 39%|███▉      | 14878/37963 [46:15:05<70:39:28, 11.02s/it]
 39%|███▉      | 14879/37963 [46:15:15<68:59:13, 10.76s/it]
 39%|███▉      | 14880/37963 [46:15:25<67:36:25, 10.54s/it]
                                                           
{'loss': '0.1552', 'grad_norm': '1.788', 'learning_rate': '1.388e-05', 'epoch': '0.392'}

 39%|███▉      | 14880/37963 [46:15:25<67:36:25, 10.54s/it]
 39%|███▉      | 14881/37963 [46:15:41<78:41:55, 12.27s/it]
 39%|███▉      | 14882/37963 [46:15:58<86:52:41, 13.55s/it]
 39%|███▉      | 14883/37963 [46:16:08<80:13:53, 12.51s/it]
 39%|███▉      | 14884/37963 [46:16:18<75:06:20, 11.72s/it]
 39%|███▉      | 14885/37963 [46:16:28<71:36:34, 11.17s/it]
 39%|███▉      | 14886/37963 [46:16:38<69:37:15, 10.86s/it]
 39%|███▉      | 14887/37963 [46:16:47<67:30:49, 10.53s/it]
 39%|███▉      | 14888/37963 [46:17:11<92:51:14, 14.49s/it]
 39%|███▉      | 14889/37963 [46:17:21<84:36:51, 13.20s/it]
 39%|███▉      | 14890/37963 [46:17:31<78:40:19, 12.27s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '1.153', 'learning_rate': '1.387e-05', 'epoch': '0.3922'}

 39%|███▉      | 14890/37963 [46:17:31<78:40:19, 12.27s/it]
 39%|███▉      | 14891/37963 [46:17:42<74:23:41, 11.61s/it]
 39%|███▉      | 14892/37963 [46:17:52<71:38:42, 11.18s/it]
 39%|███▉      | 14893/37963 [46:18:02<69:36:54, 10.86s/it]
 39%|███▉      | 14894/37963 [46:18:12<67:26:32, 10.52s/it]
 39%|███▉      | 14895/37963 [46:18:22<66:40:21, 10.40s/it]
 39%|███▉      | 14896/37963 [46:18:32<66:09:51, 10.33s/it]
 39%|███▉      | 14897/37963 [46:18:48<78:13:31, 12.21s/it]
 39%|███▉      | 14898/37963 [46:18:59<74:30:55, 11.63s/it]
 39%|███▉      | 14899/37963 [46:19:09<71:44:02, 11.20s/it]
 39%|███▉      | 14900/37963 [46:19:19<69:33:54, 10.86s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '2.259', 'learning_rate': '1.387e-05', 'epoch': '0.3925'}

 39%|███▉      | 14900/37963 [46:19:19<69:33:54, 10.86s/it]
 39%|███▉      | 14901/37963 [46:19:29<68:13:25, 10.65s/it]
 39%|███▉      | 14902/37963 [46:19:39<67:11:42, 10.49s/it]
 39%|███▉      | 14903/37963 [46:19:49<66:21:11, 10.36s/it]
 39%|███▉      | 14904/37963 [46:19:59<64:47:01, 10.11s/it]
 39%|███▉      | 14905/37963 [46:20:09<64:40:52, 10.10s/it]
 39%|███▉      | 14906/37963 [46:20:26<77:15:40, 12.06s/it]
 39%|███▉      | 14907/37963 [46:20:35<73:02:54, 11.41s/it]
 39%|███▉      | 14908/37963 [46:20:46<70:29:14, 11.01s/it]
 39%|███▉      | 14909/37963 [46:20:56<68:34:18, 10.71s/it]
 39%|███▉      | 14910/37963 [46:21:06<67:32:27, 10.55s/it]
                                                           
{'loss': '0.1736', 'grad_norm': '1.492', 'learning_rate': '1.386e-05', 'epoch': '0.3928'}

 39%|███▉      | 14910/37963 [46:21:06<67:32:27, 10.55s/it]
 39%|███▉      | 14911/37963 [46:21:16<66:34:32, 10.40s/it]
 39%|███▉      | 14912/37963 [46:21:26<66:07:21, 10.33s/it]
 39%|███▉      | 14913/37963 [46:21:36<65:45:24, 10.27s/it]
 39%|███▉      | 14914/37963 [46:21:46<65:25:46, 10.22s/it]
 39%|███▉      | 14915/37963 [46:22:03<77:27:29, 12.10s/it]
 39%|███▉      | 14916/37963 [46:22:13<73:39:18, 11.51s/it]
 39%|███▉      | 14917/37963 [46:22:23<70:54:50, 11.08s/it]
 39%|███▉      | 14918/37963 [46:22:33<68:51:34, 10.76s/it]
 39%|███▉      | 14919/37963 [46:22:43<67:23:45, 10.53s/it]
 39%|███▉      | 14920/37963 [46:22:53<65:53:37, 10.29s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '1.473', 'learning_rate': '1.385e-05', 'epoch': '0.393'}

 39%|███▉      | 14920/37963 [46:22:53<65:53:37, 10.29s/it]
 39%|███▉      | 14921/37963 [46:23:02<64:26:52, 10.07s/it]
 39%|███▉      | 14922/37963 [46:23:12<64:27:46, 10.07s/it]
 39%|███▉      | 14923/37963 [46:23:29<76:49:39, 12.00s/it]
 39%|███▉      | 14924/37963 [46:23:39<73:15:20, 11.45s/it]
 39%|███▉      | 14925/37963 [46:23:49<70:35:20, 11.03s/it]
 39%|███▉      | 14926/37963 [46:23:59<68:48:58, 10.75s/it]
 39%|███▉      | 14927/37963 [46:24:09<67:23:58, 10.53s/it]
 39%|███▉      | 14928/37963 [46:24:19<66:01:48, 10.32s/it]
 39%|███▉      | 14929/37963 [46:24:42<90:02:21, 14.07s/it]
 39%|███▉      | 14930/37963 [46:24:52<82:08:01, 12.84s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '1.897', 'learning_rate': '1.384e-05', 'epoch': '0.3933'}

 39%|███▉      | 14930/37963 [46:24:52<82:08:01, 12.84s/it]
 39%|███▉      | 14931/37963 [46:25:01<75:56:44, 11.87s/it]
 39%|███▉      | 14932/37963 [46:25:11<72:01:12, 11.26s/it]
 39%|███▉      | 14933/37963 [46:25:21<69:39:47, 10.89s/it]
 39%|███▉      | 14934/37963 [46:25:31<67:06:41, 10.49s/it]
 39%|███▉      | 14935/37963 [46:25:41<66:12:55, 10.35s/it]
 39%|███▉      | 14936/37963 [46:25:57<77:19:45, 12.09s/it]
 39%|███▉      | 14937/37963 [46:26:13<85:36:25, 13.38s/it]
 39%|███▉      | 14938/37963 [46:26:23<79:30:02, 12.43s/it]
 39%|███▉      | 14939/37963 [46:26:34<75:12:58, 11.76s/it]
 39%|███▉      | 14940/37963 [46:26:44<71:58:53, 11.26s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '2.874', 'learning_rate': '1.383e-05', 'epoch': '0.3935'}

 39%|███▉      | 14940/37963 [46:26:44<71:58:53, 11.26s/it]
 39%|███▉      | 14941/37963 [46:26:54<69:28:18, 10.86s/it]
 39%|███▉      | 14942/37963 [46:27:03<67:24:50, 10.54s/it]
 39%|███▉      | 14943/37963 [46:27:14<66:30:25, 10.40s/it]
 39%|███▉      | 14944/37963 [46:27:30<77:58:40, 12.20s/it]
 39%|███▉      | 14945/37963 [46:27:40<73:58:02, 11.57s/it]
 39%|███▉      | 14946/37963 [46:27:50<71:01:01, 11.11s/it]
 39%|███▉      | 14947/37963 [46:28:00<68:50:53, 10.77s/it]
 39%|███▉      | 14948/37963 [46:28:10<67:25:52, 10.55s/it]
 39%|███▉      | 14949/37963 [46:28:20<66:28:59, 10.40s/it]
 39%|███▉      | 14950/37963 [46:28:30<65:51:00, 10.30s/it]
                                                           
{'loss': '0.1636', 'grad_norm': '2.507', 'learning_rate': '1.383e-05', 'epoch': '0.3938'}

 39%|███▉      | 14950/37963 [46:28:30<65:51:00, 10.30s/it]
 39%|███▉      | 14951/37963 [46:28:40<65:24:08, 10.23s/it]
 39%|███▉      | 14952/37963 [46:28:50<64:35:47, 10.11s/it]
 39%|███▉      | 14953/37963 [46:29:00<63:54:29, 10.00s/it]
 39%|███▉      | 14954/37963 [46:29:16<75:46:35, 11.86s/it]
 39%|███▉      | 14955/37963 [46:29:26<72:22:13, 11.32s/it]
 39%|███▉      | 14956/37963 [46:29:36<70:06:03, 10.97s/it]
 39%|███▉      | 14957/37963 [46:29:46<68:22:12, 10.70s/it]
 39%|███▉      | 14958/37963 [46:29:56<67:12:52, 10.52s/it]
 39%|███▉      | 14959/37963 [46:30:06<66:17:35, 10.37s/it]
 39%|███▉      | 14960/37963 [46:30:17<65:52:22, 10.31s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '1.248', 'learning_rate': '1.382e-05', 'epoch': '0.3941'}

 39%|███▉      | 14960/37963 [46:30:17<65:52:22, 10.31s/it]
 39%|███▉      | 14961/37963 [46:30:27<65:27:33, 10.24s/it]
 39%|███▉      | 14962/37963 [46:30:43<77:13:16, 12.09s/it]
 39%|███▉      | 14963/37963 [46:30:53<73:02:40, 11.43s/it]
 39%|███▉      | 14964/37963 [46:31:03<70:20:36, 11.01s/it]
 39%|███▉      | 14965/37963 [46:31:13<68:37:14, 10.74s/it]
 39%|███▉      | 14966/37963 [46:31:23<67:28:00, 10.56s/it]
 39%|███▉      | 14967/37963 [46:31:33<66:36:30, 10.43s/it]
 39%|███▉      | 14968/37963 [46:31:44<66:07:27, 10.35s/it]
 39%|███▉      | 14969/37963 [46:31:54<65:40:42, 10.28s/it]
 39%|███▉      | 14970/37963 [46:32:04<64:56:46, 10.17s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '1.216', 'learning_rate': '1.381e-05', 'epoch': '0.3943'}

 39%|███▉      | 14970/37963 [46:32:04<64:56:46, 10.17s/it]
 39%|███▉      | 14971/37963 [46:32:20<76:57:16, 12.05s/it]
 39%|███▉      | 14972/37963 [46:32:30<73:12:28, 11.46s/it]
 39%|███▉      | 14973/37963 [46:32:40<70:45:40, 11.08s/it]
 39%|███▉      | 14974/37963 [46:32:50<68:47:04, 10.77s/it]
 39%|███▉      | 14975/37963 [46:33:07<79:28:08, 12.45s/it]
 39%|███▉      | 14976/37963 [46:33:17<74:31:40, 11.67s/it]
 39%|███▉      | 14977/37963 [46:33:33<84:04:27, 13.17s/it]
 39%|███▉      | 14978/37963 [46:33:43<78:16:46, 12.26s/it]
 39%|███▉      | 14979/37963 [46:33:53<73:44:12, 11.55s/it]
 39%|███▉      | 14980/37963 [46:34:03<70:19:13, 11.01s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '0.7987', 'learning_rate': '1.38e-05', 'epoch': '0.3946'}

 39%|███▉      | 14980/37963 [46:34:03<70:19:13, 11.01s/it]
 39%|███▉      | 14981/37963 [46:34:13<67:52:37, 10.63s/it]
 39%|███▉      | 14982/37963 [46:34:23<66:51:29, 10.47s/it]
 39%|███▉      | 14983/37963 [46:34:33<65:40:24, 10.29s/it]
 39%|███▉      | 14984/37963 [46:34:43<65:06:15, 10.20s/it]
 39%|███▉      | 14985/37963 [46:34:59<77:35:56, 12.16s/it]
 39%|███▉      | 14986/37963 [46:35:10<73:47:17, 11.56s/it]
 39%|███▉      | 14987/37963 [46:35:20<70:49:19, 11.10s/it]
 39%|███▉      | 14988/37963 [46:35:37<81:54:55, 12.84s/it]
 39%|███▉      | 14989/37963 [46:35:46<75:51:18, 11.89s/it]
 39%|███▉      | 14990/37963 [46:35:56<72:23:11, 11.34s/it]
                                                           
{'loss': '0.1634', 'grad_norm': '2.06', 'learning_rate': '1.379e-05', 'epoch': '0.3949'}

 39%|███▉      | 14990/37963 [46:35:56<72:23:11, 11.34s/it]
 39%|███▉      | 14991/37963 [46:36:06<69:51:20, 10.95s/it]
 39%|███▉      | 14992/37963 [46:36:16<68:05:57, 10.67s/it]
 39%|███▉      | 14993/37963 [46:36:33<79:11:04, 12.41s/it]
 39%|███▉      | 14994/37963 [46:36:43<74:29:05, 11.67s/it]
 39%|███▉      | 14995/37963 [46:36:53<71:21:50, 11.19s/it]
 40%|███▉      | 14996/37963 [46:37:03<69:16:50, 10.86s/it]
 40%|███▉      | 14997/37963 [46:37:13<67:43:11, 10.62s/it]
 40%|███▉      | 14998/37963 [46:37:23<66:23:45, 10.41s/it]
 40%|███▉      | 14999/37963 [46:37:33<65:01:52, 10.19s/it]
 40%|███▉      | 15000/37963 [46:37:43<64:31:28, 10.12s/it]
                                                           
{'loss': '0.1645', 'grad_norm': '1.547', 'learning_rate': '1.379e-05', 'epoch': '0.3951'}

 40%|███▉      | 15000/37963 [46:37:43<64:31:28, 10.12s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.40s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.40s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 40%|███▉      | 15001/37963 [46:38:41<157:53:26, 24.75s/it]
 40%|███▉      | 15002/37963 [46:38:58<142:28:46, 22.34s/it]
 40%|███▉      | 15003/37963 [46:39:08<118:59:10, 18.66s/it]
 40%|███▉      | 15004/37963 [46:39:18<102:36:10, 16.09s/it]
 40%|███▉      | 15005/37963 [46:39:28<90:39:47, 14.22s/it] 
 40%|███▉      | 15006/37963 [46:39:38<82:53:14, 13.00s/it]
 40%|███▉      | 15007/37963 [46:39:48<77:25:51, 12.14s/it]
 40%|███▉      | 15008/37963 [46:39:58<73:21:00, 11.50s/it]
 40%|███▉      | 15009/37963 [46:40:08<70:33:22, 11.07s/it]
 40%|███▉      | 15010/37963 [46:40:25<81:46:13, 12.83s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '3.032', 'learning_rate': '1.378e-05', 'epoch': '0.3954'}

 40%|███▉      | 15010/37963 [46:40:25<81:46:13, 12.83s/it]
 40%|███▉      | 15011/37963 [46:40:36<76:39:07, 12.02s/it]
 40%|███▉      | 15012/37963 [46:40:46<73:04:10, 11.46s/it]
 40%|███▉      | 15013/37963 [46:40:56<70:21:31, 11.04s/it]
 40%|███▉      | 15014/37963 [46:41:06<68:19:46, 10.72s/it]
 40%|███▉      | 15015/37963 [46:41:16<67:03:11, 10.52s/it]
 40%|███▉      | 15016/37963 [46:41:26<66:06:50, 10.37s/it]
 40%|███▉      | 15017/37963 [46:41:36<65:05:02, 10.21s/it]
 40%|███▉      | 15018/37963 [46:41:52<77:16:06, 12.12s/it]
 40%|███▉      | 15019/37963 [46:42:02<73:20:04, 11.51s/it]
 40%|███▉      | 15020/37963 [46:42:12<70:43:18, 11.10s/it]
                                                           
{'loss': '0.1663', 'grad_norm': '1.305', 'learning_rate': '1.377e-05', 'epoch': '0.3956'}

 40%|███▉      | 15020/37963 [46:42:12<70:43:18, 11.10s/it]
 40%|███▉      | 15021/37963 [46:42:22<68:12:59, 10.70s/it]
 40%|███▉      | 15022/37963 [46:42:32<66:56:28, 10.50s/it]
 40%|███▉      | 15023/37963 [46:42:49<78:11:18, 12.27s/it]
 40%|███▉      | 15024/37963 [46:43:05<85:57:19, 13.49s/it]
 40%|███▉      | 15025/37963 [46:43:15<79:31:36, 12.48s/it]
 40%|███▉      | 15026/37963 [46:43:25<74:57:42, 11.77s/it]
 40%|███▉      | 15027/37963 [46:43:35<71:17:56, 11.19s/it]
 40%|███▉      | 15028/37963 [46:43:45<69:11:18, 10.86s/it]
 40%|███▉      | 15029/37963 [46:43:55<67:24:20, 10.58s/it]
 40%|███▉      | 15030/37963 [46:44:05<66:32:54, 10.45s/it]
                                                           
{'loss': '0.1657', 'grad_norm': '0.8802', 'learning_rate': '1.376e-05', 'epoch': '0.3959'}

 40%|███▉      | 15030/37963 [46:44:05<66:32:54, 10.45s/it]
 40%|███▉      | 15031/37963 [46:44:15<65:58:42, 10.36s/it]
 40%|███▉      | 15032/37963 [46:44:25<65:23:41, 10.27s/it]
 40%|███▉      | 15033/37963 [46:44:36<65:03:13, 10.21s/it]
 40%|███▉      | 15034/37963 [46:44:52<77:19:10, 12.14s/it]
 40%|███▉      | 15035/37963 [46:45:02<73:21:00, 11.52s/it]
 40%|███▉      | 15036/37963 [46:45:19<83:55:05, 13.18s/it]
 40%|███▉      | 15037/37963 [46:45:35<89:24:10, 14.04s/it]
 40%|███▉      | 15038/37963 [46:45:45<81:43:55, 12.83s/it]
 40%|███▉      | 15039/37963 [46:45:56<76:46:58, 12.06s/it]
 40%|███▉      | 15040/37963 [46:46:06<72:50:07, 11.44s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '3.733', 'learning_rate': '1.375e-05', 'epoch': '0.3962'}

 40%|███▉      | 15040/37963 [46:46:06<72:50:07, 11.44s/it]
 40%|███▉      | 15041/37963 [46:46:15<69:51:10, 10.97s/it]
 40%|███▉      | 15042/37963 [46:46:26<68:11:43, 10.71s/it]
 40%|███▉      | 15043/37963 [46:46:36<66:57:58, 10.52s/it]
 40%|███▉      | 15044/37963 [46:46:46<66:07:50, 10.39s/it]
 40%|███▉      | 15045/37963 [46:46:56<65:40:47, 10.32s/it]
 40%|███▉      | 15046/37963 [46:47:06<64:58:10, 10.21s/it]
 40%|███▉      | 15047/37963 [46:47:16<64:52:14, 10.19s/it]
 40%|███▉      | 15048/37963 [46:47:32<76:36:39, 12.04s/it]
 40%|███▉      | 15049/37963 [46:47:42<72:57:38, 11.46s/it]
 40%|███▉      | 15050/37963 [46:47:52<70:15:11, 11.04s/it]
                                                           
{'loss': '0.1574', 'grad_norm': '1.807', 'learning_rate': '1.375e-05', 'epoch': '0.3964'}

 40%|███▉      | 15050/37963 [46:47:52<70:15:11, 11.04s/it]
 40%|███▉      | 15051/37963 [46:48:03<68:23:46, 10.75s/it]
 40%|███▉      | 15052/37963 [46:48:13<67:13:11, 10.56s/it]
 40%|███▉      | 15053/37963 [46:48:23<66:14:31, 10.41s/it]
 40%|███▉      | 15054/37963 [46:48:33<65:32:21, 10.30s/it]
 40%|███▉      | 15055/37963 [46:48:43<64:51:51, 10.19s/it]
 40%|███▉      | 15056/37963 [46:48:53<64:06:35, 10.08s/it]
 40%|███▉      | 15057/37963 [46:49:03<64:25:46, 10.13s/it]
 40%|███▉      | 15058/37963 [46:49:20<77:40:02, 12.21s/it]
 40%|███▉      | 15059/37963 [46:49:30<73:20:18, 11.53s/it]
 40%|███▉      | 15060/37963 [46:49:40<70:36:44, 11.10s/it]
                                                           
{'loss': '0.1541', 'grad_norm': '1.183', 'learning_rate': '1.374e-05', 'epoch': '0.3967'}

 40%|███▉      | 15060/37963 [46:49:40<70:36:44, 11.10s/it]
 40%|███▉      | 15061/37963 [46:49:50<68:49:36, 10.82s/it]
 40%|███▉      | 15062/37963 [46:50:00<67:28:51, 10.61s/it]
 40%|███▉      | 15063/37963 [46:50:10<65:52:59, 10.36s/it]
 40%|███▉      | 15064/37963 [46:50:20<65:15:58, 10.26s/it]
 40%|███▉      | 15065/37963 [46:50:36<76:58:25, 12.10s/it]
 40%|███▉      | 15066/37963 [46:50:47<73:18:11, 11.53s/it]
 40%|███▉      | 15067/37963 [46:50:56<70:15:39, 11.05s/it]
 40%|███▉      | 15068/37963 [46:51:07<68:24:34, 10.76s/it]
 40%|███▉      | 15069/37963 [46:51:16<66:38:27, 10.48s/it]
 40%|███▉      | 15070/37963 [46:51:26<64:57:26, 10.21s/it]
                                                           
{'loss': '0.145', 'grad_norm': '1.486', 'learning_rate': '1.373e-05', 'epoch': '0.397'}

 40%|███▉      | 15070/37963 [46:51:26<64:57:26, 10.21s/it]
 40%|███▉      | 15071/37963 [46:51:42<76:27:30, 12.02s/it]
 40%|███▉      | 15072/37963 [46:51:59<84:56:33, 13.36s/it]
 40%|███▉      | 15073/37963 [46:52:09<78:45:07, 12.39s/it]
 40%|███▉      | 15074/37963 [46:52:19<74:01:05, 11.64s/it]
 40%|███▉      | 15075/37963 [46:52:29<70:30:12, 11.09s/it]
 40%|███▉      | 15076/37963 [46:52:39<68:41:26, 10.80s/it]
 40%|███▉      | 15077/37963 [46:52:49<67:04:50, 10.55s/it]
 40%|███▉      | 15078/37963 [46:52:58<65:28:48, 10.30s/it]
 40%|███▉      | 15079/37963 [46:53:08<65:07:14, 10.24s/it]
 40%|███▉      | 15080/37963 [46:53:18<64:07:19, 10.09s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '3.684', 'learning_rate': '1.372e-05', 'epoch': '0.3972'}

 40%|███▉      | 15080/37963 [46:53:18<64:07:19, 10.09s/it]
 40%|███▉      | 15081/37963 [46:53:28<64:09:33, 10.09s/it]
 40%|███▉      | 15082/37963 [46:53:45<76:44:17, 12.07s/it]
 40%|███▉      | 15083/37963 [46:53:55<72:53:14, 11.47s/it]
 40%|███▉      | 15084/37963 [46:54:18<95:44:34, 15.07s/it]
 40%|███▉      | 15085/37963 [46:54:29<86:17:16, 13.58s/it]
 40%|███▉      | 15086/37963 [46:54:38<78:39:09, 12.38s/it]
 40%|███▉      | 15087/37963 [46:54:48<74:11:10, 11.67s/it]
 40%|███▉      | 15088/37963 [46:54:58<71:28:13, 11.25s/it]
 40%|███▉      | 15089/37963 [46:55:09<69:12:18, 10.89s/it]
 40%|███▉      | 15090/37963 [46:55:19<67:50:36, 10.68s/it]
                                                           
{'loss': '0.149', 'grad_norm': '0.8245', 'learning_rate': '1.372e-05', 'epoch': '0.3975'}

 40%|███▉      | 15090/37963 [46:55:19<67:50:36, 10.68s/it]
 40%|███▉      | 15091/37963 [46:55:29<66:20:47, 10.44s/it]
 40%|███▉      | 15092/37963 [46:55:38<64:29:15, 10.15s/it]
 40%|███▉      | 15093/37963 [46:55:48<64:38:25, 10.18s/it]
 40%|███▉      | 15094/37963 [46:55:58<63:40:14, 10.02s/it]
 40%|███▉      | 15095/37963 [46:56:08<63:52:00, 10.05s/it]
 40%|███▉      | 15096/37963 [46:56:25<76:25:46, 12.03s/it]
 40%|███▉      | 15097/37963 [46:56:35<72:43:29, 11.45s/it]
 40%|███▉      | 15098/37963 [46:56:45<70:11:10, 11.05s/it]
 40%|███▉      | 15099/37963 [46:56:55<67:47:07, 10.67s/it]
 40%|███▉      | 15100/37963 [46:57:05<66:36:40, 10.49s/it]
                                                           
{'loss': '0.1717', 'grad_norm': '1.646', 'learning_rate': '1.371e-05', 'epoch': '0.3978'}

 40%|███▉      | 15100/37963 [46:57:05<66:36:40, 10.49s/it]
 40%|███▉      | 15101/37963 [46:57:15<65:45:35, 10.35s/it]
 40%|███▉      | 15102/37963 [46:57:25<64:42:11, 10.19s/it]
 40%|███▉      | 15103/37963 [46:57:35<64:30:45, 10.16s/it]
 40%|███▉      | 15104/37963 [46:57:45<64:06:49, 10.10s/it]
 40%|███▉      | 15105/37963 [46:58:01<76:28:17, 12.04s/it]
 40%|███▉      | 15106/37963 [46:58:11<72:54:56, 11.48s/it]
 40%|███▉      | 15107/37963 [46:58:22<70:17:50, 11.07s/it]
 40%|███▉      | 15108/37963 [46:58:32<68:22:40, 10.77s/it]
 40%|███▉      | 15109/37963 [46:58:42<67:08:16, 10.58s/it]
 40%|███▉      | 15110/37963 [46:58:52<66:07:53, 10.42s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '1.866', 'learning_rate': '1.37e-05', 'epoch': '0.398'}

 40%|███▉      | 15110/37963 [46:58:52<66:07:53, 10.42s/it]
 40%|███▉      | 15111/37963 [46:59:02<65:32:09, 10.32s/it]
 40%|███▉      | 15112/37963 [46:59:12<65:03:36, 10.25s/it]
 40%|███▉      | 15113/37963 [46:59:28<76:53:12, 12.11s/it]
 40%|███▉      | 15114/37963 [46:59:39<73:11:16, 11.53s/it]
 40%|███▉      | 15115/37963 [46:59:49<70:19:42, 11.08s/it]
 40%|███▉      | 15116/37963 [46:59:59<68:37:14, 10.81s/it]
 40%|███▉      | 15117/37963 [47:00:15<79:24:48, 12.51s/it]
 40%|███▉      | 15118/37963 [47:00:25<74:53:22, 11.80s/it]
 40%|███▉      | 15119/37963 [47:00:42<83:58:43, 13.23s/it]
 40%|███▉      | 15120/37963 [47:00:52<77:56:33, 12.28s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '1.78', 'learning_rate': '1.369e-05', 'epoch': '0.3983'}

 40%|███▉      | 15120/37963 [47:00:52<77:56:33, 12.28s/it]
 40%|███▉      | 15121/37963 [47:01:02<73:55:22, 11.65s/it]
 40%|███▉      | 15122/37963 [47:01:12<70:59:18, 11.19s/it]
 40%|███▉      | 15123/37963 [47:01:23<68:58:15, 10.87s/it]
 40%|███▉      | 15124/37963 [47:01:33<67:31:53, 10.64s/it]
 40%|███▉      | 15125/37963 [47:01:43<66:31:29, 10.49s/it]
 40%|███▉      | 15126/37963 [47:01:53<65:48:09, 10.37s/it]
 40%|███▉      | 15127/37963 [47:02:03<65:12:40, 10.28s/it]
 40%|███▉      | 15128/37963 [47:02:13<64:59:10, 10.25s/it]
 40%|███▉      | 15129/37963 [47:02:23<64:38:57, 10.19s/it]
 40%|███▉      | 15130/37963 [47:02:33<64:06:43, 10.11s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '1.586', 'learning_rate': '1.368e-05', 'epoch': '0.3985'}

 40%|███▉      | 15130/37963 [47:02:33<64:06:43, 10.11s/it]
 40%|███▉      | 15131/37963 [47:02:49<75:39:11, 11.93s/it]
 40%|███▉      | 15132/37963 [47:03:06<84:00:52, 13.25s/it]
 40%|███▉      | 15133/37963 [47:03:22<90:18:37, 14.24s/it]
 40%|███▉      | 15134/37963 [47:03:32<82:29:27, 13.01s/it]
 40%|███▉      | 15135/37963 [47:03:42<76:23:13, 12.05s/it]
 40%|███▉      | 15136/37963 [47:03:52<72:43:36, 11.47s/it]
 40%|███▉      | 15137/37963 [47:04:02<70:01:03, 11.04s/it]
 40%|███▉      | 15138/37963 [47:04:12<68:21:16, 10.78s/it]
 40%|███▉      | 15139/37963 [47:04:22<66:56:46, 10.56s/it]
 40%|███▉      | 15140/37963 [47:04:32<65:58:45, 10.41s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '1.392', 'learning_rate': '1.368e-05', 'epoch': '0.3988'}

 40%|███▉      | 15140/37963 [47:04:32<65:58:45, 10.41s/it]
 40%|███▉      | 15141/37963 [47:04:43<65:21:34, 10.31s/it]
 40%|███▉      | 15142/37963 [47:04:53<64:54:15, 10.24s/it]
 40%|███▉      | 15143/37963 [47:05:02<63:50:41, 10.07s/it]
 40%|███▉      | 15144/37963 [47:05:12<63:51:28, 10.07s/it]
 40%|███▉      | 15145/37963 [47:05:22<63:29:10, 10.02s/it]
 40%|███▉      | 15146/37963 [47:05:39<75:55:26, 11.98s/it]
 40%|███▉      | 15147/37963 [47:05:49<71:58:24, 11.36s/it]
 40%|███▉      | 15148/37963 [47:05:59<69:09:32, 10.91s/it]
 40%|███▉      | 15149/37963 [47:06:09<67:31:53, 10.66s/it]
 40%|███▉      | 15150/37963 [47:06:19<66:32:41, 10.50s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '1.196', 'learning_rate': '1.367e-05', 'epoch': '0.3991'}

 40%|███▉      | 15150/37963 [47:06:19<66:32:41, 10.50s/it]
 40%|███▉      | 15151/37963 [47:06:29<65:54:32, 10.40s/it]
 40%|███▉      | 15152/37963 [47:06:39<65:08:47, 10.28s/it]
 40%|███▉      | 15153/37963 [47:06:56<77:53:43, 12.29s/it]
 40%|███▉      | 15154/37963 [47:07:06<73:42:38, 11.63s/it]
 40%|███▉      | 15155/37963 [47:07:16<70:43:18, 11.16s/it]
 40%|███▉      | 15156/37963 [47:07:26<68:39:16, 10.84s/it]
 40%|███▉      | 15157/37963 [47:07:36<65:48:36, 10.39s/it]
 40%|███▉      | 15158/37963 [47:07:46<65:13:30, 10.30s/it]
 40%|███▉      | 15159/37963 [47:07:56<64:35:40, 10.20s/it]
 40%|███▉      | 15160/37963 [47:08:06<64:19:00, 10.15s/it]
                                                           
{'loss': '0.1631', 'grad_norm': '2.84', 'learning_rate': '1.366e-05', 'epoch': '0.3993'}

 40%|███▉      | 15160/37963 [47:08:06<64:19:00, 10.15s/it]
 40%|███▉      | 15161/37963 [47:08:15<63:00:55,  9.95s/it]
 40%|███▉      | 15162/37963 [47:08:25<63:13:17,  9.98s/it]
 40%|███▉      | 15163/37963 [47:08:42<76:06:07, 12.02s/it]
 40%|███▉      | 15164/37963 [47:08:58<84:20:39, 13.32s/it]
 40%|███▉      | 15165/37963 [47:09:09<78:24:45, 12.38s/it]
 40%|███▉      | 15166/37963 [47:09:24<85:13:58, 13.46s/it]
 40%|███▉      | 15167/37963 [47:09:35<78:42:39, 12.43s/it]
 40%|███▉      | 15168/37963 [47:09:45<74:06:34, 11.70s/it]
 40%|███▉      | 15169/37963 [47:09:54<70:24:07, 11.12s/it]
 40%|███▉      | 15170/37963 [47:10:04<68:29:26, 10.82s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '3.731', 'learning_rate': '1.365e-05', 'epoch': '0.3996'}

 40%|███▉      | 15170/37963 [47:10:04<68:29:26, 10.82s/it]
 40%|███▉      | 15171/37963 [47:10:14<67:00:45, 10.58s/it]
 40%|███▉      | 15172/37963 [47:10:24<65:30:33, 10.35s/it]
 40%|███▉      | 15173/37963 [47:10:34<65:02:36, 10.27s/it]
 40%|███▉      | 15174/37963 [47:10:44<64:49:20, 10.24s/it]
 40%|███▉      | 15175/37963 [47:10:54<64:16:50, 10.15s/it]
 40%|███▉      | 15176/37963 [47:11:05<64:07:13, 10.13s/it]
 40%|███▉      | 15177/37963 [47:11:15<64:02:38, 10.12s/it]
 40%|███▉      | 15178/37963 [47:11:25<63:49:18, 10.08s/it]
 40%|███▉      | 15179/37963 [47:11:34<63:03:19,  9.96s/it]
 40%|███▉      | 15180/37963 [47:11:51<75:40:10, 11.96s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '1.962', 'learning_rate': '1.364e-05', 'epoch': '0.3999'}

 40%|███▉      | 15180/37963 [47:11:51<75:40:10, 11.96s/it]
 40%|███▉      | 15181/37963 [47:12:08<84:34:11, 13.36s/it]
 40%|███▉      | 15182/37963 [47:12:24<91:21:22, 14.44s/it]
 40%|███▉      | 15183/37963 [47:12:35<83:05:59, 13.13s/it]
 40%|███▉      | 15184/37963 [47:12:45<77:14:07, 12.21s/it]
 40%|███▉      | 15185/37963 [47:12:55<73:11:40, 11.57s/it]
 40%|████      | 15186/37963 [47:13:05<70:25:34, 11.13s/it]
 40%|████      | 15187/37963 [47:13:15<68:43:36, 10.86s/it]
 40%|████      | 15188/37963 [47:13:25<67:19:12, 10.64s/it]
 40%|████      | 15189/37963 [47:13:35<66:03:40, 10.44s/it]
 40%|████      | 15190/37963 [47:13:45<65:01:23, 10.28s/it]
                                                           
{'loss': '0.1574', 'grad_norm': '1.309', 'learning_rate': '1.364e-05', 'epoch': '0.4001'}

 40%|████      | 15190/37963 [47:13:45<65:01:23, 10.28s/it]
 40%|████      | 15191/37963 [47:13:55<64:18:18, 10.17s/it]
 40%|████      | 15192/37963 [47:14:05<64:07:02, 10.14s/it]
 40%|████      | 15193/37963 [47:14:15<63:29:20, 10.04s/it]
 40%|████      | 15194/37963 [47:14:25<63:35:13, 10.05s/it]
 40%|████      | 15195/37963 [47:14:41<75:54:12, 12.00s/it]
 40%|████      | 15196/37963 [47:14:52<72:27:54, 11.46s/it]
 40%|████      | 15197/37963 [47:15:01<69:19:53, 10.96s/it]
 40%|████      | 15198/37963 [47:15:11<67:26:48, 10.67s/it]
 40%|████      | 15199/37963 [47:15:22<66:23:35, 10.50s/it]
 40%|████      | 15200/37963 [47:15:32<65:53:13, 10.42s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '2.594', 'learning_rate': '1.363e-05', 'epoch': '0.4004'}

 40%|████      | 15200/37963 [47:15:32<65:53:13, 10.42s/it]
 40%|████      | 15201/37963 [47:15:42<65:21:00, 10.34s/it]
 40%|████      | 15202/37963 [47:15:59<78:01:12, 12.34s/it]
 40%|████      | 15203/37963 [47:16:09<73:46:40, 11.67s/it]
 40%|████      | 15204/37963 [47:16:19<70:05:17, 11.09s/it]
 40%|████      | 15205/37963 [47:16:29<68:19:17, 10.81s/it]
 40%|████      | 15206/37963 [47:16:39<66:52:55, 10.58s/it]
 40%|████      | 15207/37963 [47:16:49<65:54:22, 10.43s/it]
 40%|████      | 15208/37963 [47:16:59<65:12:15, 10.32s/it]
 40%|████      | 15209/37963 [47:17:09<64:27:17, 10.20s/it]
 40%|████      | 15210/37963 [47:17:19<64:28:47, 10.20s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '1.097', 'learning_rate': '1.362e-05', 'epoch': '0.4007'}

 40%|████      | 15210/37963 [47:17:19<64:28:47, 10.20s/it]
 40%|████      | 15211/37963 [47:17:42<88:15:38, 13.97s/it]
 40%|████      | 15212/37963 [47:17:52<80:53:45, 12.80s/it]
 40%|████      | 15213/37963 [47:18:08<87:36:19, 13.86s/it]
 40%|████      | 15214/37963 [47:18:18<80:07:43, 12.68s/it]
 40%|████      | 15215/37963 [47:18:28<75:19:43, 11.92s/it]
 40%|████      | 15216/37963 [47:18:39<71:57:37, 11.39s/it]
 40%|████      | 15217/37963 [47:18:49<69:40:39, 11.03s/it]
 40%|████      | 15218/37963 [47:18:59<67:50:15, 10.74s/it]
 40%|████      | 15219/37963 [47:19:09<66:05:38, 10.46s/it]
 40%|████      | 15220/37963 [47:19:19<65:15:46, 10.33s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '2.255', 'learning_rate': '1.361e-05', 'epoch': '0.4009'}

 40%|████      | 15220/37963 [47:19:19<65:15:46, 10.33s/it]
 40%|████      | 15221/37963 [47:19:29<64:49:29, 10.26s/it]
 40%|████      | 15222/37963 [47:19:39<64:28:52, 10.21s/it]
 40%|████      | 15223/37963 [47:19:49<63:36:27, 10.07s/it]
 40%|████      | 15224/37963 [47:19:58<63:03:57,  9.98s/it]
 40%|████      | 15225/37963 [47:20:09<63:15:40, 10.02s/it]
 40%|████      | 15226/37963 [47:20:19<63:29:10, 10.05s/it]
 40%|████      | 15227/37963 [47:20:29<63:33:13, 10.06s/it]
 40%|████      | 15228/37963 [47:20:45<75:33:56, 11.97s/it]
 40%|████      | 15229/37963 [47:21:01<83:31:47, 13.23s/it]
 40%|████      | 15230/37963 [47:21:19<91:52:26, 14.55s/it]
                                                           
{'loss': '0.3492', 'grad_norm': '2.775', 'learning_rate': '1.36e-05', 'epoch': '0.4012'}

 40%|████      | 15230/37963 [47:21:19<91:52:26, 14.55s/it]
 40%|████      | 15231/37963 [47:21:29<83:36:10, 13.24s/it]
 40%|████      | 15232/37963 [47:21:39<77:35:29, 12.29s/it]
 40%|████      | 15233/37963 [47:21:49<73:06:36, 11.58s/it]
 40%|████      | 15234/37963 [47:21:59<70:19:32, 11.14s/it]
 40%|████      | 15235/37963 [47:22:09<68:18:53, 10.82s/it]
 40%|████      | 15236/37963 [47:22:19<66:51:28, 10.59s/it]
 40%|████      | 15237/37963 [47:22:29<65:58:21, 10.45s/it]
 40%|████      | 15238/37963 [47:22:40<65:18:54, 10.35s/it]
 40%|████      | 15239/37963 [47:22:49<64:00:11, 10.14s/it]
 40%|████      | 15240/37963 [47:22:59<63:52:49, 10.12s/it]
                                                           
{'loss': '0.357', 'grad_norm': '0.9086', 'learning_rate': '1.36e-05', 'epoch': '0.4014'}

 40%|████      | 15240/37963 [47:22:59<63:52:49, 10.12s/it]
 40%|████      | 15241/37963 [47:23:10<64:00:26, 10.14s/it]
 40%|████      | 15242/37963 [47:23:26<75:58:08, 12.04s/it]
 40%|████      | 15243/37963 [47:23:36<72:11:03, 11.44s/it]
 40%|████      | 15244/37963 [47:23:46<69:11:31, 10.96s/it]
 40%|████      | 15245/37963 [47:23:55<66:31:07, 10.54s/it]
 40%|████      | 15246/37963 [47:24:05<65:30:47, 10.38s/it]
 40%|████      | 15247/37963 [47:24:16<64:58:22, 10.30s/it]
 40%|████      | 15248/37963 [47:24:26<64:43:56, 10.26s/it]
 40%|████      | 15249/37963 [47:24:36<64:24:44, 10.21s/it]
 40%|████      | 15250/37963 [47:24:53<77:16:28, 12.25s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '0.8711', 'learning_rate': '1.359e-05', 'epoch': '0.4017'}

 40%|████      | 15250/37963 [47:24:53<77:16:28, 12.25s/it]
 40%|████      | 15251/37963 [47:25:03<73:06:43, 11.59s/it]
 40%|████      | 15252/37963 [47:25:13<70:16:05, 11.14s/it]
 40%|████      | 15253/37963 [47:25:23<68:23:25, 10.84s/it]
 40%|████      | 15254/37963 [47:25:33<67:07:38, 10.64s/it]
 40%|████      | 15255/37963 [47:25:43<66:03:00, 10.47s/it]
 40%|████      | 15256/37963 [47:25:53<65:05:02, 10.32s/it]
 40%|████      | 15257/37963 [47:26:03<64:39:44, 10.25s/it]
 40%|████      | 15258/37963 [47:26:13<64:05:52, 10.16s/it]
 40%|████      | 15259/37963 [47:26:23<63:46:35, 10.11s/it]
 40%|████      | 15260/37963 [47:26:46<87:17:10, 13.84s/it]
                                                           
{'loss': '0.1535', 'grad_norm': '2.263', 'learning_rate': '1.358e-05', 'epoch': '0.402'}

 40%|████      | 15260/37963 [47:26:46<87:17:10, 13.84s/it]
 40%|████      | 15261/37963 [47:26:56<80:27:22, 12.76s/it]
 40%|████      | 15262/37963 [47:27:13<87:49:41, 13.93s/it]
 40%|████      | 15263/37963 [47:27:23<80:38:52, 12.79s/it]
 40%|████      | 15264/37963 [47:27:33<75:38:21, 12.00s/it]
 40%|████      | 15265/37963 [47:27:43<72:15:42, 11.46s/it]
 40%|████      | 15266/37963 [47:27:53<69:54:07, 11.09s/it]
 40%|████      | 15267/37963 [47:28:04<68:03:43, 10.80s/it]
 40%|████      | 15268/37963 [47:28:14<66:25:24, 10.54s/it]
 40%|████      | 15269/37963 [47:28:23<65:00:40, 10.31s/it]
 40%|████      | 15270/37963 [47:28:33<64:36:39, 10.25s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '2.152', 'learning_rate': '1.357e-05', 'epoch': '0.4022'}

 40%|████      | 15270/37963 [47:28:33<64:36:39, 10.25s/it]
 40%|████      | 15271/37963 [47:28:44<64:17:11, 10.20s/it]
 40%|████      | 15272/37963 [47:28:54<64:10:14, 10.18s/it]
 40%|████      | 15273/37963 [47:29:04<64:06:59, 10.17s/it]
 40%|████      | 15274/37963 [47:29:14<63:59:06, 10.15s/it]
 40%|████      | 15275/37963 [47:29:24<63:36:08, 10.09s/it]
 40%|████      | 15276/37963 [47:29:41<76:02:32, 12.07s/it]
 40%|████      | 15277/37963 [47:30:04<97:21:54, 15.45s/it]
 40%|████      | 15278/37963 [47:30:14<87:00:25, 13.81s/it]
 40%|████      | 15279/37963 [47:30:24<79:57:05, 12.69s/it]
 40%|████      | 15280/37963 [47:30:34<74:59:24, 11.90s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '2.038', 'learning_rate': '1.356e-05', 'epoch': '0.4025'}

 40%|████      | 15280/37963 [47:30:34<74:59:24, 11.90s/it]
 40%|████      | 15281/37963 [47:30:44<71:44:16, 11.39s/it]
 40%|████      | 15282/37963 [47:30:54<69:18:51, 11.00s/it]
 40%|████      | 15283/37963 [47:31:04<67:33:07, 10.72s/it]
 40%|████      | 15284/37963 [47:31:15<66:30:02, 10.56s/it]
 40%|████      | 15285/37963 [47:31:24<65:20:41, 10.37s/it]
 40%|████      | 15286/37963 [47:31:35<64:45:15, 10.28s/it]
 40%|████      | 15287/37963 [47:31:45<64:25:54, 10.23s/it]
 40%|████      | 15288/37963 [47:32:01<76:05:34, 12.08s/it]
 40%|████      | 15289/37963 [47:32:11<72:10:31, 11.46s/it]
 40%|████      | 15290/37963 [47:32:21<69:33:57, 11.05s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '0.9733', 'learning_rate': '1.356e-05', 'epoch': '0.4028'}

 40%|████      | 15290/37963 [47:32:21<69:33:57, 11.05s/it]
 40%|████      | 15291/37963 [47:32:31<67:39:39, 10.74s/it]
 40%|████      | 15292/37963 [47:32:41<66:23:02, 10.54s/it]
 40%|████      | 15293/37963 [47:32:51<65:20:27, 10.38s/it]
 40%|████      | 15294/37963 [47:33:01<64:44:11, 10.28s/it]
 40%|████      | 15295/37963 [47:33:11<64:18:11, 10.21s/it]
 40%|████      | 15296/37963 [47:33:21<63:53:56, 10.15s/it]
 40%|████      | 15297/37963 [47:33:38<75:34:31, 12.00s/it]
 40%|████      | 15298/37963 [47:33:48<72:11:15, 11.47s/it]
 40%|████      | 15299/37963 [47:33:58<68:52:53, 10.94s/it]
 40%|████      | 15300/37963 [47:34:07<66:50:47, 10.62s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '3.288', 'learning_rate': '1.355e-05', 'epoch': '0.403'}

 40%|████      | 15300/37963 [47:34:07<66:50:47, 10.62s/it]
 40%|████      | 15301/37963 [47:34:17<65:23:55, 10.39s/it]
 40%|████      | 15302/37963 [47:34:27<64:43:58, 10.28s/it]
 40%|████      | 15303/37963 [47:34:37<64:24:28, 10.23s/it]
 40%|████      | 15304/37963 [47:34:48<64:16:34, 10.21s/it]
 40%|████      | 15305/37963 [47:34:57<63:30:49, 10.09s/it]
 40%|████      | 15306/37963 [47:35:08<63:38:35, 10.11s/it]
 40%|████      | 15307/37963 [47:35:24<75:26:24, 11.99s/it]
 40%|████      | 15308/37963 [47:35:41<84:12:26, 13.38s/it]
 40%|████      | 15309/37963 [47:35:51<78:11:28, 12.43s/it]
 40%|████      | 15310/37963 [47:36:07<85:02:43, 13.52s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '1.563', 'learning_rate': '1.354e-05', 'epoch': '0.4033'}

 40%|████      | 15310/37963 [47:36:07<85:02:43, 13.52s/it]
 40%|████      | 15311/37963 [47:36:17<78:11:17, 12.43s/it]
 40%|████      | 15312/37963 [47:36:27<73:56:51, 11.75s/it]
 40%|████      | 15313/37963 [47:36:37<70:54:42, 11.27s/it]
 40%|████      | 15314/37963 [47:36:47<68:46:50, 10.93s/it]
 40%|████      | 15315/37963 [47:36:57<67:13:11, 10.68s/it]
 40%|████      | 15316/37963 [47:37:07<66:02:19, 10.50s/it]
 40%|████      | 15317/37963 [47:37:17<64:58:43, 10.33s/it]
 40%|████      | 15318/37963 [47:37:27<64:32:36, 10.26s/it]
 40%|████      | 15319/37963 [47:37:37<63:46:20, 10.14s/it]
 40%|████      | 15320/37963 [47:37:47<63:42:04, 10.13s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '1.972', 'learning_rate': '1.353e-05', 'epoch': '0.4036'}

 40%|████      | 15320/37963 [47:37:47<63:42:04, 10.13s/it]
 40%|████      | 15321/37963 [47:37:57<63:35:36, 10.11s/it]
 40%|████      | 15322/37963 [47:38:07<63:06:25, 10.03s/it]
 40%|████      | 15323/37963 [47:38:17<62:54:16, 10.00s/it]
 40%|████      | 15324/37963 [47:38:34<75:07:10, 11.95s/it]
 40%|████      | 15325/37963 [47:38:50<83:56:30, 13.35s/it]
 40%|████      | 15326/37963 [47:39:00<77:47:39, 12.37s/it]
 40%|████      | 15327/37963 [47:39:18<87:05:39, 13.85s/it]
 40%|████      | 15328/37963 [47:39:28<80:06:25, 12.74s/it]
 40%|████      | 15329/37963 [47:39:38<74:52:59, 11.91s/it]
 40%|████      | 15330/37963 [47:39:48<71:28:18, 11.37s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '1.436', 'learning_rate': '1.352e-05', 'epoch': '0.4038'}

 40%|████      | 15330/37963 [47:39:48<71:28:18, 11.37s/it]
 40%|████      | 15331/37963 [47:39:58<68:21:32, 10.87s/it]
 40%|████      | 15332/37963 [47:40:08<66:56:13, 10.65s/it]
 40%|████      | 15333/37963 [47:40:18<65:46:37, 10.46s/it]
 40%|████      | 15334/37963 [47:40:28<65:04:23, 10.35s/it]
 40%|████      | 15335/37963 [47:40:38<64:22:35, 10.24s/it]
 40%|████      | 15336/37963 [47:40:48<64:04:32, 10.19s/it]
 40%|████      | 15337/37963 [47:40:58<63:57:17, 10.18s/it]
 40%|████      | 15338/37963 [47:41:14<75:30:08, 12.01s/it]
 40%|████      | 15339/37963 [47:41:24<71:44:24, 11.42s/it]
 40%|████      | 15340/37963 [47:41:34<68:43:33, 10.94s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '2.042', 'learning_rate': '1.352e-05', 'epoch': '0.4041'}

 40%|████      | 15340/37963 [47:41:34<68:43:33, 10.94s/it]
 40%|████      | 15341/37963 [47:41:44<67:16:42, 10.71s/it]
 40%|████      | 15342/37963 [47:41:54<66:04:03, 10.51s/it]
 40%|████      | 15343/37963 [47:42:04<64:57:58, 10.34s/it]
 40%|████      | 15344/37963 [47:42:14<64:22:57, 10.25s/it]
 40%|████      | 15345/37963 [47:42:31<76:15:57, 12.14s/it]
 40%|████      | 15346/37963 [47:42:41<72:31:02, 11.54s/it]
 40%|████      | 15347/37963 [47:42:51<70:03:18, 11.15s/it]
 40%|████      | 15348/37963 [47:43:02<68:11:55, 10.86s/it]
 40%|████      | 15349/37963 [47:43:12<66:45:15, 10.63s/it]
 40%|████      | 15350/37963 [47:43:22<65:48:22, 10.48s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '1.394', 'learning_rate': '1.351e-05', 'epoch': '0.4043'}

 40%|████      | 15350/37963 [47:43:22<65:48:22, 10.48s/it]
 40%|████      | 15351/37963 [47:43:32<65:02:38, 10.36s/it]
 40%|████      | 15352/37963 [47:43:42<64:27:55, 10.26s/it]
 40%|████      | 15353/37963 [47:43:52<63:48:26, 10.16s/it]
 40%|████      | 15354/37963 [47:44:02<63:45:16, 10.15s/it]
 40%|████      | 15355/37963 [47:44:12<63:30:44, 10.11s/it]
 40%|████      | 15356/37963 [47:44:28<75:20:19, 12.00s/it]
 40%|████      | 15357/37963 [47:44:45<83:52:17, 13.36s/it]
 40%|████      | 15358/37963 [47:44:55<77:10:05, 12.29s/it]
 40%|████      | 15359/37963 [47:45:11<84:54:08, 13.52s/it]
 40%|████      | 15360/37963 [47:45:21<77:47:42, 12.39s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '1.228', 'learning_rate': '1.35e-05', 'epoch': '0.4046'}

 40%|████      | 15360/37963 [47:45:21<77:47:42, 12.39s/it]
 40%|████      | 15361/37963 [47:45:31<73:25:53, 11.70s/it]
 40%|████      | 15362/37963 [47:45:41<70:30:46, 11.23s/it]
 40%|████      | 15363/37963 [47:45:51<67:44:20, 10.79s/it]
 40%|████      | 15364/37963 [47:46:01<66:27:23, 10.59s/it]
 40%|████      | 15365/37963 [47:46:11<65:33:52, 10.44s/it]
 40%|████      | 15366/37963 [47:46:21<64:53:59, 10.34s/it]
 40%|████      | 15367/37963 [47:46:31<64:32:32, 10.28s/it]
 40%|████      | 15368/37963 [47:46:41<64:07:40, 10.22s/it]
 40%|████      | 15369/37963 [47:46:51<63:54:24, 10.18s/it]
 40%|████      | 15370/37963 [47:47:02<63:46:27, 10.16s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '2.387', 'learning_rate': '1.349e-05', 'epoch': '0.4049'}

 40%|████      | 15370/37963 [47:47:02<63:46:27, 10.16s/it]
 40%|████      | 15371/37963 [47:47:18<76:00:48, 12.11s/it]
 40%|████      | 15372/37963 [47:47:29<72:31:39, 11.56s/it]
 40%|████      | 15373/37963 [47:47:45<81:52:01, 13.05s/it]
 40%|████      | 15374/37963 [47:48:02<89:25:52, 14.25s/it]
 40%|████      | 15375/37963 [47:48:12<81:08:08, 12.93s/it]
 41%|████      | 15376/37963 [47:48:22<75:31:21, 12.04s/it]
 41%|████      | 15377/37963 [47:48:32<71:43:19, 11.43s/it]
 41%|████      | 15378/37963 [47:48:42<69:16:21, 11.04s/it]
 41%|████      | 15379/37963 [47:48:52<66:25:47, 10.59s/it]
 41%|████      | 15380/37963 [47:49:02<65:13:13, 10.40s/it]
                                                           
{'loss': '0.141', 'grad_norm': '1.34', 'learning_rate': '1.348e-05', 'epoch': '0.4051'}

 41%|████      | 15380/37963 [47:49:02<65:13:13, 10.40s/it]
 41%|████      | 15381/37963 [47:49:11<63:36:58, 10.14s/it]
 41%|████      | 15382/37963 [47:49:21<63:20:39, 10.10s/it]
 41%|████      | 15383/37963 [47:49:31<63:11:16, 10.07s/it]
 41%|████      | 15384/37963 [47:49:41<62:48:12, 10.01s/it]
 41%|████      | 15385/37963 [47:49:51<62:59:39, 10.04s/it]
 41%|████      | 15386/37963 [47:50:01<63:04:52, 10.06s/it]
 41%|████      | 15387/37963 [47:50:18<75:41:45, 12.07s/it]
 41%|████      | 15388/37963 [47:50:28<71:41:08, 11.43s/it]
 41%|████      | 15389/37963 [47:50:37<68:15:50, 10.89s/it]
 41%|████      | 15390/37963 [47:50:48<66:51:46, 10.66s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '3.648', 'learning_rate': '1.348e-05', 'epoch': '0.4054'}

 41%|████      | 15390/37963 [47:50:48<66:51:46, 10.66s/it]
 41%|████      | 15391/37963 [47:51:04<78:24:11, 12.50s/it]
 41%|████      | 15392/37963 [47:51:15<73:51:39, 11.78s/it]
 41%|████      | 15393/37963 [47:51:25<70:40:15, 11.27s/it]
 41%|████      | 15394/37963 [47:51:35<68:23:40, 10.91s/it]
 41%|████      | 15395/37963 [47:51:45<67:08:34, 10.71s/it]
 41%|████      | 15396/37963 [47:51:55<66:12:16, 10.56s/it]
 41%|████      | 15397/37963 [47:52:05<65:25:29, 10.44s/it]
 41%|████      | 15398/37963 [47:52:15<64:04:13, 10.22s/it]
 41%|████      | 15399/37963 [47:52:25<63:46:54, 10.18s/it]
 41%|████      | 15400/37963 [47:52:35<63:34:23, 10.14s/it]
                                                           
{'loss': '0.1448', 'grad_norm': '0.7007', 'learning_rate': '1.347e-05', 'epoch': '0.4057'}

 41%|████      | 15400/37963 [47:52:35<63:34:23, 10.14s/it]
 41%|████      | 15401/37963 [47:52:45<63:34:00, 10.14s/it]
 41%|████      | 15402/37963 [47:52:56<63:58:51, 10.21s/it]
 41%|████      | 15403/37963 [47:53:06<63:50:42, 10.19s/it]
 41%|████      | 15404/37963 [47:53:22<75:23:29, 12.03s/it]
 41%|████      | 15405/37963 [47:53:32<71:43:01, 11.45s/it]
 41%|████      | 15406/37963 [47:53:55<93:12:56, 14.88s/it]
 41%|████      | 15407/37963 [47:54:05<83:48:38, 13.38s/it]
 41%|████      | 15408/37963 [47:54:15<77:24:22, 12.35s/it]
 41%|████      | 15409/37963 [47:54:25<72:36:11, 11.59s/it]
 41%|████      | 15410/37963 [47:54:35<69:46:25, 11.14s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '0.7089', 'learning_rate': '1.346e-05', 'epoch': '0.4059'}

 41%|████      | 15410/37963 [47:54:35<69:46:25, 11.14s/it]
 41%|████      | 15411/37963 [47:54:45<67:46:46, 10.82s/it]
 41%|████      | 15412/37963 [47:54:55<66:21:27, 10.59s/it]
 41%|████      | 15413/37963 [47:55:05<65:39:16, 10.48s/it]
 41%|████      | 15414/37963 [47:55:15<64:53:17, 10.36s/it]
 41%|████      | 15415/37963 [47:55:25<64:11:55, 10.25s/it]
 41%|████      | 15416/37963 [47:55:35<63:24:06, 10.12s/it]
 41%|████      | 15417/37963 [47:55:45<63:22:56, 10.12s/it]
 41%|████      | 15418/37963 [47:55:55<63:13:22, 10.10s/it]
 41%|████      | 15419/37963 [47:56:05<62:51:44, 10.04s/it]
 41%|████      | 15420/37963 [47:56:22<75:11:28, 12.01s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '1.635', 'learning_rate': '1.345e-05', 'epoch': '0.4062'}

 41%|████      | 15420/37963 [47:56:22<75:11:28, 12.01s/it]
 41%|████      | 15421/37963 [47:56:38<83:12:29, 13.29s/it]
 41%|████      | 15422/37963 [47:56:48<77:08:14, 12.32s/it]
 41%|████      | 15423/37963 [47:57:05<85:41:10, 13.69s/it]
 41%|████      | 15424/37963 [47:57:15<78:43:24, 12.57s/it]
 41%|████      | 15425/37963 [47:57:25<73:47:13, 11.79s/it]
 41%|████      | 15426/37963 [47:57:35<70:33:38, 11.27s/it]
 41%|████      | 15427/37963 [47:57:45<68:16:56, 10.91s/it]
 41%|████      | 15428/37963 [47:57:55<66:38:43, 10.65s/it]
 41%|████      | 15429/37963 [47:58:05<65:30:01, 10.46s/it]
 41%|████      | 15430/37963 [47:58:15<64:22:03, 10.28s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '2.31', 'learning_rate': '1.344e-05', 'epoch': '0.4064'}

 41%|████      | 15430/37963 [47:58:15<64:22:03, 10.28s/it]
 41%|████      | 15431/37963 [47:58:25<64:03:21, 10.23s/it]
 41%|████      | 15432/37963 [47:58:35<63:45:52, 10.19s/it]
 41%|████      | 15433/37963 [47:58:45<63:33:17, 10.16s/it]
 41%|████      | 15434/37963 [47:59:01<74:49:09, 11.96s/it]
 41%|████      | 15435/37963 [47:59:11<71:20:09, 11.40s/it]
 41%|████      | 15436/37963 [47:59:21<68:25:29, 10.93s/it]
 41%|████      | 15437/37963 [47:59:31<66:49:13, 10.68s/it]
 41%|████      | 15438/37963 [47:59:41<65:40:49, 10.50s/it]
 41%|████      | 15439/37963 [47:59:59<78:12:46, 12.50s/it]
 41%|████      | 15440/37963 [48:00:08<72:53:14, 11.65s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '2.444', 'learning_rate': '1.344e-05', 'epoch': '0.4067'}

 41%|████      | 15440/37963 [48:00:08<72:53:14, 11.65s/it]
 41%|████      | 15441/37963 [48:00:18<70:00:43, 11.19s/it]
 41%|████      | 15442/37963 [48:00:28<66:59:03, 10.71s/it]
 41%|████      | 15443/37963 [48:00:38<65:57:13, 10.54s/it]
 41%|████      | 15444/37963 [48:00:48<64:56:52, 10.38s/it]
 41%|████      | 15445/37963 [48:00:58<64:20:28, 10.29s/it]
 41%|████      | 15446/37963 [48:01:08<63:59:31, 10.23s/it]
 41%|████      | 15447/37963 [48:01:18<63:43:49, 10.19s/it]
 41%|████      | 15448/37963 [48:01:29<63:44:49, 10.19s/it]
 41%|████      | 15449/37963 [48:01:39<63:36:16, 10.17s/it]
 41%|████      | 15450/37963 [48:01:49<63:14:39, 10.11s/it]
                                                           
{'loss': '0.1678', 'grad_norm': '1.97', 'learning_rate': '1.343e-05', 'epoch': '0.407'}

 41%|████      | 15450/37963 [48:01:49<63:14:39, 10.11s/it]
 41%|████      | 15451/37963 [48:01:59<63:20:27, 10.13s/it]
 41%|████      | 15452/37963 [48:02:09<63:18:24, 10.12s/it]
 41%|████      | 15453/37963 [48:02:26<75:21:40, 12.05s/it]
 41%|████      | 15454/37963 [48:02:42<83:33:06, 13.36s/it]
 41%|████      | 15455/37963 [48:02:58<89:14:15, 14.27s/it]
 41%|████      | 15456/37963 [48:03:09<81:28:12, 13.03s/it]
 41%|████      | 15457/37963 [48:03:19<75:44:10, 12.11s/it]
 41%|████      | 15458/37963 [48:03:29<71:49:28, 11.49s/it]
 41%|████      | 15459/37963 [48:03:39<69:06:29, 11.06s/it]
 41%|████      | 15460/37963 [48:03:49<67:10:35, 10.75s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '3.989', 'learning_rate': '1.342e-05', 'epoch': '0.4072'}

 41%|████      | 15460/37963 [48:03:49<67:10:35, 10.75s/it]
 41%|████      | 15461/37963 [48:03:59<66:00:21, 10.56s/it]
 41%|████      | 15462/37963 [48:04:09<65:03:41, 10.41s/it]
 41%|████      | 15463/37963 [48:04:19<64:15:01, 10.28s/it]
 41%|████      | 15464/37963 [48:04:29<63:56:50, 10.23s/it]
 41%|████      | 15465/37963 [48:04:39<63:42:35, 10.19s/it]
 41%|████      | 15466/37963 [48:04:49<63:26:25, 10.15s/it]
 41%|████      | 15467/37963 [48:04:59<63:14:28, 10.12s/it]
 41%|████      | 15468/37963 [48:05:22<87:13:02, 13.96s/it]
 41%|████      | 15469/37963 [48:05:32<80:04:51, 12.82s/it]
 41%|████      | 15470/37963 [48:05:42<74:31:33, 11.93s/it]
                                                           
{'loss': '0.1384', 'grad_norm': '0.9568', 'learning_rate': '1.341e-05', 'epoch': '0.4075'}

 41%|████      | 15470/37963 [48:05:42<74:31:33, 11.93s/it]
 41%|████      | 15471/37963 [48:05:52<70:28:18, 11.28s/it]
 41%|████      | 15472/37963 [48:06:08<80:27:41, 12.88s/it]
 41%|████      | 15473/37963 [48:06:18<74:37:17, 11.94s/it]
 41%|████      | 15474/37963 [48:06:28<70:09:24, 11.23s/it]
 41%|████      | 15475/37963 [48:06:38<68:00:56, 10.89s/it]
 41%|████      | 15476/37963 [48:06:48<66:28:54, 10.64s/it]
 41%|████      | 15477/37963 [48:06:58<64:41:39, 10.36s/it]
 41%|████      | 15478/37963 [48:07:08<64:20:40, 10.30s/it]
 41%|████      | 15479/37963 [48:07:18<63:58:16, 10.24s/it]
 41%|████      | 15480/37963 [48:07:28<63:21:37, 10.15s/it]
                                                           
{'loss': '0.144', 'grad_norm': '1.126', 'learning_rate': '1.34e-05', 'epoch': '0.4078'}

 41%|████      | 15480/37963 [48:07:28<63:21:37, 10.15s/it]
 41%|████      | 15481/37963 [48:07:38<63:00:02, 10.09s/it]
 41%|████      | 15482/37963 [48:07:48<62:54:50, 10.07s/it]
 41%|████      | 15483/37963 [48:08:04<74:54:56, 12.00s/it]
 41%|████      | 15484/37963 [48:08:14<71:20:50, 11.43s/it]
 41%|████      | 15485/37963 [48:08:24<68:14:32, 10.93s/it]
 41%|████      | 15486/37963 [48:08:40<78:21:08, 12.55s/it]
 41%|████      | 15487/37963 [48:08:51<73:50:45, 11.83s/it]
 41%|████      | 15488/37963 [48:09:01<70:24:05, 11.28s/it]
 41%|████      | 15489/37963 [48:09:11<68:26:50, 10.96s/it]
 41%|████      | 15490/37963 [48:09:21<66:50:34, 10.71s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '2.445', 'learning_rate': '1.34e-05', 'epoch': '0.408'}

 41%|████      | 15490/37963 [48:09:21<66:50:34, 10.71s/it]
 41%|████      | 15491/37963 [48:09:31<65:31:19, 10.50s/it]
 41%|████      | 15492/37963 [48:09:41<64:40:47, 10.36s/it]
 41%|████      | 15493/37963 [48:09:51<64:06:34, 10.27s/it]
 41%|████      | 15494/37963 [48:10:01<63:39:55, 10.20s/it]
 41%|████      | 15495/37963 [48:10:11<63:24:32, 10.16s/it]
 41%|████      | 15496/37963 [48:10:21<63:13:19, 10.13s/it]
 41%|████      | 15497/37963 [48:10:31<63:03:09, 10.10s/it]
 41%|████      | 15498/37963 [48:10:41<63:04:50, 10.11s/it]
 41%|████      | 15499/37963 [48:10:52<63:13:09, 10.13s/it]
 41%|████      | 15500/37963 [48:11:08<75:15:37, 12.06s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '3.064', 'learning_rate': '1.339e-05', 'epoch': '0.4083'}

 41%|████      | 15500/37963 [48:11:08<75:15:37, 12.06s/it]
 41%|████      | 15501/37963 [48:11:18<71:45:38, 11.50s/it]
 41%|████      | 15502/37963 [48:11:35<81:01:37, 12.99s/it]
 41%|████      | 15503/37963 [48:11:44<74:54:47, 12.01s/it]
 41%|████      | 15504/37963 [48:12:01<83:52:35, 13.44s/it]
 41%|████      | 15505/37963 [48:12:11<77:04:15, 12.35s/it]
 41%|████      | 15506/37963 [48:12:21<72:53:40, 11.69s/it]
 41%|████      | 15507/37963 [48:12:31<70:01:45, 11.23s/it]
 41%|████      | 15508/37963 [48:12:42<68:01:30, 10.91s/it]
 41%|████      | 15509/37963 [48:12:52<66:31:15, 10.67s/it]
 41%|████      | 15510/37963 [48:13:02<65:28:28, 10.50s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '1.579', 'learning_rate': '1.338e-05', 'epoch': '0.4086'}

 41%|████      | 15510/37963 [48:13:02<65:28:28, 10.50s/it]
 41%|████      | 15511/37963 [48:13:12<64:47:29, 10.39s/it]
 41%|████      | 15512/37963 [48:13:22<64:27:12, 10.34s/it]
 41%|████      | 15513/37963 [48:13:32<63:26:31, 10.17s/it]
 41%|████      | 15514/37963 [48:13:42<63:13:03, 10.14s/it]
 41%|████      | 15515/37963 [48:13:52<63:18:50, 10.15s/it]
 41%|████      | 15516/37963 [48:14:02<62:34:05, 10.03s/it]
 41%|████      | 15517/37963 [48:14:19<75:07:43, 12.05s/it]
 41%|████      | 15518/37963 [48:14:35<83:30:42, 13.39s/it]
 41%|████      | 15519/37963 [48:14:45<77:22:14, 12.41s/it]
 41%|████      | 15520/37963 [48:15:02<84:37:10, 13.57s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '2.543', 'learning_rate': '1.337e-05', 'epoch': '0.4088'}

 41%|████      | 15520/37963 [48:15:02<84:37:10, 13.57s/it]
 41%|████      | 15521/37963 [48:15:12<78:12:10, 12.54s/it]
 41%|████      | 15522/37963 [48:15:22<73:56:32, 11.86s/it]
 41%|████      | 15523/37963 [48:15:32<70:18:50, 11.28s/it]
 41%|████      | 15524/37963 [48:15:42<68:07:38, 10.93s/it]
 41%|████      | 15525/37963 [48:15:52<66:33:20, 10.68s/it]
 41%|████      | 15526/37963 [48:16:02<65:31:38, 10.51s/it]
 41%|████      | 15527/37963 [48:16:12<64:42:43, 10.38s/it]
 41%|████      | 15528/37963 [48:16:22<64:08:55, 10.29s/it]
 41%|████      | 15529/37963 [48:16:32<63:06:40, 10.13s/it]
 41%|████      | 15530/37963 [48:16:42<62:59:12, 10.11s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '2.176', 'learning_rate': '1.336e-05', 'epoch': '0.4091'}

 41%|████      | 15530/37963 [48:16:42<62:59:12, 10.11s/it]
 41%|████      | 15531/37963 [48:16:59<74:40:27, 11.98s/it]
 41%|████      | 15532/37963 [48:17:08<70:32:20, 11.32s/it]
 41%|████      | 15533/37963 [48:17:18<67:55:43, 10.90s/it]
 41%|████      | 15534/37963 [48:17:28<66:30:42, 10.68s/it]
 41%|████      | 15535/37963 [48:17:39<65:28:57, 10.51s/it]
 41%|████      | 15536/37963 [48:17:56<78:07:56, 12.54s/it]
 41%|████      | 15537/37963 [48:18:06<73:28:33, 11.79s/it]
 41%|████      | 15538/37963 [48:18:16<70:14:34, 11.28s/it]
 41%|████      | 15539/37963 [48:18:26<67:55:04, 10.90s/it]
 41%|████      | 15540/37963 [48:18:36<66:15:46, 10.64s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '1.616', 'learning_rate': '1.336e-05', 'epoch': '0.4093'}

 41%|████      | 15540/37963 [48:18:36<66:15:46, 10.64s/it]
 41%|████      | 15541/37963 [48:18:46<64:58:06, 10.43s/it]
 41%|████      | 15542/37963 [48:18:56<64:23:56, 10.34s/it]
 41%|████      | 15543/37963 [48:19:06<63:12:52, 10.15s/it]
 41%|████      | 15544/37963 [48:19:16<63:17:15, 10.16s/it]
 41%|████      | 15545/37963 [48:19:26<63:08:26, 10.14s/it]
 41%|████      | 15546/37963 [48:19:36<62:55:14, 10.10s/it]
 41%|████      | 15547/37963 [48:19:46<62:47:13, 10.08s/it]
 41%|████      | 15548/37963 [48:19:56<62:10:52,  9.99s/it]
 41%|████      | 15549/37963 [48:20:12<73:14:13, 11.76s/it]
 41%|████      | 15550/37963 [48:20:22<70:21:23, 11.30s/it]
                                                           
{'loss': '0.1556', 'grad_norm': '1.01', 'learning_rate': '1.335e-05', 'epoch': '0.4096'}

 41%|████      | 15550/37963 [48:20:22<70:21:23, 11.30s/it]
 41%|████      | 15551/37963 [48:20:39<80:05:55, 12.87s/it]
 41%|████      | 15552/37963 [48:20:55<86:41:13, 13.92s/it]
 41%|████      | 15553/37963 [48:21:05<79:32:43, 12.78s/it]
 41%|████      | 15554/37963 [48:21:15<74:33:21, 11.98s/it]
 41%|████      | 15555/37963 [48:21:25<70:55:07, 11.39s/it]
 41%|████      | 15556/37963 [48:21:35<68:31:29, 11.01s/it]
 41%|████      | 15557/37963 [48:21:45<66:12:58, 10.64s/it]
 41%|████      | 15558/37963 [48:21:55<65:18:43, 10.49s/it]
 41%|████      | 15559/37963 [48:22:05<64:18:28, 10.33s/it]
 41%|████      | 15560/37963 [48:22:15<63:51:26, 10.26s/it]
                                                           
{'loss': '0.1506', 'grad_norm': '1.597', 'learning_rate': '1.334e-05', 'epoch': '0.4099'}

 41%|████      | 15560/37963 [48:22:15<63:51:26, 10.26s/it]
 41%|████      | 15561/37963 [48:22:25<63:36:34, 10.22s/it]
 41%|████      | 15562/37963 [48:22:36<63:28:02, 10.20s/it]
 41%|████      | 15563/37963 [48:22:46<63:17:53, 10.17s/it]
 41%|████      | 15564/37963 [48:22:56<62:53:11, 10.11s/it]
 41%|████      | 15565/37963 [48:23:12<73:55:27, 11.88s/it]
 41%|████      | 15566/37963 [48:23:22<70:38:37, 11.35s/it]
 41%|████      | 15567/37963 [48:23:38<80:07:34, 12.88s/it]
 41%|████      | 15568/37963 [48:23:48<74:50:30, 12.03s/it]
 41%|████      | 15569/37963 [48:23:58<70:45:29, 11.37s/it]
 41%|████      | 15570/37963 [48:24:15<81:48:42, 13.15s/it]
                                                           
{'loss': '0.15', 'grad_norm': '0.9036', 'learning_rate': '1.333e-05', 'epoch': '0.4101'}

 41%|████      | 15570/37963 [48:24:15<81:48:42, 13.15s/it]
 41%|████      | 15571/37963 [48:24:25<76:05:49, 12.23s/it]
 41%|████      | 15572/37963 [48:24:36<72:04:33, 11.59s/it]
 41%|████      | 15573/37963 [48:24:46<69:23:02, 11.16s/it]
 41%|████      | 15574/37963 [48:24:56<67:23:51, 10.84s/it]
 41%|████      | 15575/37963 [48:25:06<65:58:44, 10.61s/it]
 41%|████      | 15576/37963 [48:25:16<64:50:28, 10.43s/it]
 41%|████      | 15577/37963 [48:25:26<64:01:48, 10.30s/it]
 41%|████      | 15578/37963 [48:25:36<63:36:30, 10.23s/it]
 41%|████      | 15579/37963 [48:25:46<63:18:42, 10.18s/it]
 41%|████      | 15580/37963 [48:26:02<73:56:07, 11.89s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '0.6846', 'learning_rate': '1.332e-05', 'epoch': '0.4104'}

 41%|████      | 15580/37963 [48:26:02<73:56:07, 11.89s/it]
 41%|████      | 15581/37963 [48:26:12<70:37:47, 11.36s/it]
 41%|████      | 15582/37963 [48:26:22<68:27:30, 11.01s/it]
 41%|████      | 15583/37963 [48:26:32<67:00:59, 10.78s/it]
 41%|████      | 15584/37963 [48:26:49<77:58:48, 12.54s/it]
 41%|████      | 15585/37963 [48:26:59<73:24:29, 11.81s/it]
 41%|████      | 15586/37963 [48:27:09<70:06:43, 11.28s/it]
 41%|████      | 15587/37963 [48:27:19<67:11:40, 10.81s/it]
 41%|████      | 15588/37963 [48:27:29<65:58:47, 10.62s/it]
 41%|████      | 15589/37963 [48:27:39<64:58:55, 10.46s/it]
 41%|████      | 15590/37963 [48:27:49<64:28:41, 10.38s/it]
                                                           
{'loss': '0.1374', 'grad_norm': '3.88', 'learning_rate': '1.332e-05', 'epoch': '0.4107'}

 41%|████      | 15590/37963 [48:27:49<64:28:41, 10.38s/it]
 41%|████      | 15591/37963 [48:28:00<64:08:53, 10.32s/it]
 41%|████      | 15592/37963 [48:28:09<63:19:57, 10.19s/it]
 41%|████      | 15593/37963 [48:28:19<62:55:11, 10.13s/it]
 41%|████      | 15594/37963 [48:28:29<62:46:33, 10.10s/it]
 41%|████      | 15595/37963 [48:28:40<62:38:15, 10.08s/it]
 41%|████      | 15596/37963 [48:28:49<62:00:33,  9.98s/it]
 41%|████      | 15597/37963 [48:28:59<62:07:32, 10.00s/it]
 41%|████      | 15598/37963 [48:29:09<62:25:29, 10.05s/it]
 41%|████      | 15599/37963 [48:29:32<86:21:11, 13.90s/it]
 41%|████      | 15600/37963 [48:29:49<91:31:29, 14.73s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '1.875', 'learning_rate': '1.331e-05', 'epoch': '0.4109'}

 41%|████      | 15600/37963 [48:29:49<91:31:29, 14.73s/it]
 41%|████      | 15601/37963 [48:29:59<82:47:44, 13.33s/it]
 41%|████      | 15602/37963 [48:30:09<76:26:51, 12.31s/it]
 41%|████      | 15603/37963 [48:30:19<72:25:19, 11.66s/it]
 41%|████      | 15604/37963 [48:30:29<69:27:14, 11.18s/it]
 41%|████      | 15605/37963 [48:30:39<67:34:02, 10.88s/it]
 41%|████      | 15606/37963 [48:30:50<66:10:45, 10.66s/it]
 41%|████      | 15607/37963 [48:30:59<64:21:44, 10.36s/it]
 41%|████      | 15608/37963 [48:31:09<63:21:58, 10.20s/it]
 41%|████      | 15609/37963 [48:31:19<62:17:04, 10.03s/it]
 41%|████      | 15610/37963 [48:31:29<62:21:29, 10.04s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '1.369', 'learning_rate': '1.33e-05', 'epoch': '0.4112'}

 41%|████      | 15610/37963 [48:31:29<62:21:29, 10.04s/it]
 41%|████      | 15611/37963 [48:31:39<62:23:45, 10.05s/it]
 41%|████      | 15612/37963 [48:31:49<62:23:45, 10.05s/it]
 41%|████      | 15613/37963 [48:31:59<62:29:59, 10.07s/it]
 41%|████      | 15614/37963 [48:32:09<62:26:15, 10.06s/it]
 41%|████      | 15615/37963 [48:32:32<86:49:44, 13.99s/it]
 41%|████      | 15616/37963 [48:32:49<92:21:06, 14.88s/it]
 41%|████      | 15617/37963 [48:32:59<83:46:09, 13.50s/it]
 41%|████      | 15618/37963 [48:33:09<77:28:04, 12.48s/it]
 41%|████      | 15619/37963 [48:33:20<73:11:56, 11.79s/it]
 41%|████      | 15620/37963 [48:33:30<70:08:22, 11.30s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '1.154', 'learning_rate': '1.329e-05', 'epoch': '0.4115'}

 41%|████      | 15620/37963 [48:33:30<70:08:22, 11.30s/it]
 41%|████      | 15621/37963 [48:33:40<67:45:06, 10.92s/it]
 41%|████      | 15622/37963 [48:33:50<65:53:24, 10.62s/it]
 41%|████      | 15623/37963 [48:34:00<64:56:29, 10.47s/it]
 41%|████      | 15624/37963 [48:34:10<64:05:22, 10.33s/it]
 41%|████      | 15625/37963 [48:34:20<63:44:17, 10.27s/it]
 41%|████      | 15626/37963 [48:34:30<62:55:12, 10.14s/it]
 41%|████      | 15627/37963 [48:34:40<62:44:25, 10.11s/it]
 41%|████      | 15628/37963 [48:34:56<74:43:22, 12.04s/it]
 41%|████      | 15629/37963 [48:35:07<71:13:24, 11.48s/it]
 41%|████      | 15630/37963 [48:35:17<68:40:18, 11.07s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '1.22', 'learning_rate': '1.328e-05', 'epoch': '0.4117'}

 41%|████      | 15630/37963 [48:35:17<68:40:18, 11.07s/it]
 41%|████      | 15631/37963 [48:35:27<67:02:14, 10.81s/it]
 41%|████      | 15632/37963 [48:35:37<65:51:07, 10.62s/it]
 41%|████      | 15633/37963 [48:35:53<76:29:37, 12.33s/it]
 41%|████      | 15634/37963 [48:36:03<71:47:20, 11.57s/it]
 41%|████      | 15635/37963 [48:36:13<69:09:45, 11.15s/it]
 41%|████      | 15636/37963 [48:36:24<67:17:19, 10.85s/it]
 41%|████      | 15637/37963 [48:36:34<65:52:02, 10.62s/it]
 41%|████      | 15638/37963 [48:36:44<64:44:28, 10.44s/it]
 41%|████      | 15639/37963 [48:36:54<64:01:31, 10.32s/it]
 41%|████      | 15640/37963 [48:37:04<63:38:27, 10.26s/it]
                                                           
{'loss': '0.1429', 'grad_norm': '1.612', 'learning_rate': '1.328e-05', 'epoch': '0.412'}

 41%|████      | 15640/37963 [48:37:04<63:38:27, 10.26s/it]
 41%|████      | 15641/37963 [48:37:14<63:37:50, 10.26s/it]
 41%|████      | 15642/37963 [48:37:24<63:21:39, 10.22s/it]
 41%|████      | 15643/37963 [48:37:34<63:02:17, 10.17s/it]
 41%|████      | 15644/37963 [48:37:44<62:10:21, 10.03s/it]
 41%|████      | 15645/37963 [48:37:54<62:11:55, 10.03s/it]
 41%|████      | 15646/37963 [48:38:04<62:20:39, 10.06s/it]
 41%|████      | 15647/37963 [48:38:21<74:30:42, 12.02s/it]
 41%|████      | 15648/37963 [48:38:31<71:02:20, 11.46s/it]
 41%|████      | 15649/37963 [48:38:54<91:55:49, 14.83s/it]
 41%|████      | 15650/37963 [48:39:04<83:12:16, 13.42s/it]
                                                           
{'loss': '0.1636', 'grad_norm': '2.791', 'learning_rate': '1.327e-05', 'epoch': '0.4122'}

 41%|████      | 15650/37963 [48:39:04<83:12:16, 13.42s/it]
 41%|████      | 15651/37963 [48:39:14<76:56:30, 12.41s/it]
 41%|████      | 15652/37963 [48:39:24<72:30:54, 11.70s/it]
 41%|████      | 15653/37963 [48:39:34<69:47:12, 11.26s/it]
 41%|████      | 15654/37963 [48:39:44<67:48:30, 10.94s/it]
 41%|████      | 15655/37963 [48:39:54<66:24:38, 10.72s/it]
 41%|████      | 15656/37963 [48:40:04<65:05:07, 10.50s/it]
 41%|████      | 15657/37963 [48:40:15<64:25:03, 10.40s/it]
 41%|████      | 15658/37963 [48:40:25<63:50:27, 10.30s/it]
 41%|████      | 15659/37963 [48:40:34<62:35:56, 10.10s/it]
 41%|████▏     | 15660/37963 [48:40:44<62:28:52, 10.09s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '1.03', 'learning_rate': '1.326e-05', 'epoch': '0.4125'}

 41%|████▏     | 15660/37963 [48:40:44<62:28:52, 10.09s/it]
 41%|████▏     | 15661/37963 [48:40:54<62:27:01, 10.08s/it]
 41%|████▏     | 15662/37963 [48:41:05<62:27:58, 10.08s/it]
 41%|████▏     | 15663/37963 [48:41:28<87:18:44, 14.10s/it]
 41%|████▏     | 15664/37963 [48:41:38<79:55:23, 12.90s/it]
 41%|████▏     | 15665/37963 [48:41:55<86:39:35, 13.99s/it]
 41%|████▏     | 15666/37963 [48:42:05<79:23:49, 12.82s/it]
 41%|████▏     | 15667/37963 [48:42:15<74:19:44, 12.00s/it]
 41%|████▏     | 15668/37963 [48:42:25<70:41:49, 11.42s/it]
 41%|████▏     | 15669/37963 [48:42:35<67:53:09, 10.96s/it]
 41%|████▏     | 15670/37963 [48:42:45<66:15:40, 10.70s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '3.128', 'learning_rate': '1.325e-05', 'epoch': '0.4128'}

 41%|████▏     | 15670/37963 [48:42:45<66:15:40, 10.70s/it]
 41%|████▏     | 15671/37963 [48:42:55<65:10:13, 10.52s/it]
 41%|████▏     | 15672/37963 [48:43:05<64:17:21, 10.38s/it]
 41%|████▏     | 15673/37963 [48:43:15<63:42:50, 10.29s/it]
 41%|████▏     | 15674/37963 [48:43:25<63:19:14, 10.23s/it]
 41%|████▏     | 15675/37963 [48:43:35<62:51:50, 10.15s/it]
 41%|████▏     | 15676/37963 [48:43:45<62:39:24, 10.12s/it]
 41%|████▏     | 15677/37963 [48:44:02<74:15:55, 12.00s/it]
 41%|████▏     | 15678/37963 [48:44:11<70:20:28, 11.36s/it]
 41%|████▏     | 15679/37963 [48:44:22<67:55:00, 10.97s/it]
 41%|████▏     | 15680/37963 [48:44:31<65:58:04, 10.66s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '1.377', 'learning_rate': '1.324e-05', 'epoch': '0.413'}

 41%|████▏     | 15680/37963 [48:44:31<65:58:04, 10.66s/it]
 41%|████▏     | 15681/37963 [48:44:42<65:10:22, 10.53s/it]
 41%|████▏     | 15682/37963 [48:44:59<77:10:20, 12.47s/it]
 41%|████▏     | 15683/37963 [48:45:08<71:35:30, 11.57s/it]
 41%|████▏     | 15684/37963 [48:45:18<69:03:02, 11.16s/it]
 41%|████▏     | 15685/37963 [48:45:28<66:34:20, 10.76s/it]
 41%|████▏     | 15686/37963 [48:45:38<64:50:32, 10.48s/it]
 41%|████▏     | 15687/37963 [48:45:48<64:00:51, 10.35s/it]
 41%|████▏     | 15688/37963 [48:45:58<63:32:34, 10.27s/it]
 41%|████▏     | 15689/37963 [48:46:08<63:10:20, 10.21s/it]
 41%|████▏     | 15690/37963 [48:46:18<63:05:55, 10.20s/it]
                                                           
{'loss': '0.1541', 'grad_norm': '1.074', 'learning_rate': '1.324e-05', 'epoch': '0.4133'}

 41%|████▏     | 15690/37963 [48:46:18<63:05:55, 10.20s/it]
 41%|████▏     | 15691/37963 [48:46:28<62:24:28, 10.09s/it]
 41%|████▏     | 15692/37963 [48:46:38<62:31:53, 10.11s/it]
 41%|████▏     | 15693/37963 [48:46:49<62:39:36, 10.13s/it]
 41%|████▏     | 15694/37963 [48:46:58<62:15:08, 10.06s/it]
 41%|████▏     | 15695/37963 [48:47:15<74:16:42, 12.01s/it]
 41%|████▏     | 15696/37963 [48:47:25<70:14:49, 11.36s/it]
 41%|████▏     | 15697/37963 [48:47:41<79:00:33, 12.77s/it]
 41%|████▏     | 15698/37963 [48:47:57<86:02:02, 13.91s/it]
 41%|████▏     | 15699/37963 [48:48:07<78:13:39, 12.65s/it]
 41%|████▏     | 15700/37963 [48:48:17<73:35:08, 11.90s/it]
                                                           
{'loss': '0.1507', 'grad_norm': '2.354', 'learning_rate': '1.323e-05', 'epoch': '0.4136'}

 41%|████▏     | 15700/37963 [48:48:17<73:35:08, 11.90s/it]
 41%|████▏     | 15701/37963 [48:48:27<70:19:55, 11.37s/it]
 41%|████▏     | 15702/37963 [48:48:38<67:56:14, 10.99s/it]
 41%|████▏     | 15703/37963 [48:48:47<65:42:24, 10.63s/it]
 41%|████▏     | 15704/37963 [48:48:58<64:53:49, 10.50s/it]
 41%|████▏     | 15705/37963 [48:49:08<64:11:27, 10.38s/it]
 41%|████▏     | 15706/37963 [48:49:18<63:37:08, 10.29s/it]
 41%|████▏     | 15707/37963 [48:49:28<63:09:57, 10.22s/it]
 41%|████▏     | 15708/37963 [48:49:38<62:57:18, 10.18s/it]
 41%|████▏     | 15709/37963 [48:49:48<62:45:58, 10.15s/it]
 41%|████▏     | 15710/37963 [48:50:05<75:37:35, 12.23s/it]
                                                           
{'loss': '0.1499', 'grad_norm': '3.039', 'learning_rate': '1.322e-05', 'epoch': '0.4138'}

 41%|████▏     | 15710/37963 [48:50:05<75:37:35, 12.23s/it]
 41%|████▏     | 15711/37963 [48:50:15<72:04:42, 11.66s/it]
 41%|████▏     | 15712/37963 [48:50:38<92:25:00, 14.95s/it]
 41%|████▏     | 15713/37963 [48:50:48<82:51:11, 13.41s/it]
 41%|████▏     | 15714/37963 [48:50:58<76:48:34, 12.43s/it]
 41%|████▏     | 15715/37963 [48:51:08<72:28:57, 11.73s/it]
 41%|████▏     | 15716/37963 [48:51:18<69:32:16, 11.25s/it]
 41%|████▏     | 15717/37963 [48:51:28<66:47:16, 10.81s/it]
 41%|████▏     | 15718/37963 [48:51:38<65:17:00, 10.57s/it]
 41%|████▏     | 15719/37963 [48:51:48<64:24:01, 10.42s/it]
 41%|████▏     | 15720/37963 [48:51:58<63:49:57, 10.33s/it]
                                                           
{'loss': '0.1588', 'grad_norm': '1.239', 'learning_rate': '1.321e-05', 'epoch': '0.4141'}

 41%|████▏     | 15720/37963 [48:51:58<63:49:57, 10.33s/it]
 41%|████▏     | 15721/37963 [48:52:08<63:23:17, 10.26s/it]
 41%|████▏     | 15722/37963 [48:52:18<63:05:41, 10.21s/it]
 41%|████▏     | 15723/37963 [48:52:35<74:34:26, 12.07s/it]
 41%|████▏     | 15724/37963 [48:52:45<70:52:21, 11.47s/it]
 41%|████▏     | 15725/37963 [48:52:55<68:04:34, 11.02s/it]
 41%|████▏     | 15726/37963 [48:53:05<66:20:45, 10.74s/it]
 41%|████▏     | 15727/37963 [48:53:15<65:12:28, 10.56s/it]
 41%|████▏     | 15728/37963 [48:53:25<64:15:53, 10.40s/it]
 41%|████▏     | 15729/37963 [48:53:35<63:42:05, 10.31s/it]
 41%|████▏     | 15730/37963 [48:53:52<75:51:32, 12.28s/it]
                                                           
{'loss': '0.1657', 'grad_norm': '2.206', 'learning_rate': '1.32e-05', 'epoch': '0.4144'}

 41%|████▏     | 15730/37963 [48:53:52<75:51:32, 12.28s/it]
 41%|████▏     | 15731/37963 [48:54:02<71:05:47, 11.51s/it]
 41%|████▏     | 15732/37963 [48:54:12<68:25:53, 11.08s/it]
 41%|████▏     | 15733/37963 [48:54:22<66:36:09, 10.79s/it]
 41%|████▏     | 15734/37963 [48:54:32<65:11:58, 10.56s/it]
 41%|████▏     | 15735/37963 [48:54:42<64:26:47, 10.44s/it]
 41%|████▏     | 15736/37963 [48:54:52<63:48:49, 10.34s/it]
 41%|████▏     | 15737/37963 [48:55:02<63:21:32, 10.26s/it]
 41%|████▏     | 15738/37963 [48:55:12<62:25:53, 10.11s/it]
 41%|████▏     | 15739/37963 [48:55:22<62:08:09, 10.07s/it]
 41%|████▏     | 15740/37963 [48:55:32<62:11:31, 10.07s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '2.137', 'learning_rate': '1.32e-05', 'epoch': '0.4146'}

 41%|████▏     | 15740/37963 [48:55:32<62:11:31, 10.07s/it]
 41%|████▏     | 15741/37963 [48:55:42<62:08:09, 10.07s/it]
 41%|████▏     | 15742/37963 [48:55:52<61:39:56,  9.99s/it]
 41%|████▏     | 15743/37963 [48:56:08<73:27:38, 11.90s/it]
 41%|████▏     | 15744/37963 [48:56:18<70:02:23, 11.35s/it]
 41%|████▏     | 15745/37963 [48:56:35<80:02:28, 12.97s/it]
 41%|████▏     | 15746/37963 [48:56:45<74:22:35, 12.05s/it]
 41%|████▏     | 15747/37963 [48:56:55<70:40:04, 11.45s/it]
 41%|████▏     | 15748/37963 [48:57:11<79:48:50, 12.93s/it]
 41%|████▏     | 15749/37963 [48:57:21<73:57:07, 11.98s/it]
 41%|████▏     | 15750/37963 [48:57:31<70:19:17, 11.40s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '2.306', 'learning_rate': '1.319e-05', 'epoch': '0.4149'}

 41%|████▏     | 15750/37963 [48:57:31<70:19:17, 11.40s/it]
 41%|████▏     | 15751/37963 [48:57:41<67:47:15, 10.99s/it]
 41%|████▏     | 15752/37963 [48:57:51<66:09:33, 10.72s/it]
 41%|████▏     | 15753/37963 [48:58:01<64:12:54, 10.41s/it]
 41%|████▏     | 15754/37963 [48:58:11<63:41:56, 10.33s/it]
 42%|████▏     | 15755/37963 [48:58:21<62:38:05, 10.15s/it]
 42%|████▏     | 15756/37963 [48:58:31<62:25:50, 10.12s/it]
 42%|████▏     | 15757/37963 [48:58:41<62:00:14, 10.05s/it]
 42%|████▏     | 15758/37963 [48:58:51<62:05:35, 10.07s/it]
 42%|████▏     | 15759/37963 [48:59:01<61:51:09, 10.03s/it]
 42%|████▏     | 15760/37963 [48:59:30<97:55:47, 15.88s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '2.617', 'learning_rate': '1.318e-05', 'epoch': '0.4151'}

 42%|████▏     | 15760/37963 [48:59:30<97:55:47, 15.88s/it]
 42%|████▏     | 15761/37963 [48:59:40<86:23:48, 14.01s/it]
 42%|████▏     | 15762/37963 [48:59:50<79:11:11, 12.84s/it]
 42%|████▏     | 15763/37963 [49:00:00<73:42:07, 11.95s/it]
 42%|████▏     | 15764/37963 [49:00:10<69:56:37, 11.34s/it]
 42%|████▏     | 15765/37963 [49:00:20<67:33:19, 10.96s/it]
 42%|████▏     | 15766/37963 [49:00:30<65:38:40, 10.65s/it]
 42%|████▏     | 15767/37963 [49:00:40<64:09:51, 10.41s/it]
 42%|████▏     | 15768/37963 [49:00:50<63:39:14, 10.32s/it]
 42%|████▏     | 15769/37963 [49:01:00<63:17:21, 10.27s/it]
 42%|████▏     | 15770/37963 [49:01:10<63:02:59, 10.23s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '1.658', 'learning_rate': '1.317e-05', 'epoch': '0.4154'}

 42%|████▏     | 15770/37963 [49:01:10<63:02:59, 10.23s/it]
 42%|████▏     | 15771/37963 [49:01:20<62:47:06, 10.19s/it]
 42%|████▏     | 15772/37963 [49:01:30<62:32:30, 10.15s/it]
 42%|████▏     | 15773/37963 [49:01:47<74:08:19, 12.03s/it]
 42%|████▏     | 15774/37963 [49:01:57<70:21:16, 11.41s/it]
 42%|████▏     | 15775/37963 [49:02:07<67:33:08, 10.96s/it]
 42%|████▏     | 15776/37963 [49:02:17<65:42:50, 10.66s/it]
 42%|████▏     | 15777/37963 [49:02:27<64:20:09, 10.44s/it]
 42%|████▏     | 15778/37963 [49:02:43<75:15:43, 12.21s/it]
 42%|████▏     | 15779/37963 [49:02:53<71:16:33, 11.57s/it]
 42%|████▏     | 15780/37963 [49:03:03<68:32:06, 11.12s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '1.247', 'learning_rate': '1.316e-05', 'epoch': '0.4157'}

 42%|████▏     | 15780/37963 [49:03:03<68:32:06, 11.12s/it]
 42%|████▏     | 15781/37963 [49:03:13<66:18:15, 10.76s/it]
 42%|████▏     | 15782/37963 [49:03:23<65:00:50, 10.55s/it]
 42%|████▏     | 15783/37963 [49:03:33<64:10:00, 10.41s/it]
 42%|████▏     | 15784/37963 [49:03:43<63:16:29, 10.27s/it]
 42%|████▏     | 15785/37963 [49:03:53<62:59:20, 10.22s/it]
 42%|████▏     | 15786/37963 [49:04:03<62:46:43, 10.19s/it]
 42%|████▏     | 15787/37963 [49:04:13<62:32:25, 10.15s/it]
 42%|████▏     | 15788/37963 [49:04:23<62:13:07, 10.10s/it]
 42%|████▏     | 15789/37963 [49:04:33<62:05:05, 10.08s/it]
 42%|████▏     | 15790/37963 [49:04:50<73:53:15, 12.00s/it]
                                                           
{'loss': '0.16', 'grad_norm': '1.013', 'learning_rate': '1.315e-05', 'epoch': '0.4159'}

 42%|████▏     | 15790/37963 [49:04:50<73:53:15, 12.00s/it]
 42%|████▏     | 15791/37963 [49:05:00<70:20:11, 11.42s/it]
 42%|████▏     | 15792/37963 [49:05:16<79:26:20, 12.90s/it]
 42%|████▏     | 15793/37963 [49:05:26<74:17:26, 12.06s/it]
 42%|████▏     | 15794/37963 [49:05:37<70:39:27, 11.47s/it]
 42%|████▏     | 15795/37963 [49:05:46<67:35:56, 10.98s/it]
 42%|████▏     | 15796/37963 [49:06:03<77:55:52, 12.66s/it]
 42%|████▏     | 15797/37963 [49:06:13<73:08:50, 11.88s/it]
 42%|████▏     | 15798/37963 [49:06:23<69:37:37, 11.31s/it]
 42%|████▏     | 15799/37963 [49:06:33<66:46:18, 10.85s/it]
 42%|████▏     | 15800/37963 [49:06:43<65:23:07, 10.62s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '1.398', 'learning_rate': '1.315e-05', 'epoch': '0.4162'}

 42%|████▏     | 15800/37963 [49:06:43<65:23:07, 10.62s/it]
 42%|████▏     | 15801/37963 [49:06:53<64:37:09, 10.50s/it]
 42%|████▏     | 15802/37963 [49:07:03<63:53:07, 10.38s/it]
 42%|████▏     | 15803/37963 [49:07:13<63:22:53, 10.30s/it]
 42%|████▏     | 15804/37963 [49:07:23<62:43:08, 10.19s/it]
 42%|████▏     | 15805/37963 [49:07:33<62:38:34, 10.18s/it]
 42%|████▏     | 15806/37963 [49:07:43<62:09:23, 10.10s/it]
 42%|████▏     | 15807/37963 [49:07:53<62:24:07, 10.14s/it]
 42%|████▏     | 15808/37963 [49:08:23<97:59:07, 15.92s/it]
 42%|████▏     | 15809/37963 [49:08:33<87:15:13, 14.18s/it]
 42%|████▏     | 15810/37963 [49:08:43<79:43:14, 12.96s/it]
                                                           
{'loss': '0.1456', 'grad_norm': '1.997', 'learning_rate': '1.314e-05', 'epoch': '0.4165'}

 42%|████▏     | 15810/37963 [49:08:43<79:43:14, 12.96s/it]
 42%|████▏     | 15811/37963 [49:08:53<74:30:14, 12.11s/it]
 42%|████▏     | 15812/37963 [49:09:03<70:56:53, 11.53s/it]
 42%|████▏     | 15813/37963 [49:09:13<67:54:09, 11.04s/it]
 42%|████▏     | 15814/37963 [49:09:23<66:09:53, 10.75s/it]
 42%|████▏     | 15815/37963 [49:09:33<64:45:54, 10.53s/it]
 42%|████▏     | 15816/37963 [49:09:43<63:24:16, 10.31s/it]
 42%|████▏     | 15817/37963 [49:09:53<62:58:28, 10.24s/it]
 42%|████▏     | 15818/37963 [49:10:03<62:36:53, 10.18s/it]
 42%|████▏     | 15819/37963 [49:10:13<62:27:30, 10.15s/it]
 42%|████▏     | 15820/37963 [49:10:23<61:52:28, 10.06s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '2.686', 'learning_rate': '1.313e-05', 'epoch': '0.4167'}

 42%|████▏     | 15820/37963 [49:10:23<61:52:28, 10.06s/it]
 42%|████▏     | 15821/37963 [49:10:33<61:53:45, 10.06s/it]
 42%|████▏     | 15822/37963 [49:10:50<74:15:47, 12.07s/it]
 42%|████▏     | 15823/37963 [49:11:00<70:46:21, 11.51s/it]
 42%|████▏     | 15824/37963 [49:11:10<68:09:01, 11.08s/it]
 42%|████▏     | 15825/37963 [49:11:20<66:11:18, 10.76s/it]
 42%|████▏     | 15826/37963 [49:11:30<63:46:38, 10.37s/it]
 42%|████▏     | 15827/37963 [49:11:40<63:23:23, 10.31s/it]
 42%|████▏     | 15828/37963 [49:11:57<75:40:18, 12.31s/it]
 42%|████▏     | 15829/37963 [49:12:07<71:23:32, 11.61s/it]
 42%|████▏     | 15830/37963 [49:12:17<68:09:22, 11.09s/it]
                                                           
{'loss': '0.1557', 'grad_norm': '0.8956', 'learning_rate': '1.312e-05', 'epoch': '0.417'}

 42%|████▏     | 15830/37963 [49:12:17<68:09:22, 11.09s/it]
 42%|████▏     | 15831/37963 [49:12:27<66:14:54, 10.78s/it]
 42%|████▏     | 15832/37963 [49:12:37<64:38:29, 10.52s/it]
 42%|████▏     | 15833/37963 [49:12:46<62:53:54, 10.23s/it]
 42%|████▏     | 15834/37963 [49:12:56<61:53:36, 10.07s/it]
 42%|████▏     | 15835/37963 [49:13:06<61:44:59, 10.05s/it]
 42%|████▏     | 15836/37963 [49:13:16<61:50:13, 10.06s/it]
 42%|████▏     | 15837/37963 [49:13:26<62:01:33, 10.09s/it]
 42%|████▏     | 15838/37963 [49:13:42<73:02:00, 11.88s/it]
 42%|████▏     | 15839/37963 [49:13:52<69:45:39, 11.35s/it]
 42%|████▏     | 15840/37963 [49:14:02<66:47:17, 10.87s/it]
                                                           
{'loss': '0.158', 'grad_norm': '0.777', 'learning_rate': '1.311e-05', 'epoch': '0.4172'}

 42%|████▏     | 15840/37963 [49:14:02<66:47:17, 10.87s/it]
 42%|████▏     | 15841/37963 [49:14:19<77:11:40, 12.56s/it]
 42%|████▏     | 15842/37963 [49:14:29<72:39:22, 11.82s/it]
 42%|████▏     | 15843/37963 [49:14:39<69:47:54, 11.36s/it]
 42%|████▏     | 15844/37963 [49:14:56<79:19:30, 12.91s/it]
 42%|████▏     | 15845/37963 [49:15:06<74:02:40, 12.05s/it]
 42%|████▏     | 15846/37963 [49:15:16<70:40:43, 11.50s/it]
 42%|████▏     | 15847/37963 [49:15:26<67:32:31, 10.99s/it]
 42%|████▏     | 15848/37963 [49:15:36<65:55:47, 10.73s/it]
 42%|████▏     | 15849/37963 [49:15:45<63:24:23, 10.32s/it]
 42%|████▏     | 15850/37963 [49:15:55<62:16:35, 10.14s/it]
                                                           
{'loss': '0.1367', 'grad_norm': '1.216', 'learning_rate': '1.311e-05', 'epoch': '0.4175'}

 42%|████▏     | 15850/37963 [49:15:55<62:16:35, 10.14s/it]
 42%|████▏     | 15851/37963 [49:16:05<62:09:25, 10.12s/it]
 42%|████▏     | 15852/37963 [49:16:15<62:06:59, 10.11s/it]
 42%|████▏     | 15853/37963 [49:16:25<62:11:24, 10.13s/it]
 42%|████▏     | 15854/37963 [49:16:35<61:50:14, 10.07s/it]
 42%|████▏     | 15855/37963 [49:16:52<74:29:59, 12.13s/it]
 42%|████▏     | 15856/37963 [49:17:08<81:52:48, 13.33s/it]
 42%|████▏     | 15857/37963 [49:17:18<76:02:25, 12.38s/it]
 42%|████▏     | 15858/37963 [49:17:35<83:39:31, 13.62s/it]
 42%|████▏     | 15859/37963 [49:17:45<77:19:54, 12.59s/it]
 42%|████▏     | 15860/37963 [49:17:55<72:34:13, 11.82s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '0.717', 'learning_rate': '1.31e-05', 'epoch': '0.4178'}

 42%|████▏     | 15860/37963 [49:17:55<72:34:13, 11.82s/it]
 42%|████▏     | 15861/37963 [49:18:05<68:55:40, 11.23s/it]
 42%|████▏     | 15862/37963 [49:18:15<66:48:59, 10.88s/it]
 42%|████▏     | 15863/37963 [49:18:25<65:17:03, 10.63s/it]
 42%|████▏     | 15864/37963 [49:18:35<64:13:07, 10.46s/it]
 42%|████▏     | 15865/37963 [49:18:45<62:54:33, 10.25s/it]
 42%|████▏     | 15866/37963 [49:18:55<62:37:31, 10.20s/it]
 42%|████▏     | 15867/37963 [49:19:05<62:22:30, 10.16s/it]
 42%|████▏     | 15868/37963 [49:19:15<61:01:29,  9.94s/it]
 42%|████▏     | 15869/37963 [49:19:24<61:06:10,  9.96s/it]
 42%|████▏     | 15870/37963 [49:19:41<72:56:18, 11.89s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '3.764', 'learning_rate': '1.309e-05', 'epoch': '0.418'}

 42%|████▏     | 15870/37963 [49:19:41<72:56:18, 11.89s/it]
 42%|████▏     | 15871/37963 [49:19:51<68:58:51, 11.24s/it]
 42%|████▏     | 15872/37963 [49:20:01<66:46:03, 10.88s/it]
 42%|████▏     | 15873/37963 [49:20:11<65:24:22, 10.66s/it]
 42%|████▏     | 15874/37963 [49:20:21<64:51:43, 10.57s/it]
 42%|████▏     | 15875/37963 [49:20:31<64:20:17, 10.49s/it]
 42%|████▏     | 15876/37963 [49:20:42<63:42:17, 10.38s/it]
 42%|████▏     | 15877/37963 [49:20:58<75:33:33, 12.32s/it]
 42%|████▏     | 15878/37963 [49:21:09<71:26:54, 11.65s/it]
 42%|████▏     | 15879/37963 [49:21:19<68:29:47, 11.17s/it]
 42%|████▏     | 15880/37963 [49:21:29<66:37:40, 10.86s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '0.9654', 'learning_rate': '1.308e-05', 'epoch': '0.4183'}

 42%|████▏     | 15880/37963 [49:21:29<66:37:40, 10.86s/it]
 42%|████▏     | 15881/37963 [49:21:39<65:21:12, 10.65s/it]
 42%|████▏     | 15882/37963 [49:21:49<64:09:40, 10.46s/it]
 42%|████▏     | 15883/37963 [49:21:59<63:30:55, 10.36s/it]
 42%|████▏     | 15884/37963 [49:22:09<63:04:15, 10.28s/it]
 42%|████▏     | 15885/37963 [49:22:19<61:59:41, 10.11s/it]
 42%|████▏     | 15886/37963 [49:22:29<61:52:28, 10.09s/it]
 42%|████▏     | 15887/37963 [49:22:38<60:58:49,  9.94s/it]
 42%|████▏     | 15888/37963 [49:22:55<73:53:16, 12.05s/it]
 42%|████▏     | 15889/37963 [49:23:05<70:10:42, 11.45s/it]
 42%|████▏     | 15890/37963 [49:23:22<79:24:13, 12.95s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '1.817', 'learning_rate': '1.307e-05', 'epoch': '0.4186'}

 42%|████▏     | 15890/37963 [49:23:22<79:24:13, 12.95s/it]
 42%|████▏     | 15891/37963 [49:23:32<74:08:36, 12.09s/it]
 42%|████▏     | 15892/37963 [49:23:42<70:27:22, 11.49s/it]
 42%|████▏     | 15893/37963 [49:23:59<79:49:02, 13.02s/it]
 42%|████▏     | 15894/37963 [49:24:09<74:27:02, 12.14s/it]
 42%|████▏     | 15895/37963 [49:24:19<70:38:53, 11.53s/it]
 42%|████▏     | 15896/37963 [49:24:28<67:07:39, 10.95s/it]
 42%|████▏     | 15897/37963 [49:24:38<65:15:35, 10.65s/it]
 42%|████▏     | 15898/37963 [49:24:48<63:38:04, 10.38s/it]
 42%|████▏     | 15899/37963 [49:24:58<62:16:39, 10.16s/it]
 42%|████▏     | 15900/37963 [49:25:08<61:43:33, 10.07s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '3.109', 'learning_rate': '1.307e-05', 'epoch': '0.4188'}

 42%|████▏     | 15900/37963 [49:25:08<61:43:33, 10.07s/it]
 42%|████▏     | 15901/37963 [49:25:18<61:51:49, 10.09s/it]
 42%|████▏     | 15902/37963 [49:25:28<62:07:42, 10.14s/it]
 42%|████▏     | 15903/37963 [49:25:38<61:54:30, 10.10s/it]
 42%|████▏     | 15904/37963 [49:26:01<86:10:58, 14.06s/it]
 42%|████▏     | 15905/37963 [49:26:11<77:38:59, 12.67s/it]
 42%|████▏     | 15906/37963 [49:26:27<84:06:24, 13.73s/it]
 42%|████▏     | 15907/37963 [49:26:37<77:10:12, 12.60s/it]
 42%|████▏     | 15908/37963 [49:26:47<72:35:24, 11.85s/it]
 42%|████▏     | 15909/37963 [49:26:57<69:21:40, 11.32s/it]
 42%|████▏     | 15910/37963 [49:27:07<67:01:49, 10.94s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '1.054', 'learning_rate': '1.306e-05', 'epoch': '0.4191'}

 42%|████▏     | 15910/37963 [49:27:07<67:01:49, 10.94s/it]
 42%|████▏     | 15911/37963 [49:27:17<65:02:00, 10.62s/it]
 42%|████▏     | 15912/37963 [49:27:27<63:59:49, 10.45s/it]
 42%|████▏     | 15913/37963 [49:27:37<63:20:17, 10.34s/it]
 42%|████▏     | 15914/37963 [49:27:47<62:04:01, 10.13s/it]
 42%|████▏     | 15915/37963 [49:27:57<62:05:10, 10.14s/it]
 42%|████▏     | 15916/37963 [49:28:07<62:06:53, 10.14s/it]
 42%|████▏     | 15917/37963 [49:28:17<61:48:05, 10.09s/it]
 42%|████▏     | 15918/37963 [49:28:27<61:52:30, 10.10s/it]
 42%|████▏     | 15919/37963 [49:28:43<72:58:35, 11.92s/it]
 42%|████▏     | 15920/37963 [49:28:53<68:56:04, 11.26s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '1.678', 'learning_rate': '1.305e-05', 'epoch': '0.4194'}

 42%|████▏     | 15920/37963 [49:28:53<68:56:04, 11.26s/it]
 42%|████▏     | 15921/37963 [49:29:03<66:49:40, 10.91s/it]
 42%|████▏     | 15922/37963 [49:29:13<65:17:51, 10.67s/it]
 42%|████▏     | 15923/37963 [49:29:23<64:16:43, 10.50s/it]
 42%|████▏     | 15924/37963 [49:29:33<62:51:29, 10.27s/it]
 42%|████▏     | 15925/37963 [49:29:43<62:33:32, 10.22s/it]
 42%|████▏     | 15926/37963 [49:30:00<73:50:03, 12.06s/it]
 42%|████▏     | 15927/37963 [49:30:10<70:10:22, 11.46s/it]
 42%|████▏     | 15928/37963 [49:30:20<67:26:11, 11.02s/it]
 42%|████▏     | 15929/37963 [49:30:30<65:41:35, 10.73s/it]
 42%|████▏     | 15930/37963 [49:30:40<64:22:28, 10.52s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '1.413', 'learning_rate': '1.304e-05', 'epoch': '0.4196'}

 42%|████▏     | 15930/37963 [49:30:40<64:22:28, 10.52s/it]
 42%|████▏     | 15931/37963 [49:30:50<63:34:18, 10.39s/it]
 42%|████▏     | 15932/37963 [49:31:00<62:52:28, 10.27s/it]
 42%|████▏     | 15933/37963 [49:31:10<62:37:00, 10.23s/it]
 42%|████▏     | 15934/37963 [49:31:20<62:23:41, 10.20s/it]
 42%|████▏     | 15935/37963 [49:31:30<62:09:20, 10.16s/it]
 42%|████▏     | 15936/37963 [49:31:47<73:27:17, 12.01s/it]
 42%|████▏     | 15937/37963 [49:32:03<81:42:00, 13.35s/it]
 42%|████▏     | 15938/37963 [49:32:13<75:35:43, 12.36s/it]
 42%|████▏     | 15939/37963 [49:32:23<70:58:27, 11.60s/it]
 42%|████▏     | 15940/37963 [49:32:33<67:55:01, 11.10s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '1.259', 'learning_rate': '1.303e-05', 'epoch': '0.4199'}

 42%|████▏     | 15940/37963 [49:32:33<67:55:01, 11.10s/it]
 42%|████▏     | 15941/37963 [49:32:49<77:57:51, 12.75s/it]
 42%|████▏     | 15942/37963 [49:33:00<73:13:28, 11.97s/it]
 42%|████▏     | 15943/37963 [49:33:09<69:03:15, 11.29s/it]
 42%|████▏     | 15944/37963 [49:33:19<66:46:17, 10.92s/it]
 42%|████▏     | 15945/37963 [49:33:29<64:47:02, 10.59s/it]
 42%|████▏     | 15946/37963 [49:33:39<63:07:35, 10.32s/it]
 42%|████▏     | 15947/37963 [49:33:49<62:38:41, 10.24s/it]
 42%|████▏     | 15948/37963 [49:33:59<61:51:22, 10.12s/it]
 42%|████▏     | 15949/37963 [49:34:09<61:17:13, 10.02s/it]
 42%|████▏     | 15950/37963 [49:34:18<60:24:01,  9.88s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '0.7002', 'learning_rate': '1.302e-05', 'epoch': '0.4201'}

 42%|████▏     | 15950/37963 [49:34:18<60:24:01,  9.88s/it]
 42%|████▏     | 15951/37963 [49:34:28<60:47:34,  9.94s/it]
 42%|████▏     | 15952/37963 [49:34:38<60:45:22,  9.94s/it]
 42%|████▏     | 15953/37963 [49:35:01<84:56:19, 13.89s/it]
 42%|████▏     | 15954/37963 [49:35:18<90:07:41, 14.74s/it]
 42%|████▏     | 15955/37963 [49:35:28<81:33:24, 13.34s/it]
 42%|████▏     | 15956/37963 [49:35:38<75:40:49, 12.38s/it]
 42%|████▏     | 15957/37963 [49:35:48<71:29:06, 11.69s/it]
 42%|████▏     | 15958/37963 [49:35:58<68:17:45, 11.17s/it]
 42%|████▏     | 15959/37963 [49:36:08<66:19:59, 10.85s/it]
 42%|████▏     | 15960/37963 [49:36:18<65:05:13, 10.65s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '0.8736', 'learning_rate': '1.302e-05', 'epoch': '0.4204'}

 42%|████▏     | 15960/37963 [49:36:18<65:05:13, 10.65s/it]
 42%|████▏     | 15961/37963 [49:36:29<64:00:14, 10.47s/it]
 42%|████▏     | 15962/37963 [49:36:39<63:15:38, 10.35s/it]
 42%|████▏     | 15963/37963 [49:36:49<62:43:59, 10.27s/it]
 42%|████▏     | 15964/37963 [49:36:59<62:32:51, 10.24s/it]
 42%|████▏     | 15965/37963 [49:37:09<62:11:25, 10.18s/it]
 42%|████▏     | 15966/37963 [49:37:25<73:45:11, 12.07s/it]
 42%|████▏     | 15967/37963 [49:37:35<70:06:49, 11.48s/it]
 42%|████▏     | 15968/37963 [49:37:45<67:29:17, 11.05s/it]
 42%|████▏     | 15969/37963 [49:37:56<65:48:47, 10.77s/it]
 42%|████▏     | 15970/37963 [49:38:06<64:26:35, 10.55s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '1.076', 'learning_rate': '1.301e-05', 'epoch': '0.4207'}

 42%|████▏     | 15970/37963 [49:38:06<64:26:35, 10.55s/it]
 42%|████▏     | 15971/37963 [49:38:16<63:35:37, 10.41s/it]
 42%|████▏     | 15972/37963 [49:38:26<63:06:03, 10.33s/it]
 42%|████▏     | 15973/37963 [49:38:43<75:25:22, 12.35s/it]
 42%|████▏     | 15974/37963 [49:38:53<71:22:59, 11.69s/it]
 42%|████▏     | 15975/37963 [49:39:03<68:34:24, 11.23s/it]
 42%|████▏     | 15976/37963 [49:39:13<66:29:42, 10.89s/it]
 42%|████▏     | 15977/37963 [49:39:24<65:16:17, 10.69s/it]
 42%|████▏     | 15978/37963 [49:39:33<63:18:40, 10.37s/it]
 42%|████▏     | 15979/37963 [49:39:43<62:18:16, 10.20s/it]
 42%|████▏     | 15980/37963 [49:39:53<62:05:44, 10.17s/it]
                                                           
{'loss': '0.16', 'grad_norm': '2.544', 'learning_rate': '1.3e-05', 'epoch': '0.4209'}

 42%|████▏     | 15980/37963 [49:39:53<62:05:44, 10.17s/it]
 42%|████▏     | 15981/37963 [49:40:03<61:50:29, 10.13s/it]
 42%|████▏     | 15982/37963 [49:40:13<61:39:54, 10.10s/it]
 42%|████▏     | 15983/37963 [49:40:30<73:38:18, 12.06s/it]
 42%|████▏     | 15984/37963 [49:40:40<70:04:52, 11.48s/it]
 42%|████▏     | 15985/37963 [49:40:56<78:53:58, 12.92s/it]
 42%|████▏     | 15986/37963 [49:41:06<73:59:38, 12.12s/it]
 42%|████▏     | 15987/37963 [49:41:16<69:41:41, 11.42s/it]
 42%|████▏     | 15988/37963 [49:41:26<66:05:04, 10.83s/it]
 42%|████▏     | 15989/37963 [49:41:42<76:28:31, 12.53s/it]
 42%|████▏     | 15990/37963 [49:41:52<71:35:35, 11.73s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '2.21', 'learning_rate': '1.299e-05', 'epoch': '0.4212'}

 42%|████▏     | 15990/37963 [49:41:52<71:35:35, 11.73s/it]
 42%|████▏     | 15991/37963 [49:42:02<68:43:59, 11.26s/it]
 42%|████▏     | 15992/37963 [49:42:12<66:31:43, 10.90s/it]
 42%|████▏     | 15993/37963 [49:42:22<65:09:16, 10.68s/it]
 42%|████▏     | 15994/37963 [49:42:32<64:02:39, 10.49s/it]
 42%|████▏     | 15995/37963 [49:42:43<63:15:24, 10.37s/it]
 42%|████▏     | 15996/37963 [49:42:53<62:44:24, 10.28s/it]
 42%|████▏     | 15997/37963 [49:43:03<61:59:29, 10.16s/it]
 42%|████▏     | 15998/37963 [49:43:12<61:18:20, 10.05s/it]
 42%|████▏     | 15999/37963 [49:43:22<61:22:06, 10.06s/it]
 42%|████▏     | 16000/37963 [49:43:32<60:48:11,  9.97s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '1.494', 'learning_rate': '1.298e-05', 'epoch': '0.4215'}

 42%|████▏     | 16000/37963 [49:43:32<60:48:11,  9.97s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.15s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.15s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 42%|████▏     | 16001/37963 [49:44:44<173:55:24, 28.51s/it]
 42%|████▏     | 16002/37963 [49:45:02<154:23:51, 25.31s/it]
 42%|████▏     | 16003/37963 [49:45:13<129:17:53, 21.20s/it]
 42%|████▏     | 16004/37963 [49:45:23<108:38:56, 17.81s/it]
 42%|████▏     | 16005/37963 [49:45:33<94:37:58, 15.51s/it] 
 42%|████▏     | 16006/37963 [49:45:44<84:47:29, 13.90s/it]
 42%|████▏     | 16007/37963 [49:45:54<78:12:42, 12.82s/it]
 42%|████▏     | 16008/37963 [49:46:04<73:11:22, 12.00s/it]
 42%|████▏     | 16009/37963 [49:46:14<69:41:27, 11.43s/it]
 42%|████▏     | 16010/37963 [49:46:23<65:52:37, 10.80s/it]
                                                           
{'loss': '0.1521', 'grad_norm': '1.146', 'learning_rate': '1.298e-05', 'epoch': '0.4217'}

 42%|████▏     | 16010/37963 [49:46:23<65:52:37, 10.80s/it]
 42%|████▏     | 16011/37963 [49:46:33<64:28:36, 10.57s/it]
 42%|████▏     | 16012/37963 [49:46:44<63:35:27, 10.43s/it]
 42%|████▏     | 16013/37963 [49:47:00<74:55:57, 12.29s/it]
 42%|████▏     | 16014/37963 [49:47:10<70:44:10, 11.60s/it]
 42%|████▏     | 16015/37963 [49:47:20<67:51:46, 11.13s/it]
 42%|████▏     | 16016/37963 [49:47:30<65:56:23, 10.82s/it]
 42%|████▏     | 16017/37963 [49:47:40<64:31:54, 10.59s/it]
 42%|████▏     | 16018/37963 [49:47:50<63:28:07, 10.41s/it]
 42%|████▏     | 16019/37963 [49:48:00<62:32:15, 10.26s/it]
 42%|████▏     | 16020/37963 [49:48:10<61:19:52, 10.06s/it]
                                                           
{'loss': '0.1417', 'grad_norm': '3.459', 'learning_rate': '1.297e-05', 'epoch': '0.422'}

 42%|████▏     | 16020/37963 [49:48:10<61:19:52, 10.06s/it]
 42%|████▏     | 16021/37963 [49:48:19<60:29:58,  9.93s/it]
 42%|████▏     | 16022/37963 [49:48:30<60:58:01, 10.00s/it]
 42%|████▏     | 16023/37963 [49:48:46<73:22:06, 12.04s/it]
 42%|████▏     | 16024/37963 [49:48:56<69:40:40, 11.43s/it]
 42%|████▏     | 16025/37963 [49:49:06<66:16:18, 10.88s/it]
 42%|████▏     | 16026/37963 [49:49:16<64:42:47, 10.62s/it]
 42%|████▏     | 16027/37963 [49:49:26<63:39:53, 10.45s/it]
 42%|████▏     | 16028/37963 [49:49:36<62:54:12, 10.32s/it]
 42%|████▏     | 16029/37963 [49:49:46<62:20:49, 10.23s/it]
 42%|████▏     | 16030/37963 [49:49:56<62:04:00, 10.19s/it]
                                                           
{'loss': '0.141', 'grad_norm': '1.898', 'learning_rate': '1.296e-05', 'epoch': '0.4223'}

 42%|████▏     | 16030/37963 [49:49:56<62:04:00, 10.19s/it]
 42%|████▏     | 16031/37963 [49:50:13<73:13:46, 12.02s/it]
 42%|████▏     | 16032/37963 [49:50:29<81:19:45, 13.35s/it]
 42%|████▏     | 16033/37963 [49:50:39<75:12:07, 12.35s/it]
 42%|████▏     | 16034/37963 [49:50:49<71:02:58, 11.66s/it]
 42%|████▏     | 16035/37963 [49:50:59<68:09:53, 11.19s/it]
 42%|████▏     | 16036/37963 [49:51:09<65:21:18, 10.73s/it]
 42%|████▏     | 16037/37963 [49:51:25<75:46:26, 12.44s/it]
 42%|████▏     | 16038/37963 [49:51:35<71:31:42, 11.74s/it]
 42%|████▏     | 16039/37963 [49:51:45<68:28:32, 11.24s/it]
 42%|████▏     | 16040/37963 [49:51:55<66:19:00, 10.89s/it]
                                                           
{'loss': '0.1461', 'grad_norm': '1.704', 'learning_rate': '1.295e-05', 'epoch': '0.4225'}

 42%|████▏     | 16040/37963 [49:51:55<66:19:00, 10.89s/it]
 42%|████▏     | 16041/37963 [49:52:06<64:55:11, 10.66s/it]
 42%|████▏     | 16042/37963 [49:52:16<63:35:21, 10.44s/it]
 42%|████▏     | 16043/37963 [49:52:26<62:57:58, 10.34s/it]
 42%|████▏     | 16044/37963 [49:52:35<62:03:00, 10.19s/it]
 42%|████▏     | 16045/37963 [49:52:46<61:51:13, 10.16s/it]
 42%|████▏     | 16046/37963 [49:52:56<61:30:22, 10.10s/it]
 42%|████▏     | 16047/37963 [49:53:06<61:36:52, 10.12s/it]
 42%|████▏     | 16048/37963 [49:53:22<73:31:25, 12.08s/it]
 42%|████▏     | 16049/37963 [49:53:39<81:45:50, 13.43s/it]
 42%|████▏     | 16050/37963 [49:53:49<75:43:34, 12.44s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '1.582', 'learning_rate': '1.294e-05', 'epoch': '0.4228'}

 42%|████▏     | 16050/37963 [49:53:49<75:43:34, 12.44s/it]
 42%|████▏     | 16051/37963 [49:53:59<71:17:56, 11.71s/it]
 42%|████▏     | 16052/37963 [49:54:09<68:07:58, 11.19s/it]
 42%|████▏     | 16053/37963 [49:54:19<66:13:22, 10.88s/it]
 42%|████▏     | 16054/37963 [49:54:29<64:18:19, 10.57s/it]
 42%|████▏     | 16055/37963 [49:54:39<63:29:46, 10.43s/it]
 42%|████▏     | 16056/37963 [49:54:49<62:54:38, 10.34s/it]
 42%|████▏     | 16057/37963 [49:54:59<62:37:03, 10.29s/it]
 42%|████▏     | 16058/37963 [49:55:09<61:14:10, 10.06s/it]
 42%|████▏     | 16059/37963 [49:55:19<60:59:01, 10.02s/it]
 42%|████▏     | 16060/37963 [49:55:29<60:42:24,  9.98s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '1.066', 'learning_rate': '1.294e-05', 'epoch': '0.423'}

 42%|████▏     | 16060/37963 [49:55:29<60:42:24,  9.98s/it]
 42%|████▏     | 16061/37963 [49:55:39<60:29:06,  9.94s/it]
 42%|████▏     | 16062/37963 [49:55:55<72:45:19, 11.96s/it]
 42%|████▏     | 16063/37963 [49:56:05<69:24:39, 11.41s/it]
 42%|████▏     | 16064/37963 [49:56:16<67:05:14, 11.03s/it]
 42%|████▏     | 16065/37963 [49:56:26<65:21:19, 10.74s/it]
 42%|████▏     | 16066/37963 [49:56:36<63:55:49, 10.51s/it]
 42%|████▏     | 16067/37963 [49:56:46<63:05:47, 10.37s/it]
 42%|████▏     | 16068/37963 [49:56:56<62:33:17, 10.29s/it]
 42%|████▏     | 16069/37963 [49:57:06<62:11:20, 10.23s/it]
 42%|████▏     | 16070/37963 [49:57:16<62:00:49, 10.20s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '2.156', 'learning_rate': '1.293e-05', 'epoch': '0.4233'}

 42%|████▏     | 16070/37963 [49:57:16<62:00:49, 10.20s/it]
 42%|████▏     | 16071/37963 [49:57:26<61:50:52, 10.17s/it]
 42%|████▏     | 16072/37963 [49:57:36<61:07:57, 10.05s/it]
 42%|████▏     | 16073/37963 [49:57:53<73:15:50, 12.05s/it]
 42%|████▏     | 16074/37963 [49:58:03<69:52:39, 11.49s/it]
 42%|████▏     | 16075/37963 [49:58:13<67:13:15, 11.06s/it]
 42%|████▏     | 16076/37963 [49:58:23<65:40:19, 10.80s/it]
 42%|████▏     | 16077/37963 [49:58:33<64:19:09, 10.58s/it]
 42%|████▏     | 16078/37963 [49:58:43<63:23:05, 10.43s/it]
 42%|████▏     | 16079/37963 [49:59:00<74:37:34, 12.28s/it]
 42%|████▏     | 16080/37963 [49:59:16<82:43:26, 13.61s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '1.403', 'learning_rate': '1.292e-05', 'epoch': '0.4236'}

 42%|████▏     | 16080/37963 [49:59:16<82:43:26, 13.61s/it]
 42%|████▏     | 16081/37963 [49:59:26<75:47:31, 12.47s/it]
 42%|████▏     | 16082/37963 [49:59:36<71:31:41, 11.77s/it]
 42%|████▏     | 16083/37963 [49:59:46<68:13:41, 11.23s/it]
 42%|████▏     | 16084/37963 [49:59:56<66:10:54, 10.89s/it]
 42%|████▏     | 16085/37963 [50:00:07<64:43:11, 10.65s/it]
 42%|████▏     | 16086/37963 [50:00:23<75:18:36, 12.39s/it]
 42%|████▏     | 16087/37963 [50:00:33<70:59:32, 11.68s/it]
 42%|████▏     | 16088/37963 [50:00:43<67:27:19, 11.10s/it]
 42%|████▏     | 16089/37963 [50:00:53<65:35:06, 10.79s/it]
 42%|████▏     | 16090/37963 [50:01:03<63:53:35, 10.52s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '2.652', 'learning_rate': '1.291e-05', 'epoch': '0.4238'}

 42%|████▏     | 16090/37963 [50:01:03<63:53:35, 10.52s/it]
 42%|████▏     | 16091/37963 [50:01:13<63:20:39, 10.43s/it]
 42%|████▏     | 16092/37963 [50:01:23<62:42:16, 10.32s/it]
 42%|████▏     | 16093/37963 [50:01:33<62:17:41, 10.25s/it]
 42%|████▏     | 16094/37963 [50:01:43<61:05:32, 10.06s/it]
 42%|████▏     | 16095/37963 [50:01:59<72:51:10, 11.99s/it]
 42%|████▏     | 16096/37963 [50:02:09<69:17:21, 11.41s/it]
 42%|████▏     | 16097/37963 [50:02:27<79:56:12, 13.16s/it]
 42%|████▏     | 16098/37963 [50:02:43<86:15:00, 14.20s/it]
 42%|████▏     | 16099/37963 [50:02:53<78:35:54, 12.94s/it]
 42%|████▏     | 16100/37963 [50:03:03<73:26:51, 12.09s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '0.7686', 'learning_rate': '1.29e-05', 'epoch': '0.4241'}

 42%|████▏     | 16100/37963 [50:03:03<73:26:51, 12.09s/it]
 42%|████▏     | 16101/37963 [50:03:13<68:47:22, 11.33s/it]
 42%|████▏     | 16102/37963 [50:03:23<66:34:30, 10.96s/it]
 42%|████▏     | 16103/37963 [50:03:33<65:03:50, 10.72s/it]
 42%|████▏     | 16104/37963 [50:03:43<63:50:23, 10.51s/it]
 42%|████▏     | 16105/37963 [50:03:53<62:57:41, 10.37s/it]
 42%|████▏     | 16106/37963 [50:04:03<62:34:11, 10.31s/it]
 42%|████▏     | 16107/37963 [50:04:13<62:09:21, 10.24s/it]
 42%|████▏     | 16108/37963 [50:04:23<60:47:48, 10.01s/it]
 42%|████▏     | 16109/37963 [50:04:33<61:03:13, 10.06s/it]
 42%|████▏     | 16110/37963 [50:04:49<72:21:22, 11.92s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '0.9847', 'learning_rate': '1.289e-05', 'epoch': '0.4244'}

 42%|████▏     | 16110/37963 [50:04:49<72:21:22, 11.92s/it]
 42%|████▏     | 16111/37963 [50:04:59<68:59:50, 11.37s/it]
 42%|████▏     | 16112/37963 [50:05:09<66:39:20, 10.98s/it]
 42%|████▏     | 16113/37963 [50:05:19<64:52:14, 10.69s/it]
 42%|████▏     | 16114/37963 [50:05:29<63:42:28, 10.50s/it]
 42%|████▏     | 16115/37963 [50:05:39<62:43:03, 10.33s/it]
 42%|████▏     | 16116/37963 [50:05:50<62:23:09, 10.28s/it]
 42%|████▏     | 16117/37963 [50:06:00<62:11:49, 10.25s/it]
 42%|████▏     | 16118/37963 [50:06:10<61:38:51, 10.16s/it]
 42%|████▏     | 16119/37963 [50:06:20<61:29:20, 10.13s/it]
 42%|████▏     | 16120/37963 [50:06:30<61:24:23, 10.12s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '1.446', 'learning_rate': '1.289e-05', 'epoch': '0.4246'}

 42%|████▏     | 16120/37963 [50:06:30<61:24:23, 10.12s/it]
 42%|████▏     | 16121/37963 [50:06:46<73:11:15, 12.06s/it]
 42%|████▏     | 16122/37963 [50:06:57<69:32:24, 11.46s/it]
 42%|████▏     | 16123/37963 [50:07:07<67:06:19, 11.06s/it]
 42%|████▏     | 16124/37963 [50:07:17<65:15:29, 10.76s/it]
 42%|████▏     | 16125/37963 [50:07:27<63:44:59, 10.51s/it]
 42%|████▏     | 16126/37963 [50:07:42<73:19:01, 12.09s/it]
 42%|████▏     | 16127/37963 [50:07:53<69:42:49, 11.49s/it]
 42%|████▏     | 16128/37963 [50:08:09<78:38:33, 12.97s/it]
 42%|████▏     | 16129/37963 [50:08:19<73:26:38, 12.11s/it]
 42%|████▏     | 16130/37963 [50:08:29<69:10:31, 11.41s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '2.365', 'learning_rate': '1.288e-05', 'epoch': '0.4249'}

 42%|████▏     | 16130/37963 [50:08:29<69:10:31, 11.41s/it]
 42%|████▏     | 16131/37963 [50:08:39<66:35:07, 10.98s/it]
 42%|████▏     | 16132/37963 [50:08:49<64:40:47, 10.67s/it]
 42%|████▏     | 16133/37963 [50:08:59<63:36:49, 10.49s/it]
 42%|████▏     | 16134/37963 [50:09:09<62:44:52, 10.35s/it]
 43%|████▎     | 16135/37963 [50:09:25<74:13:01, 12.24s/it]
 43%|████▎     | 16136/37963 [50:09:36<70:21:27, 11.60s/it]
 43%|████▎     | 16137/37963 [50:09:46<67:37:04, 11.15s/it]
 43%|████▎     | 16138/37963 [50:09:56<65:42:09, 10.84s/it]
 43%|████▎     | 16139/37963 [50:10:06<64:27:38, 10.63s/it]
 43%|████▎     | 16140/37963 [50:10:16<62:54:26, 10.38s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '0.9734', 'learning_rate': '1.287e-05', 'epoch': '0.4252'}

 43%|████▎     | 16140/37963 [50:10:16<62:54:26, 10.38s/it]
 43%|████▎     | 16141/37963 [50:10:26<62:47:01, 10.36s/it]
 43%|████▎     | 16142/37963 [50:10:36<62:19:48, 10.28s/it]
 43%|████▎     | 16143/37963 [50:10:46<61:59:00, 10.23s/it]
 43%|████▎     | 16144/37963 [50:11:10<86:20:42, 14.25s/it]
 43%|████▎     | 16145/37963 [50:11:20<78:09:26, 12.90s/it]
 43%|████▎     | 16146/37963 [50:11:30<73:04:44, 12.06s/it]
 43%|████▎     | 16147/37963 [50:11:46<80:55:17, 13.35s/it]
 43%|████▎     | 16148/37963 [50:11:56<74:55:45, 12.37s/it]
 43%|████▎     | 16149/37963 [50:12:06<70:47:55, 11.68s/it]
 43%|████▎     | 16150/37963 [50:12:16<67:58:34, 11.22s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '1.47', 'learning_rate': '1.286e-05', 'epoch': '0.4254'}

 43%|████▎     | 16150/37963 [50:12:16<67:58:34, 11.22s/it]
 43%|████▎     | 16151/37963 [50:12:26<65:55:23, 10.88s/it]
 43%|████▎     | 16152/37963 [50:12:37<64:34:56, 10.66s/it]
 43%|████▎     | 16153/37963 [50:12:47<63:37:26, 10.50s/it]
 43%|████▎     | 16154/37963 [50:12:57<62:40:08, 10.34s/it]
 43%|████▎     | 16155/37963 [50:13:07<62:11:54, 10.27s/it]
 43%|████▎     | 16156/37963 [50:13:23<72:43:17, 12.01s/it]
 43%|████▎     | 16157/37963 [50:13:33<69:16:12, 11.44s/it]
 43%|████▎     | 16158/37963 [50:13:43<66:48:05, 11.03s/it]
 43%|████▎     | 16159/37963 [50:13:53<65:13:31, 10.77s/it]
 43%|████▎     | 16160/37963 [50:14:03<64:02:49, 10.58s/it]
                                                           
{'loss': '0.1683', 'grad_norm': '2.295', 'learning_rate': '1.285e-05', 'epoch': '0.4257'}

 43%|████▎     | 16160/37963 [50:14:03<64:02:49, 10.58s/it]
 43%|████▎     | 16161/37963 [50:14:13<62:57:24, 10.40s/it]
 43%|████▎     | 16162/37963 [50:14:23<62:02:24, 10.24s/it]
 43%|████▎     | 16163/37963 [50:14:33<61:27:21, 10.15s/it]
 43%|████▎     | 16164/37963 [50:14:43<61:18:00, 10.12s/it]
 43%|████▎     | 16165/37963 [50:14:53<61:21:42, 10.13s/it]
 43%|████▎     | 16166/37963 [50:15:03<61:07:00, 10.09s/it]
 43%|████▎     | 16167/37963 [50:15:13<60:35:40, 10.01s/it]
 43%|████▎     | 16168/37963 [50:15:23<60:43:35, 10.03s/it]
 43%|████▎     | 16169/37963 [50:15:33<60:54:07, 10.06s/it]
 43%|████▎     | 16170/37963 [50:15:44<60:59:07, 10.07s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '1.004', 'learning_rate': '1.285e-05', 'epoch': '0.4259'}

 43%|████▎     | 16170/37963 [50:15:44<60:59:07, 10.07s/it]
 43%|████▎     | 16171/37963 [50:16:00<73:28:43, 12.14s/it]
 43%|████▎     | 16172/37963 [50:16:11<69:42:54, 11.52s/it]
 43%|████▎     | 16173/37963 [50:16:26<77:44:31, 12.84s/it]
 43%|████▎     | 16174/37963 [50:16:36<72:36:15, 12.00s/it]
 43%|████▎     | 16175/37963 [50:16:47<69:15:05, 11.44s/it]
 43%|████▎     | 16176/37963 [50:16:57<66:54:11, 11.05s/it]
 43%|████▎     | 16177/37963 [50:17:13<76:07:04, 12.58s/it]
 43%|████▎     | 16178/37963 [50:17:23<71:35:38, 11.83s/it]
 43%|████▎     | 16179/37963 [50:17:33<68:29:48, 11.32s/it]
 43%|████▎     | 16180/37963 [50:17:43<65:48:18, 10.88s/it]
                                                           
{'loss': '0.1419', 'grad_norm': '0.5398', 'learning_rate': '1.284e-05', 'epoch': '0.4262'}

 43%|████▎     | 16180/37963 [50:17:43<65:48:18, 10.88s/it]
 43%|████▎     | 16181/37963 [50:17:53<64:17:40, 10.63s/it]
 43%|████▎     | 16182/37963 [50:18:03<63:19:15, 10.47s/it]
 43%|████▎     | 16183/37963 [50:18:13<62:38:43, 10.35s/it]
 43%|████▎     | 16184/37963 [50:18:30<73:44:45, 12.19s/it]
 43%|████▎     | 16185/37963 [50:18:40<70:00:50, 11.57s/it]
 43%|████▎     | 16186/37963 [50:18:50<67:22:13, 11.14s/it]
 43%|████▎     | 16187/37963 [50:19:00<65:23:43, 10.81s/it]
 43%|████▎     | 16188/37963 [50:19:10<64:03:36, 10.59s/it]
 43%|████▎     | 16189/37963 [50:19:20<62:28:48, 10.33s/it]
 43%|████▎     | 16190/37963 [50:19:30<62:13:04, 10.29s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '1.39', 'learning_rate': '1.283e-05', 'epoch': '0.4265'}

 43%|████▎     | 16190/37963 [50:19:30<62:13:04, 10.29s/it]
 43%|████▎     | 16191/37963 [50:19:46<73:22:08, 12.13s/it]
 43%|████▎     | 16192/37963 [50:20:03<82:07:04, 13.58s/it]
 43%|████▎     | 16193/37963 [50:20:13<75:51:08, 12.54s/it]
 43%|████▎     | 16194/37963 [50:20:24<71:31:09, 11.83s/it]
 43%|████▎     | 16195/37963 [50:20:40<79:52:23, 13.21s/it]
 43%|████▎     | 16196/37963 [50:20:50<74:18:57, 12.29s/it]
 43%|████▎     | 16197/37963 [50:21:00<70:22:57, 11.64s/it]
 43%|████▎     | 16198/37963 [50:21:10<67:30:24, 11.17s/it]
 43%|████▎     | 16199/37963 [50:21:20<65:19:03, 10.80s/it]
 43%|████▎     | 16200/37963 [50:21:30<63:05:56, 10.44s/it]
                                                           
{'loss': '0.159', 'grad_norm': '1.647', 'learning_rate': '1.282e-05', 'epoch': '0.4267'}

 43%|████▎     | 16200/37963 [50:21:30<63:05:56, 10.44s/it]
 43%|████▎     | 16201/37963 [50:21:40<62:35:00, 10.35s/it]
 43%|████▎     | 16202/37963 [50:21:50<62:13:00, 10.29s/it]
 43%|████▎     | 16203/37963 [50:22:00<61:40:29, 10.20s/it]
 43%|████▎     | 16204/37963 [50:22:16<71:50:58, 11.89s/it]
 43%|████▎     | 16205/37963 [50:22:26<68:37:39, 11.35s/it]
 43%|████▎     | 16206/37963 [50:22:36<65:34:14, 10.85s/it]
 43%|████▎     | 16207/37963 [50:22:46<64:10:44, 10.62s/it]
 43%|████▎     | 16208/37963 [50:22:56<62:41:14, 10.37s/it]
 43%|████▎     | 16209/37963 [50:23:06<62:11:54, 10.29s/it]
 43%|████▎     | 16210/37963 [50:23:16<61:56:27, 10.25s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '1.556', 'learning_rate': '1.281e-05', 'epoch': '0.427'}

 43%|████▎     | 16210/37963 [50:23:16<61:56:27, 10.25s/it]
 43%|████▎     | 16211/37963 [50:23:26<61:41:16, 10.21s/it]
 43%|████▎     | 16212/37963 [50:23:36<61:29:02, 10.18s/it]
 43%|████▎     | 16213/37963 [50:23:46<61:27:52, 10.17s/it]
 43%|████▎     | 16214/37963 [50:23:56<61:19:12, 10.15s/it]
 43%|████▎     | 16215/37963 [50:24:07<61:12:53, 10.13s/it]
 43%|████▎     | 16216/37963 [50:24:17<61:13:32, 10.14s/it]
 43%|████▎     | 16217/37963 [50:24:27<61:07:01, 10.12s/it]
 43%|████▎     | 16218/37963 [50:24:44<73:23:44, 12.15s/it]
 43%|████▎     | 16219/37963 [50:24:54<69:41:57, 11.54s/it]
 43%|████▎     | 16220/37963 [50:25:04<67:13:31, 11.13s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '2.003', 'learning_rate': '1.28e-05', 'epoch': '0.4273'}

 43%|████▎     | 16220/37963 [50:25:04<67:13:31, 11.13s/it]
 43%|████▎     | 16221/37963 [50:25:14<65:18:22, 10.81s/it]
 43%|████▎     | 16222/37963 [50:25:30<75:25:35, 12.49s/it]
 43%|████▎     | 16223/37963 [50:25:40<70:08:24, 11.61s/it]
 43%|████▎     | 16224/37963 [50:25:50<66:51:25, 11.07s/it]
 43%|████▎     | 16225/37963 [50:26:06<76:41:53, 12.70s/it]
 43%|████▎     | 16226/37963 [50:26:16<71:39:20, 11.87s/it]
 43%|████▎     | 16227/37963 [50:26:26<68:24:57, 11.33s/it]
 43%|████▎     | 16228/37963 [50:26:36<66:04:39, 10.94s/it]
 43%|████▎     | 16229/37963 [50:26:46<64:27:00, 10.68s/it]
 43%|████▎     | 16230/37963 [50:26:57<63:32:49, 10.53s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '1.11', 'learning_rate': '1.28e-05', 'epoch': '0.4275'}

 43%|████▎     | 16230/37963 [50:26:57<63:32:49, 10.53s/it]
 43%|████▎     | 16231/37963 [50:27:13<74:59:12, 12.42s/it]
 43%|████▎     | 16232/37963 [50:27:24<70:51:10, 11.74s/it]
 43%|████▎     | 16233/37963 [50:27:34<67:50:34, 11.24s/it]
 43%|████▎     | 16234/37963 [50:27:44<65:36:53, 10.87s/it]
 43%|████▎     | 16235/37963 [50:27:54<64:13:56, 10.64s/it]
 43%|████▎     | 16236/37963 [50:28:04<63:06:03, 10.46s/it]
 43%|████▎     | 16237/37963 [50:28:14<62:06:51, 10.29s/it]
 43%|████▎     | 16238/37963 [50:28:24<61:52:21, 10.25s/it]
 43%|████▎     | 16239/37963 [50:28:34<61:31:37, 10.20s/it]
 43%|████▎     | 16240/37963 [50:28:57<85:44:20, 14.21s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '2.658', 'learning_rate': '1.279e-05', 'epoch': '0.4278'}

 43%|████▎     | 16240/37963 [50:28:57<85:44:20, 14.21s/it]
 43%|████▎     | 16241/37963 [50:29:08<78:24:39, 13.00s/it]
 43%|████▎     | 16242/37963 [50:29:18<72:55:34, 12.09s/it]
 43%|████▎     | 16243/37963 [50:29:27<68:51:00, 11.41s/it]
 43%|████▎     | 16244/37963 [50:29:44<78:14:31, 12.97s/it]
 43%|████▎     | 16245/37963 [50:29:54<72:46:50, 12.06s/it]
 43%|████▎     | 16246/37963 [50:30:04<69:13:07, 11.47s/it]
 43%|████▎     | 16247/37963 [50:30:14<66:45:38, 11.07s/it]
 43%|████▎     | 16248/37963 [50:30:24<65:03:59, 10.79s/it]
 43%|████▎     | 16249/37963 [50:30:34<63:32:07, 10.53s/it]
 43%|████▎     | 16250/37963 [50:30:44<62:47:24, 10.41s/it]
                                                           
{'loss': '0.1472', 'grad_norm': '0.8994', 'learning_rate': '1.278e-05', 'epoch': '0.428'}

 43%|████▎     | 16250/37963 [50:30:44<62:47:24, 10.41s/it]
 43%|████▎     | 16251/37963 [50:30:54<61:01:16, 10.12s/it]
 43%|████▎     | 16252/37963 [50:31:04<60:42:26, 10.07s/it]
 43%|████▎     | 16253/37963 [50:31:20<71:51:06, 11.91s/it]
 43%|████▎     | 16254/37963 [50:31:30<68:35:19, 11.37s/it]
 43%|████▎     | 16255/37963 [50:31:40<65:43:58, 10.90s/it]
 43%|████▎     | 16256/37963 [50:31:50<64:12:59, 10.65s/it]
 43%|████▎     | 16257/37963 [50:32:00<63:14:46, 10.49s/it]
 43%|████▎     | 16258/37963 [50:32:10<62:39:20, 10.39s/it]
 43%|████▎     | 16259/37963 [50:32:20<62:07:58, 10.31s/it]
 43%|████▎     | 16260/37963 [50:32:30<61:02:50, 10.13s/it]
                                                           
{'loss': '0.1428', 'grad_norm': '1.473', 'learning_rate': '1.277e-05', 'epoch': '0.4283'}

 43%|████▎     | 16260/37963 [50:32:30<61:02:50, 10.13s/it]
 43%|████▎     | 16261/37963 [50:32:40<60:41:40, 10.07s/it]
 43%|████▎     | 16262/37963 [50:32:50<60:25:29, 10.02s/it]
 43%|████▎     | 16263/37963 [50:33:00<60:17:06, 10.00s/it]
 43%|████▎     | 16264/37963 [50:33:10<59:45:31,  9.91s/it]
 43%|████▎     | 16265/37963 [50:33:26<72:14:36, 11.99s/it]
 43%|████▎     | 16266/37963 [50:33:37<68:48:47, 11.42s/it]
 43%|████▎     | 16267/37963 [50:33:47<66:19:31, 11.01s/it]
 43%|████▎     | 16268/37963 [50:33:57<64:31:10, 10.71s/it]
 43%|████▎     | 16269/37963 [50:34:06<62:56:26, 10.44s/it]
 43%|████▎     | 16270/37963 [50:34:16<61:29:06, 10.20s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '3.881', 'learning_rate': '1.276e-05', 'epoch': '0.4286'}

 43%|████▎     | 16270/37963 [50:34:16<61:29:06, 10.20s/it]
 43%|████▎     | 16271/37963 [50:34:26<61:22:18, 10.19s/it]
 43%|████▎     | 16272/37963 [50:34:43<72:51:07, 12.09s/it]
 43%|████▎     | 16273/37963 [50:34:53<68:55:23, 11.44s/it]
 43%|████▎     | 16274/37963 [50:35:09<78:01:23, 12.95s/it]
 43%|████▎     | 16275/37963 [50:35:19<72:41:29, 12.07s/it]
 43%|████▎     | 16276/37963 [50:35:29<68:22:07, 11.35s/it]
 43%|████▎     | 16277/37963 [50:35:39<66:02:40, 10.96s/it]
 43%|████▎     | 16278/37963 [50:35:49<63:49:40, 10.60s/it]
 43%|████▎     | 16279/37963 [50:36:05<74:02:23, 12.29s/it]
 43%|████▎     | 16280/37963 [50:36:15<70:09:21, 11.65s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '1.451', 'learning_rate': '1.276e-05', 'epoch': '0.4288'}

 43%|████▎     | 16280/37963 [50:36:15<70:09:21, 11.65s/it]
 43%|████▎     | 16281/37963 [50:36:25<67:23:47, 11.19s/it]
 43%|████▎     | 16282/37963 [50:36:35<65:27:07, 10.87s/it]
 43%|████▎     | 16283/37963 [50:36:45<63:54:21, 10.61s/it]
 43%|████▎     | 16284/37963 [50:36:55<62:44:26, 10.42s/it]
 43%|████▎     | 16285/37963 [50:37:05<62:07:20, 10.32s/it]
 43%|████▎     | 16286/37963 [50:37:16<62:18:55, 10.35s/it]
 43%|████▎     | 16287/37963 [50:37:32<73:33:58, 12.22s/it]
 43%|████▎     | 16288/37963 [50:37:42<69:43:51, 11.58s/it]
 43%|████▎     | 16289/37963 [50:37:53<67:16:12, 11.17s/it]
 43%|████▎     | 16290/37963 [50:38:09<76:56:06, 12.78s/it]
                                                           
{'loss': '0.1595', 'grad_norm': '1.847', 'learning_rate': '1.275e-05', 'epoch': '0.4291'}

 43%|████▎     | 16290/37963 [50:38:09<76:56:06, 12.78s/it]
 43%|████▎     | 16291/37963 [50:38:25<82:26:34, 13.69s/it]
 43%|████▎     | 16292/37963 [50:38:35<75:49:48, 12.60s/it]
 43%|████▎     | 16293/37963 [50:38:45<71:55:49, 11.95s/it]
 43%|████▎     | 16294/37963 [50:38:55<67:41:55, 11.25s/it]
 43%|████▎     | 16295/37963 [50:39:05<65:42:25, 10.92s/it]
 43%|████▎     | 16296/37963 [50:39:15<64:07:25, 10.65s/it]
 43%|████▎     | 16297/37963 [50:39:25<62:58:47, 10.46s/it]
 43%|████▎     | 16298/37963 [50:39:35<62:23:33, 10.37s/it]
 43%|████▎     | 16299/37963 [50:39:45<61:35:05, 10.23s/it]
 43%|████▎     | 16300/37963 [50:39:55<61:14:23, 10.18s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '0.7692', 'learning_rate': '1.274e-05', 'epoch': '0.4294'}

 43%|████▎     | 16300/37963 [50:39:55<61:14:23, 10.18s/it]
 43%|████▎     | 16301/37963 [50:40:12<72:02:39, 11.97s/it]
 43%|████▎     | 16302/37963 [50:40:22<69:18:09, 11.52s/it]
 43%|████▎     | 16303/37963 [50:40:32<66:43:19, 11.09s/it]
 43%|████▎     | 16304/37963 [50:40:42<64:17:46, 10.69s/it]
 43%|████▎     | 16305/37963 [50:40:52<63:23:15, 10.54s/it]
 43%|████▎     | 16306/37963 [50:41:02<62:06:56, 10.33s/it]
 43%|████▎     | 16307/37963 [50:41:12<61:46:02, 10.27s/it]
 43%|████▎     | 16308/37963 [50:41:22<61:18:42, 10.19s/it]
 43%|████▎     | 16309/37963 [50:41:32<61:05:11, 10.16s/it]
 43%|████▎     | 16310/37963 [50:41:42<60:39:22, 10.08s/it]
                                                           
{'loss': '0.1396', 'grad_norm': '3.127', 'learning_rate': '1.273e-05', 'epoch': '0.4296'}

 43%|████▎     | 16310/37963 [50:41:42<60:39:22, 10.08s/it]
 43%|████▎     | 16311/37963 [50:41:52<60:20:42, 10.03s/it]
 43%|████▎     | 16312/37963 [50:42:02<60:24:29, 10.04s/it]
 43%|████▎     | 16313/37963 [50:42:19<72:38:03, 12.08s/it]
 43%|████▎     | 16314/37963 [50:42:29<68:51:17, 11.45s/it]
 43%|████▎     | 16315/37963 [50:42:39<66:24:46, 11.04s/it]
 43%|████▎     | 16316/37963 [50:42:49<64:24:40, 10.71s/it]
 43%|████▎     | 16317/37963 [50:42:59<63:22:35, 10.54s/it]
 43%|████▎     | 16318/37963 [50:43:09<62:27:19, 10.39s/it]
 43%|████▎     | 16319/37963 [50:43:19<61:54:13, 10.30s/it]
 43%|████▎     | 16320/37963 [50:43:29<61:31:00, 10.23s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '3.503', 'learning_rate': '1.272e-05', 'epoch': '0.4299'}

 43%|████▎     | 16320/37963 [50:43:29<61:31:00, 10.23s/it]
 43%|████▎     | 16321/37963 [50:43:39<61:05:04, 10.16s/it]
 43%|████▎     | 16322/37963 [50:44:02<84:35:43, 14.07s/it]
 43%|████▎     | 16323/37963 [50:44:12<77:25:50, 12.88s/it]
 43%|████▎     | 16324/37963 [50:44:23<72:31:11, 12.06s/it]
 43%|████▎     | 16325/37963 [50:44:32<68:14:48, 11.35s/it]
 43%|████▎     | 16326/37963 [50:44:49<77:34:36, 12.91s/it]
 43%|████▎     | 16327/37963 [50:44:59<72:34:35, 12.08s/it]
 43%|████▎     | 16328/37963 [50:45:09<68:50:15, 11.45s/it]
 43%|████▎     | 16329/37963 [50:45:19<66:31:30, 11.07s/it]
 43%|████▎     | 16330/37963 [50:45:29<64:49:13, 10.79s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '1.276', 'learning_rate': '1.271e-05', 'epoch': '0.4302'}

 43%|████▎     | 16330/37963 [50:45:29<64:49:13, 10.79s/it]
 43%|████▎     | 16331/37963 [50:45:39<63:35:31, 10.58s/it]
 43%|████▎     | 16332/37963 [50:45:50<62:47:50, 10.45s/it]
 43%|████▎     | 16333/37963 [50:46:00<62:11:02, 10.35s/it]
 43%|████▎     | 16334/37963 [50:46:10<61:22:24, 10.22s/it]
 43%|████▎     | 16335/37963 [50:46:26<72:51:31, 12.13s/it]
 43%|████▎     | 16336/37963 [50:46:36<69:13:35, 11.52s/it]
 43%|████▎     | 16337/37963 [50:46:46<66:46:03, 11.11s/it]
 43%|████▎     | 16338/37963 [50:47:03<76:14:52, 12.69s/it]
 43%|████▎     | 16339/37963 [50:47:20<84:00:53, 13.99s/it]
 43%|████▎     | 16340/37963 [50:47:30<76:57:01, 12.81s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '2.365', 'learning_rate': '1.271e-05', 'epoch': '0.4304'}

 43%|████▎     | 16340/37963 [50:47:30<76:57:01, 12.81s/it]
 43%|████▎     | 16341/37963 [50:47:40<71:36:40, 11.92s/it]
 43%|████▎     | 16342/37963 [50:47:50<68:12:34, 11.36s/it]
 43%|████▎     | 16343/37963 [50:48:00<65:50:52, 10.96s/it]
 43%|████▎     | 16344/37963 [50:48:10<63:46:14, 10.62s/it]
 43%|████▎     | 16345/37963 [50:48:19<62:24:55, 10.39s/it]
 43%|████▎     | 16346/37963 [50:48:29<61:22:15, 10.22s/it]
 43%|████▎     | 16347/37963 [50:48:39<60:49:50, 10.13s/it]
 43%|████▎     | 16348/37963 [50:48:49<60:24:18, 10.06s/it]
 43%|████▎     | 16349/37963 [50:49:06<71:56:20, 11.98s/it]
 43%|████▎     | 16350/37963 [50:49:16<68:46:20, 11.46s/it]
                                                           
{'loss': '0.1588', 'grad_norm': '3.365', 'learning_rate': '1.27e-05', 'epoch': '0.4307'}

 43%|████▎     | 16350/37963 [50:49:16<68:46:20, 11.46s/it]
 43%|████▎     | 16351/37963 [50:49:26<66:01:42, 11.00s/it]
 43%|████▎     | 16352/37963 [50:49:36<64:20:24, 10.72s/it]
 43%|████▎     | 16353/37963 [50:49:46<63:11:20, 10.53s/it]
 43%|████▎     | 16354/37963 [50:49:56<62:13:13, 10.37s/it]
 43%|████▎     | 16355/37963 [50:50:06<61:51:32, 10.31s/it]
 43%|████▎     | 16356/37963 [50:50:16<61:14:30, 10.20s/it]
 43%|████▎     | 16357/37963 [50:50:26<60:59:40, 10.16s/it]
 43%|████▎     | 16358/37963 [50:50:36<60:50:24, 10.14s/it]
 43%|████▎     | 16359/37963 [50:50:46<60:50:14, 10.14s/it]
 43%|████▎     | 16360/37963 [50:50:56<60:53:07, 10.15s/it]
                                                           
{'loss': '0.1718', 'grad_norm': '1.433', 'learning_rate': '1.269e-05', 'epoch': '0.4309'}

 43%|████▎     | 16360/37963 [50:50:56<60:53:07, 10.15s/it]
 43%|████▎     | 16361/37963 [50:51:07<60:55:18, 10.15s/it]
 43%|████▎     | 16362/37963 [50:51:23<72:39:10, 12.11s/it]
 43%|████▎     | 16363/37963 [50:51:33<68:45:36, 11.46s/it]
 43%|████▎     | 16364/37963 [50:51:43<66:18:09, 11.05s/it]
 43%|████▎     | 16365/37963 [50:51:53<63:46:00, 10.63s/it]
 43%|████▎     | 16366/37963 [50:52:03<62:44:01, 10.46s/it]
 43%|████▎     | 16367/37963 [50:52:13<61:35:50, 10.27s/it]
 43%|████▎     | 16368/37963 [50:52:23<60:57:07, 10.16s/it]
 43%|████▎     | 16369/37963 [50:52:32<60:08:36, 10.03s/it]
 43%|████▎     | 16370/37963 [50:52:49<71:51:28, 11.98s/it]
                                                           
{'loss': '0.1545', 'grad_norm': '1.566', 'learning_rate': '1.268e-05', 'epoch': '0.4312'}

 43%|████▎     | 16370/37963 [50:52:49<71:51:28, 11.98s/it]
 43%|████▎     | 16371/37963 [50:53:05<79:34:01, 13.27s/it]
 43%|████▎     | 16372/37963 [50:53:15<73:44:14, 12.29s/it]
 43%|████▎     | 16373/37963 [50:53:25<69:43:23, 11.63s/it]
 43%|████▎     | 16374/37963 [50:53:42<78:32:34, 13.10s/it]
 43%|████▎     | 16375/37963 [50:53:52<73:16:27, 12.22s/it]
 43%|████▎     | 16376/37963 [50:54:02<69:30:26, 11.59s/it]
 43%|████▎     | 16377/37963 [50:54:12<66:50:10, 11.15s/it]
 43%|████▎     | 16378/37963 [50:54:23<65:11:04, 10.87s/it]
 43%|████▎     | 16379/37963 [50:54:32<63:20:07, 10.56s/it]
 43%|████▎     | 16380/37963 [50:54:43<62:47:36, 10.47s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '2.829', 'learning_rate': '1.267e-05', 'epoch': '0.4315'}

 43%|████▎     | 16380/37963 [50:54:43<62:47:36, 10.47s/it]
 43%|████▎     | 16381/37963 [50:54:52<60:59:54, 10.17s/it]
 43%|████▎     | 16382/37963 [50:55:02<61:00:40, 10.18s/it]
 43%|████▎     | 16383/37963 [50:55:12<60:46:13, 10.14s/it]
 43%|████▎     | 16384/37963 [50:55:29<72:04:07, 12.02s/it]
 43%|████▎     | 16385/37963 [50:55:39<69:19:57, 11.57s/it]
 43%|████▎     | 16386/37963 [50:55:57<79:33:14, 13.27s/it]
 43%|████▎     | 16387/37963 [50:56:13<85:41:13, 14.30s/it]
 43%|████▎     | 16388/37963 [50:56:23<77:35:17, 12.95s/it]
 43%|████▎     | 16389/37963 [50:56:33<72:25:36, 12.09s/it]
 43%|████▎     | 16390/37963 [50:56:43<68:56:19, 11.50s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '0.9234', 'learning_rate': '1.267e-05', 'epoch': '0.4317'}

 43%|████▎     | 16390/37963 [50:56:43<68:56:19, 11.50s/it]
 43%|████▎     | 16391/37963 [50:56:53<66:07:36, 11.04s/it]
 43%|████▎     | 16392/37963 [50:57:03<64:25:03, 10.75s/it]
 43%|████▎     | 16393/37963 [50:57:13<63:10:47, 10.54s/it]
 43%|████▎     | 16394/37963 [50:57:23<62:02:29, 10.36s/it]
 43%|████▎     | 16395/37963 [50:57:33<61:40:48, 10.30s/it]
 43%|████▎     | 16396/37963 [50:57:44<61:41:40, 10.30s/it]
 43%|████▎     | 16397/37963 [50:58:00<72:37:16, 12.12s/it]
 43%|████▎     | 16398/37963 [50:58:10<68:20:16, 11.41s/it]
 43%|████▎     | 16399/37963 [50:58:20<65:48:07, 10.99s/it]
 43%|████▎     | 16400/37963 [50:58:30<64:08:31, 10.71s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '3.951', 'learning_rate': '1.266e-05', 'epoch': '0.432'}

 43%|████▎     | 16400/37963 [50:58:30<64:08:31, 10.71s/it]
 43%|████▎     | 16401/37963 [50:58:40<63:02:52, 10.53s/it]
 43%|████▎     | 16402/37963 [50:58:50<61:48:35, 10.32s/it]
 43%|████▎     | 16403/37963 [50:59:00<61:09:01, 10.21s/it]
 43%|████▎     | 16404/37963 [50:59:10<60:55:40, 10.17s/it]
 43%|████▎     | 16405/37963 [50:59:20<60:47:31, 10.15s/it]
 43%|████▎     | 16406/37963 [50:59:29<59:25:46,  9.92s/it]
 43%|████▎     | 16407/37963 [50:59:40<60:04:35, 10.03s/it]
 43%|████▎     | 16408/37963 [50:59:50<60:18:26, 10.07s/it]
 43%|████▎     | 16409/37963 [51:00:06<71:46:50, 11.99s/it]
 43%|████▎     | 16410/37963 [51:00:16<68:10:47, 11.39s/it]
                                                           
{'loss': '0.1378', 'grad_norm': '1.377', 'learning_rate': '1.265e-05', 'epoch': '0.4323'}

 43%|████▎     | 16410/37963 [51:00:16<68:10:47, 11.39s/it]
 43%|████▎     | 16411/37963 [51:00:26<65:24:42, 10.93s/it]
 43%|████▎     | 16412/37963 [51:00:36<63:48:13, 10.66s/it]
 43%|████▎     | 16413/37963 [51:00:46<62:51:11, 10.50s/it]
 43%|████▎     | 16414/37963 [51:00:56<61:22:57, 10.25s/it]
 43%|████▎     | 16415/37963 [51:01:06<60:11:13, 10.06s/it]
 43%|████▎     | 16416/37963 [51:01:15<59:23:46,  9.92s/it]
 43%|████▎     | 16417/37963 [51:01:32<71:09:12, 11.89s/it]
 43%|████▎     | 16418/37963 [51:01:42<68:12:19, 11.40s/it]
 43%|████▎     | 16419/37963 [51:01:58<77:02:12, 12.87s/it]
 43%|████▎     | 16420/37963 [51:02:08<72:15:58, 12.08s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '0.9811', 'learning_rate': '1.264e-05', 'epoch': '0.4325'}

 43%|████▎     | 16420/37963 [51:02:08<72:15:58, 12.08s/it]
 43%|████▎     | 16421/37963 [51:02:19<68:58:23, 11.53s/it]
 43%|████▎     | 16422/37963 [51:02:29<66:34:57, 11.13s/it]
 43%|████▎     | 16423/37963 [51:02:46<76:43:41, 12.82s/it]
 43%|████▎     | 16424/37963 [51:02:56<71:42:29, 11.99s/it]
 43%|████▎     | 16425/37963 [51:03:06<68:08:18, 11.39s/it]
 43%|████▎     | 16426/37963 [51:03:16<65:41:04, 10.98s/it]
 43%|████▎     | 16427/37963 [51:03:26<63:46:56, 10.66s/it]
 43%|████▎     | 16428/37963 [51:03:36<62:22:37, 10.43s/it]
 43%|████▎     | 16429/37963 [51:03:46<61:57:17, 10.36s/it]
 43%|████▎     | 16430/37963 [51:03:56<61:17:34, 10.25s/it]
                                                           
{'loss': '0.1548', 'grad_norm': '0.9049', 'learning_rate': '1.263e-05', 'epoch': '0.4328'}

 43%|████▎     | 16430/37963 [51:03:56<61:17:34, 10.25s/it]
 43%|████▎     | 16431/37963 [51:04:12<72:26:32, 12.11s/it]
 43%|████▎     | 16432/37963 [51:04:22<68:20:31, 11.43s/it]
 43%|████▎     | 16433/37963 [51:04:38<76:26:47, 12.78s/it]
 43%|████▎     | 16434/37963 [51:04:55<84:16:32, 14.09s/it]
 43%|████▎     | 16435/37963 [51:05:05<77:11:56, 12.91s/it]
 43%|████▎     | 16436/37963 [51:05:15<71:58:15, 12.04s/it]
 43%|████▎     | 16437/37963 [51:05:25<68:16:52, 11.42s/it]
 43%|████▎     | 16438/37963 [51:05:35<65:13:01, 10.91s/it]
 43%|████▎     | 16439/37963 [51:05:45<63:40:44, 10.65s/it]
 43%|████▎     | 16440/37963 [51:05:55<62:39:27, 10.48s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '1.385', 'learning_rate': '1.262e-05', 'epoch': '0.4331'}

 43%|████▎     | 16440/37963 [51:05:55<62:39:27, 10.48s/it]
 43%|████▎     | 16441/37963 [51:06:05<61:16:00, 10.25s/it]
 43%|████▎     | 16442/37963 [51:06:15<61:04:22, 10.22s/it]
 43%|████▎     | 16443/37963 [51:06:25<60:33:31, 10.13s/it]
 43%|████▎     | 16444/37963 [51:06:35<60:27:28, 10.11s/it]
 43%|████▎     | 16445/37963 [51:06:45<60:28:06, 10.12s/it]
 43%|████▎     | 16446/37963 [51:07:01<71:47:19, 12.01s/it]
 43%|████▎     | 16447/37963 [51:07:12<68:41:22, 11.49s/it]
 43%|████▎     | 16448/37963 [51:07:22<66:01:40, 11.05s/it]
 43%|████▎     | 16449/37963 [51:07:32<64:27:22, 10.79s/it]
 43%|████▎     | 16450/37963 [51:07:42<63:12:49, 10.58s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.268', 'learning_rate': '1.262e-05', 'epoch': '0.4333'}

 43%|████▎     | 16450/37963 [51:07:42<63:12:49, 10.58s/it]
 43%|████▎     | 16451/37963 [51:07:52<61:48:40, 10.34s/it]
 43%|████▎     | 16452/37963 [51:08:02<60:55:19, 10.20s/it]
 43%|████▎     | 16453/37963 [51:08:12<60:42:15, 10.16s/it]
 43%|████▎     | 16454/37963 [51:08:22<60:42:33, 10.16s/it]
 43%|████▎     | 16455/37963 [51:08:32<60:40:07, 10.15s/it]
 43%|████▎     | 16456/37963 [51:08:42<60:39:17, 10.15s/it]
 43%|████▎     | 16457/37963 [51:08:52<60:35:52, 10.14s/it]
 43%|████▎     | 16458/37963 [51:09:09<72:16:00, 12.10s/it]
 43%|████▎     | 16459/37963 [51:09:19<68:43:25, 11.51s/it]
 43%|████▎     | 16460/37963 [51:09:29<66:07:04, 11.07s/it]
                                                           
{'loss': '0.1545', 'grad_norm': '2.333', 'learning_rate': '1.261e-05', 'epoch': '0.4336'}

 43%|████▎     | 16460/37963 [51:09:29<66:07:04, 11.07s/it]
 43%|████▎     | 16461/37963 [51:09:39<64:16:09, 10.76s/it]
 43%|████▎     | 16462/37963 [51:09:49<63:04:52, 10.56s/it]
 43%|████▎     | 16463/37963 [51:09:59<61:35:02, 10.31s/it]
 43%|████▎     | 16464/37963 [51:10:15<72:17:04, 12.10s/it]
 43%|████▎     | 16465/37963 [51:10:25<68:44:01, 11.51s/it]
 43%|████▎     | 16466/37963 [51:10:35<65:21:46, 10.95s/it]
 43%|████▎     | 16467/37963 [51:10:52<75:13:02, 12.60s/it]
 43%|████▎     | 16468/37963 [51:11:01<69:47:38, 11.69s/it]
 43%|████▎     | 16469/37963 [51:11:11<66:53:42, 11.20s/it]
 43%|████▎     | 16470/37963 [51:11:21<64:51:38, 10.86s/it]
                                                           
{'loss': '0.1685', 'grad_norm': '1.118', 'learning_rate': '1.26e-05', 'epoch': '0.4338'}

 43%|████▎     | 16470/37963 [51:11:21<64:51:38, 10.86s/it]
 43%|████▎     | 16471/37963 [51:11:37<74:19:13, 12.45s/it]
 43%|████▎     | 16472/37963 [51:11:47<70:03:33, 11.74s/it]
 43%|████▎     | 16473/37963 [51:11:58<67:06:46, 11.24s/it]
 43%|████▎     | 16474/37963 [51:12:08<65:00:57, 10.89s/it]
 43%|████▎     | 16475/37963 [51:12:18<63:39:08, 10.66s/it]
 43%|████▎     | 16476/37963 [51:12:28<62:34:40, 10.48s/it]
 43%|████▎     | 16477/37963 [51:12:38<62:02:28, 10.40s/it]
 43%|████▎     | 16478/37963 [51:12:48<61:02:14, 10.23s/it]
 43%|████▎     | 16479/37963 [51:13:04<72:06:21, 12.08s/it]
 43%|████▎     | 16480/37963 [51:13:14<68:35:46, 11.49s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '2.345', 'learning_rate': '1.259e-05', 'epoch': '0.4341'}

 43%|████▎     | 16480/37963 [51:13:14<68:35:46, 11.49s/it]
 43%|████▎     | 16481/37963 [51:13:31<77:22:35, 12.97s/it]
 43%|████▎     | 16482/37963 [51:13:48<84:55:19, 14.23s/it]
 43%|████▎     | 16483/37963 [51:13:58<76:52:04, 12.88s/it]
 43%|████▎     | 16484/37963 [51:14:08<71:30:38, 11.99s/it]
 43%|████▎     | 16485/37963 [51:14:18<68:06:26, 11.42s/it]
 43%|████▎     | 16486/37963 [51:14:28<65:54:02, 11.05s/it]
 43%|████▎     | 16487/37963 [51:14:38<63:49:57, 10.70s/it]
 43%|████▎     | 16488/37963 [51:14:48<62:43:18, 10.51s/it]
 43%|████▎     | 16489/37963 [51:14:58<61:26:50, 10.30s/it]
 43%|████▎     | 16490/37963 [51:15:08<61:02:16, 10.23s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '1.355', 'learning_rate': '1.258e-05', 'epoch': '0.4344'}

 43%|████▎     | 16490/37963 [51:15:08<61:02:16, 10.23s/it]
 43%|████▎     | 16491/37963 [51:15:18<60:25:31, 10.13s/it]
 43%|████▎     | 16492/37963 [51:15:28<60:18:28, 10.11s/it]
 43%|████▎     | 16493/37963 [51:15:38<60:08:59, 10.09s/it]
 43%|████▎     | 16494/37963 [51:15:48<59:45:18, 10.02s/it]
 43%|████▎     | 16495/37963 [51:16:04<71:48:17, 12.04s/it]
 43%|████▎     | 16496/37963 [51:16:14<68:07:18, 11.42s/it]
 43%|████▎     | 16497/37963 [51:16:24<65:27:38, 10.98s/it]
 43%|████▎     | 16498/37963 [51:16:34<63:47:02, 10.70s/it]
 43%|████▎     | 16499/37963 [51:16:44<62:07:04, 10.42s/it]
 43%|████▎     | 16500/37963 [51:16:54<61:31:19, 10.32s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '1.565', 'learning_rate': '1.257e-05', 'epoch': '0.4346'}

 43%|████▎     | 16500/37963 [51:16:54<61:31:19, 10.32s/it]
 43%|████▎     | 16501/37963 [51:17:04<61:06:14, 10.25s/it]
 43%|████▎     | 16502/37963 [51:17:14<60:24:33, 10.13s/it]
 43%|████▎     | 16503/37963 [51:17:24<60:09:27, 10.09s/it]
 43%|████▎     | 16504/37963 [51:17:34<60:09:34, 10.09s/it]
 43%|████▎     | 16505/37963 [51:17:44<60:10:55, 10.10s/it]
 43%|████▎     | 16506/37963 [51:18:01<72:03:39, 12.09s/it]
 43%|████▎     | 16507/37963 [51:18:11<68:41:01, 11.52s/it]
 43%|████▎     | 16508/37963 [51:18:21<66:09:33, 11.10s/it]
 43%|████▎     | 16509/37963 [51:18:31<63:38:43, 10.68s/it]
 43%|████▎     | 16510/37963 [51:18:41<62:40:50, 10.52s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '1.155', 'learning_rate': '1.257e-05', 'epoch': '0.4349'}

 43%|████▎     | 16510/37963 [51:18:41<62:40:50, 10.52s/it]
 43%|████▎     | 16511/37963 [51:18:58<73:17:23, 12.30s/it]
 43%|████▎     | 16512/37963 [51:19:08<69:21:52, 11.64s/it]
 43%|████▎     | 16513/37963 [51:19:18<66:43:59, 11.20s/it]
 44%|████▎     | 16514/37963 [51:19:35<76:38:56, 12.86s/it]
 44%|████▎     | 16515/37963 [51:19:45<71:48:12, 12.05s/it]
 44%|████▎     | 16516/37963 [51:19:55<68:15:51, 11.46s/it]
 44%|████▎     | 16517/37963 [51:20:05<66:06:33, 11.10s/it]
 44%|████▎     | 16518/37963 [51:20:15<64:36:03, 10.84s/it]
 44%|████▎     | 16519/37963 [51:20:25<62:32:20, 10.50s/it]
 44%|████▎     | 16520/37963 [51:20:35<61:57:00, 10.40s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '1.231', 'learning_rate': '1.256e-05', 'epoch': '0.4352'}

 44%|████▎     | 16520/37963 [51:20:35<61:57:00, 10.40s/it]
 44%|████▎     | 16521/37963 [51:20:51<71:45:27, 12.05s/it]
 44%|████▎     | 16522/37963 [51:21:01<68:29:18, 11.50s/it]
 44%|████▎     | 16523/37963 [51:21:11<65:40:09, 11.03s/it]
 44%|████▎     | 16524/37963 [51:21:21<63:53:17, 10.73s/it]
 44%|████▎     | 16525/37963 [51:21:31<62:33:59, 10.51s/it]
 44%|████▎     | 16526/37963 [51:21:48<72:51:04, 12.23s/it]
 44%|████▎     | 16527/37963 [51:21:57<68:39:02, 11.53s/it]
 44%|████▎     | 16528/37963 [51:22:08<66:01:57, 11.09s/it]
 44%|████▎     | 16529/37963 [51:22:18<64:18:23, 10.80s/it]
 44%|████▎     | 16530/37963 [51:22:34<74:26:25, 12.50s/it]
                                                           
{'loss': '0.1461', 'grad_norm': '1.359', 'learning_rate': '1.255e-05', 'epoch': '0.4354'}

 44%|████▎     | 16530/37963 [51:22:34<74:26:25, 12.50s/it]
 44%|████▎     | 16531/37963 [51:22:51<82:32:47, 13.87s/it]
 44%|████▎     | 16532/37963 [51:23:01<75:47:21, 12.73s/it]
 44%|████▎     | 16533/37963 [51:23:11<70:50:07, 11.90s/it]
 44%|████▎     | 16534/37963 [51:23:21<67:33:05, 11.35s/it]
 44%|████▎     | 16535/37963 [51:23:31<65:14:14, 10.96s/it]
 44%|████▎     | 16536/37963 [51:23:41<63:44:50, 10.71s/it]
 44%|████▎     | 16537/37963 [51:23:52<62:42:43, 10.54s/it]
 44%|████▎     | 16538/37963 [51:24:02<61:57:16, 10.41s/it]
 44%|████▎     | 16539/37963 [51:24:12<61:17:55, 10.30s/it]
 44%|████▎     | 16540/37963 [51:24:22<60:52:16, 10.23s/it]
                                                           
{'loss': '0.1453', 'grad_norm': '1.631', 'learning_rate': '1.254e-05', 'epoch': '0.4357'}

 44%|████▎     | 16540/37963 [51:24:22<60:52:16, 10.23s/it]
 44%|████▎     | 16541/37963 [51:24:32<60:38:11, 10.19s/it]
 44%|████▎     | 16542/37963 [51:24:48<71:49:52, 12.07s/it]
 44%|████▎     | 16543/37963 [51:24:58<68:21:10, 11.49s/it]
 44%|████▎     | 16544/37963 [51:25:09<65:47:45, 11.06s/it]
 44%|████▎     | 16545/37963 [51:25:19<63:58:33, 10.75s/it]
 44%|████▎     | 16546/37963 [51:25:29<63:01:51, 10.59s/it]
 44%|████▎     | 16547/37963 [51:25:39<62:03:07, 10.43s/it]
 44%|████▎     | 16548/37963 [51:25:49<61:22:26, 10.32s/it]
 44%|████▎     | 16549/37963 [51:25:59<61:03:10, 10.26s/it]
 44%|████▎     | 16550/37963 [51:26:09<61:01:45, 10.26s/it]
                                                           
{'loss': '0.138', 'grad_norm': '1.803', 'learning_rate': '1.253e-05', 'epoch': '0.436'}

 44%|████▎     | 16550/37963 [51:26:09<61:01:45, 10.26s/it]
 44%|████▎     | 16551/37963 [51:26:19<60:46:06, 10.22s/it]
 44%|████▎     | 16552/37963 [51:26:29<60:02:57, 10.10s/it]
 44%|████▎     | 16553/37963 [51:26:39<60:03:24, 10.10s/it]
 44%|████▎     | 16554/37963 [51:26:49<59:51:29, 10.07s/it]
 44%|████▎     | 16555/37963 [51:26:59<59:47:17, 10.05s/it]
 44%|████▎     | 16556/37963 [51:27:16<72:21:33, 12.17s/it]
 44%|████▎     | 16557/37963 [51:27:27<68:47:14, 11.57s/it]
 44%|████▎     | 16558/37963 [51:27:37<66:14:52, 11.14s/it]
 44%|████▎     | 16559/37963 [51:27:47<64:18:17, 10.82s/it]
 44%|████▎     | 16560/37963 [51:28:03<74:00:58, 12.45s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '0.5805', 'learning_rate': '1.252e-05', 'epoch': '0.4362'}

 44%|████▎     | 16560/37963 [51:28:03<74:00:58, 12.45s/it]
 44%|████▎     | 16561/37963 [51:28:13<69:57:31, 11.77s/it]
 44%|████▎     | 16562/37963 [51:28:23<67:02:14, 11.28s/it]
 44%|████▎     | 16563/37963 [51:28:33<64:26:21, 10.84s/it]
 44%|████▎     | 16564/37963 [51:28:50<74:46:46, 12.58s/it]
 44%|████▎     | 16565/37963 [51:29:00<70:00:54, 11.78s/it]
 44%|████▎     | 16566/37963 [51:29:10<66:57:42, 11.27s/it]
 44%|████▎     | 16567/37963 [51:29:20<64:52:13, 10.91s/it]
 44%|████▎     | 16568/37963 [51:29:36<74:06:08, 12.47s/it]
 44%|████▎     | 16569/37963 [51:29:46<69:44:05, 11.73s/it]
 44%|████▎     | 16570/37963 [51:29:56<66:51:50, 11.25s/it]
                                                           
{'loss': '0.1521', 'grad_norm': '1.091', 'learning_rate': '1.252e-05', 'epoch': '0.4365'}

 44%|████▎     | 16570/37963 [51:29:56<66:51:50, 11.25s/it]
 44%|████▎     | 16571/37963 [51:30:06<63:49:52, 10.74s/it]
 44%|████▎     | 16572/37963 [51:30:16<62:12:36, 10.47s/it]
 44%|████▎     | 16573/37963 [51:30:26<61:30:53, 10.35s/it]
 44%|████▎     | 16574/37963 [51:30:42<72:19:08, 12.17s/it]
 44%|████▎     | 16575/37963 [51:30:52<68:41:56, 11.56s/it]
 44%|████▎     | 16576/37963 [51:31:02<66:02:53, 11.12s/it]
 44%|████▎     | 16577/37963 [51:31:12<64:01:57, 10.78s/it]
 44%|████▎     | 16578/37963 [51:31:22<61:43:53, 10.39s/it]
 44%|████▎     | 16579/37963 [51:31:45<84:49:06, 14.28s/it]
 44%|████▎     | 16580/37963 [51:31:55<76:48:38, 12.93s/it]
                                                           
{'loss': '0.151', 'grad_norm': '1.447', 'learning_rate': '1.251e-05', 'epoch': '0.4367'}

 44%|████▎     | 16580/37963 [51:31:55<76:48:38, 12.93s/it]
 44%|████▎     | 16581/37963 [51:32:05<71:40:50, 12.07s/it]
 44%|████▎     | 16582/37963 [51:32:15<68:05:10, 11.46s/it]
 44%|████▎     | 16583/37963 [51:32:25<65:24:40, 11.01s/it]
 44%|████▎     | 16584/37963 [51:32:35<63:45:45, 10.74s/it]
 44%|████▎     | 16585/37963 [51:32:45<62:36:54, 10.54s/it]
 44%|████▎     | 16586/37963 [51:32:55<60:59:28, 10.27s/it]
 44%|████▎     | 16587/37963 [51:33:05<60:39:10, 10.21s/it]
 44%|████▎     | 16588/37963 [51:33:15<60:30:00, 10.19s/it]
 44%|████▎     | 16589/37963 [51:33:25<59:38:30, 10.05s/it]
 44%|████▎     | 16590/37963 [51:33:41<70:10:21, 11.82s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '1.498', 'learning_rate': '1.25e-05', 'epoch': '0.437'}

 44%|████▎     | 16590/37963 [51:33:41<70:10:21, 11.82s/it]
 44%|████▎     | 16591/37963 [51:33:51<67:07:59, 11.31s/it]
 44%|████▎     | 16592/37963 [51:34:01<64:55:54, 10.94s/it]
 44%|████▎     | 16593/37963 [51:34:11<63:23:04, 10.68s/it]
 44%|████▎     | 16594/37963 [51:34:21<62:25:31, 10.52s/it]
 44%|████▎     | 16595/37963 [51:34:31<61:43:43, 10.40s/it]
 44%|████▎     | 16596/37963 [51:34:41<61:08:40, 10.30s/it]
 44%|████▎     | 16597/37963 [51:34:51<60:35:56, 10.21s/it]
 44%|████▎     | 16598/37963 [51:35:01<60:19:58, 10.17s/it]
 44%|████▎     | 16599/37963 [51:35:11<60:10:00, 10.14s/it]
 44%|████▎     | 16600/37963 [51:35:22<60:19:51, 10.17s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '3.238', 'learning_rate': '1.249e-05', 'epoch': '0.4373'}

 44%|████▎     | 16600/37963 [51:35:22<60:19:51, 10.17s/it]
 44%|████▎     | 16601/37963 [51:35:32<60:22:16, 10.17s/it]
 44%|████▎     | 16602/37963 [51:35:42<60:14:30, 10.15s/it]
 44%|████▎     | 16603/37963 [51:35:52<60:23:18, 10.18s/it]
 44%|████▎     | 16604/37963 [51:36:09<71:25:22, 12.04s/it]
 44%|████▎     | 16605/37963 [51:36:19<68:01:45, 11.47s/it]
 44%|████▎     | 16606/37963 [51:36:29<65:33:36, 11.05s/it]
 44%|████▎     | 16607/37963 [51:36:39<63:51:44, 10.77s/it]
 44%|████▎     | 16608/37963 [51:36:55<73:13:33, 12.34s/it]
 44%|████▍     | 16609/37963 [51:37:05<69:23:50, 11.70s/it]
 44%|████▍     | 16610/37963 [51:37:15<66:42:13, 11.25s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '2.783', 'learning_rate': '1.248e-05', 'epoch': '0.4375'}

 44%|████▍     | 16610/37963 [51:37:15<66:42:13, 11.25s/it]
 44%|████▍     | 16611/37963 [51:37:25<64:12:02, 10.82s/it]
 44%|████▍     | 16612/37963 [51:37:35<62:56:39, 10.61s/it]
 44%|████▍     | 16613/37963 [51:37:52<73:08:56, 12.33s/it]
 44%|████▍     | 16614/37963 [51:38:01<68:31:15, 11.55s/it]
 44%|████▍     | 16615/37963 [51:38:18<77:11:07, 13.02s/it]
 44%|████▍     | 16616/37963 [51:38:28<72:11:16, 12.17s/it]
 44%|████▍     | 16617/37963 [51:38:38<68:30:54, 11.56s/it]
 44%|████▍     | 16618/37963 [51:38:48<65:45:51, 11.09s/it]
 44%|████▍     | 16619/37963 [51:38:58<63:48:40, 10.76s/it]
 44%|████▍     | 16620/37963 [51:39:08<62:29:15, 10.54s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '0.6706', 'learning_rate': '1.248e-05', 'epoch': '0.4378'}

 44%|████▍     | 16620/37963 [51:39:08<62:29:15, 10.54s/it]
 44%|████▍     | 16621/37963 [51:39:18<61:15:10, 10.33s/it]
 44%|████▍     | 16622/37963 [51:39:34<72:04:06, 12.16s/it]
 44%|████▍     | 16623/37963 [51:39:44<67:53:04, 11.45s/it]
 44%|████▍     | 16624/37963 [51:39:54<65:23:30, 11.03s/it]
 44%|████▍     | 16625/37963 [51:40:04<63:16:27, 10.68s/it]
 44%|████▍     | 16626/37963 [51:40:14<62:09:20, 10.49s/it]
 44%|████▍     | 16627/37963 [51:40:30<71:49:56, 12.12s/it]
 44%|████▍     | 16628/37963 [51:40:40<68:10:03, 11.50s/it]
 44%|████▍     | 16629/37963 [51:40:57<78:23:17, 13.23s/it]
 44%|████▍     | 16630/37963 [51:41:07<72:52:26, 12.30s/it]
                                                           
{'loss': '0.1392', 'grad_norm': '1.621', 'learning_rate': '1.247e-05', 'epoch': '0.4381'}

 44%|████▍     | 16630/37963 [51:41:07<72:52:26, 12.30s/it]
 44%|████▍     | 16631/37963 [51:41:18<69:13:02, 11.68s/it]
 44%|████▍     | 16632/37963 [51:41:28<66:17:35, 11.19s/it]
 44%|████▍     | 16633/37963 [51:41:38<63:54:09, 10.79s/it]
 44%|████▍     | 16634/37963 [51:41:48<62:38:59, 10.57s/it]
 44%|████▍     | 16635/37963 [51:41:58<61:43:37, 10.42s/it]
 44%|████▍     | 16636/37963 [51:42:08<60:41:57, 10.25s/it]
 44%|████▍     | 16637/37963 [51:42:18<60:22:49, 10.19s/it]
 44%|████▍     | 16638/37963 [51:42:34<70:52:51, 11.97s/it]
 44%|████▍     | 16639/37963 [51:42:44<67:34:33, 11.41s/it]
 44%|████▍     | 16640/37963 [51:42:54<65:20:59, 11.03s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '1.59', 'learning_rate': '1.246e-05', 'epoch': '0.4383'}

 44%|████▍     | 16640/37963 [51:42:54<65:20:59, 11.03s/it]
 44%|████▍     | 16641/37963 [51:43:04<63:04:14, 10.65s/it]
 44%|████▍     | 16642/37963 [51:43:14<61:36:50, 10.40s/it]
 44%|████▍     | 16643/37963 [51:43:24<61:03:55, 10.31s/it]
 44%|████▍     | 16644/37963 [51:43:34<60:10:12, 10.16s/it]
 44%|████▍     | 16645/37963 [51:43:43<59:49:59, 10.10s/it]
 44%|████▍     | 16646/37963 [51:43:54<59:50:08, 10.11s/it]
 44%|████▍     | 16647/37963 [51:44:04<59:40:33, 10.08s/it]
 44%|████▍     | 16648/37963 [51:44:14<59:27:34, 10.04s/it]
 44%|████▍     | 16649/37963 [51:44:24<59:46:20, 10.10s/it]
 44%|████▍     | 16650/37963 [51:44:34<59:15:02, 10.01s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '0.867', 'learning_rate': '1.245e-05', 'epoch': '0.4386'}

 44%|████▍     | 16650/37963 [51:44:34<59:15:02, 10.01s/it]
 44%|████▍     | 16651/37963 [51:44:44<59:21:34, 10.03s/it]
 44%|████▍     | 16652/37963 [51:45:01<72:01:12, 12.17s/it]
 44%|████▍     | 16653/37963 [51:45:11<68:18:00, 11.54s/it]
 44%|████▍     | 16654/37963 [51:45:21<65:44:36, 11.11s/it]
 44%|████▍     | 16655/37963 [51:45:31<63:59:18, 10.81s/it]
 44%|████▍     | 16656/37963 [51:45:47<73:37:46, 12.44s/it]
 44%|████▍     | 16657/37963 [51:45:57<69:27:00, 11.73s/it]
 44%|████▍     | 16658/37963 [51:46:07<66:28:04, 11.23s/it]
 44%|████▍     | 16659/37963 [51:46:18<64:24:19, 10.88s/it]
 44%|████▍     | 16660/37963 [51:46:28<62:57:12, 10.64s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '0.7708', 'learning_rate': '1.244e-05', 'epoch': '0.4388'}

 44%|████▍     | 16660/37963 [51:46:28<62:57:12, 10.64s/it]
 44%|████▍     | 16661/37963 [51:46:44<72:33:00, 12.26s/it]
 44%|████▍     | 16662/37963 [51:46:54<68:47:54, 11.63s/it]
 44%|████▍     | 16663/37963 [51:47:04<65:23:48, 11.05s/it]
 44%|████▍     | 16664/37963 [51:47:20<75:07:03, 12.70s/it]
 44%|████▍     | 16665/37963 [51:47:30<70:20:10, 11.89s/it]
 44%|████▍     | 16666/37963 [51:47:40<67:00:54, 11.33s/it]
 44%|████▍     | 16667/37963 [51:47:50<64:22:46, 10.88s/it]
 44%|████▍     | 16668/37963 [51:48:00<62:51:56, 10.63s/it]
 44%|████▍     | 16669/37963 [51:48:17<73:25:30, 12.41s/it]
 44%|████▍     | 16670/37963 [51:48:27<69:15:21, 11.71s/it]
                                                           
{'loss': '0.1494', 'grad_norm': '1.766', 'learning_rate': '1.243e-05', 'epoch': '0.4391'}

 44%|████▍     | 16670/37963 [51:48:27<69:15:21, 11.71s/it]
 44%|████▍     | 16671/37963 [51:48:37<66:21:45, 11.22s/it]
 44%|████▍     | 16672/37963 [51:48:47<64:17:50, 10.87s/it]
 44%|████▍     | 16673/37963 [51:48:57<62:56:26, 10.64s/it]
 44%|████▍     | 16674/37963 [51:49:07<61:24:57, 10.39s/it]
 44%|████▍     | 16675/37963 [51:49:17<60:48:56, 10.28s/it]
 44%|████▍     | 16676/37963 [51:49:33<71:37:22, 12.11s/it]
 44%|████▍     | 16677/37963 [51:49:50<79:34:56, 13.46s/it]
 44%|████▍     | 16678/37963 [51:50:00<73:40:34, 12.46s/it]
 44%|████▍     | 16679/37963 [51:50:10<69:53:34, 11.82s/it]
 44%|████▍     | 16680/37963 [51:50:20<66:10:21, 11.19s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '2.328', 'learning_rate': '1.243e-05', 'epoch': '0.4394'}

 44%|████▍     | 16680/37963 [51:50:20<66:10:21, 11.19s/it]
 44%|████▍     | 16681/37963 [51:50:30<64:13:15, 10.86s/it]
 44%|████▍     | 16682/37963 [51:50:40<62:51:44, 10.63s/it]
 44%|████▍     | 16683/37963 [51:50:50<62:11:07, 10.52s/it]
 44%|████▍     | 16684/37963 [51:51:00<61:26:33, 10.39s/it]
 44%|████▍     | 16685/37963 [51:51:10<60:39:04, 10.26s/it]
 44%|████▍     | 16686/37963 [51:51:20<60:08:03, 10.17s/it]
 44%|████▍     | 16687/37963 [51:51:37<71:27:27, 12.09s/it]
 44%|████▍     | 16688/37963 [51:51:47<67:57:36, 11.50s/it]
 44%|████▍     | 16689/37963 [51:51:57<65:23:32, 11.07s/it]
 44%|████▍     | 16690/37963 [51:52:07<63:03:41, 10.67s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '2.768', 'learning_rate': '1.242e-05', 'epoch': '0.4396'}

 44%|████▍     | 16690/37963 [51:52:07<63:03:41, 10.67s/it]
 44%|████▍     | 16691/37963 [51:52:17<61:45:31, 10.45s/it]
 44%|████▍     | 16692/37963 [51:52:27<60:49:32, 10.29s/it]
 44%|████▍     | 16693/37963 [51:52:37<60:29:04, 10.24s/it]
 44%|████▍     | 16694/37963 [51:52:47<59:48:32, 10.12s/it]
 44%|████▍     | 16695/37963 [51:52:57<59:56:37, 10.15s/it]
 44%|████▍     | 16696/37963 [51:53:07<60:00:59, 10.16s/it]
 44%|████▍     | 16697/37963 [51:53:17<59:21:26, 10.05s/it]
 44%|████▍     | 16698/37963 [51:53:27<59:08:14, 10.01s/it]
 44%|████▍     | 16699/37963 [51:53:44<71:35:57, 12.12s/it]
 44%|████▍     | 16700/37963 [51:53:54<67:58:03, 11.51s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '3.429', 'learning_rate': '1.241e-05', 'epoch': '0.4399'}

 44%|████▍     | 16700/37963 [51:53:54<67:58:03, 11.51s/it]
 44%|████▍     | 16701/37963 [51:54:04<65:09:31, 11.03s/it]
 44%|████▍     | 16702/37963 [51:54:13<62:25:35, 10.57s/it]
 44%|████▍     | 16703/37963 [51:54:23<61:30:06, 10.41s/it]
 44%|████▍     | 16704/37963 [51:54:40<72:03:43, 12.20s/it]
 44%|████▍     | 16705/37963 [51:54:50<68:20:44, 11.57s/it]
 44%|████▍     | 16706/37963 [51:55:00<65:27:32, 11.09s/it]
 44%|████▍     | 16707/37963 [51:55:16<74:45:51, 12.66s/it]
 44%|████▍     | 16708/37963 [51:55:26<70:23:19, 11.92s/it]
 44%|████▍     | 16709/37963 [51:55:36<67:12:15, 11.38s/it]
 44%|████▍     | 16710/37963 [51:55:47<64:51:28, 10.99s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '1.785', 'learning_rate': '1.24e-05', 'epoch': '0.4402'}

 44%|████▍     | 16710/37963 [51:55:47<64:51:28, 10.99s/it]
 44%|████▍     | 16711/37963 [51:55:57<63:30:32, 10.76s/it]
 44%|████▍     | 16712/37963 [51:56:13<73:41:03, 12.48s/it]
 44%|████▍     | 16713/37963 [51:56:23<69:10:29, 11.72s/it]
 44%|████▍     | 16714/37963 [51:56:33<66:19:19, 11.24s/it]
 44%|████▍     | 16715/37963 [51:56:43<63:36:55, 10.78s/it]
 44%|████▍     | 16716/37963 [51:56:53<61:56:48, 10.50s/it]
 44%|████▍     | 16717/37963 [51:57:09<72:22:52, 12.26s/it]
 44%|████▍     | 16718/37963 [51:57:19<68:19:59, 11.58s/it]
 44%|████▍     | 16719/37963 [51:57:29<65:43:59, 11.14s/it]
 44%|████▍     | 16720/37963 [51:57:39<63:23:51, 10.74s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '3.865', 'learning_rate': '1.239e-05', 'epoch': '0.4404'}

 44%|████▍     | 16720/37963 [51:57:39<63:23:51, 10.74s/it]
 44%|████▍     | 16721/37963 [51:57:49<62:15:08, 10.55s/it]
 44%|████▍     | 16722/37963 [51:57:59<61:31:04, 10.43s/it]
 44%|████▍     | 16723/37963 [51:58:09<60:36:31, 10.27s/it]
 44%|████▍     | 16724/37963 [51:58:32<83:23:15, 14.13s/it]
 44%|████▍     | 16725/37963 [51:58:43<76:11:59, 12.92s/it]
 44%|████▍     | 16726/37963 [51:58:53<71:06:58, 12.06s/it]
 44%|████▍     | 16727/37963 [51:59:03<67:30:10, 11.44s/it]
 44%|████▍     | 16728/37963 [51:59:13<65:08:16, 11.04s/it]
 44%|████▍     | 16729/37963 [51:59:23<63:20:52, 10.74s/it]
 44%|████▍     | 16730/37963 [51:59:33<62:24:45, 10.58s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '0.8992', 'learning_rate': '1.238e-05', 'epoch': '0.4407'}

 44%|████▍     | 16730/37963 [51:59:33<62:24:45, 10.58s/it]
 44%|████▍     | 16731/37963 [51:59:43<61:35:12, 10.44s/it]
 44%|████▍     | 16732/37963 [51:59:53<61:01:29, 10.35s/it]
 44%|████▍     | 16733/37963 [52:00:03<60:25:49, 10.25s/it]
 44%|████▍     | 16734/37963 [52:00:13<60:13:46, 10.21s/it]
 44%|████▍     | 16735/37963 [52:00:23<59:36:28, 10.11s/it]
 44%|████▍     | 16736/37963 [52:00:33<59:33:25, 10.10s/it]
 44%|████▍     | 16737/37963 [52:00:50<70:45:20, 12.00s/it]
 44%|████▍     | 16738/37963 [52:01:00<67:20:07, 11.42s/it]
 44%|████▍     | 16739/37963 [52:01:10<64:57:21, 11.02s/it]
 44%|████▍     | 16740/37963 [52:01:20<62:47:06, 10.65s/it]
                                                           
{'loss': '0.161', 'grad_norm': '0.6956', 'learning_rate': '1.238e-05', 'epoch': '0.441'}

 44%|████▍     | 16740/37963 [52:01:20<62:47:06, 10.65s/it]
 44%|████▍     | 16741/37963 [52:01:30<61:46:28, 10.48s/it]
 44%|████▍     | 16742/37963 [52:01:40<60:45:31, 10.31s/it]
 44%|████▍     | 16743/37963 [52:01:50<60:24:03, 10.25s/it]
 44%|████▍     | 16744/37963 [52:02:00<60:06:04, 10.20s/it]
 44%|████▍     | 16745/37963 [52:02:10<59:51:15, 10.16s/it]
 44%|████▍     | 16746/37963 [52:02:19<58:56:12, 10.00s/it]
 44%|████▍     | 16747/37963 [52:02:29<58:27:18,  9.92s/it]
 44%|████▍     | 16748/37963 [52:02:46<70:37:30, 11.98s/it]
 44%|████▍     | 16749/37963 [52:02:56<67:25:05, 11.44s/it]
 44%|████▍     | 16750/37963 [52:03:06<64:59:29, 11.03s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '1.351', 'learning_rate': '1.237e-05', 'epoch': '0.4412'}

 44%|████▍     | 16750/37963 [52:03:06<64:59:29, 11.03s/it]
 44%|████▍     | 16751/37963 [52:03:16<63:33:08, 10.79s/it]
 44%|████▍     | 16752/37963 [52:03:33<73:47:14, 12.52s/it]
 44%|████▍     | 16753/37963 [52:03:43<69:19:40, 11.77s/it]
 44%|████▍     | 16754/37963 [52:03:53<66:18:14, 11.25s/it]
 44%|████▍     | 16755/37963 [52:04:03<64:13:11, 10.90s/it]
 44%|████▍     | 16756/37963 [52:04:20<73:59:54, 12.56s/it]
 44%|████▍     | 16757/37963 [52:04:30<69:29:22, 11.80s/it]
 44%|████▍     | 16758/37963 [52:04:40<66:25:41, 11.28s/it]
 44%|████▍     | 16759/37963 [52:04:50<64:10:30, 10.90s/it]
 44%|████▍     | 16760/37963 [52:05:00<62:37:29, 10.63s/it]
                                                           
{'loss': '0.1527', 'grad_norm': '1.939', 'learning_rate': '1.236e-05', 'epoch': '0.4415'}

 44%|████▍     | 16760/37963 [52:05:00<62:37:29, 10.63s/it]
 44%|████▍     | 16761/37963 [52:05:16<73:15:11, 12.44s/it]
 44%|████▍     | 16762/37963 [52:05:26<69:07:54, 11.74s/it]
 44%|████▍     | 16763/37963 [52:05:37<66:12:25, 11.24s/it]
 44%|████▍     | 16764/37963 [52:05:47<63:59:02, 10.87s/it]
 44%|████▍     | 16765/37963 [52:06:03<74:08:17, 12.59s/it]
 44%|████▍     | 16766/37963 [52:06:13<69:48:21, 11.86s/it]
 44%|████▍     | 16767/37963 [52:06:24<66:50:12, 11.35s/it]
 44%|████▍     | 16768/37963 [52:06:34<64:33:05, 10.96s/it]
 44%|████▍     | 16769/37963 [52:06:44<62:54:28, 10.69s/it]
 44%|████▍     | 16770/37963 [52:06:54<61:49:07, 10.50s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '1.986', 'learning_rate': '1.235e-05', 'epoch': '0.4417'}

 44%|████▍     | 16770/37963 [52:06:54<61:49:07, 10.50s/it]
 44%|████▍     | 16771/37963 [52:07:03<60:30:21, 10.28s/it]
 44%|████▍     | 16772/37963 [52:07:20<71:30:29, 12.15s/it]
 44%|████▍     | 16773/37963 [52:07:30<67:50:53, 11.53s/it]
 44%|████▍     | 16774/37963 [52:07:47<77:30:52, 13.17s/it]
 44%|████▍     | 16775/37963 [52:07:57<72:06:04, 12.25s/it]
 44%|████▍     | 16776/37963 [52:08:07<68:32:04, 11.65s/it]
 44%|████▍     | 16777/37963 [52:08:18<65:53:46, 11.20s/it]
 44%|████▍     | 16778/37963 [52:08:28<63:51:21, 10.85s/it]
 44%|████▍     | 16779/37963 [52:08:38<62:42:09, 10.66s/it]
 44%|████▍     | 16780/37963 [52:08:48<61:25:22, 10.44s/it]
                                                           
{'loss': '0.1602', 'grad_norm': '2.382', 'learning_rate': '1.234e-05', 'epoch': '0.442'}

 44%|████▍     | 16780/37963 [52:08:48<61:25:22, 10.44s/it]
 44%|████▍     | 16781/37963 [52:08:58<60:53:27, 10.35s/it]
 44%|████▍     | 16782/37963 [52:09:08<60:31:19, 10.29s/it]
 44%|████▍     | 16783/37963 [52:09:18<60:05:48, 10.21s/it]
 44%|████▍     | 16784/37963 [52:09:28<59:55:18, 10.19s/it]
 44%|████▍     | 16785/37963 [52:09:44<70:43:37, 12.02s/it]
 44%|████▍     | 16786/37963 [52:09:54<66:35:54, 11.32s/it]
 44%|████▍     | 16787/37963 [52:10:04<63:58:46, 10.88s/it]
 44%|████▍     | 16788/37963 [52:10:14<61:47:37, 10.51s/it]
 44%|████▍     | 16789/37963 [52:10:24<61:11:08, 10.40s/it]
 44%|████▍     | 16790/37963 [52:10:34<60:39:34, 10.31s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '1.24', 'learning_rate': '1.233e-05', 'epoch': '0.4423'}

 44%|████▍     | 16790/37963 [52:10:34<60:39:34, 10.31s/it]
 44%|████▍     | 16791/37963 [52:10:44<60:19:13, 10.26s/it]
 44%|████▍     | 16792/37963 [52:10:54<60:01:23, 10.21s/it]
 44%|████▍     | 16793/37963 [52:11:04<59:48:19, 10.17s/it]
 44%|████▍     | 16794/37963 [52:11:14<59:35:01, 10.13s/it]
 44%|████▍     | 16795/37963 [52:11:24<59:35:01, 10.13s/it]
 44%|████▍     | 16796/37963 [52:11:41<71:04:43, 12.09s/it]
 44%|████▍     | 16797/37963 [52:11:51<67:30:56, 11.48s/it]
 44%|████▍     | 16798/37963 [52:12:01<64:31:14, 10.97s/it]
 44%|████▍     | 16799/37963 [52:12:11<62:19:39, 10.60s/it]
 44%|████▍     | 16800/37963 [52:12:27<72:09:55, 12.28s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '1.44', 'learning_rate': '1.233e-05', 'epoch': '0.4425'}

 44%|████▍     | 16800/37963 [52:12:27<72:09:55, 12.28s/it]
 44%|████▍     | 16801/37963 [52:12:37<68:23:56, 11.64s/it]
 44%|████▍     | 16802/37963 [52:12:47<65:47:00, 11.19s/it]
 44%|████▍     | 16803/37963 [52:12:57<63:53:51, 10.87s/it]
 44%|████▍     | 16804/37963 [52:13:07<62:17:21, 10.60s/it]
 44%|████▍     | 16805/37963 [52:13:24<72:31:39, 12.34s/it]
 44%|████▍     | 16806/37963 [52:13:34<68:33:11, 11.66s/it]
 44%|████▍     | 16807/37963 [52:13:44<65:27:50, 11.14s/it]
 44%|████▍     | 16808/37963 [52:13:53<63:18:24, 10.77s/it]
 44%|████▍     | 16809/37963 [52:14:04<62:05:11, 10.57s/it]
 44%|████▍     | 16810/37963 [52:14:20<72:38:51, 12.36s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '2.646', 'learning_rate': '1.232e-05', 'epoch': '0.4428'}

 44%|████▍     | 16810/37963 [52:14:20<72:38:51, 12.36s/it]
 44%|████▍     | 16811/37963 [52:14:30<68:40:20, 11.69s/it]
 44%|████▍     | 16812/37963 [52:14:40<65:17:35, 11.11s/it]
 44%|████▍     | 16813/37963 [52:14:57<74:51:16, 12.74s/it]
 44%|████▍     | 16814/37963 [52:15:06<69:34:08, 11.84s/it]
 44%|████▍     | 16815/37963 [52:15:16<66:08:35, 11.26s/it]
 44%|████▍     | 16816/37963 [52:15:26<64:17:34, 10.95s/it]
 44%|████▍     | 16817/37963 [52:15:37<63:01:17, 10.73s/it]
 44%|████▍     | 16818/37963 [52:15:46<61:22:21, 10.45s/it]
 44%|████▍     | 16819/37963 [52:15:57<60:46:08, 10.35s/it]
 44%|████▍     | 16820/37963 [52:16:13<70:56:04, 12.08s/it]
                                                           
{'loss': '0.1503', 'grad_norm': '1.683', 'learning_rate': '1.231e-05', 'epoch': '0.4431'}

 44%|████▍     | 16820/37963 [52:16:13<70:56:04, 12.08s/it]
 44%|████▍     | 16821/37963 [52:16:30<80:00:12, 13.62s/it]
 44%|████▍     | 16822/37963 [52:16:40<73:58:31, 12.60s/it]
 44%|████▍     | 16823/37963 [52:16:50<69:44:42, 11.88s/it]
 44%|████▍     | 16824/37963 [52:17:00<66:08:31, 11.26s/it]
 44%|████▍     | 16825/37963 [52:17:10<63:50:22, 10.87s/it]
 44%|████▍     | 16826/37963 [52:17:20<62:11:46, 10.59s/it]
 44%|████▍     | 16827/37963 [52:17:30<60:53:46, 10.37s/it]
 44%|████▍     | 16828/37963 [52:17:40<60:27:11, 10.30s/it]
 44%|████▍     | 16829/37963 [52:17:50<60:07:16, 10.24s/it]
 44%|████▍     | 16830/37963 [52:18:00<59:51:57, 10.20s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '0.9766', 'learning_rate': '1.23e-05', 'epoch': '0.4433'}

 44%|████▍     | 16830/37963 [52:18:00<59:51:57, 10.20s/it]
 44%|████▍     | 16831/37963 [52:18:10<59:35:39, 10.15s/it]
 44%|████▍     | 16832/37963 [52:18:20<59:44:37, 10.18s/it]
 44%|████▍     | 16833/37963 [52:18:31<59:36:02, 10.15s/it]
 44%|████▍     | 16834/37963 [52:18:47<70:39:19, 12.04s/it]
 44%|████▍     | 16835/37963 [52:18:57<67:12:52, 11.45s/it]
 44%|████▍     | 16836/37963 [52:19:07<64:48:07, 11.04s/it]
 44%|████▍     | 16837/37963 [52:19:17<63:12:10, 10.77s/it]
 44%|████▍     | 16838/37963 [52:19:27<62:08:43, 10.59s/it]
 44%|████▍     | 16839/37963 [52:19:38<61:22:22, 10.46s/it]
 44%|████▍     | 16840/37963 [52:19:48<60:37:50, 10.33s/it]
                                                           
{'loss': '0.1418', 'grad_norm': '2.565', 'learning_rate': '1.229e-05', 'epoch': '0.4436'}

 44%|████▍     | 16840/37963 [52:19:48<60:37:50, 10.33s/it]
 44%|████▍     | 16841/37963 [52:19:58<60:13:42, 10.27s/it]
 44%|████▍     | 16842/37963 [52:20:08<59:18:56, 10.11s/it]
 44%|████▍     | 16843/37963 [52:20:18<59:15:08, 10.10s/it]
 44%|████▍     | 16844/37963 [52:20:34<71:01:42, 12.11s/it]
 44%|████▍     | 16845/37963 [52:20:44<67:11:14, 11.45s/it]
 44%|████▍     | 16846/37963 [52:20:54<64:51:01, 11.06s/it]
 44%|████▍     | 16847/37963 [52:21:11<74:16:56, 12.66s/it]
 44%|████▍     | 16848/37963 [52:21:21<69:49:45, 11.91s/it]
 44%|████▍     | 16849/37963 [52:21:31<66:52:26, 11.40s/it]
 44%|████▍     | 16850/37963 [52:21:41<63:54:29, 10.90s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '1.031', 'learning_rate': '1.228e-05', 'epoch': '0.4439'}

 44%|████▍     | 16850/37963 [52:21:41<63:54:29, 10.90s/it]
 44%|████▍     | 16851/37963 [52:21:50<61:26:18, 10.48s/it]
 44%|████▍     | 16852/37963 [52:22:01<60:58:31, 10.40s/it]
 44%|████▍     | 16853/37963 [52:22:11<60:00:01, 10.23s/it]
 44%|████▍     | 16854/37963 [52:22:27<70:44:22, 12.06s/it]
 44%|████▍     | 16855/37963 [52:22:36<66:24:04, 11.32s/it]
 44%|████▍     | 16856/37963 [52:22:47<64:21:43, 10.98s/it]
 44%|████▍     | 16857/37963 [52:22:57<62:41:38, 10.69s/it]
 44%|████▍     | 16858/37963 [52:23:13<72:40:46, 12.40s/it]
 44%|████▍     | 16859/37963 [52:23:23<68:40:42, 11.72s/it]
 44%|████▍     | 16860/37963 [52:23:33<66:02:53, 11.27s/it]
                                                           
{'loss': '0.1498', 'grad_norm': '1.965', 'learning_rate': '1.228e-05', 'epoch': '0.4441'}

 44%|████▍     | 16860/37963 [52:23:33<66:02:53, 11.27s/it]
 44%|████▍     | 16861/37963 [52:23:43<63:14:52, 10.79s/it]
 44%|████▍     | 16862/37963 [52:24:00<74:33:26, 12.72s/it]
 44%|████▍     | 16863/37963 [52:24:10<69:53:03, 11.92s/it]
 44%|████▍     | 16864/37963 [52:24:20<66:34:40, 11.36s/it]
 44%|████▍     | 16865/37963 [52:24:30<63:47:53, 10.89s/it]
 44%|████▍     | 16866/37963 [52:24:40<61:44:09, 10.53s/it]
 44%|████▍     | 16867/37963 [52:24:50<60:26:37, 10.31s/it]
 44%|████▍     | 16868/37963 [52:25:06<71:35:05, 12.22s/it]
 44%|████▍     | 16869/37963 [52:25:22<78:05:59, 13.33s/it]
 44%|████▍     | 16870/37963 [52:25:32<72:12:33, 12.32s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '2.89', 'learning_rate': '1.227e-05', 'epoch': '0.4444'}

 44%|████▍     | 16870/37963 [52:25:32<72:12:33, 12.32s/it]
 44%|████▍     | 16871/37963 [52:25:42<68:15:22, 11.65s/it]
 44%|████▍     | 16872/37963 [52:25:52<65:26:30, 11.17s/it]
 44%|████▍     | 16873/37963 [52:26:02<63:30:00, 10.84s/it]
 44%|████▍     | 16874/37963 [52:26:13<62:10:14, 10.61s/it]
 44%|████▍     | 16875/37963 [52:26:23<61:17:39, 10.46s/it]
 44%|████▍     | 16876/37963 [52:26:32<60:08:39, 10.27s/it]
 44%|████▍     | 16877/37963 [52:26:42<59:40:16, 10.19s/it]
 44%|████▍     | 16878/37963 [52:26:52<59:23:01, 10.14s/it]
 44%|████▍     | 16879/37963 [52:27:03<59:16:23, 10.12s/it]
 44%|████▍     | 16880/37963 [52:27:12<58:31:28,  9.99s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '1.154', 'learning_rate': '1.226e-05', 'epoch': '0.4446'}

 44%|████▍     | 16880/37963 [52:27:12<58:31:28,  9.99s/it]
 44%|████▍     | 16881/37963 [52:27:29<70:14:42, 12.00s/it]
 44%|████▍     | 16882/37963 [52:27:39<66:54:15, 11.43s/it]
 44%|████▍     | 16883/37963 [52:27:49<64:40:28, 11.04s/it]
 44%|████▍     | 16884/37963 [52:27:59<62:59:29, 10.76s/it]
 44%|████▍     | 16885/37963 [52:28:09<61:51:01, 10.56s/it]
 44%|████▍     | 16886/37963 [52:28:19<60:35:26, 10.35s/it]
 44%|████▍     | 16887/37963 [52:28:29<59:46:13, 10.21s/it]
 44%|████▍     | 16888/37963 [52:28:39<59:41:21, 10.20s/it]
 44%|████▍     | 16889/37963 [52:28:49<59:27:25, 10.16s/it]
 44%|████▍     | 16890/37963 [52:28:59<58:55:50, 10.07s/it]
                                                           
{'loss': '0.1498', 'grad_norm': '2.975', 'learning_rate': '1.225e-05', 'epoch': '0.4449'}

 44%|████▍     | 16890/37963 [52:28:59<58:55:50, 10.07s/it]
 44%|████▍     | 16891/37963 [52:29:16<70:11:56, 11.99s/it]
 44%|████▍     | 16892/37963 [52:29:26<66:47:57, 11.41s/it]
 44%|████▍     | 16893/37963 [52:29:36<64:25:02, 11.01s/it]
 45%|████▍     | 16894/37963 [52:29:46<62:57:17, 10.76s/it]
 45%|████▍     | 16895/37963 [52:30:02<72:34:38, 12.40s/it]
 45%|████▍     | 16896/37963 [52:30:12<68:32:41, 11.71s/it]
 45%|████▍     | 16897/37963 [52:30:22<65:39:18, 11.22s/it]
 45%|████▍     | 16898/37963 [52:30:33<63:45:31, 10.90s/it]
 45%|████▍     | 16899/37963 [52:30:43<62:26:18, 10.67s/it]
 45%|████▍     | 16900/37963 [52:30:52<60:57:30, 10.42s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '0.9767', 'learning_rate': '1.224e-05', 'epoch': '0.4452'}

 45%|████▍     | 16900/37963 [52:30:52<60:57:30, 10.42s/it]
 45%|████▍     | 16901/37963 [52:31:03<60:26:41, 10.33s/it]
 45%|████▍     | 16902/37963 [52:31:13<60:13:24, 10.29s/it]
 45%|████▍     | 16903/37963 [52:31:29<70:57:55, 12.13s/it]
 45%|████▍     | 16904/37963 [52:31:39<67:16:14, 11.50s/it]
 45%|████▍     | 16905/37963 [52:31:49<64:50:13, 11.08s/it]
 45%|████▍     | 16906/37963 [52:32:06<74:31:06, 12.74s/it]
 45%|████▍     | 16907/37963 [52:32:16<69:41:55, 11.92s/it]
 45%|████▍     | 16908/37963 [52:32:26<66:28:12, 11.37s/it]
 45%|████▍     | 16909/37963 [52:32:36<64:14:47, 10.99s/it]
 45%|████▍     | 16910/37963 [52:32:52<73:27:51, 12.56s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '1.875', 'learning_rate': '1.223e-05', 'epoch': '0.4454'}

 45%|████▍     | 16910/37963 [52:32:52<73:27:51, 12.56s/it]
 45%|████▍     | 16911/37963 [52:33:03<69:22:30, 11.86s/it]
 45%|████▍     | 16912/37963 [52:33:13<66:14:33, 11.33s/it]
 45%|████▍     | 16913/37963 [52:33:23<63:52:14, 10.92s/it]
 45%|████▍     | 16914/37963 [52:33:33<62:12:41, 10.64s/it]
 45%|████▍     | 16915/37963 [52:33:50<73:30:26, 12.57s/it]
 45%|████▍     | 16916/37963 [52:34:00<69:00:07, 11.80s/it]
 45%|████▍     | 16917/37963 [52:34:10<66:05:15, 11.30s/it]
 45%|████▍     | 16918/37963 [52:34:26<74:52:44, 12.81s/it]
 45%|████▍     | 16919/37963 [52:34:36<70:06:07, 11.99s/it]
 45%|████▍     | 16920/37963 [52:34:46<66:28:11, 11.37s/it]
                                                           
{'loss': '0.1439', 'grad_norm': '1.285', 'learning_rate': '1.223e-05', 'epoch': '0.4457'}

 45%|████▍     | 16920/37963 [52:34:46<66:28:11, 11.37s/it]
 45%|████▍     | 16921/37963 [52:34:56<64:14:11, 10.99s/it]
 45%|████▍     | 16922/37963 [52:35:06<62:41:10, 10.73s/it]
 45%|████▍     | 16923/37963 [52:35:17<61:40:18, 10.55s/it]
 45%|████▍     | 16924/37963 [52:35:27<60:54:47, 10.42s/it]
 45%|████▍     | 16925/37963 [52:35:37<59:57:53, 10.26s/it]
 45%|████▍     | 16926/37963 [52:35:47<59:38:50, 10.21s/it]
 45%|████▍     | 16927/37963 [52:35:57<59:30:13, 10.18s/it]
 45%|████▍     | 16928/37963 [52:36:13<70:52:24, 12.13s/it]
 45%|████▍     | 16929/37963 [52:36:24<67:13:19, 11.51s/it]
 45%|████▍     | 16930/37963 [52:36:34<64:44:00, 11.08s/it]
                                                           
{'loss': '0.142', 'grad_norm': '1.839', 'learning_rate': '1.222e-05', 'epoch': '0.446'}

 45%|████▍     | 16930/37963 [52:36:34<64:44:00, 11.08s/it]
 45%|████▍     | 16931/37963 [52:36:44<62:53:11, 10.76s/it]
 45%|████▍     | 16932/37963 [52:36:54<61:48:24, 10.58s/it]
 45%|████▍     | 16933/37963 [52:37:04<60:26:20, 10.35s/it]
 45%|████▍     | 16934/37963 [52:37:14<59:55:19, 10.26s/it]
 45%|████▍     | 16935/37963 [52:37:23<59:10:45, 10.13s/it]
 45%|████▍     | 16936/37963 [52:37:34<59:07:15, 10.12s/it]
 45%|████▍     | 16937/37963 [52:37:44<59:04:13, 10.11s/it]
 45%|████▍     | 16938/37963 [52:37:54<58:59:33, 10.10s/it]
 45%|████▍     | 16939/37963 [52:38:04<58:26:31, 10.01s/it]
 45%|████▍     | 16940/37963 [52:38:14<58:28:36, 10.01s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '2.146', 'learning_rate': '1.221e-05', 'epoch': '0.4462'}

 45%|████▍     | 16940/37963 [52:38:14<58:28:36, 10.01s/it]
 45%|████▍     | 16941/37963 [52:38:31<70:44:54, 12.12s/it]
 45%|████▍     | 16942/37963 [52:38:41<67:27:06, 11.55s/it]
 45%|████▍     | 16943/37963 [52:38:58<76:52:22, 13.17s/it]
 45%|████▍     | 16944/37963 [52:39:08<71:20:22, 12.22s/it]
 45%|████▍     | 16945/37963 [52:39:18<67:32:39, 11.57s/it]
 45%|████▍     | 16946/37963 [52:39:28<64:53:40, 11.12s/it]
 45%|████▍     | 16947/37963 [52:39:38<62:34:29, 10.72s/it]
 45%|████▍     | 16948/37963 [52:39:48<61:16:21, 10.50s/it]
 45%|████▍     | 16949/37963 [52:39:58<60:44:31, 10.41s/it]
 45%|████▍     | 16950/37963 [52:40:08<59:56:43, 10.27s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '4.345', 'learning_rate': '1.22e-05', 'epoch': '0.4465'}

 45%|████▍     | 16950/37963 [52:40:08<59:56:43, 10.27s/it]
 45%|████▍     | 16951/37963 [52:40:24<70:36:58, 12.10s/it]
 45%|████▍     | 16952/37963 [52:40:41<78:19:40, 13.42s/it]
 45%|████▍     | 16953/37963 [52:40:51<72:31:21, 12.43s/it]
 45%|████▍     | 16954/37963 [52:41:01<68:34:45, 11.75s/it]
 45%|████▍     | 16955/37963 [52:41:11<65:02:44, 11.15s/it]
 45%|████▍     | 16956/37963 [52:41:21<63:14:14, 10.84s/it]
 45%|████▍     | 16957/37963 [52:41:31<62:03:14, 10.63s/it]
 45%|████▍     | 16958/37963 [52:41:41<60:46:05, 10.41s/it]
 45%|████▍     | 16959/37963 [52:41:57<71:32:23, 12.26s/it]
 45%|████▍     | 16960/37963 [52:42:08<67:51:57, 11.63s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '1.077', 'learning_rate': '1.219e-05', 'epoch': '0.4468'}

 45%|████▍     | 16960/37963 [52:42:08<67:51:57, 11.63s/it]
 45%|████▍     | 16961/37963 [52:42:18<65:14:49, 11.18s/it]
 45%|████▍     | 16962/37963 [52:42:28<63:15:55, 10.84s/it]
 45%|████▍     | 16963/37963 [52:42:45<74:25:37, 12.76s/it]
 45%|████▍     | 16964/37963 [52:42:55<69:25:42, 11.90s/it]
 45%|████▍     | 16965/37963 [52:43:05<65:24:24, 11.21s/it]
 45%|████▍     | 16966/37963 [52:43:15<63:27:54, 10.88s/it]
 45%|████▍     | 16967/37963 [52:43:31<73:16:47, 12.56s/it]
 45%|████▍     | 16968/37963 [52:43:41<68:58:53, 11.83s/it]
 45%|████▍     | 16969/37963 [52:43:51<66:00:03, 11.32s/it]
 45%|████▍     | 16970/37963 [52:44:01<63:50:55, 10.95s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '1.135', 'learning_rate': '1.219e-05', 'epoch': '0.447'}

 45%|████▍     | 16970/37963 [52:44:01<63:50:55, 10.95s/it]
 45%|████▍     | 16971/37963 [52:44:11<62:07:38, 10.65s/it]
 45%|████▍     | 16972/37963 [52:44:21<60:54:03, 10.44s/it]
 45%|████▍     | 16973/37963 [52:44:31<60:13:22, 10.33s/it]
 45%|████▍     | 16974/37963 [52:44:41<59:38:49, 10.23s/it]
 45%|████▍     | 16975/37963 [52:44:52<59:47:38, 10.26s/it]
 45%|████▍     | 16976/37963 [52:45:08<70:57:39, 12.17s/it]
 45%|████▍     | 16977/37963 [52:45:18<67:15:30, 11.54s/it]
 45%|████▍     | 16978/37963 [52:45:28<64:40:17, 11.09s/it]
 45%|████▍     | 16979/37963 [52:45:38<62:35:26, 10.74s/it]
 45%|████▍     | 16980/37963 [52:45:49<61:28:27, 10.55s/it]
                                                           
{'loss': '0.142', 'grad_norm': '0.9893', 'learning_rate': '1.218e-05', 'epoch': '0.4473'}

 45%|████▍     | 16980/37963 [52:45:49<61:28:27, 10.55s/it]
 45%|████▍     | 16981/37963 [52:45:59<60:30:58, 10.38s/it]
 45%|████▍     | 16982/37963 [52:46:09<59:57:48, 10.29s/it]
 45%|████▍     | 16983/37963 [52:46:18<58:48:52, 10.09s/it]
 45%|████▍     | 16984/37963 [52:46:28<58:52:06, 10.10s/it]
 45%|████▍     | 16985/37963 [52:46:38<58:36:51, 10.06s/it]
 45%|████▍     | 16986/37963 [52:46:48<58:40:11, 10.07s/it]
 45%|████▍     | 16987/37963 [52:46:58<58:07:41,  9.98s/it]
 45%|████▍     | 16988/37963 [52:47:08<58:23:37, 10.02s/it]
 45%|████▍     | 16989/37963 [52:47:25<69:34:26, 11.94s/it]
 45%|████▍     | 16990/37963 [52:47:35<66:21:22, 11.39s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '2.934', 'learning_rate': '1.217e-05', 'epoch': '0.4475'}

 45%|████▍     | 16990/37963 [52:47:35<66:21:22, 11.39s/it]
 45%|████▍     | 16991/37963 [52:47:45<63:26:44, 10.89s/it]
 45%|████▍     | 16992/37963 [52:48:01<73:45:42, 12.66s/it]
 45%|████▍     | 16993/37963 [52:48:11<69:09:49, 11.87s/it]
 45%|████▍     | 16994/37963 [52:48:21<65:28:05, 11.24s/it]
 45%|████▍     | 16995/37963 [52:48:31<63:38:21, 10.93s/it]
 45%|████▍     | 16996/37963 [52:48:42<62:24:54, 10.72s/it]
 45%|████▍     | 16997/37963 [52:48:51<60:34:32, 10.40s/it]
 45%|████▍     | 16998/37963 [52:49:08<70:56:00, 12.18s/it]
 45%|████▍     | 16999/37963 [52:49:18<67:16:36, 11.55s/it]
 45%|████▍     | 17000/37963 [52:49:34<76:00:01, 13.05s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '1.275', 'learning_rate': '1.216e-05', 'epoch': '0.4478'}

 45%|████▍     | 17000/37963 [52:49:34<76:00:01, 13.05s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.90s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.91s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 45%|████▍     | 17001/37963 [52:50:34<157:26:33, 27.04s/it]
 45%|████▍     | 17002/37963 [52:50:45<129:38:47, 22.27s/it]
 45%|████▍     | 17003/37963 [52:50:55<108:36:02, 18.65s/it]
 45%|████▍     | 17004/37963 [52:51:05<93:31:46, 16.06s/it] 
 45%|████▍     | 17005/37963 [52:51:15<83:00:00, 14.26s/it]
 45%|████▍     | 17006/37963 [52:51:32<87:04:08, 14.96s/it]
 45%|████▍     | 17007/37963 [52:51:42<78:43:20, 13.52s/it]
 45%|████▍     | 17008/37963 [52:51:52<72:45:24, 12.50s/it]
 45%|████▍     | 17009/37963 [52:52:02<68:32:45, 11.78s/it]
 45%|████▍     | 17010/37963 [52:52:12<65:33:54, 11.26s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '1.79', 'learning_rate': '1.215e-05', 'epoch': '0.4481'}

 45%|████▍     | 17010/37963 [52:52:12<65:33:54, 11.26s/it]
 45%|████▍     | 17011/37963 [52:52:29<74:42:54, 12.84s/it]
 45%|████▍     | 17012/37963 [52:52:39<70:04:27, 12.04s/it]
 45%|████▍     | 17013/37963 [52:52:49<66:33:34, 11.44s/it]
 45%|████▍     | 17014/37963 [52:52:59<64:17:16, 11.05s/it]
 45%|████▍     | 17015/37963 [52:53:16<73:56:07, 12.71s/it]
 45%|████▍     | 17016/37963 [52:53:26<69:32:34, 11.95s/it]
 45%|████▍     | 17017/37963 [52:53:36<66:06:22, 11.36s/it]
 45%|████▍     | 17018/37963 [52:53:46<63:55:41, 10.99s/it]
 45%|████▍     | 17019/37963 [52:53:56<62:11:10, 10.69s/it]
 45%|████▍     | 17020/37963 [52:54:06<61:08:53, 10.51s/it]
                                                           
{'loss': '0.1493', 'grad_norm': '2.254', 'learning_rate': '1.214e-05', 'epoch': '0.4483'}

 45%|████▍     | 17020/37963 [52:54:06<61:08:53, 10.51s/it]
 45%|████▍     | 17021/37963 [52:54:16<60:24:25, 10.38s/it]
 45%|████▍     | 17022/37963 [52:54:26<59:57:37, 10.31s/it]
 45%|████▍     | 17023/37963 [52:54:36<59:40:50, 10.26s/it]
 45%|████▍     | 17024/37963 [52:54:47<59:31:52, 10.24s/it]
 45%|████▍     | 17025/37963 [52:55:03<69:26:51, 11.94s/it]
 45%|████▍     | 17026/37963 [52:55:13<66:23:29, 11.42s/it]
 45%|████▍     | 17027/37963 [52:55:23<64:11:23, 11.04s/it]
 45%|████▍     | 17028/37963 [52:55:33<62:34:41, 10.76s/it]
 45%|████▍     | 17029/37963 [52:55:43<61:15:06, 10.53s/it]
 45%|████▍     | 17030/37963 [52:55:53<60:01:44, 10.32s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '2.452', 'learning_rate': '1.214e-05', 'epoch': '0.4486'}

 45%|████▍     | 17030/37963 [52:55:53<60:01:44, 10.32s/it]
 45%|████▍     | 17031/37963 [52:56:03<59:35:43, 10.25s/it]
 45%|████▍     | 17032/37963 [52:56:13<58:52:51, 10.13s/it]
 45%|████▍     | 17033/37963 [52:56:23<58:47:42, 10.11s/it]
 45%|████▍     | 17034/37963 [52:56:33<58:40:32, 10.09s/it]
 45%|████▍     | 17035/37963 [52:56:43<58:42:35, 10.10s/it]
 45%|████▍     | 17036/37963 [52:56:59<69:41:05, 11.99s/it]
 45%|████▍     | 17037/37963 [52:57:10<66:26:58, 11.43s/it]
 45%|████▍     | 17038/37963 [52:57:20<64:12:48, 11.05s/it]
 45%|████▍     | 17039/37963 [52:57:30<62:13:57, 10.71s/it]
 45%|████▍     | 17040/37963 [52:57:46<72:13:31, 12.43s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '0.8531', 'learning_rate': '1.213e-05', 'epoch': '0.4489'}

 45%|████▍     | 17040/37963 [52:57:46<72:13:31, 12.43s/it]
 45%|████▍     | 17041/37963 [52:57:56<68:13:35, 11.74s/it]
 45%|████▍     | 17042/37963 [52:58:06<65:24:24, 11.25s/it]
 45%|████▍     | 17043/37963 [52:58:16<62:38:25, 10.78s/it]
 45%|████▍     | 17044/37963 [52:58:26<61:21:22, 10.56s/it]
 45%|████▍     | 17045/37963 [52:58:36<60:31:07, 10.42s/it]
 45%|████▍     | 17046/37963 [52:58:52<70:24:04, 12.12s/it]
 45%|████▍     | 17047/37963 [52:59:09<78:04:36, 13.44s/it]
 45%|████▍     | 17048/37963 [52:59:19<72:25:20, 12.47s/it]
 45%|████▍     | 17049/37963 [52:59:29<67:55:40, 11.69s/it]
 45%|████▍     | 17050/37963 [52:59:39<65:15:24, 11.23s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '1.348', 'learning_rate': '1.212e-05', 'epoch': '0.4491'}

 45%|████▍     | 17050/37963 [52:59:39<65:15:24, 11.23s/it]
 45%|████▍     | 17051/37963 [52:59:49<63:13:20, 10.88s/it]
 45%|████▍     | 17052/37963 [52:59:59<61:50:00, 10.65s/it]
 45%|████▍     | 17053/37963 [53:00:15<71:40:33, 12.34s/it]
 45%|████▍     | 17054/37963 [53:00:25<67:11:02, 11.57s/it]
 45%|████▍     | 17055/37963 [53:00:35<63:58:04, 11.01s/it]
 45%|████▍     | 17056/37963 [53:00:45<62:22:36, 10.74s/it]
 45%|████▍     | 17057/37963 [53:00:55<61:07:52, 10.53s/it]
 45%|████▍     | 17058/37963 [53:01:05<60:04:10, 10.34s/it]
 45%|████▍     | 17059/37963 [53:01:15<59:15:00, 10.20s/it]
 45%|████▍     | 17060/37963 [53:01:32<71:02:02, 12.23s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '3.445', 'learning_rate': '1.211e-05', 'epoch': '0.4494'}

 45%|████▍     | 17060/37963 [53:01:32<71:02:02, 12.23s/it]
 45%|████▍     | 17061/37963 [53:01:42<67:07:47, 11.56s/it]
 45%|████▍     | 17062/37963 [53:01:52<64:03:36, 11.03s/it]
 45%|████▍     | 17063/37963 [53:02:01<61:52:24, 10.66s/it]
 45%|████▍     | 17064/37963 [53:02:18<72:38:57, 12.51s/it]
 45%|████▍     | 17065/37963 [53:02:28<68:04:40, 11.73s/it]
 45%|████▍     | 17066/37963 [53:02:38<65:17:12, 11.25s/it]
 45%|████▍     | 17067/37963 [53:02:48<62:37:20, 10.79s/it]
 45%|████▍     | 17068/37963 [53:02:58<61:20:38, 10.57s/it]
 45%|████▍     | 17069/37963 [53:03:08<60:28:22, 10.42s/it]
 45%|████▍     | 17070/37963 [53:03:18<59:51:12, 10.31s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '1.25', 'learning_rate': '1.21e-05', 'epoch': '0.4496'}

 45%|████▍     | 17070/37963 [53:03:18<59:51:12, 10.31s/it]
 45%|████▍     | 17071/37963 [53:03:28<59:30:36, 10.25s/it]
 45%|████▍     | 17072/37963 [53:03:38<59:16:31, 10.21s/it]
 45%|████▍     | 17073/37963 [53:03:55<70:10:02, 12.09s/it]
 45%|████▍     | 17074/37963 [53:04:05<66:37:25, 11.48s/it]
 45%|████▍     | 17075/37963 [53:04:15<63:52:53, 11.01s/it]
 45%|████▍     | 17076/37963 [53:04:25<62:08:26, 10.71s/it]
 45%|████▍     | 17077/37963 [53:04:35<61:03:47, 10.53s/it]
 45%|████▍     | 17078/37963 [53:04:45<60:14:45, 10.38s/it]
 45%|████▍     | 17079/37963 [53:04:55<59:27:11, 10.25s/it]
 45%|████▍     | 17080/37963 [53:05:05<59:13:45, 10.21s/it]
                                                           
{'loss': '0.1423', 'grad_norm': '1.523', 'learning_rate': '1.209e-05', 'epoch': '0.4499'}

 45%|████▍     | 17080/37963 [53:05:05<59:13:45, 10.21s/it]
 45%|████▍     | 17081/37963 [53:05:15<58:58:32, 10.17s/it]
 45%|████▍     | 17082/37963 [53:05:25<58:50:21, 10.14s/it]
 45%|████▍     | 17083/37963 [53:05:35<58:38:45, 10.11s/it]
 45%|████▌     | 17084/37963 [53:05:52<70:55:35, 12.23s/it]
 45%|████▌     | 17085/37963 [53:06:02<66:49:34, 11.52s/it]
 45%|████▌     | 17086/37963 [53:06:12<64:22:14, 11.10s/it]
 45%|████▌     | 17087/37963 [53:06:22<61:48:05, 10.66s/it]
 45%|████▌     | 17088/37963 [53:06:39<71:58:51, 12.41s/it]
 45%|████▌     | 17089/37963 [53:06:48<67:35:47, 11.66s/it]
 45%|████▌     | 17090/37963 [53:06:58<64:37:36, 11.15s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '4.727', 'learning_rate': '1.209e-05', 'epoch': '0.4502'}

 45%|████▌     | 17090/37963 [53:06:58<64:37:36, 11.15s/it]
 45%|████▌     | 17091/37963 [53:07:08<62:31:14, 10.78s/it]
 45%|████▌     | 17092/37963 [53:07:25<72:18:28, 12.47s/it]
 45%|████▌     | 17093/37963 [53:07:35<68:16:45, 11.78s/it]
 45%|████▌     | 17094/37963 [53:07:45<65:11:46, 11.25s/it]
 45%|████▌     | 17095/37963 [53:08:01<74:13:20, 12.80s/it]
 45%|████▌     | 17096/37963 [53:08:11<69:30:49, 11.99s/it]
 45%|████▌     | 17097/37963 [53:08:22<66:18:16, 11.44s/it]
 45%|████▌     | 17098/37963 [53:08:32<63:50:26, 11.01s/it]
 45%|████▌     | 17099/37963 [53:08:42<62:08:17, 10.72s/it]
 45%|████▌     | 17100/37963 [53:08:52<60:49:28, 10.50s/it]
                                                           
{'loss': '0.1472', 'grad_norm': '2.449', 'learning_rate': '1.208e-05', 'epoch': '0.4504'}

 45%|████▌     | 17100/37963 [53:08:52<60:49:28, 10.50s/it]
 45%|████▌     | 17101/37963 [53:09:08<71:00:55, 12.25s/it]
 45%|████▌     | 17102/37963 [53:09:18<67:22:06, 11.63s/it]
 45%|████▌     | 17103/37963 [53:09:28<64:44:31, 11.17s/it]
 45%|████▌     | 17104/37963 [53:09:38<61:49:53, 10.67s/it]
 45%|████▌     | 17105/37963 [53:09:48<60:19:35, 10.41s/it]
 45%|████▌     | 17106/37963 [53:09:58<59:35:53, 10.29s/it]
 45%|████▌     | 17107/37963 [53:10:15<71:27:07, 12.33s/it]
 45%|████▌     | 17108/37963 [53:10:25<67:49:26, 11.71s/it]
 45%|████▌     | 17109/37963 [53:10:35<64:55:14, 11.21s/it]
 45%|████▌     | 17110/37963 [53:10:45<62:59:44, 10.88s/it]
                                                           
{'loss': '0.1653', 'grad_norm': '3.557', 'learning_rate': '1.207e-05', 'epoch': '0.4507'}

 45%|████▌     | 17110/37963 [53:10:45<62:59:44, 10.88s/it]
 45%|████▌     | 17111/37963 [53:10:55<61:45:23, 10.66s/it]
 45%|████▌     | 17112/37963 [53:11:11<71:31:14, 12.35s/it]
 45%|████▌     | 17113/37963 [53:11:22<67:37:50, 11.68s/it]
 45%|████▌     | 17114/37963 [53:11:32<64:48:20, 11.19s/it]
 45%|████▌     | 17115/37963 [53:11:42<62:49:33, 10.85s/it]
 45%|████▌     | 17116/37963 [53:11:52<61:18:45, 10.59s/it]
 45%|████▌     | 17117/37963 [53:12:02<60:12:23, 10.40s/it]
 45%|████▌     | 17118/37963 [53:12:12<59:56:45, 10.35s/it]
 45%|████▌     | 17119/37963 [53:12:22<59:05:20, 10.21s/it]
 45%|████▌     | 17120/37963 [53:12:32<59:00:29, 10.19s/it]
                                                           
{'loss': '0.1543', 'grad_norm': '1.64', 'learning_rate': '1.206e-05', 'epoch': '0.451'}

 45%|████▌     | 17120/37963 [53:12:32<59:00:29, 10.19s/it]
 45%|████▌     | 17121/37963 [53:12:49<70:19:43, 12.15s/it]
 45%|████▌     | 17122/37963 [53:12:59<66:58:12, 11.57s/it]
 45%|████▌     | 17123/37963 [53:13:09<64:11:31, 11.09s/it]
 45%|████▌     | 17124/37963 [53:13:19<62:26:07, 10.79s/it]
 45%|████▌     | 17125/37963 [53:13:29<60:28:18, 10.45s/it]
 45%|████▌     | 17126/37963 [53:13:38<59:08:12, 10.22s/it]
 45%|████▌     | 17127/37963 [53:13:48<58:54:40, 10.18s/it]
 45%|████▌     | 17128/37963 [53:13:58<58:30:19, 10.11s/it]
 45%|████▌     | 17129/37963 [53:14:09<58:43:31, 10.15s/it]
 45%|████▌     | 17130/37963 [53:14:19<58:33:30, 10.12s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '2.947', 'learning_rate': '1.205e-05', 'epoch': '0.4512'}

 45%|████▌     | 17130/37963 [53:14:19<58:33:30, 10.12s/it]
 45%|████▌     | 17131/37963 [53:14:36<70:36:28, 12.20s/it]
 45%|████▌     | 17132/37963 [53:14:46<67:22:09, 11.64s/it]
 45%|████▌     | 17133/37963 [53:14:56<64:33:38, 11.16s/it]
 45%|████▌     | 17134/37963 [53:15:06<62:38:13, 10.83s/it]
 45%|████▌     | 17135/37963 [53:15:16<60:32:59, 10.47s/it]
 45%|████▌     | 17136/37963 [53:15:26<59:54:22, 10.35s/it]
 45%|████▌     | 17137/37963 [53:15:36<59:35:52, 10.30s/it]
 45%|████▌     | 17138/37963 [53:15:53<70:41:21, 12.22s/it]
 45%|████▌     | 17139/37963 [53:16:03<67:19:14, 11.64s/it]
 45%|████▌     | 17140/37963 [53:16:19<75:33:38, 13.06s/it]
                                                           
{'loss': '0.1461', 'grad_norm': '0.8923', 'learning_rate': '1.204e-05', 'epoch': '0.4515'}

 45%|████▌     | 17140/37963 [53:16:19<75:33:38, 13.06s/it]
 45%|████▌     | 17141/37963 [53:16:29<70:21:40, 12.17s/it]
 45%|████▌     | 17142/37963 [53:16:39<66:33:39, 11.51s/it]
 45%|████▌     | 17143/37963 [53:16:56<74:52:44, 12.95s/it]
 45%|████▌     | 17144/37963 [53:17:06<69:56:33, 12.09s/it]
 45%|████▌     | 17145/37963 [53:17:16<66:45:17, 11.54s/it]
 45%|████▌     | 17146/37963 [53:17:26<64:15:57, 11.11s/it]
 45%|████▌     | 17147/37963 [53:17:36<62:53:45, 10.88s/it]
 45%|████▌     | 17148/37963 [53:17:46<61:26:02, 10.63s/it]
 45%|████▌     | 17149/37963 [53:18:03<71:59:29, 12.45s/it]
 45%|████▌     | 17150/37963 [53:18:13<67:50:21, 11.73s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '1.236', 'learning_rate': '1.203e-05', 'epoch': '0.4518'}

 45%|████▌     | 17150/37963 [53:18:13<67:50:21, 11.73s/it]
 45%|████▌     | 17151/37963 [53:18:23<65:02:50, 11.25s/it]
 45%|████▌     | 17152/37963 [53:18:33<63:02:23, 10.90s/it]
 45%|████▌     | 17153/37963 [53:18:44<61:52:21, 10.70s/it]
 45%|████▌     | 17154/37963 [53:18:54<60:22:32, 10.45s/it]
 45%|████▌     | 17155/37963 [53:19:10<70:41:19, 12.23s/it]
 45%|████▌     | 17156/37963 [53:19:20<66:43:09, 11.54s/it]
 45%|████▌     | 17157/37963 [53:19:30<64:03:38, 11.08s/it]
 45%|████▌     | 17158/37963 [53:19:40<62:23:53, 10.80s/it]
 45%|████▌     | 17159/37963 [53:19:56<72:05:47, 12.48s/it]
 45%|████▌     | 17160/37963 [53:20:07<67:57:27, 11.76s/it]
                                                           
{'loss': '0.1444', 'grad_norm': '2.969', 'learning_rate': '1.203e-05', 'epoch': '0.452'}

 45%|████▌     | 17160/37963 [53:20:07<67:57:27, 11.76s/it]
 45%|████▌     | 17161/37963 [53:20:16<64:26:36, 11.15s/it]
 45%|████▌     | 17162/37963 [53:20:26<62:40:14, 10.85s/it]
 45%|████▌     | 17163/37963 [53:20:37<61:32:11, 10.65s/it]
 45%|████▌     | 17164/37963 [53:20:46<60:00:54, 10.39s/it]
 45%|████▌     | 17165/37963 [53:20:57<59:41:50, 10.33s/it]
 45%|████▌     | 17166/37963 [53:21:07<59:11:47, 10.25s/it]
 45%|████▌     | 17167/37963 [53:21:17<58:49:54, 10.18s/it]
 45%|████▌     | 17168/37963 [53:21:27<58:39:01, 10.15s/it]
 45%|████▌     | 17169/37963 [53:21:43<69:15:50, 11.99s/it]
 45%|████▌     | 17170/37963 [53:21:53<65:55:23, 11.41s/it]
                                                           
{'loss': '0.146', 'grad_norm': '1.228', 'learning_rate': '1.202e-05', 'epoch': '0.4523'}

 45%|████▌     | 17170/37963 [53:21:53<65:55:23, 11.41s/it]
 45%|████▌     | 17171/37963 [53:22:03<62:59:34, 10.91s/it]
 45%|████▌     | 17172/37963 [53:22:13<61:28:53, 10.65s/it]
 45%|████▌     | 17173/37963 [53:22:23<60:30:09, 10.48s/it]
 45%|████▌     | 17174/37963 [53:22:33<59:20:33, 10.28s/it]
 45%|████▌     | 17175/37963 [53:22:43<58:50:45, 10.19s/it]
 45%|████▌     | 17176/37963 [53:22:53<58:44:16, 10.17s/it]
 45%|████▌     | 17177/37963 [53:23:03<58:30:55, 10.13s/it]
 45%|████▌     | 17178/37963 [53:23:13<58:33:12, 10.14s/it]
 45%|████▌     | 17179/37963 [53:23:30<70:20:20, 12.18s/it]
 45%|████▌     | 17180/37963 [53:23:40<66:44:20, 11.56s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '1.34', 'learning_rate': '1.201e-05', 'epoch': '0.4525'}

 45%|████▌     | 17180/37963 [53:23:40<66:44:20, 11.56s/it]
 45%|████▌     | 17181/37963 [53:23:50<63:56:08, 11.08s/it]
 45%|████▌     | 17182/37963 [53:24:00<62:14:11, 10.78s/it]
 45%|████▌     | 17183/37963 [53:24:10<60:57:54, 10.56s/it]
 45%|████▌     | 17184/37963 [53:24:20<59:28:00, 10.30s/it]
 45%|████▌     | 17185/37963 [53:24:36<69:42:31, 12.08s/it]
 45%|████▌     | 17186/37963 [53:24:46<66:08:15, 11.46s/it]
 45%|████▌     | 17187/37963 [53:24:56<63:40:13, 11.03s/it]
 45%|████▌     | 17188/37963 [53:25:13<72:55:59, 12.64s/it]
 45%|████▌     | 17189/37963 [53:25:23<68:17:51, 11.84s/it]
 45%|████▌     | 17190/37963 [53:25:39<75:33:39, 13.09s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '2.977', 'learning_rate': '1.2e-05', 'epoch': '0.4528'}

 45%|████▌     | 17190/37963 [53:25:39<75:33:39, 13.09s/it]
 45%|████▌     | 17191/37963 [53:25:49<70:21:13, 12.19s/it]
 45%|████▌     | 17192/37963 [53:25:59<66:50:24, 11.58s/it]
 45%|████▌     | 17193/37963 [53:26:09<64:10:55, 11.12s/it]
 45%|████▌     | 17194/37963 [53:26:19<62:23:20, 10.81s/it]
 45%|████▌     | 17195/37963 [53:26:29<61:12:20, 10.61s/it]
 45%|████▌     | 17196/37963 [53:26:45<70:29:47, 12.22s/it]
 45%|████▌     | 17197/37963 [53:26:55<66:53:32, 11.60s/it]
 45%|████▌     | 17198/37963 [53:27:05<64:11:53, 11.13s/it]
 45%|████▌     | 17199/37963 [53:27:15<62:27:19, 10.83s/it]
 45%|████▌     | 17200/37963 [53:27:25<61:05:43, 10.59s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '0.7766', 'learning_rate': '1.199e-05', 'epoch': '0.4531'}

 45%|████▌     | 17200/37963 [53:27:25<61:05:43, 10.59s/it]
 45%|████▌     | 17201/37963 [53:27:35<60:09:50, 10.43s/it]
 45%|████▌     | 17202/37963 [53:27:45<59:07:34, 10.25s/it]
 45%|████▌     | 17203/37963 [53:27:55<58:49:18, 10.20s/it]
 45%|████▌     | 17204/37963 [53:28:12<70:32:09, 12.23s/it]
 45%|████▌     | 17205/37963 [53:28:22<66:07:30, 11.47s/it]
 45%|████▌     | 17206/37963 [53:28:32<63:42:02, 11.05s/it]
 45%|████▌     | 17207/37963 [53:28:42<61:57:39, 10.75s/it]
 45%|████▌     | 17208/37963 [53:28:59<71:47:19, 12.45s/it]
 45%|████▌     | 17209/37963 [53:29:08<67:13:15, 11.66s/it]
 45%|████▌     | 17210/37963 [53:29:19<64:35:10, 11.20s/it]
                                                           
{'loss': '0.149', 'grad_norm': '0.9427', 'learning_rate': '1.198e-05', 'epoch': '0.4533'}

 45%|████▌     | 17210/37963 [53:29:19<64:35:10, 11.20s/it]
 45%|████▌     | 17211/37963 [53:29:29<62:53:34, 10.91s/it]
 45%|████▌     | 17212/37963 [53:29:39<61:17:33, 10.63s/it]
 45%|████▌     | 17213/37963 [53:29:49<60:06:17, 10.43s/it]
 45%|████▌     | 17214/37963 [53:29:59<59:39:02, 10.35s/it]
 45%|████▌     | 17215/37963 [53:30:09<59:10:57, 10.27s/it]
 45%|████▌     | 17216/37963 [53:30:19<58:45:28, 10.20s/it]
 45%|████▌     | 17217/37963 [53:30:35<69:20:18, 12.03s/it]
 45%|████▌     | 17218/37963 [53:30:45<65:59:42, 11.45s/it]
 45%|████▌     | 17219/37963 [53:30:55<63:38:13, 11.04s/it]
 45%|████▌     | 17220/37963 [53:31:06<61:58:39, 10.76s/it]
                                                           
{'loss': '0.1406', 'grad_norm': '1.957', 'learning_rate': '1.198e-05', 'epoch': '0.4536'}

 45%|████▌     | 17220/37963 [53:31:06<61:58:39, 10.76s/it]
 45%|████▌     | 17221/37963 [53:31:16<60:49:17, 10.56s/it]
 45%|████▌     | 17222/37963 [53:31:26<59:58:22, 10.41s/it]
 45%|████▌     | 17223/37963 [53:31:36<59:36:18, 10.35s/it]
 45%|████▌     | 17224/37963 [53:31:46<59:11:36, 10.28s/it]
 45%|████▌     | 17225/37963 [53:32:03<70:33:22, 12.25s/it]
 45%|████▌     | 17226/37963 [53:32:13<66:48:07, 11.60s/it]
 45%|████▌     | 17227/37963 [53:32:23<64:07:40, 11.13s/it]
 45%|████▌     | 17228/37963 [53:32:33<62:18:52, 10.82s/it]
 45%|████▌     | 17229/37963 [53:32:43<60:19:27, 10.47s/it]
 45%|████▌     | 17230/37963 [53:32:53<59:42:17, 10.37s/it]
                                                           
{'loss': '0.14', 'grad_norm': '1.896', 'learning_rate': '1.197e-05', 'epoch': '0.4539'}

 45%|████▌     | 17230/37963 [53:32:53<59:42:17, 10.37s/it]
 45%|████▌     | 17231/37963 [53:33:03<59:16:32, 10.29s/it]
 45%|████▌     | 17232/37963 [53:33:13<58:55:28, 10.23s/it]
 45%|████▌     | 17233/37963 [53:33:23<58:40:59, 10.19s/it]
 45%|████▌     | 17234/37963 [53:33:33<58:33:27, 10.17s/it]
 45%|████▌     | 17235/37963 [53:33:50<69:41:05, 12.10s/it]
 45%|████▌     | 17236/37963 [53:34:06<77:00:34, 13.38s/it]
 45%|████▌     | 17237/37963 [53:34:23<82:28:33, 14.33s/it]
 45%|████▌     | 17238/37963 [53:34:33<75:05:47, 13.04s/it]
 45%|████▌     | 17239/37963 [53:34:43<70:08:05, 12.18s/it]
 45%|████▌     | 17240/37963 [53:34:53<66:25:35, 11.54s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '2.84', 'learning_rate': '1.196e-05', 'epoch': '0.4541'}

 45%|████▌     | 17240/37963 [53:34:53<66:25:35, 11.54s/it]
 45%|████▌     | 17241/37963 [53:35:03<63:55:59, 11.11s/it]
 45%|████▌     | 17242/37963 [53:35:13<62:10:07, 10.80s/it]
 45%|████▌     | 17243/37963 [53:35:23<60:52:18, 10.58s/it]
 45%|████▌     | 17244/37963 [53:35:39<70:16:15, 12.21s/it]
 45%|████▌     | 17245/37963 [53:35:49<66:43:35, 11.59s/it]
 45%|████▌     | 17246/37963 [53:36:00<64:13:44, 11.16s/it]
 45%|████▌     | 17247/37963 [53:36:10<62:44:06, 10.90s/it]
 45%|████▌     | 17248/37963 [53:36:20<61:32:51, 10.70s/it]
 45%|████▌     | 17249/37963 [53:36:30<60:27:05, 10.51s/it]
 45%|████▌     | 17250/37963 [53:36:40<59:28:03, 10.34s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '1.439', 'learning_rate': '1.195e-05', 'epoch': '0.4544'}

 45%|████▌     | 17250/37963 [53:36:40<59:28:03, 10.34s/it]
 45%|████▌     | 17251/37963 [53:36:50<58:45:17, 10.21s/it]
 45%|████▌     | 17252/37963 [53:37:07<70:16:01, 12.21s/it]
 45%|████▌     | 17253/37963 [53:37:17<66:01:24, 11.48s/it]
 45%|████▌     | 17254/37963 [53:37:27<63:31:07, 11.04s/it]
 45%|████▌     | 17255/37963 [53:37:37<61:46:31, 10.74s/it]
 45%|████▌     | 17256/37963 [53:37:53<70:59:52, 12.34s/it]
 45%|████▌     | 17257/37963 [53:38:03<67:05:03, 11.66s/it]
 45%|████▌     | 17258/37963 [53:38:13<64:26:09, 11.20s/it]
 45%|████▌     | 17259/37963 [53:38:23<62:27:51, 10.86s/it]
 45%|████▌     | 17260/37963 [53:38:33<60:03:49, 10.44s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '3.138', 'learning_rate': '1.194e-05', 'epoch': '0.4547'}

 45%|████▌     | 17260/37963 [53:38:33<60:03:49, 10.44s/it]
 45%|████▌     | 17261/37963 [53:38:42<58:45:27, 10.22s/it]
 45%|████▌     | 17262/37963 [53:38:52<57:58:29, 10.08s/it]
 45%|████▌     | 17263/37963 [53:39:02<58:12:17, 10.12s/it]
 45%|████▌     | 17264/37963 [53:39:12<58:05:02, 10.10s/it]
 45%|████▌     | 17265/37963 [53:39:28<68:32:09, 11.92s/it]
 45%|████▌     | 17266/37963 [53:39:39<65:23:38, 11.37s/it]
 45%|████▌     | 17267/37963 [53:39:48<62:42:56, 10.91s/it]
 45%|████▌     | 17268/37963 [53:39:58<61:09:35, 10.64s/it]
 45%|████▌     | 17269/37963 [53:40:08<60:07:08, 10.46s/it]
 45%|████▌     | 17270/37963 [53:40:19<59:35:36, 10.37s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '1.723', 'learning_rate': '1.193e-05', 'epoch': '0.4549'}

 45%|████▌     | 17270/37963 [53:40:19<59:35:36, 10.37s/it]
 45%|████▌     | 17271/37963 [53:40:36<71:21:43, 12.42s/it]
 45%|████▌     | 17272/37963 [53:40:46<67:13:17, 11.70s/it]
 45%|████▌     | 17273/37963 [53:40:56<64:29:42, 11.22s/it]
 46%|████▌     | 17274/37963 [53:41:06<62:58:17, 10.96s/it]
 46%|████▌     | 17275/37963 [53:41:16<61:19:26, 10.67s/it]
 46%|████▌     | 17276/37963 [53:41:26<60:20:13, 10.50s/it]
 46%|████▌     | 17277/37963 [53:41:36<59:06:48, 10.29s/it]
 46%|████▌     | 17278/37963 [53:41:46<58:31:14, 10.18s/it]
 46%|████▌     | 17279/37963 [53:41:56<58:05:29, 10.11s/it]
 46%|████▌     | 17280/37963 [53:42:06<57:56:23, 10.08s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '0.9201', 'learning_rate': '1.193e-05', 'epoch': '0.4552'}

 46%|████▌     | 17280/37963 [53:42:06<57:56:23, 10.08s/it]
 46%|████▌     | 17281/37963 [53:42:16<57:57:38, 10.09s/it]
 46%|████▌     | 17282/37963 [53:42:26<58:00:09, 10.10s/it]
 46%|████▌     | 17283/37963 [53:42:42<67:57:03, 11.83s/it]
 46%|████▌     | 17284/37963 [53:42:59<75:59:28, 13.23s/it]
 46%|████▌     | 17285/37963 [53:43:09<70:33:51, 12.29s/it]
 46%|████▌     | 17286/37963 [53:43:25<78:04:09, 13.59s/it]
 46%|████▌     | 17287/37963 [53:43:35<71:55:53, 12.52s/it]
 46%|████▌     | 17288/37963 [53:43:45<67:37:07, 11.77s/it]
 46%|████▌     | 17289/37963 [53:43:55<63:24:52, 11.04s/it]
 46%|████▌     | 17290/37963 [53:44:05<61:33:41, 10.72s/it]
                                                           
{'loss': '0.1634', 'grad_norm': '1.675', 'learning_rate': '1.192e-05', 'epoch': '0.4554'}

 46%|████▌     | 17290/37963 [53:44:05<61:33:41, 10.72s/it]
 46%|████▌     | 17291/37963 [53:44:15<60:09:53, 10.48s/it]
 46%|████▌     | 17292/37963 [53:44:24<59:04:55, 10.29s/it]
 46%|████▌     | 17293/37963 [53:44:35<58:42:39, 10.23s/it]
 46%|████▌     | 17294/37963 [53:44:51<69:29:03, 12.10s/it]
 46%|████▌     | 17295/37963 [53:45:01<66:06:38, 11.52s/it]
 46%|████▌     | 17296/37963 [53:45:11<63:37:33, 11.08s/it]
 46%|████▌     | 17297/37963 [53:45:21<62:01:44, 10.81s/it]
 46%|████▌     | 17298/37963 [53:45:31<60:42:30, 10.58s/it]
 46%|████▌     | 17299/37963 [53:45:42<59:52:31, 10.43s/it]
 46%|████▌     | 17300/37963 [53:45:59<71:51:43, 12.52s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '1.346', 'learning_rate': '1.191e-05', 'epoch': '0.4557'}

 46%|████▌     | 17300/37963 [53:45:59<71:51:43, 12.52s/it]
 46%|████▌     | 17301/37963 [53:46:09<67:18:57, 11.73s/it]
 46%|████▌     | 17302/37963 [53:46:19<64:28:15, 11.23s/it]
 46%|████▌     | 17303/37963 [53:46:36<73:40:53, 12.84s/it]
 46%|████▌     | 17304/37963 [53:46:46<69:21:15, 12.09s/it]
 46%|████▌     | 17305/37963 [53:46:56<65:48:24, 11.47s/it]
 46%|████▌     | 17306/37963 [53:47:06<63:24:29, 11.05s/it]
 46%|████▌     | 17307/37963 [53:47:16<61:49:34, 10.78s/it]
 46%|████▌     | 17308/37963 [53:47:26<60:35:06, 10.56s/it]
 46%|████▌     | 17309/37963 [53:47:36<59:50:47, 10.43s/it]
 46%|████▌     | 17310/37963 [53:47:46<59:01:04, 10.29s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '3.818', 'learning_rate': '1.19e-05', 'epoch': '0.456'}

 46%|████▌     | 17310/37963 [53:47:46<59:01:04, 10.29s/it]
 46%|████▌     | 17311/37963 [53:47:56<57:46:33, 10.07s/it]
 46%|████▌     | 17312/37963 [53:48:12<68:52:18, 12.01s/it]
 46%|████▌     | 17313/37963 [53:48:22<65:31:41, 11.42s/it]
 46%|████▌     | 17314/37963 [53:48:32<63:17:48, 11.04s/it]
 46%|████▌     | 17315/37963 [53:48:43<61:40:44, 10.75s/it]
 46%|████▌     | 17316/37963 [53:48:52<60:13:11, 10.50s/it]
 46%|████▌     | 17317/37963 [53:49:02<58:56:52, 10.28s/it]
 46%|████▌     | 17318/37963 [53:49:12<58:36:12, 10.22s/it]
 46%|████▌     | 17319/37963 [53:49:22<57:59:31, 10.11s/it]
 46%|████▌     | 17320/37963 [53:49:39<69:23:39, 12.10s/it]
                                                           
{'loss': '0.1587', 'grad_norm': '1.628', 'learning_rate': '1.189e-05', 'epoch': '0.4562'}

 46%|████▌     | 17320/37963 [53:49:39<69:23:39, 12.10s/it]
 46%|████▌     | 17321/37963 [53:49:49<66:09:01, 11.54s/it]
 46%|████▌     | 17322/37963 [53:49:59<63:44:26, 11.12s/it]
 46%|████▌     | 17323/37963 [53:50:10<62:10:33, 10.84s/it]
 46%|████▌     | 17324/37963 [53:50:20<60:54:03, 10.62s/it]
 46%|████▌     | 17325/37963 [53:50:30<59:47:43, 10.43s/it]
 46%|████▌     | 17326/37963 [53:50:40<59:06:58, 10.31s/it]
 46%|████▌     | 17327/37963 [53:50:50<58:43:18, 10.24s/it]
 46%|████▌     | 17328/37963 [53:51:00<58:25:28, 10.19s/it]
 46%|████▌     | 17329/37963 [53:51:10<57:45:52, 10.08s/it]
 46%|████▌     | 17330/37963 [53:51:20<57:48:14, 10.09s/it]
                                                           
{'loss': '0.1408', 'grad_norm': '0.951', 'learning_rate': '1.188e-05', 'epoch': '0.4565'}

 46%|████▌     | 17330/37963 [53:51:20<57:48:14, 10.09s/it]
 46%|████▌     | 17331/37963 [53:51:36<68:10:39, 11.90s/it]
 46%|████▌     | 17332/37963 [53:51:46<65:10:24, 11.37s/it]
 46%|████▌     | 17333/37963 [53:52:03<74:20:58, 12.97s/it]
 46%|████▌     | 17334/37963 [53:52:13<69:25:43, 12.12s/it]
 46%|████▌     | 17335/37963 [53:52:29<76:26:28, 13.34s/it]
 46%|████▌     | 17336/37963 [53:52:39<70:40:20, 12.33s/it]
 46%|████▌     | 17337/37963 [53:52:49<66:56:42, 11.68s/it]
 46%|████▌     | 17338/37963 [53:52:59<64:14:20, 11.21s/it]
 46%|████▌     | 17339/37963 [53:53:09<61:55:16, 10.81s/it]
 46%|████▌     | 17340/37963 [53:53:19<60:49:53, 10.62s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '1.446', 'learning_rate': '1.188e-05', 'epoch': '0.4568'}

 46%|████▌     | 17340/37963 [53:53:19<60:49:53, 10.62s/it]
 46%|████▌     | 17341/37963 [53:53:29<59:45:15, 10.43s/it]
 46%|████▌     | 17342/37963 [53:53:46<70:23:11, 12.29s/it]
 46%|████▌     | 17343/37963 [53:53:56<66:40:35, 11.64s/it]
 46%|████▌     | 17344/37963 [53:54:06<63:59:19, 11.17s/it]
 46%|████▌     | 17345/37963 [53:54:16<62:00:41, 10.83s/it]
 46%|████▌     | 17346/37963 [53:54:26<60:54:29, 10.64s/it]
 46%|████▌     | 17347/37963 [53:54:36<60:00:18, 10.48s/it]
 46%|████▌     | 17348/37963 [53:54:53<71:00:32, 12.40s/it]
 46%|████▌     | 17349/37963 [53:55:03<66:59:34, 11.70s/it]
 46%|████▌     | 17350/37963 [53:55:14<64:24:02, 11.25s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '3.494', 'learning_rate': '1.187e-05', 'epoch': '0.457'}

 46%|████▌     | 17350/37963 [53:55:14<64:24:02, 11.25s/it]
 46%|████▌     | 17351/37963 [53:55:23<61:57:51, 10.82s/it]
 46%|████▌     | 17352/37963 [53:55:40<72:02:57, 12.58s/it]
 46%|████▌     | 17353/37963 [53:55:50<67:41:57, 11.83s/it]
 46%|████▌     | 17354/37963 [53:56:00<64:37:47, 11.29s/it]
 46%|████▌     | 17355/37963 [53:56:10<62:26:15, 10.91s/it]
 46%|████▌     | 17356/37963 [53:56:20<60:57:47, 10.65s/it]
 46%|████▌     | 17357/37963 [53:56:30<59:58:00, 10.48s/it]
 46%|████▌     | 17358/37963 [53:56:40<59:00:24, 10.31s/it]
 46%|████▌     | 17359/37963 [53:56:50<58:13:29, 10.17s/it]
 46%|████▌     | 17360/37963 [53:57:06<68:50:47, 12.03s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '1.854', 'learning_rate': '1.186e-05', 'epoch': '0.4573'}

 46%|████▌     | 17360/37963 [53:57:06<68:50:47, 12.03s/it]
 46%|████▌     | 17361/37963 [53:57:16<65:12:09, 11.39s/it]
 46%|████▌     | 17362/37963 [53:57:27<63:04:01, 11.02s/it]
 46%|████▌     | 17363/37963 [53:57:37<61:35:22, 10.76s/it]
 46%|████▌     | 17364/37963 [53:57:47<60:35:25, 10.59s/it]
 46%|████▌     | 17365/37963 [53:57:57<59:42:00, 10.43s/it]
 46%|████▌     | 17366/37963 [53:58:07<59:13:41, 10.35s/it]
 46%|████▌     | 17367/37963 [53:58:17<58:50:52, 10.29s/it]
 46%|████▌     | 17368/37963 [53:58:34<70:27:38, 12.32s/it]
 46%|████▌     | 17369/37963 [53:58:44<66:38:27, 11.65s/it]
 46%|████▌     | 17370/37963 [53:58:54<63:13:48, 11.05s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '5.024', 'learning_rate': '1.185e-05', 'epoch': '0.4576'}

 46%|████▌     | 17370/37963 [53:58:54<63:13:48, 11.05s/it]
 46%|████▌     | 17371/37963 [53:59:04<61:33:16, 10.76s/it]
 46%|████▌     | 17372/37963 [53:59:14<60:19:24, 10.55s/it]
 46%|████▌     | 17373/37963 [53:59:24<59:13:52, 10.36s/it]
 46%|████▌     | 17374/37963 [53:59:34<58:39:32, 10.26s/it]
 46%|████▌     | 17375/37963 [53:59:44<57:47:41, 10.11s/it]
 46%|████▌     | 17376/37963 [53:59:54<57:45:49, 10.10s/it]
 46%|████▌     | 17377/37963 [54:00:04<57:23:08, 10.04s/it]
 46%|████▌     | 17378/37963 [54:00:14<57:31:03, 10.06s/it]
 46%|████▌     | 17379/37963 [54:00:30<68:16:55, 11.94s/it]
 46%|████▌     | 17380/37963 [54:00:47<75:53:14, 13.27s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '1.47', 'learning_rate': '1.184e-05', 'epoch': '0.4578'}

 46%|████▌     | 17380/37963 [54:00:47<75:53:14, 13.27s/it]
 46%|████▌     | 17381/37963 [54:00:57<70:29:24, 12.33s/it]
 46%|████▌     | 17382/37963 [54:01:07<66:36:16, 11.65s/it]
 46%|████▌     | 17383/37963 [54:01:23<74:53:36, 13.10s/it]
 46%|████▌     | 17384/37963 [54:01:33<69:43:51, 12.20s/it]
 46%|████▌     | 17385/37963 [54:01:44<66:08:06, 11.57s/it]
 46%|████▌     | 17386/37963 [54:01:54<63:32:56, 11.12s/it]
 46%|████▌     | 17387/37963 [54:02:04<62:00:08, 10.85s/it]
 46%|████▌     | 17388/37963 [54:02:14<60:52:03, 10.65s/it]
 46%|████▌     | 17389/37963 [54:02:24<59:49:57, 10.47s/it]
 46%|████▌     | 17390/37963 [54:02:34<59:10:49, 10.36s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '2.715', 'learning_rate': '1.183e-05', 'epoch': '0.4581'}

 46%|████▌     | 17390/37963 [54:02:34<59:10:49, 10.36s/it]
 46%|████▌     | 17391/37963 [54:02:44<58:35:48, 10.25s/it]
 46%|████▌     | 17392/37963 [54:03:01<69:19:29, 12.13s/it]
 46%|████▌     | 17393/37963 [54:03:11<65:54:49, 11.54s/it]
 46%|████▌     | 17394/37963 [54:03:21<63:26:23, 11.10s/it]
 46%|████▌     | 17395/37963 [54:03:37<72:38:40, 12.71s/it]
 46%|████▌     | 17396/37963 [54:03:48<68:12:46, 11.94s/it]
 46%|████▌     | 17397/37963 [54:03:58<64:50:52, 11.35s/it]
 46%|████▌     | 17398/37963 [54:04:08<62:46:10, 10.99s/it]
 46%|████▌     | 17399/37963 [54:04:24<72:12:09, 12.64s/it]
 46%|████▌     | 17400/37963 [54:04:34<67:48:48, 11.87s/it]
                                                           
{'loss': '0.1423', 'grad_norm': '1.33', 'learning_rate': '1.183e-05', 'epoch': '0.4583'}

 46%|████▌     | 17400/37963 [54:04:34<67:48:48, 11.87s/it]
 46%|████▌     | 17401/37963 [54:04:44<64:43:39, 11.33s/it]
 46%|████▌     | 17402/37963 [54:04:54<62:39:55, 10.97s/it]
 46%|████▌     | 17403/37963 [54:05:05<61:21:14, 10.74s/it]
 46%|████▌     | 17404/37963 [54:05:15<60:22:22, 10.57s/it]
 46%|████▌     | 17405/37963 [54:05:25<59:23:39, 10.40s/it]
 46%|████▌     | 17406/37963 [54:05:35<59:11:50, 10.37s/it]
 46%|████▌     | 17407/37963 [54:05:45<58:51:54, 10.31s/it]
 46%|████▌     | 17408/37963 [54:05:55<58:36:02, 10.26s/it]
 46%|████▌     | 17409/37963 [54:06:12<68:46:29, 12.05s/it]
 46%|████▌     | 17410/37963 [54:06:22<65:26:33, 11.46s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '2.153', 'learning_rate': '1.182e-05', 'epoch': '0.4586'}

 46%|████▌     | 17410/37963 [54:06:22<65:26:33, 11.46s/it]
 46%|████▌     | 17411/37963 [54:06:32<63:01:14, 11.04s/it]
 46%|████▌     | 17412/37963 [54:06:42<61:22:39, 10.75s/it]
 46%|████▌     | 17413/37963 [54:06:52<60:15:45, 10.56s/it]
 46%|████▌     | 17414/37963 [54:07:02<59:35:14, 10.44s/it]
 46%|████▌     | 17415/37963 [54:07:12<59:05:57, 10.35s/it]
 46%|████▌     | 17416/37963 [54:07:29<69:25:45, 12.16s/it]
 46%|████▌     | 17417/37963 [54:07:39<65:55:24, 11.55s/it]
 46%|████▌     | 17418/37963 [54:07:49<63:32:31, 11.13s/it]
 46%|████▌     | 17419/37963 [54:07:59<61:42:23, 10.81s/it]
 46%|████▌     | 17420/37963 [54:08:09<60:32:11, 10.61s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '0.6783', 'learning_rate': '1.181e-05', 'epoch': '0.4589'}

 46%|████▌     | 17420/37963 [54:08:09<60:32:11, 10.61s/it]
 46%|████▌     | 17421/37963 [54:08:19<59:42:06, 10.46s/it]
 46%|████▌     | 17422/37963 [54:08:29<59:02:24, 10.35s/it]
 46%|████▌     | 17423/37963 [54:08:39<58:33:39, 10.26s/it]
 46%|████▌     | 17424/37963 [54:08:50<58:25:27, 10.24s/it]
 46%|████▌     | 17425/37963 [54:09:00<58:10:47, 10.20s/it]
 46%|████▌     | 17426/37963 [54:09:10<57:58:51, 10.16s/it]
 46%|████▌     | 17427/37963 [54:09:26<68:38:59, 12.03s/it]
 46%|████▌     | 17428/37963 [54:09:36<65:23:13, 11.46s/it]
 46%|████▌     | 17429/37963 [54:09:53<73:47:07, 12.94s/it]
 46%|████▌     | 17430/37963 [54:10:03<68:29:14, 12.01s/it]
                                                           
{'loss': '0.1499', 'grad_norm': '2.762', 'learning_rate': '1.18e-05', 'epoch': '0.4591'}

 46%|████▌     | 17430/37963 [54:10:03<68:29:14, 12.01s/it]
 46%|████▌     | 17431/37963 [54:10:19<75:26:11, 13.23s/it]
 46%|████▌     | 17432/37963 [54:10:29<70:10:41, 12.31s/it]
 46%|████▌     | 17433/37963 [54:10:39<66:15:51, 11.62s/it]
 46%|████▌     | 17434/37963 [54:10:49<63:06:25, 11.07s/it]
 46%|████▌     | 17435/37963 [54:10:58<60:51:43, 10.67s/it]
 46%|████▌     | 17436/37963 [54:11:08<59:50:23, 10.49s/it]
 46%|████▌     | 17437/37963 [54:11:18<58:31:27, 10.26s/it]
 46%|████▌     | 17438/37963 [54:11:28<58:05:36, 10.19s/it]
 46%|████▌     | 17439/37963 [54:11:38<57:55:03, 10.16s/it]
 46%|████▌     | 17440/37963 [54:11:48<57:46:25, 10.13s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '1.689', 'learning_rate': '1.179e-05', 'epoch': '0.4594'}

 46%|████▌     | 17440/37963 [54:11:48<57:46:25, 10.13s/it]
 46%|████▌     | 17441/37963 [54:12:05<68:59:30, 12.10s/it]
 46%|████▌     | 17442/37963 [54:12:15<65:22:51, 11.47s/it]
 46%|████▌     | 17443/37963 [54:12:25<62:58:34, 11.05s/it]
 46%|████▌     | 17444/37963 [54:12:35<61:18:18, 10.76s/it]
 46%|████▌     | 17445/37963 [54:12:52<71:39:27, 12.57s/it]
 46%|████▌     | 17446/37963 [54:13:02<67:40:18, 11.87s/it]
 46%|████▌     | 17447/37963 [54:13:19<75:30:48, 13.25s/it]
 46%|████▌     | 17448/37963 [54:13:29<70:09:38, 12.31s/it]
 46%|████▌     | 17449/37963 [54:13:39<65:55:43, 11.57s/it]
 46%|████▌     | 17450/37963 [54:13:49<63:11:23, 11.09s/it]
                                                           
{'loss': '0.1545', 'grad_norm': '4.036', 'learning_rate': '1.178e-05', 'epoch': '0.4597'}

 46%|████▌     | 17450/37963 [54:13:49<63:11:23, 11.09s/it]
 46%|████▌     | 17451/37963 [54:13:59<61:31:26, 10.80s/it]
 46%|████▌     | 17452/37963 [54:14:09<60:10:50, 10.56s/it]
 46%|████▌     | 17453/37963 [54:14:19<59:27:49, 10.44s/it]
 46%|████▌     | 17454/37963 [54:14:29<58:53:12, 10.34s/it]
 46%|████▌     | 17455/37963 [54:14:39<58:21:51, 10.25s/it]
 46%|████▌     | 17456/37963 [54:14:49<57:13:54, 10.05s/it]
 46%|████▌     | 17457/37963 [54:14:58<56:50:22,  9.98s/it]
 46%|████▌     | 17458/37963 [54:15:15<67:27:15, 11.84s/it]
 46%|████▌     | 17459/37963 [54:15:25<64:11:37, 11.27s/it]
 46%|████▌     | 17460/37963 [54:15:34<61:21:57, 10.77s/it]
                                                           
{'loss': '0.1507', 'grad_norm': '2.055', 'learning_rate': '1.178e-05', 'epoch': '0.4599'}

 46%|████▌     | 17460/37963 [54:15:34<61:21:57, 10.77s/it]
 46%|████▌     | 17461/37963 [54:15:44<60:22:47, 10.60s/it]
 46%|████▌     | 17462/37963 [54:15:54<59:26:03, 10.44s/it]
 46%|████▌     | 17463/37963 [54:16:04<58:47:09, 10.32s/it]
 46%|████▌     | 17464/37963 [54:16:15<58:23:17, 10.25s/it]
 46%|████▌     | 17465/37963 [54:16:25<58:06:19, 10.20s/it]
 46%|████▌     | 17466/37963 [54:16:42<69:38:46, 12.23s/it]
 46%|████▌     | 17467/37963 [54:16:51<65:01:53, 11.42s/it]
 46%|████▌     | 17468/37963 [54:17:01<62:53:41, 11.05s/it]
 46%|████▌     | 17469/37963 [54:17:11<61:12:26, 10.75s/it]
 46%|████▌     | 17470/37963 [54:17:22<60:11:52, 10.57s/it]
                                                           
{'loss': '0.1574', 'grad_norm': '1.333', 'learning_rate': '1.177e-05', 'epoch': '0.4602'}

 46%|████▌     | 17470/37963 [54:17:22<60:11:52, 10.57s/it]
 46%|████▌     | 17471/37963 [54:17:32<59:14:49, 10.41s/it]
 46%|████▌     | 17472/37963 [54:17:42<58:37:35, 10.30s/it]
 46%|████▌     | 17473/37963 [54:17:52<58:14:40, 10.23s/it]
 46%|████▌     | 17474/37963 [54:18:02<58:02:34, 10.20s/it]
 46%|████▌     | 17475/37963 [54:18:12<57:49:18, 10.16s/it]
 46%|████▌     | 17476/37963 [54:18:22<57:37:16, 10.13s/it]
 46%|████▌     | 17477/37963 [54:18:38<68:30:39, 12.04s/it]
 46%|████▌     | 17478/37963 [54:18:49<65:15:13, 11.47s/it]
 46%|████▌     | 17479/37963 [54:19:12<84:59:55, 14.94s/it]
 46%|████▌     | 17480/37963 [54:19:22<76:49:38, 13.50s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '1.491', 'learning_rate': '1.176e-05', 'epoch': '0.4604'}

 46%|████▌     | 17480/37963 [54:19:22<76:49:38, 13.50s/it]
 46%|████▌     | 17481/37963 [54:19:32<70:54:40, 12.46s/it]
 46%|████▌     | 17482/37963 [54:19:42<66:43:28, 11.73s/it]
 46%|████▌     | 17483/37963 [54:19:52<63:54:36, 11.23s/it]
 46%|████▌     | 17484/37963 [54:20:02<62:04:30, 10.91s/it]
 46%|████▌     | 17485/37963 [54:20:11<59:31:34, 10.46s/it]
 46%|████▌     | 17486/37963 [54:20:21<58:25:19, 10.27s/it]
 46%|████▌     | 17487/37963 [54:20:31<58:01:39, 10.20s/it]
 46%|████▌     | 17488/37963 [54:20:41<57:37:43, 10.13s/it]
 46%|████▌     | 17489/37963 [54:20:58<68:12:27, 11.99s/it]
 46%|████▌     | 17490/37963 [54:21:08<64:43:31, 11.38s/it]
                                                           
{'loss': '0.1395', 'grad_norm': '1.171', 'learning_rate': '1.175e-05', 'epoch': '0.4607'}

 46%|████▌     | 17490/37963 [54:21:08<64:43:31, 11.38s/it]
 46%|████▌     | 17491/37963 [54:21:18<62:28:46, 10.99s/it]
 46%|████▌     | 17492/37963 [54:21:28<61:05:28, 10.74s/it]
 46%|████▌     | 17493/37963 [54:21:45<72:08:19, 12.69s/it]
 46%|████▌     | 17494/37963 [54:21:55<67:40:57, 11.90s/it]
 46%|████▌     | 17495/37963 [54:22:05<64:32:35, 11.35s/it]
 46%|████▌     | 17496/37963 [54:22:22<73:21:46, 12.90s/it]
 46%|████▌     | 17497/37963 [54:22:31<67:34:16, 11.89s/it]
 46%|████▌     | 17498/37963 [54:22:41<64:32:46, 11.35s/it]
 46%|████▌     | 17499/37963 [54:22:51<62:19:37, 10.96s/it]
 46%|████▌     | 17500/37963 [54:23:01<60:20:52, 10.62s/it]
                                                           
{'loss': '0.1379', 'grad_norm': '3.457', 'learning_rate': '1.174e-05', 'epoch': '0.461'}

 46%|████▌     | 17500/37963 [54:23:01<60:20:52, 10.62s/it]
 46%|████▌     | 17501/37963 [54:23:11<59:19:28, 10.44s/it]
 46%|████▌     | 17502/37963 [54:23:21<58:44:43, 10.34s/it]
 46%|████▌     | 17503/37963 [54:23:31<58:20:28, 10.27s/it]
 46%|████▌     | 17504/37963 [54:23:41<57:27:05, 10.11s/it]
 46%|████▌     | 17505/37963 [54:23:51<57:15:25, 10.08s/it]
 46%|████▌     | 17506/37963 [54:24:08<68:07:51, 11.99s/it]
 46%|████▌     | 17507/37963 [54:24:18<64:48:07, 11.40s/it]
 46%|████▌     | 17508/37963 [54:24:28<62:37:33, 11.02s/it]
 46%|████▌     | 17509/37963 [54:24:37<60:17:41, 10.61s/it]
 46%|████▌     | 17510/37963 [54:24:48<59:30:24, 10.47s/it]
                                                           
{'loss': '0.1511', 'grad_norm': '2.853', 'learning_rate': '1.173e-05', 'epoch': '0.4612'}

 46%|████▌     | 17510/37963 [54:24:48<59:30:24, 10.47s/it]
 46%|████▌     | 17511/37963 [54:24:58<58:59:16, 10.38s/it]
 46%|████▌     | 17512/37963 [54:25:08<58:24:59, 10.28s/it]
 46%|████▌     | 17513/37963 [54:25:18<57:38:00, 10.15s/it]
 46%|████▌     | 17514/37963 [54:25:35<69:07:59, 12.17s/it]
 46%|████▌     | 17515/37963 [54:25:44<65:19:39, 11.50s/it]
 46%|████▌     | 17516/37963 [54:25:55<62:50:16, 11.06s/it]
 46%|████▌     | 17517/37963 [54:26:04<60:50:51, 10.71s/it]
 46%|████▌     | 17518/37963 [54:26:15<59:48:41, 10.53s/it]
 46%|████▌     | 17519/37963 [54:26:24<58:49:16, 10.36s/it]
 46%|████▌     | 17520/37963 [54:26:35<58:23:58, 10.28s/it]
                                                           
{'loss': '0.1419', 'grad_norm': '1.916', 'learning_rate': '1.172e-05', 'epoch': '0.4615'}

 46%|████▌     | 17520/37963 [54:26:35<58:23:58, 10.28s/it]
 46%|████▌     | 17521/37963 [54:26:45<58:22:53, 10.28s/it]
 46%|████▌     | 17522/37963 [54:26:54<57:08:19, 10.06s/it]
 46%|████▌     | 17523/37963 [54:27:04<57:06:00, 10.06s/it]
 46%|████▌     | 17524/37963 [54:27:14<56:41:54,  9.99s/it]
 46%|████▌     | 17525/37963 [54:27:24<56:47:10, 10.00s/it]
 46%|████▌     | 17526/37963 [54:27:47<78:53:06, 13.90s/it]
 46%|████▌     | 17527/37963 [54:27:57<71:50:40, 12.66s/it]
 46%|████▌     | 17528/37963 [54:28:14<78:35:39, 13.85s/it]
 46%|████▌     | 17529/37963 [54:28:23<71:32:01, 12.60s/it]
 46%|████▌     | 17530/37963 [54:28:33<66:36:19, 11.73s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '1.688', 'learning_rate': '1.172e-05', 'epoch': '0.4618'}

 46%|████▌     | 17530/37963 [54:28:33<66:36:19, 11.73s/it]
 46%|████▌     | 17531/37963 [54:28:43<63:45:36, 11.23s/it]
 46%|████▌     | 17532/37963 [54:28:53<61:49:32, 10.89s/it]
 46%|████▌     | 17533/37963 [54:29:03<60:19:30, 10.63s/it]
 46%|████▌     | 17534/37963 [54:29:13<59:23:24, 10.47s/it]
 46%|████▌     | 17535/37963 [54:29:23<58:09:20, 10.25s/it]
 46%|████▌     | 17536/37963 [54:29:33<57:48:45, 10.19s/it]
 46%|████▌     | 17537/37963 [54:29:43<57:40:48, 10.17s/it]
 46%|████▌     | 17538/37963 [54:30:00<68:13:37, 12.03s/it]
 46%|████▌     | 17539/37963 [54:30:10<65:02:07, 11.46s/it]
 46%|████▌     | 17540/37963 [54:30:26<73:33:21, 12.97s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '1.245', 'learning_rate': '1.171e-05', 'epoch': '0.462'}

 46%|████▌     | 17540/37963 [54:30:26<73:33:21, 12.97s/it]
 46%|████▌     | 17541/37963 [54:30:36<68:14:00, 12.03s/it]
 46%|████▌     | 17542/37963 [54:30:46<64:54:33, 11.44s/it]
 46%|████▌     | 17543/37963 [54:30:56<62:45:37, 11.06s/it]
 46%|████▌     | 17544/37963 [54:31:13<72:19:19, 12.75s/it]
 46%|████▌     | 17545/37963 [54:31:23<67:48:55, 11.96s/it]
 46%|████▌     | 17546/37963 [54:31:33<64:04:33, 11.30s/it]
 46%|████▌     | 17547/37963 [54:31:43<62:03:38, 10.94s/it]
 46%|████▌     | 17548/37963 [54:31:53<60:33:39, 10.68s/it]
 46%|████▌     | 17549/37963 [54:32:03<59:21:24, 10.47s/it]
 46%|████▌     | 17550/37963 [54:32:13<58:02:25, 10.24s/it]
                                                           
{'loss': '0.1376', 'grad_norm': '1.852', 'learning_rate': '1.17e-05', 'epoch': '0.4623'}

 46%|████▌     | 17550/37963 [54:32:13<58:02:25, 10.24s/it]
 46%|████▌     | 17551/37963 [54:32:23<57:45:02, 10.19s/it]
 46%|████▌     | 17552/37963 [54:32:33<57:39:45, 10.17s/it]
 46%|████▌     | 17553/37963 [54:32:43<57:08:57, 10.08s/it]
 46%|████▌     | 17554/37963 [54:32:53<57:14:25, 10.10s/it]
 46%|████▌     | 17555/37963 [54:33:03<57:17:09, 10.11s/it]
 46%|████▌     | 17556/37963 [54:33:20<68:14:50, 12.04s/it]
 46%|████▌     | 17557/37963 [54:33:30<64:41:15, 11.41s/it]
 46%|████▋     | 17558/37963 [54:33:40<62:29:28, 11.03s/it]
 46%|████▋     | 17559/37963 [54:33:49<60:12:09, 10.62s/it]
 46%|████▋     | 17560/37963 [54:33:59<59:19:46, 10.47s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '1.871', 'learning_rate': '1.169e-05', 'epoch': '0.4626'}

 46%|████▋     | 17560/37963 [54:33:59<59:19:46, 10.47s/it]
 46%|████▋     | 17561/37963 [54:34:10<58:39:51, 10.35s/it]
 46%|████▋     | 17562/37963 [54:34:26<69:46:26, 12.31s/it]
 46%|████▋     | 17563/37963 [54:34:37<65:59:25, 11.65s/it]
 46%|████▋     | 17564/37963 [54:34:47<63:27:04, 11.20s/it]
 46%|████▋     | 17565/37963 [54:34:56<60:58:57, 10.76s/it]
 46%|████▋     | 17566/37963 [54:35:07<59:52:12, 10.57s/it]
 46%|████▋     | 17567/37963 [54:35:17<58:58:47, 10.41s/it]
 46%|████▋     | 17568/37963 [54:35:27<58:28:05, 10.32s/it]
 46%|████▋     | 17569/37963 [54:35:37<58:11:14, 10.27s/it]
 46%|████▋     | 17570/37963 [54:35:47<57:55:34, 10.23s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '1.314', 'learning_rate': '1.168e-05', 'epoch': '0.4628'}

 46%|████▋     | 17570/37963 [54:35:47<57:55:34, 10.23s/it]
 46%|████▋     | 17571/37963 [54:35:57<57:40:13, 10.18s/it]
 46%|████▋     | 17572/37963 [54:36:07<56:44:48, 10.02s/it]
 46%|████▋     | 17573/37963 [54:36:23<67:36:11, 11.94s/it]
 46%|████▋     | 17574/37963 [54:36:40<75:13:38, 13.28s/it]
 46%|████▋     | 17575/37963 [54:36:56<80:26:09, 14.20s/it]
 46%|████▋     | 17576/37963 [54:37:06<73:16:26, 12.94s/it]
 46%|████▋     | 17577/37963 [54:37:16<68:29:28, 12.09s/it]
 46%|████▋     | 17578/37963 [54:37:26<65:09:49, 11.51s/it]
 46%|████▋     | 17579/37963 [54:37:36<62:35:14, 11.05s/it]
 46%|████▋     | 17580/37963 [54:37:46<61:02:20, 10.78s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '2.341', 'learning_rate': '1.167e-05', 'epoch': '0.4631'}

 46%|████▋     | 17580/37963 [54:37:46<61:02:20, 10.78s/it]
 46%|████▋     | 17581/37963 [54:37:56<59:53:18, 10.58s/it]
 46%|████▋     | 17582/37963 [54:38:06<59:06:48, 10.44s/it]
 46%|████▋     | 17583/37963 [54:38:16<57:58:02, 10.24s/it]
 46%|████▋     | 17584/37963 [54:38:26<57:19:52, 10.13s/it]
 46%|████▋     | 17585/37963 [54:38:36<56:58:24, 10.07s/it]
 46%|████▋     | 17586/37963 [54:38:46<56:50:19, 10.04s/it]
 46%|████▋     | 17587/37963 [54:39:03<67:48:47, 11.98s/it]
 46%|████▋     | 17588/37963 [54:39:19<75:03:26, 13.26s/it]
 46%|████▋     | 17589/37963 [54:39:29<69:34:15, 12.29s/it]
 46%|████▋     | 17590/37963 [54:39:39<65:54:55, 11.65s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '3.497', 'learning_rate': '1.167e-05', 'epoch': '0.4633'}

 46%|████▋     | 17590/37963 [54:39:39<65:54:55, 11.65s/it]
 46%|████▋     | 17591/37963 [54:39:49<63:22:20, 11.20s/it]
 46%|████▋     | 17592/37963 [54:39:59<61:26:52, 10.86s/it]
 46%|████▋     | 17593/37963 [54:40:16<70:58:12, 12.54s/it]
 46%|████▋     | 17594/37963 [54:40:26<66:44:54, 11.80s/it]
 46%|████▋     | 17595/37963 [54:40:36<63:53:10, 11.29s/it]
 46%|████▋     | 17596/37963 [54:40:46<61:45:12, 10.92s/it]
 46%|████▋     | 17597/37963 [54:40:56<60:22:04, 10.67s/it]
 46%|████▋     | 17598/37963 [54:41:06<58:52:54, 10.41s/it]
 46%|████▋     | 17599/37963 [54:41:16<58:28:36, 10.34s/it]
 46%|████▋     | 17600/37963 [54:41:26<57:32:27, 10.17s/it]
                                                           
{'loss': '0.139', 'grad_norm': '1.491', 'learning_rate': '1.166e-05', 'epoch': '0.4636'}

 46%|████▋     | 17600/37963 [54:41:26<57:32:27, 10.17s/it]
 46%|████▋     | 17601/37963 [54:41:36<56:56:59, 10.07s/it]
 46%|████▋     | 17602/37963 [54:41:46<56:51:52, 10.05s/it]
 46%|████▋     | 17603/37963 [54:41:56<56:53:23, 10.06s/it]
 46%|████▋     | 17604/37963 [54:42:06<56:54:40, 10.06s/it]
 46%|████▋     | 17605/37963 [54:42:22<67:50:07, 12.00s/it]
 46%|████▋     | 17606/37963 [54:42:32<63:54:45, 11.30s/it]
 46%|████▋     | 17607/37963 [54:42:42<61:46:10, 10.92s/it]
 46%|████▋     | 17608/37963 [54:42:52<60:22:29, 10.68s/it]
 46%|████▋     | 17609/37963 [54:43:02<59:24:59, 10.51s/it]
 46%|████▋     | 17610/37963 [54:43:19<70:29:33, 12.47s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '0.9285', 'learning_rate': '1.165e-05', 'epoch': '0.4639'}

 46%|████▋     | 17610/37963 [54:43:19<70:29:33, 12.47s/it]
 46%|████▋     | 17611/37963 [54:43:29<66:21:33, 11.74s/it]
 46%|████▋     | 17612/37963 [54:43:39<63:32:13, 11.24s/it]
 46%|████▋     | 17613/37963 [54:43:49<61:06:51, 10.81s/it]
 46%|████▋     | 17614/37963 [54:43:59<59:51:09, 10.59s/it]
 46%|████▋     | 17615/37963 [54:44:09<58:23:10, 10.33s/it]
 46%|████▋     | 17616/37963 [54:44:19<57:53:44, 10.24s/it]
 46%|████▋     | 17617/37963 [54:44:29<57:37:59, 10.20s/it]
 46%|████▋     | 17618/37963 [54:44:39<57:01:41, 10.09s/it]
 46%|████▋     | 17619/37963 [54:44:49<56:55:06, 10.07s/it]
 46%|████▋     | 17620/37963 [54:44:59<57:06:09, 10.11s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '2.099', 'learning_rate': '1.164e-05', 'epoch': '0.4641'}

 46%|████▋     | 17620/37963 [54:44:59<57:06:09, 10.11s/it]
 46%|████▋     | 17621/37963 [54:45:15<67:16:21, 11.91s/it]
 46%|████▋     | 17622/37963 [54:45:31<74:13:29, 13.14s/it]
 46%|████▋     | 17623/37963 [54:45:48<80:01:06, 14.16s/it]
 46%|████▋     | 17624/37963 [54:45:58<72:59:03, 12.92s/it]
 46%|████▋     | 17625/37963 [54:46:08<68:11:16, 12.07s/it]
 46%|████▋     | 17626/37963 [54:46:17<63:53:47, 11.31s/it]
 46%|████▋     | 17627/37963 [54:46:27<61:34:38, 10.90s/it]
 46%|████▋     | 17628/37963 [54:46:37<60:15:35, 10.67s/it]
 46%|████▋     | 17629/37963 [54:46:48<59:14:27, 10.49s/it]
 46%|████▋     | 17630/37963 [54:46:57<57:56:26, 10.26s/it]
                                                           
{'loss': '0.145', 'grad_norm': '3.061', 'learning_rate': '1.163e-05', 'epoch': '0.4644'}

 46%|████▋     | 17630/37963 [54:46:57<57:56:26, 10.26s/it]
 46%|████▋     | 17631/37963 [54:47:07<57:14:33, 10.14s/it]
 46%|████▋     | 17632/37963 [54:47:17<57:25:37, 10.17s/it]
 46%|████▋     | 17633/37963 [54:47:27<56:56:49, 10.08s/it]
 46%|████▋     | 17634/37963 [54:47:37<56:18:55,  9.97s/it]
 46%|████▋     | 17635/37963 [54:47:54<67:30:57, 11.96s/it]
 46%|████▋     | 17636/37963 [54:48:04<64:18:48, 11.39s/it]
 46%|████▋     | 17637/37963 [54:48:20<73:27:56, 13.01s/it]
 46%|████▋     | 17638/37963 [54:48:31<68:40:25, 12.16s/it]
 46%|████▋     | 17639/37963 [54:48:41<64:50:14, 11.48s/it]
 46%|████▋     | 17640/37963 [54:48:57<73:18:02, 12.98s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '1.13', 'learning_rate': '1.162e-05', 'epoch': '0.4647'}

 46%|████▋     | 17640/37963 [54:48:57<73:18:02, 12.98s/it]
 46%|████▋     | 17641/37963 [54:49:07<68:18:19, 12.10s/it]
 46%|████▋     | 17642/37963 [54:49:17<65:09:19, 11.54s/it]
 46%|████▋     | 17643/37963 [54:49:27<62:54:48, 11.15s/it]
 46%|████▋     | 17644/37963 [54:49:38<61:13:08, 10.85s/it]
 46%|████▋     | 17645/37963 [54:49:48<59:59:13, 10.63s/it]
 46%|████▋     | 17646/37963 [54:49:58<59:01:28, 10.46s/it]
 46%|████▋     | 17647/37963 [54:50:08<58:10:34, 10.31s/it]
 46%|████▋     | 17648/37963 [54:50:18<57:18:00, 10.15s/it]
 46%|████▋     | 17649/37963 [54:50:28<57:13:48, 10.14s/it]
 46%|████▋     | 17650/37963 [54:50:38<57:11:31, 10.14s/it]
                                                           
{'loss': '0.1511', 'grad_norm': '2.472', 'learning_rate': '1.162e-05', 'epoch': '0.4649'}

 46%|████▋     | 17650/37963 [54:50:38<57:11:31, 10.14s/it]
 46%|████▋     | 17651/37963 [54:50:48<56:27:15, 10.01s/it]
 46%|████▋     | 17652/37963 [54:50:57<56:19:04,  9.98s/it]
 47%|████▋     | 17653/37963 [54:51:07<56:00:19,  9.93s/it]
 47%|████▋     | 17654/37963 [54:51:17<56:25:15, 10.00s/it]
 47%|████▋     | 17655/37963 [54:51:34<67:30:08, 11.97s/it]
 47%|████▋     | 17656/37963 [54:51:44<64:03:15, 11.36s/it]
 47%|████▋     | 17657/37963 [54:51:54<61:53:46, 10.97s/it]
 47%|████▋     | 17658/37963 [54:52:04<60:24:13, 10.71s/it]
 47%|████▋     | 17659/37963 [54:52:21<70:53:58, 12.57s/it]
 47%|████▋     | 17660/37963 [54:52:31<66:18:11, 11.76s/it]
                                                           
{'loss': '0.1582', 'grad_norm': '2.459', 'learning_rate': '1.161e-05', 'epoch': '0.4652'}

 47%|████▋     | 17660/37963 [54:52:31<66:18:11, 11.76s/it]
 47%|████▋     | 17661/37963 [54:52:41<63:25:21, 11.25s/it]
 47%|████▋     | 17662/37963 [54:52:51<61:28:13, 10.90s/it]
 47%|████▋     | 17663/37963 [54:53:01<60:01:37, 10.65s/it]
 47%|████▋     | 17664/37963 [54:53:11<58:56:30, 10.45s/it]
 47%|████▋     | 17665/37963 [54:53:21<57:17:13, 10.16s/it]
 47%|████▋     | 17666/37963 [54:53:31<57:14:07, 10.15s/it]
 47%|████▋     | 17667/37963 [54:53:41<56:52:22, 10.09s/it]
 47%|████▋     | 17668/37963 [54:53:51<56:55:03, 10.10s/it]
 47%|████▋     | 17669/37963 [54:54:00<56:09:12,  9.96s/it]
 47%|████▋     | 17670/37963 [54:54:17<67:11:25, 11.92s/it]
                                                           
{'loss': '0.151', 'grad_norm': '2.111', 'learning_rate': '1.16e-05', 'epoch': '0.4655'}

 47%|████▋     | 17670/37963 [54:54:17<67:11:25, 11.92s/it]
 47%|████▋     | 17671/37963 [54:54:40<85:48:34, 15.22s/it]
 47%|████▋     | 17672/37963 [54:54:50<77:04:39, 13.68s/it]
 47%|████▋     | 17673/37963 [54:55:00<71:03:49, 12.61s/it]
 47%|████▋     | 17674/37963 [54:55:10<66:14:59, 11.76s/it]
 47%|████▋     | 17675/37963 [54:55:20<63:30:28, 11.27s/it]
 47%|████▋     | 17676/37963 [54:55:30<61:34:57, 10.93s/it]
 47%|████▋     | 17677/37963 [54:55:40<59:59:01, 10.64s/it]
 47%|████▋     | 17678/37963 [54:55:50<59:14:52, 10.51s/it]
 47%|████▋     | 17679/37963 [54:56:00<58:32:42, 10.39s/it]
 47%|████▋     | 17680/37963 [54:56:10<58:12:42, 10.33s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '1.739', 'learning_rate': '1.159e-05', 'epoch': '0.4657'}

 47%|████▋     | 17680/37963 [54:56:10<58:12:42, 10.33s/it]
 47%|████▋     | 17681/37963 [54:56:21<57:48:59, 10.26s/it]
 47%|████▋     | 17682/37963 [54:56:31<57:18:16, 10.17s/it]
 47%|████▋     | 17683/37963 [54:56:48<69:32:55, 12.35s/it]
 47%|████▋     | 17684/37963 [54:57:04<76:16:26, 13.54s/it]
 47%|████▋     | 17685/37963 [54:57:14<70:24:28, 12.50s/it]
 47%|████▋     | 17686/37963 [54:57:24<66:10:30, 11.75s/it]
 47%|████▋     | 17687/37963 [54:57:34<63:22:03, 11.25s/it]
 47%|████▋     | 17688/37963 [54:57:51<72:31:43, 12.88s/it]
 47%|████▋     | 17689/37963 [54:58:01<67:50:26, 12.05s/it]
 47%|████▋     | 17690/37963 [54:58:11<64:38:19, 11.48s/it]
                                                           
{'loss': '0.1393', 'grad_norm': '1.96', 'learning_rate': '1.158e-05', 'epoch': '0.466'}

 47%|████▋     | 17690/37963 [54:58:11<64:38:19, 11.48s/it]
 47%|████▋     | 17691/37963 [54:58:21<62:17:38, 11.06s/it]
 47%|████▋     | 17692/37963 [54:58:32<60:39:20, 10.77s/it]
 47%|████▋     | 17693/37963 [54:58:42<59:30:31, 10.57s/it]
 47%|████▋     | 17694/37963 [54:58:51<58:07:42, 10.32s/it]
 47%|████▋     | 17695/37963 [54:59:01<57:34:30, 10.23s/it]
 47%|████▋     | 17696/37963 [54:59:11<57:14:03, 10.17s/it]
 47%|████▋     | 17697/37963 [54:59:22<57:22:22, 10.19s/it]
 47%|████▋     | 17698/37963 [54:59:32<57:01:02, 10.13s/it]
 47%|████▋     | 17699/37963 [54:59:42<57:03:38, 10.14s/it]
 47%|████▋     | 17700/37963 [54:59:52<56:36:35, 10.06s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '4.133', 'learning_rate': '1.157e-05', 'epoch': '0.4662'}

 47%|████▋     | 17700/37963 [54:59:52<56:36:35, 10.06s/it]
 47%|████▋     | 17701/37963 [55:00:01<56:00:36,  9.95s/it]
 47%|████▋     | 17702/37963 [55:00:18<67:14:38, 11.95s/it]
 47%|████▋     | 17703/37963 [55:00:28<64:04:49, 11.39s/it]
 47%|████▋     | 17704/37963 [55:00:38<61:43:24, 10.97s/it]
 47%|████▋     | 17705/37963 [55:00:48<59:38:44, 10.60s/it]
 47%|████▋     | 17706/37963 [55:00:58<58:45:21, 10.44s/it]
 47%|████▋     | 17707/37963 [55:01:08<58:18:38, 10.36s/it]
 47%|████▋     | 17708/37963 [55:01:18<57:50:25, 10.28s/it]
 47%|████▋     | 17709/37963 [55:01:35<68:40:14, 12.21s/it]
 47%|████▋     | 17710/37963 [55:01:45<65:06:04, 11.57s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '1.547', 'learning_rate': '1.157e-05', 'epoch': '0.4665'}

 47%|████▋     | 17710/37963 [55:01:45<65:06:04, 11.57s/it]
 47%|████▋     | 17711/37963 [55:01:55<62:40:39, 11.14s/it]
 47%|████▋     | 17712/37963 [55:02:05<60:54:10, 10.83s/it]
 47%|████▋     | 17713/37963 [55:02:15<59:39:48, 10.61s/it]
 47%|████▋     | 17714/37963 [55:02:25<58:50:55, 10.46s/it]
 47%|████▋     | 17715/37963 [55:02:35<57:08:39, 10.16s/it]
 47%|████▋     | 17716/37963 [55:02:45<57:05:33, 10.15s/it]
 47%|████▋     | 17717/37963 [55:02:55<57:02:17, 10.14s/it]
 47%|████▋     | 17718/37963 [55:03:11<67:33:28, 12.01s/it]
 47%|████▋     | 17719/37963 [55:03:28<75:24:51, 13.41s/it]
 47%|████▋     | 17720/37963 [55:03:45<80:22:42, 14.29s/it]
                                                           
{'loss': '0.143', 'grad_norm': '1.126', 'learning_rate': '1.156e-05', 'epoch': '0.4668'}

 47%|████▋     | 17720/37963 [55:03:45<80:22:42, 14.29s/it]
 47%|████▋     | 17721/37963 [55:03:55<73:15:25, 13.03s/it]
 47%|████▋     | 17722/37963 [55:04:05<68:16:50, 12.14s/it]
 47%|████▋     | 17723/37963 [55:04:15<64:22:43, 11.45s/it]
 47%|████▋     | 17724/37963 [55:04:24<61:42:03, 10.98s/it]
 47%|████▋     | 17725/37963 [55:04:34<60:10:11, 10.70s/it]
 47%|████▋     | 17726/37963 [55:04:44<59:02:14, 10.50s/it]
 47%|████▋     | 17727/37963 [55:04:55<58:14:56, 10.36s/it]
 47%|████▋     | 17728/37963 [55:05:05<57:49:32, 10.29s/it]
 47%|████▋     | 17729/37963 [55:05:21<68:33:13, 12.20s/it]
 47%|████▋     | 17730/37963 [55:05:31<64:45:01, 11.52s/it]
                                                           
{'loss': '0.149', 'grad_norm': '3.491', 'learning_rate': '1.155e-05', 'epoch': '0.467'}

 47%|████▋     | 17730/37963 [55:05:31<64:45:01, 11.52s/it]
 47%|████▋     | 17731/37963 [55:05:41<61:52:11, 11.01s/it]
 47%|████▋     | 17732/37963 [55:05:51<60:42:26, 10.80s/it]
 47%|████▋     | 17733/37963 [55:06:01<59:22:33, 10.57s/it]
 47%|████▋     | 17734/37963 [55:06:18<69:31:15, 12.37s/it]
 47%|████▋     | 17735/37963 [55:06:28<65:47:31, 11.71s/it]
 47%|████▋     | 17736/37963 [55:06:38<62:57:54, 11.21s/it]
 47%|████▋     | 17737/37963 [55:06:55<72:17:33, 12.87s/it]
 47%|████▋     | 17738/37963 [55:07:05<67:46:16, 12.06s/it]
 47%|████▋     | 17739/37963 [55:07:15<64:31:08, 11.48s/it]
 47%|████▋     | 17740/37963 [55:07:25<61:30:00, 10.95s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '1.699', 'learning_rate': '1.154e-05', 'epoch': '0.4673'}

 47%|████▋     | 17740/37963 [55:07:25<61:30:00, 10.95s/it]
 47%|████▋     | 17741/37963 [55:07:35<59:25:08, 10.58s/it]
 47%|████▋     | 17742/37963 [55:07:45<58:45:05, 10.46s/it]
 47%|████▋     | 17743/37963 [55:07:55<57:57:15, 10.32s/it]
 47%|████▋     | 17744/37963 [55:08:05<57:32:17, 10.24s/it]
 47%|████▋     | 17745/37963 [55:08:15<57:14:51, 10.19s/it]
 47%|████▋     | 17746/37963 [55:08:25<56:48:24, 10.12s/it]
 47%|████▋     | 17747/37963 [55:08:35<56:18:17, 10.03s/it]
 47%|████▋     | 17748/37963 [55:08:45<56:24:42, 10.05s/it]
 47%|████▋     | 17749/37963 [55:09:01<67:02:40, 11.94s/it]
 47%|████▋     | 17750/37963 [55:09:11<64:07:47, 11.42s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '0.9668', 'learning_rate': '1.153e-05', 'epoch': '0.4676'}

 47%|████▋     | 17750/37963 [55:09:11<64:07:47, 11.42s/it]
 47%|████▋     | 17751/37963 [55:09:21<61:51:11, 11.02s/it]
 47%|████▋     | 17752/37963 [55:09:31<60:11:49, 10.72s/it]
 47%|████▋     | 17753/37963 [55:09:42<59:04:22, 10.52s/it]
 47%|████▋     | 17754/37963 [55:09:52<58:22:26, 10.40s/it]
 47%|████▋     | 17755/37963 [55:10:01<57:20:52, 10.22s/it]
 47%|████▋     | 17756/37963 [55:10:18<68:35:03, 12.22s/it]
 47%|████▋     | 17757/37963 [55:10:28<64:55:45, 11.57s/it]
 47%|████▋     | 17758/37963 [55:10:38<62:23:34, 11.12s/it]
 47%|████▋     | 17759/37963 [55:10:48<60:35:07, 10.80s/it]
 47%|████▋     | 17760/37963 [55:10:59<59:31:08, 10.61s/it]
                                                           
{'loss': '0.148', 'grad_norm': '2.65', 'learning_rate': '1.152e-05', 'epoch': '0.4678'}

 47%|████▋     | 17760/37963 [55:10:59<59:31:08, 10.61s/it]
 47%|████▋     | 17761/37963 [55:11:09<58:40:30, 10.46s/it]
 47%|████▋     | 17762/37963 [55:11:19<58:12:35, 10.37s/it]
 47%|████▋     | 17763/37963 [55:11:29<57:46:15, 10.30s/it]
 47%|████▋     | 17764/37963 [55:11:39<57:28:50, 10.24s/it]
 47%|████▋     | 17765/37963 [55:11:55<67:39:25, 12.06s/it]
 47%|████▋     | 17766/37963 [55:12:06<64:25:22, 11.48s/it]
 47%|████▋     | 17767/37963 [55:12:22<72:29:33, 12.92s/it]
 47%|████▋     | 17768/37963 [55:12:38<78:06:46, 13.92s/it]
 47%|████▋     | 17769/37963 [55:12:48<71:28:12, 12.74s/it]
 47%|████▋     | 17770/37963 [55:12:58<67:06:40, 11.96s/it]
                                                           
{'loss': '0.1435', 'grad_norm': '1.444', 'learning_rate': '1.151e-05', 'epoch': '0.4681'}

 47%|████▋     | 17770/37963 [55:12:58<67:06:40, 11.96s/it]
 47%|████▋     | 17771/37963 [55:13:08<63:58:40, 11.41s/it]
 47%|████▋     | 17772/37963 [55:13:19<61:51:37, 11.03s/it]
 47%|████▋     | 17773/37963 [55:13:29<60:18:26, 10.75s/it]
 47%|████▋     | 17774/37963 [55:13:39<59:05:43, 10.54s/it]
 47%|████▋     | 17775/37963 [55:13:49<58:19:55, 10.40s/it]
 47%|████▋     | 17776/37963 [55:13:59<57:51:25, 10.32s/it]
 47%|████▋     | 17777/37963 [55:14:09<57:31:18, 10.26s/it]
 47%|████▋     | 17778/37963 [55:14:25<67:54:22, 12.11s/it]
 47%|████▋     | 17779/37963 [55:14:36<64:32:33, 11.51s/it]
 47%|████▋     | 17780/37963 [55:14:45<61:29:29, 10.97s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '1.016', 'learning_rate': '1.151e-05', 'epoch': '0.4684'}

 47%|████▋     | 17780/37963 [55:14:45<61:29:29, 10.97s/it]
 47%|████▋     | 17781/37963 [55:14:55<59:58:25, 10.70s/it]
 47%|████▋     | 17782/37963 [55:15:12<69:51:33, 12.46s/it]
 47%|████▋     | 17783/37963 [55:15:22<65:47:30, 11.74s/it]
 47%|████▋     | 17784/37963 [55:15:32<62:44:11, 11.19s/it]
 47%|████▋     | 17785/37963 [55:15:48<71:26:39, 12.75s/it]
 47%|████▋     | 17786/37963 [55:15:58<67:03:16, 11.96s/it]
 47%|████▋     | 17787/37963 [55:16:08<62:52:44, 11.22s/it]
 47%|████▋     | 17788/37963 [55:16:18<60:50:57, 10.86s/it]
 47%|████▋     | 17789/37963 [55:16:28<59:22:26, 10.60s/it]
 47%|████▋     | 17790/37963 [55:16:38<58:18:29, 10.41s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '4.783', 'learning_rate': '1.15e-05', 'epoch': '0.4686'}

 47%|████▋     | 17790/37963 [55:16:38<58:18:29, 10.41s/it]
 47%|████▋     | 17791/37963 [55:16:48<57:44:57, 10.31s/it]
 47%|████▋     | 17792/37963 [55:16:58<57:17:08, 10.22s/it]
 47%|████▋     | 17793/37963 [55:17:08<57:00:59, 10.18s/it]
 47%|████▋     | 17794/37963 [55:17:18<56:42:28, 10.12s/it]
 47%|████▋     | 17795/37963 [55:17:28<56:33:19, 10.10s/it]
 47%|████▋     | 17796/37963 [55:17:38<56:31:02, 10.09s/it]
 47%|████▋     | 17797/37963 [55:17:54<66:21:44, 11.85s/it]
 47%|████▋     | 17798/37963 [55:18:04<63:25:43, 11.32s/it]
 47%|████▋     | 17799/37963 [55:18:14<61:19:06, 10.95s/it]
 47%|████▋     | 17800/37963 [55:18:24<59:24:04, 10.61s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '3.513', 'learning_rate': '1.149e-05', 'epoch': '0.4689'}

 47%|████▋     | 17800/37963 [55:18:24<59:24:04, 10.61s/it]
 47%|████▋     | 17801/37963 [55:18:34<58:21:05, 10.42s/it]
 47%|████▋     | 17802/37963 [55:18:44<57:46:22, 10.32s/it]
 47%|████▋     | 17803/37963 [55:19:01<68:09:18, 12.17s/it]
 47%|████▋     | 17804/37963 [55:19:11<64:50:39, 11.58s/it]
 47%|████▋     | 17805/37963 [55:19:21<62:09:54, 11.10s/it]
 47%|████▋     | 17806/37963 [55:19:30<59:38:05, 10.65s/it]
 47%|████▋     | 17807/37963 [55:19:40<58:43:22, 10.49s/it]
 47%|████▋     | 17808/37963 [55:19:50<57:29:32, 10.27s/it]
 47%|████▋     | 17809/37963 [55:20:00<56:57:57, 10.18s/it]
 47%|████▋     | 17810/37963 [55:20:10<56:51:48, 10.16s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '1.134', 'learning_rate': '1.148e-05', 'epoch': '0.4691'}

 47%|████▋     | 17810/37963 [55:20:10<56:51:48, 10.16s/it]
 47%|████▋     | 17811/37963 [55:20:20<56:07:50, 10.03s/it]
 47%|████▋     | 17812/37963 [55:20:30<55:14:02,  9.87s/it]
 47%|████▋     | 17813/37963 [55:20:40<55:41:03,  9.95s/it]
 47%|████▋     | 17814/37963 [55:20:56<66:34:25, 11.89s/it]
 47%|████▋     | 17815/37963 [55:21:12<73:59:22, 13.22s/it]
 47%|████▋     | 17816/37963 [55:21:29<79:21:57, 14.18s/it]
 47%|████▋     | 17817/37963 [55:21:39<72:32:40, 12.96s/it]
 47%|████▋     | 17818/37963 [55:21:49<67:39:10, 12.09s/it]
 47%|████▋     | 17819/37963 [55:21:59<64:00:55, 11.44s/it]
 47%|████▋     | 17820/37963 [55:22:09<61:39:58, 11.02s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '1.824', 'learning_rate': '1.147e-05', 'epoch': '0.4694'}

 47%|████▋     | 17820/37963 [55:22:09<61:39:58, 11.02s/it]
 47%|████▋     | 17821/37963 [55:22:19<60:00:32, 10.73s/it]
 47%|████▋     | 17822/37963 [55:22:29<58:48:49, 10.51s/it]
 47%|████▋     | 17823/37963 [55:22:39<57:50:31, 10.34s/it]
 47%|████▋     | 17824/37963 [55:22:49<57:09:27, 10.22s/it]
 47%|████▋     | 17825/37963 [55:22:58<55:44:19,  9.96s/it]
 47%|████▋     | 17826/37963 [55:23:08<55:31:53,  9.93s/it]
 47%|████▋     | 17827/37963 [55:23:18<55:30:54,  9.93s/it]
 47%|████▋     | 17828/37963 [55:23:28<55:42:32,  9.96s/it]
 47%|████▋     | 17829/37963 [55:23:45<67:00:50, 11.98s/it]
 47%|████▋     | 17830/37963 [55:23:55<64:01:31, 11.45s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '1.058', 'learning_rate': '1.146e-05', 'epoch': '0.4697'}

 47%|████▋     | 17830/37963 [55:23:55<64:01:31, 11.45s/it]
 47%|████▋     | 17831/37963 [55:24:05<61:42:11, 11.03s/it]
 47%|████▋     | 17832/37963 [55:24:15<60:00:47, 10.73s/it]
 47%|████▋     | 17833/37963 [55:24:31<69:31:33, 12.43s/it]
 47%|████▋     | 17834/37963 [55:24:42<65:35:07, 11.73s/it]
 47%|████▋     | 17835/37963 [55:24:52<62:50:48, 11.24s/it]
 47%|████▋     | 17836/37963 [55:25:02<60:52:26, 10.89s/it]
 47%|████▋     | 17837/37963 [55:25:12<59:28:21, 10.64s/it]
 47%|████▋     | 17838/37963 [55:25:21<57:20:45, 10.26s/it]
 47%|████▋     | 17839/37963 [55:25:31<57:01:54, 10.20s/it]
 47%|████▋     | 17840/37963 [55:25:41<56:27:30, 10.10s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '1.89', 'learning_rate': '1.146e-05', 'epoch': '0.4699'}

 47%|████▋     | 17840/37963 [55:25:41<56:27:30, 10.10s/it]
 47%|████▋     | 17841/37963 [55:25:51<56:05:31, 10.04s/it]
 47%|████▋     | 17842/37963 [55:26:01<56:14:50, 10.06s/it]
 47%|████▋     | 17843/37963 [55:26:11<56:13:51, 10.06s/it]
 47%|████▋     | 17844/37963 [55:26:21<56:14:05, 10.06s/it]
 47%|████▋     | 17845/37963 [55:26:31<55:45:16,  9.98s/it]
 47%|████▋     | 17846/37963 [55:26:48<67:22:54, 12.06s/it]
 47%|████▋     | 17847/37963 [55:26:58<64:00:06, 11.45s/it]
 47%|████▋     | 17848/37963 [55:27:08<61:06:15, 10.94s/it]
 47%|████▋     | 17849/37963 [55:27:18<59:41:53, 10.68s/it]
 47%|████▋     | 17850/37963 [55:27:28<58:55:59, 10.55s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '1.525', 'learning_rate': '1.145e-05', 'epoch': '0.4702'}

 47%|████▋     | 17850/37963 [55:27:28<58:55:59, 10.55s/it]
 47%|████▋     | 17851/37963 [55:27:38<58:02:44, 10.39s/it]
 47%|████▋     | 17852/37963 [55:27:48<57:28:03, 10.29s/it]
 47%|████▋     | 17853/37963 [55:28:05<68:54:10, 12.33s/it]
 47%|████▋     | 17854/37963 [55:28:15<65:12:06, 11.67s/it]
 47%|████▋     | 17855/37963 [55:28:25<62:22:14, 11.17s/it]
 47%|████▋     | 17856/37963 [55:28:35<60:44:45, 10.88s/it]
 47%|████▋     | 17857/37963 [55:28:45<58:52:10, 10.54s/it]
 47%|████▋     | 17858/37963 [55:28:55<58:17:32, 10.44s/it]
 47%|████▋     | 17859/37963 [55:29:05<57:37:56, 10.32s/it]
 47%|████▋     | 17860/37963 [55:29:15<56:45:01, 10.16s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '0.9833', 'learning_rate': '1.144e-05', 'epoch': '0.4705'}

 47%|████▋     | 17860/37963 [55:29:15<56:45:01, 10.16s/it]
 47%|████▋     | 17861/37963 [55:29:25<56:45:46, 10.17s/it]
 47%|████▋     | 17862/37963 [55:29:49<78:31:37, 14.06s/it]
 47%|████▋     | 17863/37963 [55:29:59<71:51:09, 12.87s/it]
 47%|████▋     | 17864/37963 [55:30:15<77:04:20, 13.80s/it]
 47%|████▋     | 17865/37963 [55:30:25<71:12:30, 12.76s/it]
 47%|████▋     | 17866/37963 [55:30:35<66:36:50, 11.93s/it]
 47%|████▋     | 17867/37963 [55:30:45<63:19:12, 11.34s/it]
 47%|████▋     | 17868/37963 [55:30:55<61:21:35, 10.99s/it]
 47%|████▋     | 17869/37963 [55:31:05<59:49:01, 10.72s/it]
 47%|████▋     | 17870/37963 [55:31:15<58:43:26, 10.52s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '1.536', 'learning_rate': '1.143e-05', 'epoch': '0.4707'}

 47%|████▋     | 17870/37963 [55:31:15<58:43:26, 10.52s/it]
 47%|████▋     | 17871/37963 [55:31:25<58:05:42, 10.41s/it]
 47%|████▋     | 17872/37963 [55:31:36<57:48:24, 10.36s/it]
 47%|████▋     | 17873/37963 [55:31:46<57:01:22, 10.22s/it]
 47%|████▋     | 17874/37963 [55:31:56<56:56:30, 10.20s/it]
 47%|████▋     | 17875/37963 [55:32:06<56:22:34, 10.10s/it]
 47%|████▋     | 17876/37963 [55:32:16<56:29:45, 10.13s/it]
 47%|████▋     | 17877/37963 [55:32:39<78:49:05, 14.13s/it]
 47%|████▋     | 17878/37963 [55:32:49<72:01:03, 12.91s/it]
 47%|████▋     | 17879/37963 [55:33:00<67:28:07, 12.09s/it]
 47%|████▋     | 17880/37963 [55:33:09<63:27:13, 11.37s/it]
                                                           
{'loss': '0.1459', 'grad_norm': '1.983', 'learning_rate': '1.142e-05', 'epoch': '0.471'}

 47%|████▋     | 17880/37963 [55:33:09<63:27:13, 11.37s/it]
 47%|████▋     | 17881/37963 [55:33:19<61:25:28, 11.01s/it]
 47%|████▋     | 17882/37963 [55:33:36<70:39:47, 12.67s/it]
 47%|████▋     | 17883/37963 [55:33:46<66:25:56, 11.91s/it]
 47%|████▋     | 17884/37963 [55:33:56<63:22:00, 11.36s/it]
 47%|████▋     | 17885/37963 [55:34:06<61:08:38, 10.96s/it]
 47%|████▋     | 17886/37963 [55:34:16<59:33:23, 10.68s/it]
 47%|████▋     | 17887/37963 [55:34:26<58:40:02, 10.52s/it]
 47%|████▋     | 17888/37963 [55:34:36<57:53:47, 10.38s/it]
 47%|████▋     | 17889/37963 [55:34:46<57:22:41, 10.29s/it]
 47%|████▋     | 17890/37963 [55:34:56<56:55:19, 10.21s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '1.302', 'learning_rate': '1.141e-05', 'epoch': '0.4712'}

 47%|████▋     | 17890/37963 [55:34:56<56:55:19, 10.21s/it]
 47%|████▋     | 17891/37963 [55:35:07<56:48:28, 10.19s/it]
 47%|████▋     | 17892/37963 [55:35:16<56:14:20, 10.09s/it]
 47%|████▋     | 17893/37963 [55:35:26<56:02:44, 10.05s/it]
 47%|████▋     | 17894/37963 [55:35:43<66:18:36, 11.89s/it]
 47%|████▋     | 17895/37963 [55:35:53<63:16:47, 11.35s/it]
 47%|████▋     | 17896/37963 [55:36:03<61:10:09, 10.97s/it]
 47%|████▋     | 17897/37963 [55:36:13<59:39:17, 10.70s/it]
 47%|████▋     | 17898/37963 [55:36:23<58:33:19, 10.51s/it]
 47%|████▋     | 17899/37963 [55:36:33<57:17:30, 10.28s/it]
 47%|████▋     | 17900/37963 [55:36:43<57:02:39, 10.24s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '2.043', 'learning_rate': '1.14e-05', 'epoch': '0.4715'}

 47%|████▋     | 17900/37963 [55:36:43<57:02:39, 10.24s/it]
 47%|████▋     | 17901/37963 [55:36:53<56:39:40, 10.17s/it]
 47%|████▋     | 17902/37963 [55:37:10<68:01:43, 12.21s/it]
 47%|████▋     | 17903/37963 [55:37:20<64:28:52, 11.57s/it]
 47%|████▋     | 17904/37963 [55:37:30<61:48:35, 11.09s/it]
 47%|████▋     | 17905/37963 [55:37:40<59:58:12, 10.76s/it]
 47%|████▋     | 17906/37963 [55:37:50<59:03:44, 10.60s/it]
 47%|████▋     | 17907/37963 [55:38:00<57:40:46, 10.35s/it]
 47%|████▋     | 17908/37963 [55:38:10<57:04:57, 10.25s/it]
 47%|████▋     | 17909/37963 [55:38:26<67:34:47, 12.13s/it]
 47%|████▋     | 17910/37963 [55:38:36<64:13:22, 11.53s/it]
                                                           
{'loss': '0.1403', 'grad_norm': '1.789', 'learning_rate': '1.14e-05', 'epoch': '0.4718'}

 47%|████▋     | 17910/37963 [55:38:36<64:13:22, 11.53s/it]
 47%|████▋     | 17911/37963 [55:38:53<72:47:01, 13.07s/it]
 47%|████▋     | 17912/37963 [55:39:10<78:21:37, 14.07s/it]
 47%|████▋     | 17913/37963 [55:39:20<71:47:03, 12.89s/it]
 47%|████▋     | 17914/37963 [55:39:30<67:07:22, 12.05s/it]
 47%|████▋     | 17915/37963 [55:39:39<63:01:55, 11.32s/it]
 47%|████▋     | 17916/37963 [55:39:50<61:11:44, 10.99s/it]
 47%|████▋     | 17917/37963 [55:40:00<59:21:16, 10.66s/it]
 47%|████▋     | 17918/37963 [55:40:10<58:30:09, 10.51s/it]
 47%|████▋     | 17919/37963 [55:40:19<57:18:44, 10.29s/it]
 47%|████▋     | 17920/37963 [55:40:30<57:03:33, 10.25s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '1.398', 'learning_rate': '1.139e-05', 'epoch': '0.472'}

 47%|████▋     | 17920/37963 [55:40:30<57:03:33, 10.25s/it]
 47%|████▋     | 17921/37963 [55:40:40<56:45:55, 10.20s/it]
 47%|████▋     | 17922/37963 [55:40:50<56:29:27, 10.15s/it]
 47%|████▋     | 17923/37963 [55:41:07<67:45:20, 12.17s/it]
 47%|████▋     | 17924/37963 [55:41:16<63:37:52, 11.43s/it]
 47%|████▋     | 17925/37963 [55:41:26<61:15:37, 11.01s/it]
 47%|████▋     | 17926/37963 [55:41:36<59:24:52, 10.67s/it]
 47%|████▋     | 17927/37963 [55:41:52<68:42:34, 12.35s/it]
 47%|████▋     | 17928/37963 [55:42:03<64:58:35, 11.68s/it]
 47%|████▋     | 17929/37963 [55:42:13<62:18:35, 11.20s/it]
 47%|████▋     | 17930/37963 [55:42:29<71:03:08, 12.77s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '1.587', 'learning_rate': '1.138e-05', 'epoch': '0.4723'}

 47%|████▋     | 17930/37963 [55:42:29<71:03:08, 12.77s/it]
 47%|████▋     | 17931/37963 [55:42:39<66:33:48, 11.96s/it]
 47%|████▋     | 17932/37963 [55:42:49<63:09:41, 11.35s/it]
 47%|████▋     | 17933/37963 [55:42:59<60:59:03, 10.96s/it]
 47%|████▋     | 17934/37963 [55:43:09<59:15:48, 10.65s/it]
 47%|████▋     | 17935/37963 [55:43:19<58:04:35, 10.44s/it]
 47%|████▋     | 17936/37963 [55:43:29<57:02:41, 10.25s/it]
 47%|████▋     | 17937/37963 [55:43:39<56:45:12, 10.20s/it]
 47%|████▋     | 17938/37963 [55:43:49<56:36:50, 10.18s/it]
 47%|████▋     | 17939/37963 [55:43:59<56:04:27, 10.08s/it]
 47%|████▋     | 17940/37963 [55:44:09<56:10:53, 10.10s/it]
                                                           
{'loss': '0.1483', 'grad_norm': '1.091', 'learning_rate': '1.137e-05', 'epoch': '0.4726'}

 47%|████▋     | 17940/37963 [55:44:09<56:10:53, 10.10s/it]
 47%|████▋     | 17941/37963 [55:44:19<56:16:01, 10.12s/it]
 47%|████▋     | 17942/37963 [55:44:36<66:47:15, 12.01s/it]
 47%|████▋     | 17943/37963 [55:44:46<63:20:32, 11.39s/it]
 47%|████▋     | 17944/37963 [55:44:56<61:02:33, 10.98s/it]
 47%|████▋     | 17945/37963 [55:45:06<59:32:49, 10.71s/it]
 47%|████▋     | 17946/37963 [55:45:16<58:13:28, 10.47s/it]
 47%|████▋     | 17947/37963 [55:45:26<57:31:44, 10.35s/it]
 47%|████▋     | 17948/37963 [55:45:36<57:07:43, 10.28s/it]
 47%|████▋     | 17949/37963 [55:45:46<56:46:03, 10.21s/it]
 47%|████▋     | 17950/37963 [55:46:03<68:16:47, 12.28s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '3.678', 'learning_rate': '1.136e-05', 'epoch': '0.4728'}

 47%|████▋     | 17950/37963 [55:46:03<68:16:47, 12.28s/it]
 47%|████▋     | 17951/37963 [55:46:13<64:24:50, 11.59s/it]
 47%|████▋     | 17952/37963 [55:46:23<61:51:05, 11.13s/it]
 47%|████▋     | 17953/37963 [55:46:33<59:50:03, 10.76s/it]
 47%|████▋     | 17954/37963 [55:46:43<58:39:49, 10.55s/it]
 47%|████▋     | 17955/37963 [55:46:53<57:32:41, 10.35s/it]
 47%|████▋     | 17956/37963 [55:47:09<67:45:34, 12.19s/it]
 47%|████▋     | 17957/37963 [55:47:20<64:33:52, 11.62s/it]
 47%|████▋     | 17958/37963 [55:47:29<61:39:47, 11.10s/it]
 47%|████▋     | 17959/37963 [55:47:40<60:04:11, 10.81s/it]
 47%|████▋     | 17960/37963 [55:47:56<69:15:55, 12.47s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '0.7924', 'learning_rate': '1.135e-05', 'epoch': '0.4731'}

 47%|████▋     | 17960/37963 [55:47:56<69:15:55, 12.47s/it]
 47%|████▋     | 17961/37963 [55:48:06<65:27:12, 11.78s/it]
 47%|████▋     | 17962/37963 [55:48:23<73:32:20, 13.24s/it]
 47%|████▋     | 17963/37963 [55:48:33<68:01:42, 12.25s/it]
 47%|████▋     | 17964/37963 [55:48:43<64:32:40, 11.62s/it]
 47%|████▋     | 17965/37963 [55:48:53<62:01:46, 11.17s/it]
 47%|████▋     | 17966/37963 [55:49:03<59:27:41, 10.70s/it]
 47%|████▋     | 17967/37963 [55:49:13<58:20:01, 10.50s/it]
 47%|████▋     | 17968/37963 [55:49:23<57:25:28, 10.34s/it]
 47%|████▋     | 17969/37963 [55:49:33<56:59:59, 10.26s/it]
 47%|████▋     | 17970/37963 [55:49:43<56:50:04, 10.23s/it]
                                                           
{'loss': '0.1511', 'grad_norm': '1.212', 'learning_rate': '1.135e-05', 'epoch': '0.4734'}

 47%|████▋     | 17970/37963 [55:49:43<56:50:04, 10.23s/it]
 47%|████▋     | 17971/37963 [55:49:53<56:43:42, 10.22s/it]
 47%|████▋     | 17972/37963 [55:50:03<56:29:32, 10.17s/it]
 47%|████▋     | 17973/37963 [55:50:20<67:49:35, 12.21s/it]
 47%|████▋     | 17974/37963 [55:50:30<64:04:16, 11.54s/it]
 47%|████▋     | 17975/37963 [55:50:40<61:37:42, 11.10s/it]
 47%|████▋     | 17976/37963 [55:50:57<70:54:01, 12.77s/it]
 47%|████▋     | 17977/37963 [55:51:07<66:18:42, 11.94s/it]
 47%|████▋     | 17978/37963 [55:51:23<74:07:33, 13.35s/it]
 47%|████▋     | 17979/37963 [55:51:33<68:02:41, 12.26s/it]
 47%|████▋     | 17980/37963 [55:51:43<64:24:15, 11.60s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '2.785', 'learning_rate': '1.134e-05', 'epoch': '0.4736'}

 47%|████▋     | 17980/37963 [55:51:43<64:24:15, 11.60s/it]
 47%|████▋     | 17981/37963 [55:51:53<62:00:44, 11.17s/it]
 47%|████▋     | 17982/37963 [55:52:03<60:04:43, 10.82s/it]
 47%|████▋     | 17983/37963 [55:52:13<58:36:58, 10.56s/it]
 47%|████▋     | 17984/37963 [55:52:23<57:48:33, 10.42s/it]
 47%|████▋     | 17985/37963 [55:52:34<57:22:20, 10.34s/it]
 47%|████▋     | 17986/37963 [55:52:44<57:02:50, 10.28s/it]
 47%|████▋     | 17987/37963 [55:52:54<56:44:31, 10.23s/it]
 47%|████▋     | 17988/37963 [55:53:04<55:59:22, 10.09s/it]
 47%|████▋     | 17989/37963 [55:53:20<66:38:10, 12.01s/it]
 47%|████▋     | 17990/37963 [55:53:30<63:08:59, 11.38s/it]
                                                           
{'loss': '0.1416', 'grad_norm': '1.143', 'learning_rate': '1.133e-05', 'epoch': '0.4739'}

 47%|████▋     | 17990/37963 [55:53:30<63:08:59, 11.38s/it]
 47%|████▋     | 17991/37963 [55:53:40<60:58:58, 10.99s/it]
 47%|████▋     | 17992/37963 [55:53:50<59:14:30, 10.68s/it]
 47%|████▋     | 17993/37963 [55:54:00<58:12:45, 10.49s/it]
 47%|████▋     | 17994/37963 [55:54:10<57:24:08, 10.35s/it]
 47%|████▋     | 17995/37963 [55:54:20<56:56:36, 10.27s/it]
 47%|████▋     | 17996/37963 [55:54:30<56:24:14, 10.17s/it]
 47%|████▋     | 17997/37963 [55:54:40<56:12:01, 10.13s/it]
 47%|████▋     | 17998/37963 [55:54:57<67:46:39, 12.22s/it]
 47%|████▋     | 17999/37963 [55:55:07<64:11:46, 11.58s/it]
 47%|████▋     | 18000/37963 [55:55:17<61:40:31, 11.12s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '1.981', 'learning_rate': '1.132e-05', 'epoch': '0.4741'}

 47%|████▋     | 18000/37963 [55:55:17<61:40:31, 11.12s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.89s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.89s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 47%|████▋     | 18001/37963 [55:56:16<141:27:18, 25.51s/it]
 47%|████▋     | 18002/37963 [55:56:27<115:56:22, 20.91s/it]
 47%|████▋     | 18003/37963 [55:56:43<108:54:34, 19.64s/it]
 47%|████▋     | 18004/37963 [55:56:53<92:09:52, 16.62s/it] 
 47%|████▋     | 18005/37963 [55:57:03<81:30:41, 14.70s/it]
 47%|████▋     | 18006/37963 [55:57:13<73:55:38, 13.34s/it]
 47%|████▋     | 18007/37963 [55:57:23<68:41:28, 12.39s/it]
 47%|████▋     | 18008/37963 [55:57:33<64:44:21, 11.68s/it]
 47%|████▋     | 18009/37963 [55:57:50<72:21:57, 13.06s/it]
 47%|████▋     | 18010/37963 [55:58:06<77:48:38, 14.04s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '4.202', 'learning_rate': '1.131e-05', 'epoch': '0.4744'}

 47%|████▋     | 18010/37963 [55:58:06<77:48:38, 14.04s/it]
 47%|████▋     | 18011/37963 [55:58:16<71:10:47, 12.84s/it]
 47%|████▋     | 18012/37963 [55:58:26<66:46:23, 12.05s/it]
 47%|████▋     | 18013/37963 [55:58:36<63:30:21, 11.46s/it]
 47%|████▋     | 18014/37963 [55:58:47<61:17:16, 11.06s/it]
 47%|████▋     | 18015/37963 [55:58:57<59:33:07, 10.75s/it]
 47%|████▋     | 18016/37963 [55:59:06<58:00:22, 10.47s/it]
 47%|████▋     | 18017/37963 [55:59:17<57:28:36, 10.37s/it]
 47%|████▋     | 18018/37963 [55:59:27<57:05:46, 10.31s/it]
 47%|████▋     | 18019/37963 [55:59:37<56:50:45, 10.26s/it]
 47%|████▋     | 18020/37963 [55:59:54<68:24:56, 12.35s/it]
                                                           
{'loss': '0.1456', 'grad_norm': '3.06', 'learning_rate': '1.13e-05', 'epoch': '0.4747'}

 47%|████▋     | 18020/37963 [55:59:54<68:24:56, 12.35s/it]
 47%|████▋     | 18021/37963 [56:00:04<64:44:57, 11.69s/it]
 47%|████▋     | 18022/37963 [56:00:21<72:37:48, 13.11s/it]
 47%|████▋     | 18023/37963 [56:00:31<67:24:20, 12.17s/it]
 47%|████▋     | 18024/37963 [56:00:41<63:42:53, 11.50s/it]
 47%|████▋     | 18025/37963 [56:00:57<72:04:42, 13.01s/it]
 47%|████▋     | 18026/37963 [56:01:07<67:16:32, 12.15s/it]
 47%|████▋     | 18027/37963 [56:01:17<64:03:07, 11.57s/it]
 47%|████▋     | 18028/37963 [56:01:27<61:35:17, 11.12s/it]
 47%|████▋     | 18029/37963 [56:01:38<59:54:43, 10.82s/it]
 47%|████▋     | 18030/37963 [56:01:48<58:41:48, 10.60s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '1.495', 'learning_rate': '1.129e-05', 'epoch': '0.4749'}

 47%|████▋     | 18030/37963 [56:01:48<58:41:48, 10.60s/it]
 47%|████▋     | 18031/37963 [56:01:58<57:53:28, 10.46s/it]
 47%|████▋     | 18032/37963 [56:02:08<56:48:09, 10.26s/it]
 48%|████▊     | 18033/37963 [56:02:18<56:37:16, 10.23s/it]
 48%|████▊     | 18034/37963 [56:02:28<56:17:30, 10.17s/it]
 48%|████▊     | 18035/37963 [56:02:38<56:15:16, 10.16s/it]
 48%|████▊     | 18036/37963 [56:02:54<66:31:34, 12.02s/it]
 48%|████▊     | 18037/37963 [56:03:04<63:24:23, 11.46s/it]
 48%|████▊     | 18038/37963 [56:03:15<61:06:07, 11.04s/it]
 48%|████▊     | 18039/37963 [56:03:24<59:08:50, 10.69s/it]
 48%|████▊     | 18040/37963 [56:03:34<58:02:58, 10.49s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '0.9881', 'learning_rate': '1.129e-05', 'epoch': '0.4752'}

 48%|████▊     | 18040/37963 [56:03:34<58:02:58, 10.49s/it]
 48%|████▊     | 18041/37963 [56:03:45<57:55:07, 10.47s/it]
 48%|████▊     | 18042/37963 [56:03:55<57:15:52, 10.35s/it]
 48%|████▊     | 18043/37963 [56:04:05<56:54:16, 10.28s/it]
 48%|████▊     | 18044/37963 [56:04:15<56:48:10, 10.27s/it]
 48%|████▊     | 18045/37963 [56:04:25<56:27:47, 10.21s/it]
 48%|████▊     | 18046/37963 [56:04:43<68:06:19, 12.31s/it]
 48%|████▊     | 18047/37963 [56:04:53<64:21:38, 11.63s/it]
 48%|████▊     | 18048/37963 [56:05:03<61:40:28, 11.15s/it]
 48%|████▊     | 18049/37963 [56:05:13<59:41:17, 10.79s/it]
 48%|████▊     | 18050/37963 [56:05:29<68:29:27, 12.38s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '1.863', 'learning_rate': '1.128e-05', 'epoch': '0.4755'}

 48%|████▊     | 18050/37963 [56:05:29<68:29:27, 12.38s/it]
 48%|████▊     | 18051/37963 [56:05:39<64:42:03, 11.70s/it]
 48%|████▊     | 18052/37963 [56:05:49<62:04:08, 11.22s/it]
 48%|████▊     | 18053/37963 [56:05:59<60:10:20, 10.88s/it]
 48%|████▊     | 18054/37963 [56:06:09<58:48:52, 10.64s/it]
 48%|████▊     | 18055/37963 [56:06:19<58:13:43, 10.53s/it]
 48%|████▊     | 18056/37963 [56:06:29<57:03:52, 10.32s/it]
 48%|████▊     | 18057/37963 [56:06:39<56:05:24, 10.14s/it]
 48%|████▊     | 18058/37963 [56:06:55<66:32:17, 12.03s/it]
 48%|████▊     | 18059/37963 [56:07:05<63:19:27, 11.45s/it]
 48%|████▊     | 18060/37963 [56:07:22<71:37:27, 12.96s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '2.875', 'learning_rate': '1.127e-05', 'epoch': '0.4757'}

 48%|████▊     | 18060/37963 [56:07:22<71:37:27, 12.96s/it]
 48%|████▊     | 18061/37963 [56:07:32<66:48:35, 12.08s/it]
 48%|████▊     | 18062/37963 [56:07:42<63:29:46, 11.49s/it]
 48%|████▊     | 18063/37963 [56:07:52<61:07:45, 11.06s/it]
 48%|████▊     | 18064/37963 [56:08:02<59:34:23, 10.78s/it]
 48%|████▊     | 18065/37963 [56:08:12<58:23:05, 10.56s/it]
 48%|████▊     | 18066/37963 [56:08:22<57:35:51, 10.42s/it]
 48%|████▊     | 18067/37963 [56:08:32<57:00:04, 10.31s/it]
 48%|████▊     | 18068/37963 [56:08:49<68:08:31, 12.33s/it]
 48%|████▊     | 18069/37963 [56:08:59<64:08:24, 11.61s/it]
 48%|████▊     | 18070/37963 [56:09:16<72:19:36, 13.09s/it]
                                                           
{'loss': '0.1376', 'grad_norm': '1.214', 'learning_rate': '1.126e-05', 'epoch': '0.476'}

 48%|████▊     | 18070/37963 [56:09:16<72:19:36, 13.09s/it]
 48%|████▊     | 18071/37963 [56:09:26<67:31:00, 12.22s/it]
 48%|████▊     | 18072/37963 [56:09:36<64:02:11, 11.59s/it]
 48%|████▊     | 18073/37963 [56:09:46<60:57:57, 11.03s/it]
 48%|████▊     | 18074/37963 [56:09:56<59:13:31, 10.72s/it]
 48%|████▊     | 18075/37963 [56:10:13<68:55:40, 12.48s/it]
 48%|████▊     | 18076/37963 [56:10:23<64:55:23, 11.75s/it]
 48%|████▊     | 18077/37963 [56:10:33<62:12:50, 11.26s/it]
 48%|████▊     | 18078/37963 [56:10:42<59:13:07, 10.72s/it]
 48%|████▊     | 18079/37963 [56:10:52<58:09:53, 10.53s/it]
 48%|████▊     | 18080/37963 [56:11:02<56:42:27, 10.27s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '2.416', 'learning_rate': '1.125e-05', 'epoch': '0.4763'}

 48%|████▊     | 18080/37963 [56:11:02<56:42:27, 10.27s/it]
 48%|████▊     | 18081/37963 [56:11:12<56:24:52, 10.21s/it]
 48%|████▊     | 18082/37963 [56:11:22<56:11:43, 10.18s/it]
 48%|████▊     | 18083/37963 [56:11:32<56:04:13, 10.15s/it]
 48%|████▊     | 18084/37963 [56:11:49<66:33:02, 12.05s/it]
 48%|████▊     | 18085/37963 [56:11:59<63:06:16, 11.43s/it]
 48%|████▊     | 18086/37963 [56:12:09<60:46:38, 11.01s/it]
 48%|████▊     | 18087/37963 [56:12:19<59:24:37, 10.76s/it]
 48%|████▊     | 18088/37963 [56:12:29<58:21:11, 10.57s/it]
 48%|████▊     | 18089/37963 [56:12:39<57:38:04, 10.44s/it]
 48%|████▊     | 18090/37963 [56:12:49<57:04:16, 10.34s/it]
                                                           
{'loss': '0.1483', 'grad_norm': '2.919', 'learning_rate': '1.124e-05', 'epoch': '0.4765'}

 48%|████▊     | 18090/37963 [56:12:49<57:04:16, 10.34s/it]
 48%|████▊     | 18091/37963 [56:12:59<56:52:43, 10.30s/it]
 48%|████▊     | 18092/37963 [56:13:09<56:19:11, 10.20s/it]
 48%|████▊     | 18093/37963 [56:13:19<55:37:52, 10.08s/it]
 48%|████▊     | 18094/37963 [56:13:36<67:00:49, 12.14s/it]
 48%|████▊     | 18095/37963 [56:13:46<63:44:41, 11.55s/it]
 48%|████▊     | 18096/37963 [56:13:56<60:44:15, 11.01s/it]
 48%|████▊     | 18097/37963 [56:14:12<69:21:04, 12.57s/it]
 48%|████▊     | 18098/37963 [56:14:22<65:27:25, 11.86s/it]
 48%|████▊     | 18099/37963 [56:14:32<62:22:46, 11.31s/it]
 48%|████▊     | 18100/37963 [56:14:43<60:17:32, 10.93s/it]
                                                           
{'loss': '0.154', 'grad_norm': '1.552', 'learning_rate': '1.124e-05', 'epoch': '0.4768'}

 48%|████▊     | 18100/37963 [56:14:43<60:17:32, 10.93s/it]
 48%|████▊     | 18101/37963 [56:14:53<58:47:36, 10.66s/it]
 48%|████▊     | 18102/37963 [56:15:02<56:50:30, 10.30s/it]
 48%|████▊     | 18103/37963 [56:15:12<56:27:31, 10.23s/it]
 48%|████▊     | 18104/37963 [56:15:22<56:13:36, 10.19s/it]
 48%|████▊     | 18105/37963 [56:15:32<56:11:32, 10.19s/it]
 48%|████▊     | 18106/37963 [56:15:49<66:08:56, 11.99s/it]
 48%|████▊     | 18107/37963 [56:16:05<72:54:12, 13.22s/it]
 48%|████▊     | 18108/37963 [56:16:15<67:44:26, 12.28s/it]
 48%|████▊     | 18109/37963 [56:16:25<63:57:14, 11.60s/it]
 48%|████▊     | 18110/37963 [56:16:35<61:22:27, 11.13s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '2.365', 'learning_rate': '1.123e-05', 'epoch': '0.477'}

 48%|████▊     | 18110/37963 [56:16:35<61:22:27, 11.13s/it]
 48%|████▊     | 18111/37963 [56:16:45<59:38:57, 10.82s/it]
 48%|████▊     | 18112/37963 [56:16:55<58:19:39, 10.58s/it]
 48%|████▊     | 18113/37963 [56:17:05<57:08:23, 10.36s/it]
 48%|████▊     | 18114/37963 [56:17:15<56:40:47, 10.28s/it]
 48%|████▊     | 18115/37963 [56:17:25<56:26:56, 10.24s/it]
 48%|████▊     | 18116/37963 [56:17:35<56:03:39, 10.17s/it]
 48%|████▊     | 18117/37963 [56:17:52<66:33:35, 12.07s/it]
 48%|████▊     | 18118/37963 [56:18:02<63:32:58, 11.53s/it]
 48%|████▊     | 18119/37963 [56:18:12<61:12:08, 11.10s/it]
 48%|████▊     | 18120/37963 [56:18:22<59:33:40, 10.81s/it]
                                                           
{'loss': '0.1507', 'grad_norm': '1.174', 'learning_rate': '1.122e-05', 'epoch': '0.4773'}

 48%|████▊     | 18120/37963 [56:18:22<59:33:40, 10.81s/it]
 48%|████▊     | 18121/37963 [56:18:32<58:22:50, 10.59s/it]
 48%|████▊     | 18122/37963 [56:18:42<57:40:54, 10.47s/it]
 48%|████▊     | 18123/37963 [56:18:52<57:04:37, 10.36s/it]
 48%|████▊     | 18124/37963 [56:19:02<56:25:10, 10.24s/it]
 48%|████▊     | 18125/37963 [56:19:19<67:10:43, 12.19s/it]
 48%|████▊     | 18126/37963 [56:19:29<63:43:37, 11.57s/it]
 48%|████▊     | 18127/37963 [56:19:39<60:56:14, 11.06s/it]
 48%|████▊     | 18128/37963 [56:19:49<58:37:56, 10.64s/it]
 48%|████▊     | 18129/37963 [56:19:59<57:41:34, 10.47s/it]
 48%|████▊     | 18130/37963 [56:20:09<57:00:23, 10.35s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '1.772', 'learning_rate': '1.121e-05', 'epoch': '0.4776'}

 48%|████▊     | 18130/37963 [56:20:09<57:00:23, 10.35s/it]
 48%|████▊     | 18131/37963 [56:20:18<55:37:25, 10.10s/it]
 48%|████▊     | 18132/37963 [56:20:35<66:09:35, 12.01s/it]
 48%|████▊     | 18133/37963 [56:20:45<62:57:33, 11.43s/it]
 48%|████▊     | 18134/37963 [56:20:55<60:46:51, 11.03s/it]
 48%|████▊     | 18135/37963 [56:21:05<59:12:46, 10.75s/it]
 48%|████▊     | 18136/37963 [56:21:15<58:04:07, 10.54s/it]
 48%|████▊     | 18137/37963 [56:21:25<57:17:05, 10.40s/it]
 48%|████▊     | 18138/37963 [56:21:35<56:42:25, 10.30s/it]
 48%|████▊     | 18139/37963 [56:21:45<56:29:27, 10.26s/it]
 48%|████▊     | 18140/37963 [56:21:56<56:07:20, 10.19s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '3.782', 'learning_rate': '1.12e-05', 'epoch': '0.4778'}

 48%|████▊     | 18140/37963 [56:21:56<56:07:20, 10.19s/it]
 48%|████▊     | 18141/37963 [56:22:05<54:54:59,  9.97s/it]
 48%|████▊     | 18142/37963 [56:22:22<66:37:28, 12.10s/it]
 48%|████▊     | 18143/37963 [56:22:32<63:21:19, 11.51s/it]
 48%|████▊     | 18144/37963 [56:22:48<70:51:22, 12.87s/it]
 48%|████▊     | 18145/37963 [56:22:58<66:21:14, 12.05s/it]
 48%|████▊     | 18146/37963 [56:23:08<63:02:05, 11.45s/it]
 48%|████▊     | 18147/37963 [56:23:18<60:38:21, 11.02s/it]
 48%|████▊     | 18148/37963 [56:23:28<59:06:03, 10.74s/it]
 48%|████▊     | 18149/37963 [56:23:38<57:45:57, 10.50s/it]
 48%|████▊     | 18150/37963 [56:23:49<57:10:43, 10.39s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '1.661', 'learning_rate': '1.119e-05', 'epoch': '0.4781'}

 48%|████▊     | 18150/37963 [56:23:49<57:10:43, 10.39s/it]
 48%|████▊     | 18151/37963 [56:23:58<56:14:47, 10.22s/it]
 48%|████▊     | 18152/37963 [56:24:08<56:00:51, 10.18s/it]
 48%|████▊     | 18153/37963 [56:24:18<55:29:04, 10.08s/it]
 48%|████▊     | 18154/37963 [56:24:35<65:58:53, 11.99s/it]
 48%|████▊     | 18155/37963 [56:24:45<62:46:43, 11.41s/it]
 48%|████▊     | 18156/37963 [56:25:01<70:59:21, 12.90s/it]
 48%|████▊     | 18157/37963 [56:25:11<66:28:14, 12.08s/it]
 48%|████▊     | 18158/37963 [56:25:22<63:18:22, 11.51s/it]
 48%|████▊     | 18159/37963 [56:25:32<60:57:07, 11.08s/it]
 48%|████▊     | 18160/37963 [56:25:42<59:28:06, 10.81s/it]
                                                           
{'loss': '0.1357', 'grad_norm': '1.453', 'learning_rate': '1.118e-05', 'epoch': '0.4784'}

 48%|████▊     | 18160/37963 [56:25:42<59:28:06, 10.81s/it]
 48%|████▊     | 18161/37963 [56:25:52<58:15:29, 10.59s/it]
 48%|████▊     | 18162/37963 [56:26:02<57:25:12, 10.44s/it]
 48%|████▊     | 18163/37963 [56:26:12<56:46:04, 10.32s/it]
 48%|████▊     | 18164/37963 [56:26:22<56:09:13, 10.21s/it]
 48%|████▊     | 18165/37963 [56:26:46<78:15:08, 14.23s/it]
 48%|████▊     | 18166/37963 [56:26:56<71:32:36, 13.01s/it]
 48%|████▊     | 18167/37963 [56:27:06<66:46:03, 12.14s/it]
 48%|████▊     | 18168/37963 [56:27:16<63:26:36, 11.54s/it]
 48%|████▊     | 18169/37963 [56:27:26<61:18:57, 11.15s/it]
 48%|████▊     | 18170/37963 [56:27:36<59:20:23, 10.79s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '1.763', 'learning_rate': '1.118e-05', 'epoch': '0.4786'}

 48%|████▊     | 18170/37963 [56:27:36<59:20:23, 10.79s/it]
 48%|████▊     | 18171/37963 [56:27:46<58:12:09, 10.59s/it]
 48%|████▊     | 18172/37963 [56:28:03<67:43:43, 12.32s/it]
 48%|████▊     | 18173/37963 [56:28:13<63:57:39, 11.64s/it]
 48%|████▊     | 18174/37963 [56:28:23<61:22:25, 11.17s/it]
 48%|████▊     | 18175/37963 [56:28:33<59:42:23, 10.86s/it]
 48%|████▊     | 18176/37963 [56:28:43<58:28:37, 10.64s/it]
 48%|████▊     | 18177/37963 [56:28:53<57:16:28, 10.42s/it]
 48%|████▊     | 18178/37963 [56:29:03<56:36:20, 10.30s/it]
 48%|████▊     | 18179/37963 [56:29:13<56:18:30, 10.25s/it]
 48%|████▊     | 18180/37963 [56:29:30<66:47:47, 12.16s/it]
                                                           
{'loss': '0.1401', 'grad_norm': '1.568', 'learning_rate': '1.117e-05', 'epoch': '0.4789'}

 48%|████▊     | 18180/37963 [56:29:30<66:47:47, 12.16s/it]
 48%|████▊     | 18181/37963 [56:29:40<63:11:40, 11.50s/it]
 48%|████▊     | 18182/37963 [56:29:50<60:47:14, 11.06s/it]
 48%|████▊     | 18183/37963 [56:30:00<59:08:49, 10.76s/it]
 48%|████▊     | 18184/37963 [56:30:10<57:49:56, 10.53s/it]
 48%|████▊     | 18185/37963 [56:30:20<57:11:28, 10.41s/it]
 48%|████▊     | 18186/37963 [56:30:30<56:36:33, 10.30s/it]
 48%|████▊     | 18187/37963 [56:30:40<56:10:45, 10.23s/it]
 48%|████▊     | 18188/37963 [56:30:50<55:23:10, 10.08s/it]
 48%|████▊     | 18189/37963 [56:31:00<55:27:07, 10.10s/it]
 48%|████▊     | 18190/37963 [56:31:17<66:53:36, 12.18s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '2.054', 'learning_rate': '1.116e-05', 'epoch': '0.4792'}

 48%|████▊     | 18190/37963 [56:31:17<66:53:36, 12.18s/it]
 48%|████▊     | 18191/37963 [56:31:27<63:36:36, 11.58s/it]
 48%|████▊     | 18192/37963 [56:31:37<61:09:32, 11.14s/it]
 48%|████▊     | 18193/37963 [56:31:54<70:28:59, 12.83s/it]
 48%|████▊     | 18194/37963 [56:32:04<66:03:29, 12.03s/it]
 48%|████▊     | 18195/37963 [56:32:14<62:51:18, 11.45s/it]
 48%|████▊     | 18196/37963 [56:32:24<60:44:27, 11.06s/it]
 48%|████▊     | 18197/37963 [56:32:35<59:11:22, 10.78s/it]
 48%|████▊     | 18198/37963 [56:32:45<58:13:00, 10.60s/it]
 48%|████▊     | 18199/37963 [56:32:55<57:09:46, 10.41s/it]
 48%|████▊     | 18200/37963 [56:33:05<56:40:14, 10.32s/it]
                                                           
{'loss': '0.1494', 'grad_norm': '3.882', 'learning_rate': '1.115e-05', 'epoch': '0.4794'}

 48%|████▊     | 18200/37963 [56:33:05<56:40:14, 10.32s/it]
 48%|████▊     | 18201/37963 [56:33:15<56:19:47, 10.26s/it]
 48%|████▊     | 18202/37963 [56:33:25<56:01:08, 10.21s/it]
 48%|████▊     | 18203/37963 [56:33:42<66:31:40, 12.12s/it]
 48%|████▊     | 18204/37963 [56:33:52<63:13:02, 11.52s/it]
 48%|████▊     | 18205/37963 [56:34:02<60:53:28, 11.09s/it]
 48%|████▊     | 18206/37963 [56:34:18<69:32:52, 12.67s/it]
 48%|████▊     | 18207/37963 [56:34:28<65:23:48, 11.92s/it]
 48%|████▊     | 18208/37963 [56:34:38<62:21:22, 11.36s/it]
 48%|████▊     | 18209/37963 [56:34:49<60:24:21, 11.01s/it]
 48%|████▊     | 18210/37963 [56:34:58<58:16:09, 10.62s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '1.84', 'learning_rate': '1.114e-05', 'epoch': '0.4797'}

 48%|████▊     | 18210/37963 [56:34:58<58:16:09, 10.62s/it]
 48%|████▊     | 18211/37963 [56:35:08<57:22:26, 10.46s/it]
 48%|████▊     | 18212/37963 [56:35:18<56:05:35, 10.22s/it]
 48%|████▊     | 18213/37963 [56:35:42<78:24:39, 14.29s/it]
 48%|████▊     | 18214/37963 [56:35:52<71:37:14, 13.06s/it]
 48%|████▊     | 18215/37963 [56:36:02<66:29:02, 12.12s/it]
 48%|████▊     | 18216/37963 [56:36:12<63:03:31, 11.50s/it]
 48%|████▊     | 18217/37963 [56:36:22<60:30:01, 11.03s/it]
 48%|████▊     | 18218/37963 [56:36:32<58:48:14, 10.72s/it]
 48%|████▊     | 18219/37963 [56:36:42<57:49:03, 10.54s/it]
 48%|████▊     | 18220/37963 [56:36:58<67:20:42, 12.28s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '1.663', 'learning_rate': '1.113e-05', 'epoch': '0.4799'}

 48%|████▊     | 18220/37963 [56:36:58<67:20:42, 12.28s/it]
 48%|████▊     | 18221/37963 [56:37:08<63:10:44, 11.52s/it]
 48%|████▊     | 18222/37963 [56:37:18<60:52:08, 11.10s/it]
 48%|████▊     | 18223/37963 [56:37:28<59:16:41, 10.81s/it]
 48%|████▊     | 18224/37963 [56:37:38<57:16:22, 10.45s/it]
 48%|████▊     | 18225/37963 [56:37:48<56:14:07, 10.26s/it]
 48%|████▊     | 18226/37963 [56:37:58<55:55:40, 10.20s/it]
 48%|████▊     | 18227/37963 [56:38:08<55:40:14, 10.15s/it]
 48%|████▊     | 18228/37963 [56:38:18<55:32:10, 10.13s/it]
 48%|████▊     | 18229/37963 [56:38:34<65:24:06, 11.93s/it]
 48%|████▊     | 18230/37963 [56:38:44<61:46:29, 11.27s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '1.252', 'learning_rate': '1.113e-05', 'epoch': '0.4802'}

 48%|████▊     | 18230/37963 [56:38:44<61:46:29, 11.27s/it]
 48%|████▊     | 18231/37963 [56:38:54<59:45:47, 10.90s/it]
 48%|████▊     | 18232/37963 [56:39:04<58:29:57, 10.67s/it]
 48%|████▊     | 18233/37963 [56:39:14<57:28:55, 10.49s/it]
 48%|████▊     | 18234/37963 [56:39:24<56:42:49, 10.35s/it]
 48%|████▊     | 18235/37963 [56:39:33<54:59:17, 10.03s/it]
 48%|████▊     | 18236/37963 [56:39:44<55:12:37, 10.08s/it]
 48%|████▊     | 18237/37963 [56:39:54<55:00:39, 10.04s/it]
 48%|████▊     | 18238/37963 [56:40:10<66:21:16, 12.11s/it]
 48%|████▊     | 18239/37963 [56:40:20<62:50:11, 11.47s/it]
 48%|████▊     | 18240/37963 [56:40:30<60:30:36, 11.04s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '1.068', 'learning_rate': '1.112e-05', 'epoch': '0.4805'}

 48%|████▊     | 18240/37963 [56:40:30<60:30:36, 11.04s/it]
 48%|████▊     | 18241/37963 [56:40:47<69:19:05, 12.65s/it]
 48%|████▊     | 18242/37963 [56:40:57<65:23:54, 11.94s/it]
 48%|████▊     | 18243/37963 [56:41:07<62:20:04, 11.38s/it]
 48%|████▊     | 18244/37963 [56:41:17<60:11:25, 10.99s/it]
 48%|████▊     | 18245/37963 [56:41:27<58:47:14, 10.73s/it]
 48%|████▊     | 18246/37963 [56:41:38<57:46:50, 10.55s/it]
 48%|████▊     | 18247/37963 [56:41:48<57:07:04, 10.43s/it]
 48%|████▊     | 18248/37963 [56:41:58<56:11:54, 10.26s/it]
 48%|████▊     | 18249/37963 [56:42:08<55:38:26, 10.16s/it]
 48%|████▊     | 18250/37963 [56:42:18<55:38:58, 10.16s/it]
                                                           
{'loss': '0.141', 'grad_norm': '2.086', 'learning_rate': '1.111e-05', 'epoch': '0.4807'}

 48%|████▊     | 18250/37963 [56:42:18<55:38:58, 10.16s/it]
 48%|████▊     | 18251/37963 [56:42:34<66:08:09, 12.08s/it]
 48%|████▊     | 18252/37963 [56:42:44<62:56:25, 11.50s/it]
 48%|████▊     | 18253/37963 [56:42:54<60:40:43, 11.08s/it]
 48%|████▊     | 18254/37963 [56:43:10<68:32:59, 12.52s/it]
 48%|████▊     | 18255/37963 [56:43:20<64:14:47, 11.74s/it]
 48%|████▊     | 18256/37963 [56:43:30<61:29:55, 11.23s/it]
 48%|████▊     | 18257/37963 [56:43:40<59:01:39, 10.78s/it]
 48%|████▊     | 18258/37963 [56:43:50<57:38:46, 10.53s/it]
 48%|████▊     | 18259/37963 [56:44:00<56:47:22, 10.38s/it]
 48%|████▊     | 18260/37963 [56:44:17<67:44:03, 12.38s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '2.056', 'learning_rate': '1.11e-05', 'epoch': '0.481'}

 48%|████▊     | 18260/37963 [56:44:17<67:44:03, 12.38s/it]
 48%|████▊     | 18261/37963 [56:44:27<63:23:47, 11.58s/it]
 48%|████▊     | 18262/37963 [56:44:37<61:04:28, 11.16s/it]
 48%|████▊     | 18263/37963 [56:44:54<70:12:22, 12.83s/it]
 48%|████▊     | 18264/37963 [56:45:04<65:45:11, 12.02s/it]
 48%|████▊     | 18265/37963 [56:45:14<62:23:29, 11.40s/it]
 48%|████▊     | 18266/37963 [56:45:24<60:19:06, 11.02s/it]
 48%|████▊     | 18267/37963 [56:45:34<58:47:57, 10.75s/it]
 48%|████▊     | 18268/37963 [56:45:44<57:38:33, 10.54s/it]
 48%|████▊     | 18269/37963 [56:46:01<67:39:50, 12.37s/it]
 48%|████▊     | 18270/37963 [56:46:10<63:16:22, 11.57s/it]
                                                           
{'loss': '0.1493', 'grad_norm': '3.882', 'learning_rate': '1.109e-05', 'epoch': '0.4813'}

 48%|████▊     | 18270/37963 [56:46:10<63:16:22, 11.57s/it]
 48%|████▊     | 18271/37963 [56:46:20<60:50:19, 11.12s/it]
 48%|████▊     | 18272/37963 [56:46:31<59:11:08, 10.82s/it]
 48%|████▊     | 18273/37963 [56:46:40<57:34:00, 10.53s/it]
 48%|████▊     | 18274/37963 [56:46:50<56:39:12, 10.36s/it]
 48%|████▊     | 18275/37963 [56:47:01<56:11:59, 10.28s/it]
 48%|████▊     | 18276/37963 [56:47:10<55:12:06, 10.09s/it]
 48%|████▊     | 18277/37963 [56:47:27<66:08:51, 12.10s/it]
 48%|████▊     | 18278/37963 [56:47:37<62:41:30, 11.47s/it]
 48%|████▊     | 18279/37963 [56:47:47<59:55:02, 10.96s/it]
 48%|████▊     | 18280/37963 [56:47:57<58:11:14, 10.64s/it]
                                                           
{'loss': '0.1412', 'grad_norm': '1.526', 'learning_rate': '1.108e-05', 'epoch': '0.4815'}

 48%|████▊     | 18280/37963 [56:47:57<58:11:14, 10.64s/it]
 48%|████▊     | 18281/37963 [56:48:07<57:15:11, 10.47s/it]
 48%|████▊     | 18282/37963 [56:48:17<56:11:21, 10.28s/it]
 48%|████▊     | 18283/37963 [56:48:27<55:47:37, 10.21s/it]
 48%|████▊     | 18284/37963 [56:48:36<55:19:48, 10.12s/it]
 48%|████▊     | 18285/37963 [56:48:47<55:19:47, 10.12s/it]
 48%|████▊     | 18286/37963 [56:49:03<66:13:12, 12.12s/it]
 48%|████▊     | 18287/37963 [56:49:13<62:57:40, 11.52s/it]
 48%|████▊     | 18288/37963 [56:49:24<60:36:17, 11.09s/it]
 48%|████▊     | 18289/37963 [56:49:34<58:53:04, 10.77s/it]
 48%|████▊     | 18290/37963 [56:49:50<67:48:57, 12.41s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '1.967', 'learning_rate': '1.107e-05', 'epoch': '0.4818'}

 48%|████▊     | 18290/37963 [56:49:50<67:48:57, 12.41s/it]
 48%|████▊     | 18291/37963 [56:50:00<64:10:04, 11.74s/it]
 48%|████▊     | 18292/37963 [56:50:10<61:26:32, 11.24s/it]
 48%|████▊     | 18293/37963 [56:50:20<59:39:52, 10.92s/it]
 48%|████▊     | 18294/37963 [56:50:30<58:16:19, 10.67s/it]
 48%|████▊     | 18295/37963 [56:50:40<57:14:11, 10.48s/it]
 48%|████▊     | 18296/37963 [56:50:50<56:08:34, 10.28s/it]
 48%|████▊     | 18297/37963 [56:51:00<55:45:23, 10.21s/it]
 48%|████▊     | 18298/37963 [56:51:10<55:10:30, 10.10s/it]
 48%|████▊     | 18299/37963 [56:51:20<55:22:25, 10.14s/it]
 48%|████▊     | 18300/37963 [56:51:37<66:02:36, 12.09s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '1.425', 'learning_rate': '1.107e-05', 'epoch': '0.482'}

 48%|████▊     | 18300/37963 [56:51:37<66:02:36, 12.09s/it]
 48%|████▊     | 18301/37963 [56:51:47<62:42:53, 11.48s/it]
 48%|████▊     | 18302/37963 [56:51:57<59:41:00, 10.93s/it]
 48%|████▊     | 18303/37963 [56:52:07<57:59:23, 10.62s/it]
 48%|████▊     | 18304/37963 [56:52:23<66:48:02, 12.23s/it]
 48%|████▊     | 18305/37963 [56:52:32<63:01:23, 11.54s/it]
 48%|████▊     | 18306/37963 [56:52:43<60:40:50, 11.11s/it]
 48%|████▊     | 18307/37963 [56:52:53<59:02:01, 10.81s/it]
 48%|████▊     | 18308/37963 [56:53:09<68:18:23, 12.51s/it]
 48%|████▊     | 18309/37963 [56:53:19<64:12:01, 11.76s/it]
 48%|████▊     | 18310/37963 [56:53:29<61:27:58, 11.26s/it]
                                                           
{'loss': '0.1379', 'grad_norm': '1.22', 'learning_rate': '1.106e-05', 'epoch': '0.4823'}

 48%|████▊     | 18310/37963 [56:53:29<61:27:58, 11.26s/it]
 48%|████▊     | 18311/37963 [56:53:46<69:57:11, 12.81s/it]
 48%|████▊     | 18312/37963 [56:53:56<65:23:57, 11.98s/it]
 48%|████▊     | 18313/37963 [56:54:06<62:34:45, 11.46s/it]
 48%|████▊     | 18314/37963 [56:54:16<60:22:35, 11.06s/it]
 48%|████▊     | 18315/37963 [56:54:26<58:56:50, 10.80s/it]
 48%|████▊     | 18316/37963 [56:54:36<57:09:35, 10.47s/it]
 48%|████▊     | 18317/37963 [56:54:46<56:38:08, 10.38s/it]
 48%|████▊     | 18318/37963 [56:55:03<66:55:28, 12.26s/it]
 48%|████▊     | 18319/37963 [56:55:13<63:07:17, 11.57s/it]
 48%|████▊     | 18320/37963 [56:55:23<60:37:30, 11.11s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '0.7324', 'learning_rate': '1.105e-05', 'epoch': '0.4826'}

 48%|████▊     | 18320/37963 [56:55:23<60:37:30, 11.11s/it]
 48%|████▊     | 18321/37963 [56:55:33<58:56:47, 10.80s/it]
 48%|████▊     | 18322/37963 [56:55:43<57:45:09, 10.59s/it]
 48%|████▊     | 18323/37963 [56:55:53<57:05:33, 10.47s/it]
 48%|████▊     | 18324/37963 [56:56:03<56:31:33, 10.36s/it]
 48%|████▊     | 18325/37963 [56:56:20<66:32:21, 12.20s/it]
 48%|████▊     | 18326/37963 [56:56:29<62:19:48, 11.43s/it]
 48%|████▊     | 18327/37963 [56:56:40<60:07:50, 11.02s/it]
 48%|████▊     | 18328/37963 [56:56:50<58:32:20, 10.73s/it]
 48%|████▊     | 18329/37963 [56:57:00<57:18:53, 10.51s/it]
 48%|████▊     | 18330/37963 [56:57:10<56:36:21, 10.38s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '1.183', 'learning_rate': '1.104e-05', 'epoch': '0.4828'}

 48%|████▊     | 18330/37963 [56:57:10<56:36:21, 10.38s/it]
 48%|████▊     | 18331/37963 [56:57:20<56:13:48, 10.31s/it]
 48%|████▊     | 18332/37963 [56:57:30<56:06:42, 10.29s/it]
 48%|████▊     | 18333/37963 [56:57:46<66:07:51, 12.13s/it]
 48%|████▊     | 18334/37963 [56:57:56<62:34:49, 11.48s/it]
 48%|████▊     | 18335/37963 [56:58:07<60:20:38, 11.07s/it]
 48%|████▊     | 18336/37963 [56:58:17<58:40:24, 10.76s/it]
 48%|████▊     | 18337/37963 [56:58:26<57:05:25, 10.47s/it]
 48%|████▊     | 18338/37963 [56:58:42<66:05:40, 12.12s/it]
 48%|████▊     | 18339/37963 [56:58:53<62:53:47, 11.54s/it]
 48%|████▊     | 18340/37963 [56:59:02<60:12:53, 11.05s/it]
                                                           
{'loss': '0.1577', 'grad_norm': '1.297', 'learning_rate': '1.103e-05', 'epoch': '0.4831'}

 48%|████▊     | 18340/37963 [56:59:02<60:12:53, 11.05s/it]
 48%|████▊     | 18341/37963 [56:59:13<58:41:42, 10.77s/it]
 48%|████▊     | 18342/37963 [56:59:23<57:31:44, 10.56s/it]
 48%|████▊     | 18343/37963 [56:59:33<56:42:47, 10.41s/it]
 48%|████▊     | 18344/37963 [56:59:43<56:11:33, 10.31s/it]
 48%|████▊     | 18345/37963 [56:59:52<54:51:38, 10.07s/it]
 48%|████▊     | 18346/37963 [57:00:02<55:02:00, 10.10s/it]
 48%|████▊     | 18347/37963 [57:00:19<65:26:52, 12.01s/it]
 48%|████▊     | 18348/37963 [57:00:29<61:46:59, 11.34s/it]
 48%|████▊     | 18349/37963 [57:00:39<59:48:58, 10.98s/it]
 48%|████▊     | 18350/37963 [57:00:49<58:40:16, 10.77s/it]
                                                           
{'loss': '0.1535', 'grad_norm': '3.545', 'learning_rate': '1.102e-05', 'epoch': '0.4834'}

 48%|████▊     | 18350/37963 [57:00:49<58:40:16, 10.77s/it]
 48%|████▊     | 18351/37963 [57:00:59<57:40:52, 10.59s/it]
 48%|████▊     | 18352/37963 [57:01:15<66:09:40, 12.15s/it]
 48%|████▊     | 18353/37963 [57:01:25<62:51:21, 11.54s/it]
 48%|████▊     | 18354/37963 [57:01:35<60:32:14, 11.11s/it]
 48%|████▊     | 18355/37963 [57:01:45<58:44:19, 10.78s/it]
 48%|████▊     | 18356/37963 [57:02:02<68:49:07, 12.64s/it]
 48%|████▊     | 18357/37963 [57:02:12<64:12:38, 11.79s/it]
 48%|████▊     | 18358/37963 [57:02:22<61:47:22, 11.35s/it]
 48%|████▊     | 18359/37963 [57:02:32<59:47:55, 10.98s/it]
 48%|████▊     | 18360/37963 [57:02:43<58:18:24, 10.71s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '0.8084', 'learning_rate': '1.102e-05', 'epoch': '0.4836'}

 48%|████▊     | 18360/37963 [57:02:43<58:18:24, 10.71s/it]
 48%|████▊     | 18361/37963 [57:02:59<67:52:04, 12.46s/it]
 48%|████▊     | 18362/37963 [57:03:09<64:06:23, 11.77s/it]
 48%|████▊     | 18363/37963 [57:03:19<61:27:07, 11.29s/it]
 48%|████▊     | 18364/37963 [57:03:30<59:29:59, 10.93s/it]
 48%|████▊     | 18365/37963 [57:03:40<58:09:40, 10.68s/it]
 48%|████▊     | 18366/37963 [57:03:56<67:36:29, 12.42s/it]
 48%|████▊     | 18367/37963 [57:04:06<63:53:10, 11.74s/it]
 48%|████▊     | 18368/37963 [57:04:16<60:24:23, 11.10s/it]
 48%|████▊     | 18369/37963 [57:04:26<58:18:28, 10.71s/it]
 48%|████▊     | 18370/37963 [57:04:36<57:05:18, 10.49s/it]
                                                           
{'loss': '0.1328', 'grad_norm': '0.8712', 'learning_rate': '1.101e-05', 'epoch': '0.4839'}

 48%|████▊     | 18370/37963 [57:04:36<57:05:18, 10.49s/it]
 48%|████▊     | 18371/37963 [57:04:46<56:16:14, 10.34s/it]
 48%|████▊     | 18372/37963 [57:04:55<54:59:10, 10.10s/it]
 48%|████▊     | 18373/37963 [57:05:05<54:51:05, 10.08s/it]
 48%|████▊     | 18374/37963 [57:05:22<65:34:06, 12.05s/it]
 48%|████▊     | 18375/37963 [57:05:32<61:52:13, 11.37s/it]
 48%|████▊     | 18376/37963 [57:05:41<59:13:16, 10.88s/it]
 48%|████▊     | 18377/37963 [57:05:52<57:58:24, 10.66s/it]
 48%|████▊     | 18378/37963 [57:06:01<56:52:31, 10.45s/it]
 48%|████▊     | 18379/37963 [57:06:11<55:43:26, 10.24s/it]
 48%|████▊     | 18380/37963 [57:06:21<55:02:37, 10.12s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '1.78', 'learning_rate': '1.1e-05', 'epoch': '0.4842'}

 48%|████▊     | 18380/37963 [57:06:21<55:02:37, 10.12s/it]
 48%|████▊     | 18381/37963 [57:06:38<66:04:05, 12.15s/it]
 48%|████▊     | 18382/37963 [57:06:48<62:15:14, 11.45s/it]
 48%|████▊     | 18383/37963 [57:06:58<59:59:02, 11.03s/it]
 48%|████▊     | 18384/37963 [57:07:08<58:27:07, 10.75s/it]
 48%|████▊     | 18385/37963 [57:07:18<57:23:52, 10.55s/it]
 48%|████▊     | 18386/37963 [57:07:28<56:31:05, 10.39s/it]
 48%|████▊     | 18387/37963 [57:07:45<66:51:53, 12.30s/it]
 48%|████▊     | 18388/37963 [57:07:55<62:42:41, 11.53s/it]
 48%|████▊     | 18389/37963 [57:08:04<59:58:34, 11.03s/it]
 48%|████▊     | 18390/37963 [57:08:14<58:24:08, 10.74s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '2.284', 'learning_rate': '1.099e-05', 'epoch': '0.4844'}

 48%|████▊     | 18390/37963 [57:08:14<58:24:08, 10.74s/it]
 48%|████▊     | 18391/37963 [57:08:24<57:15:14, 10.53s/it]
 48%|████▊     | 18392/37963 [57:08:35<56:32:51, 10.40s/it]
 48%|████▊     | 18393/37963 [57:08:45<55:44:55, 10.26s/it]
 48%|████▊     | 18394/37963 [57:08:55<55:30:58, 10.21s/it]
 48%|████▊     | 18395/37963 [57:09:05<55:03:23, 10.13s/it]
 48%|████▊     | 18396/37963 [57:09:21<65:58:28, 12.14s/it]
 48%|████▊     | 18397/37963 [57:09:31<62:36:31, 11.52s/it]
 48%|████▊     | 18398/37963 [57:09:42<60:13:44, 11.08s/it]
 48%|████▊     | 18399/37963 [57:09:52<58:42:17, 10.80s/it]
 48%|████▊     | 18400/37963 [57:10:02<57:33:14, 10.59s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '2.603', 'learning_rate': '1.098e-05', 'epoch': '0.4847'}

 48%|████▊     | 18400/37963 [57:10:02<57:33:14, 10.59s/it]
 48%|████▊     | 18401/37963 [57:10:12<56:42:51, 10.44s/it]
 48%|████▊     | 18402/37963 [57:10:28<66:19:19, 12.21s/it]
 48%|████▊     | 18403/37963 [57:10:45<73:09:48, 13.47s/it]
 48%|████▊     | 18404/37963 [57:10:55<68:03:48, 12.53s/it]
 48%|████▊     | 18405/37963 [57:11:05<64:07:08, 11.80s/it]
 48%|████▊     | 18406/37963 [57:11:15<61:14:38, 11.27s/it]
 48%|████▊     | 18407/37963 [57:11:25<59:13:20, 10.90s/it]
 48%|████▊     | 18408/37963 [57:11:35<57:47:14, 10.64s/it]
 48%|████▊     | 18409/37963 [57:11:45<55:54:00, 10.29s/it]
 48%|████▊     | 18410/37963 [57:12:01<66:12:17, 12.19s/it]
                                                           
{'loss': '0.1443', 'grad_norm': '1.722', 'learning_rate': '1.097e-05', 'epoch': '0.4849'}

 48%|████▊     | 18410/37963 [57:12:01<66:12:17, 12.19s/it]
 48%|████▊     | 18411/37963 [57:12:11<62:51:55, 11.58s/it]
 48%|████▊     | 18412/37963 [57:12:22<60:31:03, 11.14s/it]
 49%|████▊     | 18413/37963 [57:12:32<58:48:01, 10.83s/it]
 49%|████▊     | 18414/37963 [57:12:42<57:36:26, 10.61s/it]
 49%|████▊     | 18415/37963 [57:12:51<56:11:08, 10.35s/it]
 49%|████▊     | 18416/37963 [57:13:08<66:40:02, 12.28s/it]
 49%|████▊     | 18417/37963 [57:13:18<62:43:24, 11.55s/it]
 49%|████▊     | 18418/37963 [57:13:28<60:24:43, 11.13s/it]
 49%|████▊     | 18419/37963 [57:13:38<58:23:04, 10.75s/it]
 49%|████▊     | 18420/37963 [57:13:48<56:31:54, 10.41s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '1.473', 'learning_rate': '1.096e-05', 'epoch': '0.4852'}

 49%|████▊     | 18420/37963 [57:13:48<56:31:54, 10.41s/it]
 49%|████▊     | 18421/37963 [57:13:58<55:57:32, 10.31s/it]
 49%|████▊     | 18422/37963 [57:14:08<55:41:20, 10.26s/it]
 49%|████▊     | 18423/37963 [57:14:25<65:59:12, 12.16s/it]
 49%|████▊     | 18424/37963 [57:14:35<62:39:32, 11.54s/it]
 49%|████▊     | 18425/37963 [57:14:44<59:45:12, 11.01s/it]
 49%|████▊     | 18426/37963 [57:14:54<58:11:46, 10.72s/it]
 49%|████▊     | 18427/37963 [57:15:04<56:51:55, 10.48s/it]
 49%|████▊     | 18428/37963 [57:15:14<55:48:31, 10.28s/it]
 49%|████▊     | 18429/37963 [57:15:24<55:28:05, 10.22s/it]
 49%|████▊     | 18430/37963 [57:15:34<55:17:41, 10.19s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '1.218', 'learning_rate': '1.096e-05', 'epoch': '0.4855'}

 49%|████▊     | 18430/37963 [57:15:34<55:17:41, 10.19s/it]
 49%|████▊     | 18431/37963 [57:15:51<65:55:19, 12.15s/it]
 49%|████▊     | 18432/37963 [57:16:01<62:32:08, 11.53s/it]
 49%|████▊     | 18433/37963 [57:16:11<60:18:43, 11.12s/it]
 49%|████▊     | 18434/37963 [57:16:28<68:42:07, 12.66s/it]
 49%|████▊     | 18435/37963 [57:16:38<64:24:52, 11.87s/it]
 49%|████▊     | 18436/37963 [57:16:48<61:36:42, 11.36s/it]
 49%|████▊     | 18437/37963 [57:16:58<59:29:32, 10.97s/it]
 49%|████▊     | 18438/37963 [57:17:08<58:00:12, 10.69s/it]
 49%|████▊     | 18439/37963 [57:17:18<57:11:05, 10.54s/it]
 49%|████▊     | 18440/37963 [57:17:28<56:20:02, 10.39s/it]
                                                           
{'loss': '0.1276', 'grad_norm': '3.013', 'learning_rate': '1.095e-05', 'epoch': '0.4857'}

 49%|████▊     | 18440/37963 [57:17:28<56:20:02, 10.39s/it]
 49%|████▊     | 18441/37963 [57:17:38<56:00:33, 10.33s/it]
 49%|████▊     | 18442/37963 [57:17:48<54:40:38, 10.08s/it]
 49%|████▊     | 18443/37963 [57:17:58<54:39:42, 10.08s/it]
 49%|████▊     | 18444/37963 [57:18:14<65:10:18, 12.02s/it]
 49%|████▊     | 18445/37963 [57:18:25<62:01:54, 11.44s/it]
 49%|████▊     | 18446/37963 [57:18:35<59:41:24, 11.01s/it]
 49%|████▊     | 18447/37963 [57:18:45<58:24:39, 10.77s/it]
 49%|████▊     | 18448/37963 [57:18:55<56:52:49, 10.49s/it]
 49%|████▊     | 18449/37963 [57:19:05<56:01:00, 10.33s/it]
 49%|████▊     | 18450/37963 [57:19:21<65:33:28, 12.09s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '0.8885', 'learning_rate': '1.094e-05', 'epoch': '0.486'}

 49%|████▊     | 18450/37963 [57:19:21<65:33:28, 12.09s/it]
 49%|████▊     | 18451/37963 [57:19:31<61:59:07, 11.44s/it]
 49%|████▊     | 18452/37963 [57:19:47<70:23:27, 12.99s/it]
 49%|████▊     | 18453/37963 [57:19:57<65:44:41, 12.13s/it]
 49%|████▊     | 18454/37963 [57:20:07<61:57:40, 11.43s/it]
 49%|████▊     | 18455/37963 [57:20:17<59:54:59, 11.06s/it]
 49%|████▊     | 18456/37963 [57:20:27<58:16:09, 10.75s/it]
 49%|████▊     | 18457/37963 [57:20:37<57:07:02, 10.54s/it]
 49%|████▊     | 18458/37963 [57:20:47<55:24:11, 10.23s/it]
 49%|████▊     | 18459/37963 [57:21:04<65:43:00, 12.13s/it]
 49%|████▊     | 18460/37963 [57:21:13<61:37:27, 11.38s/it]
                                                           
{'loss': '0.1378', 'grad_norm': '1.348', 'learning_rate': '1.093e-05', 'epoch': '0.4863'}

 49%|████▊     | 18460/37963 [57:21:13<61:37:27, 11.38s/it]
 49%|████▊     | 18461/37963 [57:21:23<59:28:57, 10.98s/it]
 49%|████▊     | 18462/37963 [57:21:33<57:52:24, 10.68s/it]
 49%|████▊     | 18463/37963 [57:21:43<56:48:43, 10.49s/it]
 49%|████▊     | 18464/37963 [57:21:53<56:10:08, 10.37s/it]
 49%|████▊     | 18465/37963 [57:22:10<66:41:48, 12.31s/it]
 49%|████▊     | 18466/37963 [57:22:20<62:38:05, 11.57s/it]
 49%|████▊     | 18467/37963 [57:22:30<59:17:00, 10.95s/it]
 49%|████▊     | 18468/37963 [57:22:40<57:46:10, 10.67s/it]
 49%|████▊     | 18469/37963 [57:22:49<56:35:08, 10.45s/it]
 49%|████▊     | 18470/37963 [57:23:00<55:56:46, 10.33s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '0.9062', 'learning_rate': '1.092e-05', 'epoch': '0.4865'}

 49%|████▊     | 18470/37963 [57:23:00<55:56:46, 10.33s/it]
 49%|████▊     | 18471/37963 [57:23:16<65:29:57, 12.10s/it]
 49%|████▊     | 18472/37963 [57:23:26<62:19:22, 11.51s/it]
 49%|████▊     | 18473/37963 [57:23:36<59:53:53, 11.06s/it]
 49%|████▊     | 18474/37963 [57:23:46<58:25:07, 10.79s/it]
 49%|████▊     | 18475/37963 [57:23:56<57:26:58, 10.61s/it]
 49%|████▊     | 18476/37963 [57:24:06<56:42:18, 10.48s/it]
 49%|████▊     | 18477/37963 [57:24:17<56:09:24, 10.37s/it]
 49%|████▊     | 18478/37963 [57:24:33<66:43:10, 12.33s/it]
 49%|████▊     | 18479/37963 [57:24:44<63:07:11, 11.66s/it]
 49%|████▊     | 18480/37963 [57:24:54<60:42:13, 11.22s/it]
                                                           
{'loss': '0.1587', 'grad_norm': '2.501', 'learning_rate': '1.091e-05', 'epoch': '0.4868'}

 49%|████▊     | 18480/37963 [57:24:54<60:42:13, 11.22s/it]
 49%|████▊     | 18481/37963 [57:25:04<58:58:44, 10.90s/it]
 49%|████▊     | 18482/37963 [57:25:14<57:54:24, 10.70s/it]
 49%|████▊     | 18483/37963 [57:25:24<56:44:38, 10.49s/it]
 49%|████▊     | 18484/37963 [57:25:41<66:37:33, 12.31s/it]
 49%|████▊     | 18485/37963 [57:25:50<62:32:32, 11.56s/it]
 49%|████▊     | 18486/37963 [57:26:01<60:11:58, 11.13s/it]
 49%|████▊     | 18487/37963 [57:26:11<58:35:46, 10.83s/it]
 49%|████▊     | 18488/37963 [57:26:21<57:16:00, 10.59s/it]
 49%|████▊     | 18489/37963 [57:26:31<56:13:52, 10.40s/it]
 49%|████▊     | 18490/37963 [57:26:40<54:56:34, 10.16s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '1.348', 'learning_rate': '1.09e-05', 'epoch': '0.4871'}

 49%|████▊     | 18490/37963 [57:26:40<54:56:34, 10.16s/it]
 49%|████▊     | 18491/37963 [57:26:50<54:48:23, 10.13s/it]
 49%|████▊     | 18492/37963 [57:27:01<54:47:44, 10.13s/it]
 49%|████▊     | 18493/37963 [57:27:17<64:42:31, 11.96s/it]
 49%|████▊     | 18494/37963 [57:27:27<61:52:06, 11.44s/it]
 49%|████▊     | 18495/37963 [57:27:37<59:38:09, 11.03s/it]
 49%|████▊     | 18496/37963 [57:27:47<57:21:28, 10.61s/it]
 49%|████▊     | 18497/37963 [57:27:57<56:30:39, 10.45s/it]
 49%|████▊     | 18498/37963 [57:28:07<55:57:13, 10.35s/it]
 49%|████▊     | 18499/37963 [57:28:31<77:37:09, 14.36s/it]
 49%|████▊     | 18500/37963 [57:28:41<70:29:47, 13.04s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '3.42', 'learning_rate': '1.09e-05', 'epoch': '0.4873'}

 49%|████▊     | 18500/37963 [57:28:41<70:29:47, 13.04s/it]
 49%|████▊     | 18501/37963 [57:28:51<65:39:39, 12.15s/it]
 49%|████▊     | 18502/37963 [57:29:01<62:11:43, 11.51s/it]
 49%|████▊     | 18503/37963 [57:29:11<59:41:37, 11.04s/it]
 49%|████▊     | 18504/37963 [57:29:21<58:13:30, 10.77s/it]
 49%|████▊     | 18505/37963 [57:29:31<57:08:33, 10.57s/it]
 49%|████▊     | 18506/37963 [57:29:47<66:56:42, 12.39s/it]
 49%|████▉     | 18507/37963 [57:29:57<62:46:08, 11.61s/it]
 49%|████▉     | 18508/37963 [57:30:07<59:34:00, 11.02s/it]
 49%|████▉     | 18509/37963 [57:30:17<57:52:01, 10.71s/it]
 49%|████▉     | 18510/37963 [57:30:27<56:30:03, 10.46s/it]
                                                           
{'loss': '0.1428', 'grad_norm': '0.8679', 'learning_rate': '1.089e-05', 'epoch': '0.4876'}

 49%|████▉     | 18510/37963 [57:30:27<56:30:03, 10.46s/it]
 49%|████▉     | 18511/37963 [57:30:37<55:41:38, 10.31s/it]
 49%|████▉     | 18512/37963 [57:30:47<55:29:28, 10.27s/it]
 49%|████▉     | 18513/37963 [57:30:57<55:13:35, 10.22s/it]
 49%|████▉     | 18514/37963 [57:31:14<65:31:46, 12.13s/it]
 49%|████▉     | 18515/37963 [57:31:24<62:15:30, 11.52s/it]
 49%|████▉     | 18516/37963 [57:31:34<59:53:48, 11.09s/it]
 49%|████▉     | 18517/37963 [57:31:44<58:22:01, 10.81s/it]
 49%|████▉     | 18518/37963 [57:31:54<57:13:14, 10.59s/it]
 49%|████▉     | 18519/37963 [57:32:04<56:22:48, 10.44s/it]
 49%|████▉     | 18520/37963 [57:32:21<66:51:43, 12.38s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '0.872', 'learning_rate': '1.088e-05', 'epoch': '0.4878'}

 49%|████▉     | 18520/37963 [57:32:21<66:51:43, 12.38s/it]
 49%|████▉     | 18521/37963 [57:32:31<63:10:37, 11.70s/it]
 49%|████▉     | 18522/37963 [57:32:41<59:30:51, 11.02s/it]
 49%|████▉     | 18523/37963 [57:32:51<58:08:27, 10.77s/it]
 49%|████▉     | 18524/37963 [57:33:01<56:37:40, 10.49s/it]
 49%|████▉     | 18525/37963 [57:33:11<56:00:17, 10.37s/it]
 49%|████▉     | 18526/37963 [57:33:28<66:55:19, 12.39s/it]
 49%|████▉     | 18527/37963 [57:33:38<63:08:42, 11.70s/it]
 49%|████▉     | 18528/37963 [57:33:48<60:30:54, 11.21s/it]
 49%|████▉     | 18529/37963 [57:33:58<58:38:39, 10.86s/it]
 49%|████▉     | 18530/37963 [57:34:08<57:28:44, 10.65s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '1.001', 'learning_rate': '1.087e-05', 'epoch': '0.4881'}

 49%|████▉     | 18530/37963 [57:34:08<57:28:44, 10.65s/it]
 49%|████▉     | 18531/37963 [57:34:24<66:41:37, 12.36s/it]
 49%|████▉     | 18532/37963 [57:34:35<63:01:28, 11.68s/it]
 49%|████▉     | 18533/37963 [57:34:44<60:16:07, 11.17s/it]
 49%|████▉     | 18534/37963 [57:34:55<58:42:49, 10.88s/it]
 49%|████▉     | 18535/37963 [57:35:05<57:30:02, 10.65s/it]
 49%|████▉     | 18536/37963 [57:35:15<56:42:13, 10.51s/it]
 49%|████▉     | 18537/37963 [57:35:25<55:59:16, 10.38s/it]
 49%|████▉     | 18538/37963 [57:35:35<55:28:36, 10.28s/it]
 49%|████▉     | 18539/37963 [57:35:45<55:10:42, 10.23s/it]
 49%|████▉     | 18540/37963 [57:36:01<64:36:01, 11.97s/it]
                                                           
{'loss': '0.1408', 'grad_norm': '1.261', 'learning_rate': '1.086e-05', 'epoch': '0.4884'}

 49%|████▉     | 18540/37963 [57:36:01<64:36:01, 11.97s/it]
 49%|████▉     | 18541/37963 [57:36:11<61:33:48, 11.41s/it]
 49%|████▉     | 18542/37963 [57:36:21<59:09:13, 10.97s/it]
 49%|████▉     | 18543/37963 [57:36:31<57:44:15, 10.70s/it]
 49%|████▉     | 18544/37963 [57:36:41<56:38:44, 10.50s/it]
 49%|████▉     | 18545/37963 [57:36:51<55:24:24, 10.27s/it]
 49%|████▉     | 18546/37963 [57:37:01<55:14:57, 10.24s/it]
 49%|████▉     | 18547/37963 [57:37:18<65:42:26, 12.18s/it]
 49%|████▉     | 18548/37963 [57:37:35<72:57:23, 13.53s/it]
 49%|████▉     | 18549/37963 [57:37:45<67:25:36, 12.50s/it]
 49%|████▉     | 18550/37963 [57:37:55<63:28:39, 11.77s/it]
                                                           
{'loss': '0.152', 'grad_norm': '2.972', 'learning_rate': '1.085e-05', 'epoch': '0.4886'}

 49%|████▉     | 18550/37963 [57:37:55<63:28:39, 11.77s/it]
 49%|████▉     | 18551/37963 [57:38:05<60:45:50, 11.27s/it]
 49%|████▉     | 18552/37963 [57:38:15<58:47:37, 10.90s/it]
 49%|████▉     | 18553/37963 [57:38:25<57:28:10, 10.66s/it]
 49%|████▉     | 18554/37963 [57:38:35<56:34:27, 10.49s/it]
 49%|████▉     | 18555/37963 [57:38:45<56:11:41, 10.42s/it]
 49%|████▉     | 18556/37963 [57:39:02<65:21:41, 12.12s/it]
 49%|████▉     | 18557/37963 [57:39:12<61:59:45, 11.50s/it]
 49%|████▉     | 18558/37963 [57:39:22<59:53:52, 11.11s/it]
 49%|████▉     | 18559/37963 [57:39:32<57:55:34, 10.75s/it]
 49%|████▉     | 18560/37963 [57:39:42<56:52:27, 10.55s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '4.103', 'learning_rate': '1.085e-05', 'epoch': '0.4889'}

 49%|████▉     | 18560/37963 [57:39:42<56:52:27, 10.55s/it]
 49%|████▉     | 18561/37963 [57:39:52<56:21:34, 10.46s/it]
 49%|████▉     | 18562/37963 [57:40:02<55:44:41, 10.34s/it]
 49%|████▉     | 18563/37963 [57:40:19<65:36:38, 12.18s/it]
 49%|████▉     | 18564/37963 [57:40:29<62:15:19, 11.55s/it]
 49%|████▉     | 18565/37963 [57:40:39<59:54:13, 11.12s/it]
 49%|████▉     | 18566/37963 [57:40:49<57:43:39, 10.71s/it]
 49%|████▉     | 18567/37963 [57:40:59<56:38:25, 10.51s/it]
 49%|████▉     | 18568/37963 [57:41:15<66:21:35, 12.32s/it]
 49%|████▉     | 18569/37963 [57:41:25<62:47:32, 11.66s/it]
 49%|████▉     | 18570/37963 [57:41:35<59:51:28, 11.11s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '2', 'learning_rate': '1.084e-05', 'epoch': '0.4892'}

 49%|████▉     | 18570/37963 [57:41:35<59:51:28, 11.11s/it]
 49%|████▉     | 18571/37963 [57:41:45<58:35:08, 10.88s/it]
 49%|████▉     | 18572/37963 [57:41:55<57:13:35, 10.62s/it]
 49%|████▉     | 18573/37963 [57:42:05<55:43:50, 10.35s/it]
 49%|████▉     | 18574/37963 [57:42:22<66:35:46, 12.37s/it]
 49%|████▉     | 18575/37963 [57:42:32<62:25:17, 11.59s/it]
 49%|████▉     | 18576/37963 [57:42:42<59:37:32, 11.07s/it]
 49%|████▉     | 18577/37963 [57:42:52<58:15:18, 10.82s/it]
 49%|████▉     | 18578/37963 [57:43:02<56:29:41, 10.49s/it]
 49%|████▉     | 18579/37963 [57:43:19<66:35:36, 12.37s/it]
 49%|████▉     | 18580/37963 [57:43:29<63:07:31, 11.72s/it]
                                                           
{'loss': '0.1395', 'grad_norm': '1.269', 'learning_rate': '1.083e-05', 'epoch': '0.4894'}

 49%|████▉     | 18580/37963 [57:43:29<63:07:31, 11.72s/it]
 49%|████▉     | 18581/37963 [57:43:39<60:01:44, 11.15s/it]
 49%|████▉     | 18582/37963 [57:43:49<58:08:36, 10.80s/it]
 49%|████▉     | 18583/37963 [57:43:59<56:45:21, 10.54s/it]
 49%|████▉     | 18584/37963 [57:44:09<56:00:27, 10.40s/it]
 49%|████▉     | 18585/37963 [57:44:19<55:30:33, 10.31s/it]
 49%|████▉     | 18586/37963 [57:44:29<55:10:51, 10.25s/it]
 49%|████▉     | 18587/37963 [57:44:39<54:58:01, 10.21s/it]
 49%|████▉     | 18588/37963 [57:44:49<54:50:10, 10.19s/it]
 49%|████▉     | 18589/37963 [57:44:59<54:48:03, 10.18s/it]
 49%|████▉     | 18590/37963 [57:45:16<64:46:54, 12.04s/it]
                                                           
{'loss': '0.15', 'grad_norm': '1.547', 'learning_rate': '1.082e-05', 'epoch': '0.4897'}

 49%|████▉     | 18590/37963 [57:45:16<64:46:54, 12.04s/it]
 49%|████▉     | 18591/37963 [57:45:26<61:41:39, 11.46s/it]
 49%|████▉     | 18592/37963 [57:45:36<59:14:35, 11.01s/it]
 49%|████▉     | 18593/37963 [57:45:45<57:10:05, 10.62s/it]
 49%|████▉     | 18594/37963 [57:45:56<56:21:35, 10.48s/it]
 49%|████▉     | 18595/37963 [57:46:12<65:52:43, 12.25s/it]
 49%|████▉     | 18596/37963 [57:46:28<72:44:40, 13.52s/it]
 49%|████▉     | 18597/37963 [57:46:39<67:16:16, 12.51s/it]
 49%|████▉     | 18598/37963 [57:46:49<63:13:48, 11.75s/it]
 49%|████▉     | 18599/37963 [57:46:58<60:08:19, 11.18s/it]
 49%|████▉     | 18600/37963 [57:47:08<58:17:43, 10.84s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '1.407', 'learning_rate': '1.081e-05', 'epoch': '0.49'}

 49%|████▉     | 18600/37963 [57:47:08<58:17:43, 10.84s/it]
 49%|████▉     | 18601/37963 [57:47:19<57:05:10, 10.61s/it]
 49%|████▉     | 18602/37963 [57:47:29<56:16:16, 10.46s/it]
 49%|████▉     | 18603/37963 [57:47:45<66:20:44, 12.34s/it]
 49%|████▉     | 18604/37963 [57:47:55<62:42:57, 11.66s/it]
 49%|████▉     | 18605/37963 [57:48:05<59:56:11, 11.15s/it]
 49%|████▉     | 18606/37963 [57:48:15<58:03:21, 10.80s/it]
 49%|████▉     | 18607/37963 [57:48:25<56:58:25, 10.60s/it]
 49%|████▉     | 18608/37963 [57:48:36<56:17:14, 10.47s/it]
 49%|████▉     | 18609/37963 [57:48:46<55:17:28, 10.28s/it]
 49%|████▉     | 18610/37963 [57:49:02<65:32:44, 12.19s/it]
                                                           
{'loss': '0.15', 'grad_norm': '1.76', 'learning_rate': '1.08e-05', 'epoch': '0.4902'}

 49%|████▉     | 18610/37963 [57:49:02<65:32:44, 12.19s/it]
 49%|████▉     | 18611/37963 [57:49:12<62:08:06, 11.56s/it]
 49%|████▉     | 18612/37963 [57:49:22<59:42:18, 11.11s/it]
 49%|████▉     | 18613/37963 [57:49:32<57:40:38, 10.73s/it]
 49%|████▉     | 18614/37963 [57:49:49<66:48:15, 12.43s/it]
 49%|████▉     | 18615/37963 [57:49:58<62:44:58, 11.68s/it]
 49%|████▉     | 18616/37963 [57:50:08<59:30:27, 11.07s/it]
 49%|████▉     | 18617/37963 [57:50:18<57:50:16, 10.76s/it]
 49%|████▉     | 18618/37963 [57:50:28<56:39:59, 10.55s/it]
 49%|████▉     | 18619/37963 [57:50:38<55:59:23, 10.42s/it]
 49%|████▉     | 18620/37963 [57:50:48<54:31:34, 10.15s/it]
                                                           
{'loss': '0.1511', 'grad_norm': '2.903', 'learning_rate': '1.079e-05', 'epoch': '0.4905'}

 49%|████▉     | 18620/37963 [57:50:48<54:31:34, 10.15s/it]
 49%|████▉     | 18621/37963 [57:51:05<65:47:52, 12.25s/it]
 49%|████▉     | 18622/37963 [57:51:15<62:23:50, 11.61s/it]
 49%|████▉     | 18623/37963 [57:51:25<59:45:12, 11.12s/it]
 49%|████▉     | 18624/37963 [57:51:35<58:23:44, 10.87s/it]
 49%|████▉     | 18625/37963 [57:51:46<57:13:57, 10.65s/it]
 49%|████▉     | 18626/37963 [57:51:55<55:36:52, 10.35s/it]
 49%|████▉     | 18627/37963 [57:52:12<65:26:08, 12.18s/it]
 49%|████▉     | 18628/37963 [57:52:21<61:39:28, 11.48s/it]
 49%|████▉     | 18629/37963 [57:52:32<59:46:43, 11.13s/it]
 49%|████▉     | 18630/37963 [57:52:42<58:00:26, 10.80s/it]
                                                           
{'loss': '0.1377', 'grad_norm': '0.6163', 'learning_rate': '1.079e-05', 'epoch': '0.4907'}

 49%|████▉     | 18630/37963 [57:52:42<58:00:26, 10.80s/it]
 49%|████▉     | 18631/37963 [57:52:52<56:52:47, 10.59s/it]
 49%|████▉     | 18632/37963 [57:53:02<55:58:55, 10.43s/it]
 49%|████▉     | 18633/37963 [57:53:12<55:27:48, 10.33s/it]
 49%|████▉     | 18634/37963 [57:53:22<55:02:51, 10.25s/it]
 49%|████▉     | 18635/37963 [57:53:32<54:39:21, 10.18s/it]
 49%|████▉     | 18636/37963 [57:53:42<54:25:59, 10.14s/it]
 49%|████▉     | 18637/37963 [57:53:59<64:38:09, 12.04s/it]
 49%|████▉     | 18638/37963 [57:54:09<61:31:18, 11.46s/it]
 49%|████▉     | 18639/37963 [57:54:19<58:57:50, 10.98s/it]
 49%|████▉     | 18640/37963 [57:54:29<58:02:40, 10.81s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '0.8836', 'learning_rate': '1.078e-05', 'epoch': '0.491'}

 49%|████▉     | 18640/37963 [57:54:29<58:02:40, 10.81s/it]
 49%|████▉     | 18641/37963 [57:54:39<57:00:00, 10.62s/it]
 49%|████▉     | 18642/37963 [57:54:56<67:01:21, 12.49s/it]
 49%|████▉     | 18643/37963 [57:55:06<63:16:09, 11.79s/it]
 49%|████▉     | 18644/37963 [57:55:23<71:47:26, 13.38s/it]
 49%|████▉     | 18645/37963 [57:55:33<66:25:48, 12.38s/it]
 49%|████▉     | 18646/37963 [57:55:44<62:54:39, 11.72s/it]
 49%|████▉     | 18647/37963 [57:55:53<59:59:32, 11.18s/it]
 49%|████▉     | 18648/37963 [57:56:03<57:49:46, 10.78s/it]
 49%|████▉     | 18649/37963 [57:56:13<56:39:51, 10.56s/it]
 49%|████▉     | 18650/37963 [57:56:23<55:51:15, 10.41s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '1.791', 'learning_rate': '1.077e-05', 'epoch': '0.4913'}

 49%|████▉     | 18650/37963 [57:56:23<55:51:15, 10.41s/it]
 49%|████▉     | 18651/37963 [57:56:40<65:23:00, 12.19s/it]
 49%|████▉     | 18652/37963 [57:56:50<61:50:10, 11.53s/it]
 49%|████▉     | 18653/37963 [57:57:00<59:26:20, 11.08s/it]
 49%|████▉     | 18654/37963 [57:57:10<57:13:10, 10.67s/it]
 49%|████▉     | 18655/37963 [57:57:20<56:20:56, 10.51s/it]
 49%|████▉     | 18656/37963 [57:57:30<55:44:36, 10.39s/it]
 49%|████▉     | 18657/37963 [57:57:40<55:12:08, 10.29s/it]
 49%|████▉     | 18658/37963 [57:57:57<65:27:58, 12.21s/it]
 49%|████▉     | 18659/37963 [57:58:07<62:07:27, 11.59s/it]
 49%|████▉     | 18660/37963 [57:58:17<59:41:32, 11.13s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '1.18', 'learning_rate': '1.076e-05', 'epoch': '0.4915'}

 49%|████▉     | 18660/37963 [57:58:17<59:41:32, 11.13s/it]
 49%|████▉     | 18661/37963 [57:58:27<58:11:59, 10.85s/it]
 49%|████▉     | 18662/37963 [57:58:37<56:52:48, 10.61s/it]
 49%|████▉     | 18663/37963 [57:58:54<66:31:19, 12.41s/it]
 49%|████▉     | 18664/37963 [57:59:04<62:47:34, 11.71s/it]
 49%|████▉     | 18665/37963 [57:59:14<60:13:04, 11.23s/it]
 49%|████▉     | 18666/37963 [57:59:24<58:26:47, 10.90s/it]
 49%|████▉     | 18667/37963 [57:59:34<57:05:21, 10.65s/it]
 49%|████▉     | 18668/37963 [57:59:44<56:06:45, 10.47s/it]
 49%|████▉     | 18669/37963 [57:59:54<55:23:02, 10.33s/it]
 49%|████▉     | 18670/37963 [58:00:11<66:10:18, 12.35s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '2.437', 'learning_rate': '1.075e-05', 'epoch': '0.4918'}

 49%|████▉     | 18670/37963 [58:00:11<66:10:18, 12.35s/it]
 49%|████▉     | 18671/37963 [58:00:21<62:36:40, 11.68s/it]
 49%|████▉     | 18672/37963 [58:00:31<60:03:10, 11.21s/it]
 49%|████▉     | 18673/37963 [58:00:41<57:50:45, 10.80s/it]
 49%|████▉     | 18674/37963 [58:00:51<56:51:53, 10.61s/it]
 49%|████▉     | 18675/37963 [58:01:07<65:33:39, 12.24s/it]
 49%|████▉     | 18676/37963 [58:01:17<62:05:42, 11.59s/it]
 49%|████▉     | 18677/37963 [58:01:28<59:39:37, 11.14s/it]
 49%|████▉     | 18678/37963 [58:01:38<58:02:18, 10.83s/it]
 49%|████▉     | 18679/37963 [58:01:48<56:47:47, 10.60s/it]
 49%|████▉     | 18680/37963 [58:01:58<55:59:20, 10.45s/it]
                                                           
{'loss': '0.1503', 'grad_norm': '3.562', 'learning_rate': '1.074e-05', 'epoch': '0.4921'}

 49%|████▉     | 18680/37963 [58:01:58<55:59:20, 10.45s/it]
 49%|████▉     | 18681/37963 [58:02:08<55:01:09, 10.27s/it]
 49%|████▉     | 18682/37963 [58:02:18<54:50:42, 10.24s/it]
 49%|████▉     | 18683/37963 [58:02:28<54:36:14, 10.20s/it]
 49%|████▉     | 18684/37963 [58:02:44<64:37:40, 12.07s/it]
 49%|████▉     | 18685/37963 [58:02:55<61:40:07, 11.52s/it]
 49%|████▉     | 18686/37963 [58:03:05<59:22:46, 11.09s/it]
 49%|████▉     | 18687/37963 [58:03:15<57:50:38, 10.80s/it]
 49%|████▉     | 18688/37963 [58:03:25<56:41:00, 10.59s/it]
 49%|████▉     | 18689/37963 [58:03:41<66:11:40, 12.36s/it]
 49%|████▉     | 18690/37963 [58:03:52<62:36:33, 11.69s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '1.21', 'learning_rate': '1.073e-05', 'epoch': '0.4923'}

 49%|████▉     | 18690/37963 [58:03:52<62:36:33, 11.69s/it]
 49%|████▉     | 18691/37963 [58:04:02<60:03:47, 11.22s/it]
 49%|████▉     | 18692/37963 [58:04:18<69:03:55, 12.90s/it]
 49%|████▉     | 18693/37963 [58:04:28<64:18:36, 12.01s/it]
 49%|████▉     | 18694/37963 [58:04:38<60:46:23, 11.35s/it]
 49%|████▉     | 18695/37963 [58:04:48<58:44:25, 10.97s/it]
 49%|████▉     | 18696/37963 [58:04:58<57:09:01, 10.68s/it]
 49%|████▉     | 18697/37963 [58:05:08<55:49:53, 10.43s/it]
 49%|████▉     | 18698/37963 [58:05:25<65:27:29, 12.23s/it]
 49%|████▉     | 18699/37963 [58:05:35<61:59:41, 11.59s/it]
 49%|████▉     | 18700/37963 [58:05:45<59:41:31, 11.16s/it]
                                                           
{'loss': '0.144', 'grad_norm': '0.8816', 'learning_rate': '1.073e-05', 'epoch': '0.4926'}

 49%|████▉     | 18700/37963 [58:05:45<59:41:31, 11.16s/it]
 49%|████▉     | 18701/37963 [58:05:54<57:14:26, 10.70s/it]
 49%|████▉     | 18702/37963 [58:06:04<55:49:07, 10.43s/it]
 49%|████▉     | 18703/37963 [58:06:14<54:40:30, 10.22s/it]
 49%|████▉     | 18704/37963 [58:06:24<54:32:09, 10.19s/it]
 49%|████▉     | 18705/37963 [58:06:34<54:20:04, 10.16s/it]
 49%|████▉     | 18706/37963 [58:06:44<53:36:57, 10.02s/it]
 49%|████▉     | 18707/37963 [58:07:00<64:04:49, 11.98s/it]
 49%|████▉     | 18708/37963 [58:07:11<61:16:31, 11.46s/it]
 49%|████▉     | 18709/37963 [58:07:21<58:58:16, 11.03s/it]
 49%|████▉     | 18710/37963 [58:07:31<57:26:04, 10.74s/it]
                                                           
{'loss': '0.1374', 'grad_norm': '1.638', 'learning_rate': '1.072e-05', 'epoch': '0.4928'}

 49%|████▉     | 18710/37963 [58:07:31<57:26:04, 10.74s/it]
 49%|████▉     | 18711/37963 [58:07:47<66:38:24, 12.46s/it]
 49%|████▉     | 18712/37963 [58:07:57<62:40:52, 11.72s/it]
 49%|████▉     | 18713/37963 [58:08:07<59:56:41, 11.21s/it]
 49%|████▉     | 18714/37963 [58:08:17<58:00:40, 10.85s/it]
 49%|████▉     | 18715/37963 [58:08:27<56:25:33, 10.55s/it]
 49%|████▉     | 18716/37963 [58:08:37<54:53:09, 10.27s/it]
 49%|████▉     | 18717/37963 [58:08:47<54:54:02, 10.27s/it]
 49%|████▉     | 18718/37963 [58:09:03<64:49:10, 12.13s/it]
 49%|████▉     | 18719/37963 [58:09:14<61:34:35, 11.52s/it]
 49%|████▉     | 18720/37963 [58:09:24<59:14:07, 11.08s/it]
                                                           
{'loss': '0.1429', 'grad_norm': '2.619', 'learning_rate': '1.071e-05', 'epoch': '0.4931'}

 49%|████▉     | 18720/37963 [58:09:24<59:14:07, 11.08s/it]
 49%|████▉     | 18721/37963 [58:09:34<57:41:50, 10.79s/it]
 49%|████▉     | 18722/37963 [58:09:44<56:35:00, 10.59s/it]
 49%|████▉     | 18723/37963 [58:10:00<66:10:42, 12.38s/it]
 49%|████▉     | 18724/37963 [58:10:10<62:24:16, 11.68s/it]
 49%|████▉     | 18725/37963 [58:10:21<59:49:46, 11.20s/it]
 49%|████▉     | 18726/37963 [58:10:31<57:56:30, 10.84s/it]
 49%|████▉     | 18727/37963 [58:10:41<56:42:45, 10.61s/it]
 49%|████▉     | 18728/37963 [58:10:50<55:21:32, 10.36s/it]
 49%|████▉     | 18729/37963 [58:11:00<54:41:48, 10.24s/it]
 49%|████▉     | 18730/37963 [58:11:10<54:24:13, 10.18s/it]
                                                           
{'loss': '0.1439', 'grad_norm': '3.85', 'learning_rate': '1.07e-05', 'epoch': '0.4934'}

 49%|████▉     | 18730/37963 [58:11:10<54:24:13, 10.18s/it]
 49%|████▉     | 18731/37963 [58:11:27<64:14:31, 12.03s/it]
 49%|████▉     | 18732/37963 [58:11:37<61:01:45, 11.42s/it]
 49%|████▉     | 18733/37963 [58:11:47<58:55:57, 11.03s/it]
 49%|████▉     | 18734/37963 [58:11:57<56:52:12, 10.65s/it]
 49%|████▉     | 18735/37963 [58:12:06<55:37:27, 10.41s/it]
 49%|████▉     | 18736/37963 [58:12:17<55:13:28, 10.34s/it]
 49%|████▉     | 18737/37963 [58:12:33<64:32:06, 12.08s/it]
 49%|████▉     | 18738/37963 [58:12:43<61:17:13, 11.48s/it]
 49%|████▉     | 18739/37963 [58:13:00<69:54:57, 13.09s/it]
 49%|████▉     | 18740/37963 [58:13:10<65:00:31, 12.17s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '2.046', 'learning_rate': '1.069e-05', 'epoch': '0.4936'}

 49%|████▉     | 18740/37963 [58:13:10<65:00:31, 12.17s/it]
 49%|████▉     | 18741/37963 [58:13:20<61:34:44, 11.53s/it]
 49%|████▉     | 18742/37963 [58:13:30<59:06:24, 11.07s/it]
 49%|████▉     | 18743/37963 [58:13:40<57:35:07, 10.79s/it]
 49%|████▉     | 18744/37963 [58:13:50<56:35:39, 10.60s/it]
 49%|████▉     | 18745/37963 [58:14:00<55:43:22, 10.44s/it]
 49%|████▉     | 18746/37963 [58:14:10<55:12:29, 10.34s/it]
 49%|████▉     | 18747/37963 [58:14:27<64:59:40, 12.18s/it]
 49%|████▉     | 18748/37963 [58:14:37<61:39:16, 11.55s/it]
 49%|████▉     | 18749/37963 [58:14:47<59:04:06, 11.07s/it]
 49%|████▉     | 18750/37963 [58:14:57<57:25:38, 10.76s/it]
                                                           
{'loss': '0.1415', 'grad_norm': '1.061', 'learning_rate': '1.068e-05', 'epoch': '0.4939'}

 49%|████▉     | 18750/37963 [58:14:57<57:25:38, 10.76s/it]
 49%|████▉     | 18751/37963 [58:15:07<56:21:39, 10.56s/it]
 49%|████▉     | 18752/37963 [58:15:17<55:12:58, 10.35s/it]
 49%|████▉     | 18753/37963 [58:15:27<54:55:24, 10.29s/it]
 49%|████▉     | 18754/37963 [58:15:36<53:40:30, 10.06s/it]
 49%|████▉     | 18755/37963 [58:15:53<63:49:57, 11.96s/it]
 49%|████▉     | 18756/37963 [58:16:03<61:09:02, 11.46s/it]
 49%|████▉     | 18757/37963 [58:16:13<58:58:48, 11.06s/it]
 49%|████▉     | 18758/37963 [58:16:23<57:38:09, 10.80s/it]
 49%|████▉     | 18759/37963 [58:16:40<66:25:29, 12.45s/it]
 49%|████▉     | 18760/37963 [58:16:50<62:37:47, 11.74s/it]
                                                           
{'loss': '0.1545', 'grad_norm': '1.65', 'learning_rate': '1.068e-05', 'epoch': '0.4942'}

 49%|████▉     | 18760/37963 [58:16:50<62:37:47, 11.74s/it]
 49%|████▉     | 18761/37963 [58:17:00<60:10:27, 11.28s/it]
 49%|████▉     | 18762/37963 [58:17:10<57:40:53, 10.81s/it]
 49%|████▉     | 18763/37963 [58:17:20<56:27:56, 10.59s/it]
 49%|████▉     | 18764/37963 [58:17:30<55:43:35, 10.45s/it]
 49%|████▉     | 18765/37963 [58:17:40<54:45:38, 10.27s/it]
 49%|████▉     | 18766/37963 [58:17:49<53:46:48, 10.09s/it]
 49%|████▉     | 18767/37963 [58:18:07<64:55:53, 12.18s/it]
 49%|████▉     | 18768/37963 [58:18:17<61:33:24, 11.54s/it]
 49%|████▉     | 18769/37963 [58:18:33<69:16:23, 12.99s/it]
 49%|████▉     | 18770/37963 [58:18:43<64:50:23, 12.16s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '2.775', 'learning_rate': '1.067e-05', 'epoch': '0.4944'}

 49%|████▉     | 18770/37963 [58:18:43<64:50:23, 12.16s/it]
 49%|████▉     | 18771/37963 [58:18:53<61:33:52, 11.55s/it]
 49%|████▉     | 18772/37963 [58:19:04<59:29:03, 11.16s/it]
 49%|████▉     | 18773/37963 [58:19:14<57:57:57, 10.87s/it]
 49%|████▉     | 18774/37963 [58:19:24<56:54:29, 10.68s/it]
 49%|████▉     | 18775/37963 [58:19:34<56:11:56, 10.54s/it]
 49%|████▉     | 18776/37963 [58:19:44<55:23:27, 10.39s/it]
 49%|████▉     | 18777/37963 [58:19:55<55:12:01, 10.36s/it]
 49%|████▉     | 18778/37963 [58:20:05<54:52:21, 10.30s/it]
 49%|████▉     | 18779/37963 [58:20:21<64:51:45, 12.17s/it]
 49%|████▉     | 18780/37963 [58:20:31<61:38:40, 11.57s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '2.591', 'learning_rate': '1.066e-05', 'epoch': '0.4947'}

 49%|████▉     | 18780/37963 [58:20:31<61:38:40, 11.57s/it]
 49%|████▉     | 18781/37963 [58:20:42<59:39:59, 11.20s/it]
 49%|████▉     | 18782/37963 [58:20:52<57:56:46, 10.88s/it]
 49%|████▉     | 18783/37963 [58:21:02<56:04:06, 10.52s/it]
 49%|████▉     | 18784/37963 [58:21:18<65:27:13, 12.29s/it]
 49%|████▉     | 18785/37963 [58:21:28<61:58:19, 11.63s/it]
 49%|████▉     | 18786/37963 [58:21:38<59:29:17, 11.17s/it]
 49%|████▉     | 18787/37963 [58:21:48<57:32:51, 10.80s/it]
 49%|████▉     | 18788/37963 [58:21:58<56:27:09, 10.60s/it]
 49%|████▉     | 18789/37963 [58:22:08<55:19:10, 10.39s/it]
 49%|████▉     | 18790/37963 [58:22:25<65:38:59, 12.33s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '1.941', 'learning_rate': '1.065e-05', 'epoch': '0.495'}

 49%|████▉     | 18790/37963 [58:22:25<65:38:59, 12.33s/it]
 49%|████▉     | 18791/37963 [58:22:35<61:56:24, 11.63s/it]
 50%|████▉     | 18792/37963 [58:22:45<59:13:19, 11.12s/it]
 50%|████▉     | 18793/37963 [58:22:55<57:33:01, 10.81s/it]
 50%|████▉     | 18794/37963 [58:23:04<55:22:30, 10.40s/it]
 50%|████▉     | 18795/37963 [58:23:21<65:33:23, 12.31s/it]
 50%|████▉     | 18796/37963 [58:23:31<62:06:15, 11.66s/it]
 50%|████▉     | 18797/37963 [58:23:41<59:21:31, 11.15s/it]
 50%|████▉     | 18798/37963 [58:23:51<57:33:56, 10.81s/it]
 50%|████▉     | 18799/37963 [58:24:01<56:32:22, 10.62s/it]
 50%|████▉     | 18800/37963 [58:24:11<55:28:26, 10.42s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '0.9572', 'learning_rate': '1.064e-05', 'epoch': '0.4952'}

 50%|████▉     | 18800/37963 [58:24:11<55:28:26, 10.42s/it]
 50%|████▉     | 18801/37963 [58:24:22<55:03:44, 10.34s/it]
 50%|████▉     | 18802/37963 [58:24:31<54:19:31, 10.21s/it]
 50%|████▉     | 18803/37963 [58:24:42<54:01:58, 10.15s/it]
 50%|████▉     | 18804/37963 [58:24:52<53:53:11, 10.13s/it]
 50%|████▉     | 18805/37963 [58:25:08<64:21:44, 12.09s/it]
 50%|████▉     | 18806/37963 [58:25:18<61:17:23, 11.52s/it]
 50%|████▉     | 18807/37963 [58:25:35<69:45:37, 13.11s/it]
 50%|████▉     | 18808/37963 [58:25:45<65:02:32, 12.22s/it]
 50%|████▉     | 18809/37963 [58:25:55<61:32:19, 11.57s/it]
 50%|████▉     | 18810/37963 [58:26:05<58:59:32, 11.09s/it]
                                                           
{'loss': '0.1576', 'grad_norm': '1.835', 'learning_rate': '1.063e-05', 'epoch': '0.4955'}

 50%|████▉     | 18810/37963 [58:26:05<58:59:32, 11.09s/it]
 50%|████▉     | 18811/37963 [58:26:16<57:32:49, 10.82s/it]
 50%|████▉     | 18812/37963 [58:26:25<55:51:58, 10.50s/it]
 50%|████▉     | 18813/37963 [58:26:35<55:04:57, 10.35s/it]
 50%|████▉     | 18814/37963 [58:26:45<54:40:35, 10.28s/it]
 50%|████▉     | 18815/37963 [58:27:02<65:16:22, 12.27s/it]
 50%|████▉     | 18816/37963 [58:27:13<62:00:11, 11.66s/it]
 50%|████▉     | 18817/37963 [58:27:29<69:14:28, 13.02s/it]
 50%|████▉     | 18818/37963 [58:27:39<64:05:48, 12.05s/it]
 50%|████▉     | 18819/37963 [58:27:49<61:06:29, 11.49s/it]
 50%|████▉     | 18820/37963 [58:27:59<58:55:07, 11.08s/it]
                                                           
{'loss': '0.1582', 'grad_norm': '1.723', 'learning_rate': '1.062e-05', 'epoch': '0.4957'}

 50%|████▉     | 18820/37963 [58:27:59<58:55:07, 11.08s/it]
 50%|████▉     | 18821/37963 [58:28:09<57:19:15, 10.78s/it]
 50%|████▉     | 18822/37963 [58:28:19<56:12:37, 10.57s/it]
 50%|████▉     | 18823/37963 [58:28:29<55:23:37, 10.42s/it]
 50%|████▉     | 18824/37963 [58:28:39<54:12:11, 10.20s/it]
 50%|████▉     | 18825/37963 [58:28:49<53:58:10, 10.15s/it]
 50%|████▉     | 18826/37963 [58:28:59<53:38:48, 10.09s/it]
 50%|████▉     | 18827/37963 [58:29:15<63:26:05, 11.93s/it]
 50%|████▉     | 18828/37963 [58:29:25<60:30:11, 11.38s/it]
 50%|████▉     | 18829/37963 [58:29:35<58:33:47, 11.02s/it]
 50%|████▉     | 18830/37963 [58:29:45<56:45:48, 10.68s/it]
                                                           
{'loss': '0.1435', 'grad_norm': '5.517', 'learning_rate': '1.062e-05', 'epoch': '0.496'}

 50%|████▉     | 18830/37963 [58:29:45<56:45:48, 10.68s/it]
 50%|████▉     | 18831/37963 [58:29:55<55:44:32, 10.49s/it]
 50%|████▉     | 18832/37963 [58:30:12<65:32:05, 12.33s/it]
 50%|████▉     | 18833/37963 [58:30:22<61:56:48, 11.66s/it]
 50%|████▉     | 18834/37963 [58:30:32<59:11:11, 11.14s/it]
 50%|████▉     | 18835/37963 [58:30:49<67:56:21, 12.79s/it]
 50%|████▉     | 18836/37963 [58:30:59<63:44:50, 12.00s/it]
 50%|████▉     | 18837/37963 [58:31:09<60:44:54, 11.43s/it]
 50%|████▉     | 18838/37963 [58:31:19<58:38:14, 11.04s/it]
 50%|████▉     | 18839/37963 [58:31:29<56:36:30, 10.66s/it]
 50%|████▉     | 18840/37963 [58:31:39<55:42:02, 10.49s/it]
                                                           
{'loss': '0.1503', 'grad_norm': '1.278', 'learning_rate': '1.061e-05', 'epoch': '0.4963'}

 50%|████▉     | 18840/37963 [58:31:39<55:42:02, 10.49s/it]
 50%|████▉     | 18841/37963 [58:31:49<55:03:48, 10.37s/it]
 50%|████▉     | 18842/37963 [58:31:59<54:41:00, 10.30s/it]
 50%|████▉     | 18843/37963 [58:32:09<54:03:21, 10.18s/it]
 50%|████▉     | 18844/37963 [58:32:19<53:49:36, 10.14s/it]
 50%|████▉     | 18845/37963 [58:32:36<64:18:49, 12.11s/it]
 50%|████▉     | 18846/37963 [58:32:46<61:16:12, 11.54s/it]
 50%|████▉     | 18847/37963 [58:32:56<59:02:28, 11.12s/it]
 50%|████▉     | 18848/37963 [58:33:06<57:31:01, 10.83s/it]
 50%|████▉     | 18849/37963 [58:33:16<56:14:00, 10.59s/it]
 50%|████▉     | 18850/37963 [58:33:26<54:55:38, 10.35s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '2.302', 'learning_rate': '1.06e-05', 'epoch': '0.4965'}

 50%|████▉     | 18850/37963 [58:33:26<54:55:38, 10.35s/it]
 50%|████▉     | 18851/37963 [58:33:36<54:29:12, 10.26s/it]
 50%|████▉     | 18852/37963 [58:33:46<54:09:48, 10.20s/it]
 50%|████▉     | 18853/37963 [58:33:56<53:36:12, 10.10s/it]
 50%|████▉     | 18854/37963 [58:34:13<63:57:30, 12.05s/it]
 50%|████▉     | 18855/37963 [58:34:29<70:58:33, 13.37s/it]
 50%|████▉     | 18856/37963 [58:34:39<65:44:56, 12.39s/it]
 50%|████▉     | 18857/37963 [58:34:49<62:06:41, 11.70s/it]
 50%|████▉     | 18858/37963 [58:34:59<59:27:11, 11.20s/it]
 50%|████▉     | 18859/37963 [58:35:09<57:43:14, 10.88s/it]
 50%|████▉     | 18860/37963 [58:35:20<56:42:34, 10.69s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '1.34', 'learning_rate': '1.059e-05', 'epoch': '0.4968'}

 50%|████▉     | 18860/37963 [58:35:20<56:42:34, 10.69s/it]
 50%|████▉     | 18861/37963 [58:35:30<55:32:41, 10.47s/it]
 50%|████▉     | 18862/37963 [58:35:40<54:44:28, 10.32s/it]
 50%|████▉     | 18863/37963 [58:35:56<65:19:14, 12.31s/it]
 50%|████▉     | 18864/37963 [58:36:07<61:56:43, 11.68s/it]
 50%|████▉     | 18865/37963 [58:36:23<69:48:01, 13.16s/it]
 50%|████▉     | 18866/37963 [58:36:33<64:29:28, 12.16s/it]
 50%|████▉     | 18867/37963 [58:36:43<61:15:55, 11.55s/it]
 50%|████▉     | 18868/37963 [58:36:53<59:02:22, 11.13s/it]
 50%|████▉     | 18869/37963 [58:37:03<57:17:30, 10.80s/it]
 50%|████▉     | 18870/37963 [58:37:14<56:17:25, 10.61s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '3.299', 'learning_rate': '1.058e-05', 'epoch': '0.4971'}

 50%|████▉     | 18870/37963 [58:37:14<56:17:25, 10.61s/it]
 50%|████▉     | 18871/37963 [58:37:23<55:06:50, 10.39s/it]
 50%|████▉     | 18872/37963 [58:37:33<53:57:15, 10.17s/it]
 50%|████▉     | 18873/37963 [58:37:43<53:50:24, 10.15s/it]
 50%|████▉     | 18874/37963 [58:37:53<53:37:24, 10.11s/it]
 50%|████▉     | 18875/37963 [58:38:03<53:33:31, 10.10s/it]
 50%|████▉     | 18876/37963 [58:38:20<63:48:10, 12.03s/it]
 50%|████▉     | 18877/37963 [58:38:30<60:42:02, 11.45s/it]
 50%|████▉     | 18878/37963 [58:38:40<58:48:36, 11.09s/it]
 50%|████▉     | 18879/37963 [58:38:50<57:13:32, 10.80s/it]
 50%|████▉     | 18880/37963 [58:39:00<56:05:44, 10.58s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '1.122', 'learning_rate': '1.057e-05', 'epoch': '0.4973'}

 50%|████▉     | 18880/37963 [58:39:00<56:05:44, 10.58s/it]
 50%|████▉     | 18881/37963 [58:39:17<65:25:29, 12.34s/it]
 50%|████▉     | 18882/37963 [58:39:27<61:54:33, 11.68s/it]
 50%|████▉     | 18883/37963 [58:39:37<59:16:50, 11.19s/it]
 50%|████▉     | 18884/37963 [58:39:54<68:26:30, 12.91s/it]
 50%|████▉     | 18885/37963 [58:40:04<64:00:17, 12.08s/it]
 50%|████▉     | 18886/37963 [58:40:14<60:46:50, 11.47s/it]
 50%|████▉     | 18887/37963 [58:40:24<58:00:29, 10.95s/it]
 50%|████▉     | 18888/37963 [58:40:34<56:39:10, 10.69s/it]
 50%|████▉     | 18889/37963 [58:40:44<55:42:36, 10.51s/it]
 50%|████▉     | 18890/37963 [58:40:54<54:59:37, 10.38s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '0.8749', 'learning_rate': '1.056e-05', 'epoch': '0.4976'}

 50%|████▉     | 18890/37963 [58:40:54<54:59:37, 10.38s/it]
 50%|████▉     | 18891/37963 [58:41:04<54:09:22, 10.22s/it]
 50%|████▉     | 18892/37963 [58:41:14<54:05:47, 10.21s/it]
 50%|████▉     | 18893/37963 [58:41:24<53:49:53, 10.16s/it]
 50%|████▉     | 18894/37963 [58:41:41<63:55:08, 12.07s/it]
 50%|████▉     | 18895/37963 [58:41:51<60:45:38, 11.47s/it]
 50%|████▉     | 18896/37963 [58:42:01<58:31:55, 11.05s/it]
 50%|████▉     | 18897/37963 [58:42:11<56:58:02, 10.76s/it]
 50%|████▉     | 18898/37963 [58:42:21<55:48:10, 10.54s/it]
 50%|████▉     | 18899/37963 [58:42:31<55:08:01, 10.41s/it]
 50%|████▉     | 18900/37963 [58:42:41<54:40:49, 10.33s/it]
                                                           
{'loss': '0.146', 'grad_norm': '1.031', 'learning_rate': '1.056e-05', 'epoch': '0.4979'}

 50%|████▉     | 18900/37963 [58:42:41<54:40:49, 10.33s/it]
 50%|████▉     | 18901/37963 [58:42:51<54:26:00, 10.28s/it]
 50%|████▉     | 18902/37963 [58:43:02<54:09:42, 10.23s/it]
 50%|████▉     | 18903/37963 [58:43:25<74:24:23, 14.05s/it]
 50%|████▉     | 18904/37963 [58:43:35<68:08:36, 12.87s/it]
 50%|████▉     | 18905/37963 [58:43:45<63:51:25, 12.06s/it]
 50%|████▉     | 18906/37963 [58:43:55<60:38:13, 11.45s/it]
 50%|████▉     | 18907/37963 [58:44:05<57:52:53, 10.93s/it]
 50%|████▉     | 18908/37963 [58:44:15<56:38:42, 10.70s/it]
 50%|████▉     | 18909/37963 [58:44:25<55:38:12, 10.51s/it]
 50%|████▉     | 18910/37963 [58:44:35<54:23:25, 10.28s/it]
                                                           
{'loss': '0.134', 'grad_norm': '1.701', 'learning_rate': '1.055e-05', 'epoch': '0.4981'}

 50%|████▉     | 18910/37963 [58:44:35<54:23:25, 10.28s/it]
 50%|████▉     | 18911/37963 [58:44:51<64:41:40, 12.22s/it]
 50%|████▉     | 18912/37963 [58:45:01<60:52:47, 11.50s/it]
 50%|████▉     | 18913/37963 [58:45:11<57:58:23, 10.96s/it]
 50%|████▉     | 18914/37963 [58:45:21<56:09:51, 10.61s/it]
 50%|████▉     | 18915/37963 [58:45:30<54:33:33, 10.31s/it]
 50%|████▉     | 18916/37963 [58:45:47<64:48:26, 12.25s/it]
 50%|████▉     | 18917/37963 [58:45:57<61:20:39, 11.60s/it]
 50%|████▉     | 18918/37963 [58:46:07<58:53:32, 11.13s/it]
 50%|████▉     | 18919/37963 [58:46:17<56:40:46, 10.71s/it]
 50%|████▉     | 18920/37963 [58:46:27<55:51:44, 10.56s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '1.821', 'learning_rate': '1.054e-05', 'epoch': '0.4984'}

 50%|████▉     | 18920/37963 [58:46:27<55:51:44, 10.56s/it]
 50%|████▉     | 18921/37963 [58:46:37<55:06:20, 10.42s/it]
 50%|████▉     | 18922/37963 [58:46:47<54:39:28, 10.33s/it]
 50%|████▉     | 18923/37963 [58:46:57<54:00:26, 10.21s/it]
 50%|████▉     | 18924/37963 [58:47:14<64:01:14, 12.11s/it]
 50%|████▉     | 18925/37963 [58:47:24<60:53:08, 11.51s/it]
 50%|████▉     | 18926/37963 [58:47:34<58:44:43, 11.11s/it]
 50%|████▉     | 18927/37963 [58:47:44<57:07:46, 10.80s/it]
 50%|████▉     | 18928/37963 [58:48:00<65:19:01, 12.35s/it]
 50%|████▉     | 18929/37963 [58:48:10<61:43:43, 11.68s/it]
 50%|████▉     | 18930/37963 [58:48:20<59:18:16, 11.22s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '2.344', 'learning_rate': '1.053e-05', 'epoch': '0.4986'}

 50%|████▉     | 18930/37963 [58:48:20<59:18:16, 11.22s/it]
 50%|████▉     | 18931/37963 [58:48:30<57:29:59, 10.88s/it]
 50%|████▉     | 18932/37963 [58:48:40<56:12:31, 10.63s/it]
 50%|████▉     | 18933/37963 [58:48:57<65:52:28, 12.46s/it]
 50%|████▉     | 18934/37963 [58:49:07<62:12:03, 11.77s/it]
 50%|████▉     | 18935/37963 [58:49:17<59:01:46, 11.17s/it]
 50%|████▉     | 18936/37963 [58:49:27<57:10:32, 10.82s/it]
 50%|████▉     | 18937/37963 [58:49:37<55:56:26, 10.58s/it]
 50%|████▉     | 18938/37963 [58:49:47<54:39:31, 10.34s/it]
 50%|████▉     | 18939/37963 [58:49:57<54:18:21, 10.28s/it]
 50%|████▉     | 18940/37963 [58:50:07<53:59:46, 10.22s/it]
                                                           
{'loss': '0.1468', 'grad_norm': '3.1', 'learning_rate': '1.052e-05', 'epoch': '0.4989'}

 50%|████▉     | 18940/37963 [58:50:07<53:59:46, 10.22s/it]
 50%|████▉     | 18941/37963 [58:50:17<53:15:36, 10.08s/it]
 50%|████▉     | 18942/37963 [58:50:33<63:22:22, 11.99s/it]
 50%|████▉     | 18943/37963 [58:50:44<60:28:14, 11.45s/it]
 50%|████▉     | 18944/37963 [58:50:53<57:53:14, 10.96s/it]
 50%|████▉     | 18945/37963 [58:51:03<56:33:25, 10.71s/it]
 50%|████▉     | 18946/37963 [58:51:14<55:38:57, 10.53s/it]
 50%|████▉     | 18947/37963 [58:51:24<54:53:15, 10.39s/it]
 50%|████▉     | 18948/37963 [58:51:34<54:26:48, 10.31s/it]
 50%|████▉     | 18949/37963 [58:51:44<54:06:27, 10.24s/it]
 50%|████▉     | 18950/37963 [58:51:54<53:30:34, 10.13s/it]
                                                           
{'loss': '0.1468', 'grad_norm': '1.295', 'learning_rate': '1.051e-05', 'epoch': '0.4992'}

 50%|████▉     | 18950/37963 [58:51:54<53:30:34, 10.13s/it]
 50%|████▉     | 18951/37963 [58:52:10<63:21:18, 12.00s/it]
 50%|████▉     | 18952/37963 [58:52:20<60:23:03, 11.43s/it]
 50%|████▉     | 18953/37963 [58:52:30<58:13:45, 11.03s/it]
 50%|████▉     | 18954/37963 [58:52:46<66:13:46, 12.54s/it]
 50%|████▉     | 18955/37963 [58:52:57<62:26:39, 11.83s/it]
 50%|████▉     | 18956/37963 [58:53:07<59:34:47, 11.28s/it]
 50%|████▉     | 18957/37963 [58:53:17<57:37:52, 10.92s/it]
 50%|████▉     | 18958/37963 [58:53:33<66:56:06, 12.68s/it]
 50%|████▉     | 18959/37963 [58:53:44<62:55:52, 11.92s/it]
 50%|████▉     | 18960/37963 [58:53:54<60:03:51, 11.38s/it]
                                                           
{'loss': '0.1499', 'grad_norm': '2.852', 'learning_rate': '1.05e-05', 'epoch': '0.4994'}

 50%|████▉     | 18960/37963 [58:53:54<60:03:51, 11.38s/it]
 50%|████▉     | 18961/37963 [58:54:04<58:11:26, 11.02s/it]
 50%|████▉     | 18962/37963 [58:54:14<57:03:55, 10.81s/it]
 50%|████▉     | 18963/37963 [58:54:24<55:50:58, 10.58s/it]
 50%|████▉     | 18964/37963 [58:54:34<55:00:47, 10.42s/it]
 50%|████▉     | 18965/37963 [58:54:51<64:23:34, 12.20s/it]
 50%|████▉     | 18966/37963 [58:55:01<61:06:41, 11.58s/it]
 50%|████▉     | 18967/37963 [58:55:11<58:38:09, 11.11s/it]
 50%|████▉     | 18968/37963 [58:55:21<57:08:07, 10.83s/it]
 50%|████▉     | 18969/37963 [58:55:31<55:50:20, 10.58s/it]
 50%|████▉     | 18970/37963 [58:55:41<55:00:30, 10.43s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '1.101', 'learning_rate': '1.05e-05', 'epoch': '0.4997'}

 50%|████▉     | 18970/37963 [58:55:41<55:00:30, 10.43s/it]
 50%|████▉     | 18971/37963 [58:55:51<54:38:11, 10.36s/it]
 50%|████▉     | 18972/37963 [58:56:01<54:01:38, 10.24s/it]
 50%|████▉     | 18973/37963 [58:56:11<53:56:52, 10.23s/it]
 50%|████▉     | 18974/37963 [58:56:28<64:00:36, 12.14s/it]
 50%|████▉     | 18975/37963 [58:56:38<60:43:49, 11.51s/it]
 50%|████▉     | 18976/37963 [58:56:48<58:29:19, 11.09s/it]
 50%|████▉     | 18977/37963 [58:56:58<57:03:37, 10.82s/it]
 50%|████▉     | 18978/37963 [58:57:15<66:15:50, 12.57s/it]
 50%|████▉     | 18979/37963 [58:57:25<62:13:37, 11.80s/it]
 50%|████▉     | 18980/37963 [58:57:35<59:39:21, 11.31s/it]
                                                           
{'loss': '0.1528', 'grad_norm': '1.706', 'learning_rate': '1.049e-05', 'epoch': '0.5'}

 50%|████▉     | 18980/37963 [58:57:35<59:39:21, 11.31s/it]
 50%|████▉     | 18981/37963 [58:57:45<57:42:24, 10.94s/it]
 50%|█████     | 18982/37963 [58:57:55<56:10:59, 10.66s/it]
 50%|█████     | 18983/37963 [58:58:12<66:01:41, 12.52s/it]
 50%|█████     | 18984/37963 [58:58:22<61:28:29, 11.66s/it]
 50%|█████     | 18985/37963 [58:58:32<59:01:58, 11.20s/it]
 50%|█████     | 18986/37963 [58:58:42<57:17:56, 10.87s/it]
 50%|█████     | 18987/37963 [58:58:52<56:04:35, 10.64s/it]
 50%|█████     | 18988/37963 [58:59:08<65:15:30, 12.38s/it]
 50%|█████     | 18989/37963 [58:59:19<61:42:52, 11.71s/it]
 50%|█████     | 18990/37963 [58:59:29<59:11:12, 11.23s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '2.582', 'learning_rate': '1.048e-05', 'epoch': '0.5002'}

 50%|█████     | 18990/37963 [58:59:29<59:11:12, 11.23s/it]
 50%|█████     | 18991/37963 [58:59:39<57:25:46, 10.90s/it]
 50%|█████     | 18992/37963 [58:59:49<56:08:03, 10.65s/it]
 50%|█████     | 18993/37963 [58:59:59<55:05:51, 10.46s/it]
 50%|█████     | 18994/37963 [59:00:09<54:30:05, 10.34s/it]
 50%|█████     | 18995/37963 [59:00:19<54:14:52, 10.30s/it]
 50%|█████     | 18996/37963 [59:00:29<53:49:15, 10.22s/it]
 50%|█████     | 18997/37963 [59:00:46<63:52:16, 12.12s/it]
 50%|█████     | 18998/37963 [59:00:55<59:49:03, 11.35s/it]
 50%|█████     | 18999/37963 [59:01:06<58:02:41, 11.02s/it]
 50%|█████     | 19000/37963 [59:01:15<56:03:00, 10.64s/it]
                                                           
{'loss': '0.1414', 'grad_norm': '2.296', 'learning_rate': '1.047e-05', 'epoch': '0.5005'}

 50%|█████     | 19000/37963 [59:01:15<56:03:00, 10.64s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.77s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.78s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 50%|█████     | 19001/37963 [59:02:15<133:02:22, 25.26s/it]
 50%|█████     | 19002/37963 [59:02:25<109:14:35, 20.74s/it]
 50%|█████     | 19003/37963 [59:02:41<102:31:12, 19.47s/it]
 50%|█████     | 19004/37963 [59:02:51<87:26:45, 16.60s/it] 
 50%|█████     | 19005/37963 [59:03:01<76:27:47, 14.52s/it]
 50%|█████     | 19006/37963 [59:03:18<80:47:16, 15.34s/it]
 50%|█████     | 19007/37963 [59:03:28<72:29:14, 13.77s/it]
 50%|█████     | 19008/37963 [59:03:38<66:36:55, 12.65s/it]
 50%|█████     | 19009/37963 [59:03:49<62:33:57, 11.88s/it]
 50%|█████     | 19010/37963 [59:03:59<59:42:37, 11.34s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '1.383', 'learning_rate': '1.046e-05', 'epoch': '0.5008'}

 50%|█████     | 19010/37963 [59:03:59<59:42:37, 11.34s/it]
 50%|█████     | 19011/37963 [59:04:15<67:38:12, 12.85s/it]
 50%|█████     | 19012/37963 [59:04:25<63:18:12, 12.03s/it]
 50%|█████     | 19013/37963 [59:04:35<60:33:31, 11.50s/it]
 50%|█████     | 19014/37963 [59:04:46<58:33:11, 11.12s/it]
 50%|█████     | 19015/37963 [59:04:56<56:55:55, 10.82s/it]
 50%|█████     | 19016/37963 [59:05:06<55:49:44, 10.61s/it]
 50%|█████     | 19017/37963 [59:05:16<54:43:15, 10.40s/it]
 50%|█████     | 19018/37963 [59:05:26<54:12:35, 10.30s/it]
 50%|█████     | 19019/37963 [59:05:36<53:47:14, 10.22s/it]
 50%|█████     | 19020/37963 [59:05:46<53:44:45, 10.21s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '1.197', 'learning_rate': '1.045e-05', 'epoch': '0.501'}

 50%|█████     | 19020/37963 [59:05:46<53:44:45, 10.21s/it]
 50%|█████     | 19021/37963 [59:05:56<53:31:12, 10.17s/it]
 50%|█████     | 19022/37963 [59:06:06<53:31:09, 10.17s/it]
 50%|█████     | 19023/37963 [59:06:16<53:33:04, 10.18s/it]
 50%|█████     | 19024/37963 [59:06:26<52:54:41, 10.06s/it]
 50%|█████     | 19025/37963 [59:06:43<63:11:56, 12.01s/it]
 50%|█████     | 19026/37963 [59:06:53<59:59:39, 11.41s/it]
 50%|█████     | 19027/37963 [59:07:09<67:35:48, 12.85s/it]
 50%|█████     | 19028/37963 [59:07:19<63:10:50, 12.01s/it]
 50%|█████     | 19029/37963 [59:07:29<59:57:51, 11.40s/it]
 50%|█████     | 19030/37963 [59:07:39<57:27:38, 10.93s/it]
                                                           
{'loss': '0.1416', 'grad_norm': '1.579', 'learning_rate': '1.045e-05', 'epoch': '0.5013'}

 50%|█████     | 19030/37963 [59:07:39<57:27:38, 10.93s/it]
 50%|█████     | 19031/37963 [59:07:56<67:16:51, 12.79s/it]
 50%|█████     | 19032/37963 [59:08:06<62:31:33, 11.89s/it]
 50%|█████     | 19033/37963 [59:08:16<59:42:51, 11.36s/it]
 50%|█████     | 19034/37963 [59:08:32<67:49:00, 12.90s/it]
 50%|█████     | 19035/37963 [59:08:43<63:29:50, 12.08s/it]
 50%|█████     | 19036/37963 [59:08:52<59:24:56, 11.30s/it]
 50%|█████     | 19037/37963 [59:09:02<57:15:04, 10.89s/it]
 50%|█████     | 19038/37963 [59:09:12<55:58:53, 10.65s/it]
 50%|█████     | 19039/37963 [59:09:22<55:11:51, 10.50s/it]
 50%|█████     | 19040/37963 [59:09:32<54:31:29, 10.37s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '2.733', 'learning_rate': '1.044e-05', 'epoch': '0.5015'}

 50%|█████     | 19040/37963 [59:09:32<54:31:29, 10.37s/it]
 50%|█████     | 19041/37963 [59:09:42<54:04:33, 10.29s/it]
 50%|█████     | 19042/37963 [59:09:52<53:45:16, 10.23s/it]
 50%|█████     | 19043/37963 [59:10:02<53:20:30, 10.15s/it]
 50%|█████     | 19044/37963 [59:10:12<52:56:00, 10.07s/it]
 50%|█████     | 19045/37963 [59:10:22<52:56:52, 10.08s/it]
 50%|█████     | 19046/37963 [59:10:39<62:59:45, 11.99s/it]
 50%|█████     | 19047/37963 [59:10:49<60:08:41, 11.45s/it]
 50%|█████     | 19048/37963 [59:10:59<58:10:22, 11.07s/it]
 50%|█████     | 19049/37963 [59:11:09<56:33:32, 10.77s/it]
 50%|█████     | 19050/37963 [59:11:20<55:47:02, 10.62s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '2.117', 'learning_rate': '1.043e-05', 'epoch': '0.5018'}

 50%|█████     | 19050/37963 [59:11:20<55:47:02, 10.62s/it]
 50%|█████     | 19051/37963 [59:11:36<64:44:45, 12.32s/it]
 50%|█████     | 19052/37963 [59:11:46<61:11:05, 11.65s/it]
 50%|█████     | 19053/37963 [59:12:03<69:20:51, 13.20s/it]
 50%|█████     | 19054/37963 [59:12:12<63:37:55, 12.11s/it]
 50%|█████     | 19055/37963 [59:12:22<59:55:41, 11.41s/it]
 50%|█████     | 19056/37963 [59:12:32<57:36:09, 10.97s/it]
 50%|█████     | 19057/37963 [59:12:42<56:17:06, 10.72s/it]
 50%|█████     | 19058/37963 [59:12:52<55:19:38, 10.54s/it]
 50%|█████     | 19059/37963 [59:13:09<64:55:28, 12.36s/it]
 50%|█████     | 19060/37963 [59:13:19<61:23:07, 11.69s/it]
                                                           
{'loss': '0.1503', 'grad_norm': '1.691', 'learning_rate': '1.042e-05', 'epoch': '0.5021'}

 50%|█████     | 19060/37963 [59:13:19<61:23:07, 11.69s/it]
 50%|█████     | 19061/37963 [59:13:29<58:52:18, 11.21s/it]
 50%|█████     | 19062/37963 [59:13:39<57:03:08, 10.87s/it]
 50%|█████     | 19063/37963 [59:13:49<55:28:12, 10.57s/it]
 50%|█████     | 19064/37963 [59:13:59<54:59:44, 10.48s/it]
 50%|█████     | 19065/37963 [59:14:09<54:23:46, 10.36s/it]
 50%|█████     | 19066/37963 [59:14:19<53:33:26, 10.20s/it]
 50%|█████     | 19067/37963 [59:14:29<53:25:03, 10.18s/it]
 50%|█████     | 19068/37963 [59:14:39<52:52:39, 10.07s/it]
 50%|█████     | 19069/37963 [59:14:49<52:54:37, 10.08s/it]
 50%|█████     | 19070/37963 [59:14:59<52:51:52, 10.07s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '2.91', 'learning_rate': '1.041e-05', 'epoch': '0.5023'}

 50%|█████     | 19070/37963 [59:14:59<52:51:52, 10.07s/it]
 50%|█████     | 19071/37963 [59:15:10<52:57:00, 10.09s/it]
 50%|█████     | 19072/37963 [59:15:20<53:08:01, 10.13s/it]
 50%|█████     | 19073/37963 [59:15:29<52:34:19, 10.02s/it]
 50%|█████     | 19074/37963 [59:15:53<73:14:10, 13.96s/it]
 50%|█████     | 19075/37963 [59:16:03<67:08:31, 12.80s/it]
 50%|█████     | 19076/37963 [59:16:12<61:57:36, 11.81s/it]
 50%|█████     | 19077/37963 [59:16:22<59:04:11, 11.26s/it]
 50%|█████     | 19078/37963 [59:16:32<57:28:53, 10.96s/it]
 50%|█████     | 19079/37963 [59:16:43<56:15:19, 10.72s/it]
 50%|█████     | 19080/37963 [59:17:00<66:02:26, 12.59s/it]
                                                           
{'loss': '0.1486', 'grad_norm': '1.425', 'learning_rate': '1.04e-05', 'epoch': '0.5026'}

 50%|█████     | 19080/37963 [59:17:00<66:02:26, 12.59s/it]
 50%|█████     | 19081/37963 [59:17:10<62:13:34, 11.86s/it]
 50%|█████     | 19082/37963 [59:17:27<69:58:09, 13.34s/it]
 50%|█████     | 19083/37963 [59:17:36<64:13:15, 12.25s/it]
 50%|█████     | 19084/37963 [59:17:46<60:50:00, 11.60s/it]
 50%|█████     | 19085/37963 [59:17:56<58:17:24, 11.12s/it]
 50%|█████     | 19086/37963 [59:18:06<56:40:32, 10.81s/it]
 50%|█████     | 19087/37963 [59:18:16<55:05:46, 10.51s/it]
 50%|█████     | 19088/37963 [59:18:26<54:16:00, 10.35s/it]
 50%|█████     | 19089/37963 [59:18:36<53:55:02, 10.28s/it]
 50%|█████     | 19090/37963 [59:18:46<52:54:11, 10.09s/it]
                                                           
{'loss': '0.1393', 'grad_norm': '1.441', 'learning_rate': '1.039e-05', 'epoch': '0.5029'}

 50%|█████     | 19090/37963 [59:18:46<52:54:11, 10.09s/it]
 50%|█████     | 19091/37963 [59:18:56<52:52:43, 10.09s/it]
 50%|█████     | 19092/37963 [59:19:06<52:49:32, 10.08s/it]
 50%|█████     | 19093/37963 [59:19:16<52:24:37, 10.00s/it]
 50%|█████     | 19094/37963 [59:19:26<52:05:50,  9.94s/it]
 50%|█████     | 19095/37963 [59:19:42<61:46:46, 11.79s/it]
 50%|█████     | 19096/37963 [59:19:52<59:09:41, 11.29s/it]
 50%|█████     | 19097/37963 [59:20:02<57:16:45, 10.93s/it]
 50%|█████     | 19098/37963 [59:20:12<55:43:33, 10.63s/it]
 50%|█████     | 19099/37963 [59:20:29<65:14:45, 12.45s/it]
 50%|█████     | 19100/37963 [59:20:38<60:48:42, 11.61s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '2.526', 'learning_rate': '1.039e-05', 'epoch': '0.5031'}

 50%|█████     | 19100/37963 [59:20:38<60:48:42, 11.61s/it]
 50%|█████     | 19101/37963 [59:20:49<58:38:35, 11.19s/it]
 50%|█████     | 19102/37963 [59:21:05<66:41:11, 12.73s/it]
 50%|█████     | 19103/37963 [59:21:15<62:32:19, 11.94s/it]
 50%|█████     | 19104/37963 [59:21:25<59:05:47, 11.28s/it]
 50%|█████     | 19105/37963 [59:21:35<57:07:08, 10.90s/it]
 50%|█████     | 19106/37963 [59:21:51<66:03:10, 12.61s/it]
 50%|█████     | 19107/37963 [59:22:01<61:19:14, 11.71s/it]
 50%|█████     | 19108/37963 [59:22:11<58:43:16, 11.21s/it]
 50%|█████     | 19109/37963 [59:22:21<56:08:47, 10.72s/it]
 50%|█████     | 19110/37963 [59:22:31<55:18:38, 10.56s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '0.8513', 'learning_rate': '1.038e-05', 'epoch': '0.5034'}

 50%|█████     | 19110/37963 [59:22:31<55:18:38, 10.56s/it]
 50%|█████     | 19111/37963 [59:22:40<53:54:51, 10.30s/it]
 50%|█████     | 19112/37963 [59:22:50<53:10:58, 10.16s/it]
 50%|█████     | 19113/37963 [59:23:00<53:04:55, 10.14s/it]
 50%|█████     | 19114/37963 [59:23:10<52:51:05, 10.09s/it]
 50%|█████     | 19115/37963 [59:23:20<51:47:03,  9.89s/it]
 50%|█████     | 19116/37963 [59:23:30<51:58:24,  9.93s/it]
 50%|█████     | 19117/37963 [59:23:40<52:01:53,  9.94s/it]
 50%|█████     | 19118/37963 [59:23:50<52:10:25,  9.97s/it]
 50%|█████     | 19119/37963 [59:24:00<52:26:03, 10.02s/it]
 50%|█████     | 19120/37963 [59:24:16<61:45:26, 11.80s/it]
                                                           
{'loss': '0.14', 'grad_norm': '1.693', 'learning_rate': '1.037e-05', 'epoch': '0.5036'}

 50%|█████     | 19120/37963 [59:24:16<61:45:26, 11.80s/it]
 50%|█████     | 19121/37963 [59:24:26<59:06:41, 11.29s/it]
 50%|█████     | 19122/37963 [59:24:42<67:09:28, 12.83s/it]
 50%|█████     | 19123/37963 [59:24:52<62:54:04, 12.02s/it]
 50%|█████     | 19124/37963 [59:25:02<59:42:31, 11.41s/it]
 50%|█████     | 19125/37963 [59:25:13<57:42:14, 11.03s/it]
 50%|█████     | 19126/37963 [59:25:23<56:17:01, 10.76s/it]
 50%|█████     | 19127/37963 [59:25:33<55:10:13, 10.54s/it]
 50%|█████     | 19128/37963 [59:25:49<64:46:26, 12.38s/it]
 50%|█████     | 19129/37963 [59:26:00<61:16:54, 11.71s/it]
 50%|█████     | 19130/37963 [59:26:09<58:22:16, 11.16s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '4.793', 'learning_rate': '1.036e-05', 'epoch': '0.5039'}

 50%|█████     | 19130/37963 [59:26:09<58:22:16, 11.16s/it]
 50%|█████     | 19131/37963 [59:26:26<67:11:07, 12.84s/it]
 50%|█████     | 19132/37963 [59:26:36<62:54:16, 12.03s/it]
 50%|█████     | 19133/37963 [59:26:46<59:26:51, 11.37s/it]
 50%|█████     | 19134/37963 [59:26:56<57:26:17, 10.98s/it]
 50%|█████     | 19135/37963 [59:27:06<56:08:44, 10.74s/it]
 50%|█████     | 19136/37963 [59:27:17<55:10:48, 10.55s/it]
 50%|█████     | 19137/37963 [59:27:27<54:31:13, 10.43s/it]
 50%|█████     | 19138/37963 [59:27:37<53:55:02, 10.31s/it]
 50%|█████     | 19139/37963 [59:27:47<53:23:36, 10.21s/it]
 50%|█████     | 19140/37963 [59:27:57<53:11:41, 10.17s/it]
                                                           
{'loss': '0.149', 'grad_norm': '1.384', 'learning_rate': '1.035e-05', 'epoch': '0.5042'}

 50%|█████     | 19140/37963 [59:27:57<53:11:41, 10.17s/it]
 50%|█████     | 19141/37963 [59:28:07<53:00:41, 10.14s/it]
 50%|█████     | 19142/37963 [59:28:17<52:35:17, 10.06s/it]
 50%|█████     | 19143/37963 [59:28:33<62:10:16, 11.89s/it]
 50%|█████     | 19144/37963 [59:28:43<59:28:24, 11.38s/it]
 50%|█████     | 19145/37963 [59:28:53<57:14:58, 10.95s/it]
 50%|█████     | 19146/37963 [59:29:03<56:03:11, 10.72s/it]
 50%|█████     | 19147/37963 [59:29:20<65:15:41, 12.49s/it]
 50%|█████     | 19148/37963 [59:29:30<61:38:24, 11.79s/it]
 50%|█████     | 19149/37963 [59:29:40<59:01:24, 11.29s/it]
 50%|█████     | 19150/37963 [59:29:57<67:46:48, 12.97s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '1.224', 'learning_rate': '1.034e-05', 'epoch': '0.5044'}

 50%|█████     | 19150/37963 [59:29:57<67:46:48, 12.97s/it]
 50%|█████     | 19151/37963 [59:30:07<63:12:30, 12.10s/it]
 50%|█████     | 19152/37963 [59:30:17<60:09:41, 11.51s/it]
 50%|█████     | 19153/37963 [59:30:27<57:55:53, 11.09s/it]
 50%|█████     | 19154/37963 [59:30:37<56:03:21, 10.73s/it]
 50%|█████     | 19155/37963 [59:30:47<55:06:28, 10.55s/it]
 50%|█████     | 19156/37963 [59:31:04<64:45:53, 12.40s/it]
 50%|█████     | 19157/37963 [59:31:14<61:03:18, 11.69s/it]
 50%|█████     | 19158/37963 [59:31:24<58:25:21, 11.18s/it]
 50%|█████     | 19159/37963 [59:31:34<56:47:00, 10.87s/it]
 50%|█████     | 19160/37963 [59:31:44<55:29:21, 10.62s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '1.027', 'learning_rate': '1.033e-05', 'epoch': '0.5047'}

 50%|█████     | 19160/37963 [59:31:44<55:29:21, 10.62s/it]
 50%|█████     | 19161/37963 [59:31:54<54:37:07, 10.46s/it]
 50%|█████     | 19162/37963 [59:32:05<54:17:42, 10.40s/it]
 50%|█████     | 19163/37963 [59:32:15<53:57:15, 10.33s/it]
 50%|█████     | 19164/37963 [59:32:25<53:24:38, 10.23s/it]
 50%|█████     | 19165/37963 [59:32:35<53:08:56, 10.18s/it]
 50%|█████     | 19166/37963 [59:32:45<53:13:05, 10.19s/it]
 50%|█████     | 19167/37963 [59:32:55<52:41:43, 10.09s/it]
 50%|█████     | 19168/37963 [59:33:05<52:32:49, 10.06s/it]
 50%|█████     | 19169/37963 [59:33:15<52:15:26, 10.01s/it]
 50%|█████     | 19170/37963 [59:33:31<62:33:05, 11.98s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '0.8911', 'learning_rate': '1.033e-05', 'epoch': '0.505'}

 50%|█████     | 19170/37963 [59:33:31<62:33:05, 11.98s/it]
 50%|█████     | 19171/37963 [59:33:48<69:41:18, 13.35s/it]
 51%|█████     | 19172/37963 [59:33:58<64:32:58, 12.37s/it]
 51%|█████     | 19173/37963 [59:34:08<61:15:07, 11.74s/it]
 51%|█████     | 19174/37963 [59:34:18<58:50:00, 11.27s/it]
 51%|█████     | 19175/37963 [59:34:29<57:08:13, 10.95s/it]
 51%|█████     | 19176/37963 [59:34:46<66:37:40, 12.77s/it]
 51%|█████     | 19177/37963 [59:34:56<62:33:11, 11.99s/it]
 51%|█████     | 19178/37963 [59:35:06<59:33:27, 11.41s/it]
 51%|█████     | 19179/37963 [59:35:16<57:24:37, 11.00s/it]
 51%|█████     | 19180/37963 [59:35:32<65:51:38, 12.62s/it]
                                                           
{'loss': '0.1511', 'grad_norm': '1.614', 'learning_rate': '1.032e-05', 'epoch': '0.5052'}

 51%|█████     | 19180/37963 [59:35:32<65:51:38, 12.62s/it]
 51%|█████     | 19181/37963 [59:35:42<61:54:57, 11.87s/it]
 51%|█████     | 19182/37963 [59:35:53<59:09:19, 11.34s/it]
 51%|█████     | 19183/37963 [59:36:03<57:04:10, 10.94s/it]
 51%|█████     | 19184/37963 [59:36:13<56:02:31, 10.74s/it]
 51%|█████     | 19185/37963 [59:36:23<55:07:21, 10.57s/it]
 51%|█████     | 19186/37963 [59:36:33<54:25:24, 10.43s/it]
 51%|█████     | 19187/37963 [59:36:43<53:38:35, 10.29s/it]
 51%|█████     | 19188/37963 [59:36:53<53:15:28, 10.21s/it]
 51%|█████     | 19189/37963 [59:37:03<53:10:13, 10.20s/it]
 51%|█████     | 19190/37963 [59:37:13<52:56:16, 10.15s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '2.214', 'learning_rate': '1.031e-05', 'epoch': '0.5055'}

 51%|█████     | 19190/37963 [59:37:13<52:56:16, 10.15s/it]
 51%|█████     | 19191/37963 [59:37:30<63:05:29, 12.10s/it]
 51%|█████     | 19192/37963 [59:37:40<59:50:21, 11.48s/it]
 51%|█████     | 19193/37963 [59:37:50<57:43:02, 11.07s/it]
 51%|█████     | 19194/37963 [59:38:07<66:05:19, 12.68s/it]
 51%|█████     | 19195/37963 [59:38:17<62:02:56, 11.90s/it]
 51%|█████     | 19196/37963 [59:38:27<59:09:01, 11.35s/it]
 51%|█████     | 19197/37963 [59:38:37<56:54:18, 10.92s/it]
 51%|█████     | 19198/37963 [59:38:47<55:42:01, 10.69s/it]
 51%|█████     | 19199/37963 [59:39:04<65:38:02, 12.59s/it]
 51%|█████     | 19200/37963 [59:39:14<61:43:41, 11.84s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '1.494', 'learning_rate': '1.03e-05', 'epoch': '0.5058'}

 51%|█████     | 19200/37963 [59:39:14<61:43:41, 11.84s/it]
 51%|█████     | 19201/37963 [59:39:24<58:56:45, 11.31s/it]
 51%|█████     | 19202/37963 [59:39:34<56:35:11, 10.86s/it]
 51%|█████     | 19203/37963 [59:39:44<54:53:27, 10.53s/it]
 51%|█████     | 19204/37963 [59:39:53<53:59:47, 10.36s/it]
 51%|█████     | 19205/37963 [59:40:10<63:39:21, 12.22s/it]
 51%|█████     | 19206/37963 [59:40:20<60:16:21, 11.57s/it]
 51%|█████     | 19207/37963 [59:40:30<57:54:45, 11.12s/it]
 51%|█████     | 19208/37963 [59:40:40<56:17:10, 10.80s/it]
 51%|█████     | 19209/37963 [59:40:50<54:44:18, 10.51s/it]
 51%|█████     | 19210/37963 [59:41:00<53:52:25, 10.34s/it]
                                                           
{'loss': '0.139', 'grad_norm': '1.31', 'learning_rate': '1.029e-05', 'epoch': '0.506'}

 51%|█████     | 19210/37963 [59:41:00<53:52:25, 10.34s/it]
 51%|█████     | 19211/37963 [59:41:10<52:45:27, 10.13s/it]
 51%|█████     | 19212/37963 [59:41:20<52:42:45, 10.12s/it]
 51%|█████     | 19213/37963 [59:41:30<52:41:02, 10.12s/it]
 51%|█████     | 19214/37963 [59:41:40<52:40:05, 10.11s/it]
 51%|█████     | 19215/37963 [59:41:50<52:41:57, 10.12s/it]
 51%|█████     | 19216/37963 [59:42:00<52:39:52, 10.11s/it]
 51%|█████     | 19217/37963 [59:42:10<52:33:06, 10.09s/it]
 51%|█████     | 19218/37963 [59:42:20<52:40:13, 10.12s/it]
 51%|█████     | 19219/37963 [59:42:30<52:20:30, 10.05s/it]
 51%|█████     | 19220/37963 [59:42:53<72:48:50, 13.99s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '1.657', 'learning_rate': '1.028e-05', 'epoch': '0.5063'}

 51%|█████     | 19220/37963 [59:42:53<72:48:50, 13.99s/it]
 51%|█████     | 19221/37963 [59:43:04<66:54:54, 12.85s/it]
 51%|█████     | 19222/37963 [59:43:14<62:30:51, 12.01s/it]
 51%|█████     | 19223/37963 [59:43:24<59:25:33, 11.42s/it]
 51%|█████     | 19224/37963 [59:43:34<57:13:45, 10.99s/it]
 51%|█████     | 19225/37963 [59:43:51<66:41:12, 12.81s/it]
 51%|█████     | 19226/37963 [59:44:01<62:17:07, 11.97s/it]
 51%|█████     | 19227/37963 [59:44:11<59:17:53, 11.39s/it]
 51%|█████     | 19228/37963 [59:44:21<57:13:02, 10.99s/it]
 51%|█████     | 19229/37963 [59:44:37<65:26:31, 12.58s/it]
 51%|█████     | 19230/37963 [59:44:47<61:40:53, 11.85s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '0.8575', 'learning_rate': '1.027e-05', 'epoch': '0.5065'}

 51%|█████     | 19230/37963 [59:44:47<61:40:53, 11.85s/it]
 51%|█████     | 19231/37963 [59:44:57<58:51:53, 11.31s/it]
 51%|█████     | 19232/37963 [59:45:07<56:53:22, 10.93s/it]
 51%|█████     | 19233/37963 [59:45:17<55:30:53, 10.67s/it]
 51%|█████     | 19234/37963 [59:45:27<54:21:49, 10.45s/it]
 51%|█████     | 19235/37963 [59:45:38<53:55:43, 10.37s/it]
 51%|█████     | 19236/37963 [59:45:48<53:39:41, 10.32s/it]
 51%|█████     | 19237/37963 [59:46:04<63:14:13, 12.16s/it]
 51%|█████     | 19238/37963 [59:46:14<59:56:54, 11.53s/it]
 51%|█████     | 19239/37963 [59:46:24<57:39:53, 11.09s/it]
 51%|█████     | 19240/37963 [59:46:34<56:05:38, 10.79s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '2.708', 'learning_rate': '1.027e-05', 'epoch': '0.5068'}

 51%|█████     | 19240/37963 [59:46:34<56:05:38, 10.79s/it]
 51%|█████     | 19241/37963 [59:46:45<55:03:02, 10.59s/it]
 51%|█████     | 19242/37963 [59:47:01<64:18:45, 12.37s/it]
 51%|█████     | 19243/37963 [59:47:11<60:33:55, 11.65s/it]
 51%|█████     | 19244/37963 [59:47:21<57:15:52, 11.01s/it]
 51%|█████     | 19245/37963 [59:47:31<55:59:43, 10.77s/it]
 51%|█████     | 19246/37963 [59:47:47<64:04:52, 12.33s/it]
 51%|█████     | 19247/37963 [59:47:57<60:31:05, 11.64s/it]
 51%|█████     | 19248/37963 [59:48:07<58:04:13, 11.17s/it]
 51%|█████     | 19249/37963 [59:48:17<56:16:38, 10.83s/it]
 51%|█████     | 19250/37963 [59:48:27<55:01:54, 10.59s/it]
                                                           
{'loss': '0.1469', 'grad_norm': '2.08', 'learning_rate': '1.026e-05', 'epoch': '0.5071'}

 51%|█████     | 19250/37963 [59:48:27<55:01:54, 10.59s/it]
 51%|█████     | 19251/37963 [59:48:36<53:10:19, 10.23s/it]
 51%|█████     | 19252/37963 [59:48:46<52:57:03, 10.19s/it]
 51%|█████     | 19253/37963 [59:49:03<62:51:40, 12.10s/it]
 51%|█████     | 19254/37963 [59:49:13<59:11:29, 11.39s/it]
 51%|█████     | 19255/37963 [59:49:23<57:06:41, 10.99s/it]
 51%|█████     | 19256/37963 [59:49:33<55:44:47, 10.73s/it]
 51%|█████     | 19257/37963 [59:49:43<55:00:01, 10.58s/it]
 51%|█████     | 19258/37963 [59:49:53<53:33:41, 10.31s/it]
 51%|█████     | 19259/37963 [59:50:03<53:02:23, 10.21s/it]
 51%|█████     | 19260/37963 [59:50:13<52:49:39, 10.17s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '1.934', 'learning_rate': '1.025e-05', 'epoch': '0.5073'}

 51%|█████     | 19260/37963 [59:50:13<52:49:39, 10.17s/it]
 51%|█████     | 19261/37963 [59:50:23<52:39:11, 10.14s/it]
 51%|█████     | 19262/37963 [59:50:33<52:40:34, 10.14s/it]
 51%|█████     | 19263/37963 [59:50:43<52:12:00, 10.05s/it]
 51%|█████     | 19264/37963 [59:50:53<52:02:09, 10.02s/it]
 51%|█████     | 19265/37963 [59:51:03<51:55:18, 10.00s/it]
 51%|█████     | 19266/37963 [59:51:19<62:02:14, 11.94s/it]
 51%|█████     | 19267/37963 [59:51:35<68:31:52, 13.20s/it]
 51%|█████     | 19268/37963 [59:51:45<63:43:23, 12.27s/it]
 51%|█████     | 19269/37963 [59:51:55<59:47:43, 11.52s/it]
 51%|█████     | 19270/37963 [59:52:05<57:33:25, 11.08s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '2.084', 'learning_rate': '1.024e-05', 'epoch': '0.5076'}

 51%|█████     | 19270/37963 [59:52:05<57:33:25, 11.08s/it]
 51%|█████     | 19271/37963 [59:52:15<56:05:07, 10.80s/it]
 51%|█████     | 19272/37963 [59:52:25<54:20:30, 10.47s/it]
 51%|█████     | 19273/37963 [59:52:42<64:41:09, 12.46s/it]
 51%|█████     | 19274/37963 [59:52:52<60:34:10, 11.67s/it]
 51%|█████     | 19275/37963 [59:53:02<58:08:30, 11.20s/it]
 51%|█████     | 19276/37963 [59:53:12<56:21:35, 10.86s/it]
 51%|█████     | 19277/37963 [59:53:22<55:21:43, 10.67s/it]
 51%|█████     | 19278/37963 [59:53:33<54:33:48, 10.51s/it]
 51%|█████     | 19279/37963 [59:53:49<64:09:38, 12.36s/it]
 51%|█████     | 19280/37963 [59:53:59<60:37:09, 11.68s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '0.7762', 'learning_rate': '1.023e-05', 'epoch': '0.5079'}

 51%|█████     | 19280/37963 [59:53:59<60:37:09, 11.68s/it]
 51%|█████     | 19281/37963 [59:54:09<58:07:56, 11.20s/it]
 51%|█████     | 19282/37963 [59:54:20<56:29:51, 10.89s/it]
 51%|█████     | 19283/37963 [59:54:30<55:15:16, 10.65s/it]
 51%|█████     | 19284/37963 [59:54:40<54:19:44, 10.47s/it]
 51%|█████     | 19285/37963 [59:54:50<53:47:19, 10.37s/it]
 51%|█████     | 19286/37963 [59:55:06<63:25:44, 12.23s/it]
 51%|█████     | 19287/37963 [59:55:16<59:45:57, 11.52s/it]
 51%|█████     | 19288/37963 [59:55:26<57:16:18, 11.04s/it]
 51%|█████     | 19289/37963 [59:55:36<55:37:40, 10.72s/it]
 51%|█████     | 19290/37963 [59:55:53<64:22:46, 12.41s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '1.786', 'learning_rate': '1.022e-05', 'epoch': '0.5081'}

 51%|█████     | 19290/37963 [59:55:53<64:22:46, 12.41s/it]
 51%|█████     | 19291/37963 [59:56:03<60:31:02, 11.67s/it]
 51%|█████     | 19292/37963 [59:56:13<58:04:31, 11.20s/it]
 51%|█████     | 19293/37963 [59:56:29<66:45:49, 12.87s/it]
 51%|█████     | 19294/37963 [59:56:39<62:17:37, 12.01s/it]
 51%|█████     | 19295/37963 [59:56:49<59:08:39, 11.41s/it]
 51%|█████     | 19296/37963 [59:57:00<57:10:31, 11.03s/it]
 51%|█████     | 19297/37963 [59:57:10<55:50:27, 10.77s/it]
 51%|█████     | 19298/37963 [59:57:20<54:44:41, 10.56s/it]
 51%|█████     | 19299/37963 [59:57:30<53:59:20, 10.41s/it]
 51%|█████     | 19300/37963 [59:57:40<53:24:17, 10.30s/it]
                                                           
{'loss': '0.1548', 'grad_norm': '1.404', 'learning_rate': '1.021e-05', 'epoch': '0.5084'}

 51%|█████     | 19300/37963 [59:57:40<53:24:17, 10.30s/it]
 51%|█████     | 19301/37963 [59:57:57<63:19:18, 12.22s/it]
 51%|█████     | 19302/37963 [59:58:07<60:03:21, 11.59s/it]
 51%|█████     | 19303/37963 [59:58:17<57:43:06, 11.14s/it]
 51%|█████     | 19304/37963 [59:58:27<56:00:01, 10.80s/it]
 51%|█████     | 19305/37963 [59:58:37<54:51:23, 10.58s/it]
 51%|█████     | 19306/37963 [59:58:47<54:16:07, 10.47s/it]
 51%|█████     | 19307/37963 [59:58:57<53:35:32, 10.34s/it]
 51%|█████     | 19308/37963 [59:59:07<53:05:05, 10.24s/it]
 51%|█████     | 19309/37963 [59:59:17<52:53:39, 10.21s/it]
 51%|█████     | 19310/37963 [59:59:27<52:47:30, 10.19s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '1.275', 'learning_rate': '1.021e-05', 'epoch': '0.5087'}

 51%|█████     | 19310/37963 [59:59:27<52:47:30, 10.19s/it]
 51%|█████     | 19311/37963 [59:59:37<52:35:21, 10.15s/it]
 51%|█████     | 19312/37963 [59:59:47<52:12:46, 10.08s/it]
 51%|█████     | 19313/37963 [59:59:57<52:00:36, 10.04s/it]
 51%|█████     | 19314/37963 [60:00:07<52:11:48, 10.08s/it]
 51%|█████     | 19315/37963 [60:00:24<61:57:58, 11.96s/it]
 51%|█████     | 19316/37963 [60:00:34<59:07:04, 11.41s/it]
 51%|█████     | 19317/37963 [60:00:51<67:07:38, 12.96s/it]
 51%|█████     | 19318/37963 [60:01:01<62:43:03, 12.11s/it]
 51%|█████     | 19319/37963 [60:01:11<59:44:46, 11.54s/it]
 51%|█████     | 19320/37963 [60:01:21<57:07:15, 11.03s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '1.301', 'learning_rate': '1.02e-05', 'epoch': '0.5089'}

 51%|█████     | 19320/37963 [60:01:21<57:07:15, 11.03s/it]
 51%|█████     | 19321/37963 [60:01:37<65:39:06, 12.68s/it]
 51%|█████     | 19322/37963 [60:01:47<61:28:50, 11.87s/it]
 51%|█████     | 19323/37963 [60:01:57<58:34:47, 11.31s/it]
 51%|█████     | 19324/37963 [60:02:07<56:38:33, 10.94s/it]
 51%|█████     | 19325/37963 [60:02:17<55:14:21, 10.67s/it]
 51%|█████     | 19326/37963 [60:02:27<54:01:14, 10.43s/it]
 51%|█████     | 19327/37963 [60:02:37<53:33:13, 10.35s/it]
 51%|█████     | 19328/37963 [60:02:53<62:01:21, 11.98s/it]
 51%|█████     | 19329/37963 [60:03:03<59:12:23, 11.44s/it]
 51%|█████     | 19330/37963 [60:03:13<57:01:05, 11.02s/it]
                                                           
{'loss': '0.155', 'grad_norm': '2.345', 'learning_rate': '1.019e-05', 'epoch': '0.5092'}

 51%|█████     | 19330/37963 [60:03:13<57:01:05, 11.02s/it]
 51%|█████     | 19331/37963 [60:03:23<55:30:50, 10.73s/it]
 51%|█████     | 19332/37963 [60:03:33<53:45:26, 10.39s/it]
 51%|█████     | 19333/37963 [60:03:43<53:18:34, 10.30s/it]
 51%|█████     | 19334/37963 [60:03:59<62:18:34, 12.04s/it]
 51%|█████     | 19335/37963 [60:04:09<59:30:05, 11.50s/it]
 51%|█████     | 19336/37963 [60:04:20<57:19:25, 11.08s/it]
 51%|█████     | 19337/37963 [60:04:30<55:45:14, 10.78s/it]
 51%|█████     | 19338/37963 [60:04:46<64:38:12, 12.49s/it]
 51%|█████     | 19339/37963 [60:04:56<60:25:17, 11.68s/it]
 51%|█████     | 19340/37963 [60:05:06<58:05:11, 11.23s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '1.309', 'learning_rate': '1.018e-05', 'epoch': '0.5094'}

 51%|█████     | 19340/37963 [60:05:06<58:05:11, 11.23s/it]
 51%|█████     | 19341/37963 [60:05:23<67:07:01, 12.98s/it]
 51%|█████     | 19342/37963 [60:05:33<62:40:57, 12.12s/it]
 51%|█████     | 19343/37963 [60:05:43<59:07:21, 11.43s/it]
 51%|█████     | 19344/37963 [60:05:53<56:45:11, 10.97s/it]
 51%|█████     | 19345/37963 [60:06:03<55:02:43, 10.64s/it]
 51%|█████     | 19346/37963 [60:06:13<54:00:00, 10.44s/it]
 51%|█████     | 19347/37963 [60:06:23<53:36:36, 10.37s/it]
 51%|█████     | 19348/37963 [60:06:33<53:06:32, 10.27s/it]
 51%|█████     | 19349/37963 [60:06:43<52:48:41, 10.21s/it]
 51%|█████     | 19350/37963 [60:07:00<62:34:26, 12.10s/it]
                                                           
{'loss': '0.146', 'grad_norm': '3.291', 'learning_rate': '1.017e-05', 'epoch': '0.5097'}

 51%|█████     | 19350/37963 [60:07:00<62:34:26, 12.10s/it]
 51%|█████     | 19351/37963 [60:07:09<59:00:22, 11.41s/it]
 51%|█████     | 19352/37963 [60:07:20<57:03:44, 11.04s/it]
 51%|█████     | 19353/37963 [60:07:30<55:59:16, 10.83s/it]
 51%|█████     | 19354/37963 [60:07:40<54:53:32, 10.62s/it]
 51%|█████     | 19355/37963 [60:07:50<54:09:11, 10.48s/it]
 51%|█████     | 19356/37963 [60:08:00<53:30:45, 10.35s/it]
 51%|█████     | 19357/37963 [60:08:10<53:01:53, 10.26s/it]
 51%|█████     | 19358/37963 [60:08:20<52:37:41, 10.18s/it]
 51%|█████     | 19359/37963 [60:08:30<52:32:48, 10.17s/it]
 51%|█████     | 19360/37963 [60:08:41<52:19:46, 10.13s/it]
                                                           
{'loss': '0.1411', 'grad_norm': '1.503', 'learning_rate': '1.016e-05', 'epoch': '0.51'}

 51%|█████     | 19360/37963 [60:08:41<52:19:46, 10.13s/it]
 51%|█████     | 19361/37963 [60:08:50<52:00:52, 10.07s/it]
 51%|█████     | 19362/37963 [60:09:01<52:01:02, 10.07s/it]
 51%|█████     | 19363/37963 [60:09:10<50:57:38,  9.86s/it]
 51%|█████     | 19364/37963 [60:09:26<61:09:44, 11.84s/it]
 51%|█████     | 19365/37963 [60:09:42<67:46:31, 13.12s/it]
 51%|█████     | 19366/37963 [60:09:53<63:17:24, 12.25s/it]
 51%|█████     | 19367/37963 [60:10:03<60:00:15, 11.62s/it]
 51%|█████     | 19368/37963 [60:10:13<57:26:14, 11.12s/it]
 51%|█████     | 19369/37963 [60:10:23<55:38:43, 10.77s/it]
 51%|█████     | 19370/37963 [60:10:33<54:07:03, 10.48s/it]
                                                           
{'loss': '0.1471', 'grad_norm': '1.296', 'learning_rate': '1.016e-05', 'epoch': '0.5102'}

 51%|█████     | 19370/37963 [60:10:33<54:07:03, 10.48s/it]
 51%|█████     | 19371/37963 [60:10:42<53:08:08, 10.29s/it]
 51%|█████     | 19372/37963 [60:11:00<64:01:06, 12.40s/it]
 51%|█████     | 19373/37963 [60:11:10<60:00:26, 11.62s/it]
 51%|█████     | 19374/37963 [60:11:20<57:35:56, 11.15s/it]
 51%|█████     | 19375/37963 [60:11:30<56:05:50, 10.86s/it]
 51%|█████     | 19376/37963 [60:11:46<64:40:37, 12.53s/it]
 51%|█████     | 19377/37963 [60:11:56<60:37:37, 11.74s/it]
 51%|█████     | 19378/37963 [60:12:06<57:48:22, 11.20s/it]
 51%|█████     | 19379/37963 [60:12:16<56:03:33, 10.86s/it]
 51%|█████     | 19380/37963 [60:12:26<54:13:46, 10.51s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '2.574', 'learning_rate': '1.015e-05', 'epoch': '0.5105'}

 51%|█████     | 19380/37963 [60:12:26<54:13:46, 10.51s/it]
 51%|█████     | 19381/37963 [60:12:36<53:27:55, 10.36s/it]
 51%|█████     | 19382/37963 [60:12:52<62:49:39, 12.17s/it]
 51%|█████     | 19383/37963 [60:13:02<59:38:56, 11.56s/it]
 51%|█████     | 19384/37963 [60:13:12<57:19:59, 11.11s/it]
 51%|█████     | 19385/37963 [60:13:22<55:23:15, 10.73s/it]
 51%|█████     | 19386/37963 [60:13:32<53:58:37, 10.46s/it]
 51%|█████     | 19387/37963 [60:13:55<73:49:44, 14.31s/it]
 51%|█████     | 19388/37963 [60:14:05<67:21:24, 13.05s/it]
 51%|█████     | 19389/37963 [60:14:15<62:40:53, 12.15s/it]
 51%|█████     | 19390/37963 [60:14:25<59:19:34, 11.50s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '2.023', 'learning_rate': '1.014e-05', 'epoch': '0.5108'}

 51%|█████     | 19390/37963 [60:14:25<59:19:34, 11.50s/it]
 51%|█████     | 19391/37963 [60:14:35<56:34:29, 10.97s/it]
 51%|█████     | 19392/37963 [60:14:45<55:08:18, 10.69s/it]
 51%|█████     | 19393/37963 [60:14:55<53:47:30, 10.43s/it]
 51%|█████     | 19394/37963 [60:15:05<53:14:04, 10.32s/it]
 51%|█████     | 19395/37963 [60:15:15<52:47:17, 10.23s/it]
 51%|█████     | 19396/37963 [60:15:25<52:23:46, 10.16s/it]
 51%|█████     | 19397/37963 [60:15:35<52:13:55, 10.13s/it]
 51%|█████     | 19398/37963 [60:15:45<52:10:14, 10.12s/it]
 51%|█████     | 19399/37963 [60:16:02<61:39:50, 11.96s/it]
 51%|█████     | 19400/37963 [60:16:12<58:36:56, 11.37s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '1.377', 'learning_rate': '1.013e-05', 'epoch': '0.511'}

 51%|█████     | 19400/37963 [60:16:12<58:36:56, 11.37s/it]
 51%|█████     | 19401/37963 [60:16:22<56:45:34, 11.01s/it]
 51%|█████     | 19402/37963 [60:16:32<55:26:25, 10.75s/it]
 51%|█████     | 19403/37963 [60:16:42<54:17:26, 10.53s/it]
 51%|█████     | 19404/37963 [60:16:52<53:32:47, 10.39s/it]
 51%|█████     | 19405/37963 [60:17:02<53:04:05, 10.29s/it]
 51%|█████     | 19406/37963 [60:17:12<52:36:55, 10.21s/it]
 51%|█████     | 19407/37963 [60:17:22<52:07:35, 10.11s/it]
 51%|█████     | 19408/37963 [60:17:32<52:05:26, 10.11s/it]
 51%|█████     | 19409/37963 [60:17:42<51:57:33, 10.08s/it]
 51%|█████     | 19410/37963 [60:17:52<51:30:40, 10.00s/it]
                                                           
{'loss': '0.1371', 'grad_norm': '2.566', 'learning_rate': '1.012e-05', 'epoch': '0.5113'}

 51%|█████     | 19410/37963 [60:17:52<51:30:40, 10.00s/it]
 51%|█████     | 19411/37963 [60:18:02<51:38:51, 10.02s/it]
 51%|█████     | 19412/37963 [60:18:19<62:00:03, 12.03s/it]
 51%|█████     | 19413/37963 [60:18:29<59:14:04, 11.50s/it]
 51%|█████     | 19414/37963 [60:18:39<57:05:22, 11.08s/it]
 51%|█████     | 19415/37963 [60:18:49<55:41:39, 10.81s/it]
 51%|█████     | 19416/37963 [60:19:06<64:43:15, 12.56s/it]
 51%|█████     | 19417/37963 [60:19:16<60:23:23, 11.72s/it]
 51%|█████     | 19418/37963 [60:19:26<57:46:30, 11.22s/it]
 51%|█████     | 19419/37963 [60:19:36<55:54:43, 10.85s/it]
 51%|█████     | 19420/37963 [60:19:53<65:22:11, 12.69s/it]
                                                           
{'loss': '0.1379', 'grad_norm': '2.765', 'learning_rate': '1.011e-05', 'epoch': '0.5116'}

 51%|█████     | 19420/37963 [60:19:53<65:22:11, 12.69s/it]
 51%|█████     | 19421/37963 [60:20:02<60:44:38, 11.79s/it]
 51%|█████     | 19422/37963 [60:20:12<57:56:41, 11.25s/it]
 51%|█████     | 19423/37963 [60:20:22<55:32:50, 10.79s/it]
 51%|█████     | 19424/37963 [60:20:39<64:32:43, 12.53s/it]
 51%|█████     | 19425/37963 [60:20:49<60:46:15, 11.80s/it]
 51%|█████     | 19426/37963 [60:20:58<57:40:49, 11.20s/it]
 51%|█████     | 19427/37963 [60:21:08<55:20:05, 10.75s/it]
 51%|█████     | 19428/37963 [60:21:18<54:18:56, 10.55s/it]
 51%|█████     | 19429/37963 [60:21:28<53:17:14, 10.35s/it]
 51%|█████     | 19430/37963 [60:21:44<62:20:03, 12.11s/it]
                                                           
{'loss': '0.1401', 'grad_norm': '2.147', 'learning_rate': '1.01e-05', 'epoch': '0.5118'}

 51%|█████     | 19430/37963 [60:21:44<62:20:03, 12.11s/it]
 51%|█████     | 19431/37963 [60:21:55<59:21:57, 11.53s/it]
 51%|█████     | 19432/37963 [60:22:04<56:10:44, 10.91s/it]
 51%|█████     | 19433/37963 [60:22:14<55:03:39, 10.70s/it]
 51%|█████     | 19434/37963 [60:22:24<54:09:12, 10.52s/it]
 51%|█████     | 19435/37963 [60:22:41<63:19:17, 12.30s/it]
 51%|█████     | 19436/37963 [60:22:51<59:52:53, 11.64s/it]
 51%|█████     | 19437/37963 [60:23:07<67:36:57, 13.14s/it]
 51%|█████     | 19438/37963 [60:23:18<62:51:47, 12.22s/it]
 51%|█████     | 19439/37963 [60:23:28<59:32:02, 11.57s/it]
 51%|█████     | 19440/37963 [60:23:38<57:21:06, 11.15s/it]
                                                           
{'loss': '0.1365', 'grad_norm': '2.605', 'learning_rate': '1.01e-05', 'epoch': '0.5121'}

 51%|█████     | 19440/37963 [60:23:38<57:21:06, 11.15s/it]
 51%|█████     | 19441/37963 [60:23:48<55:44:06, 10.83s/it]
 51%|█████     | 19442/37963 [60:23:58<54:04:11, 10.51s/it]
 51%|█████     | 19443/37963 [60:24:08<53:21:50, 10.37s/it]
 51%|█████     | 19444/37963 [60:24:18<52:52:33, 10.28s/it]
 51%|█████     | 19445/37963 [60:24:34<61:58:47, 12.05s/it]
 51%|█████     | 19446/37963 [60:24:44<59:13:46, 11.52s/it]
 51%|█████     | 19447/37963 [60:24:54<57:04:52, 11.10s/it]
 51%|█████     | 19448/37963 [60:25:04<55:32:06, 10.80s/it]
 51%|█████     | 19449/37963 [60:25:15<54:31:27, 10.60s/it]
 51%|█████     | 19450/37963 [60:25:25<53:39:36, 10.43s/it]
                                                           
{'loss': '0.161', 'grad_norm': '1.54', 'learning_rate': '1.009e-05', 'epoch': '0.5123'}

 51%|█████     | 19450/37963 [60:25:25<53:39:36, 10.43s/it]
 51%|█████     | 19451/37963 [60:25:35<53:04:00, 10.32s/it]
 51%|█████     | 19452/37963 [60:25:45<52:22:51, 10.19s/it]
 51%|█████     | 19453/37963 [60:25:55<52:03:58, 10.13s/it]
 51%|█████     | 19454/37963 [60:26:04<51:27:19, 10.01s/it]
 51%|█████     | 19455/37963 [60:26:14<51:36:45, 10.04s/it]
 51%|█████     | 19456/37963 [60:26:24<51:14:19,  9.97s/it]
 51%|█████▏    | 19457/37963 [60:26:34<51:28:50, 10.01s/it]
 51%|█████▏    | 19458/37963 [60:26:44<51:31:46, 10.02s/it]
 51%|█████▏    | 19459/37963 [60:26:54<51:37:07, 10.04s/it]
 51%|█████▏    | 19460/37963 [60:27:11<61:59:56, 12.06s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '3.3', 'learning_rate': '1.008e-05', 'epoch': '0.5126'}

 51%|█████▏    | 19460/37963 [60:27:11<61:59:56, 12.06s/it]
 51%|█████▏    | 19461/37963 [60:27:21<58:56:38, 11.47s/it]
 51%|█████▏    | 19462/37963 [60:27:31<56:46:12, 11.05s/it]
 51%|█████▏    | 19463/37963 [60:27:42<55:26:25, 10.79s/it]
 51%|█████▏    | 19464/37963 [60:27:52<54:20:16, 10.57s/it]
 51%|█████▏    | 19465/37963 [60:28:08<63:33:42, 12.37s/it]
 51%|█████▏    | 19466/37963 [60:28:18<60:10:14, 11.71s/it]
 51%|█████▏    | 19467/37963 [60:28:28<57:28:12, 11.19s/it]
 51%|█████▏    | 19468/37963 [60:28:45<66:18:21, 12.91s/it]
 51%|█████▏    | 19469/37963 [60:28:55<61:56:39, 12.06s/it]
 51%|█████▏    | 19470/37963 [60:29:05<58:32:25, 11.40s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '1.287', 'learning_rate': '1.007e-05', 'epoch': '0.5129'}

 51%|█████▏    | 19470/37963 [60:29:05<58:32:25, 11.40s/it]
 51%|█████▏    | 19471/37963 [60:29:15<56:37:54, 11.03s/it]
 51%|█████▏    | 19472/37963 [60:29:32<65:00:10, 12.66s/it]
 51%|█████▏    | 19473/37963 [60:29:41<60:28:39, 11.77s/it]
 51%|█████▏    | 19474/37963 [60:29:52<57:49:47, 11.26s/it]
 51%|█████▏    | 19475/37963 [60:30:01<55:47:17, 10.86s/it]
 51%|█████▏    | 19476/37963 [60:30:12<54:36:18, 10.63s/it]
 51%|█████▏    | 19477/37963 [60:30:22<53:56:45, 10.51s/it]
 51%|█████▏    | 19478/37963 [60:30:38<63:10:47, 12.30s/it]
 51%|█████▏    | 19479/37963 [60:30:48<59:51:24, 11.66s/it]
 51%|█████▏    | 19480/37963 [60:30:59<57:31:37, 11.20s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '2.133', 'learning_rate': '1.006e-05', 'epoch': '0.5131'}

 51%|█████▏    | 19480/37963 [60:30:59<57:31:37, 11.20s/it]
 51%|█████▏    | 19481/37963 [60:31:08<55:16:26, 10.77s/it]
 51%|█████▏    | 19482/37963 [60:31:25<64:14:38, 12.51s/it]
 51%|█████▏    | 19483/37963 [60:31:35<60:25:21, 11.77s/it]
 51%|█████▏    | 19484/37963 [60:31:52<68:24:01, 13.33s/it]
 51%|█████▏    | 19485/37963 [60:32:02<63:06:36, 12.30s/it]
 51%|█████▏    | 19486/37963 [60:32:12<59:20:41, 11.56s/it]
 51%|█████▏    | 19487/37963 [60:32:21<56:29:11, 11.01s/it]
 51%|█████▏    | 19488/37963 [60:32:31<54:40:11, 10.65s/it]
 51%|█████▏    | 19489/37963 [60:32:41<53:38:48, 10.45s/it]
 51%|█████▏    | 19490/37963 [60:32:51<52:45:13, 10.28s/it]
                                                           
{'loss': '0.1261', 'grad_norm': '2.946', 'learning_rate': '1.005e-05', 'epoch': '0.5134'}

 51%|█████▏    | 19490/37963 [60:32:51<52:45:13, 10.28s/it]
 51%|█████▏    | 19491/37963 [60:33:01<52:09:34, 10.17s/it]
 51%|█████▏    | 19492/37963 [60:33:11<51:57:08, 10.13s/it]
 51%|█████▏    | 19493/37963 [60:33:21<51:53:04, 10.11s/it]
 51%|█████▏    | 19494/37963 [60:33:31<51:49:45, 10.10s/it]
 51%|█████▏    | 19495/37963 [60:33:48<61:47:07, 12.04s/it]
 51%|█████▏    | 19496/37963 [60:33:58<58:47:42, 11.46s/it]
 51%|█████▏    | 19497/37963 [60:34:08<56:40:20, 11.05s/it]
 51%|█████▏    | 19498/37963 [60:34:18<54:48:18, 10.68s/it]
 51%|█████▏    | 19499/37963 [60:34:27<53:17:26, 10.39s/it]
 51%|█████▏    | 19500/37963 [60:34:37<52:33:25, 10.25s/it]
                                                           
{'loss': '0.139', 'grad_norm': '1.193', 'learning_rate': '1.004e-05', 'epoch': '0.5137'}

 51%|█████▏    | 19500/37963 [60:34:37<52:33:25, 10.25s/it]
 51%|█████▏    | 19501/37963 [60:34:47<52:20:20, 10.21s/it]
 51%|█████▏    | 19502/37963 [60:34:58<52:20:15, 10.21s/it]
 51%|█████▏    | 19503/37963 [60:35:08<51:54:50, 10.12s/it]
 51%|█████▏    | 19504/37963 [60:35:17<51:05:39,  9.96s/it]
 51%|█████▏    | 19505/37963 [60:35:27<51:01:26,  9.95s/it]
 51%|█████▏    | 19506/37963 [60:35:37<51:16:00, 10.00s/it]
 51%|█████▏    | 19507/37963 [60:35:47<51:26:20, 10.03s/it]
 51%|█████▏    | 19508/37963 [60:35:57<51:27:41, 10.04s/it]
 51%|█████▏    | 19509/37963 [60:36:14<61:07:13, 11.92s/it]
 51%|█████▏    | 19510/37963 [60:36:23<57:27:19, 11.21s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '1.577', 'learning_rate': '1.004e-05', 'epoch': '0.5139'}

 51%|█████▏    | 19510/37963 [60:36:23<57:27:19, 11.21s/it]
 51%|█████▏    | 19511/37963 [60:36:33<55:43:48, 10.87s/it]
 51%|█████▏    | 19512/37963 [60:36:49<63:48:06, 12.45s/it]
 51%|█████▏    | 19513/37963 [60:36:59<59:23:31, 11.59s/it]
 51%|█████▏    | 19514/37963 [60:37:09<56:34:12, 11.04s/it]
 51%|█████▏    | 19515/37963 [60:37:19<54:48:41, 10.70s/it]
 51%|█████▏    | 19516/37963 [60:37:36<65:02:09, 12.69s/it]
 51%|█████▏    | 19517/37963 [60:37:46<61:03:48, 11.92s/it]
 51%|█████▏    | 19518/37963 [60:37:56<58:13:37, 11.36s/it]
 51%|█████▏    | 19519/37963 [60:38:06<56:10:41, 10.97s/it]
 51%|█████▏    | 19520/37963 [60:38:23<64:34:08, 12.60s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '1.57', 'learning_rate': '1.003e-05', 'epoch': '0.5142'}

 51%|█████▏    | 19520/37963 [60:38:23<64:34:08, 12.60s/it]
 51%|█████▏    | 19521/37963 [60:38:33<60:28:34, 11.81s/it]
 51%|█████▏    | 19522/37963 [60:38:43<57:54:44, 11.31s/it]
 51%|█████▏    | 19523/37963 [60:38:53<56:33:03, 11.04s/it]
 51%|█████▏    | 19524/37963 [60:39:03<55:00:43, 10.74s/it]
 51%|█████▏    | 19525/37963 [60:39:20<63:54:14, 12.48s/it]
 51%|█████▏    | 19526/37963 [60:39:30<59:47:06, 11.67s/it]
 51%|█████▏    | 19527/37963 [60:39:40<57:24:30, 11.21s/it]
 51%|█████▏    | 19528/37963 [60:39:50<55:35:19, 10.86s/it]
 51%|█████▏    | 19529/37963 [60:40:06<64:15:39, 12.55s/it]
 51%|█████▏    | 19530/37963 [60:40:23<71:10:29, 13.90s/it]
                                                           
{'loss': '0.156', 'grad_norm': '2.246', 'learning_rate': '1.002e-05', 'epoch': '0.5144'}

 51%|█████▏    | 19530/37963 [60:40:23<71:10:29, 13.90s/it]
 51%|█████▏    | 19531/37963 [60:40:33<65:28:01, 12.79s/it]
 51%|█████▏    | 19532/37963 [60:40:44<61:13:17, 11.96s/it]
 51%|█████▏    | 19533/37963 [60:40:53<57:55:35, 11.32s/it]
 51%|█████▏    | 19534/37963 [60:41:03<56:04:16, 10.95s/it]
 51%|█████▏    | 19535/37963 [60:41:14<54:54:07, 10.73s/it]
 51%|█████▏    | 19536/37963 [60:41:23<53:28:01, 10.45s/it]
 51%|█████▏    | 19537/37963 [60:41:33<52:53:40, 10.33s/it]
 51%|█████▏    | 19538/37963 [60:41:43<51:37:11, 10.09s/it]
 51%|█████▏    | 19539/37963 [60:41:53<51:36:17, 10.08s/it]
 51%|█████▏    | 19540/37963 [60:42:03<51:21:19, 10.04s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '1.292', 'learning_rate': '1.001e-05', 'epoch': '0.5147'}

 51%|█████▏    | 19540/37963 [60:42:03<51:21:19, 10.04s/it]
 51%|█████▏    | 19541/37963 [60:42:13<50:47:19,  9.93s/it]
 51%|█████▏    | 19542/37963 [60:42:23<51:01:17,  9.97s/it]
 51%|█████▏    | 19543/37963 [60:42:33<51:16:25, 10.02s/it]
 51%|█████▏    | 19544/37963 [60:42:50<61:33:33, 12.03s/it]
 51%|█████▏    | 19545/37963 [60:43:00<58:32:51, 11.44s/it]
 51%|█████▏    | 19546/37963 [60:43:10<56:28:17, 11.04s/it]
 51%|█████▏    | 19547/37963 [60:43:20<54:42:45, 10.70s/it]
 51%|█████▏    | 19548/37963 [60:43:30<53:46:38, 10.51s/it]
 51%|█████▏    | 19549/37963 [60:43:40<53:11:35, 10.40s/it]
 51%|█████▏    | 19550/37963 [60:43:50<52:47:13, 10.32s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '1.606', 'learning_rate': '1e-05', 'epoch': '0.515'}

 51%|█████▏    | 19550/37963 [60:43:50<52:47:13, 10.32s/it]
 52%|█████▏    | 19551/37963 [60:44:00<52:23:50, 10.24s/it]
 52%|█████▏    | 19552/37963 [60:44:10<52:02:51, 10.18s/it]
 52%|█████▏    | 19553/37963 [60:44:20<50:51:03,  9.94s/it]
 52%|█████▏    | 19554/37963 [60:44:30<50:59:12,  9.97s/it]
 52%|█████▏    | 19555/37963 [60:44:40<51:01:31,  9.98s/it]
 52%|█████▏    | 19556/37963 [60:44:49<50:32:14,  9.88s/it]
 52%|█████▏    | 19557/37963 [60:45:05<60:09:14, 11.77s/it]
 52%|█████▏    | 19558/37963 [60:45:15<56:58:55, 11.15s/it]
 52%|█████▏    | 19559/37963 [60:45:25<55:15:46, 10.81s/it]
 52%|█████▏    | 19560/37963 [60:45:41<63:45:13, 12.47s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '2.355', 'learning_rate': '9.993e-06', 'epoch': '0.5152'}

 52%|█████▏    | 19560/37963 [60:45:42<63:45:13, 12.47s/it]
 52%|█████▏    | 19561/37963 [60:45:51<59:57:01, 11.73s/it]
 52%|█████▏    | 19562/37963 [60:46:01<57:23:09, 11.23s/it]
 52%|█████▏    | 19563/37963 [60:46:12<55:46:16, 10.91s/it]
 52%|█████▏    | 19564/37963 [60:46:29<65:02:39, 12.73s/it]
 52%|█████▏    | 19565/37963 [60:46:39<61:01:17, 11.94s/it]
 52%|█████▏    | 19566/37963 [60:46:49<58:22:05, 11.42s/it]
 52%|█████▏    | 19567/37963 [60:46:59<56:29:25, 11.05s/it]
 52%|█████▏    | 19568/37963 [60:47:16<64:40:10, 12.66s/it]
 52%|█████▏    | 19569/37963 [60:47:25<60:29:47, 11.84s/it]
 52%|█████▏    | 19570/37963 [60:47:36<57:47:29, 11.31s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '1.139', 'learning_rate': '9.985e-06', 'epoch': '0.5155'}

 52%|█████▏    | 19570/37963 [60:47:36<57:47:29, 11.31s/it]
 52%|█████▏    | 19571/37963 [60:47:52<65:37:20, 12.84s/it]
 52%|█████▏    | 19572/37963 [60:48:02<61:19:39, 12.00s/it]
 52%|█████▏    | 19573/37963 [60:48:12<58:01:33, 11.36s/it]
 52%|█████▏    | 19574/37963 [60:48:22<56:07:17, 10.99s/it]
 52%|█████▏    | 19575/37963 [60:48:32<54:52:34, 10.74s/it]
 52%|█████▏    | 19576/37963 [60:48:42<53:56:15, 10.56s/it]
 52%|█████▏    | 19577/37963 [60:48:59<63:14:16, 12.38s/it]
 52%|█████▏    | 19578/37963 [60:49:16<69:56:32, 13.70s/it]
 52%|█████▏    | 19579/37963 [60:49:26<64:31:52, 12.64s/it]
 52%|█████▏    | 19580/37963 [60:49:36<60:38:34, 11.88s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '2.89', 'learning_rate': '9.976e-06', 'epoch': '0.5158'}

 52%|█████▏    | 19580/37963 [60:49:36<60:38:34, 11.88s/it]
 52%|█████▏    | 19581/37963 [60:49:46<57:56:20, 11.35s/it]
 52%|█████▏    | 19582/37963 [60:49:56<55:32:57, 10.88s/it]
 52%|█████▏    | 19583/37963 [60:50:06<54:02:37, 10.59s/it]
 52%|█████▏    | 19584/37963 [60:50:16<53:05:22, 10.40s/it]
 52%|█████▏    | 19585/37963 [60:50:26<52:40:31, 10.32s/it]
 52%|█████▏    | 19586/37963 [60:50:36<52:17:16, 10.24s/it]
 52%|█████▏    | 19587/37963 [60:50:46<52:05:55, 10.21s/it]
 52%|█████▏    | 19588/37963 [60:50:56<51:54:09, 10.17s/it]
 52%|█████▏    | 19589/37963 [60:51:06<51:43:51, 10.14s/it]
 52%|█████▏    | 19590/37963 [60:51:16<51:39:59, 10.12s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '1.259', 'learning_rate': '9.968e-06', 'epoch': '0.516'}

 52%|█████▏    | 19590/37963 [60:51:16<51:39:59, 10.12s/it]
 52%|█████▏    | 19591/37963 [60:51:26<51:18:51, 10.06s/it]
 52%|█████▏    | 19592/37963 [60:51:43<61:00:00, 11.95s/it]
 52%|█████▏    | 19593/37963 [60:51:53<57:57:00, 11.36s/it]
 52%|█████▏    | 19594/37963 [60:52:03<55:59:18, 10.97s/it]
 52%|█████▏    | 19595/37963 [60:52:12<53:52:17, 10.56s/it]
 52%|█████▏    | 19596/37963 [60:52:22<52:58:13, 10.38s/it]
 52%|█████▏    | 19597/37963 [60:52:32<52:37:59, 10.32s/it]
 52%|█████▏    | 19598/37963 [60:52:42<52:12:48, 10.24s/it]
 52%|█████▏    | 19599/37963 [60:52:52<51:25:05, 10.08s/it]
 52%|█████▏    | 19600/37963 [60:53:02<51:28:35, 10.09s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '1.462', 'learning_rate': '9.959e-06', 'epoch': '0.5163'}

 52%|█████▏    | 19600/37963 [60:53:02<51:28:35, 10.09s/it]
 52%|█████▏    | 19601/37963 [60:53:12<51:23:14, 10.07s/it]
 52%|█████▏    | 19602/37963 [60:53:22<51:24:31, 10.08s/it]
 52%|█████▏    | 19603/37963 [60:53:32<51:28:12, 10.09s/it]
 52%|█████▏    | 19604/37963 [60:53:42<51:02:52, 10.01s/it]
 52%|█████▏    | 19605/37963 [60:53:52<50:39:13,  9.93s/it]
 52%|█████▏    | 19606/37963 [60:54:02<50:57:01,  9.99s/it]
 52%|█████▏    | 19607/37963 [60:54:18<60:36:36, 11.89s/it]
 52%|█████▏    | 19608/37963 [60:54:35<67:32:20, 13.25s/it]
 52%|█████▏    | 19609/37963 [60:54:45<62:42:12, 12.30s/it]
 52%|█████▏    | 19610/37963 [60:54:55<59:15:37, 11.62s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '2.974', 'learning_rate': '9.951e-06', 'epoch': '0.5166'}

 52%|█████▏    | 19610/37963 [60:54:55<59:15:37, 11.62s/it]
 52%|█████▏    | 19611/37963 [60:55:05<56:02:36, 10.99s/it]
 52%|█████▏    | 19612/37963 [60:55:22<65:24:27, 12.83s/it]
 52%|█████▏    | 19613/37963 [60:55:31<60:33:38, 11.88s/it]
 52%|█████▏    | 19614/37963 [60:55:41<57:23:23, 11.26s/it]
 52%|█████▏    | 19615/37963 [60:55:51<55:34:16, 10.90s/it]
 52%|█████▏    | 19616/37963 [60:56:01<54:20:55, 10.66s/it]
 52%|█████▏    | 19617/37963 [60:56:11<53:17:48, 10.46s/it]
 52%|█████▏    | 19618/37963 [60:56:28<62:14:14, 12.21s/it]
 52%|█████▏    | 19619/37963 [60:56:44<68:56:11, 13.53s/it]
 52%|█████▏    | 19620/37963 [60:56:54<63:37:57, 12.49s/it]
                                                           
{'loss': '0.1459', 'grad_norm': '0.9847', 'learning_rate': '9.942e-06', 'epoch': '0.5168'}

 52%|█████▏    | 19620/37963 [60:56:54<63:37:57, 12.49s/it]
 52%|█████▏    | 19621/37963 [60:57:04<59:44:08, 11.72s/it]
 52%|█████▏    | 19622/37963 [60:57:14<57:13:36, 11.23s/it]
 52%|█████▏    | 19623/37963 [60:57:24<55:35:49, 10.91s/it]
 52%|█████▏    | 19624/37963 [60:57:34<54:15:15, 10.65s/it]
 52%|█████▏    | 19625/37963 [60:57:51<63:35:04, 12.48s/it]
 52%|█████▏    | 19626/37963 [60:58:01<59:51:19, 11.75s/it]
 52%|█████▏    | 19627/37963 [60:58:18<68:09:19, 13.38s/it]
 52%|█████▏    | 19628/37963 [60:58:29<63:02:20, 12.38s/it]
 52%|█████▏    | 19629/37963 [60:58:39<59:32:46, 11.69s/it]
 52%|█████▏    | 19630/37963 [60:58:49<56:48:59, 11.16s/it]
                                                           
{'loss': '0.1535', 'grad_norm': '1.44', 'learning_rate': '9.933e-06', 'epoch': '0.5171'}

 52%|█████▏    | 19630/37963 [60:58:49<56:48:59, 11.16s/it]
 52%|█████▏    | 19631/37963 [60:58:59<55:07:30, 10.83s/it]
 52%|█████▏    | 19632/37963 [60:59:09<54:03:36, 10.62s/it]
 52%|█████▏    | 19633/37963 [60:59:19<53:06:27, 10.43s/it]
 52%|█████▏    | 19634/37963 [60:59:29<52:36:35, 10.33s/it]
 52%|█████▏    | 19635/37963 [60:59:39<52:02:22, 10.22s/it]
 52%|█████▏    | 19636/37963 [60:59:49<51:51:41, 10.19s/it]
 52%|█████▏    | 19637/37963 [60:59:59<51:14:21, 10.07s/it]
 52%|█████▏    | 19638/37963 [61:00:09<51:12:53, 10.06s/it]
 52%|█████▏    | 19639/37963 [61:00:19<51:18:17, 10.08s/it]
 52%|█████▏    | 19640/37963 [61:00:35<61:14:19, 12.03s/it]
                                                           
{'loss': '0.1418', 'grad_norm': '1.623', 'learning_rate': '9.925e-06', 'epoch': '0.5173'}

 52%|█████▏    | 19640/37963 [61:00:35<61:14:19, 12.03s/it]
 52%|█████▏    | 19641/37963 [61:00:45<58:10:40, 11.43s/it]
 52%|█████▏    | 19642/37963 [61:00:56<56:11:57, 11.04s/it]
 52%|█████▏    | 19643/37963 [61:01:06<54:38:30, 10.74s/it]
 52%|█████▏    | 19644/37963 [61:01:16<53:48:34, 10.57s/it]
 52%|█████▏    | 19645/37963 [61:01:25<52:27:50, 10.31s/it]
 52%|█████▏    | 19646/37963 [61:01:36<52:05:38, 10.24s/it]
 52%|█████▏    | 19647/37963 [61:01:46<52:06:58, 10.24s/it]
 52%|█████▏    | 19648/37963 [61:01:56<51:49:41, 10.19s/it]
 52%|█████▏    | 19649/37963 [61:02:06<51:11:40, 10.06s/it]
 52%|█████▏    | 19650/37963 [61:02:15<50:49:38,  9.99s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '1.264', 'learning_rate': '9.916e-06', 'epoch': '0.5176'}

 52%|█████▏    | 19650/37963 [61:02:15<50:49:38,  9.99s/it]
 52%|█████▏    | 19651/37963 [61:02:26<51:04:34, 10.04s/it]
 52%|█████▏    | 19652/37963 [61:02:36<51:09:46, 10.06s/it]
 52%|█████▏    | 19653/37963 [61:02:46<51:15:19, 10.08s/it]
 52%|█████▏    | 19654/37963 [61:02:56<51:26:17, 10.11s/it]
 52%|█████▏    | 19655/37963 [61:03:13<61:20:08, 12.06s/it]
 52%|█████▏    | 19656/37963 [61:03:29<68:18:42, 13.43s/it]
 52%|█████▏    | 19657/37963 [61:03:39<63:05:33, 12.41s/it]
 52%|█████▏    | 19658/37963 [61:03:49<59:40:32, 11.74s/it]
 52%|█████▏    | 19659/37963 [61:04:00<57:16:34, 11.26s/it]
 52%|█████▏    | 19660/37963 [61:04:16<65:21:49, 12.86s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '2.056', 'learning_rate': '9.908e-06', 'epoch': '0.5179'}

 52%|█████▏    | 19660/37963 [61:04:16<65:21:49, 12.86s/it]
 52%|█████▏    | 19661/37963 [61:04:26<61:10:37, 12.03s/it]
 52%|█████▏    | 19662/37963 [61:04:36<58:02:17, 11.42s/it]
 52%|█████▏    | 19663/37963 [61:04:46<55:52:46, 10.99s/it]
 52%|█████▏    | 19664/37963 [61:04:56<54:17:28, 10.68s/it]
 52%|█████▏    | 19665/37963 [61:05:13<62:53:15, 12.37s/it]
 52%|█████▏    | 19666/37963 [61:05:23<59:23:41, 11.69s/it]
 52%|█████▏    | 19667/37963 [61:05:39<66:23:41, 13.06s/it]
 52%|█████▏    | 19668/37963 [61:05:49<61:46:26, 12.16s/it]
 52%|█████▏    | 19669/37963 [61:05:59<58:35:10, 11.53s/it]
 52%|█████▏    | 19670/37963 [61:06:09<56:20:24, 11.09s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '2.132', 'learning_rate': '9.899e-06', 'epoch': '0.5181'}

 52%|█████▏    | 19670/37963 [61:06:09<56:20:24, 11.09s/it]
 52%|█████▏    | 19671/37963 [61:06:19<54:40:37, 10.76s/it]
 52%|█████▏    | 19672/37963 [61:06:29<53:40:14, 10.56s/it]
 52%|█████▏    | 19673/37963 [61:06:46<62:35:25, 12.32s/it]
 52%|█████▏    | 19674/37963 [61:07:03<69:38:40, 13.71s/it]
 52%|█████▏    | 19675/37963 [61:07:13<64:02:57, 12.61s/it]
 52%|█████▏    | 19676/37963 [61:07:22<59:39:29, 11.74s/it]
 52%|█████▏    | 19677/37963 [61:07:32<56:53:19, 11.20s/it]
 52%|█████▏    | 19678/37963 [61:07:42<55:09:55, 10.86s/it]
 52%|█████▏    | 19679/37963 [61:07:52<53:32:09, 10.54s/it]
 52%|█████▏    | 19680/37963 [61:08:02<53:03:39, 10.45s/it]
                                                           
{'loss': '0.1363', 'grad_norm': '1.371', 'learning_rate': '9.891e-06', 'epoch': '0.5184'}

 52%|█████▏    | 19680/37963 [61:08:02<53:03:39, 10.45s/it]
 52%|█████▏    | 19681/37963 [61:08:12<52:08:59, 10.27s/it]
 52%|█████▏    | 19682/37963 [61:08:22<51:48:39, 10.20s/it]
 52%|█████▏    | 19683/37963 [61:08:32<51:38:43, 10.17s/it]
 52%|█████▏    | 19684/37963 [61:08:42<51:28:44, 10.14s/it]
 52%|█████▏    | 19685/37963 [61:08:53<51:28:05, 10.14s/it]
 52%|█████▏    | 19686/37963 [61:09:03<51:15:54, 10.10s/it]
 52%|█████▏    | 19687/37963 [61:09:19<60:46:31, 11.97s/it]
 52%|█████▏    | 19688/37963 [61:09:29<57:59:33, 11.42s/it]
 52%|█████▏    | 19689/37963 [61:09:39<55:46:04, 10.99s/it]
 52%|█████▏    | 19690/37963 [61:09:49<54:51:36, 10.81s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '2.216', 'learning_rate': '9.882e-06', 'epoch': '0.5187'}

 52%|█████▏    | 19690/37963 [61:09:49<54:51:36, 10.81s/it]
 52%|█████▏    | 19691/37963 [61:09:59<53:29:30, 10.54s/it]
 52%|█████▏    | 19692/37963 [61:10:09<52:43:20, 10.39s/it]
 52%|█████▏    | 19693/37963 [61:10:19<52:09:08, 10.28s/it]
 52%|█████▏    | 19694/37963 [61:10:30<51:56:56, 10.24s/it]
 52%|█████▏    | 19695/37963 [61:10:40<51:41:36, 10.19s/it]
 52%|█████▏    | 19696/37963 [61:10:50<51:33:10, 10.16s/it]
 52%|█████▏    | 19697/37963 [61:11:00<51:26:30, 10.14s/it]
 52%|█████▏    | 19698/37963 [61:11:10<50:59:04, 10.05s/it]
 52%|█████▏    | 19699/37963 [61:11:20<51:01:24, 10.06s/it]
 52%|█████▏    | 19700/37963 [61:11:30<50:47:11, 10.01s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '1.341', 'learning_rate': '9.874e-06', 'epoch': '0.5189'}

 52%|█████▏    | 19700/37963 [61:11:30<50:47:11, 10.01s/it]
 52%|█████▏    | 19701/37963 [61:11:40<50:39:21,  9.99s/it]
 52%|█████▏    | 19702/37963 [61:11:56<60:27:30, 11.92s/it]
 52%|█████▏    | 19703/37963 [61:12:06<57:44:54, 11.39s/it]
 52%|█████▏    | 19704/37963 [61:12:16<55:46:16, 11.00s/it]
 52%|█████▏    | 19705/37963 [61:12:33<64:20:52, 12.69s/it]
 52%|█████▏    | 19706/37963 [61:12:43<60:31:04, 11.93s/it]
 52%|█████▏    | 19707/37963 [61:12:53<57:52:18, 11.41s/it]
 52%|█████▏    | 19708/37963 [61:13:10<66:16:07, 13.07s/it]
 52%|█████▏    | 19709/37963 [61:13:20<61:49:55, 12.19s/it]
 52%|█████▏    | 19710/37963 [61:13:30<58:11:11, 11.48s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '1.852', 'learning_rate': '9.865e-06', 'epoch': '0.5192'}

 52%|█████▏    | 19710/37963 [61:13:30<58:11:11, 11.48s/it]
 52%|█████▏    | 19711/37963 [61:13:40<56:03:35, 11.06s/it]
 52%|█████▏    | 19712/37963 [61:13:50<54:29:44, 10.75s/it]
 52%|█████▏    | 19713/37963 [61:14:07<63:07:14, 12.45s/it]
 52%|█████▏    | 19714/37963 [61:14:17<59:34:28, 11.75s/it]
 52%|█████▏    | 19715/37963 [61:14:33<66:55:20, 13.20s/it]
 52%|█████▏    | 19716/37963 [61:14:43<62:11:12, 12.27s/it]
 52%|█████▏    | 19717/37963 [61:14:54<58:55:24, 11.63s/it]
 52%|█████▏    | 19718/37963 [61:15:04<56:36:30, 11.17s/it]
 52%|█████▏    | 19719/37963 [61:15:14<55:10:32, 10.89s/it]
 52%|█████▏    | 19720/37963 [61:15:24<53:59:04, 10.65s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '3.831', 'learning_rate': '9.857e-06', 'epoch': '0.5195'}

 52%|█████▏    | 19720/37963 [61:15:24<53:59:04, 10.65s/it]
 52%|█████▏    | 19721/37963 [61:15:41<63:00:45, 12.44s/it]
 52%|█████▏    | 19722/37963 [61:15:51<59:31:49, 11.75s/it]
 52%|█████▏    | 19723/37963 [61:16:08<67:26:53, 13.31s/it]
 52%|█████▏    | 19724/37963 [61:16:18<62:34:21, 12.35s/it]
 52%|█████▏    | 19725/37963 [61:16:28<59:14:27, 11.69s/it]
 52%|█████▏    | 19726/37963 [61:16:38<56:46:30, 11.21s/it]
 52%|█████▏    | 19727/37963 [61:16:48<55:01:33, 10.86s/it]
 52%|█████▏    | 19728/37963 [61:16:58<53:51:58, 10.63s/it]
 52%|█████▏    | 19729/37963 [61:17:08<53:07:38, 10.49s/it]
 52%|█████▏    | 19730/37963 [61:17:18<52:28:00, 10.36s/it]
                                                           
{'loss': '0.14', 'grad_norm': '1.014', 'learning_rate': '9.848e-06', 'epoch': '0.5197'}

 52%|█████▏    | 19730/37963 [61:17:18<52:28:00, 10.36s/it]
 52%|█████▏    | 19731/37963 [61:17:28<51:27:46, 10.16s/it]
 52%|█████▏    | 19732/37963 [61:17:38<51:16:18, 10.12s/it]
 52%|█████▏    | 19733/37963 [61:17:48<51:10:09, 10.10s/it]
 52%|█████▏    | 19734/37963 [61:17:58<51:05:53, 10.09s/it]
 52%|█████▏    | 19735/37963 [61:18:08<51:18:01, 10.13s/it]
 52%|█████▏    | 19736/37963 [61:18:24<60:15:39, 11.90s/it]
 52%|█████▏    | 19737/37963 [61:18:35<57:32:42, 11.37s/it]
 52%|█████▏    | 19738/37963 [61:18:45<55:36:32, 10.98s/it]
 52%|█████▏    | 19739/37963 [61:18:55<54:08:22, 10.69s/it]
 52%|█████▏    | 19740/37963 [61:19:05<52:50:20, 10.44s/it]
                                                           
{'loss': '0.1483', 'grad_norm': '2.591', 'learning_rate': '9.84e-06', 'epoch': '0.52'}

 52%|█████▏    | 19740/37963 [61:19:05<52:50:20, 10.44s/it]
 52%|█████▏    | 19741/37963 [61:19:15<52:25:34, 10.36s/it]
 52%|█████▏    | 19742/37963 [61:19:25<52:02:24, 10.28s/it]
 52%|█████▏    | 19743/37963 [61:19:35<51:31:25, 10.18s/it]
 52%|█████▏    | 19744/37963 [61:19:45<51:39:05, 10.21s/it]
 52%|█████▏    | 19745/37963 [61:19:55<51:38:49, 10.21s/it]
 52%|█████▏    | 19746/37963 [61:20:05<51:30:24, 10.18s/it]
 52%|█████▏    | 19747/37963 [61:20:15<51:10:03, 10.11s/it]
 52%|█████▏    | 19748/37963 [61:20:25<51:14:04, 10.13s/it]
 52%|█████▏    | 19749/37963 [61:20:42<60:39:55, 11.99s/it]
 52%|█████▏    | 19750/37963 [61:20:52<57:49:36, 11.43s/it]
                                                           
{'loss': '0.1582', 'grad_norm': '1.829', 'learning_rate': '9.831e-06', 'epoch': '0.5202'}

 52%|█████▏    | 19750/37963 [61:20:52<57:49:36, 11.43s/it]
 52%|█████▏    | 19751/37963 [61:21:02<55:42:02, 11.01s/it]
 52%|█████▏    | 19752/37963 [61:21:12<53:30:58, 10.58s/it]
 52%|█████▏    | 19753/37963 [61:21:28<61:46:31, 12.21s/it]
 52%|█████▏    | 19754/37963 [61:21:38<58:38:30, 11.59s/it]
 52%|█████▏    | 19755/37963 [61:21:47<55:50:19, 11.04s/it]
 52%|█████▏    | 19756/37963 [61:21:58<54:34:25, 10.79s/it]
 52%|█████▏    | 19757/37963 [61:22:15<63:55:12, 12.64s/it]
 52%|█████▏    | 19758/37963 [61:22:25<60:51:35, 12.03s/it]
 52%|█████▏    | 19759/37963 [61:22:35<57:45:56, 11.42s/it]
 52%|█████▏    | 19760/37963 [61:22:45<55:45:51, 11.03s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '1.671', 'learning_rate': '9.823e-06', 'epoch': '0.5205'}

 52%|█████▏    | 19760/37963 [61:22:45<55:45:51, 11.03s/it]
 52%|█████▏    | 19761/37963 [61:22:56<54:31:15, 10.78s/it]
 52%|█████▏    | 19762/37963 [61:23:12<63:30:38, 12.56s/it]
 52%|█████▏    | 19763/37963 [61:23:29<69:26:19, 13.74s/it]
 52%|█████▏    | 19764/37963 [61:23:39<63:47:04, 12.62s/it]
 52%|█████▏    | 19765/37963 [61:23:49<59:54:24, 11.85s/it]
 52%|█████▏    | 19766/37963 [61:23:59<57:11:49, 11.32s/it]
 52%|█████▏    | 19767/37963 [61:24:09<54:49:15, 10.85s/it]
 52%|█████▏    | 19768/37963 [61:24:25<62:54:38, 12.45s/it]
 52%|█████▏    | 19769/37963 [61:24:35<59:00:58, 11.68s/it]
 52%|█████▏    | 19770/37963 [61:24:45<56:37:34, 11.21s/it]
                                                           
{'loss': '0.1392', 'grad_norm': '2.845', 'learning_rate': '9.814e-06', 'epoch': '0.5208'}

 52%|█████▏    | 19770/37963 [61:24:45<56:37:34, 11.21s/it]
 52%|█████▏    | 19771/37963 [61:24:55<54:27:22, 10.78s/it]
 52%|█████▏    | 19772/37963 [61:25:11<62:45:18, 12.42s/it]
 52%|█████▏    | 19773/37963 [61:25:21<59:21:37, 11.75s/it]
 52%|█████▏    | 19774/37963 [61:25:31<56:46:33, 11.24s/it]
 52%|█████▏    | 19775/37963 [61:25:41<54:44:35, 10.84s/it]
 52%|█████▏    | 19776/37963 [61:25:51<53:34:14, 10.60s/it]
 52%|█████▏    | 19777/37963 [61:26:01<52:49:13, 10.46s/it]
 52%|█████▏    | 19778/37963 [61:26:11<52:03:18, 10.31s/it]
 52%|█████▏    | 19779/37963 [61:26:21<51:37:44, 10.22s/it]
 52%|█████▏    | 19780/37963 [61:26:31<51:20:52, 10.17s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '1.153', 'learning_rate': '9.805e-06', 'epoch': '0.521'}

 52%|█████▏    | 19780/37963 [61:26:31<51:20:52, 10.17s/it]
 52%|█████▏    | 19781/37963 [61:26:41<51:12:01, 10.14s/it]
 52%|█████▏    | 19782/37963 [61:26:58<60:49:46, 12.04s/it]
 52%|█████▏    | 19783/37963 [61:27:08<57:49:19, 11.45s/it]
 52%|█████▏    | 19784/37963 [61:27:18<55:43:41, 11.04s/it]
 52%|█████▏    | 19785/37963 [61:27:28<53:50:15, 10.66s/it]
 52%|█████▏    | 19786/37963 [61:27:38<52:49:30, 10.46s/it]
 52%|█████▏    | 19787/37963 [61:27:48<52:15:18, 10.35s/it]
 52%|█████▏    | 19788/37963 [61:27:58<51:51:58, 10.27s/it]
 52%|█████▏    | 19789/37963 [61:28:07<50:50:05, 10.07s/it]
 52%|█████▏    | 19790/37963 [61:28:17<49:48:04,  9.87s/it]
                                                           
{'loss': '0.1365', 'grad_norm': '0.9343', 'learning_rate': '9.797e-06', 'epoch': '0.5213'}

 52%|█████▏    | 19790/37963 [61:28:17<49:48:04,  9.87s/it]
 52%|█████▏    | 19791/37963 [61:28:27<50:01:45,  9.91s/it]
 52%|█████▏    | 19792/37963 [61:28:37<49:43:28,  9.85s/it]
 52%|█████▏    | 19793/37963 [61:28:47<50:13:12,  9.95s/it]
 52%|█████▏    | 19794/37963 [61:28:57<50:14:12,  9.95s/it]
 52%|█████▏    | 19795/37963 [61:29:07<50:08:33,  9.94s/it]
 52%|█████▏    | 19796/37963 [61:29:17<50:20:45,  9.98s/it]
 52%|█████▏    | 19797/37963 [61:29:27<50:43:19, 10.05s/it]
 52%|█████▏    | 19798/37963 [61:29:43<60:25:13, 11.97s/it]
 52%|█████▏    | 19799/37963 [61:29:53<57:33:31, 11.41s/it]
 52%|█████▏    | 19800/37963 [61:30:04<55:39:00, 11.03s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '1.518', 'learning_rate': '9.788e-06', 'epoch': '0.5216'}

 52%|█████▏    | 19800/37963 [61:30:04<55:39:00, 11.03s/it]
 52%|█████▏    | 19801/37963 [61:30:20<63:23:37, 12.57s/it]
 52%|█████▏    | 19802/37963 [61:30:30<59:31:10, 11.80s/it]
 52%|█████▏    | 19803/37963 [61:30:40<56:49:42, 11.27s/it]
 52%|█████▏    | 19804/37963 [61:30:50<54:59:12, 10.90s/it]
 52%|█████▏    | 19805/37963 [61:31:07<64:05:27, 12.71s/it]
 52%|█████▏    | 19806/37963 [61:31:17<60:01:38, 11.90s/it]
 52%|█████▏    | 19807/37963 [61:31:27<56:49:56, 11.27s/it]
 52%|█████▏    | 19808/37963 [61:31:37<55:02:21, 10.91s/it]
 52%|█████▏    | 19809/37963 [61:31:47<53:45:09, 10.66s/it]
 52%|█████▏    | 19810/37963 [61:32:03<62:43:53, 12.44s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '2.402', 'learning_rate': '9.78e-06', 'epoch': '0.5218'}

 52%|█████▏    | 19810/37963 [61:32:03<62:43:53, 12.44s/it]
 52%|█████▏    | 19811/37963 [61:32:13<59:10:24, 11.74s/it]
 52%|█████▏    | 19812/37963 [61:32:30<66:28:39, 13.18s/it]
 52%|█████▏    | 19813/37963 [61:32:40<61:47:01, 12.25s/it]
 52%|█████▏    | 19814/37963 [61:32:50<58:14:59, 11.55s/it]
 52%|█████▏    | 19815/37963 [61:33:00<56:02:53, 11.12s/it]
 52%|█████▏    | 19816/37963 [61:33:17<64:16:52, 12.75s/it]
 52%|█████▏    | 19817/37963 [61:33:26<59:56:39, 11.89s/it]
 52%|█████▏    | 19818/37963 [61:33:36<56:48:19, 11.27s/it]
 52%|█████▏    | 19819/37963 [61:33:46<55:07:08, 10.94s/it]
 52%|█████▏    | 19820/37963 [61:33:57<54:03:28, 10.73s/it]
                                                           
{'loss': '0.1365', 'grad_norm': '1.13', 'learning_rate': '9.771e-06', 'epoch': '0.5221'}

 52%|█████▏    | 19820/37963 [61:33:57<54:03:28, 10.73s/it]
 52%|█████▏    | 19821/37963 [61:34:07<52:59:17, 10.51s/it]
 52%|█████▏    | 19822/37963 [61:34:24<63:04:05, 12.52s/it]
 52%|█████▏    | 19823/37963 [61:34:34<59:24:43, 11.79s/it]
 52%|█████▏    | 19824/37963 [61:34:44<56:49:48, 11.28s/it]
 52%|█████▏    | 19825/37963 [61:34:54<55:01:35, 10.92s/it]
 52%|█████▏    | 19826/37963 [61:35:04<54:06:44, 10.74s/it]
 52%|█████▏    | 19827/37963 [61:35:14<52:57:55, 10.51s/it]
 52%|█████▏    | 19828/37963 [61:35:25<52:22:28, 10.40s/it]
 52%|█████▏    | 19829/37963 [61:35:35<51:51:32, 10.30s/it]
 52%|█████▏    | 19830/37963 [61:35:51<60:37:48, 12.04s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '1.385', 'learning_rate': '9.763e-06', 'epoch': '0.5224'}

 52%|█████▏    | 19830/37963 [61:35:51<60:37:48, 12.04s/it]
 52%|█████▏    | 19831/37963 [61:36:01<57:37:50, 11.44s/it]
 52%|█████▏    | 19832/37963 [61:36:11<55:37:07, 11.04s/it]
 52%|█████▏    | 19833/37963 [61:36:21<53:39:09, 10.65s/it]
 52%|█████▏    | 19834/37963 [61:36:31<52:52:38, 10.50s/it]
 52%|█████▏    | 19835/37963 [61:36:41<51:56:30, 10.32s/it]
 52%|█████▏    | 19836/37963 [61:36:51<51:19:31, 10.19s/it]
 52%|█████▏    | 19837/37963 [61:37:01<51:23:39, 10.21s/it]
 52%|█████▏    | 19838/37963 [61:37:11<51:06:33, 10.15s/it]
 52%|█████▏    | 19839/37963 [61:37:21<50:58:55, 10.13s/it]
 52%|█████▏    | 19840/37963 [61:37:31<50:12:20,  9.97s/it]
                                                           
{'loss': '0.1408', 'grad_norm': '2.879', 'learning_rate': '9.754e-06', 'epoch': '0.5226'}

 52%|█████▏    | 19840/37963 [61:37:31<50:12:20,  9.97s/it]
 52%|█████▏    | 19841/37963 [61:37:41<50:15:58,  9.99s/it]
 52%|█████▏    | 19842/37963 [61:37:51<50:21:11, 10.00s/it]
 52%|█████▏    | 19843/37963 [61:38:00<50:09:04,  9.96s/it]
 52%|█████▏    | 19844/37963 [61:38:11<50:17:40,  9.99s/it]
 52%|█████▏    | 19845/37963 [61:38:21<50:28:46, 10.03s/it]
 52%|█████▏    | 19846/37963 [61:38:31<50:34:23, 10.05s/it]
 52%|█████▏    | 19847/37963 [61:38:48<60:50:08, 12.09s/it]
 52%|█████▏    | 19848/37963 [61:39:04<66:35:51, 13.23s/it]
 52%|█████▏    | 19849/37963 [61:39:14<61:46:01, 12.28s/it]
 52%|█████▏    | 19850/37963 [61:39:23<57:47:12, 11.49s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '1.104', 'learning_rate': '9.746e-06', 'epoch': '0.5229'}

 52%|█████▏    | 19850/37963 [61:39:23<57:47:12, 11.49s/it]
 52%|█████▏    | 19851/37963 [61:39:33<55:16:53, 10.99s/it]
 52%|█████▏    | 19852/37963 [61:39:43<53:23:07, 10.61s/it]
 52%|█████▏    | 19853/37963 [61:39:53<52:39:44, 10.47s/it]
 52%|█████▏    | 19854/37963 [61:40:10<62:15:46, 12.38s/it]
 52%|█████▏    | 19855/37963 [61:40:20<58:41:03, 11.67s/it]
 52%|█████▏    | 19856/37963 [61:40:30<56:22:35, 11.21s/it]
 52%|█████▏    | 19857/37963 [61:40:40<54:36:51, 10.86s/it]
 52%|█████▏    | 19858/37963 [61:40:50<53:28:40, 10.63s/it]
 52%|█████▏    | 19859/37963 [61:41:07<62:38:20, 12.46s/it]
 52%|█████▏    | 19860/37963 [61:41:23<68:43:25, 13.67s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '0.8778', 'learning_rate': '9.737e-06', 'epoch': '0.5231'}

 52%|█████▏    | 19860/37963 [61:41:23<68:43:25, 13.67s/it]
 52%|█████▏    | 19861/37963 [61:41:33<63:17:26, 12.59s/it]
 52%|█████▏    | 19862/37963 [61:41:43<59:19:02, 11.80s/it]
 52%|█████▏    | 19863/37963 [61:41:53<56:43:43, 11.28s/it]
 52%|█████▏    | 19864/37963 [61:42:03<54:16:10, 10.79s/it]
 52%|█████▏    | 19865/37963 [61:42:20<63:12:38, 12.57s/it]
 52%|█████▏    | 19866/37963 [61:42:30<59:37:10, 11.86s/it]
 52%|█████▏    | 19867/37963 [61:42:40<56:59:23, 11.34s/it]
 52%|█████▏    | 19868/37963 [61:42:50<55:10:24, 10.98s/it]
 52%|█████▏    | 19869/37963 [61:43:00<53:55:00, 10.73s/it]
 52%|█████▏    | 19870/37963 [61:43:17<63:16:50, 12.59s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '1.523', 'learning_rate': '9.729e-06', 'epoch': '0.5234'}

 52%|█████▏    | 19870/37963 [61:43:17<63:16:50, 12.59s/it]
 52%|█████▏    | 19871/37963 [61:43:27<59:27:46, 11.83s/it]
 52%|█████▏    | 19872/37963 [61:43:37<56:31:17, 11.25s/it]
 52%|█████▏    | 19873/37963 [61:43:47<54:34:00, 10.86s/it]
 52%|█████▏    | 19874/37963 [61:43:57<53:32:08, 10.65s/it]
 52%|█████▏    | 19875/37963 [61:44:07<52:09:00, 10.38s/it]
 52%|█████▏    | 19876/37963 [61:44:17<51:30:56, 10.25s/it]
 52%|█████▏    | 19877/37963 [61:44:27<50:51:40, 10.12s/it]
 52%|█████▏    | 19878/37963 [61:44:43<60:41:31, 12.08s/it]
 52%|█████▏    | 19879/37963 [61:44:54<57:45:19, 11.50s/it]
 52%|█████▏    | 19880/37963 [61:45:04<55:46:08, 11.10s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '1.929', 'learning_rate': '9.72e-06', 'epoch': '0.5237'}

 52%|█████▏    | 19880/37963 [61:45:04<55:46:08, 11.10s/it]
 52%|█████▏    | 19881/37963 [61:45:14<54:18:25, 10.81s/it]
 52%|█████▏    | 19882/37963 [61:45:24<53:24:38, 10.63s/it]
 52%|█████▏    | 19883/37963 [61:45:34<52:36:06, 10.47s/it]
 52%|█████▏    | 19884/37963 [61:45:44<51:59:47, 10.35s/it]
 52%|█████▏    | 19885/37963 [61:45:54<51:34:40, 10.27s/it]
 52%|█████▏    | 19886/37963 [61:46:04<50:58:04, 10.15s/it]
 52%|█████▏    | 19887/37963 [61:46:14<50:58:16, 10.15s/it]
 52%|█████▏    | 19888/37963 [61:46:25<50:52:24, 10.13s/it]
 52%|█████▏    | 19889/37963 [61:46:35<50:47:44, 10.12s/it]
 52%|█████▏    | 19890/37963 [61:46:45<50:42:54, 10.10s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '1.765', 'learning_rate': '9.712e-06', 'epoch': '0.5239'}

 52%|█████▏    | 19890/37963 [61:46:45<50:42:54, 10.10s/it]
 52%|█████▏    | 19891/37963 [61:46:55<50:46:17, 10.11s/it]
 52%|█████▏    | 19892/37963 [61:47:05<50:46:25, 10.11s/it]
 52%|█████▏    | 19893/37963 [61:47:15<50:41:50, 10.10s/it]
 52%|█████▏    | 19894/37963 [61:47:31<60:09:11, 11.98s/it]
 52%|█████▏    | 19895/37963 [61:47:41<57:22:27, 11.43s/it]
 52%|█████▏    | 19896/37963 [61:47:52<55:19:12, 11.02s/it]
 52%|█████▏    | 19897/37963 [61:48:02<53:59:03, 10.76s/it]
 52%|█████▏    | 19898/37963 [61:48:18<62:56:02, 12.54s/it]
 52%|█████▏    | 19899/37963 [61:48:28<58:59:35, 11.76s/it]
 52%|█████▏    | 19900/37963 [61:48:38<55:51:32, 11.13s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '1.909', 'learning_rate': '9.703e-06', 'epoch': '0.5242'}

 52%|█████▏    | 19900/37963 [61:48:38<55:51:32, 11.13s/it]
 52%|█████▏    | 19901/37963 [61:48:48<53:56:33, 10.75s/it]
 52%|█████▏    | 19902/37963 [61:49:05<63:20:54, 12.63s/it]
 52%|█████▏    | 19903/37963 [61:49:15<59:28:13, 11.85s/it]
 52%|█████▏    | 19904/37963 [61:49:25<56:44:29, 11.31s/it]
 52%|█████▏    | 19905/37963 [61:49:35<54:50:04, 10.93s/it]
 52%|█████▏    | 19906/37963 [61:49:44<52:32:10, 10.47s/it]
 52%|█████▏    | 19907/37963 [61:50:01<61:32:41, 12.27s/it]
 52%|█████▏    | 19908/37963 [61:50:17<67:16:44, 13.41s/it]
 52%|█████▏    | 19909/37963 [61:50:27<62:07:40, 12.39s/it]
 52%|█████▏    | 19910/37963 [61:50:37<58:07:08, 11.59s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '1.574', 'learning_rate': '9.695e-06', 'epoch': '0.5245'}

 52%|█████▏    | 19910/37963 [61:50:37<58:07:08, 11.59s/it]
 52%|█████▏    | 19911/37963 [61:50:47<55:49:47, 11.13s/it]
 52%|█████▏    | 19912/37963 [61:50:57<54:26:52, 10.86s/it]
 52%|█████▏    | 19913/37963 [61:51:13<62:38:44, 12.49s/it]
 52%|█████▏    | 19914/37963 [61:51:23<58:59:21, 11.77s/it]
 52%|█████▏    | 19915/37963 [61:51:33<56:29:46, 11.27s/it]
 52%|█████▏    | 19916/37963 [61:51:44<54:47:18, 10.93s/it]
 52%|█████▏    | 19917/37963 [61:51:54<53:29:18, 10.67s/it]
 52%|█████▏    | 19918/37963 [61:52:11<62:49:21, 12.53s/it]
 52%|█████▏    | 19919/37963 [61:52:21<59:16:53, 11.83s/it]
 52%|█████▏    | 19920/37963 [61:52:31<56:44:17, 11.32s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '1.378', 'learning_rate': '9.686e-06', 'epoch': '0.5247'}

 52%|█████▏    | 19920/37963 [61:52:31<56:44:17, 11.32s/it]
 52%|█████▏    | 19921/37963 [61:52:40<53:54:20, 10.76s/it]
 52%|█████▏    | 19922/37963 [61:52:50<52:53:22, 10.55s/it]
 52%|█████▏    | 19923/37963 [61:53:00<52:12:08, 10.42s/it]
 52%|█████▏    | 19924/37963 [61:53:11<51:40:09, 10.31s/it]
 52%|█████▏    | 19925/37963 [61:53:21<51:21:48, 10.25s/it]
 52%|█████▏    | 19926/37963 [61:53:31<51:04:53, 10.20s/it]
 52%|█████▏    | 19927/37963 [61:53:47<60:07:28, 12.00s/it]
 52%|█████▏    | 19928/37963 [61:53:57<57:12:37, 11.42s/it]
 52%|█████▏    | 19929/37963 [61:54:07<55:13:35, 11.02s/it]
 52%|█████▏    | 19930/37963 [61:54:17<53:51:11, 10.75s/it]
                                                           
{'loss': '0.1435', 'grad_norm': '2.355', 'learning_rate': '9.678e-06', 'epoch': '0.525'}

 52%|█████▏    | 19930/37963 [61:54:17<53:51:11, 10.75s/it]
 53%|█████▎    | 19931/37963 [61:54:27<52:52:16, 10.56s/it]
 53%|█████▎    | 19932/37963 [61:54:37<52:13:54, 10.43s/it]
 53%|█████▎    | 19933/37963 [61:54:47<51:38:38, 10.31s/it]
 53%|█████▎    | 19934/37963 [61:54:58<51:23:01, 10.26s/it]
 53%|█████▎    | 19935/37963 [61:55:07<50:45:48, 10.14s/it]
 53%|█████▎    | 19936/37963 [61:55:17<50:34:21, 10.10s/it]
 53%|█████▎    | 19937/37963 [61:55:28<50:34:43, 10.10s/it]
 53%|█████▎    | 19938/37963 [61:55:38<50:30:06, 10.09s/it]
 53%|█████▎    | 19939/37963 [61:55:48<50:39:28, 10.12s/it]
 53%|█████▎    | 19940/37963 [61:55:58<50:19:53, 10.05s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '1.5', 'learning_rate': '9.669e-06', 'epoch': '0.5252'}

 53%|█████▎    | 19940/37963 [61:55:58<50:19:53, 10.05s/it]
 53%|█████▎    | 19941/37963 [61:56:08<50:23:40, 10.07s/it]
 53%|█████▎    | 19942/37963 [61:56:18<50:17:07, 10.05s/it]
 53%|█████▎    | 19943/37963 [61:56:28<49:57:14,  9.98s/it]
 53%|█████▎    | 19944/37963 [61:56:44<59:36:39, 11.91s/it]
 53%|█████▎    | 19945/37963 [61:56:54<56:11:10, 11.23s/it]
 53%|█████▎    | 19946/37963 [61:57:10<64:10:38, 12.82s/it]
 53%|█████▎    | 19947/37963 [61:57:20<59:25:23, 11.87s/it]
 53%|█████▎    | 19948/37963 [61:57:30<56:43:48, 11.34s/it]
 53%|█████▎    | 19949/37963 [61:57:40<54:59:14, 10.99s/it]
 53%|█████▎    | 19950/37963 [61:57:50<53:37:16, 10.72s/it]
                                                           
{'loss': '0.161', 'grad_norm': '1.906', 'learning_rate': '9.661e-06', 'epoch': '0.5255'}

 53%|█████▎    | 19950/37963 [61:57:50<53:37:16, 10.72s/it]
 53%|█████▎    | 19951/37963 [61:58:07<63:21:21, 12.66s/it]
 53%|█████▎    | 19952/37963 [61:58:18<59:38:20, 11.92s/it]
 53%|█████▎    | 19953/37963 [61:58:28<56:34:48, 11.31s/it]
 53%|█████▎    | 19954/37963 [61:58:38<54:59:06, 10.99s/it]
 53%|█████▎    | 19955/37963 [61:58:54<63:21:18, 12.67s/it]
 53%|█████▎    | 19956/37963 [61:59:04<58:57:28, 11.79s/it]
 53%|█████▎    | 19957/37963 [61:59:21<65:57:56, 13.19s/it]
 53%|█████▎    | 19958/37963 [61:59:31<61:11:35, 12.24s/it]
 53%|█████▎    | 19959/37963 [61:59:41<57:50:22, 11.57s/it]
 53%|█████▎    | 19960/37963 [61:59:51<55:40:40, 11.13s/it]
                                                           
{'loss': '0.1375', 'grad_norm': '1.104', 'learning_rate': '9.652e-06', 'epoch': '0.5258'}

 53%|█████▎    | 19960/37963 [61:59:51<55:40:40, 11.13s/it]
 53%|█████▎    | 19961/37963 [62:00:07<63:57:31, 12.79s/it]
 53%|█████▎    | 19962/37963 [62:00:17<59:49:01, 11.96s/it]
 53%|█████▎    | 19963/37963 [62:00:27<57:00:21, 11.40s/it]
 53%|█████▎    | 19964/37963 [62:00:37<54:43:18, 10.94s/it]
 53%|█████▎    | 19965/37963 [62:00:48<53:42:30, 10.74s/it]
 53%|█████▎    | 19966/37963 [62:00:58<52:42:11, 10.54s/it]
 53%|█████▎    | 19967/37963 [62:01:14<62:02:37, 12.41s/it]
 53%|█████▎    | 19968/37963 [62:01:25<58:45:57, 11.76s/it]
 53%|█████▎    | 19969/37963 [62:01:35<56:17:25, 11.26s/it]
 53%|█████▎    | 19970/37963 [62:01:45<54:22:58, 10.88s/it]
                                                           
{'loss': '0.1429', 'grad_norm': '3.948', 'learning_rate': '9.643e-06', 'epoch': '0.526'}

 53%|█████▎    | 19970/37963 [62:01:45<54:22:58, 10.88s/it]
 53%|█████▎    | 19971/37963 [62:01:55<53:09:45, 10.64s/it]
 53%|█████▎    | 19972/37963 [62:02:05<52:24:06, 10.49s/it]
 53%|█████▎    | 19973/37963 [62:02:15<51:40:06, 10.34s/it]
 53%|█████▎    | 19974/37963 [62:02:25<51:16:15, 10.26s/it]
 53%|█████▎    | 19975/37963 [62:02:41<60:28:36, 12.10s/it]
 53%|█████▎    | 19976/37963 [62:02:52<57:28:43, 11.50s/it]
 53%|█████▎    | 19977/37963 [62:03:02<55:18:34, 11.07s/it]
 53%|█████▎    | 19978/37963 [62:03:12<53:50:19, 10.78s/it]
 53%|█████▎    | 19979/37963 [62:03:22<52:46:09, 10.56s/it]
 53%|█████▎    | 19980/37963 [62:03:32<52:02:34, 10.42s/it]
                                                           
{'loss': '0.1588', 'grad_norm': '2.92', 'learning_rate': '9.635e-06', 'epoch': '0.5263'}

 53%|█████▎    | 19980/37963 [62:03:32<52:02:34, 10.42s/it]
 53%|█████▎    | 19981/37963 [62:03:42<51:34:21, 10.32s/it]
 53%|█████▎    | 19982/37963 [62:03:52<51:12:39, 10.25s/it]
 53%|█████▎    | 19983/37963 [62:04:02<50:55:57, 10.20s/it]
 53%|█████▎    | 19984/37963 [62:04:12<50:50:01, 10.18s/it]
 53%|█████▎    | 19985/37963 [62:04:22<50:35:14, 10.13s/it]
 53%|█████▎    | 19986/37963 [62:04:32<50:24:15, 10.09s/it]
 53%|█████▎    | 19987/37963 [62:04:42<50:24:11, 10.09s/it]
 53%|█████▎    | 19988/37963 [62:04:52<50:11:52, 10.05s/it]
 53%|█████▎    | 19989/37963 [62:05:02<50:13:11, 10.06s/it]
 53%|█████▎    | 19990/37963 [62:05:13<50:16:20, 10.07s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '2.063', 'learning_rate': '9.626e-06', 'epoch': '0.5266'}

 53%|█████▎    | 19990/37963 [62:05:13<50:16:20, 10.07s/it]
 53%|█████▎    | 19991/37963 [62:05:23<50:18:26, 10.08s/it]
 53%|█████▎    | 19992/37963 [62:05:33<50:06:08, 10.04s/it]
 53%|█████▎    | 19993/37963 [62:05:43<50:05:58, 10.04s/it]
 53%|█████▎    | 19994/37963 [62:05:58<58:53:02, 11.80s/it]
 53%|█████▎    | 19995/37963 [62:06:15<65:21:40, 13.10s/it]
 53%|█████▎    | 19996/37963 [62:06:24<60:22:03, 12.10s/it]
 53%|█████▎    | 19997/37963 [62:06:41<66:56:38, 13.41s/it]
 53%|█████▎    | 19998/37963 [62:06:51<61:27:13, 12.31s/it]
 53%|█████▎    | 19999/37963 [62:07:01<58:07:04, 11.65s/it]
 53%|█████▎    | 20000/37963 [62:07:11<55:44:46, 11.17s/it]
                                                           
{'loss': '0.139', 'grad_norm': '2.847', 'learning_rate': '9.618e-06', 'epoch': '0.5268'}

 53%|█████▎    | 20000/37963 [62:07:11<55:44:46, 11.17s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.87s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.87s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 53%|█████▎    | 20001/37963 [62:08:18<140:13:06, 28.10s/it]
 53%|█████▎    | 20002/37963 [62:08:28<113:02:06, 22.66s/it]
 53%|█████▎    | 20003/37963 [62:08:38<93:55:00, 18.83s/it] 
 53%|█████▎    | 20004/37963 [62:08:48<80:22:28, 16.11s/it]
 53%|█████▎    | 20005/37963 [62:09:04<80:55:50, 16.22s/it]
 53%|█████▎    | 20006/37963 [62:09:15<71:46:18, 14.39s/it]
 53%|█████▎    | 20007/37963 [62:09:25<65:20:48, 13.10s/it]
 53%|█████▎    | 20008/37963 [62:09:35<60:30:15, 12.13s/it]
 53%|█████▎    | 20009/37963 [62:09:51<67:11:38, 13.47s/it]
 53%|█████▎    | 20010/37963 [62:10:01<61:34:37, 12.35s/it]
                                                           
{'loss': '0.1367', 'grad_norm': '2.118', 'learning_rate': '9.609e-06', 'epoch': '0.5271'}

 53%|█████▎    | 20010/37963 [62:10:01<61:34:37, 12.35s/it]
 53%|█████▎    | 20011/37963 [62:10:11<58:18:52, 11.69s/it]
 53%|█████▎    | 20012/37963 [62:10:21<55:52:34, 11.21s/it]
 53%|█████▎    | 20013/37963 [62:10:31<54:18:34, 10.89s/it]
 53%|█████▎    | 20014/37963 [62:10:41<53:04:04, 10.64s/it]
 53%|█████▎    | 20015/37963 [62:10:58<62:19:30, 12.50s/it]
 53%|█████▎    | 20016/37963 [62:11:08<58:36:26, 11.76s/it]
 53%|█████▎    | 20017/37963 [62:11:18<56:03:10, 11.24s/it]
 53%|█████▎    | 20018/37963 [62:11:28<54:08:15, 10.86s/it]
 53%|█████▎    | 20019/37963 [62:11:38<52:40:44, 10.57s/it]
 53%|█████▎    | 20020/37963 [62:11:48<51:45:38, 10.39s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '2.57', 'learning_rate': '9.601e-06', 'epoch': '0.5274'}

 53%|█████▎    | 20020/37963 [62:11:48<51:45:38, 10.39s/it]
 53%|█████▎    | 20021/37963 [62:11:58<51:23:48, 10.31s/it]
 53%|█████▎    | 20022/37963 [62:12:08<50:59:22, 10.23s/it]
 53%|█████▎    | 20023/37963 [62:12:18<50:50:05, 10.20s/it]
 53%|█████▎    | 20024/37963 [62:12:35<60:27:51, 12.13s/it]
 53%|█████▎    | 20025/37963 [62:12:45<57:32:22, 11.55s/it]
 53%|█████▎    | 20026/37963 [62:12:55<54:41:09, 10.98s/it]
 53%|█████▎    | 20027/37963 [62:13:05<53:08:07, 10.66s/it]
 53%|█████▎    | 20028/37963 [62:13:15<52:25:45, 10.52s/it]
 53%|█████▎    | 20029/37963 [62:13:25<51:45:44, 10.39s/it]
 53%|█████▎    | 20030/37963 [62:13:35<50:46:12, 10.19s/it]
                                                           
{'loss': '0.1304', 'grad_norm': '2.426', 'learning_rate': '9.592e-06', 'epoch': '0.5276'}

 53%|█████▎    | 20030/37963 [62:13:35<50:46:12, 10.19s/it]
 53%|█████▎    | 20031/37963 [62:13:45<50:29:38, 10.14s/it]
 53%|█████▎    | 20032/37963 [62:13:55<50:14:11, 10.09s/it]
 53%|█████▎    | 20033/37963 [62:14:05<50:04:57, 10.06s/it]
 53%|█████▎    | 20034/37963 [62:14:15<50:24:05, 10.12s/it]
 53%|█████▎    | 20035/37963 [62:14:25<50:18:27, 10.10s/it]
 53%|█████▎    | 20036/37963 [62:14:35<50:12:35, 10.08s/it]
 53%|█████▎    | 20037/37963 [62:14:45<50:13:18, 10.09s/it]
 53%|█████▎    | 20038/37963 [62:14:55<50:13:59, 10.09s/it]
 53%|█████▎    | 20039/37963 [62:15:05<50:13:36, 10.09s/it]
 53%|█████▎    | 20040/37963 [62:15:22<60:05:04, 12.07s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '5.164', 'learning_rate': '9.584e-06', 'epoch': '0.5279'}

 53%|█████▎    | 20040/37963 [62:15:22<60:05:04, 12.07s/it]
 53%|█████▎    | 20041/37963 [62:15:32<56:52:48, 11.43s/it]
 53%|█████▎    | 20042/37963 [62:15:42<54:37:50, 10.97s/it]
 53%|█████▎    | 20043/37963 [62:15:59<63:12:47, 12.70s/it]
 53%|█████▎    | 20044/37963 [62:16:15<69:24:16, 13.94s/it]
 53%|█████▎    | 20045/37963 [62:16:25<63:23:58, 12.74s/it]
 53%|█████▎    | 20046/37963 [62:16:35<59:13:19, 11.90s/it]
 53%|█████▎    | 20047/37963 [62:16:45<56:19:32, 11.32s/it]
 53%|█████▎    | 20048/37963 [62:16:56<54:43:43, 11.00s/it]
 53%|█████▎    | 20049/37963 [62:17:12<63:00:39, 12.66s/it]
 53%|█████▎    | 20050/37963 [62:17:22<58:34:12, 11.77s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '1.137', 'learning_rate': '9.575e-06', 'epoch': '0.5281'}

 53%|█████▎    | 20050/37963 [62:17:22<58:34:12, 11.77s/it]
 53%|█████▎    | 20051/37963 [62:17:32<55:55:21, 11.24s/it]
 53%|█████▎    | 20052/37963 [62:17:48<63:46:53, 12.82s/it]
 53%|█████▎    | 20053/37963 [62:17:58<59:22:27, 11.93s/it]
 53%|█████▎    | 20054/37963 [62:18:08<56:36:39, 11.38s/it]
 53%|█████▎    | 20055/37963 [62:18:25<64:41:17, 13.00s/it]
 53%|█████▎    | 20056/37963 [62:18:35<60:19:24, 12.13s/it]
 53%|█████▎    | 20057/37963 [62:18:45<57:19:50, 11.53s/it]
 53%|█████▎    | 20058/37963 [62:18:55<55:06:24, 11.08s/it]
 53%|█████▎    | 20059/37963 [62:19:05<53:11:18, 10.69s/it]
 53%|█████▎    | 20060/37963 [62:19:15<52:16:18, 10.51s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '1.027', 'learning_rate': '9.567e-06', 'epoch': '0.5284'}

 53%|█████▎    | 20060/37963 [62:19:15<52:16:18, 10.51s/it]
 53%|█████▎    | 20061/37963 [62:19:25<51:39:58, 10.39s/it]
 53%|█████▎    | 20062/37963 [62:19:35<51:11:23, 10.29s/it]
 53%|█████▎    | 20063/37963 [62:19:45<50:55:58, 10.24s/it]
 53%|█████▎    | 20064/37963 [62:19:56<50:44:41, 10.21s/it]
 53%|█████▎    | 20065/37963 [62:20:06<50:33:22, 10.17s/it]
 53%|█████▎    | 20066/37963 [62:20:16<50:32:30, 10.17s/it]
 53%|█████▎    | 20067/37963 [62:20:33<60:52:38, 12.25s/it]
 53%|█████▎    | 20068/37963 [62:20:43<57:45:42, 11.62s/it]
 53%|█████▎    | 20069/37963 [62:20:53<55:33:28, 11.18s/it]
 53%|█████▎    | 20070/37963 [62:21:03<53:42:10, 10.80s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '1.219', 'learning_rate': '9.558e-06', 'epoch': '0.5287'}

 53%|█████▎    | 20070/37963 [62:21:03<53:42:10, 10.80s/it]
 53%|█████▎    | 20071/37963 [62:21:13<52:46:24, 10.62s/it]
 53%|█████▎    | 20072/37963 [62:21:23<51:58:12, 10.46s/it]
 53%|█████▎    | 20073/37963 [62:21:40<61:13:17, 12.32s/it]
 53%|█████▎    | 20074/37963 [62:21:50<57:29:54, 11.57s/it]
 53%|█████▎    | 20075/37963 [62:22:00<55:14:44, 11.12s/it]
 53%|█████▎    | 20076/37963 [62:22:10<53:56:02, 10.85s/it]
 53%|█████▎    | 20077/37963 [62:22:20<52:37:41, 10.59s/it]
 53%|█████▎    | 20078/37963 [62:22:30<51:26:48, 10.36s/it]
 53%|█████▎    | 20079/37963 [62:22:40<50:58:27, 10.26s/it]
 53%|█████▎    | 20080/37963 [62:22:50<50:51:09, 10.24s/it]
                                                           
{'loss': '0.1511', 'grad_norm': '4.025', 'learning_rate': '9.55e-06', 'epoch': '0.5289'}

 53%|█████▎    | 20080/37963 [62:22:50<50:51:09, 10.24s/it]
 53%|█████▎    | 20081/37963 [62:23:00<49:47:18, 10.02s/it]
 53%|█████▎    | 20082/37963 [62:23:10<49:44:10, 10.01s/it]
 53%|█████▎    | 20083/37963 [62:23:20<49:51:27, 10.04s/it]
 53%|█████▎    | 20084/37963 [62:23:30<49:57:03, 10.06s/it]
 53%|█████▎    | 20085/37963 [62:23:40<49:50:38, 10.04s/it]
 53%|█████▎    | 20086/37963 [62:23:50<49:56:21, 10.06s/it]
 53%|█████▎    | 20087/37963 [62:24:00<50:02:08, 10.08s/it]
 53%|█████▎    | 20088/37963 [62:24:17<59:30:06, 11.98s/it]
 53%|█████▎    | 20089/37963 [62:24:27<56:47:26, 11.44s/it]
 53%|█████▎    | 20090/37963 [62:24:37<54:41:11, 11.02s/it]
                                                           
{'loss': '0.1548', 'grad_norm': '1.395', 'learning_rate': '9.541e-06', 'epoch': '0.5292'}

 53%|█████▎    | 20090/37963 [62:24:37<54:41:11, 11.02s/it]
 53%|█████▎    | 20091/37963 [62:24:47<53:17:46, 10.74s/it]
 53%|█████▎    | 20092/37963 [62:25:04<62:29:09, 12.59s/it]
 53%|█████▎    | 20093/37963 [62:25:14<58:41:12, 11.82s/it]
 53%|█████▎    | 20094/37963 [62:25:24<56:02:33, 11.29s/it]
 53%|█████▎    | 20095/37963 [62:25:34<54:25:10, 10.96s/it]
 53%|█████▎    | 20096/37963 [62:25:44<53:00:00, 10.68s/it]
 53%|█████▎    | 20097/37963 [62:25:54<52:05:33, 10.50s/it]
 53%|█████▎    | 20098/37963 [62:26:04<51:14:19, 10.33s/it]
 53%|█████▎    | 20099/37963 [62:26:21<60:24:56, 12.18s/it]
 53%|█████▎    | 20100/37963 [62:26:31<57:20:17, 11.56s/it]
                                                           
{'loss': '0.1487', 'grad_norm': '1.221', 'learning_rate': '9.533e-06', 'epoch': '0.5295'}

 53%|█████▎    | 20100/37963 [62:26:31<57:20:17, 11.56s/it]
 53%|█████▎    | 20101/37963 [62:26:47<65:05:52, 13.12s/it]
 53%|█████▎    | 20102/37963 [62:27:03<69:25:51, 13.99s/it]
 53%|█████▎    | 20103/37963 [62:27:14<63:35:57, 12.82s/it]
 53%|█████▎    | 20104/37963 [62:27:24<59:34:02, 12.01s/it]
 53%|█████▎    | 20105/37963 [62:27:33<55:59:07, 11.29s/it]
 53%|█████▎    | 20106/37963 [62:27:43<54:14:23, 10.93s/it]
 53%|█████▎    | 20107/37963 [62:27:53<52:54:25, 10.67s/it]
 53%|█████▎    | 20108/37963 [62:28:04<52:00:50, 10.49s/it]
 53%|█████▎    | 20109/37963 [62:28:14<51:27:32, 10.38s/it]
 53%|█████▎    | 20110/37963 [62:28:24<51:13:33, 10.33s/it]
                                                           
{'loss': '0.1333', 'grad_norm': '1.08', 'learning_rate': '9.524e-06', 'epoch': '0.5297'}

 53%|█████▎    | 20110/37963 [62:28:24<51:13:33, 10.33s/it]
 53%|█████▎    | 20111/37963 [62:28:34<51:06:40, 10.31s/it]
 53%|█████▎    | 20112/37963 [62:28:44<50:48:16, 10.25s/it]
 53%|█████▎    | 20113/37963 [62:28:54<50:30:11, 10.19s/it]
 53%|█████▎    | 20114/37963 [62:29:04<49:55:43, 10.07s/it]
 53%|█████▎    | 20115/37963 [62:29:14<49:58:10, 10.08s/it]
 53%|█████▎    | 20116/37963 [62:29:31<60:44:36, 12.25s/it]
 53%|█████▎    | 20117/37963 [62:29:42<57:27:51, 11.59s/it]
 53%|█████▎    | 20118/37963 [62:29:52<55:08:38, 11.12s/it]
 53%|█████▎    | 20119/37963 [62:30:02<53:31:32, 10.80s/it]
 53%|█████▎    | 20120/37963 [62:30:11<51:41:32, 10.43s/it]
                                                           
{'loss': '0.1516', 'grad_norm': '3.804', 'learning_rate': '9.516e-06', 'epoch': '0.53'}

 53%|█████▎    | 20120/37963 [62:30:11<51:41:32, 10.43s/it]
 53%|█████▎    | 20121/37963 [62:30:21<51:23:30, 10.37s/it]
 53%|█████▎    | 20122/37963 [62:30:38<60:18:36, 12.17s/it]
 53%|█████▎    | 20123/37963 [62:30:48<57:17:52, 11.56s/it]
 53%|█████▎    | 20124/37963 [62:30:58<54:54:12, 11.08s/it]
 53%|█████▎    | 20125/37963 [62:31:08<53:26:19, 10.78s/it]
 53%|█████▎    | 20126/37963 [62:31:18<52:13:56, 10.54s/it]
 53%|█████▎    | 20127/37963 [62:31:28<51:39:11, 10.43s/it]
 53%|█████▎    | 20128/37963 [62:31:38<51:20:55, 10.36s/it]
 53%|█████▎    | 20129/37963 [62:31:48<51:01:27, 10.30s/it]
 53%|█████▎    | 20130/37963 [62:31:59<50:42:43, 10.24s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '2.375', 'learning_rate': '9.507e-06', 'epoch': '0.5303'}

 53%|█████▎    | 20130/37963 [62:31:59<50:42:43, 10.24s/it]
 53%|█████▎    | 20131/37963 [62:32:09<50:33:06, 10.21s/it]
 53%|█████▎    | 20132/37963 [62:32:19<50:21:21, 10.17s/it]
 53%|█████▎    | 20133/37963 [62:32:29<50:09:47, 10.13s/it]
 53%|█████▎    | 20134/37963 [62:32:39<50:06:12, 10.12s/it]
 53%|█████▎    | 20135/37963 [62:32:49<50:07:06, 10.12s/it]
 53%|█████▎    | 20136/37963 [62:32:59<49:43:37, 10.04s/it]
 53%|█████▎    | 20137/37963 [62:33:15<58:51:55, 11.89s/it]
 53%|█████▎    | 20138/37963 [62:33:25<56:13:37, 11.36s/it]
 53%|█████▎    | 20139/37963 [62:33:35<54:17:30, 10.97s/it]
 53%|█████▎    | 20140/37963 [62:33:45<52:35:47, 10.62s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '0.8722', 'learning_rate': '9.499e-06', 'epoch': '0.5305'}

 53%|█████▎    | 20140/37963 [62:33:45<52:35:47, 10.62s/it]
 53%|█████▎    | 20141/37963 [62:34:08<71:26:52, 14.43s/it]
 53%|█████▎    | 20142/37963 [62:34:18<64:52:42, 13.11s/it]
 53%|█████▎    | 20143/37963 [62:34:29<60:35:26, 12.24s/it]
 53%|█████▎    | 20144/37963 [62:34:39<57:20:03, 11.58s/it]
 53%|█████▎    | 20145/37963 [62:34:49<55:01:26, 11.12s/it]
 53%|█████▎    | 20146/37963 [62:34:59<53:29:41, 10.81s/it]
 53%|█████▎    | 20147/37963 [62:35:15<61:50:08, 12.49s/it]
 53%|█████▎    | 20148/37963 [62:35:31<67:02:06, 13.55s/it]
 53%|█████▎    | 20149/37963 [62:35:48<71:35:58, 14.47s/it]
 53%|█████▎    | 20150/37963 [62:35:58<65:07:33, 13.16s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '0.9482', 'learning_rate': '9.49e-06', 'epoch': '0.5308'}

 53%|█████▎    | 20150/37963 [62:35:58<65:07:33, 13.16s/it]
 53%|█████▎    | 20151/37963 [62:36:08<59:56:17, 12.11s/it]
 53%|█████▎    | 20152/37963 [62:36:18<56:53:24, 11.50s/it]
 53%|█████▎    | 20153/37963 [62:36:28<54:46:38, 11.07s/it]
 53%|█████▎    | 20154/37963 [62:36:38<53:14:42, 10.76s/it]
 53%|█████▎    | 20155/37963 [62:36:48<51:52:36, 10.49s/it]
 53%|█████▎    | 20156/37963 [62:36:57<50:45:01, 10.26s/it]
 53%|█████▎    | 20157/37963 [62:37:08<50:40:16, 10.24s/it]
 53%|█████▎    | 20158/37963 [62:37:17<49:58:32, 10.10s/it]
 53%|█████▎    | 20159/37963 [62:37:27<49:41:28, 10.05s/it]
 53%|█████▎    | 20160/37963 [62:37:37<49:35:35, 10.03s/it]
                                                           
{'loss': '0.1535', 'grad_norm': '1.293', 'learning_rate': '9.482e-06', 'epoch': '0.531'}

 53%|█████▎    | 20160/37963 [62:37:37<49:35:35, 10.03s/it]
 53%|█████▎    | 20161/37963 [62:37:47<49:41:38, 10.05s/it]
 53%|█████▎    | 20162/37963 [62:37:57<49:40:39, 10.05s/it]
 53%|█████▎    | 20163/37963 [62:38:07<49:12:47,  9.95s/it]
 53%|█████▎    | 20164/37963 [62:38:17<49:24:32,  9.99s/it]
 53%|█████▎    | 20165/37963 [62:38:27<49:31:44, 10.02s/it]
 53%|█████▎    | 20166/37963 [62:38:45<60:24:01, 12.22s/it]
 53%|█████▎    | 20167/37963 [62:38:55<57:12:00, 11.57s/it]
 53%|█████▎    | 20168/37963 [62:39:05<55:00:54, 11.13s/it]
 53%|█████▎    | 20169/37963 [62:39:15<53:17:24, 10.78s/it]
 53%|█████▎    | 20170/37963 [62:39:31<61:46:30, 12.50s/it]
                                                           
{'loss': '0.1435', 'grad_norm': '2.795', 'learning_rate': '9.473e-06', 'epoch': '0.5313'}

 53%|█████▎    | 20170/37963 [62:39:31<61:46:30, 12.50s/it]
 53%|█████▎    | 20171/37963 [62:39:41<58:18:18, 11.80s/it]
 53%|█████▎    | 20172/37963 [62:39:52<55:48:39, 11.29s/it]
 53%|█████▎    | 20173/37963 [62:40:02<53:57:56, 10.92s/it]
 53%|█████▎    | 20174/37963 [62:40:11<52:22:09, 10.60s/it]
 53%|█████▎    | 20175/37963 [62:40:22<51:35:11, 10.44s/it]
 53%|█████▎    | 20176/37963 [62:40:32<51:05:47, 10.34s/it]
 53%|█████▎    | 20177/37963 [62:40:42<50:44:30, 10.27s/it]
 53%|█████▎    | 20178/37963 [62:40:52<50:26:09, 10.21s/it]
 53%|█████▎    | 20179/37963 [62:41:02<50:09:56, 10.16s/it]
 53%|█████▎    | 20180/37963 [62:41:12<49:31:49, 10.03s/it]
                                                           
{'loss': '0.1392', 'grad_norm': '1.73', 'learning_rate': '9.464e-06', 'epoch': '0.5316'}

 53%|█████▎    | 20180/37963 [62:41:12<49:31:49, 10.03s/it]
 53%|█████▎    | 20181/37963 [62:41:22<49:33:09, 10.03s/it]
 53%|█████▎    | 20182/37963 [62:41:32<49:32:36, 10.03s/it]
 53%|█████▎    | 20183/37963 [62:41:42<49:16:34,  9.98s/it]
 53%|█████▎    | 20184/37963 [62:41:52<49:27:46, 10.02s/it]
 53%|█████▎    | 20185/37963 [62:42:02<49:47:50, 10.08s/it]
 53%|█████▎    | 20186/37963 [62:42:18<59:26:52, 12.04s/it]
 53%|█████▎    | 20187/37963 [62:42:29<56:35:50, 11.46s/it]
 53%|█████▎    | 20188/37963 [62:42:39<54:25:51, 11.02s/it]
 53%|█████▎    | 20189/37963 [62:42:56<63:35:20, 12.88s/it]
 53%|█████▎    | 20190/37963 [62:43:06<59:27:51, 12.04s/it]
                                                           
{'loss': '0.1436', 'grad_norm': '1.61', 'learning_rate': '9.456e-06', 'epoch': '0.5318'}

 53%|█████▎    | 20190/37963 [62:43:06<59:27:51, 12.04s/it]
 53%|█████▎    | 20191/37963 [62:43:16<56:09:50, 11.38s/it]
 53%|█████▎    | 20192/37963 [62:43:26<54:23:13, 11.02s/it]
 53%|█████▎    | 20193/37963 [62:43:36<52:28:06, 10.63s/it]
 53%|█████▎    | 20194/37963 [62:43:45<50:47:15, 10.29s/it]
 53%|█████▎    | 20195/37963 [62:43:55<50:28:25, 10.23s/it]
 53%|█████▎    | 20196/37963 [62:44:18<69:07:54, 14.01s/it]
 53%|█████▎    | 20197/37963 [62:44:28<62:47:26, 12.72s/it]
 53%|█████▎    | 20198/37963 [62:44:38<58:58:09, 11.95s/it]
 53%|█████▎    | 20199/37963 [62:44:48<55:58:11, 11.34s/it]
 53%|█████▎    | 20200/37963 [62:44:58<53:58:21, 10.94s/it]
                                                           
{'loss': '0.1545', 'grad_norm': '3.571', 'learning_rate': '9.447e-06', 'epoch': '0.5321'}

 53%|█████▎    | 20200/37963 [62:44:58<53:58:21, 10.94s/it]
 53%|█████▎    | 20201/37963 [62:45:08<52:39:37, 10.67s/it]
 53%|█████▎    | 20202/37963 [62:45:18<51:42:41, 10.48s/it]
 53%|█████▎    | 20203/37963 [62:45:28<51:05:33, 10.36s/it]
 53%|█████▎    | 20204/37963 [62:45:38<50:28:55, 10.23s/it]
 53%|█████▎    | 20205/37963 [62:45:48<50:23:33, 10.22s/it]
 53%|█████▎    | 20206/37963 [62:45:58<49:55:39, 10.12s/it]
 53%|█████▎    | 20207/37963 [62:46:08<49:48:52, 10.10s/it]
 53%|█████▎    | 20208/37963 [62:46:18<49:45:16, 10.09s/it]
 53%|█████▎    | 20209/37963 [62:46:28<49:50:28, 10.11s/it]
 53%|█████▎    | 20210/37963 [62:46:38<49:44:58, 10.09s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '1.329', 'learning_rate': '9.439e-06', 'epoch': '0.5324'}

 53%|█████▎    | 20210/37963 [62:46:38<49:44:58, 10.09s/it]
 53%|█████▎    | 20211/37963 [62:46:48<49:21:56, 10.01s/it]
 53%|█████▎    | 20212/37963 [62:46:58<49:23:44, 10.02s/it]
 53%|█████▎    | 20213/37963 [62:47:15<59:24:14, 12.05s/it]
 53%|█████▎    | 20214/37963 [62:47:25<56:17:44, 11.42s/it]
 53%|█████▎    | 20215/37963 [62:47:35<54:22:15, 11.03s/it]
 53%|█████▎    | 20216/37963 [62:47:45<52:56:09, 10.74s/it]
 53%|█████▎    | 20217/37963 [62:47:55<51:51:12, 10.52s/it]
 53%|█████▎    | 20218/37963 [62:48:05<50:38:56, 10.28s/it]
 53%|█████▎    | 20219/37963 [62:48:21<59:41:56, 12.11s/it]
 53%|█████▎    | 20220/37963 [62:48:31<56:50:48, 11.53s/it]
                                                           
{'loss': '0.1386', 'grad_norm': '1.445', 'learning_rate': '9.43e-06', 'epoch': '0.5326'}

 53%|█████▎    | 20220/37963 [62:48:31<56:50:48, 11.53s/it]
 53%|█████▎    | 20221/37963 [62:48:41<54:44:54, 11.11s/it]
 53%|█████▎    | 20222/37963 [62:48:51<52:51:18, 10.73s/it]
 53%|█████▎    | 20223/37963 [62:49:01<51:57:59, 10.55s/it]
 53%|█████▎    | 20224/37963 [62:49:12<51:36:02, 10.47s/it]
 53%|█████▎    | 20225/37963 [62:49:22<51:02:15, 10.36s/it]
 53%|█████▎    | 20226/37963 [62:49:32<50:38:45, 10.28s/it]
 53%|█████▎    | 20227/37963 [62:49:42<50:11:38, 10.19s/it]
 53%|█████▎    | 20228/37963 [62:49:52<50:00:20, 10.15s/it]
 53%|█████▎    | 20229/37963 [62:50:02<49:55:37, 10.14s/it]
 53%|█████▎    | 20230/37963 [62:50:12<49:53:11, 10.13s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '1.501', 'learning_rate': '9.422e-06', 'epoch': '0.5329'}

 53%|█████▎    | 20230/37963 [62:50:12<49:53:11, 10.13s/it]
 53%|█████▎    | 20231/37963 [62:50:22<49:48:26, 10.11s/it]
 53%|█████▎    | 20232/37963 [62:50:32<49:32:34, 10.06s/it]
 53%|█████▎    | 20233/37963 [62:50:42<49:41:19, 10.09s/it]
 53%|█████▎    | 20234/37963 [62:50:52<49:20:57, 10.02s/it]
 53%|█████▎    | 20235/37963 [62:51:09<58:52:12, 11.95s/it]
 53%|█████▎    | 20236/37963 [62:51:19<56:07:57, 11.40s/it]
 53%|█████▎    | 20237/37963 [62:51:36<64:14:33, 13.05s/it]
 53%|█████▎    | 20238/37963 [62:51:52<69:30:55, 14.12s/it]
 53%|█████▎    | 20239/37963 [62:52:02<63:35:30, 12.92s/it]
 53%|█████▎    | 20240/37963 [62:52:13<59:29:33, 12.08s/it]
                                                           
{'loss': '0.1419', 'grad_norm': '1.893', 'learning_rate': '9.413e-06', 'epoch': '0.5332'}

 53%|█████▎    | 20240/37963 [62:52:13<59:29:33, 12.08s/it]
 53%|█████▎    | 20241/37963 [62:52:22<55:56:40, 11.36s/it]
 53%|█████▎    | 20242/37963 [62:52:32<54:11:03, 11.01s/it]
 53%|█████▎    | 20243/37963 [62:52:42<52:23:05, 10.64s/it]
 53%|█████▎    | 20244/37963 [62:52:59<60:55:02, 12.38s/it]
 53%|█████▎    | 20245/37963 [62:53:14<66:03:53, 13.42s/it]
 53%|█████▎    | 20246/37963 [62:53:24<60:54:40, 12.38s/it]
 53%|█████▎    | 20247/37963 [62:53:34<57:31:28, 11.69s/it]
 53%|█████▎    | 20248/37963 [62:53:44<54:17:47, 11.03s/it]
 53%|█████▎    | 20249/37963 [62:53:54<52:51:45, 10.74s/it]
 53%|█████▎    | 20250/37963 [62:54:04<52:05:08, 10.59s/it]
                                                           
{'loss': '0.1443', 'grad_norm': '2.022', 'learning_rate': '9.405e-06', 'epoch': '0.5334'}

 53%|█████▎    | 20250/37963 [62:54:04<52:05:08, 10.59s/it]
 53%|█████▎    | 20251/37963 [62:54:14<51:06:56, 10.39s/it]
 53%|█████▎    | 20252/37963 [62:54:24<50:38:14, 10.29s/it]
 53%|█████▎    | 20253/37963 [62:54:34<50:18:57, 10.23s/it]
 53%|█████▎    | 20254/37963 [62:54:44<50:08:17, 10.19s/it]
 53%|█████▎    | 20255/37963 [62:54:54<49:54:07, 10.14s/it]
 53%|█████▎    | 20256/37963 [62:55:05<49:54:36, 10.15s/it]
 53%|█████▎    | 20257/37963 [62:55:15<49:50:27, 10.13s/it]
 53%|█████▎    | 20258/37963 [62:55:25<49:23:10, 10.04s/it]
 53%|█████▎    | 20259/37963 [62:55:35<49:28:09, 10.06s/it]
 53%|█████▎    | 20260/37963 [62:55:45<49:36:15, 10.09s/it]
                                                           
{'loss': '0.1528', 'grad_norm': '2.128', 'learning_rate': '9.396e-06', 'epoch': '0.5337'}

 53%|█████▎    | 20260/37963 [62:55:45<49:36:15, 10.09s/it]
 53%|█████▎    | 20261/37963 [62:56:02<60:01:41, 12.21s/it]
 53%|█████▎    | 20262/37963 [62:56:12<57:04:44, 11.61s/it]
 53%|█████▎    | 20263/37963 [62:56:22<54:49:05, 11.15s/it]
 53%|█████▎    | 20264/37963 [62:56:32<53:14:50, 10.83s/it]
 53%|█████▎    | 20265/37963 [62:56:42<51:46:48, 10.53s/it]
 53%|█████▎    | 20266/37963 [62:56:59<60:29:06, 12.30s/it]
 53%|█████▎    | 20267/37963 [62:57:09<57:10:19, 11.63s/it]
 53%|█████▎    | 20268/37963 [62:57:19<54:53:47, 11.17s/it]
 53%|█████▎    | 20269/37963 [62:57:29<53:23:56, 10.86s/it]
 53%|█████▎    | 20270/37963 [62:57:39<52:07:32, 10.61s/it]
                                                           
{'loss': '0.1377', 'grad_norm': '4.148', 'learning_rate': '9.388e-06', 'epoch': '0.5339'}

 53%|█████▎    | 20270/37963 [62:57:39<52:07:32, 10.61s/it]
 53%|█████▎    | 20271/37963 [62:57:49<51:00:46, 10.38s/it]
 53%|█████▎    | 20272/37963 [62:57:59<50:45:33, 10.33s/it]
 53%|█████▎    | 20273/37963 [62:58:09<50:21:47, 10.25s/it]
 53%|█████▎    | 20274/37963 [62:58:19<49:38:25, 10.10s/it]
 53%|█████▎    | 20275/37963 [62:58:29<49:38:25, 10.10s/it]
 53%|█████▎    | 20276/37963 [62:58:39<49:30:00, 10.08s/it]
 53%|█████▎    | 20277/37963 [62:58:49<49:34:07, 10.09s/it]
 53%|█████▎    | 20278/37963 [62:58:59<49:32:35, 10.09s/it]
 53%|█████▎    | 20279/37963 [62:59:09<48:58:26,  9.97s/it]
 53%|█████▎    | 20280/37963 [62:59:19<49:10:45, 10.01s/it]
                                                           
{'loss': '0.1383', 'grad_norm': '4.259', 'learning_rate': '9.379e-06', 'epoch': '0.5342'}

 53%|█████▎    | 20280/37963 [62:59:19<49:10:45, 10.01s/it]
 53%|█████▎    | 20281/37963 [62:59:29<48:57:28,  9.97s/it]
 53%|█████▎    | 20282/37963 [62:59:38<48:19:30,  9.84s/it]
 53%|█████▎    | 20283/37963 [62:59:49<48:53:32,  9.96s/it]
 53%|█████▎    | 20284/37963 [63:00:05<58:53:05, 11.99s/it]
 53%|█████▎    | 20285/37963 [63:00:22<65:06:50, 13.26s/it]
 53%|█████▎    | 20286/37963 [63:00:32<60:25:02, 12.30s/it]
 53%|█████▎    | 20287/37963 [63:00:48<67:02:12, 13.65s/it]
 53%|█████▎    | 20288/37963 [63:00:58<61:20:17, 12.49s/it]
 53%|█████▎    | 20289/37963 [63:01:08<57:10:41, 11.65s/it]
 53%|█████▎    | 20290/37963 [63:01:24<64:26:30, 13.13s/it]
                                                           
{'loss': '0.153', 'grad_norm': '1.647', 'learning_rate': '9.371e-06', 'epoch': '0.5345'}

 53%|█████▎    | 20290/37963 [63:01:24<64:26:30, 13.13s/it]
 53%|█████▎    | 20291/37963 [63:01:35<60:01:40, 12.23s/it]
 53%|█████▎    | 20292/37963 [63:01:51<66:07:56, 13.47s/it]
 53%|█████▎    | 20293/37963 [63:02:07<70:27:37, 14.36s/it]
 53%|█████▎    | 20294/37963 [63:02:17<63:59:14, 13.04s/it]
 53%|█████▎    | 20295/37963 [63:02:27<59:18:51, 12.09s/it]
 53%|█████▎    | 20296/37963 [63:02:37<55:44:59, 11.36s/it]
 53%|█████▎    | 20297/37963 [63:02:47<53:54:11, 10.98s/it]
 53%|█████▎    | 20298/37963 [63:02:57<52:38:38, 10.73s/it]
 53%|█████▎    | 20299/37963 [63:03:07<51:43:05, 10.54s/it]
 53%|█████▎    | 20300/37963 [63:03:17<50:47:07, 10.35s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '0.8666', 'learning_rate': '9.362e-06', 'epoch': '0.5347'}

 53%|█████▎    | 20300/37963 [63:03:17<50:47:07, 10.35s/it]
 53%|█████▎    | 20301/37963 [63:03:27<50:24:08, 10.27s/it]
 53%|█████▎    | 20302/37963 [63:03:37<50:05:25, 10.21s/it]
 53%|█████▎    | 20303/37963 [63:03:47<49:57:46, 10.18s/it]
 53%|█████▎    | 20304/37963 [63:03:57<49:37:51, 10.12s/it]
 53%|█████▎    | 20305/37963 [63:04:07<49:33:58, 10.11s/it]
 53%|█████▎    | 20306/37963 [63:04:17<49:16:17, 10.05s/it]
 53%|█████▎    | 20307/37963 [63:04:34<59:30:24, 12.13s/it]
 53%|█████▎    | 20308/37963 [63:04:45<56:36:12, 11.54s/it]
 53%|█████▎    | 20309/37963 [63:04:55<54:23:29, 11.09s/it]
 53%|█████▎    | 20310/37963 [63:05:04<52:30:46, 10.71s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '1.698', 'learning_rate': '9.354e-06', 'epoch': '0.535'}

 53%|█████▎    | 20310/37963 [63:05:04<52:30:46, 10.71s/it]
 54%|█████▎    | 20311/37963 [63:05:14<51:24:09, 10.48s/it]
 54%|█████▎    | 20312/37963 [63:05:24<50:26:25, 10.29s/it]
 54%|█████▎    | 20313/37963 [63:05:34<49:51:00, 10.17s/it]
 54%|█████▎    | 20314/37963 [63:05:44<49:41:24, 10.14s/it]
 54%|█████▎    | 20315/37963 [63:06:00<58:41:49, 11.97s/it]
 54%|█████▎    | 20316/37963 [63:06:10<55:42:20, 11.36s/it]
 54%|█████▎    | 20317/37963 [63:06:20<53:05:15, 10.83s/it]
 54%|█████▎    | 20318/37963 [63:06:30<52:09:42, 10.64s/it]
 54%|█████▎    | 20319/37963 [63:06:40<51:29:16, 10.51s/it]
 54%|█████▎    | 20320/37963 [63:06:50<51:00:51, 10.41s/it]
                                                           
{'loss': '0.1404', 'grad_norm': '1.426', 'learning_rate': '9.345e-06', 'epoch': '0.5353'}

 54%|█████▎    | 20320/37963 [63:06:50<51:00:51, 10.41s/it]
 54%|█████▎    | 20321/37963 [63:07:01<50:32:45, 10.31s/it]
 54%|█████▎    | 20322/37963 [63:07:11<50:10:29, 10.24s/it]
 54%|█████▎    | 20323/37963 [63:07:21<49:47:29, 10.16s/it]
 54%|█████▎    | 20324/37963 [63:07:31<49:45:46, 10.16s/it]
 54%|█████▎    | 20325/37963 [63:07:41<49:18:20, 10.06s/it]
 54%|█████▎    | 20326/37963 [63:07:50<48:36:43,  9.92s/it]
 54%|█████▎    | 20327/37963 [63:08:00<48:20:30,  9.87s/it]
 54%|█████▎    | 20328/37963 [63:08:10<48:42:45,  9.94s/it]
 54%|█████▎    | 20329/37963 [63:08:27<58:22:59, 11.92s/it]
 54%|█████▎    | 20330/37963 [63:08:37<55:46:42, 11.39s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '2.16', 'learning_rate': '9.337e-06', 'epoch': '0.5355'}

 54%|█████▎    | 20330/37963 [63:08:37<55:46:42, 11.39s/it]
 54%|█████▎    | 20331/37963 [63:08:47<53:43:40, 10.97s/it]
 54%|█████▎    | 20332/37963 [63:08:57<52:23:11, 10.70s/it]
 54%|█████▎    | 20333/37963 [63:09:13<60:54:39, 12.44s/it]
 54%|█████▎    | 20334/37963 [63:09:30<67:45:55, 13.84s/it]
 54%|█████▎    | 20335/37963 [63:09:40<61:44:34, 12.61s/it]
 54%|█████▎    | 20336/37963 [63:09:50<58:05:47, 11.87s/it]
 54%|█████▎    | 20337/37963 [63:10:07<64:52:53, 13.25s/it]
 54%|█████▎    | 20338/37963 [63:10:17<59:51:50, 12.23s/it]
 54%|█████▎    | 20339/37963 [63:10:27<56:32:24, 11.55s/it]
 54%|█████▎    | 20340/37963 [63:10:43<64:00:03, 13.07s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '1.206', 'learning_rate': '9.328e-06', 'epoch': '0.5358'}

 54%|█████▎    | 20340/37963 [63:10:43<64:00:03, 13.07s/it]
 54%|█████▎    | 20341/37963 [63:10:53<59:18:28, 12.12s/it]
 54%|█████▎    | 20342/37963 [63:11:03<55:54:34, 11.42s/it]
 54%|█████▎    | 20343/37963 [63:11:19<63:09:36, 12.90s/it]
 54%|█████▎    | 20344/37963 [63:11:30<59:17:46, 12.12s/it]
 54%|█████▎    | 20345/37963 [63:11:40<56:13:08, 11.49s/it]
 54%|█████▎    | 20346/37963 [63:11:50<54:05:34, 11.05s/it]
 54%|█████▎    | 20347/37963 [63:12:00<52:38:39, 10.76s/it]
 54%|█████▎    | 20348/37963 [63:12:10<51:41:19, 10.56s/it]
 54%|█████▎    | 20349/37963 [63:12:20<51:17:20, 10.48s/it]
 54%|█████▎    | 20350/37963 [63:12:30<50:43:43, 10.37s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '1.687', 'learning_rate': '9.32e-06', 'epoch': '0.5361'}

 54%|█████▎    | 20350/37963 [63:12:30<50:43:43, 10.37s/it]
 54%|█████▎    | 20351/37963 [63:12:40<50:09:37, 10.25s/it]
 54%|█████▎    | 20352/37963 [63:12:50<49:33:41, 10.13s/it]
 54%|█████▎    | 20353/37963 [63:13:00<49:26:22, 10.11s/it]
 54%|█████▎    | 20354/37963 [63:13:10<49:24:45, 10.10s/it]
 54%|█████▎    | 20355/37963 [63:13:20<49:18:46, 10.08s/it]
 54%|█████▎    | 20356/37963 [63:13:37<59:08:17, 12.09s/it]
 54%|█████▎    | 20357/37963 [63:13:47<56:08:30, 11.48s/it]
 54%|█████▎    | 20358/37963 [63:13:57<54:14:35, 11.09s/it]
 54%|█████▎    | 20359/37963 [63:14:07<52:47:19, 10.80s/it]
 54%|█████▎    | 20360/37963 [63:14:17<51:45:16, 10.58s/it]
                                                           
{'loss': '0.1443', 'grad_norm': '4.725', 'learning_rate': '9.311e-06', 'epoch': '0.5363'}

 54%|█████▎    | 20360/37963 [63:14:17<51:45:16, 10.58s/it]
 54%|█████▎    | 20361/37963 [63:14:27<50:55:10, 10.41s/it]
 54%|█████▎    | 20362/37963 [63:14:37<50:02:24, 10.23s/it]
 54%|█████▎    | 20363/37963 [63:14:47<49:30:47, 10.13s/it]
 54%|█████▎    | 20364/37963 [63:14:57<49:26:07, 10.11s/it]
 54%|█████▎    | 20365/37963 [63:15:07<49:20:40, 10.09s/it]
 54%|█████▎    | 20366/37963 [63:15:17<48:39:05,  9.95s/it]
 54%|█████▎    | 20367/37963 [63:15:33<58:08:42, 11.90s/it]
 54%|█████▎    | 20368/37963 [63:15:43<55:21:54, 11.33s/it]
 54%|█████▎    | 20369/37963 [63:15:53<53:22:25, 10.92s/it]
 54%|█████▎    | 20370/37963 [63:16:03<52:06:14, 10.66s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '2.165', 'learning_rate': '9.303e-06', 'epoch': '0.5366'}

 54%|█████▎    | 20370/37963 [63:16:03<52:06:14, 10.66s/it]
 54%|█████▎    | 20371/37963 [63:16:13<51:22:48, 10.51s/it]
 54%|█████▎    | 20372/37963 [63:16:23<50:39:51, 10.37s/it]
 54%|█████▎    | 20373/37963 [63:16:34<50:16:34, 10.29s/it]
 54%|█████▎    | 20374/37963 [63:16:44<50:03:51, 10.25s/it]
 54%|█████▎    | 20375/37963 [63:16:54<49:46:54, 10.19s/it]
 54%|█████▎    | 20376/37963 [63:17:04<49:47:04, 10.19s/it]
 54%|█████▎    | 20377/37963 [63:17:14<49:34:31, 10.15s/it]
 54%|█████▎    | 20378/37963 [63:17:24<49:44:33, 10.18s/it]
 54%|█████▎    | 20379/37963 [63:17:34<49:38:58, 10.16s/it]
 54%|█████▎    | 20380/37963 [63:17:51<59:00:41, 12.08s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '1.2', 'learning_rate': '9.294e-06', 'epoch': '0.5368'}

 54%|█████▎    | 20380/37963 [63:17:51<59:00:41, 12.08s/it]
 54%|█████▎    | 20381/37963 [63:18:01<55:43:29, 11.41s/it]
 54%|█████▎    | 20382/37963 [63:18:17<62:50:12, 12.87s/it]
 54%|█████▎    | 20383/37963 [63:18:27<58:50:53, 12.05s/it]
 54%|█████▎    | 20384/37963 [63:18:37<56:01:11, 11.47s/it]
 54%|█████▎    | 20385/37963 [63:18:48<54:07:00, 11.08s/it]
 54%|█████▎    | 20386/37963 [63:19:04<62:13:17, 12.74s/it]
 54%|█████▎    | 20387/37963 [63:19:14<58:16:18, 11.94s/it]
 54%|█████▎    | 20388/37963 [63:19:30<64:19:49, 13.18s/it]
 54%|█████▎    | 20389/37963 [63:19:40<59:45:40, 12.24s/it]
 54%|█████▎    | 20390/37963 [63:19:50<56:39:08, 11.61s/it]
                                                           
{'loss': '0.1304', 'grad_norm': '1.308', 'learning_rate': '9.286e-06', 'epoch': '0.5371'}

 54%|█████▎    | 20390/37963 [63:19:50<56:39:08, 11.61s/it]
 54%|█████▎    | 20391/37963 [63:20:07<64:02:50, 13.12s/it]
 54%|█████▎    | 20392/37963 [63:20:17<59:21:14, 12.16s/it]
 54%|█████▎    | 20393/37963 [63:20:27<56:20:26, 11.54s/it]
 54%|█████▎    | 20394/37963 [63:20:37<54:08:30, 11.09s/it]
 54%|█████▎    | 20395/37963 [63:20:47<52:36:00, 10.78s/it]
 54%|█████▎    | 20396/37963 [63:20:57<51:31:40, 10.56s/it]
 54%|█████▎    | 20397/37963 [63:21:07<50:08:06, 10.27s/it]
 54%|█████▎    | 20398/37963 [63:21:17<49:54:11, 10.23s/it]
 54%|█████▎    | 20399/37963 [63:21:27<49:38:51, 10.18s/it]
 54%|█████▎    | 20400/37963 [63:21:37<49:33:04, 10.16s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '1.568', 'learning_rate': '9.277e-06', 'epoch': '0.5374'}

 54%|█████▎    | 20400/37963 [63:21:37<49:33:04, 10.16s/it]
 54%|█████▎    | 20401/37963 [63:21:47<49:32:05, 10.15s/it]
 54%|█████▎    | 20402/37963 [63:21:57<49:15:58, 10.10s/it]
 54%|█████▎    | 20403/37963 [63:22:07<49:16:08, 10.10s/it]
 54%|█████▎    | 20404/37963 [63:22:25<59:34:27, 12.21s/it]
 54%|█████▎    | 20405/37963 [63:22:34<56:15:41, 11.54s/it]
 54%|█████▍    | 20406/37963 [63:22:44<54:00:41, 11.07s/it]
 54%|█████▍    | 20407/37963 [63:22:55<52:28:12, 10.76s/it]
 54%|█████▍    | 20408/37963 [63:23:05<51:27:09, 10.55s/it]
 54%|█████▍    | 20409/37963 [63:23:15<50:52:46, 10.43s/it]
 54%|█████▍    | 20410/37963 [63:23:24<49:51:49, 10.23s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '1.01', 'learning_rate': '9.269e-06', 'epoch': '0.5376'}

 54%|█████▍    | 20410/37963 [63:23:24<49:51:49, 10.23s/it]
 54%|█████▍    | 20411/37963 [63:23:35<49:47:12, 10.21s/it]
 54%|█████▍    | 20412/37963 [63:23:45<49:34:22, 10.17s/it]
 54%|█████▍    | 20413/37963 [63:23:55<49:24:08, 10.13s/it]
 54%|█████▍    | 20414/37963 [63:24:05<49:19:55, 10.12s/it]
 54%|█████▍    | 20415/37963 [63:24:21<58:21:04, 11.97s/it]
 54%|█████▍    | 20416/37963 [63:24:31<55:37:09, 11.41s/it]
 54%|█████▍    | 20417/37963 [63:24:41<53:08:09, 10.90s/it]
 54%|█████▍    | 20418/37963 [63:24:51<51:56:16, 10.66s/it]
 54%|█████▍    | 20419/37963 [63:25:01<50:36:46, 10.39s/it]
 54%|█████▍    | 20420/37963 [63:25:11<49:37:34, 10.18s/it]
                                                           
{'loss': '0.1406', 'grad_norm': '1.498', 'learning_rate': '9.26e-06', 'epoch': '0.5379'}

 54%|█████▍    | 20420/37963 [63:25:11<49:37:34, 10.18s/it]
 54%|█████▍    | 20421/37963 [63:25:21<49:31:14, 10.16s/it]
 54%|█████▍    | 20422/37963 [63:25:31<49:14:48, 10.11s/it]
 54%|█████▍    | 20423/37963 [63:25:41<49:17:42, 10.12s/it]
 54%|█████▍    | 20424/37963 [63:25:51<49:20:26, 10.13s/it]
 54%|█████▍    | 20425/37963 [63:26:01<49:22:40, 10.14s/it]
 54%|█████▍    | 20426/37963 [63:26:11<49:26:52, 10.15s/it]
 54%|█████▍    | 20427/37963 [63:26:21<49:33:36, 10.17s/it]
 54%|█████▍    | 20428/37963 [63:26:32<49:28:34, 10.16s/it]
 54%|█████▍    | 20429/37963 [63:26:48<58:06:25, 11.93s/it]
 54%|█████▍    | 20430/37963 [63:27:11<75:23:47, 15.48s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '2.307', 'learning_rate': '9.252e-06', 'epoch': '0.5382'}

 54%|█████▍    | 20430/37963 [63:27:11<75:23:47, 15.48s/it]
 54%|█████▍    | 20431/37963 [63:27:22<67:43:04, 13.91s/it]
 54%|█████▍    | 20432/37963 [63:27:32<62:06:06, 12.75s/it]
 54%|█████▍    | 20433/37963 [63:27:42<58:08:33, 11.94s/it]
 54%|█████▍    | 20434/37963 [63:27:52<55:09:23, 11.33s/it]
 54%|█████▍    | 20435/37963 [63:28:08<61:48:38, 12.70s/it]
 54%|█████▍    | 20436/37963 [63:28:24<66:43:04, 13.70s/it]
 54%|█████▍    | 20437/37963 [63:28:34<61:32:29, 12.64s/it]
 54%|█████▍    | 20438/37963 [63:28:44<58:00:08, 11.91s/it]
 54%|█████▍    | 20439/37963 [63:29:01<64:53:47, 13.33s/it]
 54%|█████▍    | 20440/37963 [63:29:11<60:08:56, 12.36s/it]
                                                           
{'loss': '0.1366', 'grad_norm': '1.847', 'learning_rate': '9.243e-06', 'epoch': '0.5384'}

 54%|█████▍    | 20440/37963 [63:29:11<60:08:56, 12.36s/it]
 54%|█████▍    | 20441/37963 [63:29:21<56:55:31, 11.70s/it]
 54%|█████▍    | 20442/37963 [63:29:31<54:35:07, 11.22s/it]
 54%|█████▍    | 20443/37963 [63:29:41<52:41:33, 10.83s/it]
 54%|█████▍    | 20444/37963 [63:29:51<51:37:47, 10.61s/it]
 54%|█████▍    | 20445/37963 [63:30:01<50:55:11, 10.46s/it]
 54%|█████▍    | 20446/37963 [63:30:11<50:28:38, 10.37s/it]
 54%|█████▍    | 20447/37963 [63:30:21<50:07:11, 10.30s/it]
 54%|█████▍    | 20448/37963 [63:30:31<49:47:18, 10.23s/it]
 54%|█████▍    | 20449/37963 [63:30:42<49:32:05, 10.18s/it]
 54%|█████▍    | 20450/37963 [63:30:58<59:18:25, 12.19s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '3.95', 'learning_rate': '9.235e-06', 'epoch': '0.5387'}

 54%|█████▍    | 20450/37963 [63:30:58<59:18:25, 12.19s/it]
 54%|█████▍    | 20451/37963 [63:31:08<55:39:31, 11.44s/it]
 54%|█████▍    | 20452/37963 [63:31:18<53:50:20, 11.07s/it]
 54%|█████▍    | 20453/37963 [63:31:28<52:16:57, 10.75s/it]
 54%|█████▍    | 20454/37963 [63:31:38<51:21:21, 10.56s/it]
 54%|█████▍    | 20455/37963 [63:31:48<50:37:03, 10.41s/it]
 54%|█████▍    | 20456/37963 [63:31:59<50:14:56, 10.33s/it]
 54%|█████▍    | 20457/37963 [63:32:09<49:51:53, 10.25s/it]
 54%|█████▍    | 20458/37963 [63:32:18<49:09:09, 10.11s/it]
 54%|█████▍    | 20459/37963 [63:32:29<49:17:23, 10.14s/it]
 54%|█████▍    | 20460/37963 [63:32:38<48:39:01, 10.01s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '2.939', 'learning_rate': '9.226e-06', 'epoch': '0.5389'}

 54%|█████▍    | 20460/37963 [63:32:38<48:39:01, 10.01s/it]
 54%|█████▍    | 20461/37963 [63:32:49<48:49:53, 10.04s/it]
 54%|█████▍    | 20462/37963 [63:32:59<48:52:31, 10.05s/it]
 54%|█████▍    | 20463/37963 [63:33:09<48:52:34, 10.05s/it]
 54%|█████▍    | 20464/37963 [63:33:24<57:05:59, 11.75s/it]
 54%|█████▍    | 20465/37963 [63:33:34<54:43:07, 11.26s/it]
 54%|█████▍    | 20466/37963 [63:33:45<53:06:43, 10.93s/it]
 54%|█████▍    | 20467/37963 [63:33:55<51:49:55, 10.67s/it]
 54%|█████▍    | 20468/37963 [63:34:05<51:04:53, 10.51s/it]
 54%|█████▍    | 20469/37963 [63:34:15<50:02:29, 10.30s/it]
 54%|█████▍    | 20470/37963 [63:34:25<49:55:45, 10.28s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '0.9104', 'learning_rate': '9.218e-06', 'epoch': '0.5392'}

 54%|█████▍    | 20470/37963 [63:34:25<49:55:45, 10.28s/it]
 54%|█████▍    | 20471/37963 [63:34:34<49:00:18, 10.09s/it]
 54%|█████▍    | 20472/37963 [63:34:45<48:54:00, 10.06s/it]
 54%|█████▍    | 20473/37963 [63:34:54<48:20:58,  9.95s/it]
 54%|█████▍    | 20474/37963 [63:35:04<48:30:59,  9.99s/it]
 54%|█████▍    | 20475/37963 [63:35:14<48:31:27,  9.99s/it]
 54%|█████▍    | 20476/37963 [63:35:24<48:38:24, 10.01s/it]
 54%|█████▍    | 20477/37963 [63:35:34<48:40:09, 10.02s/it]
 54%|█████▍    | 20478/37963 [63:35:58<67:52:29, 13.97s/it]
 54%|█████▍    | 20479/37963 [63:36:14<71:47:19, 14.78s/it]
 54%|█████▍    | 20480/37963 [63:36:24<64:25:06, 13.26s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.404', 'learning_rate': '9.209e-06', 'epoch': '0.5395'}

 54%|█████▍    | 20480/37963 [63:36:24<64:25:06, 13.26s/it]
 54%|█████▍    | 20481/37963 [63:36:34<59:42:07, 12.29s/it]
 54%|█████▍    | 20482/37963 [63:36:50<65:28:31, 13.48s/it]
 54%|█████▍    | 20483/37963 [63:37:00<60:28:07, 12.45s/it]
 54%|█████▍    | 20484/37963 [63:37:10<56:35:14, 11.65s/it]
 54%|█████▍    | 20485/37963 [63:37:20<54:04:52, 11.14s/it]
 54%|█████▍    | 20486/37963 [63:37:36<61:35:48, 12.69s/it]
 54%|█████▍    | 20487/37963 [63:37:53<67:05:36, 13.82s/it]
 54%|█████▍    | 20488/37963 [63:38:03<61:47:59, 12.73s/it]
 54%|█████▍    | 20489/37963 [63:38:13<57:52:30, 11.92s/it]
 54%|█████▍    | 20490/37963 [63:38:23<55:18:34, 11.40s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '0.7361', 'learning_rate': '9.201e-06', 'epoch': '0.5397'}

 54%|█████▍    | 20490/37963 [63:38:23<55:18:34, 11.40s/it]
 54%|█████▍    | 20491/37963 [63:38:33<53:11:23, 10.96s/it]
 54%|█████▍    | 20492/37963 [63:38:43<51:26:54, 10.60s/it]
 54%|█████▍    | 20493/37963 [63:38:53<50:40:25, 10.44s/it]
 54%|█████▍    | 20494/37963 [63:39:03<50:05:38, 10.32s/it]
 54%|█████▍    | 20495/37963 [63:39:13<49:49:35, 10.27s/it]
 54%|█████▍    | 20496/37963 [63:39:23<49:31:09, 10.21s/it]
 54%|█████▍    | 20497/37963 [63:39:33<49:23:27, 10.18s/it]
 54%|█████▍    | 20498/37963 [63:39:43<49:12:13, 10.14s/it]
 54%|█████▍    | 20499/37963 [63:40:00<59:11:04, 12.20s/it]
 54%|█████▍    | 20500/37963 [63:40:10<55:32:23, 11.45s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '1.44', 'learning_rate': '9.192e-06', 'epoch': '0.54'}

 54%|█████▍    | 20500/37963 [63:40:10<55:32:23, 11.45s/it]
 54%|█████▍    | 20501/37963 [63:40:20<53:22:58, 11.01s/it]
 54%|█████▍    | 20502/37963 [63:40:30<51:19:40, 10.58s/it]
 54%|█████▍    | 20503/37963 [63:40:40<50:28:06, 10.41s/it]
 54%|█████▍    | 20504/37963 [63:40:50<49:40:05, 10.24s/it]
 54%|█████▍    | 20505/37963 [63:40:59<48:50:56, 10.07s/it]
 54%|█████▍    | 20506/37963 [63:41:09<48:51:51, 10.08s/it]
 54%|█████▍    | 20507/37963 [63:41:19<48:53:14, 10.08s/it]
 54%|█████▍    | 20508/37963 [63:41:29<48:49:31, 10.07s/it]
 54%|█████▍    | 20509/37963 [63:41:39<48:40:34, 10.04s/it]
 54%|█████▍    | 20510/37963 [63:41:49<48:00:20,  9.90s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '4.433', 'learning_rate': '9.184e-06', 'epoch': '0.5403'}

 54%|█████▍    | 20510/37963 [63:41:49<48:00:20,  9.90s/it]
 54%|█████▍    | 20511/37963 [63:42:05<57:34:55, 11.88s/it]
 54%|█████▍    | 20512/37963 [63:42:15<54:23:24, 11.22s/it]
 54%|█████▍    | 20513/37963 [63:42:25<52:22:57, 10.81s/it]
 54%|█████▍    | 20514/37963 [63:42:35<51:13:05, 10.57s/it]
 54%|█████▍    | 20515/37963 [63:42:45<50:34:46, 10.44s/it]
 54%|█████▍    | 20516/37963 [63:42:55<50:01:19, 10.32s/it]
 54%|█████▍    | 20517/37963 [63:43:05<49:26:15, 10.20s/it]
 54%|█████▍    | 20518/37963 [63:43:15<49:15:06, 10.16s/it]
 54%|█████▍    | 20519/37963 [63:43:25<48:49:54, 10.08s/it]
 54%|█████▍    | 20520/37963 [63:43:35<48:25:26,  9.99s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '1.481', 'learning_rate': '9.175e-06', 'epoch': '0.5405'}

 54%|█████▍    | 20520/37963 [63:43:35<48:25:26,  9.99s/it]
 54%|█████▍    | 20521/37963 [63:43:45<48:40:29, 10.05s/it]
 54%|█████▍    | 20522/37963 [63:43:55<48:46:51, 10.07s/it]
 54%|█████▍    | 20523/37963 [63:44:05<48:34:21, 10.03s/it]
 54%|█████▍    | 20524/37963 [63:44:15<48:46:07, 10.07s/it]
 54%|█████▍    | 20525/37963 [63:44:31<57:32:33, 11.88s/it]
 54%|█████▍    | 20526/37963 [63:44:49<65:26:25, 13.51s/it]
 54%|█████▍    | 20527/37963 [63:45:05<69:34:01, 14.36s/it]
 54%|█████▍    | 20528/37963 [63:45:15<63:31:39, 13.12s/it]
 54%|█████▍    | 20529/37963 [63:45:25<58:49:46, 12.15s/it]
 54%|█████▍    | 20530/37963 [63:45:42<65:23:27, 13.50s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '2.054', 'learning_rate': '9.167e-06', 'epoch': '0.5408'}

 54%|█████▍    | 20530/37963 [63:45:42<65:23:27, 13.50s/it]
 54%|█████▍    | 20531/37963 [63:45:51<59:53:13, 12.37s/it]
 54%|█████▍    | 20532/37963 [63:46:02<56:31:36, 11.67s/it]
 54%|█████▍    | 20533/37963 [63:46:11<53:43:56, 11.10s/it]
 54%|█████▍    | 20534/37963 [63:46:28<61:12:00, 12.64s/it]
 54%|█████▍    | 20535/37963 [63:46:44<66:49:31, 13.80s/it]
 54%|█████▍    | 20536/37963 [63:46:54<61:27:08, 12.69s/it]
 54%|█████▍    | 20537/37963 [63:47:04<57:42:35, 11.92s/it]
 54%|█████▍    | 20538/37963 [63:47:14<55:01:24, 11.37s/it]
 54%|█████▍    | 20539/37963 [63:47:24<53:06:28, 10.97s/it]
 54%|█████▍    | 20540/37963 [63:47:34<51:40:44, 10.68s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '2.478', 'learning_rate': '9.158e-06', 'epoch': '0.5411'}

 54%|█████▍    | 20540/37963 [63:47:34<51:40:44, 10.68s/it]
 54%|█████▍    | 20541/37963 [63:47:44<50:42:18, 10.48s/it]
 54%|█████▍    | 20542/37963 [63:47:54<50:09:45, 10.37s/it]
 54%|█████▍    | 20543/37963 [63:48:04<49:30:30, 10.23s/it]
 54%|█████▍    | 20544/37963 [63:48:15<49:32:19, 10.24s/it]
 54%|█████▍    | 20545/37963 [63:48:32<59:37:30, 12.32s/it]
 54%|█████▍    | 20546/37963 [63:48:42<56:25:06, 11.66s/it]
 54%|█████▍    | 20547/37963 [63:48:52<54:09:14, 11.19s/it]
 54%|█████▍    | 20548/37963 [63:49:02<52:48:38, 10.92s/it]
 54%|█████▍    | 20549/37963 [63:49:12<51:34:17, 10.66s/it]
 54%|█████▍    | 20550/37963 [63:49:22<50:20:17, 10.41s/it]
                                                           
{'loss': '0.1459', 'grad_norm': '1.43', 'learning_rate': '9.15e-06', 'epoch': '0.5413'}

 54%|█████▍    | 20550/37963 [63:49:22<50:20:17, 10.41s/it]
 54%|█████▍    | 20551/37963 [63:49:32<49:56:59, 10.33s/it]
 54%|█████▍    | 20552/37963 [63:49:43<49:41:50, 10.28s/it]
 54%|█████▍    | 20553/37963 [63:49:53<49:26:31, 10.22s/it]
 54%|█████▍    | 20554/37963 [63:50:03<48:58:02, 10.13s/it]
 54%|█████▍    | 20555/37963 [63:50:13<48:49:21, 10.10s/it]
 54%|█████▍    | 20556/37963 [63:50:22<48:30:12, 10.03s/it]
 54%|█████▍    | 20557/37963 [63:50:32<48:20:10, 10.00s/it]
 54%|█████▍    | 20558/37963 [63:50:42<48:27:49, 10.02s/it]
 54%|█████▍    | 20559/37963 [63:50:52<48:25:54, 10.02s/it]
 54%|█████▍    | 20560/37963 [63:51:09<57:55:45, 11.98s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '0.8754', 'learning_rate': '9.141e-06', 'epoch': '0.5416'}

 54%|█████▍    | 20560/37963 [63:51:09<57:55:45, 11.98s/it]
 54%|█████▍    | 20561/37963 [63:51:19<55:07:53, 11.41s/it]
 54%|█████▍    | 20562/37963 [63:51:29<53:09:56, 11.00s/it]
 54%|█████▍    | 20563/37963 [63:51:39<51:23:05, 10.63s/it]
 54%|█████▍    | 20564/37963 [63:51:49<50:46:22, 10.51s/it]
 54%|█████▍    | 20565/37963 [63:51:59<50:16:12, 10.40s/it]
 54%|█████▍    | 20566/37963 [63:52:09<49:45:30, 10.30s/it]
 54%|█████▍    | 20567/37963 [63:52:19<48:45:11, 10.09s/it]
 54%|█████▍    | 20568/37963 [63:52:29<48:32:09, 10.04s/it]
 54%|█████▍    | 20569/37963 [63:52:39<48:13:08,  9.98s/it]
 54%|█████▍    | 20570/37963 [63:52:49<48:23:47, 10.02s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '1.906', 'learning_rate': '9.133e-06', 'epoch': '0.5418'}

 54%|█████▍    | 20570/37963 [63:52:49<48:23:47, 10.02s/it]
 54%|█████▍    | 20571/37963 [63:52:59<48:38:36, 10.07s/it]
 54%|█████▍    | 20572/37963 [63:53:09<48:40:03, 10.07s/it]
 54%|█████▍    | 20573/37963 [63:53:19<48:41:23, 10.08s/it]
 54%|█████▍    | 20574/37963 [63:53:42<67:49:47, 14.04s/it]
 54%|█████▍    | 20575/37963 [63:53:53<62:03:46, 12.85s/it]
 54%|█████▍    | 20576/37963 [63:54:03<58:07:20, 12.03s/it]
 54%|█████▍    | 20577/37963 [63:54:12<54:43:47, 11.33s/it]
 54%|█████▍    | 20578/37963 [63:54:35<71:32:47, 14.82s/it]
 54%|█████▍    | 20579/37963 [63:54:45<64:37:38, 13.38s/it]
 54%|█████▍    | 20580/37963 [63:54:55<59:45:39, 12.38s/it]
                                                           
{'loss': '0.144', 'grad_norm': '2.634', 'learning_rate': '9.124e-06', 'epoch': '0.5421'}

 54%|█████▍    | 20580/37963 [63:54:55<59:45:39, 12.38s/it]
 54%|█████▍    | 20581/37963 [63:55:05<56:01:15, 11.60s/it]
 54%|█████▍    | 20582/37963 [63:55:27<71:34:57, 14.83s/it]
 54%|█████▍    | 20583/37963 [63:55:38<64:47:23, 13.42s/it]
 54%|█████▍    | 20584/37963 [63:55:48<60:01:20, 12.43s/it]
 54%|█████▍    | 20585/37963 [63:55:58<56:16:16, 11.66s/it]
 54%|█████▍    | 20586/37963 [63:56:08<54:14:03, 11.24s/it]
 54%|█████▍    | 20587/37963 [63:56:18<52:35:45, 10.90s/it]
 54%|█████▍    | 20588/37963 [63:56:28<51:29:16, 10.67s/it]
 54%|█████▍    | 20589/37963 [63:56:38<50:43:19, 10.51s/it]
 54%|█████▍    | 20590/37963 [63:56:48<49:56:07, 10.35s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '1.106', 'learning_rate': '9.116e-06', 'epoch': '0.5424'}

 54%|█████▍    | 20590/37963 [63:56:48<49:56:07, 10.35s/it]
 54%|█████▍    | 20591/37963 [63:56:58<49:29:00, 10.25s/it]
 54%|█████▍    | 20592/37963 [63:57:08<48:32:10, 10.06s/it]
 54%|█████▍    | 20593/37963 [63:57:18<48:31:16, 10.06s/it]
 54%|█████▍    | 20594/37963 [63:57:35<58:30:10, 12.13s/it]
 54%|█████▍    | 20595/37963 [63:57:45<55:30:01, 11.50s/it]
 54%|█████▍    | 20596/37963 [63:57:55<53:14:12, 11.04s/it]
 54%|█████▍    | 20597/37963 [63:58:05<51:39:19, 10.71s/it]
 54%|█████▍    | 20598/37963 [63:58:15<50:45:06, 10.52s/it]
 54%|█████▍    | 20599/37963 [63:58:25<49:54:00, 10.35s/it]
 54%|█████▍    | 20600/37963 [63:58:35<49:39:29, 10.30s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '1.976', 'learning_rate': '9.107e-06', 'epoch': '0.5426'}

 54%|█████▍    | 20600/37963 [63:58:35<49:39:29, 10.30s/it]
 54%|█████▍    | 20601/37963 [63:58:45<49:20:58, 10.23s/it]
 54%|█████▍    | 20602/37963 [63:58:55<49:09:49, 10.19s/it]
 54%|█████▍    | 20603/37963 [63:59:05<48:57:16, 10.15s/it]
 54%|█████▍    | 20604/37963 [63:59:15<49:02:11, 10.17s/it]
 54%|█████▍    | 20605/37963 [63:59:26<48:52:42, 10.14s/it]
 54%|█████▍    | 20606/37963 [63:59:36<49:01:29, 10.17s/it]
 54%|█████▍    | 20607/37963 [63:59:46<49:06:39, 10.19s/it]
 54%|█████▍    | 20608/37963 [64:00:02<57:43:20, 11.97s/it]
 54%|█████▍    | 20609/37963 [64:00:12<54:48:53, 11.37s/it]
 54%|█████▍    | 20610/37963 [64:00:22<53:01:00, 11.00s/it]
                                                           
{'loss': '0.1429', 'grad_norm': '1.7', 'learning_rate': '9.099e-06', 'epoch': '0.5429'}

 54%|█████▍    | 20610/37963 [64:00:22<53:01:00, 11.00s/it]
 54%|█████▍    | 20611/37963 [64:00:32<51:39:32, 10.72s/it]
 54%|█████▍    | 20612/37963 [64:00:42<50:44:26, 10.53s/it]
 54%|█████▍    | 20613/37963 [64:00:52<50:07:17, 10.40s/it]
 54%|█████▍    | 20614/37963 [64:01:02<49:32:11, 10.28s/it]
 54%|█████▍    | 20615/37963 [64:01:12<48:40:49, 10.10s/it]
 54%|█████▍    | 20616/37963 [64:01:22<48:28:08, 10.06s/it]
 54%|█████▍    | 20617/37963 [64:01:32<48:32:14, 10.07s/it]
 54%|█████▍    | 20618/37963 [64:01:42<48:33:57, 10.08s/it]
 54%|█████▍    | 20619/37963 [64:01:52<48:37:05, 10.09s/it]
 54%|█████▍    | 20620/37963 [64:02:10<58:44:46, 12.19s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '2.612', 'learning_rate': '9.09e-06', 'epoch': '0.5432'}

 54%|█████▍    | 20620/37963 [64:02:10<58:44:46, 12.19s/it]
 54%|█████▍    | 20621/37963 [64:02:20<55:38:15, 11.55s/it]
 54%|█████▍    | 20622/37963 [64:02:29<53:13:45, 11.05s/it]
 54%|█████▍    | 20623/37963 [64:02:46<61:29:33, 12.77s/it]
 54%|█████▍    | 20624/37963 [64:02:56<57:14:21, 11.88s/it]
 54%|█████▍    | 20625/37963 [64:03:12<63:32:26, 13.19s/it]
 54%|█████▍    | 20626/37963 [64:03:22<58:56:40, 12.24s/it]
 54%|█████▍    | 20627/37963 [64:03:39<65:07:07, 13.52s/it]
 54%|█████▍    | 20628/37963 [64:03:49<60:12:39, 12.50s/it]
 54%|█████▍    | 20629/37963 [64:04:05<65:47:49, 13.67s/it]
 54%|█████▍    | 20630/37963 [64:04:15<60:36:34, 12.59s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '2.859', 'learning_rate': '9.082e-06', 'epoch': '0.5434'}

 54%|█████▍    | 20630/37963 [64:04:15<60:36:34, 12.59s/it]
 54%|█████▍    | 20631/37963 [64:04:32<66:06:46, 13.73s/it]
 54%|█████▍    | 20632/37963 [64:04:42<60:46:35, 12.62s/it]
 54%|█████▍    | 20633/37963 [64:04:51<56:24:37, 11.72s/it]
 54%|█████▍    | 20634/37963 [64:05:02<54:04:03, 11.23s/it]
 54%|█████▍    | 20635/37963 [64:05:12<52:18:53, 10.87s/it]
 54%|█████▍    | 20636/37963 [64:05:22<51:19:42, 10.66s/it]
 54%|█████▍    | 20637/37963 [64:05:32<50:04:15, 10.40s/it]
 54%|█████▍    | 20638/37963 [64:05:41<49:13:09, 10.23s/it]
 54%|█████▍    | 20639/37963 [64:05:51<49:00:28, 10.18s/it]
 54%|█████▍    | 20640/37963 [64:06:02<48:56:16, 10.17s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '0.9788', 'learning_rate': '9.073e-06', 'epoch': '0.5437'}

 54%|█████▍    | 20640/37963 [64:06:02<48:56:16, 10.17s/it]
 54%|█████▍    | 20641/37963 [64:06:19<58:45:16, 12.21s/it]
 54%|█████▍    | 20642/37963 [64:06:29<55:41:08, 11.57s/it]
 54%|█████▍    | 20643/37963 [64:06:39<53:30:16, 11.12s/it]
 54%|█████▍    | 20644/37963 [64:06:49<52:06:12, 10.83s/it]
 54%|█████▍    | 20645/37963 [64:06:59<50:55:48, 10.59s/it]
 54%|█████▍    | 20646/37963 [64:07:09<50:11:30, 10.43s/it]
 54%|█████▍    | 20647/37963 [64:07:19<49:35:29, 10.31s/it]
 54%|█████▍    | 20648/37963 [64:07:29<49:12:28, 10.23s/it]
 54%|█████▍    | 20649/37963 [64:07:39<48:43:38, 10.13s/it]
 54%|█████▍    | 20650/37963 [64:07:49<48:38:44, 10.12s/it]
                                                           
{'loss': '0.1343', 'grad_norm': '1.361', 'learning_rate': '9.065e-06', 'epoch': '0.544'}

 54%|█████▍    | 20650/37963 [64:07:49<48:38:44, 10.12s/it]
 54%|█████▍    | 20651/37963 [64:07:59<48:32:15, 10.09s/it]
 54%|█████▍    | 20652/37963 [64:08:09<48:41:44, 10.13s/it]
 54%|█████▍    | 20653/37963 [64:08:19<48:39:35, 10.12s/it]
 54%|█████▍    | 20654/37963 [64:08:30<48:41:15, 10.13s/it]
 54%|█████▍    | 20655/37963 [64:08:40<48:36:52, 10.11s/it]
 54%|█████▍    | 20656/37963 [64:08:50<48:36:21, 10.11s/it]
 54%|█████▍    | 20657/37963 [64:09:06<57:07:25, 11.88s/it]
 54%|█████▍    | 20658/37963 [64:09:16<54:34:53, 11.35s/it]
 54%|█████▍    | 20659/37963 [64:09:26<52:41:42, 10.96s/it]
 54%|█████▍    | 20660/37963 [64:09:36<51:37:09, 10.74s/it]
                                                           
{'loss': '0.1503', 'grad_norm': '1.62', 'learning_rate': '9.056e-06', 'epoch': '0.5442'}

 54%|█████▍    | 20660/37963 [64:09:36<51:37:09, 10.74s/it]
 54%|█████▍    | 20661/37963 [64:09:46<50:21:39, 10.48s/it]
 54%|█████▍    | 20662/37963 [64:09:56<48:59:35, 10.19s/it]
 54%|█████▍    | 20663/37963 [64:10:06<48:53:04, 10.17s/it]
 54%|█████▍    | 20664/37963 [64:10:16<48:38:56, 10.12s/it]
 54%|█████▍    | 20665/37963 [64:10:26<48:33:57, 10.11s/it]
 54%|█████▍    | 20666/37963 [64:10:36<48:08:01, 10.02s/it]
 54%|█████▍    | 20667/37963 [64:10:46<48:14:36, 10.04s/it]
 54%|█████▍    | 20668/37963 [64:10:56<48:16:48, 10.05s/it]
 54%|█████▍    | 20669/37963 [64:11:18<66:16:16, 13.80s/it]
 54%|█████▍    | 20670/37963 [64:11:28<60:55:08, 12.68s/it]
                                                           
{'loss': '0.146', 'grad_norm': '3.29', 'learning_rate': '9.048e-06', 'epoch': '0.5445'}

 54%|█████▍    | 20670/37963 [64:11:28<60:55:08, 12.68s/it]
 54%|█████▍    | 20671/37963 [64:11:38<57:10:14, 11.90s/it]
 54%|█████▍    | 20672/37963 [64:11:48<54:09:11, 11.27s/it]
 54%|█████▍    | 20673/37963 [64:12:04<61:10:40, 12.74s/it]
 54%|█████▍    | 20674/37963 [64:12:15<57:41:03, 12.01s/it]
 54%|█████▍    | 20675/37963 [64:12:31<63:58:43, 13.32s/it]
 54%|█████▍    | 20676/37963 [64:12:48<68:31:40, 14.27s/it]
 54%|█████▍    | 20677/37963 [64:12:58<62:33:08, 13.03s/it]
 54%|█████▍    | 20678/37963 [64:13:14<67:33:58, 14.07s/it]
 54%|█████▍    | 20679/37963 [64:13:24<61:38:08, 12.84s/it]
 54%|█████▍    | 20680/37963 [64:13:34<57:23:29, 11.95s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '1.071', 'learning_rate': '9.039e-06', 'epoch': '0.5447'}

 54%|█████▍    | 20680/37963 [64:13:34<57:23:29, 11.95s/it]
 54%|█████▍    | 20681/37963 [64:13:44<54:51:51, 11.43s/it]
 54%|█████▍    | 20682/37963 [64:13:54<52:53:27, 11.02s/it]
 54%|█████▍    | 20683/37963 [64:14:04<51:35:16, 10.75s/it]
 54%|█████▍    | 20684/37963 [64:14:15<50:42:18, 10.56s/it]
 54%|█████▍    | 20685/37963 [64:14:24<49:38:49, 10.34s/it]
 54%|█████▍    | 20686/37963 [64:14:34<48:32:30, 10.11s/it]
 54%|█████▍    | 20687/37963 [64:14:44<48:15:16, 10.06s/it]
 54%|█████▍    | 20688/37963 [64:14:54<48:18:54, 10.07s/it]
 54%|█████▍    | 20689/37963 [64:15:11<58:41:46, 12.23s/it]
 55%|█████▍    | 20690/37963 [64:15:21<55:37:41, 11.59s/it]
                                                           
{'loss': '0.1395', 'grad_norm': '2.344', 'learning_rate': '9.031e-06', 'epoch': '0.545'}

 55%|█████▍    | 20690/37963 [64:15:21<55:37:41, 11.59s/it]
 55%|█████▍    | 20691/37963 [64:15:31<53:26:11, 11.14s/it]
 55%|█████▍    | 20692/37963 [64:15:41<51:23:16, 10.71s/it]
 55%|█████▍    | 20693/37963 [64:15:51<50:26:25, 10.51s/it]
 55%|█████▍    | 20694/37963 [64:16:01<50:02:57, 10.43s/it]
 55%|█████▍    | 20695/37963 [64:16:12<49:42:16, 10.36s/it]
 55%|█████▍    | 20696/37963 [64:16:22<49:18:27, 10.28s/it]
 55%|█████▍    | 20697/37963 [64:16:31<48:33:52, 10.13s/it]
 55%|█████▍    | 20698/37963 [64:16:41<48:22:24, 10.09s/it]
 55%|█████▍    | 20699/37963 [64:16:52<48:30:50, 10.12s/it]
 55%|█████▍    | 20700/37963 [64:17:01<48:02:56, 10.02s/it]
                                                           
{'loss': '0.1419', 'grad_norm': '1.237', 'learning_rate': '9.022e-06', 'epoch': '0.5453'}

 55%|█████▍    | 20700/37963 [64:17:01<48:02:56, 10.02s/it]
 55%|█████▍    | 20701/37963 [64:17:12<48:07:54, 10.04s/it]
 55%|█████▍    | 20702/37963 [64:17:21<47:35:03,  9.92s/it]
 55%|█████▍    | 20703/37963 [64:17:31<47:55:07,  9.99s/it]
 55%|█████▍    | 20704/37963 [64:17:41<47:59:18, 10.01s/it]
 55%|█████▍    | 20705/37963 [64:17:52<48:09:45, 10.05s/it]
 55%|█████▍    | 20706/37963 [64:18:08<57:45:27, 12.05s/it]
 55%|█████▍    | 20707/37963 [64:18:19<55:16:50, 11.53s/it]
 55%|█████▍    | 20708/37963 [64:18:29<53:16:13, 11.11s/it]
 55%|█████▍    | 20709/37963 [64:18:39<51:46:10, 10.80s/it]
 55%|█████▍    | 20710/37963 [64:18:49<50:46:08, 10.59s/it]
                                                           
{'loss': '0.1472', 'grad_norm': '1.206', 'learning_rate': '9.014e-06', 'epoch': '0.5455'}

 55%|█████▍    | 20710/37963 [64:18:49<50:46:08, 10.59s/it]
 55%|█████▍    | 20711/37963 [64:18:59<50:00:47, 10.44s/it]
 55%|█████▍    | 20712/37963 [64:19:09<49:06:58, 10.25s/it]
 55%|█████▍    | 20713/37963 [64:19:19<48:54:16, 10.21s/it]
 55%|█████▍    | 20714/37963 [64:19:29<48:41:07, 10.16s/it]
 55%|█████▍    | 20715/37963 [64:19:39<48:02:33, 10.03s/it]
 55%|█████▍    | 20716/37963 [64:19:49<47:57:22, 10.01s/it]
 55%|█████▍    | 20717/37963 [64:20:11<66:19:50, 13.85s/it]
 55%|█████▍    | 20718/37963 [64:20:21<60:36:48, 12.65s/it]
 55%|█████▍    | 20719/37963 [64:20:31<56:32:07, 11.80s/it]
 55%|█████▍    | 20720/37963 [64:20:41<54:02:31, 11.28s/it]
                                                           
{'loss': '0.1401', 'grad_norm': '2.594', 'learning_rate': '9.005e-06', 'epoch': '0.5458'}

 55%|█████▍    | 20720/37963 [64:20:41<54:02:31, 11.28s/it]
 55%|█████▍    | 20721/37963 [64:20:51<51:47:08, 10.81s/it]
 55%|█████▍    | 20722/37963 [64:21:07<60:05:19, 12.55s/it]
 55%|█████▍    | 20723/37963 [64:21:24<65:25:30, 13.66s/it]
 55%|█████▍    | 20724/37963 [64:21:41<69:56:55, 14.61s/it]
 55%|█████▍    | 20725/37963 [64:21:51<63:26:12, 13.25s/it]
 55%|█████▍    | 20726/37963 [64:22:07<67:31:00, 14.10s/it]
 55%|█████▍    | 20727/37963 [64:22:17<61:34:04, 12.86s/it]
 55%|█████▍    | 20728/37963 [64:22:27<57:32:37, 12.02s/it]
 55%|█████▍    | 20729/37963 [64:22:37<54:22:13, 11.36s/it]
 55%|█████▍    | 20730/37963 [64:22:46<52:18:07, 10.93s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '1.601', 'learning_rate': '8.997e-06', 'epoch': '0.5461'}

 55%|█████▍    | 20730/37963 [64:22:47<52:18:07, 10.93s/it]
 55%|█████▍    | 20731/37963 [64:22:57<51:00:12, 10.66s/it]
 55%|█████▍    | 20732/37963 [64:23:07<50:07:41, 10.47s/it]
 55%|█████▍    | 20733/37963 [64:23:17<49:35:57, 10.36s/it]
 55%|█████▍    | 20734/37963 [64:23:27<49:02:50, 10.25s/it]
 55%|█████▍    | 20735/37963 [64:23:37<48:47:36, 10.20s/it]
 55%|█████▍    | 20736/37963 [64:23:46<48:06:12, 10.05s/it]
 55%|█████▍    | 20737/37963 [64:24:03<57:50:50, 12.09s/it]
 55%|█████▍    | 20738/37963 [64:24:13<55:02:27, 11.50s/it]
 55%|█████▍    | 20739/37963 [64:24:24<52:59:39, 11.08s/it]
 55%|█████▍    | 20740/37963 [64:24:33<50:52:35, 10.63s/it]
                                                           
{'loss': '0.1364', 'grad_norm': '1.998', 'learning_rate': '8.988e-06', 'epoch': '0.5463'}

 55%|█████▍    | 20740/37963 [64:24:33<50:52:35, 10.63s/it]
 55%|█████▍    | 20741/37963 [64:24:43<50:10:48, 10.49s/it]
 55%|█████▍    | 20742/37963 [64:24:53<49:32:31, 10.36s/it]
 55%|█████▍    | 20743/37963 [64:25:03<49:12:46, 10.29s/it]
 55%|█████▍    | 20744/37963 [64:25:14<48:56:47, 10.23s/it]
 55%|█████▍    | 20745/37963 [64:25:23<48:30:26, 10.14s/it]
 55%|█████▍    | 20746/37963 [64:25:34<48:23:19, 10.12s/it]
 55%|█████▍    | 20747/37963 [64:25:44<48:30:31, 10.14s/it]
 55%|█████▍    | 20748/37963 [64:25:54<48:05:29, 10.06s/it]
 55%|█████▍    | 20749/37963 [64:26:04<48:14:26, 10.09s/it]
 55%|█████▍    | 20750/37963 [64:26:14<48:11:32, 10.08s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '1.78', 'learning_rate': '8.98e-06', 'epoch': '0.5466'}

 55%|█████▍    | 20750/37963 [64:26:14<48:11:32, 10.08s/it]
 55%|█████▍    | 20751/37963 [64:26:24<48:16:16, 10.10s/it]
 55%|█████▍    | 20752/37963 [64:26:34<48:20:44, 10.11s/it]
 55%|█████▍    | 20753/37963 [64:26:51<57:34:47, 12.04s/it]
 55%|█████▍    | 20754/37963 [64:27:01<54:58:10, 11.50s/it]
 55%|█████▍    | 20755/37963 [64:27:11<52:31:55, 10.99s/it]
 55%|█████▍    | 20756/37963 [64:27:21<51:15:42, 10.72s/it]
 55%|█████▍    | 20757/37963 [64:27:30<49:43:55, 10.41s/it]
 55%|█████▍    | 20758/37963 [64:27:41<49:15:17, 10.31s/it]
 55%|█████▍    | 20759/37963 [64:27:50<48:44:46, 10.20s/it]
 55%|█████▍    | 20760/37963 [64:28:01<48:36:30, 10.17s/it]
                                                           
{'loss': '0.1345', 'grad_norm': '3.037', 'learning_rate': '8.971e-06', 'epoch': '0.5469'}

 55%|█████▍    | 20760/37963 [64:28:01<48:36:30, 10.17s/it]
 55%|█████▍    | 20761/37963 [64:28:11<48:25:31, 10.13s/it]
 55%|█████▍    | 20762/37963 [64:28:21<48:18:43, 10.11s/it]
 55%|█████▍    | 20763/37963 [64:28:31<48:25:16, 10.13s/it]
 55%|█████▍    | 20764/37963 [64:28:41<48:15:40, 10.10s/it]
 55%|█████▍    | 20765/37963 [64:28:51<48:20:50, 10.12s/it]
 55%|█████▍    | 20766/37963 [64:29:09<58:51:19, 12.32s/it]
 55%|█████▍    | 20767/37963 [64:29:25<64:31:06, 13.51s/it]
 55%|█████▍    | 20768/37963 [64:29:35<59:24:01, 12.44s/it]
 55%|█████▍    | 20769/37963 [64:29:45<56:07:21, 11.75s/it]
 55%|█████▍    | 20770/37963 [64:29:55<53:41:18, 11.24s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '1.316', 'learning_rate': '8.963e-06', 'epoch': '0.5471'}

 55%|█████▍    | 20770/37963 [64:29:55<53:41:18, 11.24s/it]
 55%|█████▍    | 20771/37963 [64:30:11<60:55:05, 12.76s/it]
 55%|█████▍    | 20772/37963 [64:30:21<56:44:23, 11.88s/it]
 55%|█████▍    | 20773/37963 [64:30:38<63:25:09, 13.28s/it]
 55%|█████▍    | 20774/37963 [64:30:48<58:51:22, 12.33s/it]
 55%|█████▍    | 20775/37963 [64:31:04<65:05:36, 13.63s/it]
 55%|█████▍    | 20776/37963 [64:31:14<60:00:55, 12.57s/it]
 55%|█████▍    | 20777/37963 [64:31:25<56:22:25, 11.81s/it]
 55%|█████▍    | 20778/37963 [64:31:34<53:43:52, 11.26s/it]
 55%|█████▍    | 20779/37963 [64:31:45<52:05:12, 10.91s/it]
 55%|█████▍    | 20780/37963 [64:31:55<50:52:31, 10.66s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '1.399', 'learning_rate': '8.954e-06', 'epoch': '0.5474'}

 55%|█████▍    | 20780/37963 [64:31:55<50:52:31, 10.66s/it]
 55%|█████▍    | 20781/37963 [64:32:05<50:03:23, 10.49s/it]
 55%|█████▍    | 20782/37963 [64:32:15<49:29:30, 10.37s/it]
 55%|█████▍    | 20783/37963 [64:32:25<49:17:18, 10.33s/it]
 55%|█████▍    | 20784/37963 [64:32:42<58:44:20, 12.31s/it]
 55%|█████▍    | 20785/37963 [64:32:52<55:40:39, 11.67s/it]
 55%|█████▍    | 20786/37963 [64:33:02<53:21:03, 11.18s/it]
 55%|█████▍    | 20787/37963 [64:33:12<51:42:40, 10.84s/it]
 55%|█████▍    | 20788/37963 [64:33:22<50:35:40, 10.60s/it]
 55%|█████▍    | 20789/37963 [64:33:32<49:47:01, 10.44s/it]
 55%|█████▍    | 20790/37963 [64:33:42<49:12:56, 10.32s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '1.454', 'learning_rate': '8.946e-06', 'epoch': '0.5476'}

 55%|█████▍    | 20790/37963 [64:33:42<49:12:56, 10.32s/it]
 55%|█████▍    | 20791/37963 [64:33:53<48:57:13, 10.26s/it]
 55%|█████▍    | 20792/37963 [64:34:03<48:47:38, 10.23s/it]
 55%|█████▍    | 20793/37963 [64:34:13<48:41:53, 10.21s/it]
 55%|█████▍    | 20794/37963 [64:34:23<48:29:51, 10.17s/it]
 55%|█████▍    | 20795/37963 [64:34:33<48:20:00, 10.14s/it]
 55%|█████▍    | 20796/37963 [64:34:43<48:09:29, 10.10s/it]
 55%|█████▍    | 20797/37963 [64:34:53<48:10:03, 10.10s/it]
 55%|█████▍    | 20798/37963 [64:35:03<48:10:00, 10.10s/it]
 55%|█████▍    | 20799/37963 [64:35:13<47:34:19,  9.98s/it]
 55%|█████▍    | 20800/37963 [64:35:23<47:48:16, 10.03s/it]
                                                           
{'loss': '0.1392', 'grad_norm': '2.641', 'learning_rate': '8.937e-06', 'epoch': '0.5479'}

 55%|█████▍    | 20800/37963 [64:35:23<47:48:16, 10.03s/it]
 55%|█████▍    | 20801/37963 [64:35:39<56:28:51, 11.85s/it]
 55%|█████▍    | 20802/37963 [64:35:49<53:56:28, 11.32s/it]
 55%|█████▍    | 20803/37963 [64:35:59<52:18:47, 10.97s/it]
 55%|█████▍    | 20804/37963 [64:36:09<51:01:29, 10.71s/it]
 55%|█████▍    | 20805/37963 [64:36:20<50:15:56, 10.55s/it]
 55%|█████▍    | 20806/37963 [64:36:30<49:39:39, 10.42s/it]
 55%|█████▍    | 20807/37963 [64:36:40<49:11:27, 10.32s/it]
 55%|█████▍    | 20808/37963 [64:36:50<49:08:30, 10.31s/it]
 55%|█████▍    | 20809/37963 [64:37:00<49:05:20, 10.30s/it]
 55%|█████▍    | 20810/37963 [64:37:10<48:22:31, 10.15s/it]
                                                           
{'loss': '0.1249', 'grad_norm': '0.8789', 'learning_rate': '8.929e-06', 'epoch': '0.5482'}

 55%|█████▍    | 20810/37963 [64:37:10<48:22:31, 10.15s/it]
 55%|█████▍    | 20811/37963 [64:37:20<48:18:10, 10.14s/it]
 55%|█████▍    | 20812/37963 [64:37:37<58:11:52, 12.22s/it]
 55%|█████▍    | 20813/37963 [64:37:47<55:08:30, 11.57s/it]
 55%|█████▍    | 20814/37963 [64:38:04<62:03:58, 13.03s/it]
 55%|█████▍    | 20815/37963 [64:38:14<57:43:42, 12.12s/it]
 55%|█████▍    | 20816/37963 [64:38:24<54:47:03, 11.50s/it]
 55%|█████▍    | 20817/37963 [64:38:34<52:54:43, 11.11s/it]
 55%|█████▍    | 20818/37963 [64:38:44<50:37:35, 10.63s/it]
 55%|█████▍    | 20819/37963 [64:38:54<49:47:23, 10.46s/it]
 55%|█████▍    | 20820/37963 [64:39:03<48:36:24, 10.21s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '1.474', 'learning_rate': '8.92e-06', 'epoch': '0.5484'}

 55%|█████▍    | 20820/37963 [64:39:03<48:36:24, 10.21s/it]
 55%|█████▍    | 20821/37963 [64:39:33<76:03:54, 15.97s/it]
 55%|█████▍    | 20822/37963 [64:39:50<77:10:10, 16.21s/it]
 55%|█████▍    | 20823/37963 [64:40:00<68:25:24, 14.37s/it]
 55%|█████▍    | 20824/37963 [64:40:10<62:14:44, 13.07s/it]
 55%|█████▍    | 20825/37963 [64:40:20<57:56:14, 12.17s/it]
 55%|█████▍    | 20826/37963 [64:40:30<54:58:32, 11.55s/it]
 55%|█████▍    | 20827/37963 [64:40:40<52:53:29, 11.11s/it]
 55%|█████▍    | 20828/37963 [64:40:50<51:24:31, 10.80s/it]
 55%|█████▍    | 20829/37963 [64:41:00<50:34:46, 10.63s/it]
 55%|█████▍    | 20830/37963 [64:41:10<49:52:24, 10.48s/it]
                                                           
{'loss': '0.1469', 'grad_norm': '1.596', 'learning_rate': '8.912e-06', 'epoch': '0.5487'}

 55%|█████▍    | 20830/37963 [64:41:10<49:52:24, 10.48s/it]
 55%|█████▍    | 20831/37963 [64:41:20<49:13:17, 10.34s/it]
 55%|█████▍    | 20832/37963 [64:41:37<58:41:03, 12.33s/it]
 55%|█████▍    | 20833/37963 [64:41:47<55:28:02, 11.66s/it]
 55%|█████▍    | 20834/37963 [64:41:58<53:18:08, 11.20s/it]
 55%|█████▍    | 20835/37963 [64:42:08<51:36:47, 10.85s/it]
 55%|█████▍    | 20836/37963 [64:42:18<50:44:38, 10.67s/it]
 55%|█████▍    | 20837/37963 [64:42:28<49:31:03, 10.41s/it]
 55%|█████▍    | 20838/37963 [64:42:38<49:00:58, 10.30s/it]
 55%|█████▍    | 20839/37963 [64:42:48<48:53:49, 10.28s/it]
 55%|█████▍    | 20840/37963 [64:42:58<48:35:48, 10.22s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '1.051', 'learning_rate': '8.903e-06', 'epoch': '0.549'}

 55%|█████▍    | 20840/37963 [64:42:58<48:35:48, 10.22s/it]
 55%|█████▍    | 20841/37963 [64:43:08<48:03:39, 10.11s/it]
 55%|█████▍    | 20842/37963 [64:43:18<47:57:08, 10.08s/it]
 55%|█████▍    | 20843/37963 [64:43:28<47:48:53, 10.05s/it]
 55%|█████▍    | 20844/37963 [64:43:38<47:54:07, 10.07s/it]
 55%|█████▍    | 20845/37963 [64:43:48<48:05:12, 10.11s/it]
 55%|█████▍    | 20846/37963 [64:43:58<47:58:07, 10.09s/it]
 55%|█████▍    | 20847/37963 [64:44:08<47:57:10, 10.09s/it]
 55%|█████▍    | 20848/37963 [64:44:25<57:20:32, 12.06s/it]
 55%|█████▍    | 20849/37963 [64:44:35<54:38:13, 11.49s/it]
 55%|█████▍    | 20850/37963 [64:44:45<52:35:23, 11.06s/it]
                                                           
{'loss': '0.1429', 'grad_norm': '1.256', 'learning_rate': '8.895e-06', 'epoch': '0.5492'}

 55%|█████▍    | 20850/37963 [64:44:45<52:35:23, 11.06s/it]
 55%|█████▍    | 20851/37963 [64:44:55<51:22:30, 10.81s/it]
 55%|█████▍    | 20852/37963 [64:45:05<50:20:15, 10.59s/it]
 55%|█████▍    | 20853/37963 [64:45:16<49:41:10, 10.45s/it]
 55%|█████▍    | 20854/37963 [64:45:25<48:39:09, 10.24s/it]
 55%|█████▍    | 20855/37963 [64:45:35<48:18:48, 10.17s/it]
 55%|█████▍    | 20856/37963 [64:45:45<48:09:53, 10.14s/it]
 55%|█████▍    | 20857/37963 [64:45:55<47:41:35, 10.04s/it]
 55%|█████▍    | 20858/37963 [64:46:05<47:40:17, 10.03s/it]
 55%|█████▍    | 20859/37963 [64:46:15<47:49:44, 10.07s/it]
 55%|█████▍    | 20860/37963 [64:46:25<47:49:46, 10.07s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '2.884', 'learning_rate': '8.886e-06', 'epoch': '0.5495'}

 55%|█████▍    | 20860/37963 [64:46:25<47:49:46, 10.07s/it]
 55%|█████▍    | 20861/37963 [64:46:42<57:17:27, 12.06s/it]
 55%|█████▍    | 20862/37963 [64:46:52<54:21:28, 11.44s/it]
 55%|█████▍    | 20863/37963 [64:47:02<52:38:56, 11.08s/it]
 55%|█████▍    | 20864/37963 [64:47:19<59:59:12, 12.63s/it]
 55%|█████▍    | 20865/37963 [64:47:29<56:19:03, 11.86s/it]
 55%|█████▍    | 20866/37963 [64:47:39<53:48:23, 11.33s/it]
 55%|█████▍    | 20867/37963 [64:47:49<52:04:37, 10.97s/it]
 55%|█████▍    | 20868/37963 [64:47:59<50:50:15, 10.71s/it]
 55%|█████▍    | 20869/37963 [64:48:15<58:29:01, 12.32s/it]
 55%|█████▍    | 20870/37963 [64:48:25<54:48:10, 11.54s/it]
                                                           
{'loss': '0.1287', 'grad_norm': '1.456', 'learning_rate': '8.878e-06', 'epoch': '0.5497'}

 55%|█████▍    | 20870/37963 [64:48:25<54:48:10, 11.54s/it]
 55%|█████▍    | 20871/37963 [64:48:48<71:20:27, 15.03s/it]
 55%|█████▍    | 20872/37963 [64:48:58<64:14:30, 13.53s/it]
 55%|█████▍    | 20873/37963 [64:49:08<59:19:49, 12.50s/it]
 55%|█████▍    | 20874/37963 [64:49:18<55:47:25, 11.75s/it]
 55%|█████▍    | 20875/37963 [64:49:28<53:22:26, 11.24s/it]
 55%|█████▍    | 20876/37963 [64:49:38<51:46:56, 10.91s/it]
 55%|█████▍    | 20877/37963 [64:49:48<50:39:30, 10.67s/it]
 55%|█████▍    | 20878/37963 [64:50:05<59:39:44, 12.57s/it]
 55%|█████▍    | 20879/37963 [64:50:15<55:54:08, 11.78s/it]
 55%|█████▌    | 20880/37963 [64:50:25<53:28:56, 11.27s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '1.214', 'learning_rate': '8.869e-06', 'epoch': '0.55'}

 55%|█████▌    | 20880/37963 [64:50:25<53:28:56, 11.27s/it]
 55%|█████▌    | 20881/37963 [64:50:35<51:41:53, 10.90s/it]
 55%|█████▌    | 20882/37963 [64:50:46<50:44:13, 10.69s/it]
 55%|█████▌    | 20883/37963 [64:50:56<49:40:20, 10.47s/it]
 55%|█████▌    | 20884/37963 [64:51:06<49:02:19, 10.34s/it]
 55%|█████▌    | 20885/37963 [64:51:16<48:26:59, 10.21s/it]
 55%|█████▌    | 20886/37963 [64:51:25<47:51:12, 10.09s/it]
 55%|█████▌    | 20887/37963 [64:51:35<47:50:22, 10.09s/it]
 55%|█████▌    | 20888/37963 [64:51:46<48:01:03, 10.12s/it]
 55%|█████▌    | 20889/37963 [64:51:56<47:44:30, 10.07s/it]
 55%|█████▌    | 20890/37963 [64:52:05<47:23:51,  9.99s/it]
                                                           
{'loss': '0.1284', 'grad_norm': '2.373', 'learning_rate': '8.861e-06', 'epoch': '0.5503'}

 55%|█████▌    | 20890/37963 [64:52:05<47:23:51,  9.99s/it]
 55%|█████▌    | 20891/37963 [64:52:15<47:14:50,  9.96s/it]
 55%|█████▌    | 20892/37963 [64:52:25<47:26:09, 10.00s/it]
 55%|█████▌    | 20893/37963 [64:52:36<47:43:30, 10.07s/it]
 55%|█████▌    | 20894/37963 [64:52:46<47:52:29, 10.10s/it]
 55%|█████▌    | 20895/37963 [64:52:56<47:19:16,  9.98s/it]
 55%|█████▌    | 20896/37963 [64:53:06<47:28:18, 10.01s/it]
 55%|█████▌    | 20897/37963 [64:53:22<56:16:32, 11.87s/it]
 55%|█████▌    | 20898/37963 [64:53:32<53:37:44, 11.31s/it]
 55%|█████▌    | 20899/37963 [64:53:42<51:50:20, 10.94s/it]
 55%|█████▌    | 20900/37963 [64:53:52<50:41:13, 10.69s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '2.44', 'learning_rate': '8.853e-06', 'epoch': '0.5505'}

 55%|█████▌    | 20900/37963 [64:53:52<50:41:13, 10.69s/it]
 55%|█████▌    | 20901/37963 [64:54:02<49:41:28, 10.48s/it]
 55%|█████▌    | 20902/37963 [64:54:12<49:09:59, 10.37s/it]
 55%|█████▌    | 20903/37963 [64:54:22<48:45:58, 10.29s/it]
 55%|█████▌    | 20904/37963 [64:54:32<48:17:52, 10.19s/it]
 55%|█████▌    | 20905/37963 [64:54:42<47:49:57, 10.09s/it]
 55%|█████▌    | 20906/37963 [64:54:52<47:57:47, 10.12s/it]
 55%|█████▌    | 20907/37963 [64:55:02<47:45:35, 10.08s/it]
 55%|█████▌    | 20908/37963 [64:55:12<47:50:48, 10.10s/it]
 55%|█████▌    | 20909/37963 [64:55:22<47:48:19, 10.09s/it]
 55%|█████▌    | 20910/37963 [64:55:39<57:37:55, 12.17s/it]
                                                           
{'loss': '0.1377', 'grad_norm': '2.799', 'learning_rate': '8.844e-06', 'epoch': '0.5508'}

 55%|█████▌    | 20910/37963 [64:55:39<57:37:55, 12.17s/it]
 55%|█████▌    | 20911/37963 [64:55:50<54:37:39, 11.53s/it]
 55%|█████▌    | 20912/37963 [64:56:00<52:39:14, 11.12s/it]
 55%|█████▌    | 20913/37963 [64:56:16<60:05:24, 12.69s/it]
 55%|█████▌    | 20914/37963 [64:56:26<56:29:12, 11.93s/it]
 55%|█████▌    | 20915/37963 [64:56:36<53:30:00, 11.30s/it]
 55%|█████▌    | 20916/37963 [64:56:46<51:47:00, 10.94s/it]
 55%|█████▌    | 20917/37963 [64:56:56<50:38:41, 10.70s/it]
 55%|█████▌    | 20918/37963 [64:57:13<58:41:25, 12.40s/it]
 55%|█████▌    | 20919/37963 [64:57:29<64:50:30, 13.70s/it]
 55%|█████▌    | 20920/37963 [64:57:45<68:18:45, 14.43s/it]
                                                           
{'loss': '0.134', 'grad_norm': '1.801', 'learning_rate': '8.836e-06', 'epoch': '0.5511'}

 55%|█████▌    | 20920/37963 [64:57:45<68:18:45, 14.43s/it]
 55%|█████▌    | 20921/37963 [64:58:02<71:20:25, 15.07s/it]
 55%|█████▌    | 20922/37963 [64:58:12<64:17:55, 13.58s/it]
 55%|█████▌    | 20923/37963 [64:58:22<59:20:08, 12.54s/it]
 55%|█████▌    | 20924/37963 [64:58:32<55:38:37, 11.76s/it]
 55%|█████▌    | 20925/37963 [64:58:42<53:17:53, 11.26s/it]
 55%|█████▌    | 20926/37963 [64:58:59<61:19:55, 12.96s/it]
 55%|█████▌    | 20927/37963 [64:59:09<57:16:30, 12.10s/it]
 55%|█████▌    | 20928/37963 [64:59:19<54:02:50, 11.42s/it]
 55%|█████▌    | 20929/37963 [64:59:29<51:33:59, 10.90s/it]
 55%|█████▌    | 20930/37963 [64:59:39<49:59:31, 10.57s/it]
                                                           
{'loss': '0.13', 'grad_norm': '1.571', 'learning_rate': '8.827e-06', 'epoch': '0.5513'}

 55%|█████▌    | 20930/37963 [64:59:39<49:59:31, 10.57s/it]
 55%|█████▌    | 20931/37963 [64:59:49<49:25:16, 10.45s/it]
 55%|█████▌    | 20932/37963 [64:59:59<49:04:20, 10.37s/it]
 55%|█████▌    | 20933/37963 [65:00:09<48:32:42, 10.26s/it]
 55%|█████▌    | 20934/37963 [65:00:19<48:22:24, 10.23s/it]
 55%|█████▌    | 20935/37963 [65:00:29<48:08:01, 10.18s/it]
 55%|█████▌    | 20936/37963 [65:00:39<48:06:27, 10.17s/it]
 55%|█████▌    | 20937/37963 [65:00:49<47:44:56, 10.10s/it]
 55%|█████▌    | 20938/37963 [65:00:59<47:57:41, 10.14s/it]
 55%|█████▌    | 20939/37963 [65:01:10<47:58:01, 10.14s/it]
 55%|█████▌    | 20940/37963 [65:01:20<47:59:38, 10.15s/it]
                                                           
{'loss': '0.138', 'grad_norm': '1.007', 'learning_rate': '8.819e-06', 'epoch': '0.5516'}

 55%|█████▌    | 20940/37963 [65:01:20<47:59:38, 10.15s/it]
 55%|█████▌    | 20941/37963 [65:01:30<47:58:08, 10.15s/it]
 55%|█████▌    | 20942/37963 [65:01:40<47:49:56, 10.12s/it]
 55%|█████▌    | 20943/37963 [65:01:50<47:45:16, 10.10s/it]
 55%|█████▌    | 20944/37963 [65:02:00<47:49:58, 10.12s/it]
 55%|█████▌    | 20945/37963 [65:02:10<47:22:59, 10.02s/it]
 55%|█████▌    | 20946/37963 [65:02:27<56:39:34, 11.99s/it]
 55%|█████▌    | 20947/37963 [65:02:37<53:57:06, 11.41s/it]
 55%|█████▌    | 20948/37963 [65:02:47<52:00:47, 11.00s/it]
 55%|█████▌    | 20949/37963 [65:02:57<50:47:41, 10.75s/it]
 55%|█████▌    | 20950/37963 [65:03:07<49:49:20, 10.54s/it]
                                                           
{'loss': '0.1363', 'grad_norm': '2.239', 'learning_rate': '8.81e-06', 'epoch': '0.5519'}

 55%|█████▌    | 20950/37963 [65:03:07<49:49:20, 10.54s/it]
 55%|█████▌    | 20951/37963 [65:03:17<49:08:52, 10.40s/it]
 55%|█████▌    | 20952/37963 [65:03:27<48:41:12, 10.30s/it]
 55%|█████▌    | 20953/37963 [65:03:37<48:22:03, 10.24s/it]
 55%|█████▌    | 20954/37963 [65:03:47<48:09:18, 10.19s/it]
 55%|█████▌    | 20955/37963 [65:03:57<48:08:57, 10.19s/it]
 55%|█████▌    | 20956/37963 [65:04:07<47:55:32, 10.14s/it]
 55%|█████▌    | 20957/37963 [65:04:18<47:48:36, 10.12s/it]
 55%|█████▌    | 20958/37963 [65:04:35<57:45:30, 12.23s/it]
 55%|█████▌    | 20959/37963 [65:04:45<54:42:27, 11.58s/it]
 55%|█████▌    | 20960/37963 [65:04:55<52:34:56, 11.13s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '1.788', 'learning_rate': '8.802e-06', 'epoch': '0.5521'}

 55%|█████▌    | 20960/37963 [65:04:55<52:34:56, 11.13s/it]
 55%|█████▌    | 20961/37963 [65:05:05<51:02:50, 10.81s/it]
 55%|█████▌    | 20962/37963 [65:05:21<59:07:27, 12.52s/it]
 55%|█████▌    | 20963/37963 [65:05:32<55:47:34, 11.81s/it]
 55%|█████▌    | 20964/37963 [65:05:42<53:09:59, 11.26s/it]
 55%|█████▌    | 20965/37963 [65:05:58<60:19:24, 12.78s/it]
 55%|█████▌    | 20966/37963 [65:06:15<65:54:16, 13.96s/it]
 55%|█████▌    | 20967/37963 [65:06:25<60:29:30, 12.81s/it]
 55%|█████▌    | 20968/37963 [65:06:34<56:06:01, 11.88s/it]
 55%|█████▌    | 20969/37963 [65:06:51<62:21:58, 13.21s/it]
 55%|█████▌    | 20970/37963 [65:07:07<66:40:19, 14.12s/it]
                                                           
{'loss': '0.1356', 'grad_norm': '1.079', 'learning_rate': '8.793e-06', 'epoch': '0.5524'}

 55%|█████▌    | 20970/37963 [65:07:07<66:40:19, 14.12s/it]
 55%|█████▌    | 20971/37963 [65:07:17<61:01:19, 12.93s/it]
 55%|█████▌    | 20972/37963 [65:07:27<56:59:53, 12.08s/it]
 55%|█████▌    | 20973/37963 [65:07:37<54:20:52, 11.52s/it]
 55%|█████▌    | 20974/37963 [65:07:47<52:14:58, 11.07s/it]
 55%|█████▌    | 20975/37963 [65:08:05<60:59:25, 12.92s/it]
 55%|█████▌    | 20976/37963 [65:08:15<56:54:45, 12.06s/it]
 55%|█████▌    | 20977/37963 [65:08:25<54:08:59, 11.48s/it]
 55%|█████▌    | 20978/37963 [65:08:35<52:07:42, 11.05s/it]
 55%|█████▌    | 20979/37963 [65:08:45<50:54:14, 10.79s/it]
 55%|█████▌    | 20980/37963 [65:08:55<49:32:04, 10.50s/it]
                                                           
{'loss': '0.1396', 'grad_norm': '2.674', 'learning_rate': '8.785e-06', 'epoch': '0.5526'}

 55%|█████▌    | 20980/37963 [65:08:55<49:32:04, 10.50s/it]
 55%|█████▌    | 20981/37963 [65:09:05<48:51:23, 10.36s/it]
 55%|█████▌    | 20982/37963 [65:09:15<48:22:33, 10.26s/it]
 55%|█████▌    | 20983/37963 [65:09:25<47:50:31, 10.14s/it]
 55%|█████▌    | 20984/37963 [65:09:35<47:15:57, 10.02s/it]
 55%|█████▌    | 20985/37963 [65:09:45<47:20:54, 10.04s/it]
 55%|█████▌    | 20986/37963 [65:09:54<46:55:24,  9.95s/it]
 55%|█████▌    | 20987/37963 [65:10:04<47:04:43,  9.98s/it]
 55%|█████▌    | 20988/37963 [65:10:15<47:17:08, 10.03s/it]
 55%|█████▌    | 20989/37963 [65:10:24<46:55:23,  9.95s/it]
 55%|█████▌    | 20990/37963 [65:10:34<46:45:32,  9.92s/it]
                                                           
{'loss': '0.129', 'grad_norm': '1.235', 'learning_rate': '8.776e-06', 'epoch': '0.5529'}

 55%|█████▌    | 20990/37963 [65:10:34<46:45:32,  9.92s/it]
 55%|█████▌    | 20991/37963 [65:10:44<46:41:07,  9.90s/it]
 55%|█████▌    | 20992/37963 [65:10:54<46:29:55,  9.86s/it]
 55%|█████▌    | 20993/37963 [65:11:04<46:45:04,  9.92s/it]
 55%|█████▌    | 20994/37963 [65:11:21<56:21:17, 11.96s/it]
 55%|█████▌    | 20995/37963 [65:11:31<53:43:52, 11.40s/it]
 55%|█████▌    | 20996/37963 [65:11:41<52:01:27, 11.04s/it]
 55%|█████▌    | 20997/37963 [65:11:51<50:22:09, 10.69s/it]
 55%|█████▌    | 20998/37963 [65:12:00<48:41:29, 10.33s/it]
 55%|█████▌    | 20999/37963 [65:12:10<48:00:17, 10.19s/it]
 55%|█████▌    | 21000/37963 [65:12:20<47:46:40, 10.14s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '1.921', 'learning_rate': '8.768e-06', 'epoch': '0.5532'}

 55%|█████▌    | 21000/37963 [65:12:20<47:46:40, 10.14s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.70s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.70s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 55%|█████▌    | 21001/37963 [65:13:18<115:11:46, 24.45s/it]
 55%|█████▌    | 21002/37963 [65:13:28<95:00:56, 20.17s/it] 
 55%|█████▌    | 21003/37963 [65:13:38<80:46:30, 17.15s/it]
 55%|█████▌    | 21004/37963 [65:13:49<72:05:50, 15.30s/it]
 55%|█████▌    | 21005/37963 [65:14:00<65:44:17, 13.96s/it]
 55%|█████▌    | 21006/37963 [65:14:17<70:24:16, 14.95s/it]
 55%|█████▌    | 21007/37963 [65:14:27<63:35:22, 13.50s/it]
 55%|█████▌    | 21008/37963 [65:14:44<67:29:05, 14.33s/it]
 55%|█████▌    | 21009/37963 [65:14:54<61:33:06, 13.07s/it]
 55%|█████▌    | 21010/37963 [65:15:04<56:45:08, 12.05s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '1.592', 'learning_rate': '8.759e-06', 'epoch': '0.5534'}

 55%|█████▌    | 21010/37963 [65:15:04<56:45:08, 12.05s/it]
 55%|█████▌    | 21011/37963 [65:15:14<53:53:29, 11.44s/it]
 55%|█████▌    | 21012/37963 [65:15:30<61:23:38, 13.04s/it]
 55%|█████▌    | 21013/37963 [65:15:40<56:53:10, 12.08s/it]
 55%|█████▌    | 21014/37963 [65:15:57<63:25:53, 13.47s/it]
 55%|█████▌    | 21015/37963 [65:16:07<58:41:55, 12.47s/it]
 55%|█████▌    | 21016/37963 [65:16:23<63:51:54, 13.57s/it]
 55%|█████▌    | 21017/37963 [65:16:33<58:29:24, 12.43s/it]
 55%|█████▌    | 21018/37963 [65:16:49<64:19:02, 13.66s/it]
 55%|█████▌    | 21019/37963 [65:17:00<59:18:24, 12.60s/it]
 55%|█████▌    | 21020/37963 [65:17:10<55:39:42, 11.83s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '1.028', 'learning_rate': '8.751e-06', 'epoch': '0.5537'}

 55%|█████▌    | 21020/37963 [65:17:10<55:39:42, 11.83s/it]
 55%|█████▌    | 21021/37963 [65:17:20<53:15:58, 11.32s/it]
 55%|█████▌    | 21022/37963 [65:17:30<51:34:04, 10.96s/it]
 55%|█████▌    | 21023/37963 [65:17:40<49:53:05, 10.60s/it]
 55%|█████▌    | 21024/37963 [65:17:57<59:01:30, 12.54s/it]
 55%|█████▌    | 21025/37963 [65:18:06<54:51:58, 11.66s/it]
 55%|█████▌    | 21026/37963 [65:18:16<52:06:51, 11.08s/it]
 55%|█████▌    | 21027/37963 [65:18:26<50:40:30, 10.77s/it]
 55%|█████▌    | 21028/37963 [65:18:36<49:37:06, 10.55s/it]
 55%|█████▌    | 21029/37963 [65:18:46<48:57:27, 10.41s/it]
 55%|█████▌    | 21030/37963 [65:18:56<48:30:10, 10.31s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '1.365', 'learning_rate': '8.742e-06', 'epoch': '0.554'}

 55%|█████▌    | 21030/37963 [65:18:56<48:30:10, 10.31s/it]
 55%|█████▌    | 21031/37963 [65:19:06<48:11:58, 10.25s/it]
 55%|█████▌    | 21032/37963 [65:19:17<48:04:49, 10.22s/it]
 55%|█████▌    | 21033/37963 [65:19:27<48:07:06, 10.23s/it]
 55%|█████▌    | 21034/37963 [65:19:37<47:55:36, 10.19s/it]
 55%|█████▌    | 21035/37963 [65:19:47<47:13:35, 10.04s/it]
 55%|█████▌    | 21036/37963 [65:19:57<47:16:16, 10.05s/it]
 55%|█████▌    | 21037/37963 [65:20:06<46:57:44,  9.99s/it]
 55%|█████▌    | 21038/37963 [65:20:16<46:53:23,  9.97s/it]
 55%|█████▌    | 21039/37963 [65:20:26<46:45:01,  9.94s/it]
 55%|█████▌    | 21040/37963 [65:20:36<46:55:03,  9.98s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '1.758', 'learning_rate': '8.734e-06', 'epoch': '0.5542'}

 55%|█████▌    | 21040/37963 [65:20:36<46:55:03,  9.98s/it]
 55%|█████▌    | 21041/37963 [65:20:46<47:06:24, 10.02s/it]
 55%|█████▌    | 21042/37963 [65:20:57<47:14:22, 10.05s/it]
 55%|█████▌    | 21043/37963 [65:21:13<56:13:42, 11.96s/it]
 55%|█████▌    | 21044/37963 [65:21:23<53:31:24, 11.39s/it]
 55%|█████▌    | 21045/37963 [65:21:33<51:55:16, 11.05s/it]
 55%|█████▌    | 21046/37963 [65:21:43<50:34:03, 10.76s/it]
 55%|█████▌    | 21047/37963 [65:21:54<49:39:42, 10.57s/it]
 55%|█████▌    | 21048/37963 [65:22:03<48:30:09, 10.32s/it]
 55%|█████▌    | 21049/37963 [65:22:13<47:49:47, 10.18s/it]
 55%|█████▌    | 21050/37963 [65:22:23<47:45:12, 10.16s/it]
                                                           
{'loss': '0.1444', 'grad_norm': '1.933', 'learning_rate': '8.725e-06', 'epoch': '0.5545'}

 55%|█████▌    | 21050/37963 [65:22:23<47:45:12, 10.16s/it]
 55%|█████▌    | 21051/37963 [65:22:33<47:34:58, 10.13s/it]
 55%|█████▌    | 21052/37963 [65:22:43<47:33:44, 10.13s/it]
 55%|█████▌    | 21053/37963 [65:22:53<47:28:27, 10.11s/it]
 55%|█████▌    | 21054/37963 [65:23:11<57:16:43, 12.19s/it]
 55%|█████▌    | 21055/37963 [65:23:21<54:24:18, 11.58s/it]
 55%|█████▌    | 21056/37963 [65:23:31<52:14:51, 11.13s/it]
 55%|█████▌    | 21057/37963 [65:23:47<59:19:16, 12.63s/it]
 55%|█████▌    | 21058/37963 [65:23:57<55:43:16, 11.87s/it]
 55%|█████▌    | 21059/37963 [65:24:07<53:07:59, 11.32s/it]
 55%|█████▌    | 21060/37963 [65:24:17<51:17:53, 10.93s/it]
                                                           
{'loss': '0.1545', 'grad_norm': '2.604', 'learning_rate': '8.717e-06', 'epoch': '0.5548'}

 55%|█████▌    | 21060/37963 [65:24:17<51:17:53, 10.93s/it]
 55%|█████▌    | 21061/37963 [65:24:34<59:29:35, 12.67s/it]
 55%|█████▌    | 21062/37963 [65:24:50<64:46:40, 13.80s/it]
 55%|█████▌    | 21063/37963 [65:25:00<59:26:58, 12.66s/it]
 55%|█████▌    | 21064/37963 [65:25:10<55:49:01, 11.89s/it]
 55%|█████▌    | 21065/37963 [65:25:27<62:38:30, 13.35s/it]
 55%|█████▌    | 21066/37963 [65:25:37<58:09:56, 12.39s/it]
 55%|█████▌    | 21067/37963 [65:25:53<63:35:34, 13.55s/it]
 55%|█████▌    | 21068/37963 [65:26:03<58:11:43, 12.40s/it]
 55%|█████▌    | 21069/37963 [65:26:13<54:42:37, 11.66s/it]
 56%|█████▌    | 21070/37963 [65:26:23<52:34:34, 11.20s/it]
                                                           
{'loss': '0.1384', 'grad_norm': '1.086', 'learning_rate': '8.709e-06', 'epoch': '0.555'}

 56%|█████▌    | 21070/37963 [65:26:23<52:34:34, 11.20s/it]
 56%|█████▌    | 21071/37963 [65:26:40<60:47:02, 12.95s/it]
 56%|█████▌    | 21072/37963 [65:26:50<56:42:19, 12.09s/it]
 56%|█████▌    | 21073/37963 [65:27:00<53:50:53, 11.48s/it]
 56%|█████▌    | 21074/37963 [65:27:10<51:51:13, 11.05s/it]
 56%|█████▌    | 21075/37963 [65:27:20<50:03:05, 10.67s/it]
 56%|█████▌    | 21076/37963 [65:27:30<49:11:52, 10.49s/it]
 56%|█████▌    | 21077/37963 [65:27:40<48:43:23, 10.39s/it]
 56%|█████▌    | 21078/37963 [65:27:51<48:25:29, 10.32s/it]
 56%|█████▌    | 21079/37963 [65:28:01<48:08:22, 10.26s/it]
 56%|█████▌    | 21080/37963 [65:28:11<47:48:09, 10.19s/it]
                                                           
{'loss': '0.1255', 'grad_norm': '1.553', 'learning_rate': '8.7e-06', 'epoch': '0.5553'}

 56%|█████▌    | 21080/37963 [65:28:11<47:48:09, 10.19s/it]
 56%|█████▌    | 21081/37963 [65:28:21<47:42:25, 10.17s/it]
 56%|█████▌    | 21082/37963 [65:28:31<47:37:30, 10.16s/it]
 56%|█████▌    | 21083/37963 [65:28:41<47:27:09, 10.12s/it]
 56%|█████▌    | 21084/37963 [65:28:51<47:25:28, 10.11s/it]
 56%|█████▌    | 21085/37963 [65:29:01<47:23:17, 10.11s/it]
 56%|█████▌    | 21086/37963 [65:29:11<46:50:52,  9.99s/it]
 56%|█████▌    | 21087/37963 [65:29:21<46:29:27,  9.92s/it]
 56%|█████▌    | 21088/37963 [65:29:31<46:44:13,  9.97s/it]
 56%|█████▌    | 21089/37963 [65:29:41<47:00:59, 10.03s/it]
 56%|█████▌    | 21090/37963 [65:29:57<55:48:26, 11.91s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '1.216', 'learning_rate': '8.692e-06', 'epoch': '0.5555'}

 56%|█████▌    | 21090/37963 [65:29:57<55:48:26, 11.91s/it]
 56%|█████▌    | 21091/37963 [65:30:07<52:39:20, 11.24s/it]
 56%|█████▌    | 21092/37963 [65:30:17<51:02:16, 10.89s/it]
 56%|█████▌    | 21093/37963 [65:30:27<49:53:55, 10.65s/it]
 56%|█████▌    | 21094/37963 [65:30:37<48:43:14, 10.40s/it]
 56%|█████▌    | 21095/37963 [65:30:47<48:16:43, 10.30s/it]
 56%|█████▌    | 21096/37963 [65:30:57<47:44:39, 10.19s/it]
 56%|█████▌    | 21097/37963 [65:31:07<47:34:25, 10.15s/it]
 56%|█████▌    | 21098/37963 [65:31:17<47:23:05, 10.11s/it]
 56%|█████▌    | 21099/37963 [65:31:27<47:14:49, 10.09s/it]
 56%|█████▌    | 21100/37963 [65:31:37<47:24:52, 10.12s/it]
                                                           
{'loss': '0.1459', 'grad_norm': '1.035', 'learning_rate': '8.683e-06', 'epoch': '0.5558'}

 56%|█████▌    | 21100/37963 [65:31:37<47:24:52, 10.12s/it]
 56%|█████▌    | 21101/37963 [65:31:47<47:19:33, 10.10s/it]
 56%|█████▌    | 21102/37963 [65:31:57<47:17:02, 10.10s/it]
 56%|█████▌    | 21103/37963 [65:32:15<57:38:33, 12.31s/it]
 56%|█████▌    | 21104/37963 [65:32:25<54:22:15, 11.61s/it]
 56%|█████▌    | 21105/37963 [65:32:41<61:14:44, 13.08s/it]
 56%|█████▌    | 21106/37963 [65:32:51<57:04:04, 12.19s/it]
 56%|█████▌    | 21107/37963 [65:33:02<54:08:20, 11.56s/it]
 56%|█████▌    | 21108/37963 [65:33:18<61:26:01, 13.12s/it]
 56%|█████▌    | 21109/37963 [65:33:28<57:05:26, 12.19s/it]
 56%|█████▌    | 21110/37963 [65:33:38<53:55:55, 11.52s/it]
                                                           
{'loss': '0.1403', 'grad_norm': '1.405', 'learning_rate': '8.675e-06', 'epoch': '0.5561'}

 56%|█████▌    | 21110/37963 [65:33:38<53:55:55, 11.52s/it]
 56%|█████▌    | 21111/37963 [65:33:48<51:35:53, 11.02s/it]
 56%|█████▌    | 21112/37963 [65:34:05<59:08:32, 12.64s/it]
 56%|█████▌    | 21113/37963 [65:34:15<55:36:12, 11.88s/it]
 56%|█████▌    | 21114/37963 [65:34:31<61:56:50, 13.24s/it]
 56%|█████▌    | 21115/37963 [65:34:48<66:23:45, 14.19s/it]
 56%|█████▌    | 21116/37963 [65:34:57<60:29:04, 12.92s/it]
 56%|█████▌    | 21117/37963 [65:35:07<56:18:01, 12.03s/it]
 56%|█████▌    | 21118/37963 [65:35:17<53:31:40, 11.44s/it]
 56%|█████▌    | 21119/37963 [65:35:27<51:27:47, 11.00s/it]
 56%|█████▌    | 21120/37963 [65:35:38<50:10:33, 10.72s/it]
                                                           
{'loss': '0.147', 'grad_norm': '2.972', 'learning_rate': '8.666e-06', 'epoch': '0.5563'}

 56%|█████▌    | 21120/37963 [65:35:38<50:10:33, 10.72s/it]
 56%|█████▌    | 21121/37963 [65:35:55<59:01:46, 12.62s/it]
 56%|█████▌    | 21122/37963 [65:36:05<55:37:52, 11.89s/it]
 56%|█████▌    | 21123/37963 [65:36:15<53:08:06, 11.36s/it]
 56%|█████▌    | 21124/37963 [65:36:25<51:19:03, 10.97s/it]
 56%|█████▌    | 21125/37963 [65:36:35<50:13:45, 10.74s/it]
 56%|█████▌    | 21126/37963 [65:36:45<49:30:18, 10.58s/it]
 56%|█████▌    | 21127/37963 [65:36:55<48:48:36, 10.44s/it]
 56%|█████▌    | 21128/37963 [65:37:05<47:43:45, 10.21s/it]
 56%|█████▌    | 21129/37963 [65:37:15<46:49:47, 10.01s/it]
 56%|█████▌    | 21130/37963 [65:37:25<46:29:57,  9.94s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '2.036', 'learning_rate': '8.658e-06', 'epoch': '0.5566'}

 56%|█████▌    | 21130/37963 [65:37:25<46:29:57,  9.94s/it]
 56%|█████▌    | 21131/37963 [65:37:35<46:40:26,  9.98s/it]
 56%|█████▌    | 21132/37963 [65:37:44<46:13:51,  9.89s/it]
 56%|█████▌    | 21133/37963 [65:37:54<46:25:26,  9.93s/it]
 56%|█████▌    | 21134/37963 [65:38:04<46:16:49,  9.90s/it]
 56%|█████▌    | 21135/37963 [65:38:14<46:13:05,  9.89s/it]
 56%|█████▌    | 21136/37963 [65:38:24<46:28:57,  9.94s/it]
 56%|█████▌    | 21137/37963 [65:38:34<46:06:15,  9.86s/it]
 56%|█████▌    | 21138/37963 [65:38:50<55:38:38, 11.91s/it]
 56%|█████▌    | 21139/37963 [65:39:00<53:01:24, 11.35s/it]
 56%|█████▌    | 21140/37963 [65:39:10<50:55:14, 10.90s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '3.055', 'learning_rate': '8.649e-06', 'epoch': '0.5569'}

 56%|█████▌    | 21140/37963 [65:39:10<50:55:14, 10.90s/it]
 56%|█████▌    | 21141/37963 [65:39:20<49:49:37, 10.66s/it]
 56%|█████▌    | 21142/37963 [65:39:30<49:02:47, 10.50s/it]
 56%|█████▌    | 21143/37963 [65:39:40<48:10:58, 10.31s/it]
 56%|█████▌    | 21144/37963 [65:39:50<47:54:15, 10.25s/it]
 56%|█████▌    | 21145/37963 [65:40:00<47:32:18, 10.18s/it]
 56%|█████▌    | 21146/37963 [65:40:11<47:23:16, 10.14s/it]
 56%|█████▌    | 21147/37963 [65:40:21<47:19:31, 10.13s/it]
 56%|█████▌    | 21148/37963 [65:40:31<47:20:38, 10.14s/it]
 56%|█████▌    | 21149/37963 [65:40:41<47:17:10, 10.12s/it]
 56%|█████▌    | 21150/37963 [65:40:51<47:19:50, 10.13s/it]
                                                           
{'loss': '0.1403', 'grad_norm': '1.147', 'learning_rate': '8.641e-06', 'epoch': '0.5571'}

 56%|█████▌    | 21150/37963 [65:40:51<47:19:50, 10.13s/it]
 56%|█████▌    | 21151/37963 [65:41:01<47:25:40, 10.16s/it]
 56%|█████▌    | 21152/37963 [65:41:18<56:08:13, 12.02s/it]
 56%|█████▌    | 21153/37963 [65:41:34<61:35:41, 13.19s/it]
 56%|█████▌    | 21154/37963 [65:41:43<56:59:48, 12.21s/it]
 56%|█████▌    | 21155/37963 [65:41:53<53:47:55, 11.52s/it]
 56%|█████▌    | 21156/37963 [65:42:10<60:55:53, 13.05s/it]
 56%|█████▌    | 21157/37963 [65:42:20<56:54:03, 12.19s/it]
 56%|█████▌    | 21158/37963 [65:42:30<53:28:51, 11.46s/it]
 56%|█████▌    | 21159/37963 [65:42:40<51:30:35, 11.04s/it]
 56%|█████▌    | 21160/37963 [65:42:50<49:43:08, 10.65s/it]
                                                           
{'loss': '0.1416', 'grad_norm': '1.932', 'learning_rate': '8.632e-06', 'epoch': '0.5574'}

 56%|█████▌    | 21160/37963 [65:42:50<49:43:08, 10.65s/it]
 56%|█████▌    | 21161/37963 [65:43:06<57:05:19, 12.23s/it]
 56%|█████▌    | 21162/37963 [65:43:16<53:57:18, 11.56s/it]
 56%|█████▌    | 21163/37963 [65:43:32<61:07:29, 13.10s/it]
 56%|█████▌    | 21164/37963 [65:43:49<65:39:11, 14.07s/it]
 56%|█████▌    | 21165/37963 [65:43:59<59:42:45, 12.80s/it]
 56%|█████▌    | 21166/37963 [65:44:09<55:55:07, 11.98s/it]
 56%|█████▌    | 21167/37963 [65:44:19<53:14:39, 11.41s/it]
 56%|█████▌    | 21168/37963 [65:44:29<51:08:59, 10.96s/it]
 56%|█████▌    | 21169/37963 [65:44:39<49:51:03, 10.69s/it]
 56%|█████▌    | 21170/37963 [65:44:49<48:42:15, 10.44s/it]
                                                           
{'loss': '0.128', 'grad_norm': '1.51', 'learning_rate': '8.624e-06', 'epoch': '0.5577'}

 56%|█████▌    | 21170/37963 [65:44:49<48:42:15, 10.44s/it]
 56%|█████▌    | 21171/37963 [65:45:05<57:51:51, 12.41s/it]
 56%|█████▌    | 21172/37963 [65:45:15<54:05:48, 11.60s/it]
 56%|█████▌    | 21173/37963 [65:45:25<52:03:03, 11.16s/it]
 56%|█████▌    | 21174/37963 [65:45:35<50:13:06, 10.77s/it]
 56%|█████▌    | 21175/37963 [65:45:45<49:05:02, 10.53s/it]
 56%|█████▌    | 21176/37963 [65:45:55<48:34:22, 10.42s/it]
 56%|█████▌    | 21177/37963 [65:46:05<47:45:07, 10.24s/it]
 56%|█████▌    | 21178/37963 [65:46:15<47:35:14, 10.21s/it]
 56%|█████▌    | 21179/37963 [65:46:26<47:46:14, 10.25s/it]
 56%|█████▌    | 21180/37963 [65:46:36<47:34:50, 10.21s/it]
                                                           
{'loss': '0.1296', 'grad_norm': '3.557', 'learning_rate': '8.616e-06', 'epoch': '0.5579'}

 56%|█████▌    | 21180/37963 [65:46:36<47:34:50, 10.21s/it]
 56%|█████▌    | 21181/37963 [65:46:46<47:07:31, 10.11s/it]
 56%|█████▌    | 21182/37963 [65:46:56<47:03:36, 10.10s/it]
 56%|█████▌    | 21183/37963 [65:47:06<47:03:00, 10.09s/it]
 56%|█████▌    | 21184/37963 [65:47:16<47:03:28, 10.10s/it]
 56%|█████▌    | 21185/37963 [65:47:26<47:07:03, 10.11s/it]
 56%|█████▌    | 21186/37963 [65:47:36<47:07:17, 10.11s/it]
 56%|█████▌    | 21187/37963 [65:47:52<55:49:25, 11.98s/it]
 56%|█████▌    | 21188/37963 [65:48:02<52:39:19, 11.30s/it]
 56%|█████▌    | 21189/37963 [65:48:12<50:58:28, 10.94s/it]
 56%|█████▌    | 21190/37963 [65:48:22<49:21:24, 10.59s/it]
                                                           
{'loss': '0.158', 'grad_norm': '1.965', 'learning_rate': '8.607e-06', 'epoch': '0.5582'}

 56%|█████▌    | 21190/37963 [65:48:22<49:21:24, 10.59s/it]
 56%|█████▌    | 21191/37963 [65:48:32<48:51:01, 10.49s/it]
 56%|█████▌    | 21192/37963 [65:48:42<48:15:49, 10.36s/it]
 56%|█████▌    | 21193/37963 [65:48:53<47:57:29, 10.30s/it]
 56%|█████▌    | 21194/37963 [65:49:03<47:40:32, 10.24s/it]
 56%|█████▌    | 21195/37963 [65:49:13<47:21:27, 10.17s/it]
 56%|█████▌    | 21196/37963 [65:49:23<47:12:26, 10.14s/it]
 56%|█████▌    | 21197/37963 [65:49:33<47:08:24, 10.12s/it]
 56%|█████▌    | 21198/37963 [65:49:43<47:02:24, 10.10s/it]
 56%|█████▌    | 21199/37963 [65:49:53<46:28:54,  9.98s/it]
 56%|█████▌    | 21200/37963 [65:50:09<55:52:55, 12.00s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '1.247', 'learning_rate': '8.599e-06', 'epoch': '0.5584'}

 56%|█████▌    | 21200/37963 [65:50:09<55:52:55, 12.00s/it]
 56%|█████▌    | 21201/37963 [65:50:19<53:02:38, 11.39s/it]
 56%|█████▌    | 21202/37963 [65:50:29<51:14:56, 11.01s/it]
 56%|█████▌    | 21203/37963 [65:50:39<49:44:55, 10.69s/it]
 56%|█████▌    | 21204/37963 [65:50:56<57:44:36, 12.40s/it]
 56%|█████▌    | 21205/37963 [65:51:06<54:35:15, 11.73s/it]
 56%|█████▌    | 21206/37963 [65:51:22<60:41:05, 13.04s/it]
 56%|█████▌    | 21207/37963 [65:51:32<56:27:10, 12.13s/it]
 56%|█████▌    | 21208/37963 [65:51:42<53:16:19, 11.45s/it]
 56%|█████▌    | 21209/37963 [65:51:52<51:17:22, 11.02s/it]
 56%|█████▌    | 21210/37963 [65:52:02<50:11:19, 10.78s/it]
                                                           
{'loss': '0.1354', 'grad_norm': '1.279', 'learning_rate': '8.59e-06', 'epoch': '0.5587'}

 56%|█████▌    | 21210/37963 [65:52:02<50:11:19, 10.78s/it]
 56%|█████▌    | 21211/37963 [65:52:18<57:43:24, 12.40s/it]
 56%|█████▌    | 21212/37963 [65:52:35<63:17:03, 13.60s/it]
 56%|█████▌    | 21213/37963 [65:52:45<58:37:32, 12.60s/it]
 56%|█████▌    | 21214/37963 [65:52:55<54:48:48, 11.78s/it]
 56%|█████▌    | 21215/37963 [65:53:05<52:19:25, 11.25s/it]
 56%|█████▌    | 21216/37963 [65:53:15<50:39:12, 10.89s/it]
 56%|█████▌    | 21217/37963 [65:53:25<49:33:08, 10.65s/it]
 56%|█████▌    | 21218/37963 [65:53:34<48:04:41, 10.34s/it]
 56%|█████▌    | 21219/37963 [65:53:45<47:45:22, 10.27s/it]
 56%|█████▌    | 21220/37963 [65:54:02<57:07:29, 12.28s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '2.717', 'learning_rate': '8.582e-06', 'epoch': '0.559'}

 56%|█████▌    | 21220/37963 [65:54:02<57:07:29, 12.28s/it]
 56%|█████▌    | 21221/37963 [65:54:12<54:02:50, 11.62s/it]
 56%|█████▌    | 21222/37963 [65:54:21<51:27:47, 11.07s/it]
 56%|█████▌    | 21223/37963 [65:54:32<50:11:48, 10.80s/it]
 56%|█████▌    | 21224/37963 [65:54:42<49:09:52, 10.57s/it]
 56%|█████▌    | 21225/37963 [65:54:51<48:05:48, 10.34s/it]
 56%|█████▌    | 21226/37963 [65:55:01<47:04:07, 10.12s/it]
 56%|█████▌    | 21227/37963 [65:55:11<47:04:59, 10.13s/it]
 56%|█████▌    | 21228/37963 [65:55:21<46:49:53, 10.07s/it]
 56%|█████▌    | 21229/37963 [65:55:31<46:43:02, 10.05s/it]
 56%|█████▌    | 21230/37963 [65:55:41<46:24:21,  9.98s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '1.605', 'learning_rate': '8.573e-06', 'epoch': '0.5592'}

 56%|█████▌    | 21230/37963 [65:55:41<46:24:21,  9.98s/it]
 56%|█████▌    | 21231/37963 [65:55:51<46:19:41,  9.97s/it]
 56%|█████▌    | 21232/37963 [65:56:01<46:25:26,  9.99s/it]
 56%|█████▌    | 21233/37963 [65:56:11<46:37:52, 10.03s/it]
 56%|█████▌    | 21234/37963 [65:56:28<55:44:11, 11.99s/it]
 56%|█████▌    | 21235/37963 [65:56:38<52:56:46, 11.39s/it]
 56%|█████▌    | 21236/37963 [65:56:48<51:07:11, 11.00s/it]
 56%|█████▌    | 21237/37963 [65:56:58<49:54:03, 10.74s/it]
 56%|█████▌    | 21238/37963 [65:57:08<48:52:52, 10.52s/it]
 56%|█████▌    | 21239/37963 [65:57:18<48:20:06, 10.40s/it]
 56%|█████▌    | 21240/37963 [65:57:28<47:59:02, 10.33s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '1.408', 'learning_rate': '8.565e-06', 'epoch': '0.5595'}

 56%|█████▌    | 21240/37963 [65:57:28<47:59:02, 10.33s/it]
 56%|█████▌    | 21241/37963 [65:57:38<47:20:49, 10.19s/it]
 56%|█████▌    | 21242/37963 [65:57:48<47:09:14, 10.15s/it]
 56%|█████▌    | 21243/37963 [65:57:58<46:59:31, 10.12s/it]
 56%|█████▌    | 21244/37963 [65:58:08<47:05:24, 10.14s/it]
 56%|█████▌    | 21245/37963 [65:58:18<46:04:56,  9.92s/it]
 56%|█████▌    | 21246/37963 [65:58:28<46:16:50,  9.97s/it]
 56%|█████▌    | 21247/37963 [65:58:38<46:28:36, 10.01s/it]
 56%|█████▌    | 21248/37963 [65:58:48<46:32:47, 10.02s/it]
 56%|█████▌    | 21249/37963 [65:59:11<64:49:23, 13.96s/it]
 56%|█████▌    | 21250/37963 [65:59:21<59:24:41, 12.80s/it]
                                                           
{'loss': '0.1263', 'grad_norm': '2.144', 'learning_rate': '8.556e-06', 'epoch': '0.5598'}

 56%|█████▌    | 21250/37963 [65:59:21<59:24:41, 12.80s/it]
 56%|█████▌    | 21251/37963 [65:59:31<55:25:41, 11.94s/it]
 56%|█████▌    | 21252/37963 [65:59:48<61:39:56, 13.28s/it]
 56%|█████▌    | 21253/37963 [65:59:58<57:19:52, 12.35s/it]
 56%|█████▌    | 21254/37963 [66:00:08<54:00:01, 11.63s/it]
 56%|█████▌    | 21255/37963 [66:00:24<61:01:04, 13.15s/it]
 56%|█████▌    | 21256/37963 [66:00:35<56:48:38, 12.24s/it]
 56%|█████▌    | 21257/37963 [66:00:45<53:48:29, 11.60s/it]
 56%|█████▌    | 21258/37963 [66:00:55<51:45:10, 11.15s/it]
 56%|█████▌    | 21259/37963 [66:01:11<59:11:08, 12.76s/it]
 56%|█████▌    | 21260/37963 [66:01:27<63:54:11, 13.77s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '2.769', 'learning_rate': '8.548e-06', 'epoch': '0.56'}

 56%|█████▌    | 21260/37963 [66:01:27<63:54:11, 13.77s/it]
 56%|█████▌    | 21261/37963 [66:01:37<58:13:36, 12.55s/it]
 56%|█████▌    | 21262/37963 [66:01:47<54:48:00, 11.81s/it]
 56%|█████▌    | 21263/37963 [66:01:57<51:50:35, 11.18s/it]
 56%|█████▌    | 21264/37963 [66:02:07<50:20:33, 10.85s/it]
 56%|█████▌    | 21265/37963 [66:02:17<49:30:15, 10.67s/it]
 56%|█████▌    | 21266/37963 [66:02:27<48:58:06, 10.56s/it]
 56%|█████▌    | 21267/37963 [66:02:45<57:57:04, 12.50s/it]
 56%|█████▌    | 21268/37963 [66:02:55<54:29:45, 11.75s/it]
 56%|█████▌    | 21269/37963 [66:03:05<52:08:34, 11.24s/it]
 56%|█████▌    | 21270/37963 [66:03:15<50:21:03, 10.86s/it]
                                                           
{'loss': '0.1469', 'grad_norm': '1.32', 'learning_rate': '8.54e-06', 'epoch': '0.5603'}

 56%|█████▌    | 21270/37963 [66:03:15<50:21:03, 10.86s/it]
 56%|█████▌    | 21271/37963 [66:03:25<49:09:27, 10.60s/it]
 56%|█████▌    | 21272/37963 [66:03:35<48:29:58, 10.46s/it]
 56%|█████▌    | 21273/37963 [66:03:45<48:02:35, 10.36s/it]
 56%|█████▌    | 21274/37963 [66:03:55<47:43:25, 10.29s/it]
 56%|█████▌    | 21275/37963 [66:04:05<47:30:54, 10.25s/it]
 56%|█████▌    | 21276/37963 [66:04:15<47:12:42, 10.19s/it]
 56%|█████▌    | 21277/37963 [66:04:25<47:07:36, 10.17s/it]
 56%|█████▌    | 21278/37963 [66:04:35<46:56:24, 10.13s/it]
 56%|█████▌    | 21279/37963 [66:04:45<46:53:54, 10.12s/it]
 56%|█████▌    | 21280/37963 [66:04:55<46:45:33, 10.09s/it]
                                                           
{'loss': '0.1412', 'grad_norm': '1.802', 'learning_rate': '8.531e-06', 'epoch': '0.5605'}

 56%|█████▌    | 21280/37963 [66:04:55<46:45:33, 10.09s/it]
 56%|█████▌    | 21281/37963 [66:05:11<54:49:16, 11.83s/it]
 56%|█████▌    | 21282/37963 [66:05:21<52:11:04, 11.26s/it]
 56%|█████▌    | 21283/37963 [66:05:31<50:33:05, 10.91s/it]
 56%|█████▌    | 21284/37963 [66:05:41<48:53:34, 10.55s/it]
 56%|█████▌    | 21285/37963 [66:05:51<48:06:20, 10.38s/it]
 56%|█████▌    | 21286/37963 [66:06:01<47:43:40, 10.30s/it]
 56%|█████▌    | 21287/37963 [66:06:11<47:35:45, 10.27s/it]
 56%|█████▌    | 21288/37963 [66:06:21<47:00:26, 10.15s/it]
 56%|█████▌    | 21289/37963 [66:06:31<46:16:17,  9.99s/it]
 56%|█████▌    | 21290/37963 [66:06:41<46:26:32, 10.03s/it]
                                                           
{'loss': '0.1334', 'grad_norm': '0.82', 'learning_rate': '8.523e-06', 'epoch': '0.5608'}

 56%|█████▌    | 21290/37963 [66:06:41<46:26:32, 10.03s/it]
 56%|█████▌    | 21291/37963 [66:06:51<46:32:24, 10.05s/it]
 56%|█████▌    | 21292/37963 [66:07:01<46:39:18, 10.07s/it]
 56%|█████▌    | 21293/37963 [66:07:11<46:41:05, 10.08s/it]
 56%|█████▌    | 21294/37963 [66:07:21<46:50:49, 10.12s/it]
 56%|█████▌    | 21295/37963 [66:07:31<46:31:50, 10.05s/it]
 56%|█████▌    | 21296/37963 [66:07:55<65:08:17, 14.07s/it]
 56%|█████▌    | 21297/37963 [66:08:05<59:41:37, 12.89s/it]
 56%|█████▌    | 21298/37963 [66:08:15<55:46:24, 12.05s/it]
 56%|█████▌    | 21299/37963 [66:08:25<52:46:00, 11.40s/it]
 56%|█████▌    | 21300/37963 [66:08:41<59:55:40, 12.95s/it]
                                                           
{'loss': '0.1371', 'grad_norm': '1.927', 'learning_rate': '8.514e-06', 'epoch': '0.5611'}

 56%|█████▌    | 21300/37963 [66:08:41<59:55:40, 12.95s/it]
 56%|█████▌    | 21301/37963 [66:08:52<56:03:30, 12.11s/it]
 56%|█████▌    | 21302/37963 [66:09:02<53:19:00, 11.52s/it]
 56%|█████▌    | 21303/37963 [66:09:12<51:18:49, 11.09s/it]
 56%|█████▌    | 21304/37963 [66:09:28<58:42:52, 12.69s/it]
 56%|█████▌    | 21305/37963 [66:09:38<55:05:08, 11.90s/it]
 56%|█████▌    | 21306/37963 [66:09:48<52:15:40, 11.29s/it]
 56%|█████▌    | 21307/37963 [66:09:58<50:34:37, 10.93s/it]
 56%|█████▌    | 21308/37963 [66:10:15<58:16:51, 12.60s/it]
 56%|█████▌    | 21309/37963 [66:10:31<63:42:11, 13.77s/it]
 56%|█████▌    | 21310/37963 [66:10:41<58:31:50, 12.65s/it]
                                                           
{'loss': '0.1284', 'grad_norm': '0.9707', 'learning_rate': '8.506e-06', 'epoch': '0.5613'}

 56%|█████▌    | 21310/37963 [66:10:41<58:31:50, 12.65s/it]
 56%|█████▌    | 21311/37963 [66:10:51<54:22:32, 11.76s/it]
 56%|█████▌    | 21312/37963 [66:11:01<52:08:59, 11.27s/it]
 56%|█████▌    | 21313/37963 [66:11:11<50:34:58, 10.94s/it]
 56%|█████▌    | 21314/37963 [66:11:28<59:07:37, 12.78s/it]
 56%|█████▌    | 21315/37963 [66:11:39<55:30:58, 12.00s/it]
 56%|█████▌    | 21316/37963 [66:11:49<52:45:32, 11.41s/it]
 56%|█████▌    | 21317/37963 [66:11:59<50:59:19, 11.03s/it]
 56%|█████▌    | 21318/37963 [66:12:09<49:47:39, 10.77s/it]
 56%|█████▌    | 21319/37963 [66:12:19<48:07:46, 10.41s/it]
 56%|█████▌    | 21320/37963 [66:12:29<47:38:07, 10.30s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '2.727', 'learning_rate': '8.497e-06', 'epoch': '0.5616'}

 56%|█████▌    | 21320/37963 [66:12:29<47:38:07, 10.30s/it]
 56%|█████▌    | 21321/37963 [66:12:39<47:23:42, 10.25s/it]
 56%|█████▌    | 21322/37963 [66:12:49<47:12:13, 10.21s/it]
 56%|█████▌    | 21323/37963 [66:12:59<47:04:34, 10.18s/it]
 56%|█████▌    | 21324/37963 [66:13:09<46:54:29, 10.15s/it]
 56%|█████▌    | 21325/37963 [66:13:19<46:48:34, 10.13s/it]
 56%|█████▌    | 21326/37963 [66:13:29<46:20:40, 10.03s/it]
 56%|█████▌    | 21327/37963 [66:13:39<46:20:30, 10.03s/it]
 56%|█████▌    | 21328/37963 [66:13:49<46:08:51,  9.99s/it]
 56%|█████▌    | 21329/37963 [66:13:59<46:23:54, 10.04s/it]
 56%|█████▌    | 21330/37963 [66:14:09<46:38:01, 10.09s/it]
                                                           
{'loss': '0.1419', 'grad_norm': '0.9454', 'learning_rate': '8.489e-06', 'epoch': '0.5619'}

 56%|█████▌    | 21330/37963 [66:14:09<46:38:01, 10.09s/it]
 56%|█████▌    | 21331/37963 [66:14:26<55:37:19, 12.04s/it]
 56%|█████▌    | 21332/37963 [66:14:36<52:58:10, 11.47s/it]
 56%|█████▌    | 21333/37963 [66:14:46<51:08:28, 11.07s/it]
 56%|█████▌    | 21334/37963 [66:14:56<49:37:07, 10.74s/it]
 56%|█████▌    | 21335/37963 [66:15:06<48:47:29, 10.56s/it]
 56%|█████▌    | 21336/37963 [66:15:16<48:11:45, 10.44s/it]
 56%|█████▌    | 21337/37963 [66:15:26<47:33:06, 10.30s/it]
 56%|█████▌    | 21338/37963 [66:15:36<47:12:05, 10.22s/it]
 56%|█████▌    | 21339/37963 [66:15:46<46:46:26, 10.13s/it]
 56%|█████▌    | 21340/37963 [66:15:56<46:49:39, 10.14s/it]
                                                           
{'loss': '0.1317', 'grad_norm': '1.15', 'learning_rate': '8.48e-06', 'epoch': '0.5621'}

 56%|█████▌    | 21340/37963 [66:15:56<46:49:39, 10.14s/it]
 56%|█████▌    | 21341/37963 [66:16:06<46:41:25, 10.11s/it]
 56%|█████▌    | 21342/37963 [66:16:16<46:20:23, 10.04s/it]
 56%|█████▌    | 21343/37963 [66:16:39<63:27:36, 13.75s/it]
 56%|█████▌    | 21344/37963 [66:16:49<58:23:31, 12.65s/it]
 56%|█████▌    | 21345/37963 [66:16:59<54:36:53, 11.83s/it]
 56%|█████▌    | 21346/37963 [66:17:09<52:10:39, 11.30s/it]
 56%|█████▌    | 21347/37963 [66:17:19<50:24:55, 10.92s/it]
 56%|█████▌    | 21348/37963 [66:17:29<49:23:53, 10.70s/it]
 56%|█████▌    | 21349/37963 [66:17:46<57:44:19, 12.51s/it]
 56%|█████▌    | 21350/37963 [66:17:56<54:24:54, 11.79s/it]
                                                           
{'loss': '0.1371', 'grad_norm': '2.274', 'learning_rate': '8.472e-06', 'epoch': '0.5624'}

 56%|█████▌    | 21350/37963 [66:17:56<54:24:54, 11.79s/it]
 56%|█████▌    | 21351/37963 [66:18:06<51:47:00, 11.22s/it]
 56%|█████▌    | 21352/37963 [66:18:22<59:19:52, 12.86s/it]
 56%|█████▌    | 21353/37963 [66:18:33<55:31:05, 12.03s/it]
 56%|█████▌    | 21354/37963 [66:18:49<62:08:32, 13.47s/it]
 56%|█████▋    | 21355/37963 [66:18:59<57:31:42, 12.47s/it]
 56%|█████▋    | 21356/37963 [66:19:10<54:16:16, 11.76s/it]
 56%|█████▋    | 21357/37963 [66:19:20<51:54:25, 11.25s/it]
 56%|█████▋    | 21358/37963 [66:19:30<50:15:36, 10.90s/it]
 56%|█████▋    | 21359/37963 [66:19:46<58:09:21, 12.61s/it]
 56%|█████▋    | 21360/37963 [66:19:56<54:45:54, 11.87s/it]
                                                           
{'loss': '0.1425', 'grad_norm': '1.562', 'learning_rate': '8.464e-06', 'epoch': '0.5627'}

 56%|█████▋    | 21360/37963 [66:19:56<54:45:54, 11.87s/it]
 56%|█████▋    | 21361/37963 [66:20:07<52:16:29, 11.34s/it]
 56%|█████▋    | 21362/37963 [66:20:17<50:22:23, 10.92s/it]
 56%|█████▋    | 21363/37963 [66:20:33<58:40:23, 12.72s/it]
 56%|█████▋    | 21364/37963 [66:20:44<55:03:39, 11.94s/it]
 56%|█████▋    | 21365/37963 [66:20:54<52:42:49, 11.43s/it]
 56%|█████▋    | 21366/37963 [66:21:04<50:59:39, 11.06s/it]
 56%|█████▋    | 21367/37963 [66:21:14<49:36:01, 10.76s/it]
 56%|█████▋    | 21368/37963 [66:21:24<48:19:48, 10.48s/it]
 56%|█████▋    | 21369/37963 [66:21:34<47:54:29, 10.39s/it]
 56%|█████▋    | 21370/37963 [66:21:44<47:24:53, 10.29s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '1.401', 'learning_rate': '8.455e-06', 'epoch': '0.5629'}

 56%|█████▋    | 21370/37963 [66:21:44<47:24:53, 10.29s/it]
 56%|█████▋    | 21371/37963 [66:21:54<47:10:52, 10.24s/it]
 56%|█████▋    | 21372/37963 [66:22:04<46:58:41, 10.19s/it]
 56%|█████▋    | 21373/37963 [66:22:14<46:23:34, 10.07s/it]
 56%|█████▋    | 21374/37963 [66:22:24<46:26:30, 10.08s/it]
 56%|█████▋    | 21375/37963 [66:22:34<46:14:48, 10.04s/it]
 56%|█████▋    | 21376/37963 [66:22:51<55:16:47, 12.00s/it]
 56%|█████▋    | 21377/37963 [66:23:01<52:38:01, 11.42s/it]
 56%|█████▋    | 21378/37963 [66:23:11<50:44:09, 11.01s/it]
 56%|█████▋    | 21379/37963 [66:23:21<48:57:30, 10.63s/it]
 56%|█████▋    | 21380/37963 [66:23:30<47:43:03, 10.36s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '4.31', 'learning_rate': '8.447e-06', 'epoch': '0.5632'}

 56%|█████▋    | 21380/37963 [66:23:30<47:43:03, 10.36s/it]
 56%|█████▋    | 21381/37963 [66:23:40<47:24:14, 10.29s/it]
 56%|█████▋    | 21382/37963 [66:23:50<46:44:19, 10.15s/it]
 56%|█████▋    | 21383/37963 [66:24:01<46:51:53, 10.18s/it]
 56%|█████▋    | 21384/37963 [66:24:10<46:10:29, 10.03s/it]
 56%|█████▋    | 21385/37963 [66:24:20<46:24:24, 10.08s/it]
 56%|█████▋    | 21386/37963 [66:24:31<46:37:49, 10.13s/it]
 56%|█████▋    | 21387/37963 [66:24:41<46:35:32, 10.12s/it]
 56%|█████▋    | 21388/37963 [66:24:51<46:09:02, 10.02s/it]
 56%|█████▋    | 21389/37963 [66:25:01<46:09:31, 10.03s/it]
 56%|█████▋    | 21390/37963 [66:25:11<46:12:49, 10.04s/it]
                                                           
{'loss': '0.1366', 'grad_norm': '2.399', 'learning_rate': '8.438e-06', 'epoch': '0.5634'}

 56%|█████▋    | 21390/37963 [66:25:11<46:12:49, 10.04s/it]
 56%|█████▋    | 21391/37963 [66:25:21<46:20:13, 10.07s/it]
 56%|█████▋    | 21392/37963 [66:25:37<55:20:32, 12.02s/it]
 56%|█████▋    | 21393/37963 [66:25:55<62:37:58, 13.61s/it]
 56%|█████▋    | 21394/37963 [66:26:04<57:16:02, 12.44s/it]
 56%|█████▋    | 21395/37963 [66:26:15<54:03:12, 11.75s/it]
 56%|█████▋    | 21396/37963 [66:26:25<51:42:47, 11.24s/it]
 56%|█████▋    | 21397/37963 [66:26:35<50:04:49, 10.88s/it]
 56%|█████▋    | 21398/37963 [66:26:51<57:36:45, 12.52s/it]
 56%|█████▋    | 21399/37963 [66:27:01<54:08:30, 11.77s/it]
 56%|█████▋    | 21400/37963 [66:27:11<51:45:40, 11.25s/it]
                                                           
{'loss': '0.149', 'grad_norm': '1.228', 'learning_rate': '8.43e-06', 'epoch': '0.5637'}

 56%|█████▋    | 21400/37963 [66:27:11<51:45:40, 11.25s/it]
 56%|█████▋    | 21401/37963 [66:27:21<49:47:24, 10.82s/it]
 56%|█████▋    | 21402/37963 [66:27:44<66:15:18, 14.40s/it]
 56%|█████▋    | 21403/37963 [66:27:54<60:18:44, 13.11s/it]
 56%|█████▋    | 21404/37963 [66:28:04<56:07:26, 12.20s/it]
 56%|█████▋    | 21405/37963 [66:28:14<53:10:45, 11.56s/it]
 56%|█████▋    | 21406/37963 [66:28:30<59:18:23, 12.90s/it]
 56%|█████▋    | 21407/37963 [66:28:40<55:10:59, 12.00s/it]
 56%|█████▋    | 21408/37963 [66:28:50<52:27:31, 11.41s/it]
 56%|█████▋    | 21409/37963 [66:29:00<50:38:09, 11.01s/it]
 56%|█████▋    | 21410/37963 [66:29:10<49:13:04, 10.70s/it]
                                                           
{'loss': '0.149', 'grad_norm': '2.316', 'learning_rate': '8.422e-06', 'epoch': '0.564'}

 56%|█████▋    | 21410/37963 [66:29:10<49:13:04, 10.70s/it]
 56%|█████▋    | 21411/37963 [66:29:20<48:22:05, 10.52s/it]
 56%|█████▋    | 21412/37963 [66:29:30<47:52:55, 10.41s/it]
 56%|█████▋    | 21413/37963 [66:29:47<56:53:41, 12.38s/it]
 56%|█████▋    | 21414/37963 [66:29:57<53:47:47, 11.70s/it]
 56%|█████▋    | 21415/37963 [66:30:07<51:39:22, 11.24s/it]
 56%|█████▋    | 21416/37963 [66:30:17<49:33:23, 10.78s/it]
 56%|█████▋    | 21417/37963 [66:30:27<48:42:48, 10.60s/it]
 56%|█████▋    | 21418/37963 [66:30:37<48:03:29, 10.46s/it]
 56%|█████▋    | 21419/37963 [66:30:47<47:23:03, 10.31s/it]
 56%|█████▋    | 21420/37963 [66:30:58<47:11:09, 10.27s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '2.077', 'learning_rate': '8.413e-06', 'epoch': '0.5642'}

 56%|█████▋    | 21420/37963 [66:30:58<47:11:09, 10.27s/it]
 56%|█████▋    | 21421/37963 [66:31:08<46:53:43, 10.21s/it]
 56%|█████▋    | 21422/37963 [66:31:18<46:56:56, 10.22s/it]
 56%|█████▋    | 21423/37963 [66:31:28<46:48:41, 10.19s/it]
 56%|█████▋    | 21424/37963 [66:31:38<46:47:09, 10.18s/it]
 56%|█████▋    | 21425/37963 [66:31:54<55:16:13, 12.03s/it]
 56%|█████▋    | 21426/37963 [66:32:04<52:16:05, 11.38s/it]
 56%|█████▋    | 21427/37963 [66:32:14<50:21:51, 10.96s/it]
 56%|█████▋    | 21428/37963 [66:32:24<49:12:10, 10.71s/it]
 56%|█████▋    | 21429/37963 [66:32:35<48:38:21, 10.59s/it]
 56%|█████▋    | 21430/37963 [66:32:45<48:08:24, 10.48s/it]
                                                           
{'loss': '0.1403', 'grad_norm': '1.078', 'learning_rate': '8.405e-06', 'epoch': '0.5645'}

 56%|█████▋    | 21430/37963 [66:32:45<48:08:24, 10.48s/it]
 56%|█████▋    | 21431/37963 [66:32:55<47:36:59, 10.37s/it]
 56%|█████▋    | 21432/37963 [66:33:05<47:25:55, 10.33s/it]
 56%|█████▋    | 21433/37963 [66:33:15<46:59:44, 10.24s/it]
 56%|█████▋    | 21434/37963 [66:33:25<46:53:38, 10.21s/it]
 56%|█████▋    | 21435/37963 [66:33:35<46:14:55, 10.07s/it]
 56%|█████▋    | 21436/37963 [66:33:45<46:16:10, 10.08s/it]
 56%|█████▋    | 21437/37963 [66:33:55<46:17:17, 10.08s/it]
 56%|█████▋    | 21438/37963 [66:34:06<46:25:23, 10.11s/it]
 56%|█████▋    | 21439/37963 [66:34:16<46:26:20, 10.12s/it]
 56%|█████▋    | 21440/37963 [66:34:26<46:21:54, 10.10s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '1.183', 'learning_rate': '8.396e-06', 'epoch': '0.5648'}

 56%|█████▋    | 21440/37963 [66:34:26<46:21:54, 10.10s/it]
 56%|█████▋    | 21441/37963 [66:34:43<55:51:41, 12.17s/it]
 56%|█████▋    | 21442/37963 [66:34:53<52:49:16, 11.51s/it]
 56%|█████▋    | 21443/37963 [66:35:03<50:55:11, 11.10s/it]
 56%|█████▋    | 21444/37963 [66:35:13<49:32:45, 10.80s/it]
 56%|█████▋    | 21445/37963 [66:35:23<48:37:53, 10.60s/it]
 56%|█████▋    | 21446/37963 [66:35:33<47:19:11, 10.31s/it]
 56%|█████▋    | 21447/37963 [66:35:49<55:42:21, 12.14s/it]
 56%|█████▋    | 21448/37963 [66:35:59<52:58:14, 11.55s/it]
 56%|█████▋    | 21449/37963 [66:36:16<59:24:01, 12.95s/it]
 57%|█████▋    | 21450/37963 [66:36:26<55:18:06, 12.06s/it]
                                                           
{'loss': '0.1213', 'grad_norm': '1.186', 'learning_rate': '8.388e-06', 'epoch': '0.565'}

 57%|█████▋    | 21450/37963 [66:36:26<55:18:06, 12.06s/it]
 57%|█████▋    | 21451/37963 [66:36:42<61:35:36, 13.43s/it]
 57%|█████▋    | 21452/37963 [66:36:52<57:10:31, 12.47s/it]
 57%|█████▋    | 21453/37963 [66:37:03<54:00:37, 11.78s/it]
 57%|█████▋    | 21454/37963 [66:37:19<60:30:30, 13.19s/it]
 57%|█████▋    | 21455/37963 [66:37:29<56:10:20, 12.25s/it]
 57%|█████▋    | 21456/37963 [66:37:39<52:56:35, 11.55s/it]
 57%|█████▋    | 21457/37963 [66:37:49<51:01:39, 11.13s/it]
 57%|█████▋    | 21458/37963 [66:37:59<49:39:08, 10.83s/it]
 57%|█████▋    | 21459/37963 [66:38:09<48:09:23, 10.50s/it]
 57%|█████▋    | 21460/37963 [66:38:19<47:24:05, 10.34s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '1.486', 'learning_rate': '8.379e-06', 'epoch': '0.5653'}

 57%|█████▋    | 21460/37963 [66:38:19<47:24:05, 10.34s/it]
 57%|█████▋    | 21461/37963 [66:38:36<56:25:38, 12.31s/it]
 57%|█████▋    | 21462/37963 [66:38:46<53:22:01, 11.64s/it]
 57%|█████▋    | 21463/37963 [66:38:56<51:18:08, 11.19s/it]
 57%|█████▋    | 21464/37963 [66:39:06<49:37:31, 10.83s/it]
 57%|█████▋    | 21465/37963 [66:39:16<48:37:08, 10.61s/it]
 57%|█████▋    | 21466/37963 [66:39:26<47:55:21, 10.46s/it]
 57%|█████▋    | 21467/37963 [66:39:36<47:17:48, 10.32s/it]
 57%|█████▋    | 21468/37963 [66:39:46<46:57:44, 10.25s/it]
 57%|█████▋    | 21469/37963 [66:39:56<46:15:26, 10.10s/it]
 57%|█████▋    | 21470/37963 [66:40:06<46:22:10, 10.12s/it]
                                                           
{'loss': '0.1459', 'grad_norm': '1.228', 'learning_rate': '8.371e-06', 'epoch': '0.5656'}

 57%|█████▋    | 21470/37963 [66:40:06<46:22:10, 10.12s/it]
 57%|█████▋    | 21471/37963 [66:40:16<46:25:27, 10.13s/it]
 57%|█████▋    | 21472/37963 [66:40:27<46:31:28, 10.16s/it]
 57%|█████▋    | 21473/37963 [66:40:43<55:19:36, 12.08s/it]
 57%|█████▋    | 21474/37963 [66:40:53<52:35:42, 11.48s/it]
 57%|█████▋    | 21475/37963 [66:41:03<50:44:35, 11.08s/it]
 57%|█████▋    | 21476/37963 [66:41:14<49:27:41, 10.80s/it]
 57%|█████▋    | 21477/37963 [66:41:24<48:21:17, 10.56s/it]
 57%|█████▋    | 21478/37963 [66:41:34<47:41:14, 10.41s/it]
 57%|█████▋    | 21479/37963 [66:41:44<47:17:18, 10.33s/it]
 57%|█████▋    | 21480/37963 [66:41:54<46:47:51, 10.22s/it]
                                                           
{'loss': '0.1351', 'grad_norm': '3.778', 'learning_rate': '8.363e-06', 'epoch': '0.5658'}

 57%|█████▋    | 21480/37963 [66:41:54<46:47:51, 10.22s/it]
 57%|█████▋    | 21481/37963 [66:42:04<46:29:30, 10.15s/it]
 57%|█████▋    | 21482/37963 [66:42:14<46:21:11, 10.13s/it]
 57%|█████▋    | 21483/37963 [66:42:24<46:21:27, 10.13s/it]
 57%|█████▋    | 21484/37963 [66:42:34<46:13:39, 10.10s/it]
 57%|█████▋    | 21485/37963 [66:42:44<46:20:01, 10.12s/it]
 57%|█████▋    | 21486/37963 [66:42:54<45:57:14, 10.04s/it]
 57%|█████▋    | 21487/37963 [66:43:04<45:59:53, 10.05s/it]
 57%|█████▋    | 21488/37963 [66:43:14<45:55:01, 10.03s/it]
 57%|█████▋    | 21489/37963 [66:43:31<55:36:01, 12.15s/it]
 57%|█████▋    | 21490/37963 [66:43:48<61:37:13, 13.47s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '3.186', 'learning_rate': '8.354e-06', 'epoch': '0.5661'}

 57%|█████▋    | 21490/37963 [66:43:48<61:37:13, 13.47s/it]
 57%|█████▋    | 21491/37963 [66:43:58<57:04:31, 12.47s/it]
 57%|█████▋    | 21492/37963 [66:44:08<53:08:15, 11.61s/it]
 57%|█████▋    | 21493/37963 [66:44:18<51:03:09, 11.16s/it]
 57%|█████▋    | 21494/37963 [66:44:28<49:46:05, 10.88s/it]
 57%|█████▋    | 21495/37963 [66:44:38<48:43:27, 10.65s/it]
 57%|█████▋    | 21496/37963 [66:44:48<47:59:36, 10.49s/it]
 57%|█████▋    | 21497/37963 [66:45:11<65:14:21, 14.26s/it]
 57%|█████▋    | 21498/37963 [66:45:28<68:15:01, 14.92s/it]
 57%|█████▋    | 21499/37963 [66:45:38<61:43:27, 13.50s/it]
 57%|█████▋    | 21500/37963 [66:45:48<56:57:49, 12.46s/it]
                                                           
{'loss': '0.1359', 'grad_norm': '1.006', 'learning_rate': '8.346e-06', 'epoch': '0.5663'}

 57%|█████▋    | 21500/37963 [66:45:48<56:57:49, 12.46s/it]
 57%|█████▋    | 21501/37963 [66:45:58<53:39:20, 11.73s/it]
 57%|█████▋    | 21502/37963 [66:46:16<62:48:27, 13.74s/it]
 57%|█████▋    | 21503/37963 [66:46:26<57:59:31, 12.68s/it]
 57%|█████▋    | 21504/37963 [66:46:36<53:33:49, 11.72s/it]
 57%|█████▋    | 21505/37963 [66:46:46<51:24:33, 11.25s/it]
 57%|█████▋    | 21506/37963 [66:46:56<49:55:36, 10.92s/it]
 57%|█████▋    | 21507/37963 [66:47:06<48:49:42, 10.68s/it]
 57%|█████▋    | 21508/37963 [66:47:17<48:10:31, 10.54s/it]
 57%|█████▋    | 21509/37963 [66:47:34<57:07:42, 12.50s/it]
 57%|█████▋    | 21510/37963 [66:47:44<54:12:45, 11.86s/it]
                                                           
{'loss': '0.137', 'grad_norm': '2.014', 'learning_rate': '8.337e-06', 'epoch': '0.5666'}

 57%|█████▋    | 21510/37963 [66:47:44<54:12:45, 11.86s/it]
 57%|█████▋    | 21511/37963 [66:47:54<51:44:11, 11.32s/it]
 57%|█████▋    | 21512/37963 [66:48:04<49:58:57, 10.94s/it]
 57%|█████▋    | 21513/37963 [66:48:14<48:41:08, 10.65s/it]
 57%|█████▋    | 21514/37963 [66:48:24<47:51:30, 10.47s/it]
 57%|█████▋    | 21515/37963 [66:48:34<47:23:38, 10.37s/it]
 57%|█████▋    | 21516/37963 [66:48:44<47:01:03, 10.29s/it]
 57%|█████▋    | 21517/37963 [66:48:55<46:53:40, 10.27s/it]
 57%|█████▋    | 21518/37963 [66:49:04<46:00:13, 10.07s/it]
 57%|█████▋    | 21519/37963 [66:49:15<46:25:34, 10.16s/it]
 57%|█████▋    | 21520/37963 [66:49:25<46:23:34, 10.16s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '2.339', 'learning_rate': '8.329e-06', 'epoch': '0.5669'}

 57%|█████▋    | 21520/37963 [66:49:25<46:23:34, 10.16s/it]
 57%|█████▋    | 21521/37963 [66:49:34<45:44:56, 10.02s/it]
 57%|█████▋    | 21522/37963 [66:49:51<54:53:35, 12.02s/it]
 57%|█████▋    | 21523/37963 [66:50:01<52:16:32, 11.45s/it]
 57%|█████▋    | 21524/37963 [66:50:11<50:17:16, 11.01s/it]
 57%|█████▋    | 21525/37963 [66:50:21<49:08:32, 10.76s/it]
 57%|█████▋    | 21526/37963 [66:50:32<48:12:45, 10.56s/it]
 57%|█████▋    | 21527/37963 [66:50:42<47:35:05, 10.42s/it]
 57%|█████▋    | 21528/37963 [66:50:52<47:13:10, 10.34s/it]
 57%|█████▋    | 21529/37963 [66:51:02<46:52:59, 10.27s/it]
 57%|█████▋    | 21530/37963 [66:51:12<46:42:03, 10.23s/it]
                                                           
{'loss': '0.14', 'grad_norm': '2.009', 'learning_rate': '8.32e-06', 'epoch': '0.5671'}

 57%|█████▋    | 21530/37963 [66:51:12<46:42:03, 10.23s/it]
 57%|█████▋    | 21531/37963 [66:51:22<46:39:56, 10.22s/it]
 57%|█████▋    | 21532/37963 [66:51:32<46:26:13, 10.17s/it]
 57%|█████▋    | 21533/37963 [66:51:42<46:21:08, 10.16s/it]
 57%|█████▋    | 21534/37963 [66:51:52<46:00:16, 10.08s/it]
 57%|█████▋    | 21535/37963 [66:52:02<45:36:59, 10.00s/it]
 57%|█████▋    | 21536/37963 [66:52:12<45:44:30, 10.02s/it]
 57%|█████▋    | 21537/37963 [66:52:22<45:54:01, 10.06s/it]
 57%|█████▋    | 21538/37963 [66:52:39<55:36:16, 12.19s/it]
 57%|█████▋    | 21539/37963 [66:52:50<52:50:00, 11.58s/it]
 57%|█████▋    | 21540/37963 [66:53:06<60:01:19, 13.16s/it]
                                                           
{'loss': '0.147', 'grad_norm': '3.308', 'learning_rate': '8.312e-06', 'epoch': '0.5674'}

 57%|█████▋    | 21540/37963 [66:53:06<60:01:19, 13.16s/it]
 57%|█████▋    | 21541/37963 [66:53:16<55:28:38, 12.16s/it]
 57%|█████▋    | 21542/37963 [66:53:26<52:31:20, 11.51s/it]
 57%|█████▋    | 21543/37963 [66:53:37<50:49:14, 11.14s/it]
 57%|█████▋    | 21544/37963 [66:53:53<58:00:07, 12.72s/it]
 57%|█████▋    | 21545/37963 [66:54:09<62:34:44, 13.72s/it]
 57%|█████▋    | 21546/37963 [66:54:25<66:09:21, 14.51s/it]
 57%|█████▋    | 21547/37963 [66:54:35<59:46:30, 13.11s/it]
 57%|█████▋    | 21548/37963 [66:54:52<65:11:17, 14.30s/it]
 57%|█████▋    | 21549/37963 [66:55:02<59:28:45, 13.05s/it]
 57%|█████▋    | 21550/37963 [66:55:13<55:32:02, 12.18s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '1.404', 'learning_rate': '8.304e-06', 'epoch': '0.5677'}

 57%|█████▋    | 21550/37963 [66:55:13<55:32:02, 12.18s/it]
 57%|█████▋    | 21551/37963 [66:55:23<52:34:38, 11.53s/it]
 57%|█████▋    | 21552/37963 [66:55:32<50:01:00, 10.97s/it]
 57%|█████▋    | 21553/37963 [66:55:42<48:58:11, 10.74s/it]
 57%|█████▋    | 21554/37963 [66:55:52<47:26:10, 10.41s/it]
 57%|█████▋    | 21555/37963 [66:56:02<46:48:14, 10.27s/it]
 57%|█████▋    | 21556/37963 [66:56:12<46:32:13, 10.21s/it]
 57%|█████▋    | 21557/37963 [66:56:29<55:26:31, 12.17s/it]
 57%|█████▋    | 21558/37963 [66:56:39<52:32:04, 11.53s/it]
 57%|█████▋    | 21559/37963 [66:56:49<50:20:20, 11.05s/it]
 57%|█████▋    | 21560/37963 [66:56:59<48:38:18, 10.67s/it]
                                                           
{'loss': '0.1418', 'grad_norm': '2.339', 'learning_rate': '8.295e-06', 'epoch': '0.5679'}

 57%|█████▋    | 21560/37963 [66:56:59<48:38:18, 10.67s/it]
 57%|█████▋    | 21561/37963 [66:57:08<47:26:51, 10.41s/it]
 57%|█████▋    | 21562/37963 [66:57:18<46:55:13, 10.30s/it]
 57%|█████▋    | 21563/37963 [66:57:29<46:37:40, 10.24s/it]
 57%|█████▋    | 21564/37963 [66:57:38<45:29:46,  9.99s/it]
 57%|█████▋    | 21565/37963 [66:57:48<45:06:55,  9.90s/it]
 57%|█████▋    | 21566/37963 [66:57:58<45:27:40,  9.98s/it]
 57%|█████▋    | 21567/37963 [66:58:08<45:42:35, 10.04s/it]
 57%|█████▋    | 21568/37963 [66:58:18<45:52:26, 10.07s/it]
 57%|█████▋    | 21569/37963 [66:58:35<54:32:04, 11.98s/it]
 57%|█████▋    | 21570/37963 [66:58:45<51:55:16, 11.40s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '2.168', 'learning_rate': '8.287e-06', 'epoch': '0.5682'}

 57%|█████▋    | 21570/37963 [66:58:45<51:55:16, 11.40s/it]
 57%|█████▋    | 21571/37963 [66:58:55<50:05:07, 11.00s/it]
 57%|█████▋    | 21572/37963 [66:59:05<48:48:12, 10.72s/it]
 57%|█████▋    | 21573/37963 [66:59:15<47:58:59, 10.54s/it]
 57%|█████▋    | 21574/37963 [66:59:25<47:11:39, 10.37s/it]
 57%|█████▋    | 21575/37963 [66:59:35<46:49:01, 10.28s/it]
 57%|█████▋    | 21576/37963 [66:59:45<46:40:02, 10.25s/it]
 57%|█████▋    | 21577/37963 [66:59:55<46:25:36, 10.20s/it]
 57%|█████▋    | 21578/37963 [67:00:05<46:17:17, 10.17s/it]
 57%|█████▋    | 21579/37963 [67:00:15<45:46:06, 10.06s/it]
 57%|█████▋    | 21580/37963 [67:00:25<45:39:17, 10.03s/it]
                                                           
{'loss': '0.1367', 'grad_norm': '1.133', 'learning_rate': '8.278e-06', 'epoch': '0.5685'}

 57%|█████▋    | 21580/37963 [67:00:25<45:39:17, 10.03s/it]
 57%|█████▋    | 21581/37963 [67:00:35<45:38:57, 10.03s/it]
 57%|█████▋    | 21582/37963 [67:00:45<45:46:52, 10.06s/it]
 57%|█████▋    | 21583/37963 [67:00:55<45:46:05, 10.06s/it]
 57%|█████▋    | 21584/37963 [67:01:05<45:49:20, 10.07s/it]
 57%|█████▋    | 21585/37963 [67:01:16<45:53:50, 10.09s/it]
 57%|█████▋    | 21586/37963 [67:01:32<54:35:47, 12.00s/it]
 57%|█████▋    | 21587/37963 [67:01:42<51:58:00, 11.42s/it]
 57%|█████▋    | 21588/37963 [67:01:52<50:11:52, 11.04s/it]
 57%|█████▋    | 21589/37963 [67:02:09<57:38:54, 12.67s/it]
 57%|█████▋    | 21590/37963 [67:02:19<53:50:04, 11.84s/it]
                                                           
{'loss': '0.1301', 'grad_norm': '1.633', 'learning_rate': '8.27e-06', 'epoch': '0.5687'}

 57%|█████▋    | 21590/37963 [67:02:19<53:50:04, 11.84s/it]
 57%|█████▋    | 21591/37963 [67:02:29<51:35:15, 11.34s/it]
 57%|█████▋    | 21592/37963 [67:02:39<49:51:57, 10.97s/it]
 57%|█████▋    | 21593/37963 [67:03:02<66:18:37, 14.58s/it]
 57%|█████▋    | 21594/37963 [67:03:12<60:11:38, 13.24s/it]
 57%|█████▋    | 21595/37963 [67:03:22<55:53:38, 12.29s/it]
 57%|█████▋    | 21596/37963 [67:03:45<70:44:50, 15.56s/it]
 57%|█████▋    | 21597/37963 [67:03:55<63:18:16, 13.92s/it]
 57%|█████▋    | 21598/37963 [67:04:05<58:04:11, 12.77s/it]
 57%|█████▋    | 21599/37963 [67:04:15<54:20:10, 11.95s/it]
 57%|█████▋    | 21600/37963 [67:04:25<51:29:26, 11.33s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '1.742', 'learning_rate': '8.262e-06', 'epoch': '0.569'}

 57%|█████▋    | 21600/37963 [67:04:25<51:29:26, 11.33s/it]
 57%|█████▋    | 21601/37963 [67:04:35<49:27:57, 10.88s/it]
 57%|█████▋    | 21602/37963 [67:04:45<48:12:10, 10.61s/it]
 57%|█████▋    | 21603/37963 [67:04:56<48:06:11, 10.59s/it]
 57%|█████▋    | 21604/37963 [67:05:06<47:05:58, 10.36s/it]
 57%|█████▋    | 21605/37963 [67:05:16<46:44:00, 10.28s/it]
 57%|█████▋    | 21606/37963 [67:05:33<55:51:48, 12.29s/it]
 57%|█████▋    | 21607/37963 [67:05:43<52:39:31, 11.59s/it]
 57%|█████▋    | 21608/37963 [67:05:53<50:42:55, 11.16s/it]
 57%|█████▋    | 21609/37963 [67:06:03<49:12:34, 10.83s/it]
 57%|█████▋    | 21610/37963 [67:06:13<48:25:27, 10.66s/it]
                                                           
{'loss': '0.1405', 'grad_norm': '3.032', 'learning_rate': '8.253e-06', 'epoch': '0.5692'}

 57%|█████▋    | 21610/37963 [67:06:13<48:25:27, 10.66s/it]
 57%|█████▋    | 21611/37963 [67:06:23<47:40:12, 10.49s/it]
 57%|█████▋    | 21612/37963 [67:06:33<47:06:01, 10.37s/it]
 57%|█████▋    | 21613/37963 [67:06:43<46:39:40, 10.27s/it]
 57%|█████▋    | 21614/37963 [67:06:53<46:26:04, 10.22s/it]
 57%|█████▋    | 21615/37963 [67:07:03<45:54:01, 10.11s/it]
 57%|█████▋    | 21616/37963 [67:07:19<54:04:57, 11.91s/it]
 57%|█████▋    | 21617/37963 [67:07:30<51:42:13, 11.39s/it]
 57%|█████▋    | 21618/37963 [67:07:40<49:54:46, 10.99s/it]
 57%|█████▋    | 21619/37963 [67:07:49<48:03:44, 10.59s/it]
 57%|█████▋    | 21620/37963 [67:07:59<47:02:45, 10.36s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '1.277', 'learning_rate': '8.245e-06', 'epoch': '0.5695'}

 57%|█████▋    | 21620/37963 [67:07:59<47:02:45, 10.36s/it]
 57%|█████▋    | 21621/37963 [67:08:09<46:39:16, 10.28s/it]
 57%|█████▋    | 21622/37963 [67:08:19<46:24:38, 10.22s/it]
 57%|█████▋    | 21623/37963 [67:08:29<45:34:16, 10.04s/it]
 57%|█████▋    | 21624/37963 [67:08:39<45:33:15, 10.04s/it]
 57%|█████▋    | 21625/37963 [67:08:49<45:32:07, 10.03s/it]
 57%|█████▋    | 21626/37963 [67:08:59<45:35:14, 10.05s/it]
 57%|█████▋    | 21627/37963 [67:09:09<45:24:40, 10.01s/it]
 57%|█████▋    | 21628/37963 [67:09:19<45:02:47,  9.93s/it]
 57%|█████▋    | 21629/37963 [67:09:29<44:57:53,  9.91s/it]
 57%|█████▋    | 21630/37963 [67:09:38<45:02:57,  9.93s/it]
                                                           
{'loss': '0.1408', 'grad_norm': '1.458', 'learning_rate': '8.236e-06', 'epoch': '0.5698'}

 57%|█████▋    | 21630/37963 [67:09:38<45:02:57,  9.93s/it]
 57%|█████▋    | 21631/37963 [67:09:49<45:16:16,  9.98s/it]
 57%|█████▋    | 21632/37963 [67:09:59<45:28:47, 10.03s/it]
 57%|█████▋    | 21633/37963 [67:10:09<45:40:28, 10.07s/it]
 57%|█████▋    | 21634/37963 [67:10:19<45:47:56, 10.10s/it]
 57%|█████▋    | 21635/37963 [67:10:29<45:47:49, 10.10s/it]
 57%|█████▋    | 21636/37963 [67:10:46<54:45:44, 12.07s/it]
 57%|█████▋    | 21637/37963 [67:10:56<51:55:48, 11.45s/it]
 57%|█████▋    | 21638/37963 [67:11:06<50:00:47, 11.03s/it]
 57%|█████▋    | 21639/37963 [67:11:22<57:05:51, 12.59s/it]
 57%|█████▋    | 21640/37963 [67:11:40<64:51:49, 14.31s/it]
                                                           
{'loss': '0.1444', 'grad_norm': '1.571', 'learning_rate': '8.228e-06', 'epoch': '0.57'}

 57%|█████▋    | 21640/37963 [67:11:40<64:51:49, 14.31s/it]
 57%|█████▋    | 21641/37963 [67:11:50<58:51:30, 12.98s/it]
 57%|█████▋    | 21642/37963 [67:12:00<55:02:56, 12.14s/it]
 57%|█████▋    | 21643/37963 [67:12:17<61:01:20, 13.46s/it]
 57%|█████▋    | 21644/37963 [67:12:34<65:49:55, 14.52s/it]
 57%|█████▋    | 21645/37963 [67:12:44<59:47:33, 13.19s/it]
 57%|█████▋    | 21646/37963 [67:12:54<55:30:12, 12.25s/it]
 57%|█████▋    | 21647/37963 [67:13:04<52:40:10, 11.62s/it]
 57%|█████▋    | 21648/37963 [67:13:14<50:33:55, 11.16s/it]
 57%|█████▋    | 21649/37963 [67:13:24<49:00:39, 10.82s/it]
 57%|█████▋    | 21650/37963 [67:13:34<47:55:57, 10.58s/it]
                                                           
{'loss': '0.1309', 'grad_norm': '2.639', 'learning_rate': '8.22e-06', 'epoch': '0.5703'}

 57%|█████▋    | 21650/37963 [67:13:34<47:55:57, 10.58s/it]
 57%|█████▋    | 21651/37963 [67:13:45<47:18:15, 10.44s/it]
 57%|█████▋    | 21652/37963 [67:13:55<46:51:51, 10.34s/it]
 57%|█████▋    | 21653/37963 [67:14:11<55:25:34, 12.23s/it]
 57%|█████▋    | 21654/37963 [67:14:21<51:22:09, 11.34s/it]
 57%|█████▋    | 21655/37963 [67:14:31<49:44:00, 10.98s/it]
 57%|█████▋    | 21656/37963 [67:14:41<48:37:45, 10.74s/it]
 57%|█████▋    | 21657/37963 [67:14:51<47:46:35, 10.55s/it]
 57%|█████▋    | 21658/37963 [67:15:01<47:09:39, 10.41s/it]
 57%|█████▋    | 21659/37963 [67:15:11<46:54:33, 10.36s/it]
 57%|█████▋    | 21660/37963 [67:15:21<46:36:20, 10.29s/it]
                                                           
{'loss': '0.1394', 'grad_norm': '2.231', 'learning_rate': '8.211e-06', 'epoch': '0.5706'}

 57%|█████▋    | 21660/37963 [67:15:21<46:36:20, 10.29s/it]
 57%|█████▋    | 21661/37963 [67:15:32<46:24:38, 10.25s/it]
 57%|█████▋    | 21662/37963 [67:15:42<46:20:30, 10.23s/it]
 57%|█████▋    | 21663/37963 [67:15:51<45:32:16, 10.06s/it]
 57%|█████▋    | 21664/37963 [67:16:02<45:35:08, 10.07s/it]
 57%|█████▋    | 21665/37963 [67:16:18<54:12:36, 11.97s/it]
 57%|█████▋    | 21666/37963 [67:16:28<51:47:51, 11.44s/it]
 57%|█████▋    | 21667/37963 [67:16:38<49:59:00, 11.04s/it]
 57%|█████▋    | 21668/37963 [67:16:48<48:41:55, 10.76s/it]
 57%|█████▋    | 21669/37963 [67:16:58<47:45:04, 10.55s/it]
 57%|█████▋    | 21670/37963 [67:17:09<47:14:54, 10.44s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '2.447', 'learning_rate': '8.203e-06', 'epoch': '0.5708'}

 57%|█████▋    | 21670/37963 [67:17:09<47:14:54, 10.44s/it]
 57%|█████▋    | 21671/37963 [67:17:19<46:53:19, 10.36s/it]
 57%|█████▋    | 21672/37963 [67:17:29<46:40:04, 10.31s/it]
 57%|█████▋    | 21673/37963 [67:17:39<46:39:16, 10.31s/it]
 57%|█████▋    | 21674/37963 [67:17:50<46:32:53, 10.29s/it]
 57%|█████▋    | 21675/37963 [67:18:00<46:11:02, 10.21s/it]
 57%|█████▋    | 21676/37963 [67:18:10<46:14:34, 10.22s/it]
 57%|█████▋    | 21677/37963 [67:18:20<45:54:35, 10.15s/it]
 57%|█████▋    | 21678/37963 [67:18:30<45:56:39, 10.16s/it]
 57%|█████▋    | 21679/37963 [67:18:40<46:13:32, 10.22s/it]
 57%|█████▋    | 21680/37963 [67:18:50<46:05:00, 10.19s/it]
                                                           
{'loss': '0.1303', 'grad_norm': '4.781', 'learning_rate': '8.194e-06', 'epoch': '0.5711'}

 57%|█████▋    | 21680/37963 [67:18:50<46:05:00, 10.19s/it]
 57%|█████▋    | 21681/37963 [67:19:00<45:49:49, 10.13s/it]
 57%|█████▋    | 21682/37963 [67:19:11<45:45:40, 10.12s/it]
 57%|█████▋    | 21683/37963 [67:19:21<45:46:56, 10.12s/it]
 57%|█████▋    | 21684/37963 [67:19:37<54:19:14, 12.01s/it]
 57%|█████▋    | 21685/37963 [67:20:01<69:54:36, 15.46s/it]
 57%|█████▋    | 21686/37963 [67:20:11<62:28:58, 13.82s/it]
 57%|█████▋    | 21687/37963 [67:20:21<57:25:06, 12.70s/it]
 57%|█████▋    | 21688/37963 [67:20:31<53:59:46, 11.94s/it]
 57%|█████▋    | 21689/37963 [67:20:41<51:26:22, 11.38s/it]
 57%|█████▋    | 21690/37963 [67:20:58<58:32:11, 12.95s/it]
                                                           
{'loss': '0.1398', 'grad_norm': '1.758', 'learning_rate': '8.186e-06', 'epoch': '0.5713'}

 57%|█████▋    | 21690/37963 [67:20:58<58:32:11, 12.95s/it]
 57%|█████▋    | 21691/37963 [67:21:07<54:09:13, 11.98s/it]
 57%|█████▋    | 21692/37963 [67:21:24<60:18:06, 13.34s/it]
 57%|█████▋    | 21693/37963 [67:21:41<65:18:20, 14.45s/it]
 57%|█████▋    | 21694/37963 [67:21:51<59:20:50, 13.13s/it]
 57%|█████▋    | 21695/37963 [67:22:01<55:18:26, 12.24s/it]
 57%|█████▋    | 21696/37963 [67:22:11<52:14:25, 11.56s/it]
 57%|█████▋    | 21697/37963 [67:22:21<50:12:40, 11.11s/it]
 57%|█████▋    | 21698/37963 [67:22:31<48:53:29, 10.82s/it]
 57%|█████▋    | 21699/37963 [67:22:41<47:48:38, 10.58s/it]
 57%|█████▋    | 21700/37963 [67:22:51<47:04:52, 10.42s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '4.438', 'learning_rate': '8.178e-06', 'epoch': '0.5716'}

 57%|█████▋    | 21700/37963 [67:22:51<47:04:52, 10.42s/it]
 57%|█████▋    | 21701/37963 [67:23:01<46:23:11, 10.27s/it]
 57%|█████▋    | 21702/37963 [67:23:18<55:36:29, 12.31s/it]
 57%|█████▋    | 21703/37963 [67:23:28<52:27:22, 11.61s/it]
 57%|█████▋    | 21704/37963 [67:23:38<50:04:13, 11.09s/it]
 57%|█████▋    | 21705/37963 [67:23:48<48:11:27, 10.67s/it]
 57%|█████▋    | 21706/37963 [67:23:58<47:03:03, 10.42s/it]
 57%|█████▋    | 21707/37963 [67:24:08<46:25:46, 10.28s/it]
 57%|█████▋    | 21708/37963 [67:24:18<46:13:09, 10.24s/it]
 57%|█████▋    | 21709/37963 [67:24:28<46:07:10, 10.21s/it]
 57%|█████▋    | 21710/37963 [67:24:38<45:44:09, 10.13s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '1.323', 'learning_rate': '8.169e-06', 'epoch': '0.5719'}

 57%|█████▋    | 21710/37963 [67:24:38<45:44:09, 10.13s/it]
 57%|█████▋    | 21711/37963 [67:24:48<45:38:45, 10.11s/it]
 57%|█████▋    | 21712/37963 [67:24:58<45:30:41, 10.08s/it]
 57%|█████▋    | 21713/37963 [67:25:08<45:04:16,  9.99s/it]
 57%|█████▋    | 21714/37963 [67:25:24<53:25:57, 11.84s/it]
 57%|█████▋    | 21715/37963 [67:25:34<50:59:24, 11.30s/it]
 57%|█████▋    | 21716/37963 [67:25:44<49:24:38, 10.95s/it]
 57%|█████▋    | 21717/37963 [67:25:54<47:59:06, 10.63s/it]
 57%|█████▋    | 21718/37963 [67:26:04<47:02:03, 10.42s/it]
 57%|█████▋    | 21719/37963 [67:26:14<46:37:15, 10.33s/it]
 57%|█████▋    | 21720/37963 [67:26:24<45:38:22, 10.12s/it]
                                                           
{'loss': '0.1367', 'grad_norm': '1.769', 'learning_rate': '8.161e-06', 'epoch': '0.5721'}

 57%|█████▋    | 21720/37963 [67:26:24<45:38:22, 10.12s/it]
 57%|█████▋    | 21721/37963 [67:26:33<45:07:48, 10.00s/it]
 57%|█████▋    | 21722/37963 [67:26:43<45:15:28, 10.03s/it]
 57%|█████▋    | 21723/37963 [67:26:53<45:12:49, 10.02s/it]
 57%|█████▋    | 21724/37963 [67:27:03<45:18:31, 10.04s/it]
 57%|█████▋    | 21725/37963 [67:27:13<45:02:00,  9.98s/it]
 57%|█████▋    | 21726/37963 [67:27:23<44:47:35,  9.93s/it]
 57%|█████▋    | 21727/37963 [67:27:33<44:46:47,  9.93s/it]
 57%|█████▋    | 21728/37963 [67:27:43<44:15:03,  9.81s/it]
 57%|█████▋    | 21729/37963 [67:27:53<44:36:38,  9.89s/it]
 57%|█████▋    | 21730/37963 [67:28:03<44:52:26,  9.95s/it]
                                                           
{'loss': '0.1348', 'grad_norm': '2.415', 'learning_rate': '8.153e-06', 'epoch': '0.5724'}

 57%|█████▋    | 21730/37963 [67:28:03<44:52:26,  9.95s/it]
 57%|█████▋    | 21731/37963 [67:28:13<44:40:50,  9.91s/it]
 57%|█████▋    | 21732/37963 [67:28:29<54:07:50, 12.01s/it]
 57%|█████▋    | 21733/37963 [67:28:45<59:30:14, 13.20s/it]
 57%|█████▋    | 21734/37963 [67:28:55<54:31:12, 12.09s/it]
 57%|█████▋    | 21735/37963 [67:29:12<60:30:55, 13.42s/it]
 57%|█████▋    | 21736/37963 [67:29:22<55:56:14, 12.41s/it]
 57%|█████▋    | 21737/37963 [67:29:32<52:38:13, 11.68s/it]
 57%|█████▋    | 21738/37963 [67:29:56<69:45:03, 15.48s/it]
 57%|█████▋    | 21739/37963 [67:30:06<62:24:25, 13.85s/it]
 57%|█████▋    | 21740/37963 [67:30:16<57:20:10, 12.72s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '1.391', 'learning_rate': '8.144e-06', 'epoch': '0.5727'}

 57%|█████▋    | 21740/37963 [67:30:16<57:20:10, 12.72s/it]
 57%|█████▋    | 21741/37963 [67:30:32<62:04:18, 13.77s/it]
 57%|█████▋    | 21742/37963 [67:30:42<56:48:14, 12.61s/it]
 57%|█████▋    | 21743/37963 [67:30:52<53:19:35, 11.84s/it]
 57%|█████▋    | 21744/37963 [67:31:02<50:56:33, 11.31s/it]
 57%|█████▋    | 21745/37963 [67:31:12<49:06:19, 10.90s/it]
 57%|█████▋    | 21746/37963 [67:31:22<48:00:18, 10.66s/it]
 57%|█████▋    | 21747/37963 [67:31:32<47:16:41, 10.50s/it]
 57%|█████▋    | 21748/37963 [67:31:43<46:48:43, 10.39s/it]
 57%|█████▋    | 21749/37963 [67:31:53<46:18:14, 10.28s/it]
 57%|█████▋    | 21750/37963 [67:32:09<55:08:43, 12.24s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '1.777', 'learning_rate': '8.136e-06', 'epoch': '0.5729'}

 57%|█████▋    | 21750/37963 [67:32:09<55:08:43, 12.24s/it]
 57%|█████▋    | 21751/37963 [67:32:19<51:12:45, 11.37s/it]
 57%|█████▋    | 21752/37963 [67:32:29<49:30:45, 11.00s/it]
 57%|█████▋    | 21753/37963 [67:32:39<48:23:46, 10.75s/it]
 57%|█████▋    | 21754/37963 [67:32:49<47:29:34, 10.55s/it]
 57%|█████▋    | 21755/37963 [67:32:59<46:50:27, 10.40s/it]
 57%|█████▋    | 21756/37963 [67:33:09<46:28:23, 10.32s/it]
 57%|█████▋    | 21757/37963 [67:33:19<46:09:11, 10.25s/it]
 57%|█████▋    | 21758/37963 [67:33:29<45:54:58, 10.20s/it]
 57%|█████▋    | 21759/37963 [67:33:40<45:44:25, 10.16s/it]
 57%|█████▋    | 21760/37963 [67:33:50<45:34:17, 10.13s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '0.9247', 'learning_rate': '8.127e-06', 'epoch': '0.5732'}

 57%|█████▋    | 21760/37963 [67:33:50<45:34:17, 10.13s/it]
 57%|█████▋    | 21761/37963 [67:34:06<54:03:43, 12.01s/it]
 57%|█████▋    | 21762/37963 [67:34:16<51:25:06, 11.43s/it]
 57%|█████▋    | 21763/37963 [67:34:26<49:15:36, 10.95s/it]
 57%|█████▋    | 21764/37963 [67:34:36<47:43:50, 10.61s/it]
 57%|█████▋    | 21765/37963 [67:34:46<46:43:37, 10.39s/it]
 57%|█████▋    | 21766/37963 [67:34:56<46:19:22, 10.30s/it]
 57%|█████▋    | 21767/37963 [67:35:06<46:13:49, 10.28s/it]
 57%|█████▋    | 21768/37963 [67:35:16<46:00:59, 10.23s/it]
 57%|█████▋    | 21769/37963 [67:35:26<45:59:56, 10.23s/it]
 57%|█████▋    | 21770/37963 [67:35:36<45:59:06, 10.22s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '1.287', 'learning_rate': '8.119e-06', 'epoch': '0.5735'}

 57%|█████▋    | 21770/37963 [67:35:36<45:59:06, 10.22s/it]
 57%|█████▋    | 21771/37963 [67:35:47<45:51:42, 10.20s/it]
 57%|█████▋    | 21772/37963 [67:35:57<45:34:04, 10.13s/it]
 57%|█████▋    | 21773/37963 [67:36:07<45:25:49, 10.10s/it]
 57%|█████▋    | 21774/37963 [67:36:17<45:38:19, 10.15s/it]
 57%|█████▋    | 21775/37963 [67:36:27<45:38:28, 10.15s/it]
 57%|█████▋    | 21776/37963 [67:36:37<45:36:37, 10.14s/it]
 57%|█████▋    | 21777/37963 [67:36:47<45:39:46, 10.16s/it]
 57%|█████▋    | 21778/37963 [67:36:57<45:31:40, 10.13s/it]
 57%|█████▋    | 21779/37963 [67:37:07<45:18:45, 10.08s/it]
 57%|█████▋    | 21780/37963 [67:37:24<54:40:19, 12.16s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '1.142', 'learning_rate': '8.111e-06', 'epoch': '0.5737'}

 57%|█████▋    | 21780/37963 [67:37:24<54:40:19, 12.16s/it]
 57%|█████▋    | 21781/37963 [67:37:34<51:51:22, 11.54s/it]
 57%|█████▋    | 21782/37963 [67:37:51<58:24:17, 12.99s/it]
 57%|█████▋    | 21783/37963 [67:38:08<63:44:56, 14.18s/it]
 57%|█████▋    | 21784/37963 [67:38:18<58:18:17, 12.97s/it]
 57%|█████▋    | 21785/37963 [67:38:41<72:21:56, 16.10s/it]
 57%|█████▋    | 21786/37963 [67:38:51<64:18:22, 14.31s/it]
 57%|█████▋    | 21787/37963 [67:39:02<58:35:19, 13.04s/it]
 57%|█████▋    | 21788/37963 [67:39:12<54:36:44, 12.15s/it]
 57%|█████▋    | 21789/37963 [67:39:28<60:47:58, 13.53s/it]
 57%|█████▋    | 21790/37963 [67:39:39<56:16:37, 12.53s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '1.906', 'learning_rate': '8.102e-06', 'epoch': '0.574'}

 57%|█████▋    | 21790/37963 [67:39:39<56:16:37, 12.53s/it]
 57%|█████▋    | 21791/37963 [67:39:49<52:57:36, 11.79s/it]
 57%|█████▋    | 21792/37963 [67:39:59<50:40:22, 11.28s/it]
 57%|█████▋    | 21793/37963 [67:40:09<48:59:52, 10.91s/it]
 57%|█████▋    | 21794/37963 [67:40:19<47:39:33, 10.61s/it]
 57%|█████▋    | 21795/37963 [67:40:29<46:53:47, 10.44s/it]
 57%|█████▋    | 21796/37963 [67:40:39<46:23:19, 10.33s/it]
 57%|█████▋    | 21797/37963 [67:40:49<46:06:33, 10.27s/it]
 57%|█████▋    | 21798/37963 [67:40:59<45:45:11, 10.19s/it]
 57%|█████▋    | 21799/37963 [67:41:09<45:36:30, 10.16s/it]
 57%|█████▋    | 21800/37963 [67:41:26<54:49:54, 12.21s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '1.823', 'learning_rate': '8.094e-06', 'epoch': '0.5742'}

 57%|█████▋    | 21800/37963 [67:41:26<54:49:54, 12.21s/it]
 57%|█████▋    | 21801/37963 [67:41:36<51:28:55, 11.47s/it]
 57%|█████▋    | 21802/37963 [67:41:46<49:41:13, 11.07s/it]
 57%|█████▋    | 21803/37963 [67:41:56<47:57:09, 10.68s/it]
 57%|█████▋    | 21804/37963 [67:42:06<47:05:26, 10.49s/it]
 57%|█████▋    | 21805/37963 [67:42:16<46:34:01, 10.38s/it]
 57%|█████▋    | 21806/37963 [67:42:26<46:21:23, 10.33s/it]
 57%|█████▋    | 21807/37963 [67:42:36<45:32:36, 10.15s/it]
 57%|█████▋    | 21808/37963 [67:42:46<45:28:33, 10.13s/it]
 57%|█████▋    | 21809/37963 [67:43:02<53:37:36, 11.95s/it]
 57%|█████▋    | 21810/37963 [67:43:12<51:15:42, 11.42s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '2.604', 'learning_rate': '8.086e-06', 'epoch': '0.5745'}

 57%|█████▋    | 21810/37963 [67:43:12<51:15:42, 11.42s/it]
 57%|█████▋    | 21811/37963 [67:43:22<49:31:49, 11.04s/it]
 57%|█████▋    | 21812/37963 [67:43:32<48:14:13, 10.75s/it]
 57%|█████▋    | 21813/37963 [67:43:42<46:59:18, 10.47s/it]
 57%|█████▋    | 21814/37963 [67:43:52<46:31:22, 10.37s/it]
 57%|█████▋    | 21815/37963 [67:44:02<45:54:52, 10.24s/it]
 57%|█████▋    | 21816/37963 [67:44:12<45:11:09, 10.07s/it]
 57%|█████▋    | 21817/37963 [67:44:22<45:04:15, 10.05s/it]
 57%|█████▋    | 21818/37963 [67:44:32<44:51:23, 10.00s/it]
 57%|█████▋    | 21819/37963 [67:44:42<45:10:54, 10.08s/it]
 57%|█████▋    | 21820/37963 [67:44:52<45:11:35, 10.08s/it]
                                                           
{'loss': '0.1344', 'grad_norm': '1.62', 'learning_rate': '8.077e-06', 'epoch': '0.5748'}

 57%|█████▋    | 21820/37963 [67:44:52<45:11:35, 10.08s/it]
 57%|█████▋    | 21821/37963 [67:45:02<44:53:21, 10.01s/it]
 57%|█████▋    | 21822/37963 [67:45:12<44:53:46, 10.01s/it]
 57%|█████▋    | 21823/37963 [67:45:22<44:55:35, 10.02s/it]
 57%|█████▋    | 21824/37963 [67:45:32<44:50:48, 10.00s/it]
 57%|█████▋    | 21825/37963 [67:45:42<44:57:47, 10.03s/it]
 57%|█████▋    | 21826/37963 [67:45:52<45:16:35, 10.10s/it]
 57%|█████▋    | 21827/37963 [67:46:03<45:16:20, 10.10s/it]
 57%|█████▋    | 21828/37963 [67:46:12<44:55:01, 10.02s/it]
 58%|█████▊    | 21829/37963 [67:46:36<63:04:08, 14.07s/it]
 58%|█████▊    | 21830/37963 [67:46:46<57:42:44, 12.88s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '2.607', 'learning_rate': '8.069e-06', 'epoch': '0.575'}

 58%|█████▊    | 21830/37963 [67:46:46<57:42:44, 12.88s/it]
 58%|█████▊    | 21831/37963 [67:47:03<62:47:32, 14.01s/it]
 58%|█████▊    | 21832/37963 [67:47:13<57:34:26, 12.85s/it]
 58%|█████▊    | 21833/37963 [67:47:29<62:40:05, 13.99s/it]
 58%|█████▊    | 21834/37963 [67:47:40<57:24:10, 12.81s/it]
 58%|█████▊    | 21835/37963 [67:47:49<53:16:31, 11.89s/it]
 58%|█████▊    | 21836/37963 [67:48:06<60:11:49, 13.44s/it]
 58%|█████▊    | 21837/37963 [67:48:17<55:49:55, 12.46s/it]
 58%|█████▊    | 21838/37963 [67:48:27<52:39:48, 11.76s/it]
 58%|█████▊    | 21839/37963 [67:48:43<58:23:21, 13.04s/it]
 58%|█████▊    | 21840/37963 [67:48:53<54:28:13, 12.16s/it]
                                                           
{'loss': '0.1386', 'grad_norm': '2.262', 'learning_rate': '8.06e-06', 'epoch': '0.5753'}

 58%|█████▊    | 21840/37963 [67:48:53<54:28:13, 12.16s/it]
 58%|█████▊    | 21841/37963 [67:49:03<51:56:28, 11.60s/it]
 58%|█████▊    | 21842/37963 [67:49:13<49:55:20, 11.15s/it]
 58%|█████▊    | 21843/37963 [67:49:23<48:32:33, 10.84s/it]
 58%|█████▊    | 21844/37963 [67:49:33<47:32:29, 10.62s/it]
 58%|█████▊    | 21845/37963 [67:49:44<47:02:45, 10.51s/it]
 58%|█████▊    | 21846/37963 [67:49:54<46:49:54, 10.46s/it]
 58%|█████▊    | 21847/37963 [67:50:04<46:16:43, 10.34s/it]
 58%|█████▊    | 21848/37963 [67:50:21<55:02:32, 12.30s/it]
 58%|█████▊    | 21849/37963 [67:50:31<52:06:46, 11.64s/it]
 58%|█████▊    | 21850/37963 [67:50:41<49:51:02, 11.14s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '0.9522', 'learning_rate': '8.052e-06', 'epoch': '0.5756'}

 58%|█████▊    | 21850/37963 [67:50:41<49:51:02, 11.14s/it]
 58%|█████▊    | 21851/37963 [67:50:51<48:29:32, 10.83s/it]
 58%|█████▊    | 21852/37963 [67:51:01<47:28:56, 10.61s/it]
 58%|█████▊    | 21853/37963 [67:51:11<46:46:29, 10.45s/it]
 58%|█████▊    | 21854/37963 [67:51:21<46:21:16, 10.36s/it]
 58%|█████▊    | 21855/37963 [67:51:32<46:09:01, 10.31s/it]
 58%|█████▊    | 21856/37963 [67:51:42<45:51:47, 10.25s/it]
 58%|█████▊    | 21857/37963 [67:51:58<53:54:43, 12.05s/it]
 58%|█████▊    | 21858/37963 [67:52:08<51:09:27, 11.44s/it]
 58%|█████▊    | 21859/37963 [67:52:18<49:24:44, 11.05s/it]
 58%|█████▊    | 21860/37963 [67:52:28<48:07:51, 10.76s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '1.331', 'learning_rate': '8.044e-06', 'epoch': '0.5758'}

 58%|█████▊    | 21860/37963 [67:52:28<48:07:51, 10.76s/it]
 58%|█████▊    | 21861/37963 [67:52:38<47:13:53, 10.56s/it]
 58%|█████▊    | 21862/37963 [67:52:48<46:16:31, 10.35s/it]
 58%|█████▊    | 21863/37963 [67:52:58<46:02:19, 10.29s/it]
 58%|█████▊    | 21864/37963 [67:53:08<45:40:35, 10.21s/it]
 58%|█████▊    | 21865/37963 [67:53:18<45:28:04, 10.17s/it]
 58%|█████▊    | 21866/37963 [67:53:29<45:25:27, 10.16s/it]
 58%|█████▊    | 21867/37963 [67:53:39<45:21:30, 10.14s/it]
 58%|█████▊    | 21868/37963 [67:53:49<45:12:56, 10.11s/it]
 58%|█████▊    | 21869/37963 [67:53:59<45:14:20, 10.12s/it]
 58%|█████▊    | 21870/37963 [67:54:09<45:20:37, 10.14s/it]
                                                           
{'loss': '0.1371', 'grad_norm': '1.062', 'learning_rate': '8.035e-06', 'epoch': '0.5761'}

 58%|█████▊    | 21870/37963 [67:54:09<45:20:37, 10.14s/it]
 58%|█████▊    | 21871/37963 [67:54:19<45:19:54, 10.14s/it]
 58%|█████▊    | 21872/37963 [67:54:29<45:27:52, 10.17s/it]
 58%|█████▊    | 21873/37963 [67:54:40<45:26:24, 10.17s/it]
 58%|█████▊    | 21874/37963 [67:54:56<53:56:38, 12.07s/it]
 58%|█████▊    | 21875/37963 [67:55:06<51:25:42, 11.51s/it]
 58%|█████▊    | 21876/37963 [67:55:16<48:45:32, 10.91s/it]
 58%|█████▊    | 21877/37963 [67:55:26<47:36:33, 10.65s/it]
 58%|█████▊    | 21878/37963 [67:55:36<46:53:25, 10.49s/it]
 58%|█████▊    | 21879/37963 [67:55:46<46:15:51, 10.36s/it]
 58%|█████▊    | 21880/37963 [67:56:10<64:10:49, 14.37s/it]
                                                           
{'loss': '0.1343', 'grad_norm': '2.05', 'learning_rate': '8.027e-06', 'epoch': '0.5764'}

 58%|█████▊    | 21880/37963 [67:56:10<64:10:49, 14.37s/it]
 58%|█████▊    | 21881/37963 [67:56:26<67:07:56, 15.03s/it]
 58%|█████▊    | 21882/37963 [67:56:36<60:32:46, 13.55s/it]
 58%|█████▊    | 21883/37963 [67:56:46<55:38:36, 12.46s/it]
 58%|█████▊    | 21884/37963 [67:56:56<52:33:15, 11.77s/it]
 58%|█████▊    | 21885/37963 [67:57:14<60:02:20, 13.44s/it]
 58%|█████▊    | 21886/37963 [67:57:24<55:40:49, 12.47s/it]
 58%|█████▊    | 21887/37963 [67:57:40<60:35:22, 13.57s/it]
 58%|█████▊    | 21888/37963 [67:57:50<56:03:54, 12.56s/it]
 58%|█████▊    | 21889/37963 [67:58:00<52:42:21, 11.80s/it]
 58%|█████▊    | 21890/37963 [67:58:11<50:25:26, 11.29s/it]
                                                           
{'loss': '0.153', 'grad_norm': '2.475', 'learning_rate': '8.019e-06', 'epoch': '0.5766'}

 58%|█████▊    | 21890/37963 [67:58:11<50:25:26, 11.29s/it]
 58%|█████▊    | 21891/37963 [67:58:21<49:00:46, 10.98s/it]
 58%|█████▊    | 21892/37963 [67:58:31<47:49:48, 10.71s/it]
 58%|█████▊    | 21893/37963 [67:58:41<47:04:25, 10.55s/it]
 58%|█████▊    | 21894/37963 [67:58:51<46:41:37, 10.46s/it]
 58%|█████▊    | 21895/37963 [67:59:08<55:11:02, 12.36s/it]
 58%|█████▊    | 21896/37963 [67:59:18<52:21:50, 11.73s/it]
 58%|█████▊    | 21897/37963 [67:59:29<50:28:30, 11.31s/it]
 58%|█████▊    | 21898/37963 [67:59:39<48:51:40, 10.95s/it]
 58%|█████▊    | 21899/37963 [67:59:49<47:41:34, 10.69s/it]
 58%|█████▊    | 21900/37963 [67:59:59<46:53:07, 10.51s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '1.128', 'learning_rate': '8.01e-06', 'epoch': '0.5769'}

 58%|█████▊    | 21900/37963 [67:59:59<46:53:07, 10.51s/it]
 58%|█████▊    | 21901/37963 [68:00:09<46:15:48, 10.37s/it]
 58%|█████▊    | 21902/37963 [68:00:19<45:49:35, 10.27s/it]
 58%|█████▊    | 21903/37963 [68:00:29<45:37:53, 10.23s/it]
 58%|█████▊    | 21904/37963 [68:00:39<45:23:14, 10.17s/it]
 58%|█████▊    | 21905/37963 [68:00:49<45:24:54, 10.18s/it]
 58%|█████▊    | 21906/37963 [68:01:06<54:00:03, 12.11s/it]
 58%|█████▊    | 21907/37963 [68:01:16<51:41:23, 11.59s/it]
 58%|█████▊    | 21908/37963 [68:01:26<49:41:11, 11.14s/it]
 58%|█████▊    | 21909/37963 [68:01:37<48:18:23, 10.83s/it]
 58%|█████▊    | 21910/37963 [68:01:47<47:28:01, 10.64s/it]
                                                           
{'loss': '0.1393', 'grad_norm': '2.002', 'learning_rate': '8.002e-06', 'epoch': '0.5771'}

 58%|█████▊    | 21910/37963 [68:01:47<47:28:01, 10.64s/it]
 58%|█████▊    | 21911/37963 [68:01:57<46:41:43, 10.47s/it]
 58%|█████▊    | 21912/37963 [68:02:07<46:10:43, 10.36s/it]
 58%|█████▊    | 21913/37963 [68:02:17<45:53:02, 10.29s/it]
 58%|█████▊    | 21914/37963 [68:02:27<45:32:06, 10.21s/it]
 58%|█████▊    | 21915/37963 [68:02:37<45:22:54, 10.18s/it]
 58%|█████▊    | 21916/37963 [68:02:47<45:20:20, 10.17s/it]
 58%|█████▊    | 21917/37963 [68:02:57<45:08:51, 10.13s/it]
 58%|█████▊    | 21918/37963 [68:03:07<44:47:57, 10.05s/it]
 58%|█████▊    | 21919/37963 [68:03:17<44:37:39, 10.01s/it]
 58%|█████▊    | 21920/37963 [68:03:27<44:43:27, 10.04s/it]
                                                           
{'loss': '0.1368', 'grad_norm': '2.428', 'learning_rate': '7.993e-06', 'epoch': '0.5774'}

 58%|█████▊    | 21920/37963 [68:03:27<44:43:27, 10.04s/it]
 58%|█████▊    | 21921/37963 [68:03:44<54:10:42, 12.16s/it]
 58%|█████▊    | 21922/37963 [68:03:55<51:37:05, 11.58s/it]
 58%|█████▊    | 21923/37963 [68:04:05<49:45:50, 11.17s/it]
 58%|█████▊    | 21924/37963 [68:04:15<48:40:48, 10.93s/it]
 58%|█████▊    | 21925/37963 [68:04:25<47:19:56, 10.62s/it]
 58%|█████▊    | 21926/37963 [68:04:35<46:17:20, 10.39s/it]
 58%|█████▊    | 21927/37963 [68:04:45<45:52:30, 10.30s/it]
 58%|█████▊    | 21928/37963 [68:05:08<63:14:27, 14.20s/it]
 58%|█████▊    | 21929/37963 [68:05:18<57:34:06, 12.93s/it]
 58%|█████▊    | 21930/37963 [68:05:34<61:41:20, 13.85s/it]
                                                           
{'loss': '0.1304', 'grad_norm': '1.761', 'learning_rate': '7.985e-06', 'epoch': '0.5777'}

 58%|█████▊    | 21930/37963 [68:05:34<61:41:20, 13.85s/it]
 58%|█████▊    | 21931/37963 [68:05:44<56:04:50, 12.59s/it]
 58%|█████▊    | 21932/37963 [68:05:54<52:03:46, 11.69s/it]
 58%|█████▊    | 21933/37963 [68:06:11<59:33:33, 13.38s/it]
 58%|█████▊    | 21934/37963 [68:06:21<55:27:12, 12.45s/it]
 58%|█████▊    | 21935/37963 [68:06:31<52:30:26, 11.79s/it]
 58%|█████▊    | 21936/37963 [68:06:48<58:48:15, 13.21s/it]
 58%|█████▊    | 21937/37963 [68:06:58<54:32:45, 12.25s/it]
 58%|█████▊    | 21938/37963 [68:07:08<51:36:44, 11.59s/it]
 58%|█████▊    | 21939/37963 [68:07:18<49:33:16, 11.13s/it]
 58%|█████▊    | 21940/37963 [68:07:28<47:42:59, 10.72s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '0.9972', 'learning_rate': '7.977e-06', 'epoch': '0.5779'}

 58%|█████▊    | 21940/37963 [68:07:28<47:42:59, 10.72s/it]
 58%|█████▊    | 21941/37963 [68:07:38<47:00:13, 10.56s/it]
 58%|█████▊    | 21942/37963 [68:07:48<46:05:30, 10.36s/it]
 58%|█████▊    | 21943/37963 [68:08:05<55:03:40, 12.37s/it]
 58%|█████▊    | 21944/37963 [68:08:15<52:17:45, 11.75s/it]
 58%|█████▊    | 21945/37963 [68:08:25<49:35:07, 11.14s/it]
 58%|█████▊    | 21946/37963 [68:08:35<48:06:48, 10.81s/it]
 58%|█████▊    | 21947/37963 [68:08:45<47:04:37, 10.58s/it]
 58%|█████▊    | 21948/37963 [68:08:55<46:13:01, 10.39s/it]
 58%|█████▊    | 21949/37963 [68:09:05<45:48:17, 10.30s/it]
 58%|█████▊    | 21950/37963 [68:09:15<45:03:03, 10.13s/it]
                                                           
{'loss': '0.1301', 'grad_norm': '1.2', 'learning_rate': '7.968e-06', 'epoch': '0.5782'}

 58%|█████▊    | 21950/37963 [68:09:15<45:03:03, 10.13s/it]
 58%|█████▊    | 21951/37963 [68:09:25<44:58:33, 10.11s/it]
 58%|█████▊    | 21952/37963 [68:09:35<45:13:09, 10.17s/it]
 58%|█████▊    | 21953/37963 [68:09:52<53:40:17, 12.07s/it]
 58%|█████▊    | 21954/37963 [68:10:02<50:50:17, 11.43s/it]
 58%|█████▊    | 21955/37963 [68:10:12<49:08:15, 11.05s/it]
 58%|█████▊    | 21956/37963 [68:10:22<47:57:36, 10.79s/it]
 58%|█████▊    | 21957/37963 [68:10:32<46:55:55, 10.56s/it]
 58%|█████▊    | 21958/37963 [68:10:42<46:18:21, 10.42s/it]
 58%|█████▊    | 21959/37963 [68:10:52<45:49:53, 10.31s/it]
 58%|█████▊    | 21960/37963 [68:11:02<45:11:54, 10.17s/it]
                                                           
{'loss': '0.1398', 'grad_norm': '3.404', 'learning_rate': '7.96e-06', 'epoch': '0.5785'}

 58%|█████▊    | 21960/37963 [68:11:02<45:11:54, 10.17s/it]
 58%|█████▊    | 21961/37963 [68:11:12<45:07:50, 10.15s/it]
 58%|█████▊    | 21962/37963 [68:11:22<45:10:09, 10.16s/it]
 58%|█████▊    | 21963/37963 [68:11:32<45:06:46, 10.15s/it]
 58%|█████▊    | 21964/37963 [68:11:43<45:16:56, 10.19s/it]
 58%|█████▊    | 21965/37963 [68:11:53<45:17:16, 10.19s/it]
 58%|█████▊    | 21966/37963 [68:12:03<45:15:00, 10.18s/it]
 58%|█████▊    | 21967/37963 [68:12:13<44:25:53, 10.00s/it]
 58%|█████▊    | 21968/37963 [68:12:23<44:29:23, 10.01s/it]
 58%|█████▊    | 21969/37963 [68:12:33<44:36:15, 10.04s/it]
 58%|█████▊    | 21970/37963 [68:12:43<44:42:58, 10.07s/it]
                                                           
{'loss': '0.1425', 'grad_norm': '1.226', 'learning_rate': '7.952e-06', 'epoch': '0.5787'}

 58%|█████▊    | 21970/37963 [68:12:43<44:42:58, 10.07s/it]
 58%|█████▊    | 21971/37963 [68:12:53<45:03:22, 10.14s/it]
 58%|█████▊    | 21972/37963 [68:13:10<54:20:30, 12.23s/it]
 58%|█████▊    | 21973/37963 [68:13:21<51:36:32, 11.62s/it]
 58%|█████▊    | 21974/37963 [68:13:31<49:43:41, 11.20s/it]
 58%|█████▊    | 21975/37963 [68:13:47<56:42:04, 12.77s/it]
 58%|█████▊    | 21976/37963 [68:14:04<61:30:21, 13.85s/it]
 58%|█████▊    | 21977/37963 [68:14:14<56:27:56, 12.72s/it]
 58%|█████▊    | 21978/37963 [68:14:30<60:56:29, 13.72s/it]
 58%|█████▊    | 21979/37963 [68:14:40<56:05:43, 12.63s/it]
 58%|█████▊    | 21980/37963 [68:14:50<52:19:11, 11.78s/it]
                                                           
{'loss': '0.1414', 'grad_norm': '2.426', 'learning_rate': '7.943e-06', 'epoch': '0.579'}

 58%|█████▊    | 21980/37963 [68:14:50<52:19:11, 11.78s/it]
 58%|█████▊    | 21981/37963 [68:15:06<59:00:06, 13.29s/it]
 58%|█████▊    | 21982/37963 [68:15:16<54:40:21, 12.32s/it]
 58%|█████▊    | 21983/37963 [68:15:26<51:30:05, 11.60s/it]
 58%|█████▊    | 21984/37963 [68:15:36<48:49:44, 11.00s/it]
 58%|█████▊    | 21985/37963 [68:15:52<55:59:09, 12.61s/it]
 58%|█████▊    | 21986/37963 [68:16:02<52:35:10, 11.85s/it]
 58%|█████▊    | 21987/37963 [68:16:12<50:14:07, 11.32s/it]
 58%|█████▊    | 21988/37963 [68:16:23<48:55:58, 11.03s/it]
 58%|█████▊    | 21989/37963 [68:16:33<47:34:45, 10.72s/it]
 58%|█████▊    | 21990/37963 [68:16:50<56:02:51, 12.63s/it]
                                                           
{'loss': '0.1369', 'grad_norm': '2.168', 'learning_rate': '7.935e-06', 'epoch': '0.5793'}

 58%|█████▊    | 21990/37963 [68:16:50<56:02:51, 12.63s/it]
 58%|█████▊    | 21991/37963 [68:17:00<53:00:22, 11.95s/it]
 58%|█████▊    | 21992/37963 [68:17:10<50:38:25, 11.41s/it]
 58%|█████▊    | 21993/37963 [68:17:21<48:59:02, 11.04s/it]
 58%|█████▊    | 21994/37963 [68:17:31<47:36:54, 10.73s/it]
 58%|█████▊    | 21995/37963 [68:17:41<46:46:57, 10.55s/it]
 58%|█████▊    | 21996/37963 [68:17:51<46:06:40, 10.40s/it]
 58%|█████▊    | 21997/37963 [68:18:01<45:41:41, 10.30s/it]
 58%|█████▊    | 21998/37963 [68:18:11<45:23:47, 10.24s/it]
 58%|█████▊    | 21999/37963 [68:18:21<45:24:46, 10.24s/it]
 58%|█████▊    | 22000/37963 [68:18:31<45:13:19, 10.20s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '1.757', 'learning_rate': '7.927e-06', 'epoch': '0.5795'}

 58%|█████▊    | 22000/37963 [68:18:31<45:13:19, 10.20s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.46s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.46s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 58%|█████▊    | 22001/37963 [68:19:29<108:51:40, 24.55s/it]
 58%|█████▊    | 22002/37963 [68:19:46<98:38:06, 22.25s/it] 
 58%|█████▊    | 22003/37963 [68:19:57<83:38:56, 18.87s/it]
 58%|█████▊    | 22004/37963 [68:20:08<73:12:45, 16.52s/it]
 58%|█████▊    | 22005/37963 [68:20:18<64:12:24, 14.48s/it]
 58%|█████▊    | 22006/37963 [68:20:28<58:29:38, 13.20s/it]
 58%|█████▊    | 22007/37963 [68:20:38<54:18:56, 12.25s/it]
 58%|█████▊    | 22008/37963 [68:20:48<51:37:14, 11.65s/it]
 58%|█████▊    | 22009/37963 [68:20:59<49:32:27, 11.18s/it]
 58%|█████▊    | 22010/37963 [68:21:09<48:14:54, 10.89s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '2.042', 'learning_rate': '7.918e-06', 'epoch': '0.5798'}

 58%|█████▊    | 22010/37963 [68:21:09<48:14:54, 10.89s/it]
 58%|█████▊    | 22011/37963 [68:21:19<47:06:40, 10.63s/it]
 58%|█████▊    | 22012/37963 [68:21:29<46:17:29, 10.45s/it]
 58%|█████▊    | 22013/37963 [68:21:39<45:35:47, 10.29s/it]
 58%|█████▊    | 22014/37963 [68:21:49<45:18:05, 10.23s/it]
 58%|█████▊    | 22015/37963 [68:21:59<45:04:24, 10.17s/it]
 58%|█████▊    | 22016/37963 [68:22:09<44:57:43, 10.15s/it]
 58%|█████▊    | 22017/37963 [68:22:19<44:57:22, 10.15s/it]
 58%|█████▊    | 22018/37963 [68:22:29<44:53:20, 10.13s/it]
 58%|█████▊    | 22019/37963 [68:22:39<44:52:58, 10.13s/it]
 58%|█████▊    | 22020/37963 [68:22:49<44:20:21, 10.01s/it]
                                                           
{'loss': '0.1417', 'grad_norm': '3.35', 'learning_rate': '7.91e-06', 'epoch': '0.58'}

 58%|█████▊    | 22020/37963 [68:22:49<44:20:21, 10.01s/it]
 58%|█████▊    | 22021/37963 [68:23:06<53:14:39, 12.02s/it]
 58%|█████▊    | 22022/37963 [68:23:16<51:03:17, 11.53s/it]
 58%|█████▊    | 22023/37963 [68:23:26<49:07:00, 11.09s/it]
 58%|█████▊    | 22024/37963 [68:23:43<56:49:41, 12.84s/it]
 58%|█████▊    | 22025/37963 [68:23:59<61:28:49, 13.89s/it]
 58%|█████▊    | 22026/37963 [68:24:10<56:26:52, 12.75s/it]
 58%|█████▊    | 22027/37963 [68:24:26<61:30:10, 13.89s/it]
 58%|█████▊    | 22028/37963 [68:24:36<56:27:00, 12.75s/it]
 58%|█████▊    | 22029/37963 [68:24:54<62:29:03, 14.12s/it]
 58%|█████▊    | 22030/37963 [68:25:04<57:05:58, 12.90s/it]
                                                           
{'loss': '0.1345', 'grad_norm': '1.394', 'learning_rate': '7.902e-06', 'epoch': '0.5803'}

 58%|█████▊    | 22030/37963 [68:25:04<57:05:58, 12.90s/it]
 58%|█████▊    | 22031/37963 [68:25:20<61:55:43, 13.99s/it]
 58%|█████▊    | 22032/37963 [68:25:30<56:48:33, 12.84s/it]
 58%|█████▊    | 22033/37963 [68:25:40<53:10:24, 12.02s/it]
 58%|█████▊    | 22034/37963 [68:25:51<50:40:07, 11.45s/it]
 58%|█████▊    | 22035/37963 [68:26:00<48:32:44, 10.97s/it]
 58%|█████▊    | 22036/37963 [68:26:10<47:22:34, 10.71s/it]
 58%|█████▊    | 22037/37963 [68:26:21<46:29:54, 10.51s/it]
 58%|█████▊    | 22038/37963 [68:26:30<45:26:50, 10.27s/it]
 58%|█████▊    | 22039/37963 [68:26:47<54:06:56, 12.23s/it]
 58%|█████▊    | 22040/37963 [68:26:57<51:26:30, 11.63s/it]
                                                           
{'loss': '0.1436', 'grad_norm': '1.521', 'learning_rate': '7.893e-06', 'epoch': '0.5806'}

 58%|█████▊    | 22040/37963 [68:26:57<51:26:30, 11.63s/it]
 58%|█████▊    | 22041/37963 [68:27:07<49:22:44, 11.16s/it]
 58%|█████▊    | 22042/37963 [68:27:17<47:56:35, 10.84s/it]
 58%|█████▊    | 22043/37963 [68:27:28<47:05:11, 10.65s/it]
 58%|█████▊    | 22044/37963 [68:27:38<46:23:51, 10.49s/it]
 58%|█████▊    | 22045/37963 [68:27:48<45:50:43, 10.37s/it]
 58%|█████▊    | 22046/37963 [68:27:58<45:46:03, 10.35s/it]
 58%|█████▊    | 22047/37963 [68:28:08<45:26:13, 10.28s/it]
 58%|█████▊    | 22048/37963 [68:28:18<45:00:00, 10.18s/it]
 58%|█████▊    | 22049/37963 [68:28:34<52:55:34, 11.97s/it]
 58%|█████▊    | 22050/37963 [68:28:44<50:06:31, 11.34s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '2.155', 'learning_rate': '7.885e-06', 'epoch': '0.5808'}

 58%|█████▊    | 22050/37963 [68:28:44<50:06:31, 11.34s/it]
 58%|█████▊    | 22051/37963 [68:28:54<47:47:37, 10.81s/it]
 58%|█████▊    | 22052/37963 [68:29:04<47:06:40, 10.66s/it]
 58%|█████▊    | 22053/37963 [68:29:14<46:20:24, 10.49s/it]
 58%|█████▊    | 22054/37963 [68:29:24<45:46:40, 10.36s/it]
 58%|█████▊    | 22055/37963 [68:29:34<45:23:03, 10.27s/it]
 58%|█████▊    | 22056/37963 [68:29:44<44:40:03, 10.11s/it]
 58%|█████▊    | 22057/37963 [68:29:54<44:41:41, 10.12s/it]
 58%|█████▊    | 22058/37963 [68:30:04<44:43:27, 10.12s/it]
 58%|█████▊    | 22059/37963 [68:30:14<44:34:21, 10.09s/it]
 58%|█████▊    | 22060/37963 [68:30:24<44:36:40, 10.10s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '2.326', 'learning_rate': '7.877e-06', 'epoch': '0.5811'}

 58%|█████▊    | 22060/37963 [68:30:24<44:36:40, 10.10s/it]
 58%|█████▊    | 22061/37963 [68:30:34<44:32:27, 10.08s/it]
 58%|█████▊    | 22062/37963 [68:30:45<44:37:23, 10.10s/it]
 58%|█████▊    | 22063/37963 [68:30:55<44:43:53, 10.13s/it]
 58%|█████▊    | 22064/37963 [68:31:05<44:39:50, 10.11s/it]
 58%|█████▊    | 22065/37963 [68:31:15<44:38:45, 10.11s/it]
 58%|█████▊    | 22066/37963 [68:31:25<44:10:57, 10.01s/it]
 58%|█████▊    | 22067/37963 [68:31:35<44:18:12, 10.03s/it]
 58%|█████▊    | 22068/37963 [68:31:45<43:56:44,  9.95s/it]
 58%|█████▊    | 22069/37963 [68:31:55<43:55:27,  9.95s/it]
 58%|█████▊    | 22070/37963 [68:32:05<44:12:38, 10.01s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '1.366', 'learning_rate': '7.868e-06', 'epoch': '0.5814'}

 58%|█████▊    | 22070/37963 [68:32:05<44:12:38, 10.01s/it]
 58%|█████▊    | 22071/37963 [68:32:22<53:19:00, 12.08s/it]
 58%|█████▊    | 22072/37963 [68:32:39<59:42:35, 13.53s/it]
 58%|█████▊    | 22073/37963 [68:32:55<63:32:21, 14.40s/it]
 58%|█████▊    | 22074/37963 [68:33:11<65:57:52, 14.95s/it]
 58%|█████▊    | 22075/37963 [68:33:22<59:52:19, 13.57s/it]
 58%|█████▊    | 22076/37963 [68:33:32<55:22:52, 12.55s/it]
 58%|█████▊    | 22077/37963 [68:33:42<52:03:28, 11.80s/it]
 58%|█████▊    | 22078/37963 [68:34:05<67:17:24, 15.25s/it]
 58%|█████▊    | 22079/37963 [68:34:15<60:32:38, 13.72s/it]
 58%|█████▊    | 22080/37963 [68:34:25<55:59:17, 12.69s/it]
                                                           
{'loss': '0.1396', 'grad_norm': '1.281', 'learning_rate': '7.86e-06', 'epoch': '0.5816'}

 58%|█████▊    | 22080/37963 [68:34:26<55:59:17, 12.69s/it]
 58%|█████▊    | 22081/37963 [68:34:36<52:37:45, 11.93s/it]
 58%|█████▊    | 22082/37963 [68:34:46<49:53:29, 11.31s/it]
 58%|█████▊    | 22083/37963 [68:34:56<48:17:51, 10.95s/it]
 58%|█████▊    | 22084/37963 [68:35:06<47:08:40, 10.69s/it]
 58%|█████▊    | 22085/37963 [68:35:16<46:10:36, 10.47s/it]
 58%|█████▊    | 22086/37963 [68:35:26<45:45:41, 10.38s/it]
 58%|█████▊    | 22087/37963 [68:35:36<45:35:07, 10.34s/it]
 58%|█████▊    | 22088/37963 [68:35:52<53:37:27, 12.16s/it]
 58%|█████▊    | 22089/37963 [68:36:02<50:23:48, 11.43s/it]
 58%|█████▊    | 22090/37963 [68:36:12<48:44:36, 11.06s/it]
                                                           
{'loss': '0.1429', 'grad_norm': '1.327', 'learning_rate': '7.852e-06', 'epoch': '0.5819'}

 58%|█████▊    | 22090/37963 [68:36:12<48:44:36, 11.06s/it]
 58%|█████▊    | 22091/37963 [68:36:22<47:21:27, 10.74s/it]
 58%|█████▊    | 22092/37963 [68:36:33<46:31:18, 10.55s/it]
 58%|█████▊    | 22093/37963 [68:36:42<45:43:49, 10.37s/it]
 58%|█████▊    | 22094/37963 [68:36:53<45:21:10, 10.29s/it]
 58%|█████▊    | 22095/37963 [68:37:03<44:54:15, 10.19s/it]
 58%|█████▊    | 22096/37963 [68:37:13<44:51:26, 10.18s/it]
 58%|█████▊    | 22097/37963 [68:37:29<52:42:43, 11.96s/it]
 58%|█████▊    | 22098/37963 [68:37:39<50:17:01, 11.41s/it]
 58%|█████▊    | 22099/37963 [68:37:49<48:20:58, 10.97s/it]
 58%|█████▊    | 22100/37963 [68:37:59<47:01:56, 10.67s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '3.026', 'learning_rate': '7.843e-06', 'epoch': '0.5821'}

 58%|█████▊    | 22100/37963 [68:37:59<47:01:56, 10.67s/it]
 58%|█████▊    | 22101/37963 [68:38:09<46:11:52, 10.48s/it]
 58%|█████▊    | 22102/37963 [68:38:19<45:37:40, 10.36s/it]
 58%|█████▊    | 22103/37963 [68:38:29<45:21:36, 10.30s/it]
 58%|█████▊    | 22104/37963 [68:38:39<45:16:07, 10.28s/it]
 58%|█████▊    | 22105/37963 [68:38:49<44:55:20, 10.20s/it]
 58%|█████▊    | 22106/37963 [68:38:59<44:46:18, 10.16s/it]
 58%|█████▊    | 22107/37963 [68:39:09<44:18:49, 10.06s/it]
 58%|█████▊    | 22108/37963 [68:39:19<44:21:59, 10.07s/it]
 58%|█████▊    | 22109/37963 [68:39:29<44:11:58, 10.04s/it]
 58%|█████▊    | 22110/37963 [68:39:39<43:49:49,  9.95s/it]
                                                           
{'loss': '0.1361', 'grad_norm': '0.9007', 'learning_rate': '7.835e-06', 'epoch': '0.5824'}

 58%|█████▊    | 22110/37963 [68:39:39<43:49:49,  9.95s/it]
 58%|█████▊    | 22111/37963 [68:39:49<44:00:35,  9.99s/it]
 58%|█████▊    | 22112/37963 [68:40:00<44:30:04, 10.11s/it]
 58%|█████▊    | 22113/37963 [68:40:09<44:01:45, 10.00s/it]
 58%|█████▊    | 22114/37963 [68:40:19<44:09:34, 10.03s/it]
 58%|█████▊    | 22115/37963 [68:40:30<44:23:56, 10.09s/it]
 58%|█████▊    | 22116/37963 [68:40:40<44:23:14, 10.08s/it]
 58%|█████▊    | 22117/37963 [68:40:50<44:09:41, 10.03s/it]
 58%|█████▊    | 22118/37963 [68:41:00<44:12:43, 10.05s/it]
 58%|█████▊    | 22119/37963 [68:41:17<53:42:23, 12.20s/it]
 58%|█████▊    | 22120/37963 [68:41:33<59:29:47, 13.52s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '2.007', 'learning_rate': '7.827e-06', 'epoch': '0.5827'}

 58%|█████▊    | 22120/37963 [68:41:33<59:29:47, 13.52s/it]
 58%|█████▊    | 22121/37963 [68:41:51<64:27:31, 14.65s/it]
 58%|█████▊    | 22122/37963 [68:42:01<58:19:59, 13.26s/it]
 58%|█████▊    | 22123/37963 [68:42:17<62:54:12, 14.30s/it]
 58%|█████▊    | 22124/37963 [68:42:28<57:20:27, 13.03s/it]
 58%|█████▊    | 22125/37963 [68:42:38<53:32:07, 12.17s/it]
 58%|█████▊    | 22126/37963 [68:42:48<50:45:43, 11.54s/it]
 58%|█████▊    | 22127/37963 [68:43:11<66:44:11, 15.17s/it]
 58%|█████▊    | 22128/37963 [68:43:21<59:50:11, 13.60s/it]
 58%|█████▊    | 22129/37963 [68:43:31<54:46:38, 12.45s/it]
 58%|█████▊    | 22130/37963 [68:43:41<51:42:16, 11.76s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '1.273', 'learning_rate': '7.818e-06', 'epoch': '0.5829'}

 58%|█████▊    | 22130/37963 [68:43:41<51:42:16, 11.76s/it]
 58%|█████▊    | 22131/37963 [68:43:51<49:31:38, 11.26s/it]
 58%|█████▊    | 22132/37963 [68:44:01<47:31:11, 10.81s/it]
 58%|█████▊    | 22133/37963 [68:44:11<46:15:16, 10.52s/it]
 58%|█████▊    | 22134/37963 [68:44:21<45:48:33, 10.42s/it]
 58%|█████▊    | 22135/37963 [68:44:31<44:49:13, 10.19s/it]
 58%|█████▊    | 22136/37963 [68:44:41<44:45:58, 10.18s/it]
 58%|█████▊    | 22137/37963 [68:44:58<53:39:04, 12.20s/it]
 58%|█████▊    | 22138/37963 [68:45:08<50:50:34, 11.57s/it]
 58%|█████▊    | 22139/37963 [68:45:18<48:54:35, 11.13s/it]
 58%|█████▊    | 22140/37963 [68:45:28<47:36:09, 10.83s/it]
                                                           
{'loss': '0.1412', 'grad_norm': '1.978', 'learning_rate': '7.81e-06', 'epoch': '0.5832'}

 58%|█████▊    | 22140/37963 [68:45:28<47:36:09, 10.83s/it]
 58%|█████▊    | 22141/37963 [68:45:38<46:38:53, 10.61s/it]
 58%|█████▊    | 22142/37963 [68:45:49<46:05:14, 10.49s/it]
 58%|█████▊    | 22143/37963 [68:45:59<45:37:19, 10.38s/it]
 58%|█████▊    | 22144/37963 [68:46:09<45:20:18, 10.32s/it]
 58%|█████▊    | 22145/37963 [68:46:19<45:02:41, 10.25s/it]
 58%|█████▊    | 22146/37963 [68:46:35<52:48:06, 12.02s/it]
 58%|█████▊    | 22147/37963 [68:46:45<49:30:54, 11.27s/it]
 58%|█████▊    | 22148/37963 [68:46:55<47:54:08, 10.90s/it]
 58%|█████▊    | 22149/37963 [68:47:05<46:51:14, 10.67s/it]
 58%|█████▊    | 22150/37963 [68:47:15<46:07:44, 10.50s/it]
                                                           
{'loss': '0.1461', 'grad_norm': '2.337', 'learning_rate': '7.802e-06', 'epoch': '0.5835'}

 58%|█████▊    | 22150/37963 [68:47:15<46:07:44, 10.50s/it]
 58%|█████▊    | 22151/37963 [68:47:25<45:42:27, 10.41s/it]
 58%|█████▊    | 22152/37963 [68:47:35<45:14:26, 10.30s/it]
 58%|█████▊    | 22153/37963 [68:47:45<44:59:58, 10.25s/it]
 58%|█████▊    | 22154/37963 [68:47:55<44:40:30, 10.17s/it]
 58%|█████▊    | 22155/37963 [68:48:05<44:42:58, 10.18s/it]
 58%|█████▊    | 22156/37963 [68:48:16<44:51:13, 10.22s/it]
 58%|█████▊    | 22157/37963 [68:48:26<44:53:22, 10.22s/it]
 58%|█████▊    | 22158/37963 [68:48:36<44:42:35, 10.18s/it]
 58%|█████▊    | 22159/37963 [68:48:46<44:27:10, 10.13s/it]
 58%|█████▊    | 22160/37963 [68:48:56<44:24:38, 10.12s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '1.957', 'learning_rate': '7.793e-06', 'epoch': '0.5837'}

 58%|█████▊    | 22160/37963 [68:48:56<44:24:38, 10.12s/it]
 58%|█████▊    | 22161/37963 [68:49:06<44:06:42, 10.05s/it]
 58%|█████▊    | 22162/37963 [68:49:16<44:01:14, 10.03s/it]
 58%|█████▊    | 22163/37963 [68:49:26<44:14:51, 10.08s/it]
 58%|█████▊    | 22164/37963 [68:49:36<44:02:11, 10.03s/it]
 58%|█████▊    | 22165/37963 [68:49:46<44:14:56, 10.08s/it]
 58%|█████▊    | 22166/37963 [68:49:56<44:16:09, 10.09s/it]
 58%|█████▊    | 22167/37963 [68:50:13<53:16:55, 12.14s/it]
 58%|█████▊    | 22168/37963 [68:50:23<50:34:31, 11.53s/it]
 58%|█████▊    | 22169/37963 [68:50:40<57:46:19, 13.17s/it]
 58%|█████▊    | 22170/37963 [68:50:57<62:19:32, 14.21s/it]
                                                           
{'loss': '0.136', 'grad_norm': '2.094', 'learning_rate': '7.785e-06', 'epoch': '0.584'}

 58%|█████▊    | 22170/37963 [68:50:57<62:19:32, 14.21s/it]
 58%|█████▊    | 22171/37963 [68:51:07<56:54:38, 12.97s/it]
 58%|█████▊    | 22172/37963 [68:51:17<52:55:23, 12.07s/it]
 58%|█████▊    | 22173/37963 [68:51:34<58:52:47, 13.42s/it]
 58%|█████▊    | 22174/37963 [68:51:44<54:10:14, 12.35s/it]
 58%|█████▊    | 22175/37963 [68:52:01<60:33:01, 13.81s/it]
 58%|█████▊    | 22176/37963 [68:52:11<55:39:59, 12.69s/it]
 58%|█████▊    | 22177/37963 [68:52:21<52:39:51, 12.01s/it]
 58%|█████▊    | 22178/37963 [68:52:32<50:24:00, 11.49s/it]
 58%|█████▊    | 22179/37963 [68:52:42<48:48:29, 11.13s/it]
 58%|█████▊    | 22180/37963 [68:52:52<47:26:15, 10.82s/it]
                                                           
{'loss': '0.1323', 'grad_norm': '3.259', 'learning_rate': '7.777e-06', 'epoch': '0.5843'}

 58%|█████▊    | 22180/37963 [68:52:52<47:26:15, 10.82s/it]
 58%|█████▊    | 22181/37963 [68:53:02<46:26:34, 10.59s/it]
 58%|█████▊    | 22182/37963 [68:53:12<45:39:32, 10.42s/it]
 58%|█████▊    | 22183/37963 [68:53:22<45:17:51, 10.33s/it]
 58%|█████▊    | 22184/37963 [68:53:32<45:01:05, 10.27s/it]
 58%|█████▊    | 22185/37963 [68:53:50<54:47:18, 12.50s/it]
 58%|█████▊    | 22186/37963 [68:54:00<50:52:37, 11.61s/it]
 58%|█████▊    | 22187/37963 [68:54:09<48:36:58, 11.09s/it]
 58%|█████▊    | 22188/37963 [68:54:20<47:18:10, 10.79s/it]
 58%|█████▊    | 22189/37963 [68:54:30<46:23:40, 10.59s/it]
 58%|█████▊    | 22190/37963 [68:54:40<45:41:00, 10.43s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.512', 'learning_rate': '7.768e-06', 'epoch': '0.5845'}

 58%|█████▊    | 22190/37963 [68:54:40<45:41:00, 10.43s/it]
 58%|█████▊    | 22191/37963 [68:54:50<45:12:33, 10.32s/it]
 58%|█████▊    | 22192/37963 [68:55:00<44:54:06, 10.25s/it]
 58%|█████▊    | 22193/37963 [68:55:10<44:32:53, 10.17s/it]
 58%|█████▊    | 22194/37963 [68:55:20<44:27:41, 10.15s/it]
 58%|█████▊    | 22195/37963 [68:55:36<52:27:15, 11.98s/it]
 58%|█████▊    | 22196/37963 [68:55:46<50:08:34, 11.45s/it]
 58%|█████▊    | 22197/37963 [68:55:56<48:21:04, 11.04s/it]
 58%|█████▊    | 22198/37963 [68:56:07<47:13:56, 10.79s/it]
 58%|█████▊    | 22199/37963 [68:56:16<45:51:13, 10.47s/it]
 58%|█████▊    | 22200/37963 [68:56:27<45:22:23, 10.36s/it]
                                                           
{'loss': '0.1288', 'grad_norm': '2.718', 'learning_rate': '7.76e-06', 'epoch': '0.5848'}

 58%|█████▊    | 22200/37963 [68:56:27<45:22:23, 10.36s/it]
 58%|█████▊    | 22201/37963 [68:56:37<45:11:19, 10.32s/it]
 58%|█████▊    | 22202/37963 [68:56:47<44:52:46, 10.25s/it]
 58%|█████▊    | 22203/37963 [68:56:57<44:45:05, 10.22s/it]
 58%|█████▊    | 22204/37963 [68:57:07<44:30:49, 10.17s/it]
 58%|█████▊    | 22205/37963 [68:57:17<43:38:01,  9.97s/it]
 58%|█████▊    | 22206/37963 [68:57:27<43:46:46, 10.00s/it]
 58%|█████▊    | 22207/37963 [68:57:37<43:52:38, 10.03s/it]
 58%|█████▊    | 22208/37963 [68:57:47<43:40:12,  9.98s/it]
 59%|█████▊    | 22209/37963 [68:57:57<43:47:21, 10.01s/it]
 59%|█████▊    | 22210/37963 [68:58:07<43:57:14, 10.04s/it]
                                                           
{'loss': '0.1374', 'grad_norm': '2.175', 'learning_rate': '7.752e-06', 'epoch': '0.585'}

 59%|█████▊    | 22210/37963 [68:58:07<43:57:14, 10.04s/it]
 59%|█████▊    | 22211/37963 [68:58:17<43:50:22, 10.02s/it]
 59%|█████▊    | 22212/37963 [68:58:27<43:48:37, 10.01s/it]
 59%|█████▊    | 22213/37963 [68:58:37<43:40:08,  9.98s/it]
 59%|█████▊    | 22214/37963 [68:58:46<43:07:55,  9.86s/it]
 59%|█████▊    | 22215/37963 [68:59:03<52:52:06, 12.09s/it]
 59%|█████▊    | 22216/37963 [68:59:14<50:16:08, 11.49s/it]
 59%|█████▊    | 22217/37963 [68:59:30<57:03:36, 13.05s/it]
 59%|█████▊    | 22218/37963 [68:59:40<53:09:22, 12.15s/it]
 59%|█████▊    | 22219/37963 [68:59:51<50:33:26, 11.56s/it]
 59%|█████▊    | 22220/37963 [69:00:07<57:09:37, 13.07s/it]
                                                           
{'loss': '0.141', 'grad_norm': '1.377', 'learning_rate': '7.743e-06', 'epoch': '0.5853'}

 59%|█████▊    | 22220/37963 [69:00:07<57:09:37, 13.07s/it]
 59%|█████▊    | 22221/37963 [69:00:24<61:47:40, 14.13s/it]
 59%|█████▊    | 22222/37963 [69:00:34<56:28:29, 12.92s/it]
 59%|█████▊    | 22223/37963 [69:00:50<60:59:48, 13.95s/it]
 59%|█████▊    | 22224/37963 [69:01:07<65:04:36, 14.89s/it]
 59%|█████▊    | 22225/37963 [69:01:17<58:52:18, 13.47s/it]
 59%|█████▊    | 22226/37963 [69:01:28<54:28:45, 12.46s/it]
 59%|█████▊    | 22227/37963 [69:01:38<51:26:07, 11.77s/it]
 59%|█████▊    | 22228/37963 [69:01:48<49:07:22, 11.24s/it]
 59%|█████▊    | 22229/37963 [69:01:58<47:18:06, 10.82s/it]
 59%|█████▊    | 22230/37963 [69:02:08<46:18:13, 10.60s/it]
                                                           
{'loss': '0.1373', 'grad_norm': '2.785', 'learning_rate': '7.735e-06', 'epoch': '0.5856'}

 59%|█████▊    | 22230/37963 [69:02:08<46:18:13, 10.60s/it]
 59%|█████▊    | 22231/37963 [69:02:18<45:26:59, 10.40s/it]
 59%|█████▊    | 22232/37963 [69:02:28<45:05:07, 10.32s/it]
 59%|█████▊    | 22233/37963 [69:02:38<44:36:52, 10.21s/it]
 59%|█████▊    | 22234/37963 [69:02:48<44:32:28, 10.19s/it]
 59%|█████▊    | 22235/37963 [69:03:05<53:29:37, 12.24s/it]
 59%|█████▊    | 22236/37963 [69:03:15<50:19:52, 11.52s/it]
 59%|█████▊    | 22237/37963 [69:03:25<48:25:02, 11.08s/it]
 59%|█████▊    | 22238/37963 [69:03:35<47:05:02, 10.78s/it]
 59%|█████▊    | 22239/37963 [69:03:45<46:10:03, 10.57s/it]
 59%|█████▊    | 22240/37963 [69:03:55<45:39:50, 10.46s/it]
                                                           
{'loss': '0.1336', 'grad_norm': '1.732', 'learning_rate': '7.727e-06', 'epoch': '0.5858'}

 59%|█████▊    | 22240/37963 [69:03:55<45:39:50, 10.46s/it]
 59%|█████▊    | 22241/37963 [69:04:05<44:52:49, 10.28s/it]
 59%|█████▊    | 22242/37963 [69:04:15<44:31:41, 10.20s/it]
 59%|█████▊    | 22243/37963 [69:04:31<52:21:35, 11.99s/it]
 59%|█████▊    | 22244/37963 [69:04:41<50:05:31, 11.47s/it]
 59%|█████▊    | 22245/37963 [69:04:51<48:17:24, 11.06s/it]
 59%|█████▊    | 22246/37963 [69:05:01<46:50:17, 10.73s/it]
 59%|█████▊    | 22247/37963 [69:05:11<45:35:57, 10.45s/it]
 59%|█████▊    | 22248/37963 [69:05:21<45:13:58, 10.36s/it]
 59%|█████▊    | 22249/37963 [69:05:31<44:54:28, 10.29s/it]
 59%|█████▊    | 22250/37963 [69:05:42<44:37:38, 10.22s/it]
                                                           
{'loss': '0.1316', 'grad_norm': '3.347', 'learning_rate': '7.719e-06', 'epoch': '0.5861'}

 59%|█████▊    | 22250/37963 [69:05:42<44:37:38, 10.22s/it]
 59%|█████▊    | 22251/37963 [69:05:52<44:26:41, 10.18s/it]
 59%|█████▊    | 22252/37963 [69:06:02<44:24:25, 10.18s/it]
 59%|█████▊    | 22253/37963 [69:06:12<44:22:18, 10.17s/it]
 59%|█████▊    | 22254/37963 [69:06:22<44:12:11, 10.13s/it]
 59%|█████▊    | 22255/37963 [69:06:32<44:21:57, 10.17s/it]
 59%|█████▊    | 22256/37963 [69:06:42<43:59:50, 10.08s/it]
 59%|█████▊    | 22257/37963 [69:06:52<43:53:19, 10.06s/it]
 59%|█████▊    | 22258/37963 [69:07:02<43:24:07,  9.95s/it]
 59%|█████▊    | 22259/37963 [69:07:12<43:13:49,  9.91s/it]
 59%|█████▊    | 22260/37963 [69:07:22<43:17:12,  9.92s/it]
                                                           
{'loss': '0.1287', 'grad_norm': '1.455', 'learning_rate': '7.71e-06', 'epoch': '0.5864'}

 59%|█████▊    | 22260/37963 [69:07:22<43:17:12,  9.92s/it]
 59%|█████▊    | 22261/37963 [69:07:32<43:35:04,  9.99s/it]
 59%|█████▊    | 22262/37963 [69:07:42<43:27:02,  9.96s/it]
 59%|█████▊    | 22263/37963 [69:07:59<52:36:19, 12.06s/it]
 59%|█████▊    | 22264/37963 [69:08:08<49:32:52, 11.36s/it]
 59%|█████▊    | 22265/37963 [69:08:25<57:04:29, 13.09s/it]
 59%|█████▊    | 22266/37963 [69:08:35<52:44:23, 12.10s/it]
 59%|█████▊    | 22267/37963 [69:08:45<50:09:31, 11.50s/it]
 59%|█████▊    | 22268/37963 [69:08:55<47:53:26, 10.98s/it]
 59%|█████▊    | 22269/37963 [69:09:11<54:45:24, 12.56s/it]
 59%|█████▊    | 22270/37963 [69:09:28<60:09:08, 13.80s/it]
                                                           
{'loss': '0.1345', 'grad_norm': '1.26', 'learning_rate': '7.702e-06', 'epoch': '0.5866'}

 59%|█████▊    | 22270/37963 [69:09:28<60:09:08, 13.80s/it]
 59%|█████▊    | 22271/37963 [69:09:45<63:41:01, 14.61s/it]
 59%|█████▊    | 22272/37963 [69:10:01<66:43:55, 15.31s/it]
 59%|█████▊    | 22273/37963 [69:10:11<59:35:41, 13.67s/it]
 59%|█████▊    | 22274/37963 [69:10:21<54:54:23, 12.60s/it]
 59%|█████▊    | 22275/37963 [69:10:32<51:36:38, 11.84s/it]
 59%|█████▊    | 22276/37963 [69:10:42<49:24:29, 11.34s/it]
 59%|█████▊    | 22277/37963 [69:10:52<47:47:25, 10.97s/it]
 59%|█████▊    | 22278/37963 [69:11:02<46:42:13, 10.72s/it]
 59%|█████▊    | 22279/37963 [69:11:12<45:36:27, 10.47s/it]
 59%|█████▊    | 22280/37963 [69:11:22<45:04:24, 10.35s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.942', 'learning_rate': '7.694e-06', 'epoch': '0.5869'}

 59%|█████▊    | 22280/37963 [69:11:22<45:04:24, 10.35s/it]
 59%|█████▊    | 22281/37963 [69:11:32<44:38:32, 10.25s/it]
 59%|█████▊    | 22282/37963 [69:11:48<52:38:53, 12.09s/it]
 59%|█████▊    | 22283/37963 [69:11:58<49:53:20, 11.45s/it]
 59%|█████▊    | 22284/37963 [69:12:08<48:08:02, 11.05s/it]
 59%|█████▊    | 22285/37963 [69:12:19<47:06:34, 10.82s/it]
 59%|█████▊    | 22286/37963 [69:12:29<46:01:41, 10.57s/it]
 59%|█████▊    | 22287/37963 [69:12:38<44:59:31, 10.33s/it]
 59%|█████▊    | 22288/37963 [69:12:48<44:40:31, 10.26s/it]
 59%|█████▊    | 22289/37963 [69:12:59<44:29:38, 10.22s/it]
 59%|█████▊    | 22290/37963 [69:13:09<44:22:56, 10.19s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '1.301', 'learning_rate': '7.685e-06', 'epoch': '0.5872'}

 59%|█████▊    | 22290/37963 [69:13:09<44:22:56, 10.19s/it]
 59%|█████▊    | 22291/37963 [69:13:19<44:09:27, 10.14s/it]
 59%|█████▊    | 22292/37963 [69:13:35<52:05:47, 11.97s/it]
 59%|█████▊    | 22293/37963 [69:13:45<49:40:28, 11.41s/it]
 59%|█████▊    | 22294/37963 [69:13:55<47:48:34, 10.98s/it]
 59%|█████▊    | 22295/37963 [69:14:05<46:27:44, 10.68s/it]
 59%|█████▊    | 22296/37963 [69:14:15<45:27:38, 10.45s/it]
 59%|█████▊    | 22297/37963 [69:14:25<45:07:31, 10.37s/it]
 59%|█████▊    | 22298/37963 [69:14:35<44:22:13, 10.20s/it]
 59%|█████▊    | 22299/37963 [69:14:45<43:56:55, 10.10s/it]
 59%|█████▊    | 22300/37963 [69:14:55<43:33:11, 10.01s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '2.805', 'learning_rate': '7.677e-06', 'epoch': '0.5874'}

 59%|█████▊    | 22300/37963 [69:14:55<43:33:11, 10.01s/it]
 59%|█████▊    | 22301/37963 [69:15:05<43:39:25, 10.03s/it]
 59%|█████▊    | 22302/37963 [69:15:14<43:18:29,  9.96s/it]
 59%|█████▊    | 22303/37963 [69:15:25<43:27:49,  9.99s/it]
 59%|█████▉    | 22304/37963 [69:15:35<43:41:14, 10.04s/it]
 59%|█████▉    | 22305/37963 [69:15:45<43:38:10, 10.03s/it]
 59%|█████▉    | 22306/37963 [69:15:55<43:35:52, 10.02s/it]
 59%|█████▉    | 22307/37963 [69:16:05<43:31:16, 10.01s/it]
 59%|█████▉    | 22308/37963 [69:16:15<43:28:22, 10.00s/it]
 59%|█████▉    | 22309/37963 [69:16:25<43:35:00, 10.02s/it]
 59%|█████▉    | 22310/37963 [69:16:35<43:16:34,  9.95s/it]
                                                           
{'loss': '0.1215', 'grad_norm': '2.359', 'learning_rate': '7.669e-06', 'epoch': '0.5877'}

 59%|█████▉    | 22310/37963 [69:16:35<43:16:34,  9.95s/it]
 59%|█████▉    | 22311/37963 [69:16:45<43:18:56,  9.96s/it]
 59%|█████▉    | 22312/37963 [69:16:55<43:30:44, 10.01s/it]
 59%|█████▉    | 22313/37963 [69:17:12<53:26:12, 12.29s/it]
 59%|█████▉    | 22314/37963 [69:17:29<58:53:52, 13.55s/it]
 59%|█████▉    | 22315/37963 [69:17:39<54:32:02, 12.55s/it]
 59%|█████▉    | 22316/37963 [69:17:49<51:21:00, 11.81s/it]
 59%|█████▉    | 22317/37963 [69:17:59<49:08:23, 11.31s/it]
 59%|█████▉    | 22318/37963 [69:18:09<47:19:27, 10.89s/it]
 59%|█████▉    | 22319/37963 [69:18:32<62:37:44, 14.41s/it]
 59%|█████▉    | 22320/37963 [69:18:48<65:37:19, 15.10s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '1.697', 'learning_rate': '7.66e-06', 'epoch': '0.5879'}

 59%|█████▉    | 22320/37963 [69:18:48<65:37:19, 15.10s/it]
 59%|█████▉    | 22321/37963 [69:18:59<59:05:30, 13.60s/it]
 59%|█████▉    | 22322/37963 [69:19:16<63:31:32, 14.62s/it]
 59%|█████▉    | 22323/37963 [69:19:25<57:04:55, 13.14s/it]
 59%|█████▉    | 22324/37963 [69:19:35<53:02:04, 12.21s/it]
 59%|█████▉    | 22325/37963 [69:19:45<50:21:53, 11.59s/it]
 59%|█████▉    | 22326/37963 [69:19:55<48:21:52, 11.13s/it]
 59%|█████▉    | 22327/37963 [69:20:06<47:07:07, 10.85s/it]
 59%|█████▉    | 22328/37963 [69:20:16<46:03:42, 10.61s/it]
 59%|█████▉    | 22329/37963 [69:20:33<54:07:37, 12.46s/it]
 59%|█████▉    | 22330/37963 [69:20:43<51:13:34, 11.80s/it]
                                                           
{'loss': '0.142', 'grad_norm': '1.139', 'learning_rate': '7.652e-06', 'epoch': '0.5882'}

 59%|█████▉    | 22330/37963 [69:20:43<51:13:34, 11.80s/it]
 59%|█████▉    | 22331/37963 [69:20:53<48:57:38, 11.28s/it]
 59%|█████▉    | 22332/37963 [69:21:03<47:28:04, 10.93s/it]
 59%|█████▉    | 22333/37963 [69:21:13<46:24:57, 10.69s/it]
 59%|█████▉    | 22334/37963 [69:21:23<45:44:10, 10.53s/it]
 59%|█████▉    | 22335/37963 [69:21:33<45:11:00, 10.41s/it]
 59%|█████▉    | 22336/37963 [69:21:44<45:00:41, 10.37s/it]
 59%|█████▉    | 22337/37963 [69:21:54<44:44:53, 10.31s/it]
 59%|█████▉    | 22338/37963 [69:22:04<44:09:16, 10.17s/it]
 59%|█████▉    | 22339/37963 [69:22:14<43:55:07, 10.12s/it]
 59%|█████▉    | 22340/37963 [69:22:30<51:58:26, 11.98s/it]
                                                           
{'loss': '0.1248', 'grad_norm': '0.8798', 'learning_rate': '7.644e-06', 'epoch': '0.5885'}

 59%|█████▉    | 22340/37963 [69:22:30<51:58:26, 11.98s/it]
 59%|█████▉    | 22341/37963 [69:22:40<49:15:02, 11.35s/it]
 59%|█████▉    | 22342/37963 [69:22:50<47:50:14, 11.02s/it]
 59%|█████▉    | 22343/37963 [69:23:00<46:38:15, 10.75s/it]
 59%|█████▉    | 22344/37963 [69:23:11<46:04:33, 10.62s/it]
 59%|█████▉    | 22345/37963 [69:23:21<45:23:44, 10.46s/it]
 59%|█████▉    | 22346/37963 [69:23:31<44:54:24, 10.35s/it]
 59%|█████▉    | 22347/37963 [69:23:41<44:39:59, 10.30s/it]
 59%|█████▉    | 22348/37963 [69:23:51<44:41:30, 10.30s/it]
 59%|█████▉    | 22349/37963 [69:24:01<44:18:21, 10.22s/it]
 59%|█████▉    | 22350/37963 [69:24:11<44:12:09, 10.19s/it]
                                                           
{'loss': '0.1297', 'grad_norm': '1.525', 'learning_rate': '7.636e-06', 'epoch': '0.5887'}

 59%|█████▉    | 22350/37963 [69:24:11<44:12:09, 10.19s/it]
 59%|█████▉    | 22351/37963 [69:24:21<44:05:44, 10.17s/it]
 59%|█████▉    | 22352/37963 [69:24:32<43:56:15, 10.13s/it]
 59%|█████▉    | 22353/37963 [69:24:42<43:53:25, 10.12s/it]
 59%|█████▉    | 22354/37963 [69:24:52<43:50:32, 10.11s/it]
 59%|█████▉    | 22355/37963 [69:25:02<43:35:00, 10.05s/it]
 59%|█████▉    | 22356/37963 [69:25:12<43:35:31, 10.06s/it]
 59%|█████▉    | 22357/37963 [69:25:22<43:42:35, 10.08s/it]
 59%|█████▉    | 22358/37963 [69:25:32<43:22:20, 10.01s/it]
 59%|█████▉    | 22359/37963 [69:25:48<51:52:53, 11.97s/it]
 59%|█████▉    | 22360/37963 [69:26:05<57:34:58, 13.29s/it]
                                                           
{'loss': '0.1405', 'grad_norm': '1.949', 'learning_rate': '7.627e-06', 'epoch': '0.589'}

 59%|█████▉    | 22360/37963 [69:26:05<57:34:58, 13.29s/it]
 59%|█████▉    | 22361/37963 [69:26:15<53:42:20, 12.39s/it]
 59%|█████▉    | 22362/37963 [69:26:25<50:44:44, 11.71s/it]
 59%|█████▉    | 22363/37963 [69:26:35<48:39:27, 11.23s/it]
 59%|█████▉    | 22364/37963 [69:26:45<47:16:09, 10.91s/it]
 59%|█████▉    | 22365/37963 [69:26:55<46:19:23, 10.69s/it]
 59%|█████▉    | 22366/37963 [69:27:12<54:01:44, 12.47s/it]
 59%|█████▉    | 22367/37963 [69:27:22<50:47:33, 11.72s/it]
 59%|█████▉    | 22368/37963 [69:27:38<56:44:55, 13.10s/it]
 59%|█████▉    | 22369/37963 [69:27:48<52:49:02, 12.19s/it]
 59%|█████▉    | 22370/37963 [69:28:05<59:06:02, 13.64s/it]
                                                           
{'loss': '0.1349', 'grad_norm': '1.329', 'learning_rate': '7.619e-06', 'epoch': '0.5893'}

 59%|█████▉    | 22370/37963 [69:28:05<59:06:02, 13.64s/it]
 59%|█████▉    | 22371/37963 [69:28:16<54:27:05, 12.57s/it]
 59%|█████▉    | 22372/37963 [69:28:32<59:30:28, 13.74s/it]
 59%|█████▉    | 22373/37963 [69:28:42<54:28:31, 12.58s/it]
 59%|█████▉    | 22374/37963 [69:28:52<51:09:28, 11.81s/it]
 59%|█████▉    | 22375/37963 [69:29:02<49:00:20, 11.32s/it]
 59%|█████▉    | 22376/37963 [69:29:12<47:28:28, 10.96s/it]
 59%|█████▉    | 22377/37963 [69:29:22<46:24:44, 10.72s/it]
 59%|█████▉    | 22378/37963 [69:29:40<54:53:47, 12.68s/it]
 59%|█████▉    | 22379/37963 [69:29:50<51:43:23, 11.95s/it]
 59%|█████▉    | 22380/37963 [69:30:00<49:17:42, 11.39s/it]
                                                           
{'loss': '0.118', 'grad_norm': '1.091', 'learning_rate': '7.611e-06', 'epoch': '0.5895'}

 59%|█████▉    | 22380/37963 [69:30:00<49:17:42, 11.39s/it]
 59%|█████▉    | 22381/37963 [69:30:10<47:40:01, 11.01s/it]
 59%|█████▉    | 22382/37963 [69:30:20<46:20:13, 10.71s/it]
 59%|█████▉    | 22383/37963 [69:30:30<45:15:14, 10.46s/it]
 59%|█████▉    | 22384/37963 [69:30:40<44:43:37, 10.34s/it]
 59%|█████▉    | 22385/37963 [69:30:50<44:14:45, 10.23s/it]
 59%|█████▉    | 22386/37963 [69:31:00<44:10:07, 10.21s/it]
 59%|█████▉    | 22387/37963 [69:31:16<52:05:18, 12.04s/it]
 59%|█████▉    | 22388/37963 [69:31:26<49:22:28, 11.41s/it]
 59%|█████▉    | 22389/37963 [69:31:36<47:03:46, 10.88s/it]
 59%|█████▉    | 22390/37963 [69:31:46<46:09:47, 10.67s/it]
                                                           
{'loss': '0.1264', 'grad_norm': '1.413', 'learning_rate': '7.602e-06', 'epoch': '0.5898'}

 59%|█████▉    | 22390/37963 [69:31:46<46:09:47, 10.67s/it]
 59%|█████▉    | 22391/37963 [69:31:56<45:21:54, 10.49s/it]
 59%|█████▉    | 22392/37963 [69:32:06<44:39:44, 10.33s/it]
 59%|█████▉    | 22393/37963 [69:32:16<44:25:06, 10.27s/it]
 59%|█████▉    | 22394/37963 [69:32:26<44:07:25, 10.20s/it]
 59%|█████▉    | 22395/37963 [69:32:36<43:55:27, 10.16s/it]
 59%|█████▉    | 22396/37963 [69:32:47<43:56:06, 10.16s/it]
 59%|█████▉    | 22397/37963 [69:32:57<43:37:24, 10.09s/it]
 59%|█████▉    | 22398/37963 [69:33:06<43:15:03, 10.00s/it]
 59%|█████▉    | 22399/37963 [69:33:16<43:27:29, 10.05s/it]
 59%|█████▉    | 22400/37963 [69:33:27<43:37:36, 10.09s/it]
                                                           
{'loss': '0.1304', 'grad_norm': '3.503', 'learning_rate': '7.594e-06', 'epoch': '0.5901'}

 59%|█████▉    | 22400/37963 [69:33:27<43:37:36, 10.09s/it]
 59%|█████▉    | 22401/37963 [69:33:37<43:41:08, 10.11s/it]
 59%|█████▉    | 22402/37963 [69:33:47<43:39:50, 10.10s/it]
 59%|█████▉    | 22403/37963 [69:33:57<43:47:55, 10.13s/it]
 59%|█████▉    | 22404/37963 [69:34:07<43:48:57, 10.14s/it]
 59%|█████▉    | 22405/37963 [69:34:17<43:44:55, 10.12s/it]
 59%|█████▉    | 22406/37963 [69:34:27<43:14:29, 10.01s/it]
 59%|█████▉    | 22407/37963 [69:34:44<51:35:13, 11.94s/it]
 59%|█████▉    | 22408/37963 [69:34:54<49:19:19, 11.41s/it]
 59%|█████▉    | 22409/37963 [69:35:11<56:21:57, 13.05s/it]
 59%|█████▉    | 22410/37963 [69:35:21<52:35:46, 12.17s/it]
                                                           
{'loss': '0.1393', 'grad_norm': '3.667', 'learning_rate': '7.586e-06', 'epoch': '0.5903'}

 59%|█████▉    | 22410/37963 [69:35:21<52:35:46, 12.17s/it]
 59%|█████▉    | 22411/37963 [69:35:31<49:51:02, 11.54s/it]
 59%|█████▉    | 22412/37963 [69:35:41<47:55:07, 11.09s/it]
 59%|█████▉    | 22413/37963 [69:35:57<54:45:14, 12.68s/it]
 59%|█████▉    | 22414/37963 [69:36:07<51:18:41, 11.88s/it]
 59%|█████▉    | 22415/37963 [69:36:17<49:03:47, 11.36s/it]
 59%|█████▉    | 22416/37963 [69:36:33<55:07:27, 12.76s/it]
 59%|█████▉    | 22417/37963 [69:36:44<51:54:40, 12.02s/it]
 59%|█████▉    | 22418/37963 [69:36:54<49:21:42, 11.43s/it]
 59%|█████▉    | 22419/37963 [69:37:11<56:39:37, 13.12s/it]
 59%|█████▉    | 22420/37963 [69:37:27<60:54:01, 14.11s/it]
                                                           
{'loss': '0.134', 'grad_norm': '2.452', 'learning_rate': '7.578e-06', 'epoch': '0.5906'}

 59%|█████▉    | 22420/37963 [69:37:27<60:54:01, 14.11s/it]
 59%|█████▉    | 22421/37963 [69:37:37<55:45:31, 12.92s/it]
 59%|█████▉    | 22422/37963 [69:37:47<52:08:16, 12.08s/it]
 59%|█████▉    | 22423/37963 [69:37:58<49:36:25, 11.49s/it]
 59%|█████▉    | 22424/37963 [69:38:14<56:34:25, 13.11s/it]
 59%|█████▉    | 22425/37963 [69:38:25<52:40:07, 12.20s/it]
 59%|█████▉    | 22426/37963 [69:38:34<49:35:30, 11.49s/it]
 59%|█████▉    | 22427/37963 [69:38:45<48:04:20, 11.14s/it]
 59%|█████▉    | 22428/37963 [69:38:55<46:57:09, 10.88s/it]
 59%|█████▉    | 22429/37963 [69:39:05<46:05:05, 10.68s/it]
 59%|█████▉    | 22430/37963 [69:39:15<45:24:07, 10.52s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '4.345', 'learning_rate': '7.569e-06', 'epoch': '0.5908'}

 59%|█████▉    | 22430/37963 [69:39:15<45:24:07, 10.52s/it]
 59%|█████▉    | 22431/37963 [69:39:26<45:10:49, 10.47s/it]
 59%|█████▉    | 22432/37963 [69:39:36<44:36:57, 10.34s/it]
 59%|█████▉    | 22433/37963 [69:39:46<44:21:28, 10.28s/it]
 59%|█████▉    | 22434/37963 [69:40:02<52:20:58, 12.14s/it]
 59%|█████▉    | 22435/37963 [69:40:12<49:41:28, 11.52s/it]
 59%|█████▉    | 22436/37963 [69:40:23<48:02:33, 11.14s/it]
 59%|█████▉    | 22437/37963 [69:40:33<46:46:33, 10.85s/it]
 59%|█████▉    | 22438/37963 [69:40:43<45:41:24, 10.59s/it]
 59%|█████▉    | 22439/37963 [69:40:53<45:05:45, 10.46s/it]
 59%|█████▉    | 22440/37963 [69:41:03<44:38:18, 10.35s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '1.327', 'learning_rate': '7.561e-06', 'epoch': '0.5911'}

 59%|█████▉    | 22440/37963 [69:41:03<44:38:18, 10.35s/it]
 59%|█████▉    | 22441/37963 [69:41:13<44:23:04, 10.29s/it]
 59%|█████▉    | 22442/37963 [69:41:23<44:06:54, 10.23s/it]
 59%|█████▉    | 22443/37963 [69:41:33<43:53:15, 10.18s/it]
 59%|█████▉    | 22444/37963 [69:41:44<43:51:19, 10.17s/it]
 59%|█████▉    | 22445/37963 [69:41:53<43:18:01, 10.05s/it]
 59%|█████▉    | 22446/37963 [69:42:03<43:12:53, 10.03s/it]
 59%|█████▉    | 22447/37963 [69:42:13<43:16:58, 10.04s/it]
 59%|█████▉    | 22448/37963 [69:42:23<43:02:16,  9.99s/it]
 59%|█████▉    | 22449/37963 [69:42:33<43:19:07, 10.05s/it]
 59%|█████▉    | 22450/37963 [69:42:43<43:15:26, 10.04s/it]
                                                           
{'loss': '0.1412', 'grad_norm': '0.838', 'learning_rate': '7.553e-06', 'epoch': '0.5914'}

 59%|█████▉    | 22450/37963 [69:42:43<43:15:26, 10.04s/it]
 59%|█████▉    | 22451/37963 [69:42:54<43:20:00, 10.06s/it]
 59%|█████▉    | 22452/37963 [69:43:04<43:27:57, 10.09s/it]
 59%|█████▉    | 22453/37963 [69:43:14<43:34:24, 10.11s/it]
 59%|█████▉    | 22454/37963 [69:43:24<43:07:22, 10.01s/it]
 59%|█████▉    | 22455/37963 [69:43:41<52:06:06, 12.09s/it]
 59%|█████▉    | 22456/37963 [69:43:50<49:11:58, 11.42s/it]
 59%|█████▉    | 22457/37963 [69:44:01<47:30:28, 11.03s/it]
 59%|█████▉    | 22458/37963 [69:44:18<55:23:21, 12.86s/it]
 59%|█████▉    | 22459/37963 [69:44:28<51:27:17, 11.95s/it]
 59%|█████▉    | 22460/37963 [69:44:44<57:23:06, 13.33s/it]
                                                           
{'loss': '0.1435', 'grad_norm': '1.031', 'learning_rate': '7.544e-06', 'epoch': '0.5916'}

 59%|█████▉    | 22460/37963 [69:44:44<57:23:06, 13.33s/it]
 59%|█████▉    | 22461/37963 [69:44:54<52:58:12, 12.30s/it]
 59%|█████▉    | 22462/37963 [69:45:04<50:05:51, 11.63s/it]
 59%|█████▉    | 22463/37963 [69:45:14<48:09:11, 11.18s/it]
 59%|█████▉    | 22464/37963 [69:45:31<55:06:29, 12.80s/it]
 59%|█████▉    | 22465/37963 [69:45:41<51:38:55, 12.00s/it]
 59%|█████▉    | 22466/37963 [69:45:57<57:11:27, 13.29s/it]
 59%|█████▉    | 22467/37963 [69:46:14<61:35:09, 14.31s/it]
 59%|█████▉    | 22468/37963 [69:46:24<56:19:49, 13.09s/it]
 59%|█████▉    | 22469/37963 [69:46:34<52:05:40, 12.10s/it]
 59%|█████▉    | 22470/37963 [69:46:44<49:30:17, 11.50s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '1.534', 'learning_rate': '7.536e-06', 'epoch': '0.5919'}

 59%|█████▉    | 22470/37963 [69:46:44<49:30:17, 11.50s/it]
 59%|█████▉    | 22471/37963 [69:46:54<47:48:44, 11.11s/it]
 59%|█████▉    | 22472/37963 [69:47:11<55:19:12, 12.86s/it]
 59%|█████▉    | 22473/37963 [69:47:21<51:51:09, 12.05s/it]
 59%|█████▉    | 22474/37963 [69:47:31<49:24:03, 11.48s/it]
 59%|█████▉    | 22475/37963 [69:47:42<47:44:45, 11.10s/it]
 59%|█████▉    | 22476/37963 [69:47:52<46:32:03, 10.82s/it]
 59%|█████▉    | 22477/37963 [69:48:02<45:35:03, 10.60s/it]
 59%|█████▉    | 22478/37963 [69:48:12<44:52:14, 10.43s/it]
 59%|█████▉    | 22479/37963 [69:48:22<44:26:33, 10.33s/it]
 59%|█████▉    | 22480/37963 [69:48:32<44:23:29, 10.32s/it]
                                                           
{'loss': '0.1386', 'grad_norm': '1.688', 'learning_rate': '7.528e-06', 'epoch': '0.5922'}

 59%|█████▉    | 22480/37963 [69:48:32<44:23:29, 10.32s/it]
 59%|█████▉    | 22481/37963 [69:48:43<44:19:45, 10.31s/it]
 59%|█████▉    | 22482/37963 [69:48:53<44:00:22, 10.23s/it]
 59%|█████▉    | 22483/37963 [69:49:09<52:25:49, 12.19s/it]
 59%|█████▉    | 22484/37963 [69:49:19<49:06:04, 11.42s/it]
 59%|█████▉    | 22485/37963 [69:49:29<47:09:48, 10.97s/it]
 59%|█████▉    | 22486/37963 [69:49:39<46:14:10, 10.75s/it]
 59%|█████▉    | 22487/37963 [69:49:49<45:28:02, 10.58s/it]
 59%|█████▉    | 22488/37963 [69:49:59<44:47:37, 10.42s/it]
 59%|█████▉    | 22489/37963 [69:50:10<44:18:40, 10.31s/it]
 59%|█████▉    | 22490/37963 [69:50:20<44:13:47, 10.29s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '2.479', 'learning_rate': '7.52e-06', 'epoch': '0.5924'}

 59%|█████▉    | 22490/37963 [69:50:20<44:13:47, 10.29s/it]
 59%|█████▉    | 22491/37963 [69:50:30<44:02:49, 10.25s/it]
 59%|█████▉    | 22492/37963 [69:50:40<43:47:08, 10.19s/it]
 59%|█████▉    | 22493/37963 [69:50:50<43:44:48, 10.18s/it]
 59%|█████▉    | 22494/37963 [69:51:00<43:47:37, 10.19s/it]
 59%|█████▉    | 22495/37963 [69:51:10<43:38:56, 10.16s/it]
 59%|█████▉    | 22496/37963 [69:51:20<43:29:54, 10.12s/it]
 59%|█████▉    | 22497/37963 [69:51:31<43:26:03, 10.11s/it]
 59%|█████▉    | 22498/37963 [69:51:41<43:29:16, 10.12s/it]
 59%|█████▉    | 22499/37963 [69:51:51<43:31:11, 10.13s/it]
 59%|█████▉    | 22500/37963 [69:52:01<43:23:10, 10.10s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '1.738', 'learning_rate': '7.511e-06', 'epoch': '0.5927'}

 59%|█████▉    | 22500/37963 [69:52:01<43:23:10, 10.10s/it]
 59%|█████▉    | 22501/37963 [69:52:11<43:22:36, 10.10s/it]
 59%|█████▉    | 22502/37963 [69:52:21<43:24:42, 10.11s/it]
 59%|█████▉    | 22503/37963 [69:52:31<43:25:18, 10.11s/it]
 59%|█████▉    | 22504/37963 [69:52:41<43:23:45, 10.11s/it]
 59%|█████▉    | 22505/37963 [69:52:58<52:09:15, 12.15s/it]
 59%|█████▉    | 22506/37963 [69:53:16<58:47:16, 13.69s/it]
 59%|█████▉    | 22507/37963 [69:53:26<54:03:08, 12.59s/it]
 59%|█████▉    | 22508/37963 [69:53:35<50:30:29, 11.77s/it]
 59%|█████▉    | 22509/37963 [69:53:52<56:32:27, 13.17s/it]
 59%|█████▉    | 22510/37963 [69:54:02<52:30:41, 12.23s/it]
                                                           
{'loss': '0.1401', 'grad_norm': '2.624', 'learning_rate': '7.503e-06', 'epoch': '0.5929'}

 59%|█████▉    | 22510/37963 [69:54:02<52:30:41, 12.23s/it]
 59%|█████▉    | 22511/37963 [69:54:12<49:40:45, 11.57s/it]
 59%|█████▉    | 22512/37963 [69:54:28<55:37:16, 12.96s/it]
 59%|█████▉    | 22513/37963 [69:54:38<51:35:42, 12.02s/it]
 59%|█████▉    | 22514/37963 [69:55:01<66:24:11, 15.47s/it]
 59%|█████▉    | 22515/37963 [69:55:11<59:14:48, 13.81s/it]
 59%|█████▉    | 22516/37963 [69:55:22<54:43:15, 12.75s/it]
 59%|█████▉    | 22517/37963 [69:55:32<51:17:42, 11.96s/it]
 59%|█████▉    | 22518/37963 [69:55:42<48:52:33, 11.39s/it]
 59%|█████▉    | 22519/37963 [69:55:52<46:46:44, 10.90s/it]
 59%|█████▉    | 22520/37963 [69:56:09<54:37:57, 12.74s/it]
                                                           
{'loss': '0.1387', 'grad_norm': '1.329', 'learning_rate': '7.495e-06', 'epoch': '0.5932'}

 59%|█████▉    | 22520/37963 [69:56:09<54:37:57, 12.74s/it]
 59%|█████▉    | 22521/37963 [69:56:19<51:12:44, 11.94s/it]
 59%|█████▉    | 22522/37963 [69:56:29<48:50:37, 11.39s/it]
 59%|█████▉    | 22523/37963 [69:56:39<47:09:52, 11.00s/it]
 59%|█████▉    | 22524/37963 [69:56:49<45:50:25, 10.69s/it]
 59%|█████▉    | 22525/37963 [69:56:59<45:10:09, 10.53s/it]
 59%|█████▉    | 22526/37963 [69:57:09<44:35:36, 10.40s/it]
 59%|█████▉    | 22527/37963 [69:57:19<44:12:30, 10.31s/it]
 59%|█████▉    | 22528/37963 [69:57:29<43:39:39, 10.18s/it]
 59%|█████▉    | 22529/37963 [69:57:45<51:35:41, 12.03s/it]
 59%|█████▉    | 22530/37963 [69:57:56<49:14:25, 11.49s/it]
                                                           
{'loss': '0.136', 'grad_norm': '1.03', 'learning_rate': '7.487e-06', 'epoch': '0.5935'}

 59%|█████▉    | 22530/37963 [69:57:56<49:14:25, 11.49s/it]
 59%|█████▉    | 22531/37963 [69:58:06<47:28:47, 11.08s/it]
 59%|█████▉    | 22532/37963 [69:58:16<46:22:31, 10.82s/it]
 59%|█████▉    | 22533/37963 [69:58:26<45:31:08, 10.62s/it]
 59%|█████▉    | 22534/37963 [69:58:36<44:48:03, 10.45s/it]
 59%|█████▉    | 22535/37963 [69:58:46<44:32:10, 10.39s/it]
 59%|█████▉    | 22536/37963 [69:58:57<44:20:16, 10.35s/it]
 59%|█████▉    | 22537/37963 [69:59:07<43:51:41, 10.24s/it]
 59%|█████▉    | 22538/37963 [69:59:17<43:40:59, 10.20s/it]
 59%|█████▉    | 22539/37963 [69:59:27<43:51:04, 10.24s/it]
 59%|█████▉    | 22540/37963 [69:59:37<43:38:53, 10.19s/it]
                                                           
{'loss': '0.1327', 'grad_norm': '1.563', 'learning_rate': '7.478e-06', 'epoch': '0.5937'}

 59%|█████▉    | 22540/37963 [69:59:37<43:38:53, 10.19s/it]
 59%|█████▉    | 22541/37963 [69:59:47<43:42:21, 10.20s/it]
 59%|█████▉    | 22542/37963 [69:59:57<43:30:35, 10.16s/it]
 59%|█████▉    | 22543/37963 [70:00:08<43:30:17, 10.16s/it]
 59%|█████▉    | 22544/37963 [70:00:18<43:30:07, 10.16s/it]
 59%|█████▉    | 22545/37963 [70:00:28<43:13:02, 10.09s/it]
 59%|█████▉    | 22546/37963 [70:00:38<43:09:45, 10.08s/it]
 59%|█████▉    | 22547/37963 [70:00:48<43:11:36, 10.09s/it]
 59%|█████▉    | 22548/37963 [70:00:58<42:48:03, 10.00s/it]
 59%|█████▉    | 22549/37963 [70:01:07<42:27:45,  9.92s/it]
 59%|█████▉    | 22550/37963 [70:01:18<42:42:43,  9.98s/it]
                                                           
{'loss': '0.1461', 'grad_norm': '1.757', 'learning_rate': '7.47e-06', 'epoch': '0.594'}

 59%|█████▉    | 22550/37963 [70:01:18<42:42:43,  9.98s/it]
 59%|█████▉    | 22551/37963 [70:01:28<42:48:33, 10.00s/it]
 59%|█████▉    | 22552/37963 [70:01:44<51:29:24, 12.03s/it]
 59%|█████▉    | 22553/37963 [70:01:55<49:11:02, 11.49s/it]
 59%|█████▉    | 22554/37963 [70:02:05<47:27:59, 11.09s/it]
 59%|█████▉    | 22555/37963 [70:02:22<55:23:34, 12.94s/it]
 59%|█████▉    | 22556/37963 [70:02:32<51:50:25, 12.11s/it]
 59%|█████▉    | 22557/37963 [70:02:49<57:32:39, 13.45s/it]
 59%|█████▉    | 22558/37963 [70:02:59<53:09:51, 12.42s/it]
 59%|█████▉    | 22559/37963 [70:03:09<50:15:03, 11.74s/it]
 59%|█████▉    | 22560/37963 [70:03:19<47:57:48, 11.21s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '2.55', 'learning_rate': '7.462e-06', 'epoch': '0.5943'}

 59%|█████▉    | 22560/37963 [70:03:19<47:57:48, 11.21s/it]
 59%|█████▉    | 22561/37963 [70:03:42<63:36:46, 14.87s/it]
 59%|█████▉    | 22562/37963 [70:03:52<57:34:57, 13.46s/it]
 59%|█████▉    | 22563/37963 [70:04:09<61:02:28, 14.27s/it]
 59%|█████▉    | 22564/37963 [70:04:19<55:38:28, 13.01s/it]
 59%|█████▉    | 22565/37963 [70:04:29<52:04:49, 12.18s/it]
 59%|█████▉    | 22566/37963 [70:04:39<49:23:08, 11.55s/it]
 59%|█████▉    | 22567/37963 [70:04:49<47:37:45, 11.14s/it]
 59%|█████▉    | 22568/37963 [70:04:59<46:22:48, 10.85s/it]
 59%|█████▉    | 22569/37963 [70:05:09<44:58:54, 10.52s/it]
 59%|█████▉    | 22570/37963 [70:05:26<53:11:34, 12.44s/it]
                                                           
{'loss': '0.129', 'grad_norm': '0.8963', 'learning_rate': '7.454e-06', 'epoch': '0.5945'}

 59%|█████▉    | 22570/37963 [70:05:26<53:11:34, 12.44s/it]
 59%|█████▉    | 22571/37963 [70:05:36<50:11:42, 11.74s/it]
 59%|█████▉    | 22572/37963 [70:05:46<47:46:48, 11.18s/it]
 59%|█████▉    | 22573/37963 [70:05:56<46:29:03, 10.87s/it]
 59%|█████▉    | 22574/37963 [70:06:06<45:30:45, 10.65s/it]
 59%|█████▉    | 22575/37963 [70:06:16<44:44:06, 10.47s/it]
 59%|█████▉    | 22576/37963 [70:06:26<43:58:31, 10.29s/it]
 59%|█████▉    | 22577/37963 [70:06:43<52:00:20, 12.17s/it]
 59%|█████▉    | 22578/37963 [70:06:53<49:19:01, 11.54s/it]
 59%|█████▉    | 22579/37963 [70:07:03<47:25:12, 11.10s/it]
 59%|█████▉    | 22580/37963 [70:07:13<46:05:05, 10.78s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '1.874', 'learning_rate': '7.445e-06', 'epoch': '0.5948'}

 59%|█████▉    | 22580/37963 [70:07:13<46:05:05, 10.78s/it]
 59%|█████▉    | 22581/37963 [70:07:23<45:07:06, 10.56s/it]
 59%|█████▉    | 22582/37963 [70:07:33<44:47:41, 10.48s/it]
 59%|█████▉    | 22583/37963 [70:07:44<44:31:03, 10.42s/it]
 59%|█████▉    | 22584/37963 [70:07:54<44:08:50, 10.33s/it]
 59%|█████▉    | 22585/37963 [70:08:04<43:52:27, 10.27s/it]
 59%|█████▉    | 22586/37963 [70:08:14<43:33:51, 10.20s/it]
 59%|█████▉    | 22587/37963 [70:08:24<43:24:49, 10.16s/it]
 60%|█████▉    | 22588/37963 [70:08:34<43:18:57, 10.14s/it]
 60%|█████▉    | 22589/37963 [70:08:44<43:12:48, 10.12s/it]
 60%|█████▉    | 22590/37963 [70:08:54<42:59:43, 10.07s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '1.191', 'learning_rate': '7.437e-06', 'epoch': '0.5951'}

 60%|█████▉    | 22590/37963 [70:08:54<42:59:43, 10.07s/it]
 60%|█████▉    | 22591/37963 [70:09:04<43:13:46, 10.12s/it]
 60%|█████▉    | 22592/37963 [70:09:14<43:18:23, 10.14s/it]
 60%|█████▉    | 22593/37963 [70:09:25<43:12:02, 10.12s/it]
 60%|█████▉    | 22594/37963 [70:09:35<43:16:18, 10.14s/it]
 60%|█████▉    | 22595/37963 [70:09:45<43:16:42, 10.14s/it]
 60%|█████▉    | 22596/37963 [70:09:55<43:09:44, 10.11s/it]
 60%|█████▉    | 22597/37963 [70:10:05<42:51:31, 10.04s/it]
 60%|█████▉    | 22598/37963 [70:10:15<42:42:24, 10.01s/it]
 60%|█████▉    | 22599/37963 [70:10:25<42:53:04, 10.05s/it]
 60%|█████▉    | 22600/37963 [70:10:42<52:08:57, 12.22s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '3.113', 'learning_rate': '7.429e-06', 'epoch': '0.5953'}

 60%|█████▉    | 22600/37963 [70:10:42<52:08:57, 12.22s/it]
 60%|█████▉    | 22601/37963 [70:10:52<49:12:54, 11.53s/it]
 60%|█████▉    | 22602/37963 [70:11:02<47:20:14, 11.09s/it]
 60%|█████▉    | 22603/37963 [70:11:18<53:40:48, 12.58s/it]
 60%|█████▉    | 22604/37963 [70:11:28<50:29:07, 11.83s/it]
 60%|█████▉    | 22605/37963 [70:11:45<57:12:50, 13.41s/it]
 60%|█████▉    | 22606/37963 [70:11:55<52:32:47, 12.32s/it]
 60%|█████▉    | 22607/37963 [70:12:05<49:44:14, 11.66s/it]
 60%|█████▉    | 22608/37963 [70:12:15<47:38:02, 11.17s/it]
 60%|█████▉    | 22609/37963 [70:12:38<62:58:52, 14.77s/it]
 60%|█████▉    | 22610/37963 [70:12:49<57:25:46, 13.47s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '1.48', 'learning_rate': '7.421e-06', 'epoch': '0.5956'}

 60%|█████▉    | 22610/37963 [70:12:49<57:25:46, 13.47s/it]
 60%|█████▉    | 22611/37963 [70:12:59<53:06:49, 12.46s/it]
 60%|█████▉    | 22612/37963 [70:13:15<58:15:25, 13.66s/it]
 60%|█████▉    | 22613/37963 [70:13:26<53:42:34, 12.60s/it]
 60%|█████▉    | 22614/37963 [70:13:36<50:28:12, 11.84s/it]
 60%|█████▉    | 22615/37963 [70:13:46<48:00:08, 11.26s/it]
 60%|█████▉    | 22616/37963 [70:13:55<46:01:52, 10.80s/it]
 60%|█████▉    | 22617/37963 [70:14:12<53:51:23, 12.63s/it]
 60%|█████▉    | 22618/37963 [70:14:22<50:32:57, 11.86s/it]
 60%|█████▉    | 22619/37963 [70:14:32<48:17:36, 11.33s/it]
 60%|█████▉    | 22620/37963 [70:14:42<46:43:28, 10.96s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '1.917', 'learning_rate': '7.412e-06', 'epoch': '0.5958'}

 60%|█████▉    | 22620/37963 [70:14:42<46:43:28, 10.96s/it]
 60%|█████▉    | 22621/37963 [70:14:53<45:36:51, 10.70s/it]
 60%|█████▉    | 22622/37963 [70:15:02<44:33:38, 10.46s/it]
 60%|█████▉    | 22623/37963 [70:15:12<44:00:46, 10.33s/it]
 60%|█████▉    | 22624/37963 [70:15:23<43:41:57, 10.26s/it]
 60%|█████▉    | 22625/37963 [70:15:33<43:24:19, 10.19s/it]
 60%|█████▉    | 22626/37963 [70:15:49<50:55:16, 11.95s/it]
 60%|█████▉    | 22627/37963 [70:15:59<48:25:49, 11.37s/it]
 60%|█████▉    | 22628/37963 [70:16:09<46:39:21, 10.95s/it]
 60%|█████▉    | 22629/37963 [70:16:18<45:10:34, 10.61s/it]
 60%|█████▉    | 22630/37963 [70:16:29<44:37:24, 10.48s/it]
                                                           
{'loss': '0.1333', 'grad_norm': '1.17', 'learning_rate': '7.404e-06', 'epoch': '0.5961'}

 60%|█████▉    | 22630/37963 [70:16:29<44:37:24, 10.48s/it]
 60%|█████▉    | 22631/37963 [70:16:39<44:00:36, 10.33s/it]
 60%|█████▉    | 22632/37963 [70:16:49<43:44:07, 10.27s/it]
 60%|█████▉    | 22633/37963 [70:16:59<43:27:17, 10.20s/it]
 60%|█████▉    | 22634/37963 [70:17:09<43:16:14, 10.16s/it]
 60%|█████▉    | 22635/37963 [70:17:19<43:15:17, 10.16s/it]
 60%|█████▉    | 22636/37963 [70:17:29<42:33:32, 10.00s/it]
 60%|█████▉    | 22637/37963 [70:17:39<42:44:33, 10.04s/it]
 60%|█████▉    | 22638/37963 [70:17:49<42:49:43, 10.06s/it]
 60%|█████▉    | 22639/37963 [70:17:59<43:06:15, 10.13s/it]
 60%|█████▉    | 22640/37963 [70:18:09<42:34:56, 10.00s/it]
                                                           
{'loss': '0.1352', 'grad_norm': '1.227', 'learning_rate': '7.396e-06', 'epoch': '0.5964'}

 60%|█████▉    | 22640/37963 [70:18:09<42:34:56, 10.00s/it]
 60%|█████▉    | 22641/37963 [70:18:19<42:38:30, 10.02s/it]
 60%|█████▉    | 22642/37963 [70:18:29<42:40:19, 10.03s/it]
 60%|█████▉    | 22643/37963 [70:18:39<42:56:58, 10.09s/it]
 60%|█████▉    | 22644/37963 [70:18:49<42:42:27, 10.04s/it]
 60%|█████▉    | 22645/37963 [70:18:59<42:22:46,  9.96s/it]
 60%|█████▉    | 22646/37963 [70:19:09<42:36:53, 10.02s/it]
 60%|█████▉    | 22647/37963 [70:19:26<51:25:55, 12.09s/it]
 60%|█████▉    | 22648/37963 [70:19:36<48:39:34, 11.44s/it]
 60%|█████▉    | 22649/37963 [70:19:46<47:00:54, 11.05s/it]
 60%|█████▉    | 22650/37963 [70:19:56<45:49:41, 10.77s/it]
                                                           
{'loss': '0.1243', 'grad_norm': '2.224', 'learning_rate': '7.388e-06', 'epoch': '0.5966'}

 60%|█████▉    | 22650/37963 [70:19:56<45:49:41, 10.77s/it]
 60%|█████▉    | 22651/37963 [70:20:06<44:55:08, 10.56s/it]
 60%|█████▉    | 22652/37963 [70:20:22<51:46:32, 12.17s/it]
 60%|█████▉    | 22653/37963 [70:20:32<48:59:28, 11.52s/it]
 60%|█████▉    | 22654/37963 [70:20:49<55:14:07, 12.99s/it]
 60%|█████▉    | 22655/37963 [70:20:59<51:35:29, 12.13s/it]
 60%|█████▉    | 22656/37963 [70:21:15<57:09:13, 13.44s/it]
 60%|█████▉    | 22657/37963 [70:21:32<61:43:15, 14.52s/it]
 60%|█████▉    | 22658/37963 [70:21:42<55:35:16, 13.08s/it]
 60%|█████▉    | 22659/37963 [70:21:52<52:00:41, 12.23s/it]
 60%|█████▉    | 22660/37963 [70:22:02<49:19:01, 11.60s/it]
                                                           
{'loss': '0.1386', 'grad_norm': '2.129', 'learning_rate': '7.379e-06', 'epoch': '0.5969'}

 60%|█████▉    | 22660/37963 [70:22:02<49:19:01, 11.60s/it]
 60%|█████▉    | 22661/37963 [70:22:19<55:22:29, 13.03s/it]
 60%|█████▉    | 22662/37963 [70:22:29<51:17:22, 12.07s/it]
 60%|█████▉    | 22663/37963 [70:22:39<48:46:12, 11.48s/it]
 60%|█████▉    | 22664/37963 [70:22:55<55:27:39, 13.05s/it]
 60%|█████▉    | 22665/37963 [70:23:05<51:18:43, 12.07s/it]
 60%|█████▉    | 22666/37963 [70:23:15<48:29:25, 11.41s/it]
 60%|█████▉    | 22667/37963 [70:23:25<46:50:50, 11.03s/it]
 60%|█████▉    | 22668/37963 [70:23:35<45:53:48, 10.80s/it]
 60%|█████▉    | 22669/37963 [70:23:45<44:56:38, 10.58s/it]
 60%|█████▉    | 22670/37963 [70:23:56<44:20:18, 10.44s/it]
                                                           
{'loss': '0.1377', 'grad_norm': '1.296', 'learning_rate': '7.371e-06', 'epoch': '0.5972'}

 60%|█████▉    | 22670/37963 [70:23:56<44:20:18, 10.44s/it]
 60%|█████▉    | 22671/37963 [70:24:06<44:02:26, 10.37s/it]
 60%|█████▉    | 22672/37963 [70:24:16<43:41:10, 10.29s/it]
 60%|█████▉    | 22673/37963 [70:24:26<42:57:15, 10.11s/it]
 60%|█████▉    | 22674/37963 [70:24:42<50:56:43, 12.00s/it]
 60%|█████▉    | 22675/37963 [70:24:52<48:48:51, 11.49s/it]
 60%|█████▉    | 22676/37963 [70:25:02<46:56:23, 11.05s/it]
 60%|█████▉    | 22677/37963 [70:25:12<45:41:34, 10.76s/it]
 60%|█████▉    | 22678/37963 [70:25:22<44:34:46, 10.50s/it]
 60%|█████▉    | 22679/37963 [70:25:32<44:09:07, 10.40s/it]
 60%|█████▉    | 22680/37963 [70:25:43<43:48:35, 10.32s/it]
                                                           
{'loss': '0.1271', 'grad_norm': '1.512', 'learning_rate': '7.363e-06', 'epoch': '0.5974'}

 60%|█████▉    | 22680/37963 [70:25:43<43:48:35, 10.32s/it]
 60%|█████▉    | 22681/37963 [70:25:53<43:37:31, 10.28s/it]
 60%|█████▉    | 22682/37963 [70:26:03<43:09:41, 10.17s/it]
 60%|█████▉    | 22683/37963 [70:26:13<43:07:01, 10.16s/it]
 60%|█████▉    | 22684/37963 [70:26:23<43:04:32, 10.15s/it]
 60%|█████▉    | 22685/37963 [70:26:33<43:01:56, 10.14s/it]
 60%|█████▉    | 22686/37963 [70:26:43<42:57:41, 10.12s/it]
 60%|█████▉    | 22687/37963 [70:26:53<42:58:28, 10.13s/it]
 60%|█████▉    | 22688/37963 [70:27:03<42:38:35, 10.05s/it]
 60%|█████▉    | 22689/37963 [70:27:13<42:46:56, 10.08s/it]
 60%|█████▉    | 22690/37963 [70:27:23<42:12:30,  9.95s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '1.904', 'learning_rate': '7.355e-06', 'epoch': '0.5977'}

 60%|█████▉    | 22690/37963 [70:27:23<42:12:30,  9.95s/it]
 60%|█████▉    | 22691/37963 [70:27:33<42:41:55, 10.07s/it]
 60%|█████▉    | 22692/37963 [70:27:43<42:32:41, 10.03s/it]
 60%|█████▉    | 22693/37963 [70:27:53<42:34:32, 10.04s/it]
 60%|█████▉    | 22694/37963 [70:28:03<42:38:54, 10.06s/it]
 60%|█████▉    | 22695/37963 [70:28:14<42:52:12, 10.11s/it]
 60%|█████▉    | 22696/37963 [70:28:31<52:07:48, 12.29s/it]
 60%|█████▉    | 22697/37963 [70:28:41<49:24:23, 11.65s/it]
 60%|█████▉    | 22698/37963 [70:28:51<47:21:54, 11.17s/it]
 60%|█████▉    | 22699/37963 [70:29:01<46:02:30, 10.86s/it]
 60%|█████▉    | 22700/37963 [70:29:11<45:02:44, 10.62s/it]
                                                           
{'loss': '0.1317', 'grad_norm': '3.565', 'learning_rate': '7.346e-06', 'epoch': '0.598'}

 60%|█████▉    | 22700/37963 [70:29:11<45:02:44, 10.62s/it]
 60%|█████▉    | 22701/37963 [70:29:35<61:28:41, 14.50s/it]
 60%|█████▉    | 22702/37963 [70:29:45<55:54:20, 13.19s/it]
 60%|█████▉    | 22703/37963 [70:29:55<51:57:22, 12.26s/it]
 60%|█████▉    | 22704/37963 [70:30:11<57:05:50, 13.47s/it]
 60%|█████▉    | 22705/37963 [70:30:28<61:00:35, 14.39s/it]
 60%|█████▉    | 22706/37963 [70:30:38<55:35:41, 13.12s/it]
 60%|█████▉    | 22707/37963 [70:30:48<51:49:22, 12.23s/it]
 60%|█████▉    | 22708/37963 [70:31:05<57:14:32, 13.51s/it]
 60%|█████▉    | 22709/37963 [70:31:15<52:37:32, 12.42s/it]
 60%|█████▉    | 22710/37963 [70:31:24<48:57:51, 11.56s/it]
                                                           
{'loss': '0.1346', 'grad_norm': '2.061', 'learning_rate': '7.338e-06', 'epoch': '0.5982'}

 60%|█████▉    | 22710/37963 [70:31:24<48:57:51, 11.56s/it]
 60%|█████▉    | 22711/37963 [70:31:34<47:12:15, 11.14s/it]
 60%|█████▉    | 22712/37963 [70:31:52<54:47:59, 12.94s/it]
 60%|█████▉    | 22713/37963 [70:32:01<50:54:03, 12.02s/it]
 60%|█████▉    | 22714/37963 [70:32:12<48:38:00, 11.48s/it]
 60%|█████▉    | 22715/37963 [70:32:22<46:45:10, 11.04s/it]
 60%|█████▉    | 22716/37963 [70:32:32<45:36:56, 10.77s/it]
 60%|█████▉    | 22717/37963 [70:32:42<45:03:24, 10.64s/it]
 60%|█████▉    | 22718/37963 [70:32:52<44:04:58, 10.41s/it]
 60%|█████▉    | 22719/37963 [70:33:02<43:32:18, 10.28s/it]
 60%|█████▉    | 22720/37963 [70:33:12<43:19:30, 10.23s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '4.308', 'learning_rate': '7.33e-06', 'epoch': '0.5985'}

 60%|█████▉    | 22720/37963 [70:33:12<43:19:30, 10.23s/it]
 60%|█████▉    | 22721/37963 [70:33:22<43:16:40, 10.22s/it]
 60%|█████▉    | 22722/37963 [70:33:39<51:00:54, 12.05s/it]
 60%|█████▉    | 22723/37963 [70:33:49<48:26:41, 11.44s/it]
 60%|█████▉    | 22724/37963 [70:33:59<46:40:07, 11.02s/it]
 60%|█████▉    | 22725/37963 [70:34:09<45:23:40, 10.72s/it]
 60%|█████▉    | 22726/37963 [70:34:19<44:24:49, 10.49s/it]
 60%|█████▉    | 22727/37963 [70:34:29<43:35:51, 10.30s/it]
 60%|█████▉    | 22728/37963 [70:34:39<43:20:10, 10.24s/it]
 60%|█████▉    | 22729/37963 [70:34:49<43:14:40, 10.22s/it]
 60%|█████▉    | 22730/37963 [70:34:59<42:58:54, 10.16s/it]
                                                           
{'loss': '0.1256', 'grad_norm': '2.058', 'learning_rate': '7.322e-06', 'epoch': '0.5987'}

 60%|█████▉    | 22730/37963 [70:34:59<42:58:54, 10.16s/it]
 60%|█████▉    | 22731/37963 [70:35:09<42:38:27, 10.08s/it]
 60%|█████▉    | 22732/37963 [70:35:19<42:47:44, 10.12s/it]
 60%|█████▉    | 22733/37963 [70:35:29<43:01:42, 10.17s/it]
 60%|█████▉    | 22734/37963 [70:35:39<42:55:26, 10.15s/it]
 60%|█████▉    | 22735/37963 [70:35:49<42:51:39, 10.13s/it]
 60%|█████▉    | 22736/37963 [70:35:59<42:49:26, 10.12s/it]
 60%|█████▉    | 22737/37963 [70:36:10<42:50:10, 10.13s/it]
 60%|█████▉    | 22738/37963 [70:36:20<42:47:28, 10.12s/it]
 60%|█████▉    | 22739/37963 [70:36:30<42:56:12, 10.15s/it]
 60%|█████▉    | 22740/37963 [70:36:40<42:56:01, 10.15s/it]
                                                           
{'loss': '0.1227', 'grad_norm': '1.424', 'learning_rate': '7.314e-06', 'epoch': '0.599'}

 60%|█████▉    | 22740/37963 [70:36:40<42:56:01, 10.15s/it]
 60%|█████▉    | 22741/37963 [70:36:50<42:54:06, 10.15s/it]
 60%|█████▉    | 22742/37963 [70:37:00<42:53:57, 10.15s/it]
 60%|█████▉    | 22743/37963 [70:37:11<42:57:17, 10.16s/it]
 60%|█████▉    | 22744/37963 [70:37:28<52:08:48, 12.34s/it]
 60%|█████▉    | 22745/37963 [70:37:38<49:21:41, 11.68s/it]
 60%|█████▉    | 22746/37963 [70:37:48<47:08:50, 11.15s/it]
 60%|█████▉    | 22747/37963 [70:37:58<45:45:14, 10.83s/it]
 60%|█████▉    | 22748/37963 [70:38:15<53:36:36, 12.68s/it]
 60%|█████▉    | 22749/37963 [70:38:31<57:53:35, 13.70s/it]
 60%|█████▉    | 22750/37963 [70:38:41<52:56:42, 12.53s/it]
                                                           
{'loss': '0.1258', 'grad_norm': '1.464', 'learning_rate': '7.305e-06', 'epoch': '0.5993'}

 60%|█████▉    | 22750/37963 [70:38:41<52:56:42, 12.53s/it]
 60%|█████▉    | 22751/37963 [70:38:51<49:51:52, 11.80s/it]
 60%|█████▉    | 22752/37963 [70:39:07<55:39:17, 13.17s/it]
 60%|█████▉    | 22753/37963 [70:39:25<61:11:43, 14.48s/it]
 60%|█████▉    | 22754/37963 [70:39:35<55:50:51, 13.22s/it]
 60%|█████▉    | 22755/37963 [70:39:45<51:59:58, 12.31s/it]
 60%|█████▉    | 22756/37963 [70:40:02<57:13:08, 13.55s/it]
 60%|█████▉    | 22757/37963 [70:40:12<52:49:07, 12.50s/it]
 60%|█████▉    | 22758/37963 [70:40:22<49:53:50, 11.81s/it]
 60%|█████▉    | 22759/37963 [70:40:32<47:29:19, 11.24s/it]
 60%|█████▉    | 22760/37963 [70:40:48<53:58:49, 12.78s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '2.808', 'learning_rate': '7.297e-06', 'epoch': '0.5995'}

 60%|█████▉    | 22760/37963 [70:40:48<53:58:49, 12.78s/it]
 60%|█████▉    | 22761/37963 [70:40:59<50:36:35, 11.98s/it]
 60%|█████▉    | 22762/37963 [70:41:09<48:20:11, 11.45s/it]
 60%|█████▉    | 22763/37963 [70:41:18<45:58:34, 10.89s/it]
 60%|█████▉    | 22764/37963 [70:41:28<44:55:11, 10.64s/it]
 60%|█████▉    | 22765/37963 [70:41:39<44:12:59, 10.47s/it]
 60%|█████▉    | 22766/37963 [70:41:49<43:39:42, 10.34s/it]
 60%|█████▉    | 22767/37963 [70:41:58<43:06:45, 10.21s/it]
 60%|█████▉    | 22768/37963 [70:42:09<42:53:16, 10.16s/it]
 60%|█████▉    | 22769/37963 [70:42:19<42:50:41, 10.15s/it]
 60%|█████▉    | 22770/37963 [70:42:35<50:40:55, 12.01s/it]
                                                           
{'loss': '0.1314', 'grad_norm': '2.323', 'learning_rate': '7.289e-06', 'epoch': '0.5998'}

 60%|█████▉    | 22770/37963 [70:42:35<50:40:55, 12.01s/it]
 60%|█████▉    | 22771/37963 [70:42:45<48:13:43, 11.43s/it]
 60%|█████▉    | 22772/37963 [70:42:55<46:31:30, 11.03s/it]
 60%|█████▉    | 22773/37963 [70:43:05<45:21:05, 10.75s/it]
 60%|█████▉    | 22774/37963 [70:43:15<44:20:22, 10.51s/it]
 60%|█████▉    | 22775/37963 [70:43:25<43:53:50, 10.40s/it]
 60%|█████▉    | 22776/37963 [70:43:35<43:22:04, 10.28s/it]
 60%|█████▉    | 22777/37963 [70:43:45<43:07:01, 10.22s/it]
 60%|██████    | 22778/37963 [70:43:55<42:54:00, 10.17s/it]
 60%|██████    | 22779/37963 [70:44:05<42:30:17, 10.08s/it]
 60%|██████    | 22780/37963 [70:44:15<42:33:54, 10.09s/it]
                                                           
{'loss': '0.1384', 'grad_norm': '1.336', 'learning_rate': '7.281e-06', 'epoch': '0.6001'}

 60%|██████    | 22780/37963 [70:44:15<42:33:54, 10.09s/it]
 60%|██████    | 22781/37963 [70:44:25<41:59:50,  9.96s/it]
 60%|██████    | 22782/37963 [70:44:35<42:11:37, 10.01s/it]
 60%|██████    | 22783/37963 [70:44:45<42:11:29, 10.01s/it]
 60%|██████    | 22784/37963 [70:44:56<42:32:46, 10.09s/it]
 60%|██████    | 22785/37963 [70:45:06<42:45:34, 10.14s/it]
 60%|██████    | 22786/37963 [70:45:16<42:39:24, 10.12s/it]
 60%|██████    | 22787/37963 [70:45:26<42:33:31, 10.10s/it]
 60%|██████    | 22788/37963 [70:45:36<42:38:13, 10.11s/it]
 60%|██████    | 22789/37963 [70:45:46<42:20:35, 10.05s/it]
 60%|██████    | 22790/37963 [70:45:56<41:56:25,  9.95s/it]
                                                           
{'loss': '0.1373', 'grad_norm': '2.922', 'learning_rate': '7.273e-06', 'epoch': '0.6003'}

 60%|██████    | 22790/37963 [70:45:56<41:56:25,  9.95s/it]
 60%|██████    | 22791/37963 [70:46:06<42:09:15, 10.00s/it]
 60%|██████    | 22792/37963 [70:46:22<50:14:36, 11.92s/it]
 60%|██████    | 22793/37963 [70:46:32<47:31:19, 11.28s/it]
 60%|██████    | 22794/37963 [70:46:42<46:00:35, 10.92s/it]
 60%|██████    | 22795/37963 [70:46:52<44:55:33, 10.66s/it]
 60%|██████    | 22796/37963 [70:47:02<44:18:03, 10.52s/it]
 60%|██████    | 22797/37963 [70:47:26<61:01:24, 14.49s/it]
 60%|██████    | 22798/37963 [70:47:36<55:18:14, 13.13s/it]
 60%|██████    | 22799/37963 [70:47:46<51:21:05, 12.19s/it]
 60%|██████    | 22800/37963 [70:48:02<56:36:59, 13.44s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '3.767', 'learning_rate': '7.264e-06', 'epoch': '0.6006'}

 60%|██████    | 22800/37963 [70:48:02<56:36:59, 13.44s/it]
 60%|██████    | 22801/37963 [70:48:19<61:03:32, 14.50s/it]
 60%|██████    | 22802/37963 [70:48:29<55:34:17, 13.20s/it]
 60%|██████    | 22803/37963 [70:48:39<51:26:56, 12.22s/it]
 60%|██████    | 22804/37963 [70:48:50<48:50:34, 11.60s/it]
 60%|██████    | 22805/37963 [70:49:06<55:26:32, 13.17s/it]
 60%|██████    | 22806/37963 [70:49:17<51:35:02, 12.25s/it]
 60%|██████    | 22807/37963 [70:49:26<48:28:40, 11.51s/it]
 60%|██████    | 22808/37963 [70:49:43<55:05:26, 13.09s/it]
 60%|██████    | 22809/37963 [70:49:53<51:22:35, 12.21s/it]
 60%|██████    | 22810/37963 [70:50:03<48:49:32, 11.60s/it]
                                                           
{'loss': '0.1349', 'grad_norm': '1.952', 'learning_rate': '7.256e-06', 'epoch': '0.6009'}

 60%|██████    | 22810/37963 [70:50:03<48:49:32, 11.60s/it]
 60%|██████    | 22811/37963 [70:50:13<46:53:45, 11.14s/it]
 60%|██████    | 22812/37963 [70:50:24<45:39:29, 10.85s/it]
 60%|██████    | 22813/37963 [70:50:34<44:25:07, 10.55s/it]
 60%|██████    | 22814/37963 [70:50:44<43:56:34, 10.44s/it]
 60%|██████    | 22815/37963 [70:50:54<43:29:07, 10.33s/it]
 60%|██████    | 22816/37963 [70:51:04<43:12:09, 10.27s/it]
 60%|██████    | 22817/37963 [70:51:14<43:00:19, 10.22s/it]
 60%|██████    | 22818/37963 [70:51:30<50:52:35, 12.09s/it]
 60%|██████    | 22819/37963 [70:51:41<48:38:30, 11.56s/it]
 60%|██████    | 22820/37963 [70:51:51<46:59:54, 11.17s/it]
                                                           
{'loss': '0.135', 'grad_norm': '1.288', 'learning_rate': '7.248e-06', 'epoch': '0.6011'}

 60%|██████    | 22820/37963 [70:51:51<46:59:54, 11.17s/it]
 60%|██████    | 22821/37963 [70:52:01<45:10:33, 10.74s/it]
 60%|██████    | 22822/37963 [70:52:11<44:16:43, 10.53s/it]
 60%|██████    | 22823/37963 [70:52:21<43:50:02, 10.42s/it]
 60%|██████    | 22824/37963 [70:52:31<43:10:38, 10.27s/it]
 60%|██████    | 22825/37963 [70:52:41<43:15:35, 10.29s/it]
 60%|██████    | 22826/37963 [70:52:51<42:54:17, 10.20s/it]
 60%|██████    | 22827/37963 [70:53:01<42:49:36, 10.19s/it]
 60%|██████    | 22828/37963 [70:53:11<42:35:31, 10.13s/it]
 60%|██████    | 22829/37963 [70:53:22<42:41:08, 10.15s/it]
 60%|██████    | 22830/37963 [70:53:32<42:29:43, 10.11s/it]
                                                           
{'loss': '0.1384', 'grad_norm': '3.346', 'learning_rate': '7.24e-06', 'epoch': '0.6014'}

 60%|██████    | 22830/37963 [70:53:32<42:29:43, 10.11s/it]
 60%|██████    | 22831/37963 [70:53:42<42:28:32, 10.11s/it]
 60%|██████    | 22832/37963 [70:53:52<42:23:53, 10.09s/it]
 60%|██████    | 22833/37963 [70:54:02<42:10:10, 10.03s/it]
 60%|██████    | 22834/37963 [70:54:12<42:11:00, 10.04s/it]
 60%|██████    | 22835/37963 [70:54:22<42:20:27, 10.08s/it]
 60%|██████    | 22836/37963 [70:54:32<42:19:55, 10.07s/it]
 60%|██████    | 22837/37963 [70:54:42<42:22:52, 10.09s/it]
 60%|██████    | 22838/37963 [70:54:52<42:27:09, 10.10s/it]
 60%|██████    | 22839/37963 [70:55:02<42:26:58, 10.10s/it]
 60%|██████    | 22840/37963 [70:55:20<51:29:39, 12.26s/it]
                                                           
{'loss': '0.1171', 'grad_norm': '1.212', 'learning_rate': '7.232e-06', 'epoch': '0.6016'}

 60%|██████    | 22840/37963 [70:55:20<51:29:39, 12.26s/it]
 60%|██████    | 22841/37963 [70:55:30<48:52:32, 11.64s/it]
 60%|██████    | 22842/37963 [70:55:40<46:49:59, 11.15s/it]
 60%|██████    | 22843/37963 [70:55:50<45:30:08, 10.83s/it]
 60%|██████    | 22844/37963 [70:56:00<44:13:14, 10.53s/it]
 60%|██████    | 22845/37963 [70:56:10<43:37:34, 10.39s/it]
 60%|██████    | 22846/37963 [70:56:33<60:00:56, 14.29s/it]
 60%|██████    | 22847/37963 [70:56:43<54:23:41, 12.95s/it]
 60%|██████    | 22848/37963 [70:57:06<67:32:44, 16.09s/it]
 60%|██████    | 22849/37963 [70:57:17<60:02:51, 14.30s/it]
 60%|██████    | 22850/37963 [70:57:26<54:07:54, 12.89s/it]
                                                           
{'loss': '0.1368', 'grad_norm': '1.852', 'learning_rate': '7.223e-06', 'epoch': '0.6019'}

 60%|██████    | 22850/37963 [70:57:26<54:07:54, 12.89s/it]
 60%|██████    | 22851/37963 [70:57:36<49:58:54, 11.91s/it]
 60%|██████    | 22852/37963 [70:57:46<47:26:01, 11.30s/it]
 60%|██████    | 22853/37963 [70:58:02<54:02:56, 12.88s/it]
 60%|██████    | 22854/37963 [70:58:12<50:31:36, 12.04s/it]
 60%|██████    | 22855/37963 [70:58:22<48:03:13, 11.45s/it]
 60%|██████    | 22856/37963 [70:58:39<55:11:07, 13.15s/it]
 60%|██████    | 22857/37963 [70:58:50<51:41:05, 12.32s/it]
 60%|██████    | 22858/37963 [70:59:00<49:04:49, 11.70s/it]
 60%|██████    | 22859/37963 [70:59:10<46:40:26, 11.12s/it]
 60%|██████    | 22860/37963 [70:59:20<45:09:54, 10.77s/it]
                                                           
{'loss': '0.1293', 'grad_norm': '2.085', 'learning_rate': '7.215e-06', 'epoch': '0.6022'}

 60%|██████    | 22860/37963 [70:59:20<45:09:54, 10.77s/it]
 60%|██████    | 22861/37963 [70:59:30<44:14:59, 10.55s/it]
 60%|██████    | 22862/37963 [70:59:40<43:38:01, 10.40s/it]
 60%|██████    | 22863/37963 [70:59:50<43:29:21, 10.37s/it]
 60%|██████    | 22864/37963 [71:00:00<42:20:30, 10.10s/it]
 60%|██████    | 22865/37963 [71:00:10<42:08:36, 10.05s/it]
 60%|██████    | 22866/37963 [71:00:26<50:13:30, 11.98s/it]
 60%|██████    | 22867/37963 [71:00:36<47:57:07, 11.44s/it]
 60%|██████    | 22868/37963 [71:00:46<46:13:37, 11.02s/it]
 60%|██████    | 22869/37963 [71:00:57<45:19:22, 10.81s/it]
 60%|██████    | 22870/37963 [71:01:07<44:30:06, 10.61s/it]
                                                           
{'loss': '0.1298', 'grad_norm': '2.274', 'learning_rate': '7.207e-06', 'epoch': '0.6024'}

 60%|██████    | 22870/37963 [71:01:07<44:30:06, 10.61s/it]
 60%|██████    | 22871/37963 [71:01:17<43:50:59, 10.46s/it]
 60%|██████    | 22872/37963 [71:01:27<43:25:30, 10.36s/it]
 60%|██████    | 22873/37963 [71:01:37<43:16:09, 10.32s/it]
 60%|██████    | 22874/37963 [71:01:47<42:37:36, 10.17s/it]
 60%|██████    | 22875/37963 [71:01:57<42:37:17, 10.17s/it]
 60%|██████    | 22876/37963 [71:02:07<42:23:13, 10.11s/it]
 60%|██████    | 22877/37963 [71:02:17<42:19:46, 10.10s/it]
 60%|██████    | 22878/37963 [71:02:28<42:32:43, 10.15s/it]
 60%|██████    | 22879/37963 [71:02:37<42:10:53, 10.07s/it]
 60%|██████    | 22880/37963 [71:02:48<42:14:24, 10.08s/it]
                                                           
{'loss': '0.137', 'grad_norm': '2.674', 'learning_rate': '7.199e-06', 'epoch': '0.6027'}

 60%|██████    | 22880/37963 [71:02:48<42:14:24, 10.08s/it]
 60%|██████    | 22881/37963 [71:02:58<42:13:54, 10.08s/it]
 60%|██████    | 22882/37963 [71:03:08<42:19:09, 10.10s/it]
 60%|██████    | 22883/37963 [71:03:17<41:51:22,  9.99s/it]
 60%|██████    | 22884/37963 [71:03:27<41:39:35,  9.95s/it]
 60%|██████    | 22885/37963 [71:03:37<41:52:02, 10.00s/it]
 60%|██████    | 22886/37963 [71:03:47<41:07:45,  9.82s/it]
 60%|██████    | 22887/37963 [71:03:56<40:52:15,  9.76s/it]
 60%|██████    | 22888/37963 [71:04:06<41:11:29,  9.84s/it]
 60%|██████    | 22889/37963 [71:04:24<50:34:26, 12.08s/it]
 60%|██████    | 22890/37963 [71:04:34<48:13:08, 11.52s/it]
                                                           
{'loss': '0.1353', 'grad_norm': '1.565', 'learning_rate': '7.191e-06', 'epoch': '0.603'}

 60%|██████    | 22890/37963 [71:04:34<48:13:08, 11.52s/it]
 60%|██████    | 22891/37963 [71:04:44<46:26:25, 11.09s/it]
 60%|██████    | 22892/37963 [71:04:54<45:25:00, 10.85s/it]
 60%|██████    | 22893/37963 [71:05:04<44:22:33, 10.60s/it]
 60%|██████    | 22894/37963 [71:05:28<60:15:52, 14.40s/it]
 60%|██████    | 22895/37963 [71:05:37<54:13:00, 12.95s/it]
 60%|██████    | 22896/37963 [71:05:54<58:30:10, 13.98s/it]
 60%|██████    | 22897/37963 [71:06:10<61:57:23, 14.80s/it]
 60%|██████    | 22898/37963 [71:06:20<56:03:34, 13.40s/it]
 60%|██████    | 22899/37963 [71:06:31<52:00:39, 12.43s/it]
 60%|██████    | 22900/37963 [71:06:41<49:06:36, 11.74s/it]
                                                           
{'loss': '0.1373', 'grad_norm': '2.22', 'learning_rate': '7.182e-06', 'epoch': '0.6032'}

 60%|██████    | 22900/37963 [71:06:41<49:06:36, 11.74s/it]
 60%|██████    | 22901/37963 [71:06:57<55:01:17, 13.15s/it]
 60%|██████    | 22902/37963 [71:07:07<50:30:01, 12.07s/it]
 60%|██████    | 22903/37963 [71:07:24<56:32:50, 13.52s/it]
 60%|██████    | 22904/37963 [71:07:33<51:40:51, 12.35s/it]
 60%|██████    | 22905/37963 [71:07:43<48:57:13, 11.70s/it]
 60%|██████    | 22906/37963 [71:07:54<46:56:41, 11.22s/it]
 60%|██████    | 22907/37963 [71:08:04<45:33:35, 10.89s/it]
 60%|██████    | 22908/37963 [71:08:14<44:32:21, 10.65s/it]
 60%|██████    | 22909/37963 [71:08:24<43:48:19, 10.48s/it]
 60%|██████    | 22910/37963 [71:08:34<43:17:16, 10.35s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '2.17', 'learning_rate': '7.174e-06', 'epoch': '0.6035'}

 60%|██████    | 22910/37963 [71:08:34<43:17:16, 10.35s/it]
 60%|██████    | 22911/37963 [71:08:44<42:57:24, 10.27s/it]
 60%|██████    | 22912/37963 [71:08:54<42:46:29, 10.23s/it]
 60%|██████    | 22913/37963 [71:09:04<42:37:35, 10.20s/it]
 60%|██████    | 22914/37963 [71:09:14<42:25:46, 10.15s/it]
 60%|██████    | 22915/37963 [71:09:31<50:26:32, 12.07s/it]
 60%|██████    | 22916/37963 [71:09:41<47:52:57, 11.46s/it]
 60%|██████    | 22917/37963 [71:09:51<46:09:26, 11.04s/it]
 60%|██████    | 22918/37963 [71:10:01<44:58:59, 10.76s/it]
 60%|██████    | 22919/37963 [71:10:11<44:04:51, 10.55s/it]
 60%|██████    | 22920/37963 [71:10:21<43:14:10, 10.35s/it]
                                                           
{'loss': '0.1255', 'grad_norm': '0.9132', 'learning_rate': '7.166e-06', 'epoch': '0.6037'}

 60%|██████    | 22920/37963 [71:10:21<43:14:10, 10.35s/it]
 60%|██████    | 22921/37963 [71:10:31<42:43:33, 10.23s/it]
 60%|██████    | 22922/37963 [71:10:41<42:17:47, 10.12s/it]
 60%|██████    | 22923/37963 [71:10:51<42:11:20, 10.10s/it]
 60%|██████    | 22924/37963 [71:11:01<42:09:17, 10.09s/it]
 60%|██████    | 22925/37963 [71:11:11<42:02:39, 10.07s/it]
 60%|██████    | 22926/37963 [71:11:21<42:20:17, 10.14s/it]
 60%|██████    | 22927/37963 [71:11:31<42:21:29, 10.14s/it]
 60%|██████    | 22928/37963 [71:11:41<42:10:48, 10.10s/it]
 60%|██████    | 22929/37963 [71:11:51<42:08:26, 10.09s/it]
 60%|██████    | 22930/37963 [71:12:02<42:11:46, 10.10s/it]
                                                           
{'loss': '0.1236', 'grad_norm': '1.652', 'learning_rate': '7.158e-06', 'epoch': '0.604'}

 60%|██████    | 22930/37963 [71:12:02<42:11:46, 10.10s/it]
 60%|██████    | 22931/37963 [71:12:12<42:06:50, 10.09s/it]
 60%|██████    | 22932/37963 [71:12:22<42:15:01, 10.12s/it]
 60%|██████    | 22933/37963 [71:12:32<42:10:23, 10.10s/it]
 60%|██████    | 22934/37963 [71:12:42<42:13:44, 10.12s/it]
 60%|██████    | 22935/37963 [71:12:52<42:14:41, 10.12s/it]
 60%|██████    | 22936/37963 [71:13:02<42:05:27, 10.08s/it]
 60%|██████    | 22937/37963 [71:13:19<50:09:44, 12.02s/it]
 60%|██████    | 22938/37963 [71:13:29<47:57:16, 11.49s/it]
 60%|██████    | 22939/37963 [71:13:39<45:42:49, 10.95s/it]
 60%|██████    | 22940/37963 [71:13:49<44:42:07, 10.71s/it]
                                                           
{'loss': '0.1296', 'grad_norm': '2.424', 'learning_rate': '7.15e-06', 'epoch': '0.6043'}

 60%|██████    | 22940/37963 [71:13:49<44:42:07, 10.71s/it]
 60%|██████    | 22941/37963 [71:14:05<51:39:36, 12.38s/it]
 60%|██████    | 22942/37963 [71:14:15<48:47:17, 11.69s/it]
 60%|██████    | 22943/37963 [71:14:32<55:15:14, 13.24s/it]
 60%|██████    | 22944/37963 [71:14:42<51:10:10, 12.27s/it]
 60%|██████    | 22945/37963 [71:14:58<56:12:14, 13.47s/it]
 60%|██████    | 22946/37963 [71:15:15<60:21:56, 14.47s/it]
 60%|██████    | 22947/37963 [71:15:25<54:52:32, 13.16s/it]
 60%|██████    | 22948/37963 [71:15:35<51:00:28, 12.23s/it]
 60%|██████    | 22949/37963 [71:15:45<48:09:13, 11.55s/it]
 60%|██████    | 22950/37963 [71:15:55<46:18:03, 11.10s/it]
                                                           
{'loss': '0.1315', 'grad_norm': '1.596', 'learning_rate': '7.141e-06', 'epoch': '0.6045'}

 60%|██████    | 22950/37963 [71:15:55<46:18:03, 11.10s/it]
 60%|██████    | 22951/37963 [71:16:18<61:05:37, 14.65s/it]
 60%|██████    | 22952/37963 [71:16:28<55:33:51, 13.33s/it]
 60%|██████    | 22953/37963 [71:16:38<51:20:07, 12.31s/it]
 60%|██████    | 22954/37963 [71:16:48<48:31:19, 11.64s/it]
 60%|██████    | 22955/37963 [71:16:59<46:45:10, 11.21s/it]
 60%|██████    | 22956/37963 [71:17:09<45:06:29, 10.82s/it]
 60%|██████    | 22957/37963 [71:17:19<44:05:53, 10.58s/it]
 60%|██████    | 22958/37963 [71:17:29<43:28:02, 10.43s/it]
 60%|██████    | 22959/37963 [71:17:39<42:44:05, 10.25s/it]
 60%|██████    | 22960/37963 [71:17:49<42:30:37, 10.20s/it]
                                                           
{'loss': '0.1386', 'grad_norm': '2.341', 'learning_rate': '7.133e-06', 'epoch': '0.6048'}

 60%|██████    | 22960/37963 [71:17:49<42:30:37, 10.20s/it]
 60%|██████    | 22961/37963 [71:17:59<42:13:43, 10.13s/it]
 60%|██████    | 22962/37963 [71:18:09<42:18:14, 10.15s/it]
 60%|██████    | 22963/37963 [71:18:19<42:27:18, 10.19s/it]
 60%|██████    | 22964/37963 [71:18:35<50:10:13, 12.04s/it]
 60%|██████    | 22965/37963 [71:18:45<47:42:03, 11.45s/it]
 60%|██████    | 22966/37963 [71:18:56<46:03:41, 11.06s/it]
 60%|██████    | 22967/37963 [71:19:06<44:52:04, 10.77s/it]
 61%|██████    | 22968/37963 [71:19:16<44:01:52, 10.57s/it]
 61%|██████    | 22969/37963 [71:19:26<43:07:22, 10.35s/it]
 61%|██████    | 22970/37963 [71:19:36<42:48:53, 10.28s/it]
                                                           
{'loss': '0.1294', 'grad_norm': '4.047', 'learning_rate': '7.125e-06', 'epoch': '0.6051'}

 61%|██████    | 22970/37963 [71:19:36<42:48:53, 10.28s/it]
 61%|██████    | 22971/37963 [71:19:46<42:42:28, 10.26s/it]
 61%|██████    | 22972/37963 [71:19:56<42:29:20, 10.20s/it]
 61%|██████    | 22973/37963 [71:20:06<42:24:02, 10.18s/it]
 61%|██████    | 22974/37963 [71:20:16<42:17:22, 10.16s/it]
 61%|██████    | 22975/37963 [71:20:26<42:10:05, 10.13s/it]
 61%|██████    | 22976/37963 [71:20:36<42:06:55, 10.12s/it]
 61%|██████    | 22977/37963 [71:20:47<42:08:22, 10.12s/it]
 61%|██████    | 22978/37963 [71:20:57<42:06:19, 10.12s/it]
 61%|██████    | 22979/37963 [71:21:07<41:58:36, 10.09s/it]
 61%|██████    | 22980/37963 [71:21:16<41:29:59,  9.97s/it]
                                                           
{'loss': '0.1465', 'grad_norm': '1.83', 'learning_rate': '7.117e-06', 'epoch': '0.6053'}

 61%|██████    | 22980/37963 [71:21:16<41:29:59,  9.97s/it]
 61%|██████    | 22981/37963 [71:21:26<41:38:15, 10.01s/it]
 61%|██████    | 22982/37963 [71:21:37<41:42:46, 10.02s/it]
 61%|██████    | 22983/37963 [71:21:47<41:45:27, 10.04s/it]
 61%|██████    | 22984/37963 [71:21:57<42:03:12, 10.11s/it]
 61%|██████    | 22985/37963 [71:22:07<42:01:19, 10.10s/it]
 61%|██████    | 22986/37963 [71:22:17<42:08:38, 10.13s/it]
 61%|██████    | 22987/37963 [71:22:34<50:49:36, 12.22s/it]
 61%|██████    | 22988/37963 [71:22:44<48:12:23, 11.59s/it]
 61%|██████    | 22989/37963 [71:23:01<54:31:42, 13.11s/it]
 61%|██████    | 22990/37963 [71:23:11<50:35:34, 12.16s/it]
                                                           
{'loss': '0.1286', 'grad_norm': '1.654', 'learning_rate': '7.109e-06', 'epoch': '0.6056'}

 61%|██████    | 22990/37963 [71:23:11<50:35:34, 12.16s/it]
 61%|██████    | 22991/37963 [71:23:28<56:00:41, 13.47s/it]
 61%|██████    | 22992/37963 [71:23:44<59:48:47, 14.38s/it]
 61%|██████    | 22993/37963 [71:23:54<54:09:33, 13.02s/it]
 61%|██████    | 22994/37963 [71:24:04<50:33:29, 12.16s/it]
 61%|██████    | 22995/37963 [71:24:21<56:39:25, 13.63s/it]
 61%|██████    | 22996/37963 [71:24:31<51:58:51, 12.50s/it]
 61%|██████    | 22997/37963 [71:24:41<48:49:20, 11.74s/it]
 61%|██████    | 22998/37963 [71:24:51<46:46:27, 11.25s/it]
 61%|██████    | 22999/37963 [71:25:08<53:55:11, 12.97s/it]
 61%|██████    | 23000/37963 [71:25:25<58:46:16, 14.14s/it]
                                                           
{'loss': '0.1256', 'grad_norm': '1.278', 'learning_rate': '7.101e-06', 'epoch': '0.6059'}

 61%|██████    | 23000/37963 [71:25:25<58:46:16, 14.14s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.82s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.83s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 61%|██████    | 23001/37963 [71:26:22<112:44:19, 27.13s/it]
 61%|██████    | 23002/37963 [71:26:32<91:04:21, 21.91s/it] 
 61%|██████    | 23003/37963 [71:26:42<76:39:36, 18.45s/it]
 61%|██████    | 23004/37963 [71:26:54<67:32:43, 16.26s/it]
 61%|██████    | 23005/37963 [71:27:04<59:54:33, 14.42s/it]
 61%|██████    | 23006/37963 [71:27:14<54:28:24, 13.11s/it]
 61%|██████    | 23007/37963 [71:27:24<50:28:58, 12.15s/it]
 61%|██████    | 23008/37963 [71:27:34<48:08:41, 11.59s/it]
 61%|██████    | 23009/37963 [71:27:44<45:45:13, 11.01s/it]
 61%|██████    | 23010/37963 [71:27:54<44:51:23, 10.80s/it]
                                                           
{'loss': '0.1301', 'grad_norm': '1.78', 'learning_rate': '7.092e-06', 'epoch': '0.6061'}

 61%|██████    | 23010/37963 [71:27:54<44:51:23, 10.80s/it]
 61%|██████    | 23011/37963 [71:28:04<43:57:10, 10.58s/it]
 61%|██████    | 23012/37963 [71:28:14<43:24:09, 10.45s/it]
 61%|██████    | 23013/37963 [71:28:24<43:04:47, 10.37s/it]
 61%|██████    | 23014/37963 [71:28:41<50:36:56, 12.19s/it]
 61%|██████    | 23015/37963 [71:28:51<48:18:23, 11.63s/it]
 61%|██████    | 23016/37963 [71:29:01<46:22:11, 11.17s/it]
 61%|██████    | 23017/37963 [71:29:11<45:06:45, 10.87s/it]
 61%|██████    | 23018/37963 [71:29:22<44:14:51, 10.66s/it]
 61%|██████    | 23019/37963 [71:29:32<43:37:49, 10.51s/it]
 61%|██████    | 23020/37963 [71:29:42<43:12:32, 10.41s/it]
                                                           
{'loss': '0.1432', 'grad_norm': '2.292', 'learning_rate': '7.084e-06', 'epoch': '0.6064'}

 61%|██████    | 23020/37963 [71:29:42<43:12:32, 10.41s/it]
 61%|██████    | 23021/37963 [71:29:52<42:24:14, 10.22s/it]
 61%|██████    | 23022/37963 [71:30:02<42:05:05, 10.14s/it]
 61%|██████    | 23023/37963 [71:30:12<42:03:55, 10.14s/it]
 61%|██████    | 23024/37963 [71:30:22<42:10:07, 10.16s/it]
 61%|██████    | 23025/37963 [71:30:32<41:55:31, 10.10s/it]
 61%|██████    | 23026/37963 [71:30:42<41:57:14, 10.11s/it]
 61%|██████    | 23027/37963 [71:30:52<41:58:35, 10.12s/it]
 61%|██████    | 23028/37963 [71:31:02<42:11:34, 10.17s/it]
 61%|██████    | 23029/37963 [71:31:13<42:03:46, 10.14s/it]
 61%|██████    | 23030/37963 [71:31:23<42:03:18, 10.14s/it]
                                                           
{'loss': '0.1334', 'grad_norm': '1.796', 'learning_rate': '7.076e-06', 'epoch': '0.6066'}

 61%|██████    | 23030/37963 [71:31:23<42:03:18, 10.14s/it]
 61%|██████    | 23031/37963 [71:31:33<41:58:56, 10.12s/it]
 61%|██████    | 23032/37963 [71:31:43<41:45:13, 10.07s/it]
 61%|██████    | 23033/37963 [71:31:53<41:51:13, 10.09s/it]
 61%|██████    | 23034/37963 [71:32:10<50:27:04, 12.17s/it]
 61%|██████    | 23035/37963 [71:32:19<47:17:34, 11.41s/it]
 61%|██████    | 23036/37963 [71:32:30<45:36:02, 11.00s/it]
 61%|██████    | 23037/37963 [71:32:47<53:12:58, 12.84s/it]
 61%|██████    | 23038/37963 [71:33:03<57:36:56, 13.90s/it]
 61%|██████    | 23039/37963 [71:33:13<52:51:36, 12.75s/it]
 61%|██████    | 23040/37963 [71:33:29<57:21:55, 13.84s/it]
                                                           
{'loss': '0.1319', 'grad_norm': '2.068', 'learning_rate': '7.068e-06', 'epoch': '0.6069'}

 61%|██████    | 23040/37963 [71:33:29<57:21:55, 13.84s/it]
 61%|██████    | 23041/37963 [71:33:40<52:44:53, 12.73s/it]
 61%|██████    | 23042/37963 [71:33:50<49:43:07, 12.00s/it]
 61%|██████    | 23043/37963 [71:34:00<47:34:10, 11.48s/it]
 61%|██████    | 23044/37963 [71:34:10<45:57:16, 11.09s/it]
 61%|██████    | 23045/37963 [71:34:27<52:18:04, 12.62s/it]
 61%|██████    | 23046/37963 [71:34:50<66:12:09, 15.98s/it]
 61%|██████    | 23047/37963 [71:35:01<58:59:44, 14.24s/it]
 61%|██████    | 23048/37963 [71:35:11<53:47:38, 12.98s/it]
 61%|██████    | 23049/37963 [71:35:21<50:11:38, 12.12s/it]
 61%|██████    | 23050/37963 [71:35:31<47:41:26, 11.51s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '3.324', 'learning_rate': '7.06e-06', 'epoch': '0.6072'}

 61%|██████    | 23050/37963 [71:35:31<47:41:26, 11.51s/it]
 61%|██████    | 23051/37963 [71:35:40<45:27:30, 10.97s/it]
 61%|██████    | 23052/37963 [71:35:51<44:32:23, 10.75s/it]
 61%|██████    | 23053/37963 [71:36:01<43:42:07, 10.55s/it]
 61%|██████    | 23054/37963 [71:36:11<42:52:48, 10.35s/it]
 61%|██████    | 23055/37963 [71:36:20<41:50:34, 10.10s/it]
 61%|██████    | 23056/37963 [71:36:30<41:49:42, 10.10s/it]
 61%|██████    | 23057/37963 [71:36:40<41:45:20, 10.08s/it]
 61%|██████    | 23058/37963 [71:36:50<41:32:30, 10.03s/it]
 61%|██████    | 23059/37963 [71:37:00<41:32:18, 10.03s/it]
 61%|██████    | 23060/37963 [71:37:10<41:39:53, 10.06s/it]
                                                           
{'loss': '0.1346', 'grad_norm': '1.325', 'learning_rate': '7.052e-06', 'epoch': '0.6074'}

 61%|██████    | 23060/37963 [71:37:10<41:39:53, 10.06s/it]
 61%|██████    | 23061/37963 [71:37:20<41:33:09, 10.04s/it]
 61%|██████    | 23062/37963 [71:37:37<49:49:45, 12.04s/it]
 61%|██████    | 23063/37963 [71:37:47<47:30:35, 11.48s/it]
 61%|██████    | 23064/37963 [71:37:57<45:51:51, 11.08s/it]
 61%|██████    | 23065/37963 [71:38:07<44:11:59, 10.68s/it]
 61%|██████    | 23066/37963 [71:38:17<43:35:27, 10.53s/it]
 61%|██████    | 23067/37963 [71:38:27<42:57:09, 10.38s/it]
 61%|██████    | 23068/37963 [71:38:38<42:42:00, 10.32s/it]
 61%|██████    | 23069/37963 [71:38:47<41:39:52, 10.07s/it]
 61%|██████    | 23070/37963 [71:38:57<41:34:22, 10.05s/it]
                                                           
{'loss': '0.1257', 'grad_norm': '1.217', 'learning_rate': '7.044e-06', 'epoch': '0.6077'}

 61%|██████    | 23070/37963 [71:38:57<41:34:22, 10.05s/it]
 61%|██████    | 23071/37963 [71:39:07<41:10:13,  9.95s/it]
 61%|██████    | 23072/37963 [71:39:16<40:47:48,  9.86s/it]
 61%|██████    | 23073/37963 [71:39:27<41:04:16,  9.93s/it]
 61%|██████    | 23074/37963 [71:39:37<41:15:51,  9.98s/it]
 61%|██████    | 23075/37963 [71:39:47<41:38:06, 10.07s/it]
 61%|██████    | 23076/37963 [71:39:57<41:38:35, 10.07s/it]
 61%|██████    | 23077/37963 [71:40:07<41:37:32, 10.07s/it]
 61%|██████    | 23078/37963 [71:40:17<41:41:42, 10.08s/it]
 61%|██████    | 23079/37963 [71:40:27<41:47:45, 10.11s/it]
 61%|██████    | 23080/37963 [71:40:37<41:43:44, 10.09s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '0.9701', 'learning_rate': '7.035e-06', 'epoch': '0.608'}

 61%|██████    | 23080/37963 [71:40:37<41:43:44, 10.09s/it]
 61%|██████    | 23081/37963 [71:40:47<41:38:27, 10.07s/it]
 61%|██████    | 23082/37963 [71:41:04<49:58:53, 12.09s/it]
 61%|██████    | 23083/37963 [71:41:14<47:13:59, 11.43s/it]
 61%|██████    | 23084/37963 [71:41:31<54:15:51, 13.13s/it]
 61%|██████    | 23085/37963 [71:41:41<50:33:30, 12.23s/it]
 61%|██████    | 23086/37963 [71:41:52<47:59:35, 11.61s/it]
 61%|██████    | 23087/37963 [71:42:08<53:41:02, 12.99s/it]
 61%|██████    | 23088/37963 [71:42:24<58:04:15, 14.05s/it]
 61%|██████    | 23089/37963 [71:42:34<53:12:35, 12.88s/it]
 61%|██████    | 23090/37963 [71:42:44<49:29:13, 11.98s/it]
                                                           
{'loss': '0.1266', 'grad_norm': '3.012', 'learning_rate': '7.027e-06', 'epoch': '0.6082'}

 61%|██████    | 23090/37963 [71:42:44<49:29:13, 11.98s/it]
 61%|██████    | 23091/37963 [71:42:54<46:55:49, 11.36s/it]
 61%|██████    | 23092/37963 [71:43:04<45:25:30, 11.00s/it]
 61%|██████    | 23093/37963 [71:43:21<52:01:39, 12.60s/it]
 61%|██████    | 23094/37963 [71:43:38<57:16:41, 13.87s/it]
 61%|██████    | 23095/37963 [71:43:55<61:13:45, 14.83s/it]
 61%|██████    | 23096/37963 [71:44:05<55:24:15, 13.42s/it]
 61%|██████    | 23097/37963 [71:44:15<51:17:09, 12.42s/it]
 61%|██████    | 23098/37963 [71:44:25<48:10:57, 11.67s/it]
 61%|██████    | 23099/37963 [71:44:35<46:17:28, 11.21s/it]
 61%|██████    | 23100/37963 [71:44:45<44:37:03, 10.81s/it]
                                                           
{'loss': '0.1393', 'grad_norm': '1.586', 'learning_rate': '7.019e-06', 'epoch': '0.6085'}

 61%|██████    | 23100/37963 [71:44:45<44:37:03, 10.81s/it]
 61%|██████    | 23101/37963 [71:44:55<43:45:34, 10.60s/it]
 61%|██████    | 23102/37963 [71:45:05<43:07:37, 10.45s/it]
 61%|██████    | 23103/37963 [71:45:15<42:40:28, 10.34s/it]
 61%|██████    | 23104/37963 [71:45:25<42:27:13, 10.29s/it]
 61%|██████    | 23105/37963 [71:45:35<41:54:13, 10.15s/it]
 61%|██████    | 23106/37963 [71:45:45<41:39:54, 10.10s/it]
 61%|██████    | 23107/37963 [71:45:55<41:42:03, 10.11s/it]
 61%|██████    | 23108/37963 [71:46:05<41:42:55, 10.11s/it]
 61%|██████    | 23109/37963 [71:46:15<41:38:55, 10.09s/it]
 61%|██████    | 23110/37963 [71:46:25<41:31:04, 10.06s/it]
                                                           
{'loss': '0.1352', 'grad_norm': '1.02', 'learning_rate': '7.011e-06', 'epoch': '0.6088'}

 61%|██████    | 23110/37963 [71:46:25<41:31:04, 10.06s/it]
 61%|██████    | 23111/37963 [71:46:42<49:28:19, 11.99s/it]
 61%|██████    | 23112/37963 [71:46:52<46:57:21, 11.38s/it]
 61%|██████    | 23113/37963 [71:47:02<45:27:45, 11.02s/it]
 61%|██████    | 23114/37963 [71:47:12<44:05:55, 10.69s/it]
 61%|██████    | 23115/37963 [71:47:22<43:25:29, 10.53s/it]
 61%|██████    | 23116/37963 [71:47:32<42:52:43, 10.40s/it]
 61%|██████    | 23117/37963 [71:47:42<42:12:15, 10.23s/it]
 61%|██████    | 23118/37963 [71:47:52<42:02:18, 10.19s/it]
 61%|██████    | 23119/37963 [71:48:02<41:52:38, 10.16s/it]
 61%|██████    | 23120/37963 [71:48:12<41:46:12, 10.13s/it]
                                                           
{'loss': '0.1196', 'grad_norm': '0.9224', 'learning_rate': '7.003e-06', 'epoch': '0.609'}

 61%|██████    | 23120/37963 [71:48:12<41:46:12, 10.13s/it]
 61%|██████    | 23121/37963 [71:48:22<41:50:29, 10.15s/it]
 61%|██████    | 23122/37963 [71:48:32<41:38:48, 10.10s/it]
 61%|██████    | 23123/37963 [71:48:42<41:24:35, 10.05s/it]
 61%|██████    | 23124/37963 [71:48:52<41:23:07, 10.04s/it]
 61%|██████    | 23125/37963 [71:49:02<41:34:02, 10.09s/it]
 61%|██████    | 23126/37963 [71:49:13<41:30:52, 10.07s/it]
 61%|██████    | 23127/37963 [71:49:23<41:44:57, 10.13s/it]
 61%|██████    | 23128/37963 [71:49:33<41:41:01, 10.12s/it]
 61%|██████    | 23129/37963 [71:49:43<41:26:15, 10.06s/it]
 61%|██████    | 23130/37963 [71:49:53<41:30:24, 10.07s/it]
                                                           
{'loss': '0.1383', 'grad_norm': '1.675', 'learning_rate': '6.995e-06', 'epoch': '0.6093'}

 61%|██████    | 23130/37963 [71:49:53<41:30:24, 10.07s/it]
 61%|██████    | 23131/37963 [71:50:03<41:30:41, 10.08s/it]
 61%|██████    | 23132/37963 [71:50:20<50:16:27, 12.20s/it]
 61%|██████    | 23133/37963 [71:50:30<47:42:03, 11.58s/it]
 61%|██████    | 23134/37963 [71:50:47<54:13:24, 13.16s/it]
 61%|██████    | 23135/37963 [71:51:04<58:40:33, 14.25s/it]
 61%|██████    | 23136/37963 [71:51:14<53:29:08, 12.99s/it]
 61%|██████    | 23137/37963 [71:51:30<57:02:58, 13.85s/it]
 61%|██████    | 23138/37963 [71:51:40<52:24:50, 12.73s/it]
 61%|██████    | 23139/37963 [71:51:50<48:52:18, 11.87s/it]
 61%|██████    | 23140/37963 [71:52:00<46:34:09, 11.31s/it]
                                                           
{'loss': '0.138', 'grad_norm': '1.946', 'learning_rate': '6.987e-06', 'epoch': '0.6095'}

 61%|██████    | 23140/37963 [71:52:00<46:34:09, 11.31s/it]
 61%|██████    | 23141/37963 [71:52:10<44:45:36, 10.87s/it]
 61%|██████    | 23142/37963 [71:52:33<59:53:52, 14.55s/it]
 61%|██████    | 23143/37963 [71:52:50<63:05:54, 15.33s/it]
 61%|██████    | 23144/37963 [71:53:00<56:39:42, 13.76s/it]
 61%|██████    | 23145/37963 [71:53:10<52:15:58, 12.70s/it]
 61%|██████    | 23146/37963 [71:53:20<49:02:06, 11.91s/it]
 61%|██████    | 23147/37963 [71:53:30<46:36:24, 11.32s/it]
 61%|██████    | 23148/37963 [71:53:40<45:12:12, 10.98s/it]
 61%|██████    | 23149/37963 [71:53:51<44:06:42, 10.72s/it]
 61%|██████    | 23150/37963 [71:54:01<43:28:32, 10.57s/it]
                                                           
{'loss': '0.158', 'grad_norm': '1.624', 'learning_rate': '6.978e-06', 'epoch': '0.6098'}

 61%|██████    | 23150/37963 [71:54:01<43:28:32, 10.57s/it]
 61%|██████    | 23151/37963 [71:54:11<42:51:45, 10.42s/it]
 61%|██████    | 23152/37963 [71:54:21<42:25:23, 10.31s/it]
 61%|██████    | 23153/37963 [71:54:31<42:04:22, 10.23s/it]
 61%|██████    | 23154/37963 [71:54:41<42:07:41, 10.24s/it]
 61%|██████    | 23155/37963 [71:54:51<41:24:17, 10.07s/it]
 61%|██████    | 23156/37963 [71:55:01<41:45:25, 10.15s/it]
 61%|██████    | 23157/37963 [71:55:11<41:40:36, 10.13s/it]
 61%|██████    | 23158/37963 [71:55:27<48:57:38, 11.91s/it]
 61%|██████    | 23159/37963 [71:55:37<46:46:51, 11.38s/it]
 61%|██████    | 23160/37963 [71:55:47<44:45:04, 10.88s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '1.996', 'learning_rate': '6.97e-06', 'epoch': '0.6101'}

 61%|██████    | 23160/37963 [71:55:47<44:45:04, 10.88s/it]
 61%|██████    | 23161/37963 [71:55:58<43:59:57, 10.70s/it]
 61%|██████    | 23162/37963 [71:56:08<43:17:02, 10.53s/it]
 61%|██████    | 23163/37963 [71:56:18<42:42:10, 10.39s/it]
 61%|██████    | 23164/37963 [71:56:28<42:28:02, 10.33s/it]
 61%|██████    | 23165/37963 [71:56:38<42:12:35, 10.27s/it]
 61%|██████    | 23166/37963 [71:56:48<42:03:26, 10.23s/it]
 61%|██████    | 23167/37963 [71:56:58<41:56:46, 10.21s/it]
 61%|██████    | 23168/37963 [71:57:08<41:31:59, 10.11s/it]
 61%|██████    | 23169/37963 [71:57:18<41:32:15, 10.11s/it]
 61%|██████    | 23170/37963 [71:57:28<40:55:33,  9.96s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '1.512', 'learning_rate': '6.962e-06', 'epoch': '0.6103'}

 61%|██████    | 23170/37963 [71:57:28<40:55:33,  9.96s/it]
 61%|██████    | 23171/37963 [71:57:38<40:53:19,  9.95s/it]
 61%|██████    | 23172/37963 [71:57:48<40:43:30,  9.91s/it]
 61%|██████    | 23173/37963 [71:57:58<41:02:56,  9.99s/it]
 61%|██████    | 23174/37963 [71:58:08<41:07:37, 10.01s/it]
 61%|██████    | 23175/37963 [71:58:18<41:02:21,  9.99s/it]
 61%|██████    | 23176/37963 [71:58:27<40:36:49,  9.89s/it]
 61%|██████    | 23177/37963 [71:58:38<41:07:41, 10.01s/it]
 61%|██████    | 23178/37963 [71:58:48<41:06:04, 10.01s/it]
 61%|██████    | 23179/37963 [71:58:58<41:10:52, 10.03s/it]
 61%|██████    | 23180/37963 [71:59:08<41:17:14, 10.05s/it]
                                                           
{'loss': '0.131', 'grad_norm': '1.359', 'learning_rate': '6.954e-06', 'epoch': '0.6106'}

 61%|██████    | 23180/37963 [71:59:08<41:17:14, 10.05s/it]
 61%|██████    | 23181/37963 [71:59:25<49:21:22, 12.02s/it]
 61%|██████    | 23182/37963 [71:59:34<46:45:18, 11.39s/it]
 61%|██████    | 23183/37963 [71:59:51<53:13:08, 12.96s/it]
 61%|██████    | 23184/37963 [72:00:08<57:37:08, 14.04s/it]
 61%|██████    | 23185/37963 [72:00:18<52:48:57, 12.87s/it]
 61%|██████    | 23186/37963 [72:00:34<57:12:21, 13.94s/it]
 61%|██████    | 23187/37963 [72:00:44<52:32:25, 12.80s/it]
 61%|██████    | 23188/37963 [72:00:54<49:12:36, 11.99s/it]
 61%|██████    | 23189/37963 [72:01:11<54:40:10, 13.32s/it]
 61%|██████    | 23190/37963 [72:01:21<50:22:12, 12.27s/it]
                                                           
{'loss': '0.1468', 'grad_norm': '1.736', 'learning_rate': '6.946e-06', 'epoch': '0.6109'}

 61%|██████    | 23190/37963 [72:01:21<50:22:12, 12.27s/it]
 61%|██████    | 23191/37963 [72:01:38<56:17:32, 13.72s/it]
 61%|██████    | 23192/37963 [72:01:55<60:38:07, 14.78s/it]
 61%|██████    | 23193/37963 [72:02:05<55:01:01, 13.41s/it]
 61%|██████    | 23194/37963 [72:02:16<51:05:20, 12.45s/it]
 61%|██████    | 23195/37963 [72:02:26<48:27:26, 11.81s/it]
 61%|██████    | 23196/37963 [72:02:36<46:31:23, 11.34s/it]
 61%|██████    | 23197/37963 [72:02:46<44:39:05, 10.89s/it]
 61%|██████    | 23198/37963 [72:02:56<43:30:52, 10.61s/it]
 61%|██████    | 23199/37963 [72:03:06<42:59:40, 10.48s/it]
 61%|██████    | 23200/37963 [72:03:16<42:31:05, 10.37s/it]
                                                           
{'loss': '0.1439', 'grad_norm': '1.169', 'learning_rate': '6.938e-06', 'epoch': '0.6111'}

 61%|██████    | 23200/37963 [72:03:16<42:31:05, 10.37s/it]
 61%|██████    | 23201/37963 [72:03:26<41:32:54, 10.13s/it]
 61%|██████    | 23202/37963 [72:03:36<41:27:15, 10.11s/it]
 61%|██████    | 23203/37963 [72:03:46<41:30:57, 10.13s/it]
 61%|██████    | 23204/37963 [72:03:56<41:24:18, 10.10s/it]
 61%|██████    | 23205/37963 [72:04:06<41:25:37, 10.11s/it]
 61%|██████    | 23206/37963 [72:04:16<41:29:04, 10.12s/it]
 61%|██████    | 23207/37963 [72:04:33<49:21:05, 12.04s/it]
 61%|██████    | 23208/37963 [72:04:42<46:01:56, 11.23s/it]
 61%|██████    | 23209/37963 [72:04:52<44:36:44, 10.89s/it]
 61%|██████    | 23210/37963 [72:05:02<43:40:49, 10.66s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '3.321', 'learning_rate': '6.93e-06', 'epoch': '0.6114'}

 61%|██████    | 23210/37963 [72:05:02<43:40:49, 10.66s/it]
 61%|██████    | 23211/37963 [72:05:12<43:01:41, 10.50s/it]
 61%|██████    | 23212/37963 [72:05:23<42:26:47, 10.36s/it]
 61%|██████    | 23213/37963 [72:05:33<42:09:32, 10.29s/it]
 61%|██████    | 23214/37963 [72:05:43<41:43:23, 10.18s/it]
 61%|██████    | 23215/37963 [72:05:53<41:40:33, 10.17s/it]
 61%|██████    | 23216/37963 [72:06:02<41:07:47, 10.04s/it]
 61%|██████    | 23217/37963 [72:06:13<41:29:09, 10.13s/it]
 61%|██████    | 23218/37963 [72:06:23<41:25:16, 10.11s/it]
 61%|██████    | 23219/37963 [72:06:33<41:24:52, 10.11s/it]
 61%|██████    | 23220/37963 [72:06:43<41:26:27, 10.12s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '2.769', 'learning_rate': '6.922e-06', 'epoch': '0.6117'}

 61%|██████    | 23220/37963 [72:06:43<41:26:27, 10.12s/it]
 61%|██████    | 23221/37963 [72:06:53<41:26:33, 10.12s/it]
 61%|██████    | 23222/37963 [72:07:03<41:15:41, 10.08s/it]
 61%|██████    | 23223/37963 [72:07:13<41:25:46, 10.12s/it]
 61%|██████    | 23224/37963 [72:07:24<41:29:15, 10.13s/it]
 61%|██████    | 23225/37963 [72:07:34<41:27:31, 10.13s/it]
 61%|██████    | 23226/37963 [72:07:44<41:24:11, 10.11s/it]
 61%|██████    | 23227/37963 [72:07:54<41:03:58, 10.03s/it]
 61%|██████    | 23228/37963 [72:08:04<41:06:57, 10.05s/it]
 61%|██████    | 23229/37963 [72:08:14<41:12:45, 10.07s/it]
 61%|██████    | 23230/37963 [72:08:31<49:58:25, 12.21s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '1.166', 'learning_rate': '6.913e-06', 'epoch': '0.6119'}

 61%|██████    | 23230/37963 [72:08:31<49:58:25, 12.21s/it]
 61%|██████    | 23231/37963 [72:08:41<47:22:04, 11.58s/it]
 61%|██████    | 23232/37963 [72:09:05<61:57:32, 15.14s/it]
 61%|██████    | 23233/37963 [72:09:15<55:52:45, 13.66s/it]
 61%|██████    | 23234/37963 [72:09:31<59:28:26, 14.54s/it]
 61%|██████    | 23235/37963 [72:09:41<53:19:55, 13.04s/it]
 61%|██████    | 23236/37963 [72:09:51<49:46:16, 12.17s/it]
 61%|██████    | 23237/37963 [72:10:08<55:40:44, 13.61s/it]
 61%|██████    | 23238/37963 [72:10:25<59:35:20, 14.57s/it]
 61%|██████    | 23239/37963 [72:10:35<54:17:59, 13.28s/it]
 61%|██████    | 23240/37963 [72:10:52<58:58:39, 14.42s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '1.77', 'learning_rate': '6.905e-06', 'epoch': '0.6122'}

 61%|██████    | 23240/37963 [72:10:52<58:58:39, 14.42s/it]
 61%|██████    | 23241/37963 [72:11:02<53:09:53, 13.00s/it]
 61%|██████    | 23242/37963 [72:11:12<49:41:19, 12.15s/it]
 61%|██████    | 23243/37963 [72:11:22<47:12:10, 11.54s/it]
 61%|██████    | 23244/37963 [72:11:32<45:25:50, 11.11s/it]
 61%|██████    | 23245/37963 [72:11:42<44:12:15, 10.81s/it]
 61%|██████    | 23246/37963 [72:11:52<43:16:46, 10.59s/it]
 61%|██████    | 23247/37963 [72:12:03<42:39:21, 10.44s/it]
 61%|██████    | 23248/37963 [72:12:13<42:09:33, 10.31s/it]
 61%|██████    | 23249/37963 [72:12:23<41:50:49, 10.24s/it]
 61%|██████    | 23250/37963 [72:12:32<41:11:06, 10.08s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '2.758', 'learning_rate': '6.897e-06', 'epoch': '0.6124'}

 61%|██████    | 23250/37963 [72:12:32<41:11:06, 10.08s/it]
 61%|██████    | 23251/37963 [72:12:42<41:13:48, 10.09s/it]
 61%|██████    | 23252/37963 [72:12:52<41:10:01, 10.07s/it]
 61%|██████▏   | 23253/37963 [72:13:02<40:40:24,  9.95s/it]
 61%|██████▏   | 23254/37963 [72:13:12<40:52:26, 10.00s/it]
 61%|██████▏   | 23255/37963 [72:13:22<40:44:35,  9.97s/it]
 61%|██████▏   | 23256/37963 [72:13:32<40:31:31,  9.92s/it]
 61%|██████▏   | 23257/37963 [72:13:49<48:40:32, 11.92s/it]
 61%|██████▏   | 23258/37963 [72:13:58<46:10:10, 11.30s/it]
 61%|██████▏   | 23259/37963 [72:14:08<44:25:47, 10.88s/it]
 61%|██████▏   | 23260/37963 [72:14:18<43:28:37, 10.65s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '1.115', 'learning_rate': '6.889e-06', 'epoch': '0.6127'}

 61%|██████▏   | 23260/37963 [72:14:18<43:28:37, 10.65s/it]
 61%|██████▏   | 23261/37963 [72:14:29<43:00:27, 10.53s/it]
 61%|██████▏   | 23262/37963 [72:14:39<42:35:29, 10.43s/it]
 61%|██████▏   | 23263/37963 [72:14:49<42:24:25, 10.39s/it]
 61%|██████▏   | 23264/37963 [72:14:59<42:04:07, 10.30s/it]
 61%|██████▏   | 23265/37963 [72:15:09<41:53:23, 10.26s/it]
 61%|██████▏   | 23266/37963 [72:15:19<41:09:34, 10.08s/it]
 61%|██████▏   | 23267/37963 [72:15:29<40:53:10, 10.02s/it]
 61%|██████▏   | 23268/37963 [72:15:39<41:14:07, 10.10s/it]
 61%|██████▏   | 23269/37963 [72:15:49<40:59:07, 10.04s/it]
 61%|██████▏   | 23270/37963 [72:15:59<41:00:41, 10.05s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '1.457', 'learning_rate': '6.881e-06', 'epoch': '0.613'}

 61%|██████▏   | 23270/37963 [72:15:59<41:00:41, 10.05s/it]
 61%|██████▏   | 23271/37963 [72:16:09<40:55:41, 10.03s/it]
 61%|██████▏   | 23272/37963 [72:16:19<40:34:32,  9.94s/it]
 61%|██████▏   | 23273/37963 [72:16:29<40:44:00,  9.98s/it]
 61%|██████▏   | 23274/37963 [72:16:39<40:40:15,  9.97s/it]
 61%|██████▏   | 23275/37963 [72:16:49<40:53:42, 10.02s/it]
 61%|██████▏   | 23276/37963 [72:16:59<40:59:00, 10.05s/it]
 61%|██████▏   | 23277/37963 [72:17:09<40:52:25, 10.02s/it]
 61%|██████▏   | 23278/37963 [72:17:19<41:07:11, 10.08s/it]
 61%|██████▏   | 23279/37963 [72:17:36<48:49:11, 11.97s/it]
 61%|██████▏   | 23280/37963 [72:17:46<46:31:59, 11.41s/it]
                                                           
{'loss': '0.1439', 'grad_norm': '2.152', 'learning_rate': '6.873e-06', 'epoch': '0.6132'}

 61%|██████▏   | 23280/37963 [72:17:46<46:31:59, 11.41s/it]
 61%|██████▏   | 23281/37963 [72:18:03<53:45:46, 13.18s/it]
 61%|██████▏   | 23282/37963 [72:18:13<50:01:47, 12.27s/it]
 61%|██████▏   | 23283/37963 [72:18:30<55:21:15, 13.57s/it]
 61%|██████▏   | 23284/37963 [72:18:40<51:04:42, 12.53s/it]
 61%|██████▏   | 23285/37963 [72:18:57<56:06:46, 13.76s/it]
 61%|██████▏   | 23286/37963 [72:19:14<60:08:07, 14.75s/it]
 61%|██████▏   | 23287/37963 [72:19:24<54:34:11, 13.39s/it]
 61%|██████▏   | 23288/37963 [72:19:34<50:39:42, 12.43s/it]
 61%|██████▏   | 23289/37963 [72:19:51<56:04:36, 13.76s/it]
 61%|██████▏   | 23290/37963 [72:20:01<51:17:21, 12.58s/it]
                                                           
{'loss': '0.1344', 'grad_norm': '1.676', 'learning_rate': '6.865e-06', 'epoch': '0.6135'}

 61%|██████▏   | 23290/37963 [72:20:01<51:17:21, 12.58s/it]
 61%|██████▏   | 23291/37963 [72:20:11<48:25:40, 11.88s/it]
 61%|██████▏   | 23292/37963 [72:20:21<46:22:29, 11.38s/it]
 61%|██████▏   | 23293/37963 [72:20:31<44:45:27, 10.98s/it]
 61%|██████▏   | 23294/37963 [72:20:41<43:36:37, 10.70s/it]
 61%|██████▏   | 23295/37963 [72:20:51<42:34:24, 10.45s/it]
 61%|██████▏   | 23296/37963 [72:21:01<42:01:52, 10.32s/it]
 61%|██████▏   | 23297/37963 [72:21:11<41:38:15, 10.22s/it]
 61%|██████▏   | 23298/37963 [72:21:21<41:36:12, 10.21s/it]
 61%|██████▏   | 23299/37963 [72:21:31<41:22:07, 10.16s/it]
 61%|██████▏   | 23300/37963 [72:21:42<41:15:25, 10.13s/it]
                                                           
{'loss': '0.1387', 'grad_norm': '1.544', 'learning_rate': '6.857e-06', 'epoch': '0.6138'}

 61%|██████▏   | 23300/37963 [72:21:42<41:15:25, 10.13s/it]
 61%|██████▏   | 23301/37963 [72:21:52<41:21:19, 10.15s/it]
 61%|██████▏   | 23302/37963 [72:22:02<41:18:06, 10.14s/it]
 61%|██████▏   | 23303/37963 [72:22:12<41:20:45, 10.15s/it]
 61%|██████▏   | 23304/37963 [72:22:29<49:09:54, 12.07s/it]
 61%|██████▏   | 23305/37963 [72:22:38<46:30:48, 11.42s/it]
 61%|██████▏   | 23306/37963 [72:22:48<44:22:20, 10.90s/it]
 61%|██████▏   | 23307/37963 [72:22:58<43:31:22, 10.69s/it]
 61%|██████▏   | 23308/37963 [72:23:09<43:07:41, 10.59s/it]
 61%|██████▏   | 23309/37963 [72:23:19<42:19:26, 10.40s/it]
 61%|██████▏   | 23310/37963 [72:23:29<41:59:34, 10.32s/it]
                                                           
{'loss': '0.1299', 'grad_norm': '1.549', 'learning_rate': '6.849e-06', 'epoch': '0.614'}

 61%|██████▏   | 23310/37963 [72:23:29<41:59:34, 10.32s/it]
 61%|██████▏   | 23311/37963 [72:23:39<41:49:21, 10.28s/it]
 61%|██████▏   | 23312/37963 [72:23:49<41:33:32, 10.21s/it]
 61%|██████▏   | 23313/37963 [72:23:59<41:23:56, 10.17s/it]
 61%|██████▏   | 23314/37963 [72:24:09<41:17:23, 10.15s/it]
 61%|██████▏   | 23315/37963 [72:24:19<41:12:06, 10.13s/it]
 61%|██████▏   | 23316/37963 [72:24:29<41:00:51, 10.08s/it]
 61%|██████▏   | 23317/37963 [72:24:39<40:54:09, 10.05s/it]
 61%|██████▏   | 23318/37963 [72:24:50<41:08:53, 10.11s/it]
 61%|██████▏   | 23319/37963 [72:25:00<41:16:09, 10.15s/it]
 61%|██████▏   | 23320/37963 [72:25:10<41:13:14, 10.13s/it]
                                                           
{'loss': '0.1282', 'grad_norm': '1.177', 'learning_rate': '6.84e-06', 'epoch': '0.6143'}

 61%|██████▏   | 23320/37963 [72:25:10<41:13:14, 10.13s/it]
 61%|██████▏   | 23321/37963 [72:25:20<41:09:42, 10.12s/it]
 61%|██████▏   | 23322/37963 [72:25:30<41:11:01, 10.13s/it]
 61%|██████▏   | 23323/37963 [72:25:40<41:07:06, 10.11s/it]
 61%|██████▏   | 23324/37963 [72:25:50<41:13:56, 10.14s/it]
 61%|██████▏   | 23325/37963 [72:26:00<41:11:40, 10.13s/it]
 61%|██████▏   | 23326/37963 [72:26:11<41:10:58, 10.13s/it]
 61%|██████▏   | 23327/37963 [72:26:21<41:15:25, 10.15s/it]
 61%|██████▏   | 23328/37963 [72:26:45<57:53:56, 14.24s/it]
 61%|██████▏   | 23329/37963 [72:27:01<61:04:52, 15.03s/it]
 61%|██████▏   | 23330/37963 [72:27:12<55:08:18, 13.57s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '1.529', 'learning_rate': '6.832e-06', 'epoch': '0.6145'}

 61%|██████▏   | 23330/37963 [72:27:12<55:08:18, 13.57s/it]
 61%|██████▏   | 23331/37963 [72:27:28<58:46:31, 14.46s/it]
 61%|██████▏   | 23332/37963 [72:27:45<61:25:25, 15.11s/it]
 61%|██████▏   | 23333/37963 [72:28:02<63:55:51, 15.73s/it]
 61%|██████▏   | 23334/37963 [72:28:12<57:02:38, 14.04s/it]
 61%|██████▏   | 23335/37963 [72:28:22<52:22:09, 12.89s/it]
 61%|██████▏   | 23336/37963 [72:28:32<48:21:49, 11.90s/it]
 61%|██████▏   | 23337/37963 [72:28:42<46:16:13, 11.39s/it]
 61%|██████▏   | 23338/37963 [72:28:59<53:19:17, 13.13s/it]
 61%|██████▏   | 23339/37963 [72:29:09<49:30:44, 12.19s/it]
 61%|██████▏   | 23340/37963 [72:29:19<46:52:42, 11.54s/it]
                                                           
{'loss': '0.1439', 'grad_norm': '1.929', 'learning_rate': '6.824e-06', 'epoch': '0.6148'}

 61%|██████▏   | 23340/37963 [72:29:19<46:52:42, 11.54s/it]
 61%|██████▏   | 23341/37963 [72:29:29<45:11:43, 11.13s/it]
 61%|██████▏   | 23342/37963 [72:29:39<43:38:05, 10.74s/it]
 61%|██████▏   | 23343/37963 [72:29:50<43:06:00, 10.61s/it]
 61%|██████▏   | 23344/37963 [72:30:00<42:29:24, 10.46s/it]
 61%|██████▏   | 23345/37963 [72:30:10<42:00:26, 10.35s/it]
 61%|██████▏   | 23346/37963 [72:30:20<41:46:27, 10.29s/it]
 61%|██████▏   | 23347/37963 [72:30:30<41:37:57, 10.25s/it]
 62%|██████▏   | 23348/37963 [72:30:40<41:28:54, 10.22s/it]
 62%|██████▏   | 23349/37963 [72:30:50<41:16:55, 10.17s/it]
 62%|██████▏   | 23350/37963 [72:31:00<41:07:12, 10.13s/it]
                                                           
{'loss': '0.1435', 'grad_norm': '2.674', 'learning_rate': '6.816e-06', 'epoch': '0.6151'}

 62%|██████▏   | 23350/37963 [72:31:00<41:07:12, 10.13s/it]
 62%|██████▏   | 23351/37963 [72:31:10<40:58:04, 10.09s/it]
 62%|██████▏   | 23352/37963 [72:31:27<48:37:58, 11.98s/it]
 62%|██████▏   | 23353/37963 [72:31:37<46:05:30, 11.36s/it]
 62%|██████▏   | 23354/37963 [72:31:47<44:32:48, 10.98s/it]
 62%|██████▏   | 23355/37963 [72:31:57<43:29:11, 10.72s/it]
 62%|██████▏   | 23356/37963 [72:32:07<42:43:59, 10.53s/it]
 62%|██████▏   | 23357/37963 [72:32:17<42:13:33, 10.41s/it]
 62%|██████▏   | 23358/37963 [72:32:27<41:50:10, 10.31s/it]
 62%|██████▏   | 23359/37963 [72:32:37<41:36:44, 10.26s/it]
 62%|██████▏   | 23360/37963 [72:32:47<41:23:08, 10.20s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '3.914', 'learning_rate': '6.808e-06', 'epoch': '0.6153'}

 62%|██████▏   | 23360/37963 [72:32:47<41:23:08, 10.20s/it]
 62%|██████▏   | 23361/37963 [72:32:57<41:01:45, 10.12s/it]
 62%|██████▏   | 23362/37963 [72:33:07<40:57:29, 10.10s/it]
 62%|██████▏   | 23363/37963 [72:33:17<40:54:06, 10.09s/it]
 62%|██████▏   | 23364/37963 [72:33:27<40:42:25, 10.04s/it]
 62%|██████▏   | 23365/37963 [72:33:37<40:23:33,  9.96s/it]
 62%|██████▏   | 23366/37963 [72:33:47<40:33:57, 10.00s/it]
 62%|██████▏   | 23367/37963 [72:33:57<40:26:41,  9.98s/it]
 62%|██████▏   | 23368/37963 [72:34:07<40:26:05,  9.97s/it]
 62%|██████▏   | 23369/37963 [72:34:17<40:37:25, 10.02s/it]
 62%|██████▏   | 23370/37963 [72:34:27<40:34:40, 10.01s/it]
                                                           
{'loss': '0.1444', 'grad_norm': '1.331', 'learning_rate': '6.8e-06', 'epoch': '0.6156'}

 62%|██████▏   | 23370/37963 [72:34:27<40:34:40, 10.01s/it]
 62%|██████▏   | 23371/37963 [72:34:37<40:19:21,  9.95s/it]
 62%|██████▏   | 23372/37963 [72:34:47<40:24:21,  9.97s/it]
 62%|██████▏   | 23373/37963 [72:34:57<40:34:17, 10.01s/it]
 62%|██████▏   | 23374/37963 [72:35:07<40:54:46, 10.10s/it]
 62%|██████▏   | 23375/37963 [72:35:23<48:03:00, 11.86s/it]
 62%|██████▏   | 23376/37963 [72:35:33<45:58:59, 11.35s/it]
 62%|██████▏   | 23377/37963 [72:35:50<52:41:01, 13.00s/it]
 62%|██████▏   | 23378/37963 [72:36:00<49:02:14, 12.10s/it]
 62%|██████▏   | 23379/37963 [72:36:16<53:55:37, 13.31s/it]
 62%|██████▏   | 23380/37963 [72:36:34<58:35:41, 14.46s/it]
                                                           
{'loss': '0.1328', 'grad_norm': '1.359', 'learning_rate': '6.792e-06', 'epoch': '0.6159'}

 62%|██████▏   | 23380/37963 [72:36:34<58:35:41, 14.46s/it]
 62%|██████▏   | 23381/37963 [72:36:57<69:18:28, 17.11s/it]
 62%|██████▏   | 23382/37963 [72:37:07<60:54:23, 15.04s/it]
 62%|██████▏   | 23383/37963 [72:37:17<54:21:46, 13.42s/it]
 62%|██████▏   | 23384/37963 [72:37:27<50:23:48, 12.44s/it]
 62%|██████▏   | 23385/37963 [72:37:37<47:34:11, 11.75s/it]
 62%|██████▏   | 23386/37963 [72:37:54<53:58:07, 13.33s/it]
 62%|██████▏   | 23387/37963 [72:38:04<50:05:22, 12.37s/it]
 62%|██████▏   | 23388/37963 [72:38:14<47:03:54, 11.63s/it]
 62%|██████▏   | 23389/37963 [72:38:24<45:21:22, 11.20s/it]
 62%|██████▏   | 23390/37963 [72:38:34<44:04:49, 10.89s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '3.192', 'learning_rate': '6.784e-06', 'epoch': '0.6161'}

 62%|██████▏   | 23390/37963 [72:38:34<44:04:49, 10.89s/it]
 62%|██████▏   | 23391/37963 [72:38:45<43:10:00, 10.66s/it]
 62%|██████▏   | 23392/37963 [72:38:55<42:42:43, 10.55s/it]
 62%|██████▏   | 23393/37963 [72:39:05<41:39:55, 10.29s/it]
 62%|██████▏   | 23394/37963 [72:39:15<41:32:08, 10.26s/it]
 62%|██████▏   | 23395/37963 [72:39:25<41:18:11, 10.21s/it]
 62%|██████▏   | 23396/37963 [72:39:35<40:44:35, 10.07s/it]
 62%|██████▏   | 23397/37963 [72:39:45<40:31:34, 10.02s/it]
 62%|██████▏   | 23398/37963 [72:39:54<40:18:59,  9.96s/it]
 62%|██████▏   | 23399/37963 [72:40:11<48:07:29, 11.90s/it]
 62%|██████▏   | 23400/37963 [72:40:21<45:54:56, 11.35s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '2.204', 'learning_rate': '6.776e-06', 'epoch': '0.6164'}

 62%|██████▏   | 23400/37963 [72:40:21<45:54:56, 11.35s/it]
 62%|██████▏   | 23401/37963 [72:40:31<44:22:31, 10.97s/it]
 62%|██████▏   | 23402/37963 [72:40:41<43:29:42, 10.75s/it]
 62%|██████▏   | 23403/37963 [72:40:51<42:50:04, 10.59s/it]
 62%|██████▏   | 23404/37963 [72:41:02<42:33:26, 10.52s/it]
 62%|██████▏   | 23405/37963 [72:41:12<42:03:39, 10.40s/it]
 62%|██████▏   | 23406/37963 [72:41:22<41:44:54, 10.32s/it]
 62%|██████▏   | 23407/37963 [72:41:32<41:35:13, 10.29s/it]
 62%|██████▏   | 23408/37963 [72:41:42<41:27:00, 10.25s/it]
 62%|██████▏   | 23409/37963 [72:41:53<41:26:24, 10.25s/it]
 62%|██████▏   | 23410/37963 [72:42:02<40:56:35, 10.13s/it]
                                                           
{'loss': '0.1323', 'grad_norm': '2.495', 'learning_rate': '6.768e-06', 'epoch': '0.6167'}

 62%|██████▏   | 23410/37963 [72:42:02<40:56:35, 10.13s/it]
 62%|██████▏   | 23411/37963 [72:42:13<40:51:15, 10.11s/it]
 62%|██████▏   | 23412/37963 [72:42:23<40:50:29, 10.10s/it]
 62%|██████▏   | 23413/37963 [72:42:33<40:46:51, 10.09s/it]
 62%|██████▏   | 23414/37963 [72:42:43<40:37:08, 10.05s/it]
 62%|██████▏   | 23415/37963 [72:42:53<40:43:54, 10.08s/it]
 62%|██████▏   | 23416/37963 [72:43:03<40:22:57,  9.99s/it]
 62%|██████▏   | 23417/37963 [72:43:13<40:34:34, 10.04s/it]
 62%|██████▏   | 23418/37963 [72:43:23<40:36:55, 10.05s/it]
 62%|██████▏   | 23419/37963 [72:43:33<40:38:14, 10.06s/it]
 62%|██████▏   | 23420/37963 [72:43:43<40:40:42, 10.07s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '3.569', 'learning_rate': '6.76e-06', 'epoch': '0.6169'}

 62%|██████▏   | 23420/37963 [72:43:43<40:40:42, 10.07s/it]
 62%|██████▏   | 23421/37963 [72:43:53<40:36:17, 10.05s/it]
 62%|██████▏   | 23422/37963 [72:44:10<48:32:21, 12.02s/it]
 62%|██████▏   | 23423/37963 [72:44:20<46:18:53, 11.47s/it]
 62%|██████▏   | 23424/37963 [72:44:30<44:44:26, 11.08s/it]
 62%|██████▏   | 23425/37963 [72:44:40<43:32:30, 10.78s/it]
 62%|██████▏   | 23426/37963 [72:44:56<50:23:46, 12.48s/it]
 62%|██████▏   | 23427/37963 [72:45:07<47:38:46, 11.80s/it]
 62%|██████▏   | 23428/37963 [72:45:30<61:37:26, 15.26s/it]
 62%|██████▏   | 23429/37963 [72:45:40<54:54:30, 13.60s/it]
 62%|██████▏   | 23430/37963 [72:46:03<66:49:36, 16.55s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '2.748', 'learning_rate': '6.752e-06', 'epoch': '0.6172'}

 62%|██████▏   | 23430/37963 [72:46:03<66:49:36, 16.55s/it]
 62%|██████▏   | 23431/37963 [72:46:13<58:59:11, 14.61s/it]
 62%|██████▏   | 23432/37963 [72:46:23<53:38:19, 13.29s/it]
 62%|██████▏   | 23433/37963 [72:46:34<49:46:09, 12.33s/it]
 62%|██████▏   | 23434/37963 [72:46:44<47:05:26, 11.67s/it]
 62%|██████▏   | 23435/37963 [72:47:01<53:26:19, 13.24s/it]
 62%|██████▏   | 23436/37963 [72:47:11<49:23:37, 12.24s/it]
 62%|██████▏   | 23437/37963 [72:47:21<46:46:29, 11.59s/it]
 62%|██████▏   | 23438/37963 [72:47:30<44:40:31, 11.07s/it]
 62%|██████▏   | 23439/37963 [72:47:41<43:27:13, 10.77s/it]
 62%|██████▏   | 23440/37963 [72:47:51<42:37:12, 10.56s/it]
                                                           
{'loss': '0.1344', 'grad_norm': '1.645', 'learning_rate': '6.743e-06', 'epoch': '0.6174'}

 62%|██████▏   | 23440/37963 [72:47:51<42:37:12, 10.56s/it]
 62%|██████▏   | 23441/37963 [72:48:01<41:59:15, 10.41s/it]
 62%|██████▏   | 23442/37963 [72:48:11<41:37:27, 10.32s/it]
 62%|██████▏   | 23443/37963 [72:48:21<41:21:36, 10.25s/it]
 62%|██████▏   | 23444/37963 [72:48:31<41:08:44, 10.20s/it]
 62%|██████▏   | 23445/37963 [72:48:41<41:08:27, 10.20s/it]
 62%|██████▏   | 23446/37963 [72:48:51<40:59:42, 10.17s/it]
 62%|██████▏   | 23447/37963 [72:49:08<48:43:48, 12.09s/it]
 62%|██████▏   | 23448/37963 [72:49:18<46:00:36, 11.41s/it]
 62%|██████▏   | 23449/37963 [72:49:28<44:20:45, 11.00s/it]
 62%|██████▏   | 23450/37963 [72:49:38<43:23:31, 10.76s/it]
                                                           
{'loss': '0.1262', 'grad_norm': '2.173', 'learning_rate': '6.735e-06', 'epoch': '0.6177'}

 62%|██████▏   | 23450/37963 [72:49:38<43:23:31, 10.76s/it]
 62%|██████▏   | 23451/37963 [72:49:48<42:33:20, 10.56s/it]
 62%|██████▏   | 23452/37963 [72:49:58<41:35:20, 10.32s/it]
 62%|██████▏   | 23453/37963 [72:50:08<40:59:50, 10.17s/it]
 62%|██████▏   | 23454/37963 [72:50:17<40:36:25, 10.08s/it]
 62%|██████▏   | 23455/37963 [72:50:27<40:37:05, 10.08s/it]
 62%|██████▏   | 23456/37963 [72:50:38<40:52:10, 10.14s/it]
 62%|██████▏   | 23457/37963 [72:50:48<40:43:05, 10.11s/it]
 62%|██████▏   | 23458/37963 [72:50:58<40:46:15, 10.12s/it]
 62%|██████▏   | 23459/37963 [72:51:08<40:59:13, 10.17s/it]
 62%|██████▏   | 23460/37963 [72:51:18<40:56:52, 10.16s/it]
                                                           
{'loss': '0.1361', 'grad_norm': '1.505', 'learning_rate': '6.727e-06', 'epoch': '0.618'}

 62%|██████▏   | 23460/37963 [72:51:18<40:56:52, 10.16s/it]
 62%|██████▏   | 23461/37963 [72:51:28<40:49:08, 10.13s/it]
 62%|██████▏   | 23462/37963 [72:51:38<40:28:06, 10.05s/it]
 62%|██████▏   | 23463/37963 [72:51:49<40:41:15, 10.10s/it]
 62%|██████▏   | 23464/37963 [72:51:59<40:42:58, 10.11s/it]
 62%|██████▏   | 23465/37963 [72:52:09<40:53:41, 10.15s/it]
 62%|██████▏   | 23466/37963 [72:52:19<40:47:04, 10.13s/it]
 62%|██████▏   | 23467/37963 [72:52:29<40:44:29, 10.12s/it]
 62%|██████▏   | 23468/37963 [72:52:39<41:00:18, 10.18s/it]
 62%|██████▏   | 23469/37963 [72:52:50<41:01:17, 10.19s/it]
 62%|██████▏   | 23470/37963 [72:53:00<41:02:31, 10.19s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '1.91', 'learning_rate': '6.719e-06', 'epoch': '0.6182'}

 62%|██████▏   | 23470/37963 [72:53:00<41:02:31, 10.19s/it]
 62%|██████▏   | 23471/37963 [72:53:16<48:05:24, 11.95s/it]
 62%|██████▏   | 23472/37963 [72:53:26<45:40:36, 11.35s/it]
 62%|██████▏   | 23473/37963 [72:53:36<43:49:08, 10.89s/it]
 62%|██████▏   | 23474/37963 [72:53:59<58:42:34, 14.59s/it]
 62%|██████▏   | 23475/37963 [72:54:09<53:17:28, 13.24s/it]
 62%|██████▏   | 23476/37963 [72:54:32<65:27:45, 16.27s/it]
 62%|██████▏   | 23477/37963 [72:54:42<57:43:41, 14.35s/it]
 62%|██████▏   | 23478/37963 [72:54:59<61:02:35, 15.17s/it]
 62%|██████▏   | 23479/37963 [72:55:09<54:34:37, 13.57s/it]
 62%|██████▏   | 23480/37963 [72:55:19<50:14:55, 12.49s/it]
                                                           
{'loss': '0.1348', 'grad_norm': '1.591', 'learning_rate': '6.711e-06', 'epoch': '0.6185'}

 62%|██████▏   | 23480/37963 [72:55:19<50:14:55, 12.49s/it]
 62%|██████▏   | 23481/37963 [72:55:29<47:29:11, 11.80s/it]
 62%|██████▏   | 23482/37963 [72:55:46<53:32:12, 13.31s/it]
 62%|██████▏   | 23483/37963 [72:55:56<49:43:47, 12.36s/it]
 62%|██████▏   | 23484/37963 [72:56:06<46:47:49, 11.64s/it]
 62%|██████▏   | 23485/37963 [72:56:16<44:32:20, 11.07s/it]
 62%|██████▏   | 23486/37963 [72:56:26<43:23:42, 10.79s/it]
 62%|██████▏   | 23487/37963 [72:56:36<42:00:52, 10.45s/it]
 62%|██████▏   | 23488/37963 [72:56:46<41:33:18, 10.33s/it]
 62%|██████▏   | 23489/37963 [72:56:55<40:41:16, 10.12s/it]
 62%|██████▏   | 23490/37963 [72:57:06<40:42:26, 10.13s/it]
                                                           
{'loss': '0.1361', 'grad_norm': '1.55', 'learning_rate': '6.703e-06', 'epoch': '0.6188'}

 62%|██████▏   | 23490/37963 [72:57:06<40:42:26, 10.13s/it]
 62%|██████▏   | 23491/37963 [72:57:16<40:40:23, 10.12s/it]
 62%|██████▏   | 23492/37963 [72:57:26<40:41:14, 10.12s/it]
 62%|██████▏   | 23493/37963 [72:57:35<40:13:13, 10.01s/it]
 62%|██████▏   | 23494/37963 [72:57:46<40:32:41, 10.09s/it]
 62%|██████▏   | 23495/37963 [72:58:02<48:24:07, 12.04s/it]
 62%|██████▏   | 23496/37963 [72:58:13<46:06:06, 11.47s/it]
 62%|██████▏   | 23497/37963 [72:58:23<44:27:57, 11.07s/it]
 62%|██████▏   | 23498/37963 [72:58:33<43:20:35, 10.79s/it]
 62%|██████▏   | 23499/37963 [72:58:43<42:26:39, 10.56s/it]
 62%|██████▏   | 23500/37963 [72:58:53<41:49:56, 10.41s/it]
                                                           
{'loss': '0.1251', 'grad_norm': '1.535', 'learning_rate': '6.695e-06', 'epoch': '0.619'}

 62%|██████▏   | 23500/37963 [72:58:53<41:49:56, 10.41s/it]
 62%|██████▏   | 23501/37963 [72:59:03<41:31:11, 10.34s/it]
 62%|██████▏   | 23502/37963 [72:59:13<41:24:45, 10.31s/it]
 62%|██████▏   | 23503/37963 [72:59:23<41:06:53, 10.24s/it]
 62%|██████▏   | 23504/37963 [72:59:33<40:57:58, 10.20s/it]
 62%|██████▏   | 23505/37963 [72:59:44<40:51:55, 10.18s/it]
 62%|██████▏   | 23506/37963 [72:59:54<40:46:29, 10.15s/it]
 62%|██████▏   | 23507/37963 [73:00:04<40:41:14, 10.13s/it]
 62%|██████▏   | 23508/37963 [73:00:14<40:41:40, 10.13s/it]
 62%|██████▏   | 23509/37963 [73:00:24<40:38:09, 10.12s/it]
 62%|██████▏   | 23510/37963 [73:00:34<40:38:10, 10.12s/it]
                                                           
{'loss': '0.1287', 'grad_norm': '1.381', 'learning_rate': '6.687e-06', 'epoch': '0.6193'}

 62%|██████▏   | 23510/37963 [73:00:34<40:38:10, 10.12s/it]
 62%|██████▏   | 23511/37963 [73:00:44<40:37:12, 10.12s/it]
 62%|██████▏   | 23512/37963 [73:00:54<40:35:56, 10.11s/it]
 62%|██████▏   | 23513/37963 [73:01:04<40:26:40, 10.08s/it]
 62%|██████▏   | 23514/37963 [73:01:14<40:03:50,  9.98s/it]
 62%|██████▏   | 23515/37963 [73:01:24<40:08:02, 10.00s/it]
 62%|██████▏   | 23516/37963 [73:01:34<40:12:21, 10.02s/it]
 62%|██████▏   | 23517/37963 [73:01:44<40:20:44, 10.05s/it]
 62%|██████▏   | 23518/37963 [73:02:01<48:03:37, 11.98s/it]
 62%|██████▏   | 23519/37963 [73:02:11<45:52:44, 11.43s/it]
 62%|██████▏   | 23520/37963 [73:02:21<44:30:57, 11.10s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '2.284', 'learning_rate': '6.679e-06', 'epoch': '0.6196'}

 62%|██████▏   | 23520/37963 [73:02:21<44:30:57, 11.10s/it]
 62%|██████▏   | 23521/37963 [73:02:31<43:15:24, 10.78s/it]
 62%|██████▏   | 23522/37963 [73:02:55<58:16:11, 14.53s/it]
 62%|██████▏   | 23523/37963 [73:03:05<52:50:58, 13.18s/it]
 62%|██████▏   | 23524/37963 [73:03:15<48:59:04, 12.21s/it]
 62%|██████▏   | 23525/37963 [73:03:37<61:28:52, 15.33s/it]
 62%|██████▏   | 23526/37963 [73:03:47<55:22:01, 13.81s/it]
 62%|██████▏   | 23527/37963 [73:04:05<59:29:15, 14.83s/it]
 62%|██████▏   | 23528/37963 [73:04:15<53:44:01, 13.40s/it]
 62%|██████▏   | 23529/37963 [73:04:25<49:46:55, 12.42s/it]
 62%|██████▏   | 23530/37963 [73:04:42<54:56:40, 13.70s/it]
                                                           
{'loss': '0.1343', 'grad_norm': '1.022', 'learning_rate': '6.671e-06', 'epoch': '0.6198'}

 62%|██████▏   | 23530/37963 [73:04:42<54:56:40, 13.70s/it]
 62%|██████▏   | 23531/37963 [73:04:52<50:35:41, 12.62s/it]
 62%|██████▏   | 23532/37963 [73:05:02<47:30:21, 11.85s/it]
 62%|██████▏   | 23533/37963 [73:05:12<45:28:07, 11.34s/it]
 62%|██████▏   | 23534/37963 [73:05:22<43:50:22, 10.94s/it]
 62%|██████▏   | 23535/37963 [73:05:32<42:46:52, 10.67s/it]
 62%|██████▏   | 23536/37963 [73:05:42<42:06:54, 10.51s/it]
 62%|██████▏   | 23537/37963 [73:05:52<41:34:56, 10.38s/it]
 62%|██████▏   | 23538/37963 [73:06:02<41:19:21, 10.31s/it]
 62%|██████▏   | 23539/37963 [73:06:12<40:40:53, 10.15s/it]
 62%|██████▏   | 23540/37963 [73:06:22<40:30:08, 10.11s/it]
                                                           
{'loss': '0.1227', 'grad_norm': '3.26', 'learning_rate': '6.663e-06', 'epoch': '0.6201'}

 62%|██████▏   | 23540/37963 [73:06:22<40:30:08, 10.11s/it]
 62%|██████▏   | 23541/37963 [73:06:32<40:31:27, 10.12s/it]
 62%|██████▏   | 23542/37963 [73:06:48<47:43:05, 11.91s/it]
 62%|██████▏   | 23543/37963 [73:06:58<45:36:06, 11.38s/it]
 62%|██████▏   | 23544/37963 [73:07:08<43:58:24, 10.98s/it]
 62%|██████▏   | 23545/37963 [73:07:19<42:52:04, 10.70s/it]
 62%|██████▏   | 23546/37963 [73:07:29<42:07:44, 10.52s/it]
 62%|██████▏   | 23547/37963 [73:07:39<41:34:34, 10.38s/it]
 62%|██████▏   | 23548/37963 [73:07:49<41:05:55, 10.26s/it]
 62%|██████▏   | 23549/37963 [73:07:59<40:38:19, 10.15s/it]
 62%|██████▏   | 23550/37963 [73:08:09<40:33:40, 10.13s/it]
                                                           
{'loss': '0.142', 'grad_norm': '1.998', 'learning_rate': '6.655e-06', 'epoch': '0.6203'}

 62%|██████▏   | 23550/37963 [73:08:09<40:33:40, 10.13s/it]
 62%|██████▏   | 23551/37963 [73:08:18<40:02:48, 10.00s/it]
 62%|██████▏   | 23552/37963 [73:08:28<40:11:08, 10.04s/it]
 62%|██████▏   | 23553/37963 [73:08:38<40:09:19, 10.03s/it]
 62%|██████▏   | 23554/37963 [73:08:49<40:21:06, 10.08s/it]
 62%|██████▏   | 23555/37963 [73:08:58<39:58:15,  9.99s/it]
 62%|██████▏   | 23556/37963 [73:09:09<40:18:53, 10.07s/it]
 62%|██████▏   | 23557/37963 [73:09:19<40:05:26, 10.02s/it]
 62%|██████▏   | 23558/37963 [73:09:29<40:15:10, 10.06s/it]
 62%|██████▏   | 23559/37963 [73:09:39<40:13:39, 10.05s/it]
 62%|██████▏   | 23560/37963 [73:09:49<40:15:22, 10.06s/it]
                                                           
{'loss': '0.1276', 'grad_norm': '2.727', 'learning_rate': '6.647e-06', 'epoch': '0.6206'}

 62%|██████▏   | 23560/37963 [73:09:49<40:15:22, 10.06s/it]
 62%|██████▏   | 23561/37963 [73:09:59<40:12:41, 10.05s/it]
 62%|██████▏   | 23562/37963 [73:10:09<40:09:55, 10.04s/it]
 62%|██████▏   | 23563/37963 [73:10:19<40:15:22, 10.06s/it]
 62%|██████▏   | 23564/37963 [73:10:29<40:19:55, 10.08s/it]
 62%|██████▏   | 23565/37963 [73:10:39<40:09:56, 10.04s/it]
 62%|██████▏   | 23566/37963 [73:10:49<40:18:48, 10.08s/it]
 62%|██████▏   | 23567/37963 [73:11:05<47:35:52, 11.90s/it]
 62%|██████▏   | 23568/37963 [73:11:15<45:15:38, 11.32s/it]
 62%|██████▏   | 23569/37963 [73:11:31<50:47:12, 12.70s/it]
 62%|██████▏   | 23570/37963 [73:11:41<47:38:31, 11.92s/it]
                                                           
{'loss': '0.1395', 'grad_norm': '1.146', 'learning_rate': '6.639e-06', 'epoch': '0.6209'}

 62%|██████▏   | 23570/37963 [73:11:41<47:38:31, 11.92s/it]
 62%|██████▏   | 23571/37963 [73:11:59<54:08:06, 13.54s/it]
 62%|██████▏   | 23572/37963 [73:12:09<50:00:51, 12.51s/it]
 62%|██████▏   | 23573/37963 [73:12:26<55:01:37, 13.77s/it]
 62%|██████▏   | 23574/37963 [73:12:35<50:27:04, 12.62s/it]
 62%|██████▏   | 23575/37963 [73:12:45<47:05:49, 11.78s/it]
 62%|██████▏   | 23576/37963 [73:13:09<61:04:28, 15.28s/it]
 62%|██████▏   | 23577/37963 [73:13:26<63:24:14, 15.87s/it]
 62%|██████▏   | 23578/37963 [73:13:36<56:20:36, 14.10s/it]
 62%|██████▏   | 23579/37963 [73:13:46<51:22:55, 12.86s/it]
 62%|██████▏   | 23580/37963 [73:13:56<48:01:40, 12.02s/it]
                                                           
{'loss': '0.1306', 'grad_norm': '1.847', 'learning_rate': '6.631e-06', 'epoch': '0.6211'}

 62%|██████▏   | 23580/37963 [73:13:56<48:01:40, 12.02s/it]
 62%|██████▏   | 23581/37963 [73:14:06<45:38:02, 11.42s/it]
 62%|██████▏   | 23582/37963 [73:14:16<43:47:19, 10.96s/it]
 62%|██████▏   | 23583/37963 [73:14:26<42:55:49, 10.75s/it]
 62%|██████▏   | 23584/37963 [73:14:36<42:03:43, 10.53s/it]
 62%|██████▏   | 23585/37963 [73:14:46<41:41:49, 10.44s/it]
 62%|██████▏   | 23586/37963 [73:14:57<41:17:29, 10.34s/it]
 62%|██████▏   | 23587/37963 [73:15:07<40:56:08, 10.25s/it]
 62%|██████▏   | 23588/37963 [73:15:17<40:44:37, 10.20s/it]
 62%|██████▏   | 23589/37963 [73:15:27<40:37:44, 10.18s/it]
 62%|██████▏   | 23590/37963 [73:15:37<40:40:33, 10.19s/it]
                                                           
{'loss': '0.1213', 'grad_norm': '1.533', 'learning_rate': '6.623e-06', 'epoch': '0.6214'}

 62%|██████▏   | 23590/37963 [73:15:37<40:40:33, 10.19s/it]
 62%|██████▏   | 23591/37963 [73:15:53<48:02:07, 12.03s/it]
 62%|██████▏   | 23592/37963 [73:16:03<45:43:56, 11.46s/it]
 62%|██████▏   | 23593/37963 [73:16:13<44:02:38, 11.03s/it]
 62%|██████▏   | 23594/37963 [73:16:24<42:54:54, 10.75s/it]
 62%|██████▏   | 23595/37963 [73:16:34<41:59:24, 10.52s/it]
 62%|██████▏   | 23596/37963 [73:16:44<41:34:51, 10.42s/it]
 62%|██████▏   | 23597/37963 [73:16:54<41:11:52, 10.32s/it]
 62%|██████▏   | 23598/37963 [73:17:04<40:55:15, 10.26s/it]
 62%|██████▏   | 23599/37963 [73:17:14<40:43:49, 10.21s/it]
 62%|██████▏   | 23600/37963 [73:17:24<40:25:28, 10.13s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '1.996', 'learning_rate': '6.615e-06', 'epoch': '0.6217'}

 62%|██████▏   | 23600/37963 [73:17:24<40:25:28, 10.13s/it]
 62%|██████▏   | 23601/37963 [73:17:34<40:22:20, 10.12s/it]
 62%|██████▏   | 23602/37963 [73:17:44<40:31:23, 10.16s/it]
 62%|██████▏   | 23603/37963 [73:17:54<40:07:54, 10.06s/it]
 62%|██████▏   | 23604/37963 [73:18:04<39:49:55,  9.99s/it]
 62%|██████▏   | 23605/37963 [73:18:14<40:03:18, 10.04s/it]
 62%|██████▏   | 23606/37963 [73:18:24<39:42:05,  9.96s/it]
 62%|██████▏   | 23607/37963 [73:18:34<39:38:33,  9.94s/it]
 62%|██████▏   | 23608/37963 [73:18:44<39:50:13,  9.99s/it]
 62%|██████▏   | 23609/37963 [73:18:54<39:58:23, 10.03s/it]
 62%|██████▏   | 23610/37963 [73:19:04<39:45:22,  9.97s/it]
                                                           
{'loss': '0.1331', 'grad_norm': '3.305', 'learning_rate': '6.607e-06', 'epoch': '0.6219'}

 62%|██████▏   | 23610/37963 [73:19:04<39:45:22,  9.97s/it]
 62%|██████▏   | 23611/37963 [73:19:14<39:55:54, 10.02s/it]
 62%|██████▏   | 23612/37963 [73:19:24<39:39:59,  9.95s/it]
 62%|██████▏   | 23613/37963 [73:19:33<39:17:08,  9.86s/it]
 62%|██████▏   | 23614/37963 [73:19:43<39:16:12,  9.85s/it]
 62%|██████▏   | 23615/37963 [73:20:00<47:28:44, 11.91s/it]
 62%|██████▏   | 23616/37963 [73:20:10<45:38:24, 11.45s/it]
 62%|██████▏   | 23617/37963 [73:20:27<51:41:44, 12.97s/it]
 62%|██████▏   | 23618/37963 [73:20:37<48:26:04, 12.16s/it]
 62%|██████▏   | 23619/37963 [73:20:53<53:26:50, 13.41s/it]
 62%|██████▏   | 23620/37963 [73:21:04<49:26:05, 12.41s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '2.04', 'learning_rate': '6.599e-06', 'epoch': '0.6222'}

 62%|██████▏   | 23620/37963 [73:21:04<49:26:05, 12.41s/it]
 62%|██████▏   | 23621/37963 [73:21:14<46:45:40, 11.74s/it]
 62%|██████▏   | 23622/37963 [73:21:31<52:58:29, 13.30s/it]
 62%|██████▏   | 23623/37963 [73:21:47<56:36:29, 14.21s/it]
 62%|██████▏   | 23624/37963 [73:22:04<59:26:12, 14.92s/it]
 62%|██████▏   | 23625/37963 [73:22:20<61:10:53, 15.36s/it]
 62%|██████▏   | 23626/37963 [73:22:30<54:50:32, 13.77s/it]
 62%|██████▏   | 23627/37963 [73:22:40<50:24:22, 12.66s/it]
 62%|██████▏   | 23628/37963 [73:22:50<47:17:10, 11.88s/it]
 62%|██████▏   | 23629/37963 [73:23:00<44:59:18, 11.30s/it]
 62%|██████▏   | 23630/37963 [73:23:10<43:12:03, 10.85s/it]
                                                           
{'loss': '0.1369', 'grad_norm': '1.435', 'learning_rate': '6.591e-06', 'epoch': '0.6225'}

 62%|██████▏   | 23630/37963 [73:23:10<43:12:03, 10.85s/it]
 62%|██████▏   | 23631/37963 [73:23:20<42:16:30, 10.62s/it]
 62%|██████▏   | 23632/37963 [73:23:30<41:40:47, 10.47s/it]
 62%|██████▏   | 23633/37963 [73:23:40<41:15:33, 10.37s/it]
 62%|██████▏   | 23634/37963 [73:23:50<40:49:12, 10.26s/it]
 62%|██████▏   | 23635/37963 [73:24:00<40:38:09, 10.21s/it]
 62%|██████▏   | 23636/37963 [73:24:10<40:20:49, 10.14s/it]
 62%|██████▏   | 23637/37963 [73:24:20<40:18:52, 10.13s/it]
 62%|██████▏   | 23638/37963 [73:24:31<40:17:29, 10.13s/it]
 62%|██████▏   | 23639/37963 [73:24:40<40:06:57, 10.08s/it]
 62%|██████▏   | 23640/37963 [73:24:57<47:19:22, 11.89s/it]
                                                           
{'loss': '0.1356', 'grad_norm': '2.265', 'learning_rate': '6.583e-06', 'epoch': '0.6227'}

 62%|██████▏   | 23640/37963 [73:24:57<47:19:22, 11.89s/it]
 62%|██████▏   | 23641/37963 [73:25:06<44:44:06, 11.24s/it]
 62%|██████▏   | 23642/37963 [73:25:16<43:23:28, 10.91s/it]
 62%|██████▏   | 23643/37963 [73:25:26<42:14:52, 10.62s/it]
 62%|██████▏   | 23644/37963 [73:25:37<41:36:21, 10.46s/it]
 62%|██████▏   | 23645/37963 [73:25:47<41:13:52, 10.37s/it]
 62%|██████▏   | 23646/37963 [73:25:57<40:50:16, 10.27s/it]
 62%|██████▏   | 23647/37963 [73:26:07<40:47:19, 10.26s/it]
 62%|██████▏   | 23648/37963 [73:26:17<40:53:59, 10.29s/it]
 62%|██████▏   | 23649/37963 [73:26:27<40:37:01, 10.22s/it]
 62%|██████▏   | 23650/37963 [73:26:37<40:00:19, 10.06s/it]
                                                           
{'loss': '0.1208', 'grad_norm': '1.072', 'learning_rate': '6.575e-06', 'epoch': '0.623'}

 62%|██████▏   | 23650/37963 [73:26:37<40:00:19, 10.06s/it]
 62%|██████▏   | 23651/37963 [73:26:47<40:06:54, 10.09s/it]
 62%|██████▏   | 23652/37963 [73:26:57<40:10:16, 10.11s/it]
 62%|██████▏   | 23653/37963 [73:27:07<40:13:02, 10.12s/it]
 62%|██████▏   | 23654/37963 [73:27:18<40:07:48, 10.10s/it]
 62%|██████▏   | 23655/37963 [73:27:28<40:04:21, 10.08s/it]
 62%|██████▏   | 23656/37963 [73:27:38<40:09:23, 10.10s/it]
 62%|██████▏   | 23657/37963 [73:27:48<40:04:47, 10.09s/it]
 62%|██████▏   | 23658/37963 [73:27:58<40:05:24, 10.09s/it]
 62%|██████▏   | 23659/37963 [73:28:08<39:56:38, 10.05s/it]
 62%|██████▏   | 23660/37963 [73:28:18<39:41:03,  9.99s/it]
                                                           
{'loss': '0.1312', 'grad_norm': '1.684', 'learning_rate': '6.567e-06', 'epoch': '0.6232'}

 62%|██████▏   | 23660/37963 [73:28:18<39:41:03,  9.99s/it]
 62%|██████▏   | 23661/37963 [73:28:27<39:28:17,  9.94s/it]
 62%|██████▏   | 23662/37963 [73:28:37<39:29:23,  9.94s/it]
 62%|██████▏   | 23663/37963 [73:28:54<47:19:50, 11.92s/it]
 62%|██████▏   | 23664/37963 [73:29:04<44:56:51, 11.32s/it]
 62%|██████▏   | 23665/37963 [73:29:14<43:27:34, 10.94s/it]
 62%|██████▏   | 23666/37963 [73:29:24<42:09:44, 10.62s/it]
 62%|██████▏   | 23667/37963 [73:29:47<57:29:33, 14.48s/it]
 62%|██████▏   | 23668/37963 [73:29:57<52:18:18, 13.17s/it]
 62%|██████▏   | 23669/37963 [73:30:08<48:46:39, 12.28s/it]
 62%|██████▏   | 23670/37963 [73:30:18<46:10:07, 11.63s/it]
                                                           
{'loss': '0.1244', 'grad_norm': '2.66', 'learning_rate': '6.559e-06', 'epoch': '0.6235'}

 62%|██████▏   | 23670/37963 [73:30:18<46:10:07, 11.63s/it]
 62%|██████▏   | 23671/37963 [73:30:41<60:05:47, 15.14s/it]
 62%|██████▏   | 23672/37963 [73:30:58<62:31:22, 15.75s/it]
 62%|██████▏   | 23673/37963 [73:31:08<55:32:53, 13.99s/it]
 62%|██████▏   | 23674/37963 [73:31:24<58:13:13, 14.67s/it]
 62%|██████▏   | 23675/37963 [73:31:34<52:29:09, 13.22s/it]
 62%|██████▏   | 23676/37963 [73:31:44<48:37:42, 12.25s/it]
 62%|██████▏   | 23677/37963 [73:31:54<46:02:03, 11.60s/it]
 62%|██████▏   | 23678/37963 [73:32:04<44:16:56, 11.16s/it]
 62%|██████▏   | 23679/37963 [73:32:14<42:57:49, 10.83s/it]
 62%|██████▏   | 23680/37963 [73:32:25<42:04:10, 10.60s/it]
                                                           
{'loss': '0.1259', 'grad_norm': '2.066', 'learning_rate': '6.551e-06', 'epoch': '0.6238'}

 62%|██████▏   | 23680/37963 [73:32:25<42:04:10, 10.60s/it]
 62%|██████▏   | 23681/37963 [73:32:35<41:23:36, 10.43s/it]
 62%|██████▏   | 23682/37963 [73:32:45<41:00:41, 10.34s/it]
 62%|██████▏   | 23683/37963 [73:32:55<40:47:51, 10.29s/it]
 62%|██████▏   | 23684/37963 [73:33:05<40:44:41, 10.27s/it]
 62%|██████▏   | 23685/37963 [73:33:15<40:32:04, 10.22s/it]
 62%|██████▏   | 23686/37963 [73:33:25<40:18:13, 10.16s/it]
 62%|██████▏   | 23687/37963 [73:33:35<39:38:33, 10.00s/it]
 62%|██████▏   | 23688/37963 [73:33:51<47:19:01, 11.93s/it]
 62%|██████▏   | 23689/37963 [73:34:01<45:03:32, 11.36s/it]
 62%|██████▏   | 23690/37963 [73:34:11<43:30:56, 10.98s/it]
                                                           
{'loss': '0.143', 'grad_norm': '4.701', 'learning_rate': '6.543e-06', 'epoch': '0.624'}

 62%|██████▏   | 23690/37963 [73:34:11<43:30:56, 10.98s/it]
 62%|██████▏   | 23691/37963 [73:34:21<41:43:33, 10.53s/it]
 62%|██████▏   | 23692/37963 [73:34:31<41:10:46, 10.39s/it]
 62%|██████▏   | 23693/37963 [73:34:41<40:53:41, 10.32s/it]
 62%|██████▏   | 23694/37963 [73:34:51<40:35:03, 10.24s/it]
 62%|██████▏   | 23695/37963 [73:35:01<40:26:43, 10.20s/it]
 62%|██████▏   | 23696/37963 [73:35:11<40:20:33, 10.18s/it]
 62%|██████▏   | 23697/37963 [73:35:22<40:16:43, 10.16s/it]
 62%|██████▏   | 23698/37963 [73:35:32<40:10:36, 10.14s/it]
 62%|██████▏   | 23699/37963 [73:35:42<40:06:48, 10.12s/it]
 62%|██████▏   | 23700/37963 [73:35:52<40:04:18, 10.11s/it]
                                                           
{'loss': '0.1305', 'grad_norm': '1.406', 'learning_rate': '6.535e-06', 'epoch': '0.6243'}

 62%|██████▏   | 23700/37963 [73:35:52<40:04:18, 10.11s/it]
 62%|██████▏   | 23701/37963 [73:36:02<40:07:37, 10.13s/it]
 62%|██████▏   | 23702/37963 [73:36:12<39:51:25, 10.06s/it]
 62%|██████▏   | 23703/37963 [73:36:22<39:56:01, 10.08s/it]
 62%|██████▏   | 23704/37963 [73:36:32<40:00:08, 10.10s/it]
 62%|██████▏   | 23705/37963 [73:36:42<40:11:23, 10.15s/it]
 62%|██████▏   | 23706/37963 [73:36:53<40:10:42, 10.15s/it]
 62%|██████▏   | 23707/37963 [73:37:03<40:08:44, 10.14s/it]
 62%|██████▏   | 23708/37963 [73:37:13<40:08:09, 10.14s/it]
 62%|██████▏   | 23709/37963 [73:37:23<39:52:17, 10.07s/it]
 62%|██████▏   | 23710/37963 [73:37:33<39:58:04, 10.10s/it]
                                                           
{'loss': '0.1458', 'grad_norm': '1.151', 'learning_rate': '6.527e-06', 'epoch': '0.6246'}

 62%|██████▏   | 23710/37963 [73:37:33<39:58:04, 10.10s/it]
 62%|██████▏   | 23711/37963 [73:37:50<47:47:51, 12.07s/it]
 62%|██████▏   | 23712/37963 [73:38:00<45:23:35, 11.47s/it]
 62%|██████▏   | 23713/37963 [73:38:10<43:34:04, 11.01s/it]
 62%|██████▏   | 23714/37963 [73:38:19<42:19:34, 10.69s/it]
 62%|██████▏   | 23715/37963 [73:38:43<57:10:14, 14.45s/it]
 62%|██████▏   | 23716/37963 [73:38:53<52:00:15, 13.14s/it]
 62%|██████▏   | 23717/37963 [73:39:03<48:19:25, 12.21s/it]
 62%|██████▏   | 23718/37963 [73:39:13<45:53:27, 11.60s/it]
 62%|██████▏   | 23719/37963 [73:39:30<52:20:31, 13.23s/it]
 62%|██████▏   | 23720/37963 [73:39:47<56:23:36, 14.25s/it]
                                                           
{'loss': '0.1327', 'grad_norm': '3.094', 'learning_rate': '6.519e-06', 'epoch': '0.6248'}

 62%|██████▏   | 23720/37963 [73:39:47<56:23:36, 14.25s/it]
 62%|██████▏   | 23721/37963 [73:40:04<59:31:06, 15.04s/it]
 62%|██████▏   | 23722/37963 [73:40:14<53:44:14, 13.58s/it]
 62%|██████▏   | 23723/37963 [73:40:31<57:52:19, 14.63s/it]
 62%|██████▏   | 23724/37963 [73:40:41<52:34:16, 13.29s/it]
 62%|██████▏   | 23725/37963 [73:40:51<48:50:26, 12.35s/it]
 62%|██████▏   | 23726/37963 [73:41:01<46:22:38, 11.73s/it]
 63%|██████▎   | 23727/37963 [73:41:12<44:29:42, 11.25s/it]
 63%|██████▎   | 23728/37963 [73:41:22<42:57:33, 10.86s/it]
 63%|██████▎   | 23729/37963 [73:41:31<41:35:40, 10.52s/it]
 63%|██████▎   | 23730/37963 [73:41:41<41:06:36, 10.40s/it]
                                                           
{'loss': '0.1252', 'grad_norm': '2.718', 'learning_rate': '6.511e-06', 'epoch': '0.6251'}

 63%|██████▎   | 23730/37963 [73:41:41<41:06:36, 10.40s/it]
 63%|██████▎   | 23731/37963 [73:41:51<40:48:01, 10.32s/it]
 63%|██████▎   | 23732/37963 [73:42:02<40:39:13, 10.28s/it]
 63%|██████▎   | 23733/37963 [73:42:12<40:17:09, 10.19s/it]
 63%|██████▎   | 23734/37963 [73:42:21<39:44:36, 10.06s/it]
 63%|██████▎   | 23735/37963 [73:42:38<47:14:10, 11.95s/it]
 63%|██████▎   | 23736/37963 [73:42:48<44:39:02, 11.30s/it]
 63%|██████▎   | 23737/37963 [73:42:58<43:14:21, 10.94s/it]
 63%|██████▎   | 23738/37963 [73:43:08<42:10:42, 10.67s/it]
 63%|██████▎   | 23739/37963 [73:43:18<41:30:53, 10.51s/it]
 63%|██████▎   | 23740/37963 [73:43:28<41:03:06, 10.39s/it]
                                                           
{'loss': '0.1285', 'grad_norm': '1.876', 'learning_rate': '6.503e-06', 'epoch': '0.6253'}

 63%|██████▎   | 23740/37963 [73:43:28<41:03:06, 10.39s/it]
 63%|██████▎   | 23741/37963 [73:43:38<40:43:29, 10.31s/it]
 63%|██████▎   | 23742/37963 [73:43:48<40:10:16, 10.17s/it]
 63%|██████▎   | 23743/37963 [73:43:58<40:00:25, 10.13s/it]
 63%|██████▎   | 23744/37963 [73:44:08<39:33:57, 10.02s/it]
 63%|██████▎   | 23745/37963 [73:44:17<39:07:08,  9.90s/it]
 63%|██████▎   | 23746/37963 [73:44:28<39:42:12, 10.05s/it]
 63%|██████▎   | 23747/37963 [73:44:38<39:48:57, 10.08s/it]
 63%|██████▎   | 23748/37963 [73:44:48<39:51:54, 10.10s/it]
 63%|██████▎   | 23749/37963 [73:44:58<39:24:28,  9.98s/it]
 63%|██████▎   | 23750/37963 [73:45:08<39:29:28, 10.00s/it]
                                                           
{'loss': '0.1365', 'grad_norm': '2.229', 'learning_rate': '6.495e-06', 'epoch': '0.6256'}

 63%|██████▎   | 23750/37963 [73:45:08<39:29:28, 10.00s/it]
 63%|██████▎   | 23751/37963 [73:45:18<39:21:51,  9.97s/it]
 63%|██████▎   | 23752/37963 [73:45:28<39:35:26, 10.03s/it]
 63%|██████▎   | 23753/37963 [73:45:38<39:43:47, 10.07s/it]
 63%|██████▎   | 23754/37963 [73:45:48<39:16:09,  9.95s/it]
 63%|██████▎   | 23755/37963 [73:45:58<39:28:29, 10.00s/it]
 63%|██████▎   | 23756/37963 [73:46:08<39:34:59, 10.03s/it]
 63%|██████▎   | 23757/37963 [73:46:18<39:36:57, 10.04s/it]
 63%|██████▎   | 23758/37963 [73:46:28<39:40:08, 10.05s/it]
 63%|██████▎   | 23759/37963 [73:46:45<47:16:57, 11.98s/it]
 63%|██████▎   | 23760/37963 [73:46:55<45:06:53, 11.44s/it]
                                                           
{'loss': '0.131', 'grad_norm': '1.505', 'learning_rate': '6.487e-06', 'epoch': '0.6259'}

 63%|██████▎   | 23760/37963 [73:46:55<45:06:53, 11.44s/it]
 63%|██████▎   | 23761/37963 [73:47:05<43:16:30, 10.97s/it]
 63%|██████▎   | 23762/37963 [73:47:21<49:45:44, 12.61s/it]
 63%|██████▎   | 23763/37963 [73:47:31<46:45:36, 11.85s/it]
 63%|██████▎   | 23764/37963 [73:47:41<44:54:09, 11.38s/it]
 63%|██████▎   | 23765/37963 [73:48:05<59:36:26, 15.11s/it]
 63%|██████▎   | 23766/37963 [73:48:15<53:40:26, 13.61s/it]
 63%|██████▎   | 23767/37963 [73:48:25<49:32:15, 12.56s/it]
 63%|██████▎   | 23768/37963 [73:48:35<46:26:44, 11.78s/it]
 63%|██████▎   | 23769/37963 [73:48:59<60:30:55, 15.35s/it]
 63%|██████▎   | 23770/37963 [73:49:09<54:17:23, 13.77s/it]
                                                           
{'loss': '0.1262', 'grad_norm': '1.326', 'learning_rate': '6.479e-06', 'epoch': '0.6261'}

 63%|██████▎   | 23770/37963 [73:49:09<54:17:23, 13.77s/it]
 63%|██████▎   | 23771/37963 [73:49:19<49:29:44, 12.56s/it]
 63%|██████▎   | 23772/37963 [73:49:36<54:22:31, 13.79s/it]
 63%|██████▎   | 23773/37963 [73:49:45<49:30:55, 12.56s/it]
 63%|██████▎   | 23774/37963 [73:49:55<46:20:05, 11.76s/it]
 63%|██████▎   | 23775/37963 [73:50:05<44:30:36, 11.29s/it]
 63%|██████▎   | 23776/37963 [73:50:15<43:04:27, 10.93s/it]
 63%|██████▎   | 23777/37963 [73:50:25<42:03:33, 10.67s/it]
 63%|██████▎   | 23778/37963 [73:50:36<41:23:09, 10.50s/it]
 63%|██████▎   | 23779/37963 [73:50:46<40:59:30, 10.40s/it]
 63%|██████▎   | 23780/37963 [73:50:56<40:38:29, 10.32s/it]
                                                           
{'loss': '0.1268', 'grad_norm': '1.427', 'learning_rate': '6.471e-06', 'epoch': '0.6264'}

 63%|██████▎   | 23780/37963 [73:50:56<40:38:29, 10.32s/it]
 63%|██████▎   | 23781/37963 [73:51:06<40:09:42, 10.19s/it]
 63%|██████▎   | 23782/37963 [73:51:16<40:01:53, 10.16s/it]
 63%|██████▎   | 23783/37963 [73:51:26<39:45:05, 10.09s/it]
 63%|██████▎   | 23784/37963 [73:51:42<47:17:43, 12.01s/it]
 63%|██████▎   | 23785/37963 [73:51:52<44:53:09, 11.40s/it]
 63%|██████▎   | 23786/37963 [73:52:02<43:14:28, 10.98s/it]
 63%|██████▎   | 23787/37963 [73:52:12<42:09:33, 10.71s/it]
 63%|██████▎   | 23788/37963 [73:52:22<41:28:46, 10.53s/it]
 63%|██████▎   | 23789/37963 [73:52:33<41:00:32, 10.42s/it]
 63%|██████▎   | 23790/37963 [73:52:43<40:39:00, 10.33s/it]
                                                           
{'loss': '0.1367', 'grad_norm': '1.431', 'learning_rate': '6.463e-06', 'epoch': '0.6267'}

 63%|██████▎   | 23790/37963 [73:52:43<40:39:00, 10.33s/it]
 63%|██████▎   | 23791/37963 [73:52:53<40:25:14, 10.27s/it]
 63%|██████▎   | 23792/37963 [73:53:03<40:22:01, 10.25s/it]
 63%|██████▎   | 23793/37963 [73:53:13<40:23:38, 10.26s/it]
 63%|██████▎   | 23794/37963 [73:53:24<40:21:54, 10.26s/it]
 63%|██████▎   | 23795/37963 [73:53:34<40:04:14, 10.18s/it]
 63%|██████▎   | 23796/37963 [73:53:44<39:55:28, 10.15s/it]
 63%|██████▎   | 23797/37963 [73:53:54<39:41:09, 10.09s/it]
 63%|██████▎   | 23798/37963 [73:54:04<39:40:30, 10.08s/it]
 63%|██████▎   | 23799/37963 [73:54:14<39:50:08, 10.12s/it]
 63%|██████▎   | 23800/37963 [73:54:24<39:28:38, 10.03s/it]
                                                           
{'loss': '0.1315', 'grad_norm': '2.497', 'learning_rate': '6.455e-06', 'epoch': '0.6269'}

 63%|██████▎   | 23800/37963 [73:54:24<39:28:38, 10.03s/it]
 63%|██████▎   | 23801/37963 [73:54:34<39:30:18, 10.04s/it]
 63%|██████▎   | 23802/37963 [73:54:44<39:11:09,  9.96s/it]
 63%|██████▎   | 23803/37963 [73:54:54<39:22:20, 10.01s/it]
 63%|██████▎   | 23804/37963 [73:55:04<39:25:41, 10.02s/it]
 63%|██████▎   | 23805/37963 [73:55:14<39:28:35, 10.04s/it]
 63%|██████▎   | 23806/37963 [73:55:24<39:22:32, 10.01s/it]
 63%|██████▎   | 23807/37963 [73:55:34<39:12:27,  9.97s/it]
 63%|██████▎   | 23808/37963 [73:55:50<46:50:44, 11.91s/it]
 63%|██████▎   | 23809/37963 [73:56:00<44:20:44, 11.28s/it]
 63%|██████▎   | 23810/37963 [73:56:10<42:59:45, 10.94s/it]
                                                           
{'loss': '0.1191', 'grad_norm': '1.627', 'learning_rate': '6.447e-06', 'epoch': '0.6272'}

 63%|██████▎   | 23810/37963 [73:56:10<42:59:45, 10.94s/it]
 63%|██████▎   | 23811/37963 [73:56:34<58:15:30, 14.82s/it]
 63%|██████▎   | 23812/37963 [73:56:51<60:21:48, 15.36s/it]
 63%|██████▎   | 23813/37963 [73:57:01<54:09:31, 13.78s/it]
 63%|██████▎   | 23814/37963 [73:57:10<49:30:56, 12.60s/it]
 63%|██████▎   | 23815/37963 [73:57:20<46:14:44, 11.77s/it]
 63%|██████▎   | 23816/37963 [73:57:31<44:34:04, 11.34s/it]
 63%|██████▎   | 23817/37963 [73:57:48<51:40:11, 13.15s/it]
 63%|██████▎   | 23818/37963 [73:57:58<48:02:29, 12.23s/it]
 63%|██████▎   | 23819/37963 [73:58:15<53:10:07, 13.53s/it]
 63%|██████▎   | 23820/37963 [73:58:25<49:10:56, 12.52s/it]
                                                           
{'loss': '0.1367', 'grad_norm': '1.701', 'learning_rate': '6.439e-06', 'epoch': '0.6275'}

 63%|██████▎   | 23820/37963 [73:58:25<49:10:56, 12.52s/it]
 63%|██████▎   | 23821/37963 [73:58:35<46:14:50, 11.77s/it]
 63%|██████▎   | 23822/37963 [73:58:45<44:16:29, 11.27s/it]
 63%|██████▎   | 23823/37963 [73:58:55<42:55:23, 10.93s/it]
 63%|██████▎   | 23824/37963 [73:59:05<42:05:00, 10.72s/it]
 63%|██████▎   | 23825/37963 [73:59:15<41:06:42, 10.47s/it]
 63%|██████▎   | 23826/37963 [73:59:25<40:44:49, 10.38s/it]
 63%|██████▎   | 23827/37963 [73:59:36<40:32:04, 10.32s/it]
 63%|██████▎   | 23828/37963 [73:59:46<40:17:25, 10.26s/it]
 63%|██████▎   | 23829/37963 [73:59:55<39:32:40, 10.07s/it]
 63%|██████▎   | 23830/37963 [74:00:05<39:11:54,  9.98s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '1.622', 'learning_rate': '6.431e-06', 'epoch': '0.6277'}

 63%|██████▎   | 23830/37963 [74:00:05<39:11:54,  9.98s/it]
 63%|██████▎   | 23831/37963 [74:00:15<39:19:51, 10.02s/it]
 63%|██████▎   | 23832/37963 [74:00:31<46:31:34, 11.85s/it]
 63%|██████▎   | 23833/37963 [74:00:42<44:41:41, 11.39s/it]
 63%|██████▎   | 23834/37963 [74:00:52<43:16:19, 11.03s/it]
 63%|██████▎   | 23835/37963 [74:01:02<42:13:22, 10.76s/it]
 63%|██████▎   | 23836/37963 [74:01:12<41:41:21, 10.62s/it]
 63%|██████▎   | 23837/37963 [74:01:22<40:35:56, 10.35s/it]
 63%|██████▎   | 23838/37963 [74:01:32<40:31:42, 10.33s/it]
 63%|██████▎   | 23839/37963 [74:01:42<39:59:34, 10.19s/it]
 63%|██████▎   | 23840/37963 [74:01:52<39:55:20, 10.18s/it]
                                                           
{'loss': '0.1314', 'grad_norm': '2.397', 'learning_rate': '6.423e-06', 'epoch': '0.628'}

 63%|██████▎   | 23840/37963 [74:01:52<39:55:20, 10.18s/it]
 63%|██████▎   | 23841/37963 [74:02:02<39:47:07, 10.14s/it]
 63%|██████▎   | 23842/37963 [74:02:12<39:30:53, 10.07s/it]
 63%|██████▎   | 23843/37963 [74:02:22<39:35:15, 10.09s/it]
 63%|██████▎   | 23844/37963 [74:02:32<39:28:37, 10.07s/it]
 63%|██████▎   | 23845/37963 [74:02:42<39:28:53, 10.07s/it]
 63%|██████▎   | 23846/37963 [74:02:53<39:40:33, 10.12s/it]
 63%|██████▎   | 23847/37963 [74:03:03<39:32:27, 10.08s/it]
 63%|██████▎   | 23848/37963 [74:03:12<39:12:00, 10.00s/it]
 63%|██████▎   | 23849/37963 [74:03:23<39:20:39, 10.04s/it]
 63%|██████▎   | 23850/37963 [74:03:33<39:25:42, 10.06s/it]
                                                           
{'loss': '0.1272', 'grad_norm': '2.561', 'learning_rate': '6.415e-06', 'epoch': '0.6282'}

 63%|██████▎   | 23850/37963 [74:03:33<39:25:42, 10.06s/it]
 63%|██████▎   | 23851/37963 [74:03:43<39:11:06, 10.00s/it]
 63%|██████▎   | 23852/37963 [74:03:53<39:24:22, 10.05s/it]
 63%|██████▎   | 23853/37963 [74:04:03<39:35:26, 10.10s/it]
 63%|██████▎   | 23854/37963 [74:04:13<39:33:20, 10.09s/it]
 63%|██████▎   | 23855/37963 [74:04:23<39:24:19, 10.06s/it]
 63%|██████▎   | 23856/37963 [74:04:39<46:52:07, 11.96s/it]
 63%|██████▎   | 23857/37963 [74:04:49<44:28:06, 11.35s/it]
 63%|██████▎   | 23858/37963 [74:05:13<58:34:45, 14.95s/it]
 63%|██████▎   | 23859/37963 [74:05:29<60:22:33, 15.41s/it]
 63%|██████▎   | 23860/37963 [74:05:39<54:14:16, 13.85s/it]
                                                           
{'loss': '0.1228', 'grad_norm': '1.685', 'learning_rate': '6.407e-06', 'epoch': '0.6285'}

 63%|██████▎   | 23860/37963 [74:05:39<54:14:16, 13.85s/it]
 63%|██████▎   | 23861/37963 [74:05:49<49:42:38, 12.69s/it]
 63%|██████▎   | 23862/37963 [74:05:59<46:38:19, 11.91s/it]
 63%|██████▎   | 23863/37963 [74:06:09<44:25:14, 11.34s/it]
 63%|██████▎   | 23864/37963 [74:06:26<50:12:22, 12.82s/it]
 63%|██████▎   | 23865/37963 [74:06:43<55:22:21, 14.14s/it]
 63%|██████▎   | 23866/37963 [74:06:59<58:03:10, 14.83s/it]
 63%|██████▎   | 23867/37963 [74:07:09<52:32:22, 13.42s/it]
 63%|██████▎   | 23868/37963 [74:07:19<48:10:00, 12.30s/it]
 63%|██████▎   | 23869/37963 [74:07:29<44:48:26, 11.45s/it]
 63%|██████▎   | 23870/37963 [74:07:39<43:09:55, 11.03s/it]
                                                           
{'loss': '0.1367', 'grad_norm': '1.998', 'learning_rate': '6.399e-06', 'epoch': '0.6288'}

 63%|██████▎   | 23870/37963 [74:07:39<43:09:55, 11.03s/it]
 63%|██████▎   | 23871/37963 [74:07:49<42:08:22, 10.77s/it]
 63%|██████▎   | 23872/37963 [74:07:59<41:28:12, 10.59s/it]
 63%|██████▎   | 23873/37963 [74:08:09<40:53:28, 10.45s/it]
 63%|██████▎   | 23874/37963 [74:08:19<40:28:35, 10.34s/it]
 63%|██████▎   | 23875/37963 [74:08:29<40:04:36, 10.24s/it]
 63%|██████▎   | 23876/37963 [74:08:39<39:41:56, 10.15s/it]
 63%|██████▎   | 23877/37963 [74:08:49<39:35:16, 10.12s/it]
 63%|██████▎   | 23878/37963 [74:08:59<39:32:18, 10.11s/it]
 63%|██████▎   | 23879/37963 [74:09:09<39:34:49, 10.12s/it]
 63%|██████▎   | 23880/37963 [74:09:26<47:28:12, 12.13s/it]
                                                           
{'loss': '0.1228', 'grad_norm': '1.89', 'learning_rate': '6.391e-06', 'epoch': '0.629'}

 63%|██████▎   | 23880/37963 [74:09:26<47:28:12, 12.13s/it]
 63%|██████▎   | 23881/37963 [74:09:37<45:20:03, 11.59s/it]
 63%|██████▎   | 23882/37963 [74:09:46<43:20:01, 11.08s/it]
 63%|██████▎   | 23883/37963 [74:09:56<42:00:35, 10.74s/it]
 63%|██████▎   | 23884/37963 [74:10:07<41:26:50, 10.60s/it]
 63%|██████▎   | 23885/37963 [74:10:17<40:55:40, 10.47s/it]
 63%|██████▎   | 23886/37963 [74:10:27<40:27:10, 10.35s/it]
 63%|██████▎   | 23887/37963 [74:10:37<40:17:32, 10.30s/it]
 63%|██████▎   | 23888/37963 [74:10:47<40:07:08, 10.26s/it]
 63%|██████▎   | 23889/37963 [74:10:57<39:33:55, 10.12s/it]
 63%|██████▎   | 23890/37963 [74:11:07<39:30:29, 10.11s/it]
                                                           
{'loss': '0.1385', 'grad_norm': '2.65', 'learning_rate': '6.383e-06', 'epoch': '0.6293'}

 63%|██████▎   | 23890/37963 [74:11:07<39:30:29, 10.11s/it]
 63%|██████▎   | 23891/37963 [74:11:17<39:06:09, 10.00s/it]
 63%|██████▎   | 23892/37963 [74:11:27<38:56:40,  9.96s/it]
 63%|██████▎   | 23893/37963 [74:11:37<39:08:54, 10.02s/it]
 63%|██████▎   | 23894/37963 [74:11:47<39:15:50, 10.05s/it]
 63%|██████▎   | 23895/37963 [74:11:57<39:17:31, 10.05s/it]
 63%|██████▎   | 23896/37963 [74:12:07<39:18:03, 10.06s/it]
 63%|██████▎   | 23897/37963 [74:12:17<39:22:50, 10.08s/it]
 63%|██████▎   | 23898/37963 [74:12:27<39:26:39, 10.10s/it]
 63%|██████▎   | 23899/37963 [74:12:38<39:26:00, 10.09s/it]
 63%|██████▎   | 23900/37963 [74:12:48<39:19:10, 10.07s/it]
                                                           
{'loss': '0.1301', 'grad_norm': '1.614', 'learning_rate': '6.375e-06', 'epoch': '0.6296'}

 63%|██████▎   | 23900/37963 [74:12:48<39:19:10, 10.07s/it]
 63%|██████▎   | 23901/37963 [74:12:58<39:21:34, 10.08s/it]
 63%|██████▎   | 23902/37963 [74:13:14<46:30:29, 11.91s/it]
 63%|██████▎   | 23903/37963 [74:13:24<44:23:16, 11.37s/it]
 63%|██████▎   | 23904/37963 [74:13:34<42:57:03, 11.00s/it]
 63%|██████▎   | 23905/37963 [74:13:51<49:48:02, 12.75s/it]
 63%|██████▎   | 23906/37963 [74:14:01<46:47:13, 11.98s/it]
 63%|██████▎   | 23907/37963 [74:14:18<52:03:36, 13.33s/it]
 63%|██████▎   | 23908/37963 [74:14:35<56:36:55, 14.50s/it]
 63%|██████▎   | 23909/37963 [74:14:45<51:23:35, 13.16s/it]
 63%|██████▎   | 23910/37963 [74:14:55<47:52:17, 12.26s/it]
                                                           
{'loss': '0.1384', 'grad_norm': '2.423', 'learning_rate': '6.367e-06', 'epoch': '0.6298'}

 63%|██████▎   | 23910/37963 [74:14:55<47:52:17, 12.26s/it]
 63%|██████▎   | 23911/37963 [74:15:05<45:24:59, 11.64s/it]
 63%|██████▎   | 23912/37963 [74:15:15<43:39:29, 11.19s/it]
 63%|██████▎   | 23913/37963 [74:15:32<50:14:05, 12.87s/it]
 63%|██████▎   | 23914/37963 [74:15:49<55:11:04, 14.14s/it]
 63%|██████▎   | 23915/37963 [74:16:06<58:00:25, 14.87s/it]
 63%|██████▎   | 23916/37963 [74:16:16<52:27:12, 13.44s/it]
 63%|██████▎   | 23917/37963 [74:16:26<48:19:14, 12.38s/it]
 63%|██████▎   | 23918/37963 [74:16:36<45:39:01, 11.70s/it]
 63%|██████▎   | 23919/37963 [74:16:46<43:50:04, 11.24s/it]
 63%|██████▎   | 23920/37963 [74:16:56<42:25:41, 10.88s/it]
                                                           
{'loss': '0.1125', 'grad_norm': '1.189', 'learning_rate': '6.359e-06', 'epoch': '0.6301'}

 63%|██████▎   | 23920/37963 [74:16:56<42:25:41, 10.88s/it]
 63%|██████▎   | 23921/37963 [74:17:06<41:35:27, 10.66s/it]
 63%|██████▎   | 23922/37963 [74:17:16<40:56:51, 10.50s/it]
 63%|██████▎   | 23923/37963 [74:17:26<40:18:20, 10.33s/it]
 63%|██████▎   | 23924/37963 [74:17:36<40:02:25, 10.27s/it]
 63%|██████▎   | 23925/37963 [74:17:47<39:49:04, 10.21s/it]
 63%|██████▎   | 23926/37963 [74:17:57<39:41:32, 10.18s/it]
 63%|██████▎   | 23927/37963 [74:18:13<47:06:01, 12.08s/it]
 63%|██████▎   | 23928/37963 [74:18:23<44:51:28, 11.51s/it]
 63%|██████▎   | 23929/37963 [74:18:33<43:09:58, 11.07s/it]
 63%|██████▎   | 23930/37963 [74:18:43<42:00:05, 10.78s/it]
                                                           
{'loss': '0.1394', 'grad_norm': '2.232', 'learning_rate': '6.351e-06', 'epoch': '0.6304'}

 63%|██████▎   | 23930/37963 [74:18:43<42:00:05, 10.78s/it]
 63%|██████▎   | 23931/37963 [74:18:54<41:24:22, 10.62s/it]
 63%|██████▎   | 23932/37963 [74:19:04<40:47:33, 10.47s/it]
 63%|██████▎   | 23933/37963 [74:19:14<40:18:28, 10.34s/it]
 63%|██████▎   | 23934/37963 [74:19:24<39:54:56, 10.24s/it]
 63%|██████▎   | 23935/37963 [74:19:34<39:46:50, 10.21s/it]
 63%|██████▎   | 23936/37963 [74:19:44<39:39:26, 10.18s/it]
 63%|██████▎   | 23937/37963 [74:19:54<39:36:21, 10.17s/it]
 63%|██████▎   | 23938/37963 [74:20:04<39:21:32, 10.10s/it]
 63%|██████▎   | 23939/37963 [74:20:14<39:17:31, 10.09s/it]
 63%|██████▎   | 23940/37963 [74:20:24<39:21:56, 10.11s/it]
                                                           
{'loss': '0.1371', 'grad_norm': '1.169', 'learning_rate': '6.343e-06', 'epoch': '0.6306'}

 63%|██████▎   | 23940/37963 [74:20:24<39:21:56, 10.11s/it]
 63%|██████▎   | 23941/37963 [74:20:35<39:20:08, 10.10s/it]
 63%|██████▎   | 23942/37963 [74:20:45<39:20:49, 10.10s/it]
 63%|██████▎   | 23943/37963 [74:20:55<39:18:59, 10.10s/it]
 63%|██████▎   | 23944/37963 [74:21:05<39:18:08, 10.09s/it]
 63%|██████▎   | 23945/37963 [74:21:15<39:12:34, 10.07s/it]
 63%|██████▎   | 23946/37963 [74:21:25<39:19:32, 10.10s/it]
 63%|██████▎   | 23947/37963 [74:21:35<39:26:05, 10.13s/it]
 63%|██████▎   | 23948/37963 [74:21:45<39:17:16, 10.09s/it]
 63%|██████▎   | 23949/37963 [74:22:02<47:05:09, 12.10s/it]
 63%|██████▎   | 23950/37963 [74:22:12<44:27:06, 11.42s/it]
                                                           
{'loss': '0.1443', 'grad_norm': '2.183', 'learning_rate': '6.335e-06', 'epoch': '0.6309'}

 63%|██████▎   | 23950/37963 [74:22:12<44:27:06, 11.42s/it]
 63%|██████▎   | 23951/37963 [74:22:22<42:56:18, 11.03s/it]
 63%|██████▎   | 23952/37963 [74:22:38<49:22:02, 12.68s/it]
 63%|██████▎   | 23953/37963 [74:22:49<46:24:05, 11.92s/it]
 63%|██████▎   | 23954/37963 [74:22:59<44:16:18, 11.38s/it]
 63%|██████▎   | 23955/37963 [74:23:22<57:49:06, 14.86s/it]
 63%|██████▎   | 23956/37963 [74:23:32<52:11:09, 13.41s/it]
 63%|██████▎   | 23957/37963 [74:23:42<48:14:17, 12.40s/it]
 63%|██████▎   | 23958/37963 [74:23:52<45:32:06, 11.70s/it]
 63%|██████▎   | 23959/37963 [74:24:02<43:23:44, 11.16s/it]
 63%|██████▎   | 23960/37963 [74:24:12<42:04:46, 10.82s/it]
                                                           
{'loss': '0.1355', 'grad_norm': '3.423', 'learning_rate': '6.327e-06', 'epoch': '0.6311'}

 63%|██████▎   | 23960/37963 [74:24:12<42:04:46, 10.82s/it]
 63%|██████▎   | 23961/37963 [74:24:29<49:23:53, 12.70s/it]
 63%|██████▎   | 23962/37963 [74:24:46<54:21:38, 13.98s/it]
 63%|██████▎   | 23963/37963 [74:25:02<57:14:08, 14.72s/it]
 63%|██████▎   | 23964/37963 [74:25:12<51:31:05, 13.25s/it]
 63%|██████▎   | 23965/37963 [74:25:22<47:50:30, 12.30s/it]
 63%|██████▎   | 23966/37963 [74:25:32<45:06:43, 11.60s/it]
 63%|██████▎   | 23967/37963 [74:25:42<43:12:04, 11.11s/it]
 63%|██████▎   | 23968/37963 [74:25:52<42:10:22, 10.85s/it]
 63%|██████▎   | 23969/37963 [74:26:02<41:21:48, 10.64s/it]
 63%|██████▎   | 23970/37963 [74:26:12<40:37:40, 10.45s/it]
                                                           
{'loss': '0.1303', 'grad_norm': '3.135', 'learning_rate': '6.319e-06', 'epoch': '0.6314'}

 63%|██████▎   | 23970/37963 [74:26:12<40:37:40, 10.45s/it]
 63%|██████▎   | 23971/37963 [74:26:23<40:16:12, 10.36s/it]
 63%|██████▎   | 23972/37963 [74:26:33<40:08:15, 10.33s/it]
 63%|██████▎   | 23973/37963 [74:26:43<39:56:19, 10.28s/it]
 63%|██████▎   | 23974/37963 [74:26:53<39:43:36, 10.22s/it]
 63%|██████▎   | 23975/37963 [74:27:03<39:31:47, 10.17s/it]
 63%|██████▎   | 23976/37963 [74:27:20<46:54:35, 12.07s/it]
 63%|██████▎   | 23977/37963 [74:27:30<44:44:29, 11.52s/it]
 63%|██████▎   | 23978/37963 [74:27:40<43:06:30, 11.10s/it]
 63%|██████▎   | 23979/37963 [74:27:50<41:56:37, 10.80s/it]
 63%|██████▎   | 23980/37963 [74:28:00<41:04:12, 10.57s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '1.555', 'learning_rate': '6.312e-06', 'epoch': '0.6317'}

 63%|██████▎   | 23980/37963 [74:28:00<41:04:12, 10.57s/it]
 63%|██████▎   | 23981/37963 [74:28:10<40:31:04, 10.43s/it]
 63%|██████▎   | 23982/37963 [74:28:20<40:04:14, 10.32s/it]
 63%|██████▎   | 23983/37963 [74:28:30<39:48:02, 10.25s/it]
 63%|██████▎   | 23984/37963 [74:28:40<39:03:57, 10.06s/it]
 63%|██████▎   | 23985/37963 [74:28:50<39:05:25, 10.07s/it]
 63%|██████▎   | 23986/37963 [74:29:00<39:06:49, 10.07s/it]
 63%|██████▎   | 23987/37963 [74:29:10<38:45:16,  9.98s/it]
 63%|██████▎   | 23988/37963 [74:29:20<39:04:27, 10.07s/it]
 63%|██████▎   | 23989/37963 [74:29:30<39:08:35, 10.08s/it]
 63%|██████▎   | 23990/37963 [74:29:40<38:26:59,  9.91s/it]
                                                           
{'loss': '0.1318', 'grad_norm': '1.096', 'learning_rate': '6.304e-06', 'epoch': '0.6319'}

 63%|██████▎   | 23990/37963 [74:29:40<38:26:59,  9.91s/it]
 63%|██████▎   | 23991/37963 [74:29:50<38:38:32,  9.96s/it]
 63%|██████▎   | 23992/37963 [74:30:00<39:00:10, 10.05s/it]
 63%|██████▎   | 23993/37963 [74:30:10<38:46:35,  9.99s/it]
 63%|██████▎   | 23994/37963 [74:30:20<38:58:57, 10.05s/it]
 63%|██████▎   | 23995/37963 [74:30:30<38:57:35, 10.04s/it]
 63%|██████▎   | 23996/37963 [74:30:40<38:57:19, 10.04s/it]
 63%|██████▎   | 23997/37963 [74:30:56<45:55:24, 11.84s/it]
 63%|██████▎   | 23998/37963 [74:31:06<43:46:50, 11.29s/it]
 63%|██████▎   | 23999/37963 [74:31:16<42:23:13, 10.93s/it]
 63%|██████▎   | 24000/37963 [74:31:26<41:03:50, 10.59s/it]
                                                           
{'loss': '0.1296', 'grad_norm': '1.725', 'learning_rate': '6.296e-06', 'epoch': '0.6322'}

 63%|██████▎   | 24000/37963 [74:31:26<41:03:50, 10.59s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.89s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.90s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 63%|██████▎   | 24001/37963 [74:32:27<99:15:23, 25.59s/it]
 63%|██████▎   | 24002/37963 [74:32:51<98:02:20, 25.28s/it]
 63%|██████▎   | 24003/37963 [74:33:02<80:31:06, 20.76s/it]
 63%|██████▎   | 24004/37963 [74:33:12<68:19:55, 17.62s/it]
 63%|██████▎   | 24005/37963 [74:33:29<67:52:22, 17.51s/it]
 63%|██████▎   | 24006/37963 [74:33:39<59:00:50, 15.22s/it]
 63%|██████▎   | 24007/37963 [74:33:49<53:02:09, 13.68s/it]
 63%|██████▎   | 24008/37963 [74:33:59<48:36:07, 12.54s/it]
 63%|██████▎   | 24009/37963 [74:34:16<54:07:27, 13.96s/it]
 63%|██████▎   | 24010/37963 [74:34:33<57:38:36, 14.87s/it]
                                                           
{'loss': '0.1293', 'grad_norm': '3.305', 'learning_rate': '6.288e-06', 'epoch': '0.6325'}

 63%|██████▎   | 24010/37963 [74:34:33<57:38:36, 14.87s/it]
 63%|██████▎   | 24011/37963 [74:34:50<59:40:01, 15.40s/it]
 63%|██████▎   | 24012/37963 [74:35:00<53:22:58, 13.78s/it]
 63%|██████▎   | 24013/37963 [74:35:10<48:54:35, 12.62s/it]
 63%|██████▎   | 24014/37963 [74:35:20<46:01:32, 11.88s/it]
 63%|██████▎   | 24015/37963 [74:35:30<43:59:15, 11.35s/it]
 63%|██████▎   | 24016/37963 [74:35:40<42:21:45, 10.93s/it]
 63%|██████▎   | 24017/37963 [74:35:50<41:11:31, 10.63s/it]
 63%|██████▎   | 24018/37963 [74:36:00<40:38:47, 10.49s/it]
 63%|██████▎   | 24019/37963 [74:36:10<40:10:35, 10.37s/it]
 63%|██████▎   | 24020/37963 [74:36:20<39:56:21, 10.31s/it]
                                                           
{'loss': '0.1297', 'grad_norm': '4.245', 'learning_rate': '6.28e-06', 'epoch': '0.6327'}

 63%|██████▎   | 24020/37963 [74:36:20<39:56:21, 10.31s/it]
 63%|██████▎   | 24021/37963 [74:36:30<39:16:08, 10.14s/it]
 63%|██████▎   | 24022/37963 [74:36:40<39:19:38, 10.16s/it]
 63%|██████▎   | 24023/37963 [74:36:51<39:20:47, 10.16s/it]
 63%|██████▎   | 24024/37963 [74:37:01<39:17:13, 10.15s/it]
 63%|██████▎   | 24025/37963 [74:37:17<46:39:13, 12.05s/it]
 63%|██████▎   | 24026/37963 [74:37:27<44:24:54, 11.47s/it]
 63%|██████▎   | 24027/37963 [74:37:37<42:45:19, 11.04s/it]
 63%|██████▎   | 24028/37963 [74:37:48<41:48:10, 10.80s/it]
 63%|██████▎   | 24029/37963 [74:37:58<41:00:08, 10.59s/it]
 63%|██████▎   | 24030/37963 [74:38:08<40:34:43, 10.48s/it]
                                                           
{'loss': '0.14', 'grad_norm': '2.86', 'learning_rate': '6.272e-06', 'epoch': '0.633'}

 63%|██████▎   | 24030/37963 [74:38:08<40:34:43, 10.48s/it]
 63%|██████▎   | 24031/37963 [74:38:18<40:06:45, 10.37s/it]
 63%|██████▎   | 24032/37963 [74:38:28<39:49:10, 10.29s/it]
 63%|██████▎   | 24033/37963 [74:38:38<39:36:14, 10.24s/it]
 63%|██████▎   | 24034/37963 [74:38:48<39:06:58, 10.11s/it]
 63%|██████▎   | 24035/37963 [74:38:58<39:05:21, 10.10s/it]
 63%|██████▎   | 24036/37963 [74:39:08<39:10:26, 10.13s/it]
 63%|██████▎   | 24037/37963 [74:39:18<39:10:44, 10.13s/it]
 63%|██████▎   | 24038/37963 [74:39:29<39:10:27, 10.13s/it]
 63%|██████▎   | 24039/37963 [74:39:39<39:16:08, 10.15s/it]
 63%|██████▎   | 24040/37963 [74:39:48<38:45:28, 10.02s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '1.822', 'learning_rate': '6.264e-06', 'epoch': '0.6333'}

 63%|██████▎   | 24040/37963 [74:39:48<38:45:28, 10.02s/it]
 63%|██████▎   | 24041/37963 [74:39:59<38:50:08, 10.04s/it]
 63%|██████▎   | 24042/37963 [74:40:09<38:46:09, 10.03s/it]
 63%|██████▎   | 24043/37963 [74:40:18<38:30:24,  9.96s/it]
 63%|██████▎   | 24044/37963 [74:40:34<45:41:29, 11.82s/it]
 63%|██████▎   | 24045/37963 [74:40:45<43:42:40, 11.31s/it]
 63%|██████▎   | 24046/37963 [74:40:55<42:17:05, 10.94s/it]
 63%|██████▎   | 24047/37963 [74:41:05<41:33:41, 10.75s/it]
 63%|██████▎   | 24048/37963 [74:41:15<40:52:09, 10.57s/it]
 63%|██████▎   | 24049/37963 [74:41:25<40:18:21, 10.43s/it]
 63%|██████▎   | 24050/37963 [74:41:42<47:46:32, 12.36s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '1.045', 'learning_rate': '6.256e-06', 'epoch': '0.6335'}

 63%|██████▎   | 24050/37963 [74:41:42<47:46:32, 12.36s/it]
 63%|██████▎   | 24051/37963 [74:41:59<52:36:11, 13.61s/it]
 63%|██████▎   | 24052/37963 [74:42:09<48:39:04, 12.59s/it]
 63%|██████▎   | 24053/37963 [74:42:26<53:52:41, 13.94s/it]
 63%|██████▎   | 24054/37963 [74:42:36<49:41:17, 12.86s/it]
 63%|██████▎   | 24055/37963 [74:42:46<46:05:58, 11.93s/it]
 63%|██████▎   | 24056/37963 [74:42:56<43:58:02, 11.38s/it]
 63%|██████▎   | 24057/37963 [74:43:14<51:10:29, 13.25s/it]
 63%|██████▎   | 24058/37963 [74:43:24<47:27:34, 12.29s/it]
 63%|██████▎   | 24059/37963 [74:43:47<59:54:18, 15.51s/it]
 63%|██████▎   | 24060/37963 [74:43:57<53:41:13, 13.90s/it]
                                                           
{'loss': '0.133', 'grad_norm': '1.364', 'learning_rate': '6.248e-06', 'epoch': '0.6338'}

 63%|██████▎   | 24060/37963 [74:43:57<53:41:13, 13.90s/it]
 63%|██████▎   | 24061/37963 [74:44:07<49:07:06, 12.72s/it]
 63%|██████▎   | 24062/37963 [74:44:17<46:00:52, 11.92s/it]
 63%|██████▎   | 24063/37963 [74:44:27<43:56:06, 11.38s/it]
 63%|██████▎   | 24064/37963 [74:44:37<42:40:54, 11.06s/it]
 63%|██████▎   | 24065/37963 [74:44:47<41:09:29, 10.66s/it]
 63%|██████▎   | 24066/37963 [74:44:57<40:25:03, 10.47s/it]
 63%|██████▎   | 24067/37963 [74:45:07<39:29:10, 10.23s/it]
 63%|██████▎   | 24068/37963 [74:45:17<39:09:00, 10.14s/it]
 63%|██████▎   | 24069/37963 [74:45:27<39:03:28, 10.12s/it]
 63%|██████▎   | 24070/37963 [74:45:37<38:58:29, 10.10s/it]
                                                           
{'loss': '0.1281', 'grad_norm': '1.66', 'learning_rate': '6.24e-06', 'epoch': '0.634'}

 63%|██████▎   | 24070/37963 [74:45:37<38:58:29, 10.10s/it]
 63%|██████▎   | 24071/37963 [74:45:47<38:54:58, 10.08s/it]
 63%|██████▎   | 24072/37963 [74:45:57<38:50:24, 10.07s/it]
 63%|██████▎   | 24073/37963 [74:46:13<46:10:29, 11.97s/it]
 63%|██████▎   | 24074/37963 [74:46:24<44:07:07, 11.44s/it]
 63%|██████▎   | 24075/37963 [74:46:34<42:41:55, 11.07s/it]
 63%|██████▎   | 24076/37963 [74:46:44<41:27:47, 10.75s/it]
 63%|██████▎   | 24077/37963 [74:46:54<40:31:34, 10.51s/it]
 63%|██████▎   | 24078/37963 [74:47:04<39:48:47, 10.32s/it]
 63%|██████▎   | 24079/37963 [74:47:13<38:52:22, 10.08s/it]
 63%|██████▎   | 24080/37963 [74:47:23<38:49:24, 10.07s/it]
                                                           
{'loss': '0.12', 'grad_norm': '1.427', 'learning_rate': '6.232e-06', 'epoch': '0.6343'}

 63%|██████▎   | 24080/37963 [74:47:23<38:49:24, 10.07s/it]
 63%|██████▎   | 24081/37963 [74:47:33<38:38:07, 10.02s/it]
 63%|██████▎   | 24082/37963 [74:47:43<38:56:27, 10.10s/it]
 63%|██████▎   | 24083/37963 [74:47:53<38:30:15,  9.99s/it]
 63%|██████▎   | 24084/37963 [74:48:03<38:40:55, 10.03s/it]
 63%|██████▎   | 24085/37963 [74:48:13<38:44:37, 10.05s/it]
 63%|██████▎   | 24086/37963 [74:48:23<38:23:14,  9.96s/it]
 63%|██████▎   | 24087/37963 [74:48:33<38:41:55, 10.04s/it]
 63%|██████▎   | 24088/37963 [74:48:43<38:41:59, 10.04s/it]
 63%|██████▎   | 24089/37963 [74:48:53<38:32:09, 10.00s/it]
 63%|██████▎   | 24090/37963 [74:49:03<38:32:59, 10.00s/it]
                                                           
{'loss': '0.1235', 'grad_norm': '2.188', 'learning_rate': '6.224e-06', 'epoch': '0.6346'}

 63%|██████▎   | 24090/37963 [74:49:03<38:32:59, 10.00s/it]
 63%|██████▎   | 24091/37963 [74:49:20<45:51:16, 11.90s/it]
 63%|██████▎   | 24092/37963 [74:49:30<43:46:23, 11.36s/it]
 63%|██████▎   | 24093/37963 [74:49:40<42:08:18, 10.94s/it]
 63%|██████▎   | 24094/37963 [74:49:50<41:10:59, 10.69s/it]
 63%|██████▎   | 24095/37963 [74:49:59<39:54:31, 10.36s/it]
 63%|██████▎   | 24096/37963 [74:50:09<39:35:58, 10.28s/it]
 63%|██████▎   | 24097/37963 [74:50:19<39:12:49, 10.18s/it]
 63%|██████▎   | 24098/37963 [74:50:36<47:10:28, 12.25s/it]
 63%|██████▎   | 24099/37963 [74:50:53<52:03:24, 13.52s/it]
 63%|██████▎   | 24100/37963 [74:51:03<48:04:53, 12.49s/it]
                                                           
{'loss': '0.1274', 'grad_norm': '2.228', 'learning_rate': '6.217e-06', 'epoch': '0.6348'}

 63%|██████▎   | 24100/37963 [74:51:03<48:04:53, 12.49s/it]
 63%|██████▎   | 24101/37963 [74:51:13<45:03:08, 11.70s/it]
 63%|██████▎   | 24102/37963 [74:51:30<51:35:47, 13.40s/it]
 63%|██████▎   | 24103/37963 [74:51:40<47:27:33, 12.33s/it]
 63%|██████▎   | 24104/37963 [74:51:58<53:24:01, 13.87s/it]
 63%|██████▎   | 24105/37963 [74:52:08<48:58:04, 12.72s/it]
 63%|██████▎   | 24106/37963 [74:52:24<53:45:01, 13.96s/it]
 64%|██████▎   | 24107/37963 [74:52:34<49:10:13, 12.78s/it]
 64%|██████▎   | 24108/37963 [74:52:44<45:34:01, 11.84s/it]
 64%|██████▎   | 24109/37963 [74:52:54<43:33:39, 11.32s/it]
 64%|██████▎   | 24110/37963 [74:53:04<42:02:58, 10.93s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '3.16', 'learning_rate': '6.209e-06', 'epoch': '0.6351'}

 64%|██████▎   | 24110/37963 [74:53:04<42:02:58, 10.93s/it]
 64%|██████▎   | 24111/37963 [74:53:14<40:51:23, 10.62s/it]
 64%|██████▎   | 24112/37963 [74:53:24<40:16:12, 10.47s/it]
 64%|██████▎   | 24113/37963 [74:53:34<39:54:36, 10.37s/it]
 64%|██████▎   | 24114/37963 [74:53:44<39:35:49, 10.29s/it]
 64%|██████▎   | 24115/37963 [74:53:54<39:09:50, 10.18s/it]
 64%|██████▎   | 24116/37963 [74:54:04<38:52:52, 10.11s/it]
 64%|██████▎   | 24117/37963 [74:54:14<38:46:54, 10.08s/it]
 64%|██████▎   | 24118/37963 [74:54:24<38:20:55,  9.97s/it]
 64%|██████▎   | 24119/37963 [74:54:34<38:27:45, 10.00s/it]
 64%|██████▎   | 24120/37963 [74:54:51<45:55:49, 11.94s/it]
                                                           
{'loss': '0.1376', 'grad_norm': '3.703', 'learning_rate': '6.201e-06', 'epoch': '0.6354'}

 64%|██████▎   | 24120/37963 [74:54:51<45:55:49, 11.94s/it]
 64%|██████▎   | 24121/37963 [74:55:01<43:36:00, 11.34s/it]
 64%|██████▎   | 24122/37963 [74:55:11<42:07:48, 10.96s/it]
 64%|██████▎   | 24123/37963 [74:55:21<40:58:53, 10.66s/it]
 64%|██████▎   | 24124/37963 [74:55:30<39:54:58, 10.38s/it]
 64%|██████▎   | 24125/37963 [74:55:40<39:33:49, 10.29s/it]
 64%|██████▎   | 24126/37963 [74:55:50<38:38:11, 10.05s/it]
 64%|██████▎   | 24127/37963 [74:56:00<38:38:49, 10.06s/it]
 64%|██████▎   | 24128/37963 [74:56:10<38:40:03, 10.06s/it]
 64%|██████▎   | 24129/37963 [74:56:20<38:23:00,  9.99s/it]
 64%|██████▎   | 24130/37963 [74:56:30<38:34:34, 10.04s/it]
                                                           
{'loss': '0.1361', 'grad_norm': '1.253', 'learning_rate': '6.193e-06', 'epoch': '0.6356'}

 64%|██████▎   | 24130/37963 [74:56:30<38:34:34, 10.04s/it]
 64%|██████▎   | 24131/37963 [74:56:40<38:46:55, 10.09s/it]
 64%|██████▎   | 24132/37963 [74:56:50<38:52:13, 10.12s/it]
 64%|██████▎   | 24133/37963 [74:57:00<38:50:30, 10.11s/it]
 64%|██████▎   | 24134/37963 [74:57:11<38:46:45, 10.10s/it]
 64%|██████▎   | 24135/37963 [74:57:20<38:01:18,  9.90s/it]
 64%|██████▎   | 24136/37963 [74:57:30<38:04:09,  9.91s/it]
 64%|██████▎   | 24137/37963 [74:57:40<38:03:33,  9.91s/it]
 64%|██████▎   | 24138/37963 [74:57:56<45:11:41, 11.77s/it]
 64%|██████▎   | 24139/37963 [74:58:06<43:32:12, 11.34s/it]
 64%|██████▎   | 24140/37963 [74:58:16<42:13:35, 11.00s/it]
                                                           
{'loss': '0.1383', 'grad_norm': '1.32', 'learning_rate': '6.185e-06', 'epoch': '0.6359'}

 64%|██████▎   | 24140/37963 [74:58:16<42:13:35, 11.00s/it]
 64%|██████▎   | 24141/37963 [74:58:26<41:01:50, 10.69s/it]
 64%|██████▎   | 24142/37963 [74:58:37<40:20:40, 10.51s/it]
 64%|██████▎   | 24143/37963 [74:58:47<39:53:29, 10.39s/it]
 64%|██████▎   | 24144/37963 [74:58:57<39:34:35, 10.31s/it]
 64%|██████▎   | 24145/37963 [74:59:07<39:11:48, 10.21s/it]
 64%|██████▎   | 24146/37963 [74:59:17<39:03:40, 10.18s/it]
 64%|██████▎   | 24147/37963 [74:59:27<39:01:49, 10.17s/it]
 64%|██████▎   | 24148/37963 [74:59:51<54:45:41, 14.27s/it]
 64%|██████▎   | 24149/37963 [75:00:01<49:56:36, 13.02s/it]
 64%|██████▎   | 24150/37963 [75:00:11<46:47:23, 12.19s/it]
                                                           
{'loss': '0.1217', 'grad_norm': '2.56', 'learning_rate': '6.177e-06', 'epoch': '0.6361'}

 64%|██████▎   | 24150/37963 [75:00:11<46:47:23, 12.19s/it]
 64%|██████▎   | 24151/37963 [75:00:28<51:53:32, 13.53s/it]
 64%|██████▎   | 24152/37963 [75:00:38<47:58:50, 12.51s/it]
 64%|██████▎   | 24153/37963 [75:00:48<45:11:21, 11.78s/it]
 64%|██████▎   | 24154/37963 [75:01:04<50:21:52, 13.13s/it]
 64%|██████▎   | 24155/37963 [75:01:27<61:51:47, 16.13s/it]
 64%|██████▎   | 24156/37963 [75:01:38<54:53:00, 14.31s/it]
 64%|██████▎   | 24157/37963 [75:01:48<50:03:56, 13.05s/it]
 64%|██████▎   | 24158/37963 [75:01:58<46:27:05, 12.11s/it]
 64%|██████▎   | 24159/37963 [75:02:08<44:10:49, 11.52s/it]
 64%|██████▎   | 24160/37963 [75:02:18<42:34:36, 11.10s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '1.653', 'learning_rate': '6.169e-06', 'epoch': '0.6364'}

 64%|██████▎   | 24160/37963 [75:02:18<42:34:36, 11.10s/it]
 64%|██████▎   | 24161/37963 [75:02:28<41:25:57, 10.81s/it]
 64%|██████▎   | 24162/37963 [75:02:38<40:42:24, 10.62s/it]
 64%|██████▎   | 24163/37963 [75:02:48<40:06:49, 10.46s/it]
 64%|██████▎   | 24164/37963 [75:02:58<39:42:03, 10.36s/it]
 64%|██████▎   | 24165/37963 [75:03:08<39:24:55, 10.28s/it]
 64%|██████▎   | 24166/37963 [75:03:19<39:17:08, 10.25s/it]
 64%|██████▎   | 24167/37963 [75:03:29<39:05:32, 10.20s/it]
 64%|██████▎   | 24168/37963 [75:03:45<46:32:01, 12.14s/it]
 64%|██████▎   | 24169/37963 [75:03:55<44:00:13, 11.48s/it]
 64%|██████▎   | 24170/37963 [75:04:05<42:25:12, 11.07s/it]
                                                           
{'loss': '0.138', 'grad_norm': '4.137', 'learning_rate': '6.161e-06', 'epoch': '0.6367'}

 64%|██████▎   | 24170/37963 [75:04:05<42:25:12, 11.07s/it]
 64%|██████▎   | 24171/37963 [75:04:16<41:18:52, 10.78s/it]
 64%|██████▎   | 24172/37963 [75:04:26<40:29:50, 10.57s/it]
 64%|██████▎   | 24173/37963 [75:04:36<39:55:49, 10.42s/it]
 64%|██████▎   | 24174/37963 [75:04:46<39:39:45, 10.36s/it]
 64%|██████▎   | 24175/37963 [75:04:56<39:23:02, 10.28s/it]
 64%|██████▎   | 24176/37963 [75:05:06<39:14:54, 10.25s/it]
 64%|██████▎   | 24177/37963 [75:05:16<39:08:22, 10.22s/it]
 64%|██████▎   | 24178/37963 [75:05:27<39:11:36, 10.24s/it]
 64%|██████▎   | 24179/37963 [75:05:37<39:07:12, 10.22s/it]
 64%|██████▎   | 24180/37963 [75:05:47<39:08:58, 10.23s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '2.011', 'learning_rate': '6.153e-06', 'epoch': '0.6369'}

 64%|██████▎   | 24180/37963 [75:05:47<39:08:58, 10.23s/it]
 64%|██████▎   | 24181/37963 [75:05:57<38:58:32, 10.18s/it]
 64%|██████▎   | 24182/37963 [75:06:07<38:54:30, 10.16s/it]
 64%|██████▎   | 24183/37963 [75:06:17<38:36:06, 10.08s/it]
 64%|██████▎   | 24184/37963 [75:06:27<38:11:51,  9.98s/it]
 64%|██████▎   | 24185/37963 [75:06:37<38:25:27, 10.04s/it]
 64%|██████▎   | 24186/37963 [75:06:47<38:35:28, 10.08s/it]
 64%|██████▎   | 24187/37963 [75:06:58<38:52:04, 10.16s/it]
 64%|██████▎   | 24188/37963 [75:07:14<46:34:24, 12.17s/it]
 64%|██████▎   | 24189/37963 [75:07:25<44:15:09, 11.57s/it]
 64%|██████▎   | 24190/37963 [75:07:35<42:30:02, 11.11s/it]
                                                           
{'loss': '0.1268', 'grad_norm': '1.666', 'learning_rate': '6.146e-06', 'epoch': '0.6372'}

 64%|██████▎   | 24190/37963 [75:07:35<42:30:02, 11.11s/it]
 64%|██████▎   | 24191/37963 [75:07:45<41:06:39, 10.75s/it]
 64%|██████▎   | 24192/37963 [75:07:55<40:24:07, 10.56s/it]
 64%|██████▎   | 24193/37963 [75:08:05<39:44:59, 10.39s/it]
 64%|██████▎   | 24194/37963 [75:08:15<39:21:57, 10.29s/it]
 64%|██████▎   | 24195/37963 [75:08:32<46:56:59, 12.28s/it]
 64%|██████▎   | 24196/37963 [75:08:49<52:26:16, 13.71s/it]
 64%|██████▎   | 24197/37963 [75:08:59<48:03:40, 12.57s/it]
 64%|██████▎   | 24198/37963 [75:09:08<44:59:57, 11.77s/it]
 64%|██████▎   | 24199/37963 [75:09:25<49:55:59, 13.06s/it]
 64%|██████▎   | 24200/37963 [75:09:35<46:26:28, 12.15s/it]
                                                           
{'loss': '0.1242', 'grad_norm': '1.832', 'learning_rate': '6.138e-06', 'epoch': '0.6375'}

 64%|██████▎   | 24200/37963 [75:09:35<46:26:28, 12.15s/it]
 64%|██████▎   | 24201/37963 [75:09:45<44:04:38, 11.53s/it]
 64%|██████▍   | 24202/37963 [75:10:08<57:56:24, 15.16s/it]
 64%|██████▍   | 24203/37963 [75:10:25<59:28:09, 15.56s/it]
 64%|██████▍   | 24204/37963 [75:10:34<52:44:47, 13.80s/it]
 64%|██████▍   | 24205/37963 [75:10:44<48:11:21, 12.61s/it]
 64%|██████▍   | 24206/37963 [75:10:54<45:06:21, 11.80s/it]
 64%|██████▍   | 24207/37963 [75:11:04<43:02:46, 11.27s/it]
 64%|██████▍   | 24208/37963 [75:11:14<41:18:47, 10.81s/it]
 64%|██████▍   | 24209/37963 [75:11:24<40:16:01, 10.54s/it]
 64%|██████▍   | 24210/37963 [75:11:34<39:51:12, 10.43s/it]
                                                           
{'loss': '0.1313', 'grad_norm': '2.813', 'learning_rate': '6.13e-06', 'epoch': '0.6377'}

 64%|██████▍   | 24210/37963 [75:11:34<39:51:12, 10.43s/it]
 64%|██████▍   | 24211/37963 [75:11:44<39:29:28, 10.34s/it]
 64%|██████▍   | 24212/37963 [75:11:54<39:09:35, 10.25s/it]
 64%|██████▍   | 24213/37963 [75:12:04<38:51:59, 10.18s/it]
 64%|██████▍   | 24214/37963 [75:12:15<38:56:59, 10.20s/it]
 64%|██████▍   | 24215/37963 [75:12:25<38:57:18, 10.20s/it]
 64%|██████▍   | 24216/37963 [75:12:35<38:51:17, 10.18s/it]
 64%|██████▍   | 24217/37963 [75:12:52<46:19:20, 12.13s/it]
 64%|██████▍   | 24218/37963 [75:13:02<43:55:10, 11.50s/it]
 64%|██████▍   | 24219/37963 [75:13:11<42:01:04, 11.01s/it]
 64%|██████▍   | 24220/37963 [75:13:22<40:58:13, 10.73s/it]
                                                           
{'loss': '0.1261', 'grad_norm': '2.402', 'learning_rate': '6.122e-06', 'epoch': '0.638'}

 64%|██████▍   | 24220/37963 [75:13:22<40:58:13, 10.73s/it]
 64%|██████▍   | 24221/37963 [75:13:32<40:18:34, 10.56s/it]
 64%|██████▍   | 24222/37963 [75:13:42<39:48:07, 10.43s/it]
 64%|██████▍   | 24223/37963 [75:13:52<39:17:53, 10.30s/it]
 64%|██████▍   | 24224/37963 [75:14:02<39:07:04, 10.25s/it]
 64%|██████▍   | 24225/37963 [75:14:12<38:57:11, 10.21s/it]
 64%|██████▍   | 24226/37963 [75:14:22<38:51:19, 10.18s/it]
 64%|██████▍   | 24227/37963 [75:14:32<38:46:49, 10.16s/it]
 64%|██████▍   | 24228/37963 [75:14:42<38:50:01, 10.18s/it]
 64%|██████▍   | 24229/37963 [75:14:52<38:27:29, 10.08s/it]
 64%|██████▍   | 24230/37963 [75:15:03<38:33:05, 10.11s/it]
                                                           
{'loss': '0.1375', 'grad_norm': '1.64', 'learning_rate': '6.114e-06', 'epoch': '0.6383'}

 64%|██████▍   | 24230/37963 [75:15:03<38:33:05, 10.11s/it]
 64%|██████▍   | 24231/37963 [75:15:13<38:37:28, 10.13s/it]
 64%|██████▍   | 24232/37963 [75:15:23<38:48:31, 10.17s/it]
 64%|██████▍   | 24233/37963 [75:15:33<38:44:29, 10.16s/it]
 64%|██████▍   | 24234/37963 [75:15:43<38:41:04, 10.14s/it]
 64%|██████▍   | 24235/37963 [75:16:00<46:03:27, 12.08s/it]
 64%|██████▍   | 24236/37963 [75:16:10<43:37:47, 11.44s/it]
 64%|██████▍   | 24237/37963 [75:16:20<41:53:13, 10.99s/it]
 64%|██████▍   | 24238/37963 [75:16:30<40:52:06, 10.72s/it]
 64%|██████▍   | 24239/37963 [75:16:40<39:49:13, 10.45s/it]
 64%|██████▍   | 24240/37963 [75:16:50<39:26:50, 10.35s/it]
                                                           
{'loss': '0.1272', 'grad_norm': '1.771', 'learning_rate': '6.106e-06', 'epoch': '0.6385'}

 64%|██████▍   | 24240/37963 [75:16:50<39:26:50, 10.35s/it]
 64%|██████▍   | 24241/37963 [75:16:59<38:43:44, 10.16s/it]
 64%|██████▍   | 24242/37963 [75:17:16<46:22:59, 12.17s/it]
 64%|██████▍   | 24243/37963 [75:17:26<43:21:44, 11.38s/it]
 64%|██████▍   | 24244/37963 [75:17:43<49:52:14, 13.09s/it]
 64%|██████▍   | 24245/37963 [75:17:53<46:39:30, 12.24s/it]
 64%|██████▍   | 24246/37963 [75:18:03<43:48:57, 11.50s/it]
 64%|██████▍   | 24247/37963 [75:18:13<41:53:25, 10.99s/it]
 64%|██████▍   | 24248/37963 [75:18:30<48:41:39, 12.78s/it]
 64%|██████▍   | 24249/37963 [75:18:46<53:02:24, 13.92s/it]
 64%|██████▍   | 24250/37963 [75:18:56<48:45:29, 12.80s/it]
                                                           
{'loss': '0.1368', 'grad_norm': '2.088', 'learning_rate': '6.098e-06', 'epoch': '0.6388'}

 64%|██████▍   | 24250/37963 [75:18:56<48:45:29, 12.80s/it]
 64%|██████▍   | 24251/37963 [75:19:13<52:45:33, 13.85s/it]
 64%|██████▍   | 24252/37963 [75:19:30<56:18:43, 14.79s/it]
 64%|██████▍   | 24253/37963 [75:19:40<50:49:45, 13.35s/it]
 64%|██████▍   | 24254/37963 [75:19:50<46:47:16, 12.29s/it]
 64%|██████▍   | 24255/37963 [75:20:00<44:24:13, 11.66s/it]
 64%|██████▍   | 24256/37963 [75:20:10<42:22:01, 11.13s/it]
 64%|██████▍   | 24257/37963 [75:20:20<41:09:55, 10.81s/it]
 64%|██████▍   | 24258/37963 [75:20:30<40:19:26, 10.59s/it]
 64%|██████▍   | 24259/37963 [75:20:40<39:43:32, 10.44s/it]
 64%|██████▍   | 24260/37963 [75:20:50<39:18:21, 10.33s/it]
                                                           
{'loss': '0.1323', 'grad_norm': '1.335', 'learning_rate': '6.091e-06', 'epoch': '0.639'}

 64%|██████▍   | 24260/37963 [75:20:50<39:18:21, 10.33s/it]
 64%|██████▍   | 24261/37963 [75:21:00<39:03:48, 10.26s/it]
 64%|██████▍   | 24262/37963 [75:21:10<38:48:49, 10.20s/it]
 64%|██████▍   | 24263/37963 [75:21:20<38:48:11, 10.20s/it]
 64%|██████▍   | 24264/37963 [75:21:30<38:40:18, 10.16s/it]
 64%|██████▍   | 24265/37963 [75:21:47<45:42:37, 12.01s/it]
 64%|██████▍   | 24266/37963 [75:21:57<43:31:40, 11.44s/it]
 64%|██████▍   | 24267/37963 [75:22:07<42:02:31, 11.05s/it]
 64%|██████▍   | 24268/37963 [75:22:17<41:07:03, 10.81s/it]
 64%|██████▍   | 24269/37963 [75:22:27<40:18:33, 10.60s/it]
 64%|██████▍   | 24270/37963 [75:22:37<39:49:17, 10.47s/it]
                                                           
{'loss': '0.1362', 'grad_norm': '1.616', 'learning_rate': '6.083e-06', 'epoch': '0.6393'}

 64%|██████▍   | 24270/37963 [75:22:37<39:49:17, 10.47s/it]
 64%|██████▍   | 24271/37963 [75:22:47<39:20:20, 10.34s/it]
 64%|██████▍   | 24272/37963 [75:22:58<39:03:11, 10.27s/it]
 64%|██████▍   | 24273/37963 [75:23:08<38:56:14, 10.24s/it]
 64%|██████▍   | 24274/37963 [75:23:18<38:45:23, 10.19s/it]
 64%|██████▍   | 24275/37963 [75:23:28<38:29:55, 10.13s/it]
 64%|██████▍   | 24276/37963 [75:23:38<38:29:02, 10.12s/it]
 64%|██████▍   | 24277/37963 [75:23:48<38:24:15, 10.10s/it]
 64%|██████▍   | 24278/37963 [75:23:58<38:23:13, 10.10s/it]
 64%|██████▍   | 24279/37963 [75:24:08<38:12:48, 10.05s/it]
 64%|██████▍   | 24280/37963 [75:24:18<38:19:46, 10.08s/it]
                                                           
{'loss': '0.1289', 'grad_norm': '1.621', 'learning_rate': '6.075e-06', 'epoch': '0.6396'}

 64%|██████▍   | 24280/37963 [75:24:18<38:19:46, 10.08s/it]
 64%|██████▍   | 24281/37963 [75:24:28<38:23:37, 10.10s/it]
 64%|██████▍   | 24282/37963 [75:24:38<38:24:30, 10.11s/it]
 64%|██████▍   | 24283/37963 [75:24:49<38:25:51, 10.11s/it]
 64%|██████▍   | 24284/37963 [75:25:05<45:32:34, 11.99s/it]
 64%|██████▍   | 24285/37963 [75:25:15<43:21:11, 11.41s/it]
 64%|██████▍   | 24286/37963 [75:25:25<41:48:11, 11.00s/it]
 64%|██████▍   | 24287/37963 [75:25:35<40:29:07, 10.66s/it]
 64%|██████▍   | 24288/37963 [75:25:45<39:52:01, 10.50s/it]
 64%|██████▍   | 24289/37963 [75:26:02<47:16:36, 12.45s/it]
 64%|██████▍   | 24290/37963 [75:26:19<52:21:43, 13.79s/it]
                                                           
{'loss': '0.1257', 'grad_norm': '1.428', 'learning_rate': '6.067e-06', 'epoch': '0.6398'}

 64%|██████▍   | 24290/37963 [75:26:19<52:21:43, 13.79s/it]
 64%|██████▍   | 24291/37963 [75:26:29<48:21:11, 12.73s/it]
 64%|██████▍   | 24292/37963 [75:26:39<45:21:51, 11.95s/it]
 64%|██████▍   | 24293/37963 [75:26:49<43:14:30, 11.39s/it]
 64%|██████▍   | 24294/37963 [75:27:00<41:58:54, 11.06s/it]
 64%|██████▍   | 24295/37963 [75:27:10<40:57:51, 10.79s/it]
 64%|██████▍   | 24296/37963 [75:27:26<47:00:46, 12.38s/it]
 64%|██████▍   | 24297/37963 [75:27:43<52:17:21, 13.77s/it]
 64%|██████▍   | 24298/37963 [75:27:53<48:14:45, 12.71s/it]
 64%|██████▍   | 24299/37963 [75:28:03<45:12:07, 11.91s/it]
 64%|██████▍   | 24300/37963 [75:28:26<58:05:26, 15.31s/it]
                                                           
{'loss': '0.1285', 'grad_norm': '2.055', 'learning_rate': '6.059e-06', 'epoch': '0.6401'}

 64%|██████▍   | 24300/37963 [75:28:26<58:05:26, 15.31s/it]
 64%|██████▍   | 24301/37963 [75:28:36<52:04:42, 13.72s/it]
 64%|██████▍   | 24302/37963 [75:28:47<47:58:02, 12.64s/it]
 64%|██████▍   | 24303/37963 [75:28:57<45:01:35, 11.87s/it]
 64%|██████▍   | 24304/37963 [75:29:07<43:03:12, 11.35s/it]
 64%|██████▍   | 24305/37963 [75:29:17<41:32:46, 10.95s/it]
 64%|██████▍   | 24306/37963 [75:29:27<40:37:05, 10.71s/it]
 64%|██████▍   | 24307/37963 [75:29:37<39:46:16, 10.48s/it]
 64%|██████▍   | 24308/37963 [75:29:47<39:19:08, 10.37s/it]
 64%|██████▍   | 24309/37963 [75:29:57<39:01:30, 10.29s/it]
 64%|██████▍   | 24310/37963 [75:30:07<38:37:27, 10.18s/it]
                                                           
{'loss': '0.1232', 'grad_norm': '1.467', 'learning_rate': '6.051e-06', 'epoch': '0.6404'}

 64%|██████▍   | 24310/37963 [75:30:07<38:37:27, 10.18s/it]
 64%|██████▍   | 24311/37963 [75:30:17<38:42:49, 10.21s/it]
 64%|██████▍   | 24312/37963 [75:30:27<38:25:05, 10.13s/it]
 64%|██████▍   | 24313/37963 [75:30:44<45:25:27, 11.98s/it]
 64%|██████▍   | 24314/37963 [75:30:54<43:12:18, 11.40s/it]
 64%|██████▍   | 24315/37963 [75:31:04<41:49:18, 11.03s/it]
 64%|██████▍   | 24316/37963 [75:31:14<40:50:22, 10.77s/it]
 64%|██████▍   | 24317/37963 [75:31:24<39:43:48, 10.48s/it]
 64%|██████▍   | 24318/37963 [75:31:34<39:15:39, 10.36s/it]
 64%|██████▍   | 24319/37963 [75:31:44<38:35:55, 10.18s/it]
 64%|██████▍   | 24320/37963 [75:31:53<38:12:57, 10.08s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '1.85', 'learning_rate': '6.043e-06', 'epoch': '0.6406'}

 64%|██████▍   | 24320/37963 [75:31:53<38:12:57, 10.08s/it]
 64%|██████▍   | 24321/37963 [75:32:04<38:11:15, 10.08s/it]
 64%|██████▍   | 24322/37963 [75:32:14<38:16:37, 10.10s/it]
 64%|██████▍   | 24323/37963 [75:32:23<37:53:50, 10.00s/it]
 64%|██████▍   | 24324/37963 [75:32:34<38:02:20, 10.04s/it]
 64%|██████▍   | 24325/37963 [75:32:44<38:12:40, 10.09s/it]
 64%|██████▍   | 24326/37963 [75:32:53<37:37:44,  9.93s/it]
 64%|██████▍   | 24327/37963 [75:33:03<37:46:31,  9.97s/it]
 64%|██████▍   | 24328/37963 [75:33:14<37:57:08, 10.02s/it]
 64%|██████▍   | 24329/37963 [75:33:24<38:07:45, 10.07s/it]
 64%|██████▍   | 24330/37963 [75:33:34<38:07:39, 10.07s/it]
                                                           
{'loss': '0.1246', 'grad_norm': '1.523', 'learning_rate': '6.036e-06', 'epoch': '0.6409'}

 64%|██████▍   | 24330/37963 [75:33:34<38:07:39, 10.07s/it]
 64%|██████▍   | 24331/37963 [75:33:44<38:13:55, 10.10s/it]
 64%|██████▍   | 24332/37963 [75:33:54<38:11:45, 10.09s/it]
 64%|██████▍   | 24333/37963 [75:34:10<45:25:32, 12.00s/it]
 64%|██████▍   | 24334/37963 [75:34:21<43:14:20, 11.42s/it]
 64%|██████▍   | 24335/37963 [75:34:31<41:53:29, 11.07s/it]
 64%|██████▍   | 24336/37963 [75:34:47<48:13:27, 12.74s/it]
 64%|██████▍   | 24337/37963 [75:34:57<45:00:54, 11.89s/it]
 64%|██████▍   | 24338/37963 [75:35:14<50:57:00, 13.46s/it]
 64%|██████▍   | 24339/37963 [75:35:24<46:23:55, 12.26s/it]
 64%|██████▍   | 24340/37963 [75:35:34<43:58:58, 11.62s/it]
                                                           
{'loss': '0.1324', 'grad_norm': '1.819', 'learning_rate': '6.028e-06', 'epoch': '0.6412'}

 64%|██████▍   | 24340/37963 [75:35:34<43:58:58, 11.62s/it]
 64%|██████▍   | 24341/37963 [75:35:44<42:19:07, 11.18s/it]
 64%|██████▍   | 24342/37963 [75:35:54<40:49:21, 10.79s/it]
 64%|██████▍   | 24343/37963 [75:36:04<40:02:59, 10.59s/it]
 64%|██████▍   | 24344/37963 [75:36:21<47:09:22, 12.47s/it]
 64%|██████▍   | 24345/37963 [75:36:37<51:20:25, 13.57s/it]
 64%|██████▍   | 24346/37963 [75:36:47<46:44:09, 12.36s/it]
 64%|██████▍   | 24347/37963 [75:36:56<43:46:51, 11.58s/it]
 64%|██████▍   | 24348/37963 [75:37:13<49:15:42, 13.03s/it]
 64%|██████▍   | 24349/37963 [75:37:23<45:43:22, 12.09s/it]
 64%|██████▍   | 24350/37963 [75:37:40<51:12:01, 13.54s/it]
                                                           
{'loss': '0.1358', 'grad_norm': '1.517', 'learning_rate': '6.02e-06', 'epoch': '0.6414'}

 64%|██████▍   | 24350/37963 [75:37:40<51:12:01, 13.54s/it]
 64%|██████▍   | 24351/37963 [75:37:50<46:57:36, 12.42s/it]
 64%|██████▍   | 24352/37963 [75:38:00<44:16:06, 11.71s/it]
 64%|██████▍   | 24353/37963 [75:38:10<42:25:50, 11.22s/it]
 64%|██████▍   | 24354/37963 [75:38:20<41:08:20, 10.88s/it]
 64%|██████▍   | 24355/37963 [75:38:30<40:14:04, 10.64s/it]
 64%|██████▍   | 24356/37963 [75:38:40<39:34:56, 10.47s/it]
 64%|██████▍   | 24357/37963 [75:38:50<39:10:29, 10.37s/it]
 64%|██████▍   | 24358/37963 [75:39:00<38:53:05, 10.29s/it]
 64%|██████▍   | 24359/37963 [75:39:10<38:50:45, 10.28s/it]
 64%|██████▍   | 24360/37963 [75:39:20<38:29:41, 10.19s/it]
                                                           
{'loss': '0.1271', 'grad_norm': '1.786', 'learning_rate': '6.012e-06', 'epoch': '0.6417'}

 64%|██████▍   | 24360/37963 [75:39:20<38:29:41, 10.19s/it]
 64%|██████▍   | 24361/37963 [75:39:30<37:45:09,  9.99s/it]
 64%|██████▍   | 24362/37963 [75:39:46<44:55:58, 11.89s/it]
 64%|██████▍   | 24363/37963 [75:39:56<42:58:28, 11.38s/it]
 64%|██████▍   | 24364/37963 [75:40:06<41:28:29, 10.98s/it]
 64%|██████▍   | 24365/37963 [75:40:16<40:00:10, 10.59s/it]
 64%|██████▍   | 24366/37963 [75:40:26<39:25:12, 10.44s/it]
 64%|██████▍   | 24367/37963 [75:40:36<38:36:25, 10.22s/it]
 64%|██████▍   | 24368/37963 [75:40:46<38:30:54, 10.20s/it]
 64%|██████▍   | 24369/37963 [75:40:56<38:30:30, 10.20s/it]
 64%|██████▍   | 24370/37963 [75:41:06<38:20:13, 10.15s/it]
                                                           
{'loss': '0.1155', 'grad_norm': '2.09', 'learning_rate': '6.004e-06', 'epoch': '0.6419'}

 64%|██████▍   | 24370/37963 [75:41:06<38:20:13, 10.15s/it]
 64%|██████▍   | 24371/37963 [75:41:16<38:15:36, 10.13s/it]
 64%|██████▍   | 24372/37963 [75:41:26<37:54:30, 10.04s/it]
 64%|██████▍   | 24373/37963 [75:41:36<37:57:59, 10.06s/it]
 64%|██████▍   | 24374/37963 [75:41:46<37:35:07,  9.96s/it]
 64%|██████▍   | 24375/37963 [75:41:56<37:41:46,  9.99s/it]
 64%|██████▍   | 24376/37963 [75:42:06<37:49:18, 10.02s/it]
 64%|██████▍   | 24377/37963 [75:42:16<37:46:52, 10.01s/it]
 64%|██████▍   | 24378/37963 [75:42:26<37:48:44, 10.02s/it]
 64%|██████▍   | 24379/37963 [75:42:36<37:57:38, 10.06s/it]
 64%|██████▍   | 24380/37963 [75:42:47<38:06:42, 10.10s/it]
                                                           
{'loss': '0.1284', 'grad_norm': '1.799', 'learning_rate': '5.997e-06', 'epoch': '0.6422'}

 64%|██████▍   | 24380/37963 [75:42:47<38:06:42, 10.10s/it]
 64%|██████▍   | 24381/37963 [75:42:57<37:56:10, 10.06s/it]
 64%|██████▍   | 24382/37963 [75:43:13<45:06:24, 11.96s/it]
 64%|██████▍   | 24383/37963 [75:43:23<42:48:36, 11.35s/it]
 64%|██████▍   | 24384/37963 [75:43:40<49:10:03, 13.04s/it]
 64%|██████▍   | 24385/37963 [75:43:49<45:15:10, 12.00s/it]
 64%|██████▍   | 24386/37963 [75:44:00<43:09:35, 11.44s/it]
 64%|██████▍   | 24387/37963 [75:44:16<49:13:21, 13.05s/it]
 64%|██████▍   | 24388/37963 [75:44:27<46:05:58, 12.23s/it]
 64%|██████▍   | 24389/37963 [75:44:36<43:19:26, 11.49s/it]
 64%|██████▍   | 24390/37963 [75:44:47<41:52:16, 11.11s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '1.198', 'learning_rate': '5.989e-06', 'epoch': '0.6425'}

 64%|██████▍   | 24390/37963 [75:44:47<41:52:16, 11.11s/it]
 64%|██████▍   | 24391/37963 [75:44:57<40:44:53, 10.81s/it]
 64%|██████▍   | 24392/37963 [75:45:14<47:42:31, 12.66s/it]
 64%|██████▍   | 24393/37963 [75:45:30<52:03:27, 13.81s/it]
 64%|██████▍   | 24394/37963 [75:45:40<47:53:42, 12.71s/it]
 64%|██████▍   | 24395/37963 [75:45:51<45:10:51, 11.99s/it]
 64%|██████▍   | 24396/37963 [75:46:07<50:05:54, 13.29s/it]
 64%|██████▍   | 24397/37963 [75:46:17<46:28:19, 12.33s/it]
 64%|██████▍   | 24398/37963 [75:46:27<43:56:58, 11.66s/it]
 64%|██████▍   | 24399/37963 [75:46:44<49:26:40, 13.12s/it]
 64%|██████▍   | 24400/37963 [75:46:54<45:59:55, 12.21s/it]
                                                           
{'loss': '0.1305', 'grad_norm': '1.374', 'learning_rate': '5.981e-06', 'epoch': '0.6427'}

 64%|██████▍   | 24400/37963 [75:46:54<45:59:55, 12.21s/it]
 64%|██████▍   | 24401/37963 [75:47:03<42:58:53, 11.41s/it]
 64%|██████▍   | 24402/37963 [75:47:13<41:14:34, 10.95s/it]
 64%|██████▍   | 24403/37963 [75:47:23<40:05:24, 10.64s/it]
 64%|██████▍   | 24404/37963 [75:47:33<39:26:27, 10.47s/it]
 64%|██████▍   | 24405/37963 [75:47:43<39:06:37, 10.38s/it]
 64%|██████▍   | 24406/37963 [75:47:54<38:49:36, 10.31s/it]
 64%|██████▍   | 24407/37963 [75:48:04<38:37:14, 10.26s/it]
 64%|██████▍   | 24408/37963 [75:48:14<38:17:28, 10.17s/it]
 64%|██████▍   | 24409/37963 [75:48:24<38:20:38, 10.18s/it]
 64%|██████▍   | 24410/37963 [75:48:34<38:20:26, 10.18s/it]
                                                           
{'loss': '0.1348', 'grad_norm': '2.272', 'learning_rate': '5.973e-06', 'epoch': '0.643'}

 64%|██████▍   | 24410/37963 [75:48:34<38:20:26, 10.18s/it]
 64%|██████▍   | 24411/37963 [75:48:44<38:13:15, 10.15s/it]
 64%|██████▍   | 24412/37963 [75:49:01<45:40:52, 12.14s/it]
 64%|██████▍   | 24413/37963 [75:49:11<43:00:28, 11.43s/it]
 64%|██████▍   | 24414/37963 [75:49:21<41:33:45, 11.04s/it]
 64%|██████▍   | 24415/37963 [75:49:31<40:25:40, 10.74s/it]
 64%|██████▍   | 24416/37963 [75:49:41<40:08:37, 10.67s/it]
 64%|██████▍   | 24417/37963 [75:49:51<39:11:49, 10.42s/it]
 64%|██████▍   | 24418/37963 [75:50:01<38:50:45, 10.32s/it]
 64%|██████▍   | 24419/37963 [75:50:11<38:17:14, 10.18s/it]
 64%|██████▍   | 24420/37963 [75:50:21<38:04:29, 10.12s/it]
                                                           
{'loss': '0.1195', 'grad_norm': '3.603', 'learning_rate': '5.965e-06', 'epoch': '0.6433'}

 64%|██████▍   | 24420/37963 [75:50:21<38:04:29, 10.12s/it]
 64%|██████▍   | 24421/37963 [75:50:31<37:24:02,  9.94s/it]
 64%|██████▍   | 24422/37963 [75:50:41<37:24:00,  9.94s/it]
 64%|██████▍   | 24423/37963 [75:50:51<37:34:43,  9.99s/it]
 64%|██████▍   | 24424/37963 [75:51:01<37:42:04, 10.02s/it]
 64%|██████▍   | 24425/37963 [75:51:11<37:49:18, 10.06s/it]
 64%|██████▍   | 24426/37963 [75:51:21<37:56:14, 10.09s/it]
 64%|██████▍   | 24427/37963 [75:51:31<37:36:42, 10.00s/it]
 64%|██████▍   | 24428/37963 [75:51:41<37:13:13,  9.90s/it]
 64%|██████▍   | 24429/37963 [75:51:51<37:29:42,  9.97s/it]
 64%|██████▍   | 24430/37963 [75:52:01<37:17:26,  9.92s/it]
                                                           
{'loss': '0.1343', 'grad_norm': '2.013', 'learning_rate': '5.957e-06', 'epoch': '0.6435'}

 64%|██████▍   | 24430/37963 [75:52:01<37:17:26,  9.92s/it]
 64%|██████▍   | 24431/37963 [75:52:17<44:36:36, 11.87s/it]
 64%|██████▍   | 24432/37963 [75:52:27<42:39:50, 11.35s/it]
 64%|██████▍   | 24433/37963 [75:52:44<48:58:09, 13.03s/it]
 64%|██████▍   | 24434/37963 [75:52:54<45:41:15, 12.16s/it]
 64%|██████▍   | 24435/37963 [75:53:04<43:26:31, 11.56s/it]
 64%|██████▍   | 24436/37963 [75:53:21<49:42:26, 13.23s/it]
 64%|██████▍   | 24437/37963 [75:53:31<46:05:46, 12.27s/it]
 64%|██████▍   | 24438/37963 [75:53:41<43:13:32, 11.51s/it]
 64%|██████▍   | 24439/37963 [75:53:51<41:15:32, 10.98s/it]
 64%|██████▍   | 24440/37963 [75:54:07<46:37:31, 12.41s/it]
                                                           
{'loss': '0.1271', 'grad_norm': '2.07', 'learning_rate': '5.95e-06', 'epoch': '0.6438'}

 64%|██████▍   | 24440/37963 [75:54:07<46:37:31, 12.41s/it]
 64%|██████▍   | 24441/37963 [75:54:24<51:45:55, 13.78s/it]
 64%|██████▍   | 24442/37963 [75:54:34<47:39:35, 12.69s/it]
 64%|██████▍   | 24443/37963 [75:54:44<44:47:48, 11.93s/it]
 64%|██████▍   | 24444/37963 [75:54:54<42:12:37, 11.24s/it]
 64%|██████▍   | 24445/37963 [75:55:10<48:11:57, 12.84s/it]
 64%|██████▍   | 24446/37963 [75:55:20<45:12:15, 12.04s/it]
 64%|██████▍   | 24447/37963 [75:55:30<43:05:45, 11.48s/it]
 64%|██████▍   | 24448/37963 [75:55:48<49:37:56, 13.22s/it]
 64%|██████▍   | 24449/37963 [75:55:58<45:56:17, 12.24s/it]
 64%|██████▍   | 24450/37963 [75:56:08<43:37:19, 11.62s/it]
                                                           
{'loss': '0.1292', 'grad_norm': '2.035', 'learning_rate': '5.942e-06', 'epoch': '0.6441'}

 64%|██████▍   | 24450/37963 [75:56:08<43:37:19, 11.62s/it]
 64%|██████▍   | 24451/37963 [75:56:18<42:15:44, 11.26s/it]
 64%|██████▍   | 24452/37963 [75:56:28<40:41:21, 10.84s/it]
 64%|██████▍   | 24453/37963 [75:56:38<39:53:47, 10.63s/it]
 64%|██████▍   | 24454/37963 [75:56:48<39:20:12, 10.48s/it]
 64%|██████▍   | 24455/37963 [75:56:59<38:54:23, 10.37s/it]
 64%|██████▍   | 24456/37963 [75:57:08<38:03:47, 10.14s/it]
 64%|██████▍   | 24457/37963 [75:57:18<38:11:04, 10.18s/it]
 64%|██████▍   | 24458/37963 [75:57:29<38:10:06, 10.17s/it]
 64%|██████▍   | 24459/37963 [75:57:45<45:18:53, 12.08s/it]
 64%|██████▍   | 24460/37963 [75:57:55<42:41:08, 11.38s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '1.443', 'learning_rate': '5.934e-06', 'epoch': '0.6443'}

 64%|██████▍   | 24460/37963 [75:57:55<42:41:08, 11.38s/it]
 64%|██████▍   | 24461/37963 [75:58:05<41:10:21, 10.98s/it]
 64%|██████▍   | 24462/37963 [75:58:15<40:09:32, 10.71s/it]
 64%|██████▍   | 24463/37963 [75:58:25<39:25:23, 10.51s/it]
 64%|██████▍   | 24464/37963 [75:58:35<38:55:13, 10.38s/it]
 64%|██████▍   | 24465/37963 [75:58:45<38:46:36, 10.34s/it]
 64%|██████▍   | 24466/37963 [75:58:55<38:28:40, 10.26s/it]
 64%|██████▍   | 24467/37963 [75:59:06<38:19:28, 10.22s/it]
 64%|██████▍   | 24468/37963 [75:59:16<38:18:33, 10.22s/it]
 64%|██████▍   | 24469/37963 [75:59:25<37:29:33, 10.00s/it]
 64%|██████▍   | 24470/37963 [75:59:35<37:34:45, 10.03s/it]
                                                           
{'loss': '0.1346', 'grad_norm': '1.841', 'learning_rate': '5.926e-06', 'epoch': '0.6446'}

 64%|██████▍   | 24470/37963 [75:59:35<37:34:45, 10.03s/it]
 64%|██████▍   | 24471/37963 [75:59:45<37:02:08,  9.88s/it]
 64%|██████▍   | 24472/37963 [75:59:55<37:19:23,  9.96s/it]
 64%|██████▍   | 24473/37963 [76:00:05<37:31:39, 10.01s/it]
 64%|██████▍   | 24474/37963 [76:00:15<37:43:23, 10.07s/it]
 64%|██████▍   | 24475/37963 [76:00:25<37:31:21, 10.01s/it]
 64%|██████▍   | 24476/37963 [76:00:35<37:19:26,  9.96s/it]
 64%|██████▍   | 24477/37963 [76:00:45<37:25:50,  9.99s/it]
 64%|██████▍   | 24478/37963 [76:01:02<44:54:17, 11.99s/it]
 64%|██████▍   | 24479/37963 [76:01:12<42:45:59, 11.42s/it]
 64%|██████▍   | 24480/37963 [76:01:22<41:27:23, 11.07s/it]
                                                           
{'loss': '0.1299', 'grad_norm': '2.092', 'learning_rate': '5.919e-06', 'epoch': '0.6448'}

 64%|██████▍   | 24480/37963 [76:01:22<41:27:23, 11.07s/it]
 64%|██████▍   | 24481/37963 [76:01:38<46:59:10, 12.55s/it]
 64%|██████▍   | 24482/37963 [76:01:48<44:16:40, 11.82s/it]
 64%|██████▍   | 24483/37963 [76:01:58<41:50:51, 11.18s/it]
 64%|██████▍   | 24484/37963 [76:02:08<40:29:31, 10.81s/it]
 64%|██████▍   | 24485/37963 [76:02:25<47:26:22, 12.67s/it]
 64%|██████▍   | 24486/37963 [76:02:35<44:25:19, 11.87s/it]
 65%|██████▍   | 24487/37963 [76:02:45<42:33:53, 11.37s/it]
 65%|██████▍   | 24488/37963 [76:02:55<41:05:04, 10.98s/it]
 65%|██████▍   | 24489/37963 [76:03:12<47:05:48, 12.58s/it]
 65%|██████▍   | 24490/37963 [76:03:28<51:54:01, 13.87s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '2.728', 'learning_rate': '5.911e-06', 'epoch': '0.6451'}

 65%|██████▍   | 24490/37963 [76:03:28<51:54:01, 13.87s/it]
 65%|██████▍   | 24491/37963 [76:03:38<47:23:25, 12.66s/it]
 65%|██████▍   | 24492/37963 [76:03:48<44:30:41, 11.90s/it]
 65%|██████▍   | 24493/37963 [76:03:58<42:24:29, 11.33s/it]
 65%|██████▍   | 24494/37963 [76:04:15<48:18:45, 12.91s/it]
 65%|██████▍   | 24495/37963 [76:04:25<45:07:59, 12.06s/it]
 65%|██████▍   | 24496/37963 [76:04:42<50:27:56, 13.49s/it]
 65%|██████▍   | 24497/37963 [76:04:52<46:39:22, 12.47s/it]
 65%|██████▍   | 24498/37963 [76:05:02<43:56:33, 11.75s/it]
 65%|██████▍   | 24499/37963 [76:05:12<42:02:12, 11.24s/it]
 65%|██████▍   | 24500/37963 [76:05:22<40:47:17, 10.91s/it]
                                                           
{'loss': '0.14', 'grad_norm': '1.862', 'learning_rate': '5.903e-06', 'epoch': '0.6454'}

 65%|██████▍   | 24500/37963 [76:05:22<40:47:17, 10.91s/it]
 65%|██████▍   | 24501/37963 [76:05:32<39:38:19, 10.60s/it]
 65%|██████▍   | 24502/37963 [76:05:42<39:06:02, 10.46s/it]
 65%|██████▍   | 24503/37963 [76:05:52<38:50:31, 10.39s/it]
 65%|██████▍   | 24504/37963 [76:06:02<38:23:55, 10.27s/it]
 65%|██████▍   | 24505/37963 [76:06:13<38:08:29, 10.20s/it]
 65%|██████▍   | 24506/37963 [76:06:23<38:03:37, 10.18s/it]
 65%|██████▍   | 24507/37963 [76:06:39<45:15:50, 12.11s/it]
 65%|██████▍   | 24508/37963 [76:06:49<43:02:10, 11.51s/it]
 65%|██████▍   | 24509/37963 [76:07:00<41:31:29, 11.11s/it]
 65%|██████▍   | 24510/37963 [76:07:09<39:49:27, 10.66s/it]
                                                           
{'loss': '0.1247', 'grad_norm': '1.031', 'learning_rate': '5.895e-06', 'epoch': '0.6456'}

 65%|██████▍   | 24510/37963 [76:07:09<39:49:27, 10.66s/it]
 65%|██████▍   | 24511/37963 [76:07:19<39:18:25, 10.52s/it]
 65%|██████▍   | 24512/37963 [76:07:29<38:25:47, 10.29s/it]
 65%|██████▍   | 24513/37963 [76:07:39<38:10:35, 10.22s/it]
 65%|██████▍   | 24514/37963 [76:07:49<38:10:34, 10.22s/it]
 65%|██████▍   | 24515/37963 [76:07:59<37:58:29, 10.17s/it]
 65%|██████▍   | 24516/37963 [76:08:10<37:56:43, 10.16s/it]
 65%|██████▍   | 24517/37963 [76:08:20<37:51:55, 10.14s/it]
 65%|██████▍   | 24518/37963 [76:08:30<37:39:06, 10.08s/it]
 65%|██████▍   | 24519/37963 [76:08:40<37:43:21, 10.10s/it]
 65%|██████▍   | 24520/37963 [76:08:50<37:47:12, 10.12s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '1.843', 'learning_rate': '5.887e-06', 'epoch': '0.6459'}

 65%|██████▍   | 24520/37963 [76:08:50<37:47:12, 10.12s/it]
 65%|██████▍   | 24521/37963 [76:09:00<37:48:54, 10.13s/it]
 65%|██████▍   | 24522/37963 [76:09:10<37:46:24, 10.12s/it]
 65%|██████▍   | 24523/37963 [76:09:20<37:44:31, 10.11s/it]
 65%|██████▍   | 24524/37963 [76:09:30<37:18:48, 10.00s/it]
 65%|██████▍   | 24525/37963 [76:09:40<37:25:14, 10.02s/it]
 65%|██████▍   | 24526/37963 [76:09:50<37:32:13, 10.06s/it]
 65%|██████▍   | 24527/37963 [76:10:07<45:11:51, 12.11s/it]
 65%|██████▍   | 24528/37963 [76:10:17<43:08:38, 11.56s/it]
 65%|██████▍   | 24529/37963 [76:10:34<48:23:37, 12.97s/it]
 65%|██████▍   | 24530/37963 [76:10:43<44:46:12, 12.00s/it]
                                                           
{'loss': '0.1253', 'grad_norm': '1.976', 'learning_rate': '5.88e-06', 'epoch': '0.6462'}

 65%|██████▍   | 24530/37963 [76:10:43<44:46:12, 12.00s/it]
 65%|██████▍   | 24531/37963 [76:10:53<42:16:28, 11.33s/it]
 65%|██████▍   | 24532/37963 [76:11:03<41:07:27, 11.02s/it]
 65%|██████▍   | 24533/37963 [76:11:21<48:01:25, 12.87s/it]
 65%|██████▍   | 24534/37963 [76:11:30<44:36:41, 11.96s/it]
 65%|██████▍   | 24535/37963 [76:11:46<48:54:55, 13.11s/it]
 65%|██████▍   | 24536/37963 [76:11:57<45:44:36, 12.26s/it]
 65%|██████▍   | 24537/37963 [76:12:07<43:23:07, 11.63s/it]
 65%|██████▍   | 24538/37963 [76:12:17<41:41:41, 11.18s/it]
 65%|██████▍   | 24539/37963 [76:12:34<48:48:44, 13.09s/it]
 65%|██████▍   | 24540/37963 [76:12:51<52:35:20, 14.10s/it]
                                                           
{'loss': '0.1423', 'grad_norm': '2.52', 'learning_rate': '5.872e-06', 'epoch': '0.6464'}

 65%|██████▍   | 24540/37963 [76:12:51<52:35:20, 14.10s/it]
 65%|██████▍   | 24541/37963 [76:13:01<48:06:15, 12.90s/it]
 65%|██████▍   | 24542/37963 [76:13:18<52:15:40, 14.02s/it]
 65%|██████▍   | 24543/37963 [76:13:28<47:53:51, 12.85s/it]
 65%|██████▍   | 24544/37963 [76:13:37<44:19:45, 11.89s/it]
 65%|██████▍   | 24545/37963 [76:13:48<42:26:06, 11.39s/it]
 65%|██████▍   | 24546/37963 [76:13:58<40:51:05, 10.96s/it]
 65%|██████▍   | 24547/37963 [76:14:08<39:59:23, 10.73s/it]
 65%|██████▍   | 24548/37963 [76:14:18<39:16:07, 10.54s/it]
 65%|██████▍   | 24549/37963 [76:14:28<38:50:49, 10.43s/it]
 65%|██████▍   | 24550/37963 [76:14:38<38:30:52, 10.34s/it]
                                                           
{'loss': '0.1293', 'grad_norm': '1.815', 'learning_rate': '5.864e-06', 'epoch': '0.6467'}

 65%|██████▍   | 24550/37963 [76:14:38<38:30:52, 10.34s/it]
 65%|██████▍   | 24551/37963 [76:14:48<38:14:48, 10.27s/it]
 65%|██████▍   | 24552/37963 [76:14:58<37:58:02, 10.19s/it]
 65%|██████▍   | 24553/37963 [76:15:08<37:37:14, 10.10s/it]
 65%|██████▍   | 24554/37963 [76:15:25<44:44:40, 12.01s/it]
 65%|██████▍   | 24555/37963 [76:15:35<42:28:54, 11.41s/it]
 65%|██████▍   | 24556/37963 [76:15:45<40:56:06, 10.99s/it]
 65%|██████▍   | 24557/37963 [76:15:55<40:04:06, 10.76s/it]
 65%|██████▍   | 24558/37963 [76:16:05<39:06:25, 10.50s/it]
 65%|██████▍   | 24559/37963 [76:16:15<38:39:45, 10.38s/it]
 65%|██████▍   | 24560/37963 [76:16:25<38:25:13, 10.32s/it]
                                                           
{'loss': '0.1174', 'grad_norm': '1.346', 'learning_rate': '5.856e-06', 'epoch': '0.6469'}

 65%|██████▍   | 24560/37963 [76:16:25<38:25:13, 10.32s/it]
 65%|██████▍   | 24561/37963 [76:16:35<38:05:55, 10.23s/it]
 65%|██████▍   | 24562/37963 [76:16:45<37:55:27, 10.19s/it]
 65%|██████▍   | 24563/37963 [76:16:55<37:39:51, 10.12s/it]
 65%|██████▍   | 24564/37963 [76:17:05<37:14:01, 10.00s/it]
 65%|██████▍   | 24565/37963 [76:17:15<37:27:28, 10.06s/it]
 65%|██████▍   | 24566/37963 [76:17:25<37:24:59, 10.05s/it]
 65%|██████▍   | 24567/37963 [76:17:35<37:20:41, 10.04s/it]
 65%|██████▍   | 24568/37963 [76:17:45<37:30:11, 10.08s/it]
 65%|██████▍   | 24569/37963 [76:17:55<37:39:27, 10.12s/it]
 65%|██████▍   | 24570/37963 [76:18:06<37:37:41, 10.11s/it]
                                                           
{'loss': '0.131', 'grad_norm': '1.839', 'learning_rate': '5.849e-06', 'epoch': '0.6472'}

 65%|██████▍   | 24570/37963 [76:18:06<37:37:41, 10.11s/it]
 65%|██████▍   | 24571/37963 [76:18:15<37:19:21, 10.03s/it]
 65%|██████▍   | 24572/37963 [76:18:25<37:22:05, 10.05s/it]
 65%|██████▍   | 24573/37963 [76:18:36<37:24:01, 10.06s/it]
 65%|██████▍   | 24574/37963 [76:18:52<45:04:41, 12.12s/it]
 65%|██████▍   | 24575/37963 [76:19:02<42:40:35, 11.48s/it]
 65%|██████▍   | 24576/37963 [76:19:13<41:18:15, 11.11s/it]
 65%|██████▍   | 24577/37963 [76:19:29<47:05:45, 12.67s/it]
 65%|██████▍   | 24578/37963 [76:19:39<44:13:27, 11.89s/it]
 65%|██████▍   | 24579/37963 [76:19:56<49:45:41, 13.38s/it]
 65%|██████▍   | 24580/37963 [76:20:06<46:07:04, 12.41s/it]
                                                           
{'loss': '0.129', 'grad_norm': '1.876', 'learning_rate': '5.841e-06', 'epoch': '0.6475'}

 65%|██████▍   | 24580/37963 [76:20:06<46:07:04, 12.41s/it]
 65%|██████▍   | 24581/37963 [76:20:16<43:37:05, 11.73s/it]
 65%|██████▍   | 24582/37963 [76:20:26<41:47:49, 11.24s/it]
 65%|██████▍   | 24583/37963 [76:20:36<40:27:37, 10.89s/it]
 65%|██████▍   | 24584/37963 [76:20:52<46:03:50, 12.39s/it]
 65%|██████▍   | 24585/37963 [76:21:02<43:05:41, 11.60s/it]
 65%|██████▍   | 24586/37963 [76:21:12<41:13:29, 11.09s/it]
 65%|██████▍   | 24587/37963 [76:21:29<47:55:55, 12.90s/it]
 65%|██████▍   | 24588/37963 [76:21:45<51:46:44, 13.94s/it]
 65%|██████▍   | 24589/37963 [76:21:56<47:30:54, 12.79s/it]
 65%|██████▍   | 24590/37963 [76:22:12<51:51:52, 13.96s/it]
                                                           
{'loss': '0.1241', 'grad_norm': '2.47', 'learning_rate': '5.833e-06', 'epoch': '0.6477'}

 65%|██████▍   | 24590/37963 [76:22:12<51:51:52, 13.96s/it]
 65%|██████▍   | 24591/37963 [76:22:22<47:15:05, 12.72s/it]
 65%|██████▍   | 24592/37963 [76:22:32<44:22:03, 11.95s/it]
 65%|██████▍   | 24593/37963 [76:22:42<41:46:17, 11.25s/it]
 65%|██████▍   | 24594/37963 [76:22:52<40:30:33, 10.91s/it]
 65%|██████▍   | 24595/37963 [76:23:02<39:41:05, 10.69s/it]
 65%|██████▍   | 24596/37963 [76:23:12<38:59:11, 10.50s/it]
 65%|██████▍   | 24597/37963 [76:23:22<38:31:23, 10.38s/it]
 65%|██████▍   | 24598/37963 [76:23:32<38:13:19, 10.30s/it]
 65%|██████▍   | 24599/37963 [76:23:42<37:58:55, 10.23s/it]
 65%|██████▍   | 24600/37963 [76:23:59<44:50:47, 12.08s/it]
                                                           
{'loss': '0.1263', 'grad_norm': '1.636', 'learning_rate': '5.825e-06', 'epoch': '0.648'}

 65%|██████▍   | 24600/37963 [76:23:59<44:50:47, 12.08s/it]
 65%|██████▍   | 24601/37963 [76:24:09<42:20:21, 11.41s/it]
 65%|██████▍   | 24602/37963 [76:24:19<40:56:11, 11.03s/it]
 65%|██████▍   | 24603/37963 [76:24:29<39:48:06, 10.73s/it]
 65%|██████▍   | 24604/37963 [76:24:39<39:02:36, 10.52s/it]
 65%|██████▍   | 24605/37963 [76:24:49<38:34:57, 10.40s/it]
 65%|██████▍   | 24606/37963 [76:24:59<38:15:12, 10.31s/it]
 65%|██████▍   | 24607/37963 [76:25:09<37:32:58, 10.12s/it]
 65%|██████▍   | 24608/37963 [76:25:19<37:28:06, 10.10s/it]
 65%|██████▍   | 24609/37963 [76:25:29<37:02:01,  9.98s/it]
 65%|██████▍   | 24610/37963 [76:25:38<36:50:20,  9.93s/it]
                                                           
{'loss': '0.127', 'grad_norm': '2.162', 'learning_rate': '5.818e-06', 'epoch': '0.6483'}

 65%|██████▍   | 24610/37963 [76:25:38<36:50:20,  9.93s/it]
 65%|██████▍   | 24611/37963 [76:25:48<36:59:12,  9.97s/it]
 65%|██████▍   | 24612/37963 [76:25:58<36:58:49,  9.97s/it]
 65%|██████▍   | 24613/37963 [76:26:09<37:09:11, 10.02s/it]
 65%|██████▍   | 24614/37963 [76:26:19<37:21:39, 10.08s/it]
 65%|██████▍   | 24615/37963 [76:26:29<37:23:34, 10.09s/it]
 65%|██████▍   | 24616/37963 [76:26:39<37:26:22, 10.10s/it]
 65%|██████▍   | 24617/37963 [76:26:49<37:25:30, 10.10s/it]
 65%|██████▍   | 24618/37963 [76:26:59<37:30:31, 10.12s/it]
 65%|██████▍   | 24619/37963 [76:27:09<37:15:45, 10.05s/it]
 65%|██████▍   | 24620/37963 [76:27:19<37:13:44, 10.04s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '1.785', 'learning_rate': '5.81e-06', 'epoch': '0.6485'}

 65%|██████▍   | 24620/37963 [76:27:19<37:13:44, 10.04s/it]
 65%|██████▍   | 24621/37963 [76:27:36<44:15:46, 11.94s/it]
 65%|██████▍   | 24622/37963 [76:27:46<42:06:39, 11.36s/it]
 65%|██████▍   | 24623/37963 [76:27:56<40:37:40, 10.96s/it]
 65%|██████▍   | 24624/37963 [76:28:05<39:18:56, 10.61s/it]
 65%|██████▍   | 24625/37963 [76:28:22<46:32:43, 12.56s/it]
 65%|██████▍   | 24626/37963 [76:28:32<43:17:36, 11.69s/it]
 65%|██████▍   | 24627/37963 [76:28:42<41:35:07, 11.23s/it]
 65%|██████▍   | 24628/37963 [76:28:52<40:22:35, 10.90s/it]
 65%|██████▍   | 24629/37963 [76:29:09<47:10:02, 12.73s/it]
 65%|██████▍   | 24630/37963 [76:29:20<44:20:09, 11.97s/it]
                                                           
{'loss': '0.1359', 'grad_norm': '2.412', 'learning_rate': '5.802e-06', 'epoch': '0.6488'}

 65%|██████▍   | 24630/37963 [76:29:20<44:20:09, 11.97s/it]
 65%|██████▍   | 24631/37963 [76:29:30<42:23:55, 11.45s/it]
 65%|██████▍   | 24632/37963 [76:29:40<41:16:25, 11.15s/it]
 65%|██████▍   | 24633/37963 [76:29:50<40:04:43, 10.82s/it]
 65%|██████▍   | 24634/37963 [76:30:14<53:52:34, 14.55s/it]
 65%|██████▍   | 24635/37963 [76:30:24<49:04:40, 13.26s/it]
 65%|██████▍   | 24636/37963 [76:30:40<52:42:40, 14.24s/it]
 65%|██████▍   | 24637/37963 [76:30:51<48:10:02, 13.01s/it]
 65%|██████▍   | 24638/37963 [76:31:01<45:01:25, 12.16s/it]
 65%|██████▍   | 24639/37963 [76:31:18<50:33:24, 13.66s/it]
 65%|██████▍   | 24640/37963 [76:31:28<46:40:58, 12.61s/it]
                                                           
{'loss': '0.1331', 'grad_norm': '2.542', 'learning_rate': '5.794e-06', 'epoch': '0.6491'}

 65%|██████▍   | 24640/37963 [76:31:28<46:40:58, 12.61s/it]
 65%|██████▍   | 24641/37963 [76:31:38<43:57:22, 11.88s/it]
 65%|██████▍   | 24642/37963 [76:31:48<41:45:20, 11.28s/it]
 65%|██████▍   | 24643/37963 [76:31:58<39:45:01, 10.74s/it]
 65%|██████▍   | 24644/37963 [76:32:08<38:58:25, 10.53s/it]
 65%|██████▍   | 24645/37963 [76:32:18<38:34:24, 10.43s/it]
 65%|██████▍   | 24646/37963 [76:32:28<38:08:17, 10.31s/it]
 65%|██████▍   | 24647/37963 [76:32:38<37:35:05, 10.16s/it]
 65%|██████▍   | 24648/37963 [76:32:54<44:11:46, 11.95s/it]
 65%|██████▍   | 24649/37963 [76:33:04<42:08:13, 11.39s/it]
 65%|██████▍   | 24650/37963 [76:33:14<40:18:19, 10.90s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '2.086', 'learning_rate': '5.787e-06', 'epoch': '0.6493'}

 65%|██████▍   | 24650/37963 [76:33:14<40:18:19, 10.90s/it]
 65%|██████▍   | 24651/37963 [76:33:24<39:22:11, 10.65s/it]
 65%|██████▍   | 24652/37963 [76:33:34<38:41:42, 10.47s/it]
 65%|██████▍   | 24653/37963 [76:33:44<38:33:16, 10.43s/it]
 65%|██████▍   | 24654/37963 [76:33:54<38:05:17, 10.30s/it]
 65%|██████▍   | 24655/37963 [76:34:04<37:56:05, 10.26s/it]
 65%|██████▍   | 24656/37963 [76:34:14<37:27:05, 10.13s/it]
 65%|██████▍   | 24657/37963 [76:34:24<37:26:09, 10.13s/it]
 65%|██████▍   | 24658/37963 [76:34:34<37:09:48, 10.06s/it]
 65%|██████▍   | 24659/37963 [76:34:44<37:10:17, 10.06s/it]
 65%|██████▍   | 24660/37963 [76:34:54<37:04:03, 10.03s/it]
                                                           
{'loss': '0.1205', 'grad_norm': '1.694', 'learning_rate': '5.779e-06', 'epoch': '0.6496'}

 65%|██████▍   | 24660/37963 [76:34:54<37:04:03, 10.03s/it]
 65%|██████▍   | 24661/37963 [76:35:04<37:16:45, 10.09s/it]
 65%|██████▍   | 24662/37963 [76:35:15<37:34:45, 10.17s/it]
 65%|██████▍   | 24663/37963 [76:35:25<37:31:51, 10.16s/it]
 65%|██████▍   | 24664/37963 [76:35:35<37:24:59, 10.13s/it]
 65%|██████▍   | 24665/37963 [76:35:45<37:25:51, 10.13s/it]
 65%|██████▍   | 24666/37963 [76:35:55<37:20:54, 10.11s/it]
 65%|██████▍   | 24667/37963 [76:36:05<37:20:17, 10.11s/it]
 65%|██████▍   | 24668/37963 [76:36:15<37:20:24, 10.11s/it]
 65%|██████▍   | 24669/37963 [76:36:25<37:14:26, 10.08s/it]
 65%|██████▍   | 24670/37963 [76:36:42<44:18:37, 12.00s/it]
                                                           
{'loss': '0.143', 'grad_norm': '1.181', 'learning_rate': '5.771e-06', 'epoch': '0.6498'}

 65%|██████▍   | 24670/37963 [76:36:42<44:18:37, 12.00s/it]
 65%|██████▍   | 24671/37963 [76:36:52<42:10:56, 11.42s/it]
 65%|██████▍   | 24672/37963 [76:37:02<40:48:17, 11.05s/it]
 65%|██████▍   | 24673/37963 [76:37:12<39:33:24, 10.72s/it]
 65%|██████▍   | 24674/37963 [76:37:29<46:15:45, 12.53s/it]
 65%|██████▍   | 24675/37963 [76:37:39<43:40:17, 11.83s/it]
 65%|██████▌   | 24676/37963 [76:37:49<41:36:27, 11.27s/it]
 65%|██████▌   | 24677/37963 [76:38:06<47:56:54, 12.99s/it]
 65%|██████▌   | 24678/37963 [76:38:16<44:40:20, 12.11s/it]
 65%|██████▌   | 24679/37963 [76:38:26<42:25:28, 11.50s/it]
 65%|██████▌   | 24680/37963 [76:38:36<40:43:54, 11.04s/it]
                                                           
{'loss': '0.126', 'grad_norm': '1.349', 'learning_rate': '5.763e-06', 'epoch': '0.6501'}

 65%|██████▌   | 24680/37963 [76:38:36<40:43:54, 11.04s/it]
 65%|██████▌   | 24681/37963 [76:38:52<46:43:17, 12.66s/it]
 65%|██████▌   | 24682/37963 [76:39:09<51:28:47, 13.95s/it]
 65%|██████▌   | 24683/37963 [76:39:20<47:15:06, 12.81s/it]
 65%|██████▌   | 24684/37963 [76:39:36<51:46:46, 14.04s/it]
 65%|██████▌   | 24685/37963 [76:39:47<47:27:31, 12.87s/it]
 65%|██████▌   | 24686/37963 [76:39:57<44:18:43, 12.02s/it]
 65%|██████▌   | 24687/37963 [76:40:07<41:59:53, 11.39s/it]
 65%|██████▌   | 24688/37963 [76:40:23<48:06:07, 13.04s/it]
 65%|██████▌   | 24689/37963 [76:40:34<44:52:50, 12.17s/it]
 65%|██████▌   | 24690/37963 [76:40:44<42:37:46, 11.56s/it]
                                                           
{'loss': '0.1243', 'grad_norm': '1.469', 'learning_rate': '5.756e-06', 'epoch': '0.6504'}

 65%|██████▌   | 24690/37963 [76:40:44<42:37:46, 11.56s/it]
 65%|██████▌   | 24691/37963 [76:40:53<40:21:25, 10.95s/it]
 65%|██████▌   | 24692/37963 [76:41:03<39:01:49, 10.59s/it]
 65%|██████▌   | 24693/37963 [76:41:13<38:08:57, 10.35s/it]
 65%|██████▌   | 24694/37963 [76:41:23<37:57:49, 10.30s/it]
 65%|██████▌   | 24695/37963 [76:41:33<37:48:27, 10.26s/it]
 65%|██████▌   | 24696/37963 [76:41:50<44:51:19, 12.17s/it]
 65%|██████▌   | 24697/37963 [76:41:59<41:56:34, 11.38s/it]
 65%|██████▌   | 24698/37963 [76:42:09<40:16:56, 10.93s/it]
 65%|██████▌   | 24699/37963 [76:42:19<39:35:19, 10.74s/it]
 65%|██████▌   | 24700/37963 [76:42:30<38:54:55, 10.56s/it]
                                                           
{'loss': '0.1218', 'grad_norm': '3.042', 'learning_rate': '5.748e-06', 'epoch': '0.6506'}

 65%|██████▌   | 24700/37963 [76:42:30<38:54:55, 10.56s/it]
 65%|██████▌   | 24701/37963 [76:42:40<38:28:43, 10.45s/it]
 65%|██████▌   | 24702/37963 [76:42:50<38:01:13, 10.32s/it]
 65%|██████▌   | 24703/37963 [76:43:00<37:48:12, 10.26s/it]
 65%|██████▌   | 24704/37963 [76:43:10<37:37:07, 10.21s/it]
 65%|██████▌   | 24705/37963 [76:43:20<37:19:23, 10.13s/it]
 65%|██████▌   | 24706/37963 [76:43:30<37:17:38, 10.13s/it]
 65%|██████▌   | 24707/37963 [76:43:40<37:14:21, 10.11s/it]
 65%|██████▌   | 24708/37963 [76:43:50<37:17:30, 10.13s/it]
 65%|██████▌   | 24709/37963 [76:44:00<37:09:54, 10.09s/it]
 65%|██████▌   | 24710/37963 [76:44:10<37:05:44, 10.08s/it]
                                                           
{'loss': '0.1222', 'grad_norm': '2.173', 'learning_rate': '5.74e-06', 'epoch': '0.6509'}

 65%|██████▌   | 24710/37963 [76:44:10<37:05:44, 10.08s/it]
 65%|██████▌   | 24711/37963 [76:44:21<37:11:58, 10.11s/it]
 65%|██████▌   | 24712/37963 [76:44:31<37:12:03, 10.11s/it]
 65%|██████▌   | 24713/37963 [76:44:41<36:53:27, 10.02s/it]
 65%|██████▌   | 24714/37963 [76:44:51<37:09:18, 10.10s/it]
 65%|██████▌   | 24715/37963 [76:45:01<37:08:05, 10.09s/it]
 65%|██████▌   | 24716/37963 [76:45:11<37:07:24, 10.09s/it]
 65%|██████▌   | 24717/37963 [76:45:21<37:03:57, 10.07s/it]
 65%|██████▌   | 24718/37963 [76:45:31<36:34:24,  9.94s/it]
 65%|██████▌   | 24719/37963 [76:45:47<43:56:59, 11.95s/it]
 65%|██████▌   | 24720/37963 [76:45:57<41:46:15, 11.36s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '1.528', 'learning_rate': '5.732e-06', 'epoch': '0.6512'}

 65%|██████▌   | 24720/37963 [76:45:57<41:46:15, 11.36s/it]
 65%|██████▌   | 24721/37963 [76:46:07<40:30:37, 11.01s/it]
 65%|██████▌   | 24722/37963 [76:46:24<46:28:49, 12.64s/it]
 65%|██████▌   | 24723/37963 [76:46:34<43:46:10, 11.90s/it]
 65%|██████▌   | 24724/37963 [76:46:44<41:26:58, 11.27s/it]
 65%|██████▌   | 24725/37963 [76:47:01<47:44:18, 12.98s/it]
 65%|██████▌   | 24726/37963 [76:47:11<44:29:39, 12.10s/it]
 65%|██████▌   | 24727/37963 [76:47:21<42:21:14, 11.52s/it]
 65%|██████▌   | 24728/37963 [76:47:31<40:48:40, 11.10s/it]
 65%|██████▌   | 24729/37963 [76:47:47<46:06:48, 12.54s/it]
 65%|██████▌   | 24730/37963 [76:47:57<43:28:41, 11.83s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '3.113', 'learning_rate': '5.725e-06', 'epoch': '0.6514'}

 65%|██████▌   | 24730/37963 [76:47:57<43:28:41, 11.83s/it]
 65%|██████▌   | 24731/37963 [76:48:14<49:03:48, 13.35s/it]
 65%|██████▌   | 24732/37963 [76:48:31<52:39:04, 14.33s/it]
 65%|██████▌   | 24733/37963 [76:48:41<47:55:58, 13.04s/it]
 65%|██████▌   | 24734/37963 [76:48:50<44:09:50, 12.02s/it]
 65%|██████▌   | 24735/37963 [76:49:00<41:41:11, 11.35s/it]
 65%|██████▌   | 24736/37963 [76:49:17<47:47:56, 13.01s/it]
 65%|██████▌   | 24737/37963 [76:49:27<44:42:34, 12.17s/it]
 65%|██████▌   | 24738/37963 [76:49:37<42:30:07, 11.57s/it]
 65%|██████▌   | 24739/37963 [76:49:47<40:19:44, 10.98s/it]
 65%|██████▌   | 24740/37963 [76:49:57<39:28:26, 10.75s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '2.564', 'learning_rate': '5.717e-06', 'epoch': '0.6517'}

 65%|██████▌   | 24740/37963 [76:49:57<39:28:26, 10.75s/it]
 65%|██████▌   | 24741/37963 [76:50:07<38:46:54, 10.56s/it]
 65%|██████▌   | 24742/37963 [76:50:18<38:26:16, 10.47s/it]
 65%|██████▌   | 24743/37963 [76:50:27<37:41:19, 10.26s/it]
 65%|██████▌   | 24744/37963 [76:50:38<37:36:17, 10.24s/it]
 65%|██████▌   | 24745/37963 [76:50:48<37:13:27, 10.14s/it]
 65%|██████▌   | 24746/37963 [76:51:04<44:14:57, 12.05s/it]
 65%|██████▌   | 24747/37963 [76:51:14<42:05:56, 11.47s/it]
 65%|██████▌   | 24748/37963 [76:51:24<40:35:01, 11.06s/it]
 65%|██████▌   | 24749/37963 [76:51:34<39:02:40, 10.64s/it]
 65%|██████▌   | 24750/37963 [76:51:44<38:44:49, 10.56s/it]
                                                           
{'loss': '0.1186', 'grad_norm': '1.609', 'learning_rate': '5.709e-06', 'epoch': '0.652'}

 65%|██████▌   | 24750/37963 [76:51:44<38:44:49, 10.56s/it]
 65%|██████▌   | 24751/37963 [76:51:54<38:03:52, 10.37s/it]
 65%|██████▌   | 24752/37963 [76:52:04<37:41:43, 10.27s/it]
 65%|██████▌   | 24753/37963 [76:52:14<37:29:30, 10.22s/it]
 65%|██████▌   | 24754/37963 [76:52:25<37:33:36, 10.24s/it]
 65%|██████▌   | 24755/37963 [76:52:35<37:26:31, 10.21s/it]
 65%|██████▌   | 24756/37963 [76:52:45<37:17:16, 10.16s/it]
 65%|██████▌   | 24757/37963 [76:52:55<37:02:09, 10.10s/it]
 65%|██████▌   | 24758/37963 [76:53:05<37:05:00, 10.11s/it]
 65%|██████▌   | 24759/37963 [76:53:15<36:54:49, 10.06s/it]
 65%|██████▌   | 24760/37963 [76:53:25<36:38:59,  9.99s/it]
                                                           
{'loss': '0.1416', 'grad_norm': '1.432', 'learning_rate': '5.702e-06', 'epoch': '0.6522'}

 65%|██████▌   | 24760/37963 [76:53:25<36:38:59,  9.99s/it]
 65%|██████▌   | 24761/37963 [76:53:35<36:49:57, 10.04s/it]
 65%|██████▌   | 24762/37963 [76:53:45<36:59:33, 10.09s/it]
 65%|██████▌   | 24763/37963 [76:53:55<36:52:00, 10.05s/it]
 65%|██████▌   | 24764/37963 [76:54:05<36:36:06,  9.98s/it]
 65%|██████▌   | 24765/37963 [76:54:22<44:13:02, 12.06s/it]
 65%|██████▌   | 24766/37963 [76:54:32<42:10:35, 11.51s/it]
 65%|██████▌   | 24767/37963 [76:54:42<40:26:36, 11.03s/it]
 65%|██████▌   | 24768/37963 [76:54:52<39:22:25, 10.74s/it]
 65%|██████▌   | 24769/37963 [76:55:02<38:44:51, 10.57s/it]
 65%|██████▌   | 24770/37963 [76:55:19<45:17:28, 12.36s/it]
                                                           
{'loss': '0.1341', 'grad_norm': '1.735', 'learning_rate': '5.694e-06', 'epoch': '0.6525'}

 65%|██████▌   | 24770/37963 [76:55:19<45:17:28, 12.36s/it]
 65%|██████▌   | 24771/37963 [76:55:29<42:50:56, 11.69s/it]
 65%|██████▌   | 24772/37963 [76:55:39<41:07:18, 11.22s/it]
 65%|██████▌   | 24773/37963 [76:55:56<47:23:18, 12.93s/it]
 65%|██████▌   | 24774/37963 [76:56:06<44:20:15, 12.10s/it]
 65%|██████▌   | 24775/37963 [76:56:16<42:10:44, 11.51s/it]
 65%|██████▌   | 24776/37963 [76:56:26<40:38:11, 11.09s/it]
 65%|██████▌   | 24777/37963 [76:56:36<39:32:25, 10.80s/it]
 65%|██████▌   | 24778/37963 [76:57:00<53:31:22, 14.61s/it]
 65%|██████▌   | 24779/37963 [76:57:10<48:36:52, 13.27s/it]
 65%|██████▌   | 24780/37963 [76:57:27<52:25:07, 14.31s/it]
                                                           
{'loss': '0.1209', 'grad_norm': '1.367', 'learning_rate': '5.686e-06', 'epoch': '0.6527'}

 65%|██████▌   | 24780/37963 [76:57:27<52:25:07, 14.31s/it]
 65%|██████▌   | 24781/37963 [76:57:37<47:45:44, 13.04s/it]
 65%|██████▌   | 24782/37963 [76:57:47<44:28:16, 12.15s/it]
 65%|██████▌   | 24783/37963 [76:57:57<42:14:16, 11.54s/it]
 65%|██████▌   | 24784/37963 [76:58:13<47:41:16, 13.03s/it]
 65%|██████▌   | 24785/37963 [76:58:24<44:32:51, 12.17s/it]
 65%|██████▌   | 24786/37963 [76:58:34<42:26:32, 11.60s/it]
 65%|██████▌   | 24787/37963 [76:58:44<40:51:15, 11.16s/it]
 65%|██████▌   | 24788/37963 [76:58:54<39:49:45, 10.88s/it]
 65%|██████▌   | 24789/37963 [76:59:04<38:30:56, 10.53s/it]
 65%|██████▌   | 24790/37963 [76:59:14<38:02:57, 10.40s/it]
                                                           
{'loss': '0.1256', 'grad_norm': '5.712', 'learning_rate': '5.679e-06', 'epoch': '0.653'}

 65%|██████▌   | 24790/37963 [76:59:14<38:02:57, 10.40s/it]
 65%|██████▌   | 24791/37963 [76:59:24<37:40:29, 10.30s/it]
 65%|██████▌   | 24792/37963 [76:59:34<37:33:11, 10.26s/it]
 65%|██████▌   | 24793/37963 [76:59:45<37:30:19, 10.25s/it]
 65%|██████▌   | 24794/37963 [76:59:55<37:20:09, 10.21s/it]
 65%|██████▌   | 24795/37963 [77:00:11<44:32:03, 12.18s/it]
 65%|██████▌   | 24796/37963 [77:00:22<42:14:23, 11.55s/it]
 65%|██████▌   | 24797/37963 [77:00:32<40:34:46, 11.10s/it]
 65%|██████▌   | 24798/37963 [77:00:41<38:51:13, 10.62s/it]
 65%|██████▌   | 24799/37963 [77:00:51<38:04:14, 10.41s/it]
 65%|██████▌   | 24800/37963 [77:01:01<37:07:11, 10.15s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '2.08', 'learning_rate': '5.671e-06', 'epoch': '0.6533'}

 65%|██████▌   | 24800/37963 [77:01:01<37:07:11, 10.15s/it]
 65%|██████▌   | 24801/37963 [77:01:11<36:54:24, 10.09s/it]
 65%|██████▌   | 24802/37963 [77:01:21<36:53:12, 10.09s/it]
 65%|██████▌   | 24803/37963 [77:01:31<36:57:57, 10.11s/it]
 65%|██████▌   | 24804/37963 [77:01:41<36:47:02, 10.06s/it]
 65%|██████▌   | 24805/37963 [77:01:51<36:50:40, 10.08s/it]
 65%|██████▌   | 24806/37963 [77:02:01<36:37:30, 10.02s/it]
 65%|██████▌   | 24807/37963 [77:02:11<36:25:24,  9.97s/it]
 65%|██████▌   | 24808/37963 [77:02:21<36:43:27, 10.05s/it]
 65%|██████▌   | 24809/37963 [77:02:31<36:55:59, 10.11s/it]
 65%|██████▌   | 24810/37963 [77:02:41<37:00:14, 10.13s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '1.205', 'learning_rate': '5.663e-06', 'epoch': '0.6535'}

 65%|██████▌   | 24810/37963 [77:02:41<37:00:14, 10.13s/it]
 65%|██████▌   | 24811/37963 [77:02:51<36:56:29, 10.11s/it]
 65%|██████▌   | 24812/37963 [77:03:01<36:46:57, 10.07s/it]
 65%|██████▌   | 24813/37963 [77:03:18<44:36:17, 12.21s/it]
 65%|██████▌   | 24814/37963 [77:03:29<42:16:10, 11.57s/it]
 65%|██████▌   | 24815/37963 [77:03:39<40:50:39, 11.18s/it]
 65%|██████▌   | 24816/37963 [77:03:49<39:38:42, 10.86s/it]
 65%|██████▌   | 24817/37963 [77:03:59<38:47:30, 10.62s/it]
 65%|██████▌   | 24818/37963 [77:04:15<45:10:54, 12.37s/it]
 65%|██████▌   | 24819/37963 [77:04:26<42:57:27, 11.77s/it]
 65%|██████▌   | 24820/37963 [77:04:36<41:09:31, 11.27s/it]
                                                           
{'loss': '0.1418', 'grad_norm': '1.23', 'learning_rate': '5.655e-06', 'epoch': '0.6538'}

 65%|██████▌   | 24820/37963 [77:04:36<41:09:31, 11.27s/it]
 65%|██████▌   | 24821/37963 [77:04:53<47:29:21, 13.01s/it]
 65%|██████▌   | 24822/37963 [77:05:03<44:24:55, 12.17s/it]
 65%|██████▌   | 24823/37963 [77:05:13<42:05:31, 11.53s/it]
 65%|██████▌   | 24824/37963 [77:05:23<40:35:37, 11.12s/it]
 65%|██████▌   | 24825/37963 [77:05:40<46:32:27, 12.75s/it]
 65%|██████▌   | 24826/37963 [77:05:56<50:39:46, 13.88s/it]
 65%|██████▌   | 24827/37963 [77:06:13<53:27:20, 14.65s/it]
 65%|██████▌   | 24828/37963 [77:06:23<48:26:32, 13.28s/it]
 65%|██████▌   | 24829/37963 [77:06:33<45:04:35, 12.36s/it]
 65%|██████▌   | 24830/37963 [77:06:43<42:39:55, 11.70s/it]
                                                           
{'loss': '0.1246', 'grad_norm': '2.328', 'learning_rate': '5.648e-06', 'epoch': '0.6541'}

 65%|██████▌   | 24830/37963 [77:06:43<42:39:55, 11.70s/it]
 65%|██████▌   | 24831/37963 [77:06:53<40:42:08, 11.16s/it]
 65%|██████▌   | 24832/37963 [77:07:10<47:03:39, 12.90s/it]
 65%|██████▌   | 24833/37963 [77:07:20<43:38:48, 11.97s/it]
 65%|██████▌   | 24834/37963 [77:07:30<41:39:05, 11.42s/it]
 65%|██████▌   | 24835/37963 [77:07:40<40:20:33, 11.06s/it]
 65%|██████▌   | 24836/37963 [77:07:51<39:19:09, 10.78s/it]
 65%|██████▌   | 24837/37963 [77:08:00<38:25:07, 10.54s/it]
 65%|██████▌   | 24838/37963 [77:08:11<37:57:23, 10.41s/it]
 65%|██████▌   | 24839/37963 [77:08:21<37:32:01, 10.30s/it]
 65%|██████▌   | 24840/37963 [77:08:31<37:15:46, 10.22s/it]
                                                           
{'loss': '0.1334', 'grad_norm': '2.084', 'learning_rate': '5.64e-06', 'epoch': '0.6543'}

 65%|██████▌   | 24840/37963 [77:08:31<37:15:46, 10.22s/it]
 65%|██████▌   | 24841/37963 [77:08:41<37:01:50, 10.16s/it]
 65%|██████▌   | 24842/37963 [77:08:57<44:08:56, 12.11s/it]
 65%|██████▌   | 24843/37963 [77:09:07<41:46:20, 11.46s/it]
 65%|██████▌   | 24844/37963 [77:09:17<40:15:01, 11.05s/it]
 65%|██████▌   | 24845/37963 [77:09:27<39:13:15, 10.76s/it]
 65%|██████▌   | 24846/37963 [77:09:38<38:29:01, 10.56s/it]
 65%|██████▌   | 24847/37963 [77:09:48<38:03:45, 10.45s/it]
 65%|██████▌   | 24848/37963 [77:09:58<37:29:28, 10.29s/it]
 65%|██████▌   | 24849/37963 [77:10:08<36:59:02, 10.15s/it]
 65%|██████▌   | 24850/37963 [77:10:18<36:55:07, 10.14s/it]
                                                           
{'loss': '0.1289', 'grad_norm': '1.306', 'learning_rate': '5.632e-06', 'epoch': '0.6546'}

 65%|██████▌   | 24850/37963 [77:10:18<36:55:07, 10.14s/it]
 65%|██████▌   | 24851/37963 [77:10:28<36:53:26, 10.13s/it]
 65%|██████▌   | 24852/37963 [77:10:38<36:46:25, 10.10s/it]
 65%|██████▌   | 24853/37963 [77:10:48<36:46:16, 10.10s/it]
 65%|██████▌   | 24854/37963 [77:10:58<36:17:59,  9.97s/it]
 65%|██████▌   | 24855/37963 [77:11:07<35:51:53,  9.85s/it]
 65%|██████▌   | 24856/37963 [77:11:17<35:55:13,  9.87s/it]
 65%|██████▌   | 24857/37963 [77:11:27<36:10:23,  9.94s/it]
 65%|██████▌   | 24858/37963 [77:11:37<36:18:33,  9.97s/it]
 65%|██████▌   | 24859/37963 [77:11:47<36:12:39,  9.95s/it]
 65%|██████▌   | 24860/37963 [77:11:57<36:20:50,  9.99s/it]
                                                           
{'loss': '0.1212', 'grad_norm': '1.906', 'learning_rate': '5.625e-06', 'epoch': '0.6549'}

 65%|██████▌   | 24860/37963 [77:11:57<36:20:50,  9.99s/it]
 65%|██████▌   | 24861/37963 [77:12:07<36:10:49,  9.94s/it]
 65%|██████▌   | 24862/37963 [77:12:17<36:21:07,  9.99s/it]
 65%|██████▌   | 24863/37963 [77:12:27<36:17:07,  9.97s/it]
 65%|██████▌   | 24864/37963 [77:12:51<51:11:13, 14.07s/it]
 65%|██████▌   | 24865/37963 [77:13:01<46:48:21, 12.86s/it]
 66%|██████▌   | 24866/37963 [77:13:11<43:55:16, 12.07s/it]
 66%|██████▌   | 24867/37963 [77:13:21<41:27:51, 11.40s/it]
 66%|██████▌   | 24868/37963 [77:13:30<39:41:42, 10.91s/it]
 66%|██████▌   | 24869/37963 [77:13:48<46:42:46, 12.84s/it]
 66%|██████▌   | 24870/37963 [77:13:58<43:16:51, 11.90s/it]
                                                           
{'loss': '0.1272', 'grad_norm': '1.555', 'learning_rate': '5.617e-06', 'epoch': '0.6551'}

 66%|██████▌   | 24870/37963 [77:13:58<43:16:51, 11.90s/it]
 66%|██████▌   | 24871/37963 [77:14:08<41:19:40, 11.36s/it]
 66%|██████▌   | 24872/37963 [77:14:18<39:56:22, 10.98s/it]
 66%|██████▌   | 24873/37963 [77:14:28<38:53:22, 10.70s/it]
 66%|██████▌   | 24874/37963 [77:14:45<45:37:01, 12.55s/it]
 66%|██████▌   | 24875/37963 [77:15:07<56:28:07, 15.53s/it]
 66%|██████▌   | 24876/37963 [77:15:17<50:26:46, 13.88s/it]
 66%|██████▌   | 24877/37963 [77:15:27<46:16:41, 12.73s/it]
 66%|██████▌   | 24878/37963 [77:15:44<50:37:16, 13.93s/it]
 66%|██████▌   | 24879/37963 [77:15:54<46:39:42, 12.84s/it]
 66%|██████▌   | 24880/37963 [77:16:04<43:31:43, 11.98s/it]
                                                           
{'loss': '0.117', 'grad_norm': '1.532', 'learning_rate': '5.609e-06', 'epoch': '0.6554'}

 66%|██████▌   | 24880/37963 [77:16:04<43:31:43, 11.98s/it]
 66%|██████▌   | 24881/37963 [77:16:14<41:29:49, 11.42s/it]
 66%|██████▌   | 24882/37963 [77:16:24<40:07:26, 11.04s/it]
 66%|██████▌   | 24883/37963 [77:16:35<39:08:59, 10.78s/it]
 66%|██████▌   | 24884/37963 [77:16:45<38:26:17, 10.58s/it]
 66%|██████▌   | 24885/37963 [77:16:55<37:54:24, 10.43s/it]
 66%|██████▌   | 24886/37963 [77:17:05<37:15:25, 10.26s/it]
 66%|██████▌   | 24887/37963 [77:17:15<37:03:59, 10.20s/it]
 66%|██████▌   | 24888/37963 [77:17:25<36:39:15, 10.09s/it]
 66%|██████▌   | 24889/37963 [77:17:35<36:35:42, 10.08s/it]
 66%|██████▌   | 24890/37963 [77:17:45<36:43:33, 10.11s/it]
                                                           
{'loss': '0.1374', 'grad_norm': '2.307', 'learning_rate': '5.602e-06', 'epoch': '0.6556'}

 66%|██████▌   | 24890/37963 [77:17:45<36:43:33, 10.11s/it]
 66%|██████▌   | 24891/37963 [77:17:55<36:43:48, 10.12s/it]
 66%|██████▌   | 24892/37963 [77:18:11<43:43:24, 12.04s/it]
 66%|██████▌   | 24893/37963 [77:18:21<41:07:37, 11.33s/it]
 66%|██████▌   | 24894/37963 [77:18:31<39:40:35, 10.93s/it]
 66%|██████▌   | 24895/37963 [77:18:41<38:43:13, 10.67s/it]
 66%|██████▌   | 24896/37963 [77:18:51<38:03:58, 10.49s/it]
 66%|██████▌   | 24897/37963 [77:19:01<37:43:44, 10.40s/it]
 66%|██████▌   | 24898/37963 [77:19:11<37:19:23, 10.28s/it]
 66%|██████▌   | 24899/37963 [77:19:22<37:05:14, 10.22s/it]
 66%|██████▌   | 24900/37963 [77:19:31<36:39:31, 10.10s/it]
                                                           
{'loss': '0.1332', 'grad_norm': '2.57', 'learning_rate': '5.594e-06', 'epoch': '0.6559'}

 66%|██████▌   | 24900/37963 [77:19:31<36:39:31, 10.10s/it]
 66%|██████▌   | 24901/37963 [77:19:41<36:17:42, 10.00s/it]
 66%|██████▌   | 24902/37963 [77:19:51<35:57:06,  9.91s/it]
 66%|██████▌   | 24903/37963 [77:20:01<36:15:18,  9.99s/it]
 66%|██████▌   | 24904/37963 [77:20:11<36:31:45, 10.07s/it]
 66%|██████▌   | 24905/37963 [77:20:21<35:52:37,  9.89s/it]
 66%|██████▌   | 24906/37963 [77:20:31<36:11:17,  9.98s/it]
 66%|██████▌   | 24907/37963 [77:20:41<36:26:00, 10.05s/it]
 66%|██████▌   | 24908/37963 [77:20:51<36:19:17, 10.02s/it]
 66%|██████▌   | 24909/37963 [77:21:01<36:28:09, 10.06s/it]
 66%|██████▌   | 24910/37963 [77:21:11<36:28:22, 10.06s/it]
                                                           
{'loss': '0.1238', 'grad_norm': '1.828', 'learning_rate': '5.586e-06', 'epoch': '0.6562'}

 66%|██████▌   | 24910/37963 [77:21:11<36:28:22, 10.06s/it]
 66%|██████▌   | 24911/37963 [77:21:21<36:29:04, 10.06s/it]
 66%|██████▌   | 24912/37963 [77:21:31<36:18:58, 10.02s/it]
 66%|██████▌   | 24913/37963 [77:21:48<43:08:14, 11.90s/it]
 66%|██████▌   | 24914/37963 [77:22:05<48:55:00, 13.50s/it]
 66%|██████▌   | 24915/37963 [77:22:15<45:20:06, 12.51s/it]
 66%|██████▌   | 24916/37963 [77:22:25<42:27:40, 11.72s/it]
 66%|██████▌   | 24917/37963 [77:22:42<48:05:09, 13.27s/it]
 66%|██████▌   | 24918/37963 [77:22:52<44:39:57, 12.33s/it]
 66%|██████▌   | 24919/37963 [77:23:02<42:15:01, 11.66s/it]
 66%|██████▌   | 24920/37963 [77:23:12<40:15:42, 11.11s/it]
                                                           
{'loss': '0.1345', 'grad_norm': '1.745', 'learning_rate': '5.579e-06', 'epoch': '0.6564'}

 66%|██████▌   | 24920/37963 [77:23:12<40:15:42, 11.11s/it]
 66%|██████▌   | 24921/37963 [77:23:22<39:16:53, 10.84s/it]
 66%|██████▌   | 24922/37963 [77:23:39<45:28:43, 12.55s/it]
 66%|██████▌   | 24923/37963 [77:24:02<57:27:47, 15.86s/it]
 66%|██████▌   | 24924/37963 [77:24:12<51:01:21, 14.09s/it]
 66%|██████▌   | 24925/37963 [77:24:22<46:48:38, 12.93s/it]
 66%|██████▌   | 24926/37963 [77:24:33<43:58:38, 12.14s/it]
 66%|██████▌   | 24927/37963 [77:24:50<49:27:48, 13.66s/it]
 66%|██████▌   | 24928/37963 [77:25:00<45:36:53, 12.60s/it]
 66%|██████▌   | 24929/37963 [77:25:10<42:52:03, 11.84s/it]
 66%|██████▌   | 24930/37963 [77:25:20<41:03:25, 11.34s/it]
                                                           
{'loss': '0.1309', 'grad_norm': '1.407', 'learning_rate': '5.571e-06', 'epoch': '0.6567'}

 66%|██████▌   | 24930/37963 [77:25:20<41:03:25, 11.34s/it]
 66%|██████▌   | 24931/37963 [77:25:30<39:40:34, 10.96s/it]
 66%|██████▌   | 24932/37963 [77:25:40<38:43:33, 10.70s/it]
 66%|██████▌   | 24933/37963 [77:25:51<38:14:13, 10.56s/it]
 66%|██████▌   | 24934/37963 [77:26:01<37:53:52, 10.47s/it]
 66%|██████▌   | 24935/37963 [77:26:11<37:35:42, 10.39s/it]
 66%|██████▌   | 24936/37963 [77:26:21<37:15:32, 10.30s/it]
 66%|██████▌   | 24937/37963 [77:26:31<36:37:30, 10.12s/it]
 66%|██████▌   | 24938/37963 [77:26:41<36:22:10, 10.05s/it]
 66%|██████▌   | 24939/37963 [77:26:51<36:30:05, 10.09s/it]
 66%|██████▌   | 24940/37963 [77:27:07<43:17:14, 11.97s/it]
                                                           
{'loss': '0.1261', 'grad_norm': '3.727', 'learning_rate': '5.563e-06', 'epoch': '0.657'}

 66%|██████▌   | 24940/37963 [77:27:07<43:17:14, 11.97s/it]
 66%|██████▌   | 24941/37963 [77:27:17<41:12:05, 11.39s/it]
 66%|██████▌   | 24942/37963 [77:27:27<39:46:50, 11.00s/it]
 66%|██████▌   | 24943/37963 [77:27:37<38:43:19, 10.71s/it]
 66%|██████▌   | 24944/37963 [77:27:48<38:08:35, 10.55s/it]
 66%|██████▌   | 24945/37963 [77:27:58<37:53:51, 10.48s/it]
 66%|██████▌   | 24946/37963 [77:28:08<37:27:58, 10.36s/it]
 66%|██████▌   | 24947/37963 [77:28:18<37:11:52, 10.29s/it]
 66%|██████▌   | 24948/37963 [77:28:28<36:53:10, 10.20s/it]
 66%|██████▌   | 24949/37963 [77:28:39<37:04:28, 10.26s/it]
 66%|██████▌   | 24950/37963 [77:28:49<36:54:12, 10.21s/it]
                                                           
{'loss': '0.1295', 'grad_norm': '2.203', 'learning_rate': '5.556e-06', 'epoch': '0.6572'}

 66%|██████▌   | 24950/37963 [77:28:49<36:54:12, 10.21s/it]
 66%|██████▌   | 24951/37963 [77:28:59<36:44:26, 10.16s/it]
 66%|██████▌   | 24952/37963 [77:29:08<36:19:05, 10.05s/it]
 66%|██████▌   | 24953/37963 [77:29:19<36:23:28, 10.07s/it]
 66%|██████▌   | 24954/37963 [77:29:29<36:31:11, 10.11s/it]
 66%|██████▌   | 24955/37963 [77:29:39<36:38:20, 10.14s/it]
 66%|██████▌   | 24956/37963 [77:29:49<36:34:30, 10.12s/it]
 66%|██████▌   | 24957/37963 [77:29:59<36:43:26, 10.17s/it]
 66%|██████▌   | 24958/37963 [77:30:09<36:25:14, 10.08s/it]
 66%|██████▌   | 24959/37963 [77:30:19<36:32:02, 10.11s/it]
 66%|██████▌   | 24960/37963 [77:30:29<36:12:27, 10.02s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '1.277', 'learning_rate': '5.548e-06', 'epoch': '0.6575'}

 66%|██████▌   | 24960/37963 [77:30:29<36:12:27, 10.02s/it]
 66%|██████▌   | 24961/37963 [77:30:46<43:18:15, 11.99s/it]
 66%|██████▌   | 24962/37963 [77:31:03<48:45:35, 13.50s/it]
 66%|██████▌   | 24963/37963 [77:31:13<44:46:19, 12.40s/it]
 66%|██████▌   | 24964/37963 [77:31:23<42:09:28, 11.68s/it]
 66%|██████▌   | 24965/37963 [77:31:40<47:48:18, 13.24s/it]
 66%|██████▌   | 24966/37963 [77:31:50<44:20:43, 12.28s/it]
 66%|██████▌   | 24967/37963 [77:32:00<41:54:46, 11.61s/it]
 66%|██████▌   | 24968/37963 [77:32:10<40:15:22, 11.15s/it]
 66%|██████▌   | 24969/37963 [77:32:20<39:05:54, 10.83s/it]
 66%|██████▌   | 24970/37963 [77:32:36<45:15:58, 12.54s/it]
                                                           
{'loss': '0.1291', 'grad_norm': '1.246', 'learning_rate': '5.541e-06', 'epoch': '0.6577'}

 66%|██████▌   | 24970/37963 [77:32:36<45:15:58, 12.54s/it]
 66%|██████▌   | 24971/37963 [77:32:46<42:21:57, 11.74s/it]
 66%|██████▌   | 24972/37963 [77:33:03<48:18:28, 13.39s/it]
 66%|██████▌   | 24973/37963 [77:33:27<59:14:21, 16.42s/it]
 66%|██████▌   | 24974/37963 [77:33:37<52:20:52, 14.51s/it]
 66%|██████▌   | 24975/37963 [77:33:47<47:31:41, 13.17s/it]
 66%|██████▌   | 24976/37963 [77:33:57<43:41:02, 12.11s/it]
 66%|██████▌   | 24977/37963 [77:34:07<41:28:52, 11.50s/it]
 66%|██████▌   | 24978/37963 [77:34:17<39:57:45, 11.08s/it]
 66%|██████▌   | 24979/37963 [77:34:27<38:54:30, 10.79s/it]
 66%|██████▌   | 24980/37963 [77:34:37<38:06:24, 10.57s/it]
                                                           
{'loss': '0.1291', 'grad_norm': '1.919', 'learning_rate': '5.533e-06', 'epoch': '0.658'}

 66%|██████▌   | 24980/37963 [77:34:37<38:06:24, 10.57s/it]
 66%|██████▌   | 24981/37963 [77:34:47<37:39:33, 10.44s/it]
 66%|██████▌   | 24982/37963 [77:34:57<37:14:45, 10.33s/it]
 66%|██████▌   | 24983/37963 [77:35:07<37:08:21, 10.30s/it]
 66%|██████▌   | 24984/37963 [77:35:17<36:51:06, 10.22s/it]
 66%|██████▌   | 24985/37963 [77:35:27<36:26:21, 10.11s/it]
 66%|██████▌   | 24986/37963 [77:35:37<36:13:23, 10.05s/it]
 66%|██████▌   | 24987/37963 [77:35:47<36:18:21, 10.07s/it]
 66%|██████▌   | 24988/37963 [77:36:03<42:41:45, 11.85s/it]
 66%|██████▌   | 24989/37963 [77:36:13<40:37:43, 11.27s/it]
 66%|██████▌   | 24990/37963 [77:36:23<39:23:01, 10.93s/it]
                                                           
{'loss': '0.1216', 'grad_norm': '1.629', 'learning_rate': '5.525e-06', 'epoch': '0.6583'}

 66%|██████▌   | 24990/37963 [77:36:23<39:23:01, 10.93s/it]
 66%|██████▌   | 24991/37963 [77:36:33<38:22:57, 10.65s/it]
 66%|██████▌   | 24992/37963 [77:36:44<37:47:01, 10.49s/it]
 66%|██████▌   | 24993/37963 [77:36:54<37:22:41, 10.37s/it]
 66%|██████▌   | 24994/37963 [77:37:04<37:06:44, 10.30s/it]
 66%|██████▌   | 24995/37963 [77:37:13<36:29:27, 10.13s/it]
 66%|██████▌   | 24996/37963 [77:37:23<36:12:14, 10.05s/it]
 66%|██████▌   | 24997/37963 [77:37:33<36:17:11, 10.07s/it]
 66%|██████▌   | 24998/37963 [77:37:44<36:19:47, 10.09s/it]
 66%|██████▌   | 24999/37963 [77:37:54<36:29:26, 10.13s/it]
 66%|██████▌   | 25000/37963 [77:38:04<36:24:45, 10.11s/it]
                                                           
{'loss': '0.1257', 'grad_norm': '1.978', 'learning_rate': '5.518e-06', 'epoch': '0.6585'}

 66%|██████▌   | 25000/37963 [77:38:04<36:24:45, 10.11s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.32s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.32s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 66%|██████▌   | 25001/37963 [77:39:02<88:45:34, 24.65s/it]
 66%|██████▌   | 25002/37963 [77:39:13<72:59:34, 20.27s/it]
 66%|██████▌   | 25003/37963 [77:39:23<62:28:48, 17.36s/it]
 66%|██████▌   | 25004/37963 [77:39:34<55:50:25, 15.51s/it]
 66%|██████▌   | 25005/37963 [77:39:44<49:25:51, 13.73s/it]
 66%|██████▌   | 25006/37963 [77:39:54<45:39:40, 12.69s/it]
 66%|██████▌   | 25007/37963 [77:40:04<42:51:23, 11.91s/it]
 66%|██████▌   | 25008/37963 [77:40:21<47:42:46, 13.26s/it]
 66%|██████▌   | 25009/37963 [77:40:31<44:09:34, 12.27s/it]
 66%|██████▌   | 25010/37963 [77:40:41<41:47:42, 11.62s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '3.171', 'learning_rate': '5.51e-06', 'epoch': '0.6588'}

 66%|██████▌   | 25010/37963 [77:40:41<41:47:42, 11.62s/it]
 66%|██████▌   | 25011/37963 [77:40:51<40:06:14, 11.15s/it]
 66%|██████▌   | 25012/37963 [77:41:08<46:24:21, 12.90s/it]
 66%|██████▌   | 25013/37963 [77:41:24<50:17:57, 13.98s/it]
 66%|██████▌   | 25014/37963 [77:41:34<46:14:44, 12.86s/it]
 66%|██████▌   | 25015/37963 [77:41:44<42:56:23, 11.94s/it]
 66%|██████▌   | 25016/37963 [77:41:54<40:54:39, 11.38s/it]
 66%|██████▌   | 25017/37963 [77:42:04<39:12:09, 10.90s/it]
 66%|██████▌   | 25018/37963 [77:42:14<38:18:02, 10.65s/it]
 66%|██████▌   | 25019/37963 [77:42:37<51:20:44, 14.28s/it]
 66%|██████▌   | 25020/37963 [77:42:54<54:24:14, 15.13s/it]
                                                           
{'loss': '0.1312', 'grad_norm': '2.068', 'learning_rate': '5.502e-06', 'epoch': '0.6591'}

 66%|██████▌   | 25020/37963 [77:42:54<54:24:14, 15.13s/it]
 66%|██████▌   | 25021/37963 [77:43:04<48:58:45, 13.62s/it]
 66%|██████▌   | 25022/37963 [77:43:21<52:26:26, 14.59s/it]
 66%|██████▌   | 25023/37963 [77:43:31<47:31:25, 13.22s/it]
 66%|██████▌   | 25024/37963 [77:43:41<44:07:27, 12.28s/it]
 66%|██████▌   | 25025/37963 [77:43:51<41:37:02, 11.58s/it]
 66%|██████▌   | 25026/37963 [77:44:01<40:02:09, 11.14s/it]
 66%|██████▌   | 25027/37963 [77:44:11<38:29:42, 10.71s/it]
 66%|██████▌   | 25028/37963 [77:44:21<37:36:09, 10.47s/it]
 66%|██████▌   | 25029/37963 [77:44:31<37:22:19, 10.40s/it]
 66%|██████▌   | 25030/37963 [77:44:41<36:53:30, 10.27s/it]
                                                           
{'loss': '0.1301', 'grad_norm': '1.896', 'learning_rate': '5.495e-06', 'epoch': '0.6593'}

 66%|██████▌   | 25030/37963 [77:44:41<36:53:30, 10.27s/it]
 66%|██████▌   | 25031/37963 [77:44:51<36:17:32, 10.10s/it]
 66%|██████▌   | 25032/37963 [77:45:00<35:56:29, 10.01s/it]
 66%|██████▌   | 25033/37963 [77:45:11<35:59:47, 10.02s/it]
 66%|██████▌   | 25034/37963 [77:45:21<36:04:44, 10.05s/it]
 66%|██████▌   | 25035/37963 [77:45:31<35:57:44, 10.01s/it]
 66%|██████▌   | 25036/37963 [77:45:47<43:02:30, 11.99s/it]
 66%|██████▌   | 25037/37963 [77:45:57<40:36:08, 11.31s/it]
 66%|██████▌   | 25038/37963 [77:46:07<39:18:30, 10.95s/it]
 66%|██████▌   | 25039/37963 [77:46:17<38:26:53, 10.71s/it]
 66%|██████▌   | 25040/37963 [77:46:27<37:39:41, 10.49s/it]
                                                           
{'loss': '0.1267', 'grad_norm': '1.453', 'learning_rate': '5.487e-06', 'epoch': '0.6596'}

 66%|██████▌   | 25040/37963 [77:46:27<37:39:41, 10.49s/it]
 66%|██████▌   | 25041/37963 [77:46:37<36:48:48, 10.26s/it]
 66%|██████▌   | 25042/37963 [77:46:47<36:37:10, 10.20s/it]
 66%|██████▌   | 25043/37963 [77:46:57<36:43:01, 10.23s/it]
 66%|██████▌   | 25044/37963 [77:47:07<36:36:39, 10.20s/it]
 66%|██████▌   | 25045/37963 [77:47:17<36:26:59, 10.16s/it]
 66%|██████▌   | 25046/37963 [77:47:27<36:21:32, 10.13s/it]
 66%|██████▌   | 25047/37963 [77:47:37<36:03:44, 10.05s/it]
 66%|██████▌   | 25048/37963 [77:47:47<36:04:10, 10.05s/it]
 66%|██████▌   | 25049/37963 [77:47:58<36:19:35, 10.13s/it]
 66%|██████▌   | 25050/37963 [77:48:08<36:21:07, 10.13s/it]
                                                           
{'loss': '0.1235', 'grad_norm': '1.697', 'learning_rate': '5.48e-06', 'epoch': '0.6599'}

 66%|██████▌   | 25050/37963 [77:48:08<36:21:07, 10.13s/it]
 66%|██████▌   | 25051/37963 [77:48:18<36:18:30, 10.12s/it]
 66%|██████▌   | 25052/37963 [77:48:28<36:26:30, 10.16s/it]
 66%|██████▌   | 25053/37963 [77:48:38<36:33:58, 10.20s/it]
 66%|██████▌   | 25054/37963 [77:48:49<36:38:40, 10.22s/it]
 66%|██████▌   | 25055/37963 [77:48:59<36:32:48, 10.19s/it]
 66%|██████▌   | 25056/37963 [77:49:09<36:04:16, 10.06s/it]
 66%|██████▌   | 25057/37963 [77:49:25<43:16:05, 12.07s/it]
 66%|██████▌   | 25058/37963 [77:49:35<40:54:26, 11.41s/it]
 66%|██████▌   | 25059/37963 [77:49:52<47:02:52, 13.13s/it]
 66%|██████▌   | 25060/37963 [77:50:03<43:48:53, 12.22s/it]
                                                           
{'loss': '0.1187', 'grad_norm': '1.286', 'learning_rate': '5.472e-06', 'epoch': '0.6601'}

 66%|██████▌   | 25060/37963 [77:50:03<43:48:53, 12.22s/it]
 66%|██████▌   | 25061/37963 [77:50:13<41:29:38, 11.58s/it]
 66%|██████▌   | 25062/37963 [77:50:29<46:48:22, 13.06s/it]
 66%|██████▌   | 25063/37963 [77:50:39<43:48:09, 12.22s/it]
 66%|██████▌   | 25064/37963 [77:50:50<41:39:17, 11.63s/it]
 66%|██████▌   | 25065/37963 [77:51:00<40:01:31, 11.17s/it]
 66%|██████▌   | 25066/37963 [77:51:17<46:13:12, 12.90s/it]
 66%|██████▌   | 25067/37963 [77:51:33<49:58:30, 13.95s/it]
 66%|██████▌   | 25068/37963 [77:51:43<45:50:48, 12.80s/it]
 66%|██████▌   | 25069/37963 [77:52:00<50:27:32, 14.09s/it]
 66%|██████▌   | 25070/37963 [77:52:17<53:21:58, 14.90s/it]
                                                           
{'loss': '0.1257', 'grad_norm': '1.447', 'learning_rate': '5.464e-06', 'epoch': '0.6604'}

 66%|██████▌   | 25070/37963 [77:52:17<53:21:58, 14.90s/it]
 66%|██████▌   | 25071/37963 [77:52:27<48:12:42, 13.46s/it]
 66%|██████▌   | 25072/37963 [77:52:37<44:38:22, 12.47s/it]
 66%|██████▌   | 25073/37963 [77:52:48<42:11:14, 11.78s/it]
 66%|██████▌   | 25074/37963 [77:52:58<40:28:18, 11.30s/it]
 66%|██████▌   | 25075/37963 [77:53:08<39:00:37, 10.90s/it]
 66%|██████▌   | 25076/37963 [77:53:18<38:07:04, 10.65s/it]
 66%|██████▌   | 25077/37963 [77:53:28<37:23:49, 10.45s/it]
 66%|██████▌   | 25078/37963 [77:53:37<36:30:01, 10.20s/it]
 66%|██████▌   | 25079/37963 [77:53:47<36:07:04, 10.09s/it]
 66%|██████▌   | 25080/37963 [77:53:57<36:11:58, 10.12s/it]
                                                           
{'loss': '0.1328', 'grad_norm': '1.604', 'learning_rate': '5.457e-06', 'epoch': '0.6606'}

 66%|██████▌   | 25080/37963 [77:53:57<36:11:58, 10.12s/it]
 66%|██████▌   | 25081/37963 [77:54:07<36:01:53, 10.07s/it]
 66%|██████▌   | 25082/37963 [77:54:17<36:10:00, 10.11s/it]
 66%|██████▌   | 25083/37963 [77:54:35<43:56:36, 12.28s/it]
 66%|██████▌   | 25084/37963 [77:54:45<41:38:41, 11.64s/it]
 66%|██████▌   | 25085/37963 [77:54:55<40:00:30, 11.18s/it]
 66%|██████▌   | 25086/37963 [77:55:05<38:40:34, 10.81s/it]
 66%|██████▌   | 25087/37963 [77:55:15<37:51:35, 10.59s/it]
 66%|██████▌   | 25088/37963 [77:55:25<37:38:35, 10.53s/it]
 66%|██████▌   | 25089/37963 [77:55:35<36:38:05, 10.24s/it]
 66%|██████▌   | 25090/37963 [77:55:45<36:25:33, 10.19s/it]
                                                           
{'loss': '0.1211', 'grad_norm': '1.607', 'learning_rate': '5.449e-06', 'epoch': '0.6609'}

 66%|██████▌   | 25090/37963 [77:55:45<36:25:33, 10.19s/it]
 66%|██████▌   | 25091/37963 [77:55:55<36:18:02, 10.15s/it]
 66%|██████▌   | 25092/37963 [77:56:05<36:22:25, 10.17s/it]
 66%|██████▌   | 25093/37963 [77:56:16<36:16:16, 10.15s/it]
 66%|██████▌   | 25094/37963 [77:56:25<35:42:53,  9.99s/it]
 66%|██████▌   | 25095/37963 [77:56:35<35:51:08, 10.03s/it]
 66%|██████▌   | 25096/37963 [77:56:45<35:44:30, 10.00s/it]
 66%|██████▌   | 25097/37963 [77:56:55<35:58:25, 10.07s/it]
 66%|██████▌   | 25098/37963 [77:57:06<36:04:38, 10.10s/it]
 66%|██████▌   | 25099/37963 [77:57:16<35:59:20, 10.07s/it]
 66%|██████▌   | 25100/37963 [77:57:25<35:38:03,  9.97s/it]
                                                           
{'loss': '0.1343', 'grad_norm': '3.237', 'learning_rate': '5.442e-06', 'epoch': '0.6612'}

 66%|██████▌   | 25100/37963 [77:57:25<35:38:03,  9.97s/it]
 66%|██████▌   | 25101/37963 [77:57:35<35:46:15, 10.01s/it]
 66%|██████▌   | 25102/37963 [77:57:46<35:49:46, 10.03s/it]
 66%|██████▌   | 25103/37963 [77:57:56<35:56:06, 10.06s/it]
 66%|██████▌   | 25104/37963 [77:58:05<35:40:52,  9.99s/it]
 66%|██████▌   | 25105/37963 [77:58:16<35:51:14, 10.04s/it]
 66%|██████▌   | 25106/37963 [77:58:32<42:53:27, 12.01s/it]
 66%|██████▌   | 25107/37963 [77:58:42<40:48:35, 11.43s/it]
 66%|██████▌   | 25108/37963 [77:58:52<38:54:20, 10.90s/it]
 66%|██████▌   | 25109/37963 [77:59:08<44:48:41, 12.55s/it]
 66%|██████▌   | 25110/37963 [77:59:18<42:10:35, 11.81s/it]
                                                           
{'loss': '0.1209', 'grad_norm': '2.124', 'learning_rate': '5.434e-06', 'epoch': '0.6614'}

 66%|██████▌   | 25110/37963 [77:59:18<42:10:35, 11.81s/it]
 66%|██████▌   | 25111/37963 [77:59:36<47:51:50, 13.41s/it]
 66%|██████▌   | 25112/37963 [77:59:46<44:19:31, 12.42s/it]
 66%|██████▌   | 25113/37963 [78:00:02<48:30:20, 13.59s/it]
 66%|██████▌   | 25114/37963 [78:00:12<44:54:17, 12.58s/it]
 66%|██████▌   | 25115/37963 [78:00:29<49:21:39, 13.83s/it]
 66%|██████▌   | 25116/37963 [78:00:39<45:18:02, 12.69s/it]
 66%|██████▌   | 25117/37963 [78:00:49<42:08:46, 11.81s/it]
 66%|██████▌   | 25118/37963 [78:01:06<47:36:58, 13.35s/it]
 66%|██████▌   | 25119/37963 [78:01:23<51:51:00, 14.53s/it]
 66%|██████▌   | 25120/37963 [78:01:33<46:36:37, 13.07s/it]
                                                           
{'loss': '0.1227', 'grad_norm': '1.785', 'learning_rate': '5.426e-06', 'epoch': '0.6617'}

 66%|██████▌   | 25120/37963 [78:01:33<46:36:37, 13.07s/it]
 66%|██████▌   | 25121/37963 [78:01:43<43:28:34, 12.19s/it]
 66%|██████▌   | 25122/37963 [78:01:53<41:06:45, 11.53s/it]
 66%|██████▌   | 25123/37963 [78:02:03<39:38:52, 11.12s/it]
 66%|██████▌   | 25124/37963 [78:02:13<38:04:56, 10.68s/it]
 66%|██████▌   | 25125/37963 [78:02:22<37:12:55, 10.44s/it]
 66%|██████▌   | 25126/37963 [78:02:33<36:55:26, 10.35s/it]
 66%|██████▌   | 25127/37963 [78:02:43<36:36:14, 10.27s/it]
 66%|██████▌   | 25128/37963 [78:02:53<36:26:53, 10.22s/it]
 66%|██████▌   | 25129/37963 [78:03:03<36:09:40, 10.14s/it]
 66%|██████▌   | 25130/37963 [78:03:19<42:56:40, 12.05s/it]
                                                           
{'loss': '0.135', 'grad_norm': '1.932', 'learning_rate': '5.419e-06', 'epoch': '0.662'}

 66%|██████▌   | 25130/37963 [78:03:19<42:56:40, 12.05s/it]
 66%|██████▌   | 25131/37963 [78:03:29<40:49:28, 11.45s/it]
 66%|██████▌   | 25132/37963 [78:03:39<39:27:28, 11.07s/it]
 66%|██████▌   | 25133/37963 [78:03:50<38:20:25, 10.76s/it]
 66%|██████▌   | 25134/37963 [78:04:00<37:36:05, 10.55s/it]
 66%|██████▌   | 25135/37963 [78:04:09<36:51:18, 10.34s/it]
 66%|██████▌   | 25136/37963 [78:04:20<36:34:43, 10.27s/it]
 66%|██████▌   | 25137/37963 [78:04:30<36:24:15, 10.22s/it]
 66%|██████▌   | 25138/37963 [78:04:40<36:20:16, 10.20s/it]
 66%|██████▌   | 25139/37963 [78:04:50<36:03:32, 10.12s/it]
 66%|██████▌   | 25140/37963 [78:05:00<36:01:17, 10.11s/it]
                                                           
{'loss': '0.1209', 'grad_norm': '1.094', 'learning_rate': '5.411e-06', 'epoch': '0.6622'}

 66%|██████▌   | 25140/37963 [78:05:00<36:01:17, 10.11s/it]
 66%|██████▌   | 25141/37963 [78:05:10<35:39:09, 10.01s/it]
 66%|██████▌   | 25142/37963 [78:05:20<35:50:32, 10.06s/it]
 66%|██████▌   | 25143/37963 [78:05:30<35:49:38, 10.06s/it]
 66%|██████▌   | 25144/37963 [78:05:40<35:57:51, 10.10s/it]
 66%|██████▌   | 25145/37963 [78:05:50<35:47:52, 10.05s/it]
 66%|██████▌   | 25146/37963 [78:06:00<36:00:10, 10.11s/it]
 66%|██████▌   | 25147/37963 [78:06:10<35:55:49, 10.09s/it]
 66%|██████▌   | 25148/37963 [78:06:20<35:49:17, 10.06s/it]
 66%|██████▌   | 25149/37963 [78:06:30<35:46:43, 10.05s/it]
 66%|██████▌   | 25150/37963 [78:06:40<35:50:20, 10.07s/it]
                                                           
{'loss': '0.1264', 'grad_norm': '1.902', 'learning_rate': '5.404e-06', 'epoch': '0.6625'}

 66%|██████▌   | 25150/37963 [78:06:40<35:50:20, 10.07s/it]
 66%|██████▋   | 25151/37963 [78:06:50<35:50:39, 10.07s/it]
 66%|██████▋   | 25152/37963 [78:07:00<35:22:22,  9.94s/it]
 66%|██████▋   | 25153/37963 [78:07:10<35:41:38, 10.03s/it]
 66%|██████▋   | 25154/37963 [78:07:27<42:37:27, 11.98s/it]
 66%|██████▋   | 25155/37963 [78:07:37<40:41:52, 11.44s/it]
 66%|██████▋   | 25156/37963 [78:07:47<38:47:37, 10.90s/it]
 66%|██████▋   | 25157/37963 [78:08:04<45:57:22, 12.92s/it]
 66%|██████▋   | 25158/37963 [78:08:14<42:22:37, 11.91s/it]
 66%|██████▋   | 25159/37963 [78:08:24<40:32:18, 11.40s/it]