diff --git "a/train.log" "b/train.log"
new file mode 100644--- /dev/null
+++ "b/train.log"
@@ -0,0 +1,5194 @@
+W0615 16:04:04.968000 1402579 site-packages/torch/distributed/run.py:766] 
+W0615 16:04:04.968000 1402579 site-packages/torch/distributed/run.py:766] *****************************************
+W0615 16:04:04.968000 1402579 site-packages/torch/distributed/run.py:766] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
+W0615 16:04:04.968000 1402579 site-packages/torch/distributed/run.py:766] *****************************************
+[INFO] Running in WANDB offline mode
+[INFO] Running in WANDB offline mode
+[INFO] Running in WANDB offline mode
+[INFO] Running in WANDB offline mode
+[INFO] Running in WANDB offline mode
+[INFO] Running in WANDB offline mode
+[INFO] Running in WANDB offline mode
+[INFO] Running in WANDB offline mode
+Trainer._get_train_sampler replaced with custom implementation.
+warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
+[2026-06-15 16:04:14,859] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+df: /home/dungpq6/.triton/autotune: No such file or directory
+Trainer._get_train_sampler replaced with custom implementation.
+warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
+[2026-06-15 16:04:14,974] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+Trainer._get_train_sampler replaced with custom implementation.
+warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
+[2026-06-15 16:04:15,081] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+Trainer._get_train_sampler replaced with custom implementation.
+warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
+Trainer._get_train_sampler replaced with custom implementation.
+warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
+[2026-06-15 16:04:15,134] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+[2026-06-15 16:04:15,160] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+[2026-06-15 16:04:15,191] [INFO] [comm.py:658:init_distributed] cdb=None
+Trainer._get_train_sampler replaced with custom implementation.
+Trainer._get_train_sampler replaced with custom implementation.
+warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
+warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
+[2026-06-15 16:04:15,247] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+[2026-06-15 16:04:15,260] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+Trainer._get_train_sampler replaced with custom implementation.
+[2026-06-15 16:04:15,304] [INFO] [comm.py:658:init_distributed] cdb=None
+[2026-06-15 16:04:15,304] [INFO] [comm.py:689:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
+warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
+[2026-06-15 16:04:15,362] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
+[2026-06-15 16:04:15,407] [INFO] [comm.py:658:init_distributed] cdb=None
+[2026-06-15 16:04:15,498] [INFO] [comm.py:658:init_distributed] cdb=None
+[2026-06-15 16:04:15,519] [INFO] [comm.py:658:init_distributed] cdb=None
+[2026-06-15 16:04:15,603] [INFO] [comm.py:658:init_distributed] cdb=None
+[2026-06-15 16:04:15,636] [INFO] [comm.py:658:init_distributed] cdb=None
+[2026-06-15 16:04:15,723] [INFO] [comm.py:658:init_distributed] cdb=None
+
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 11793.16it/s]
+
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 11298.96it/s]
+
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 10974.69it/s]
+
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 12113.02it/s]
+
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 10835.52it/s]
+
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 10725.98it/s]
+
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 11233.83it/s]
+
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 11452.53it/s]
+Loading weights from local directory
+Loading weights from local directory
+Loading weights from local directory
+Loading weights from local directory
+Loading weights from local directory
+Loading weights from local directory
+Loading weights from local directory
+Loading weights from local directory
+Qwen3_5Config {
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "feature_fusion_method": "deepstack_language_add",
+  "fusion_num_layers": 1,
+  "geometry_encoder_layers": [
+    11,
+    17,
+    23
+  ],
+  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
+  "geometry_encoder_streaming": true,
+  "geometry_encoder_type": "vggt",
+  "geometry_fusion_layers": [
+    0,
+    1,
+    2
+  ],
+  "geometry_merger_type": "mlp",
+  "image_token_id": 248056,
+  "include_camera_token": false,
+  "model_type": "qwen3_5",
+  "pos_encoding_type": "none",
+  "reference_frame": "first",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 2560,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 32,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 16,
+    "num_hidden_layers": 32,
+    "num_key_value_heads": 4,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": true,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.3.0",
+  "use_cache": false,
+  "use_geometry_encoder": true,
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 24,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1024,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 2560,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_language_fusion_layers": null,
+  "vision_start_token_id": 248053
+}
+
+Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
+Vision Module - Attention Blocks:
+Trainable Block Indices: None
+Non-Trainable Block Indices: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23]
+Merger Module Trainable: True
+LLM Module - Embed Tokens Trainable: True
+LLM Module - Trainable Layer Indices: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31]
+LLM Module - Non-Trainable Layer Indices: None
+Qwen3_5Config {
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "feature_fusion_method": "deepstack_language_add",
+  "fusion_num_layers": 1,
+  "geometry_encoder_layers": [
+    11,
+    17,
+    23
+  ],
+  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
+  "geometry_encoder_streaming": true,
+  "geometry_encoder_type": "vggt",
+  "geometry_fusion_layers": [
+    0,
+    1,
+    2
+  ],
+  "geometry_merger_type": "mlp",
+  "image_token_id": 248056,
+  "include_camera_token": false,
+  "model_type": "qwen3_5",
+  "pos_encoding_type": "none",
+  "reference_frame": "first",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 2560,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 32,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 16,
+    "num_hidden_layers": 32,
+    "num_key_value_heads": 4,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": true,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.3.0",
+  "use_cache": false,
+  "use_geometry_encoder": true,
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 24,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1024,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 2560,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_language_fusion_layers": null,
+  "vision_start_token_id": 248053
+}
+
+Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
+Qwen3_5Config {
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "feature_fusion_method": "deepstack_language_add",
+  "fusion_num_layers": 1,
+  "geometry_encoder_layers": [
+    11,
+    17,
+    23
+  ],
+  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
+  "geometry_encoder_streaming": true,
+  "geometry_encoder_type": "vggt",
+  "geometry_fusion_layers": [
+    0,
+    1,
+    2
+  ],
+  "geometry_merger_type": "mlp",
+  "image_token_id": 248056,
+  "include_camera_token": false,
+  "model_type": "qwen3_5",
+  "pos_encoding_type": "none",
+  "reference_frame": "first",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 2560,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 32,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 16,
+    "num_hidden_layers": 32,
+    "num_key_value_heads": 4,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": true,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.3.0",
+  "use_cache": false,
+  "use_geometry_encoder": true,
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 24,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1024,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 2560,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_language_fusion_layers": null,
+  "vision_start_token_id": 248053
+}
+
+Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
+Qwen3_5Config {
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "feature_fusion_method": "deepstack_language_add",
+  "fusion_num_layers": 1,
+  "geometry_encoder_layers": [
+    11,
+    17,
+    23
+  ],
+  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
+  "geometry_encoder_streaming": true,
+  "geometry_encoder_type": "vggt",
+  "geometry_fusion_layers": [
+    0,
+    1,
+    2
+  ],
+  "geometry_merger_type": "mlp",
+  "image_token_id": 248056,
+  "include_camera_token": false,
+  "model_type": "qwen3_5",
+  "pos_encoding_type": "none",
+  "reference_frame": "first",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 2560,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 32,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 16,
+    "num_hidden_layers": 32,
+    "num_key_value_heads": 4,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": true,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.3.0",
+  "use_cache": false,
+  "use_geometry_encoder": true,
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 24,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1024,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 2560,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_language_fusion_layers": null,
+  "vision_start_token_id": 248053
+}
+
+Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
+Qwen3_5Config {
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "feature_fusion_method": "deepstack_language_add",
+  "fusion_num_layers": 1,
+  "geometry_encoder_layers": [
+    11,
+    17,
+    23
+  ],
+  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
+  "geometry_encoder_streaming": true,
+  "geometry_encoder_type": "vggt",
+  "geometry_fusion_layers": [
+    0,
+    1,
+    2
+  ],
+  "geometry_merger_type": "mlp",
+  "image_token_id": 248056,
+  "include_camera_token": false,
+  "model_type": "qwen3_5",
+  "pos_encoding_type": "none",
+  "reference_frame": "first",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 2560,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 32,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 16,
+    "num_hidden_layers": 32,
+    "num_key_value_heads": 4,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": true,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.3.0",
+  "use_cache": false,
+  "use_geometry_encoder": true,
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 24,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1024,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 2560,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_language_fusion_layers": null,
+  "vision_start_token_id": 248053
+}
+
+Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
+Qwen3_5Config {
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "feature_fusion_method": "deepstack_language_add",
+  "fusion_num_layers": 1,
+  "geometry_encoder_layers": [
+    11,
+    17,
+    23
+  ],
+  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
+  "geometry_encoder_streaming": true,
+  "geometry_encoder_type": "vggt",
+  "geometry_fusion_layers": [
+    0,
+    1,
+    2
+  ],
+  "geometry_merger_type": "mlp",
+  "image_token_id": 248056,
+  "include_camera_token": false,
+  "model_type": "qwen3_5",
+  "pos_encoding_type": "none",
+  "reference_frame": "first",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 2560,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 32,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 16,
+    "num_hidden_layers": 32,
+    "num_key_value_heads": 4,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": true,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.3.0",
+  "use_cache": false,
+  "use_geometry_encoder": true,
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 24,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1024,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 2560,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_language_fusion_layers": null,
+  "vision_start_token_id": 248053
+}
+
+Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
+Qwen3_5Config {
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "feature_fusion_method": "deepstack_language_add",
+  "fusion_num_layers": 1,
+  "geometry_encoder_layers": [
+    11,
+    17,
+    23
+  ],
+  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
+  "geometry_encoder_streaming": true,
+  "geometry_encoder_type": "vggt",
+  "geometry_fusion_layers": [
+    0,
+    1,
+    2
+  ],
+  "geometry_merger_type": "mlp",
+  "image_token_id": 248056,
+  "include_camera_token": false,
+  "model_type": "qwen3_5",
+  "pos_encoding_type": "none",
+  "reference_frame": "first",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 2560,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 32,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 16,
+    "num_hidden_layers": 32,
+    "num_key_value_heads": 4,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": true,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.3.0",
+  "use_cache": false,
+  "use_geometry_encoder": true,
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 24,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1024,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 2560,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_language_fusion_layers": null,
+  "vision_start_token_id": 248053
+}
+
+Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
+Qwen3_5Config {
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "feature_fusion_method": "deepstack_language_add",
+  "fusion_num_layers": 1,
+  "geometry_encoder_layers": [
+    11,
+    17,
+    23
+  ],
+  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
+  "geometry_encoder_streaming": true,
+  "geometry_encoder_type": "vggt",
+  "geometry_fusion_layers": [
+    0,
+    1,
+    2
+  ],
+  "geometry_merger_type": "mlp",
+  "image_token_id": 248056,
+  "include_camera_token": false,
+  "model_type": "qwen3_5",
+  "pos_encoding_type": "none",
+  "reference_frame": "first",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 2560,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 32,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 16,
+    "num_hidden_layers": 32,
+    "num_key_value_heads": 4,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": true,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.3.0",
+  "use_cache": false,
+  "use_geometry_encoder": true,
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 24,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1024,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4096,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 2560,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_language_fusion_layers": null,
+  "vision_start_token_id": 248053
+}
+
+Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
+Total training samples: 2429620
+Total training samples: 2429620
+Total training samples: 2429620
+Total training samples: 2429620
+Total training samples: 2429620
+Formatting inputs...Skip in lazy mode
+Formatting inputs...Skip in lazy mode
+Formatting inputs...Skip in lazy mode
+Formatting inputs...Skip in lazy mode
+Total training samples: 2429620
+Formatting inputs...Skip in lazy mode
+Formatting inputs...Skip in lazy mode
+Total training samples: 2429620
+The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
+The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
+The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
+Total training samples: 2429620
+The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
+Formatting inputs...Skip in lazy mode
+The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
+Formatting inputs...Skip in lazy mode
+The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
+The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
+The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
+NCCL version 2.26.2+cuda12.2
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
  0%|          | 0/37963 [00:00<?, ?it/s]/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
  0%|          | 1/37963 [01:55<1221:10:21, 115.81s/it]/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
  0%|          | 2/37963 [02:04<555:09:32, 52.65s/it]  
  0%|          | 3/37963 [02:12<340:55:18, 32.33s/it]
  0%|          | 4/37963 [02:20<240:33:02, 22.81s/it]
  0%|          | 5/37963 [02:36<213:35:13, 20.26s/it]
  0%|          | 6/37963 [02:44<171:19:48, 16.25s/it]
  0%|          | 7/37963 [02:53<143:32:02, 13.61s/it]
  0%|          | 8/37963 [03:01<125:18:17, 11.89s/it]
  0%|          | 9/37963 [03:09<112:47:28, 10.70s/it]
  0%|          | 10/37963 [03:17<104:18:42,  9.89s/it]
                                                      
{'loss': '2.292', 'grad_norm': '1152', 'learning_rate': '1.58e-07', 'epoch': '0.0002634'}
+
  0%|          | 10/37963 [03:18<104:18:42,  9.89s/it]
  0%|          | 11/37963 [03:33<125:33:21, 11.91s/it]
  0%|          | 12/37963 [03:41<113:20:17, 10.75s/it]
  0%|          | 13/37963 [03:50<105:41:00, 10.03s/it]
  0%|          | 14/37963 [03:58<99:30:07,  9.44s/it] 
  0%|          | 15/37963 [04:06<95:18:05,  9.04s/it]
  0%|          | 16/37963 [04:14<92:28:05,  8.77s/it]
  0%|          | 17/37963 [04:22<90:25:41,  8.58s/it]
  0%|          | 18/37963 [04:30<89:02:29,  8.45s/it]
  0%|          | 19/37963 [04:39<88:17:08,  8.38s/it]
  0%|          | 20/37963 [04:47<87:31:26,  8.30s/it]
                                                     
{'loss': '0.6024', 'grad_norm': '53.25', 'learning_rate': '3.336e-07', 'epoch': '0.0005268'}
+
  0%|          | 20/37963 [04:47<87:31:26,  8.30s/it]
  0%|          | 21/37963 [04:55<87:09:14,  8.27s/it]
  0%|          | 22/37963 [05:03<86:19:25,  8.19s/it]
  0%|          | 23/37963 [05:11<85:56:43,  8.16s/it]
  0%|          | 24/37963 [05:19<85:31:17,  8.12s/it]
  0%|          | 25/37963 [05:27<85:00:02,  8.07s/it]
  0%|          | 26/37963 [05:35<85:26:01,  8.11s/it]
  0%|          | 27/37963 [05:43<85:29:09,  8.11s/it]
  0%|          | 28/37963 [05:52<85:39:43,  8.13s/it]
  0%|          | 29/37963 [05:59<84:59:55,  8.07s/it]
  0%|          | 30/37963 [06:08<85:37:54,  8.13s/it]
                                                     
{'loss': '0.2964', 'grad_norm': '40.88', 'learning_rate': '5.092e-07', 'epoch': '0.0007902'}
+
  0%|          | 30/37963 [06:08<85:37:54,  8.13s/it]
  0%|          | 31/37963 [06:16<85:25:54,  8.11s/it]
  0%|          | 32/37963 [06:24<84:41:38,  8.04s/it]
  0%|          | 33/37963 [06:32<84:41:03,  8.04s/it]
  0%|          | 34/37963 [06:40<84:13:32,  7.99s/it]
  0%|          | 35/37963 [06:48<84:32:30,  8.02s/it]
  0%|          | 36/37963 [06:56<84:31:08,  8.02s/it]
  0%|          | 37/37963 [07:04<84:46:08,  8.05s/it]
  0%|          | 38/37963 [07:20<109:16:54, 10.37s/it]
  0%|          | 39/37963 [07:27<100:47:20,  9.57s/it]
  0%|          | 40/37963 [07:35<96:21:10,  9.15s/it] 
                                                     
{'loss': '0.2472', 'grad_norm': '18.02', 'learning_rate': '6.848e-07', 'epoch': '0.001054'}
+
  0%|          | 40/37963 [07:35<96:21:10,  9.15s/it]
  0%|          | 41/37963 [07:50<114:16:09, 10.85s/it]
  0%|          | 42/37963 [07:58<105:34:08, 10.02s/it]
  0%|          | 43/37963 [08:20<141:26:52, 13.43s/it]
  0%|          | 44/37963 [08:52<199:28:40, 18.94s/it]
  0%|          | 45/37963 [09:00<165:13:16, 15.69s/it]
  0%|          | 46/37963 [09:08<141:28:22, 13.43s/it]
  0%|          | 47/37963 [09:16<125:29:47, 11.92s/it]
  0%|          | 48/37963 [09:31<134:19:43, 12.75s/it]
  0%|          | 49/37963 [09:39<119:27:40, 11.34s/it]
  0%|          | 50/37963 [09:47<109:35:18, 10.41s/it]
                                                      
{'loss': '0.2554', 'grad_norm': '24.57', 'learning_rate': '8.604e-07', 'epoch': '0.001317'}
+
  0%|          | 50/37963 [09:47<109:35:18, 10.41s/it]
  0%|          | 51/37963 [09:55<102:09:43,  9.70s/it]
  0%|          | 52/37963 [10:03<97:40:24,  9.28s/it] 
  0%|          | 53/37963 [10:11<93:33:48,  8.88s/it]
  0%|          | 54/37963 [10:20<91:33:46,  8.70s/it]
  0%|          | 55/37963 [10:28<89:16:15,  8.48s/it]
  0%|          | 56/37963 [10:36<87:42:08,  8.33s/it]
  0%|          | 57/37963 [10:44<87:22:54,  8.30s/it]
  0%|          | 58/37963 [10:52<86:05:56,  8.18s/it]
  0%|          | 59/37963 [11:00<85:56:46,  8.16s/it]
  0%|          | 60/37963 [11:08<85:54:26,  8.16s/it]
                                                     
{'loss': '0.2359', 'grad_norm': '16.3', 'learning_rate': '1.036e-06', 'epoch': '0.00158'}
+
  0%|          | 60/37963 [11:08<85:54:26,  8.16s/it]
  0%|          | 61/37963 [11:16<86:07:57,  8.18s/it]
  0%|          | 62/37963 [11:24<85:25:34,  8.11s/it]
  0%|          | 63/37963 [11:33<85:57:25,  8.16s/it]
  0%|          | 64/37963 [11:41<85:59:38,  8.17s/it]
  0%|          | 65/37963 [11:49<86:28:57,  8.22s/it]
  0%|          | 66/37963 [11:57<85:28:44,  8.12s/it]
  0%|          | 67/37963 [12:05<86:07:41,  8.18s/it]
  0%|          | 68/37963 [12:13<85:57:13,  8.17s/it]
  0%|          | 69/37963 [12:21<85:03:05,  8.08s/it]
  0%|          | 70/37963 [12:30<85:36:02,  8.13s/it]
                                                     
{'loss': '0.2204', 'grad_norm': '14.41', 'learning_rate': '1.212e-06', 'epoch': '0.001844'}
+
  0%|          | 70/37963 [12:30<85:36:02,  8.13s/it]
  0%|          | 71/37963 [12:38<85:29:21,  8.12s/it]
  0%|          | 72/37963 [12:46<85:30:49,  8.12s/it]
  0%|          | 73/37963 [12:54<85:44:33,  8.15s/it]
  0%|          | 74/37963 [13:02<86:09:31,  8.19s/it]
  0%|          | 75/37963 [13:10<85:45:37,  8.15s/it]
  0%|          | 76/37963 [13:18<85:45:07,  8.15s/it]
  0%|          | 77/37963 [13:27<85:45:12,  8.15s/it]
  0%|          | 78/37963 [13:35<85:56:30,  8.17s/it]
  0%|          | 79/37963 [13:43<86:07:30,  8.18s/it]
  0%|          | 80/37963 [13:51<86:05:30,  8.18s/it]
                                                     
{'loss': '0.2314', 'grad_norm': '11.3', 'learning_rate': '1.387e-06', 'epoch': '0.002107'}
+
  0%|          | 80/37963 [13:51<86:05:30,  8.18s/it]
  0%|          | 81/37963 [13:59<85:39:42,  8.14s/it]
  0%|          | 82/37963 [14:07<85:41:17,  8.14s/it]
  0%|          | 83/37963 [14:16<85:34:41,  8.13s/it]
  0%|          | 84/37963 [14:24<85:56:00,  8.17s/it]
  0%|          | 85/37963 [14:32<84:56:13,  8.07s/it]
  0%|          | 86/37963 [14:40<84:52:33,  8.07s/it]
  0%|          | 87/37963 [14:48<85:50:00,  8.16s/it]
  0%|          | 88/37963 [14:56<85:01:07,  8.08s/it]
  0%|          | 89/37963 [15:04<84:57:10,  8.07s/it]
  0%|          | 90/37963 [15:25<126:40:31, 12.04s/it]
                                                      
{'loss': '0.2145', 'grad_norm': '15.08', 'learning_rate': '1.563e-06', 'epoch': '0.002371'}
+
  0%|          | 90/37963 [15:25<126:40:31, 12.04s/it]
  0%|          | 91/37963 [15:33<114:23:57, 10.87s/it]
  0%|          | 92/37963 [15:48<126:28:07, 12.02s/it]
  0%|          | 93/37963 [16:14<168:47:30, 16.05s/it]
  0%|          | 94/37963 [16:35<185:26:34, 17.63s/it]
  0%|          | 95/37963 [16:43<155:05:50, 14.74s/it]
  0%|          | 96/37963 [16:51<134:27:45, 12.78s/it]
  0%|          | 97/37963 [16:59<120:08:23, 11.42s/it]
  0%|          | 98/37963 [17:18<142:37:22, 13.56s/it]
  0%|          | 99/37963 [17:26<125:23:55, 11.92s/it]
  0%|          | 100/37963 [17:34<113:16:34, 10.77s/it]
                                                       
{'loss': '0.2128', 'grad_norm': '15.51', 'learning_rate': '1.738e-06', 'epoch': '0.002634'}
+
  0%|          | 100/37963 [17:34<113:16:34, 10.77s/it]
  0%|          | 101/37963 [17:42<105:15:11, 10.01s/it]
  0%|          | 102/37963 [17:51<99:46:53,  9.49s/it] 
  0%|          | 103/37963 [17:59<95:30:49,  9.08s/it]
  0%|          | 104/37963 [18:07<92:07:02,  8.76s/it]
  0%|          | 105/37963 [18:15<89:18:36,  8.49s/it]
  0%|          | 106/37963 [18:23<88:01:22,  8.37s/it]
  0%|          | 107/37963 [18:31<87:44:39,  8.34s/it]
  0%|          | 108/37963 [18:39<86:40:14,  8.24s/it]
  0%|          | 109/37963 [18:47<86:57:01,  8.27s/it]
  0%|          | 110/37963 [18:55<86:38:22,  8.24s/it]
                                                      
{'loss': '0.2157', 'grad_norm': '13.98', 'learning_rate': '1.914e-06', 'epoch': '0.002898'}
+
  0%|          | 110/37963 [18:55<86:38:22,  8.24s/it]
  0%|          | 111/37963 [19:04<86:43:39,  8.25s/it]
  0%|          | 112/37963 [19:12<86:07:46,  8.19s/it]
  0%|          | 113/37963 [19:20<86:25:42,  8.22s/it]
  0%|          | 114/37963 [19:28<86:19:32,  8.21s/it]
  0%|          | 115/37963 [19:36<85:59:35,  8.18s/it]
  0%|          | 116/37963 [19:45<86:03:32,  8.19s/it]
  0%|          | 117/37963 [19:53<85:35:13,  8.14s/it]
  0%|          | 118/37963 [20:01<85:38:18,  8.15s/it]
  0%|          | 119/37963 [20:09<85:39:51,  8.15s/it]
  0%|          | 120/37963 [20:17<85:46:15,  8.16s/it]
                                                      
{'loss': '0.2312', 'grad_norm': '21.82', 'learning_rate': '2.09e-06', 'epoch': '0.003161'}
+
  0%|          | 120/37963 [20:17<85:46:15,  8.16s/it]
  0%|          | 121/37963 [20:25<84:51:06,  8.07s/it]
  0%|          | 122/37963 [20:33<84:35:58,  8.05s/it]
  0%|          | 123/37963 [20:41<84:12:47,  8.01s/it]
  0%|          | 124/37963 [20:49<84:31:45,  8.04s/it]
  0%|          | 125/37963 [20:57<83:21:01,  7.93s/it]
  0%|          | 126/37963 [21:05<83:37:06,  7.96s/it]
  0%|          | 127/37963 [21:13<83:26:51,  7.94s/it]
  0%|          | 128/37963 [21:21<83:32:40,  7.95s/it]
  0%|          | 129/37963 [21:28<83:22:35,  7.93s/it]
  0%|          | 130/37963 [21:37<84:24:33,  8.03s/it]
                                                      
{'loss': '0.2002', 'grad_norm': '13.58', 'learning_rate': '2.265e-06', 'epoch': '0.003424'}
+
  0%|          | 130/37963 [21:37<84:24:33,  8.03s/it]
  0%|          | 131/37963 [21:45<84:46:00,  8.07s/it]
  0%|          | 132/37963 [21:53<85:24:26,  8.13s/it]
  0%|          | 133/37963 [22:01<84:11:23,  8.01s/it]
  0%|          | 134/37963 [22:09<84:15:02,  8.02s/it]
  0%|          | 135/37963 [22:24<104:56:15,  9.99s/it]
  0%|          | 136/37963 [22:32<99:19:37,  9.45s/it] 
  0%|          | 137/37963 [22:46<115:13:40, 10.97s/it]
  0%|          | 138/37963 [23:01<126:08:00, 12.00s/it]
  0%|          | 139/37963 [23:09<113:15:34, 10.78s/it]
  0%|          | 140/37963 [23:23<125:24:01, 11.94s/it]
                                                       
{'loss': '0.2124', 'grad_norm': '15.44', 'learning_rate': '2.441e-06', 'epoch': '0.003688'}
+
  0%|          | 140/37963 [23:23<125:24:01, 11.94s/it]
  0%|          | 141/37963 [23:45<155:22:29, 14.79s/it]
  0%|          | 142/37963 [23:53<133:49:09, 12.74s/it]
  0%|          | 143/37963 [24:01<118:56:14, 11.32s/it]
  0%|          | 144/37963 [24:16<131:23:15, 12.51s/it]
  0%|          | 145/37963 [24:31<138:51:03, 13.22s/it]
  0%|          | 146/37963 [24:39<122:00:46, 11.62s/it]
  0%|          | 147/37963 [24:47<110:56:16, 10.56s/it]
  0%|          | 148/37963 [24:55<102:50:33,  9.79s/it]
  0%|          | 149/37963 [25:03<97:13:16,  9.26s/it] 
  0%|          | 150/37963 [25:11<93:21:00,  8.89s/it]
                                                      
{'loss': '0.2167', 'grad_norm': '13.26', 'learning_rate': '2.616e-06', 'epoch': '0.003951'}
+
  0%|          | 150/37963 [25:11<93:21:00,  8.89s/it]
  0%|          | 151/37963 [25:19<90:48:49,  8.65s/it]
  0%|          | 152/37963 [25:27<88:42:36,  8.45s/it]
  0%|          | 153/37963 [25:35<86:56:54,  8.28s/it]
  0%|          | 154/37963 [25:43<86:41:02,  8.25s/it]
  0%|          | 155/37963 [25:51<85:47:11,  8.17s/it]
  0%|          | 156/37963 [25:59<85:24:04,  8.13s/it]
  0%|          | 157/37963 [26:07<85:34:07,  8.15s/it]
  0%|          | 158/37963 [26:15<85:29:25,  8.14s/it]
  0%|          | 159/37963 [26:23<84:49:54,  8.08s/it]
  0%|          | 160/37963 [26:31<85:24:15,  8.13s/it]
                                                      
{'loss': '0.2301', 'grad_norm': '20.54', 'learning_rate': '2.792e-06', 'epoch': '0.004215'}
+
  0%|          | 160/37963 [26:31<85:24:15,  8.13s/it]
  0%|          | 161/37963 [26:39<84:48:50,  8.08s/it]
  0%|          | 162/37963 [26:48<85:03:11,  8.10s/it]
  0%|          | 163/37963 [26:55<83:37:47,  7.96s/it]
  0%|          | 164/37963 [27:03<83:41:26,  7.97s/it]
  0%|          | 165/37963 [27:11<83:57:44,  8.00s/it]
  0%|          | 166/37963 [27:19<84:28:38,  8.05s/it]
  0%|          | 167/37963 [27:27<83:38:30,  7.97s/it]
  0%|          | 168/37963 [27:35<83:58:04,  8.00s/it]
  0%|          | 169/37963 [27:43<83:39:12,  7.97s/it]
  0%|          | 170/37963 [27:51<83:34:38,  7.96s/it]
                                                      
{'loss': '0.2278', 'grad_norm': '14.39', 'learning_rate': '2.968e-06', 'epoch': '0.004478'}
+
  0%|          | 170/37963 [27:51<83:34:38,  7.96s/it]
  0%|          | 171/37963 [27:59<83:25:33,  7.95s/it]
  0%|          | 172/37963 [28:07<83:57:06,  8.00s/it]
  0%|          | 173/37963 [28:15<84:08:14,  8.02s/it]
  0%|          | 174/37963 [28:23<84:20:36,  8.04s/it]
  0%|          | 175/37963 [28:31<84:15:29,  8.03s/it]
  0%|          | 176/37963 [28:39<84:46:35,  8.08s/it]
  0%|          | 177/37963 [28:48<84:52:30,  8.09s/it]
  0%|          | 178/37963 [28:56<85:13:16,  8.12s/it]
  0%|          | 179/37963 [29:04<85:28:32,  8.14s/it]
  0%|          | 180/37963 [29:12<85:39:45,  8.16s/it]
                                                      
{'loss': '0.2272', 'grad_norm': '13.05', 'learning_rate': '3.143e-06', 'epoch': '0.004741'}
+
  0%|          | 180/37963 [29:12<85:39:45,  8.16s/it]
  0%|          | 181/37963 [29:20<85:42:00,  8.17s/it]
  0%|          | 182/37963 [29:29<85:43:34,  8.17s/it]
  0%|          | 183/37963 [29:37<85:40:12,  8.16s/it]
  0%|          | 184/37963 [29:51<105:57:32, 10.10s/it]
  0%|          | 185/37963 [29:59<99:53:22,  9.52s/it] 
  0%|          | 186/37963 [30:21<137:54:17, 13.14s/it]
  0%|          | 187/37963 [30:29<121:50:47, 11.61s/it]
  0%|          | 188/37963 [30:47<143:04:35, 13.64s/it]
  0%|          | 189/37963 [30:55<125:28:40, 11.96s/it]
  1%|          | 190/37963 [31:10<133:48:00, 12.75s/it]
                                                       
{'loss': '0.2098', 'grad_norm': '9.629', 'learning_rate': '3.319e-06', 'epoch': '0.005005'}
+
  1%|          | 190/37963 [31:10<133:48:00, 12.75s/it]
  1%|          | 191/37963 [31:25<140:11:37, 13.36s/it]
  1%|          | 192/37963 [31:40<144:48:45, 13.80s/it]
  1%|          | 193/37963 [31:48<126:38:43, 12.07s/it]
  1%|          | 194/37963 [32:02<134:07:42, 12.78s/it]
  1%|          | 195/37963 [32:10<119:49:27, 11.42s/it]
  1%|          | 196/37963 [32:19<109:53:40, 10.48s/it]
  1%|          | 197/37963 [32:27<101:39:21,  9.69s/it]
  1%|          | 198/37963 [32:35<97:14:54,  9.27s/it] 
  1%|          | 199/37963 [32:43<93:45:45,  8.94s/it]
  1%|          | 200/37963 [32:51<91:18:35,  8.70s/it]
                                                      
{'loss': '0.2228', 'grad_norm': '14.27', 'learning_rate': '3.494e-06', 'epoch': '0.005268'}
+
  1%|          | 200/37963 [32:51<91:18:35,  8.70s/it]
  1%|          | 201/37963 [32:59<89:31:29,  8.53s/it]
  1%|          | 202/37963 [33:07<88:14:49,  8.41s/it]
  1%|          | 203/37963 [33:16<87:12:24,  8.31s/it]
  1%|          | 204/37963 [33:24<86:47:25,  8.27s/it]
  1%|          | 205/37963 [33:32<86:18:06,  8.23s/it]
  1%|          | 206/37963 [33:40<86:17:40,  8.23s/it]
  1%|          | 207/37963 [33:48<86:34:30,  8.25s/it]
  1%|          | 208/37963 [33:57<86:30:42,  8.25s/it]
  1%|          | 209/37963 [34:05<85:49:59,  8.18s/it]
  1%|          | 210/37963 [34:13<85:56:11,  8.19s/it]
                                                      
{'loss': '0.2092', 'grad_norm': '12.91', 'learning_rate': '3.67e-06', 'epoch': '0.005532'}
+
  1%|          | 210/37963 [34:13<85:56:11,  8.19s/it]
  1%|          | 211/37963 [34:21<86:07:31,  8.21s/it]
  1%|          | 212/37963 [34:29<85:37:45,  8.17s/it]
  1%|          | 213/37963 [34:37<85:45:38,  8.18s/it]
  1%|          | 214/37963 [34:46<85:46:50,  8.18s/it]
  1%|          | 215/37963 [34:54<85:58:31,  8.20s/it]
  1%|          | 216/37963 [35:02<85:33:21,  8.16s/it]
  1%|          | 217/37963 [35:10<85:35:17,  8.16s/it]
  1%|          | 218/37963 [35:18<85:41:55,  8.17s/it]
  1%|          | 219/37963 [35:26<85:19:13,  8.14s/it]
  1%|          | 220/37963 [35:34<84:37:21,  8.07s/it]
                                                      
{'loss': '0.2018', 'grad_norm': '23.27', 'learning_rate': '3.845e-06', 'epoch': '0.005795'}
+
  1%|          | 220/37963 [35:34<84:37:21,  8.07s/it]
  1%|          | 221/37963 [35:42<84:07:08,  8.02s/it]
  1%|          | 222/37963 [35:50<84:43:34,  8.08s/it]
  1%|          | 223/37963 [35:58<84:38:33,  8.07s/it]
  1%|          | 224/37963 [36:06<84:22:46,  8.05s/it]
  1%|          | 225/37963 [36:15<85:04:20,  8.12s/it]
  1%|          | 226/37963 [36:22<84:11:42,  8.03s/it]
  1%|          | 227/37963 [36:31<84:12:26,  8.03s/it]
  1%|          | 228/37963 [36:39<84:08:39,  8.03s/it]
  1%|          | 229/37963 [36:47<84:09:07,  8.03s/it]
  1%|          | 230/37963 [36:55<84:49:39,  8.09s/it]
                                                      
{'loss': '0.2123', 'grad_norm': '12.85', 'learning_rate': '4.021e-06', 'epoch': '0.006059'}
+
  1%|          | 230/37963 [36:55<84:49:39,  8.09s/it]
  1%|          | 231/37963 [37:03<84:58:14,  8.11s/it]
  1%|          | 232/37963 [37:25<128:33:30, 12.27s/it]
  1%|          | 233/37963 [37:33<115:41:15, 11.04s/it]
  1%|          | 234/37963 [37:41<106:18:45, 10.14s/it]
  1%|          | 235/37963 [37:49<100:09:06,  9.56s/it]
  1%|          | 236/37963 [38:07<126:08:08, 12.04s/it]
  1%|          | 237/37963 [38:22<136:01:25, 12.98s/it]
  1%|          | 238/37963 [38:36<139:23:29, 13.30s/it]
  1%|          | 239/37963 [38:51<143:02:07, 13.65s/it]
  1%|          | 240/37963 [39:08<155:15:56, 14.82s/it]
                                                       
{'loss': '0.2194', 'grad_norm': '14.03', 'learning_rate': '4.197e-06', 'epoch': '0.006322'}
+
  1%|          | 240/37963 [39:08<155:15:56, 14.82s/it]
  1%|          | 241/37963 [39:25<161:53:52, 15.45s/it]
  1%|          | 242/37963 [39:33<138:24:16, 13.21s/it]
  1%|          | 243/37963 [39:41<122:23:43, 11.68s/it]
  1%|          | 244/37963 [39:50<111:44:49, 10.67s/it]
  1%|          | 245/37963 [39:58<104:15:20,  9.95s/it]
  1%|          | 246/37963 [40:06<98:36:35,  9.41s/it] 
  1%|          | 247/37963 [40:14<94:25:52,  9.01s/it]
  1%|          | 248/37963 [40:22<91:22:15,  8.72s/it]
  1%|          | 249/37963 [40:30<88:27:09,  8.44s/it]
  1%|          | 250/37963 [40:38<87:55:44,  8.39s/it]
                                                      
{'loss': '0.1761', 'grad_norm': '18.68', 'learning_rate': '4.372e-06', 'epoch': '0.006585'}
+
  1%|          | 250/37963 [40:38<87:55:44,  8.39s/it]
  1%|          | 251/37963 [40:46<86:18:09,  8.24s/it]
  1%|          | 252/37963 [40:54<85:15:17,  8.14s/it]
  1%|          | 253/37963 [41:02<84:42:56,  8.09s/it]
  1%|          | 254/37963 [41:10<84:43:51,  8.09s/it]
  1%|          | 255/37963 [41:18<84:45:24,  8.09s/it]
  1%|          | 256/37963 [41:26<84:27:46,  8.06s/it]
  1%|          | 257/37963 [41:35<85:00:30,  8.12s/it]
  1%|          | 258/37963 [41:43<85:07:59,  8.13s/it]
  1%|          | 259/37963 [41:51<85:37:49,  8.18s/it]
  1%|          | 260/37963 [41:59<85:39:36,  8.18s/it]
                                                      
{'loss': '0.2142', 'grad_norm': '15.58', 'learning_rate': '4.548e-06', 'epoch': '0.006849'}
+
  1%|          | 260/37963 [41:59<85:39:36,  8.18s/it]
  1%|          | 261/37963 [42:07<85:09:26,  8.13s/it]
  1%|          | 262/37963 [42:15<85:35:32,  8.17s/it]
  1%|          | 263/37963 [42:24<85:23:24,  8.15s/it]
  1%|          | 264/37963 [42:32<85:20:53,  8.15s/it]
  1%|          | 265/37963 [42:40<85:20:11,  8.15s/it]
  1%|          | 266/37963 [42:48<85:31:14,  8.17s/it]
  1%|          | 267/37963 [42:56<85:18:46,  8.15s/it]
  1%|          | 268/37963 [43:04<84:57:29,  8.11s/it]
  1%|          | 269/37963 [43:12<84:22:42,  8.06s/it]
  1%|          | 270/37963 [43:21<85:38:05,  8.18s/it]
                                                      
{'loss': '0.1927', 'grad_norm': '7.936', 'learning_rate': '4.723e-06', 'epoch': '0.007112'}
+
  1%|          | 270/37963 [43:21<85:38:05,  8.18s/it]
  1%|          | 271/37963 [43:29<85:46:48,  8.19s/it]
  1%|          | 272/37963 [43:37<85:32:31,  8.17s/it]
  1%|          | 273/37963 [43:45<85:19:47,  8.15s/it]
  1%|          | 274/37963 [43:53<85:13:12,  8.14s/it]
  1%|          | 275/37963 [44:01<85:04:48,  8.13s/it]
  1%|          | 276/37963 [44:09<84:46:23,  8.10s/it]
  1%|          | 277/37963 [44:17<84:34:53,  8.08s/it]
  1%|          | 278/37963 [44:32<105:11:03, 10.05s/it]
  1%|          | 279/37963 [44:47<119:59:58, 11.46s/it]
  1%|          | 280/37963 [44:55<109:49:15, 10.49s/it]
                                                       
{'loss': '0.1979', 'grad_norm': '17.27', 'learning_rate': '4.899e-06', 'epoch': '0.007376'}
+
  1%|          | 280/37963 [44:55<109:49:15, 10.49s/it]
  1%|          | 281/37963 [45:03<102:00:29,  9.75s/it]
  1%|          | 282/37963 [45:19<121:42:41, 11.63s/it]
  1%|          | 283/37963 [45:27<110:27:20, 10.55s/it]
  1%|          | 284/37963 [45:42<124:01:56, 11.85s/it]
  1%|          | 285/37963 [45:50<111:58:14, 10.70s/it]
  1%|          | 286/37963 [46:05<124:30:17, 11.90s/it]
  1%|          | 287/37963 [46:13<112:10:37, 10.72s/it]
  1%|          | 288/37963 [46:28<125:50:11, 12.02s/it]
  1%|          | 289/37963 [46:43<135:21:48, 12.93s/it]
  1%|          | 290/37963 [46:51<119:48:06, 11.45s/it]
                                                       
{'loss': '0.1912', 'grad_norm': '11.12', 'learning_rate': '5.075e-06', 'epoch': '0.007639'}
+
  1%|          | 290/37963 [46:51<119:48:06, 11.45s/it]
  1%|          | 291/37963 [46:59<109:07:12, 10.43s/it]
  1%|          | 292/37963 [47:06<100:44:34,  9.63s/it]
  1%|          | 293/37963 [47:15<96:06:47,  9.19s/it] 
  1%|          | 294/37963 [47:23<92:48:32,  8.87s/it]
  1%|          | 295/37963 [47:31<90:07:30,  8.61s/it]
  1%|          | 296/37963 [47:39<88:28:43,  8.46s/it]
  1%|          | 297/37963 [47:47<87:57:27,  8.41s/it]
  1%|          | 298/37963 [47:55<86:54:18,  8.31s/it]
  1%|          | 299/37963 [48:03<86:36:01,  8.28s/it]
  1%|          | 300/37963 [48:12<86:00:53,  8.22s/it]
                                                      
{'loss': '0.199', 'grad_norm': '11.51', 'learning_rate': '5.25e-06', 'epoch': '0.007902'}
+
  1%|          | 300/37963 [48:12<86:00:53,  8.22s/it]
  1%|          | 301/37963 [48:20<86:23:40,  8.26s/it]
  1%|          | 302/37963 [48:28<85:52:41,  8.21s/it]
  1%|          | 303/37963 [48:36<85:35:35,  8.18s/it]
  1%|          | 304/37963 [48:44<84:49:14,  8.11s/it]
  1%|          | 305/37963 [48:52<84:52:10,  8.11s/it]
  1%|          | 306/37963 [49:00<84:52:35,  8.11s/it]
  1%|          | 307/37963 [49:08<84:53:53,  8.12s/it]
  1%|          | 308/37963 [49:17<85:12:44,  8.15s/it]
  1%|          | 309/37963 [49:25<85:09:59,  8.14s/it]
  1%|          | 310/37963 [49:33<84:46:26,  8.11s/it]
                                                      
{'loss': '0.1899', 'grad_norm': '10.18', 'learning_rate': '5.426e-06', 'epoch': '0.008166'}
+
  1%|          | 310/37963 [49:33<84:46:26,  8.11s/it]
  1%|          | 311/37963 [49:41<83:50:18,  8.02s/it]
  1%|          | 312/37963 [49:49<83:43:23,  8.01s/it]
  1%|          | 313/37963 [49:57<83:54:52,  8.02s/it]
  1%|          | 314/37963 [50:05<84:31:09,  8.08s/it]
  1%|          | 315/37963 [50:13<84:47:40,  8.11s/it]
  1%|          | 316/37963 [50:21<85:10:36,  8.15s/it]
  1%|          | 317/37963 [50:29<85:00:14,  8.13s/it]
  1%|          | 318/37963 [50:37<84:54:02,  8.12s/it]
  1%|          | 319/37963 [50:46<84:46:46,  8.11s/it]
  1%|          | 320/37963 [50:54<84:42:13,  8.10s/it]
                                                      
{'loss': '0.1985', 'grad_norm': '13.68', 'learning_rate': '5.601e-06', 'epoch': '0.008429'}
+
  1%|          | 320/37963 [50:54<84:42:13,  8.10s/it]
  1%|          | 321/37963 [51:02<84:50:57,  8.11s/it]
  1%|          | 322/37963 [51:10<84:26:54,  8.08s/it]
  1%|          | 323/37963 [51:18<84:42:18,  8.10s/it]
  1%|          | 324/37963 [51:26<84:29:00,  8.08s/it]
  1%|          | 325/37963 [51:34<84:00:28,  8.04s/it]
  1%|          | 326/37963 [51:49<105:37:36, 10.10s/it]
  1%|          | 327/37963 [52:03<119:53:31, 11.47s/it]
  1%|          | 328/37963 [52:12<109:26:57, 10.47s/it]
  1%|          | 329/37963 [52:20<102:01:38,  9.76s/it]
  1%|          | 330/37963 [52:34<116:58:24, 11.19s/it]
                                                       
{'loss': '0.2059', 'grad_norm': '7.952', 'learning_rate': '5.777e-06', 'epoch': '0.008693'}
+
  1%|          | 330/37963 [52:34<116:58:24, 11.19s/it]
  1%|          | 331/37963 [52:49<127:36:45, 12.21s/it]
  1%|          | 332/37963 [53:06<144:13:52, 13.80s/it]
  1%|          | 333/37963 [53:14<126:04:01, 12.06s/it]
  1%|          | 334/37963 [53:22<113:54:04, 10.90s/it]
  1%|          | 335/37963 [53:31<105:04:23, 10.05s/it]
  1%|          | 336/37963 [53:45<119:43:04, 11.45s/it]
  1%|          | 337/37963 [54:00<129:43:26, 12.41s/it]
  1%|          | 338/37963 [54:15<136:45:20, 13.08s/it]
  1%|          | 339/37963 [54:23<120:41:55, 11.55s/it]
  1%|          | 340/37963 [54:30<108:27:17, 10.38s/it]
                                                       
{'loss': '0.1903', 'grad_norm': '15.23', 'learning_rate': '5.953e-06', 'epoch': '0.008956'}
+
  1%|          | 340/37963 [54:30<108:27:17, 10.38s/it]
  1%|          | 341/37963 [54:38<101:07:21,  9.68s/it]
  1%|          | 342/37963 [54:46<96:01:28,  9.19s/it] 
  1%|          | 343/37963 [54:54<92:27:19,  8.85s/it]
  1%|          | 344/37963 [55:02<89:45:01,  8.59s/it]
  1%|          | 345/37963 [55:10<87:24:04,  8.36s/it]
  1%|          | 346/37963 [55:18<86:56:05,  8.32s/it]
  1%|          | 347/37963 [55:27<86:26:00,  8.27s/it]
  1%|          | 348/37963 [55:35<86:19:06,  8.26s/it]
  1%|          | 349/37963 [55:43<85:30:59,  8.18s/it]
  1%|          | 350/37963 [55:51<85:41:18,  8.20s/it]
                                                      
{'loss': '0.2132', 'grad_norm': '10.5', 'learning_rate': '6.128e-06', 'epoch': '0.00922'}
+
  1%|          | 350/37963 [55:51<85:41:18,  8.20s/it]
  1%|          | 351/37963 [55:59<84:51:14,  8.12s/it]
  1%|          | 352/37963 [56:07<85:22:30,  8.17s/it]
  1%|          | 353/37963 [56:15<84:54:36,  8.13s/it]
  1%|          | 354/37963 [56:23<85:00:51,  8.14s/it]
  1%|          | 355/37963 [56:31<84:42:01,  8.11s/it]
  1%|          | 356/37963 [56:40<84:46:14,  8.11s/it]
  1%|          | 357/37963 [56:48<84:52:36,  8.13s/it]
  1%|          | 358/37963 [56:56<84:48:41,  8.12s/it]
  1%|          | 359/37963 [57:04<84:52:01,  8.12s/it]
  1%|          | 360/37963 [57:12<84:47:50,  8.12s/it]
                                                      
{'loss': '0.1996', 'grad_norm': '9.875', 'learning_rate': '6.304e-06', 'epoch': '0.009483'}
+
  1%|          | 360/37963 [57:12<84:47:50,  8.12s/it]
  1%|          | 361/37963 [57:20<84:45:27,  8.11s/it]
  1%|          | 362/37963 [57:28<84:53:39,  8.13s/it]
  1%|          | 363/37963 [57:37<85:01:51,  8.14s/it]
  1%|          | 364/37963 [57:45<84:57:30,  8.13s/it]
  1%|          | 365/37963 [57:53<85:50:22,  8.22s/it]
  1%|          | 366/37963 [58:01<85:40:24,  8.20s/it]
  1%|          | 367/37963 [58:09<85:33:16,  8.19s/it]
  1%|          | 368/37963 [58:17<85:08:18,  8.15s/it]
  1%|          | 369/37963 [58:26<84:58:03,  8.14s/it]
  1%|          | 370/37963 [58:34<85:07:54,  8.15s/it]
                                                      
{'loss': '0.2033', 'grad_norm': '8.792', 'learning_rate': '6.479e-06', 'epoch': '0.009746'}
+
  1%|          | 370/37963 [58:34<85:07:54,  8.15s/it]
  1%|          | 371/37963 [58:42<84:57:40,  8.14s/it]
  1%|          | 372/37963 [58:50<85:02:09,  8.14s/it]
  1%|          | 373/37963 [59:05<105:38:55, 10.12s/it]
  1%|          | 374/37963 [59:13<98:39:13,  9.45s/it] 
  1%|          | 375/37963 [59:21<95:10:27,  9.12s/it]
  1%|          | 376/37963 [59:36<112:39:32, 10.79s/it]
  1%|          | 377/37963 [59:50<124:44:16, 11.95s/it]
  1%|          | 378/37963 [59:58<112:22:20, 10.76s/it]
  1%|          | 379/37963 [1:00:16<134:27:08, 12.88s/it]
  1%|          | 380/37963 [1:00:31<140:20:50, 13.44s/it]
                                                         
{'loss': '0.2059', 'grad_norm': '7.236', 'learning_rate': '6.655e-06', 'epoch': '0.01001'}
+
  1%|          | 380/37963 [1:00:31<140:20:50, 13.44s/it]
  1%|          | 381/37963 [1:00:39<123:58:52, 11.88s/it]
  1%|          | 382/37963 [1:00:47<112:11:50, 10.75s/it]
  1%|          | 383/37963 [1:01:02<123:59:16, 11.88s/it]
  1%|          | 384/37963 [1:01:23<154:16:57, 14.78s/it]
  1%|          | 385/37963 [1:01:31<133:31:27, 12.79s/it]
  1%|          | 386/37963 [1:01:40<118:59:02, 11.40s/it]
  1%|          | 387/37963 [1:01:48<109:46:26, 10.52s/it]
  1%|          | 388/37963 [1:01:56<101:21:26,  9.71s/it]
  1%|          | 389/37963 [1:02:04<96:19:12,  9.23s/it] 
  1%|          | 390/37963 [1:02:12<93:05:06,  8.92s/it]
                                                        
{'loss': '0.1987', 'grad_norm': '13.13', 'learning_rate': '6.831e-06', 'epoch': '0.01027'}
+
  1%|          | 390/37963 [1:02:12<93:05:06,  8.92s/it]
  1%|          | 391/37963 [1:02:20<90:55:16,  8.71s/it]
  1%|          | 392/37963 [1:02:28<88:49:47,  8.51s/it]
  1%|          | 393/37963 [1:02:37<87:28:39,  8.38s/it]
  1%|          | 394/37963 [1:02:44<84:36:01,  8.11s/it]
  1%|          | 395/37963 [1:02:52<84:35:26,  8.11s/it]
  1%|          | 396/37963 [1:03:00<83:55:30,  8.04s/it]
  1%|          | 397/37963 [1:03:08<83:59:02,  8.05s/it]
  1%|          | 398/37963 [1:03:16<84:12:58,  8.07s/it]
  1%|          | 399/37963 [1:03:24<83:34:45,  8.01s/it]
  1%|          | 400/37963 [1:03:32<83:56:44,  8.05s/it]
                                                        
{'loss': '0.1953', 'grad_norm': '7.778', 'learning_rate': '7.006e-06', 'epoch': '0.01054'}
+
  1%|          | 400/37963 [1:03:32<83:56:44,  8.05s/it]
  1%|          | 401/37963 [1:03:41<84:54:23,  8.14s/it]
  1%|          | 402/37963 [1:03:48<84:16:45,  8.08s/it]
  1%|          | 403/37963 [1:03:56<82:39:19,  7.92s/it]
  1%|          | 404/37963 [1:04:04<82:41:36,  7.93s/it]
  1%|          | 405/37963 [1:04:12<82:13:59,  7.88s/it]
  1%|          | 406/37963 [1:04:20<83:40:54,  8.02s/it]
  1%|          | 407/37963 [1:04:28<84:16:48,  8.08s/it]
  1%|          | 408/37963 [1:04:36<83:51:17,  8.04s/it]
  1%|          | 409/37963 [1:04:44<84:05:01,  8.06s/it]
  1%|          | 410/37963 [1:04:52<84:03:14,  8.06s/it]
                                                        
{'loss': '0.189', 'grad_norm': '4.6', 'learning_rate': '7.182e-06', 'epoch': '0.0108'}
+
  1%|          | 410/37963 [1:04:52<84:03:14,  8.06s/it]
  1%|          | 411/37963 [1:05:01<84:14:15,  8.08s/it]
  1%|          | 412/37963 [1:05:09<84:03:06,  8.06s/it]
  1%|          | 413/37963 [1:05:17<84:44:38,  8.12s/it]
  1%|          | 414/37963 [1:05:25<85:13:40,  8.17s/it]
  1%|          | 415/37963 [1:05:33<85:14:47,  8.17s/it]
  1%|          | 416/37963 [1:05:41<85:08:17,  8.16s/it]
  1%|          | 417/37963 [1:05:49<84:38:16,  8.12s/it]
  1%|          | 418/37963 [1:05:57<84:04:06,  8.06s/it]
  1%|          | 419/37963 [1:06:05<84:14:15,  8.08s/it]
  1%|          | 420/37963 [1:06:13<83:32:31,  8.01s/it]
                                                        
{'loss': '0.1958', 'grad_norm': '6.628', 'learning_rate': '7.357e-06', 'epoch': '0.01106'}
+
  1%|          | 420/37963 [1:06:13<83:32:31,  8.01s/it]
  1%|          | 421/37963 [1:06:28<103:07:06,  9.89s/it]
  1%|          | 422/37963 [1:06:35<95:53:08,  9.19s/it] 
  1%|          | 423/37963 [1:06:43<92:39:34,  8.89s/it]
  1%|          | 424/37963 [1:07:02<121:55:29, 11.69s/it]
  1%|          | 425/37963 [1:07:16<130:32:27, 12.52s/it]
  1%|          | 426/37963 [1:07:30<136:09:45, 13.06s/it]
  1%|          | 427/37963 [1:07:38<119:25:38, 11.45s/it]
  1%|          | 428/37963 [1:07:46<108:40:05, 10.42s/it]
  1%|          | 429/37963 [1:08:01<121:48:59, 11.68s/it]
  1%|          | 430/37963 [1:08:09<109:55:25, 10.54s/it]
                                                         
{'loss': '0.1792', 'grad_norm': '12.51', 'learning_rate': '7.533e-06', 'epoch': '0.01133'}
+
  1%|          | 430/37963 [1:08:09<109:55:25, 10.54s/it]
  1%|          | 431/37963 [1:08:24<123:44:34, 11.87s/it]
  1%|          | 432/37963 [1:08:32<111:34:59, 10.70s/it]
  1%|          | 433/37963 [1:08:46<124:15:19, 11.92s/it]
  1%|          | 434/37963 [1:08:54<111:57:03, 10.74s/it]
  1%|          | 435/37963 [1:09:02<103:13:51,  9.90s/it]
  1%|          | 436/37963 [1:09:10<96:21:01,  9.24s/it] 
  1%|          | 437/37963 [1:09:18<92:14:13,  8.85s/it]
  1%|          | 438/37963 [1:09:26<89:44:46,  8.61s/it]
  1%|          | 439/37963 [1:09:34<87:57:00,  8.44s/it]
  1%|          | 440/37963 [1:09:42<86:33:47,  8.30s/it]
                                                        
{'loss': '0.1873', 'grad_norm': '5.822', 'learning_rate': '7.709e-06', 'epoch': '0.01159'}
+
  1%|          | 440/37963 [1:09:42<86:33:47,  8.30s/it]
  1%|          | 441/37963 [1:09:50<86:22:11,  8.29s/it]
  1%|          | 442/37963 [1:09:58<85:17:08,  8.18s/it]
  1%|          | 443/37963 [1:10:06<84:47:44,  8.14s/it]
  1%|          | 444/37963 [1:10:14<84:49:36,  8.14s/it]
  1%|          | 445/37963 [1:10:22<84:13:05,  8.08s/it]
  1%|          | 446/37963 [1:10:30<83:35:59,  8.02s/it]
  1%|          | 447/37963 [1:10:38<82:38:33,  7.93s/it]
  1%|          | 448/37963 [1:10:46<83:04:00,  7.97s/it]
  1%|          | 449/37963 [1:10:54<83:11:56,  7.98s/it]
  1%|          | 450/37963 [1:11:02<83:28:00,  8.01s/it]
                                                        
{'loss': '0.198', 'grad_norm': '7.835', 'learning_rate': '7.884e-06', 'epoch': '0.01185'}
+
  1%|          | 450/37963 [1:11:02<83:28:00,  8.01s/it]
  1%|          | 451/37963 [1:11:10<83:05:02,  7.97s/it]
  1%|          | 452/37963 [1:11:18<82:53:46,  7.96s/it]
  1%|          | 453/37963 [1:11:26<82:21:59,  7.91s/it]
  1%|          | 454/37963 [1:11:34<82:52:59,  7.95s/it]
  1%|          | 455/37963 [1:11:42<82:52:35,  7.95s/it]
  1%|          | 456/37963 [1:11:50<83:35:03,  8.02s/it]
  1%|          | 457/37963 [1:11:58<83:03:00,  7.97s/it]
  1%|          | 458/37963 [1:12:06<84:45:45,  8.14s/it]
  1%|          | 459/37963 [1:12:14<83:20:08,  8.00s/it]
  1%|          | 460/37963 [1:12:22<83:24:10,  8.01s/it]
                                                        
{'loss': '0.1926', 'grad_norm': '7.861', 'learning_rate': '8.06e-06', 'epoch': '0.01212'}
+
  1%|          | 460/37963 [1:12:22<83:24:10,  8.01s/it]
  1%|          | 461/37963 [1:12:30<83:03:21,  7.97s/it]
  1%|          | 462/37963 [1:12:38<83:16:26,  7.99s/it]
  1%|          | 463/37963 [1:12:46<83:25:57,  8.01s/it]
  1%|          | 464/37963 [1:12:54<83:58:21,  8.06s/it]
  1%|          | 465/37963 [1:13:02<84:38:12,  8.13s/it]
  1%|          | 466/37963 [1:13:10<84:12:10,  8.08s/it]
  1%|          | 467/37963 [1:13:18<83:41:50,  8.04s/it]
  1%|          | 468/37963 [1:13:26<83:47:02,  8.04s/it]
  1%|          | 469/37963 [1:13:34<83:24:42,  8.01s/it]
  1%|          | 470/37963 [1:13:42<83:45:45,  8.04s/it]
                                                        
{'loss': '0.1821', 'grad_norm': '6.469', 'learning_rate': '8.235e-06', 'epoch': '0.01238'}
+
  1%|          | 470/37963 [1:13:42<83:45:45,  8.04s/it]
  1%|          | 471/37963 [1:13:51<85:22:40,  8.20s/it]
  1%|          | 472/37963 [1:14:08<114:24:07, 10.99s/it]
  1%|          | 473/37963 [1:14:23<127:02:12, 12.20s/it]
  1%|          | 474/37963 [1:14:32<114:40:52, 11.01s/it]
  1%|▏         | 475/37963 [1:14:46<125:19:47, 12.04s/it]
  1%|▏         | 476/37963 [1:15:01<133:21:20, 12.81s/it]
  1%|▏         | 477/37963 [1:15:09<118:58:30, 11.43s/it]
  1%|▏         | 478/37963 [1:15:23<128:44:06, 12.36s/it]
  1%|▏         | 479/37963 [1:15:31<115:10:00, 11.06s/it]
  1%|▏         | 480/37963 [1:15:47<127:41:53, 12.26s/it]
                                                         
{'loss': '0.192', 'grad_norm': '7.271', 'learning_rate': '8.411e-06', 'epoch': '0.01264'}
+
  1%|▏         | 480/37963 [1:15:47<127:41:53, 12.26s/it]
  1%|▏         | 481/37963 [1:15:55<115:40:53, 11.11s/it]
  1%|▏         | 482/37963 [1:16:10<127:35:09, 12.25s/it]
  1%|▏         | 483/37963 [1:16:25<135:42:17, 13.03s/it]
  1%|▏         | 484/37963 [1:16:33<120:21:54, 11.56s/it]
  1%|▏         | 485/37963 [1:16:41<109:18:29, 10.50s/it]
  1%|▏         | 486/37963 [1:16:49<101:36:44,  9.76s/it]
  1%|▏         | 487/37963 [1:16:57<95:46:40,  9.20s/it] 
  1%|▏         | 488/37963 [1:17:05<91:49:56,  8.82s/it]
  1%|▏         | 489/37963 [1:17:13<89:40:33,  8.61s/it]
  1%|▏         | 490/37963 [1:17:21<88:01:18,  8.46s/it]
                                                        
{'loss': '0.1917', 'grad_norm': '8.729', 'learning_rate': '8.586e-06', 'epoch': '0.01291'}
+
  1%|▏         | 490/37963 [1:17:21<88:01:18,  8.46s/it]
  1%|▏         | 491/37963 [1:17:29<85:45:15,  8.24s/it]
  1%|▏         | 492/37963 [1:17:37<85:09:22,  8.18s/it]
  1%|▏         | 493/37963 [1:17:45<84:20:35,  8.10s/it]
  1%|▏         | 494/37963 [1:17:53<84:35:20,  8.13s/it]
  1%|▏         | 495/37963 [1:18:01<83:51:08,  8.06s/it]
  1%|▏         | 496/37963 [1:18:09<84:15:45,  8.10s/it]
  1%|▏         | 497/37963 [1:18:17<84:06:21,  8.08s/it]
  1%|▏         | 498/37963 [1:18:25<85:05:37,  8.18s/it]
  1%|▏         | 499/37963 [1:18:34<85:18:57,  8.20s/it]
  1%|▏         | 500/37963 [1:18:42<85:06:11,  8.18s/it]
                                                        
{'loss': '0.2089', 'grad_norm': '15.1', 'learning_rate': '8.762e-06', 'epoch': '0.01317'}
+
  1%|▏         | 500/37963 [1:18:42<85:06:11,  8.18s/it]
  1%|▏         | 501/37963 [1:18:50<84:49:19,  8.15s/it]
  1%|▏         | 502/37963 [1:18:58<84:21:46,  8.11s/it]
  1%|▏         | 503/37963 [1:19:06<84:56:03,  8.16s/it]
  1%|▏         | 504/37963 [1:19:14<84:26:28,  8.12s/it]
  1%|▏         | 505/37963 [1:19:22<84:53:49,  8.16s/it]
  1%|▏         | 506/37963 [1:19:30<84:32:38,  8.13s/it]
  1%|▏         | 507/37963 [1:19:38<84:09:06,  8.09s/it]
  1%|▏         | 508/37963 [1:19:47<84:20:09,  8.11s/it]
  1%|▏         | 509/37963 [1:19:55<84:26:55,  8.12s/it]
  1%|▏         | 510/37963 [1:20:03<84:46:46,  8.15s/it]
                                                        
{'loss': '0.2075', 'grad_norm': '7.576', 'learning_rate': '8.938e-06', 'epoch': '0.01343'}
+
  1%|▏         | 510/37963 [1:20:03<84:46:46,  8.15s/it]
  1%|▏         | 511/37963 [1:20:11<85:12:45,  8.19s/it]
  1%|▏         | 512/37963 [1:20:19<85:12:01,  8.19s/it]
  1%|▏         | 513/37963 [1:20:27<84:28:49,  8.12s/it]
  1%|▏         | 514/37963 [1:20:35<84:18:49,  8.11s/it]
  1%|▏         | 515/37963 [1:20:44<84:53:51,  8.16s/it]
  1%|▏         | 516/37963 [1:20:52<84:40:02,  8.14s/it]
  1%|▏         | 517/37963 [1:21:07<105:25:06, 10.13s/it]
  1%|▏         | 518/37963 [1:21:15<99:41:15,  9.58s/it] 
  1%|▏         | 519/37963 [1:21:23<95:33:18,  9.19s/it]
  1%|▏         | 520/37963 [1:21:38<112:14:24, 10.79s/it]
                                                         
{'loss': '0.2036', 'grad_norm': '11.21', 'learning_rate': '9.113e-06', 'epoch': '0.0137'}
+
  1%|▏         | 520/37963 [1:21:38<112:14:24, 10.79s/it]
  1%|▏         | 521/37963 [1:21:46<103:50:28,  9.98s/it]
  1%|▏         | 522/37963 [1:21:54<97:42:47,  9.40s/it] 
  1%|▏         | 523/37963 [1:22:12<124:51:08, 12.01s/it]
  1%|▏         | 524/37963 [1:22:20<112:51:01, 10.85s/it]
  1%|▏         | 525/37963 [1:22:28<103:24:21,  9.94s/it]
  1%|▏         | 526/37963 [1:22:36<97:56:40,  9.42s/it] 
  1%|▏         | 527/37963 [1:22:58<135:15:45, 13.01s/it]
  1%|▏         | 528/37963 [1:23:12<140:15:12, 13.49s/it]
  1%|▏         | 529/37963 [1:23:33<164:08:05, 15.78s/it]
  1%|▏         | 530/37963 [1:23:41<140:28:29, 13.51s/it]
                                                         
{'loss': '0.1944', 'grad_norm': '6.769', 'learning_rate': '9.289e-06', 'epoch': '0.01396'}
+
  1%|▏         | 530/37963 [1:23:41<140:28:29, 13.51s/it]
  1%|▏         | 531/37963 [1:23:50<123:29:17, 11.88s/it]
  1%|▏         | 532/37963 [1:23:57<110:54:33, 10.67s/it]
  1%|▏         | 533/37963 [1:24:06<103:07:26,  9.92s/it]
  1%|▏         | 534/37963 [1:24:14<97:31:18,  9.38s/it] 
  1%|▏         | 535/37963 [1:24:22<93:37:14,  9.00s/it]
  1%|▏         | 536/37963 [1:24:30<90:56:20,  8.75s/it]
  1%|▏         | 537/37963 [1:24:38<89:23:13,  8.60s/it]
  1%|▏         | 538/37963 [1:24:46<88:09:26,  8.48s/it]
  1%|▏         | 539/37963 [1:24:54<86:10:05,  8.29s/it]
  1%|▏         | 540/37963 [1:25:02<85:27:19,  8.22s/it]
                                                        
{'loss': '0.1929', 'grad_norm': '10.72', 'learning_rate': '9.464e-06', 'epoch': '0.01422'}
+
  1%|▏         | 540/37963 [1:25:02<85:27:19,  8.22s/it]
  1%|▏         | 541/37963 [1:25:10<84:31:24,  8.13s/it]
  1%|▏         | 542/37963 [1:25:19<85:01:02,  8.18s/it]
  1%|▏         | 543/37963 [1:25:27<84:31:03,  8.13s/it]
  1%|▏         | 544/37963 [1:25:35<84:36:44,  8.14s/it]
  1%|▏         | 545/37963 [1:25:43<84:47:32,  8.16s/it]
  1%|▏         | 546/37963 [1:25:51<84:45:48,  8.16s/it]
  1%|▏         | 547/37963 [1:25:59<84:09:58,  8.10s/it]
  1%|▏         | 548/37963 [1:26:07<84:39:41,  8.15s/it]
  1%|▏         | 549/37963 [1:26:15<84:07:40,  8.09s/it]
  1%|▏         | 550/37963 [1:26:24<84:46:44,  8.16s/it]
                                                        
{'loss': '0.1892', 'grad_norm': '4.953', 'learning_rate': '9.64e-06', 'epoch': '0.01449'}
+
  1%|▏         | 550/37963 [1:26:24<84:46:44,  8.16s/it]
  1%|▏         | 551/37963 [1:26:32<84:42:26,  8.15s/it]
  1%|▏         | 552/37963 [1:26:40<85:20:28,  8.21s/it]
  1%|▏         | 553/37963 [1:26:48<85:17:38,  8.21s/it]
  1%|▏         | 554/37963 [1:26:56<85:03:03,  8.18s/it]
  1%|▏         | 555/37963 [1:27:04<84:10:00,  8.10s/it]
  1%|▏         | 556/37963 [1:27:12<84:18:45,  8.11s/it]
  1%|▏         | 557/37963 [1:27:20<83:47:10,  8.06s/it]
  1%|▏         | 558/37963 [1:27:28<83:49:24,  8.07s/it]
  1%|▏         | 559/37963 [1:27:36<83:31:40,  8.04s/it]
  1%|▏         | 560/37963 [1:27:45<83:50:22,  8.07s/it]
                                                        
{'loss': '0.1814', 'grad_norm': '6.429', 'learning_rate': '9.816e-06', 'epoch': '0.01475'}
+
  1%|▏         | 560/37963 [1:27:45<83:50:22,  8.07s/it]
  1%|▏         | 561/37963 [1:27:53<83:59:24,  8.08s/it]
  1%|▏         | 562/37963 [1:28:01<84:14:06,  8.11s/it]
  1%|▏         | 563/37963 [1:28:09<83:35:39,  8.05s/it]
  1%|▏         | 564/37963 [1:28:17<82:55:22,  7.98s/it]
  1%|▏         | 565/37963 [1:28:25<83:42:52,  8.06s/it]
  1%|▏         | 566/37963 [1:28:33<84:24:22,  8.13s/it]
  1%|▏         | 567/37963 [1:28:41<83:25:27,  8.03s/it]
  1%|▏         | 568/37963 [1:28:55<103:40:09,  9.98s/it]
  1%|▏         | 569/37963 [1:29:03<96:49:41,  9.32s/it] 
  2%|▏         | 570/37963 [1:29:21<124:41:27, 12.00s/it]
                                                         
{'loss': '0.1906', 'grad_norm': '5.743', 'learning_rate': '9.991e-06', 'epoch': '0.01501'}
+
  2%|▏         | 570/37963 [1:29:21<124:41:27, 12.00s/it]
  2%|▏         | 571/37963 [1:29:30<112:37:49, 10.84s/it]
  2%|▏         | 572/37963 [1:29:58<167:36:31, 16.14s/it]
  2%|▏         | 573/37963 [1:30:06<142:15:03, 13.70s/it]
  2%|▏         | 574/37963 [1:30:21<145:03:11, 13.97s/it]
  2%|▏         | 575/37963 [1:30:29<126:26:32, 12.17s/it]
  2%|▏         | 576/37963 [1:30:37<113:31:25, 10.93s/it]
  2%|▏         | 577/37963 [1:30:58<145:48:13, 14.04s/it]
  2%|▏         | 578/37963 [1:31:06<127:26:56, 12.27s/it]
  2%|▏         | 579/37963 [1:31:21<134:30:07, 12.95s/it]
  2%|▏         | 580/37963 [1:31:29<119:15:19, 11.48s/it]
                                                         
{'loss': '0.2002', 'grad_norm': '8.629', 'learning_rate': '1.017e-05', 'epoch': '0.01528'}
+
  2%|▏         | 580/37963 [1:31:29<119:15:19, 11.48s/it]
  2%|▏         | 581/37963 [1:31:37<107:52:39, 10.39s/it]
  2%|▏         | 582/37963 [1:31:45<101:11:10,  9.74s/it]
  2%|▏         | 583/37963 [1:31:53<96:06:32,  9.26s/it] 
  2%|▏         | 584/37963 [1:32:01<92:41:12,  8.93s/it]
  2%|▏         | 585/37963 [1:32:09<90:46:14,  8.74s/it]
  2%|▏         | 586/37963 [1:32:17<88:41:18,  8.54s/it]
  2%|▏         | 587/37963 [1:32:26<87:26:12,  8.42s/it]
  2%|▏         | 588/37963 [1:32:33<85:10:16,  8.20s/it]
  2%|▏         | 589/37963 [1:32:41<84:21:08,  8.13s/it]
  2%|▏         | 590/37963 [1:32:49<83:50:19,  8.08s/it]
                                                        
{'loss': '0.183', 'grad_norm': '10.12', 'learning_rate': '1.034e-05', 'epoch': '0.01554'}
+
  2%|▏         | 590/37963 [1:32:49<83:50:19,  8.08s/it]
  2%|▏         | 591/37963 [1:32:57<83:56:23,  8.09s/it]
  2%|▏         | 592/37963 [1:33:05<83:44:24,  8.07s/it]
  2%|▏         | 593/37963 [1:33:13<83:43:25,  8.07s/it]
  2%|▏         | 594/37963 [1:33:22<83:46:40,  8.07s/it]
  2%|▏         | 595/37963 [1:33:30<83:42:36,  8.06s/it]
  2%|▏         | 596/37963 [1:33:37<83:14:17,  8.02s/it]
  2%|▏         | 597/37963 [1:33:46<83:37:03,  8.06s/it]
  2%|▏         | 598/37963 [1:33:54<84:09:25,  8.11s/it]
  2%|▏         | 599/37963 [1:34:02<84:08:32,  8.11s/it]
  2%|▏         | 600/37963 [1:34:10<83:49:47,  8.08s/it]
                                                        
{'loss': '0.1898', 'grad_norm': '10.19', 'learning_rate': '1.052e-05', 'epoch': '0.0158'}
+
  2%|▏         | 600/37963 [1:34:10<83:49:47,  8.08s/it]
  2%|▏         | 601/37963 [1:34:18<83:55:59,  8.09s/it]
  2%|▏         | 602/37963 [1:34:26<83:54:16,  8.08s/it]
  2%|▏         | 603/37963 [1:34:34<83:16:09,  8.02s/it]
  2%|▏         | 604/37963 [1:34:42<83:55:36,  8.09s/it]
  2%|▏         | 605/37963 [1:34:51<85:20:19,  8.22s/it]
  2%|▏         | 606/37963 [1:34:59<84:54:33,  8.18s/it]
  2%|▏         | 607/37963 [1:35:07<84:49:59,  8.18s/it]
  2%|▏         | 608/37963 [1:35:15<85:24:49,  8.23s/it]
  2%|▏         | 609/37963 [1:35:24<85:36:48,  8.25s/it]
  2%|▏         | 610/37963 [1:35:32<84:45:04,  8.17s/it]
                                                        
{'loss': '0.1903', 'grad_norm': '6.897', 'learning_rate': '1.069e-05', 'epoch': '0.01607'}
+
  2%|▏         | 610/37963 [1:35:32<84:45:04,  8.17s/it]
  2%|▏         | 611/37963 [1:35:39<83:21:05,  8.03s/it]
  2%|▏         | 612/37963 [1:35:47<83:32:52,  8.05s/it]
  2%|▏         | 613/37963 [1:36:04<110:25:41, 10.64s/it]
  2%|▏         | 614/37963 [1:36:12<102:20:57,  9.87s/it]
  2%|▏         | 615/37963 [1:36:20<96:54:21,  9.34s/it] 
  2%|▏         | 616/37963 [1:36:28<92:02:29,  8.87s/it]
  2%|▏         | 617/37963 [1:36:36<89:13:13,  8.60s/it]
  2%|▏         | 618/37963 [1:36:51<108:41:01, 10.48s/it]
  2%|▏         | 619/37963 [1:37:06<122:07:56, 11.77s/it]
  2%|▏         | 620/37963 [1:37:14<110:25:19, 10.65s/it]
                                                         
{'loss': '0.182', 'grad_norm': '5.719', 'learning_rate': '1.087e-05', 'epoch': '0.01633'}
+
  2%|▏         | 620/37963 [1:37:14<110:25:19, 10.65s/it]
  2%|▏         | 621/37963 [1:37:22<103:03:56,  9.94s/it]
  2%|▏         | 622/37963 [1:37:30<97:54:51,  9.44s/it] 
  2%|▏         | 623/37963 [1:37:45<115:19:27, 11.12s/it]
  2%|▏         | 624/37963 [1:38:00<126:27:52, 12.19s/it]
  2%|▏         | 625/37963 [1:38:08<114:06:36, 11.00s/it]
  2%|▏         | 626/37963 [1:38:23<125:35:05, 12.11s/it]
  2%|▏         | 627/37963 [1:38:31<113:09:28, 10.91s/it]
  2%|▏         | 628/37963 [1:38:45<123:04:23, 11.87s/it]
  2%|▏         | 629/37963 [1:38:53<111:03:34, 10.71s/it]
  2%|▏         | 630/37963 [1:39:01<102:50:51,  9.92s/it]
                                                         
{'loss': '0.205', 'grad_norm': '12.94', 'learning_rate': '1.104e-05', 'epoch': '0.0166'}
+
  2%|▏         | 630/37963 [1:39:01<102:50:51,  9.92s/it]
  2%|▏         | 631/37963 [1:39:09<96:44:45,  9.33s/it] 
  2%|▏         | 632/37963 [1:39:17<93:15:44,  8.99s/it]
  2%|▏         | 633/37963 [1:39:25<89:44:46,  8.65s/it]
  2%|▏         | 634/37963 [1:39:33<87:34:02,  8.44s/it]
  2%|▏         | 635/37963 [1:39:41<86:32:46,  8.35s/it]
  2%|▏         | 636/37963 [1:39:49<85:39:59,  8.26s/it]
  2%|▏         | 637/37963 [1:39:57<84:57:02,  8.19s/it]
  2%|▏         | 638/37963 [1:40:06<84:38:26,  8.16s/it]
  2%|▏         | 639/37963 [1:40:14<84:11:20,  8.12s/it]
  2%|▏         | 640/37963 [1:40:22<83:39:05,  8.07s/it]
                                                        
{'loss': '0.1844', 'grad_norm': '7.09', 'learning_rate': '1.122e-05', 'epoch': '0.01686'}
+
  2%|▏         | 640/37963 [1:40:22<83:39:05,  8.07s/it]
  2%|▏         | 641/37963 [1:40:29<83:09:53,  8.02s/it]
  2%|▏         | 642/37963 [1:40:38<83:20:02,  8.04s/it]
  2%|▏         | 643/37963 [1:40:46<83:55:53,  8.10s/it]
  2%|▏         | 644/37963 [1:40:54<84:15:05,  8.13s/it]
  2%|▏         | 645/37963 [1:41:02<84:17:14,  8.13s/it]
  2%|▏         | 646/37963 [1:41:10<83:49:45,  8.09s/it]
  2%|▏         | 647/37963 [1:41:18<83:22:45,  8.04s/it]
  2%|▏         | 648/37963 [1:41:26<83:13:50,  8.03s/it]
  2%|▏         | 649/37963 [1:41:34<82:47:29,  7.99s/it]
  2%|▏         | 650/37963 [1:41:42<82:38:38,  7.97s/it]
                                                        
{'loss': '0.1897', 'grad_norm': '8.073', 'learning_rate': '1.14e-05', 'epoch': '0.01712'}
+
  2%|▏         | 650/37963 [1:41:42<82:38:38,  7.97s/it]
  2%|▏         | 651/37963 [1:41:50<83:01:19,  8.01s/it]
  2%|▏         | 652/37963 [1:41:58<83:16:59,  8.04s/it]
  2%|▏         | 653/37963 [1:42:06<82:19:33,  7.94s/it]
  2%|▏         | 654/37963 [1:42:14<82:24:27,  7.95s/it]
  2%|▏         | 655/37963 [1:42:22<82:28:32,  7.96s/it]
  2%|▏         | 656/37963 [1:42:30<82:27:37,  7.96s/it]
  2%|▏         | 657/37963 [1:42:38<83:31:14,  8.06s/it]
  2%|▏         | 658/37963 [1:42:46<84:18:15,  8.14s/it]
  2%|▏         | 659/37963 [1:42:54<84:03:55,  8.11s/it]
  2%|▏         | 660/37963 [1:43:09<104:39:00, 10.10s/it]
                                                         
{'loss': '0.2158', 'grad_norm': '4.672', 'learning_rate': '1.157e-05', 'epoch': '0.01739'}
+
  2%|▏         | 660/37963 [1:43:09<104:39:00, 10.10s/it]
  2%|▏         | 661/37963 [1:43:17<98:08:06,  9.47s/it] 
  2%|▏         | 662/37963 [1:43:25<93:53:48,  9.06s/it]
  2%|▏         | 663/37963 [1:43:33<90:54:08,  8.77s/it]
  2%|▏         | 664/37963 [1:43:41<88:51:06,  8.58s/it]
  2%|▏         | 665/37963 [1:43:50<87:48:24,  8.48s/it]
  2%|▏         | 666/37963 [1:44:15<139:38:07, 13.48s/it]
  2%|▏         | 667/37963 [1:44:23<123:03:58, 11.88s/it]
  2%|▏         | 668/37963 [1:44:37<131:17:24, 12.67s/it]
  2%|▏         | 669/37963 [1:44:52<138:22:35, 13.36s/it]
  2%|▏         | 670/37963 [1:45:01<122:14:19, 11.80s/it]
                                                         
{'loss': '0.1979', 'grad_norm': '6.209', 'learning_rate': '1.175e-05', 'epoch': '0.01765'}
+
  2%|▏         | 670/37963 [1:45:01<122:14:19, 11.80s/it]
  2%|▏         | 671/37963 [1:45:09<110:52:26, 10.70s/it]
  2%|▏         | 672/37963 [1:45:17<103:11:28,  9.96s/it]
  2%|▏         | 673/37963 [1:45:35<127:52:37, 12.35s/it]
  2%|▏         | 674/37963 [1:45:43<114:43:03, 11.08s/it]
  2%|▏         | 675/37963 [1:45:51<105:55:27, 10.23s/it]
  2%|▏         | 676/37963 [1:46:06<119:04:40, 11.50s/it]
  2%|▏         | 677/37963 [1:46:14<108:04:56, 10.44s/it]
  2%|▏         | 678/37963 [1:46:22<101:16:06,  9.78s/it]
  2%|▏         | 679/37963 [1:46:30<95:58:52,  9.27s/it] 
  2%|▏         | 680/37963 [1:46:45<112:46:21, 10.89s/it]
                                                         
{'loss': '0.1892', 'grad_norm': '6.144', 'learning_rate': '1.192e-05', 'epoch': '0.01791'}
+
  2%|▏         | 680/37963 [1:46:45<112:46:21, 10.89s/it]
  2%|▏         | 681/37963 [1:46:53<103:33:56, 10.00s/it]
  2%|▏         | 682/37963 [1:47:01<97:38:05,  9.43s/it] 
  2%|▏         | 683/37963 [1:47:09<93:15:39,  9.01s/it]
  2%|▏         | 684/37963 [1:47:17<90:30:46,  8.74s/it]
  2%|▏         | 685/37963 [1:47:25<88:55:27,  8.59s/it]
  2%|▏         | 686/37963 [1:47:33<87:38:05,  8.46s/it]
  2%|▏         | 687/37963 [1:47:41<86:03:41,  8.31s/it]
  2%|▏         | 688/37963 [1:47:49<85:16:51,  8.24s/it]
  2%|▏         | 689/37963 [1:47:57<83:59:47,  8.11s/it]
  2%|▏         | 690/37963 [1:48:05<83:47:51,  8.09s/it]
                                                        
{'loss': '0.1989', 'grad_norm': '8.257', 'learning_rate': '1.21e-05', 'epoch': '0.01818'}
+
  2%|▏         | 690/37963 [1:48:05<83:47:51,  8.09s/it]
  2%|▏         | 691/37963 [1:48:13<83:44:39,  8.09s/it]
  2%|▏         | 692/37963 [1:48:21<84:04:00,  8.12s/it]
  2%|▏         | 693/37963 [1:48:29<83:54:26,  8.10s/it]
  2%|▏         | 694/37963 [1:48:37<83:42:41,  8.09s/it]
  2%|▏         | 695/37963 [1:48:45<83:21:09,  8.05s/it]
  2%|▏         | 696/37963 [1:48:54<83:24:12,  8.06s/it]
  2%|▏         | 697/37963 [1:49:01<82:27:01,  7.96s/it]
  2%|▏         | 698/37963 [1:49:09<82:31:10,  7.97s/it]
  2%|▏         | 699/37963 [1:49:18<83:30:29,  8.07s/it]
  2%|▏         | 700/37963 [1:49:26<83:49:50,  8.10s/it]
                                                        
{'loss': '0.1968', 'grad_norm': '7.26', 'learning_rate': '1.227e-05', 'epoch': '0.01844'}
+
  2%|▏         | 700/37963 [1:49:26<83:49:50,  8.10s/it]
  2%|▏         | 701/37963 [1:49:34<84:03:23,  8.12s/it]
  2%|▏         | 702/37963 [1:49:42<84:07:11,  8.13s/it]
  2%|▏         | 703/37963 [1:49:50<84:20:59,  8.15s/it]
  2%|▏         | 704/37963 [1:49:58<83:52:59,  8.10s/it]
  2%|▏         | 705/37963 [1:50:06<84:15:07,  8.14s/it]
  2%|▏         | 706/37963 [1:50:15<84:02:09,  8.12s/it]
  2%|▏         | 707/37963 [1:50:23<83:50:10,  8.10s/it]
  2%|▏         | 708/37963 [1:50:31<84:13:55,  8.14s/it]
  2%|▏         | 709/37963 [1:50:39<84:06:35,  8.13s/it]
  2%|▏         | 710/37963 [1:50:54<105:02:43, 10.15s/it]
                                                         
{'loss': '0.1807', 'grad_norm': '7.962', 'learning_rate': '1.245e-05', 'epoch': '0.0187'}
+
  2%|▏         | 710/37963 [1:50:54<105:02:43, 10.15s/it]
  2%|▏         | 711/37963 [1:51:02<99:07:43,  9.58s/it] 
  2%|▏         | 712/37963 [1:51:10<93:06:13,  9.00s/it]
  2%|▏         | 713/37963 [1:51:18<90:26:05,  8.74s/it]
  2%|▏         | 714/37963 [1:51:33<108:54:04, 10.52s/it]
  2%|▏         | 715/37963 [1:51:47<121:38:21, 11.76s/it]
  2%|▏         | 716/37963 [1:51:55<110:33:59, 10.69s/it]
  2%|▏         | 717/37963 [1:52:03<102:23:10,  9.90s/it]
  2%|▏         | 718/37963 [1:52:18<117:19:02, 11.34s/it]
  2%|▏         | 719/37963 [1:52:26<107:25:23, 10.38s/it]
  2%|▏         | 720/37963 [1:52:41<120:50:43, 11.68s/it]
                                                         
{'loss': '0.1864', 'grad_norm': '7.95', 'learning_rate': '1.263e-05', 'epoch': '0.01897'}
+
  2%|▏         | 720/37963 [1:52:41<120:50:43, 11.68s/it]
  2%|▏         | 721/37963 [1:52:49<110:09:59, 10.65s/it]
  2%|▏         | 722/37963 [1:52:57<102:18:42,  9.89s/it]
  2%|▏         | 723/37963 [1:53:05<96:53:47,  9.37s/it] 
  2%|▏         | 724/37963 [1:53:20<114:07:27, 11.03s/it]
  2%|▏         | 725/37963 [1:53:35<126:34:40, 12.24s/it]
  2%|▏         | 726/37963 [1:53:43<113:21:02, 10.96s/it]
  2%|▏         | 727/37963 [1:54:02<135:42:54, 13.12s/it]
  2%|▏         | 728/37963 [1:54:10<120:00:28, 11.60s/it]
  2%|▏         | 729/37963 [1:54:18<108:51:52, 10.53s/it]
  2%|▏         | 730/37963 [1:54:26<101:50:40,  9.85s/it]
                                                         
{'loss': '0.1875', 'grad_norm': '4.536', 'learning_rate': '1.28e-05', 'epoch': '0.01923'}
+
  2%|▏         | 730/37963 [1:54:26<101:50:40,  9.85s/it]
  2%|▏         | 731/37963 [1:54:34<96:51:41,  9.37s/it] 
  2%|▏         | 732/37963 [1:54:42<93:06:50,  9.00s/it]
  2%|▏         | 733/37963 [1:54:50<90:34:01,  8.76s/it]
  2%|▏         | 734/37963 [1:54:59<88:32:02,  8.56s/it]
  2%|▏         | 735/37963 [1:55:07<86:50:49,  8.40s/it]
  2%|▏         | 736/37963 [1:55:15<86:03:53,  8.32s/it]
  2%|▏         | 737/37963 [1:55:23<85:24:48,  8.26s/it]
  2%|▏         | 738/37963 [1:55:31<84:37:51,  8.18s/it]
  2%|▏         | 739/37963 [1:55:39<84:18:30,  8.15s/it]
  2%|▏         | 740/37963 [1:55:47<83:54:05,  8.11s/it]
                                                        
{'loss': '0.1954', 'grad_norm': '8.837', 'learning_rate': '1.298e-05', 'epoch': '0.01949'}
+
  2%|▏         | 740/37963 [1:55:47<83:54:05,  8.11s/it]
  2%|▏         | 741/37963 [1:55:55<84:11:58,  8.14s/it]
  2%|▏         | 742/37963 [1:56:03<83:50:22,  8.11s/it]
  2%|▏         | 743/37963 [1:56:11<83:24:58,  8.07s/it]
  2%|▏         | 744/37963 [1:56:19<83:43:08,  8.10s/it]
  2%|▏         | 745/37963 [1:56:28<84:05:22,  8.13s/it]
  2%|▏         | 746/37963 [1:56:36<83:52:34,  8.11s/it]
  2%|▏         | 747/37963 [1:56:44<83:43:13,  8.10s/it]
  2%|▏         | 748/37963 [1:56:52<84:15:46,  8.15s/it]
  2%|▏         | 749/37963 [1:57:00<83:36:26,  8.09s/it]
  2%|▏         | 750/37963 [1:57:08<83:00:44,  8.03s/it]
                                                        
{'loss': '0.2018', 'grad_norm': '6', 'learning_rate': '1.315e-05', 'epoch': '0.01976'}
+
  2%|▏         | 750/37963 [1:57:08<83:00:44,  8.03s/it]
  2%|▏         | 751/37963 [1:57:16<83:34:28,  8.09s/it]
  2%|▏         | 752/37963 [1:57:24<83:16:18,  8.06s/it]
  2%|▏         | 753/37963 [1:57:32<83:40:12,  8.09s/it]
  2%|▏         | 754/37963 [1:57:40<83:32:05,  8.08s/it]
  2%|▏         | 755/37963 [1:57:48<83:54:46,  8.12s/it]
  2%|▏         | 756/37963 [1:57:57<84:06:09,  8.14s/it]
  2%|▏         | 757/37963 [1:58:05<84:13:08,  8.15s/it]
  2%|▏         | 758/37963 [1:58:13<84:41:33,  8.19s/it]
  2%|▏         | 759/37963 [1:58:28<105:24:18, 10.20s/it]
  2%|▏         | 760/37963 [1:58:43<118:57:03, 11.51s/it]
                                                         
{'loss': '0.196', 'grad_norm': '8.002', 'learning_rate': '1.333e-05', 'epoch': '0.02002'}
+
  2%|▏         | 760/37963 [1:58:43<118:57:03, 11.51s/it]
  2%|▏         | 761/37963 [1:58:51<108:51:59, 10.53s/it]
  2%|▏         | 762/37963 [1:58:59<100:25:26,  9.72s/it]
  2%|▏         | 763/37963 [1:59:13<115:28:16, 11.17s/it]
  2%|▏         | 764/37963 [1:59:28<125:54:43, 12.19s/it]
  2%|▏         | 765/37963 [1:59:36<112:54:28, 10.93s/it]
  2%|▏         | 766/37963 [1:59:50<122:44:10, 11.88s/it]
  2%|▏         | 767/37963 [1:59:58<111:02:57, 10.75s/it]
  2%|▏         | 768/37963 [2:00:06<102:36:24,  9.93s/it]
  2%|▏         | 769/37963 [2:00:14<96:50:36,  9.37s/it] 
  2%|▏         | 770/37963 [2:00:22<93:48:54,  9.08s/it]
                                                        
{'loss': '0.2074', 'grad_norm': '8.193', 'learning_rate': '1.35e-05', 'epoch': '0.02028'}
+
  2%|▏         | 770/37963 [2:00:22<93:48:54,  9.08s/it]
  2%|▏         | 771/37963 [2:00:31<90:46:43,  8.79s/it]
  2%|▏         | 772/37963 [2:00:46<110:21:54, 10.68s/it]
  2%|▏         | 773/37963 [2:00:54<102:34:07,  9.93s/it]
  2%|▏         | 774/37963 [2:01:08<116:16:19, 11.26s/it]
  2%|▏         | 775/37963 [2:01:23<126:54:12, 12.28s/it]
  2%|▏         | 776/37963 [2:01:31<114:09:51, 11.05s/it]
  2%|▏         | 777/37963 [2:01:39<104:40:34, 10.13s/it]
  2%|▏         | 778/37963 [2:01:47<98:46:42,  9.56s/it] 
  2%|▏         | 779/37963 [2:01:55<94:21:40,  9.14s/it]
  2%|▏         | 780/37963 [2:02:04<91:28:52,  8.86s/it]
                                                        
{'loss': '0.1917', 'grad_norm': '3.517', 'learning_rate': '1.368e-05', 'epoch': '0.02055'}
+
  2%|▏         | 780/37963 [2:02:04<91:28:52,  8.86s/it]
  2%|▏         | 781/37963 [2:02:12<88:38:20,  8.58s/it]
  2%|▏         | 782/37963 [2:02:20<87:15:22,  8.45s/it]
  2%|▏         | 783/37963 [2:02:28<86:43:54,  8.40s/it]
  2%|▏         | 784/37963 [2:02:36<85:39:01,  8.29s/it]
  2%|▏         | 785/37963 [2:02:44<85:02:22,  8.23s/it]
  2%|▏         | 786/37963 [2:02:52<84:13:42,  8.16s/it]
  2%|▏         | 787/37963 [2:03:00<83:29:16,  8.08s/it]
  2%|▏         | 788/37963 [2:03:08<82:35:10,  8.00s/it]
  2%|▏         | 789/37963 [2:03:16<82:47:53,  8.02s/it]
  2%|▏         | 790/37963 [2:03:24<82:50:47,  8.02s/it]
                                                        
{'loss': '0.184', 'grad_norm': '4.966', 'learning_rate': '1.385e-05', 'epoch': '0.02081'}
+
  2%|▏         | 790/37963 [2:03:24<82:50:47,  8.02s/it]
  2%|▏         | 791/37963 [2:03:32<82:37:01,  8.00s/it]
  2%|▏         | 792/37963 [2:03:40<82:27:30,  7.99s/it]
  2%|▏         | 793/37963 [2:03:48<82:26:10,  7.98s/it]
  2%|▏         | 794/37963 [2:03:56<82:29:01,  7.99s/it]
  2%|▏         | 795/37963 [2:04:04<81:52:53,  7.93s/it]
  2%|▏         | 796/37963 [2:04:12<81:57:48,  7.94s/it]
  2%|▏         | 797/37963 [2:04:19<81:54:48,  7.93s/it]
  2%|▏         | 798/37963 [2:04:27<82:06:41,  7.95s/it]
  2%|▏         | 799/37963 [2:04:35<82:07:19,  7.95s/it]
  2%|▏         | 800/37963 [2:04:44<82:33:39,  8.00s/it]
                                                        
{'loss': '0.2134', 'grad_norm': '16.93', 'learning_rate': '1.403e-05', 'epoch': '0.02107'}
+
  2%|▏         | 800/37963 [2:04:44<82:33:39,  8.00s/it]
  2%|▏         | 801/37963 [2:04:51<82:27:48,  7.99s/it]
  2%|▏         | 802/37963 [2:04:59<82:16:17,  7.97s/it]
  2%|▏         | 803/37963 [2:05:07<82:30:07,  7.99s/it]
  2%|▏         | 804/37963 [2:05:22<103:06:23,  9.99s/it]
  2%|▏         | 805/37963 [2:05:30<96:20:52,  9.33s/it] 
  2%|▏         | 806/37963 [2:05:38<92:50:27,  9.00s/it]
  2%|▏         | 807/37963 [2:05:46<90:32:25,  8.77s/it]
  2%|▏         | 808/37963 [2:05:55<89:03:49,  8.63s/it]
  2%|▏         | 809/37963 [2:06:03<87:51:21,  8.51s/it]
  2%|▏         | 810/37963 [2:06:18<107:56:56, 10.46s/it]
                                                         
{'loss': '0.1874', 'grad_norm': '4.542', 'learning_rate': '1.421e-05', 'epoch': '0.02134'}
+
  2%|▏         | 810/37963 [2:06:18<107:56:56, 10.46s/it]
  2%|▏         | 811/37963 [2:06:33<122:08:10, 11.83s/it]
  2%|▏         | 812/37963 [2:06:48<130:43:44, 12.67s/it]
  2%|▏         | 813/37963 [2:06:56<116:29:02, 11.29s/it]
  2%|▏         | 814/37963 [2:07:04<106:02:59, 10.28s/it]
  2%|▏         | 815/37963 [2:07:12<99:10:22,  9.61s/it] 
  2%|▏         | 816/37963 [2:07:20<94:55:37,  9.20s/it]
  2%|▏         | 817/37963 [2:07:34<111:28:55, 10.80s/it]
  2%|▏         | 818/37963 [2:07:42<101:31:34,  9.84s/it]
  2%|▏         | 819/37963 [2:07:50<95:59:53,  9.30s/it] 
  2%|▏         | 820/37963 [2:07:58<91:49:57,  8.90s/it]
                                                        
{'loss': '0.1853', 'grad_norm': '5.56', 'learning_rate': '1.438e-05', 'epoch': '0.0216'}
+
  2%|▏         | 820/37963 [2:07:58<91:49:57,  8.90s/it]
  2%|▏         | 821/37963 [2:08:06<89:00:29,  8.63s/it]
  2%|▏         | 822/37963 [2:08:14<87:35:07,  8.49s/it]
  2%|▏         | 823/37963 [2:08:22<87:05:23,  8.44s/it]
  2%|▏         | 824/37963 [2:08:31<85:57:07,  8.33s/it]
  2%|▏         | 825/37963 [2:08:39<85:06:58,  8.25s/it]
  2%|▏         | 826/37963 [2:08:53<105:13:26, 10.20s/it]
  2%|▏         | 827/37963 [2:09:08<119:25:04, 11.58s/it]
  2%|▏         | 828/37963 [2:09:16<108:10:45, 10.49s/it]
  2%|▏         | 829/37963 [2:09:31<120:28:23, 11.68s/it]
  2%|▏         | 830/37963 [2:09:39<110:10:43, 10.68s/it]
                                                         
{'loss': '0.1904', 'grad_norm': '3.768', 'learning_rate': '1.456e-05', 'epoch': '0.02186'}
+
  2%|▏         | 830/37963 [2:09:39<110:10:43, 10.68s/it]
  2%|▏         | 831/37963 [2:09:47<102:16:53,  9.92s/it]
  2%|▏         | 832/37963 [2:09:55<97:01:49,  9.41s/it] 
  2%|▏         | 833/37963 [2:10:04<93:27:07,  9.06s/it]
  2%|▏         | 834/37963 [2:10:12<90:40:52,  8.79s/it]
  2%|▏         | 835/37963 [2:10:20<88:40:16,  8.60s/it]
  2%|▏         | 836/37963 [2:10:28<87:05:39,  8.45s/it]
  2%|▏         | 837/37963 [2:10:36<86:03:32,  8.34s/it]
  2%|▏         | 838/37963 [2:10:44<85:11:32,  8.26s/it]
  2%|▏         | 839/37963 [2:10:52<84:35:24,  8.20s/it]
  2%|▏         | 840/37963 [2:11:00<83:51:01,  8.13s/it]
                                                        
{'loss': '0.1874', 'grad_norm': '4.451', 'learning_rate': '1.473e-05', 'epoch': '0.02213'}
+
  2%|▏         | 840/37963 [2:11:00<83:51:01,  8.13s/it]
  2%|▏         | 841/37963 [2:11:08<84:22:16,  8.18s/it]
  2%|▏         | 842/37963 [2:11:17<84:34:32,  8.20s/it]
  2%|▏         | 843/37963 [2:11:25<84:02:45,  8.15s/it]
  2%|▏         | 844/37963 [2:11:33<83:20:48,  8.08s/it]
  2%|▏         | 845/37963 [2:11:40<82:28:40,  8.00s/it]
  2%|▏         | 846/37963 [2:11:49<83:03:45,  8.06s/it]
  2%|▏         | 847/37963 [2:11:57<82:34:04,  8.01s/it]
  2%|▏         | 848/37963 [2:12:05<82:32:49,  8.01s/it]
  2%|▏         | 849/37963 [2:12:12<82:18:30,  7.98s/it]
  2%|▏         | 850/37963 [2:12:21<83:17:59,  8.08s/it]
                                                        
{'loss': '0.1887', 'grad_norm': '5.411', 'learning_rate': '1.491e-05', 'epoch': '0.02239'}
+
  2%|▏         | 850/37963 [2:12:21<83:17:59,  8.08s/it]
  2%|▏         | 851/37963 [2:12:35<103:23:32, 10.03s/it]
  2%|▏         | 852/37963 [2:12:43<97:19:48,  9.44s/it] 
  2%|▏         | 853/37963 [2:12:51<92:36:57,  8.98s/it]
  2%|▏         | 854/37963 [2:12:59<90:07:55,  8.74s/it]
  2%|▏         | 855/37963 [2:13:08<88:09:29,  8.55s/it]
  2%|▏         | 856/37963 [2:13:16<86:49:42,  8.42s/it]
  2%|▏         | 857/37963 [2:13:31<106:48:38, 10.36s/it]
  2%|▏         | 858/37963 [2:13:49<130:52:12, 12.70s/it]
  2%|▏         | 859/37963 [2:14:03<136:12:44, 13.22s/it]
  2%|▏         | 860/37963 [2:14:11<120:16:50, 11.67s/it]
                                                         
{'loss': '0.1819', 'grad_norm': '4.494', 'learning_rate': '1.508e-05', 'epoch': '0.02265'}
+
  2%|▏         | 860/37963 [2:14:11<120:16:50, 11.67s/it]
  2%|▏         | 861/37963 [2:14:19<109:14:42, 10.60s/it]
  2%|▏         | 862/37963 [2:14:27<101:22:17,  9.84s/it]
  2%|▏         | 863/37963 [2:14:35<95:39:26,  9.28s/it] 
  2%|▏         | 864/37963 [2:14:44<92:23:04,  8.96s/it]
  2%|▏         | 865/37963 [2:14:52<90:02:22,  8.74s/it]
  2%|▏         | 866/37963 [2:15:00<88:25:26,  8.58s/it]
  2%|▏         | 867/37963 [2:15:15<107:09:59, 10.40s/it]
  2%|▏         | 868/37963 [2:15:23<99:58:47,  9.70s/it] 
  2%|▏         | 869/37963 [2:15:31<94:22:48,  9.16s/it]
  2%|▏         | 870/37963 [2:15:45<110:17:35, 10.70s/it]
                                                         
{'loss': '0.19', 'grad_norm': '5.467', 'learning_rate': '1.526e-05', 'epoch': '0.02292'}
+
  2%|▏         | 870/37963 [2:15:45<110:17:35, 10.70s/it]
  2%|▏         | 871/37963 [2:15:53<102:58:09,  9.99s/it]
  2%|▏         | 872/37963 [2:16:02<97:40:49,  9.48s/it] 
  2%|▏         | 873/37963 [2:16:10<93:33:14,  9.08s/it]
  2%|▏         | 874/37963 [2:16:24<110:00:30, 10.68s/it]
  2%|▏         | 875/37963 [2:16:32<101:49:09,  9.88s/it]
  2%|▏         | 876/37963 [2:16:40<96:05:43,  9.33s/it] 
  2%|▏         | 877/37963 [2:16:48<91:37:24,  8.89s/it]
  2%|▏         | 878/37963 [2:16:56<89:41:35,  8.71s/it]
  2%|▏         | 879/37963 [2:17:04<87:35:54,  8.50s/it]
  2%|▏         | 880/37963 [2:17:13<86:47:31,  8.43s/it]
                                                        
{'loss': '0.1979', 'grad_norm': '4.836', 'learning_rate': '1.543e-05', 'epoch': '0.02318'}
+
  2%|▏         | 880/37963 [2:17:13<86:47:31,  8.43s/it]
  2%|▏         | 881/37963 [2:17:21<85:44:44,  8.32s/it]
  2%|▏         | 882/37963 [2:17:29<85:28:11,  8.30s/it]
  2%|▏         | 883/37963 [2:17:44<106:06:56, 10.30s/it]
  2%|▏         | 884/37963 [2:17:52<99:24:37,  9.65s/it] 
  2%|▏         | 885/37963 [2:18:00<94:49:46,  9.21s/it]
  2%|▏         | 886/37963 [2:18:08<91:55:27,  8.93s/it]
  2%|▏         | 887/37963 [2:18:17<89:27:01,  8.69s/it]
  2%|▏         | 888/37963 [2:18:25<88:00:31,  8.55s/it]
  2%|▏         | 889/37963 [2:18:33<86:03:35,  8.36s/it]
  2%|▏         | 890/37963 [2:18:41<85:08:18,  8.27s/it]
                                                        
{'loss': '0.1796', 'grad_norm': '4.793', 'learning_rate': '1.561e-05', 'epoch': '0.02344'}
+
  2%|▏         | 890/37963 [2:18:41<85:08:18,  8.27s/it]
  2%|▏         | 891/37963 [2:18:49<85:23:32,  8.29s/it]
  2%|▏         | 892/37963 [2:18:57<83:41:14,  8.13s/it]
  2%|▏         | 893/37963 [2:19:05<83:56:51,  8.15s/it]
  2%|▏         | 894/37963 [2:19:13<83:46:48,  8.14s/it]
  2%|▏         | 895/37963 [2:19:21<84:08:00,  8.17s/it]
  2%|▏         | 896/37963 [2:19:29<83:37:58,  8.12s/it]
  2%|▏         | 897/37963 [2:19:46<109:15:24, 10.61s/it]
  2%|▏         | 898/37963 [2:19:54<101:45:21,  9.88s/it]
  2%|▏         | 899/37963 [2:20:02<96:06:31,  9.33s/it] 
  2%|▏         | 900/37963 [2:20:10<92:03:14,  8.94s/it]
                                                        
{'loss': '0.1767', 'grad_norm': '4.37', 'learning_rate': '1.579e-05', 'epoch': '0.02371'}
+
  2%|▏         | 900/37963 [2:20:10<92:03:14,  8.94s/it]
  2%|▏         | 901/37963 [2:20:18<88:33:05,  8.60s/it]
  2%|▏         | 902/37963 [2:20:26<86:48:00,  8.43s/it]
  2%|▏         | 903/37963 [2:20:34<84:56:54,  8.25s/it]
  2%|▏         | 904/37963 [2:20:42<84:27:22,  8.20s/it]
  2%|▏         | 905/37963 [2:20:59<113:01:54, 10.98s/it]
  2%|▏         | 906/37963 [2:21:08<104:27:17, 10.15s/it]
  2%|▏         | 907/37963 [2:21:23<119:13:03, 11.58s/it]
  2%|▏         | 908/37963 [2:21:37<127:54:56, 12.43s/it]
  2%|▏         | 909/37963 [2:21:44<112:50:06, 10.96s/it]
  2%|▏         | 910/37963 [2:21:52<103:26:25, 10.05s/it]
                                                         
{'loss': '0.1922', 'grad_norm': '2.758', 'learning_rate': '1.596e-05', 'epoch': '0.02397'}
+
  2%|▏         | 910/37963 [2:21:52<103:26:25, 10.05s/it]
  2%|▏         | 911/37963 [2:22:00<96:20:08,  9.36s/it] 
  2%|▏         | 912/37963 [2:22:08<91:29:31,  8.89s/it]
  2%|▏         | 913/37963 [2:22:16<88:37:08,  8.61s/it]
  2%|▏         | 914/37963 [2:22:24<86:42:28,  8.43s/it]
  2%|▏         | 915/37963 [2:22:39<106:19:38, 10.33s/it]
  2%|▏         | 916/37963 [2:22:47<99:12:15,  9.64s/it] 
  2%|▏         | 917/37963 [2:22:55<94:06:49,  9.15s/it]
  2%|▏         | 918/37963 [2:23:09<110:54:27, 10.78s/it]
  2%|▏         | 919/37963 [2:23:17<102:19:51,  9.94s/it]
  2%|▏         | 920/37963 [2:23:32<116:25:59, 11.32s/it]
                                                         
{'loss': '0.1934', 'grad_norm': '10.94', 'learning_rate': '1.614e-05', 'epoch': '0.02423'}
+
  2%|▏         | 920/37963 [2:23:32<116:25:59, 11.32s/it]
  2%|▏         | 921/37963 [2:23:40<105:45:04, 10.28s/it]
  2%|▏         | 922/37963 [2:23:48<98:40:40,  9.59s/it] 
  2%|▏         | 923/37963 [2:23:56<94:07:11,  9.15s/it]
  2%|▏         | 924/37963 [2:24:04<90:43:01,  8.82s/it]
  2%|▏         | 925/37963 [2:24:12<88:32:13,  8.61s/it]
  2%|▏         | 926/37963 [2:24:20<86:38:27,  8.42s/it]
  2%|▏         | 927/37963 [2:24:28<85:41:53,  8.33s/it]
  2%|▏         | 928/37963 [2:24:36<84:03:13,  8.17s/it]
  2%|▏         | 929/37963 [2:24:44<83:43:56,  8.14s/it]
  2%|▏         | 930/37963 [2:24:59<104:21:01, 10.14s/it]
                                                         
{'loss': '0.1967', 'grad_norm': '4.192', 'learning_rate': '1.631e-05', 'epoch': '0.0245'}
+
  2%|▏         | 930/37963 [2:24:59<104:21:01, 10.14s/it]
  2%|▏         | 931/37963 [2:25:07<98:00:24,  9.53s/it] 
  2%|▏         | 932/37963 [2:25:15<93:16:33,  9.07s/it]
  2%|▏         | 933/37963 [2:25:23<90:07:17,  8.76s/it]
  2%|▏         | 934/37963 [2:25:31<87:53:03,  8.54s/it]
  2%|▏         | 935/37963 [2:25:39<86:33:55,  8.42s/it]
  2%|▏         | 936/37963 [2:25:47<86:26:55,  8.41s/it]
  2%|▏         | 937/37963 [2:25:55<84:30:09,  8.22s/it]
  2%|▏         | 938/37963 [2:26:03<84:27:36,  8.21s/it]
  2%|▏         | 939/37963 [2:26:12<84:44:29,  8.24s/it]
  2%|▏         | 940/37963 [2:26:20<85:10:53,  8.28s/it]
                                                        
{'loss': '0.1832', 'grad_norm': '3.848', 'learning_rate': '1.649e-05', 'epoch': '0.02476'}
+
  2%|▏         | 940/37963 [2:26:20<85:10:53,  8.28s/it]
  2%|▏         | 941/37963 [2:26:28<85:03:47,  8.27s/it]
  2%|▏         | 942/37963 [2:26:37<85:01:32,  8.27s/it]
  2%|▏         | 943/37963 [2:26:45<84:37:47,  8.23s/it]
  2%|▏         | 944/37963 [2:26:53<84:45:15,  8.24s/it]
  2%|▏         | 945/37963 [2:27:08<104:21:27, 10.15s/it]
  2%|▏         | 946/37963 [2:27:16<97:51:59,  9.52s/it] 
  2%|▏         | 947/37963 [2:27:23<92:26:36,  8.99s/it]
  2%|▏         | 948/37963 [2:27:31<89:16:57,  8.68s/it]
  2%|▏         | 949/37963 [2:27:39<87:00:07,  8.46s/it]
  3%|▎         | 950/37963 [2:27:47<85:05:50,  8.28s/it]
                                                        
{'loss': '0.176', 'grad_norm': '3.764', 'learning_rate': '1.666e-05', 'epoch': '0.02502'}
+
  3%|▎         | 950/37963 [2:27:47<85:05:50,  8.28s/it]
  3%|▎         | 951/37963 [2:27:55<83:50:05,  8.15s/it]
  3%|▎         | 952/37963 [2:28:03<83:43:30,  8.14s/it]
  3%|▎         | 953/37963 [2:28:25<125:46:35, 12.23s/it]
  3%|▎         | 954/37963 [2:28:33<112:20:23, 10.93s/it]
  3%|▎         | 955/37963 [2:28:47<122:42:32, 11.94s/it]
  3%|▎         | 956/37963 [2:28:55<111:08:14, 10.81s/it]
  3%|▎         | 957/37963 [2:29:03<102:06:24,  9.93s/it]
  3%|▎         | 958/37963 [2:29:11<96:00:39,  9.34s/it] 
  3%|▎         | 959/37963 [2:29:19<91:49:56,  8.93s/it]
  3%|▎         | 960/37963 [2:29:27<89:25:19,  8.70s/it]
                                                        
{'loss': '0.1843', 'grad_norm': '4.13', 'learning_rate': '1.684e-05', 'epoch': '0.02529'}
+
  3%|▎         | 960/37963 [2:29:27<89:25:19,  8.70s/it]
  3%|▎         | 961/37963 [2:29:36<88:30:20,  8.61s/it]
  3%|▎         | 962/37963 [2:30:00<138:28:27, 13.47s/it]
  3%|▎         | 963/37963 [2:30:09<122:20:10, 11.90s/it]
  3%|▎         | 964/37963 [2:30:17<111:12:39, 10.82s/it]
  3%|▎         | 965/37963 [2:30:25<103:06:38, 10.03s/it]
  3%|▎         | 966/37963 [2:30:33<97:15:16,  9.46s/it] 
  3%|▎         | 967/37963 [2:30:42<93:46:08,  9.12s/it]
  3%|▎         | 968/37963 [2:30:50<90:43:08,  8.83s/it]
  3%|▎         | 969/37963 [2:30:58<88:55:46,  8.65s/it]
  3%|▎         | 970/37963 [2:31:13<107:14:19, 10.44s/it]
                                                         
{'loss': '0.1745', 'grad_norm': '2.696', 'learning_rate': '1.701e-05', 'epoch': '0.02555'}
+
  3%|▎         | 970/37963 [2:31:13<107:14:19, 10.44s/it]
  3%|▎         | 971/37963 [2:31:21<99:48:19,  9.71s/it] 
  3%|▎         | 972/37963 [2:31:29<95:17:33,  9.27s/it]
  3%|▎         | 973/37963 [2:31:37<91:54:56,  8.95s/it]
  3%|▎         | 974/37963 [2:31:45<89:54:36,  8.75s/it]
  3%|▎         | 975/37963 [2:31:53<88:00:18,  8.57s/it]
  3%|▎         | 976/37963 [2:32:02<87:09:01,  8.48s/it]
  3%|▎         | 977/37963 [2:32:10<86:39:32,  8.43s/it]
  3%|▎         | 978/37963 [2:32:18<85:36:32,  8.33s/it]
  3%|▎         | 979/37963 [2:32:26<84:51:06,  8.26s/it]
  3%|▎         | 980/37963 [2:32:34<84:34:58,  8.23s/it]
                                                        
{'loss': '0.1969', 'grad_norm': '8.333', 'learning_rate': '1.719e-05', 'epoch': '0.02581'}
+
  3%|▎         | 980/37963 [2:32:34<84:34:58,  8.23s/it]
  3%|▎         | 981/37963 [2:32:43<84:31:18,  8.23s/it]
  3%|▎         | 982/37963 [2:32:51<84:27:17,  8.22s/it]
  3%|▎         | 983/37963 [2:33:06<104:16:22, 10.15s/it]
  3%|▎         | 984/37963 [2:33:13<96:52:35,  9.43s/it] 
  3%|▎         | 985/37963 [2:33:21<92:49:53,  9.04s/it]
  3%|▎         | 986/37963 [2:33:29<89:49:57,  8.75s/it]
  3%|▎         | 987/37963 [2:33:38<87:59:56,  8.57s/it]
  3%|▎         | 988/37963 [2:33:46<86:58:51,  8.47s/it]
  3%|▎         | 989/37963 [2:33:54<85:08:57,  8.29s/it]
  3%|▎         | 990/37963 [2:34:02<85:02:20,  8.28s/it]
                                                        
{'loss': '0.1865', 'grad_norm': '3.952', 'learning_rate': '1.737e-05', 'epoch': '0.02608'}
+
  3%|▎         | 990/37963 [2:34:02<85:02:20,  8.28s/it]
  3%|▎         | 991/37963 [2:34:10<84:31:08,  8.23s/it]
  3%|▎         | 992/37963 [2:34:18<84:16:51,  8.21s/it]
  3%|▎         | 993/37963 [2:34:27<84:33:54,  8.23s/it]
  3%|▎         | 994/37963 [2:34:41<104:52:32, 10.21s/it]
  3%|▎         | 995/37963 [2:34:50<99:17:41,  9.67s/it] 
  3%|▎         | 996/37963 [2:34:58<94:44:42,  9.23s/it]
  3%|▎         | 997/37963 [2:35:13<111:53:33, 10.90s/it]
  3%|▎         | 998/37963 [2:35:21<104:29:05, 10.18s/it]
  3%|▎         | 999/37963 [2:35:30<98:43:15,  9.61s/it] 
  3%|▎         | 1000/37963 [2:35:38<94:41:31,  9.22s/it]
                                                         
{'loss': '0.195', 'grad_norm': '7.211', 'learning_rate': '1.754e-05', 'epoch': '0.02634'}
+
  3%|▎         | 1000/37963 [2:35:38<94:41:31,  9.22s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:11<00:00, 11.36s/it]
Writing model shards: 100%|██████████| 1/1 [00:11<00:00, 11.36s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
  3%|▎         | 1001/37963 [2:36:36<244:50:25, 23.85s/it]
  3%|▎         | 1002/37963 [2:36:44<196:18:35, 19.12s/it]
  3%|▎         | 1003/37963 [2:36:52<161:45:09, 15.76s/it]
  3%|▎         | 1004/37963 [2:37:07<159:56:52, 15.58s/it]
  3%|▎         | 1005/37963 [2:37:15<136:52:45, 13.33s/it]
  3%|▎         | 1006/37963 [2:37:23<120:10:57, 11.71s/it]
  3%|▎         | 1007/37963 [2:37:31<108:14:35, 10.54s/it]
  3%|▎         | 1008/37963 [2:37:45<120:17:22, 11.72s/it]
  3%|▎         | 1009/37963 [2:37:53<109:16:16, 10.65s/it]
  3%|▎         | 1010/37963 [2:38:01<100:25:22,  9.78s/it]
                                                          
{'loss': '0.1977', 'grad_norm': '5.301', 'learning_rate': '1.772e-05', 'epoch': '0.0266'}
+
  3%|▎         | 1010/37963 [2:38:01<100:25:22,  9.78s/it]
  3%|▎         | 1011/37963 [2:38:09<94:11:30,  9.18s/it] 
  3%|▎         | 1012/37963 [2:38:26<117:32:21, 11.45s/it]
  3%|▎         | 1013/37963 [2:38:34<106:16:49, 10.35s/it]
  3%|▎         | 1014/37963 [2:38:50<126:36:48, 12.34s/it]
  3%|▎         | 1015/37963 [2:38:58<112:34:06, 10.97s/it]
  3%|▎         | 1016/37963 [2:39:06<102:45:22, 10.01s/it]
  3%|▎         | 1017/37963 [2:39:14<95:46:56,  9.33s/it] 
  3%|▎         | 1018/37963 [2:39:28<110:24:01, 10.76s/it]
  3%|▎         | 1019/37963 [2:39:36<101:25:30,  9.88s/it]
  3%|▎         | 1020/37963 [2:39:43<94:53:46,  9.25s/it] 
                                                         
{'loss': '0.1955', 'grad_norm': '5.971', 'learning_rate': '1.789e-05', 'epoch': '0.02687'}
+
  3%|▎         | 1020/37963 [2:39:43<94:53:46,  9.25s/it]
  3%|▎         | 1021/37963 [2:39:51<90:29:19,  8.82s/it]
  3%|▎         | 1022/37963 [2:39:59<86:55:14,  8.47s/it]
  3%|▎         | 1023/37963 [2:40:07<84:31:47,  8.24s/it]
  3%|▎         | 1024/37963 [2:40:14<82:30:23,  8.04s/it]
  3%|▎         | 1025/37963 [2:40:22<81:26:40,  7.94s/it]
  3%|▎         | 1026/37963 [2:40:30<80:58:51,  7.89s/it]
  3%|▎         | 1027/37963 [2:40:47<109:44:34, 10.70s/it]
  3%|▎         | 1028/37963 [2:40:55<100:20:39,  9.78s/it]
  3%|▎         | 1029/37963 [2:41:02<94:00:52,  9.16s/it] 
  3%|▎         | 1030/37963 [2:41:10<89:14:25,  8.70s/it]
                                                         
{'loss': '0.177', 'grad_norm': '3.021', 'learning_rate': '1.807e-05', 'epoch': '0.02713'}
+
  3%|▎         | 1030/37963 [2:41:10<89:14:25,  8.70s/it]
  3%|▎         | 1031/37963 [2:41:18<86:29:23,  8.43s/it]
  3%|▎         | 1032/37963 [2:41:25<84:18:16,  8.22s/it]
  3%|▎         | 1033/37963 [2:41:33<82:26:16,  8.04s/it]
  3%|▎         | 1034/37963 [2:41:41<81:56:17,  7.99s/it]
  3%|▎         | 1035/37963 [2:41:49<81:30:47,  7.95s/it]
  3%|▎         | 1036/37963 [2:41:56<80:11:26,  7.82s/it]
  3%|▎         | 1037/37963 [2:42:04<79:50:06,  7.78s/it]
  3%|▎         | 1038/37963 [2:42:12<78:56:26,  7.70s/it]
  3%|▎         | 1039/37963 [2:42:19<78:56:55,  7.70s/it]
  3%|▎         | 1040/37963 [2:42:27<79:00:30,  7.70s/it]
                                                         
{'loss': '0.1899', 'grad_norm': '3.623', 'learning_rate': '1.824e-05', 'epoch': '0.0274'}
+
  3%|▎         | 1040/37963 [2:42:27<79:00:30,  7.70s/it]
  3%|▎         | 1041/37963 [2:42:35<79:06:42,  7.71s/it]
  3%|▎         | 1042/37963 [2:42:42<79:06:15,  7.71s/it]
  3%|▎         | 1043/37963 [2:42:57<99:12:40,  9.67s/it]
  3%|▎         | 1044/37963 [2:43:04<92:54:19,  9.06s/it]
  3%|▎         | 1045/37963 [2:43:12<88:12:46,  8.60s/it]
  3%|▎         | 1046/37963 [2:43:26<104:16:55, 10.17s/it]
  3%|▎         | 1047/37963 [2:43:33<96:27:01,  9.41s/it] 
  3%|▎         | 1048/37963 [2:43:41<91:05:32,  8.88s/it]
  3%|▎         | 1049/37963 [2:43:49<87:50:05,  8.57s/it]
  3%|▎         | 1050/37963 [2:43:56<85:07:14,  8.30s/it]
                                                         
{'loss': '0.1803', 'grad_norm': '4.988', 'learning_rate': '1.842e-05', 'epoch': '0.02766'}
+
  3%|▎         | 1050/37963 [2:43:56<85:07:14,  8.30s/it]
  3%|▎         | 1051/37963 [2:44:11<103:39:15, 10.11s/it]
  3%|▎         | 1052/37963 [2:44:18<96:02:06,  9.37s/it] 
  3%|▎         | 1053/37963 [2:44:26<90:59:13,  8.87s/it]
  3%|▎         | 1054/37963 [2:44:34<87:30:40,  8.54s/it]
  3%|▎         | 1055/37963 [2:44:42<84:56:35,  8.29s/it]
  3%|▎         | 1056/37963 [2:44:56<103:38:31, 10.11s/it]
  3%|▎         | 1057/37963 [2:45:04<96:15:23,  9.39s/it] 
  3%|▎         | 1058/37963 [2:45:20<117:40:28, 11.48s/it]
  3%|▎         | 1059/37963 [2:45:28<106:02:14, 10.34s/it]
  3%|▎         | 1060/37963 [2:45:35<97:45:41,  9.54s/it] 
                                                         
{'loss': '0.1951', 'grad_norm': '4.392', 'learning_rate': '1.86e-05', 'epoch': '0.02792'}
+
  3%|▎         | 1060/37963 [2:45:35<97:45:41,  9.54s/it]
  3%|▎         | 1061/37963 [2:45:51<116:03:18, 11.32s/it]
  3%|▎         | 1062/37963 [2:45:59<105:03:00, 10.25s/it]
  3%|▎         | 1063/37963 [2:46:06<96:17:44,  9.39s/it] 
  3%|▎         | 1064/37963 [2:46:14<91:12:36,  8.90s/it]
  3%|▎         | 1065/37963 [2:46:21<86:45:47,  8.47s/it]
  3%|▎         | 1066/37963 [2:46:29<84:28:10,  8.24s/it]
  3%|▎         | 1067/37963 [2:46:36<81:29:28,  7.95s/it]
  3%|▎         | 1068/37963 [2:46:44<80:10:32,  7.82s/it]
  3%|▎         | 1069/37963 [2:46:51<80:06:30,  7.82s/it]
  3%|▎         | 1070/37963 [2:46:59<79:14:23,  7.73s/it]
                                                         
{'loss': '0.1786', 'grad_norm': '3.946', 'learning_rate': '1.877e-05', 'epoch': '0.02819'}
+
  3%|▎         | 1070/37963 [2:46:59<79:14:23,  7.73s/it]
  3%|▎         | 1071/37963 [2:47:14<102:13:08,  9.97s/it]
  3%|▎         | 1072/37963 [2:47:22<95:54:07,  9.36s/it] 
  3%|▎         | 1073/37963 [2:47:36<110:43:13, 10.80s/it]
  3%|▎         | 1074/37963 [2:47:44<101:06:27,  9.87s/it]
  3%|▎         | 1075/37963 [2:47:52<94:41:24,  9.24s/it] 
  3%|▎         | 1076/37963 [2:47:59<89:55:52,  8.78s/it]
  3%|▎         | 1077/37963 [2:48:07<86:34:31,  8.45s/it]
  3%|▎         | 1078/37963 [2:48:15<84:07:41,  8.21s/it]
  3%|▎         | 1079/37963 [2:48:23<82:33:43,  8.06s/it]
  3%|▎         | 1080/37963 [2:48:30<81:22:36,  7.94s/it]
                                                         
{'loss': '0.2005', 'grad_norm': '2.562', 'learning_rate': '1.895e-05', 'epoch': '0.02845'}
+
  3%|▎         | 1080/37963 [2:48:30<81:22:36,  7.94s/it]
  3%|▎         | 1081/37963 [2:48:37<79:20:57,  7.75s/it]
  3%|▎         | 1082/37963 [2:48:45<79:08:23,  7.72s/it]
  3%|▎         | 1083/37963 [2:48:53<79:27:57,  7.76s/it]
  3%|▎         | 1084/37963 [2:49:01<79:00:15,  7.71s/it]
  3%|▎         | 1085/37963 [2:49:08<78:21:49,  7.65s/it]
  3%|▎         | 1086/37963 [2:49:16<78:41:28,  7.68s/it]
  3%|▎         | 1087/37963 [2:49:23<78:31:22,  7.67s/it]
  3%|▎         | 1088/37963 [2:49:31<78:24:14,  7.65s/it]
  3%|▎         | 1089/37963 [2:49:39<78:22:46,  7.65s/it]
  3%|▎         | 1090/37963 [2:49:46<77:14:29,  7.54s/it]
                                                         
{'loss': '0.1963', 'grad_norm': '7.076', 'learning_rate': '1.912e-05', 'epoch': '0.02871'}
+
  3%|▎         | 1090/37963 [2:49:46<77:14:29,  7.54s/it]
  3%|▎         | 1091/37963 [2:49:53<76:54:50,  7.51s/it]
  3%|▎         | 1092/37963 [2:50:01<77:15:09,  7.54s/it]
  3%|▎         | 1093/37963 [2:50:09<77:42:30,  7.59s/it]
  3%|▎         | 1094/37963 [2:50:16<77:53:27,  7.61s/it]
  3%|▎         | 1095/37963 [2:50:30<97:24:33,  9.51s/it]
  3%|▎         | 1096/37963 [2:50:38<91:37:12,  8.95s/it]
  3%|▎         | 1097/37963 [2:50:52<108:02:21, 10.55s/it]
  3%|▎         | 1098/37963 [2:51:00<98:53:36,  9.66s/it] 
  3%|▎         | 1099/37963 [2:51:08<93:01:52,  9.09s/it]
  3%|▎         | 1100/37963 [2:51:15<88:36:46,  8.65s/it]
                                                         
{'loss': '0.1849', 'grad_norm': '3.34', 'learning_rate': '1.93e-05', 'epoch': '0.02898'}
+
  3%|▎         | 1100/37963 [2:51:15<88:36:46,  8.65s/it]
  3%|▎         | 1101/37963 [2:51:23<85:24:57,  8.34s/it]
  3%|▎         | 1102/37963 [2:51:30<82:55:36,  8.10s/it]
  3%|▎         | 1103/37963 [2:51:38<81:56:36,  8.00s/it]
  3%|▎         | 1104/37963 [2:51:46<80:56:44,  7.91s/it]
  3%|▎         | 1105/37963 [2:52:07<121:29:28, 11.87s/it]
  3%|▎         | 1106/37963 [2:52:22<132:10:25, 12.91s/it]
  3%|▎         | 1107/37963 [2:52:30<116:17:07, 11.36s/it]
  3%|▎         | 1108/37963 [2:52:38<105:03:32, 10.26s/it]
  3%|▎         | 1109/37963 [2:52:45<96:16:42,  9.40s/it] 
  3%|▎         | 1110/37963 [2:52:53<90:39:51,  8.86s/it]
                                                         
{'loss': '0.1944', 'grad_norm': '4.309', 'learning_rate': '1.947e-05', 'epoch': '0.02924'}
+
  3%|▎         | 1110/37963 [2:52:53<90:39:51,  8.86s/it]
  3%|▎         | 1111/37963 [2:53:01<87:27:00,  8.54s/it]
  3%|▎         | 1112/37963 [2:53:08<84:52:28,  8.29s/it]
  3%|▎         | 1113/37963 [2:53:16<82:49:01,  8.09s/it]
  3%|▎         | 1114/37963 [2:53:24<81:45:00,  7.99s/it]
  3%|▎         | 1115/37963 [2:53:31<80:38:12,  7.88s/it]
  3%|▎         | 1116/37963 [2:53:46<103:08:12, 10.08s/it]
  3%|▎         | 1117/37963 [2:53:54<96:11:15,  9.40s/it] 
  3%|▎         | 1118/37963 [2:54:02<91:12:42,  8.91s/it]
  3%|▎         | 1119/37963 [2:54:10<87:28:30,  8.55s/it]
  3%|▎         | 1120/37963 [2:54:18<85:04:45,  8.31s/it]
                                                         
{'loss': '0.1806', 'grad_norm': '4.276', 'learning_rate': '1.965e-05', 'epoch': '0.0295'}
+
  3%|▎         | 1120/37963 [2:54:18<85:04:45,  8.31s/it]
  3%|▎         | 1121/37963 [2:54:25<82:56:50,  8.11s/it]
  3%|▎         | 1122/37963 [2:54:33<82:01:53,  8.02s/it]
  3%|▎         | 1123/37963 [2:54:48<102:50:56, 10.05s/it]
  3%|▎         | 1124/37963 [2:54:56<95:55:30,  9.37s/it] 
  3%|▎         | 1125/37963 [2:55:03<90:11:06,  8.81s/it]
  3%|▎         | 1126/37963 [2:55:10<85:49:14,  8.39s/it]
  3%|▎         | 1127/37963 [2:55:24<102:37:52, 10.03s/it]
  3%|▎         | 1128/37963 [2:55:32<95:28:41,  9.33s/it] 
  3%|▎         | 1129/37963 [2:55:40<90:25:18,  8.84s/it]
  3%|▎         | 1130/37963 [2:55:47<86:53:54,  8.49s/it]
                                                         
{'loss': '0.1821', 'grad_norm': '5.688', 'learning_rate': '1.982e-05', 'epoch': '0.02977'}
+
  3%|▎         | 1130/37963 [2:55:47<86:53:54,  8.49s/it]
  3%|▎         | 1131/37963 [2:55:55<83:47:19,  8.19s/it]
  3%|▎         | 1132/37963 [2:56:02<81:21:36,  7.95s/it]
  3%|▎         | 1133/37963 [2:56:10<80:29:09,  7.87s/it]
  3%|▎         | 1134/37963 [2:56:18<79:54:00,  7.81s/it]
  3%|▎         | 1135/37963 [2:56:25<79:31:39,  7.77s/it]
  3%|▎         | 1136/37963 [2:56:33<78:55:57,  7.72s/it]
  3%|▎         | 1137/37963 [2:56:40<78:31:24,  7.68s/it]
  3%|▎         | 1138/37963 [2:56:48<78:40:30,  7.69s/it]
  3%|▎         | 1139/37963 [2:56:56<78:27:10,  7.67s/it]
  3%|▎         | 1140/37963 [2:57:04<78:39:34,  7.69s/it]
                                                         
{'loss': '0.1869', 'grad_norm': '3.561', 'learning_rate': '2e-05', 'epoch': '0.03003'}
+
  3%|▎         | 1140/37963 [2:57:04<78:39:34,  7.69s/it]
  3%|▎         | 1141/37963 [2:57:18<98:52:04,  9.67s/it]
  3%|▎         | 1142/37963 [2:57:26<93:07:58,  9.11s/it]
  3%|▎         | 1143/37963 [2:57:40<108:27:55, 10.60s/it]
  3%|▎         | 1144/37963 [2:57:48<99:47:03,  9.76s/it] 
  3%|▎         | 1145/37963 [2:57:55<92:50:44,  9.08s/it]
  3%|▎         | 1146/37963 [2:58:03<88:49:35,  8.69s/it]
  3%|▎         | 1147/37963 [2:58:10<85:35:12,  8.37s/it]
  3%|▎         | 1148/37963 [2:58:25<103:51:26, 10.16s/it]
  3%|▎         | 1149/37963 [2:58:32<96:20:50,  9.42s/it] 
  3%|▎         | 1150/37963 [2:58:40<90:47:02,  8.88s/it]
                                                         
{'loss': '0.1866', 'grad_norm': '7.692', 'learning_rate': '2e-05', 'epoch': '0.03029'}
+
  3%|▎         | 1150/37963 [2:58:40<90:47:02,  8.88s/it]
  3%|▎         | 1151/37963 [2:58:48<87:16:53,  8.54s/it]
  3%|▎         | 1152/37963 [2:59:02<105:42:04, 10.34s/it]
  3%|▎         | 1153/37963 [2:59:16<117:12:31, 11.46s/it]
  3%|▎         | 1154/37963 [2:59:24<104:49:21, 10.25s/it]
  3%|▎         | 1155/37963 [2:59:32<96:52:15,  9.47s/it] 
  3%|▎         | 1156/37963 [2:59:39<91:06:37,  8.91s/it]
  3%|▎         | 1157/37963 [2:59:47<87:10:44,  8.53s/it]
  3%|▎         | 1158/37963 [2:59:54<84:35:23,  8.27s/it]
  3%|▎         | 1159/37963 [3:00:02<81:40:16,  7.99s/it]
  3%|▎         | 1160/37963 [3:00:09<80:30:45,  7.88s/it]
                                                         
{'loss': '0.1817', 'grad_norm': '6.012', 'learning_rate': '2e-05', 'epoch': '0.03056'}
+
  3%|▎         | 1160/37963 [3:00:09<80:30:45,  7.88s/it]
  3%|▎         | 1161/37963 [3:00:17<80:20:06,  7.86s/it]
  3%|▎         | 1162/37963 [3:00:25<79:11:01,  7.75s/it]
  3%|▎         | 1163/37963 [3:00:32<79:02:22,  7.73s/it]
  3%|▎         | 1164/37963 [3:00:40<78:52:23,  7.72s/it]
  3%|▎         | 1165/37963 [3:00:48<79:02:29,  7.73s/it]
  3%|▎         | 1166/37963 [3:00:55<78:11:40,  7.65s/it]
  3%|▎         | 1167/37963 [3:01:10<100:43:20,  9.85s/it]
  3%|▎         | 1168/37963 [3:01:18<94:53:22,  9.28s/it] 
  3%|▎         | 1169/37963 [3:01:26<89:25:54,  8.75s/it]
  3%|▎         | 1170/37963 [3:01:33<85:43:04,  8.39s/it]
                                                         
{'loss': '0.1883', 'grad_norm': '3.348', 'learning_rate': '2e-05', 'epoch': '0.03082'}
+
  3%|▎         | 1170/37963 [3:01:33<85:43:04,  8.39s/it]
  3%|▎         | 1171/37963 [3:01:41<83:45:33,  8.20s/it]
  3%|▎         | 1172/37963 [3:01:49<81:55:24,  8.02s/it]
  3%|▎         | 1173/37963 [3:01:56<80:20:39,  7.86s/it]
  3%|▎         | 1174/37963 [3:02:04<80:17:35,  7.86s/it]
  3%|▎         | 1175/37963 [3:02:11<79:16:28,  7.76s/it]
  3%|▎         | 1176/37963 [3:02:19<79:16:13,  7.76s/it]
  3%|▎         | 1177/37963 [3:02:34<100:44:11,  9.86s/it]
  3%|▎         | 1178/37963 [3:02:42<94:20:22,  9.23s/it] 
  3%|▎         | 1179/37963 [3:02:50<89:53:46,  8.80s/it]
  3%|▎         | 1180/37963 [3:02:57<86:45:34,  8.49s/it]
                                                         
{'loss': '0.1786', 'grad_norm': '3.827', 'learning_rate': '2e-05', 'epoch': '0.03108'}
+
  3%|▎         | 1180/37963 [3:02:57<86:45:34,  8.49s/it]
  3%|▎         | 1181/37963 [3:03:11<104:10:34, 10.20s/it]
  3%|▎         | 1182/37963 [3:03:19<96:26:47,  9.44s/it] 
  3%|▎         | 1183/37963 [3:03:27<90:39:28,  8.87s/it]
  3%|▎         | 1184/37963 [3:03:34<86:05:23,  8.43s/it]
  3%|▎         | 1185/37963 [3:03:42<83:25:16,  8.17s/it]
  3%|▎         | 1186/37963 [3:03:49<81:35:32,  7.99s/it]
  3%|▎         | 1187/37963 [3:04:03<100:37:38,  9.85s/it]
  3%|▎         | 1188/37963 [3:04:11<94:02:09,  9.21s/it] 
  3%|▎         | 1189/37963 [3:04:19<89:32:27,  8.77s/it]
  3%|▎         | 1190/37963 [3:04:27<86:20:17,  8.45s/it]
                                                         
{'loss': '0.1834', 'grad_norm': '6.101', 'learning_rate': '2e-05', 'epoch': '0.03135'}
+
  3%|▎         | 1190/37963 [3:04:27<86:20:17,  8.45s/it]
  3%|▎         | 1191/37963 [3:04:34<82:34:29,  8.08s/it]
  3%|▎         | 1192/37963 [3:04:42<81:30:06,  7.98s/it]
  3%|▎         | 1193/37963 [3:04:49<80:53:27,  7.92s/it]
  3%|▎         | 1194/37963 [3:04:57<80:11:22,  7.85s/it]
  3%|▎         | 1195/37963 [3:05:11<100:02:43,  9.80s/it]
  3%|▎         | 1196/37963 [3:05:26<114:39:04, 11.23s/it]
  3%|▎         | 1197/37963 [3:05:34<104:18:15, 10.21s/it]
  3%|▎         | 1198/37963 [3:05:41<96:25:19,  9.44s/it] 
  3%|▎         | 1199/37963 [3:05:49<91:44:04,  8.98s/it]
  3%|▎         | 1200/37963 [3:05:57<87:48:50,  8.60s/it]
                                                         
{'loss': '0.1732', 'grad_norm': '5.194', 'learning_rate': '2e-05', 'epoch': '0.03161'}
+
  3%|▎         | 1200/37963 [3:05:57<87:48:50,  8.60s/it]
  3%|▎         | 1201/37963 [3:06:11<103:16:26, 10.11s/it]
  3%|▎         | 1202/37963 [3:06:25<116:21:14, 11.39s/it]
  3%|▎         | 1203/37963 [3:06:33<105:12:17, 10.30s/it]
  3%|▎         | 1204/37963 [3:06:40<97:03:37,  9.51s/it] 
  3%|▎         | 1205/37963 [3:06:48<90:45:22,  8.89s/it]
  3%|▎         | 1206/37963 [3:06:56<87:35:34,  8.58s/it]
  3%|▎         | 1207/37963 [3:07:04<85:17:39,  8.35s/it]
  3%|▎         | 1208/37963 [3:07:11<83:26:42,  8.17s/it]
  3%|▎         | 1209/37963 [3:07:19<82:12:10,  8.05s/it]
  3%|▎         | 1210/37963 [3:07:27<80:50:52,  7.92s/it]
                                                         
{'loss': '0.1763', 'grad_norm': '10.91', 'learning_rate': '2e-05', 'epoch': '0.03187'}
+
  3%|▎         | 1210/37963 [3:07:27<80:50:52,  7.92s/it]
  3%|▎         | 1211/37963 [3:07:35<80:27:15,  7.88s/it]
  3%|▎         | 1212/37963 [3:07:42<79:30:52,  7.79s/it]
  3%|▎         | 1213/37963 [3:07:50<79:47:41,  7.82s/it]
  3%|▎         | 1214/37963 [3:07:58<79:45:30,  7.81s/it]
  3%|▎         | 1215/37963 [3:08:06<79:31:54,  7.79s/it]
  3%|▎         | 1216/37963 [3:08:13<78:35:38,  7.70s/it]
  3%|▎         | 1217/37963 [3:08:21<78:44:10,  7.71s/it]
  3%|▎         | 1218/37963 [3:08:36<100:16:42,  9.82s/it]
  3%|▎         | 1219/37963 [3:08:43<93:38:28,  9.17s/it] 
  3%|▎         | 1220/37963 [3:08:51<88:49:36,  8.70s/it]
                                                         
{'loss': '0.1904', 'grad_norm': '7.049', 'learning_rate': '2e-05', 'epoch': '0.03214'}
+
  3%|▎         | 1220/37963 [3:08:51<88:49:36,  8.70s/it]
  3%|▎         | 1221/37963 [3:08:59<86:03:08,  8.43s/it]
  3%|▎         | 1222/37963 [3:09:06<83:26:38,  8.18s/it]
  3%|▎         | 1223/37963 [3:09:14<82:05:04,  8.04s/it]
  3%|▎         | 1224/37963 [3:09:22<81:09:42,  7.95s/it]
  3%|▎         | 1225/37963 [3:09:29<80:45:02,  7.91s/it]
  3%|▎         | 1226/37963 [3:09:37<80:15:44,  7.87s/it]
  3%|▎         | 1227/37963 [3:09:45<79:51:52,  7.83s/it]
  3%|▎         | 1228/37963 [3:09:53<79:54:28,  7.83s/it]
  3%|▎         | 1229/37963 [3:10:07<100:40:34,  9.87s/it]
  3%|▎         | 1230/37963 [3:10:15<94:10:22,  9.23s/it] 
                                                         
{'loss': '0.1999', 'grad_norm': '7.888', 'learning_rate': '2e-05', 'epoch': '0.0324'}
+
  3%|▎         | 1230/37963 [3:10:15<94:10:22,  9.23s/it]
  3%|▎         | 1231/37963 [3:10:23<89:45:07,  8.80s/it]
  3%|▎         | 1232/37963 [3:10:37<105:38:24, 10.35s/it]
  3%|▎         | 1233/37963 [3:10:44<96:44:14,  9.48s/it] 
  3%|▎         | 1234/37963 [3:10:52<91:33:59,  8.97s/it]
  3%|▎         | 1235/37963 [3:11:06<106:57:39, 10.48s/it]
  3%|▎         | 1236/37963 [3:11:14<98:52:01,  9.69s/it] 
  3%|▎         | 1237/37963 [3:11:22<92:40:29,  9.08s/it]
  3%|▎         | 1238/37963 [3:11:29<88:17:23,  8.65s/it]
  3%|▎         | 1239/37963 [3:11:44<106:00:56, 10.39s/it]
  3%|▎         | 1240/37963 [3:11:52<97:55:32,  9.60s/it] 
                                                         
{'loss': '0.1917', 'grad_norm': '13.31', 'learning_rate': '2e-05', 'epoch': '0.03266'}
+
  3%|▎         | 1240/37963 [3:11:52<97:55:32,  9.60s/it]
  3%|▎         | 1241/37963 [3:12:06<113:50:43, 11.16s/it]
  3%|▎         | 1242/37963 [3:12:14<103:25:47, 10.14s/it]
  3%|▎         | 1243/37963 [3:12:22<96:03:19,  9.42s/it] 
  3%|▎         | 1244/37963 [3:12:29<89:55:10,  8.82s/it]
  3%|▎         | 1245/37963 [3:12:43<106:32:29, 10.45s/it]
  3%|▎         | 1246/37963 [3:12:51<98:21:08,  9.64s/it] 
  3%|▎         | 1247/37963 [3:12:59<92:21:33,  9.06s/it]
  3%|▎         | 1248/37963 [3:13:06<87:21:26,  8.57s/it]
  3%|▎         | 1249/37963 [3:13:14<84:32:46,  8.29s/it]
  3%|▎         | 1250/37963 [3:13:21<81:38:10,  8.01s/it]
                                                         
{'loss': '0.1898', 'grad_norm': '5.622', 'learning_rate': '2e-05', 'epoch': '0.03293'}
+
  3%|▎         | 1250/37963 [3:13:21<81:38:10,  8.01s/it]
  3%|▎         | 1251/37963 [3:13:29<80:33:12,  7.90s/it]
  3%|▎         | 1252/37963 [3:13:36<78:43:42,  7.72s/it]
  3%|▎         | 1253/37963 [3:13:44<78:02:51,  7.65s/it]
  3%|▎         | 1254/37963 [3:13:52<78:48:51,  7.73s/it]
  3%|▎         | 1255/37963 [3:14:00<79:18:20,  7.78s/it]
  3%|▎         | 1256/37963 [3:14:14<99:12:19,  9.73s/it]
  3%|▎         | 1257/37963 [3:14:22<93:21:33,  9.16s/it]
  3%|▎         | 1258/37963 [3:14:29<88:16:18,  8.66s/it]
  3%|▎         | 1259/37963 [3:14:37<85:12:03,  8.36s/it]
  3%|▎         | 1260/37963 [3:14:45<83:17:55,  8.17s/it]
                                                         
{'loss': '0.1961', 'grad_norm': '6.268', 'learning_rate': '2e-05', 'epoch': '0.03319'}
+
  3%|▎         | 1260/37963 [3:14:45<83:17:55,  8.17s/it]
  3%|▎         | 1261/37963 [3:14:52<81:45:41,  8.02s/it]
  3%|▎         | 1262/37963 [3:15:07<102:49:36, 10.09s/it]
  3%|▎         | 1263/37963 [3:15:15<96:00:45,  9.42s/it] 
  3%|▎         | 1264/37963 [3:15:23<90:37:14,  8.89s/it]
  3%|▎         | 1265/37963 [3:15:30<86:59:46,  8.53s/it]
  3%|▎         | 1266/37963 [3:15:38<84:27:46,  8.29s/it]
  3%|▎         | 1267/37963 [3:15:46<82:03:17,  8.05s/it]
  3%|▎         | 1268/37963 [3:15:53<80:53:03,  7.94s/it]
  3%|▎         | 1269/37963 [3:16:01<79:25:35,  7.79s/it]
  3%|▎         | 1270/37963 [3:16:08<78:59:12,  7.75s/it]
                                                         
{'loss': '0.198', 'grad_norm': '2.161', 'learning_rate': '2e-05', 'epoch': '0.03345'}
+
  3%|▎         | 1270/37963 [3:16:08<78:59:12,  7.75s/it]
  3%|▎         | 1271/37963 [3:16:16<78:39:53,  7.72s/it]
  3%|▎         | 1272/37963 [3:16:24<78:19:43,  7.69s/it]
  3%|▎         | 1273/37963 [3:16:38<99:47:55,  9.79s/it]
  3%|▎         | 1274/37963 [3:16:46<93:39:05,  9.19s/it]
  3%|▎         | 1275/37963 [3:16:54<89:20:19,  8.77s/it]
  3%|▎         | 1276/37963 [3:17:02<86:15:56,  8.47s/it]
  3%|▎         | 1277/37963 [3:17:09<83:50:26,  8.23s/it]
  3%|▎         | 1278/37963 [3:17:17<82:16:25,  8.07s/it]
  3%|▎         | 1279/37963 [3:17:25<80:31:38,  7.90s/it]
  3%|▎         | 1280/37963 [3:17:32<80:00:15,  7.85s/it]
                                                         
{'loss': '0.1806', 'grad_norm': '3.496', 'learning_rate': '2e-05', 'epoch': '0.03372'}
+
  3%|▎         | 1280/37963 [3:17:32<80:00:15,  7.85s/it]
  3%|▎         | 1281/37963 [3:17:40<79:42:12,  7.82s/it]
  3%|▎         | 1282/37963 [3:17:54<99:14:02,  9.74s/it]
  3%|▎         | 1283/37963 [3:18:02<92:50:25,  9.11s/it]
  3%|▎         | 1284/37963 [3:18:09<88:20:34,  8.67s/it]
  3%|▎         | 1285/37963 [3:18:17<84:43:55,  8.32s/it]
  3%|▎         | 1286/37963 [3:18:31<100:58:06,  9.91s/it]
  3%|▎         | 1287/37963 [3:18:38<94:25:57,  9.27s/it] 
  3%|▎         | 1288/37963 [3:18:46<89:10:10,  8.75s/it]
  3%|▎         | 1289/37963 [3:19:00<106:18:58, 10.44s/it]
  3%|▎         | 1290/37963 [3:19:08<98:39:15,  9.68s/it] 
                                                         
{'loss': '0.191', 'grad_norm': '2.807', 'learning_rate': '2e-05', 'epoch': '0.03398'}
+
  3%|▎         | 1290/37963 [3:19:08<98:39:15,  9.68s/it]
  3%|▎         | 1291/37963 [3:19:16<93:04:39,  9.14s/it]
  3%|▎         | 1292/37963 [3:19:24<88:52:41,  8.73s/it]
  3%|▎         | 1293/37963 [3:19:39<107:00:52, 10.51s/it]
  3%|▎         | 1294/37963 [3:19:46<97:58:50,  9.62s/it] 
  3%|▎         | 1295/37963 [3:19:54<92:07:48,  9.05s/it]
  3%|▎         | 1296/37963 [3:20:07<106:00:03, 10.41s/it]
  3%|▎         | 1297/37963 [3:20:15<97:59:08,  9.62s/it] 
  3%|▎         | 1298/37963 [3:20:23<91:19:56,  8.97s/it]
  3%|▎         | 1299/37963 [3:20:30<87:54:37,  8.63s/it]
  3%|▎         | 1300/37963 [3:20:38<85:05:54,  8.36s/it]
                                                         
{'loss': '0.1793', 'grad_norm': '5.27', 'learning_rate': '2e-05', 'epoch': '0.03424'}
+
  3%|▎         | 1300/37963 [3:20:38<85:05:54,  8.36s/it]
  3%|▎         | 1301/37963 [3:20:46<83:09:49,  8.17s/it]
  3%|▎         | 1302/37963 [3:20:54<81:40:44,  8.02s/it]
  3%|▎         | 1303/37963 [3:21:08<100:52:00,  9.91s/it]
  3%|▎         | 1304/37963 [3:21:15<93:54:52,  9.22s/it] 
  3%|▎         | 1305/37963 [3:21:30<110:14:39, 10.83s/it]
  3%|▎         | 1306/37963 [3:21:38<101:21:59,  9.95s/it]
  3%|▎         | 1307/37963 [3:21:46<94:13:31,  9.25s/it] 
  3%|▎         | 1308/37963 [3:21:53<89:09:44,  8.76s/it]
  3%|▎         | 1309/37963 [3:22:01<85:41:53,  8.42s/it]
  3%|▎         | 1310/37963 [3:22:08<82:03:27,  8.06s/it]
                                                         
{'loss': '0.1847', 'grad_norm': '8.789', 'learning_rate': '2e-05', 'epoch': '0.03451'}
+
  3%|▎         | 1310/37963 [3:22:08<82:03:27,  8.06s/it]
  3%|▎         | 1311/37963 [3:22:16<80:48:19,  7.94s/it]
  3%|▎         | 1312/37963 [3:22:23<80:19:59,  7.89s/it]
  3%|▎         | 1313/37963 [3:22:31<78:47:36,  7.74s/it]
  3%|▎         | 1314/37963 [3:22:39<78:29:47,  7.71s/it]
  3%|▎         | 1315/37963 [3:22:46<78:29:29,  7.71s/it]
  3%|▎         | 1316/37963 [3:22:54<78:33:39,  7.72s/it]
  3%|▎         | 1317/37963 [3:23:09<100:26:50,  9.87s/it]
  3%|▎         | 1318/37963 [3:23:17<93:50:00,  9.22s/it] 
  3%|▎         | 1319/37963 [3:23:24<89:02:44,  8.75s/it]
  3%|▎         | 1320/37963 [3:23:32<85:02:48,  8.36s/it]
                                                         
{'loss': '0.1805', 'grad_norm': '2.633', 'learning_rate': '2e-05', 'epoch': '0.03477'}
+
  3%|▎         | 1320/37963 [3:23:32<85:02:48,  8.36s/it]
  3%|▎         | 1321/37963 [3:23:39<82:06:13,  8.07s/it]
  3%|▎         | 1322/37963 [3:23:47<81:01:36,  7.96s/it]
  3%|▎         | 1323/37963 [3:23:54<79:46:04,  7.84s/it]
  3%|▎         | 1324/37963 [3:24:02<79:11:14,  7.78s/it]
  3%|▎         | 1325/37963 [3:24:10<78:53:13,  7.75s/it]
  3%|▎         | 1326/37963 [3:24:17<78:41:17,  7.73s/it]
  3%|▎         | 1327/37963 [3:24:25<79:01:44,  7.77s/it]
  3%|▎         | 1328/37963 [3:24:33<77:55:55,  7.66s/it]
  4%|▎         | 1329/37963 [3:24:40<76:53:18,  7.56s/it]
  4%|▎         | 1330/37963 [3:24:48<77:37:50,  7.63s/it]
                                                         
{'loss': '0.1847', 'grad_norm': '3.037', 'learning_rate': '2e-05', 'epoch': '0.03503'}
+
  4%|▎         | 1330/37963 [3:24:48<77:37:50,  7.63s/it]
  4%|▎         | 1331/37963 [3:24:55<77:37:21,  7.63s/it]
  4%|▎         | 1332/37963 [3:25:09<96:33:17,  9.49s/it]
  4%|▎         | 1333/37963 [3:25:24<111:54:20, 11.00s/it]
  4%|▎         | 1334/37963 [3:25:31<101:51:55, 10.01s/it]
  4%|▎         | 1335/37963 [3:25:39<94:30:36,  9.29s/it] 
  4%|▎         | 1336/37963 [3:25:53<109:17:21, 10.74s/it]
  4%|▎         | 1337/37963 [3:26:01<99:57:02,  9.82s/it] 
  4%|▎         | 1338/37963 [3:26:09<93:35:33,  9.20s/it]
  4%|▎         | 1339/37963 [3:26:16<89:04:45,  8.76s/it]
  4%|▎         | 1340/37963 [3:26:24<86:20:21,  8.49s/it]
                                                         
{'loss': '0.1918', 'grad_norm': '4.018', 'learning_rate': '2e-05', 'epoch': '0.0353'}
+
  4%|▎         | 1340/37963 [3:26:24<86:20:21,  8.49s/it]
  4%|▎         | 1341/37963 [3:26:32<83:03:23,  8.16s/it]
  4%|▎         | 1342/37963 [3:26:39<81:41:56,  8.03s/it]
  4%|▎         | 1343/37963 [3:26:47<80:45:17,  7.94s/it]
  4%|▎         | 1344/37963 [3:26:55<79:52:02,  7.85s/it]
  4%|▎         | 1345/37963 [3:27:02<79:06:13,  7.78s/it]
  4%|▎         | 1346/37963 [3:27:10<78:56:46,  7.76s/it]
  4%|▎         | 1347/37963 [3:27:25<100:48:01,  9.91s/it]
  4%|▎         | 1348/37963 [3:27:33<94:35:00,  9.30s/it] 
  4%|▎         | 1349/37963 [3:27:40<89:25:20,  8.79s/it]
  4%|▎         | 1350/37963 [3:27:55<106:02:32, 10.43s/it]
                                                          
{'loss': '0.185', 'grad_norm': '5.795', 'learning_rate': '2e-05', 'epoch': '0.03556'}
+
  4%|▎         | 1350/37963 [3:27:55<106:02:32, 10.43s/it]
  4%|▎         | 1351/37963 [3:28:02<98:15:25,  9.66s/it] 
  4%|▎         | 1352/37963 [3:28:17<112:44:57, 11.09s/it]
  4%|▎         | 1353/37963 [3:28:25<102:32:37, 10.08s/it]
  4%|▎         | 1354/37963 [3:28:32<94:51:37,  9.33s/it] 
  4%|▎         | 1355/37963 [3:28:40<89:38:27,  8.82s/it]
  4%|▎         | 1356/37963 [3:28:48<86:24:45,  8.50s/it]
  4%|▎         | 1357/37963 [3:28:55<83:38:15,  8.23s/it]
  4%|▎         | 1358/37963 [3:29:03<81:53:57,  8.05s/it]
  4%|▎         | 1359/37963 [3:29:11<81:10:42,  7.98s/it]
  4%|▎         | 1360/37963 [3:29:26<104:03:40, 10.23s/it]
                                                          
{'loss': '0.1845', 'grad_norm': '10.27', 'learning_rate': '2e-05', 'epoch': '0.03582'}
+
  4%|▎         | 1360/37963 [3:29:26<104:03:40, 10.23s/it]
  4%|▎         | 1361/37963 [3:29:41<118:27:04, 11.65s/it]
  4%|▎         | 1362/37963 [3:29:49<107:12:21, 10.54s/it]
  4%|▎         | 1363/37963 [3:29:57<97:54:44,  9.63s/it] 
  4%|▎         | 1364/37963 [3:30:04<92:13:26,  9.07s/it]
  4%|▎         | 1365/37963 [3:30:12<88:01:39,  8.66s/it]
  4%|▎         | 1366/37963 [3:30:20<85:08:21,  8.38s/it]
  4%|▎         | 1367/37963 [3:30:27<83:07:44,  8.18s/it]
  4%|▎         | 1368/37963 [3:30:35<81:34:24,  8.02s/it]
  4%|▎         | 1369/37963 [3:30:43<80:21:53,  7.91s/it]
  4%|▎         | 1370/37963 [3:30:50<79:37:28,  7.83s/it]
                                                         
{'loss': '0.1883', 'grad_norm': '6.559', 'learning_rate': '2e-05', 'epoch': '0.03609'}
+
  4%|▎         | 1370/37963 [3:30:50<79:37:28,  7.83s/it]
  4%|▎         | 1371/37963 [3:30:58<79:03:16,  7.78s/it]
  4%|▎         | 1372/37963 [3:31:06<78:40:50,  7.74s/it]
  4%|▎         | 1373/37963 [3:31:13<78:35:15,  7.73s/it]
  4%|▎         | 1374/37963 [3:31:21<78:50:48,  7.76s/it]
  4%|▎         | 1375/37963 [3:31:29<78:49:39,  7.76s/it]
  4%|▎         | 1376/37963 [3:31:37<78:29:10,  7.72s/it]
  4%|▎         | 1377/37963 [3:31:51<98:57:50,  9.74s/it]
  4%|▎         | 1378/37963 [3:31:59<93:11:23,  9.17s/it]
  4%|▎         | 1379/37963 [3:32:07<88:27:27,  8.70s/it]
  4%|▎         | 1380/37963 [3:32:21<105:35:41, 10.39s/it]
                                                          
{'loss': '0.1817', 'grad_norm': '4.935', 'learning_rate': '2e-05', 'epoch': '0.03635'}
+
  4%|▎         | 1380/37963 [3:32:21<105:35:41, 10.39s/it]
  4%|▎         | 1381/37963 [3:32:29<97:32:12,  9.60s/it] 
  4%|▎         | 1382/37963 [3:32:36<90:55:55,  8.95s/it]
  4%|▎         | 1383/37963 [3:32:44<86:55:57,  8.56s/it]
  4%|▎         | 1384/37963 [3:32:51<84:30:33,  8.32s/it]
  4%|▎         | 1385/37963 [3:32:59<81:20:23,  8.01s/it]
  4%|▎         | 1386/37963 [3:33:06<80:22:07,  7.91s/it]
  4%|▎         | 1387/37963 [3:33:21<99:56:47,  9.84s/it]
  4%|▎         | 1388/37963 [3:33:28<92:35:02,  9.11s/it]
  4%|▎         | 1389/37963 [3:33:36<88:24:36,  8.70s/it]
  4%|▎         | 1390/37963 [3:33:43<84:49:28,  8.35s/it]
                                                         
{'loss': '0.1811', 'grad_norm': '2.751', 'learning_rate': '2e-05', 'epoch': '0.03661'}
+
  4%|▎         | 1390/37963 [3:33:43<84:49:28,  8.35s/it]
  4%|▎         | 1391/37963 [3:33:51<82:23:51,  8.11s/it]
  4%|▎         | 1392/37963 [3:34:06<103:00:54, 10.14s/it]
  4%|▎         | 1393/37963 [3:34:13<94:32:16,  9.31s/it] 
  4%|▎         | 1394/37963 [3:34:21<89:47:52,  8.84s/it]
  4%|▎         | 1395/37963 [3:34:29<86:19:42,  8.50s/it]
  4%|▎         | 1396/37963 [3:34:36<83:41:09,  8.24s/it]
  4%|▎         | 1397/37963 [3:34:44<81:40:41,  8.04s/it]
  4%|▎         | 1398/37963 [3:34:51<79:55:16,  7.87s/it]
  4%|▎         | 1399/37963 [3:34:59<78:37:18,  7.74s/it]
  4%|▎         | 1400/37963 [3:35:06<78:21:17,  7.71s/it]
                                                         
{'loss': '0.1704', 'grad_norm': '3.618', 'learning_rate': '2e-05', 'epoch': '0.03688'}
+
  4%|▎         | 1400/37963 [3:35:06<78:21:17,  7.71s/it]
  4%|▎         | 1401/37963 [3:35:14<78:12:47,  7.70s/it]
  4%|▎         | 1402/37963 [3:35:22<78:19:04,  7.71s/it]
  4%|▎         | 1403/37963 [3:35:30<78:45:42,  7.76s/it]
  4%|▎         | 1404/37963 [3:35:44<98:43:04,  9.72s/it]
  4%|▎         | 1405/37963 [3:35:58<111:52:31, 11.02s/it]
  4%|▎         | 1406/37963 [3:36:05<100:43:34,  9.92s/it]
  4%|▎         | 1407/37963 [3:36:13<93:20:11,  9.19s/it] 
  4%|▎         | 1408/37963 [3:36:35<132:25:16, 13.04s/it]
  4%|▎         | 1409/37963 [3:36:43<115:51:34, 11.41s/it]
  4%|▎         | 1410/37963 [3:36:50<104:04:22, 10.25s/it]
                                                          
{'loss': '0.1855', 'grad_norm': '3.795', 'learning_rate': '2e-05', 'epoch': '0.03714'}
+
  4%|▎         | 1410/37963 [3:36:50<104:04:22, 10.25s/it]
  4%|▎         | 1411/37963 [3:36:57<95:24:38,  9.40s/it] 
  4%|▎         | 1412/37963 [3:37:05<90:14:25,  8.89s/it]
  4%|▎         | 1413/37963 [3:37:13<86:45:53,  8.55s/it]
  4%|▎         | 1414/37963 [3:37:21<84:15:55,  8.30s/it]
  4%|▎         | 1415/37963 [3:37:28<81:41:44,  8.05s/it]
  4%|▎         | 1416/37963 [3:37:36<80:39:07,  7.94s/it]
  4%|▎         | 1417/37963 [3:37:43<79:09:37,  7.80s/it]
  4%|▎         | 1418/37963 [3:37:51<79:31:03,  7.83s/it]
  4%|▎         | 1419/37963 [3:37:59<78:58:30,  7.78s/it]
  4%|▎         | 1420/37963 [3:38:06<78:31:24,  7.74s/it]
                                                         
{'loss': '0.1894', 'grad_norm': '2.266', 'learning_rate': '2e-05', 'epoch': '0.0374'}
+
  4%|▎         | 1420/37963 [3:38:06<78:31:24,  7.74s/it]
  4%|▎         | 1421/37963 [3:38:14<78:14:21,  7.71s/it]
  4%|▎         | 1422/37963 [3:38:22<78:18:35,  7.72s/it]
  4%|▎         | 1423/37963 [3:38:36<97:31:39,  9.61s/it]
  4%|▍         | 1424/37963 [3:38:44<91:36:50,  9.03s/it]
  4%|▍         | 1425/37963 [3:38:51<87:39:36,  8.64s/it]
  4%|▍         | 1426/37963 [3:38:59<85:13:36,  8.40s/it]
  4%|▍         | 1427/37963 [3:39:07<83:00:29,  8.18s/it]
  4%|▍         | 1428/37963 [3:39:14<81:03:09,  7.99s/it]
  4%|▍         | 1429/37963 [3:39:22<80:29:11,  7.93s/it]
  4%|▍         | 1430/37963 [3:39:30<80:03:14,  7.89s/it]
                                                         
{'loss': '0.18', 'grad_norm': '5.323', 'learning_rate': '2e-05', 'epoch': '0.03767'}
+
  4%|▍         | 1430/37963 [3:39:30<80:03:14,  7.89s/it]
  4%|▍         | 1431/37963 [3:39:44<100:03:00,  9.86s/it]
  4%|▍         | 1432/37963 [3:39:52<93:40:33,  9.23s/it] 
  4%|▍         | 1433/37963 [3:40:00<88:57:15,  8.77s/it]
  4%|▍         | 1434/37963 [3:40:07<85:30:15,  8.43s/it]
  4%|▍         | 1435/37963 [3:40:15<83:29:39,  8.23s/it]
  4%|▍         | 1436/37963 [3:40:23<81:49:56,  8.07s/it]
  4%|▍         | 1437/37963 [3:40:30<80:23:49,  7.92s/it]
  4%|▍         | 1438/37963 [3:40:38<79:38:09,  7.85s/it]
  4%|▍         | 1439/37963 [3:40:46<78:40:23,  7.75s/it]
  4%|▍         | 1440/37963 [3:40:59<96:50:09,  9.54s/it]
                                                         
{'loss': '0.1743', 'grad_norm': '5.264', 'learning_rate': '2e-05', 'epoch': '0.03793'}
+
  4%|▍         | 1440/37963 [3:40:59<96:50:09,  9.54s/it]
  4%|▍         | 1441/37963 [3:41:07<90:50:09,  8.95s/it]
  4%|▍         | 1442/37963 [3:41:15<86:46:39,  8.55s/it]
  4%|▍         | 1443/37963 [3:41:29<105:49:56, 10.43s/it]
  4%|▍         | 1444/37963 [3:41:37<97:40:48,  9.63s/it] 
  4%|▍         | 1445/37963 [3:41:45<90:50:08,  8.95s/it]
  4%|▍         | 1446/37963 [3:41:52<87:00:10,  8.58s/it]
  4%|▍         | 1447/37963 [3:42:00<84:16:16,  8.31s/it]
  4%|▍         | 1448/37963 [3:42:08<82:26:56,  8.13s/it]
  4%|▍         | 1449/37963 [3:42:15<81:01:57,  7.99s/it]
  4%|▍         | 1450/37963 [3:42:29<99:19:42,  9.79s/it]
                                                         
{'loss': '0.2', 'grad_norm': '4.975', 'learning_rate': '2e-05', 'epoch': '0.0382'}
+
  4%|▍         | 1450/37963 [3:42:29<99:19:42,  9.79s/it]
  4%|▍         | 1451/37963 [3:42:37<93:21:10,  9.20s/it]
  4%|▍         | 1452/37963 [3:42:45<88:29:22,  8.73s/it]
  4%|▍         | 1453/37963 [3:42:59<103:51:31, 10.24s/it]
  4%|▍         | 1454/37963 [3:43:13<117:43:31, 11.61s/it]
  4%|▍         | 1455/37963 [3:43:29<128:46:56, 12.70s/it]
  4%|▍         | 1456/37963 [3:43:36<112:44:04, 11.12s/it]
  4%|▍         | 1457/37963 [3:43:44<102:22:31, 10.10s/it]
  4%|▍         | 1458/37963 [3:43:51<94:57:22,  9.36s/it] 
  4%|▍         | 1459/37963 [3:43:59<89:37:40,  8.84s/it]
  4%|▍         | 1460/37963 [3:44:07<85:53:36,  8.47s/it]
                                                         
{'loss': '0.1916', 'grad_norm': '2.055', 'learning_rate': '2e-05', 'epoch': '0.03846'}
+
  4%|▍         | 1460/37963 [3:44:07<85:53:36,  8.47s/it]
  4%|▍         | 1461/37963 [3:44:14<83:51:05,  8.27s/it]
  4%|▍         | 1462/37963 [3:44:22<82:23:06,  8.13s/it]
  4%|▍         | 1463/37963 [3:44:30<80:58:41,  7.99s/it]
  4%|▍         | 1464/37963 [3:44:37<79:52:59,  7.88s/it]
  4%|▍         | 1465/37963 [3:44:45<79:00:54,  7.79s/it]
  4%|▍         | 1466/37963 [3:44:53<78:23:13,  7.73s/it]
  4%|▍         | 1467/37963 [3:45:01<79:29:21,  7.84s/it]
  4%|▍         | 1468/37963 [3:45:08<78:56:35,  7.79s/it]
  4%|▍         | 1469/37963 [3:45:23<98:58:21,  9.76s/it]
  4%|▍         | 1470/37963 [3:45:31<92:48:11,  9.15s/it]
                                                         
{'loss': '0.1768', 'grad_norm': '3.893', 'learning_rate': '2e-05', 'epoch': '0.03872'}
+
  4%|▍         | 1470/37963 [3:45:31<92:48:11,  9.15s/it]
  4%|▍         | 1471/37963 [3:45:38<87:57:32,  8.68s/it]
  4%|▍         | 1472/37963 [3:45:46<84:23:24,  8.33s/it]
  4%|▍         | 1473/37963 [3:45:53<82:34:24,  8.15s/it]
  4%|▍         | 1474/37963 [3:46:01<81:15:53,  8.02s/it]
  4%|▍         | 1475/37963 [3:46:09<80:01:09,  7.89s/it]
  4%|▍         | 1476/37963 [3:46:16<79:37:07,  7.86s/it]
  4%|▍         | 1477/37963 [3:46:24<79:18:25,  7.83s/it]
  4%|▍         | 1478/37963 [3:46:32<79:03:51,  7.80s/it]
  4%|▍         | 1479/37963 [3:46:39<78:18:58,  7.73s/it]
  4%|▍         | 1480/37963 [3:46:47<78:24:31,  7.74s/it]
                                                         
{'loss': '0.1854', 'grad_norm': '4.136', 'learning_rate': '2e-05', 'epoch': '0.03899'}
+
  4%|▍         | 1480/37963 [3:46:47<78:24:31,  7.74s/it]
  4%|▍         | 1481/37963 [3:46:55<78:16:25,  7.72s/it]
  4%|▍         | 1482/37963 [3:47:03<78:10:33,  7.71s/it]
  4%|▍         | 1483/37963 [3:47:10<78:02:57,  7.70s/it]
  4%|▍         | 1484/37963 [3:47:18<77:20:44,  7.63s/it]
  4%|▍         | 1485/37963 [3:47:32<98:02:40,  9.68s/it]
  4%|▍         | 1486/37963 [3:47:40<91:38:54,  9.05s/it]
  4%|▍         | 1487/37963 [3:47:48<88:34:02,  8.74s/it]
  4%|▍         | 1488/37963 [3:47:55<85:18:44,  8.42s/it]
  4%|▍         | 1489/37963 [3:48:03<83:09:53,  8.21s/it]
  4%|▍         | 1490/37963 [3:48:11<81:13:56,  8.02s/it]
                                                         
{'loss': '0.1877', 'grad_norm': '4.758', 'learning_rate': '2e-05', 'epoch': '0.03925'}
+
  4%|▍         | 1490/37963 [3:48:11<81:13:56,  8.02s/it]
  4%|▍         | 1491/37963 [3:48:26<102:45:40, 10.14s/it]
  4%|▍         | 1492/37963 [3:48:33<95:08:10,  9.39s/it] 
  4%|▍         | 1493/37963 [3:48:41<89:33:50,  8.84s/it]
  4%|▍         | 1494/37963 [3:48:55<104:37:24, 10.33s/it]
  4%|▍         | 1495/37963 [3:49:02<96:07:51,  9.49s/it] 
  4%|▍         | 1496/37963 [3:49:10<90:18:42,  8.92s/it]
  4%|▍         | 1497/37963 [3:49:18<86:31:14,  8.54s/it]
  4%|▍         | 1498/37963 [3:49:25<83:48:12,  8.27s/it]
  4%|▍         | 1499/37963 [3:49:39<101:38:10, 10.03s/it]
  4%|▍         | 1500/37963 [3:49:47<94:28:30,  9.33s/it] 
                                                         
{'loss': '0.181', 'grad_norm': '3.803', 'learning_rate': '2e-05', 'epoch': '0.03951'}
+
  4%|▍         | 1500/37963 [3:49:47<94:28:30,  9.33s/it]
  4%|▍         | 1501/37963 [3:49:55<89:42:14,  8.86s/it]
  4%|▍         | 1502/37963 [3:50:09<105:31:02, 10.42s/it]
  4%|▍         | 1503/37963 [3:50:17<97:36:25,  9.64s/it] 
  4%|▍         | 1504/37963 [3:50:24<91:38:37,  9.05s/it]
  4%|▍         | 1505/37963 [3:50:32<87:14:35,  8.61s/it]
  4%|▍         | 1506/37963 [3:50:46<104:57:58, 10.37s/it]
  4%|▍         | 1507/37963 [3:51:01<118:44:02, 11.72s/it]
  4%|▍         | 1508/37963 [3:51:09<105:58:47, 10.47s/it]
  4%|▍         | 1509/37963 [3:51:16<96:48:49,  9.56s/it] 
  4%|▍         | 1510/37963 [3:51:24<91:20:08,  9.02s/it]
                                                         
{'loss': '0.1694', 'grad_norm': '6.306', 'learning_rate': '2e-05', 'epoch': '0.03978'}
+
  4%|▍         | 1510/37963 [3:51:24<91:20:08,  9.02s/it]
  4%|▍         | 1511/37963 [3:51:31<86:24:33,  8.53s/it]
  4%|▍         | 1512/37963 [3:51:39<84:23:44,  8.34s/it]
  4%|▍         | 1513/37963 [3:51:47<82:40:43,  8.17s/it]
  4%|▍         | 1514/37963 [3:51:55<81:35:03,  8.06s/it]
  4%|▍         | 1515/37963 [3:52:02<79:38:48,  7.87s/it]
  4%|▍         | 1516/37963 [3:52:10<79:03:37,  7.81s/it]
  4%|▍         | 1517/37963 [3:52:18<78:36:57,  7.77s/it]
  4%|▍         | 1518/37963 [3:52:25<78:09:04,  7.72s/it]
  4%|▍         | 1519/37963 [3:52:33<78:25:37,  7.75s/it]
  4%|▍         | 1520/37963 [3:52:41<78:20:12,  7.74s/it]
                                                         
{'loss': '0.1698', 'grad_norm': '2.685', 'learning_rate': '1.999e-05', 'epoch': '0.04004'}
+
  4%|▍         | 1520/37963 [3:52:41<78:20:12,  7.74s/it]
  4%|▍         | 1521/37963 [3:52:49<78:23:55,  7.74s/it]
  4%|▍         | 1522/37963 [3:52:56<78:21:34,  7.74s/it]
  4%|▍         | 1523/37963 [3:53:10<97:15:28,  9.61s/it]
  4%|▍         | 1524/37963 [3:53:18<91:33:47,  9.05s/it]
  4%|▍         | 1525/37963 [3:53:26<87:42:02,  8.66s/it]
  4%|▍         | 1526/37963 [3:53:33<84:33:12,  8.35s/it]
  4%|▍         | 1527/37963 [3:53:41<82:35:44,  8.16s/it]
  4%|▍         | 1528/37963 [3:53:49<81:09:09,  8.02s/it]
  4%|▍         | 1529/37963 [3:53:57<80:23:53,  7.94s/it]
  4%|▍         | 1530/37963 [3:54:04<79:10:54,  7.82s/it]
                                                         
{'loss': '0.1674', 'grad_norm': '5.083', 'learning_rate': '1.999e-05', 'epoch': '0.0403'}
+
  4%|▍         | 1530/37963 [3:54:04<79:10:54,  7.82s/it]
  4%|▍         | 1531/37963 [3:54:12<78:50:51,  7.79s/it]
  4%|▍         | 1532/37963 [3:54:20<78:52:55,  7.79s/it]
  4%|▍         | 1533/37963 [3:54:27<78:30:14,  7.76s/it]
  4%|▍         | 1534/37963 [3:54:35<78:20:25,  7.74s/it]
  4%|▍         | 1535/37963 [3:54:43<78:25:20,  7.75s/it]
  4%|▍         | 1536/37963 [3:54:50<78:11:53,  7.73s/it]
  4%|▍         | 1537/37963 [3:55:05<97:43:44,  9.66s/it]
  4%|▍         | 1538/37963 [3:55:12<91:05:52,  9.00s/it]
  4%|▍         | 1539/37963 [3:55:26<106:25:06, 10.52s/it]
  4%|▍         | 1540/37963 [3:55:34<97:51:49,  9.67s/it] 
                                                         
{'loss': '0.1945', 'grad_norm': '5.964', 'learning_rate': '1.999e-05', 'epoch': '0.04057'}
+
  4%|▍         | 1540/37963 [3:55:34<97:51:49,  9.67s/it]
  4%|▍         | 1541/37963 [3:55:42<91:49:10,  9.08s/it]
  4%|▍         | 1542/37963 [3:55:49<86:39:36,  8.57s/it]
  4%|▍         | 1543/37963 [3:56:03<102:26:03, 10.13s/it]
  4%|▍         | 1544/37963 [3:56:10<94:47:34,  9.37s/it] 
  4%|▍         | 1545/37963 [3:56:18<89:02:36,  8.80s/it]
  4%|▍         | 1546/37963 [3:56:32<106:16:05, 10.51s/it]
  4%|▍         | 1547/37963 [3:56:47<117:37:10, 11.63s/it]
  4%|▍         | 1548/37963 [3:56:54<106:24:33, 10.52s/it]
  4%|▍         | 1549/37963 [3:57:02<98:01:16,  9.69s/it] 
  4%|▍         | 1550/37963 [3:57:10<91:41:17,  9.06s/it]
                                                         
{'loss': '0.1891', 'grad_norm': '3.976', 'learning_rate': '1.999e-05', 'epoch': '0.04083'}
+
  4%|▍         | 1550/37963 [3:57:10<91:41:17,  9.06s/it]
  4%|▍         | 1551/37963 [3:57:18<87:53:37,  8.69s/it]
  4%|▍         | 1552/37963 [3:57:33<106:47:03, 10.56s/it]
  4%|▍         | 1553/37963 [3:57:40<98:07:45,  9.70s/it] 
  4%|▍         | 1554/37963 [3:57:48<92:27:41,  9.14s/it]
  4%|▍         | 1555/37963 [3:58:03<109:12:06, 10.80s/it]
  4%|▍         | 1556/37963 [3:58:11<100:20:37,  9.92s/it]
  4%|▍         | 1557/37963 [3:58:18<93:44:25,  9.27s/it] 
  4%|▍         | 1558/37963 [3:58:26<88:34:30,  8.76s/it]
  4%|▍         | 1559/37963 [3:58:34<85:55:51,  8.50s/it]
  4%|▍         | 1560/37963 [3:58:42<83:36:37,  8.27s/it]
                                                         
{'loss': '0.1673', 'grad_norm': '5.083', 'learning_rate': '1.999e-05', 'epoch': '0.04109'}
+
  4%|▍         | 1560/37963 [3:58:42<83:36:37,  8.27s/it]
  4%|▍         | 1561/37963 [3:58:49<82:10:01,  8.13s/it]
  4%|▍         | 1562/37963 [3:58:57<80:44:23,  7.99s/it]
  4%|▍         | 1563/37963 [3:59:05<80:08:46,  7.93s/it]
  4%|▍         | 1564/37963 [3:59:12<79:17:17,  7.84s/it]
  4%|▍         | 1565/37963 [3:59:20<78:47:44,  7.79s/it]
  4%|▍         | 1566/37963 [3:59:28<77:33:18,  7.67s/it]
  4%|▍         | 1567/37963 [3:59:35<77:47:03,  7.69s/it]
  4%|▍         | 1568/37963 [3:59:43<77:59:10,  7.71s/it]
  4%|▍         | 1569/37963 [3:59:51<78:09:58,  7.73s/it]
  4%|▍         | 1570/37963 [3:59:58<77:18:25,  7.65s/it]
                                                         
{'loss': '0.1793', 'grad_norm': '7.779', 'learning_rate': '1.999e-05', 'epoch': '0.04136'}
+
  4%|▍         | 1570/37963 [3:59:58<77:18:25,  7.65s/it]
  4%|▍         | 1571/37963 [4:00:12<97:14:11,  9.62s/it]
  4%|▍         | 1572/37963 [4:00:20<91:26:22,  9.05s/it]
  4%|▍         | 1573/37963 [4:00:28<87:11:17,  8.63s/it]
  4%|▍         | 1574/37963 [4:00:35<84:06:55,  8.32s/it]
  4%|▍         | 1575/37963 [4:00:43<81:46:30,  8.09s/it]
  4%|▍         | 1576/37963 [4:00:51<80:51:06,  8.00s/it]
  4%|▍         | 1577/37963 [4:00:58<79:47:36,  7.89s/it]
  4%|▍         | 1578/37963 [4:01:06<79:09:30,  7.83s/it]
  4%|▍         | 1579/37963 [4:01:14<78:31:49,  7.77s/it]
  4%|▍         | 1580/37963 [4:01:22<79:03:28,  7.82s/it]
                                                         
{'loss': '0.1801', 'grad_norm': '3.1', 'learning_rate': '1.999e-05', 'epoch': '0.04162'}
+
  4%|▍         | 1580/37963 [4:01:22<79:03:28,  7.82s/it]
  4%|▍         | 1581/37963 [4:01:29<78:21:34,  7.75s/it]
  4%|▍         | 1582/37963 [4:01:37<77:25:53,  7.66s/it]
  4%|▍         | 1583/37963 [4:01:51<98:58:37,  9.79s/it]
  4%|▍         | 1584/37963 [4:01:59<92:42:44,  9.17s/it]
  4%|▍         | 1585/37963 [4:02:07<87:27:00,  8.65s/it]
  4%|▍         | 1586/37963 [4:02:14<84:29:14,  8.36s/it]
  4%|▍         | 1587/37963 [4:02:22<82:55:32,  8.21s/it]
  4%|▍         | 1588/37963 [4:02:30<81:52:06,  8.10s/it]
  4%|▍         | 1589/37963 [4:02:44<101:00:35, 10.00s/it]
  4%|▍         | 1590/37963 [4:02:59<114:24:14, 11.32s/it]
                                                          
{'loss': '0.1775', 'grad_norm': '2.038', 'learning_rate': '1.999e-05', 'epoch': '0.04188'}
+
  4%|▍         | 1590/37963 [4:02:59<114:24:14, 11.32s/it]
  4%|▍         | 1591/37963 [4:03:07<103:39:27, 10.26s/it]
  4%|▍         | 1592/37963 [4:03:14<95:48:53,  9.48s/it] 
  4%|▍         | 1593/37963 [4:03:22<89:53:37,  8.90s/it]
  4%|▍         | 1594/37963 [4:03:30<86:14:05,  8.54s/it]
  4%|▍         | 1595/37963 [4:03:37<83:33:31,  8.27s/it]
  4%|▍         | 1596/37963 [4:03:45<81:48:19,  8.10s/it]
  4%|▍         | 1597/37963 [4:03:59<100:04:20,  9.91s/it]
  4%|▍         | 1598/37963 [4:04:07<93:45:14,  9.28s/it] 
  4%|▍         | 1599/37963 [4:04:14<88:37:58,  8.77s/it]
  4%|▍         | 1600/37963 [4:04:36<126:24:49, 12.52s/it]
                                                          
{'loss': '0.1935', 'grad_norm': '2.282', 'learning_rate': '1.999e-05', 'epoch': '0.04215'}
+
  4%|▍         | 1600/37963 [4:04:36<126:24:49, 12.52s/it]
  4%|▍         | 1601/37963 [4:04:43<112:01:27, 11.09s/it]
  4%|▍         | 1602/37963 [4:04:51<101:47:31, 10.08s/it]
  4%|▍         | 1603/37963 [4:04:59<94:44:24,  9.38s/it] 
  4%|▍         | 1604/37963 [4:05:07<89:38:00,  8.87s/it]
  4%|▍         | 1605/37963 [4:05:14<85:54:19,  8.51s/it]
  4%|▍         | 1606/37963 [4:05:22<83:42:12,  8.29s/it]
  4%|▍         | 1607/37963 [4:05:37<103:35:54, 10.26s/it]
  4%|▍         | 1608/37963 [4:05:45<95:45:18,  9.48s/it] 
  4%|▍         | 1609/37963 [4:05:52<90:55:35,  9.00s/it]
  4%|▍         | 1610/37963 [4:06:00<87:11:47,  8.63s/it]
                                                         
{'loss': '0.172', 'grad_norm': '8.144', 'learning_rate': '1.999e-05', 'epoch': '0.04241'}
+
  4%|▍         | 1610/37963 [4:06:00<87:11:47,  8.63s/it]
  4%|▍         | 1611/37963 [4:06:08<84:52:57,  8.41s/it]
  4%|▍         | 1612/37963 [4:06:16<82:55:30,  8.21s/it]
  4%|▍         | 1613/37963 [4:06:24<81:24:43,  8.06s/it]
  4%|▍         | 1614/37963 [4:06:31<80:26:40,  7.97s/it]
  4%|▍         | 1615/37963 [4:06:39<79:47:28,  7.90s/it]
  4%|▍         | 1616/37963 [4:06:47<78:54:34,  7.82s/it]
  4%|▍         | 1617/37963 [4:06:54<78:34:04,  7.78s/it]
  4%|▍         | 1618/37963 [4:07:02<77:43:55,  7.70s/it]
  4%|▍         | 1619/37963 [4:07:10<77:53:15,  7.72s/it]
  4%|▍         | 1620/37963 [4:07:24<96:56:43,  9.60s/it]
                                                         
{'loss': '0.1797', 'grad_norm': '7.017', 'learning_rate': '1.999e-05', 'epoch': '0.04267'}
+
  4%|▍         | 1620/37963 [4:07:24<96:56:43,  9.60s/it]
  4%|▍         | 1621/37963 [4:07:31<91:09:10,  9.03s/it]
  4%|▍         | 1622/37963 [4:07:39<87:07:54,  8.63s/it]
  4%|▍         | 1623/37963 [4:07:47<84:14:54,  8.35s/it]
  4%|▍         | 1624/37963 [4:07:55<82:56:14,  8.22s/it]
  4%|▍         | 1625/37963 [4:08:02<81:04:09,  8.03s/it]
  4%|▍         | 1626/37963 [4:08:10<80:08:51,  7.94s/it]
  4%|▍         | 1627/37963 [4:08:18<79:25:25,  7.87s/it]
  4%|▍         | 1628/37963 [4:08:25<78:02:32,  7.73s/it]
  4%|▍         | 1629/37963 [4:08:33<77:59:06,  7.73s/it]
  4%|▍         | 1630/37963 [4:08:40<77:02:47,  7.63s/it]
                                                         
{'loss': '0.1706', 'grad_norm': '3.745', 'learning_rate': '1.999e-05', 'epoch': '0.04294'}
+
  4%|▍         | 1630/37963 [4:08:40<77:02:47,  7.63s/it]
  4%|▍         | 1631/37963 [4:08:48<77:21:23,  7.66s/it]
  4%|▍         | 1632/37963 [4:09:02<97:18:31,  9.64s/it]
  4%|▍         | 1633/37963 [4:09:10<91:27:28,  9.06s/it]
  4%|▍         | 1634/37963 [4:09:25<109:46:18, 10.88s/it]
  4%|▍         | 1635/37963 [4:09:33<99:40:04,  9.88s/it] 
  4%|▍         | 1636/37963 [4:09:40<93:15:04,  9.24s/it]
  4%|▍         | 1637/37963 [4:09:48<88:31:01,  8.77s/it]
  4%|▍         | 1638/37963 [4:09:55<84:21:56,  8.36s/it]
  4%|▍         | 1639/37963 [4:10:03<82:29:11,  8.18s/it]
  4%|▍         | 1640/37963 [4:10:11<80:53:21,  8.02s/it]
                                                         
{'loss': '0.1902', 'grad_norm': '6.802', 'learning_rate': '1.999e-05', 'epoch': '0.0432'}
+
  4%|▍         | 1640/37963 [4:10:11<80:53:21,  8.02s/it]
  4%|▍         | 1641/37963 [4:10:19<80:30:53,  7.98s/it]
  4%|▍         | 1642/37963 [4:10:33<99:01:02,  9.81s/it]
  4%|▍         | 1643/37963 [4:10:40<91:26:09,  9.06s/it]
  4%|▍         | 1644/37963 [4:10:48<87:31:24,  8.68s/it]
  4%|▍         | 1645/37963 [4:11:02<104:25:04, 10.35s/it]
  4%|▍         | 1646/37963 [4:11:10<96:54:15,  9.61s/it] 
  4%|▍         | 1647/37963 [4:11:18<91:16:23,  9.05s/it]
  4%|▍         | 1648/37963 [4:11:25<86:06:09,  8.54s/it]
  4%|▍         | 1649/37963 [4:11:33<83:33:12,  8.28s/it]
  4%|▍         | 1650/37963 [4:11:48<104:06:50, 10.32s/it]
                                                          
{'loss': '0.1725', 'grad_norm': '2.321', 'learning_rate': '1.999e-05', 'epoch': '0.04346'}
+
  4%|▍         | 1650/37963 [4:11:48<104:06:50, 10.32s/it]
  4%|▍         | 1651/37963 [4:12:03<118:27:33, 11.74s/it]
  4%|▍         | 1652/37963 [4:12:10<105:33:15, 10.47s/it]
  4%|▍         | 1653/37963 [4:12:18<97:13:07,  9.64s/it] 
  4%|▍         | 1654/37963 [4:12:33<111:43:57, 11.08s/it]
  4%|▍         | 1655/37963 [4:12:40<101:27:18, 10.06s/it]
  4%|▍         | 1656/37963 [4:12:48<94:14:34,  9.34s/it] 
  4%|▍         | 1657/37963 [4:12:55<88:57:57,  8.82s/it]
  4%|▍         | 1658/37963 [4:13:03<85:38:13,  8.49s/it]
  4%|▍         | 1659/37963 [4:13:11<83:18:43,  8.26s/it]
  4%|▍         | 1660/37963 [4:13:19<81:43:58,  8.11s/it]
                                                         
{'loss': '0.1972', 'grad_norm': '4.346', 'learning_rate': '1.999e-05', 'epoch': '0.04373'}
+
  4%|▍         | 1660/37963 [4:13:19<81:43:58,  8.11s/it]
  4%|▍         | 1661/37963 [4:13:26<80:27:41,  7.98s/it]
  4%|▍         | 1662/37963 [4:13:34<79:17:32,  7.86s/it]
  4%|▍         | 1663/37963 [4:13:42<78:39:56,  7.80s/it]
  4%|▍         | 1664/37963 [4:13:49<77:30:06,  7.69s/it]
  4%|▍         | 1665/37963 [4:13:57<77:23:13,  7.68s/it]
  4%|▍         | 1666/37963 [4:14:04<77:13:46,  7.66s/it]
  4%|▍         | 1667/37963 [4:14:12<77:35:13,  7.70s/it]
  4%|▍         | 1668/37963 [4:14:20<77:29:05,  7.69s/it]
  4%|▍         | 1669/37963 [4:14:27<77:17:53,  7.67s/it]
  4%|▍         | 1670/37963 [4:14:35<77:28:31,  7.69s/it]
                                                         
{'loss': '0.1916', 'grad_norm': '4.992', 'learning_rate': '1.999e-05', 'epoch': '0.04399'}
+
  4%|▍         | 1670/37963 [4:14:35<77:28:31,  7.69s/it]
  4%|▍         | 1671/37963 [4:14:43<77:43:00,  7.71s/it]
  4%|▍         | 1672/37963 [4:14:51<78:10:39,  7.76s/it]
  4%|▍         | 1673/37963 [4:15:05<96:51:04,  9.61s/it]
  4%|▍         | 1674/37963 [4:15:12<91:28:49,  9.08s/it]
  4%|▍         | 1675/37963 [4:15:20<86:44:25,  8.61s/it]
  4%|▍         | 1676/37963 [4:15:34<103:13:12, 10.24s/it]
  4%|▍         | 1677/37963 [4:15:42<95:33:17,  9.48s/it] 
  4%|▍         | 1678/37963 [4:15:49<90:06:40,  8.94s/it]
  4%|▍         | 1679/37963 [4:15:57<86:01:05,  8.53s/it]
  4%|▍         | 1680/37963 [4:16:05<83:54:33,  8.33s/it]
                                                         
{'loss': '0.1719', 'grad_norm': '2.476', 'learning_rate': '1.999e-05', 'epoch': '0.04425'}
+
  4%|▍         | 1680/37963 [4:16:05<83:54:33,  8.33s/it]
  4%|▍         | 1681/37963 [4:16:13<81:51:15,  8.12s/it]
  4%|▍         | 1682/37963 [4:16:20<80:37:48,  8.00s/it]
  4%|▍         | 1683/37963 [4:16:28<79:41:23,  7.91s/it]
  4%|▍         | 1684/37963 [4:16:35<78:33:17,  7.80s/it]
  4%|▍         | 1685/37963 [4:16:51<101:12:59, 10.04s/it]
  4%|▍         | 1686/37963 [4:16:58<94:03:54,  9.33s/it] 
  4%|▍         | 1687/37963 [4:17:06<89:04:15,  8.84s/it]
  4%|▍         | 1688/37963 [4:17:14<85:15:46,  8.46s/it]
  4%|▍         | 1689/37963 [4:17:22<83:28:25,  8.28s/it]
  4%|▍         | 1690/37963 [4:17:29<81:37:33,  8.10s/it]
                                                         
{'loss': '0.1719', 'grad_norm': '3.324', 'learning_rate': '1.999e-05', 'epoch': '0.04452'}
+
  4%|▍         | 1690/37963 [4:17:29<81:37:33,  8.10s/it]
  4%|▍         | 1691/37963 [4:17:45<106:07:06, 10.53s/it]
  4%|▍         | 1692/37963 [4:17:53<97:50:54,  9.71s/it] 
  4%|▍         | 1693/37963 [4:18:01<91:49:48,  9.11s/it]
  4%|▍         | 1694/37963 [4:18:08<87:02:26,  8.64s/it]
  4%|▍         | 1695/37963 [4:18:30<125:30:20, 12.46s/it]
  4%|▍         | 1696/37963 [4:18:38<111:11:04, 11.04s/it]
  4%|▍         | 1697/37963 [4:18:45<101:20:50, 10.06s/it]
  4%|▍         | 1698/37963 [4:18:53<93:38:13,  9.30s/it] 
  4%|▍         | 1699/37963 [4:19:01<89:07:31,  8.85s/it]
  4%|▍         | 1700/37963 [4:19:08<85:01:09,  8.44s/it]
                                                         
{'loss': '0.188', 'grad_norm': '2.246', 'learning_rate': '1.999e-05', 'epoch': '0.04478'}
+
  4%|▍         | 1700/37963 [4:19:08<85:01:09,  8.44s/it]
  4%|▍         | 1701/37963 [4:19:16<82:46:16,  8.22s/it]
  4%|▍         | 1702/37963 [4:19:24<81:21:33,  8.08s/it]
  4%|▍         | 1703/37963 [4:19:31<80:21:06,  7.98s/it]
  4%|▍         | 1704/37963 [4:19:46<101:38:19, 10.09s/it]
  4%|▍         | 1705/37963 [4:19:54<94:59:25,  9.43s/it] 
  4%|▍         | 1706/37963 [4:20:02<89:39:16,  8.90s/it]
  4%|▍         | 1707/37963 [4:20:10<86:02:11,  8.54s/it]
  4%|▍         | 1708/37963 [4:20:24<103:20:15, 10.26s/it]
  5%|▍         | 1709/37963 [4:20:32<96:05:01,  9.54s/it] 
  5%|▍         | 1710/37963 [4:20:39<90:25:36,  8.98s/it]
                                                         
{'loss': '0.1873', 'grad_norm': '5.711', 'learning_rate': '1.999e-05', 'epoch': '0.04504'}
+
  5%|▍         | 1710/37963 [4:20:39<90:25:36,  8.98s/it]
  5%|▍         | 1711/37963 [4:20:47<86:37:57,  8.60s/it]
  5%|▍         | 1712/37963 [4:20:55<83:32:52,  8.30s/it]
  5%|▍         | 1713/37963 [4:21:02<81:15:01,  8.07s/it]
  5%|▍         | 1714/37963 [4:21:10<80:11:56,  7.96s/it]
  5%|▍         | 1715/37963 [4:21:18<79:44:57,  7.92s/it]
  5%|▍         | 1716/37963 [4:21:25<78:56:18,  7.84s/it]
  5%|▍         | 1717/37963 [4:21:33<77:41:29,  7.72s/it]
  5%|▍         | 1718/37963 [4:21:41<77:30:14,  7.70s/it]
  5%|▍         | 1719/37963 [4:21:48<77:30:52,  7.70s/it]
  5%|▍         | 1720/37963 [4:21:56<77:35:41,  7.71s/it]
                                                         
{'loss': '0.183', 'grad_norm': '3.354', 'learning_rate': '1.999e-05', 'epoch': '0.04531'}
+
  5%|▍         | 1720/37963 [4:21:56<77:35:41,  7.71s/it]
  5%|▍         | 1721/37963 [4:22:10<96:49:42,  9.62s/it]
  5%|▍         | 1722/37963 [4:22:25<111:58:23, 11.12s/it]
  5%|▍         | 1723/37963 [4:22:32<101:40:28, 10.10s/it]
  5%|▍         | 1724/37963 [4:22:40<94:20:27,  9.37s/it] 
  5%|▍         | 1725/37963 [4:22:48<88:43:03,  8.81s/it]
  5%|▍         | 1726/37963 [4:22:55<84:04:48,  8.35s/it]
  5%|▍         | 1727/37963 [4:23:03<82:00:28,  8.15s/it]
  5%|▍         | 1728/37963 [4:23:10<80:17:56,  7.98s/it]
  5%|▍         | 1729/37963 [4:23:18<79:05:21,  7.86s/it]
  5%|▍         | 1730/37963 [4:23:25<78:50:11,  7.83s/it]
                                                         
{'loss': '0.1871', 'grad_norm': '5.484', 'learning_rate': '1.999e-05', 'epoch': '0.04557'}
+
  5%|▍         | 1730/37963 [4:23:25<78:50:11,  7.83s/it]
  5%|▍         | 1731/37963 [4:23:33<78:24:32,  7.79s/it]
  5%|▍         | 1732/37963 [4:23:41<78:03:18,  7.76s/it]
  5%|▍         | 1733/37963 [4:23:56<99:47:18,  9.92s/it]
  5%|▍         | 1734/37963 [4:24:03<93:01:28,  9.24s/it]
  5%|▍         | 1735/37963 [4:24:11<88:19:09,  8.78s/it]
  5%|▍         | 1736/37963 [4:24:19<85:30:26,  8.50s/it]
  5%|▍         | 1737/37963 [4:24:27<83:02:40,  8.25s/it]
  5%|▍         | 1738/37963 [4:24:34<80:56:11,  8.04s/it]
  5%|▍         | 1739/37963 [4:24:49<101:14:14, 10.06s/it]
  5%|▍         | 1740/37963 [4:24:57<93:57:03,  9.34s/it] 
                                                         
{'loss': '0.1764', 'grad_norm': '5.98', 'learning_rate': '1.999e-05', 'epoch': '0.04583'}
+
  5%|▍         | 1740/37963 [4:24:57<93:57:03,  9.34s/it]
  5%|▍         | 1741/37963 [4:25:04<88:39:32,  8.81s/it]
  5%|▍         | 1742/37963 [4:25:12<85:06:29,  8.46s/it]
  5%|▍         | 1743/37963 [4:25:20<82:44:29,  8.22s/it]
  5%|▍         | 1744/37963 [4:25:27<81:05:06,  8.06s/it]
  5%|▍         | 1745/37963 [4:25:42<102:32:02, 10.19s/it]
  5%|▍         | 1746/37963 [4:25:50<95:14:30,  9.47s/it] 
  5%|▍         | 1747/37963 [4:25:58<89:39:45,  8.91s/it]
  5%|��         | 1748/37963 [4:26:19<128:09:39, 12.74s/it]
  5%|▍         | 1749/37963 [4:26:27<113:28:50, 11.28s/it]
  5%|▍         | 1750/37963 [4:26:35<102:13:13, 10.16s/it]
                                                          
{'loss': '0.1856', 'grad_norm': '2.43', 'learning_rate': '1.999e-05', 'epoch': '0.0461'}
+
  5%|▍         | 1750/37963 [4:26:35<102:13:13, 10.16s/it]
  5%|▍         | 1751/37963 [4:26:43<94:42:13,  9.41s/it] 
  5%|▍         | 1752/37963 [4:26:50<89:33:21,  8.90s/it]
  5%|▍         | 1753/37963 [4:26:58<84:43:41,  8.42s/it]
  5%|▍         | 1754/37963 [4:27:12<102:13:07, 10.16s/it]
  5%|▍         | 1755/37963 [4:27:20<95:06:15,  9.46s/it] 
  5%|▍         | 1756/37963 [4:27:27<89:26:36,  8.89s/it]
  5%|▍         | 1757/37963 [4:27:35<86:00:51,  8.55s/it]
  5%|▍         | 1758/37963 [4:27:43<83:22:19,  8.29s/it]
  5%|▍         | 1759/37963 [4:27:50<81:34:29,  8.11s/it]
  5%|▍         | 1760/37963 [4:27:58<80:04:39,  7.96s/it]
                                                         
{'loss': '0.1783', 'grad_norm': '3.992', 'learning_rate': '1.999e-05', 'epoch': '0.04636'}
+
  5%|▍         | 1760/37963 [4:27:58<80:04:39,  7.96s/it]
  5%|▍         | 1761/37963 [4:28:05<78:36:57,  7.82s/it]
  5%|▍         | 1762/37963 [4:28:13<77:57:32,  7.75s/it]
  5%|▍         | 1763/37963 [4:28:21<77:43:22,  7.73s/it]
  5%|▍         | 1764/37963 [4:28:28<77:22:40,  7.70s/it]
  5%|▍         | 1765/37963 [4:28:36<77:31:21,  7.71s/it]
  5%|▍         | 1766/37963 [4:28:44<76:46:58,  7.64s/it]
  5%|▍         | 1767/37963 [4:28:51<76:45:35,  7.63s/it]
  5%|▍         | 1768/37963 [4:28:59<76:55:53,  7.65s/it]
  5%|▍         | 1769/37963 [4:29:13<96:59:03,  9.65s/it]
  5%|▍         | 1770/37963 [4:29:27<110:00:21, 10.94s/it]
                                                          
{'loss': '0.1866', 'grad_norm': '2.541', 'learning_rate': '1.999e-05', 'epoch': '0.04662'}
+
  5%|▍         | 1770/37963 [4:29:27<110:00:21, 10.94s/it]
  5%|▍         | 1771/37963 [4:29:34<99:12:41,  9.87s/it] 
  5%|▍         | 1772/37963 [4:29:42<91:55:40,  9.14s/it]
  5%|▍         | 1773/37963 [4:29:50<87:56:32,  8.75s/it]
  5%|▍         | 1774/37963 [4:29:57<84:57:24,  8.45s/it]
  5%|▍         | 1775/37963 [4:30:05<82:32:10,  8.21s/it]
  5%|▍         | 1776/37963 [4:30:13<80:44:05,  8.03s/it]
  5%|▍         | 1777/37963 [4:30:28<101:25:44, 10.09s/it]
  5%|▍         | 1778/37963 [4:30:35<93:57:58,  9.35s/it] 
  5%|▍         | 1779/37963 [4:30:43<88:36:27,  8.82s/it]
  5%|▍         | 1780/37963 [4:30:51<85:17:57,  8.49s/it]
                                                         
{'loss': '0.1824', 'grad_norm': '3.438', 'learning_rate': '1.999e-05', 'epoch': '0.04689'}
+
  5%|▍         | 1780/37963 [4:30:51<85:17:57,  8.49s/it]
  5%|▍         | 1781/37963 [4:30:58<82:59:47,  8.26s/it]
  5%|▍         | 1782/37963 [4:31:06<81:24:54,  8.10s/it]
  5%|▍         | 1783/37963 [4:31:14<79:58:46,  7.96s/it]
  5%|▍         | 1784/37963 [4:31:21<79:23:00,  7.90s/it]
  5%|▍         | 1785/37963 [4:31:29<79:35:56,  7.92s/it]
  5%|▍         | 1786/37963 [4:31:37<78:13:05,  7.78s/it]
  5%|▍         | 1787/37963 [4:31:44<76:58:26,  7.66s/it]
  5%|▍         | 1788/37963 [4:31:52<75:52:57,  7.55s/it]
  5%|▍         | 1789/37963 [4:32:07<98:57:20,  9.85s/it]
  5%|▍         | 1790/37963 [4:32:14<92:21:16,  9.19s/it]
                                                         
{'loss': '0.1711', 'grad_norm': '3.763', 'learning_rate': '1.998e-05', 'epoch': '0.04715'}
+
  5%|▍         | 1790/37963 [4:32:14<92:21:16,  9.19s/it]
  5%|▍         | 1791/37963 [4:32:22<88:22:00,  8.79s/it]
  5%|▍         | 1792/37963 [4:32:37<106:32:41, 10.60s/it]
  5%|▍         | 1793/37963 [4:32:52<119:52:11, 11.93s/it]
  5%|▍         | 1794/37963 [4:33:00<107:08:50, 10.66s/it]
  5%|▍         | 1795/37963 [4:33:14<117:51:43, 11.73s/it]
  5%|▍         | 1796/37963 [4:33:22<105:58:05, 10.55s/it]
  5%|▍         | 1797/37963 [4:33:29<97:08:12,  9.67s/it] 
  5%|▍         | 1798/37963 [4:33:37<91:14:32,  9.08s/it]
  5%|▍         | 1799/37963 [4:33:45<86:53:33,  8.65s/it]
  5%|▍         | 1800/37963 [4:33:53<84:13:53,  8.39s/it]
                                                         
{'loss': '0.1827', 'grad_norm': '4.052', 'learning_rate': '1.998e-05', 'epoch': '0.04741'}
+
  5%|▍         | 1800/37963 [4:33:53<84:13:53,  8.39s/it]
  5%|▍         | 1801/37963 [4:34:00<82:28:22,  8.21s/it]
  5%|▍         | 1802/37963 [4:34:15<100:27:15, 10.00s/it]
  5%|▍         | 1803/37963 [4:34:22<93:58:16,  9.36s/it] 
  5%|▍         | 1804/37963 [4:34:30<88:49:18,  8.84s/it]
  5%|▍         | 1805/37963 [4:34:38<85:31:43,  8.52s/it]
  5%|▍         | 1806/37963 [4:34:45<82:47:56,  8.24s/it]
  5%|▍         | 1807/37963 [4:34:53<81:07:05,  8.08s/it]
  5%|▍         | 1808/37963 [4:35:01<79:51:37,  7.95s/it]
  5%|▍         | 1809/37963 [4:35:08<79:03:21,  7.87s/it]
  5%|▍         | 1810/37963 [4:35:16<78:11:37,  7.79s/it]
                                                         
{'loss': '0.1876', 'grad_norm': '2.483', 'learning_rate': '1.998e-05', 'epoch': '0.04768'}
+
  5%|▍         | 1810/37963 [4:35:16<78:11:37,  7.79s/it]
  5%|▍         | 1811/37963 [4:35:24<78:04:33,  7.77s/it]
  5%|▍         | 1812/37963 [4:35:32<78:17:06,  7.80s/it]
  5%|▍         | 1813/37963 [4:35:39<77:56:12,  7.76s/it]
  5%|▍         | 1814/37963 [4:35:47<77:46:02,  7.74s/it]
  5%|▍         | 1815/37963 [4:36:01<96:54:37,  9.65s/it]
  5%|▍         | 1816/37963 [4:36:09<91:26:55,  9.11s/it]
  5%|▍         | 1817/37963 [4:36:17<87:09:30,  8.68s/it]
  5%|▍         | 1818/37963 [4:36:24<83:34:39,  8.32s/it]
  5%|▍         | 1819/37963 [4:36:32<81:30:33,  8.12s/it]
  5%|▍         | 1820/37963 [4:36:39<80:06:06,  7.98s/it]
                                                         
{'loss': '0.1779', 'grad_norm': '3.526', 'learning_rate': '1.998e-05', 'epoch': '0.04794'}
+
  5%|▍         | 1820/37963 [4:36:39<80:06:06,  7.98s/it]
  5%|▍         | 1821/37963 [4:36:47<79:26:42,  7.91s/it]
  5%|▍         | 1822/37963 [4:36:55<78:03:17,  7.78s/it]
  5%|▍         | 1823/37963 [4:37:09<96:52:23,  9.65s/it]
  5%|▍         | 1824/37963 [4:37:16<90:56:19,  9.06s/it]
  5%|▍         | 1825/37963 [4:37:24<87:01:57,  8.67s/it]
  5%|▍         | 1826/37963 [4:37:32<84:06:19,  8.38s/it]
  5%|▍         | 1827/37963 [4:37:39<80:59:45,  8.07s/it]
  5%|▍         | 1828/37963 [4:37:54<101:21:28, 10.10s/it]
  5%|▍         | 1829/37963 [4:38:02<94:02:37,  9.37s/it] 
  5%|▍         | 1830/37963 [4:38:09<88:51:43,  8.85s/it]
                                                         
{'loss': '0.176', 'grad_norm': '2.873', 'learning_rate': '1.998e-05', 'epoch': '0.0482'}
+
  5%|▍         | 1830/37963 [4:38:09<88:51:43,  8.85s/it]
  5%|▍         | 1831/37963 [4:38:17<85:26:37,  8.51s/it]
  5%|▍         | 1832/37963 [4:38:25<82:52:19,  8.26s/it]
  5%|▍         | 1833/37963 [4:38:32<81:04:57,  8.08s/it]
  5%|▍         | 1834/37963 [4:38:40<79:48:26,  7.95s/it]
  5%|▍         | 1835/37963 [4:38:55<100:13:17,  9.99s/it]
  5%|▍         | 1836/37963 [4:39:02<92:59:55,  9.27s/it] 
  5%|▍         | 1837/37963 [4:39:25<133:11:47, 13.27s/it]
  5%|▍         | 1838/37963 [4:39:33<116:26:14, 11.60s/it]
  5%|▍         | 1839/37963 [4:39:47<123:39:10, 12.32s/it]
  5%|▍         | 1840/37963 [4:39:54<109:49:31, 10.95s/it]
                                                          
{'loss': '0.182', 'grad_norm': '2.326', 'learning_rate': '1.998e-05', 'epoch': '0.04847'}
+
  5%|▍         | 1840/37963 [4:39:54<109:49:31, 10.95s/it]
  5%|▍         | 1841/37963 [4:40:02<99:46:27,  9.94s/it] 
  5%|▍         | 1842/37963 [4:40:10<92:43:32,  9.24s/it]
  5%|▍         | 1843/37963 [4:40:17<87:50:56,  8.76s/it]
  5%|▍         | 1844/37963 [4:40:25<85:16:21,  8.50s/it]
  5%|▍         | 1845/37963 [4:40:33<82:55:38,  8.27s/it]
  5%|▍         | 1846/37963 [4:40:41<81:34:09,  8.13s/it]
  5%|▍         | 1847/37963 [4:40:48<80:28:21,  8.02s/it]
  5%|▍         | 1848/37963 [4:40:56<79:24:40,  7.92s/it]
  5%|▍         | 1849/37963 [4:41:04<78:41:22,  7.84s/it]
  5%|▍         | 1850/37963 [4:41:18<97:47:08,  9.75s/it]
                                                         
{'loss': '0.1808', 'grad_norm': '2.519', 'learning_rate': '1.998e-05', 'epoch': '0.04873'}
+
  5%|▍         | 1850/37963 [4:41:18<97:47:08,  9.75s/it]
  5%|▍         | 1851/37963 [4:41:26<92:44:06,  9.24s/it]
  5%|▍         | 1852/37963 [4:41:34<88:13:22,  8.80s/it]
  5%|▍         | 1853/37963 [4:41:42<85:15:33,  8.50s/it]
  5%|▍         | 1854/37963 [4:41:49<82:34:00,  8.23s/it]
  5%|▍         | 1855/37963 [4:41:57<80:57:43,  8.07s/it]
  5%|▍         | 1856/37963 [4:42:04<79:32:17,  7.93s/it]
  5%|▍         | 1857/37963 [4:42:12<78:41:56,  7.85s/it]
  5%|▍         | 1858/37963 [4:42:20<78:41:27,  7.85s/it]
  5%|▍         | 1859/37963 [4:42:28<78:44:49,  7.85s/it]
  5%|▍         | 1860/37963 [4:42:36<78:14:25,  7.80s/it]
                                                         
{'loss': '0.1667', 'grad_norm': '2.134', 'learning_rate': '1.998e-05', 'epoch': '0.049'}
+
  5%|▍         | 1860/37963 [4:42:36<78:14:25,  7.80s/it]
  5%|▍         | 1861/37963 [4:42:43<78:01:03,  7.78s/it]
  5%|▍         | 1862/37963 [4:42:51<77:42:28,  7.75s/it]
  5%|▍         | 1863/37963 [4:42:58<76:56:03,  7.67s/it]
  5%|▍         | 1864/37963 [4:43:06<76:55:48,  7.67s/it]
  5%|▍         | 1865/37963 [4:43:14<76:48:43,  7.66s/it]
  5%|▍         | 1866/37963 [4:43:21<77:06:44,  7.69s/it]
  5%|▍         | 1867/37963 [4:43:29<77:00:53,  7.68s/it]
  5%|▍         | 1868/37963 [4:43:43<96:24:51,  9.62s/it]
  5%|▍         | 1869/37963 [4:43:51<91:07:35,  9.09s/it]
  5%|▍         | 1870/37963 [4:43:59<86:33:44,  8.63s/it]
                                                         
{'loss': '0.1822', 'grad_norm': '3.774', 'learning_rate': '1.998e-05', 'epoch': '0.04926'}
+
  5%|▍         | 1870/37963 [4:43:59<86:33:44,  8.63s/it]
  5%|▍         | 1871/37963 [4:44:13<104:05:37, 10.38s/it]
  5%|▍         | 1872/37963 [4:44:21<96:07:00,  9.59s/it] 
  5%|▍         | 1873/37963 [4:44:29<90:23:32,  9.02s/it]
  5%|▍         | 1874/37963 [4:44:43<107:56:14, 10.77s/it]
  5%|▍         | 1875/37963 [4:44:51<99:19:29,  9.91s/it] 
  5%|▍         | 1876/37963 [4:44:59<92:33:47,  9.23s/it]
  5%|▍         | 1877/37963 [4:45:07<87:45:20,  8.75s/it]
  5%|▍         | 1878/37963 [4:45:14<84:45:51,  8.46s/it]
  5%|▍         | 1879/37963 [4:45:22<82:27:30,  8.23s/it]
  5%|▍         | 1880/37963 [4:45:30<81:32:15,  8.13s/it]
                                                         
{'loss': '0.1727', 'grad_norm': '2.437', 'learning_rate': '1.998e-05', 'epoch': '0.04952'}
+
  5%|▍         | 1880/37963 [4:45:30<81:32:15,  8.13s/it]
  5%|▍         | 1881/37963 [4:45:45<101:45:23, 10.15s/it]
  5%|▍         | 1882/37963 [4:45:52<94:08:18,  9.39s/it] 
  5%|▍         | 1883/37963 [4:46:07<108:49:56, 10.86s/it]
  5%|▍         | 1884/37963 [4:46:14<99:25:27,  9.92s/it] 
  5%|▍         | 1885/37963 [4:46:29<114:41:34, 11.44s/it]
  5%|▍         | 1886/37963 [4:46:37<103:22:06, 10.31s/it]
  5%|▍         | 1887/37963 [4:46:45<95:26:31,  9.52s/it] 
  5%|▍         | 1888/37963 [4:46:53<90:09:20,  9.00s/it]
  5%|▍         | 1889/37963 [4:47:00<86:01:24,  8.58s/it]
  5%|▍         | 1890/37963 [4:47:08<83:17:20,  8.31s/it]
                                                         
{'loss': '0.178', 'grad_norm': '5.75', 'learning_rate': '1.998e-05', 'epoch': '0.04979'}
+
  5%|▍         | 1890/37963 [4:47:08<83:17:20,  8.31s/it]
  5%|▍         | 1891/37963 [4:47:23<102:24:01, 10.22s/it]
  5%|▍         | 1892/37963 [4:47:30<94:00:55,  9.38s/it] 
  5%|▍         | 1893/37963 [4:47:38<88:51:29,  8.87s/it]
  5%|▍         | 1894/37963 [4:47:45<85:25:59,  8.53s/it]
  5%|▍         | 1895/37963 [4:47:53<82:48:15,  8.26s/it]
  5%|▍         | 1896/37963 [4:48:01<81:09:16,  8.10s/it]
  5%|▍         | 1897/37963 [4:48:08<79:48:35,  7.97s/it]
  5%|▍         | 1898/37963 [4:48:22<97:54:10,  9.77s/it]
  5%|▌         | 1899/37963 [4:48:30<92:11:03,  9.20s/it]
  5%|▌         | 1900/37963 [4:48:38<87:41:39,  8.75s/it]
                                                         
{'loss': '0.1765', 'grad_norm': '3.635', 'learning_rate': '1.998e-05', 'epoch': '0.05005'}
+
  5%|▌         | 1900/37963 [4:48:38<87:41:39,  8.75s/it]
  5%|▌         | 1901/37963 [4:48:46<84:34:35,  8.44s/it]
  5%|▌         | 1902/37963 [4:48:53<82:22:05,  8.22s/it]
  5%|▌         | 1903/37963 [4:49:01<80:32:28,  8.04s/it]
  5%|▌         | 1904/37963 [4:49:09<79:36:35,  7.95s/it]
  5%|▌         | 1905/37963 [4:49:17<79:27:44,  7.93s/it]
  5%|▌         | 1906/37963 [4:49:24<78:50:27,  7.87s/it]
  5%|▌         | 1907/37963 [4:49:32<77:16:20,  7.72s/it]
  5%|▌         | 1908/37963 [4:49:39<76:48:25,  7.67s/it]
  5%|▌         | 1909/37963 [4:49:47<75:55:11,  7.58s/it]
  5%|▌         | 1910/37963 [4:49:54<76:08:53,  7.60s/it]
                                                         
{'loss': '0.1806', 'grad_norm': '5.418', 'learning_rate': '1.998e-05', 'epoch': '0.05031'}
+
  5%|▌         | 1910/37963 [4:49:54<76:08:53,  7.60s/it]
  5%|▌         | 1911/37963 [4:50:02<76:42:42,  7.66s/it]
  5%|▌         | 1912/37963 [4:50:16<96:05:50,  9.60s/it]
  5%|▌         | 1913/37963 [4:50:24<90:56:51,  9.08s/it]
  5%|▌         | 1914/37963 [4:50:38<104:53:04, 10.47s/it]
  5%|▌         | 1915/37963 [4:50:46<96:28:35,  9.63s/it] 
  5%|▌         | 1916/37963 [4:50:53<90:33:56,  9.04s/it]
  5%|▌         | 1917/37963 [4:51:01<86:41:55,  8.66s/it]
  5%|▌         | 1918/37963 [4:51:09<83:47:24,  8.37s/it]
  5%|▌         | 1919/37963 [4:51:16<81:33:00,  8.15s/it]
  5%|▌         | 1920/37963 [4:51:24<80:05:10,  8.00s/it]
                                                         
{'loss': '0.1559', 'grad_norm': '6.067', 'learning_rate': '1.998e-05', 'epoch': '0.05058'}
+
  5%|▌         | 1920/37963 [4:51:24<80:05:10,  8.00s/it]
  5%|▌         | 1921/37963 [4:51:31<77:50:43,  7.78s/it]
  5%|▌         | 1922/37963 [4:51:39<77:11:53,  7.71s/it]
  5%|▌         | 1923/37963 [4:51:46<77:00:27,  7.69s/it]
  5%|▌         | 1924/37963 [4:51:54<76:21:29,  7.63s/it]
  5%|▌         | 1925/37963 [4:52:09<97:48:58,  9.77s/it]
  5%|▌         | 1926/37963 [4:52:30<132:38:02, 13.25s/it]
  5%|▌         | 1927/37963 [4:52:38<116:08:56, 11.60s/it]
  5%|▌         | 1928/37963 [4:52:45<104:11:06, 10.41s/it]
  5%|▌         | 1929/37963 [4:52:53<95:25:12,  9.53s/it] 
  5%|▌         | 1930/37963 [4:53:08<111:03:07, 11.10s/it]
                                                          
{'loss': '0.1844', 'grad_norm': '3.121', 'learning_rate': '1.998e-05', 'epoch': '0.05084'}
+
  5%|▌         | 1930/37963 [4:53:08<111:03:07, 11.10s/it]
  5%|▌         | 1931/37963 [4:53:15<100:42:55, 10.06s/it]
  5%|▌         | 1932/37963 [4:53:23<93:49:40,  9.37s/it] 
  5%|▌         | 1933/37963 [4:53:31<88:46:31,  8.87s/it]
  5%|▌         | 1934/37963 [4:53:38<84:58:31,  8.49s/it]
  5%|▌         | 1935/37963 [4:53:46<82:28:51,  8.24s/it]
  5%|▌         | 1936/37963 [4:54:01<102:47:56, 10.27s/it]
  5%|▌         | 1937/37963 [4:54:09<94:48:55,  9.47s/it] 
  5%|▌         | 1938/37963 [4:54:16<89:18:09,  8.92s/it]
  5%|▌         | 1939/37963 [4:54:24<85:17:18,  8.52s/it]
  5%|▌         | 1940/37963 [4:54:32<82:43:53,  8.27s/it]
                                                         
{'loss': '0.1794', 'grad_norm': '2.074', 'learning_rate': '1.998e-05', 'epoch': '0.0511'}
+
  5%|▌         | 1940/37963 [4:54:32<82:43:53,  8.27s/it]
  5%|▌         | 1941/37963 [4:54:39<81:32:47,  8.15s/it]
  5%|▌         | 1942/37963 [4:54:47<79:25:31,  7.94s/it]
  5%|▌         | 1943/37963 [4:54:55<78:35:35,  7.85s/it]
  5%|▌         | 1944/37963 [4:55:02<77:58:54,  7.79s/it]
  5%|▌         | 1945/37963 [4:55:10<77:28:42,  7.74s/it]
  5%|▌         | 1946/37963 [4:55:18<77:25:09,  7.74s/it]
  5%|▌         | 1947/37963 [4:55:25<77:00:57,  7.70s/it]
  5%|▌         | 1948/37963 [4:55:33<76:41:18,  7.67s/it]
  5%|▌         | 1949/37963 [4:55:40<76:30:56,  7.65s/it]
  5%|▌         | 1950/37963 [4:55:55<96:56:51,  9.69s/it]
                                                         
{'loss': '0.1787', 'grad_norm': '4.489', 'learning_rate': '1.998e-05', 'epoch': '0.05137'}
+
  5%|▌         | 1950/37963 [4:55:55<96:56:51,  9.69s/it]
  5%|▌         | 1951/37963 [4:56:02<91:00:15,  9.10s/it]
  5%|▌         | 1952/37963 [4:56:10<86:54:57,  8.69s/it]
  5%|▌         | 1953/37963 [4:56:18<83:47:37,  8.38s/it]
  5%|▌         | 1954/37963 [4:56:26<81:52:37,  8.19s/it]
  5%|▌         | 1955/37963 [4:56:34<81:16:43,  8.13s/it]
  5%|▌         | 1956/37963 [4:56:41<79:58:52,  8.00s/it]
  5%|▌         | 1957/37963 [4:56:49<79:23:49,  7.94s/it]
  5%|▌         | 1958/37963 [4:56:57<79:09:54,  7.92s/it]
  5%|▌         | 1959/37963 [4:57:05<78:17:57,  7.83s/it]
  5%|▌         | 1960/37963 [4:57:12<77:01:52,  7.70s/it]
                                                         
{'loss': '0.1918', 'grad_norm': '3.498', 'learning_rate': '1.998e-05', 'epoch': '0.05163'}
+
  5%|▌         | 1960/37963 [4:57:12<77:01:52,  7.70s/it]
  5%|▌         | 1961/37963 [4:57:20<77:08:30,  7.71s/it]
  5%|▌         | 1962/37963 [4:57:40<115:28:00, 11.55s/it]
  5%|▌         | 1963/37963 [4:57:48<104:07:24, 10.41s/it]
  5%|▌         | 1964/37963 [4:57:56<96:13:08,  9.62s/it] 
  5%|▌         | 1965/37963 [4:58:03<90:17:46,  9.03s/it]
  5%|▌         | 1966/37963 [4:58:11<86:42:51,  8.67s/it]
  5%|▌         | 1967/37963 [4:58:19<83:59:12,  8.40s/it]
  5%|▌         | 1968/37963 [4:58:27<81:44:04,  8.17s/it]
  5%|▌         | 1969/37963 [4:58:34<80:03:31,  8.01s/it]
  5%|▌         | 1970/37963 [4:58:42<78:54:03,  7.89s/it]
                                                         
{'loss': '0.1728', 'grad_norm': '4.025', 'learning_rate': '1.997e-05', 'epoch': '0.05189'}
+
  5%|▌         | 1970/37963 [4:58:42<78:54:03,  7.89s/it]
  5%|▌         | 1971/37963 [4:58:50<78:47:04,  7.88s/it]
  5%|▌         | 1972/37963 [4:58:57<77:57:12,  7.80s/it]
  5%|▌         | 1973/37963 [4:59:05<77:03:40,  7.71s/it]
  5%|▌         | 1974/37963 [4:59:12<76:44:48,  7.68s/it]
  5%|▌         | 1975/37963 [4:59:20<76:55:38,  7.70s/it]
  5%|▌         | 1976/37963 [4:59:35<97:41:12,  9.77s/it]
  5%|▌         | 1977/37963 [4:59:42<90:52:40,  9.09s/it]
  5%|▌         | 1978/37963 [4:59:50<87:01:57,  8.71s/it]
  5%|▌         | 1979/37963 [5:00:19<146:39:34, 14.67s/it]
  5%|▌         | 1980/37963 [5:00:33<146:45:10, 14.68s/it]
                                                          
{'loss': '0.1885', 'grad_norm': '2.091', 'learning_rate': '1.997e-05', 'epoch': '0.05216'}
+
  5%|▌         | 1980/37963 [5:00:33<146:45:10, 14.68s/it]
  5%|▌         | 1981/37963 [5:00:41<126:01:13, 12.61s/it]
  5%|▌         | 1982/37963 [5:00:49<111:21:24, 11.14s/it]
  5%|▌         | 1983/37963 [5:00:57<101:21:29, 10.14s/it]
  5%|▌         | 1984/37963 [5:01:04<94:06:49,  9.42s/it] 
  5%|▌         | 1985/37963 [5:01:12<89:18:41,  8.94s/it]
  5%|▌         | 1986/37963 [5:01:20<85:51:29,  8.59s/it]
  5%|▌         | 1987/37963 [5:01:28<83:12:02,  8.33s/it]
  5%|▌         | 1988/37963 [5:01:35<80:06:50,  8.02s/it]
  5%|▌         | 1989/37963 [5:01:43<79:17:39,  7.94s/it]
  5%|▌         | 1990/37963 [5:01:51<78:44:43,  7.88s/it]
                                                         
{'loss': '0.1708', 'grad_norm': '1.8', 'learning_rate': '1.997e-05', 'epoch': '0.05242'}
+
  5%|▌         | 1990/37963 [5:01:51<78:44:43,  7.88s/it]
  5%|▌         | 1991/37963 [5:01:58<76:58:40,  7.70s/it]
  5%|▌         | 1992/37963 [5:02:06<77:03:57,  7.71s/it]
  5%|▌         | 1993/37963 [5:02:13<77:06:54,  7.72s/it]
  5%|▌         | 1994/37963 [5:02:21<76:57:06,  7.70s/it]
  5%|▌         | 1995/37963 [5:02:29<76:53:21,  7.70s/it]
  5%|▌         | 1996/37963 [5:02:36<76:55:24,  7.70s/it]
  5%|▌         | 1997/37963 [5:02:44<76:32:32,  7.66s/it]
  5%|▌         | 1998/37963 [5:02:58<95:58:55,  9.61s/it]
  5%|▌         | 1999/37963 [5:03:06<90:19:31,  9.04s/it]
  5%|▌         | 2000/37963 [5:03:13<85:52:19,  8.60s/it]
                                                         
{'loss': '0.1764', 'grad_norm': '5.474', 'learning_rate': '1.997e-05', 'epoch': '0.05268'}
+
  5%|▌         | 2000/37963 [5:03:13<85:52:19,  8.60s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.27s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.27s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
  5%|▌         | 2001/37963 [5:04:06<217:00:29, 21.72s/it]
  5%|▌         | 2002/37963 [5:04:13<175:03:42, 17.53s/it]
  5%|▌         | 2003/37963 [5:04:21<144:47:09, 14.49s/it]
  5%|▌         | 2004/37963 [5:04:28<124:05:18, 12.42s/it]
  5%|▌         | 2005/37963 [5:04:36<109:45:15, 10.99s/it]
  5%|▌         | 2006/37963 [5:04:44<99:58:05, 10.01s/it] 
  5%|▌         | 2007/37963 [5:04:52<93:02:10,  9.31s/it]
  5%|▌         | 2008/37963 [5:04:59<87:26:14,  8.75s/it]
  5%|▌         | 2009/37963 [5:05:13<104:35:06, 10.47s/it]
  5%|▌         | 2010/37963 [5:05:21<96:44:52,  9.69s/it] 
                                                         
{'loss': '0.1753', 'grad_norm': '1.495', 'learning_rate': '1.997e-05', 'epoch': '0.05295'}
+
  5%|▌         | 2010/37963 [5:05:21<96:44:52,  9.69s/it]
  5%|▌         | 2011/37963 [5:05:29<91:12:15,  9.13s/it]
  5%|▌         | 2012/37963 [5:05:43<106:22:56, 10.65s/it]
  5%|▌         | 2013/37963 [5:05:51<97:43:02,  9.79s/it] 
  5%|▌         | 2014/37963 [5:05:59<91:12:49,  9.13s/it]
  5%|▌         | 2015/37963 [5:06:06<86:52:31,  8.70s/it]
  5%|▌         | 2016/37963 [5:06:14<84:05:45,  8.42s/it]
  5%|▌         | 2017/37963 [5:06:22<81:15:52,  8.14s/it]
  5%|▌         | 2018/37963 [5:06:30<80:28:22,  8.06s/it]
  5%|▌         | 2019/37963 [5:06:37<79:56:51,  8.01s/it]
  5%|▌         | 2020/37963 [5:06:45<78:25:24,  7.85s/it]
                                                         
{'loss': '0.1867', 'grad_norm': '4.459', 'learning_rate': '1.997e-05', 'epoch': '0.05321'}
+
  5%|▌         | 2020/37963 [5:06:45<78:25:24,  7.85s/it]
  5%|▌         | 2021/37963 [5:06:53<77:41:48,  7.78s/it]
  5%|▌         | 2022/37963 [5:07:00<76:34:37,  7.67s/it]
  5%|▌         | 2023/37963 [5:07:07<75:25:38,  7.56s/it]
  5%|▌         | 2024/37963 [5:07:15<75:05:39,  7.52s/it]
  5%|▌         | 2025/37963 [5:07:30<97:20:38,  9.75s/it]
  5%|▌         | 2026/37963 [5:07:44<111:50:25, 11.20s/it]
  5%|▌         | 2027/37963 [5:07:52<102:33:15, 10.27s/it]
  5%|▌         | 2028/37963 [5:08:00<94:51:33,  9.50s/it] 
  5%|▌         | 2029/37963 [5:08:15<109:49:32, 11.00s/it]
  5%|▌         | 2030/37963 [5:08:36<141:15:48, 14.15s/it]
                                                          
{'loss': '0.1743', 'grad_norm': '3.318', 'learning_rate': '1.997e-05', 'epoch': '0.05347'}
+
  5%|▌         | 2030/37963 [5:08:36<141:15:48, 14.15s/it]
  5%|▌         | 2031/37963 [5:08:44<122:28:18, 12.27s/it]
  5%|▌         | 2032/37963 [5:08:52<108:49:06, 10.90s/it]
  5%|▌         | 2033/37963 [5:08:59<99:24:13,  9.96s/it] 
  5%|▌         | 2034/37963 [5:09:07<92:25:44,  9.26s/it]
  5%|▌         | 2035/37963 [5:09:15<87:29:41,  8.77s/it]
  5%|▌         | 2036/37963 [5:09:22<84:20:31,  8.45s/it]
  5%|▌         | 2037/37963 [5:09:30<82:02:54,  8.22s/it]
  5%|▌         | 2038/37963 [5:09:38<80:26:08,  8.06s/it]
  5%|▌         | 2039/37963 [5:09:45<78:54:42,  7.91s/it]
  5%|▌         | 2040/37963 [5:09:53<77:36:53,  7.78s/it]
                                                         
{'loss': '0.1832', 'grad_norm': '3.695', 'learning_rate': '1.997e-05', 'epoch': '0.05374'}
+
  5%|▌         | 2040/37963 [5:09:53<77:36:53,  7.78s/it]
  5%|▌         | 2041/37963 [5:10:00<77:14:29,  7.74s/it]
  5%|▌         | 2042/37963 [5:10:08<77:16:43,  7.74s/it]
  5%|▌         | 2043/37963 [5:10:16<77:08:22,  7.73s/it]
  5%|▌         | 2044/37963 [5:10:24<77:15:22,  7.74s/it]
  5%|▌         | 2045/37963 [5:10:31<77:03:46,  7.72s/it]
  5%|▌         | 2046/37963 [5:10:39<77:02:56,  7.72s/it]
  5%|▌         | 2047/37963 [5:10:53<96:36:15,  9.68s/it]
  5%|▌         | 2048/37963 [5:11:01<90:28:27,  9.07s/it]
  5%|▌         | 2049/37963 [5:11:09<86:26:09,  8.66s/it]
  5%|▌         | 2050/37963 [5:11:16<83:41:36,  8.39s/it]
                                                         
{'loss': '0.1728', 'grad_norm': '1.757', 'learning_rate': '1.997e-05', 'epoch': '0.054'}
+
  5%|▌         | 2050/37963 [5:11:16<83:41:36,  8.39s/it]
  5%|▌         | 2051/37963 [5:11:24<81:33:30,  8.18s/it]
  5%|▌         | 2052/37963 [5:11:32<79:48:19,  8.00s/it]
  5%|▌         | 2053/37963 [5:11:39<78:41:02,  7.89s/it]
  5%|▌         | 2054/37963 [5:11:47<78:09:50,  7.84s/it]
  5%|▌         | 2055/37963 [5:11:54<77:11:45,  7.74s/it]
  5%|▌         | 2056/37963 [5:12:02<76:58:43,  7.72s/it]
  5%|▌         | 2057/37963 [5:12:10<76:09:57,  7.64s/it]
  5%|▌         | 2058/37963 [5:12:17<76:33:08,  7.68s/it]
  5%|▌         | 2059/37963 [5:12:25<76:47:55,  7.70s/it]
  5%|▌         | 2060/37963 [5:12:33<76:40:12,  7.69s/it]
                                                         
{'loss': '0.1876', 'grad_norm': '2.873', 'learning_rate': '1.997e-05', 'epoch': '0.05426'}
+
  5%|▌         | 2060/37963 [5:12:33<76:40:12,  7.69s/it]
  5%|▌         | 2061/37963 [5:12:47<95:44:51,  9.60s/it]
  5%|▌         | 2062/37963 [5:12:55<90:19:07,  9.06s/it]
  5%|▌         | 2063/37963 [5:13:02<86:16:35,  8.65s/it]
  5%|▌         | 2064/37963 [5:13:10<83:06:03,  8.33s/it]
  5%|▌         | 2065/37963 [5:13:24<101:34:47, 10.19s/it]
  5%|▌         | 2066/37963 [5:13:32<94:55:10,  9.52s/it] 
  5%|▌         | 2067/37963 [5:13:40<89:20:07,  8.96s/it]
  5%|▌         | 2068/37963 [5:13:48<85:38:24,  8.59s/it]
  5%|▌         | 2069/37963 [5:13:55<82:46:35,  8.30s/it]
  5%|▌         | 2070/37963 [5:14:03<81:21:15,  8.16s/it]
                                                         
{'loss': '0.1879', 'grad_norm': '5.634', 'learning_rate': '1.997e-05', 'epoch': '0.05453'}
+
  5%|▌         | 2070/37963 [5:14:03<81:21:15,  8.16s/it]
  5%|▌         | 2071/37963 [5:14:18<101:11:35, 10.15s/it]
  5%|▌         | 2072/37963 [5:14:26<94:06:04,  9.44s/it] 
  5%|▌         | 2073/37963 [5:14:41<110:14:48, 11.06s/it]
  5%|▌         | 2074/37963 [5:14:55<120:20:20, 12.07s/it]
  5%|▌         | 2075/37963 [5:15:10<128:15:59, 12.87s/it]
  5%|▌         | 2076/37963 [5:15:18<113:11:59, 11.36s/it]
  5%|▌         | 2077/37963 [5:15:25<102:06:27, 10.24s/it]
  5%|▌         | 2078/37963 [5:15:33<94:17:46,  9.46s/it] 
  5%|▌         | 2079/37963 [5:15:48<109:56:50, 11.03s/it]
  5%|▌         | 2080/37963 [5:15:55<100:09:46, 10.05s/it]
                                                          
{'loss': '0.1719', 'grad_norm': '4.187', 'learning_rate': '1.997e-05', 'epoch': '0.05479'}
+
  5%|▌         | 2080/37963 [5:15:55<100:09:46, 10.05s/it]
  5%|▌         | 2081/37963 [5:16:03<92:38:30,  9.29s/it] 
  5%|▌         | 2082/37963 [5:16:10<87:27:27,  8.77s/it]
  5%|▌         | 2083/37963 [5:16:18<83:36:24,  8.39s/it]
  5%|▌         | 2084/37963 [5:16:26<81:32:52,  8.18s/it]
  5%|▌         | 2085/37963 [5:16:33<79:50:25,  8.01s/it]
  5%|▌         | 2086/37963 [5:16:41<79:11:58,  7.95s/it]
  5%|▌         | 2087/37963 [5:16:49<78:37:21,  7.89s/it]
  6%|▌         | 2088/37963 [5:16:56<77:11:36,  7.75s/it]
  6%|▌         | 2089/37963 [5:17:04<77:03:58,  7.73s/it]
  6%|▌         | 2090/37963 [5:17:18<95:45:47,  9.61s/it]
                                                         
{'loss': '0.1793', 'grad_norm': '2.932', 'learning_rate': '1.997e-05', 'epoch': '0.05505'}
+
  6%|▌         | 2090/37963 [5:17:18<95:45:47,  9.61s/it]
  6%|▌         | 2091/37963 [5:17:26<90:17:43,  9.06s/it]
  6%|▌         | 2092/37963 [5:17:33<85:34:09,  8.59s/it]
  6%|▌         | 2093/37963 [5:17:41<82:51:26,  8.32s/it]
  6%|▌         | 2094/37963 [5:17:48<80:41:56,  8.10s/it]
  6%|▌         | 2095/37963 [5:17:56<79:37:08,  7.99s/it]
  6%|▌         | 2096/37963 [5:18:04<78:33:13,  7.88s/it]
  6%|▌         | 2097/37963 [5:18:12<77:55:36,  7.82s/it]
  6%|▌         | 2098/37963 [5:18:19<77:26:17,  7.77s/it]
  6%|▌         | 2099/37963 [5:18:27<76:53:29,  7.72s/it]
  6%|▌         | 2100/37963 [5:18:34<76:47:46,  7.71s/it]
                                                         
{'loss': '0.1895', 'grad_norm': '2.392', 'learning_rate': '1.997e-05', 'epoch': '0.05532'}
+
  6%|▌         | 2100/37963 [5:18:34<76:47:46,  7.71s/it]
  6%|▌         | 2101/37963 [5:18:42<77:45:53,  7.81s/it]
  6%|▌         | 2102/37963 [5:18:50<76:57:51,  7.73s/it]
  6%|▌         | 2103/37963 [5:18:58<76:57:54,  7.73s/it]
  6%|▌         | 2104/37963 [5:19:05<75:34:21,  7.59s/it]
  6%|▌         | 2105/37963 [5:19:13<75:17:17,  7.56s/it]
  6%|▌         | 2106/37963 [5:19:20<76:08:55,  7.65s/it]
  6%|▌         | 2107/37963 [5:19:35<95:51:15,  9.62s/it]
  6%|▌         | 2108/37963 [5:19:42<90:23:45,  9.08s/it]
  6%|▌         | 2109/37963 [5:19:50<86:28:10,  8.68s/it]
  6%|▌         | 2110/37963 [5:19:58<82:51:31,  8.32s/it]
                                                         
{'loss': '0.1765', 'grad_norm': '5.487', 'learning_rate': '1.997e-05', 'epoch': '0.05558'}
+
  6%|▌         | 2110/37963 [5:19:58<82:51:31,  8.32s/it]
  6%|▌         | 2111/37963 [5:20:05<80:44:15,  8.11s/it]
  6%|▌         | 2112/37963 [5:20:13<79:09:54,  7.95s/it]
  6%|▌         | 2113/37963 [5:20:21<78:40:38,  7.90s/it]
  6%|▌         | 2114/37963 [5:20:28<78:03:39,  7.84s/it]
  6%|▌         | 2115/37963 [5:20:43<98:45:10,  9.92s/it]
  6%|▌         | 2116/37963 [5:20:51<92:05:44,  9.25s/it]
  6%|▌         | 2117/37963 [5:20:58<87:18:59,  8.77s/it]
  6%|▌         | 2118/37963 [5:21:12<102:20:20, 10.28s/it]
  6%|▌         | 2119/37963 [5:21:26<113:13:36, 11.37s/it]
  6%|▌         | 2120/37963 [5:21:34<102:32:38, 10.30s/it]
                                                          
{'loss': '0.1846', 'grad_norm': '3.377', 'learning_rate': '1.997e-05', 'epoch': '0.05584'}
+
  6%|▌         | 2120/37963 [5:21:34<102:32:38, 10.30s/it]
  6%|▌         | 2121/37963 [5:21:42<94:34:21,  9.50s/it] 
  6%|▌         | 2122/37963 [5:21:49<89:27:56,  8.99s/it]
  6%|▌         | 2123/37963 [5:22:04<106:45:16, 10.72s/it]
  6%|▌         | 2124/37963 [5:22:12<98:18:20,  9.87s/it] 
  6%|▌         | 2125/37963 [5:22:20<91:51:15,  9.23s/it]
  6%|▌         | 2126/37963 [5:22:34<108:07:16, 10.86s/it]
  6%|▌         | 2127/37963 [5:22:50<121:31:10, 12.21s/it]
  6%|▌         | 2128/37963 [5:22:58<108:21:17, 10.89s/it]
  6%|▌         | 2129/37963 [5:23:05<98:46:32,  9.92s/it] 
  6%|▌         | 2130/37963 [5:23:13<92:02:43,  9.25s/it]
                                                         
{'loss': '0.1848', 'grad_norm': '6.558', 'learning_rate': '1.996e-05', 'epoch': '0.05611'}
+
  6%|▌         | 2130/37963 [5:23:13<92:02:43,  9.25s/it]
  6%|▌         | 2131/37963 [5:23:21<88:21:55,  8.88s/it]
  6%|▌         | 2132/37963 [5:23:29<84:59:54,  8.54s/it]
  6%|▌         | 2133/37963 [5:23:36<82:10:55,  8.26s/it]
  6%|▌         | 2134/37963 [5:23:44<80:19:33,  8.07s/it]
  6%|▌         | 2135/37963 [5:23:52<79:23:27,  7.98s/it]
  6%|▌         | 2136/37963 [5:23:59<78:29:27,  7.89s/it]
  6%|▌         | 2137/37963 [5:24:07<77:53:37,  7.83s/it]
  6%|▌         | 2138/37963 [5:24:15<77:36:54,  7.80s/it]
  6%|▌         | 2139/37963 [5:24:23<77:35:11,  7.80s/it]
  6%|▌         | 2140/37963 [5:24:30<77:10:42,  7.76s/it]
                                                         
{'loss': '0.1787', 'grad_norm': '2.112', 'learning_rate': '1.996e-05', 'epoch': '0.05637'}
+
  6%|▌         | 2140/37963 [5:24:30<77:10:42,  7.76s/it]
  6%|▌         | 2141/37963 [5:24:38<76:58:32,  7.74s/it]
  6%|▌         | 2142/37963 [5:24:46<76:52:29,  7.73s/it]
  6%|▌         | 2143/37963 [5:24:54<77:36:19,  7.80s/it]
  6%|▌         | 2144/37963 [5:25:01<77:23:10,  7.78s/it]
  6%|▌         | 2145/37963 [5:25:15<96:10:00,  9.67s/it]
  6%|▌         | 2146/37963 [5:25:23<90:07:32,  9.06s/it]
  6%|▌         | 2147/37963 [5:25:31<85:48:38,  8.63s/it]
  6%|▌         | 2148/37963 [5:25:38<83:01:39,  8.35s/it]
  6%|▌         | 2149/37963 [5:25:46<80:23:49,  8.08s/it]
  6%|▌         | 2150/37963 [5:25:53<79:12:44,  7.96s/it]
                                                         
{'loss': '0.1687', 'grad_norm': '2.011', 'learning_rate': '1.996e-05', 'epoch': '0.05663'}
+
  6%|▌         | 2150/37963 [5:25:53<79:12:44,  7.96s/it]
  6%|▌         | 2151/37963 [5:26:01<78:18:49,  7.87s/it]
  6%|▌         | 2152/37963 [5:26:09<77:46:53,  7.82s/it]
  6%|▌         | 2153/37963 [5:26:17<77:19:45,  7.77s/it]
  6%|▌         | 2154/37963 [5:26:24<76:37:49,  7.70s/it]
  6%|▌         | 2155/37963 [5:26:32<76:29:38,  7.69s/it]
  6%|▌         | 2156/37963 [5:26:39<76:37:04,  7.70s/it]
  6%|▌         | 2157/37963 [5:26:47<76:50:09,  7.73s/it]
  6%|▌         | 2158/37963 [5:26:55<75:47:28,  7.62s/it]
  6%|▌         | 2159/37963 [5:27:02<76:20:31,  7.68s/it]
  6%|▌         | 2160/37963 [5:27:10<76:24:49,  7.68s/it]
                                                         
{'loss': '0.163', 'grad_norm': '3.724', 'learning_rate': '1.996e-05', 'epoch': '0.0569'}
+
  6%|▌         | 2160/37963 [5:27:10<76:24:49,  7.68s/it]
  6%|▌         | 2161/37963 [5:27:24<96:04:54,  9.66s/it]
  6%|▌         | 2162/37963 [5:27:32<89:58:47,  9.05s/it]
  6%|▌         | 2163/37963 [5:27:40<85:32:23,  8.60s/it]
  6%|▌         | 2164/37963 [5:27:47<82:43:12,  8.32s/it]
  6%|▌         | 2165/37963 [5:27:55<81:15:04,  8.17s/it]
  6%|▌         | 2166/37963 [5:28:16<118:02:33, 11.87s/it]
  6%|▌         | 2167/37963 [5:28:23<105:49:42, 10.64s/it]
  6%|▌         | 2168/37963 [5:28:31<97:08:23,  9.77s/it] 
  6%|▌         | 2169/37963 [5:28:46<112:05:47, 11.27s/it]
  6%|▌         | 2170/37963 [5:29:00<120:48:22, 12.15s/it]
                                                          
{'loss': '0.1595', 'grad_norm': '3.484', 'learning_rate': '1.996e-05', 'epoch': '0.05716'}
+
  6%|▌         | 2170/37963 [5:29:00<120:48:22, 12.15s/it]
  6%|▌         | 2171/37963 [5:29:15<129:25:18, 13.02s/it]
  6%|▌         | 2172/37963 [5:29:23<113:24:01, 11.41s/it]
  6%|▌         | 2173/37963 [5:29:31<102:43:56, 10.33s/it]
  6%|▌         | 2174/37963 [5:29:38<94:35:36,  9.52s/it] 
  6%|▌         | 2175/37963 [5:29:46<89:07:34,  8.97s/it]
  6%|▌         | 2176/37963 [5:29:54<85:20:57,  8.59s/it]
  6%|▌         | 2177/37963 [5:30:01<82:51:52,  8.34s/it]
  6%|▌         | 2178/37963 [5:30:09<80:55:35,  8.14s/it]
  6%|▌         | 2179/37963 [5:30:24<102:23:05, 10.30s/it]
  6%|▌         | 2180/37963 [5:30:32<94:49:48,  9.54s/it] 
                                                         
{'loss': '0.1948', 'grad_norm': '3.789', 'learning_rate': '1.996e-05', 'epoch': '0.05742'}
+
  6%|▌         | 2180/37963 [5:30:32<94:49:48,  9.54s/it]
  6%|▌         | 2181/37963 [5:30:40<89:19:17,  8.99s/it]
  6%|▌         | 2182/37963 [5:30:47<85:25:39,  8.60s/it]
  6%|▌         | 2183/37963 [5:30:55<82:47:18,  8.33s/it]
  6%|▌         | 2184/37963 [5:31:03<80:42:29,  8.12s/it]
  6%|▌         | 2185/37963 [5:31:10<79:05:21,  7.96s/it]
  6%|▌         | 2186/37963 [5:31:18<78:31:38,  7.90s/it]
  6%|▌         | 2187/37963 [5:31:26<77:14:56,  7.77s/it]
  6%|▌         | 2188/37963 [5:31:33<76:55:20,  7.74s/it]
  6%|▌         | 2189/37963 [5:31:41<76:37:04,  7.71s/it]
  6%|▌         | 2190/37963 [5:31:49<76:40:42,  7.72s/it]
                                                         
{'loss': '0.1898', 'grad_norm': '8.109', 'learning_rate': '1.996e-05', 'epoch': '0.05769'}
+
  6%|▌         | 2190/37963 [5:31:49<76:40:42,  7.72s/it]
  6%|▌         | 2191/37963 [5:31:56<76:35:13,  7.71s/it]
  6%|▌         | 2192/37963 [5:32:04<76:30:45,  7.70s/it]
  6%|▌         | 2193/37963 [5:32:11<75:37:55,  7.61s/it]
  6%|▌         | 2194/37963 [5:32:19<75:53:50,  7.64s/it]
  6%|▌         | 2195/37963 [5:32:27<75:40:07,  7.62s/it]
  6%|▌         | 2196/37963 [5:32:34<75:55:35,  7.64s/it]
  6%|▌         | 2197/37963 [5:32:49<95:15:06,  9.59s/it]
  6%|▌         | 2198/37963 [5:32:56<89:15:05,  8.98s/it]
  6%|▌         | 2199/37963 [5:33:04<85:16:50,  8.58s/it]
  6%|▌         | 2200/37963 [5:33:11<82:18:52,  8.29s/it]
                                                         
{'loss': '0.1719', 'grad_norm': '1.58', 'learning_rate': '1.996e-05', 'epoch': '0.05795'}
+
  6%|▌         | 2200/37963 [5:33:11<82:18:52,  8.29s/it]
  6%|▌         | 2201/37963 [5:33:19<79:54:26,  8.04s/it]
  6%|▌         | 2202/37963 [5:33:26<78:44:05,  7.93s/it]
  6%|▌         | 2203/37963 [5:33:34<78:11:53,  7.87s/it]
  6%|▌         | 2204/37963 [5:33:42<77:46:44,  7.83s/it]
  6%|▌         | 2205/37963 [5:33:50<77:10:58,  7.77s/it]
  6%|▌         | 2206/37963 [5:33:57<76:58:42,  7.75s/it]
  6%|▌         | 2207/37963 [5:34:05<76:42:03,  7.72s/it]
  6%|▌         | 2208/37963 [5:34:19<95:50:05,  9.65s/it]
  6%|▌         | 2209/37963 [5:34:27<90:02:13,  9.07s/it]
  6%|▌         | 2210/37963 [5:34:34<85:54:20,  8.65s/it]
                                                         
{'loss': '0.1741', 'grad_norm': '4.56', 'learning_rate': '1.996e-05', 'epoch': '0.05821'}
+
  6%|▌         | 2210/37963 [5:34:34<85:54:20,  8.65s/it]
  6%|▌         | 2211/37963 [5:34:42<82:51:03,  8.34s/it]
  6%|▌         | 2212/37963 [5:34:57<101:56:59, 10.27s/it]
  6%|▌         | 2213/37963 [5:35:11<113:29:49, 11.43s/it]
  6%|▌         | 2214/37963 [5:35:25<122:04:22, 12.29s/it]
  6%|▌         | 2215/37963 [5:35:33<108:09:28, 10.89s/it]
  6%|▌         | 2216/37963 [5:35:40<98:02:01,  9.87s/it] 
  6%|▌         | 2217/37963 [5:35:55<111:02:16, 11.18s/it]
  6%|▌         | 2218/37963 [5:36:02<100:43:38, 10.14s/it]
  6%|▌         | 2219/37963 [5:36:10<93:13:07,  9.39s/it] 
  6%|▌         | 2220/37963 [5:36:18<87:52:07,  8.85s/it]
                                                         
{'loss': '0.1631', 'grad_norm': '2.616', 'learning_rate': '1.996e-05', 'epoch': '0.05848'}
+
  6%|▌         | 2220/37963 [5:36:18<87:52:07,  8.85s/it]
  6%|▌         | 2221/37963 [5:36:25<84:24:05,  8.50s/it]
  6%|▌         | 2222/37963 [5:36:33<81:50:07,  8.24s/it]
  6%|▌         | 2223/37963 [5:36:41<80:12:18,  8.08s/it]
  6%|▌         | 2224/37963 [5:36:55<100:08:29, 10.09s/it]
  6%|▌         | 2225/37963 [5:37:03<92:41:38,  9.34s/it] 
  6%|▌         | 2226/37963 [5:37:10<86:32:39,  8.72s/it]
  6%|▌         | 2227/37963 [5:37:25<103:59:09, 10.48s/it]
  6%|▌         | 2228/37963 [5:37:33<95:37:33,  9.63s/it] 
  6%|▌         | 2229/37963 [5:37:40<89:37:03,  9.03s/it]
  6%|▌         | 2230/37963 [5:37:48<85:46:07,  8.64s/it]
                                                         
{'loss': '0.1801', 'grad_norm': '4.993', 'learning_rate': '1.996e-05', 'epoch': '0.05874'}
+
  6%|▌         | 2230/37963 [5:37:48<85:46:07,  8.64s/it]
  6%|▌         | 2231/37963 [5:37:56<83:05:07,  8.37s/it]
  6%|▌         | 2232/37963 [5:38:03<81:10:50,  8.18s/it]
  6%|▌         | 2233/37963 [5:38:11<79:02:54,  7.96s/it]
  6%|▌         | 2234/37963 [5:38:18<78:09:31,  7.88s/it]
  6%|▌         | 2235/37963 [5:38:26<77:22:28,  7.80s/it]
  6%|▌         | 2236/37963 [5:38:34<77:01:09,  7.76s/it]
  6%|▌         | 2237/37963 [5:38:41<76:49:18,  7.74s/it]
  6%|▌         | 2238/37963 [5:38:49<76:29:55,  7.71s/it]
  6%|▌         | 2239/37963 [5:38:57<76:24:35,  7.70s/it]
  6%|▌         | 2240/37963 [5:39:04<75:54:44,  7.65s/it]
                                                         
{'loss': '0.1674', 'grad_norm': '5.734', 'learning_rate': '1.996e-05', 'epoch': '0.05901'}
+
  6%|▌         | 2240/37963 [5:39:04<75:54:44,  7.65s/it]
  6%|▌         | 2241/37963 [5:39:12<75:36:24,  7.62s/it]
  6%|▌         | 2242/37963 [5:39:20<75:48:52,  7.64s/it]
  6%|▌         | 2243/37963 [5:39:27<75:53:46,  7.65s/it]
  6%|▌         | 2244/37963 [5:39:35<75:52:30,  7.65s/it]
  6%|▌         | 2245/37963 [5:39:49<95:00:46,  9.58s/it]
  6%|▌         | 2246/37963 [5:39:57<89:44:12,  9.04s/it]
  6%|▌         | 2247/37963 [5:40:05<85:57:17,  8.66s/it]
  6%|▌         | 2248/37963 [5:40:12<83:12:48,  8.39s/it]
  6%|▌         | 2249/37963 [5:40:20<81:08:37,  8.18s/it]
  6%|▌         | 2250/37963 [5:40:27<79:06:51,  7.98s/it]
                                                         
{'loss': '0.1761', 'grad_norm': '4.148', 'learning_rate': '1.996e-05', 'epoch': '0.05927'}
+
  6%|▌         | 2250/37963 [5:40:27<79:06:51,  7.98s/it]
  6%|▌         | 2251/37963 [5:40:42<98:08:08,  9.89s/it]
  6%|▌         | 2252/37963 [5:40:49<91:04:31,  9.18s/it]
  6%|▌         | 2253/37963 [5:40:57<86:38:17,  8.73s/it]
  6%|▌         | 2254/37963 [5:41:05<83:28:15,  8.42s/it]
  6%|▌         | 2255/37963 [5:41:12<80:35:38,  8.13s/it]
  6%|▌         | 2256/37963 [5:41:20<80:17:29,  8.10s/it]
  6%|▌         | 2257/37963 [5:41:28<79:00:59,  7.97s/it]
  6%|▌         | 2258/37963 [5:41:35<77:19:40,  7.80s/it]
  6%|▌         | 2259/37963 [5:41:43<76:32:23,  7.72s/it]
  6%|▌         | 2260/37963 [5:41:50<76:15:03,  7.69s/it]
                                                         
{'loss': '0.1766', 'grad_norm': '2.703', 'learning_rate': '1.995e-05', 'epoch': '0.05953'}
+
  6%|▌         | 2260/37963 [5:41:50<76:15:03,  7.69s/it]
  6%|▌         | 2261/37963 [5:42:05<95:30:18,  9.63s/it]
  6%|▌         | 2262/37963 [5:42:12<89:55:54,  9.07s/it]
  6%|▌         | 2263/37963 [5:42:20<85:23:43,  8.61s/it]
  6%|▌         | 2264/37963 [5:42:35<103:55:24, 10.48s/it]
  6%|▌         | 2265/37963 [5:42:42<95:38:55,  9.65s/it] 
  6%|▌         | 2266/37963 [5:42:50<90:08:13,  9.09s/it]
  6%|▌         | 2267/37963 [5:43:05<107:15:10, 10.82s/it]
  6%|▌         | 2268/37963 [5:43:20<118:07:41, 11.91s/it]
  6%|▌         | 2269/37963 [5:43:27<106:26:00, 10.73s/it]
  6%|▌         | 2270/37963 [5:43:35<96:45:56,  9.76s/it] 
                                                         
{'loss': '0.1727', 'grad_norm': '4.614', 'learning_rate': '1.995e-05', 'epoch': '0.0598'}
+
  6%|▌         | 2270/37963 [5:43:35<96:45:56,  9.76s/it]
  6%|▌         | 2271/37963 [5:43:50<111:13:19, 11.22s/it]
  6%|▌         | 2272/37963 [5:43:57<101:08:24, 10.20s/it]
  6%|▌         | 2273/37963 [5:44:05<92:31:43,  9.33s/it] 
  6%|▌         | 2274/37963 [5:44:12<87:44:06,  8.85s/it]
  6%|▌         | 2275/37963 [5:44:20<84:46:06,  8.55s/it]
  6%|▌         | 2276/37963 [5:44:28<81:53:36,  8.26s/it]
  6%|▌         | 2277/37963 [5:44:36<80:23:48,  8.11s/it]
  6%|▌         | 2278/37963 [5:44:51<100:44:29, 10.16s/it]
  6%|▌         | 2279/37963 [5:44:58<92:47:06,  9.36s/it] 
  6%|▌         | 2280/37963 [5:45:06<88:01:02,  8.88s/it]
                                                         
{'loss': '0.181', 'grad_norm': '3.041', 'learning_rate': '1.995e-05', 'epoch': '0.06006'}
+
  6%|▌         | 2280/37963 [5:45:06<88:01:02,  8.88s/it]
  6%|▌         | 2281/37963 [5:45:14<84:26:16,  8.52s/it]
  6%|▌         | 2282/37963 [5:45:21<81:44:13,  8.25s/it]
  6%|▌         | 2283/37963 [5:45:29<79:33:43,  8.03s/it]
  6%|▌         | 2284/37963 [5:45:36<78:16:16,  7.90s/it]
  6%|▌         | 2285/37963 [5:45:44<76:22:31,  7.71s/it]
  6%|▌         | 2286/37963 [5:45:51<76:29:13,  7.72s/it]
  6%|▌         | 2287/37963 [5:45:59<76:03:57,  7.68s/it]
  6%|▌         | 2288/37963 [5:46:07<76:18:01,  7.70s/it]
  6%|▌         | 2289/37963 [5:46:14<76:03:56,  7.68s/it]
  6%|▌         | 2290/37963 [5:46:22<76:03:23,  7.68s/it]
                                                         
{'loss': '0.1734', 'grad_norm': '3.962', 'learning_rate': '1.995e-05', 'epoch': '0.06032'}
+
  6%|▌         | 2290/37963 [5:46:22<76:03:23,  7.68s/it]
  6%|▌         | 2291/37963 [5:46:30<76:05:03,  7.68s/it]
  6%|▌         | 2292/37963 [5:46:37<76:06:01,  7.68s/it]
  6%|▌         | 2293/37963 [5:46:52<96:15:46,  9.72s/it]
  6%|▌         | 2294/37963 [5:46:59<89:17:29,  9.01s/it]
  6%|▌         | 2295/37963 [5:47:13<104:18:43, 10.53s/it]
  6%|▌         | 2296/37963 [5:47:21<96:22:16,  9.73s/it] 
  6%|▌         | 2297/37963 [5:47:29<90:04:52,  9.09s/it]
  6%|▌         | 2298/37963 [5:47:36<85:45:50,  8.66s/it]
  6%|▌         | 2299/37963 [5:47:44<82:34:05,  8.33s/it]
  6%|▌         | 2300/37963 [5:47:52<80:46:23,  8.15s/it]
                                                         
{'loss': '0.171', 'grad_norm': '4.533', 'learning_rate': '1.995e-05', 'epoch': '0.06059'}
+
  6%|▌         | 2300/37963 [5:47:52<80:46:23,  8.15s/it]
  6%|▌         | 2301/37963 [5:47:59<78:40:18,  7.94s/it]
  6%|▌         | 2302/37963 [5:48:07<77:44:48,  7.85s/it]
  6%|▌         | 2303/37963 [5:48:14<77:08:53,  7.79s/it]
  6%|▌         | 2304/37963 [5:48:22<76:36:57,  7.73s/it]
  6%|▌         | 2305/37963 [5:48:29<76:05:24,  7.68s/it]
  6%|▌         | 2306/37963 [5:48:37<75:58:49,  7.67s/it]
  6%|▌         | 2307/37963 [5:48:45<76:02:21,  7.68s/it]
  6%|▌         | 2308/37963 [5:48:59<96:06:26,  9.70s/it]
  6%|▌         | 2309/37963 [5:49:07<90:12:56,  9.11s/it]
  6%|▌         | 2310/37963 [5:49:15<85:56:09,  8.68s/it]
                                                         
{'loss': '0.1725', 'grad_norm': '1.642', 'learning_rate': '1.995e-05', 'epoch': '0.06085'}
+
  6%|▌         | 2310/37963 [5:49:15<85:56:09,  8.68s/it]
  6%|▌         | 2311/37963 [5:49:22<83:07:35,  8.39s/it]
  6%|▌         | 2312/37963 [5:49:37<102:30:43, 10.35s/it]
  6%|▌         | 2313/37963 [5:49:45<94:21:45,  9.53s/it] 
  6%|▌         | 2314/37963 [5:49:53<88:51:26,  8.97s/it]
  6%|▌         | 2315/37963 [5:50:00<85:03:35,  8.59s/it]
  6%|▌         | 2316/37963 [5:50:15<103:00:28, 10.40s/it]
  6%|▌         | 2317/37963 [5:50:22<94:04:19,  9.50s/it] 
  6%|▌         | 2318/37963 [5:50:30<88:36:15,  8.95s/it]
  6%|▌         | 2319/37963 [5:50:38<84:58:25,  8.58s/it]
  6%|▌         | 2320/37963 [5:50:52<103:22:33, 10.44s/it]
                                                          
{'loss': '0.1753', 'grad_norm': '3.07', 'learning_rate': '1.995e-05', 'epoch': '0.06111'}
+
  6%|▌         | 2320/37963 [5:50:52<103:22:33, 10.44s/it]
  6%|▌         | 2321/37963 [5:51:00<96:00:39,  9.70s/it] 
  6%|▌         | 2322/37963 [5:51:08<89:38:29,  9.05s/it]
  6%|▌         | 2323/37963 [5:51:16<86:05:06,  8.70s/it]
  6%|▌         | 2324/37963 [5:51:31<104:24:35, 10.55s/it]
  6%|▌         | 2325/37963 [5:51:38<95:57:17,  9.69s/it] 
  6%|▌         | 2326/37963 [5:51:46<89:38:33,  9.06s/it]
  6%|▌         | 2327/37963 [5:52:01<106:30:25, 10.76s/it]
  6%|▌         | 2328/37963 [5:52:09<98:13:58,  9.92s/it] 
  6%|▌         | 2329/37963 [5:52:16<90:59:44,  9.19s/it]
  6%|▌         | 2330/37963 [5:52:24<86:17:47,  8.72s/it]
                                                         
{'loss': '0.1755', 'grad_norm': '3.504', 'learning_rate': '1.995e-05', 'epoch': '0.06138'}
+
  6%|▌         | 2330/37963 [5:52:24<86:17:47,  8.72s/it]
  6%|▌         | 2331/37963 [5:52:31<82:54:02,  8.38s/it]
  6%|▌         | 2332/37963 [5:52:39<80:50:41,  8.17s/it]
  6%|▌         | 2333/37963 [5:52:47<78:58:45,  7.98s/it]
  6%|▌         | 2334/37963 [5:52:54<78:00:42,  7.88s/it]
  6%|▌         | 2335/37963 [5:53:02<77:11:13,  7.80s/it]
  6%|▌         | 2336/37963 [5:53:09<76:42:18,  7.75s/it]
  6%|▌         | 2337/37963 [5:53:17<76:43:16,  7.75s/it]
  6%|▌         | 2338/37963 [5:53:25<76:18:22,  7.71s/it]
  6%|▌         | 2339/37963 [5:53:39<96:03:26,  9.71s/it]
  6%|▌         | 2340/37963 [5:53:47<90:12:25,  9.12s/it]
                                                         
{'loss': '0.1809', 'grad_norm': '8.644', 'learning_rate': '1.995e-05', 'epoch': '0.06164'}
+
  6%|▌         | 2340/37963 [5:53:47<90:12:25,  9.12s/it]
  6%|▌         | 2341/37963 [5:54:01<105:38:35, 10.68s/it]
  6%|▌         | 2342/37963 [5:54:09<96:44:17,  9.78s/it] 
  6%|▌         | 2343/37963 [5:54:17<90:48:07,  9.18s/it]
  6%|▌         | 2344/37963 [5:54:25<86:50:45,  8.78s/it]
  6%|▌         | 2345/37963 [5:54:32<82:40:59,  8.36s/it]
  6%|▌         | 2346/37963 [5:54:40<80:19:22,  8.12s/it]
  6%|▌         | 2347/37963 [5:54:47<78:17:39,  7.91s/it]
  6%|▌         | 2348/37963 [5:54:55<77:27:00,  7.83s/it]
  6%|▌         | 2349/37963 [5:55:02<77:03:35,  7.79s/it]
  6%|▌         | 2350/37963 [5:55:10<77:03:15,  7.79s/it]
                                                         
{'loss': '0.1899', 'grad_norm': '5.48', 'learning_rate': '1.995e-05', 'epoch': '0.0619'}
+
  6%|▌         | 2350/37963 [5:55:10<77:03:15,  7.79s/it]
  6%|▌         | 2351/37963 [5:55:18<76:45:12,  7.76s/it]
  6%|▌         | 2352/37963 [5:55:26<76:43:33,  7.76s/it]
  6%|▌         | 2353/37963 [5:55:33<75:57:35,  7.68s/it]
  6%|▌         | 2354/37963 [5:55:40<75:08:46,  7.60s/it]
  6%|▌         | 2355/37963 [5:55:48<75:32:43,  7.64s/it]
  6%|▌         | 2356/37963 [5:56:02<94:29:07,  9.55s/it]
  6%|▌         | 2357/37963 [5:56:10<89:21:42,  9.04s/it]
  6%|▌         | 2358/37963 [5:56:18<85:16:15,  8.62s/it]
  6%|▌         | 2359/37963 [5:56:25<82:36:14,  8.35s/it]
  6%|▌         | 2360/37963 [5:56:33<80:43:19,  8.16s/it]
                                                         
{'loss': '0.1903', 'grad_norm': '3.213', 'learning_rate': '1.995e-05', 'epoch': '0.06217'}
+
  6%|▌         | 2360/37963 [5:56:33<80:43:19,  8.16s/it]
  6%|▌         | 2361/37963 [5:56:41<79:21:27,  8.02s/it]
  6%|▌         | 2362/37963 [5:56:48<78:18:04,  7.92s/it]
  6%|▌         | 2363/37963 [5:56:56<77:40:09,  7.85s/it]
  6%|▌         | 2364/37963 [5:57:04<77:03:15,  7.79s/it]
  6%|▌         | 2365/37963 [5:57:11<76:11:30,  7.71s/it]
  6%|▌         | 2366/37963 [5:57:26<97:11:12,  9.83s/it]
  6%|▌         | 2367/37963 [5:57:34<90:40:08,  9.17s/it]
  6%|▌         | 2368/37963 [5:57:49<107:29:57, 10.87s/it]
  6%|▌         | 2369/37963 [5:58:03<117:54:05, 11.92s/it]
  6%|▌         | 2370/37963 [5:58:11<105:20:58, 10.66s/it]
                                                          
{'loss': '0.1747', 'grad_norm': '4.619', 'learning_rate': '1.994e-05', 'epoch': '0.06243'}
+
  6%|▌         | 2370/37963 [5:58:11<105:20:58, 10.66s/it]
  6%|▌         | 2371/37963 [5:58:18<97:01:05,  9.81s/it] 
  6%|▌         | 2372/37963 [5:58:26<90:24:42,  9.15s/it]
  6%|▋         | 2373/37963 [5:58:34<86:02:37,  8.70s/it]
  6%|▋         | 2374/37963 [5:58:48<103:02:37, 10.42s/it]
  6%|▋         | 2375/37963 [5:58:56<94:55:15,  9.60s/it] 
  6%|▋         | 2376/37963 [5:59:10<109:27:52, 11.07s/it]
  6%|▋         | 2377/37963 [5:59:18<99:46:12, 10.09s/it] 
  6%|▋         | 2378/37963 [5:59:26<92:35:46,  9.37s/it]
  6%|▋         | 2379/37963 [5:59:34<87:35:56,  8.86s/it]
  6%|▋         | 2380/37963 [5:59:41<84:52:51,  8.59s/it]
                                                         
{'loss': '0.1652', 'grad_norm': '4.142', 'learning_rate': '1.994e-05', 'epoch': '0.06269'}
+
  6%|▋         | 2380/37963 [5:59:41<84:52:51,  8.59s/it]
  6%|▋         | 2381/37963 [5:59:49<81:17:14,  8.22s/it]
  6%|▋         | 2382/37963 [6:00:03<98:46:25,  9.99s/it]
  6%|▋         | 2383/37963 [6:00:11<91:26:45,  9.25s/it]
  6%|▋         | 2384/37963 [6:00:25<105:54:19, 10.72s/it]
  6%|▋         | 2385/37963 [6:00:32<96:48:44,  9.80s/it] 
  6%|▋         | 2386/37963 [6:00:40<90:16:55,  9.14s/it]
  6%|▋         | 2387/37963 [6:00:48<85:51:03,  8.69s/it]
  6%|▋         | 2388/37963 [6:00:55<82:33:17,  8.35s/it]
  6%|▋         | 2389/37963 [6:01:03<80:12:09,  8.12s/it]
  6%|▋         | 2390/37963 [6:01:10<78:52:29,  7.98s/it]
                                                         
{'loss': '0.1838', 'grad_norm': '5.989', 'learning_rate': '1.994e-05', 'epoch': '0.06296'}
+
  6%|▋         | 2390/37963 [6:01:10<78:52:29,  7.98s/it]
  6%|▋         | 2391/37963 [6:01:18<77:48:47,  7.87s/it]
  6%|▋         | 2392/37963 [6:01:26<77:07:29,  7.81s/it]
  6%|▋         | 2393/37963 [6:01:33<76:28:50,  7.74s/it]
  6%|▋         | 2394/37963 [6:01:41<76:23:02,  7.73s/it]
  6%|▋         | 2395/37963 [6:01:49<76:23:37,  7.73s/it]
  6%|▋         | 2396/37963 [6:01:56<76:08:35,  7.71s/it]
  6%|▋         | 2397/37963 [6:02:04<75:49:06,  7.67s/it]
  6%|▋         | 2398/37963 [6:02:12<76:21:10,  7.73s/it]
  6%|▋         | 2399/37963 [6:02:20<76:32:07,  7.75s/it]
  6%|▋         | 2400/37963 [6:02:27<76:16:39,  7.72s/it]
                                                         
{'loss': '0.1707', 'grad_norm': '2.902', 'learning_rate': '1.994e-05', 'epoch': '0.06322'}
+
  6%|▋         | 2400/37963 [6:02:27<76:16:39,  7.72s/it]
  6%|▋         | 2401/37963 [6:02:35<76:15:25,  7.72s/it]
  6%|▋         | 2402/37963 [6:02:43<76:14:39,  7.72s/it]
  6%|▋         | 2403/37963 [6:02:50<76:29:31,  7.74s/it]
  6%|▋         | 2404/37963 [6:02:58<76:09:55,  7.71s/it]
  6%|▋         | 2405/37963 [6:03:06<75:48:43,  7.68s/it]
  6%|▋         | 2406/37963 [6:03:13<75:13:40,  7.62s/it]
  6%|▋         | 2407/37963 [6:03:21<75:20:17,  7.63s/it]
  6%|▋         | 2408/37963 [6:03:29<75:48:39,  7.68s/it]
  6%|▋         | 2409/37963 [6:03:43<94:34:14,  9.58s/it]
  6%|▋         | 2410/37963 [6:03:51<89:41:21,  9.08s/it]
                                                         
{'loss': '0.1768', 'grad_norm': '2.073', 'learning_rate': '1.994e-05', 'epoch': '0.06348'}
+
  6%|▋         | 2410/37963 [6:03:51<89:41:21,  9.08s/it]
  6%|▋         | 2411/37963 [6:03:58<85:46:41,  8.69s/it]
  6%|▋         | 2412/37963 [6:04:13<103:12:25, 10.45s/it]
  6%|▋         | 2413/37963 [6:04:21<95:14:19,  9.64s/it] 
  6%|▋         | 2414/37963 [6:04:28<89:21:38,  9.05s/it]
  6%|▋         | 2415/37963 [6:04:50<125:35:22, 12.72s/it]
  6%|▋         | 2416/37963 [6:04:57<110:47:33, 11.22s/it]
  6%|▋         | 2417/37963 [6:05:05<99:17:57, 10.06s/it] 
  6%|▋         | 2418/37963 [6:05:12<91:54:01,  9.31s/it]
  6%|▋         | 2419/37963 [6:05:20<87:19:30,  8.84s/it]
  6%|▋         | 2420/37963 [6:05:28<83:54:17,  8.50s/it]
                                                         
{'loss': '0.1721', 'grad_norm': '2.14', 'learning_rate': '1.994e-05', 'epoch': '0.06375'}
+
  6%|▋         | 2420/37963 [6:05:28<83:54:17,  8.50s/it]
  6%|▋         | 2421/37963 [6:05:35<81:27:54,  8.25s/it]
  6%|▋         | 2422/37963 [6:05:43<79:37:23,  8.07s/it]
  6%|▋         | 2423/37963 [6:05:50<78:04:13,  7.91s/it]
  6%|▋         | 2424/37963 [6:05:58<77:08:32,  7.81s/it]
  6%|▋         | 2425/37963 [6:06:13<98:08:45,  9.94s/it]
  6%|▋         | 2426/37963 [6:06:21<91:37:01,  9.28s/it]
  6%|▋         | 2427/37963 [6:06:35<106:22:19, 10.78s/it]
  6%|▋         | 2428/37963 [6:06:43<97:39:37,  9.89s/it] 
  6%|▋         | 2429/37963 [6:06:51<91:09:45,  9.24s/it]
  6%|▋         | 2430/37963 [6:06:58<85:48:46,  8.69s/it]
                                                         
{'loss': '0.1681', 'grad_norm': '2.266', 'learning_rate': '1.994e-05', 'epoch': '0.06401'}
+
  6%|▋         | 2430/37963 [6:06:58<85:48:46,  8.69s/it]
  6%|▋         | 2431/37963 [6:07:12<101:51:54, 10.32s/it]
  6%|▋         | 2432/37963 [6:07:20<94:33:51,  9.58s/it] 
  6%|▋         | 2433/37963 [6:07:28<89:16:46,  9.05s/it]
  6%|▋         | 2434/37963 [6:07:36<85:35:33,  8.67s/it]
  6%|▋         | 2435/37963 [6:07:43<82:07:16,  8.32s/it]
  6%|▋         | 2436/37963 [6:07:51<80:32:04,  8.16s/it]
  6%|▋         | 2437/37963 [6:07:59<79:30:57,  8.06s/it]
  6%|▋         | 2438/37963 [6:08:06<78:18:05,  7.93s/it]
  6%|▋         | 2439/37963 [6:08:21<97:00:26,  9.83s/it]
  6%|▋         | 2440/37963 [6:08:28<90:44:46,  9.20s/it]
                                                         
{'loss': '0.181', 'grad_norm': '8.009', 'learning_rate': '1.994e-05', 'epoch': '0.06427'}
+
  6%|▋         | 2440/37963 [6:08:28<90:44:46,  9.20s/it]
  6%|▋         | 2441/37963 [6:08:36<86:17:15,  8.74s/it]
  6%|▋         | 2442/37963 [6:08:44<83:07:08,  8.42s/it]
  6%|▋         | 2443/37963 [6:08:51<81:11:14,  8.23s/it]
  6%|▋         | 2444/37963 [6:08:59<79:32:36,  8.06s/it]
  6%|▋         | 2445/37963 [6:09:07<78:12:13,  7.93s/it]
  6%|▋         | 2446/37963 [6:09:14<76:22:00,  7.74s/it]
  6%|▋         | 2447/37963 [6:09:22<76:24:51,  7.75s/it]
  6%|▋         | 2448/37963 [6:09:29<76:04:51,  7.71s/it]
  6%|▋         | 2449/37963 [6:09:37<75:48:09,  7.68s/it]
  6%|▋         | 2450/37963 [6:09:45<75:45:59,  7.68s/it]
                                                         
{'loss': '0.1546', 'grad_norm': '2.009', 'learning_rate': '1.994e-05', 'epoch': '0.06454'}
+
  6%|▋         | 2450/37963 [6:09:45<75:45:59,  7.68s/it]
  6%|▋         | 2451/37963 [6:09:52<75:58:05,  7.70s/it]
  6%|▋         | 2452/37963 [6:10:00<75:27:50,  7.65s/it]
  6%|▋         | 2453/37963 [6:10:08<75:16:31,  7.63s/it]
  6%|▋         | 2454/37963 [6:10:15<75:13:51,  7.63s/it]
  6%|▋         | 2455/37963 [6:10:22<74:17:39,  7.53s/it]
  6%|▋         | 2456/37963 [6:10:37<94:12:13,  9.55s/it]
  6%|▋         | 2457/37963 [6:10:44<88:36:47,  8.98s/it]
  6%|▋         | 2458/37963 [6:10:52<84:57:23,  8.61s/it]
  6%|▋         | 2459/37963 [6:11:00<81:18:27,  8.24s/it]
  6%|▋         | 2460/37963 [6:11:14<98:58:16, 10.04s/it]
                                                         
{'loss': '0.1624', 'grad_norm': '2.838', 'learning_rate': '1.994e-05', 'epoch': '0.0648'}
+
  6%|▋         | 2460/37963 [6:11:14<98:58:16, 10.04s/it]
  6%|▋         | 2461/37963 [6:11:21<92:07:24,  9.34s/it]
  6%|▋         | 2462/37963 [6:11:29<86:34:06,  8.78s/it]
  6%|▋         | 2463/37963 [6:11:36<82:34:02,  8.37s/it]
  6%|▋         | 2464/37963 [6:11:44<80:51:19,  8.20s/it]
  6%|▋         | 2465/37963 [6:11:52<79:17:42,  8.04s/it]
  6%|▋         | 2466/37963 [6:12:06<98:30:50,  9.99s/it]
  6%|▋         | 2467/37963 [6:12:21<111:23:07, 11.30s/it]
  7%|▋         | 2468/37963 [6:12:28<101:03:43, 10.25s/it]
  7%|▋         | 2469/37963 [6:12:36<93:19:33,  9.47s/it] 
  7%|▋         | 2470/37963 [6:12:51<108:40:23, 11.02s/it]
                                                          
{'loss': '0.1769', 'grad_norm': '2.881', 'learning_rate': '1.994e-05', 'epoch': '0.06506'}
+
  7%|▋         | 2470/37963 [6:12:51<108:40:23, 11.02s/it]
  7%|▋         | 2471/37963 [6:12:58<98:20:50,  9.98s/it] 
  7%|▋         | 2472/37963 [6:13:06<91:22:53,  9.27s/it]
  7%|▋         | 2473/37963 [6:13:14<86:29:27,  8.77s/it]
  7%|▋         | 2474/37963 [6:13:21<83:27:36,  8.47s/it]
  7%|▋         | 2475/37963 [6:13:29<81:05:01,  8.23s/it]
  7%|▋         | 2476/37963 [6:13:37<79:26:57,  8.06s/it]
  7%|▋         | 2477/37963 [6:13:51<97:58:18,  9.94s/it]
  7%|▋         | 2478/37963 [6:13:59<91:31:17,  9.28s/it]
  7%|▋         | 2479/37963 [6:14:06<86:54:34,  8.82s/it]
  7%|▋         | 2480/37963 [6:14:14<83:10:31,  8.44s/it]
                                                         
{'loss': '0.1868', 'grad_norm': '4.516', 'learning_rate': '1.993e-05', 'epoch': '0.06533'}
+
  7%|▋         | 2480/37963 [6:14:14<83:10:31,  8.44s/it]
  7%|▋         | 2481/37963 [6:14:22<81:17:44,  8.25s/it]
  7%|▋         | 2482/37963 [6:14:30<79:59:32,  8.12s/it]
  7%|▋         | 2483/37963 [6:14:37<78:40:30,  7.98s/it]
  7%|▋         | 2484/37963 [6:14:45<77:50:08,  7.90s/it]
  7%|▋         | 2485/37963 [6:14:59<96:48:35,  9.82s/it]
  7%|▋         | 2486/37963 [6:15:07<90:27:45,  9.18s/it]
  7%|▋         | 2487/37963 [6:15:15<85:44:51,  8.70s/it]
  7%|▋         | 2488/37963 [6:15:22<82:50:24,  8.41s/it]
  7%|▋         | 2489/37963 [6:15:30<80:29:22,  8.17s/it]
  7%|▋         | 2490/37963 [6:15:44<99:06:34, 10.06s/it]
                                                         
{'loss': '0.1841', 'grad_norm': '2.626', 'learning_rate': '1.993e-05', 'epoch': '0.06559'}
+
  7%|▋         | 2490/37963 [6:15:44<99:06:34, 10.06s/it]
  7%|▋         | 2491/37963 [6:15:52<91:40:45,  9.30s/it]
  7%|▋         | 2492/37963 [6:15:59<86:29:14,  8.78s/it]
  7%|▋         | 2493/37963 [6:16:07<82:21:24,  8.36s/it]
  7%|▋         | 2494/37963 [6:16:14<79:42:23,  8.09s/it]
  7%|▋         | 2495/37963 [6:16:22<78:21:00,  7.95s/it]
  7%|▋         | 2496/37963 [6:16:30<77:15:38,  7.84s/it]
  7%|▋         | 2497/37963 [6:16:37<76:24:48,  7.76s/it]
  7%|▋         | 2498/37963 [6:16:45<76:10:14,  7.73s/it]
  7%|▋         | 2499/37963 [6:16:52<75:27:17,  7.66s/it]
  7%|▋         | 2500/37963 [6:17:00<75:15:44,  7.64s/it]
                                                         
{'loss': '0.1705', 'grad_norm': '4.831', 'learning_rate': '1.993e-05', 'epoch': '0.06585'}
+
  7%|▋         | 2500/37963 [6:17:00<75:15:44,  7.64s/it]
  7%|▋         | 2501/37963 [6:17:08<75:25:01,  7.66s/it]
  7%|▋         | 2502/37963 [6:17:15<74:47:13,  7.59s/it]
  7%|▋         | 2503/37963 [6:17:23<75:10:21,  7.63s/it]
  7%|▋         | 2504/37963 [6:17:37<95:11:10,  9.66s/it]
  7%|▋         | 2505/37963 [6:17:45<88:48:13,  9.02s/it]
  7%|▋         | 2506/37963 [6:17:52<84:42:07,  8.60s/it]
  7%|▋         | 2507/37963 [6:18:00<82:07:30,  8.34s/it]
  7%|▋         | 2508/37963 [6:18:08<79:46:54,  8.10s/it]
  7%|▋         | 2509/37963 [6:18:23<100:36:46, 10.22s/it]
  7%|▋         | 2510/37963 [6:18:30<93:18:08,  9.47s/it] 
                                                         
{'loss': '0.182', 'grad_norm': '3.905', 'learning_rate': '1.993e-05', 'epoch': '0.06612'}
+
  7%|▋         | 2510/37963 [6:18:30<93:18:08,  9.47s/it]
  7%|▋         | 2511/37963 [6:18:38<88:05:39,  8.95s/it]
  7%|▋         | 2512/37963 [6:18:52<104:06:17, 10.57s/it]
  7%|▋         | 2513/37963 [6:19:00<95:35:22,  9.71s/it] 
  7%|▋         | 2514/37963 [6:19:15<110:35:50, 11.23s/it]
  7%|▋         | 2515/37963 [6:19:23<100:26:57, 10.20s/it]
  7%|▋         | 2516/37963 [6:19:30<93:02:26,  9.45s/it] 
  7%|▋         | 2517/37963 [6:19:38<87:11:52,  8.86s/it]
  7%|▋         | 2518/37963 [6:19:46<84:05:51,  8.54s/it]
  7%|▋         | 2519/37963 [6:20:01<102:52:12, 10.45s/it]
  7%|▋         | 2520/37963 [6:20:08<94:39:16,  9.61s/it] 
                                                         
{'loss': '0.1815', 'grad_norm': '3.711', 'learning_rate': '1.993e-05', 'epoch': '0.06638'}
+
  7%|▋         | 2520/37963 [6:20:08<94:39:16,  9.61s/it]
  7%|▋         | 2521/37963 [6:20:16<89:11:54,  9.06s/it]
  7%|▋         | 2522/37963 [6:20:24<85:25:06,  8.68s/it]
  7%|▋         | 2523/37963 [6:20:32<82:24:41,  8.37s/it]
  7%|▋         | 2524/37963 [6:20:39<79:58:12,  8.12s/it]
  7%|▋         | 2525/37963 [6:20:47<78:25:57,  7.97s/it]
  7%|▋         | 2526/37963 [6:20:54<77:29:54,  7.87s/it]
  7%|▋         | 2527/37963 [6:21:02<76:38:57,  7.79s/it]
  7%|▋         | 2528/37963 [6:21:10<76:30:55,  7.77s/it]
  7%|▋         | 2529/37963 [6:21:17<76:13:30,  7.74s/it]
  7%|▋         | 2530/37963 [6:21:25<75:56:32,  7.72s/it]
                                                         
{'loss': '0.1861', 'grad_norm': '2.489', 'learning_rate': '1.993e-05', 'epoch': '0.06664'}
+
  7%|▋         | 2530/37963 [6:21:25<75:56:32,  7.72s/it]
  7%|▋         | 2531/37963 [6:21:40<96:32:30,  9.81s/it]
  7%|▋         | 2532/37963 [6:21:47<89:40:22,  9.11s/it]
  7%|▋         | 2533/37963 [6:22:01<103:22:01, 10.50s/it]
  7%|▋         | 2534/37963 [6:22:09<95:29:42,  9.70s/it] 
  7%|▋         | 2535/37963 [6:22:16<89:32:30,  9.10s/it]
  7%|▋         | 2536/37963 [6:22:24<85:26:58,  8.68s/it]
  7%|▋         | 2537/37963 [6:22:38<102:03:42, 10.37s/it]
  7%|▋         | 2538/37963 [6:22:46<94:04:50,  9.56s/it] 
  7%|▋         | 2539/37963 [6:22:54<88:51:05,  9.03s/it]
  7%|▋         | 2540/37963 [6:23:01<84:21:31,  8.57s/it]
                                                         
{'loss': '0.1721', 'grad_norm': '2.457', 'learning_rate': '1.993e-05', 'epoch': '0.06691'}
+
  7%|▋         | 2540/37963 [6:23:01<84:21:31,  8.57s/it]
  7%|▋         | 2541/37963 [6:23:09<81:12:47,  8.25s/it]
  7%|▋         | 2542/37963 [6:23:17<79:48:15,  8.11s/it]
  7%|▋         | 2543/37963 [6:23:24<78:23:13,  7.97s/it]
  7%|▋         | 2544/37963 [6:23:32<77:25:40,  7.87s/it]
  7%|▋         | 2545/37963 [6:23:40<76:35:05,  7.78s/it]
  7%|▋         | 2546/37963 [6:23:47<76:29:15,  7.77s/it]
  7%|▋         | 2547/37963 [6:23:55<76:17:49,  7.76s/it]
  7%|▋         | 2548/37963 [6:24:03<76:19:11,  7.76s/it]
  7%|▋         | 2549/37963 [6:24:10<76:06:55,  7.74s/it]
  7%|▋         | 2550/37963 [6:24:18<76:35:07,  7.79s/it]
                                                         
{'loss': '0.16', 'grad_norm': '1.3', 'learning_rate': '1.993e-05', 'epoch': '0.06717'}
+
  7%|▋         | 2550/37963 [6:24:18<76:35:07,  7.79s/it]
  7%|▋         | 2551/37963 [6:24:26<76:14:40,  7.75s/it]
  7%|▋         | 2552/37963 [6:24:40<96:00:26,  9.76s/it]
  7%|▋         | 2553/37963 [6:24:48<89:22:39,  9.09s/it]
  7%|▋         | 2554/37963 [6:24:55<84:22:55,  8.58s/it]
  7%|▋         | 2555/37963 [6:25:03<82:13:14,  8.36s/it]
  7%|▋         | 2556/37963 [6:25:18<102:05:26, 10.38s/it]
  7%|▋         | 2557/37963 [6:25:26<94:42:28,  9.63s/it] 
  7%|▋         | 2558/37963 [6:25:41<109:31:36, 11.14s/it]
  7%|▋         | 2559/37963 [6:25:49<99:30:14, 10.12s/it] 
  7%|▋         | 2560/37963 [6:25:56<92:05:33,  9.36s/it]
                                                         
{'loss': '0.1922', 'grad_norm': '1.356', 'learning_rate': '1.993e-05', 'epoch': '0.06743'}
+
  7%|▋         | 2560/37963 [6:25:56<92:05:33,  9.36s/it]
  7%|▋         | 2561/37963 [6:26:04<87:02:56,  8.85s/it]
  7%|▋         | 2562/37963 [6:26:11<83:19:59,  8.47s/it]
  7%|▋         | 2563/37963 [6:26:19<81:25:06,  8.28s/it]
  7%|▋         | 2564/37963 [6:26:27<79:25:36,  8.08s/it]
  7%|▋         | 2565/37963 [6:26:34<77:55:53,  7.93s/it]
  7%|▋         | 2566/37963 [6:26:50<99:18:13, 10.10s/it]
  7%|▋         | 2567/37963 [6:26:57<92:10:23,  9.37s/it]
  7%|▋         | 2568/37963 [6:27:05<86:29:33,  8.80s/it]
  7%|▋         | 2569/37963 [6:27:12<83:00:44,  8.44s/it]
  7%|▋         | 2570/37963 [6:27:20<81:08:05,  8.25s/it]
                                                         
{'loss': '0.1809', 'grad_norm': '6.248', 'learning_rate': '1.993e-05', 'epoch': '0.0677'}
+
  7%|▋         | 2570/37963 [6:27:20<81:08:05,  8.25s/it]
  7%|▋         | 2571/37963 [6:27:28<79:16:22,  8.06s/it]
  7%|▋         | 2572/37963 [6:27:35<77:22:50,  7.87s/it]
  7%|▋         | 2573/37963 [6:27:43<77:03:43,  7.84s/it]
  7%|▋         | 2574/37963 [6:27:51<77:00:51,  7.83s/it]
  7%|▋         | 2575/37963 [6:27:59<76:47:47,  7.81s/it]
  7%|▋         | 2576/37963 [6:28:06<76:02:45,  7.74s/it]
  7%|▋         | 2577/37963 [6:28:20<95:00:43,  9.67s/it]
  7%|▋         | 2578/37963 [6:28:28<89:35:25,  9.11s/it]
  7%|▋         | 2579/37963 [6:28:36<85:14:43,  8.67s/it]
  7%|▋         | 2580/37963 [6:28:43<81:25:00,  8.28s/it]
                                                         
{'loss': '0.1742', 'grad_norm': '2.95', 'learning_rate': '1.992e-05', 'epoch': '0.06796'}
+
  7%|▋         | 2580/37963 [6:28:43<81:25:00,  8.28s/it]
  7%|▋         | 2581/37963 [6:28:57<98:09:30,  9.99s/it]
  7%|▋         | 2582/37963 [6:29:12<111:35:30, 11.35s/it]
  7%|▋         | 2583/37963 [6:29:19<101:04:28, 10.28s/it]
  7%|▋         | 2584/37963 [6:29:27<93:58:10,  9.56s/it] 
  7%|▋         | 2585/37963 [6:29:35<88:43:21,  9.03s/it]
  7%|▋         | 2586/37963 [6:29:43<84:30:11,  8.60s/it]
  7%|▋         | 2587/37963 [6:29:50<81:46:41,  8.32s/it]
  7%|▋         | 2588/37963 [6:29:58<80:06:30,  8.15s/it]
  7%|▋         | 2589/37963 [6:30:06<77:50:15,  7.92s/it]
  7%|▋         | 2590/37963 [6:30:13<76:31:33,  7.79s/it]
                                                         
{'loss': '0.1892', 'grad_norm': '2.735', 'learning_rate': '1.992e-05', 'epoch': '0.06822'}
+
  7%|▋         | 2590/37963 [6:30:13<76:31:33,  7.79s/it]
  7%|▋         | 2591/37963 [6:30:21<76:03:56,  7.74s/it]
  7%|▋         | 2592/37963 [6:30:28<75:19:06,  7.67s/it]
  7%|▋         | 2593/37963 [6:30:36<74:28:33,  7.58s/it]
  7%|▋         | 2594/37963 [6:30:43<74:02:44,  7.54s/it]
  7%|▋         | 2595/37963 [6:30:51<74:37:43,  7.60s/it]
  7%|▋         | 2596/37963 [6:30:58<74:38:16,  7.60s/it]
  7%|▋         | 2597/37963 [6:31:06<74:41:10,  7.60s/it]
  7%|▋         | 2598/37963 [6:31:14<74:47:54,  7.61s/it]
  7%|▋         | 2599/37963 [6:31:21<75:06:39,  7.65s/it]
  7%|▋         | 2600/37963 [6:31:42<114:37:05, 11.67s/it]
                                                          
{'loss': '0.1771', 'grad_norm': '4.065', 'learning_rate': '1.992e-05', 'epoch': '0.06849'}
+
  7%|▋         | 2600/37963 [6:31:42<114:37:05, 11.67s/it]
  7%|▋         | 2601/37963 [6:31:50<103:20:03, 10.52s/it]
  7%|▋         | 2602/37963 [6:31:58<94:54:19,  9.66s/it] 
  7%|▋         | 2603/37963 [6:32:12<108:09:08, 11.01s/it]
  7%|▋         | 2604/37963 [6:32:27<119:28:26, 12.16s/it]
  7%|▋         | 2605/37963 [6:32:35<106:20:54, 10.83s/it]
  7%|▋         | 2606/37963 [6:32:42<96:56:20,  9.87s/it] 
  7%|▋         | 2607/37963 [6:32:50<89:51:19,  9.15s/it]
  7%|▋         | 2608/37963 [6:32:57<85:21:03,  8.69s/it]
  7%|▋         | 2609/37963 [6:33:05<82:12:04,  8.37s/it]
  7%|▋         | 2610/37963 [6:33:13<80:19:54,  8.18s/it]
                                                         
{'loss': '0.1761', 'grad_norm': '4.617', 'learning_rate': '1.992e-05', 'epoch': '0.06875'}
+
  7%|▋         | 2610/37963 [6:33:13<80:19:54,  8.18s/it]
  7%|▋         | 2611/37963 [6:33:20<78:11:51,  7.96s/it]
  7%|▋         | 2612/37963 [6:33:28<77:15:38,  7.87s/it]
  7%|▋         | 2613/37963 [6:33:35<76:08:38,  7.75s/it]
  7%|▋         | 2614/37963 [6:33:43<75:30:58,  7.69s/it]
  7%|▋         | 2615/37963 [6:33:50<74:12:49,  7.56s/it]
  7%|▋         | 2616/37963 [6:33:58<74:35:53,  7.60s/it]
  7%|▋         | 2617/37963 [6:34:05<73:55:51,  7.53s/it]
  7%|▋         | 2618/37963 [6:34:13<74:10:00,  7.55s/it]
  7%|▋         | 2619/37963 [6:34:28<95:42:54,  9.75s/it]
  7%|▋         | 2620/37963 [6:34:35<89:27:42,  9.11s/it]
                                                         
{'loss': '0.1835', 'grad_norm': '3.146', 'learning_rate': '1.992e-05', 'epoch': '0.06901'}
+
  7%|▋         | 2620/37963 [6:34:35<89:27:42,  9.11s/it]
  7%|▋         | 2621/37963 [6:34:43<85:26:44,  8.70s/it]
  7%|▋         | 2622/37963 [6:34:57<101:32:59, 10.34s/it]
  7%|▋         | 2623/37963 [6:35:05<93:57:48,  9.57s/it] 
  7%|▋         | 2624/37963 [6:35:13<88:44:13,  9.04s/it]
  7%|▋         | 2625/37963 [6:35:27<104:28:44, 10.64s/it]
  7%|▋         | 2626/37963 [6:35:35<95:52:39,  9.77s/it] 
  7%|▋         | 2627/37963 [6:35:42<89:32:27,  9.12s/it]
  7%|▋         | 2628/37963 [6:35:50<85:04:06,  8.67s/it]
  7%|▋         | 2629/37963 [6:36:05<103:01:49, 10.50s/it]
  7%|▋         | 2630/37963 [6:36:12<94:38:52,  9.64s/it] 
                                                         
{'loss': '0.1678', 'grad_norm': '5.02', 'learning_rate': '1.992e-05', 'epoch': '0.06928'}
+
  7%|▋         | 2630/37963 [6:36:12<94:38:52,  9.64s/it]
  7%|▋         | 2631/37963 [6:36:20<89:11:44,  9.09s/it]
  7%|▋         | 2632/37963 [6:36:28<84:19:09,  8.59s/it]
  7%|▋         | 2633/37963 [6:36:35<81:03:59,  8.26s/it]
  7%|▋         | 2634/37963 [6:36:43<78:37:47,  8.01s/it]
  7%|▋         | 2635/37963 [6:36:50<77:34:12,  7.90s/it]
  7%|▋         | 2636/37963 [6:36:58<77:15:41,  7.87s/it]
  7%|▋         | 2637/37963 [6:37:06<76:27:35,  7.79s/it]
  7%|▋         | 2638/37963 [6:37:13<75:56:11,  7.74s/it]
  7%|▋         | 2639/37963 [6:37:21<75:32:04,  7.70s/it]
  7%|▋         | 2640/37963 [6:37:28<75:25:31,  7.69s/it]
                                                         
{'loss': '0.1713', 'grad_norm': '2.352', 'learning_rate': '1.992e-05', 'epoch': '0.06954'}
+
  7%|▋         | 2640/37963 [6:37:28<75:25:31,  7.69s/it]
  7%|▋         | 2641/37963 [6:37:36<75:34:59,  7.70s/it]
  7%|▋         | 2642/37963 [6:37:44<74:39:25,  7.61s/it]
  7%|▋         | 2643/37963 [6:37:51<75:11:26,  7.66s/it]
  7%|▋         | 2644/37963 [6:37:59<74:37:58,  7.61s/it]
  7%|▋         | 2645/37963 [6:38:06<74:23:40,  7.58s/it]
  7%|▋         | 2646/37963 [6:38:14<74:52:44,  7.63s/it]
  7%|▋         | 2647/37963 [6:38:29<95:38:29,  9.75s/it]
  7%|▋         | 2648/37963 [6:38:43<109:45:12, 11.19s/it]
  7%|▋         | 2649/37963 [6:38:51<100:13:35, 10.22s/it]
  7%|▋         | 2650/37963 [6:39:06<114:37:51, 11.69s/it]
                                                          
{'loss': '0.1712', 'grad_norm': '2.039', 'learning_rate': '1.992e-05', 'epoch': '0.06981'}
+
  7%|▋         | 2650/37963 [6:39:06<114:37:51, 11.69s/it]
  7%|▋         | 2651/37963 [6:39:21<121:38:29, 12.40s/it]
  7%|▋         | 2652/37963 [6:39:28<108:08:51, 11.03s/it]
  7%|▋         | 2653/37963 [6:39:36<98:21:32, 10.03s/it] 
  7%|▋         | 2654/37963 [6:39:44<91:24:48,  9.32s/it]
  7%|▋         | 2655/37963 [6:39:51<86:50:41,  8.85s/it]
  7%|▋         | 2656/37963 [6:39:59<83:22:56,  8.50s/it]
  7%|▋         | 2657/37963 [6:40:07<80:57:06,  8.25s/it]
  7%|▋         | 2658/37963 [6:40:15<79:12:35,  8.08s/it]
  7%|▋         | 2659/37963 [6:40:22<78:00:28,  7.95s/it]
  7%|▋         | 2660/37963 [6:40:30<77:25:37,  7.90s/it]
                                                         
{'loss': '0.1766', 'grad_norm': '5.247', 'learning_rate': '1.992e-05', 'epoch': '0.07007'}
+
  7%|▋         | 2660/37963 [6:40:30<77:25:37,  7.90s/it]
  7%|▋         | 2661/37963 [6:40:38<76:44:30,  7.83s/it]
  7%|▋         | 2662/37963 [6:40:45<76:08:07,  7.76s/it]
  7%|▋         | 2663/37963 [6:40:53<76:12:11,  7.77s/it]
  7%|▋         | 2664/37963 [6:41:08<96:07:27,  9.80s/it]
  7%|▋         | 2665/37963 [6:41:15<90:16:32,  9.21s/it]
  7%|▋         | 2666/37963 [6:41:23<85:31:17,  8.72s/it]
  7%|▋         | 2667/37963 [6:41:31<82:11:05,  8.38s/it]
  7%|▋         | 2668/37963 [6:41:38<80:11:48,  8.18s/it]
  7%|▋         | 2669/37963 [6:41:53<98:36:04, 10.06s/it]
  7%|▋         | 2670/37963 [6:42:00<91:35:13,  9.34s/it]
                                                         
{'loss': '0.1679', 'grad_norm': '6.427', 'learning_rate': '1.991e-05', 'epoch': '0.07033'}
+
  7%|▋         | 2670/37963 [6:42:00<91:35:13,  9.34s/it]
  7%|▋         | 2671/37963 [6:42:08<86:32:55,  8.83s/it]
  7%|▋         | 2672/37963 [6:42:15<82:33:33,  8.42s/it]
  7%|▋         | 2673/37963 [6:42:23<80:10:32,  8.18s/it]
  7%|▋         | 2674/37963 [6:42:31<78:33:46,  8.01s/it]
  7%|▋         | 2675/37963 [6:42:38<77:17:24,  7.88s/it]
  7%|▋         | 2676/37963 [6:42:53<96:54:42,  9.89s/it]
  7%|▋         | 2677/37963 [6:43:00<89:17:55,  9.11s/it]
  7%|▋         | 2678/37963 [6:43:15<105:41:27, 10.78s/it]
  7%|▋         | 2679/37963 [6:43:23<96:31:10,  9.85s/it] 
  7%|▋         | 2680/37963 [6:43:30<89:57:41,  9.18s/it]
                                                         
{'loss': '0.1579', 'grad_norm': '1.874', 'learning_rate': '1.991e-05', 'epoch': '0.0706'}
+
  7%|▋         | 2680/37963 [6:43:30<89:57:41,  9.18s/it]
  7%|▋         | 2681/37963 [6:43:38<84:50:05,  8.66s/it]
  7%|▋         | 2682/37963 [6:43:45<81:52:23,  8.35s/it]
  7%|▋         | 2683/37963 [6:43:53<79:53:11,  8.15s/it]
  7%|▋         | 2684/37963 [6:44:01<78:38:36,  8.03s/it]
  7%|▋         | 2685/37963 [6:44:08<77:21:51,  7.89s/it]
  7%|▋         | 2686/37963 [6:44:16<76:32:35,  7.81s/it]
  7%|▋         | 2687/37963 [6:44:24<76:25:50,  7.80s/it]
  7%|▋         | 2688/37963 [6:44:31<75:50:56,  7.74s/it]
  7%|▋         | 2689/37963 [6:44:39<75:33:37,  7.71s/it]
  7%|▋         | 2690/37963 [6:44:46<75:00:39,  7.66s/it]
                                                         
{'loss': '0.1775', 'grad_norm': '2.952', 'learning_rate': '1.991e-05', 'epoch': '0.07086'}
+
  7%|▋         | 2690/37963 [6:44:46<75:00:39,  7.66s/it]
  7%|▋         | 2691/37963 [6:44:53<73:11:11,  7.47s/it]
  7%|▋         | 2692/37963 [6:45:01<72:41:44,  7.42s/it]
  7%|▋         | 2693/37963 [6:45:08<73:13:35,  7.47s/it]
  7%|▋         | 2694/37963 [6:45:16<73:03:44,  7.46s/it]
  7%|▋         | 2695/37963 [6:45:23<73:38:37,  7.52s/it]
  7%|▋         | 2696/37963 [6:45:38<94:52:01,  9.68s/it]
  7%|▋         | 2697/37963 [6:45:46<89:10:21,  9.10s/it]
  7%|▋         | 2698/37963 [6:46:00<103:16:56, 10.54s/it]
  7%|▋         | 2699/37963 [6:46:07<94:53:46,  9.69s/it] 
  7%|▋         | 2700/37963 [6:46:22<110:32:35, 11.29s/it]
                                                          
{'loss': '0.1786', 'grad_norm': '3.751', 'learning_rate': '1.991e-05', 'epoch': '0.07112'}
+
  7%|▋         | 2700/37963 [6:46:22<110:32:35, 11.29s/it]
  7%|▋         | 2701/37963 [6:46:36<118:21:10, 12.08s/it]
  7%|▋         | 2702/37963 [6:46:44<105:17:47, 10.75s/it]
  7%|▋         | 2703/37963 [6:46:52<95:38:27,  9.76s/it] 
  7%|▋         | 2704/37963 [6:46:59<89:37:25,  9.15s/it]
  7%|▋         | 2705/37963 [6:47:07<85:08:32,  8.69s/it]
  7%|▋         | 2706/37963 [6:47:15<82:05:40,  8.38s/it]
  7%|▋         | 2707/37963 [6:47:22<80:13:07,  8.19s/it]
  7%|▋         | 2708/37963 [6:47:30<78:33:34,  8.02s/it]
  7%|▋         | 2709/37963 [6:47:38<77:34:50,  7.92s/it]
  7%|▋         | 2710/37963 [6:47:45<77:05:29,  7.87s/it]
                                                         
{'loss': '0.1686', 'grad_norm': '3.12', 'learning_rate': '1.991e-05', 'epoch': '0.07139'}
+
  7%|▋         | 2710/37963 [6:47:45<77:05:29,  7.87s/it]
  7%|▋         | 2711/37963 [6:47:53<77:05:35,  7.87s/it]
  7%|▋         | 2712/37963 [6:48:08<97:11:40,  9.93s/it]
  7%|▋         | 2713/37963 [6:48:16<90:35:38,  9.25s/it]
  7%|▋         | 2714/37963 [6:48:23<85:36:15,  8.74s/it]
  7%|▋         | 2715/37963 [6:48:37<101:41:30, 10.39s/it]
  7%|▋         | 2716/37963 [6:48:45<92:57:44,  9.49s/it] 
  7%|▋         | 2717/37963 [6:48:52<87:35:20,  8.95s/it]
  7%|▋         | 2718/37963 [6:49:00<83:05:54,  8.49s/it]
  7%|▋         | 2719/37963 [6:49:07<80:18:48,  8.20s/it]
  7%|▋         | 2720/37963 [6:49:15<77:31:03,  7.92s/it]
                                                         
{'loss': '0.1833', 'grad_norm': '3.368', 'learning_rate': '1.991e-05', 'epoch': '0.07165'}
+
  7%|▋         | 2720/37963 [6:49:15<77:31:03,  7.92s/it]
  7%|▋         | 2721/37963 [6:49:22<76:48:22,  7.85s/it]
  7%|▋         | 2722/37963 [6:49:30<76:13:31,  7.79s/it]
  7%|▋         | 2723/37963 [6:49:38<75:55:14,  7.76s/it]
  7%|▋         | 2724/37963 [6:49:46<76:03:27,  7.77s/it]
  7%|▋         | 2725/37963 [6:49:53<75:05:29,  7.67s/it]
  7%|▋         | 2726/37963 [6:50:08<96:30:18,  9.86s/it]
  7%|▋         | 2727/37963 [6:50:15<89:45:03,  9.17s/it]
  7%|▋         | 2728/37963 [6:50:23<85:45:58,  8.76s/it]
  7%|▋         | 2729/37963 [6:50:31<82:03:55,  8.38s/it]
  7%|▋         | 2730/37963 [6:50:45<99:17:28, 10.15s/it]
                                                         
{'loss': '0.1856', 'grad_norm': '1.921', 'learning_rate': '1.991e-05', 'epoch': '0.07191'}
+
  7%|▋         | 2730/37963 [6:50:45<99:17:28, 10.15s/it]
  7%|▋         | 2731/37963 [6:50:53<91:45:00,  9.38s/it]
  7%|▋         | 2732/37963 [6:51:00<87:00:00,  8.89s/it]
  7%|▋         | 2733/37963 [6:51:08<83:25:19,  8.52s/it]
  7%|▋         | 2734/37963 [6:51:16<81:11:11,  8.30s/it]
  7%|▋         | 2735/37963 [6:51:24<79:38:40,  8.14s/it]
  7%|▋         | 2736/37963 [6:51:31<78:16:40,  8.00s/it]
  7%|▋         | 2737/37963 [6:51:39<77:26:25,  7.91s/it]
  7%|▋         | 2738/37963 [6:51:47<77:12:57,  7.89s/it]
  7%|▋         | 2739/37963 [6:51:55<76:46:47,  7.85s/it]
  7%|▋         | 2740/37963 [6:52:02<76:15:41,  7.79s/it]
                                                         
{'loss': '0.1737', 'grad_norm': '3.866', 'learning_rate': '1.991e-05', 'epoch': '0.07218'}
+
  7%|▋         | 2740/37963 [6:52:02<76:15:41,  7.79s/it]
  7%|▋         | 2741/37963 [6:52:10<75:04:30,  7.67s/it]
  7%|▋         | 2742/37963 [6:52:17<75:31:55,  7.72s/it]
  7%|▋         | 2743/37963 [6:52:25<75:17:37,  7.70s/it]
  7%|▋         | 2744/37963 [6:52:33<74:53:02,  7.65s/it]
  7%|▋         | 2745/37963 [6:52:47<95:54:36,  9.80s/it]
  7%|▋         | 2746/37963 [6:52:55<89:55:08,  9.19s/it]
  7%|▋         | 2747/37963 [6:53:03<85:08:03,  8.70s/it]
  7%|▋         | 2748/37963 [6:53:18<102:56:25, 10.52s/it]
  7%|▋         | 2749/37963 [6:53:32<114:58:44, 11.75s/it]
  7%|▋         | 2750/37963 [6:53:46<122:24:25, 12.51s/it]
                                                          
{'loss': '0.1778', 'grad_norm': '5.231', 'learning_rate': '1.991e-05', 'epoch': '0.07244'}
+
  7%|▋         | 2750/37963 [6:53:46<122:24:25, 12.51s/it]
  7%|▋         | 2751/37963 [6:53:54<108:46:24, 11.12s/it]
  7%|▋         | 2752/37963 [6:54:02<98:47:50, 10.10s/it] 
  7%|▋         | 2753/37963 [6:54:10<91:40:14,  9.37s/it]
  7%|▋         | 2754/37963 [6:54:17<86:44:44,  8.87s/it]
  7%|▋         | 2755/37963 [6:54:25<82:43:11,  8.46s/it]
  7%|▋         | 2756/37963 [6:54:32<80:00:18,  8.18s/it]
  7%|▋         | 2757/37963 [6:54:40<78:31:44,  8.03s/it]
  7%|▋         | 2758/37963 [6:54:48<77:19:24,  7.91s/it]
  7%|▋         | 2759/37963 [6:54:55<76:42:26,  7.84s/it]
  7%|▋         | 2760/37963 [6:55:03<76:04:16,  7.78s/it]
                                                         
{'loss': '0.1779', 'grad_norm': '4.588', 'learning_rate': '1.99e-05', 'epoch': '0.0727'}
+
  7%|▋         | 2760/37963 [6:55:03<76:04:16,  7.78s/it]
  7%|▋         | 2761/37963 [6:55:11<75:36:04,  7.73s/it]
  7%|▋         | 2762/37963 [6:55:18<75:29:26,  7.72s/it]
  7%|▋         | 2763/37963 [6:55:26<75:25:06,  7.71s/it]
  7%|▋         | 2764/37963 [6:55:40<94:12:37,  9.64s/it]
  7%|▋         | 2765/37963 [6:55:55<109:11:31, 11.17s/it]
  7%|▋         | 2766/37963 [6:56:03<99:04:57, 10.13s/it] 
  7%|▋         | 2767/37963 [6:56:10<92:05:50,  9.42s/it]
  7%|▋         | 2768/37963 [6:56:18<87:07:33,  8.91s/it]
  7%|▋         | 2769/37963 [6:56:26<83:14:13,  8.51s/it]
  7%|▋         | 2770/37963 [6:56:33<80:40:39,  8.25s/it]
                                                         
{'loss': '0.1708', 'grad_norm': '3.067', 'learning_rate': '1.99e-05', 'epoch': '0.07297'}
+
  7%|▋         | 2770/37963 [6:56:33<80:40:39,  8.25s/it]
  7%|▋         | 2771/37963 [6:56:41<79:01:09,  8.08s/it]
  7%|▋         | 2772/37963 [6:56:48<76:50:15,  7.86s/it]
  7%|▋         | 2773/37963 [6:56:56<76:17:17,  7.80s/it]
  7%|▋         | 2774/37963 [6:57:04<75:52:18,  7.76s/it]
  7%|▋         | 2775/37963 [6:57:11<75:21:02,  7.71s/it]
  7%|▋         | 2776/37963 [6:57:26<95:41:10,  9.79s/it]
  7%|▋         | 2777/37963 [6:57:33<88:47:20,  9.08s/it]
  7%|▋         | 2778/37963 [6:57:41<84:52:54,  8.68s/it]
  7%|▋         | 2779/37963 [6:57:49<81:21:17,  8.32s/it]
  7%|▋         | 2780/37963 [6:57:56<79:18:45,  8.12s/it]
                                                         
{'loss': '0.1681', 'grad_norm': '3.29', 'learning_rate': '1.99e-05', 'epoch': '0.07323'}
+
  7%|▋         | 2780/37963 [6:57:56<79:18:45,  8.12s/it]
  7%|▋         | 2781/37963 [6:58:11<97:25:14,  9.97s/it]
  7%|▋         | 2782/37963 [6:58:18<91:12:35,  9.33s/it]
  7%|▋         | 2783/37963 [6:58:26<85:52:52,  8.79s/it]
  7%|▋         | 2784/37963 [6:58:33<82:08:31,  8.41s/it]
  7%|▋         | 2785/37963 [6:58:41<80:18:20,  8.22s/it]
  7%|▋         | 2786/37963 [6:58:49<79:03:39,  8.09s/it]
  7%|▋         | 2787/37963 [6:58:57<78:06:19,  7.99s/it]
  7%|▋         | 2788/37963 [6:59:05<77:19:15,  7.91s/it]
  7%|▋         | 2789/37963 [6:59:12<75:45:49,  7.75s/it]
  7%|▋         | 2790/37963 [6:59:20<75:30:34,  7.73s/it]
                                                         
{'loss': '0.171', 'grad_norm': '5.044', 'learning_rate': '1.99e-05', 'epoch': '0.07349'}
+
  7%|▋         | 2790/37963 [6:59:20<75:30:34,  7.73s/it]
  7%|▋         | 2791/37963 [6:59:27<75:50:30,  7.76s/it]
  7%|▋         | 2792/37963 [6:59:35<75:50:04,  7.76s/it]
  7%|▋         | 2793/37963 [6:59:50<96:12:26,  9.85s/it]
  7%|▋         | 2794/37963 [7:00:04<109:11:05, 11.18s/it]
  7%|▋         | 2795/37963 [7:00:12<99:51:03, 10.22s/it] 
  7%|▋         | 2796/37963 [7:00:27<112:49:00, 11.55s/it]
  7%|▋         | 2797/37963 [7:00:35<102:02:44, 10.45s/it]
  7%|▋         | 2798/37963 [7:00:49<112:13:37, 11.49s/it]
  7%|▋         | 2799/37963 [7:00:57<101:56:09, 10.44s/it]
  7%|▋         | 2800/37963 [7:01:04<93:56:13,  9.62s/it] 
                                                         
{'loss': '0.1807', 'grad_norm': '6.791', 'learning_rate': '1.99e-05', 'epoch': '0.07376'}
+
  7%|▋         | 2800/37963 [7:01:04<93:56:13,  9.62s/it]
  7%|▋         | 2801/37963 [7:01:12<87:34:34,  8.97s/it]
  7%|▋         | 2802/37963 [7:01:19<83:00:47,  8.50s/it]
  7%|▋         | 2803/37963 [7:01:27<80:46:32,  8.27s/it]
  7%|▋         | 2804/37963 [7:01:35<79:03:45,  8.10s/it]
  7%|▋         | 2805/37963 [7:01:42<77:17:36,  7.91s/it]
  7%|▋         | 2806/37963 [7:01:50<75:54:29,  7.77s/it]
  7%|▋         | 2807/37963 [7:01:57<75:15:48,  7.71s/it]
  7%|▋         | 2808/37963 [7:02:05<74:49:27,  7.66s/it]
  7%|▋         | 2809/37963 [7:02:12<74:44:20,  7.65s/it]
  7%|▋         | 2810/37963 [7:02:20<74:43:03,  7.65s/it]
                                                         
{'loss': '0.1735', 'grad_norm': '2.691', 'learning_rate': '1.99e-05', 'epoch': '0.07402'}
+
  7%|▋         | 2810/37963 [7:02:20<74:43:03,  7.65s/it]
  7%|▋         | 2811/37963 [7:02:28<74:45:08,  7.66s/it]
  7%|▋         | 2812/37963 [7:02:35<74:49:44,  7.66s/it]
  7%|▋         | 2813/37963 [7:02:50<94:23:23,  9.67s/it]
  7%|▋         | 2814/37963 [7:02:57<89:10:43,  9.13s/it]
  7%|▋         | 2815/37963 [7:03:05<84:51:31,  8.69s/it]
  7%|▋         | 2816/37963 [7:03:13<81:44:51,  8.37s/it]
  7%|▋         | 2817/37963 [7:03:27<98:39:32, 10.11s/it]
  7%|▋         | 2818/37963 [7:03:35<91:55:41,  9.42s/it]
  7%|▋         | 2819/37963 [7:03:42<86:53:05,  8.90s/it]
  7%|▋         | 2820/37963 [7:03:50<83:00:53,  8.50s/it]
                                                         
{'loss': '0.1736', 'grad_norm': '2.958', 'learning_rate': '1.99e-05', 'epoch': '0.07428'}
+
  7%|▋         | 2820/37963 [7:03:50<83:00:53,  8.50s/it]
  7%|▋         | 2821/37963 [7:03:58<81:14:08,  8.32s/it]
  7%|▋         | 2822/37963 [7:04:06<79:18:46,  8.13s/it]
  7%|▋         | 2823/37963 [7:04:21<99:38:59, 10.21s/it]
  7%|▋         | 2824/37963 [7:04:28<92:26:52,  9.47s/it]
  7%|▋         | 2825/37963 [7:04:36<87:10:32,  8.93s/it]
  7%|▋         | 2826/37963 [7:04:44<83:19:19,  8.54s/it]
  7%|▋         | 2827/37963 [7:04:51<80:01:53,  8.20s/it]
  7%|▋         | 2828/37963 [7:04:59<78:23:30,  8.03s/it]
  7%|▋         | 2829/37963 [7:05:13<96:49:29,  9.92s/it]
  7%|▋         | 2830/37963 [7:05:21<90:33:53,  9.28s/it]
                                                         
{'loss': '0.1881', 'grad_norm': '4.767', 'learning_rate': '1.99e-05', 'epoch': '0.07455'}
+
  7%|▋         | 2830/37963 [7:05:21<90:33:53,  9.28s/it]
  7%|▋         | 2831/37963 [7:05:28<85:14:14,  8.73s/it]
  7%|▋         | 2832/37963 [7:05:36<82:04:56,  8.41s/it]
  7%|▋         | 2833/37963 [7:05:44<80:04:48,  8.21s/it]
  7%|▋         | 2834/37963 [7:05:51<78:11:16,  8.01s/it]
  7%|▋         | 2835/37963 [7:05:59<77:24:24,  7.93s/it]
  7%|▋         | 2836/37963 [7:06:07<76:50:26,  7.88s/it]
  7%|▋         | 2837/37963 [7:06:14<75:09:33,  7.70s/it]
  7%|▋         | 2838/37963 [7:06:28<94:09:16,  9.65s/it]
  7%|▋         | 2839/37963 [7:06:36<88:22:55,  9.06s/it]
  7%|▋         | 2840/37963 [7:06:51<104:37:01, 10.72s/it]
                                                          
{'loss': '0.1752', 'grad_norm': '4.099', 'learning_rate': '1.99e-05', 'epoch': '0.07481'}
+
  7%|▋         | 2840/37963 [7:06:51<104:37:01, 10.72s/it]
  7%|▋         | 2841/37963 [7:06:58<95:23:07,  9.78s/it] 
  7%|▋         | 2842/37963 [7:07:05<87:54:22,  9.01s/it]
  7%|▋         | 2843/37963 [7:07:13<82:57:42,  8.50s/it]
  7%|▋         | 2844/37963 [7:07:20<80:40:06,  8.27s/it]
  7%|▋         | 2845/37963 [7:07:28<79:11:07,  8.12s/it]
  7%|▋         | 2846/37963 [7:07:43<98:54:27, 10.14s/it]
  7%|▋         | 2847/37963 [7:07:51<91:51:11,  9.42s/it]
  8%|▊         | 2848/37963 [7:07:58<86:39:08,  8.88s/it]
  8%|▊         | 2849/37963 [7:08:12<101:38:44, 10.42s/it]
  8%|▊         | 2850/37963 [7:08:20<93:08:22,  9.55s/it] 
                                                         
{'loss': '0.173', 'grad_norm': '2.25', 'learning_rate': '1.989e-05', 'epoch': '0.07507'}
+
  8%|▊         | 2850/37963 [7:08:20<93:08:22,  9.55s/it]
  8%|▊         | 2851/37963 [7:08:27<87:25:57,  8.96s/it]
  8%|▊         | 2852/37963 [7:08:35<83:26:01,  8.55s/it]
  8%|▊         | 2853/37963 [7:08:43<80:41:14,  8.27s/it]
  8%|▊         | 2854/37963 [7:08:50<78:42:58,  8.07s/it]
  8%|▊         | 2855/37963 [7:08:58<77:37:20,  7.96s/it]
  8%|▊         | 2856/37963 [7:09:05<76:04:43,  7.80s/it]
  8%|▊         | 2857/37963 [7:09:13<75:38:55,  7.76s/it]
  8%|▊         | 2858/37963 [7:09:21<75:24:54,  7.73s/it]
  8%|▊         | 2859/37963 [7:09:28<75:14:01,  7.72s/it]
  8%|▊         | 2860/37963 [7:09:36<75:08:34,  7.71s/it]
                                                         
{'loss': '0.1802', 'grad_norm': '8.362', 'learning_rate': '1.989e-05', 'epoch': '0.07534'}
+
  8%|▊         | 2860/37963 [7:09:36<75:08:34,  7.71s/it]
  8%|▊         | 2861/37963 [7:09:44<74:58:19,  7.69s/it]
  8%|▊         | 2862/37963 [7:09:52<75:10:24,  7.71s/it]
  8%|▊         | 2863/37963 [7:09:59<74:48:09,  7.67s/it]
  8%|▊         | 2864/37963 [7:10:07<74:14:32,  7.61s/it]
  8%|▊         | 2865/37963 [7:10:14<74:20:10,  7.62s/it]
  8%|▊         | 2866/37963 [7:10:22<74:28:36,  7.64s/it]
  8%|▊         | 2867/37963 [7:10:37<95:21:26,  9.78s/it]
  8%|▊         | 2868/37963 [7:10:44<88:52:32,  9.12s/it]
  8%|▊         | 2869/37963 [7:10:52<84:43:42,  8.69s/it]
  8%|▊         | 2870/37963 [7:10:59<80:49:02,  8.29s/it]
                                                         
{'loss': '0.1709', 'grad_norm': '3.427', 'learning_rate': '1.989e-05', 'epoch': '0.0756'}
+
  8%|▊         | 2870/37963 [7:10:59<80:49:02,  8.29s/it]
  8%|▊         | 2871/37963 [7:11:21<119:56:05, 12.30s/it]
  8%|▊         | 2872/37963 [7:11:29<106:31:31, 10.93s/it]
  8%|▊         | 2873/37963 [7:11:36<97:00:02,  9.95s/it] 
  8%|▊         | 2874/37963 [7:11:44<90:02:23,  9.24s/it]
  8%|▊         | 2875/37963 [7:11:51<85:04:48,  8.73s/it]
  8%|▊         | 2876/37963 [7:12:06<101:29:04, 10.41s/it]
  8%|▊         | 2877/37963 [7:12:14<94:27:47,  9.69s/it] 
  8%|▊         | 2878/37963 [7:12:22<88:44:22,  9.11s/it]
  8%|▊         | 2879/37963 [7:12:29<84:10:06,  8.64s/it]
  8%|▊         | 2880/37963 [7:12:37<81:11:27,  8.33s/it]
                                                         
{'loss': '0.1902', 'grad_norm': '4.559', 'learning_rate': '1.989e-05', 'epoch': '0.07586'}
+
  8%|▊         | 2880/37963 [7:12:37<81:11:27,  8.33s/it]
  8%|▊         | 2881/37963 [7:12:44<79:01:56,  8.11s/it]
  8%|▊         | 2882/37963 [7:12:52<77:53:11,  7.99s/it]
  8%|▊         | 2883/37963 [7:13:00<76:55:14,  7.89s/it]
  8%|▊         | 2884/37963 [7:13:07<75:53:37,  7.79s/it]
  8%|▊         | 2885/37963 [7:13:22<96:51:19,  9.94s/it]
  8%|▊         | 2886/37963 [7:13:37<109:44:33, 11.26s/it]
  8%|▊         | 2887/37963 [7:13:44<99:27:07, 10.21s/it] 
  8%|▊         | 2888/37963 [7:13:52<92:06:49,  9.45s/it]
  8%|▊         | 2889/37963 [7:14:00<86:49:06,  8.91s/it]
  8%|▊         | 2890/37963 [7:14:07<82:57:48,  8.52s/it]
                                                         
{'loss': '0.1613', 'grad_norm': '2.686', 'learning_rate': '1.989e-05', 'epoch': '0.07613'}
+
  8%|▊         | 2890/37963 [7:14:07<82:57:48,  8.52s/it]
  8%|▊         | 2891/37963 [7:14:15<80:22:25,  8.25s/it]
  8%|▊         | 2892/37963 [7:14:22<78:30:45,  8.06s/it]
  8%|▊         | 2893/37963 [7:14:30<77:16:49,  7.93s/it]
  8%|▊         | 2894/37963 [7:14:45<97:09:02,  9.97s/it]
  8%|▊         | 2895/37963 [7:14:53<90:57:30,  9.34s/it]
  8%|▊         | 2896/37963 [7:15:07<105:05:26, 10.79s/it]
  8%|▊         | 2897/37963 [7:15:14<95:48:36,  9.84s/it] 
  8%|▊         | 2898/37963 [7:15:22<89:40:14,  9.21s/it]
  8%|▊         | 2899/37963 [7:15:30<84:47:07,  8.70s/it]
  8%|▊         | 2900/37963 [7:15:37<81:12:06,  8.34s/it]
                                                         
{'loss': '0.1523', 'grad_norm': '5.316', 'learning_rate': '1.989e-05', 'epoch': '0.07639'}
+
  8%|▊         | 2900/37963 [7:15:37<81:12:06,  8.34s/it]
  8%|▊         | 2901/37963 [7:15:45<79:17:52,  8.14s/it]
  8%|▊         | 2902/37963 [7:15:53<78:07:55,  8.02s/it]
  8%|▊         | 2903/37963 [7:16:00<76:34:08,  7.86s/it]
  8%|▊         | 2904/37963 [7:16:08<75:45:35,  7.78s/it]
  8%|▊         | 2905/37963 [7:16:16<75:44:31,  7.78s/it]
  8%|▊         | 2906/37963 [7:16:23<74:42:06,  7.67s/it]
  8%|▊         | 2907/37963 [7:16:31<74:31:48,  7.65s/it]
  8%|▊         | 2908/37963 [7:16:38<74:41:13,  7.67s/it]
  8%|▊         | 2909/37963 [7:16:46<74:10:32,  7.62s/it]
  8%|▊         | 2910/37963 [7:16:53<74:24:25,  7.64s/it]
                                                         
{'loss': '0.182', 'grad_norm': '2.633', 'learning_rate': '1.989e-05', 'epoch': '0.07665'}
+
  8%|▊         | 2910/37963 [7:16:53<74:24:25,  7.64s/it]
  8%|▊         | 2911/37963 [7:17:01<74:24:57,  7.64s/it]
  8%|▊         | 2912/37963 [7:17:09<74:38:22,  7.67s/it]
  8%|▊         | 2913/37963 [7:17:24<96:12:06,  9.88s/it]
  8%|▊         | 2914/37963 [7:17:32<89:58:43,  9.24s/it]
  8%|▊         | 2915/37963 [7:17:47<106:39:39, 10.96s/it]
  8%|▊         | 2916/37963 [7:17:54<97:36:42, 10.03s/it] 
  8%|▊         | 2917/37963 [7:18:02<90:07:38,  9.26s/it]
  8%|▊         | 2918/37963 [7:18:09<84:27:47,  8.68s/it]
  8%|▊         | 2919/37963 [7:18:17<81:20:10,  8.36s/it]
  8%|▊         | 2920/37963 [7:18:31<97:22:53, 10.00s/it]
                                                         
{'loss': '0.1746', 'grad_norm': '3.251', 'learning_rate': '1.988e-05', 'epoch': '0.07692'}
+
  8%|▊         | 2920/37963 [7:18:31<97:22:53, 10.00s/it]
  8%|▊         | 2921/37963 [7:18:38<90:28:35,  9.29s/it]
  8%|▊         | 2922/37963 [7:18:46<85:38:46,  8.80s/it]
  8%|▊         | 2923/37963 [7:18:54<82:36:33,  8.49s/it]
  8%|▊         | 2924/37963 [7:19:01<80:00:28,  8.22s/it]
  8%|▊         | 2925/37963 [7:19:15<97:21:17, 10.00s/it]
  8%|▊         | 2926/37963 [7:19:23<91:00:15,  9.35s/it]
  8%|▊         | 2927/37963 [7:19:31<86:14:32,  8.86s/it]
  8%|▊         | 2928/37963 [7:19:39<82:53:46,  8.52s/it]
  8%|▊         | 2929/37963 [7:19:46<80:27:00,  8.27s/it]
  8%|▊         | 2930/37963 [7:20:00<97:19:57, 10.00s/it]
                                                         
{'loss': '0.1627', 'grad_norm': '5.571', 'learning_rate': '1.988e-05', 'epoch': '0.07718'}
+
  8%|▊         | 2930/37963 [7:20:00<97:19:57, 10.00s/it]
  8%|▊         | 2931/37963 [7:20:08<90:29:15,  9.30s/it]
  8%|▊         | 2932/37963 [7:20:15<84:35:08,  8.69s/it]
  8%|▊         | 2933/37963 [7:20:23<81:38:15,  8.39s/it]
  8%|▊         | 2934/37963 [7:20:31<79:41:38,  8.19s/it]
  8%|▊         | 2935/37963 [7:20:39<78:16:06,  8.04s/it]
  8%|▊         | 2936/37963 [7:20:46<77:05:21,  7.92s/it]
  8%|▊         | 2937/37963 [7:20:54<75:48:34,  7.79s/it]
  8%|▊         | 2938/37963 [7:21:09<96:40:09,  9.94s/it]
  8%|▊         | 2939/37963 [7:21:16<90:17:54,  9.28s/it]
  8%|▊         | 2940/37963 [7:21:24<85:42:31,  8.81s/it]
                                                         
{'loss': '0.1829', 'grad_norm': '2.421', 'learning_rate': '1.988e-05', 'epoch': '0.07744'}
+
  8%|▊         | 2940/37963 [7:21:24<85:42:31,  8.81s/it]
  8%|▊         | 2941/37963 [7:21:32<82:13:17,  8.45s/it]
  8%|▊         | 2942/37963 [7:21:39<79:59:03,  8.22s/it]
  8%|▊         | 2943/37963 [7:21:47<78:19:48,  8.05s/it]
  8%|▊         | 2944/37963 [7:21:55<76:43:05,  7.89s/it]
  8%|▊         | 2945/37963 [7:22:02<76:29:42,  7.86s/it]
  8%|▊         | 2946/37963 [7:22:24<116:08:24, 11.94s/it]
  8%|▊         | 2947/37963 [7:22:31<103:29:54, 10.64s/it]
  8%|▊         | 2948/37963 [7:22:39<93:29:58,  9.61s/it] 
  8%|▊         | 2949/37963 [7:22:46<88:04:35,  9.06s/it]
  8%|▊         | 2950/37963 [7:22:54<84:10:46,  8.66s/it]
                                                         
{'loss': '0.1655', 'grad_norm': '2.66', 'learning_rate': '1.988e-05', 'epoch': '0.07771'}
+
  8%|▊         | 2950/37963 [7:22:54<84:10:46,  8.66s/it]
  8%|▊         | 2951/37963 [7:23:02<81:08:13,  8.34s/it]
  8%|▊         | 2952/37963 [7:23:09<79:04:56,  8.13s/it]
  8%|▊         | 2953/37963 [7:23:17<77:26:07,  7.96s/it]
  8%|▊         | 2954/37963 [7:23:25<76:35:42,  7.88s/it]
  8%|▊         | 2955/37963 [7:23:32<75:48:42,  7.80s/it]
  8%|▊         | 2956/37963 [7:23:40<75:19:49,  7.75s/it]
  8%|▊         | 2957/37963 [7:23:48<75:22:52,  7.75s/it]
  8%|▊         | 2958/37963 [7:23:55<75:04:57,  7.72s/it]
  8%|▊         | 2959/37963 [7:24:03<74:56:07,  7.71s/it]
  8%|▊         | 2960/37963 [7:24:10<74:16:58,  7.64s/it]
                                                         
{'loss': '0.172', 'grad_norm': '3.444', 'learning_rate': '1.988e-05', 'epoch': '0.07797'}
+
  8%|▊         | 2960/37963 [7:24:10<74:16:58,  7.64s/it]
  8%|▊         | 2961/37963 [7:24:18<74:49:09,  7.70s/it]
  8%|▊         | 2962/37963 [7:24:26<74:23:45,  7.65s/it]
  8%|▊         | 2963/37963 [7:24:34<74:45:04,  7.69s/it]
  8%|▊         | 2964/37963 [7:24:41<75:08:28,  7.73s/it]
  8%|▊         | 2965/37963 [7:24:49<74:25:54,  7.66s/it]
  8%|▊         | 2966/37963 [7:24:56<73:53:09,  7.60s/it]
  8%|▊         | 2967/37963 [7:25:18<115:13:52, 11.85s/it]
  8%|▊         | 2968/37963 [7:25:26<102:43:53, 10.57s/it]
  8%|▊         | 2969/37963 [7:25:33<94:25:41,  9.71s/it] 
  8%|▊         | 2970/37963 [7:25:41<88:16:27,  9.08s/it]
                                                         
{'loss': '0.1851', 'grad_norm': '1.179', 'learning_rate': '1.988e-05', 'epoch': '0.07823'}
+
  8%|▊         | 2970/37963 [7:25:41<88:16:27,  9.08s/it]
  8%|▊         | 2971/37963 [7:25:48<83:41:16,  8.61s/it]
  8%|▊         | 2972/37963 [7:25:56<80:04:56,  8.24s/it]
  8%|▊         | 2973/37963 [7:26:03<78:14:17,  8.05s/it]
  8%|▊         | 2974/37963 [7:26:18<95:43:29,  9.85s/it]
  8%|▊         | 2975/37963 [7:26:25<89:50:24,  9.24s/it]
  8%|▊         | 2976/37963 [7:26:33<84:56:31,  8.74s/it]
  8%|▊         | 2977/37963 [7:26:41<82:07:02,  8.45s/it]
  8%|▊         | 2978/37963 [7:26:56<101:05:16, 10.40s/it]
  8%|▊         | 2979/37963 [7:27:03<93:38:02,  9.64s/it] 
  8%|▊         | 2980/37963 [7:27:11<87:39:09,  9.02s/it]
                                                         
{'loss': '0.1876', 'grad_norm': '1.527', 'learning_rate': '1.988e-05', 'epoch': '0.0785'}
+
  8%|▊         | 2980/37963 [7:27:11<87:39:09,  9.02s/it]
  8%|▊         | 2981/37963 [7:27:19<84:06:18,  8.66s/it]
  8%|▊         | 2982/37963 [7:27:26<80:59:28,  8.34s/it]
  8%|▊         | 2983/37963 [7:27:34<79:05:56,  8.14s/it]
  8%|▊         | 2984/37963 [7:27:42<76:49:51,  7.91s/it]
  8%|▊         | 2985/37963 [7:27:49<76:00:12,  7.82s/it]
  8%|▊         | 2986/37963 [7:28:04<96:08:26,  9.90s/it]
  8%|▊         | 2987/37963 [7:28:12<89:33:43,  9.22s/it]
  8%|▊         | 2988/37963 [7:28:19<85:19:44,  8.78s/it]
  8%|▊         | 2989/37963 [7:28:27<81:52:50,  8.43s/it]
  8%|▊         | 2990/37963 [7:28:35<79:46:04,  8.21s/it]
                                                         
{'loss': '0.1762', 'grad_norm': '3.551', 'learning_rate': '1.988e-05', 'epoch': '0.07876'}
+
  8%|▊         | 2990/37963 [7:28:35<79:46:04,  8.21s/it]
  8%|▊         | 2991/37963 [7:28:42<77:25:30,  7.97s/it]
  8%|▊         | 2992/37963 [7:28:50<76:54:04,  7.92s/it]
  8%|▊         | 2993/37963 [7:28:57<76:05:17,  7.83s/it]
  8%|▊         | 2994/37963 [7:29:11<94:05:19,  9.69s/it]
  8%|▊         | 2995/37963 [7:29:19<88:06:28,  9.07s/it]
  8%|▊         | 2996/37963 [7:29:27<83:37:13,  8.61s/it]
  8%|▊         | 2997/37963 [7:29:34<79:17:51,  8.16s/it]
  8%|▊         | 2998/37963 [7:29:49<98:51:25, 10.18s/it]
  8%|▊         | 2999/37963 [7:29:56<91:26:26,  9.42s/it]
  8%|▊         | 3000/37963 [7:30:04<86:20:54,  8.89s/it]
                                                         
{'loss': '0.1615', 'grad_norm': '2.579', 'learning_rate': '1.987e-05', 'epoch': '0.07902'}
+
  8%|▊         | 3000/37963 [7:30:04<86:20:54,  8.89s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.44s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.44s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
  8%|▊         | 3001/37963 [7:30:56<212:03:52, 21.84s/it]
  8%|▊         | 3002/37963 [7:31:04<171:09:22, 17.62s/it]
  8%|▊         | 3003/37963 [7:31:11<141:34:41, 14.58s/it]
  8%|▊         | 3004/37963 [7:31:19<121:20:28, 12.50s/it]
  8%|▊         | 3005/37963 [7:31:26<107:06:19, 11.03s/it]
  8%|▊         | 3006/37963 [7:31:34<97:43:49, 10.06s/it] 
  8%|▊         | 3007/37963 [7:31:42<90:28:11,  9.32s/it]
  8%|▊         | 3008/37963 [7:31:50<85:43:41,  8.83s/it]
  8%|▊         | 3009/37963 [7:31:57<81:50:22,  8.43s/it]
  8%|▊         | 3010/37963 [7:32:05<79:25:08,  8.18s/it]
                                                         
{'loss': '0.1803', 'grad_norm': '3.29', 'learning_rate': '1.987e-05', 'epoch': '0.07929'}
+
  8%|▊         | 3010/37963 [7:32:05<79:25:08,  8.18s/it]
  8%|▊         | 3011/37963 [7:32:12<78:07:43,  8.05s/it]
  8%|▊         | 3012/37963 [7:32:20<77:16:48,  7.96s/it]
  8%|▊         | 3013/37963 [7:32:35<98:37:16, 10.16s/it]
  8%|▊         | 3014/37963 [7:32:51<113:19:20, 11.67s/it]
  8%|▊         | 3015/37963 [7:32:58<101:53:28, 10.50s/it]
  8%|▊         | 3016/37963 [7:33:06<93:28:37,  9.63s/it] 
  8%|▊         | 3017/37963 [7:33:14<87:29:44,  9.01s/it]
  8%|▊         | 3018/37963 [7:33:28<103:17:03, 10.64s/it]
  8%|▊         | 3019/37963 [7:33:36<94:40:24,  9.75s/it] 
  8%|▊         | 3020/37963 [7:33:43<88:39:11,  9.13s/it]
                                                         
{'loss': '0.1634', 'grad_norm': '3.906', 'learning_rate': '1.987e-05', 'epoch': '0.07955'}
+
  8%|▊         | 3020/37963 [7:33:43<88:39:11,  9.13s/it]
  8%|▊         | 3021/37963 [7:33:58<103:52:29, 10.70s/it]
  8%|▊         | 3022/37963 [7:34:05<94:14:00,  9.71s/it] 
  8%|▊         | 3023/37963 [7:34:13<88:15:51,  9.09s/it]
  8%|▊         | 3024/37963 [7:34:21<84:19:32,  8.69s/it]
  8%|▊         | 3025/37963 [7:34:28<81:18:01,  8.38s/it]
  8%|▊         | 3026/37963 [7:34:36<79:23:45,  8.18s/it]
  8%|▊         | 3027/37963 [7:34:50<97:29:26, 10.05s/it]
  8%|▊         | 3028/37963 [7:34:58<90:06:27,  9.29s/it]
  8%|▊         | 3029/37963 [7:35:05<85:16:02,  8.79s/it]
  8%|▊         | 3030/37963 [7:35:13<81:43:28,  8.42s/it]
                                                         
{'loss': '0.1564', 'grad_norm': '4.696', 'learning_rate': '1.987e-05', 'epoch': '0.07981'}
+
  8%|▊         | 3030/37963 [7:35:13<81:43:28,  8.42s/it]
  8%|▊         | 3031/37963 [7:35:28<101:24:12, 10.45s/it]
  8%|▊         | 3032/37963 [7:35:36<92:48:01,  9.56s/it] 
  8%|▊         | 3033/37963 [7:35:43<86:58:28,  8.96s/it]
  8%|▊         | 3034/37963 [7:35:51<83:12:46,  8.58s/it]
  8%|▊         | 3035/37963 [7:35:59<80:36:50,  8.31s/it]
  8%|▊         | 3036/37963 [7:36:06<78:49:06,  8.12s/it]
  8%|▊         | 3037/37963 [7:36:14<77:24:37,  7.98s/it]
  8%|▊         | 3038/37963 [7:36:22<76:33:43,  7.89s/it]
  8%|▊         | 3039/37963 [7:36:29<75:48:34,  7.81s/it]
  8%|▊         | 3040/37963 [7:36:37<75:47:28,  7.81s/it]
                                                         
{'loss': '0.1631', 'grad_norm': '2.628', 'learning_rate': '1.987e-05', 'epoch': '0.08008'}
+
  8%|▊         | 3040/37963 [7:36:37<75:47:28,  7.81s/it]
  8%|▊         | 3041/37963 [7:36:45<75:39:07,  7.80s/it]
  8%|▊         | 3042/37963 [7:36:53<75:39:21,  7.80s/it]
  8%|▊         | 3043/37963 [7:37:00<75:27:01,  7.78s/it]
  8%|▊         | 3044/37963 [7:37:08<75:06:31,  7.74s/it]
  8%|▊         | 3045/37963 [7:37:23<96:57:20, 10.00s/it]
  8%|▊         | 3046/37963 [7:37:31<89:44:13,  9.25s/it]
  8%|▊         | 3047/37963 [7:37:45<104:15:16, 10.75s/it]
  8%|▊         | 3048/37963 [7:37:53<95:23:59,  9.84s/it] 
  8%|▊         | 3049/37963 [7:38:00<88:29:24,  9.12s/it]
  8%|▊         | 3050/37963 [7:38:08<84:56:25,  8.76s/it]
                                                         
{'loss': '0.1763', 'grad_norm': '4.298', 'learning_rate': '1.987e-05', 'epoch': '0.08034'}
+
  8%|▊         | 3050/37963 [7:38:08<84:56:25,  8.76s/it]
  8%|▊         | 3051/37963 [7:38:16<81:44:59,  8.43s/it]
  8%|▊         | 3052/37963 [7:38:23<78:36:59,  8.11s/it]
  8%|▊         | 3053/37963 [7:38:31<77:08:20,  7.95s/it]
  8%|▊         | 3054/37963 [7:38:38<76:29:41,  7.89s/it]
  8%|▊         | 3055/37963 [7:38:46<75:43:51,  7.81s/it]
  8%|▊         | 3056/37963 [7:38:54<75:19:41,  7.77s/it]
  8%|▊         | 3057/37963 [7:39:01<74:23:07,  7.67s/it]
  8%|▊         | 3058/37963 [7:39:09<74:22:55,  7.67s/it]
  8%|▊         | 3059/37963 [7:39:16<74:00:33,  7.63s/it]
  8%|▊         | 3060/37963 [7:39:24<74:38:28,  7.70s/it]
                                                         
{'loss': '0.1771', 'grad_norm': '1.868', 'learning_rate': '1.987e-05', 'epoch': '0.08061'}
+
  8%|▊         | 3060/37963 [7:39:24<74:38:28,  7.70s/it]
  8%|▊         | 3061/37963 [7:39:39<95:26:50,  9.85s/it]
  8%|▊         | 3062/37963 [7:39:47<88:44:39,  9.15s/it]
  8%|▊         | 3063/37963 [7:39:54<84:00:52,  8.67s/it]
  8%|▊         | 3064/37963 [7:40:02<81:27:13,  8.40s/it]
  8%|▊         | 3065/37963 [7:40:10<79:21:03,  8.19s/it]
  8%|▊         | 3066/37963 [7:40:17<78:03:51,  8.05s/it]
  8%|▊         | 3067/37963 [7:40:38<115:49:52, 11.95s/it]
  8%|▊         | 3068/37963 [7:40:46<104:16:50, 10.76s/it]
  8%|▊         | 3069/37963 [7:40:54<95:33:50,  9.86s/it] 
  8%|▊         | 3070/37963 [7:41:02<89:17:52,  9.21s/it]
                                                         
{'loss': '0.1613', 'grad_norm': '2.681', 'learning_rate': '1.986e-05', 'epoch': '0.08087'}
+
  8%|▊         | 3070/37963 [7:41:02<89:17:52,  9.21s/it]
  8%|▊         | 3071/37963 [7:41:16<104:26:00, 10.77s/it]
  8%|▊         | 3072/37963 [7:41:31<115:00:34, 11.87s/it]
  8%|▊         | 3073/37963 [7:41:39<103:44:41, 10.70s/it]
  8%|▊         | 3074/37963 [7:41:46<95:06:43,  9.81s/it] 
  8%|▊         | 3075/37963 [7:41:54<88:53:11,  9.17s/it]
  8%|▊         | 3076/37963 [7:42:02<84:25:17,  8.71s/it]
  8%|▊         | 3077/37963 [7:42:17<102:48:06, 10.61s/it]
  8%|▊         | 3078/37963 [7:42:24<93:42:25,  9.67s/it] 
  8%|▊         | 3079/37963 [7:42:32<88:10:38,  9.10s/it]
  8%|▊         | 3080/37963 [7:42:40<83:45:46,  8.64s/it]
                                                         
{'loss': '0.186', 'grad_norm': '2.592', 'learning_rate': '1.986e-05', 'epoch': '0.08113'}
+
  8%|▊         | 3080/37963 [7:42:40<83:45:46,  8.64s/it]
  8%|▊         | 3081/37963 [7:42:47<81:10:50,  8.38s/it]
  8%|▊         | 3082/37963 [7:42:55<79:08:52,  8.17s/it]
  8%|▊         | 3083/37963 [7:43:03<78:04:44,  8.06s/it]
  8%|▊         | 3084/37963 [7:43:11<77:03:52,  7.95s/it]
  8%|▊         | 3085/37963 [7:43:18<76:31:40,  7.90s/it]
  8%|▊         | 3086/37963 [7:43:26<76:06:36,  7.86s/it]
  8%|▊         | 3087/37963 [7:43:34<75:27:03,  7.79s/it]
  8%|▊         | 3088/37963 [7:43:41<74:51:24,  7.73s/it]
  8%|▊         | 3089/37963 [7:43:49<74:10:46,  7.66s/it]
  8%|▊         | 3090/37963 [7:43:56<73:29:26,  7.59s/it]
                                                         
{'loss': '0.1786', 'grad_norm': '5.095', 'learning_rate': '1.986e-05', 'epoch': '0.0814'}
+
  8%|▊         | 3090/37963 [7:43:56<73:29:26,  7.59s/it]
  8%|▊         | 3091/37963 [7:44:04<73:49:17,  7.62s/it]
  8%|▊         | 3092/37963 [7:44:12<74:23:16,  7.68s/it]
  8%|▊         | 3093/37963 [7:44:19<74:26:00,  7.68s/it]
  8%|▊         | 3094/37963 [7:44:41<115:28:09, 11.92s/it]
  8%|▊         | 3095/37963 [7:44:49<104:04:04, 10.74s/it]
  8%|▊         | 3096/37963 [7:44:57<95:30:55,  9.86s/it] 
  8%|▊         | 3097/37963 [7:45:05<88:38:54,  9.15s/it]
  8%|▊         | 3098/37963 [7:45:12<84:15:38,  8.70s/it]
  8%|▊         | 3099/37963 [7:45:20<81:33:47,  8.42s/it]
  8%|▊         | 3100/37963 [7:45:28<79:03:33,  8.16s/it]
                                                         
{'loss': '0.1917', 'grad_norm': '1.685', 'learning_rate': '1.986e-05', 'epoch': '0.08166'}
+
  8%|▊         | 3100/37963 [7:45:28<79:03:33,  8.16s/it]
  8%|▊         | 3101/37963 [7:45:35<77:28:47,  8.00s/it]
  8%|▊         | 3102/37963 [7:45:43<76:28:19,  7.90s/it]
  8%|▊         | 3103/37963 [7:45:50<75:46:06,  7.82s/it]
  8%|▊         | 3104/37963 [7:45:58<75:22:13,  7.78s/it]
  8%|▊         | 3105/37963 [7:46:06<74:51:38,  7.73s/it]
  8%|▊         | 3106/37963 [7:46:14<75:03:11,  7.75s/it]
  8%|▊         | 3107/37963 [7:46:21<74:57:10,  7.74s/it]
  8%|▊         | 3108/37963 [7:46:29<74:40:11,  7.71s/it]
  8%|▊         | 3109/37963 [7:46:44<95:35:44,  9.87s/it]
  8%|▊         | 3110/37963 [7:46:52<89:27:16,  9.24s/it]
                                                         
{'loss': '0.1658', 'grad_norm': '3.396', 'learning_rate': '1.986e-05', 'epoch': '0.08192'}
+
  8%|▊         | 3110/37963 [7:46:52<89:27:16,  9.24s/it]
  8%|▊         | 3111/37963 [7:46:59<85:08:38,  8.79s/it]
  8%|▊         | 3112/37963 [7:47:06<80:17:03,  8.29s/it]
  8%|▊         | 3113/37963 [7:47:22<100:04:03, 10.34s/it]
  8%|▊         | 3114/37963 [7:47:36<110:52:04, 11.45s/it]
  8%|▊         | 3115/37963 [7:47:44<100:41:49, 10.40s/it]
  8%|▊         | 3116/37963 [7:47:51<92:26:39,  9.55s/it] 
  8%|▊         | 3117/37963 [7:48:05<106:19:47, 10.99s/it]
  8%|▊         | 3118/37963 [7:48:13<96:42:00,  9.99s/it] 
  8%|▊         | 3119/37963 [7:48:28<109:42:19, 11.33s/it]
  8%|▊         | 3120/37963 [7:48:35<99:25:34, 10.27s/it] 
                                                         
{'loss': '0.1654', 'grad_norm': '3.009', 'learning_rate': '1.986e-05', 'epoch': '0.08219'}
+
  8%|▊         | 3120/37963 [7:48:35<99:25:34, 10.27s/it]
  8%|▊         | 3121/37963 [7:48:43<91:41:18,  9.47s/it]
  8%|▊         | 3122/37963 [7:48:51<86:57:40,  8.99s/it]
  8%|▊         | 3123/37963 [7:48:58<82:58:07,  8.57s/it]
  8%|▊         | 3124/37963 [7:49:06<80:11:02,  8.29s/it]
  8%|▊         | 3125/37963 [7:49:14<78:26:24,  8.11s/it]
  8%|▊         | 3126/37963 [7:49:21<76:59:09,  7.96s/it]
  8%|▊         | 3127/37963 [7:49:29<76:20:56,  7.89s/it]
  8%|▊         | 3128/37963 [7:49:37<75:26:56,  7.80s/it]
  8%|▊         | 3129/37963 [7:49:44<74:30:26,  7.70s/it]
  8%|▊         | 3130/37963 [7:49:52<74:29:48,  7.70s/it]
                                                         
{'loss': '0.1779', 'grad_norm': '7.04', 'learning_rate': '1.986e-05', 'epoch': '0.08245'}
+
  8%|▊         | 3130/37963 [7:49:52<74:29:48,  7.70s/it]
  8%|▊         | 3131/37963 [7:50:07<94:46:03,  9.79s/it]
  8%|▊         | 3132/37963 [7:50:14<88:44:56,  9.17s/it]
  8%|▊         | 3133/37963 [7:50:22<84:37:47,  8.75s/it]
  8%|▊         | 3134/37963 [7:50:30<81:17:50,  8.40s/it]
  8%|▊         | 3135/37963 [7:50:37<79:06:48,  8.18s/it]
  8%|▊         | 3136/37963 [7:50:45<77:37:37,  8.02s/it]
  8%|▊         | 3137/37963 [7:50:59<95:01:15,  9.82s/it]
  8%|▊         | 3138/37963 [7:51:07<89:40:07,  9.27s/it]
  8%|▊         | 3139/37963 [7:51:15<85:12:48,  8.81s/it]
  8%|▊         | 3140/37963 [7:51:22<81:43:46,  8.45s/it]
                                                         
{'loss': '0.1683', 'grad_norm': '3.518', 'learning_rate': '1.985e-05', 'epoch': '0.08271'}
+
  8%|▊         | 3140/37963 [7:51:22<81:43:46,  8.45s/it]
  8%|▊         | 3141/37963 [7:51:37<99:26:43, 10.28s/it]
  8%|▊         | 3142/37963 [7:51:44<91:40:28,  9.48s/it]
  8%|▊         | 3143/37963 [7:51:52<86:28:13,  8.94s/it]
  8%|▊         | 3144/37963 [7:52:00<82:52:24,  8.57s/it]
  8%|▊         | 3145/37963 [7:52:07<80:07:54,  8.29s/it]
  8%|▊         | 3146/37963 [7:52:15<78:26:43,  8.11s/it]
  8%|▊         | 3147/37963 [7:52:23<77:14:04,  7.99s/it]
  8%|▊         | 3148/37963 [7:52:31<76:14:30,  7.88s/it]
  8%|▊         | 3149/37963 [7:52:38<75:52:40,  7.85s/it]
  8%|▊         | 3150/37963 [7:52:46<74:45:07,  7.73s/it]
                                                         
{'loss': '0.1775', 'grad_norm': '5.305', 'learning_rate': '1.985e-05', 'epoch': '0.08298'}
+
  8%|▊         | 3150/37963 [7:52:46<74:45:07,  7.73s/it]
  8%|▊         | 3151/37963 [7:52:53<74:25:57,  7.70s/it]
  8%|▊         | 3152/37963 [7:53:01<74:18:15,  7.68s/it]
  8%|▊         | 3153/37963 [7:53:08<73:45:18,  7.63s/it]
  8%|▊         | 3154/37963 [7:53:16<73:48:04,  7.63s/it]
  8%|▊         | 3155/37963 [7:53:24<73:47:09,  7.63s/it]
  8%|▊         | 3156/37963 [7:53:31<73:48:04,  7.63s/it]
  8%|▊         | 3157/37963 [7:53:39<73:35:40,  7.61s/it]
  8%|▊         | 3158/37963 [7:53:54<94:53:14,  9.81s/it]
  8%|▊         | 3159/37963 [7:54:02<88:30:12,  9.15s/it]
  8%|▊         | 3160/37963 [7:54:09<84:34:38,  8.75s/it]
                                                         
{'loss': '0.1689', 'grad_norm': '4.842', 'learning_rate': '1.985e-05', 'epoch': '0.08324'}
+
  8%|▊         | 3160/37963 [7:54:09<84:34:38,  8.75s/it]
  8%|▊         | 3161/37963 [7:54:25<103:13:32, 10.68s/it]
  8%|▊         | 3162/37963 [7:54:32<94:19:57,  9.76s/it] 
  8%|▊         | 3163/37963 [7:54:46<106:45:56, 11.04s/it]
  8%|▊         | 3164/37963 [7:54:54<97:40:23, 10.10s/it] 
  8%|▊         | 3165/37963 [7:55:08<110:02:29, 11.38s/it]
  8%|▊         | 3166/37963 [7:55:16<99:14:12, 10.27s/it] 
  8%|▊         | 3167/37963 [7:55:23<90:41:19,  9.38s/it]
  8%|▊         | 3168/37963 [7:55:30<83:56:27,  8.68s/it]
  8%|▊         | 3169/37963 [7:55:38<80:59:45,  8.38s/it]
  8%|▊         | 3170/37963 [7:55:46<78:19:58,  8.11s/it]
                                                         
{'loss': '0.1636', 'grad_norm': '1.379', 'learning_rate': '1.985e-05', 'epoch': '0.0835'}
+
  8%|▊         | 3170/37963 [7:55:46<78:19:58,  8.11s/it]
  8%|▊         | 3171/37963 [7:55:53<76:36:02,  7.93s/it]
  8%|▊         | 3172/37963 [7:56:01<76:05:21,  7.87s/it]
  8%|▊         | 3173/37963 [7:56:15<95:21:58,  9.87s/it]
  8%|▊         | 3174/37963 [7:56:23<88:45:56,  9.19s/it]
  8%|▊         | 3175/37963 [7:56:31<84:28:35,  8.74s/it]
  8%|▊         | 3176/37963 [7:56:38<81:03:11,  8.39s/it]
  8%|▊         | 3177/37963 [7:56:46<78:45:01,  8.15s/it]
  8%|▊         | 3178/37963 [7:56:54<77:20:48,  8.00s/it]
  8%|▊         | 3179/37963 [7:57:01<76:28:21,  7.91s/it]
  8%|▊         | 3180/37963 [7:57:09<75:55:10,  7.86s/it]
                                                         
{'loss': '0.1625', 'grad_norm': '4.844', 'learning_rate': '1.985e-05', 'epoch': '0.08377'}
+
  8%|▊         | 3180/37963 [7:57:09<75:55:10,  7.86s/it]
  8%|▊         | 3181/37963 [7:57:17<75:22:29,  7.80s/it]
  8%|▊         | 3182/37963 [7:57:24<75:22:15,  7.80s/it]
  8%|▊         | 3183/37963 [7:57:32<74:54:35,  7.75s/it]
  8%|▊         | 3184/37963 [7:57:46<93:44:54,  9.70s/it]
  8%|▊         | 3185/37963 [7:58:01<108:37:49, 11.24s/it]
  8%|▊         | 3186/37963 [7:58:09<98:17:56, 10.18s/it] 
  8%|▊         | 3187/37963 [7:58:16<90:27:06,  9.36s/it]
  8%|▊         | 3188/37963 [7:58:24<85:19:41,  8.83s/it]
  8%|▊         | 3189/37963 [7:58:39<102:30:21, 10.61s/it]
  8%|▊         | 3190/37963 [7:58:46<94:00:10,  9.73s/it] 
                                                         
{'loss': '0.1716', 'grad_norm': '4.478', 'learning_rate': '1.985e-05', 'epoch': '0.08403'}
+
  8%|▊         | 3190/37963 [7:58:46<94:00:10,  9.73s/it]
  8%|▊         | 3191/37963 [7:58:54<88:01:09,  9.11s/it]
  8%|▊         | 3192/37963 [7:59:02<83:46:09,  8.67s/it]
  8%|▊         | 3193/37963 [7:59:09<80:09:33,  8.30s/it]
  8%|▊         | 3194/37963 [7:59:17<78:17:13,  8.11s/it]
  8%|▊         | 3195/37963 [7:59:24<76:42:59,  7.94s/it]
  8%|▊         | 3196/37963 [7:59:32<75:30:07,  7.82s/it]
  8%|▊         | 3197/37963 [7:59:39<74:37:10,  7.73s/it]
  8%|▊         | 3198/37963 [7:59:47<74:23:07,  7.70s/it]
  8%|▊         | 3199/37963 [7:59:55<74:17:10,  7.69s/it]
  8%|▊         | 3200/37963 [8:00:02<74:18:35,  7.70s/it]
                                                         
{'loss': '0.1823', 'grad_norm': '4.032', 'learning_rate': '1.985e-05', 'epoch': '0.08429'}
+
  8%|▊         | 3200/37963 [8:00:02<74:18:35,  7.70s/it]
  8%|▊         | 3201/37963 [8:00:10<73:26:56,  7.61s/it]
  8%|▊         | 3202/37963 [8:00:18<73:52:27,  7.65s/it]
  8%|▊         | 3203/37963 [8:00:25<74:05:15,  7.67s/it]
  8%|▊         | 3204/37963 [8:00:33<73:39:31,  7.63s/it]
  8%|▊         | 3205/37963 [8:00:40<73:42:41,  7.63s/it]
  8%|▊         | 3206/37963 [8:00:55<93:56:06,  9.73s/it]
  8%|▊         | 3207/37963 [8:01:03<87:57:06,  9.11s/it]
  8%|▊         | 3208/37963 [8:01:10<82:55:43,  8.59s/it]
  8%|▊         | 3209/37963 [8:01:25<101:19:44, 10.50s/it]
  8%|▊         | 3210/37963 [8:01:33<93:08:59,  9.65s/it] 
                                                         
{'loss': '0.163', 'grad_norm': '1.836', 'learning_rate': '1.984e-05', 'epoch': '0.08456'}
+
  8%|▊         | 3210/37963 [8:01:33<93:08:59,  9.65s/it]
  8%|▊         | 3211/37963 [8:01:47<106:16:36, 11.01s/it]
  8%|▊         | 3212/37963 [8:01:55<97:51:12, 10.14s/it] 
  8%|▊         | 3213/37963 [8:02:03<90:34:08,  9.38s/it]
  8%|▊         | 3214/37963 [8:02:10<85:26:24,  8.85s/it]
  8%|▊         | 3215/37963 [8:02:24<100:46:18, 10.44s/it]
  8%|▊         | 3216/37963 [8:02:32<92:37:44,  9.60s/it] 
  8%|▊         | 3217/37963 [8:02:40<86:51:33,  9.00s/it]
  8%|▊         | 3218/37963 [8:02:47<83:08:43,  8.61s/it]
  8%|▊         | 3219/37963 [8:02:55<80:26:32,  8.34s/it]
  8%|▊         | 3220/37963 [8:03:09<97:01:36, 10.05s/it]
                                                         
{'loss': '0.1636', 'grad_norm': '6.039', 'learning_rate': '1.984e-05', 'epoch': '0.08482'}
+
  8%|▊         | 3220/37963 [8:03:09<97:01:36, 10.05s/it]
  8%|▊         | 3221/37963 [8:03:17<89:55:49,  9.32s/it]
  8%|▊         | 3222/37963 [8:03:24<85:03:42,  8.81s/it]
  8%|▊         | 3223/37963 [8:03:32<81:30:45,  8.45s/it]
  8%|▊         | 3224/37963 [8:03:40<79:09:12,  8.20s/it]
  8%|▊         | 3225/37963 [8:03:47<77:36:04,  8.04s/it]
  8%|▊         | 3226/37963 [8:03:55<76:38:36,  7.94s/it]
  9%|▊         | 3227/37963 [8:04:03<75:58:25,  7.87s/it]
  9%|▊         | 3228/37963 [8:04:17<95:24:05,  9.89s/it]
  9%|▊         | 3229/37963 [8:04:25<89:20:50,  9.26s/it]
  9%|▊         | 3230/37963 [8:04:33<84:38:11,  8.77s/it]
                                                         
{'loss': '0.1782', 'grad_norm': '2.433', 'learning_rate': '1.984e-05', 'epoch': '0.08508'}
+
  9%|▊         | 3230/37963 [8:04:33<84:38:11,  8.77s/it]
  9%|▊         | 3231/37963 [8:04:40<80:52:08,  8.38s/it]
  9%|▊         | 3232/37963 [8:04:48<78:59:34,  8.19s/it]
  9%|▊         | 3233/37963 [8:04:56<77:40:57,  8.05s/it]
  9%|▊         | 3234/37963 [8:05:03<76:40:14,  7.95s/it]
  9%|▊         | 3235/37963 [8:05:11<75:47:24,  7.86s/it]
  9%|▊         | 3236/37963 [8:05:25<94:58:54,  9.85s/it]
  9%|▊         | 3237/37963 [8:05:40<108:37:40, 11.26s/it]
  9%|▊         | 3238/37963 [8:05:48<98:22:38, 10.20s/it] 
  9%|▊         | 3239/37963 [8:05:55<90:55:23,  9.43s/it]
  9%|▊         | 3240/37963 [8:06:03<85:46:24,  8.89s/it]
                                                         
{'loss': '0.1639', 'grad_norm': '3.403', 'learning_rate': '1.984e-05', 'epoch': '0.08535'}
+
  9%|▊         | 3240/37963 [8:06:03<85:46:24,  8.89s/it]
  9%|▊         | 3241/37963 [8:06:10<81:47:44,  8.48s/it]
  9%|▊         | 3242/37963 [8:06:18<79:56:26,  8.29s/it]
  9%|▊         | 3243/37963 [8:06:26<78:18:46,  8.12s/it]
  9%|▊         | 3244/37963 [8:06:34<76:54:42,  7.97s/it]
  9%|▊         | 3245/37963 [8:06:41<76:03:03,  7.89s/it]
  9%|▊         | 3246/37963 [8:06:49<75:32:52,  7.83s/it]
  9%|▊         | 3247/37963 [8:06:57<75:38:52,  7.84s/it]
  9%|▊         | 3248/37963 [8:07:05<75:05:52,  7.79s/it]
  9%|▊         | 3249/37963 [8:07:12<74:44:29,  7.75s/it]
  9%|▊         | 3250/37963 [8:07:20<74:23:01,  7.71s/it]
                                                         
{'loss': '0.1837', 'grad_norm': '2.858', 'learning_rate': '1.984e-05', 'epoch': '0.08561'}
+
  9%|▊         | 3250/37963 [8:07:20<74:23:01,  7.71s/it]
  9%|▊         | 3251/37963 [8:07:28<74:15:50,  7.70s/it]
  9%|▊         | 3252/37963 [8:07:35<74:03:29,  7.68s/it]
  9%|▊         | 3253/37963 [8:07:43<73:51:31,  7.66s/it]
  9%|▊         | 3254/37963 [8:07:51<74:17:44,  7.71s/it]
  9%|▊         | 3255/37963 [8:08:11<111:59:42, 11.62s/it]
  9%|▊         | 3256/37963 [8:08:20<101:59:22, 10.58s/it]
  9%|▊         | 3257/37963 [8:08:34<114:39:25, 11.89s/it]
  9%|▊         | 3258/37963 [8:08:42<102:38:49, 10.65s/it]
  9%|▊         | 3259/37963 [8:08:50<94:13:44,  9.77s/it] 
  9%|▊         | 3260/37963 [8:08:58<88:21:36,  9.17s/it]
                                                         
{'loss': '0.161', 'grad_norm': '3.837', 'learning_rate': '1.984e-05', 'epoch': '0.08587'}
+
  9%|▊         | 3260/37963 [8:08:58<88:21:36,  9.17s/it]
  9%|▊         | 3261/37963 [8:09:05<83:38:53,  8.68s/it]
  9%|▊         | 3262/37963 [8:09:13<80:31:11,  8.35s/it]
  9%|▊         | 3263/37963 [8:09:21<78:38:07,  8.16s/it]
  9%|▊         | 3264/37963 [8:09:35<96:20:28, 10.00s/it]
  9%|▊         | 3265/37963 [8:09:43<89:43:35,  9.31s/it]
  9%|▊         | 3266/37963 [8:09:50<85:01:19,  8.82s/it]
  9%|▊         | 3267/37963 [8:09:58<81:42:50,  8.48s/it]
  9%|▊         | 3268/37963 [8:10:05<79:05:31,  8.21s/it]
  9%|▊         | 3269/37963 [8:10:19<94:57:38,  9.85s/it]
  9%|▊         | 3270/37963 [8:10:27<88:40:41,  9.20s/it]
                                                         
{'loss': '0.1753', 'grad_norm': '2.536', 'learning_rate': '1.984e-05', 'epoch': '0.08614'}
+
  9%|▊         | 3270/37963 [8:10:27<88:40:41,  9.20s/it]
  9%|▊         | 3271/37963 [8:10:34<83:24:45,  8.66s/it]
  9%|▊         | 3272/37963 [8:10:42<80:22:48,  8.34s/it]
  9%|▊         | 3273/37963 [8:10:49<78:18:20,  8.13s/it]
  9%|▊         | 3274/37963 [8:10:57<76:03:41,  7.89s/it]
  9%|▊         | 3275/37963 [8:11:04<75:08:16,  7.80s/it]
  9%|▊         | 3276/37963 [8:11:19<95:51:11,  9.95s/it]
  9%|▊         | 3277/37963 [8:11:27<88:42:14,  9.21s/it]
  9%|▊         | 3278/37963 [8:11:34<84:05:42,  8.73s/it]
  9%|▊         | 3279/37963 [8:11:42<80:59:39,  8.41s/it]
  9%|▊         | 3280/37963 [8:11:50<79:05:31,  8.21s/it]
                                                         
{'loss': '0.1763', 'grad_norm': '3.054', 'learning_rate': '1.983e-05', 'epoch': '0.0864'}
+
  9%|▊         | 3280/37963 [8:11:50<79:05:31,  8.21s/it]
  9%|▊         | 3281/37963 [8:11:57<76:59:51,  7.99s/it]
  9%|▊         | 3282/37963 [8:12:05<76:20:33,  7.92s/it]
  9%|▊         | 3283/37963 [8:12:12<74:45:21,  7.76s/it]
  9%|▊         | 3284/37963 [8:12:27<94:00:19,  9.76s/it]
  9%|▊         | 3285/37963 [8:12:42<109:04:58, 11.32s/it]
  9%|▊         | 3286/37963 [8:12:50<98:34:21, 10.23s/it] 
  9%|▊         | 3287/37963 [8:12:57<91:01:04,  9.45s/it]
  9%|▊         | 3288/37963 [8:13:05<85:46:53,  8.91s/it]
  9%|▊         | 3289/37963 [8:13:13<82:19:47,  8.55s/it]
  9%|▊         | 3290/37963 [8:13:20<80:03:30,  8.31s/it]
                                                         
{'loss': '0.1759', 'grad_norm': '5.772', 'learning_rate': '1.983e-05', 'epoch': '0.08666'}
+
  9%|▊         | 3290/37963 [8:13:20<80:03:30,  8.31s/it]
  9%|▊         | 3291/37963 [8:13:28<77:39:04,  8.06s/it]
  9%|▊         | 3292/37963 [8:13:35<75:57:17,  7.89s/it]
  9%|▊         | 3293/37963 [8:13:43<75:10:14,  7.81s/it]
  9%|▊         | 3294/37963 [8:13:51<74:50:29,  7.77s/it]
  9%|▊         | 3295/37963 [8:13:58<74:30:54,  7.74s/it]
  9%|▊         | 3296/37963 [8:14:06<74:09:36,  7.70s/it]
  9%|▊         | 3297/37963 [8:14:13<73:52:21,  7.67s/it]
  9%|▊         | 3298/37963 [8:14:21<73:04:57,  7.59s/it]
  9%|▊         | 3299/37963 [8:14:28<72:29:09,  7.53s/it]
  9%|▊         | 3300/37963 [8:14:36<72:25:10,  7.52s/it]
                                                         
{'loss': '0.1824', 'grad_norm': '6.413', 'learning_rate': '1.983e-05', 'epoch': '0.08693'}
+
  9%|▊         | 3300/37963 [8:14:36<72:25:10,  7.52s/it]
  9%|▊         | 3301/37963 [8:14:43<72:57:29,  7.58s/it]
  9%|▊         | 3302/37963 [8:14:51<73:33:41,  7.64s/it]
  9%|▊         | 3303/37963 [8:14:58<71:58:39,  7.48s/it]
  9%|▊         | 3304/37963 [8:15:06<72:46:45,  7.56s/it]
  9%|▊         | 3305/37963 [8:15:14<73:04:06,  7.59s/it]
  9%|▊         | 3306/37963 [8:15:21<73:10:08,  7.60s/it]
  9%|▊         | 3307/37963 [8:15:29<73:12:35,  7.60s/it]
  9%|▊         | 3308/37963 [8:15:43<91:53:51,  9.55s/it]
  9%|▊         | 3309/37963 [8:15:58<107:25:46, 11.16s/it]
  9%|▊         | 3310/37963 [8:16:06<97:23:42, 10.12s/it] 
                                                         
{'loss': '0.17', 'grad_norm': '4.199', 'learning_rate': '1.983e-05', 'epoch': '0.08719'}
+
  9%|▊         | 3310/37963 [8:16:06<97:23:42, 10.12s/it]
  9%|▊         | 3311/37963 [8:16:27<129:01:14, 13.40s/it]
  9%|▊         | 3312/37963 [8:16:34<112:07:18, 11.65s/it]
  9%|▊         | 3313/37963 [8:16:42<100:15:44, 10.42s/it]
  9%|▊         | 3314/37963 [8:16:50<92:26:47,  9.61s/it] 
  9%|▊         | 3315/37963 [8:16:57<86:35:44,  9.00s/it]
  9%|▊         | 3316/37963 [8:17:05<82:32:50,  8.58s/it]
  9%|▊         | 3317/37963 [8:17:19<98:05:28, 10.19s/it]
  9%|▊         | 3318/37963 [8:17:26<91:03:43,  9.46s/it]
  9%|▊         | 3319/37963 [8:17:34<86:01:54,  8.94s/it]
  9%|▊         | 3320/37963 [8:17:42<82:26:42,  8.57s/it]
                                                         
{'loss': '0.1653', 'grad_norm': '8.266', 'learning_rate': '1.983e-05', 'epoch': '0.08745'}
+
  9%|▊         | 3320/37963 [8:17:42<82:26:42,  8.57s/it]
  9%|▊         | 3321/37963 [8:17:50<79:50:28,  8.30s/it]
  9%|▉         | 3322/37963 [8:18:04<98:05:48, 10.19s/it]
  9%|▉         | 3323/37963 [8:18:12<90:52:06,  9.44s/it]
  9%|▉         | 3324/37963 [8:18:20<86:32:48,  8.99s/it]
  9%|▉         | 3325/37963 [8:18:27<82:40:55,  8.59s/it]
  9%|▉         | 3326/37963 [8:18:35<80:05:49,  8.32s/it]
  9%|▉         | 3327/37963 [8:18:43<78:10:56,  8.13s/it]
  9%|▉         | 3328/37963 [8:18:50<76:31:45,  7.95s/it]
  9%|▉         | 3329/37963 [8:18:58<75:50:44,  7.88s/it]
  9%|▉         | 3330/37963 [8:19:06<75:15:51,  7.82s/it]
                                                         
{'loss': '0.1711', 'grad_norm': '3.147', 'learning_rate': '1.983e-05', 'epoch': '0.08772'}
+
  9%|▉         | 3330/37963 [8:19:06<75:15:51,  7.82s/it]
  9%|▉         | 3331/37963 [8:19:13<75:00:11,  7.80s/it]
  9%|▉         | 3332/37963 [8:19:35<113:32:23, 11.80s/it]
  9%|▉         | 3333/37963 [8:19:42<101:34:26, 10.56s/it]
  9%|▉         | 3334/37963 [8:19:50<93:18:18,  9.70s/it] 
  9%|▉         | 3335/37963 [8:19:58<87:33:06,  9.10s/it]
  9%|▉         | 3336/37963 [8:20:05<83:20:58,  8.67s/it]
  9%|▉         | 3337/37963 [8:20:13<80:30:53,  8.37s/it]
  9%|▉         | 3338/37963 [8:20:21<78:43:16,  8.18s/it]
  9%|▉         | 3339/37963 [8:20:28<76:46:59,  7.98s/it]
  9%|▉         | 3340/37963 [8:20:36<74:45:02,  7.77s/it]
                                                         
{'loss': '0.1693', 'grad_norm': '3.988', 'learning_rate': '1.982e-05', 'epoch': '0.08798'}
+
  9%|▉         | 3340/37963 [8:20:36<74:45:02,  7.77s/it]
  9%|▉         | 3341/37963 [8:20:43<74:27:49,  7.74s/it]
  9%|▉         | 3342/37963 [8:20:51<74:35:05,  7.76s/it]
  9%|▉         | 3343/37963 [8:20:58<73:27:26,  7.64s/it]
  9%|▉         | 3344/37963 [8:21:06<72:28:58,  7.54s/it]
  9%|▉         | 3345/37963 [8:21:13<72:49:07,  7.57s/it]
  9%|▉         | 3346/37963 [8:21:21<73:08:37,  7.61s/it]
  9%|▉         | 3347/37963 [8:21:29<73:11:09,  7.61s/it]
  9%|▉         | 3348/37963 [8:21:36<71:51:40,  7.47s/it]
  9%|▉         | 3349/37963 [8:21:44<72:38:08,  7.55s/it]
  9%|▉         | 3350/37963 [8:21:51<73:06:38,  7.60s/it]
                                                         
{'loss': '0.1789', 'grad_norm': '4.234', 'learning_rate': '1.982e-05', 'epoch': '0.08824'}
+
  9%|▉         | 3350/37963 [8:21:51<73:06:38,  7.60s/it]
  9%|▉         | 3351/37963 [8:21:59<73:51:17,  7.68s/it]
  9%|▉         | 3352/37963 [8:22:07<73:30:05,  7.65s/it]
  9%|▉         | 3353/37963 [8:22:14<73:36:32,  7.66s/it]
  9%|▉         | 3354/37963 [8:22:22<73:32:43,  7.65s/it]
  9%|▉         | 3355/37963 [8:22:37<94:11:48,  9.80s/it]
  9%|▉         | 3356/37963 [8:22:45<88:36:36,  9.22s/it]
  9%|▉         | 3357/37963 [8:23:06<123:02:03, 12.80s/it]
  9%|▉         | 3358/37963 [8:23:14<109:00:38, 11.34s/it]
  9%|▉         | 3359/37963 [8:23:28<117:25:48, 12.22s/it]
  9%|▉         | 3360/37963 [8:23:35<103:32:05, 10.77s/it]
                                                          
{'loss': '0.1808', 'grad_norm': '2.336', 'learning_rate': '1.982e-05', 'epoch': '0.08851'}
+
  9%|▉         | 3360/37963 [8:23:35<103:32:05, 10.77s/it]
  9%|▉         | 3361/37963 [8:23:43<94:34:53,  9.84s/it] 
  9%|▉         | 3362/37963 [8:23:51<88:35:06,  9.22s/it]
  9%|▉         | 3363/37963 [8:23:59<84:15:27,  8.77s/it]
  9%|▉         | 3364/37963 [8:24:06<80:38:36,  8.39s/it]
  9%|▉         | 3365/37963 [8:24:14<78:28:41,  8.17s/it]
  9%|▉         | 3366/37963 [8:24:29<97:45:41, 10.17s/it]
  9%|▉         | 3367/37963 [8:24:36<90:26:18,  9.41s/it]
  9%|▉         | 3368/37963 [8:24:44<85:17:27,  8.88s/it]
  9%|▉         | 3369/37963 [8:24:52<82:06:59,  8.55s/it]
  9%|▉         | 3370/37963 [8:24:59<79:08:47,  8.24s/it]
                                                         
{'loss': '0.1748', 'grad_norm': '4.759', 'learning_rate': '1.982e-05', 'epoch': '0.08877'}
+
  9%|▉         | 3370/37963 [8:24:59<79:08:47,  8.24s/it]
  9%|▉         | 3371/37963 [8:25:13<96:13:36, 10.01s/it]
  9%|▉         | 3372/37963 [8:25:21<89:50:33,  9.35s/it]
  9%|▉         | 3373/37963 [8:25:29<84:43:37,  8.82s/it]
  9%|▉         | 3374/37963 [8:25:36<81:31:01,  8.48s/it]
  9%|▉         | 3375/37963 [8:25:44<79:16:02,  8.25s/it]
  9%|▉         | 3376/37963 [8:25:52<77:50:07,  8.10s/it]
  9%|▉         | 3377/37963 [8:26:00<76:53:36,  8.00s/it]
  9%|▉         | 3378/37963 [8:26:07<75:53:27,  7.90s/it]
  9%|▉         | 3379/37963 [8:26:22<94:55:31,  9.88s/it]
  9%|▉         | 3380/37963 [8:26:37<109:34:22, 11.41s/it]
                                                          
{'loss': '0.1656', 'grad_norm': '4.552', 'learning_rate': '1.982e-05', 'epoch': '0.08903'}
+
  9%|▉         | 3380/37963 [8:26:37<109:34:22, 11.41s/it]
  9%|▉         | 3381/37963 [8:26:44<98:34:14, 10.26s/it] 
  9%|▉         | 3382/37963 [8:26:52<90:41:25,  9.44s/it]
  9%|▉         | 3383/37963 [8:26:59<85:18:58,  8.88s/it]
  9%|▉         | 3384/37963 [8:27:07<81:56:33,  8.53s/it]
  9%|▉         | 3385/37963 [8:27:15<78:48:54,  8.21s/it]
  9%|▉         | 3386/37963 [8:27:22<77:03:50,  8.02s/it]
  9%|▉         | 3387/37963 [8:27:30<75:56:19,  7.91s/it]
  9%|▉         | 3388/37963 [8:27:38<75:14:21,  7.83s/it]
  9%|▉         | 3389/37963 [8:27:45<74:42:15,  7.78s/it]
  9%|▉         | 3390/37963 [8:27:53<74:13:03,  7.73s/it]
                                                         
{'loss': '0.1644', 'grad_norm': '2.135', 'learning_rate': '1.982e-05', 'epoch': '0.0893'}
+
  9%|▉         | 3390/37963 [8:27:53<74:13:03,  7.73s/it]
  9%|▉         | 3391/37963 [8:28:00<73:48:39,  7.69s/it]
  9%|▉         | 3392/37963 [8:28:08<72:52:02,  7.59s/it]
  9%|▉         | 3393/37963 [8:28:15<72:23:31,  7.54s/it]
  9%|▉         | 3394/37963 [8:28:23<72:46:13,  7.58s/it]
  9%|▉         | 3395/37963 [8:28:30<73:01:20,  7.60s/it]
  9%|▉         | 3396/37963 [8:28:38<72:26:30,  7.54s/it]
  9%|▉         | 3397/37963 [8:28:46<72:42:53,  7.57s/it]
  9%|▉         | 3398/37963 [8:28:53<73:10:27,  7.62s/it]
  9%|▉         | 3399/37963 [8:29:01<73:16:27,  7.63s/it]
  9%|▉         | 3400/37963 [8:29:09<73:33:23,  7.66s/it]
                                                         
{'loss': '0.1703', 'grad_norm': '1.487', 'learning_rate': '1.981e-05', 'epoch': '0.08956'}
+
  9%|▉         | 3400/37963 [8:29:09<73:33:23,  7.66s/it]
  9%|▉         | 3401/37963 [8:29:16<73:46:51,  7.69s/it]
  9%|▉         | 3402/37963 [8:29:24<73:49:27,  7.69s/it]
  9%|▉         | 3403/37963 [8:29:32<73:59:20,  7.71s/it]
  9%|▉         | 3404/37963 [8:29:46<93:12:51,  9.71s/it]
  9%|▉         | 3405/37963 [8:30:08<127:29:21, 13.28s/it]
  9%|▉         | 3406/37963 [8:30:16<111:42:01, 11.64s/it]
  9%|▉         | 3407/37963 [8:30:30<118:31:39, 12.35s/it]
  9%|▉         | 3408/37963 [8:30:37<104:42:18, 10.91s/it]
  9%|▉         | 3409/37963 [8:30:45<94:39:55,  9.86s/it] 
  9%|▉         | 3410/37963 [8:30:52<87:33:46,  9.12s/it]
                                                         
{'loss': '0.1717', 'grad_norm': '4.682', 'learning_rate': '1.981e-05', 'epoch': '0.08982'}
+
  9%|▉         | 3410/37963 [8:30:52<87:33:46,  9.12s/it]
  9%|▉         | 3411/37963 [8:31:00<83:20:55,  8.68s/it]
  9%|▉         | 3412/37963 [8:31:07<79:58:37,  8.33s/it]
  9%|▉         | 3413/37963 [8:31:15<77:58:16,  8.12s/it]
  9%|▉         | 3414/37963 [8:31:23<76:49:32,  8.01s/it]
  9%|▉         | 3415/37963 [8:31:30<75:01:31,  7.82s/it]
  9%|▉         | 3416/37963 [8:31:38<74:30:36,  7.76s/it]
  9%|▉         | 3417/37963 [8:31:45<74:12:12,  7.73s/it]
  9%|▉         | 3418/37963 [8:31:53<74:04:51,  7.72s/it]
  9%|▉         | 3419/37963 [8:32:07<92:11:31,  9.61s/it]
  9%|▉         | 3420/37963 [8:32:22<107:39:09, 11.22s/it]
                                                          
{'loss': '0.1711', 'grad_norm': '3.613', 'learning_rate': '1.981e-05', 'epoch': '0.09009'}
+
  9%|▉         | 3420/37963 [8:32:22<107:39:09, 11.22s/it]
  9%|▉         | 3421/37963 [8:32:29<96:55:54, 10.10s/it] 
  9%|▉         | 3422/37963 [8:32:43<107:32:05, 11.21s/it]
  9%|▉         | 3423/37963 [8:32:51<97:48:52, 10.19s/it] 
  9%|▉         | 3424/37963 [8:32:59<90:26:42,  9.43s/it]
  9%|▉         | 3425/37963 [8:33:06<84:30:42,  8.81s/it]
  9%|▉         | 3426/37963 [8:33:14<80:44:41,  8.42s/it]
  9%|▉         | 3427/37963 [8:33:21<79:08:55,  8.25s/it]
  9%|▉         | 3428/37963 [8:33:29<77:37:16,  8.09s/it]
  9%|▉         | 3429/37963 [8:33:37<76:28:42,  7.97s/it]
  9%|▉         | 3430/37963 [8:33:44<75:34:21,  7.88s/it]
                                                         
{'loss': '0.178', 'grad_norm': '2.537', 'learning_rate': '1.981e-05', 'epoch': '0.09035'}
+
  9%|▉         | 3430/37963 [8:33:44<75:34:21,  7.88s/it]
  9%|▉         | 3431/37963 [8:33:52<75:00:46,  7.82s/it]
  9%|▉         | 3432/37963 [8:33:59<73:25:09,  7.65s/it]
  9%|▉         | 3433/37963 [8:34:07<73:25:10,  7.65s/it]
  9%|▉         | 3434/37963 [8:34:22<94:21:30,  9.84s/it]
  9%|▉         | 3435/37963 [8:34:30<88:14:01,  9.20s/it]
  9%|▉         | 3436/37963 [8:34:37<83:43:47,  8.73s/it]
  9%|▉         | 3437/37963 [8:34:45<79:56:06,  8.33s/it]
  9%|▉         | 3438/37963 [8:34:52<78:03:11,  8.14s/it]
  9%|▉         | 3439/37963 [8:35:00<76:44:21,  8.00s/it]
  9%|▉         | 3440/37963 [8:35:08<75:23:22,  7.86s/it]
                                                         
{'loss': '0.1822', 'grad_norm': '3.093', 'learning_rate': '1.981e-05', 'epoch': '0.09061'}
+
  9%|▉         | 3440/37963 [8:35:08<75:23:22,  7.86s/it]
  9%|▉         | 3441/37963 [8:35:15<74:02:21,  7.72s/it]
  9%|▉         | 3442/37963 [8:35:23<74:05:49,  7.73s/it]
  9%|▉         | 3443/37963 [8:35:30<72:51:37,  7.60s/it]
  9%|▉         | 3444/37963 [8:35:38<72:59:54,  7.61s/it]
  9%|▉         | 3445/37963 [8:35:46<73:31:39,  7.67s/it]
  9%|▉         | 3446/37963 [8:35:53<73:28:49,  7.66s/it]
  9%|▉         | 3447/37963 [8:36:01<73:20:15,  7.65s/it]
  9%|▉         | 3448/37963 [8:36:08<73:28:21,  7.66s/it]
  9%|▉         | 3449/37963 [8:36:16<73:26:12,  7.66s/it]
  9%|▉         | 3450/37963 [8:36:24<73:27:21,  7.66s/it]
                                                         
{'loss': '0.1723', 'grad_norm': '3.349', 'learning_rate': '1.981e-05', 'epoch': '0.09088'}
+
  9%|▉         | 3450/37963 [8:36:24<73:27:21,  7.66s/it]
  9%|▉         | 3451/37963 [8:36:39<94:20:40,  9.84s/it]
  9%|▉         | 3452/37963 [8:36:47<88:29:52,  9.23s/it]
  9%|▉         | 3453/37963 [8:37:01<103:03:23, 10.75s/it]
  9%|▉         | 3454/37963 [8:37:15<114:15:08, 11.92s/it]
  9%|▉         | 3455/37963 [8:37:23<102:40:44, 10.71s/it]
  9%|▉         | 3456/37963 [8:37:31<94:08:19,  9.82s/it] 
  9%|▉         | 3457/37963 [8:37:38<86:58:46,  9.07s/it]
  9%|▉         | 3458/37963 [8:37:46<82:50:29,  8.64s/it]
  9%|▉         | 3459/37963 [8:37:54<79:39:34,  8.31s/it]
  9%|▉         | 3460/37963 [8:38:01<77:19:48,  8.07s/it]
                                                         
{'loss': '0.1594', 'grad_norm': '2.195', 'learning_rate': '1.98e-05', 'epoch': '0.09114'}
+
  9%|▉         | 3460/37963 [8:38:01<77:19:48,  8.07s/it]
  9%|▉         | 3461/37963 [8:38:15<95:13:20,  9.94s/it]
  9%|▉         | 3462/37963 [8:38:23<89:28:12,  9.34s/it]
  9%|▉         | 3463/37963 [8:38:37<102:10:02, 10.66s/it]
  9%|▉         | 3464/37963 [8:38:45<93:44:30,  9.78s/it] 
  9%|▉         | 3465/37963 [8:38:52<86:30:16,  9.03s/it]
  9%|▉         | 3466/37963 [8:39:00<82:44:53,  8.64s/it]
  9%|▉         | 3467/37963 [8:39:07<79:51:30,  8.33s/it]
  9%|▉         | 3468/37963 [8:39:15<77:49:44,  8.12s/it]
  9%|▉         | 3469/37963 [8:39:29<95:19:42,  9.95s/it]
  9%|▉         | 3470/37963 [8:39:37<89:22:02,  9.33s/it]
                                                         
{'loss': '0.1595', 'grad_norm': '1.087', 'learning_rate': '1.98e-05', 'epoch': '0.09141'}
+
  9%|▉         | 3470/37963 [8:39:37<89:22:02,  9.33s/it]
  9%|▉         | 3471/37963 [8:39:45<84:36:37,  8.83s/it]
  9%|▉         | 3472/37963 [8:39:52<80:45:05,  8.43s/it]
  9%|▉         | 3473/37963 [8:40:00<78:39:04,  8.21s/it]
  9%|▉         | 3474/37963 [8:40:15<97:32:44, 10.18s/it]
  9%|▉         | 3475/37963 [8:40:23<90:28:34,  9.44s/it]
  9%|▉         | 3476/37963 [8:40:30<85:20:42,  8.91s/it]
  9%|▉         | 3477/37963 [8:40:38<81:36:38,  8.52s/it]
  9%|▉         | 3478/37963 [8:40:46<79:17:45,  8.28s/it]
  9%|▉         | 3479/37963 [8:41:01<98:59:01, 10.33s/it]
  9%|▉         | 3480/37963 [8:41:08<91:26:35,  9.55s/it]
                                                         
{'loss': '0.1816', 'grad_norm': '2.266', 'learning_rate': '1.98e-05', 'epoch': '0.09167'}
+
  9%|▉         | 3480/37963 [8:41:08<91:26:35,  9.55s/it]
  9%|▉         | 3481/37963 [8:41:16<85:53:06,  8.97s/it]
  9%|▉         | 3482/37963 [8:41:24<82:40:59,  8.63s/it]
  9%|▉         | 3483/37963 [8:41:31<79:27:06,  8.30s/it]
  9%|▉         | 3484/37963 [8:41:39<77:31:00,  8.09s/it]
  9%|▉         | 3485/37963 [8:41:47<76:02:16,  7.94s/it]
  9%|▉         | 3486/37963 [8:41:54<75:24:58,  7.87s/it]
  9%|▉         | 3487/37963 [8:42:02<74:55:57,  7.82s/it]
  9%|▉         | 3488/37963 [8:42:10<74:42:15,  7.80s/it]
  9%|▉         | 3489/37963 [8:42:17<74:17:31,  7.76s/it]
  9%|▉         | 3490/37963 [8:42:25<73:22:29,  7.66s/it]
                                                         
{'loss': '0.1558', 'grad_norm': '4.005', 'learning_rate': '1.98e-05', 'epoch': '0.09193'}
+
  9%|▉         | 3490/37963 [8:42:25<73:22:29,  7.66s/it]
  9%|▉         | 3491/37963 [8:42:33<73:26:24,  7.67s/it]
  9%|▉         | 3492/37963 [8:42:40<73:18:29,  7.66s/it]
  9%|▉         | 3493/37963 [8:42:48<73:25:26,  7.67s/it]
  9%|▉         | 3494/37963 [8:42:55<72:55:28,  7.62s/it]
  9%|▉         | 3495/37963 [8:43:03<73:06:11,  7.64s/it]
  9%|▉         | 3496/37963 [8:43:18<94:21:19,  9.86s/it]
  9%|▉         | 3497/37963 [8:43:26<88:26:32,  9.24s/it]
  9%|▉         | 3498/37963 [8:43:41<104:12:34, 10.89s/it]
  9%|▉         | 3499/37963 [8:43:48<94:44:35,  9.90s/it] 
  9%|▉         | 3500/37963 [8:44:03<107:33:58, 11.24s/it]
                                                          
{'loss': '0.1843', 'grad_norm': '1.434', 'learning_rate': '1.98e-05', 'epoch': '0.0922'}
+
  9%|▉         | 3500/37963 [8:44:03<107:33:58, 11.24s/it]
  9%|▉         | 3501/37963 [8:44:10<97:29:26, 10.18s/it] 
  9%|▉         | 3502/37963 [8:44:18<90:21:53,  9.44s/it]
  9%|▉         | 3503/37963 [8:44:26<85:14:28,  8.91s/it]
  9%|▉         | 3504/37963 [8:44:33<81:29:07,  8.51s/it]
  9%|▉         | 3505/37963 [8:44:41<78:36:49,  8.21s/it]
  9%|▉         | 3506/37963 [8:44:48<77:17:11,  8.07s/it]
  9%|▉         | 3507/37963 [8:45:03<95:25:41,  9.97s/it]
  9%|▉         | 3508/37963 [8:45:10<88:40:34,  9.27s/it]
  9%|▉         | 3509/37963 [8:45:18<84:16:39,  8.81s/it]
  9%|▉         | 3510/37963 [8:45:26<80:59:30,  8.46s/it]
                                                         
{'loss': '0.1719', 'grad_norm': '2.263', 'learning_rate': '1.98e-05', 'epoch': '0.09246'}
+
  9%|▉         | 3510/37963 [8:45:26<80:59:30,  8.46s/it]
  9%|▉         | 3511/37963 [8:45:40<97:33:14, 10.19s/it]
  9%|▉         | 3512/37963 [8:45:48<90:42:15,  9.48s/it]
  9%|▉         | 3513/37963 [8:45:56<85:21:10,  8.92s/it]
  9%|▉         | 3514/37963 [8:46:03<82:03:22,  8.58s/it]
  9%|▉         | 3515/37963 [8:46:11<79:41:31,  8.33s/it]
  9%|▉         | 3516/37963 [8:46:19<77:57:59,  8.15s/it]
  9%|▉         | 3517/37963 [8:46:26<76:00:50,  7.94s/it]
  9%|▉         | 3518/37963 [8:46:34<75:07:04,  7.85s/it]
  9%|▉         | 3519/37963 [8:46:41<74:04:08,  7.74s/it]
  9%|▉         | 3520/37963 [8:46:49<74:25:20,  7.78s/it]
                                                         
{'loss': '0.1729', 'grad_norm': '1.553', 'learning_rate': '1.979e-05', 'epoch': '0.09272'}
+
  9%|▉         | 3520/37963 [8:46:49<74:25:20,  7.78s/it]
  9%|▉         | 3521/37963 [8:46:57<74:18:21,  7.77s/it]
  9%|▉         | 3522/37963 [8:47:05<73:34:22,  7.69s/it]
  9%|▉         | 3523/37963 [8:47:26<113:09:32, 11.83s/it]
  9%|▉         | 3524/37963 [8:47:34<101:20:23, 10.59s/it]
  9%|▉         | 3525/37963 [8:47:41<92:58:07,  9.72s/it] 
  9%|▉         | 3526/37963 [8:47:49<86:36:57,  9.05s/it]
  9%|▉         | 3527/37963 [8:47:57<82:32:40,  8.63s/it]
  9%|▉         | 3528/37963 [8:48:12<101:02:19, 10.56s/it]
  9%|▉         | 3529/37963 [8:48:19<92:51:12,  9.71s/it] 
  9%|▉         | 3530/37963 [8:48:27<87:04:37,  9.10s/it]
                                                         
{'loss': '0.1702', 'grad_norm': '3.698', 'learning_rate': '1.979e-05', 'epoch': '0.09299'}
+
  9%|▉         | 3530/37963 [8:48:27<87:04:37,  9.10s/it]
  9%|▉         | 3531/37963 [8:48:35<82:34:13,  8.63s/it]
  9%|▉         | 3532/37963 [8:48:42<79:19:36,  8.29s/it]
  9%|▉         | 3533/37963 [8:48:50<77:52:12,  8.14s/it]
  9%|▉         | 3534/37963 [8:48:57<76:25:57,  7.99s/it]
  9%|▉         | 3535/37963 [8:49:05<75:24:45,  7.89s/it]
  9%|▉         | 3536/37963 [8:49:13<74:57:13,  7.84s/it]
  9%|▉         | 3537/37963 [8:49:21<74:52:15,  7.83s/it]
  9%|▉         | 3538/37963 [8:49:28<74:26:14,  7.78s/it]
  9%|▉         | 3539/37963 [8:49:36<73:50:23,  7.72s/it]
  9%|▉         | 3540/37963 [8:49:44<73:51:41,  7.72s/it]
                                                         
{'loss': '0.1827', 'grad_norm': '2.913', 'learning_rate': '1.979e-05', 'epoch': '0.09325'}
+
  9%|▉         | 3540/37963 [8:49:44<73:51:41,  7.72s/it]
  9%|▉         | 3541/37963 [8:49:58<93:39:32,  9.80s/it]
  9%|▉         | 3542/37963 [8:50:06<87:39:57,  9.17s/it]
  9%|▉         | 3543/37963 [8:50:14<83:11:53,  8.70s/it]
  9%|▉         | 3544/37963 [8:50:21<79:44:47,  8.34s/it]
  9%|▉         | 3545/37963 [8:50:29<77:44:02,  8.13s/it]
  9%|▉         | 3546/37963 [8:50:43<94:41:54,  9.91s/it]
  9%|▉         | 3547/37963 [8:50:57<108:23:02, 11.34s/it]
  9%|▉         | 3548/37963 [8:51:05<98:06:13, 10.26s/it] 
  9%|▉         | 3549/37963 [8:51:13<90:29:52,  9.47s/it]
  9%|▉         | 3550/37963 [8:51:21<85:47:17,  8.97s/it]
                                                         
{'loss': '0.1778', 'grad_norm': '1.946', 'learning_rate': '1.979e-05', 'epoch': '0.09351'}
+
  9%|▉         | 3550/37963 [8:51:21<85:47:17,  8.97s/it]
  9%|▉         | 3551/37963 [8:51:28<82:09:13,  8.59s/it]
  9%|▉         | 3552/37963 [8:51:36<79:26:37,  8.31s/it]
  9%|▉         | 3553/37963 [8:51:44<77:29:12,  8.11s/it]
  9%|▉         | 3554/37963 [8:51:51<76:20:51,  7.99s/it]
  9%|▉         | 3555/37963 [8:51:59<76:11:23,  7.97s/it]
  9%|▉         | 3556/37963 [8:52:07<75:18:24,  7.88s/it]
  9%|▉         | 3557/37963 [8:52:15<74:34:57,  7.80s/it]
  9%|▉         | 3558/37963 [8:52:22<73:49:44,  7.73s/it]
  9%|▉         | 3559/37963 [8:52:36<92:16:43,  9.66s/it]
  9%|▉         | 3560/37963 [8:52:44<86:53:28,  9.09s/it]
                                                         
{'loss': '0.1777', 'grad_norm': '2.338', 'learning_rate': '1.979e-05', 'epoch': '0.09378'}
+
  9%|▉         | 3560/37963 [8:52:44<86:53:28,  9.09s/it]
  9%|▉         | 3561/37963 [8:52:58<101:48:59, 10.65s/it]
  9%|▉         | 3562/37963 [8:53:06<92:37:13,  9.69s/it] 
  9%|▉         | 3563/37963 [8:53:13<86:40:14,  9.07s/it]
  9%|▉         | 3564/37963 [8:53:21<82:47:10,  8.66s/it]
  9%|▉         | 3565/37963 [8:53:29<80:26:10,  8.42s/it]
  9%|▉         | 3566/37963 [8:53:37<78:41:41,  8.24s/it]
  9%|▉         | 3567/37963 [8:53:45<77:28:03,  8.11s/it]
  9%|▉         | 3568/37963 [8:53:52<75:52:47,  7.94s/it]
  9%|▉         | 3569/37963 [8:54:00<75:15:21,  7.88s/it]
  9%|▉         | 3570/37963 [8:54:07<74:18:33,  7.78s/it]
                                                         
{'loss': '0.1811', 'grad_norm': '4.476', 'learning_rate': '1.979e-05', 'epoch': '0.09404'}
+
  9%|▉         | 3570/37963 [8:54:07<74:18:33,  7.78s/it]
  9%|▉         | 3571/37963 [8:54:15<74:02:10,  7.75s/it]
  9%|▉         | 3572/37963 [8:54:23<73:55:21,  7.74s/it]
  9%|▉         | 3573/37963 [8:54:37<92:40:28,  9.70s/it]
  9%|▉         | 3574/37963 [8:54:45<87:19:46,  9.14s/it]
  9%|▉         | 3575/37963 [8:55:00<102:59:07, 10.78s/it]
  9%|▉         | 3576/37963 [8:55:14<114:57:19, 12.03s/it]
  9%|▉         | 3577/37963 [8:55:22<102:08:00, 10.69s/it]
  9%|▉         | 3578/37963 [8:55:30<93:47:14,  9.82s/it] 
  9%|▉         | 3579/37963 [8:55:38<87:42:27,  9.18s/it]
  9%|▉         | 3580/37963 [8:55:45<83:35:03,  8.75s/it]
                                                         
{'loss': '0.1753', 'grad_norm': '1.051', 'learning_rate': '1.978e-05', 'epoch': '0.0943'}
+
  9%|▉         | 3580/37963 [8:55:45<83:35:03,  8.75s/it]
  9%|▉         | 3581/37963 [8:55:53<80:07:28,  8.39s/it]
  9%|▉         | 3582/37963 [8:56:00<77:47:37,  8.15s/it]
  9%|▉         | 3583/37963 [8:56:08<76:29:07,  8.01s/it]
  9%|▉         | 3584/37963 [8:56:16<75:03:44,  7.86s/it]
  9%|▉         | 3585/37963 [8:56:23<74:30:11,  7.80s/it]
  9%|▉         | 3586/37963 [8:56:31<73:35:21,  7.71s/it]
  9%|▉         | 3587/37963 [8:56:38<73:38:54,  7.71s/it]
  9%|▉         | 3588/37963 [8:56:46<73:35:42,  7.71s/it]
  9%|▉         | 3589/37963 [8:56:54<73:23:32,  7.69s/it]
  9%|▉         | 3590/37963 [8:57:01<72:44:26,  7.62s/it]
                                                         
{'loss': '0.1703', 'grad_norm': '2.755', 'learning_rate': '1.978e-05', 'epoch': '0.09457'}
+
  9%|▉         | 3590/37963 [8:57:01<72:44:26,  7.62s/it]
  9%|▉         | 3591/37963 [8:57:15<90:53:51,  9.52s/it]
  9%|▉         | 3592/37963 [8:57:23<86:00:39,  9.01s/it]
  9%|▉         | 3593/37963 [8:57:38<102:08:09, 10.70s/it]
  9%|▉         | 3594/37963 [8:57:45<93:31:33,  9.80s/it] 
  9%|▉         | 3595/37963 [8:57:53<87:32:57,  9.17s/it]
  9%|▉         | 3596/37963 [8:58:01<83:04:36,  8.70s/it]
  9%|▉         | 3597/37963 [8:58:08<80:23:27,  8.42s/it]
  9%|▉         | 3598/37963 [8:58:16<78:20:07,  8.21s/it]
  9%|▉         | 3599/37963 [8:58:31<96:22:37, 10.10s/it]
  9%|▉         | 3600/37963 [8:58:39<90:03:49,  9.44s/it]
                                                         
{'loss': '0.1652', 'grad_norm': '3.946', 'learning_rate': '1.978e-05', 'epoch': '0.09483'}
+
  9%|▉         | 3600/37963 [8:58:39<90:03:49,  9.44s/it]
  9%|▉         | 3601/37963 [8:58:46<84:20:42,  8.84s/it]
  9%|▉         | 3602/37963 [8:58:54<81:11:54,  8.51s/it]
  9%|▉         | 3603/37963 [8:59:01<78:45:11,  8.25s/it]
  9%|▉         | 3604/37963 [8:59:09<77:05:13,  8.08s/it]
  9%|▉         | 3605/37963 [8:59:17<75:53:43,  7.95s/it]
  9%|▉         | 3606/37963 [8:59:24<74:24:55,  7.80s/it]
 10%|▉         | 3607/37963 [8:59:32<73:44:47,  7.73s/it]
 10%|▉         | 3608/37963 [8:59:39<73:18:21,  7.68s/it]
 10%|▉         | 3609/37963 [8:59:47<73:18:07,  7.68s/it]
 10%|▉         | 3610/37963 [9:00:08<111:08:01, 11.65s/it]
                                                          
{'loss': '0.1702', 'grad_norm': '3.709', 'learning_rate': '1.978e-05', 'epoch': '0.09509'}
+
 10%|▉         | 3610/37963 [9:00:08<111:08:01, 11.65s/it]
 10%|▉         | 3611/37963 [9:00:15<99:27:46, 10.42s/it] 
 10%|▉         | 3612/37963 [9:00:23<91:42:15,  9.61s/it]
 10%|▉         | 3613/37963 [9:00:31<85:59:33,  9.01s/it]
 10%|▉         | 3614/37963 [9:00:38<82:09:18,  8.61s/it]
 10%|▉         | 3615/37963 [9:00:46<79:33:57,  8.34s/it]
 10%|▉         | 3616/37963 [9:00:54<77:17:30,  8.10s/it]
 10%|▉         | 3617/37963 [9:01:01<76:19:25,  8.00s/it]
 10%|▉         | 3618/37963 [9:01:15<93:25:24,  9.79s/it]
 10%|▉         | 3619/37963 [9:01:23<87:22:26,  9.16s/it]
 10%|▉         | 3620/37963 [9:01:31<82:59:36,  8.70s/it]
                                                         
{'loss': '0.1697', 'grad_norm': '7.7', 'learning_rate': '1.978e-05', 'epoch': '0.09536'}
+
 10%|▉         | 3620/37963 [9:01:31<82:59:36,  8.70s/it]
 10%|▉         | 3621/37963 [9:01:38<79:43:15,  8.36s/it]
 10%|▉         | 3622/37963 [9:01:46<77:38:13,  8.14s/it]
 10%|▉         | 3623/37963 [9:01:53<75:26:40,  7.91s/it]
 10%|▉         | 3624/37963 [9:02:01<74:34:32,  7.82s/it]
 10%|▉         | 3625/37963 [9:02:09<74:11:07,  7.78s/it]
 10%|▉         | 3626/37963 [9:02:16<74:00:05,  7.76s/it]
 10%|▉         | 3627/37963 [9:02:24<72:59:30,  7.65s/it]
 10%|▉         | 3628/37963 [9:02:38<92:46:06,  9.73s/it]
 10%|▉         | 3629/37963 [9:02:46<87:13:04,  9.14s/it]
 10%|▉         | 3630/37963 [9:03:01<102:57:59, 10.80s/it]
                                                          
{'loss': '0.162', 'grad_norm': '2.627', 'learning_rate': '1.978e-05', 'epoch': '0.09562'}
+
 10%|▉         | 3630/37963 [9:03:01<102:57:59, 10.80s/it]
 10%|▉         | 3631/37963 [9:03:08<94:00:58,  9.86s/it] 
 10%|▉         | 3632/37963 [9:03:16<87:38:25,  9.19s/it]
 10%|▉         | 3633/37963 [9:03:24<83:27:33,  8.75s/it]
 10%|▉         | 3634/37963 [9:03:32<80:40:53,  8.46s/it]
 10%|▉         | 3635/37963 [9:03:46<96:42:33, 10.14s/it]
 10%|▉         | 3636/37963 [9:03:54<90:21:36,  9.48s/it]
 10%|▉         | 3637/37963 [9:04:01<84:43:50,  8.89s/it]
 10%|▉         | 3638/37963 [9:04:09<81:00:11,  8.50s/it]
 10%|▉         | 3639/37963 [9:04:16<78:08:26,  8.20s/it]
 10%|▉         | 3640/37963 [9:04:23<75:46:27,  7.95s/it]
                                                         
{'loss': '0.1777', 'grad_norm': '1.204', 'learning_rate': '1.977e-05', 'epoch': '0.09588'}
+
 10%|▉         | 3640/37963 [9:04:23<75:46:27,  7.95s/it]
 10%|▉         | 3641/37963 [9:04:31<74:10:11,  7.78s/it]
 10%|▉         | 3642/37963 [9:04:39<73:54:36,  7.75s/it]
 10%|▉         | 3643/37963 [9:04:46<73:31:45,  7.71s/it]
 10%|▉         | 3644/37963 [9:04:54<73:49:02,  7.74s/it]
 10%|▉         | 3645/37963 [9:05:02<73:31:32,  7.71s/it]
 10%|▉         | 3646/37963 [9:05:16<93:04:02,  9.76s/it]
 10%|▉         | 3647/37963 [9:05:24<87:32:31,  9.18s/it]
 10%|▉         | 3648/37963 [9:05:32<83:11:21,  8.73s/it]
 10%|▉         | 3649/37963 [9:05:39<80:11:11,  8.41s/it]
 10%|▉         | 3650/37963 [9:05:47<78:09:03,  8.20s/it]
                                                         
{'loss': '0.1812', 'grad_norm': '4.712', 'learning_rate': '1.977e-05', 'epoch': '0.09615'}
+
 10%|▉         | 3650/37963 [9:05:47<78:09:03,  8.20s/it]
 10%|▉         | 3651/37963 [9:05:55<76:32:27,  8.03s/it]
 10%|▉         | 3652/37963 [9:06:02<75:14:28,  7.89s/it]
 10%|▉         | 3653/37963 [9:06:17<94:27:20,  9.91s/it]
 10%|▉         | 3654/37963 [9:06:25<88:57:56,  9.34s/it]
 10%|▉         | 3655/37963 [9:06:33<84:33:57,  8.87s/it]
 10%|▉         | 3656/37963 [9:06:40<80:21:40,  8.43s/it]
 10%|▉         | 3657/37963 [9:06:48<77:41:47,  8.15s/it]
 10%|▉         | 3658/37963 [9:06:55<76:17:56,  8.01s/it]
 10%|▉         | 3659/37963 [9:07:03<75:25:00,  7.91s/it]
 10%|▉         | 3660/37963 [9:07:11<75:18:07,  7.90s/it]
                                                         
{'loss': '0.165', 'grad_norm': '2.024', 'learning_rate': '1.977e-05', 'epoch': '0.09641'}
+
 10%|▉         | 3660/37963 [9:07:11<75:18:07,  7.90s/it]
 10%|▉         | 3661/37963 [9:07:25<93:47:15,  9.84s/it]
 10%|▉         | 3662/37963 [9:07:33<87:28:59,  9.18s/it]
 10%|▉         | 3663/37963 [9:07:40<82:24:53,  8.65s/it]
 10%|▉         | 3664/37963 [9:08:01<117:48:11, 12.36s/it]
 10%|▉         | 3665/37963 [9:08:09<104:50:15, 11.00s/it]
 10%|▉         | 3666/37963 [9:08:17<95:19:47, 10.01s/it] 
 10%|▉         | 3667/37963 [9:08:24<88:37:06,  9.30s/it]
 10%|▉         | 3668/37963 [9:08:32<83:36:37,  8.78s/it]
 10%|▉         | 3669/37963 [9:08:40<80:45:15,  8.48s/it]
 10%|▉         | 3670/37963 [9:08:47<78:19:37,  8.22s/it]
                                                         
{'loss': '0.1838', 'grad_norm': '9.26', 'learning_rate': '1.977e-05', 'epoch': '0.09667'}
+
 10%|▉         | 3670/37963 [9:08:47<78:19:37,  8.22s/it]
 10%|▉         | 3671/37963 [9:08:55<76:28:02,  8.03s/it]
 10%|▉         | 3672/37963 [9:09:03<76:00:53,  7.98s/it]
 10%|▉         | 3673/37963 [9:09:11<75:21:21,  7.91s/it]
 10%|▉         | 3674/37963 [9:09:18<75:12:07,  7.90s/it]
 10%|▉         | 3675/37963 [9:09:26<74:28:44,  7.82s/it]
 10%|▉         | 3676/37963 [9:09:34<73:37:58,  7.73s/it]
 10%|▉         | 3677/37963 [9:09:41<73:22:34,  7.70s/it]
 10%|▉         | 3678/37963 [9:10:04<116:25:34, 12.22s/it]
 10%|▉         | 3679/37963 [9:10:12<103:32:14, 10.87s/it]
 10%|▉         | 3680/37963 [9:10:19<94:30:54,  9.92s/it] 
                                                         
{'loss': '0.1852', 'grad_norm': '5.981', 'learning_rate': '1.977e-05', 'epoch': '0.09694'}
+
 10%|▉         | 3680/37963 [9:10:19<94:30:54,  9.92s/it]
 10%|▉         | 3681/37963 [9:10:27<88:12:29,  9.26s/it]
 10%|▉         | 3682/37963 [9:10:35<83:42:48,  8.79s/it]
 10%|▉         | 3683/37963 [9:10:42<79:52:27,  8.39s/it]
 10%|▉         | 3684/37963 [9:10:57<97:13:03, 10.21s/it]
 10%|▉         | 3685/37963 [9:11:04<90:03:04,  9.46s/it]
 10%|▉         | 3686/37963 [9:11:12<85:11:08,  8.95s/it]
 10%|▉         | 3687/37963 [9:11:20<81:33:26,  8.57s/it]
 10%|▉         | 3688/37963 [9:11:27<78:45:18,  8.27s/it]
 10%|▉         | 3689/37963 [9:11:35<77:15:23,  8.11s/it]
 10%|▉         | 3690/37963 [9:11:43<75:57:40,  7.98s/it]
                                                         
{'loss': '0.1796', 'grad_norm': '5.27', 'learning_rate': '1.976e-05', 'epoch': '0.0972'}
+
 10%|▉         | 3690/37963 [9:11:43<75:57:40,  7.98s/it]
 10%|▉         | 3691/37963 [9:11:51<75:21:34,  7.92s/it]
 10%|▉         | 3692/37963 [9:11:58<74:34:13,  7.83s/it]
 10%|▉         | 3693/37963 [9:12:06<73:55:22,  7.77s/it]
 10%|▉         | 3694/37963 [9:12:14<74:05:10,  7.78s/it]
 10%|▉         | 3695/37963 [9:12:21<73:52:35,  7.76s/it]
 10%|▉         | 3696/37963 [9:12:29<73:26:16,  7.72s/it]
 10%|▉         | 3697/37963 [9:12:44<94:34:18,  9.94s/it]
 10%|▉         | 3698/37963 [9:12:52<87:58:17,  9.24s/it]
 10%|▉         | 3699/37963 [9:12:59<83:22:36,  8.76s/it]
 10%|▉         | 3700/37963 [9:13:07<79:54:47,  8.40s/it]
                                                         
{'loss': '0.1666', 'grad_norm': '3.753', 'learning_rate': '1.976e-05', 'epoch': '0.09746'}
+
 10%|▉         | 3700/37963 [9:13:07<79:54:47,  8.40s/it]
 10%|▉         | 3701/37963 [9:13:15<78:10:55,  8.21s/it]
 10%|▉         | 3702/37963 [9:13:22<76:22:50,  8.03s/it]
 10%|▉         | 3703/37963 [9:13:30<75:08:22,  7.90s/it]
 10%|▉         | 3704/37963 [9:13:45<94:26:21,  9.92s/it]
 10%|▉         | 3705/37963 [9:13:52<88:08:44,  9.26s/it]
 10%|▉         | 3706/37963 [9:14:00<83:39:04,  8.79s/it]
 10%|▉         | 3707/37963 [9:14:08<80:27:36,  8.46s/it]
 10%|▉         | 3708/37963 [9:14:29<115:46:00, 12.17s/it]
 10%|▉         | 3709/37963 [9:14:36<102:40:44, 10.79s/it]
 10%|▉         | 3710/37963 [9:14:44<93:49:01,  9.86s/it] 
                                                         
{'loss': '0.1821', 'grad_norm': '2.861', 'learning_rate': '1.976e-05', 'epoch': '0.09773'}
+
 10%|▉         | 3710/37963 [9:14:44<93:49:01,  9.86s/it]
 10%|▉         | 3711/37963 [9:14:52<87:42:34,  9.22s/it]
 10%|▉         | 3712/37963 [9:14:59<83:26:15,  8.77s/it]
 10%|▉         | 3713/37963 [9:15:07<80:02:44,  8.41s/it]
 10%|▉         | 3714/37963 [9:15:14<77:48:37,  8.18s/it]
 10%|▉         | 3715/37963 [9:15:29<94:38:31,  9.95s/it]
 10%|▉         | 3716/37963 [9:15:36<87:59:33,  9.25s/it]
 10%|▉         | 3717/37963 [9:15:44<83:02:27,  8.73s/it]
 10%|▉         | 3718/37963 [9:15:51<79:48:42,  8.39s/it]
 10%|▉         | 3719/37963 [9:15:59<77:52:24,  8.19s/it]
 10%|▉         | 3720/37963 [9:16:07<76:14:19,  8.02s/it]
                                                         
{'loss': '0.1619', 'grad_norm': '2.31', 'learning_rate': '1.976e-05', 'epoch': '0.09799'}
+
 10%|▉         | 3720/37963 [9:16:07<76:14:19,  8.02s/it]
 10%|▉         | 3721/37963 [9:16:14<75:20:36,  7.92s/it]
 10%|▉         | 3722/37963 [9:16:22<74:29:42,  7.83s/it]
 10%|▉         | 3723/37963 [9:16:29<73:40:21,  7.75s/it]
 10%|▉         | 3724/37963 [9:16:37<73:23:36,  7.72s/it]
 10%|▉         | 3725/37963 [9:16:45<73:15:14,  7.70s/it]
 10%|▉         | 3726/37963 [9:16:52<73:14:24,  7.70s/it]
 10%|▉         | 3727/37963 [9:17:00<72:10:13,  7.59s/it]
 10%|▉         | 3728/37963 [9:17:07<72:20:44,  7.61s/it]
 10%|▉         | 3729/37963 [9:17:22<92:47:45,  9.76s/it]
 10%|▉         | 3730/37963 [9:17:30<86:19:22,  9.08s/it]
                                                         
{'loss': '0.1582', 'grad_norm': '2.84', 'learning_rate': '1.976e-05', 'epoch': '0.09825'}
+
 10%|▉         | 3730/37963 [9:17:30<86:19:22,  9.08s/it]
 10%|▉         | 3731/37963 [9:17:44<102:34:04, 10.79s/it]
 10%|▉         | 3732/37963 [9:17:52<93:59:08,  9.88s/it] 
 10%|▉         | 3733/37963 [9:18:00<87:35:20,  9.21s/it]
 10%|▉         | 3734/37963 [9:18:14<101:38:58, 10.69s/it]
 10%|▉         | 3735/37963 [9:18:22<93:07:32,  9.79s/it] 
 10%|▉         | 3736/37963 [9:18:29<87:08:12,  9.17s/it]
 10%|▉         | 3737/37963 [9:18:37<82:44:21,  8.70s/it]
 10%|▉         | 3738/37963 [9:18:45<79:43:05,  8.39s/it]
 10%|▉         | 3739/37963 [9:18:52<77:06:13,  8.11s/it]
 10%|▉         | 3740/37963 [9:19:07<96:28:00, 10.15s/it]
                                                         
{'loss': '0.1562', 'grad_norm': '1.735', 'learning_rate': '1.975e-05', 'epoch': '0.09852'}
+
 10%|▉         | 3740/37963 [9:19:07<96:28:00, 10.15s/it]
 10%|▉         | 3741/37963 [9:19:15<89:23:55,  9.40s/it]
 10%|▉         | 3742/37963 [9:19:22<83:57:55,  8.83s/it]
 10%|▉         | 3743/37963 [9:19:30<80:33:37,  8.48s/it]
 10%|▉         | 3744/37963 [9:19:38<78:15:45,  8.23s/it]
 10%|▉         | 3745/37963 [9:19:45<75:54:53,  7.99s/it]
 10%|▉         | 3746/37963 [9:19:52<74:16:42,  7.81s/it]
 10%|▉         | 3747/37963 [9:20:00<74:00:00,  7.79s/it]
 10%|▉         | 3748/37963 [9:20:08<73:30:11,  7.73s/it]
 10%|▉         | 3749/37963 [9:20:15<73:08:51,  7.70s/it]
 10%|▉         | 3750/37963 [9:20:23<73:17:52,  7.71s/it]
                                                         
{'loss': '0.1674', 'grad_norm': '3.105', 'learning_rate': '1.975e-05', 'epoch': '0.09878'}
+
 10%|▉         | 3750/37963 [9:20:23<73:17:52,  7.71s/it]
 10%|▉         | 3751/37963 [9:20:38<93:33:07,  9.84s/it]
 10%|▉         | 3752/37963 [9:20:52<105:43:33, 11.13s/it]
 10%|▉         | 3753/37963 [9:21:00<95:49:42, 10.08s/it] 
 10%|▉         | 3754/37963 [9:21:14<107:11:28, 11.28s/it]
 10%|▉         | 3755/37963 [9:21:22<97:22:07, 10.25s/it] 
 10%|▉         | 3756/37963 [9:21:29<90:05:34,  9.48s/it]
 10%|▉         | 3757/37963 [9:21:37<84:55:42,  8.94s/it]
 10%|▉         | 3758/37963 [9:21:45<81:32:29,  8.58s/it]
 10%|▉         | 3759/37963 [9:21:52<78:25:01,  8.25s/it]
 10%|▉         | 3760/37963 [9:22:00<76:58:33,  8.10s/it]
                                                         
{'loss': '0.1557', 'grad_norm': '1.794', 'learning_rate': '1.975e-05', 'epoch': '0.09904'}
+
 10%|▉         | 3760/37963 [9:22:00<76:58:33,  8.10s/it]
 10%|▉         | 3761/37963 [9:22:08<75:39:27,  7.96s/it]
 10%|▉         | 3762/37963 [9:22:15<75:14:29,  7.92s/it]
 10%|▉         | 3763/37963 [9:22:23<74:45:31,  7.87s/it]
 10%|▉         | 3764/37963 [9:22:31<73:35:39,  7.75s/it]
 10%|▉         | 3765/37963 [9:22:45<91:33:49,  9.64s/it]
 10%|▉         | 3766/37963 [9:22:53<87:16:24,  9.19s/it]
 10%|▉         | 3767/37963 [9:23:00<82:28:23,  8.68s/it]
 10%|▉         | 3768/37963 [9:23:08<80:00:05,  8.42s/it]
 10%|▉         | 3769/37963 [9:23:16<77:40:57,  8.18s/it]
 10%|▉         | 3770/37963 [9:23:23<75:58:32,  8.00s/it]
                                                         
{'loss': '0.1718', 'grad_norm': '2.472', 'learning_rate': '1.975e-05', 'epoch': '0.09931'}
+
 10%|▉         | 3770/37963 [9:23:23<75:58:32,  8.00s/it]
 10%|▉         | 3771/37963 [9:23:31<74:12:27,  7.81s/it]
 10%|▉         | 3772/37963 [9:23:38<74:00:19,  7.79s/it]
 10%|▉         | 3773/37963 [9:23:46<73:39:30,  7.76s/it]
 10%|▉         | 3774/37963 [9:23:54<73:58:32,  7.79s/it]
 10%|▉         | 3775/37963 [9:24:02<73:29:08,  7.74s/it]
 10%|▉         | 3776/37963 [9:24:09<73:20:39,  7.72s/it]
 10%|▉         | 3777/37963 [9:24:24<93:10:41,  9.81s/it]
 10%|▉         | 3778/37963 [9:24:39<107:23:56, 11.31s/it]
 10%|▉         | 3779/37963 [9:24:46<97:05:07, 10.22s/it] 
 10%|▉         | 3780/37963 [9:24:54<89:47:21,  9.46s/it]
                                                         
{'loss': '0.1675', 'grad_norm': '2.018', 'learning_rate': '1.975e-05', 'epoch': '0.09957'}
+
 10%|▉         | 3780/37963 [9:24:54<89:47:21,  9.46s/it]
 10%|▉         | 3781/37963 [9:25:02<84:35:26,  8.91s/it]
 10%|▉         | 3782/37963 [9:25:09<81:11:07,  8.55s/it]
 10%|▉         | 3783/37963 [9:25:17<78:55:38,  8.31s/it]
 10%|▉         | 3784/37963 [9:25:32<96:04:14, 10.12s/it]
 10%|▉         | 3785/37963 [9:25:39<89:14:24,  9.40s/it]
 10%|▉         | 3786/37963 [9:25:47<84:11:49,  8.87s/it]
 10%|▉         | 3787/37963 [9:25:55<80:44:22,  8.50s/it]
 10%|▉         | 3788/37963 [9:26:02<77:48:12,  8.20s/it]
 10%|▉         | 3789/37963 [9:26:10<76:17:53,  8.04s/it]
 10%|▉         | 3790/37963 [9:26:17<75:11:08,  7.92s/it]
                                                         
{'loss': '0.1743', 'grad_norm': '4.191', 'learning_rate': '1.975e-05', 'epoch': '0.09983'}
+
 10%|▉         | 3790/37963 [9:26:17<75:11:08,  7.92s/it]
 10%|▉         | 3791/37963 [9:26:25<74:19:31,  7.83s/it]
 10%|▉         | 3792/37963 [9:26:39<92:29:41,  9.74s/it]
 10%|▉         | 3793/37963 [9:26:47<86:50:36,  9.15s/it]
 10%|▉         | 3794/37963 [9:26:55<82:32:32,  8.70s/it]
 10%|▉         | 3795/37963 [9:27:02<79:25:23,  8.37s/it]
 10%|▉         | 3796/37963 [9:27:10<76:47:57,  8.09s/it]
 10%|█         | 3797/37963 [9:27:17<75:09:06,  7.92s/it]
 10%|█         | 3798/37963 [9:27:25<74:28:53,  7.85s/it]
 10%|█         | 3799/37963 [9:27:33<74:00:44,  7.80s/it]
 10%|█         | 3800/37963 [9:27:47<92:49:06,  9.78s/it]
                                                         
{'loss': '0.173', 'grad_norm': '3.112', 'learning_rate': '1.974e-05', 'epoch': '0.1001'}
+
 10%|█         | 3800/37963 [9:27:47<92:49:06,  9.78s/it]
 10%|█         | 3801/37963 [9:27:55<86:37:17,  9.13s/it]
 10%|█         | 3802/37963 [9:28:02<82:33:34,  8.70s/it]
 10%|█         | 3803/37963 [9:28:10<79:39:48,  8.40s/it]
 10%|█         | 3804/37963 [9:28:25<97:27:38, 10.27s/it]
 10%|█         | 3805/37963 [9:28:32<89:27:52,  9.43s/it]
 10%|█         | 3806/37963 [9:28:46<103:30:58, 10.91s/it]
 10%|█         | 3807/37963 [9:28:54<94:43:00,  9.98s/it] 
 10%|█         | 3808/37963 [9:29:02<88:09:33,  9.29s/it]
 10%|█         | 3809/37963 [9:29:10<83:23:39,  8.79s/it]
 10%|█         | 3810/37963 [9:29:17<80:22:01,  8.47s/it]
                                                         
{'loss': '0.1741', 'grad_norm': '2.217', 'learning_rate': '1.974e-05', 'epoch': '0.1004'}
+
 10%|█         | 3810/37963 [9:29:17<80:22:01,  8.47s/it]
 10%|█         | 3811/37963 [9:29:25<78:14:02,  8.25s/it]
 10%|█         | 3812/37963 [9:29:39<95:43:20, 10.09s/it]
 10%|█         | 3813/37963 [9:29:47<88:33:38,  9.34s/it]
 10%|█         | 3814/37963 [9:29:55<83:52:30,  8.84s/it]
 10%|█         | 3815/37963 [9:30:02<80:36:50,  8.50s/it]
 10%|█         | 3816/37963 [9:30:10<77:31:19,  8.17s/it]
 10%|█         | 3817/37963 [9:30:17<75:13:09,  7.93s/it]
 10%|█         | 3818/37963 [9:30:25<74:25:29,  7.85s/it]
 10%|█         | 3819/37963 [9:30:32<73:05:09,  7.71s/it]
 10%|█         | 3820/37963 [9:30:40<72:47:25,  7.67s/it]
                                                         
{'loss': '0.1725', 'grad_norm': '4.025', 'learning_rate': '1.974e-05', 'epoch': '0.1006'}
+
 10%|█         | 3820/37963 [9:30:40<72:47:25,  7.67s/it]
 10%|█         | 3821/37963 [9:30:47<72:52:32,  7.68s/it]
 10%|█         | 3822/37963 [9:30:55<72:31:55,  7.65s/it]
 10%|█         | 3823/37963 [9:31:03<72:26:46,  7.64s/it]
 10%|█         | 3824/37963 [9:31:10<71:51:02,  7.58s/it]
 10%|█         | 3825/37963 [9:31:25<92:23:49,  9.74s/it]
 10%|█         | 3826/37963 [9:31:32<85:26:12,  9.01s/it]
 10%|█         | 3827/37963 [9:31:40<81:51:34,  8.63s/it]
 10%|█         | 3828/37963 [9:31:48<79:55:44,  8.43s/it]
 10%|█         | 3829/37963 [9:31:56<77:55:55,  8.22s/it]
 10%|█         | 3830/37963 [9:32:03<75:28:23,  7.96s/it]
                                                         
{'loss': '0.1819', 'grad_norm': '2.698', 'learning_rate': '1.974e-05', 'epoch': '0.1009'}
+
 10%|█         | 3830/37963 [9:32:03<75:28:23,  7.96s/it]
 10%|█         | 3831/37963 [9:32:10<73:34:57,  7.76s/it]
 10%|█         | 3832/37963 [9:32:25<94:41:34,  9.99s/it]
 10%|█         | 3833/37963 [9:32:33<87:41:37,  9.25s/it]
 10%|█         | 3834/37963 [9:32:41<83:16:15,  8.78s/it]
 10%|█         | 3835/37963 [9:32:48<80:28:39,  8.49s/it]
 10%|█         | 3836/37963 [9:32:56<77:43:10,  8.20s/it]
 10%|█         | 3837/37963 [9:33:10<94:58:02, 10.02s/it]
 10%|█         | 3838/37963 [9:33:18<89:12:18,  9.41s/it]
 10%|█         | 3839/37963 [9:33:26<84:08:33,  8.88s/it]
 10%|█         | 3840/37963 [9:33:33<80:39:32,  8.51s/it]
                                                         
{'loss': '0.1621', 'grad_norm': '3.928', 'learning_rate': '1.974e-05', 'epoch': '0.1012'}
+
 10%|█         | 3840/37963 [9:33:34<80:39:32,  8.51s/it]
 10%|█         | 3841/37963 [9:33:48<98:33:37, 10.40s/it]
 10%|█         | 3842/37963 [9:33:56<90:48:50,  9.58s/it]
 10%|█         | 3843/37963 [9:34:04<85:23:41,  9.01s/it]
 10%|█         | 3844/37963 [9:34:18<100:47:30, 10.63s/it]
 10%|█         | 3845/37963 [9:34:26<92:43:22,  9.78s/it] 
 10%|█         | 3846/37963 [9:34:33<86:16:54,  9.10s/it]
 10%|█         | 3847/37963 [9:34:41<81:28:41,  8.60s/it]
 10%|█         | 3848/37963 [9:34:48<78:49:49,  8.32s/it]
 10%|█         | 3849/37963 [9:34:56<76:44:17,  8.10s/it]
 10%|█         | 3850/37963 [9:35:04<75:12:50,  7.94s/it]
                                                         
{'loss': '0.1669', 'grad_norm': '2.171', 'learning_rate': '1.973e-05', 'epoch': '0.1014'}
+
 10%|█         | 3850/37963 [9:35:04<75:12:50,  7.94s/it]
 10%|█         | 3851/37963 [9:35:11<74:49:40,  7.90s/it]
 10%|█         | 3852/37963 [9:35:19<74:18:24,  7.84s/it]
 10%|█         | 3853/37963 [9:35:34<93:38:55,  9.88s/it]
 10%|█         | 3854/37963 [9:35:42<87:40:40,  9.25s/it]
 10%|█         | 3855/37963 [9:35:49<83:06:45,  8.77s/it]
 10%|█         | 3856/37963 [9:36:03<98:40:06, 10.41s/it]
 10%|█         | 3857/37963 [9:36:11<90:51:34,  9.59s/it]
 10%|█         | 3858/37963 [9:36:19<85:24:27,  9.02s/it]
 10%|█         | 3859/37963 [9:36:26<81:07:42,  8.56s/it]
 10%|█         | 3860/37963 [9:36:41<97:08:12, 10.25s/it]
                                                         
{'loss': '0.1682', 'grad_norm': '1.803', 'learning_rate': '1.973e-05', 'epoch': '0.1017'}
+
 10%|█         | 3860/37963 [9:36:41<97:08:12, 10.25s/it]
 10%|█         | 3861/37963 [9:36:48<90:04:27,  9.51s/it]
 10%|█         | 3862/37963 [9:36:56<84:36:03,  8.93s/it]
 10%|█         | 3863/37963 [9:37:04<80:56:07,  8.54s/it]
 10%|█         | 3864/37963 [9:37:11<78:09:11,  8.25s/it]
 10%|█         | 3865/37963 [9:37:19<76:28:02,  8.07s/it]
 10%|█         | 3866/37963 [9:37:26<74:35:25,  7.88s/it]
 10%|█         | 3867/37963 [9:37:34<73:07:08,  7.72s/it]
 10%|█         | 3868/37963 [9:37:41<72:34:36,  7.66s/it]
 10%|█         | 3869/37963 [9:37:49<72:18:34,  7.64s/it]
 10%|█         | 3870/37963 [9:37:56<72:15:26,  7.63s/it]
                                                         
{'loss': '0.1784', 'grad_norm': '2.29', 'learning_rate': '1.973e-05', 'epoch': '0.1019'}
+
 10%|█         | 3870/37963 [9:37:56<72:15:26,  7.63s/it]
 10%|█         | 3871/37963 [9:38:04<72:20:07,  7.64s/it]
 10%|█         | 3872/37963 [9:38:11<71:58:18,  7.60s/it]
 10%|█         | 3873/37963 [9:38:19<72:22:17,  7.64s/it]
 10%|█         | 3874/37963 [9:38:27<72:14:08,  7.63s/it]
 10%|█         | 3875/37963 [9:38:34<72:23:35,  7.65s/it]
 10%|█         | 3876/37963 [9:38:42<72:11:33,  7.62s/it]
 10%|█         | 3877/37963 [9:38:50<72:16:46,  7.63s/it]
 10%|█         | 3878/37963 [9:39:05<93:01:56,  9.83s/it]
 10%|█         | 3879/37963 [9:39:20<107:28:31, 11.35s/it]
 10%|█         | 3880/37963 [9:39:27<97:21:52, 10.28s/it] 
                                                         
{'loss': '0.1783', 'grad_norm': '2.846', 'learning_rate': '1.973e-05', 'epoch': '0.1022'}
+
 10%|█         | 3880/37963 [9:39:27<97:21:52, 10.28s/it]
 10%|█         | 3881/37963 [9:39:35<90:02:52,  9.51s/it]
 10%|█         | 3882/37963 [9:39:43<84:43:59,  8.95s/it]
 10%|█         | 3883/37963 [9:39:50<80:48:45,  8.54s/it]
 10%|█         | 3884/37963 [9:39:58<78:09:59,  8.26s/it]
 10%|█         | 3885/37963 [9:40:06<76:32:26,  8.09s/it]
 10%|█         | 3886/37963 [9:40:20<95:32:59, 10.09s/it]
 10%|█         | 3887/37963 [9:40:28<88:33:43,  9.36s/it]
 10%|█         | 3888/37963 [9:40:42<102:14:18, 10.80s/it]
 10%|█         | 3889/37963 [9:40:50<94:04:16,  9.94s/it] 
 10%|█         | 3890/37963 [9:40:58<88:12:35,  9.32s/it]
                                                         
{'loss': '0.1747', 'grad_norm': '1.461', 'learning_rate': '1.973e-05', 'epoch': '0.1025'}
+
 10%|█         | 3890/37963 [9:40:58<88:12:35,  9.32s/it]
 10%|█         | 3891/37963 [9:41:12<101:29:52, 10.72s/it]
 10%|█         | 3892/37963 [9:41:20<93:04:32,  9.83s/it] 
 10%|█         | 3893/37963 [9:41:27<86:50:30,  9.18s/it]
 10%|█         | 3894/37963 [9:41:35<82:24:15,  8.71s/it]
 10%|█         | 3895/37963 [9:41:43<79:18:24,  8.38s/it]
 10%|█         | 3896/37963 [9:41:50<77:13:44,  8.16s/it]
 10%|█         | 3897/37963 [9:41:58<76:00:19,  8.03s/it]
 10%|█         | 3898/37963 [9:42:06<74:57:20,  7.92s/it]
 10%|█         | 3899/37963 [9:42:13<74:09:54,  7.84s/it]
 10%|█         | 3900/37963 [9:42:21<73:58:30,  7.82s/it]
                                                         
{'loss': '0.1741', 'grad_norm': '4.26', 'learning_rate': '1.972e-05', 'epoch': '0.1027'}
+
 10%|█         | 3900/37963 [9:42:21<73:58:30,  7.82s/it]
 10%|█         | 3901/37963 [9:42:36<94:15:43,  9.96s/it]
 10%|█         | 3902/37963 [9:42:43<87:06:38,  9.21s/it]
 10%|█         | 3903/37963 [9:42:51<82:51:12,  8.76s/it]
 10%|█         | 3904/37963 [9:43:05<97:36:58, 10.32s/it]
 10%|█         | 3905/37963 [9:43:13<90:08:33,  9.53s/it]
 10%|█         | 3906/37963 [9:43:21<85:09:34,  9.00s/it]
 10%|█         | 3907/37963 [9:43:28<81:13:55,  8.59s/it]
 10%|█         | 3908/37963 [9:43:36<78:22:40,  8.29s/it]
 10%|█         | 3909/37963 [9:43:44<76:58:48,  8.14s/it]
 10%|█         | 3910/37963 [9:43:51<76:02:50,  8.04s/it]
                                                         
{'loss': '0.1766', 'grad_norm': '2.558', 'learning_rate': '1.972e-05', 'epoch': '0.103'}
+
 10%|█         | 3910/37963 [9:43:51<76:02:50,  8.04s/it]
 10%|█         | 3911/37963 [9:44:06<94:26:01,  9.98s/it]
 10%|█         | 3912/37963 [9:44:13<87:36:48,  9.26s/it]
 10%|█         | 3913/37963 [9:44:21<83:33:46,  8.83s/it]
 10%|█         | 3914/37963 [9:44:29<80:23:55,  8.50s/it]
 10%|█         | 3915/37963 [9:44:37<78:07:53,  8.26s/it]
 10%|█         | 3916/37963 [9:44:44<76:43:34,  8.11s/it]
 10%|█         | 3917/37963 [9:44:52<74:48:28,  7.91s/it]
 10%|█         | 3918/37963 [9:45:00<74:03:27,  7.83s/it]
 10%|█         | 3919/37963 [9:45:07<73:41:39,  7.79s/it]
 10%|█         | 3920/37963 [9:45:15<73:09:39,  7.74s/it]
                                                         
{'loss': '0.1754', 'grad_norm': '3.32', 'learning_rate': '1.972e-05', 'epoch': '0.1033'}
+
 10%|█         | 3920/37963 [9:45:15<73:09:39,  7.74s/it]
 10%|█         | 3921/37963 [9:45:23<73:05:46,  7.73s/it]
 10%|█         | 3922/37963 [9:45:30<73:06:55,  7.73s/it]
 10%|█         | 3923/37963 [9:45:38<72:41:42,  7.69s/it]
 10%|█         | 3924/37963 [9:45:53<94:10:27,  9.96s/it]
 10%|█         | 3925/37963 [9:46:01<87:16:58,  9.23s/it]
 10%|█         | 3926/37963 [9:46:16<103:15:57, 10.92s/it]
 10%|█         | 3927/37963 [9:46:23<94:41:34, 10.02s/it] 
 10%|█         | 3928/37963 [9:46:31<88:06:43,  9.32s/it]
 10%|█         | 3929/37963 [9:46:39<82:34:31,  8.73s/it]
 10%|█         | 3930/37963 [9:46:46<79:46:36,  8.44s/it]
                                                         
{'loss': '0.1672', 'grad_norm': '1.568', 'learning_rate': '1.972e-05', 'epoch': '0.1035'}
+
 10%|█         | 3930/37963 [9:46:46<79:46:36,  8.44s/it]
 10%|█         | 3931/37963 [9:46:54<76:52:15,  8.13s/it]
 10%|█         | 3932/37963 [9:47:01<75:45:44,  8.01s/it]
 10%|█         | 3933/37963 [9:47:16<95:38:23, 10.12s/it]
 10%|█         | 3934/37963 [9:47:24<89:26:40,  9.46s/it]
 10%|█         | 3935/37963 [9:47:32<84:30:57,  8.94s/it]
 10%|█         | 3936/37963 [9:47:40<80:53:36,  8.56s/it]
 10%|█         | 3937/37963 [9:47:47<78:31:45,  8.31s/it]
 10%|█         | 3938/37963 [9:48:02<94:45:25, 10.03s/it]
 10%|█         | 3939/37963 [9:48:09<87:23:48,  9.25s/it]
 10%|█         | 3940/37963 [9:48:16<82:00:33,  8.68s/it]
                                                         
{'loss': '0.1613', 'grad_norm': '3.328', 'learning_rate': '1.972e-05', 'epoch': '0.1038'}
+
 10%|█         | 3940/37963 [9:48:16<82:00:33,  8.68s/it]
 10%|█         | 3941/37963 [9:48:31<97:47:38, 10.35s/it]
 10%|█         | 3942/37963 [9:48:38<90:26:11,  9.57s/it]
 10%|█         | 3943/37963 [9:48:46<85:08:08,  9.01s/it]
 10%|█         | 3944/37963 [9:48:54<81:29:55,  8.62s/it]
 10%|█         | 3945/37963 [9:49:01<78:11:41,  8.28s/it]
 10%|█         | 3946/37963 [9:49:09<76:23:12,  8.08s/it]
 10%|█         | 3947/37963 [9:49:17<75:21:35,  7.98s/it]
 10%|█         | 3948/37963 [9:49:24<74:28:22,  7.88s/it]
 10%|█         | 3949/37963 [9:49:32<73:17:10,  7.76s/it]
 10%|█         | 3950/37963 [9:49:47<93:47:39,  9.93s/it]
                                                         
{'loss': '0.1977', 'grad_norm': '2.272', 'learning_rate': '1.971e-05', 'epoch': '0.104'}
+
 10%|█         | 3950/37963 [9:49:47<93:47:39,  9.93s/it]
 10%|█         | 3951/37963 [9:49:55<87:51:11,  9.30s/it]
 10%|█         | 3952/37963 [9:50:09<102:15:03, 10.82s/it]
 10%|█         | 3953/37963 [9:50:17<93:15:07,  9.87s/it] 
 10%|█         | 3954/37963 [9:50:24<87:01:47,  9.21s/it]
 10%|█         | 3955/37963 [9:50:32<82:03:57,  8.69s/it]
 10%|█         | 3956/37963 [9:50:39<79:10:37,  8.38s/it]
 10%|█         | 3957/37963 [9:50:54<95:54:05, 10.15s/it]
 10%|█         | 3958/37963 [9:51:01<89:20:34,  9.46s/it]
 10%|█         | 3959/37963 [9:51:09<84:16:27,  8.92s/it]
 10%|█         | 3960/37963 [9:51:16<79:50:16,  8.45s/it]
                                                         
{'loss': '0.1834', 'grad_norm': '3.046', 'learning_rate': '1.971e-05', 'epoch': '0.1043'}
+
 10%|█         | 3960/37963 [9:51:16<79:50:16,  8.45s/it]
 10%|█         | 3961/37963 [9:51:24<77:38:26,  8.22s/it]
 10%|█         | 3962/37963 [9:51:32<75:50:18,  8.03s/it]
 10%|█         | 3963/37963 [9:51:39<74:28:50,  7.89s/it]
 10%|█         | 3964/37963 [9:51:47<73:53:30,  7.82s/it]
 10%|█         | 3965/37963 [9:51:55<74:02:00,  7.84s/it]
 10%|█         | 3966/37963 [9:52:03<73:45:31,  7.81s/it]
 10%|█         | 3967/37963 [9:52:10<73:35:42,  7.79s/it]
 10%|█         | 3968/37963 [9:52:18<73:53:25,  7.82s/it]
 10%|█         | 3969/37963 [9:52:26<73:42:05,  7.81s/it]
 10%|█         | 3970/37963 [9:52:41<93:06:55,  9.86s/it]
                                                         
{'loss': '0.1826', 'grad_norm': '4.281', 'learning_rate': '1.971e-05', 'epoch': '0.1046'}
+
 10%|█         | 3970/37963 [9:52:41<93:06:55,  9.86s/it]
 10%|█         | 3971/37963 [9:52:48<87:02:38,  9.22s/it]
 10%|█         | 3972/37963 [9:52:56<82:30:58,  8.74s/it]
 10%|█         | 3973/37963 [9:53:11<100:35:37, 10.65s/it]
 10%|█         | 3974/37963 [9:53:19<92:15:36,  9.77s/it] 
 10%|█         | 3975/37963 [9:53:26<85:40:21,  9.07s/it]
 10%|█         | 3976/37963 [9:53:34<81:47:50,  8.66s/it]
 10%|█         | 3977/37963 [9:53:42<78:58:12,  8.36s/it]
 10%|█         | 3978/37963 [9:53:49<77:05:34,  8.17s/it]
 10%|█         | 3979/37963 [9:53:57<75:46:28,  8.03s/it]
 10%|█         | 3980/37963 [9:54:04<73:56:33,  7.83s/it]
                                                         
{'loss': '0.1721', 'grad_norm': '2.228', 'learning_rate': '1.971e-05', 'epoch': '0.1048'}
+
 10%|█         | 3980/37963 [9:54:04<73:56:33,  7.83s/it]
 10%|█         | 3981/37963 [9:54:19<93:28:42,  9.90s/it]
 10%|█         | 3982/37963 [9:54:27<87:26:25,  9.26s/it]
 10%|█         | 3983/37963 [9:54:35<82:55:08,  8.78s/it]
 10%|█         | 3984/37963 [9:54:42<79:43:38,  8.45s/it]
 10%|█         | 3985/37963 [9:54:50<77:37:42,  8.22s/it]
 10%|█         | 3986/37963 [9:54:58<76:07:55,  8.07s/it]
 11%|█         | 3987/37963 [9:55:05<74:14:42,  7.87s/it]
 11%|█         | 3988/37963 [9:55:13<73:33:14,  7.79s/it]
 11%|█         | 3989/37963 [9:55:20<73:14:45,  7.76s/it]
 11%|█         | 3990/37963 [9:55:28<73:08:54,  7.75s/it]
                                                         
{'loss': '0.1791', 'grad_norm': '2.879', 'learning_rate': '1.971e-05', 'epoch': '0.1051'}
+
 11%|█         | 3990/37963 [9:55:28<73:08:54,  7.75s/it]
 11%|█         | 3991/37963 [9:55:42<91:09:37,  9.66s/it]
 11%|█         | 3992/37963 [9:55:50<85:48:03,  9.09s/it]
 11%|█         | 3993/37963 [9:55:58<81:36:18,  8.65s/it]
 11%|█         | 3994/37963 [9:56:12<96:46:12, 10.26s/it]
 11%|█         | 3995/37963 [9:56:19<89:05:21,  9.44s/it]
 11%|█         | 3996/37963 [9:56:27<83:55:25,  8.89s/it]
 11%|█         | 3997/37963 [9:56:34<80:27:35,  8.53s/it]
 11%|█         | 3998/37963 [9:56:42<77:19:51,  8.20s/it]
 11%|█         | 3999/37963 [9:56:50<75:58:45,  8.05s/it]
 11%|█         | 4000/37963 [9:57:04<92:50:13,  9.84s/it]
                                                         
{'loss': '0.1623', 'grad_norm': '2.723', 'learning_rate': '1.97e-05', 'epoch': '0.1054'}
+
 11%|█         | 4000/37963 [9:57:04<92:50:13,  9.84s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|█���████████| 1/1 [00:09<00:00,  9.45s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.45s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 11%|█         | 4001/37963 [9:57:56<213:03:06, 22.58s/it]
 11%|█         | 4002/37963 [9:58:04<171:21:48, 18.17s/it]
 11%|█         | 4003/37963 [9:58:19<162:15:17, 17.20s/it]
 11%|█         | 4004/37963 [9:58:27<135:36:42, 14.38s/it]
 11%|█         | 4005/37963 [9:58:34<116:40:23, 12.37s/it]
 11%|█         | 4006/37963 [9:58:42<103:17:32, 10.95s/it]
 11%|█         | 4007/37963 [9:58:49<93:55:47,  9.96s/it] 
 11%|█         | 4008/37963 [9:58:57<87:38:15,  9.29s/it]
 11%|█         | 4009/37963 [9:59:05<82:58:05,  8.80s/it]
 11%|█         | 4010/37963 [9:59:12<79:20:07,  8.41s/it]
                                                         
{'loss': '0.1821', 'grad_norm': '2.554', 'learning_rate': '1.97e-05', 'epoch': '0.1056'}
+
 11%|█         | 4010/37963 [9:59:12<79:20:07,  8.41s/it]
 11%|█         | 4011/37963 [9:59:27<96:12:15, 10.20s/it]
 11%|█         | 4012/37963 [9:59:34<89:11:52,  9.46s/it]
 11%|█         | 4013/37963 [9:59:42<84:16:32,  8.94s/it]
 11%|█         | 4014/37963 [9:59:50<80:31:25,  8.54s/it]
 11%|█         | 4015/37963 [9:59:57<77:58:35,  8.27s/it]
 11%|█         | 4016/37963 [10:00:12<96:13:14, 10.20s/it]
 11%|█         | 4017/37963 [10:00:20<90:25:26,  9.59s/it]
 11%|█         | 4018/37963 [10:00:28<85:12:32,  9.04s/it]
 11%|█         | 4019/37963 [10:00:36<81:18:42,  8.62s/it]
 11%|█         | 4020/37963 [10:00:43<78:37:21,  8.34s/it]
                                                          
{'loss': '0.1675', 'grad_norm': '4.012', 'learning_rate': '1.97e-05', 'epoch': '0.1059'}
+
 11%|█         | 4020/37963 [10:00:43<78:37:21,  8.34s/it]
 11%|█         | 4021/37963 [10:00:51<76:51:39,  8.15s/it]
 11%|█         | 4022/37963 [10:00:59<74:57:20,  7.95s/it]
 11%|█         | 4023/37963 [10:01:06<74:02:18,  7.85s/it]
 11%|█         | 4024/37963 [10:01:14<73:23:07,  7.78s/it]
 11%|█         | 4025/37963 [10:01:22<73:22:30,  7.78s/it]
 11%|█         | 4026/37963 [10:01:36<93:17:38,  9.90s/it]
 11%|█         | 4027/37963 [10:01:44<87:09:41,  9.25s/it]
 11%|█         | 4028/37963 [10:01:52<82:44:13,  8.78s/it]
 11%|█         | 4029/37963 [10:01:59<79:14:46,  8.41s/it]
 11%|█         | 4030/37963 [10:02:14<96:37:00, 10.25s/it]
                                                          
{'loss': '0.1743', 'grad_norm': '2.335', 'learning_rate': '1.97e-05', 'epoch': '0.1062'}
+
 11%|█         | 4030/37963 [10:02:14<96:37:00, 10.25s/it]
 11%|█         | 4031/37963 [10:02:22<89:45:12,  9.52s/it]
 11%|█         | 4032/37963 [10:02:29<84:25:45,  8.96s/it]
 11%|█         | 4033/37963 [10:02:37<80:42:35,  8.56s/it]
 11%|█         | 4034/37963 [10:02:45<78:08:27,  8.29s/it]
 11%|█         | 4035/37963 [10:02:52<76:32:20,  8.12s/it]
 11%|█         | 4036/37963 [10:03:00<75:06:54,  7.97s/it]
 11%|█         | 4037/37963 [10:03:08<73:37:30,  7.81s/it]
 11%|█         | 4038/37963 [10:03:15<73:17:46,  7.78s/it]
 11%|█         | 4039/37963 [10:03:30<91:46:43,  9.74s/it]
 11%|█         | 4040/37963 [10:03:37<85:59:26,  9.13s/it]
                                                          
{'loss': '0.1778', 'grad_norm': '1.225', 'learning_rate': '1.97e-05', 'epoch': '0.1064'}
+
 11%|█         | 4040/37963 [10:03:37<85:59:26,  9.13s/it]
 11%|█         | 4041/37963 [10:03:45<81:43:21,  8.67s/it]
 11%|█         | 4042/37963 [10:03:59<96:55:34, 10.29s/it]
 11%|█         | 4043/37963 [10:04:07<89:37:12,  9.51s/it]
 11%|█         | 4044/37963 [10:04:14<84:27:20,  8.96s/it]
 11%|█         | 4045/37963 [10:04:22<80:15:03,  8.52s/it]
 11%|█         | 4046/37963 [10:04:29<77:42:36,  8.25s/it]
 11%|█         | 4047/37963 [10:04:44<94:23:51, 10.02s/it]
 11%|█         | 4048/37963 [10:04:51<87:31:46,  9.29s/it]
 11%|█         | 4049/37963 [10:04:59<83:14:55,  8.84s/it]
 11%|█         | 4050/37963 [10:05:07<80:26:14,  8.54s/it]
                                                          
{'loss': '0.153', 'grad_norm': '4.986', 'learning_rate': '1.969e-05', 'epoch': '0.1067'}
+
 11%|█         | 4050/37963 [10:05:07<80:26:14,  8.54s/it]
 11%|█         | 4051/37963 [10:05:22<98:58:48, 10.51s/it]
 11%|█         | 4052/37963 [10:05:30<91:26:15,  9.71s/it]
 11%|█         | 4053/37963 [10:05:37<85:37:15,  9.09s/it]
 11%|█         | 4054/37963 [10:05:45<81:40:00,  8.67s/it]
 11%|█         | 4055/37963 [10:05:53<78:33:01,  8.34s/it]
 11%|█         | 4056/37963 [10:06:00<76:41:02,  8.14s/it]
 11%|█         | 4057/37963 [10:06:08<75:35:09,  8.03s/it]
 11%|█         | 4058/37963 [10:06:22<92:41:54,  9.84s/it]
 11%|█         | 4059/37963 [10:06:30<86:41:12,  9.20s/it]
 11%|█         | 4060/37963 [10:06:37<82:11:15,  8.73s/it]
                                                          
{'loss': '0.1798', 'grad_norm': '3.844', 'learning_rate': '1.969e-05', 'epoch': '0.1069'}
+
 11%|█         | 4060/37963 [10:06:37<82:11:15,  8.73s/it]
 11%|█         | 4061/37963 [10:06:45<78:37:04,  8.35s/it]
 11%|█         | 4062/37963 [10:06:53<76:46:09,  8.15s/it]
 11%|█         | 4063/37963 [10:07:00<75:34:23,  8.03s/it]
 11%|█         | 4064/37963 [10:07:08<74:20:17,  7.89s/it]
 11%|█         | 4065/37963 [10:07:16<73:57:21,  7.85s/it]
 11%|█         | 4066/37963 [10:07:23<72:40:38,  7.72s/it]
 11%|█         | 4067/37963 [10:07:31<72:43:27,  7.72s/it]
 11%|█         | 4068/37963 [10:07:38<72:29:50,  7.70s/it]
 11%|█         | 4069/37963 [10:07:54<93:14:36,  9.90s/it]
 11%|█         | 4070/37963 [10:08:01<87:04:15,  9.25s/it]
                                                          
{'loss': '0.1775', 'grad_norm': '2.72', 'learning_rate': '1.969e-05', 'epoch': '0.1072'}
+
 11%|█         | 4070/37963 [10:08:01<87:04:15,  9.25s/it]
 11%|█         | 4071/37963 [10:08:09<81:46:25,  8.69s/it]
 11%|█         | 4072/37963 [10:08:16<79:06:22,  8.40s/it]
 11%|█         | 4073/37963 [10:08:24<76:51:26,  8.16s/it]
 11%|█         | 4074/37963 [10:08:39<95:06:51, 10.10s/it]
 11%|█         | 4075/37963 [10:08:46<88:33:34,  9.41s/it]
 11%|█         | 4076/37963 [10:08:54<83:39:53,  8.89s/it]
 11%|█         | 4077/37963 [10:09:02<80:10:04,  8.52s/it]
 11%|█         | 4078/37963 [10:09:09<78:03:38,  8.29s/it]
 11%|█         | 4079/37963 [10:09:17<76:23:12,  8.12s/it]
 11%|█         | 4080/37963 [10:09:25<74:37:56,  7.93s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '2.535', 'learning_rate': '1.969e-05', 'epoch': '0.1075'}
+
 11%|█         | 4080/37963 [10:09:25<74:37:56,  7.93s/it]
 11%|█         | 4081/37963 [10:09:32<72:49:26,  7.74s/it]
 11%|█         | 4082/37963 [10:09:40<72:19:09,  7.68s/it]
 11%|█         | 4083/37963 [10:09:47<72:23:42,  7.69s/it]
 11%|█         | 4084/37963 [10:10:01<90:50:24,  9.65s/it]
 11%|█         | 4085/37963 [10:10:09<85:10:36,  9.05s/it]
 11%|█         | 4086/37963 [10:10:17<81:29:14,  8.66s/it]
 11%|█         | 4087/37963 [10:10:25<78:47:27,  8.37s/it]
 11%|█         | 4088/37963 [10:10:39<95:37:22, 10.16s/it]
 11%|█         | 4089/37963 [10:10:47<88:45:35,  9.43s/it]
 11%|█         | 4090/37963 [10:11:01<102:30:12, 10.89s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '2.138', 'learning_rate': '1.968e-05', 'epoch': '0.1077'}
+
 11%|█         | 4090/37963 [10:11:01<102:30:12, 10.89s/it]
 11%|█         | 4091/37963 [10:11:09<93:48:05,  9.97s/it] 
 11%|█         | 4092/37963 [10:11:16<87:16:45,  9.28s/it]
 11%|█         | 4093/37963 [10:11:24<82:23:32,  8.76s/it]
 11%|█         | 4094/37963 [10:11:32<79:24:37,  8.44s/it]
 11%|█         | 4095/37963 [10:11:39<77:26:47,  8.23s/it]
 11%|█         | 4096/37963 [10:11:47<75:16:48,  8.00s/it]
 11%|█         | 4097/37963 [10:11:55<74:27:19,  7.91s/it]
 11%|█         | 4098/37963 [10:12:02<73:41:54,  7.83s/it]
 11%|█         | 4099/37963 [10:12:16<91:29:55,  9.73s/it]
 11%|█         | 4100/37963 [10:12:24<85:44:18,  9.11s/it]
                                                          
{'loss': '0.19', 'grad_norm': '3.972', 'learning_rate': '1.968e-05', 'epoch': '0.108'}
+
 11%|█         | 4100/37963 [10:12:24<85:44:18,  9.11s/it]
 11%|█         | 4101/37963 [10:12:39<101:46:33, 10.82s/it]
 11%|█         | 4102/37963 [10:12:46<92:52:36,  9.87s/it] 
 11%|█         | 4103/37963 [10:12:54<86:30:04,  9.20s/it]
 11%|█         | 4104/37963 [10:13:02<82:39:32,  8.79s/it]
 11%|█         | 4105/37963 [10:13:09<78:59:12,  8.40s/it]
 11%|█         | 4106/37963 [10:13:24<95:29:00, 10.15s/it]
 11%|█         | 4107/37963 [10:13:31<88:28:27,  9.41s/it]
 11%|█         | 4108/37963 [10:13:39<83:38:58,  8.89s/it]
 11%|█         | 4109/37963 [10:13:47<80:09:13,  8.52s/it]
 11%|█         | 4110/37963 [10:13:54<78:04:12,  8.30s/it]
                                                          
{'loss': '0.1524', 'grad_norm': '2.42', 'learning_rate': '1.968e-05', 'epoch': '0.1083'}
+
 11%|█         | 4110/37963 [10:13:54<78:04:12,  8.30s/it]
 11%|█         | 4111/37963 [10:14:02<76:17:04,  8.11s/it]
 11%|█         | 4112/37963 [10:14:10<74:43:57,  7.95s/it]
 11%|█         | 4113/37963 [10:14:18<74:27:25,  7.92s/it]
 11%|█         | 4114/37963 [10:14:25<73:45:18,  7.84s/it]
 11%|█         | 4115/37963 [10:14:33<73:54:07,  7.86s/it]
 11%|█         | 4116/37963 [10:14:41<73:12:48,  7.79s/it]
 11%|█         | 4117/37963 [10:14:56<94:28:13, 10.05s/it]
 11%|█         | 4118/37963 [10:15:04<87:19:12,  9.29s/it]
 11%|█         | 4119/37963 [10:15:11<83:01:39,  8.83s/it]
 11%|█         | 4120/37963 [10:15:19<80:01:59,  8.51s/it]
                                                          
{'loss': '0.1762', 'grad_norm': '1.359', 'learning_rate': '1.968e-05', 'epoch': '0.1085'}
+
 11%|█         | 4120/37963 [10:15:19<80:01:59,  8.51s/it]
 11%|█         | 4121/37963 [10:15:27<77:02:39,  8.20s/it]
 11%|█         | 4122/37963 [10:15:34<75:34:20,  8.04s/it]
 11%|█         | 4123/37963 [10:15:42<74:37:58,  7.94s/it]
 11%|█         | 4124/37963 [10:15:57<94:23:13, 10.04s/it]
 11%|█         | 4125/37963 [10:16:05<87:46:45,  9.34s/it]
 11%|█         | 4126/37963 [10:16:12<82:39:12,  8.79s/it]
 11%|█         | 4127/37963 [10:16:20<79:18:34,  8.44s/it]
 11%|█         | 4128/37963 [10:16:27<77:19:47,  8.23s/it]
 11%|█         | 4129/37963 [10:16:35<75:46:43,  8.06s/it]
 11%|█         | 4130/37963 [10:16:43<74:32:58,  7.93s/it]
                                                          
{'loss': '0.1699', 'grad_norm': '5.045', 'learning_rate': '1.968e-05', 'epoch': '0.1088'}
+
 11%|█         | 4130/37963 [10:16:43<74:32:58,  7.93s/it]
 11%|█         | 4131/37963 [10:16:57<93:21:20,  9.93s/it]
 11%|█         | 4132/37963 [10:17:05<87:07:33,  9.27s/it]
 11%|█         | 4133/37963 [10:17:19<101:16:52, 10.78s/it]
 11%|█         | 4134/37963 [10:17:27<92:46:08,  9.87s/it] 
 11%|█         | 4135/37963 [10:17:35<86:41:35,  9.23s/it]
 11%|█         | 4136/37963 [10:17:49<101:16:54, 10.78s/it]
 11%|█         | 4137/37963 [10:17:57<92:14:38,  9.82s/it] 
 11%|█         | 4138/37963 [10:18:05<86:15:42,  9.18s/it]
 11%|█         | 4139/37963 [10:18:12<80:55:38,  8.61s/it]
 11%|█         | 4140/37963 [10:18:19<78:02:31,  8.31s/it]
                                                          
{'loss': '0.1763', 'grad_norm': '5.998', 'learning_rate': '1.967e-05', 'epoch': '0.1091'}
+
 11%|█         | 4140/37963 [10:18:19<78:02:31,  8.31s/it]
 11%|█         | 4141/37963 [10:18:27<76:20:05,  8.13s/it]
 11%|█         | 4142/37963 [10:18:35<75:08:54,  8.00s/it]
 11%|█         | 4143/37963 [10:18:43<74:11:35,  7.90s/it]
 11%|█         | 4144/37963 [10:18:51<74:41:55,  7.95s/it]
 11%|█         | 4145/37963 [10:18:58<73:49:56,  7.86s/it]
 11%|█         | 4146/37963 [10:19:06<73:09:45,  7.79s/it]
 11%|█         | 4147/37963 [10:19:14<72:53:24,  7.76s/it]
 11%|█         | 4148/37963 [10:19:21<72:58:32,  7.77s/it]
 11%|█         | 4149/37963 [10:19:29<71:51:57,  7.65s/it]
 11%|█         | 4150/37963 [10:19:36<70:51:21,  7.54s/it]
                                                          
{'loss': '0.1737', 'grad_norm': '2.011', 'learning_rate': '1.967e-05', 'epoch': '0.1093'}
+
 11%|█         | 4150/37963 [10:19:36<70:51:21,  7.54s/it]
 11%|█         | 4151/37963 [10:19:44<71:18:23,  7.59s/it]
 11%|█         | 4152/37963 [10:19:58<89:39:53,  9.55s/it]
 11%|█         | 4153/37963 [10:20:06<84:43:13,  9.02s/it]
 11%|█         | 4154/37963 [10:20:13<81:01:23,  8.63s/it]
 11%|█         | 4155/37963 [10:20:28<97:43:14, 10.41s/it]
 11%|█         | 4156/37963 [10:20:42<108:32:11, 11.56s/it]
 11%|█         | 4157/37963 [10:20:50<98:31:55, 10.49s/it] 
 11%|█         | 4158/37963 [10:20:58<90:35:14,  9.65s/it]
 11%|█         | 4159/37963 [10:21:05<84:37:49,  9.01s/it]
 11%|█         | 4160/37963 [10:21:13<80:44:05,  8.60s/it]
                                                          
{'loss': '0.1733', 'grad_norm': '6.49', 'learning_rate': '1.967e-05', 'epoch': '0.1096'}
+
 11%|█         | 4160/37963 [10:21:13<80:44:05,  8.60s/it]
 11%|█         | 4161/37963 [10:21:21<78:16:28,  8.34s/it]
 11%|█         | 4162/37963 [10:21:28<76:27:58,  8.14s/it]
 11%|█         | 4163/37963 [10:21:36<74:31:41,  7.94s/it]
 11%|█         | 4164/37963 [10:21:43<73:35:42,  7.84s/it]
 11%|█         | 4165/37963 [10:21:51<73:06:37,  7.79s/it]
 11%|█         | 4166/37963 [10:21:59<72:25:51,  7.72s/it]
 11%|█         | 4167/37963 [10:22:13<91:38:19,  9.76s/it]
 11%|█         | 4168/37963 [10:22:21<85:45:02,  9.13s/it]
 11%|█         | 4169/37963 [10:22:29<81:48:14,  8.71s/it]
 11%|█         | 4170/37963 [10:22:36<78:47:27,  8.39s/it]
                                                          
{'loss': '0.1709', 'grad_norm': '1.503', 'learning_rate': '1.967e-05', 'epoch': '0.1098'}
+
 11%|█         | 4170/37963 [10:22:36<78:47:27,  8.39s/it]
 11%|█         | 4171/37963 [10:22:44<76:28:37,  8.15s/it]
 11%|█         | 4172/37963 [10:22:59<95:30:56, 10.18s/it]
 11%|█         | 4173/37963 [10:23:06<88:40:07,  9.45s/it]
 11%|█         | 4174/37963 [10:23:14<83:32:34,  8.90s/it]
 11%|█         | 4175/37963 [10:23:22<80:10:34,  8.54s/it]
 11%|█         | 4176/37963 [10:23:30<77:46:58,  8.29s/it]
 11%|█         | 4177/37963 [10:23:37<75:44:51,  8.07s/it]
 11%|█         | 4178/37963 [10:23:45<74:22:38,  7.93s/it]
 11%|█         | 4179/37963 [10:23:52<73:33:40,  7.84s/it]
 11%|█         | 4180/37963 [10:24:00<73:28:38,  7.83s/it]
                                                          
{'loss': '0.1654', 'grad_norm': '3.016', 'learning_rate': '1.967e-05', 'epoch': '0.1101'}
+
 11%|█         | 4180/37963 [10:24:00<73:28:38,  7.83s/it]
 11%|█         | 4181/37963 [10:24:08<73:02:03,  7.78s/it]
 11%|█         | 4182/37963 [10:24:22<91:04:24,  9.71s/it]
 11%|█         | 4183/37963 [10:24:30<85:36:58,  9.12s/it]
 11%|█         | 4184/37963 [10:24:44<100:41:15, 10.73s/it]
 11%|█         | 4185/37963 [10:24:52<93:12:34,  9.93s/it] 
 11%|█         | 4186/37963 [10:25:00<86:52:34,  9.26s/it]
 11%|█         | 4187/37963 [10:25:14<100:09:50, 10.68s/it]
 11%|█         | 4188/37963 [10:25:22<92:04:49,  9.81s/it] 
 11%|█         | 4189/37963 [10:25:29<85:56:46,  9.16s/it]
 11%|█         | 4190/37963 [10:25:37<81:46:17,  8.72s/it]
                                                          
{'loss': '0.1684', 'grad_norm': '2.304', 'learning_rate': '1.966e-05', 'epoch': '0.1104'}
+
 11%|█         | 4190/37963 [10:25:37<81:46:17,  8.72s/it]
 11%|█         | 4191/37963 [10:25:45<78:36:05,  8.38s/it]
 11%|█         | 4192/37963 [10:25:52<76:50:17,  8.19s/it]
 11%|█         | 4193/37963 [10:26:00<75:21:20,  8.03s/it]
 11%|█         | 4194/37963 [10:26:08<74:12:12,  7.91s/it]
 11%|█         | 4195/37963 [10:26:15<73:26:23,  7.83s/it]
 11%|█         | 4196/37963 [10:26:23<72:38:11,  7.74s/it]
 11%|█         | 4197/37963 [10:26:37<90:30:51,  9.65s/it]
 11%|█         | 4198/37963 [10:26:45<85:17:38,  9.09s/it]
 11%|█         | 4199/37963 [10:26:53<81:34:07,  8.70s/it]
 11%|█         | 4200/37963 [10:27:00<78:50:06,  8.41s/it]
                                                          
{'loss': '0.1746', 'grad_norm': '1.229', 'learning_rate': '1.966e-05', 'epoch': '0.1106'}
+
 11%|█         | 4200/37963 [10:27:00<78:50:06,  8.41s/it]
 11%|█         | 4201/37963 [10:27:08<77:10:47,  8.23s/it]
 11%|█         | 4202/37963 [10:27:16<75:34:22,  8.06s/it]
 11%|█         | 4203/37963 [10:27:31<94:29:07, 10.08s/it]
 11%|█         | 4204/37963 [10:27:44<105:05:09, 11.21s/it]
 11%|█         | 4205/37963 [10:27:52<95:16:25, 10.16s/it] 
 11%|█         | 4206/37963 [10:28:00<88:21:36,  9.42s/it]
 11%|█         | 4207/37963 [10:28:08<83:39:14,  8.92s/it]
 11%|█         | 4208/37963 [10:28:15<80:29:13,  8.58s/it]
 11%|█         | 4209/37963 [10:28:23<77:52:22,  8.31s/it]
 11%|█         | 4210/37963 [10:28:31<76:01:49,  8.11s/it]
                                                          
{'loss': '0.1626', 'grad_norm': '2.517', 'learning_rate': '1.966e-05', 'epoch': '0.1109'}
+
 11%|█         | 4210/37963 [10:28:31<76:01:49,  8.11s/it]
 11%|█         | 4211/37963 [10:28:45<93:15:15,  9.95s/it]
 11%|█         | 4212/37963 [10:28:53<87:29:10,  9.33s/it]
 11%|█         | 4213/37963 [10:29:00<82:49:36,  8.83s/it]
 11%|█         | 4214/37963 [10:29:08<79:32:59,  8.49s/it]
 11%|█         | 4215/37963 [10:29:15<76:17:24,  8.14s/it]
 11%|█         | 4216/37963 [10:29:23<75:03:04,  8.01s/it]
 11%|█         | 4217/37963 [10:29:31<73:55:37,  7.89s/it]
 11%|█         | 4218/37963 [10:29:38<72:44:07,  7.76s/it]
 11%|█         | 4219/37963 [10:29:46<71:57:54,  7.68s/it]
 11%|█         | 4220/37963 [10:29:54<72:27:43,  7.73s/it]
                                                          
{'loss': '0.1529', 'grad_norm': '1.663', 'learning_rate': '1.966e-05', 'epoch': '0.1112'}
+
 11%|█         | 4220/37963 [10:29:54<72:27:43,  7.73s/it]
 11%|█         | 4221/37963 [10:30:02<73:59:49,  7.89s/it]
 11%|█         | 4222/37963 [10:30:17<94:29:51, 10.08s/it]
 11%|█         | 4223/37963 [10:30:25<87:14:33,  9.31s/it]
 11%|█         | 4224/37963 [10:30:32<83:06:03,  8.87s/it]
 11%|█         | 4225/37963 [10:30:40<79:34:18,  8.49s/it]
 11%|█         | 4226/37963 [10:30:48<77:39:17,  8.29s/it]
 11%|█         | 4227/37963 [10:30:55<75:44:46,  8.08s/it]
 11%|█         | 4228/37963 [10:31:03<74:57:50,  8.00s/it]
 11%|█         | 4229/37963 [10:31:11<74:49:47,  7.99s/it]
 11%|█         | 4230/37963 [10:31:19<74:14:58,  7.92s/it]
                                                          
{'loss': '0.1728', 'grad_norm': '4.455', 'learning_rate': '1.965e-05', 'epoch': '0.1114'}
+
 11%|█         | 4230/37963 [10:31:19<74:14:58,  7.92s/it]
 11%|█         | 4231/37963 [10:31:41<112:48:52, 12.04s/it]
 11%|█         | 4232/37963 [10:31:48<100:34:12, 10.73s/it]
 11%|█         | 4233/37963 [10:31:56<91:50:27,  9.80s/it] 
 11%|█         | 4234/37963 [10:32:03<85:25:15,  9.12s/it]
 11%|█         | 4235/37963 [10:32:11<81:47:51,  8.73s/it]
 11%|█         | 4236/37963 [10:32:26<97:57:12, 10.46s/it]
 11%|█         | 4237/37963 [10:32:33<90:14:46,  9.63s/it]
 11%|█         | 4238/37963 [10:32:41<84:32:39,  9.02s/it]
 11%|█         | 4239/37963 [10:32:49<81:02:39,  8.65s/it]
 11%|█         | 4240/37963 [10:32:56<77:21:59,  8.26s/it]
                                                          
{'loss': '0.1785', 'grad_norm': '3.897', 'learning_rate': '1.965e-05', 'epoch': '0.1117'}
+
 11%|█         | 4240/37963 [10:32:56<77:21:59,  8.26s/it]
 11%|█         | 4241/37963 [10:33:04<75:42:16,  8.08s/it]
 11%|█         | 4242/37963 [10:33:12<74:29:46,  7.95s/it]
 11%|█         | 4243/37963 [10:33:19<73:14:05,  7.82s/it]
 11%|█         | 4244/37963 [10:33:27<72:53:44,  7.78s/it]
 11%|█         | 4245/37963 [10:33:34<72:31:31,  7.74s/it]
 11%|█         | 4246/37963 [10:33:42<72:21:01,  7.72s/it]
 11%|█         | 4247/37963 [10:33:50<72:22:01,  7.73s/it]
 11%|█         | 4248/37963 [10:33:58<72:28:49,  7.74s/it]
 11%|█         | 4249/37963 [10:34:19<110:08:05, 11.76s/it]
 11%|█         | 4250/37963 [10:34:26<99:01:29, 10.57s/it] 
                                                          
{'loss': '0.1623', 'grad_norm': '3.108', 'learning_rate': '1.965e-05', 'epoch': '0.112'}
+
 11%|█         | 4250/37963 [10:34:27<99:01:29, 10.57s/it]
 11%|█         | 4251/37963 [10:34:42<111:28:50, 11.90s/it]
 11%|█         | 4252/37963 [10:34:49<99:35:16, 10.64s/it] 
 11%|█         | 4253/37963 [10:34:57<91:13:59,  9.74s/it]
 11%|█         | 4254/37963 [10:35:04<85:16:27,  9.11s/it]
 11%|█         | 4255/37963 [10:35:12<81:22:56,  8.69s/it]
 11%|█         | 4256/37963 [10:35:20<78:28:56,  8.38s/it]
 11%|█         | 4257/37963 [10:35:27<76:20:55,  8.15s/it]
 11%|█         | 4258/37963 [10:35:35<75:06:04,  8.02s/it]
 11%|█         | 4259/37963 [10:35:43<74:11:44,  7.93s/it]
 11%|█         | 4260/37963 [10:35:58<93:11:38,  9.95s/it]
                                                          
{'loss': '0.1683', 'grad_norm': '2.358', 'learning_rate': '1.965e-05', 'epoch': '0.1122'}
+
 11%|█         | 4260/37963 [10:35:58<93:11:38,  9.95s/it]
 11%|█         | 4261/37963 [10:36:05<86:17:13,  9.22s/it]
 11%|█         | 4262/37963 [10:36:13<81:58:32,  8.76s/it]
 11%|█         | 4263/37963 [10:36:21<79:20:40,  8.48s/it]
 11%|█         | 4264/37963 [10:36:28<76:27:28,  8.17s/it]
 11%|█         | 4265/37963 [10:36:36<75:06:33,  8.02s/it]
 11%|█         | 4266/37963 [10:36:43<73:56:10,  7.90s/it]
 11%|█         | 4267/37963 [10:36:51<73:19:55,  7.83s/it]
 11%|█         | 4268/37963 [10:36:59<72:39:40,  7.76s/it]
 11%|█         | 4269/37963 [10:37:13<90:41:42,  9.69s/it]
 11%|█         | 4270/37963 [10:37:21<85:20:06,  9.12s/it]
                                                          
{'loss': '0.1777', 'grad_norm': '2.402', 'learning_rate': '1.965e-05', 'epoch': '0.1125'}
+
 11%|█         | 4270/37963 [10:37:21<85:20:06,  9.12s/it]
 11%|█▏        | 4271/37963 [10:37:28<80:21:59,  8.59s/it]
 11%|█▏        | 4272/37963 [10:37:36<77:34:39,  8.29s/it]
 11%|█▏        | 4273/37963 [10:37:43<75:10:43,  8.03s/it]
 11%|█▏        | 4274/37963 [10:37:51<74:20:56,  7.94s/it]
 11%|█▏        | 4275/37963 [10:37:58<73:29:54,  7.85s/it]
 11%|█▏        | 4276/37963 [10:38:06<72:41:04,  7.77s/it]
 11%|█▏        | 4277/37963 [10:38:14<72:48:39,  7.78s/it]
 11%|█▏        | 4278/37963 [10:38:21<71:51:23,  7.68s/it]
 11%|█▏        | 4279/37963 [10:38:36<91:45:32,  9.81s/it]
 11%|█▏        | 4280/37963 [10:38:43<85:26:19,  9.13s/it]
                                                          
{'loss': '0.1764', 'grad_norm': '5.036', 'learning_rate': '1.964e-05', 'epoch': '0.1127'}
+
 11%|█▏        | 4280/37963 [10:38:43<85:26:19,  9.13s/it]
 11%|█▏        | 4281/37963 [10:38:51<81:08:04,  8.67s/it]
 11%|█▏        | 4282/37963 [10:39:05<96:40:52, 10.33s/it]
 11%|█▏        | 4283/37963 [10:39:19<107:22:04, 11.48s/it]
 11%|█▏        | 4284/37963 [10:39:27<96:43:37, 10.34s/it] 
 11%|█▏        | 4285/37963 [10:39:35<89:13:34,  9.54s/it]
 11%|█▏        | 4286/37963 [10:39:42<83:52:35,  8.97s/it]
 11%|█▏        | 4287/37963 [10:39:50<80:35:36,  8.62s/it]
 11%|█▏        | 4288/37963 [10:39:58<77:56:27,  8.33s/it]
 11%|█▏        | 4289/37963 [10:40:06<76:11:06,  8.14s/it]
 11%|█▏        | 4290/37963 [10:40:13<75:08:55,  8.03s/it]
                                                          
{'loss': '0.1768', 'grad_norm': '3.491', 'learning_rate': '1.964e-05', 'epoch': '0.113'}
+
 11%|█▏        | 4290/37963 [10:40:13<75:08:55,  8.03s/it]
 11%|█▏        | 4291/37963 [10:40:21<73:43:30,  7.88s/it]
 11%|█▏        | 4292/37963 [10:40:29<73:09:58,  7.82s/it]
 11%|█▏        | 4293/37963 [10:40:36<72:33:48,  7.76s/it]
 11%|█▏        | 4294/37963 [10:40:44<72:26:04,  7.74s/it]
 11%|█▏        | 4295/37963 [10:40:58<91:07:19,  9.74s/it]
 11%|█▏        | 4296/37963 [10:41:06<85:30:16,  9.14s/it]
 11%|█▏        | 4297/37963 [10:41:14<81:27:18,  8.71s/it]
 11%|█▏        | 4298/37963 [10:41:29<98:56:46, 10.58s/it]
 11%|█▏        | 4299/37963 [10:41:36<90:45:34,  9.71s/it]
 11%|█▏        | 4300/37963 [10:41:44<85:17:18,  9.12s/it]
                                                          
{'loss': '0.1559', 'grad_norm': '1.738', 'learning_rate': '1.964e-05', 'epoch': '0.1133'}
+
 11%|█▏        | 4300/37963 [10:41:44<85:17:18,  9.12s/it]
 11%|█▏        | 4301/37963 [10:41:59<100:17:18, 10.73s/it]
 11%|█▏        | 4302/37963 [10:42:06<90:55:07,  9.72s/it] 
 11%|█▏        | 4303/37963 [10:42:14<84:57:27,  9.09s/it]
 11%|█▏        | 4304/37963 [10:42:21<80:57:07,  8.66s/it]
 11%|█▏        | 4305/37963 [10:42:29<78:33:00,  8.40s/it]
 11%|█▏        | 4306/37963 [10:42:36<75:48:51,  8.11s/it]
 11%|█▏        | 4307/37963 [10:42:44<74:45:07,  8.00s/it]
 11%|█▏        | 4308/37963 [10:42:59<94:45:10, 10.14s/it]
 11%|█▏        | 4309/37963 [10:43:07<87:30:09,  9.36s/it]
 11%|█▏        | 4310/37963 [10:43:15<82:46:33,  8.85s/it]
                                                          
{'loss': '0.1751', 'grad_norm': '3.984', 'learning_rate': '1.964e-05', 'epoch': '0.1135'}
+
 11%|█▏        | 4310/37963 [10:43:15<82:46:33,  8.85s/it]
 11%|█▏        | 4311/37963 [10:43:22<79:29:54,  8.50s/it]
 11%|█▏        | 4312/37963 [10:43:30<77:18:52,  8.27s/it]
 11%|█▏        | 4313/37963 [10:43:38<75:34:11,  8.08s/it]
 11%|█▏        | 4314/37963 [10:43:45<73:57:12,  7.91s/it]
 11%|█▏        | 4315/37963 [10:43:53<73:18:22,  7.84s/it]
 11%|█▏        | 4316/37963 [10:44:00<72:37:31,  7.77s/it]
 11%|█▏        | 4317/37963 [10:44:15<92:38:18,  9.91s/it]
 11%|█▏        | 4318/37963 [10:44:23<86:33:39,  9.26s/it]
 11%|█▏        | 4319/37963 [10:44:31<82:01:13,  8.78s/it]
 11%|█▏        | 4320/37963 [10:44:38<78:26:38,  8.39s/it]
                                                          
{'loss': '0.1724', 'grad_norm': '3.611', 'learning_rate': '1.963e-05', 'epoch': '0.1138'}
+
 11%|█▏        | 4320/37963 [10:44:38<78:26:38,  8.39s/it]
 11%|█▏        | 4321/37963 [10:44:46<76:35:49,  8.20s/it]
 11%|█▏        | 4322/37963 [10:44:54<75:11:35,  8.05s/it]
 11%|█▏        | 4323/37963 [10:45:01<74:07:25,  7.93s/it]
 11%|█▏        | 4324/37963 [10:45:09<73:30:46,  7.87s/it]
 11%|█▏        | 4325/37963 [10:45:17<73:26:38,  7.86s/it]
 11%|█▏        | 4326/37963 [10:45:24<72:44:06,  7.78s/it]
 11%|█▏        | 4327/37963 [10:45:32<71:38:17,  7.67s/it]
 11%|█▏        | 4328/37963 [10:45:40<71:40:23,  7.67s/it]
 11%|█▏        | 4329/37963 [10:45:47<71:43:48,  7.68s/it]
 11%|█▏        | 4330/37963 [10:45:55<71:39:37,  7.67s/it]
                                                          
{'loss': '0.1791', 'grad_norm': '2.698', 'learning_rate': '1.963e-05', 'epoch': '0.1141'}
+
 11%|█▏        | 4330/37963 [10:45:55<71:39:37,  7.67s/it]
 11%|█▏        | 4331/37963 [10:46:03<71:38:12,  7.67s/it]
 11%|█▏        | 4332/37963 [10:46:17<91:39:08,  9.81s/it]
 11%|█▏        | 4333/37963 [10:46:32<104:15:18, 11.16s/it]
 11%|█▏        | 4334/37963 [10:46:40<95:03:38, 10.18s/it] 
 11%|█▏        | 4335/37963 [10:46:54<106:04:12, 11.36s/it]
 11%|█▏        | 4336/37963 [10:47:01<95:54:11, 10.27s/it] 
 11%|█▏        | 4337/37963 [10:47:09<88:34:26,  9.48s/it]
 11%|█▏        | 4338/37963 [10:47:17<83:42:52,  8.96s/it]
 11%|█▏        | 4339/37963 [10:47:24<79:58:24,  8.56s/it]
 11%|█▏        | 4340/37963 [10:47:32<77:19:50,  8.28s/it]
                                                          
{'loss': '0.1804', 'grad_norm': '2.945', 'learning_rate': '1.963e-05', 'epoch': '0.1143'}
+
 11%|█▏        | 4340/37963 [10:47:32<77:19:50,  8.28s/it]
 11%|█▏        | 4341/37963 [10:47:40<75:55:10,  8.13s/it]
 11%|█▏        | 4342/37963 [10:47:54<93:19:36,  9.99s/it]
 11%|█▏        | 4343/37963 [10:48:02<86:47:51,  9.29s/it]
 11%|█▏        | 4344/37963 [10:48:09<81:25:18,  8.72s/it]
 11%|█▏        | 4345/37963 [10:48:17<78:35:22,  8.42s/it]
 11%|█▏        | 4346/37963 [10:48:25<76:21:59,  8.18s/it]
 11%|█▏        | 4347/37963 [10:48:39<94:52:17, 10.16s/it]
 11%|█▏        | 4348/37963 [10:48:47<88:07:17,  9.44s/it]
 11%|█▏        | 4349/37963 [10:48:55<82:53:22,  8.88s/it]
 11%|█▏        | 4350/37963 [10:49:02<79:52:26,  8.55s/it]
                                                          
{'loss': '0.1795', 'grad_norm': '2.863', 'learning_rate': '1.963e-05', 'epoch': '0.1146'}
+
 11%|█▏        | 4350/37963 [10:49:02<79:52:26,  8.55s/it]
 11%|█▏        | 4351/37963 [10:49:10<77:34:44,  8.31s/it]
 11%|█▏        | 4352/37963 [10:49:18<75:03:12,  8.04s/it]
 11%|█▏        | 4353/37963 [10:49:25<73:52:47,  7.91s/it]
 11%|█▏        | 4354/37963 [10:49:33<73:03:53,  7.83s/it]
 11%|█▏        | 4355/37963 [10:49:54<111:40:08, 11.96s/it]
 11%|█▏        | 4356/37963 [10:50:02<99:18:56, 10.64s/it] 
 11%|█▏        | 4357/37963 [10:50:09<90:15:45,  9.67s/it]
 11%|█▏        | 4358/37963 [10:50:17<84:46:48,  9.08s/it]
 11%|█▏        | 4359/37963 [10:50:25<80:39:35,  8.64s/it]
 11%|█▏        | 4360/37963 [10:50:32<77:49:18,  8.34s/it]
                                                          
{'loss': '0.175', 'grad_norm': '3.292', 'learning_rate': '1.963e-05', 'epoch': '0.1148'}
+
 11%|█▏        | 4360/37963 [10:50:32<77:49:18,  8.34s/it]
 11%|█▏        | 4361/37963 [10:50:40<76:02:00,  8.15s/it]
 11%|█▏        | 4362/37963 [10:50:48<74:28:04,  7.98s/it]
 11%|█▏        | 4363/37963 [10:50:55<73:43:42,  7.90s/it]
 11%|█▏        | 4364/37963 [10:51:03<73:08:53,  7.84s/it]
 11%|█▏        | 4365/37963 [10:51:11<72:45:37,  7.80s/it]
 12%|█▏        | 4366/37963 [10:51:26<93:03:19,  9.97s/it]
 12%|█▏        | 4367/37963 [10:51:34<86:56:54,  9.32s/it]
 12%|█▏        | 4368/37963 [10:51:41<82:19:39,  8.82s/it]
 12%|█▏        | 4369/37963 [10:51:49<79:32:14,  8.52s/it]
 12%|█▏        | 4370/37963 [10:51:56<76:24:07,  8.19s/it]
                                                          
{'loss': '0.1796', 'grad_norm': '6.69', 'learning_rate': '1.962e-05', 'epoch': '0.1151'}
+
 12%|█▏        | 4370/37963 [10:51:56<76:24:07,  8.19s/it]
 12%|█▏        | 4371/37963 [10:52:04<74:53:13,  8.03s/it]
 12%|█▏        | 4372/37963 [10:52:12<74:08:37,  7.95s/it]
 12%|█▏        | 4373/37963 [10:52:20<73:19:53,  7.86s/it]
 12%|█▏        | 4374/37963 [10:52:27<72:56:34,  7.82s/it]
 12%|█▏        | 4375/37963 [10:52:35<72:13:04,  7.74s/it]
 12%|█▏        | 4376/37963 [10:52:43<72:13:29,  7.74s/it]
 12%|█▏        | 4377/37963 [10:52:50<71:55:32,  7.71s/it]
 12%|█▏        | 4378/37963 [10:52:58<72:03:33,  7.72s/it]
 12%|█▏        | 4379/37963 [10:53:06<71:48:24,  7.70s/it]
 12%|█▏        | 4380/37963 [10:53:13<71:38:52,  7.68s/it]
                                                          
{'loss': '0.1861', 'grad_norm': '3.647', 'learning_rate': '1.962e-05', 'epoch': '0.1154'}
+
 12%|█▏        | 4380/37963 [10:53:13<71:38:52,  7.68s/it]
 12%|█▏        | 4381/37963 [10:53:28<90:05:27,  9.66s/it]
 12%|█▏        | 4382/37963 [10:53:35<84:44:26,  9.08s/it]
 12%|█▏        | 4383/37963 [10:53:43<80:46:56,  8.66s/it]
 12%|█▏        | 4384/37963 [10:53:50<77:23:43,  8.30s/it]
 12%|█▏        | 4385/37963 [10:53:58<75:33:50,  8.10s/it]
 12%|█▏        | 4386/37963 [10:54:13<94:39:48, 10.15s/it]
 12%|█▏        | 4387/37963 [10:54:21<88:10:57,  9.45s/it]
 12%|█▏        | 4388/37963 [10:54:28<82:47:34,  8.88s/it]
 12%|█▏        | 4389/37963 [10:54:49<116:28:58, 12.49s/it]
 12%|█▏        | 4390/37963 [10:54:57<103:19:57, 11.08s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '1.44', 'learning_rate': '1.962e-05', 'epoch': '0.1156'}
+
 12%|█▏        | 4390/37963 [10:54:57<103:19:57, 11.08s/it]
 12%|█▏        | 4391/37963 [10:55:04<92:56:39,  9.97s/it] 
 12%|█▏        | 4392/37963 [10:55:12<86:21:03,  9.26s/it]
 12%|█▏        | 4393/37963 [10:55:20<81:32:06,  8.74s/it]
 12%|█▏        | 4394/37963 [10:55:27<78:28:14,  8.42s/it]
 12%|█▏        | 4395/37963 [10:55:35<76:35:26,  8.21s/it]
 12%|█▏        | 4396/37963 [10:55:42<74:31:53,  7.99s/it]
 12%|█▏        | 4397/37963 [10:55:50<73:53:07,  7.92s/it]
 12%|█▏        | 4398/37963 [10:55:58<73:19:39,  7.86s/it]
 12%|█▏        | 4399/37963 [10:56:06<72:45:49,  7.80s/it]
 12%|█▏        | 4400/37963 [10:56:13<72:50:45,  7.81s/it]
                                                          
{'loss': '0.1757', 'grad_norm': '2.081', 'learning_rate': '1.962e-05', 'epoch': '0.1159'}
+
 12%|█▏        | 4400/37963 [10:56:13<72:50:45,  7.81s/it]
 12%|█▏        | 4401/37963 [10:56:29<93:20:20, 10.01s/it]
 12%|█▏        | 4402/37963 [10:56:43<105:13:37, 11.29s/it]
 12%|█▏        | 4403/37963 [10:56:51<96:21:03, 10.34s/it] 
 12%|█▏        | 4404/37963 [10:56:59<88:49:46,  9.53s/it]
 12%|█▏        | 4405/37963 [10:57:06<83:51:03,  9.00s/it]
 12%|█▏        | 4406/37963 [10:57:21<99:57:45, 10.72s/it]
 12%|█▏        | 4407/37963 [10:57:29<91:19:25,  9.80s/it]
 12%|█▏        | 4408/37963 [10:57:36<85:00:37,  9.12s/it]
 12%|█▏        | 4409/37963 [10:57:44<81:06:16,  8.70s/it]
 12%|█▏        | 4410/37963 [10:57:52<78:38:36,  8.44s/it]
                                                          
{'loss': '0.1651', 'grad_norm': '4.537', 'learning_rate': '1.961e-05', 'epoch': '0.1162'}
+
 12%|█▏        | 4410/37963 [10:57:52<78:38:36,  8.44s/it]
 12%|█▏        | 4411/37963 [10:58:06<95:19:13, 10.23s/it]
 12%|█▏        | 4412/37963 [10:58:14<88:28:14,  9.49s/it]
 12%|█▏        | 4413/37963 [10:58:22<83:47:14,  8.99s/it]
 12%|█▏        | 4414/37963 [10:58:30<80:15:01,  8.61s/it]
 12%|█▏        | 4415/37963 [10:58:37<77:24:45,  8.31s/it]
 12%|█▏        | 4416/37963 [10:58:45<75:52:06,  8.14s/it]
 12%|█▏        | 4417/37963 [10:58:53<75:22:03,  8.09s/it]
 12%|█▏        | 4418/37963 [10:59:00<73:31:03,  7.89s/it]
 12%|█▏        | 4419/37963 [10:59:08<72:57:05,  7.83s/it]
 12%|█▏        | 4420/37963 [10:59:16<72:27:20,  7.78s/it]
                                                          
{'loss': '0.1733', 'grad_norm': '2.092', 'learning_rate': '1.961e-05', 'epoch': '0.1164'}
+
 12%|█▏        | 4420/37963 [10:59:16<72:27:20,  7.78s/it]
 12%|█▏        | 4421/37963 [10:59:23<72:32:10,  7.79s/it]
 12%|█▏        | 4422/37963 [10:59:31<72:05:57,  7.74s/it]
 12%|█▏        | 4423/37963 [10:59:39<72:03:21,  7.73s/it]
 12%|█▏        | 4424/37963 [10:59:46<71:14:20,  7.65s/it]
 12%|█▏        | 4425/37963 [10:59:54<71:20:23,  7.66s/it]
 12%|█▏        | 4426/37963 [11:00:02<71:27:47,  7.67s/it]
 12%|█▏        | 4427/37963 [11:00:09<71:00:28,  7.62s/it]
 12%|█▏        | 4428/37963 [11:00:17<71:11:21,  7.64s/it]
 12%|█▏        | 4429/37963 [11:00:24<71:10:39,  7.64s/it]
 12%|█▏        | 4430/37963 [11:00:32<70:52:39,  7.61s/it]
                                                          
{'loss': '0.1587', 'grad_norm': '3.921', 'learning_rate': '1.961e-05', 'epoch': '0.1167'}
+
 12%|█▏        | 4430/37963 [11:00:32<70:52:39,  7.61s/it]
 12%|█▏        | 4431/37963 [11:00:40<71:02:40,  7.63s/it]
 12%|█▏        | 4432/37963 [11:00:47<71:20:53,  7.66s/it]
 12%|█▏        | 4433/37963 [11:00:55<70:14:38,  7.54s/it]
 12%|█▏        | 4434/37963 [11:01:09<90:27:41,  9.71s/it]
 12%|█▏        | 4435/37963 [11:01:30<120:33:59, 12.95s/it]
 12%|█▏        | 4436/37963 [11:01:38<105:49:26, 11.36s/it]
 12%|█▏        | 4437/37963 [11:01:45<96:01:44, 10.31s/it] 
 12%|█▏        | 4438/37963 [11:02:00<107:16:34, 11.52s/it]
 12%|█▏        | 4439/37963 [11:02:07<96:38:30, 10.38s/it] 
 12%|█▏        | 4440/37963 [11:02:15<89:15:39,  9.59s/it]
                                                          
{'loss': '0.1615', 'grad_norm': '4.674', 'learning_rate': '1.961e-05', 'epoch': '0.117'}
+
 12%|█▏        | 4440/37963 [11:02:15<89:15:39,  9.59s/it]
 12%|█▏        | 4441/37963 [11:02:23<84:15:59,  9.05s/it]
 12%|█▏        | 4442/37963 [11:02:31<80:19:11,  8.63s/it]
 12%|█▏        | 4443/37963 [11:02:38<77:33:58,  8.33s/it]
 12%|█▏        | 4444/37963 [11:02:46<74:58:07,  8.05s/it]
 12%|█▏        | 4445/37963 [11:02:53<74:04:48,  7.96s/it]
 12%|█▏        | 4446/37963 [11:03:01<73:13:49,  7.87s/it]
 12%|█▏        | 4447/37963 [11:03:09<72:31:58,  7.79s/it]
 12%|█▏        | 4448/37963 [11:03:24<93:05:47, 10.00s/it]
 12%|█▏        | 4449/37963 [11:03:31<86:27:30,  9.29s/it]
 12%|█▏        | 4450/37963 [11:03:39<81:53:29,  8.80s/it]
                                                          
{'loss': '0.1773', 'grad_norm': '2.219', 'learning_rate': '1.96e-05', 'epoch': '0.1172'}
+
 12%|█▏        | 4450/37963 [11:03:39<81:53:29,  8.80s/it]
 12%|█▏        | 4451/37963 [11:03:47<78:32:27,  8.44s/it]
 12%|█▏        | 4452/37963 [11:03:54<75:47:00,  8.14s/it]
 12%|█▏        | 4453/37963 [11:04:02<74:17:36,  7.98s/it]
 12%|█▏        | 4454/37963 [11:04:09<73:26:01,  7.89s/it]
 12%|█▏        | 4455/37963 [11:04:24<92:57:10,  9.99s/it]
 12%|█▏        | 4456/37963 [11:04:38<104:19:00, 11.21s/it]
 12%|█▏        | 4457/37963 [11:04:46<94:21:43, 10.14s/it] 
 12%|█▏        | 4458/37963 [11:05:01<108:03:55, 11.61s/it]
 12%|█▏        | 4459/37963 [11:05:09<96:49:56, 10.40s/it] 
 12%|█▏        | 4460/37963 [11:05:17<89:40:21,  9.64s/it]
                                                          
{'loss': '0.1786', 'grad_norm': '1.732', 'learning_rate': '1.96e-05', 'epoch': '0.1175'}
+
 12%|█▏        | 4460/37963 [11:05:17<89:40:21,  9.64s/it]
 12%|█▏        | 4461/37963 [11:05:24<84:13:31,  9.05s/it]
 12%|█▏        | 4462/37963 [11:05:32<80:21:34,  8.64s/it]
 12%|█▏        | 4463/37963 [11:05:39<76:46:41,  8.25s/it]
 12%|█▏        | 4464/37963 [11:05:47<74:58:19,  8.06s/it]
 12%|█▏        | 4465/37963 [11:05:55<74:07:57,  7.97s/it]
 12%|█▏        | 4466/37963 [11:06:02<73:37:26,  7.91s/it]
 12%|█▏        | 4467/37963 [11:06:10<72:44:12,  7.82s/it]
 12%|█▏        | 4468/37963 [11:06:18<72:41:51,  7.81s/it]
 12%|█▏        | 4469/37963 [11:06:25<71:24:57,  7.68s/it]
 12%|█▏        | 4470/37963 [11:06:33<71:35:26,  7.69s/it]
                                                          
{'loss': '0.1744', 'grad_norm': '4.262', 'learning_rate': '1.96e-05', 'epoch': '0.1177'}
+
 12%|█▏        | 4470/37963 [11:06:33<71:35:26,  7.69s/it]
 12%|█▏        | 4471/37963 [11:06:40<71:11:49,  7.65s/it]
 12%|█▏        | 4472/37963 [11:06:48<70:58:37,  7.63s/it]
 12%|█▏        | 4473/37963 [11:06:56<71:16:15,  7.66s/it]
 12%|█▏        | 4474/37963 [11:07:03<71:12:54,  7.66s/it]
 12%|█▏        | 4475/37963 [11:07:11<71:11:58,  7.65s/it]
 12%|█▏        | 4476/37963 [11:07:19<71:31:00,  7.69s/it]
 12%|█▏        | 4477/37963 [11:07:26<71:15:18,  7.66s/it]
 12%|█▏        | 4478/37963 [11:07:34<71:20:38,  7.67s/it]
 12%|█▏        | 4479/37963 [11:07:42<71:24:57,  7.68s/it]
 12%|█▏        | 4480/37963 [11:07:49<70:54:37,  7.62s/it]
                                                          
{'loss': '0.1678', 'grad_norm': '1.924', 'learning_rate': '1.96e-05', 'epoch': '0.118'}
+
 12%|█▏        | 4480/37963 [11:07:49<70:54:37,  7.62s/it]
 12%|█▏        | 4481/37963 [11:07:57<71:13:40,  7.66s/it]
 12%|█▏        | 4482/37963 [11:08:05<71:18:03,  7.67s/it]
 12%|█▏        | 4483/37963 [11:08:19<89:28:10,  9.62s/it]
 12%|█▏        | 4484/37963 [11:08:40<122:50:45, 13.21s/it]
 12%|█▏        | 4485/37963 [11:08:48<107:31:08, 11.56s/it]
 12%|█▏        | 4486/37963 [11:08:56<96:04:48, 10.33s/it] 
 12%|█▏        | 4487/37963 [11:09:03<89:02:16,  9.58s/it]
 12%|█▏        | 4488/37963 [11:09:11<83:09:49,  8.94s/it]
 12%|█▏        | 4489/37963 [11:09:25<98:33:48, 10.60s/it]
 12%|█▏        | 4490/37963 [11:09:33<89:30:44,  9.63s/it]
                                                          
{'loss': '0.1746', 'grad_norm': '2.567', 'learning_rate': '1.959e-05', 'epoch': '0.1183'}
+
 12%|█▏        | 4490/37963 [11:09:33<89:30:44,  9.63s/it]
 12%|█▏        | 4491/37963 [11:09:40<84:09:19,  9.05s/it]
 12%|█▏        | 4492/37963 [11:09:48<79:55:01,  8.60s/it]
 12%|█▏        | 4493/37963 [11:09:56<77:00:11,  8.28s/it]
 12%|█▏        | 4494/37963 [11:10:03<75:32:10,  8.12s/it]
 12%|█▏        | 4495/37963 [11:10:11<74:00:00,  7.96s/it]
 12%|█▏        | 4496/37963 [11:10:19<73:32:47,  7.91s/it]
 12%|█▏        | 4497/37963 [11:10:27<73:22:26,  7.89s/it]
 12%|█▏        | 4498/37963 [11:10:41<91:40:14,  9.86s/it]
 12%|█▏        | 4499/37963 [11:10:49<85:40:32,  9.22s/it]
 12%|█▏        | 4500/37963 [11:10:56<81:32:58,  8.77s/it]
                                                          
{'loss': '0.1634', 'grad_norm': '1.979', 'learning_rate': '1.959e-05', 'epoch': '0.1185'}
+
 12%|█▏        | 4500/37963 [11:10:56<81:32:58,  8.77s/it]
 12%|█▏        | 4501/37963 [11:11:04<78:21:09,  8.43s/it]
 12%|█▏        | 4502/37963 [11:11:12<76:18:23,  8.21s/it]
 12%|█▏        | 4503/37963 [11:11:26<94:07:47, 10.13s/it]
 12%|█▏        | 4504/37963 [11:11:34<87:10:32,  9.38s/it]
 12%|█▏        | 4505/37963 [11:11:41<81:27:46,  8.77s/it]
 12%|█▏        | 4506/37963 [11:11:49<78:10:46,  8.41s/it]
 12%|█▏        | 4507/37963 [11:12:11<115:16:33, 12.40s/it]
 12%|█▏        | 4508/37963 [11:12:18<101:52:26, 10.96s/it]
 12%|█▏        | 4509/37963 [11:12:26<92:49:38,  9.99s/it] 
 12%|█▏        | 4510/37963 [11:12:34<86:33:36,  9.32s/it]
                                                          
{'loss': '0.1612', 'grad_norm': '3.307', 'learning_rate': '1.959e-05', 'epoch': '0.1188'}
+
 12%|█▏        | 4510/37963 [11:12:34<86:33:36,  9.32s/it]
 12%|█▏        | 4511/37963 [11:12:41<82:14:59,  8.85s/it]
 12%|█▏        | 4512/37963 [11:12:49<78:51:37,  8.49s/it]
 12%|█▏        | 4513/37963 [11:12:57<76:11:53,  8.20s/it]
 12%|█▏        | 4514/37963 [11:13:04<74:46:02,  8.05s/it]
 12%|█▏        | 4515/37963 [11:13:12<73:58:17,  7.96s/it]
 12%|█▏        | 4516/37963 [11:13:20<73:47:26,  7.94s/it]
 12%|█▏        | 4517/37963 [11:13:28<73:16:05,  7.89s/it]
 12%|█▏        | 4518/37963 [11:13:35<72:19:36,  7.79s/it]
 12%|█▏        | 4519/37963 [11:13:43<72:02:17,  7.75s/it]
 12%|█▏        | 4520/37963 [11:13:51<72:22:50,  7.79s/it]
                                                          
{'loss': '0.1701', 'grad_norm': '3.428', 'learning_rate': '1.959e-05', 'epoch': '0.1191'}
+
 12%|█▏        | 4520/37963 [11:13:51<72:22:50,  7.79s/it]
 12%|█▏        | 4521/37963 [11:13:59<72:01:55,  7.75s/it]
 12%|█▏        | 4522/37963 [11:14:06<71:54:50,  7.74s/it]
 12%|█▏        | 4523/37963 [11:14:14<71:32:09,  7.70s/it]
 12%|█▏        | 4524/37963 [11:14:22<71:43:19,  7.72s/it]
 12%|█▏        | 4525/37963 [11:14:29<71:50:55,  7.74s/it]
 12%|█▏        | 4526/37963 [11:14:37<70:53:43,  7.63s/it]
 12%|█▏        | 4527/37963 [11:14:44<71:12:04,  7.67s/it]
 12%|█▏        | 4528/37963 [11:14:59<91:21:09,  9.84s/it]
 12%|█▏        | 4529/37963 [11:15:14<103:46:52, 11.17s/it]
 12%|█▏        | 4530/37963 [11:15:21<94:08:11, 10.14s/it] 
                                                          
{'loss': '0.1724', 'grad_norm': '2.676', 'learning_rate': '1.958e-05', 'epoch': '0.1193'}
+
 12%|█▏        | 4530/37963 [11:15:21<94:08:11, 10.14s/it]
 12%|█▏        | 4531/37963 [11:15:29<87:43:12,  9.45s/it]
 12%|█▏        | 4532/37963 [11:15:37<82:43:45,  8.91s/it]
 12%|█▏        | 4533/37963 [11:15:45<79:19:46,  8.54s/it]
 12%|█▏        | 4534/37963 [11:15:52<77:08:29,  8.31s/it]
 12%|█▏        | 4535/37963 [11:16:00<75:19:12,  8.11s/it]
 12%|█▏        | 4536/37963 [11:16:08<74:02:33,  7.97s/it]
 12%|█▏        | 4537/37963 [11:16:22<92:31:34,  9.97s/it]
 12%|█▏        | 4538/37963 [11:16:30<86:22:09,  9.30s/it]
 12%|█▏        | 4539/37963 [11:16:38<81:27:54,  8.77s/it]
 12%|█▏        | 4540/37963 [11:16:45<78:31:42,  8.46s/it]
                                                          
{'loss': '0.1755', 'grad_norm': '2.843', 'learning_rate': '1.958e-05', 'epoch': '0.1196'}
+
 12%|█▏        | 4540/37963 [11:16:45<78:31:42,  8.46s/it]
 12%|█▏        | 4541/37963 [11:16:53<76:20:23,  8.22s/it]
 12%|█▏        | 4542/37963 [11:17:01<74:38:08,  8.04s/it]
 12%|█▏        | 4543/37963 [11:17:08<72:38:37,  7.83s/it]
 12%|█▏        | 4544/37963 [11:17:16<72:13:41,  7.78s/it]
 12%|█▏        | 4545/37963 [11:17:23<71:37:30,  7.72s/it]
 12%|█▏        | 4546/37963 [11:17:31<71:52:35,  7.74s/it]
 12%|█▏        | 4547/37963 [11:17:39<72:21:29,  7.80s/it]
 12%|█▏        | 4548/37963 [11:17:54<91:39:10,  9.87s/it]
 12%|█▏        | 4549/37963 [11:18:01<85:54:36,  9.26s/it]
 12%|█▏        | 4550/37963 [11:18:09<81:31:08,  8.78s/it]
                                                          
{'loss': '0.1636', 'grad_norm': '2.13', 'learning_rate': '1.958e-05', 'epoch': '0.1199'}
+
 12%|█▏        | 4550/37963 [11:18:09<81:31:08,  8.78s/it]
 12%|█▏        | 4551/37963 [11:18:17<78:44:00,  8.48s/it]
 12%|█▏        | 4552/37963 [11:18:32<97:25:17, 10.50s/it]
 12%|█▏        | 4553/37963 [11:18:40<89:56:07,  9.69s/it]
 12%|█▏        | 4554/37963 [11:18:55<104:32:33, 11.27s/it]
 12%|█▏        | 4555/37963 [11:19:09<113:18:06, 12.21s/it]
 12%|█▏        | 4556/37963 [11:19:17<101:08:40, 10.90s/it]
 12%|█▏        | 4557/37963 [11:19:25<92:10:54,  9.93s/it] 
 12%|█▏        | 4558/37963 [11:19:32<86:03:42,  9.27s/it]
 12%|█▏        | 4559/37963 [11:19:40<81:45:41,  8.81s/it]
 12%|█▏        | 4560/37963 [11:19:48<79:05:45,  8.52s/it]
                                                          
{'loss': '0.1749', 'grad_norm': '2.008', 'learning_rate': '1.958e-05', 'epoch': '0.1201'}
+
 12%|█▏        | 4560/37963 [11:19:48<79:05:45,  8.52s/it]
 12%|█▏        | 4561/37963 [11:19:56<76:21:32,  8.23s/it]
 12%|█▏        | 4562/37963 [11:20:03<75:23:36,  8.13s/it]
 12%|█▏        | 4563/37963 [11:20:11<74:10:36,  8.00s/it]
 12%|█▏        | 4564/37963 [11:20:19<73:39:05,  7.94s/it]
 12%|█▏        | 4565/37963 [11:20:26<72:12:59,  7.78s/it]
 12%|█▏        | 4566/37963 [11:20:34<72:08:58,  7.78s/it]
 12%|█▏        | 4567/37963 [11:20:42<72:02:11,  7.77s/it]
 12%|█▏        | 4568/37963 [11:20:50<72:13:50,  7.79s/it]
 12%|█▏        | 4569/37963 [11:20:57<72:07:31,  7.78s/it]
 12%|█▏        | 4570/37963 [11:21:05<71:34:21,  7.72s/it]
                                                          
{'loss': '0.1794', 'grad_norm': '1.808', 'learning_rate': '1.957e-05', 'epoch': '0.1204'}
+
 12%|█▏        | 4570/37963 [11:21:05<71:34:21,  7.72s/it]
 12%|█▏        | 4571/37963 [11:21:13<71:25:22,  7.70s/it]
 12%|█▏        | 4572/37963 [11:21:20<71:25:09,  7.70s/it]
 12%|█▏        | 4573/37963 [11:21:34<88:29:07,  9.54s/it]
 12%|█▏        | 4574/37963 [11:21:42<83:07:54,  8.96s/it]
 12%|█▏        | 4575/37963 [11:21:50<79:32:28,  8.58s/it]
 12%|█▏        | 4576/37963 [11:21:57<76:49:13,  8.28s/it]
 12%|█▏        | 4577/37963 [11:22:12<96:14:55, 10.38s/it]
 12%|█▏        | 4578/37963 [11:22:20<88:42:25,  9.57s/it]
 12%|█▏        | 4579/37963 [11:22:28<83:09:09,  8.97s/it]
 12%|█▏        | 4580/37963 [11:22:35<79:31:13,  8.58s/it]
                                                          
{'loss': '0.1707', 'grad_norm': '1.827', 'learning_rate': '1.957e-05', 'epoch': '0.1206'}
+
 12%|█▏        | 4580/37963 [11:22:35<79:31:13,  8.58s/it]
 12%|█▏        | 4581/37963 [11:22:50<95:33:45, 10.31s/it]
 12%|█▏        | 4582/37963 [11:22:57<88:26:52,  9.54s/it]
 12%|█▏        | 4583/37963 [11:23:05<83:20:17,  8.99s/it]
 12%|█▏        | 4584/37963 [11:23:13<79:31:11,  8.58s/it]
 12%|█▏        | 4585/37963 [11:23:20<76:55:52,  8.30s/it]
 12%|█▏        | 4586/37963 [11:23:34<92:04:10,  9.93s/it]
 12%|█▏        | 4587/37963 [11:23:42<86:09:30,  9.29s/it]
 12%|█▏        | 4588/37963 [11:23:50<82:04:10,  8.85s/it]
 12%|█▏        | 4589/37963 [11:23:57<78:03:07,  8.42s/it]
 12%|█▏        | 4590/37963 [11:24:05<75:55:19,  8.19s/it]
                                                          
{'loss': '0.1695', 'grad_norm': '1.649', 'learning_rate': '1.957e-05', 'epoch': '0.1209'}
+
 12%|█▏        | 4590/37963 [11:24:05<75:55:19,  8.19s/it]
 12%|█▏        | 4591/37963 [11:24:12<74:23:36,  8.03s/it]
 12%|█▏        | 4592/37963 [11:24:20<72:50:10,  7.86s/it]
 12%|█▏        | 4593/37963 [11:24:27<71:52:56,  7.75s/it]
 12%|█▏        | 4594/37963 [11:24:35<71:38:39,  7.73s/it]
 12%|█▏        | 4595/37963 [11:24:43<71:58:38,  7.77s/it]
 12%|█▏        | 4596/37963 [11:24:58<91:46:39,  9.90s/it]
 12%|█▏        | 4597/37963 [11:25:05<85:29:49,  9.22s/it]
 12%|█▏        | 4598/37963 [11:25:21<101:52:28, 10.99s/it]
 12%|█▏        | 4599/37963 [11:25:28<92:39:16, 10.00s/it] 
 12%|█▏        | 4600/37963 [11:25:36<86:15:26,  9.31s/it]
                                                          
{'loss': '0.1801', 'grad_norm': '3.542', 'learning_rate': '1.957e-05', 'epoch': '0.1212'}
+
 12%|█▏        | 4600/37963 [11:25:36<86:15:26,  9.31s/it]
 12%|█▏        | 4601/37963 [11:25:51<101:42:19, 10.97s/it]
 12%|█▏        | 4602/37963 [11:26:05<109:58:34, 11.87s/it]
 12%|█▏        | 4603/37963 [11:26:13<98:28:31, 10.63s/it] 
 12%|█▏        | 4604/37963 [11:26:20<90:35:22,  9.78s/it]
 12%|█▏        | 4605/37963 [11:26:28<84:44:16,  9.14s/it]
 12%|█▏        | 4606/37963 [11:26:36<80:29:20,  8.69s/it]
 12%|█▏        | 4607/37963 [11:26:43<77:58:22,  8.42s/it]
 12%|█▏        | 4608/37963 [11:26:51<76:05:53,  8.21s/it]
 12%|█▏        | 4609/37963 [11:26:59<74:10:44,  8.01s/it]
 12%|█▏        | 4610/37963 [11:27:06<73:01:17,  7.88s/it]
                                                          
{'loss': '0.1756', 'grad_norm': '3.222', 'learning_rate': '1.956e-05', 'epoch': '0.1214'}
+
 12%|█▏        | 4610/37963 [11:27:06<73:01:17,  7.88s/it]
 12%|█▏        | 4611/37963 [11:27:14<72:19:22,  7.81s/it]
 12%|█▏        | 4612/37963 [11:27:22<71:53:14,  7.76s/it]
 12%|█▏        | 4613/37963 [11:27:29<71:37:29,  7.73s/it]
 12%|█▏        | 4614/37963 [11:27:37<71:30:57,  7.72s/it]
 12%|█▏        | 4615/37963 [11:27:45<71:15:28,  7.69s/it]
 12%|█▏        | 4616/37963 [11:27:52<70:16:25,  7.59s/it]
 12%|█▏        | 4617/37963 [11:28:06<88:57:11,  9.60s/it]
 12%|█▏        | 4618/37963 [11:28:14<83:21:22,  9.00s/it]
 12%|█▏        | 4619/37963 [11:28:21<79:31:01,  8.59s/it]
 12%|█▏        | 4620/37963 [11:28:29<76:49:46,  8.30s/it]
                                                          
{'loss': '0.1651', 'grad_norm': '3.05', 'learning_rate': '1.956e-05', 'epoch': '0.1217'}
+
 12%|█▏        | 4620/37963 [11:28:29<76:49:46,  8.30s/it]
 12%|█▏        | 4621/37963 [11:28:37<75:13:51,  8.12s/it]
 12%|█▏        | 4622/37963 [11:28:44<73:54:54,  7.98s/it]
 12%|█▏        | 4623/37963 [11:28:59<91:26:25,  9.87s/it]
 12%|█▏        | 4624/37963 [11:29:06<85:27:00,  9.23s/it]
 12%|█▏        | 4625/37963 [11:29:14<81:20:52,  8.78s/it]
 12%|█▏        | 4626/37963 [11:29:22<77:56:03,  8.42s/it]
 12%|█▏        | 4627/37963 [11:29:29<75:43:03,  8.18s/it]
 12%|█▏        | 4628/37963 [11:29:37<74:36:09,  8.06s/it]
 12%|█▏        | 4629/37963 [11:29:44<72:41:49,  7.85s/it]
 12%|█▏        | 4630/37963 [11:29:59<90:11:00,  9.74s/it]
                                                          
{'loss': '0.1682', 'grad_norm': '3.599', 'learning_rate': '1.956e-05', 'epoch': '0.122'}
+
 12%|█▏        | 4630/37963 [11:29:59<90:11:00,  9.74s/it]
 12%|█▏        | 4631/37963 [11:30:06<84:36:24,  9.14s/it]
 12%|█▏        | 4632/37963 [11:30:14<80:10:12,  8.66s/it]
 12%|█▏        | 4633/37963 [11:30:28<95:36:32, 10.33s/it]
 12%|█▏        | 4634/37963 [11:30:36<88:16:52,  9.54s/it]
 12%|█▏        | 4635/37963 [11:30:44<83:47:00,  9.05s/it]
 12%|█▏        | 4636/37963 [11:30:51<80:11:32,  8.66s/it]
 12%|█▏        | 4637/37963 [11:30:59<77:32:02,  8.38s/it]
 12%|█▏        | 4638/37963 [11:31:07<75:31:32,  8.16s/it]
 12%|█▏        | 4639/37963 [11:31:15<74:32:20,  8.05s/it]
 12%|█▏        | 4640/37963 [11:31:22<73:17:20,  7.92s/it]
                                                          
{'loss': '0.1696', 'grad_norm': '2.394', 'learning_rate': '1.956e-05', 'epoch': '0.1222'}
+
 12%|█▏        | 4640/37963 [11:31:22<73:17:20,  7.92s/it]
 12%|█▏        | 4641/37963 [11:31:30<71:58:52,  7.78s/it]
 12%|█▏        | 4642/37963 [11:31:37<71:09:23,  7.69s/it]
 12%|█▏        | 4643/37963 [11:31:45<71:07:42,  7.68s/it]
 12%|█▏        | 4644/37963 [11:31:59<89:48:55,  9.70s/it]
 12%|█▏        | 4645/37963 [11:32:07<84:37:50,  9.14s/it]
 12%|█▏        | 4646/37963 [11:32:22<101:01:48, 10.92s/it]
 12%|█▏        | 4647/37963 [11:32:37<113:10:39, 12.23s/it]
 12%|█▏        | 4648/37963 [11:32:45<100:56:23, 10.91s/it]
 12%|█▏        | 4649/37963 [11:32:53<91:46:12,  9.92s/it] 
 12%|█▏        | 4650/37963 [11:33:00<85:25:46,  9.23s/it]
                                                          
{'loss': '0.1667', 'grad_norm': '3.217', 'learning_rate': '1.955e-05', 'epoch': '0.1225'}
+
 12%|█▏        | 4650/37963 [11:33:00<85:25:46,  9.23s/it]
 12%|█▏        | 4651/37963 [11:33:08<81:02:07,  8.76s/it]
 12%|█▏        | 4652/37963 [11:33:16<78:33:28,  8.49s/it]
 12%|█▏        | 4653/37963 [11:33:24<76:40:01,  8.29s/it]
 12%|█▏        | 4654/37963 [11:33:38<93:10:34, 10.07s/it]
 12%|█▏        | 4655/37963 [11:33:46<86:55:26,  9.39s/it]
 12%|█▏        | 4656/37963 [11:33:54<82:12:56,  8.89s/it]
 12%|█▏        | 4657/37963 [11:34:01<78:37:30,  8.50s/it]
 12%|█▏        | 4658/37963 [11:34:09<76:20:43,  8.25s/it]
 12%|█▏        | 4659/37963 [11:34:17<74:44:18,  8.08s/it]
 12%|█▏        | 4660/37963 [11:34:24<73:48:14,  7.98s/it]
                                                          
{'loss': '0.1823', 'grad_norm': '1.336', 'learning_rate': '1.955e-05', 'epoch': '0.1228'}
+
 12%|█▏        | 4660/37963 [11:34:24<73:48:14,  7.98s/it]
 12%|█▏        | 4661/37963 [11:34:32<73:05:11,  7.90s/it]
 12%|█▏        | 4662/37963 [11:34:40<73:01:49,  7.89s/it]
 12%|█▏        | 4663/37963 [11:34:48<72:24:05,  7.83s/it]
 12%|█▏        | 4664/37963 [11:34:55<71:49:13,  7.76s/it]
 12%|█▏        | 4665/37963 [11:35:03<72:10:19,  7.80s/it]
 12%|█▏        | 4666/37963 [11:35:18<90:44:39,  9.81s/it]
 12%|█▏        | 4667/37963 [11:35:25<84:32:37,  9.14s/it]
 12%|█▏        | 4668/37963 [11:35:33<80:21:33,  8.69s/it]
 12%|█▏        | 4669/37963 [11:35:41<77:53:22,  8.42s/it]
 12%|█▏        | 4670/37963 [11:35:48<75:46:28,  8.19s/it]
                                                          
{'loss': '0.1802', 'grad_norm': '1.709', 'learning_rate': '1.955e-05', 'epoch': '0.123'}
+
 12%|█▏        | 4670/37963 [11:35:48<75:46:28,  8.19s/it]
 12%|█▏        | 4671/37963 [11:35:56<74:03:44,  8.01s/it]
 12%|█▏        | 4672/37963 [11:36:03<73:09:48,  7.91s/it]
 12%|█▏        | 4673/37963 [11:36:11<72:29:33,  7.84s/it]
 12%|█▏        | 4674/37963 [11:36:26<93:21:31, 10.10s/it]
 12%|█▏        | 4675/37963 [11:36:34<86:44:42,  9.38s/it]
 12%|█▏        | 4676/37963 [11:36:42<81:32:05,  8.82s/it]
 12%|█▏        | 4677/37963 [11:36:49<78:26:46,  8.48s/it]
 12%|█▏        | 4678/37963 [11:36:57<76:16:07,  8.25s/it]
 12%|█▏        | 4679/37963 [11:37:05<74:45:53,  8.09s/it]
 12%|█▏        | 4680/37963 [11:37:19<92:27:51, 10.00s/it]
                                                          
{'loss': '0.1611', 'grad_norm': '6.613', 'learning_rate': '1.955e-05', 'epoch': '0.1233'}
+
 12%|█▏        | 4680/37963 [11:37:19<92:27:51, 10.00s/it]
 12%|█▏        | 4681/37963 [11:37:34<104:50:15, 11.34s/it]
 12%|█▏        | 4682/37963 [11:37:41<94:47:59, 10.25s/it] 
 12%|█▏        | 4683/37963 [11:37:49<87:48:55,  9.50s/it]
 12%|█▏        | 4684/37963 [11:37:57<82:32:27,  8.93s/it]
 12%|█▏        | 4685/37963 [11:38:04<79:03:57,  8.55s/it]
 12%|█▏        | 4686/37963 [11:38:12<76:11:31,  8.24s/it]
 12%|█▏        | 4687/37963 [11:38:20<74:24:53,  8.05s/it]
 12%|█▏        | 4688/37963 [11:38:34<92:28:48, 10.01s/it]
 12%|█▏        | 4689/37963 [11:38:42<86:24:29,  9.35s/it]
 12%|█▏        | 4690/37963 [11:38:50<81:58:30,  8.87s/it]
                                                          
{'loss': '0.1657', 'grad_norm': '1.551', 'learning_rate': '1.954e-05', 'epoch': '0.1235'}
+
 12%|█▏        | 4690/37963 [11:38:50<81:58:30,  8.87s/it]
 12%|█▏        | 4691/37963 [11:38:58<79:11:18,  8.57s/it]
 12%|█▏        | 4692/37963 [11:39:05<77:07:24,  8.34s/it]
 12%|█▏        | 4693/37963 [11:39:13<75:04:10,  8.12s/it]
 12%|█▏        | 4694/37963 [11:39:21<74:22:22,  8.05s/it]
 12%|█▏        | 4695/37963 [11:39:36<92:29:57, 10.01s/it]
 12%|█▏        | 4696/37963 [11:39:43<85:26:29,  9.25s/it]
 12%|█▏        | 4697/37963 [11:39:51<81:01:57,  8.77s/it]
 12%|█▏        | 4698/37963 [11:39:58<77:30:58,  8.39s/it]
 12%|█▏        | 4699/37963 [11:40:13<95:08:06, 10.30s/it]
 12%|█▏        | 4700/37963 [11:40:21<88:22:33,  9.56s/it]
                                                          
{'loss': '0.161', 'grad_norm': '1.747', 'learning_rate': '1.954e-05', 'epoch': '0.1238'}
+
 12%|█▏        | 4700/37963 [11:40:21<88:22:33,  9.56s/it]
 12%|█▏        | 4701/37963 [11:40:28<83:10:33,  9.00s/it]
 12%|█▏        | 4702/37963 [11:40:36<79:30:32,  8.61s/it]
 12%|█▏        | 4703/37963 [11:40:44<76:42:00,  8.30s/it]
 12%|█▏        | 4704/37963 [11:40:51<75:05:07,  8.13s/it]
 12%|█▏        | 4705/37963 [11:40:59<74:14:18,  8.04s/it]
 12%|█▏        | 4706/37963 [11:41:07<72:31:04,  7.85s/it]
 12%|█▏        | 4707/37963 [11:41:14<71:59:18,  7.79s/it]
 12%|█▏        | 4708/37963 [11:41:29<90:07:32,  9.76s/it]
 12%|█▏        | 4709/37963 [11:41:36<84:25:41,  9.14s/it]
 12%|█▏        | 4710/37963 [11:41:44<80:51:08,  8.75s/it]
                                                          
{'loss': '0.1746', 'grad_norm': '3.18', 'learning_rate': '1.954e-05', 'epoch': '0.1241'}
+
 12%|█▏        | 4710/37963 [11:41:44<80:51:08,  8.75s/it]
 12%|█▏        | 4711/37963 [11:41:52<77:45:41,  8.42s/it]
 12%|█▏        | 4712/37963 [11:42:00<75:46:39,  8.20s/it]
 12%|█▏        | 4713/37963 [11:42:07<74:17:23,  8.04s/it]
 12%|█▏        | 4714/37963 [11:42:21<90:04:03,  9.75s/it]
 12%|█▏        | 4715/37963 [11:42:29<84:33:14,  9.16s/it]
 12%|█▏        | 4716/37963 [11:42:36<79:58:26,  8.66s/it]
 12%|█▏        | 4717/37963 [11:42:44<77:15:39,  8.37s/it]
 12%|█▏        | 4718/37963 [11:42:51<75:05:22,  8.13s/it]
 12%|█▏        | 4719/37963 [11:42:59<73:51:48,  8.00s/it]
 12%|█▏        | 4720/37963 [11:43:07<72:44:36,  7.88s/it]
                                                          
{'loss': '0.1756', 'grad_norm': '3.985', 'learning_rate': '1.954e-05', 'epoch': '0.1243'}
+
 12%|█▏        | 4720/37963 [11:43:07<72:44:36,  7.88s/it]
 12%|█▏        | 4721/37963 [11:43:14<72:11:40,  7.82s/it]
 12%|█▏        | 4722/37963 [11:43:29<91:59:44,  9.96s/it]
 12%|█▏        | 4723/37963 [11:43:37<85:38:40,  9.28s/it]
 12%|█▏        | 4724/37963 [11:43:45<81:15:51,  8.80s/it]
 12%|█▏        | 4725/37963 [11:43:53<78:37:49,  8.52s/it]
 12%|█▏        | 4726/37963 [11:44:07<94:50:00, 10.27s/it]
 12%|█▏        | 4727/37963 [11:44:15<87:55:08,  9.52s/it]
 12%|█▏        | 4728/37963 [11:44:23<83:08:07,  9.01s/it]
 12%|█▏        | 4729/37963 [11:44:30<78:51:41,  8.54s/it]
 12%|█▏        | 4730/37963 [11:44:38<76:35:52,  8.30s/it]
                                                          
{'loss': '0.1837', 'grad_norm': '3.922', 'learning_rate': '1.953e-05', 'epoch': '0.1246'}
+
 12%|█▏        | 4730/37963 [11:44:38<76:35:52,  8.30s/it]
 12%|█▏        | 4731/37963 [11:44:45<74:53:04,  8.11s/it]
 12%|█▏        | 4732/37963 [11:45:00<93:42:25, 10.15s/it]
 12%|█▏        | 4733/37963 [11:45:08<86:53:09,  9.41s/it]
 12%|█▏        | 4734/37963 [11:45:22<100:40:59, 10.91s/it]
 12%|█▏        | 4735/37963 [11:45:30<91:43:27,  9.94s/it] 
 12%|█▏        | 4736/37963 [11:45:38<85:16:34,  9.24s/it]
 12%|█▏        | 4737/37963 [11:45:45<80:45:58,  8.75s/it]
 12%|█▏        | 4738/37963 [11:45:53<77:44:11,  8.42s/it]
 12%|█▏        | 4739/37963 [11:46:01<75:35:56,  8.19s/it]
 12%|█▏        | 4740/37963 [11:46:08<74:23:27,  8.06s/it]
                                                          
{'loss': '0.1805', 'grad_norm': '2.302', 'learning_rate': '1.953e-05', 'epoch': '0.1249'}
+
 12%|█▏        | 4740/37963 [11:46:08<74:23:27,  8.06s/it]
 12%|█▏        | 4741/37963 [11:46:16<72:58:29,  7.91s/it]
 12%|█▏        | 4742/37963 [11:46:23<71:55:47,  7.79s/it]
 12%|█▏        | 4743/37963 [11:46:31<71:59:47,  7.80s/it]
 12%|█▏        | 4744/37963 [11:46:39<71:37:19,  7.76s/it]
 12%|█▏        | 4745/37963 [11:46:47<71:17:10,  7.73s/it]
 13%|█▎        | 4746/37963 [11:46:54<71:05:52,  7.71s/it]
 13%|█▎        | 4747/37963 [11:47:02<70:19:57,  7.62s/it]
 13%|█▎        | 4748/37963 [11:47:17<90:14:43,  9.78s/it]
 13%|█▎        | 4749/37963 [11:47:24<84:11:51,  9.13s/it]
 13%|█▎        | 4750/37963 [11:47:32<80:23:25,  8.71s/it]
                                                          
{'loss': '0.1894', 'grad_norm': '3.525', 'learning_rate': '1.953e-05', 'epoch': '0.1251'}
+
 13%|█▎        | 4750/37963 [11:47:32<80:23:25,  8.71s/it]
 13%|█▎        | 4751/37963 [11:47:40<77:45:10,  8.43s/it]
 13%|█▎        | 4752/37963 [11:47:55<95:49:55, 10.39s/it]
 13%|█▎        | 4753/37963 [11:48:02<88:27:32,  9.59s/it]
 13%|█▎        | 4754/37963 [11:48:10<82:09:47,  8.91s/it]
 13%|█▎        | 4755/37963 [11:48:17<79:02:21,  8.57s/it]
 13%|█▎        | 4756/37963 [11:48:31<93:55:34, 10.18s/it]
 13%|█▎        | 4757/37963 [11:48:39<87:14:17,  9.46s/it]
 13%|█▎        | 4758/37963 [11:48:47<82:19:37,  8.93s/it]
 13%|█▎        | 4759/37963 [11:48:54<78:55:56,  8.56s/it]
 13%|█▎        | 4760/37963 [11:49:02<76:37:30,  8.31s/it]
                                                          
{'loss': '0.164', 'grad_norm': '3.078', 'learning_rate': '1.953e-05', 'epoch': '0.1254'}
+
 13%|█▎        | 4760/37963 [11:49:02<76:37:30,  8.31s/it]
 13%|█▎        | 4761/37963 [11:49:10<74:37:48,  8.09s/it]
 13%|█▎        | 4762/37963 [11:49:24<92:04:18,  9.98s/it]
 13%|█▎        | 4763/37963 [11:49:32<86:12:24,  9.35s/it]
 13%|█▎        | 4764/37963 [11:49:40<81:41:55,  8.86s/it]
 13%|█▎        | 4765/37963 [11:49:47<78:03:56,  8.47s/it]
 13%|█▎        | 4766/37963 [11:49:55<75:51:39,  8.23s/it]
 13%|█▎        | 4767/37963 [11:50:03<74:21:12,  8.06s/it]
 13%|█▎        | 4768/37963 [11:50:10<73:11:58,  7.94s/it]
 13%|█▎        | 4769/37963 [11:50:18<72:39:07,  7.88s/it]
 13%|█▎        | 4770/37963 [11:50:26<72:22:00,  7.85s/it]
                                                          
{'loss': '0.1825', 'grad_norm': '1.71', 'learning_rate': '1.952e-05', 'epoch': '0.1256'}
+
 13%|█▎        | 4770/37963 [11:50:26<72:22:00,  7.85s/it]
 13%|█▎        | 4771/37963 [11:50:40<90:43:42,  9.84s/it]
 13%|█▎        | 4772/37963 [11:50:55<105:09:43, 11.41s/it]
 13%|█▎        | 4773/37963 [11:51:03<94:53:08, 10.29s/it] 
 13%|█▎        | 4774/37963 [11:51:11<87:36:38,  9.50s/it]
 13%|█▎        | 4775/37963 [11:51:19<82:46:59,  8.98s/it]
 13%|█▎        | 4776/37963 [11:51:26<77:50:06,  8.44s/it]
 13%|█▎        | 4777/37963 [11:51:33<75:42:43,  8.21s/it]
 13%|█▎        | 4778/37963 [11:51:41<74:12:18,  8.05s/it]
 13%|█▎        | 4779/37963 [11:51:49<73:40:43,  7.99s/it]
 13%|█▎        | 4780/37963 [11:52:04<92:46:53, 10.07s/it]
                                                          
{'loss': '0.1737', 'grad_norm': '24.77', 'learning_rate': '1.952e-05', 'epoch': '0.1259'}
+
 13%|█▎        | 4780/37963 [11:52:04<92:46:53, 10.07s/it]
 13%|█▎        | 4781/37963 [11:52:11<86:00:39,  9.33s/it]
 13%|█▎        | 4782/37963 [11:52:26<99:46:37, 10.83s/it]
 13%|█▎        | 4783/37963 [11:52:33<90:56:17,  9.87s/it]
 13%|█▎        | 4784/37963 [11:52:41<84:15:43,  9.14s/it]
 13%|█▎        | 4785/37963 [11:52:49<80:18:39,  8.71s/it]
 13%|█▎        | 4786/37963 [11:52:56<77:24:40,  8.40s/it]
 13%|█▎        | 4787/37963 [11:53:04<74:46:30,  8.11s/it]
 13%|█▎        | 4788/37963 [11:53:11<72:42:08,  7.89s/it]
 13%|█▎        | 4789/37963 [11:53:19<72:10:48,  7.83s/it]
 13%|█▎        | 4790/37963 [11:53:26<71:31:45,  7.76s/it]
                                                          
{'loss': '3.714', 'grad_norm': '2.391', 'learning_rate': '1.952e-05', 'epoch': '0.1262'}
+
 13%|█▎        | 4790/37963 [11:53:26<71:31:45,  7.76s/it]
 13%|█▎        | 4791/37963 [11:53:34<71:08:50,  7.72s/it]
 13%|█▎        | 4792/37963 [11:53:42<70:47:54,  7.68s/it]
 13%|█▎        | 4793/37963 [11:53:49<70:54:09,  7.70s/it]
 13%|█▎        | 4794/37963 [11:53:57<70:40:15,  7.67s/it]
 13%|█▎        | 4795/37963 [11:54:05<70:39:12,  7.67s/it]
 13%|█▎        | 4796/37963 [11:54:12<70:07:01,  7.61s/it]
 13%|█▎        | 4797/37963 [11:54:27<90:29:59,  9.82s/it]
 13%|█▎        | 4798/37963 [11:54:35<84:48:21,  9.21s/it]
 13%|█▎        | 4799/37963 [11:54:43<80:46:48,  8.77s/it]
 13%|█▎        | 4800/37963 [11:54:57<97:53:56, 10.63s/it]
                                                          
{'loss': '0.2204', 'grad_norm': '2.693', 'learning_rate': '1.952e-05', 'epoch': '0.1264'}
+
 13%|█▎        | 4800/37963 [11:54:57<97:53:56, 10.63s/it]
 13%|█▎        | 4801/37963 [11:55:05<89:41:02,  9.74s/it]
 13%|█▎        | 4802/37963 [11:55:13<84:00:09,  9.12s/it]
 13%|█▎        | 4803/37963 [11:55:27<98:02:02, 10.64s/it]
 13%|█▎        | 4804/37963 [11:55:35<89:44:29,  9.74s/it]
 13%|█▎        | 4805/37963 [11:55:42<83:41:36,  9.09s/it]
 13%|█▎        | 4806/37963 [11:55:50<79:57:48,  8.68s/it]
 13%|█▎        | 4807/37963 [11:55:58<77:16:09,  8.39s/it]
 13%|█▎        | 4808/37963 [11:56:05<75:14:55,  8.17s/it]
 13%|█▎        | 4809/37963 [11:56:13<73:35:13,  7.99s/it]
 13%|█▎        | 4810/37963 [11:56:21<72:40:13,  7.89s/it]
                                                          
{'loss': '0.1941', 'grad_norm': '4.328', 'learning_rate': '1.951e-05', 'epoch': '0.1267'}
+
 13%|█▎        | 4810/37963 [11:56:21<72:40:13,  7.89s/it]
 13%|█▎        | 4811/37963 [11:56:28<72:06:13,  7.83s/it]
 13%|█▎        | 4812/37963 [11:56:36<71:28:10,  7.76s/it]
 13%|█▎        | 4813/37963 [11:56:43<71:01:47,  7.71s/it]
 13%|█▎        | 4814/37963 [11:56:51<71:04:08,  7.72s/it]
 13%|█▎        | 4815/37963 [11:57:06<89:35:26,  9.73s/it]
 13%|█▎        | 4816/37963 [11:57:21<104:45:47, 11.38s/it]
 13%|█▎        | 4817/37963 [11:57:29<94:50:33, 10.30s/it] 
 13%|█▎        | 4818/37963 [11:57:36<87:34:31,  9.51s/it]
 13%|█▎        | 4819/37963 [11:57:44<82:26:44,  8.95s/it]
 13%|█▎        | 4820/37963 [11:57:52<79:28:40,  8.63s/it]
                                                          
{'loss': '0.206', 'grad_norm': '2.713', 'learning_rate': '1.951e-05', 'epoch': '0.127'}
+
 13%|█▎        | 4820/37963 [11:57:52<79:28:40,  8.63s/it]
 13%|█▎        | 4821/37963 [11:57:59<76:43:03,  8.33s/it]
 13%|█▎        | 4822/37963 [11:58:07<75:09:51,  8.16s/it]
 13%|█▎        | 4823/37963 [11:58:15<73:59:22,  8.04s/it]
 13%|█▎        | 4824/37963 [11:58:23<73:04:23,  7.94s/it]
 13%|█▎        | 4825/37963 [11:58:30<71:30:23,  7.77s/it]
 13%|█▎        | 4826/37963 [11:58:38<70:52:55,  7.70s/it]
 13%|█▎        | 4827/37963 [11:58:53<91:06:27,  9.90s/it]
 13%|█▎        | 4828/37963 [11:59:01<85:34:52,  9.30s/it]
 13%|█▎        | 4829/37963 [11:59:15<99:02:08, 10.76s/it]
 13%|█▎        | 4830/37963 [11:59:22<90:29:40,  9.83s/it]
                                                          
{'loss': '0.1867', 'grad_norm': '3.101', 'learning_rate': '1.951e-05', 'epoch': '0.1272'}
+
 13%|█▎        | 4830/37963 [11:59:22<90:29:40,  9.83s/it]
 13%|█▎        | 4831/37963 [11:59:30<84:53:38,  9.22s/it]
 13%|█▎        | 4832/37963 [11:59:38<80:43:43,  8.77s/it]
 13%|█▎        | 4833/37963 [11:59:46<77:37:58,  8.44s/it]
 13%|█▎        | 4834/37963 [11:59:53<75:15:40,  8.18s/it]
 13%|█▎        | 4835/37963 [12:00:01<73:12:43,  7.96s/it]
 13%|█▎        | 4836/37963 [12:00:08<72:12:58,  7.85s/it]
 13%|█▎        | 4837/37963 [12:00:16<72:26:13,  7.87s/it]
 13%|█▎        | 4838/37963 [12:00:24<71:57:17,  7.82s/it]
 13%|█▎        | 4839/37963 [12:00:31<70:37:40,  7.68s/it]
 13%|█▎        | 4840/37963 [12:00:39<70:41:33,  7.68s/it]
                                                          
{'loss': '0.1828', 'grad_norm': '2.115', 'learning_rate': '1.951e-05', 'epoch': '0.1275'}
+
 13%|█▎        | 4840/37963 [12:00:39<70:41:33,  7.68s/it]
 13%|█▎        | 4841/37963 [12:00:47<71:04:36,  7.73s/it]
 13%|█▎        | 4842/37963 [12:00:54<71:00:38,  7.72s/it]
 13%|█▎        | 4843/37963 [12:01:02<70:58:24,  7.71s/it]
 13%|█▎        | 4844/37963 [12:01:09<70:03:13,  7.61s/it]
 13%|█▎        | 4845/37963 [12:01:25<91:17:19,  9.92s/it]
 13%|█▎        | 4846/37963 [12:01:32<84:58:21,  9.24s/it]
 13%|█▎        | 4847/37963 [12:01:47<98:35:38, 10.72s/it]
 13%|█▎        | 4848/37963 [12:01:54<90:29:21,  9.84s/it]
 13%|█▎        | 4849/37963 [12:02:02<84:34:02,  9.19s/it]
 13%|█▎        | 4850/37963 [12:02:09<79:50:36,  8.68s/it]
                                                          
{'loss': '0.2005', 'grad_norm': '1.634', 'learning_rate': '1.95e-05', 'epoch': '0.1278'}
+
 13%|█▎        | 4850/37963 [12:02:09<79:50:36,  8.68s/it]
 13%|█▎        | 4851/37963 [12:02:17<77:27:14,  8.42s/it]
 13%|█▎        | 4852/37963 [12:02:25<75:25:00,  8.20s/it]
 13%|█▎        | 4853/37963 [12:02:33<73:47:32,  8.02s/it]
 13%|█▎        | 4854/37963 [12:02:48<93:20:34, 10.15s/it]
 13%|█▎        | 4855/37963 [12:02:55<86:06:26,  9.36s/it]
 13%|█▎        | 4856/37963 [12:03:03<81:34:03,  8.87s/it]
 13%|█▎        | 4857/37963 [12:03:11<78:06:59,  8.49s/it]
 13%|█▎        | 4858/37963 [12:03:18<76:01:11,  8.27s/it]
 13%|█▎        | 4859/37963 [12:03:26<73:34:13,  8.00s/it]
 13%|█▎        | 4860/37963 [12:03:33<71:48:19,  7.81s/it]
                                                          
{'loss': '0.1783', 'grad_norm': '3.019', 'learning_rate': '1.95e-05', 'epoch': '0.128'}
+
 13%|█▎        | 4860/37963 [12:03:33<71:48:19,  7.81s/it]
 13%|█▎        | 4861/37963 [12:03:41<71:16:24,  7.75s/it]
 13%|█▎        | 4862/37963 [12:03:48<71:27:06,  7.77s/it]
 13%|█▎        | 4863/37963 [12:04:02<88:37:02,  9.64s/it]
 13%|█▎        | 4864/37963 [12:04:10<83:08:51,  9.04s/it]
 13%|█▎        | 4865/37963 [12:04:18<79:45:28,  8.68s/it]
 13%|█▎        | 4866/37963 [12:04:33<96:02:07, 10.45s/it]
 13%|█▎        | 4867/37963 [12:04:40<88:28:29,  9.62s/it]
 13%|█▎        | 4868/37963 [12:04:48<82:57:01,  9.02s/it]
 13%|█▎        | 4869/37963 [12:05:03<98:54:17, 10.76s/it]
 13%|█▎        | 4870/37963 [12:05:10<90:13:47,  9.82s/it]
                                                          
{'loss': '0.1951', 'grad_norm': '2.809', 'learning_rate': '1.95e-05', 'epoch': '0.1283'}
+
 13%|█▎        | 4870/37963 [12:05:10<90:13:47,  9.82s/it]
 13%|█▎        | 4871/37963 [12:05:18<84:35:49,  9.20s/it]
 13%|█▎        | 4872/37963 [12:05:26<80:09:15,  8.72s/it]
 13%|█▎        | 4873/37963 [12:05:40<96:00:01, 10.44s/it]
 13%|█▎        | 4874/37963 [12:05:48<88:43:25,  9.65s/it]
 13%|█▎        | 4875/37963 [12:05:55<82:32:04,  8.98s/it]
 13%|█▎        | 4876/37963 [12:06:11<99:39:40, 10.84s/it]
 13%|█▎        | 4877/37963 [12:06:18<91:18:59,  9.94s/it]
 13%|█▎        | 4878/37963 [12:06:26<85:04:26,  9.26s/it]
 13%|█▎        | 4879/37963 [12:06:34<80:50:58,  8.80s/it]
 13%|█▎        | 4880/37963 [12:06:41<77:55:41,  8.48s/it]
                                                          
{'loss': '0.1883', 'grad_norm': '4.197', 'learning_rate': '1.95e-05', 'epoch': '0.1285'}
+
 13%|█▎        | 4880/37963 [12:06:41<77:55:41,  8.48s/it]
 13%|█▎        | 4881/37963 [12:06:49<76:02:11,  8.27s/it]
 13%|█▎        | 4882/37963 [12:06:57<74:21:46,  8.09s/it]
 13%|█▎        | 4883/37963 [12:07:05<73:26:59,  7.99s/it]
 13%|█▎        | 4884/37963 [12:07:12<72:51:00,  7.93s/it]
 13%|█▎        | 4885/37963 [12:07:20<72:08:17,  7.85s/it]
 13%|█▎        | 4886/37963 [12:07:28<71:00:04,  7.73s/it]
 13%|█▎        | 4887/37963 [12:07:35<70:46:59,  7.70s/it]
 13%|█▎        | 4888/37963 [12:07:42<69:30:40,  7.57s/it]
 13%|█▎        | 4889/37963 [12:07:50<69:51:58,  7.60s/it]
 13%|█▎        | 4890/37963 [12:08:04<87:48:54,  9.56s/it]
                                                          
{'loss': '0.2042', 'grad_norm': '4.394', 'learning_rate': '1.949e-05', 'epoch': '0.1288'}
+
 13%|█▎        | 4890/37963 [12:08:04<87:48:54,  9.56s/it]
 13%|█▎        | 4891/37963 [12:08:12<82:14:32,  8.95s/it]
 13%|█▎        | 4892/37963 [12:08:20<79:03:49,  8.61s/it]
 13%|█▎        | 4893/37963 [12:08:27<76:50:41,  8.37s/it]
 13%|█▎        | 4894/37963 [12:08:42<94:15:01, 10.26s/it]
 13%|█▎        | 4895/37963 [12:08:50<87:30:55,  9.53s/it]
 13%|█▎        | 4896/37963 [12:08:58<82:49:50,  9.02s/it]
 13%|█▎        | 4897/37963 [12:09:05<79:07:35,  8.61s/it]
 13%|█▎        | 4898/37963 [12:09:13<75:58:03,  8.27s/it]
 13%|█▎        | 4899/37963 [12:09:21<74:49:31,  8.15s/it]
 13%|█▎        | 4900/37963 [12:09:28<73:26:01,  8.00s/it]
                                                          
{'loss': '0.1886', 'grad_norm': '3.49', 'learning_rate': '1.949e-05', 'epoch': '0.1291'}
+
 13%|█▎        | 4900/37963 [12:09:28<73:26:01,  8.00s/it]
 13%|█▎        | 4901/37963 [12:09:36<71:49:25,  7.82s/it]
 13%|█▎        | 4902/37963 [12:09:43<71:26:57,  7.78s/it]
 13%|█▎        | 4903/37963 [12:09:58<90:10:50,  9.82s/it]
 13%|█▎        | 4904/37963 [12:10:06<84:21:04,  9.19s/it]
 13%|█▎        | 4905/37963 [12:10:13<80:03:21,  8.72s/it]
 13%|█▎        | 4906/37963 [12:10:21<77:15:43,  8.41s/it]
 13%|█▎        | 4907/37963 [12:10:29<74:43:55,  8.14s/it]
 13%|█▎        | 4908/37963 [12:10:36<73:25:37,  8.00s/it]
 13%|█▎        | 4909/37963 [12:10:44<72:33:09,  7.90s/it]
 13%|█▎        | 4910/37963 [12:10:51<71:17:13,  7.76s/it]
                                                          
{'loss': '0.1822', 'grad_norm': '4.736', 'learning_rate': '1.949e-05', 'epoch': '0.1293'}
+
 13%|█▎        | 4910/37963 [12:10:51<71:17:13,  7.76s/it]
 13%|█▎        | 4911/37963 [12:10:59<70:47:48,  7.71s/it]
 13%|█▎        | 4912/37963 [12:11:07<70:29:01,  7.68s/it]
 13%|█▎        | 4913/37963 [12:11:14<70:11:14,  7.65s/it]
 13%|█▎        | 4914/37963 [12:11:28<88:35:26,  9.65s/it]
 13%|█▎        | 4915/37963 [12:11:36<83:32:16,  9.10s/it]
 13%|█▎        | 4916/37963 [12:11:44<79:39:01,  8.68s/it]
 13%|█▎        | 4917/37963 [12:11:52<77:08:05,  8.40s/it]
 13%|█▎        | 4918/37963 [12:12:00<75:22:43,  8.21s/it]
 13%|█▎        | 4919/37963 [12:12:07<74:06:39,  8.07s/it]
 13%|█▎        | 4920/37963 [12:12:29<111:07:27, 12.11s/it]
                                                           
{'loss': '0.1904', 'grad_norm': '6.518', 'learning_rate': '1.948e-05', 'epoch': '0.1296'}
+
 13%|█▎        | 4920/37963 [12:12:29<111:07:27, 12.11s/it]
 13%|█▎        | 4921/37963 [12:12:43<117:19:30, 12.78s/it]
 13%|█▎        | 4922/37963 [12:12:51<103:34:28, 11.29s/it]
 13%|█▎        | 4923/37963 [12:12:59<93:26:42, 10.18s/it] 
 13%|█▎        | 4924/37963 [12:13:06<86:29:13,  9.42s/it]
 13%|█▎        | 4925/37963 [12:13:14<81:33:55,  8.89s/it]
 13%|█▎        | 4926/37963 [12:13:22<78:30:26,  8.55s/it]
 13%|█▎        | 4927/37963 [12:13:29<76:08:11,  8.30s/it]
 13%|█▎        | 4928/37963 [12:13:37<74:16:55,  8.09s/it]
 13%|█▎        | 4929/37963 [12:13:45<73:22:46,  8.00s/it]
 13%|█▎        | 4930/37963 [12:13:52<71:45:53,  7.82s/it]
                                                          
{'loss': '0.1832', 'grad_norm': '5.791', 'learning_rate': '1.948e-05', 'epoch': '0.1299'}
+
 13%|█▎        | 4930/37963 [12:13:52<71:45:53,  7.82s/it]
 13%|█▎        | 4931/37963 [12:14:00<71:33:20,  7.80s/it]
 13%|█▎        | 4932/37963 [12:14:08<71:11:25,  7.76s/it]
 13%|█▎        | 4933/37963 [12:14:15<70:52:37,  7.73s/it]
 13%|█▎        | 4934/37963 [12:14:23<70:05:44,  7.64s/it]
 13%|█▎        | 4935/37963 [12:14:30<70:27:48,  7.68s/it]
 13%|█▎        | 4936/37963 [12:14:45<88:56:41,  9.70s/it]
 13%|█▎        | 4937/37963 [12:14:53<83:34:26,  9.11s/it]
 13%|█▎        | 4938/37963 [12:15:00<79:43:50,  8.69s/it]
 13%|█▎        | 4939/37963 [12:15:08<76:59:35,  8.39s/it]
 13%|█▎        | 4940/37963 [12:15:16<75:09:03,  8.19s/it]
                                                          
{'loss': '0.1732', 'grad_norm': '1.799', 'learning_rate': '1.948e-05', 'epoch': '0.1301'}
+
 13%|█▎        | 4940/37963 [12:15:16<75:09:03,  8.19s/it]
 13%|█▎        | 4941/37963 [12:15:23<73:48:06,  8.05s/it]
 13%|█▎        | 4942/37963 [12:15:38<92:11:35, 10.05s/it]
 13%|█▎        | 4943/37963 [12:15:46<85:46:00,  9.35s/it]
 13%|█▎        | 4944/37963 [12:15:53<81:09:02,  8.85s/it]
 13%|█▎        | 4945/37963 [12:16:01<78:12:02,  8.53s/it]
 13%|█▎        | 4946/37963 [12:16:09<75:53:44,  8.28s/it]
 13%|█▎        | 4947/37963 [12:16:17<74:18:46,  8.10s/it]
 13%|█▎        | 4948/37963 [12:16:24<73:06:11,  7.97s/it]
 13%|█▎        | 4949/37963 [12:16:32<72:29:26,  7.90s/it]
 13%|█▎        | 4950/37963 [12:16:40<71:17:48,  7.77s/it]
                                                          
{'loss': '0.1815', 'grad_norm': '1.316', 'learning_rate': '1.948e-05', 'epoch': '0.1304'}
+
 13%|█▎        | 4950/37963 [12:16:40<71:17:48,  7.77s/it]
 13%|█▎        | 4951/37963 [12:16:47<71:20:06,  7.78s/it]
 13%|█▎        | 4952/37963 [12:17:02<91:07:34,  9.94s/it]
 13%|█▎        | 4953/37963 [12:17:10<84:54:33,  9.26s/it]
 13%|█▎        | 4954/37963 [12:17:18<80:39:23,  8.80s/it]
 13%|█▎        | 4955/37963 [12:17:25<77:01:25,  8.40s/it]
 13%|█▎        | 4956/37963 [12:17:33<74:58:30,  8.18s/it]
 13%|█▎        | 4957/37963 [12:17:41<73:49:01,  8.05s/it]
 13%|█▎        | 4958/37963 [12:17:55<91:26:51,  9.97s/it]
 13%|█▎        | 4959/37963 [12:18:03<85:41:53,  9.35s/it]
 13%|█▎        | 4960/37963 [12:18:10<80:46:14,  8.81s/it]
                                                          
{'loss': '0.1873', 'grad_norm': '1.674', 'learning_rate': '1.947e-05', 'epoch': '0.1307'}
+
 13%|█▎        | 4960/37963 [12:18:10<80:46:14,  8.81s/it]
 13%|█▎        | 4961/37963 [12:18:18<77:42:35,  8.48s/it]
 13%|█▎        | 4962/37963 [12:18:26<75:25:13,  8.23s/it]
 13%|█▎        | 4963/37963 [12:18:33<73:26:23,  8.01s/it]
 13%|█▎        | 4964/37963 [12:18:48<91:52:27, 10.02s/it]
 13%|█▎        | 4965/37963 [12:19:03<104:16:52, 11.38s/it]
 13%|█▎        | 4966/37963 [12:19:10<94:12:55, 10.28s/it] 
 13%|█▎        | 4967/37963 [12:19:18<87:05:17,  9.50s/it]
 13%|█▎        | 4968/37963 [12:19:26<82:04:02,  8.95s/it]
 13%|█▎        | 4969/37963 [12:19:33<78:34:17,  8.57s/it]
 13%|█▎        | 4970/37963 [12:19:41<75:49:54,  8.27s/it]
                                                          
{'loss': '0.1847', 'grad_norm': '5.038', 'learning_rate': '1.947e-05', 'epoch': '0.1309'}
+
 13%|█▎        | 4970/37963 [12:19:41<75:49:54,  8.27s/it]
 13%|█▎        | 4971/37963 [12:19:49<74:17:11,  8.11s/it]
 13%|█▎        | 4972/37963 [12:19:56<73:13:33,  7.99s/it]
 13%|█▎        | 4973/37963 [12:20:04<72:01:21,  7.86s/it]
 13%|���▎        | 4974/37963 [12:20:12<71:19:42,  7.78s/it]
 13%|█▎        | 4975/37963 [12:20:19<70:36:52,  7.71s/it]
 13%|█▎        | 4976/37963 [12:20:27<70:24:43,  7.68s/it]
 13%|█▎        | 4977/37963 [12:20:34<70:25:43,  7.69s/it]
 13%|█▎        | 4978/37963 [12:20:42<69:46:18,  7.61s/it]
 13%|█▎        | 4979/37963 [12:20:50<70:05:35,  7.65s/it]
 13%|█▎        | 4980/37963 [12:20:57<69:41:12,  7.61s/it]
                                                          
{'loss': '0.1898', 'grad_norm': '1.862', 'learning_rate': '1.947e-05', 'epoch': '0.1312'}
+
 13%|█▎        | 4980/37963 [12:20:57<69:41:12,  7.61s/it]
 13%|█▎        | 4981/37963 [12:21:05<69:45:24,  7.61s/it]
 13%|█▎        | 4982/37963 [12:21:19<87:15:37,  9.52s/it]
 13%|█▎        | 4983/37963 [12:21:26<82:08:10,  8.97s/it]
 13%|█▎        | 4984/37963 [12:21:34<78:36:31,  8.58s/it]
 13%|█▎        | 4985/37963 [12:21:42<76:07:08,  8.31s/it]
 13%|█▎        | 4986/37963 [12:21:49<73:56:07,  8.07s/it]
 13%|█▎        | 4987/37963 [12:21:57<71:46:19,  7.84s/it]
 13%|█▎        | 4988/37963 [12:22:04<71:13:54,  7.78s/it]
 13%|█▎        | 4989/37963 [12:22:12<71:06:47,  7.76s/it]
 13%|█▎        | 4990/37963 [12:22:27<90:22:36,  9.87s/it]
                                                          
{'loss': '0.1695', 'grad_norm': '3.226', 'learning_rate': '1.947e-05', 'epoch': '0.1314'}
+
 13%|█▎        | 4990/37963 [12:22:27<90:22:36,  9.87s/it]
 13%|█▎        | 4991/37963 [12:22:34<84:20:04,  9.21s/it]
 13%|█▎        | 4992/37963 [12:22:42<79:52:56,  8.72s/it]
 13%|█▎        | 4993/37963 [12:22:50<77:03:37,  8.41s/it]
 13%|█▎        | 4994/37963 [12:22:57<74:09:38,  8.10s/it]
 13%|█▎        | 4995/37963 [12:23:05<73:14:00,  8.00s/it]
 13%|█▎        | 4996/37963 [12:23:12<71:54:19,  7.85s/it]
 13%|█▎        | 4997/37963 [12:23:20<71:31:37,  7.81s/it]
 13%|█▎        | 4998/37963 [12:23:28<70:47:52,  7.73s/it]
 13%|█▎        | 4999/37963 [12:23:35<70:29:05,  7.70s/it]
 13%|█▎        | 5000/37963 [12:23:43<70:27:56,  7.70s/it]
                                                          
{'loss': '0.1736', 'grad_norm': '1.188', 'learning_rate': '1.946e-05', 'epoch': '0.1317'}
+
 13%|█▎        | 5000/37963 [12:23:43<70:27:56,  7.70s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.21s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.21s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 13%|█▎        | 5001/37963 [12:24:42<213:08:06, 23.28s/it]
 13%|█▎        | 5002/37963 [12:24:57<188:25:59, 20.58s/it]
 13%|█▎        | 5003/37963 [12:25:04<153:01:24, 16.71s/it]
 13%|█▎        | 5004/37963 [12:25:12<128:27:10, 14.03s/it]
 13%|█▎        | 5005/37963 [12:25:20<110:26:00, 12.06s/it]
 13%|█▎        | 5006/37963 [12:25:27<97:33:57, 10.66s/it] 
 13%|█▎        | 5007/37963 [12:25:35<89:11:33,  9.74s/it]
 13%|█▎        | 5008/37963 [12:25:42<83:29:02,  9.12s/it]
 13%|█▎        | 5009/37963 [12:25:57<97:48:50, 10.69s/it]
 13%|█▎        | 5010/37963 [12:26:04<89:45:09,  9.81s/it]
                                                          
{'loss': '0.1755', 'grad_norm': '2.858', 'learning_rate': '1.946e-05', 'epoch': '0.132'}
+
 13%|█▎        | 5010/37963 [12:26:04<89:45:09,  9.81s/it]
 13%|█▎        | 5011/37963 [12:26:12<83:49:33,  9.16s/it]
 13%|█▎        | 5012/37963 [12:26:34<117:44:07, 12.86s/it]
 13%|█▎        | 5013/37963 [12:26:41<103:34:08, 11.32s/it]
 13%|█▎        | 5014/37963 [12:26:56<113:57:35, 12.45s/it]
 13%|█▎        | 5015/37963 [12:27:04<100:31:27, 10.98s/it]
 13%|█▎        | 5016/37963 [12:27:12<91:15:46,  9.97s/it] 
 13%|█▎        | 5017/37963 [12:27:19<85:06:38,  9.30s/it]
 13%|█▎        | 5018/37963 [12:27:27<79:47:46,  8.72s/it]
 13%|█▎        | 5019/37963 [12:27:34<76:53:47,  8.40s/it]
 13%|█▎        | 5020/37963 [12:27:42<74:43:33,  8.17s/it]
                                                          
{'loss': '0.166', 'grad_norm': '2.196', 'learning_rate': '1.946e-05', 'epoch': '0.1322'}
+
 13%|█▎        | 5020/37963 [12:27:42<74:43:33,  8.17s/it]
 13%|█▎        | 5021/37963 [12:27:50<73:34:26,  8.04s/it]
 13%|█▎        | 5022/37963 [12:27:57<72:25:03,  7.91s/it]
 13%|█▎        | 5023/37963 [12:28:05<71:37:13,  7.83s/it]
 13%|█▎        | 5024/37963 [12:28:13<71:08:54,  7.78s/it]
 13%|█▎        | 5025/37963 [12:28:20<70:39:57,  7.72s/it]
 13%|█▎        | 5026/37963 [12:28:28<70:27:37,  7.70s/it]
 13%|█▎        | 5027/37963 [12:28:35<70:16:15,  7.68s/it]
 13%|█▎        | 5028/37963 [12:28:43<69:43:21,  7.62s/it]
 13%|█▎        | 5029/37963 [12:28:51<69:57:59,  7.65s/it]
 13%|█���        | 5030/37963 [12:29:05<87:49:13,  9.60s/it]
                                                          
{'loss': '0.1728', 'grad_norm': '3.824', 'learning_rate': '1.945e-05', 'epoch': '0.1325'}
+
 13%|█▎        | 5030/37963 [12:29:05<87:49:13,  9.60s/it]
 13%|█▎        | 5031/37963 [12:29:12<82:28:37,  9.02s/it]
 13%|█▎        | 5032/37963 [12:29:20<79:05:24,  8.65s/it]
 13%|█▎        | 5033/37963 [12:29:28<76:24:01,  8.35s/it]
 13%|█▎        | 5034/37963 [12:29:36<74:38:22,  8.16s/it]
 13%|█▎        | 5035/37963 [12:29:43<73:27:08,  8.03s/it]
 13%|█▎        | 5036/37963 [12:29:51<72:34:20,  7.93s/it]
 13%|█▎        | 5037/37963 [12:29:59<71:42:46,  7.84s/it]
 13%|█▎        | 5038/37963 [12:30:06<71:10:09,  7.78s/it]
 13%|█▎        | 5039/37963 [12:30:14<70:36:16,  7.72s/it]
 13%|█▎        | 5040/37963 [12:30:29<89:38:32,  9.80s/it]
                                                          
{'loss': '0.1811', 'grad_norm': '1.98', 'learning_rate': '1.945e-05', 'epoch': '0.1328'}
+
 13%|█▎        | 5040/37963 [12:30:29<89:38:32,  9.80s/it]
 13%|█▎        | 5041/37963 [12:30:36<84:03:37,  9.19s/it]
 13%|█▎        | 5042/37963 [12:30:44<79:01:25,  8.64s/it]
 13%|█▎        | 5043/37963 [12:30:51<76:26:52,  8.36s/it]
 13%|█▎        | 5044/37963 [12:30:59<74:30:01,  8.15s/it]
 13%|█▎        | 5045/37963 [12:31:06<72:27:16,  7.92s/it]
 13%|█▎        | 5046/37963 [12:31:14<71:28:55,  7.82s/it]
 13%|█▎        | 5047/37963 [12:31:21<70:08:51,  7.67s/it]
 13%|█▎        | 5048/37963 [12:31:35<87:49:25,  9.61s/it]
 13%|█▎        | 5049/37963 [12:31:51<103:31:20, 11.32s/it]
 13%|█▎        | 5050/37963 [12:31:58<93:33:20, 10.23s/it] 
                                                          
{'loss': '0.1861', 'grad_norm': '2.435', 'learning_rate': '1.945e-05', 'epoch': '0.133'}
+
 13%|█▎        | 5050/37963 [12:31:58<93:33:20, 10.23s/it]
 13%|█▎        | 5051/37963 [12:32:06<86:31:09,  9.46s/it]
 13%|█▎        | 5052/37963 [12:32:14<81:45:39,  8.94s/it]
 13%|█▎        | 5053/37963 [12:32:28<97:03:19, 10.62s/it]
 13%|█▎        | 5054/37963 [12:32:36<88:33:36,  9.69s/it]
 13%|█▎        | 5055/37963 [12:32:44<82:53:04,  9.07s/it]
 13%|█▎        | 5056/37963 [12:32:51<78:07:25,  8.55s/it]
 13%|█▎        | 5057/37963 [12:32:58<75:28:05,  8.26s/it]
 13%|█▎        | 5058/37963 [12:33:06<74:01:57,  8.10s/it]
 13%|█▎        | 5059/37963 [12:33:14<73:00:26,  7.99s/it]
 13%|█▎        | 5060/37963 [12:33:22<72:32:43,  7.94s/it]
                                                          
{'loss': '0.1689', 'grad_norm': '2.467', 'learning_rate': '1.945e-05', 'epoch': '0.1333'}
+
 13%|█▎        | 5060/37963 [12:33:22<72:32:43,  7.94s/it]
 13%|█▎        | 5061/37963 [12:33:36<91:12:34,  9.98s/it]
 13%|█▎        | 5062/37963 [12:33:44<84:54:24,  9.29s/it]
 13%|█▎        | 5063/37963 [12:33:52<80:30:13,  8.81s/it]
 13%|█▎        | 5064/37963 [12:34:06<95:55:03, 10.50s/it]
 13%|█▎        | 5065/37963 [12:34:14<88:29:31,  9.68s/it]
 13%|█▎        | 5066/37963 [12:34:22<82:48:24,  9.06s/it]
 13%|█▎        | 5067/37963 [12:34:29<78:52:20,  8.63s/it]
 13%|█▎        | 5068/37963 [12:34:44<95:55:45, 10.50s/it]
 13%|█▎        | 5069/37963 [12:34:52<88:14:38,  9.66s/it]
 13%|█▎        | 5070/37963 [12:35:00<82:50:20,  9.07s/it]
                                                          
{'loss': '0.1637', 'grad_norm': '2.611', 'learning_rate': '1.944e-05', 'epoch': '0.1336'}
+
 13%|█▎        | 5070/37963 [12:35:00<82:50:20,  9.07s/it]
 13%|█▎        | 5071/37963 [12:35:07<78:44:22,  8.62s/it]
 13%|█▎        | 5072/37963 [12:35:15<75:59:42,  8.32s/it]
 13%|█▎        | 5073/37963 [12:35:22<74:14:12,  8.13s/it]
 13%|█▎        | 5074/37963 [12:35:30<73:00:36,  7.99s/it]
 13%|█▎        | 5075/37963 [12:35:38<71:58:16,  7.88s/it]
 13%|█▎        | 5076/37963 [12:35:45<71:17:55,  7.80s/it]
 13%|█▎        | 5077/37963 [12:35:53<71:01:31,  7.78s/it]
 13%|█▎        | 5078/37963 [12:36:01<70:29:58,  7.72s/it]
 13%|█▎        | 5079/37963 [12:36:08<70:06:05,  7.67s/it]
 13%|█▎        | 5080/37963 [12:36:16<69:46:08,  7.64s/it]
                                                          
{'loss': '0.1805', 'grad_norm': '2.172', 'learning_rate': '1.944e-05', 'epoch': '0.1338'}
+
 13%|█▎        | 5080/37963 [12:36:16<69:46:08,  7.64s/it]
 13%|█▎        | 5081/37963 [12:36:23<69:00:17,  7.55s/it]
 13%|█▎        | 5082/37963 [12:36:31<69:10:42,  7.57s/it]
 13%|█▎        | 5083/37963 [12:36:45<87:01:57,  9.53s/it]
 13%|█▎        | 5084/37963 [12:37:00<101:16:08, 11.09s/it]
 13%|█▎        | 5085/37963 [12:37:07<91:49:07, 10.05s/it] 
 13%|█▎        | 5086/37963 [12:37:15<85:12:07,  9.33s/it]
 13%|█▎        | 5087/37963 [12:37:22<80:08:41,  8.78s/it]
 13%|█▎        | 5088/37963 [12:37:30<77:00:53,  8.43s/it]
 13%|█▎        | 5089/37963 [12:37:37<74:28:10,  8.16s/it]
 13%|█▎        | 5090/37963 [12:37:45<73:02:56,  8.00s/it]
                                                          
{'loss': '0.1652', 'grad_norm': '1.45', 'learning_rate': '1.944e-05', 'epoch': '0.1341'}
+
 13%|█▎        | 5090/37963 [12:37:45<73:02:56,  8.00s/it]
 13%|█▎        | 5091/37963 [12:37:53<71:47:15,  7.86s/it]
 13%|█▎        | 5092/37963 [12:38:00<71:10:41,  7.80s/it]
 13%|█▎        | 5093/37963 [12:38:08<70:53:47,  7.76s/it]
 13%|█▎        | 5094/37963 [12:38:16<70:40:31,  7.74s/it]
 13%|█▎        | 5095/37963 [12:38:31<90:24:51,  9.90s/it]
 13%|█▎        | 5096/37963 [12:38:45<102:43:20, 11.25s/it]
 13%|█▎        | 5097/37963 [12:38:59<110:06:03, 12.06s/it]
 13%|█▎        | 5098/37963 [12:39:07<98:07:04, 10.75s/it] 
 13%|█▎        | 5099/37963 [12:39:14<89:35:33,  9.81s/it]
 13%|█▎        | 5100/37963 [12:39:22<83:21:51,  9.13s/it]
                                                          
{'loss': '0.1692', 'grad_norm': '3.241', 'learning_rate': '1.943e-05', 'epoch': '0.1343'}
+
 13%|█▎        | 5100/37963 [12:39:22<83:21:51,  9.13s/it]
 13%|█▎        | 5101/37963 [12:39:29<79:10:41,  8.67s/it]
 13%|█▎        | 5102/37963 [12:39:37<76:31:01,  8.38s/it]
 13%|█▎        | 5103/37963 [12:39:45<74:33:40,  8.17s/it]
 13%|█▎        | 5104/37963 [12:39:52<73:10:35,  8.02s/it]
 13%|█▎        | 5105/37963 [12:40:00<72:39:58,  7.96s/it]
 13%|█▎        | 5106/37963 [12:40:08<71:59:15,  7.89s/it]
 13%|█▎        | 5107/37963 [12:40:15<70:48:54,  7.76s/it]
 13%|█▎        | 5108/37963 [12:40:30<89:27:01,  9.80s/it]
 13%|█▎        | 5109/37963 [12:40:38<83:48:36,  9.18s/it]
 13%|█▎        | 5110/37963 [12:40:45<79:02:03,  8.66s/it]
                                                          
{'loss': '0.183', 'grad_norm': '3.352', 'learning_rate': '1.943e-05', 'epoch': '0.1346'}
+
 13%|█▎        | 5110/37963 [12:40:45<79:02:03,  8.66s/it]
 13%|█▎        | 5111/37963 [12:40:53<76:43:11,  8.41s/it]
 13%|█▎        | 5112/37963 [12:41:01<74:41:57,  8.19s/it]
 13%|█▎        | 5113/37963 [12:41:08<72:50:11,  7.98s/it]
 13%|█▎        | 5114/37963 [12:41:16<71:59:13,  7.89s/it]
 13%|█▎        | 5115/37963 [12:41:23<71:18:34,  7.82s/it]
 13%|█▎        | 5116/37963 [12:41:31<70:41:29,  7.75s/it]
 13%|█▎        | 5117/37963 [12:41:39<70:11:51,  7.69s/it]
 13%|█▎        | 5118/37963 [12:41:53<87:59:48,  9.64s/it]
 13%|█▎        | 5119/37963 [12:42:01<82:40:26,  9.06s/it]
 13%|█▎        | 5120/37963 [12:42:08<77:47:56,  8.53s/it]
                                                          
{'loss': '0.1756', 'grad_norm': '5.333', 'learning_rate': '1.943e-05', 'epoch': '0.1349'}
+
 13%|█▎        | 5120/37963 [12:42:08<77:47:56,  8.53s/it]
 13%|█▎        | 5121/37963 [12:42:16<75:28:48,  8.27s/it]
 13%|█▎        | 5122/37963 [12:42:30<93:24:34, 10.24s/it]
 13%|█▎        | 5123/37963 [12:42:38<87:01:51,  9.54s/it]
 13%|█▎        | 5124/37963 [12:42:46<81:40:35,  8.95s/it]
 13%|█▎        | 5125/37963 [12:42:54<78:09:13,  8.57s/it]
 14%|█▎        | 5126/37963 [12:43:01<75:06:14,  8.23s/it]
 14%|█▎        | 5127/37963 [12:43:09<73:27:14,  8.05s/it]
 14%|█▎        | 5128/37963 [12:43:16<72:01:28,  7.90s/it]
 14%|█▎        | 5129/37963 [12:43:24<71:29:49,  7.84s/it]
 14%|█▎        | 5130/37963 [12:43:31<70:33:29,  7.74s/it]
                                                          
{'loss': '0.1713', 'grad_norm': '2.954', 'learning_rate': '1.943e-05', 'epoch': '0.1351'}
+
 14%|█▎        | 5130/37963 [12:43:31<70:33:29,  7.74s/it]
 14%|█▎        | 5131/37963 [12:43:46<90:00:47,  9.87s/it]
 14%|█▎        | 5132/37963 [12:44:00<101:47:48, 11.16s/it]
 14%|█▎        | 5133/37963 [12:44:08<92:12:16, 10.11s/it] 
 14%|█▎        | 5134/37963 [12:44:16<85:27:20,  9.37s/it]
 14%|█▎        | 5135/37963 [12:44:23<80:45:27,  8.86s/it]
 14%|█▎        | 5136/37963 [12:44:31<77:29:14,  8.50s/it]
 14%|█▎        | 5137/37963 [12:44:39<75:34:10,  8.29s/it]
 14%|█▎        | 5138/37963 [12:44:46<73:44:32,  8.09s/it]
 14%|█▎        | 5139/37963 [12:44:54<71:56:55,  7.89s/it]
 14%|█▎        | 5140/37963 [12:45:01<71:13:15,  7.81s/it]
                                                          
{'loss': '0.1797', 'grad_norm': '1.885', 'learning_rate': '1.942e-05', 'epoch': '0.1354'}
+
 14%|█▎        | 5140/37963 [12:45:01<71:13:15,  7.81s/it]
 14%|█▎        | 5141/37963 [12:45:09<70:43:51,  7.76s/it]
 14%|█▎        | 5142/37963 [12:45:17<70:36:25,  7.74s/it]
 14%|█▎        | 5143/37963 [12:45:24<70:24:08,  7.72s/it]
 14%|█▎        | 5144/37963 [12:45:32<70:30:06,  7.73s/it]
 14%|█▎        | 5145/37963 [12:45:40<70:27:31,  7.73s/it]
 14%|█▎        | 5146/37963 [12:45:54<87:43:06,  9.62s/it]
 14%|█▎        | 5147/37963 [12:46:08<99:53:57, 10.96s/it]
 14%|█▎        | 5148/37963 [12:46:23<111:18:24, 12.21s/it]
 14%|█▎        | 5149/37963 [12:46:31<99:40:03, 10.93s/it] 
 14%|█▎        | 5150/37963 [12:46:39<90:38:23,  9.94s/it]
                                                          
{'loss': '0.1733', 'grad_norm': '1.84', 'learning_rate': '1.942e-05', 'epoch': '0.1357'}
+
 14%|█▎        | 5150/37963 [12:46:39<90:38:23,  9.94s/it]
 14%|█▎        | 5151/37963 [12:46:46<84:16:43,  9.25s/it]
 14%|█▎        | 5152/37963 [12:46:54<79:52:44,  8.76s/it]
 14%|█▎        | 5153/37963 [12:47:02<76:51:53,  8.43s/it]
 14%|█▎        | 5154/37963 [12:47:09<74:54:50,  8.22s/it]
 14%|█▎        | 5155/37963 [12:47:17<73:23:45,  8.05s/it]
 14%|█▎        | 5156/37963 [12:47:25<72:16:39,  7.93s/it]
 14%|█▎        | 5157/37963 [12:47:40<91:09:11, 10.00s/it]
 14%|█▎        | 5158/37963 [12:47:47<85:02:31,  9.33s/it]
 14%|█▎        | 5159/37963 [12:47:55<80:45:27,  8.86s/it]
 14%|█▎        | 5160/37963 [12:48:03<77:09:15,  8.47s/it]
                                                          
{'loss': '0.1688', 'grad_norm': '1.525', 'learning_rate': '1.942e-05', 'epoch': '0.1359'}
+
 14%|█▎        | 5160/37963 [12:48:03<77:09:15,  8.47s/it]
 14%|█▎        | 5161/37963 [12:48:10<74:54:58,  8.22s/it]
 14%|█▎        | 5162/37963 [12:48:18<73:21:28,  8.05s/it]
 14%|█▎        | 5163/37963 [12:48:26<72:07:01,  7.92s/it]
 14%|█▎        | 5164/37963 [12:48:33<70:54:19,  7.78s/it]
 14%|█▎        | 5165/37963 [12:48:41<70:21:46,  7.72s/it]
 14%|█▎        | 5166/37963 [12:48:48<69:55:21,  7.68s/it]
 14%|█▎        | 5167/37963 [12:48:56<69:28:14,  7.63s/it]
 14%|█▎        | 5168/37963 [12:49:03<69:41:07,  7.65s/it]
 14%|█▎        | 5169/37963 [12:49:11<68:58:11,  7.57s/it]
 14%|█▎        | 5170/37963 [12:49:19<69:35:31,  7.64s/it]
                                                          
{'loss': '0.1832', 'grad_norm': '2.544', 'learning_rate': '1.941e-05', 'epoch': '0.1362'}
+
 14%|█▎        | 5170/37963 [12:49:19<69:35:31,  7.64s/it]
 14%|█▎        | 5171/37963 [12:49:26<69:39:22,  7.65s/it]
 14%|█▎        | 5172/37963 [12:49:40<87:16:45,  9.58s/it]
 14%|█▎        | 5173/37963 [12:49:48<82:20:54,  9.04s/it]
 14%|█▎        | 5174/37963 [12:49:56<78:38:32,  8.63s/it]
 14%|█▎        | 5175/37963 [12:50:11<95:48:17, 10.52s/it]
 14%|█▎        | 5176/37963 [12:50:18<88:11:25,  9.68s/it]
 14%|█▎        | 5177/37963 [12:50:26<82:26:39,  9.05s/it]
 14%|█▎        | 5178/37963 [12:50:34<78:42:26,  8.64s/it]
 14%|█▎        | 5179/37963 [12:50:49<95:56:10, 10.53s/it]
 14%|█▎        | 5180/37963 [12:50:56<87:55:16,  9.65s/it]
                                                          
{'loss': '0.1678', 'grad_norm': '2.818', 'learning_rate': '1.941e-05', 'epoch': '0.1364'}
+
 14%|█▎        | 5180/37963 [12:50:56<87:55:16,  9.65s/it]
 14%|█▎        | 5181/37963 [12:51:11<100:28:12, 11.03s/it]
 14%|█▎        | 5182/37963 [12:51:18<91:30:42, 10.05s/it] 
 14%|█▎        | 5183/37963 [12:51:26<84:48:54,  9.31s/it]
 14%|█▎        | 5184/37963 [12:51:34<80:18:55,  8.82s/it]
 14%|█▎        | 5185/37963 [12:51:41<76:53:06,  8.44s/it]
 14%|█▎        | 5186/37963 [12:51:49<74:39:37,  8.20s/it]
 14%|█▎        | 5187/37963 [12:51:56<73:25:26,  8.06s/it]
 14%|█▎        | 5188/37963 [12:52:04<72:21:14,  7.95s/it]
 14%|█▎        | 5189/37963 [12:52:12<71:26:32,  7.85s/it]
 14%|█▎        | 5190/37963 [12:52:19<70:57:18,  7.79s/it]
                                                          
{'loss': '0.1702', 'grad_norm': '1.406', 'learning_rate': '1.941e-05', 'epoch': '0.1367'}
+
 14%|█▎        | 5190/37963 [12:52:19<70:57:18,  7.79s/it]
 14%|█▎        | 5191/37963 [12:52:33<87:44:43,  9.64s/it]
 14%|█▎        | 5192/37963 [12:52:48<102:09:32, 11.22s/it]
 14%|█▎        | 5193/37963 [12:52:56<92:32:39, 10.17s/it] 
 14%|█▎        | 5194/37963 [12:53:10<103:33:02, 11.38s/it]
 14%|█▎        | 5195/37963 [12:53:18<93:29:15, 10.27s/it] 
 14%|█▎        | 5196/37963 [12:53:25<86:05:20,  9.46s/it]
 14%|█▎        | 5197/37963 [12:53:33<81:04:53,  8.91s/it]
 14%|█▎        | 5198/37963 [12:53:41<77:34:15,  8.52s/it]
 14%|█▎        | 5199/37963 [12:53:48<75:07:00,  8.25s/it]
 14%|█▎        | 5200/37963 [12:53:56<73:31:37,  8.08s/it]
                                                          
{'loss': '0.1754', 'grad_norm': '2.749', 'learning_rate': '1.941e-05', 'epoch': '0.137'}
+
 14%|█▎        | 5200/37963 [12:53:56<73:31:37,  8.08s/it]
 14%|█▎        | 5201/37963 [12:54:10<90:49:58,  9.98s/it]
 14%|█▎        | 5202/37963 [12:54:18<85:03:49,  9.35s/it]
 14%|█▎        | 5203/37963 [12:54:26<79:45:27,  8.76s/it]
 14%|█▎        | 5204/37963 [12:54:33<76:42:02,  8.43s/it]
 14%|█▎        | 5205/37963 [12:54:41<74:38:30,  8.20s/it]
 14%|█▎        | 5206/37963 [12:54:49<73:24:36,  8.07s/it]
 14%|█▎        | 5207/37963 [12:54:56<71:52:19,  7.90s/it]
 14%|█▎        | 5208/37963 [12:55:04<71:13:02,  7.83s/it]
 14%|█▎        | 5209/37963 [12:55:11<70:27:22,  7.74s/it]
 14%|█▎        | 5210/37963 [12:55:19<70:19:41,  7.73s/it]
                                                          
{'loss': '0.1788', 'grad_norm': '8.529', 'learning_rate': '1.94e-05', 'epoch': '0.1372'}
+
 14%|█▎        | 5210/37963 [12:55:19<70:19:41,  7.73s/it]
 14%|█▎        | 5211/37963 [12:55:27<70:20:13,  7.73s/it]
 14%|█▎        | 5212/37963 [12:55:35<70:05:01,  7.70s/it]
 14%|█▎        | 5213/37963 [12:55:42<70:02:21,  7.70s/it]
 14%|█▎        | 5214/37963 [12:55:50<69:26:29,  7.63s/it]
 14%|█▎        | 5215/37963 [12:55:57<69:25:22,  7.63s/it]
 14%|█▎        | 5216/37963 [12:56:05<69:38:44,  7.66s/it]
 14%|█▎        | 5217/37963 [12:56:13<69:44:05,  7.67s/it]
 14%|█▎        | 5218/37963 [12:56:27<88:22:07,  9.72s/it]
 14%|█▎        | 5219/37963 [12:56:35<82:43:16,  9.09s/it]
 14%|█▍        | 5220/37963 [12:56:42<78:15:12,  8.60s/it]
                                                          
{'loss': '0.1795', 'grad_norm': '1.817', 'learning_rate': '1.94e-05', 'epoch': '0.1375'}
+
 14%|█▍        | 5220/37963 [12:56:42<78:15:12,  8.60s/it]
 14%|█▍        | 5221/37963 [12:56:50<76:49:04,  8.45s/it]
 14%|█▍        | 5222/37963 [12:56:58<75:12:05,  8.27s/it]
 14%|█▍        | 5223/37963 [12:57:06<72:46:44,  8.00s/it]
 14%|█▍        | 5224/37963 [12:57:13<71:52:46,  7.90s/it]
 14%|█▍        | 5225/37963 [12:57:21<71:25:23,  7.85s/it]
 14%|█▍        | 5226/37963 [12:57:36<90:24:14,  9.94s/it]
 14%|█▍        | 5227/37963 [12:57:51<104:21:19, 11.48s/it]
 14%|█▍        | 5228/37963 [12:57:59<93:52:39, 10.32s/it] 
 14%|█▍        | 5229/37963 [12:58:13<104:51:46, 11.53s/it]
 14%|█▍        | 5230/37963 [12:58:21<94:33:12, 10.40s/it] 
                                                          
{'loss': '0.1813', 'grad_norm': '1.303', 'learning_rate': '1.94e-05', 'epoch': '0.1378'}
+
 14%|█▍        | 5230/37963 [12:58:21<94:33:12, 10.40s/it]
 14%|█▍        | 5231/37963 [12:58:28<87:00:35,  9.57s/it]
 14%|█▍        | 5232/37963 [12:58:36<81:44:09,  8.99s/it]
 14%|█▍        | 5233/37963 [12:58:44<78:01:15,  8.58s/it]
 14%|█▍        | 5234/37963 [12:58:51<75:35:23,  8.31s/it]
 14%|█▍        | 5235/37963 [12:58:59<73:57:24,  8.14s/it]
 14%|█▍        | 5236/37963 [12:59:06<71:48:02,  7.90s/it]
 14%|█▍        | 5237/37963 [12:59:14<71:06:07,  7.82s/it]
 14%|█▍        | 5238/37963 [12:59:22<70:50:01,  7.79s/it]
 14%|█▍        | 5239/37963 [12:59:36<88:08:43,  9.70s/it]
 14%|█▍        | 5240/37963 [12:59:43<82:26:05,  9.07s/it]
                                                          
{'loss': '0.1717', 'grad_norm': '2.274', 'learning_rate': '1.939e-05', 'epoch': '0.138'}
+
 14%|█▍        | 5240/37963 [12:59:43<82:26:05,  9.07s/it]
 14%|█▍        | 5241/37963 [12:59:51<78:44:18,  8.66s/it]
 14%|█▍        | 5242/37963 [12:59:59<76:19:31,  8.40s/it]
 14%|█▍        | 5243/37963 [13:00:13<91:45:51, 10.10s/it]
 14%|█▍        | 5244/37963 [13:00:21<85:40:27,  9.43s/it]
 14%|█▍        | 5245/37963 [13:00:29<80:45:36,  8.89s/it]
 14%|█▍        | 5246/37963 [13:00:44<98:18:33, 10.82s/it]
 14%|█▍        | 5247/37963 [13:00:52<90:06:01,  9.91s/it]
 14%|█▍        | 5248/37963 [13:00:59<83:37:36,  9.20s/it]
 14%|█▍        | 5249/37963 [13:01:14<100:14:28, 11.03s/it]
 14%|█▍        | 5250/37963 [13:01:22<91:27:13, 10.06s/it] 
                                                          
{'loss': '0.1747', 'grad_norm': '1.659', 'learning_rate': '1.939e-05', 'epoch': '0.1383'}
+
 14%|█▍        | 5250/37963 [13:01:22<91:27:13, 10.06s/it]
 14%|█▍        | 5251/37963 [13:01:30<84:48:45,  9.33s/it]
 14%|█▍        | 5252/37963 [13:01:37<79:57:11,  8.80s/it]
 14%|█▍        | 5253/37963 [13:01:45<76:53:20,  8.46s/it]
 14%|█▍        | 5254/37963 [13:01:53<74:46:25,  8.23s/it]
 14%|█▍        | 5255/37963 [13:02:00<73:10:15,  8.05s/it]
 14%|█▍        | 5256/37963 [13:02:08<72:19:04,  7.96s/it]
 14%|█▍        | 5257/37963 [13:02:16<71:02:52,  7.82s/it]
 14%|█▍        | 5258/37963 [13:02:23<70:48:25,  7.79s/it]
 14%|█▍        | 5259/37963 [13:02:31<70:31:08,  7.76s/it]
 14%|█▍        | 5260/37963 [13:02:39<70:11:03,  7.73s/it]
                                                          
{'loss': '0.1848', 'grad_norm': '2.837', 'learning_rate': '1.939e-05', 'epoch': '0.1386'}
+
 14%|█▍        | 5260/37963 [13:02:39<70:11:03,  7.73s/it]
 14%|█▍        | 5261/37963 [13:02:53<87:47:27,  9.66s/it]
 14%|█▍        | 5262/37963 [13:03:01<82:12:10,  9.05s/it]
 14%|█▍        | 5263/37963 [13:03:08<78:24:38,  8.63s/it]
 14%|█▍        | 5264/37963 [13:03:16<75:45:02,  8.34s/it]
 14%|█▍        | 5265/37963 [13:03:23<73:22:55,  8.08s/it]
 14%|█▍        | 5266/37963 [13:03:31<72:06:06,  7.94s/it]
 14%|█▍        | 5267/37963 [13:03:39<71:22:50,  7.86s/it]
 14%|█▍        | 5268/37963 [13:03:46<70:59:41,  7.82s/it]
 14%|█▍        | 5269/37963 [13:03:54<70:39:38,  7.78s/it]
 14%|█▍        | 5270/37963 [13:04:01<69:43:13,  7.68s/it]
                                                          
{'loss': '0.177', 'grad_norm': '2.36', 'learning_rate': '1.939e-05', 'epoch': '0.1388'}
+
 14%|█▍        | 5270/37963 [13:04:01<69:43:13,  7.68s/it]
 14%|█▍        | 5271/37963 [13:04:09<69:42:54,  7.68s/it]
 14%|█▍        | 5272/37963 [13:04:17<70:03:27,  7.71s/it]
 14%|█▍        | 5273/37963 [13:04:32<89:01:12,  9.80s/it]
 14%|█▍        | 5274/37963 [13:04:47<103:32:20, 11.40s/it]
 14%|█▍        | 5275/37963 [13:04:55<93:54:26, 10.34s/it] 
 14%|█▍        | 5276/37963 [13:05:02<86:41:19,  9.55s/it]
 14%|█▍        | 5277/37963 [13:05:10<81:35:59,  8.99s/it]
 14%|█▍        | 5278/37963 [13:05:17<77:11:01,  8.50s/it]
 14%|█▍        | 5279/37963 [13:05:25<75:01:39,  8.26s/it]
 14%|█▍        | 5280/37963 [13:05:40<92:43:36, 10.21s/it]
                                                          
{'loss': '0.1664', 'grad_norm': '1.568', 'learning_rate': '1.938e-05', 'epoch': '0.1391'}
+
 14%|█▍        | 5280/37963 [13:05:40<92:43:36, 10.21s/it]
 14%|█▍        | 5281/37963 [13:05:48<85:58:42,  9.47s/it]
 14%|█▍        | 5282/37963 [13:05:55<81:05:57,  8.93s/it]
 14%|█▍        | 5283/37963 [13:06:10<95:37:28, 10.53s/it]
 14%|█▍        | 5284/37963 [13:06:17<88:21:45,  9.73s/it]
 14%|█▍        | 5285/37963 [13:06:25<82:56:11,  9.14s/it]
 14%|█▍        | 5286/37963 [13:06:33<78:55:18,  8.69s/it]
 14%|█▍        | 5287/37963 [13:06:40<75:48:57,  8.35s/it]
 14%|█▍        | 5288/37963 [13:06:48<73:40:35,  8.12s/it]
 14%|█▍        | 5289/37963 [13:06:56<72:24:15,  7.98s/it]
 14%|█▍        | 5290/37963 [13:07:03<71:28:37,  7.88s/it]
                                                          
{'loss': '0.1641', 'grad_norm': '2.433', 'learning_rate': '1.938e-05', 'epoch': '0.1393'}
+
 14%|█▍        | 5290/37963 [13:07:03<71:28:37,  7.88s/it]
 14%|█▍        | 5291/37963 [13:07:11<70:57:41,  7.82s/it]
 14%|█▍        | 5292/37963 [13:07:19<70:47:22,  7.80s/it]
 14%|█▍        | 5293/37963 [13:07:26<70:40:03,  7.79s/it]
 14%|█▍        | 5294/37963 [13:07:34<70:19:05,  7.75s/it]
 14%|█▍        | 5295/37963 [13:07:42<70:19:47,  7.75s/it]
 14%|█▍        | 5296/37963 [13:07:50<70:39:09,  7.79s/it]
 14%|█▍        | 5297/37963 [13:08:12<109:04:13, 12.02s/it]
 14%|█▍        | 5298/37963 [13:08:19<97:43:18, 10.77s/it] 
 14%|█▍        | 5299/37963 [13:08:34<108:40:26, 11.98s/it]
 14%|█▍        | 5300/37963 [13:08:42<97:08:20, 10.71s/it] 
                                                          
{'loss': '0.1666', 'grad_norm': '2.818', 'learning_rate': '1.938e-05', 'epoch': '0.1396'}
+
 14%|█▍        | 5300/37963 [13:08:42<97:08:20, 10.71s/it]
 14%|█▍        | 5301/37963 [13:08:49<88:11:06,  9.72s/it]
 14%|█▍        | 5302/37963 [13:08:57<82:29:03,  9.09s/it]
 14%|█▍        | 5303/37963 [13:09:05<78:26:10,  8.65s/it]
 14%|█▍        | 5304/37963 [13:09:12<76:05:59,  8.39s/it]
 14%|█▍        | 5305/37963 [13:09:20<74:02:44,  8.16s/it]
 14%|█▍        | 5306/37963 [13:09:28<72:46:11,  8.02s/it]
 14%|█▍        | 5307/37963 [13:09:35<71:48:04,  7.92s/it]
 14%|█▍        | 5308/37963 [13:09:50<88:47:44,  9.79s/it]
 14%|█▍        | 5309/37963 [13:09:57<82:52:31,  9.14s/it]
 14%|█▍        | 5310/37963 [13:10:05<79:03:26,  8.72s/it]
                                                          
{'loss': '0.1727', 'grad_norm': '2.18', 'learning_rate': '1.937e-05', 'epoch': '0.1399'}
+
 14%|█▍        | 5310/37963 [13:10:05<79:03:26,  8.72s/it]
 14%|█▍        | 5311/37963 [13:10:13<76:25:59,  8.43s/it]
 14%|█▍        | 5312/37963 [13:10:20<74:23:33,  8.20s/it]
 14%|█▍        | 5313/37963 [13:10:28<72:53:14,  8.04s/it]
 14%|█▍        | 5314/37963 [13:10:36<71:38:41,  7.90s/it]
 14%|█▍        | 5315/37963 [13:10:43<70:58:32,  7.83s/it]
 14%|█▍        | 5316/37963 [13:10:51<70:38:57,  7.79s/it]
 14%|█▍        | 5317/37963 [13:11:06<89:01:06,  9.82s/it]
 14%|█▍        | 5318/37963 [13:11:13<83:06:26,  9.16s/it]
 14%|█▍        | 5319/37963 [13:11:21<79:23:26,  8.76s/it]
 14%|█▍        | 5320/37963 [13:11:29<76:29:48,  8.44s/it]
                                                          
{'loss': '0.1758', 'grad_norm': '4.081', 'learning_rate': '1.937e-05', 'epoch': '0.1401'}
+
 14%|█▍        | 5320/37963 [13:11:29<76:29:48,  8.44s/it]
 14%|█▍        | 5321/37963 [13:11:43<93:24:08, 10.30s/it]
 14%|█▍        | 5322/37963 [13:11:51<86:46:19,  9.57s/it]
 14%|█▍        | 5323/37963 [13:11:59<81:30:09,  8.99s/it]
 14%|█▍        | 5324/37963 [13:12:06<77:56:53,  8.60s/it]
 14%|█▍        | 5325/37963 [13:12:14<74:23:41,  8.21s/it]
 14%|█▍        | 5326/37963 [13:12:21<73:01:26,  8.05s/it]
 14%|█▍        | 5327/37963 [13:12:35<88:41:59,  9.78s/it]
 14%|█▍        | 5328/37963 [13:12:43<83:04:26,  9.16s/it]
 14%|█▍        | 5329/37963 [13:12:58<98:47:16, 10.90s/it]
 14%|█▍        | 5330/37963 [13:13:06<90:00:04,  9.93s/it]
                                                          
{'loss': '0.1824', 'grad_norm': '4.065', 'learning_rate': '1.937e-05', 'epoch': '0.1404'}
+
 14%|█▍        | 5330/37963 [13:13:06<90:00:04,  9.93s/it]
 14%|█▍        | 5331/37963 [13:13:13<83:53:39,  9.26s/it]
 14%|█▍        | 5332/37963 [13:13:21<79:41:20,  8.79s/it]
 14%|█▍        | 5333/37963 [13:13:29<76:31:28,  8.44s/it]
 14%|█▍        | 5334/37963 [13:13:36<74:41:25,  8.24s/it]
 14%|█▍        | 5335/37963 [13:13:44<73:02:47,  8.06s/it]
 14%|█▍        | 5336/37963 [13:13:52<72:04:15,  7.95s/it]
 14%|█▍        | 5337/37963 [13:13:59<71:20:16,  7.87s/it]
 14%|█▍        | 5338/37963 [13:14:07<70:40:51,  7.80s/it]
 14%|█▍        | 5339/37963 [13:14:15<70:12:57,  7.75s/it]
 14%|█▍        | 5340/37963 [13:14:22<69:50:50,  7.71s/it]
                                                          
{'loss': '0.1749', 'grad_norm': '2.86', 'learning_rate': '1.936e-05', 'epoch': '0.1407'}
+
 14%|█▍        | 5340/37963 [13:14:22<69:50:50,  7.71s/it]
 14%|█▍        | 5341/37963 [13:14:30<69:36:51,  7.68s/it]
 14%|█▍        | 5342/37963 [13:14:38<69:36:41,  7.68s/it]
 14%|█▍        | 5343/37963 [13:14:52<87:31:25,  9.66s/it]
 14%|█▍        | 5344/37963 [13:15:00<82:33:27,  9.11s/it]
 14%|█▍        | 5345/37963 [13:15:07<78:42:45,  8.69s/it]
 14%|█▍        | 5346/37963 [13:15:15<75:51:11,  8.37s/it]
 14%|█▍        | 5347/37963 [13:15:23<73:50:33,  8.15s/it]
 14%|█▍        | 5348/37963 [13:15:30<72:29:21,  8.00s/it]
 14%|█▍        | 5349/37963 [13:15:44<89:08:53,  9.84s/it]
 14%|█▍        | 5350/37963 [13:15:52<82:41:04,  9.13s/it]
                                                          
{'loss': '0.166', 'grad_norm': '2.257', 'learning_rate': '1.936e-05', 'epoch': '0.1409'}
+
 14%|█▍        | 5350/37963 [13:15:52<82:41:04,  9.13s/it]
 14%|█▍        | 5351/37963 [13:16:06<97:11:34, 10.73s/it]
 14%|█▍        | 5352/37963 [13:16:14<88:57:12,  9.82s/it]
 14%|█▍        | 5353/37963 [13:16:22<83:13:26,  9.19s/it]
 14%|█▍        | 5354/37963 [13:16:29<78:34:29,  8.67s/it]
 14%|█▍        | 5355/37963 [13:16:37<75:02:17,  8.28s/it]
 14%|█▍        | 5356/37963 [13:16:44<72:12:57,  7.97s/it]
 14%|█▍        | 5357/37963 [13:16:51<70:40:57,  7.80s/it]
 14%|█▍        | 5358/37963 [13:16:59<70:14:03,  7.75s/it]
 14%|█▍        | 5359/37963 [13:17:07<70:06:05,  7.74s/it]
 14%|█▍        | 5360/37963 [13:17:21<87:21:36,  9.65s/it]
                                                          
{'loss': '0.1715', 'grad_norm': '1.958', 'learning_rate': '1.936e-05', 'epoch': '0.1412'}
+
 14%|█▍        | 5360/37963 [13:17:21<87:21:36,  9.65s/it]
 14%|█▍        | 5361/37963 [13:17:28<82:06:32,  9.07s/it]
 14%|█▍        | 5362/37963 [13:17:36<78:22:25,  8.65s/it]
 14%|█▍        | 5363/37963 [13:17:44<75:56:59,  8.39s/it]
 14%|█▍        | 5364/37963 [13:17:58<92:13:54, 10.19s/it]
 14%|█▍        | 5365/37963 [13:18:06<85:24:06,  9.43s/it]
 14%|█▍        | 5366/37963 [13:18:13<80:01:24,  8.84s/it]
 14%|█▍        | 5367/37963 [13:18:21<76:55:32,  8.50s/it]
 14%|█▍        | 5368/37963 [13:18:29<74:32:54,  8.23s/it]
 14%|█▍        | 5369/37963 [13:18:36<72:36:44,  8.02s/it]
 14%|█▍        | 5370/37963 [13:18:51<91:29:26, 10.11s/it]
                                                          
{'loss': '0.166', 'grad_norm': '3.15', 'learning_rate': '1.936e-05', 'epoch': '0.1415'}
+
 14%|█▍        | 5370/37963 [13:18:51<91:29:26, 10.11s/it]
 14%|█▍        | 5371/37963 [13:18:59<84:58:25,  9.39s/it]
 14%|█▍        | 5372/37963 [13:19:13<97:04:47, 10.72s/it]
 14%|█▍        | 5373/37963 [13:19:21<88:52:44,  9.82s/it]
 14%|█▍        | 5374/37963 [13:19:28<81:56:58,  9.05s/it]
 14%|█▍        | 5375/37963 [13:19:35<78:12:06,  8.64s/it]
 14%|█▍        | 5376/37963 [13:19:43<73:54:58,  8.17s/it]
 14%|█▍        | 5377/37963 [13:19:50<72:36:16,  8.02s/it]
 14%|█▍        | 5378/37963 [13:19:58<71:10:06,  7.86s/it]
 14%|█▍        | 5379/37963 [13:20:05<70:36:38,  7.80s/it]
 14%|█▍        | 5380/37963 [13:20:13<69:24:37,  7.67s/it]
                                                          
{'loss': '0.1593', 'grad_norm': '1.986', 'learning_rate': '1.935e-05', 'epoch': '0.1417'}
+
 14%|█▍        | 5380/37963 [13:20:13<69:24:37,  7.67s/it]
 14%|█▍        | 5381/37963 [13:20:27<87:52:49,  9.71s/it]
 14%|█▍        | 5382/37963 [13:20:35<82:34:57,  9.12s/it]
 14%|█▍        | 5383/37963 [13:20:43<78:31:28,  8.68s/it]
 14%|█▍        | 5384/37963 [13:20:50<76:06:29,  8.41s/it]
 14%|█▍        | 5385/37963 [13:20:58<73:55:53,  8.17s/it]
 14%|█▍        | 5386/37963 [13:21:06<72:32:28,  8.02s/it]
 14%|█▍        | 5387/37963 [13:21:13<72:04:43,  7.97s/it]
 14%|█▍        | 5388/37963 [13:21:21<71:19:44,  7.88s/it]
 14%|█▍        | 5389/37963 [13:21:29<71:02:38,  7.85s/it]
 14%|█▍        | 5390/37963 [13:21:37<70:23:10,  7.78s/it]
                                                          
{'loss': '0.1791', 'grad_norm': '2.566', 'learning_rate': '1.935e-05', 'epoch': '0.142'}
+
 14%|█▍        | 5390/37963 [13:21:37<70:23:10,  7.78s/it]
 14%|█▍        | 5391/37963 [13:21:44<70:11:12,  7.76s/it]
 14%|█▍        | 5392/37963 [13:21:52<69:57:56,  7.73s/it]
 14%|█▍        | 5393/37963 [13:22:00<69:56:35,  7.73s/it]
 14%|█▍        | 5394/37963 [13:22:07<69:41:33,  7.70s/it]
 14%|█▍        | 5395/37963 [13:22:22<89:44:17,  9.92s/it]
 14%|█▍        | 5396/37963 [13:22:37<101:25:51, 11.21s/it]
 14%|█▍        | 5397/37963 [13:22:44<91:51:46, 10.15s/it] 
 14%|█▍        | 5398/37963 [13:22:52<85:09:20,  9.41s/it]
 14%|█▍        | 5399/37963 [13:22:59<79:38:53,  8.81s/it]
 14%|█▍        | 5400/37963 [13:23:07<75:34:01,  8.35s/it]
                                                          
{'loss': '0.1701', 'grad_norm': '2.432', 'learning_rate': '1.935e-05', 'epoch': '0.1422'}
+
 14%|█▍        | 5400/37963 [13:23:07<75:34:01,  8.35s/it]
 14%|█▍        | 5401/37963 [13:23:14<73:31:50,  8.13s/it]
 14%|█▍        | 5402/37963 [13:23:22<71:47:23,  7.94s/it]
 14%|█▍        | 5403/37963 [13:23:29<70:32:00,  7.80s/it]
 14%|█▍        | 5404/37963 [13:23:37<70:04:48,  7.75s/it]
 14%|█▍        | 5405/37963 [13:23:52<89:20:37,  9.88s/it]
 14%|█▍        | 5406/37963 [13:24:00<83:52:21,  9.27s/it]
 14%|█▍        | 5407/37963 [13:24:07<79:21:17,  8.77s/it]
 14%|█▍        | 5408/37963 [13:24:22<94:51:08, 10.49s/it]
 14%|█▍        | 5409/37963 [13:24:30<87:43:51,  9.70s/it]
 14%|█▍        | 5410/37963 [13:24:37<82:12:30,  9.09s/it]
                                                          
{'loss': '0.1629', 'grad_norm': '5.331', 'learning_rate': '1.934e-05', 'epoch': '0.1425'}
+
 14%|█▍        | 5410/37963 [13:24:37<82:12:30,  9.09s/it]
 14%|█▍        | 5411/37963 [13:24:45<78:15:03,  8.65s/it]
 14%|█▍        | 5412/37963 [13:24:52<75:25:29,  8.34s/it]
 14%|█▍        | 5413/37963 [13:25:00<73:33:22,  8.14s/it]
 14%|█▍        | 5414/37963 [13:25:14<90:12:26,  9.98s/it]
 14%|█▍        | 5415/37963 [13:25:29<101:50:07, 11.26s/it]
 14%|█▍        | 5416/37963 [13:25:37<92:48:22, 10.27s/it] 
 14%|█▍        | 5417/37963 [13:25:44<85:44:05,  9.48s/it]
 14%|█▍        | 5418/37963 [13:25:59<100:02:22, 11.07s/it]
 14%|█▍        | 5419/37963 [13:26:07<90:42:22, 10.03s/it] 
 14%|█▍        | 5420/37963 [13:26:14<83:59:44,  9.29s/it]
                                                          
{'loss': '0.1759', 'grad_norm': '3.353', 'learning_rate': '1.934e-05', 'epoch': '0.1428'}
+
 14%|█▍        | 5420/37963 [13:26:14<83:59:44,  9.29s/it]
 14%|█▍        | 5421/37963 [13:26:22<79:07:06,  8.75s/it]
 14%|█▍        | 5422/37963 [13:26:29<76:13:22,  8.43s/it]
 14%|█▍        | 5423/37963 [13:26:37<74:17:27,  8.22s/it]
 14%|█▍        | 5424/37963 [13:26:45<72:34:58,  8.03s/it]
 14%|█▍        | 5425/37963 [13:26:52<71:49:09,  7.95s/it]
 14%|█▍        | 5426/37963 [13:27:00<71:04:05,  7.86s/it]
 14%|█▍        | 5427/37963 [13:27:08<70:29:17,  7.80s/it]
 14%|█▍        | 5428/37963 [13:27:15<70:16:56,  7.78s/it]
 14%|█▍        | 5429/37963 [13:27:30<89:10:11,  9.87s/it]
 14%|█▍        | 5430/37963 [13:27:38<83:28:23,  9.24s/it]
                                                          
{'loss': '0.1715', 'grad_norm': '2.938', 'learning_rate': '1.934e-05', 'epoch': '0.143'}
+
 14%|█▍        | 5430/37963 [13:27:38<83:28:23,  9.24s/it]
 14%|█▍        | 5431/37963 [13:27:46<79:25:58,  8.79s/it]
 14%|█▍        | 5432/37963 [13:27:53<75:29:39,  8.35s/it]
 14%|█▍        | 5433/37963 [13:28:01<73:35:53,  8.14s/it]
 14%|█▍        | 5434/37963 [13:28:08<72:30:30,  8.02s/it]
 14%|█▍        | 5435/37963 [13:28:16<71:57:46,  7.96s/it]
 14%|█▍        | 5436/37963 [13:28:24<71:04:58,  7.87s/it]
 14%|█▍        | 5437/37963 [13:28:32<70:30:31,  7.80s/it]
 14%|█▍        | 5438/37963 [13:28:39<70:07:04,  7.76s/it]
 14%|█▍        | 5439/37963 [13:28:47<69:38:20,  7.71s/it]
 14%|█▍        | 5440/37963 [13:28:54<69:27:27,  7.69s/it]
                                                          
{'loss': '0.1688', 'grad_norm': '2.917', 'learning_rate': '1.933e-05', 'epoch': '0.1433'}
+
 14%|█▍        | 5440/37963 [13:28:54<69:27:27,  7.69s/it]
 14%|█▍        | 5441/37963 [13:29:02<69:25:31,  7.69s/it]
 14%|█▍        | 5442/37963 [13:29:10<69:07:39,  7.65s/it]
 14%|█▍        | 5443/37963 [13:29:31<106:09:00, 11.75s/it]
 14%|█▍        | 5444/37963 [13:29:39<94:40:40, 10.48s/it] 
 14%|█▍        | 5445/37963 [13:29:46<87:02:32,  9.64s/it]
 14%|█▍        | 5446/37963 [13:29:54<82:00:34,  9.08s/it]
 14%|█▍        | 5447/37963 [13:30:02<78:09:10,  8.65s/it]
 14%|█▍        | 5448/37963 [13:30:09<74:16:26,  8.22s/it]
 14%|█▍        | 5449/37963 [13:30:17<72:38:11,  8.04s/it]
 14%|█▍        | 5450/37963 [13:30:24<70:23:06,  7.79s/it]
                                                          
{'loss': '0.1732', 'grad_norm': '1.217', 'learning_rate': '1.933e-05', 'epoch': '0.1436'}
+
 14%|█▍        | 5450/37963 [13:30:24<70:23:06,  7.79s/it]
 14%|█▍        | 5451/37963 [13:30:31<70:08:21,  7.77s/it]
 14%|█▍        | 5452/37963 [13:30:39<69:06:54,  7.65s/it]
 14%|█▍        | 5453/37963 [13:30:47<69:29:13,  7.69s/it]
 14%|█▍        | 5454/37963 [13:30:54<69:34:36,  7.70s/it]
 14%|█▍        | 5455/37963 [13:31:02<69:21:50,  7.68s/it]
 14%|█▍        | 5456/37963 [13:31:17<88:35:36,  9.81s/it]
 14%|█▍        | 5457/37963 [13:31:31<100:58:05, 11.18s/it]
 14%|█▍        | 5458/37963 [13:31:46<109:49:09, 12.16s/it]
 14%|█▍        | 5459/37963 [13:31:53<98:06:33, 10.87s/it] 
 14%|█▍        | 5460/37963 [13:32:01<88:53:36,  9.85s/it]
                                                          
{'loss': '0.1743', 'grad_norm': '2.835', 'learning_rate': '1.933e-05', 'epoch': '0.1438'}
+
 14%|█▍        | 5460/37963 [13:32:01<88:53:36,  9.85s/it]
 14%|█▍        | 5461/37963 [13:32:08<82:42:29,  9.16s/it]
 14%|█▍        | 5462/37963 [13:32:16<79:16:40,  8.78s/it]
 14%|█▍        | 5463/37963 [13:32:24<76:12:29,  8.44s/it]
 14%|█▍        | 5464/37963 [13:32:32<73:59:17,  8.20s/it]
 14%|█▍        | 5465/37963 [13:32:39<72:17:39,  8.01s/it]
 14%|█▍        | 5466/37963 [13:33:01<108:23:33, 12.01s/it]
 14%|█▍        | 5467/37963 [13:33:08<96:53:22, 10.73s/it] 
 14%|█▍        | 5468/37963 [13:33:16<88:53:34,  9.85s/it]
 14%|█▍        | 5469/37963 [13:33:24<82:36:47,  9.15s/it]
 14%|█▍        | 5470/37963 [13:33:31<78:37:47,  8.71s/it]
                                                          
{'loss': '0.1786', 'grad_norm': '2.682', 'learning_rate': '1.933e-05', 'epoch': '0.1441'}
+
 14%|█▍        | 5470/37963 [13:33:31<78:37:47,  8.71s/it]
 14%|█▍        | 5471/37963 [13:33:39<75:39:47,  8.38s/it]
 14%|█▍        | 5472/37963 [13:33:46<73:26:42,  8.14s/it]
 14%|█▍        | 5473/37963 [13:33:54<72:39:25,  8.05s/it]
 14%|█▍        | 5474/37963 [13:34:09<91:02:53, 10.09s/it]
 14%|█▍        | 5475/37963 [13:34:17<84:33:12,  9.37s/it]
 14%|█▍        | 5476/37963 [13:34:24<78:59:29,  8.75s/it]
 14%|█▍        | 5477/37963 [13:34:32<76:17:20,  8.45s/it]
 14%|█▍        | 5478/37963 [13:34:40<74:22:47,  8.24s/it]
 14%|█▍        | 5479/37963 [13:34:47<72:43:56,  8.06s/it]
 14%|█▍        | 5480/37963 [13:34:55<71:07:25,  7.88s/it]
                                                          
{'loss': '0.1699', 'grad_norm': '1.814', 'learning_rate': '1.932e-05', 'epoch': '0.1444'}
+
 14%|█▍        | 5480/37963 [13:34:55<71:07:25,  7.88s/it]
 14%|█▍        | 5481/37963 [13:35:02<70:32:01,  7.82s/it]
 14%|█▍        | 5482/37963 [13:35:10<69:57:59,  7.75s/it]
 14%|█▍        | 5483/37963 [13:35:18<69:41:36,  7.72s/it]
 14%|█▍        | 5484/37963 [13:35:25<68:30:46,  7.59s/it]
 14%|█▍        | 5485/37963 [13:35:32<68:05:21,  7.55s/it]
 14%|█▍        | 5486/37963 [13:35:40<69:01:57,  7.65s/it]
 14%|█▍        | 5487/37963 [13:35:48<69:10:18,  7.67s/it]
 14%|█▍        | 5488/37963 [13:35:56<68:53:47,  7.64s/it]
 14%|█▍        | 5489/37963 [13:36:03<68:47:17,  7.63s/it]
 14%|█▍        | 5490/37963 [13:36:18<88:34:10,  9.82s/it]
                                                          
{'loss': '0.1658', 'grad_norm': '2.093', 'learning_rate': '1.932e-05', 'epoch': '0.1446'}
+
 14%|█▍        | 5490/37963 [13:36:18<88:34:10,  9.82s/it]
 14%|█▍        | 5491/37963 [13:36:26<82:58:25,  9.20s/it]
 14%|█▍        | 5492/37963 [13:36:34<78:51:31,  8.74s/it]
 14%|█▍        | 5493/37963 [13:36:41<75:51:11,  8.41s/it]
 14%|█▍        | 5494/37963 [13:36:49<73:47:32,  8.18s/it]
 14%|█▍        | 5495/37963 [13:36:56<72:02:57,  7.99s/it]
 14%|█▍        | 5496/37963 [13:37:04<70:24:00,  7.81s/it]
 14%|█▍        | 5497/37963 [13:37:18<87:10:48,  9.67s/it]
 14%|█▍        | 5498/37963 [13:37:25<81:46:33,  9.07s/it]
 14%|█▍        | 5499/37963 [13:37:40<97:32:31, 10.82s/it]
 14%|█▍        | 5500/37963 [13:37:48<89:04:40,  9.88s/it]
                                                          
{'loss': '0.1753', 'grad_norm': '1.275', 'learning_rate': '1.932e-05', 'epoch': '0.1449'}
+
 14%|█▍        | 5500/37963 [13:37:48<89:04:40,  9.88s/it]
 14%|█▍        | 5501/37963 [13:38:02<100:35:47, 11.16s/it]
 14%|█▍        | 5502/37963 [13:38:09<90:07:34, 10.00s/it] 
 14%|█▍        | 5503/37963 [13:38:23<100:46:38, 11.18s/it]
 14%|█▍        | 5504/37963 [13:38:31<90:43:40, 10.06s/it] 
 15%|█▍        | 5505/37963 [13:38:38<83:57:11,  9.31s/it]
 15%|█▍        | 5506/37963 [13:38:46<79:05:04,  8.77s/it]
 15%|█▍        | 5507/37963 [13:38:53<75:36:51,  8.39s/it]
 15%|█▍        | 5508/37963 [13:39:01<73:30:39,  8.15s/it]
 15%|█▍        | 5509/37963 [13:39:09<71:58:54,  7.98s/it]
 15%|█▍        | 5510/37963 [13:39:16<70:52:36,  7.86s/it]
                                                          
{'loss': '0.1748', 'grad_norm': '1.791', 'learning_rate': '1.931e-05', 'epoch': '0.1451'}
+
 15%|█▍        | 5510/37963 [13:39:16<70:52:36,  7.86s/it]
 15%|█▍        | 5511/37963 [13:39:24<70:30:05,  7.82s/it]
 15%|█▍        | 5512/37963 [13:39:32<69:54:05,  7.75s/it]
 15%|█▍        | 5513/37963 [13:39:39<69:36:01,  7.72s/it]
 15%|█▍        | 5514/37963 [13:39:47<69:17:19,  7.69s/it]
 15%|█▍        | 5515/37963 [13:40:02<89:27:07,  9.92s/it]
 15%|█▍        | 5516/37963 [13:40:16<100:52:40, 11.19s/it]
 15%|█▍        | 5517/37963 [13:40:24<91:27:03, 10.15s/it] 
 15%|█▍        | 5518/37963 [13:40:38<103:11:06, 11.45s/it]
 15%|█▍        | 5519/37963 [13:40:46<93:11:46, 10.34s/it] 
 15%|█▍        | 5520/37963 [13:40:54<85:51:09,  9.53s/it]
                                                          
{'loss': '0.1729', 'grad_norm': '2.632', 'learning_rate': '1.931e-05', 'epoch': '0.1454'}
+
 15%|█▍        | 5520/37963 [13:40:54<85:51:09,  9.53s/it]
 15%|█▍        | 5521/37963 [13:41:01<80:45:42,  8.96s/it]
 15%|█▍        | 5522/37963 [13:41:09<77:02:26,  8.55s/it]
 15%|█▍        | 5523/37963 [13:41:17<74:36:12,  8.28s/it]
 15%|█▍        | 5524/37963 [13:41:24<72:59:44,  8.10s/it]
 15%|█▍        | 5525/37963 [13:41:32<71:51:02,  7.97s/it]
 15%|█▍        | 5526/37963 [13:41:39<70:28:16,  7.82s/it]
 15%|█▍        | 5527/37963 [13:41:47<70:08:04,  7.78s/it]
 15%|█▍        | 5528/37963 [13:41:55<69:41:14,  7.73s/it]
 15%|█▍        | 5529/37963 [13:42:02<69:38:05,  7.73s/it]
 15%|█▍        | 5530/37963 [13:42:10<69:18:34,  7.69s/it]
                                                          
{'loss': '0.1754', 'grad_norm': '4.173', 'learning_rate': '1.931e-05', 'epoch': '0.1457'}
+
 15%|█▍        | 5530/37963 [13:42:10<69:18:34,  7.69s/it]
 15%|█▍        | 5531/37963 [13:42:18<69:03:54,  7.67s/it]
 15%|█▍        | 5532/37963 [13:42:25<68:18:33,  7.58s/it]
 15%|█▍        | 5533/37963 [13:42:33<68:20:54,  7.59s/it]
 15%|█▍        | 5534/37963 [13:42:40<68:24:44,  7.59s/it]
 15%|█▍        | 5535/37963 [13:42:55<87:17:15,  9.69s/it]
 15%|█▍        | 5536/37963 [13:43:03<82:06:47,  9.12s/it]
 15%|█▍        | 5537/37963 [13:43:10<77:46:12,  8.63s/it]
 15%|█▍        | 5538/37963 [13:43:18<75:19:26,  8.36s/it]
 15%|█▍        | 5539/37963 [13:43:25<73:15:43,  8.13s/it]
 15%|█▍        | 5540/37963 [13:43:33<71:58:29,  7.99s/it]
                                                          
{'loss': '0.1823', 'grad_norm': '2.253', 'learning_rate': '1.93e-05', 'epoch': '0.1459'}
+
 15%|█▍        | 5540/37963 [13:43:33<71:58:29,  7.99s/it]
 15%|█▍        | 5541/37963 [13:43:41<70:55:19,  7.87s/it]
 15%|█▍        | 5542/37963 [13:43:48<70:26:45,  7.82s/it]
 15%|█▍        | 5543/37963 [13:43:56<70:04:19,  7.78s/it]
 15%|█▍        | 5544/37963 [13:44:04<69:46:46,  7.75s/it]
 15%|█▍        | 5545/37963 [13:44:11<69:43:35,  7.74s/it]
 15%|█▍        | 5546/37963 [13:44:19<69:42:56,  7.74s/it]
 15%|█▍        | 5547/37963 [13:44:33<86:17:06,  9.58s/it]
 15%|█▍        | 5548/37963 [13:44:41<81:09:41,  9.01s/it]
 15%|█▍        | 5549/37963 [13:44:48<77:38:50,  8.62s/it]
 15%|█▍        | 5550/37963 [13:45:02<91:38:35, 10.18s/it]
                                                          
{'loss': '0.1706', 'grad_norm': '1.667', 'learning_rate': '1.93e-05', 'epoch': '0.1462'}
+
 15%|█▍        | 5550/37963 [13:45:02<91:38:35, 10.18s/it]
 15%|█▍        | 5551/37963 [13:45:17<104:39:37, 11.62s/it]
 15%|█▍        | 5552/37963 [13:45:25<93:59:20, 10.44s/it] 
 15%|█▍        | 5553/37963 [13:45:39<103:49:11, 11.53s/it]
 15%|█▍        | 5554/37963 [13:45:47<93:15:22, 10.36s/it] 
 15%|█▍        | 5555/37963 [13:45:54<86:28:23,  9.61s/it]
 15%|█▍        | 5556/37963 [13:46:02<80:37:02,  8.96s/it]
 15%|█▍        | 5557/37963 [13:46:10<77:05:31,  8.56s/it]
 15%|█▍        | 5558/37963 [13:46:17<74:01:22,  8.22s/it]
 15%|█▍        | 5559/37963 [13:46:32<91:30:44, 10.17s/it]
 15%|█▍        | 5560/37963 [13:46:39<84:51:04,  9.43s/it]
                                                          
{'loss': '0.166', 'grad_norm': '2.636', 'learning_rate': '1.93e-05', 'epoch': '0.1465'}
+
 15%|█▍        | 5560/37963 [13:46:39<84:51:04,  9.43s/it]
 15%|█▍        | 5561/37963 [13:46:47<80:09:05,  8.91s/it]
 15%|█▍        | 5562/37963 [13:47:08<112:40:54, 12.52s/it]
 15%|█▍        | 5563/37963 [13:47:16<99:52:32, 11.10s/it] 
 15%|█▍        | 5564/37963 [13:47:24<91:04:36, 10.12s/it]
 15%|█▍        | 5565/37963 [13:47:31<84:20:03,  9.37s/it]
 15%|█▍        | 5566/37963 [13:47:39<79:40:22,  8.85s/it]
 15%|█▍        | 5567/37963 [13:47:46<76:03:29,  8.45s/it]
 15%|█▍        | 5568/37963 [13:47:54<73:25:59,  8.16s/it]
 15%|█▍        | 5569/37963 [13:48:02<72:01:09,  8.00s/it]
 15%|█▍        | 5570/37963 [13:48:09<70:19:21,  7.82s/it]
                                                          
{'loss': '0.1653', 'grad_norm': '4.676', 'learning_rate': '1.929e-05', 'epoch': '0.1467'}
+
 15%|█▍        | 5570/37963 [13:48:09<70:19:21,  7.82s/it]
 15%|█▍        | 5571/37963 [13:48:17<70:02:06,  7.78s/it]
 15%|█▍        | 5572/37963 [13:48:24<70:00:13,  7.78s/it]
 15%|█▍        | 5573/37963 [13:48:32<69:33:25,  7.73s/it]
 15%|█▍        | 5574/37963 [13:48:40<69:16:48,  7.70s/it]
 15%|█▍        | 5575/37963 [13:48:47<69:25:34,  7.72s/it]
 15%|█▍        | 5576/37963 [13:48:55<69:03:42,  7.68s/it]
 15%|█▍        | 5577/37963 [13:49:03<68:48:38,  7.65s/it]
 15%|█▍        | 5578/37963 [13:49:10<68:10:22,  7.58s/it]
 15%|█▍        | 5579/37963 [13:49:18<68:14:46,  7.59s/it]
 15%|█▍        | 5580/37963 [13:49:25<68:00:14,  7.56s/it]
                                                          
{'loss': '0.1821', 'grad_norm': '2.182', 'learning_rate': '1.929e-05', 'epoch': '0.147'}
+
 15%|█▍        | 5580/37963 [13:49:25<68:00:14,  7.56s/it]
 15%|█▍        | 5581/37963 [13:49:40<88:12:03,  9.81s/it]
 15%|█▍        | 5582/37963 [13:49:48<82:47:13,  9.20s/it]
 15%|█▍        | 5583/37963 [13:49:56<78:34:30,  8.74s/it]
 15%|█▍        | 5584/37963 [13:50:03<75:53:01,  8.44s/it]
 15%|█▍        | 5585/37963 [13:50:11<73:14:07,  8.14s/it]
 15%|█▍        | 5586/37963 [13:50:18<71:42:39,  7.97s/it]
 15%|█▍        | 5587/37963 [13:50:26<71:07:21,  7.91s/it]
 15%|█▍        | 5588/37963 [13:50:34<70:59:46,  7.89s/it]
 15%|█▍        | 5589/37963 [13:50:42<70:37:52,  7.85s/it]
 15%|█▍        | 5590/37963 [13:50:50<70:42:30,  7.86s/it]
                                                          
{'loss': '0.1701', 'grad_norm': '1.193', 'learning_rate': '1.929e-05', 'epoch': '0.1472'}
+
 15%|█▍        | 5590/37963 [13:50:50<70:42:30,  7.86s/it]
 15%|█▍        | 5591/37963 [13:50:57<69:41:03,  7.75s/it]
 15%|█▍        | 5592/37963 [13:51:05<69:22:05,  7.71s/it]
 15%|█▍        | 5593/37963 [13:51:12<68:34:50,  7.63s/it]
 15%|█▍        | 5594/37963 [13:51:27<86:50:30,  9.66s/it]
 15%|█▍        | 5595/37963 [13:51:34<81:54:48,  9.11s/it]
 15%|█▍        | 5596/37963 [13:51:49<95:32:49, 10.63s/it]
 15%|█▍        | 5597/37963 [13:51:56<87:33:29,  9.74s/it]
 15%|█▍        | 5598/37963 [13:52:04<81:53:58,  9.11s/it]
 15%|█▍        | 5599/37963 [13:52:19<97:20:14, 10.83s/it]
 15%|█▍        | 5600/37963 [13:52:33<107:09:14, 11.92s/it]
                                                           
{'loss': '0.1735', 'grad_norm': '2.618', 'learning_rate': '1.928e-05', 'epoch': '0.1475'}
+
 15%|█▍        | 5600/37963 [13:52:33<107:09:14, 11.92s/it]
 15%|█▍        | 5601/37963 [13:52:41<95:44:38, 10.65s/it] 
 15%|█▍        | 5602/37963 [13:52:49<87:49:54,  9.77s/it]
 15%|█▍        | 5603/37963 [13:52:56<82:05:17,  9.13s/it]
 15%|█▍        | 5604/37963 [13:53:04<78:32:53,  8.74s/it]
 15%|█▍        | 5605/37963 [13:53:12<75:11:28,  8.37s/it]
 15%|█▍        | 5606/37963 [13:53:27<93:34:41, 10.41s/it]
 15%|█▍        | 5607/37963 [13:53:34<86:10:35,  9.59s/it]
 15%|█▍        | 5608/37963 [13:53:42<80:47:51,  8.99s/it]
 15%|█▍        | 5609/37963 [13:53:57<96:40:56, 10.76s/it]
 15%|█▍        | 5610/37963 [13:54:05<88:21:31,  9.83s/it]
                                                          
{'loss': '0.1724', 'grad_norm': '2.26', 'learning_rate': '1.928e-05', 'epoch': '0.1478'}
+
 15%|█▍        | 5610/37963 [13:54:05<88:21:31,  9.83s/it]
 15%|█▍        | 5611/37963 [13:54:12<82:46:06,  9.21s/it]
 15%|█▍        | 5612/37963 [13:54:27<97:15:51, 10.82s/it]
 15%|█▍        | 5613/37963 [13:54:35<88:54:12,  9.89s/it]
 15%|█▍        | 5614/37963 [13:54:42<83:18:59,  9.27s/it]
 15%|█▍        | 5615/37963 [13:54:50<79:05:08,  8.80s/it]
 15%|█▍        | 5616/37963 [13:54:58<76:05:58,  8.47s/it]
 15%|█▍        | 5617/37963 [13:55:06<74:01:09,  8.24s/it]
 15%|█▍        | 5618/37963 [13:55:13<72:31:56,  8.07s/it]
 15%|█▍        | 5619/37963 [13:55:21<71:42:33,  7.98s/it]
 15%|█▍        | 5620/37963 [13:55:29<70:47:31,  7.88s/it]
                                                          
{'loss': '0.1537', 'grad_norm': '1.194', 'learning_rate': '1.928e-05', 'epoch': '0.148'}
+
 15%|█▍        | 5620/37963 [13:55:29<70:47:31,  7.88s/it]
 15%|█▍        | 5621/37963 [13:55:36<70:07:38,  7.81s/it]
 15%|█▍        | 5622/37963 [13:55:44<69:04:38,  7.69s/it]
 15%|█▍        | 5623/37963 [13:55:51<69:03:36,  7.69s/it]
 15%|█▍        | 5624/37963 [13:55:59<69:23:33,  7.72s/it]
 15%|█▍        | 5625/37963 [13:56:07<69:26:58,  7.73s/it]
 15%|█▍        | 5626/37963 [13:56:15<69:09:28,  7.70s/it]
 15%|█▍        | 5627/37963 [13:56:22<69:13:41,  7.71s/it]
 15%|█▍        | 5628/37963 [13:56:30<69:06:30,  7.69s/it]
 15%|█▍        | 5629/37963 [13:56:45<88:56:14,  9.90s/it]
 15%|█▍        | 5630/37963 [13:56:53<83:42:41,  9.32s/it]
                                                          
{'loss': '0.1619', 'grad_norm': '3.261', 'learning_rate': '1.928e-05', 'epoch': '0.1483'}
+
 15%|█▍        | 5630/37963 [13:56:53<83:42:41,  9.32s/it]
 15%|█▍        | 5631/37963 [13:57:01<79:25:28,  8.84s/it]
 15%|█▍        | 5632/37963 [13:57:08<75:33:46,  8.41s/it]
 15%|█▍        | 5633/37963 [13:57:16<73:41:02,  8.20s/it]
 15%|█▍        | 5634/37963 [13:57:24<72:36:23,  8.09s/it]
 15%|���▍        | 5635/37963 [13:57:31<71:17:22,  7.94s/it]
 15%|█▍        | 5636/37963 [13:57:39<70:38:41,  7.87s/it]
 15%|█▍        | 5637/37963 [13:57:47<70:17:01,  7.83s/it]
 15%|█▍        | 5638/37963 [13:58:01<87:41:22,  9.77s/it]
 15%|█▍        | 5639/37963 [13:58:09<82:31:59,  9.19s/it]
 15%|█▍        | 5640/37963 [13:58:16<78:00:41,  8.69s/it]
                                                          
{'loss': '0.1663', 'grad_norm': '4.403', 'learning_rate': '1.927e-05', 'epoch': '0.1486'}
+
 15%|█▍        | 5640/37963 [13:58:16<78:00:41,  8.69s/it]
 15%|█▍        | 5641/37963 [13:58:24<75:43:52,  8.43s/it]
 15%|█▍        | 5642/37963 [13:58:38<91:32:54, 10.20s/it]
 15%|█▍        | 5643/37963 [13:58:46<84:54:09,  9.46s/it]
 15%|█▍        | 5644/37963 [13:59:01<98:10:34, 10.94s/it]
 15%|█▍        | 5645/37963 [13:59:08<89:51:29, 10.01s/it]
 15%|█▍        | 5646/37963 [13:59:16<83:40:34,  9.32s/it]
 15%|█▍        | 5647/37963 [13:59:24<78:55:24,  8.79s/it]
 15%|█▍        | 5648/37963 [13:59:38<93:08:53, 10.38s/it]
 15%|█▍        | 5649/37963 [13:59:46<86:02:56,  9.59s/it]
 15%|█▍        | 5650/37963 [13:59:53<81:07:14,  9.04s/it]
                                                          
{'loss': '0.1682', 'grad_norm': '5.668', 'learning_rate': '1.927e-05', 'epoch': '0.1488'}
+
 15%|█▍        | 5650/37963 [13:59:53<81:07:14,  9.04s/it]
 15%|█▍        | 5651/37963 [14:00:01<76:49:43,  8.56s/it]
 15%|█▍        | 5652/37963 [14:00:08<74:27:36,  8.30s/it]
 15%|█▍        | 5653/37963 [14:00:16<73:07:45,  8.15s/it]
 15%|█▍        | 5654/37963 [14:00:24<72:21:13,  8.06s/it]
 15%|█▍        | 5655/37963 [14:00:32<70:55:55,  7.90s/it]
 15%|█▍        | 5656/37963 [14:00:39<70:15:36,  7.83s/it]
 15%|█▍        | 5657/37963 [14:00:47<70:01:21,  7.80s/it]
 15%|█▍        | 5658/37963 [14:01:09<108:31:24, 12.09s/it]
 15%|█▍        | 5659/37963 [14:01:17<96:32:30, 10.76s/it] 
 15%|█▍        | 5660/37963 [14:01:24<87:49:09,  9.79s/it]
                                                          
{'loss': '0.1871', 'grad_norm': '2.173', 'learning_rate': '1.927e-05', 'epoch': '0.1491'}
+
 15%|█▍        | 5660/37963 [14:01:24<87:49:09,  9.79s/it]
 15%|█▍        | 5661/37963 [14:01:32<81:24:13,  9.07s/it]
 15%|█▍        | 5662/37963 [14:01:39<77:38:26,  8.65s/it]
 15%|█▍        | 5663/37963 [14:01:47<74:57:10,  8.35s/it]
 15%|█▍        | 5664/37963 [14:01:55<73:12:51,  8.16s/it]
 15%|█▍        | 5665/37963 [14:02:09<90:21:43, 10.07s/it]
 15%|█▍        | 5666/37963 [14:02:17<84:04:26,  9.37s/it]
 15%|█▍        | 5667/37963 [14:02:25<79:30:18,  8.86s/it]
 15%|█▍        | 5668/37963 [14:02:32<76:27:44,  8.52s/it]
 15%|█▍        | 5669/37963 [14:02:40<73:46:21,  8.22s/it]
 15%|█▍        | 5670/37963 [14:02:48<72:20:35,  8.06s/it]
                                                          
{'loss': '0.1816', 'grad_norm': '4.236', 'learning_rate': '1.926e-05', 'epoch': '0.1494'}
+
 15%|█▍        | 5670/37963 [14:02:48<72:20:35,  8.06s/it]
 15%|█▍        | 5671/37963 [14:02:55<70:53:59,  7.90s/it]
 15%|█▍        | 5672/37963 [14:03:03<70:16:31,  7.83s/it]
 15%|█▍        | 5673/37963 [14:03:10<69:45:27,  7.78s/it]
 15%|█▍        | 5674/37963 [14:03:18<69:41:09,  7.77s/it]
 15%|█▍        | 5675/37963 [14:03:26<69:22:18,  7.73s/it]
 15%|█▍        | 5676/37963 [14:03:33<69:06:14,  7.71s/it]
 15%|█▍        | 5677/37963 [14:03:41<69:17:03,  7.73s/it]
 15%|█▍        | 5678/37963 [14:03:49<69:17:18,  7.73s/it]
 15%|█▍        | 5679/37963 [14:03:57<69:08:47,  7.71s/it]
 15%|█▍        | 5680/37963 [14:04:04<69:02:27,  7.70s/it]
                                                          
{'loss': '0.1636', 'grad_norm': '1.721', 'learning_rate': '1.926e-05', 'epoch': '0.1496'}
+
 15%|█▍        | 5680/37963 [14:04:04<69:02:27,  7.70s/it]
 15%|█▍        | 5681/37963 [14:04:11<67:21:08,  7.51s/it]
 15%|█▍        | 5682/37963 [14:04:26<85:35:58,  9.55s/it]
 15%|█▍        | 5683/37963 [14:04:41<100:50:23, 11.25s/it]
 15%|█▍        | 5684/37963 [14:04:49<91:36:35, 10.22s/it] 
 15%|█▍        | 5685/37963 [14:04:56<84:49:54,  9.46s/it]
 15%|█▍        | 5686/37963 [14:05:04<79:29:04,  8.87s/it]
 15%|█▍        | 5687/37963 [14:05:11<76:03:38,  8.48s/it]
 15%|█▍        | 5688/37963 [14:05:19<73:54:13,  8.24s/it]
 15%|█▍        | 5689/37963 [14:05:27<71:54:33,  8.02s/it]
 15%|█▍        | 5690/37963 [14:05:34<71:00:50,  7.92s/it]
                                                          
{'loss': '0.1583', 'grad_norm': '2.024', 'learning_rate': '1.926e-05', 'epoch': '0.1499'}
+
 15%|█▍        | 5690/37963 [14:05:34<71:00:50,  7.92s/it]
 15%|█▍        | 5691/37963 [14:05:42<70:26:47,  7.86s/it]
 15%|█▍        | 5692/37963 [14:05:50<70:12:32,  7.83s/it]
 15%|█▍        | 5693/37963 [14:05:57<68:50:34,  7.68s/it]
 15%|█▍        | 5694/37963 [14:06:12<86:45:54,  9.68s/it]
 15%|█▌        | 5695/37963 [14:06:19<81:53:36,  9.14s/it]
 15%|█▌        | 5696/37963 [14:06:27<77:48:48,  8.68s/it]
 15%|█▌        | 5697/37963 [14:06:41<91:49:28, 10.25s/it]
 15%|█▌        | 5698/37963 [14:06:56<103:40:53, 11.57s/it]
 15%|█▌        | 5699/37963 [14:07:03<93:26:27, 10.43s/it] 
 15%|█▌        | 5700/37963 [14:07:11<85:38:34,  9.56s/it]
                                                          
{'loss': '0.1515', 'grad_norm': '2.665', 'learning_rate': '1.925e-05', 'epoch': '0.1501'}
+
 15%|█▌        | 5700/37963 [14:07:11<85:38:34,  9.56s/it]
 15%|█▌        | 5701/37963 [14:07:19<80:36:54,  9.00s/it]
 15%|█▌        | 5702/37963 [14:07:26<76:58:03,  8.59s/it]
 15%|█▌        | 5703/37963 [14:07:34<74:30:19,  8.31s/it]
 15%|█▌        | 5704/37963 [14:07:41<72:36:21,  8.10s/it]
 15%|█▌        | 5705/37963 [14:07:49<71:52:57,  8.02s/it]
 15%|█▌        | 5706/37963 [14:07:57<70:57:10,  7.92s/it]
 15%|█▌        | 5707/37963 [14:08:05<70:27:23,  7.86s/it]
 15%|█▌        | 5708/37963 [14:08:12<69:34:26,  7.77s/it]
 15%|█▌        | 5709/37963 [14:08:20<69:22:23,  7.74s/it]
 15%|█▌        | 5710/37963 [14:08:28<69:04:42,  7.71s/it]
                                                          
{'loss': '0.1694', 'grad_norm': '6.856', 'learning_rate': '1.925e-05', 'epoch': '0.1504'}
+
 15%|█▌        | 5710/37963 [14:08:28<69:04:42,  7.71s/it]
 15%|█▌        | 5711/37963 [14:08:49<106:13:34, 11.86s/it]
 15%|█▌        | 5712/37963 [14:09:04<114:55:35, 12.83s/it]
 15%|█▌        | 5713/37963 [14:09:12<101:52:58, 11.37s/it]
 15%|█▌        | 5714/37963 [14:09:20<92:04:15, 10.28s/it] 
 15%|█▌        | 5715/37963 [14:09:28<84:55:40,  9.48s/it]
 15%|█▌        | 5716/37963 [14:09:35<79:53:35,  8.92s/it]
 15%|█▌        | 5717/37963 [14:09:43<76:19:39,  8.52s/it]
 15%|█▌        | 5718/37963 [14:09:51<74:32:01,  8.32s/it]
 15%|█▌        | 5719/37963 [14:09:58<71:59:23,  8.04s/it]
 15%|█▌        | 5720/37963 [14:10:06<71:05:27,  7.94s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '4.957', 'learning_rate': '1.925e-05', 'epoch': '0.1507'}
+
 15%|█▌        | 5720/37963 [14:10:06<71:05:27,  7.94s/it]
 15%|█▌        | 5721/37963 [14:10:13<70:49:55,  7.91s/it]
 15%|█▌        | 5722/37963 [14:10:21<70:43:25,  7.90s/it]
 15%|█▌        | 5723/37963 [14:10:29<70:00:09,  7.82s/it]
 15%|█▌        | 5724/37963 [14:10:37<69:34:07,  7.77s/it]
 15%|█▌        | 5725/37963 [14:10:44<68:54:38,  7.70s/it]
 15%|█▌        | 5726/37963 [14:10:52<69:12:30,  7.73s/it]
 15%|█▌        | 5727/37963 [14:10:59<67:55:51,  7.59s/it]
 15%|█▌        | 5728/37963 [14:11:13<84:55:00,  9.48s/it]
 15%|█▌        | 5729/37963 [14:11:21<80:29:40,  8.99s/it]
 15%|█▌        | 5730/37963 [14:11:36<96:04:39, 10.73s/it]
                                                          
{'loss': '0.1722', 'grad_norm': '3.012', 'learning_rate': '1.924e-05', 'epoch': '0.1509'}
+
 15%|█▌        | 5730/37963 [14:11:36<96:04:39, 10.73s/it]
 15%|█▌        | 5731/37963 [14:11:44<88:32:32,  9.89s/it]
 15%|█▌        | 5732/37963 [14:11:51<82:51:52,  9.26s/it]
 15%|█▌        | 5733/37963 [14:11:59<78:52:56,  8.81s/it]
 15%|█▌        | 5734/37963 [14:12:07<75:29:26,  8.43s/it]
 15%|█▌        | 5735/37963 [14:12:15<73:37:21,  8.22s/it]
 15%|█▌        | 5736/37963 [14:12:22<72:16:22,  8.07s/it]
 15%|█▌        | 5737/37963 [14:12:30<71:00:58,  7.93s/it]
 15%|█▌        | 5738/37963 [14:12:37<69:48:13,  7.80s/it]
 15%|█▌        | 5739/37963 [14:12:45<69:13:27,  7.73s/it]
 15%|█▌        | 5740/37963 [14:12:53<69:08:25,  7.72s/it]
                                                          
{'loss': '0.1734', 'grad_norm': '3.798', 'learning_rate': '1.924e-05', 'epoch': '0.1512'}
+
 15%|█▌        | 5740/37963 [14:12:53<69:08:25,  7.72s/it]
 15%|█▌        | 5741/37963 [14:13:00<68:52:22,  7.69s/it]
 15%|█▌        | 5742/37963 [14:13:08<68:53:40,  7.70s/it]
 15%|█▌        | 5743/37963 [14:13:16<68:45:20,  7.68s/it]
 15%|█▌        | 5744/37963 [14:13:23<68:48:50,  7.69s/it]
 15%|█▌        | 5745/37963 [14:13:31<68:44:46,  7.68s/it]
 15%|█▌        | 5746/37963 [14:13:45<86:32:51,  9.67s/it]
 15%|█▌        | 5747/37963 [14:14:00<101:09:25, 11.30s/it]
 15%|█▌        | 5748/37963 [14:14:08<91:27:01, 10.22s/it] 
 15%|█▌        | 5749/37963 [14:14:16<84:10:11,  9.41s/it]
 15%|█▌        | 5750/37963 [14:14:23<79:04:29,  8.84s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '5.465', 'learning_rate': '1.924e-05', 'epoch': '0.1515'}
+
 15%|█▌        | 5750/37963 [14:14:23<79:04:29,  8.84s/it]
 15%|█▌        | 5751/37963 [14:14:37<93:32:04, 10.45s/it]
 15%|█▌        | 5752/37963 [14:14:45<85:55:08,  9.60s/it]
 15%|█▌        | 5753/37963 [14:14:53<80:37:16,  9.01s/it]
 15%|█▌        | 5754/37963 [14:15:00<77:16:13,  8.64s/it]
 15%|█▌        | 5755/37963 [14:15:15<92:09:13, 10.30s/it]
 15%|█▌        | 5756/37963 [14:15:22<85:25:12,  9.55s/it]
 15%|█▌        | 5757/37963 [14:15:30<80:11:21,  8.96s/it]
 15%|█▌        | 5758/37963 [14:15:38<76:28:34,  8.55s/it]
 15%|█▌        | 5759/37963 [14:15:53<93:58:59, 10.51s/it]
 15%|█▌        | 5760/37963 [14:16:00<86:16:15,  9.64s/it]
                                                          
{'loss': '0.1624', 'grad_norm': '2.901', 'learning_rate': '1.923e-05', 'epoch': '0.1517'}
+
 15%|█▌        | 5760/37963 [14:16:00<86:16:15,  9.64s/it]
 15%|█▌        | 5761/37963 [14:16:08<81:13:41,  9.08s/it]
 15%|█▌        | 5762/37963 [14:16:16<77:19:25,  8.64s/it]
 15%|█▌        | 5763/37963 [14:16:23<74:23:19,  8.32s/it]
 15%|█▌        | 5764/37963 [14:16:31<72:43:55,  8.13s/it]
 15%|█▌        | 5765/37963 [14:16:38<71:12:56,  7.96s/it]
 15%|█▌        | 5766/37963 [14:16:53<89:52:49, 10.05s/it]
 15%|█▌        | 5767/37963 [14:17:01<83:45:07,  9.36s/it]
 15%|█▌        | 5768/37963 [14:17:09<79:07:39,  8.85s/it]
 15%|█▌        | 5769/37963 [14:17:16<75:59:54,  8.50s/it]
 15%|█▌        | 5770/37963 [14:17:24<73:44:34,  8.25s/it]
                                                          
{'loss': '0.1682', 'grad_norm': '1.257', 'learning_rate': '1.923e-05', 'epoch': '0.152'}
+
 15%|█▌        | 5770/37963 [14:17:24<73:44:34,  8.25s/it]
 15%|█▌        | 5771/37963 [14:17:31<71:10:30,  7.96s/it]
 15%|█▌        | 5772/37963 [14:17:39<70:27:27,  7.88s/it]
 15%|█▌        | 5773/37963 [14:17:47<69:56:55,  7.82s/it]
 15%|█▌        | 5774/37963 [14:17:55<69:45:00,  7.80s/it]
 15%|█▌        | 5775/37963 [14:18:02<68:59:36,  7.72s/it]
 15%|█▌        | 5776/37963 [14:18:10<68:51:39,  7.70s/it]
 15%|█▌        | 5777/37963 [14:18:24<86:47:49,  9.71s/it]
 15%|█▌        | 5778/37963 [14:18:32<81:30:21,  9.12s/it]
 15%|█▌        | 5779/37963 [14:18:39<77:34:54,  8.68s/it]
 15%|█▌        | 5780/37963 [14:18:54<94:12:11, 10.54s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '2.008', 'learning_rate': '1.923e-05', 'epoch': '0.1523'}
+
 15%|█▌        | 5780/37963 [14:18:54<94:12:11, 10.54s/it]
 15%|█▌        | 5781/37963 [14:19:02<86:17:20,  9.65s/it]
 15%|█▌        | 5782/37963 [14:19:09<80:26:42,  9.00s/it]
 15%|█▌        | 5783/37963 [14:19:17<76:54:06,  8.60s/it]
 15%|█▌        | 5784/37963 [14:19:25<74:22:28,  8.32s/it]
 15%|█▌        | 5785/37963 [14:19:32<72:27:44,  8.11s/it]
 15%|█▌        | 5786/37963 [14:19:40<71:15:28,  7.97s/it]
 15%|█▌        | 5787/37963 [14:19:48<70:25:53,  7.88s/it]
 15%|█▌        | 5788/37963 [14:19:56<70:26:08,  7.88s/it]
 15%|█▌        | 5789/37963 [14:20:03<69:42:42,  7.80s/it]
 15%|█▌        | 5790/37963 [14:20:11<69:18:27,  7.76s/it]
                                                          
{'loss': '0.1632', 'grad_norm': '2.274', 'learning_rate': '1.922e-05', 'epoch': '0.1525'}
+
 15%|█▌        | 5790/37963 [14:20:11<69:18:27,  7.76s/it]
 15%|█▌        | 5791/37963 [14:20:19<69:22:29,  7.76s/it]
 15%|█▌        | 5792/37963 [14:20:26<69:07:23,  7.74s/it]
 15%|█▌        | 5793/37963 [14:20:34<69:02:00,  7.73s/it]
 15%|█▌        | 5794/37963 [14:20:49<87:44:17,  9.82s/it]
 15%|█▌        | 5795/37963 [14:20:56<81:45:38,  9.15s/it]
 15%|█▌        | 5796/37963 [14:21:11<95:29:46, 10.69s/it]
 15%|█▌        | 5797/37963 [14:21:18<87:49:07,  9.83s/it]
 15%|█▌        | 5798/37963 [14:21:26<81:59:40,  9.18s/it]
 15%|█▌        | 5799/37963 [14:21:40<95:33:51, 10.70s/it]
 15%|█▌        | 5800/37963 [14:21:48<87:34:26,  9.80s/it]
                                                          
{'loss': '0.1678', 'grad_norm': '7.669', 'learning_rate': '1.922e-05', 'epoch': '0.1528'}
+
 15%|█▌        | 5800/37963 [14:21:48<87:34:26,  9.80s/it]
 15%|█▌        | 5801/37963 [14:21:56<81:54:16,  9.17s/it]
 15%|█▌        | 5802/37963 [14:22:03<77:35:27,  8.69s/it]
 15%|█▌        | 5803/37963 [14:22:11<74:51:18,  8.38s/it]
 15%|█▌        | 5804/37963 [14:22:18<72:24:10,  8.11s/it]
 15%|█▌        | 5805/37963 [14:22:26<71:32:42,  8.01s/it]
 15%|█▌        | 5806/37963 [14:22:34<70:04:51,  7.85s/it]
 15%|█▌        | 5807/37963 [14:22:41<69:24:42,  7.77s/it]
 15%|█▌        | 5808/37963 [14:22:56<86:58:15,  9.74s/it]
 15%|█▌        | 5809/37963 [14:23:03<81:01:31,  9.07s/it]
 15%|█▌        | 5810/37963 [14:23:11<77:10:49,  8.64s/it]
                                                          
{'loss': '0.1665', 'grad_norm': '3.74', 'learning_rate': '1.922e-05', 'epoch': '0.153'}
+
 15%|█▌        | 5810/37963 [14:23:11<77:10:49,  8.64s/it]
 15%|█▌        | 5811/37963 [14:23:19<75:02:12,  8.40s/it]
 15%|█▌        | 5812/37963 [14:23:26<72:46:01,  8.15s/it]
 15%|█▌        | 5813/37963 [14:23:41<90:50:07, 10.17s/it]
 15%|█▌        | 5814/37963 [14:23:49<84:17:24,  9.44s/it]
 15%|█▌        | 5815/37963 [14:24:04<99:07:03, 11.10s/it]
 15%|█▌        | 5816/37963 [14:24:11<89:20:39, 10.01s/it]
 15%|█▌        | 5817/37963 [14:24:19<83:18:35,  9.33s/it]
 15%|█▌        | 5818/37963 [14:24:27<78:54:40,  8.84s/it]
 15%|█▌        | 5819/37963 [14:24:34<75:55:01,  8.50s/it]
 15%|█▌        | 5820/37963 [14:24:42<73:46:25,  8.26s/it]
                                                          
{'loss': '0.1611', 'grad_norm': '1.406', 'learning_rate': '1.921e-05', 'epoch': '0.1533'}
+
 15%|█▌        | 5820/37963 [14:24:42<73:46:25,  8.26s/it]
 15%|█▌        | 5821/37963 [14:24:50<72:31:44,  8.12s/it]
 15%|█▌        | 5822/37963 [14:25:04<88:39:32,  9.93s/it]
 15%|█▌        | 5823/37963 [14:25:12<83:50:03,  9.39s/it]
 15%|█▌        | 5824/37963 [14:25:20<79:00:47,  8.85s/it]
 15%|█▌        | 5825/37963 [14:25:27<75:44:44,  8.48s/it]
 15%|█▌        | 5826/37963 [14:25:35<73:39:29,  8.25s/it]
 15%|█▌        | 5827/37963 [14:25:43<72:34:25,  8.13s/it]
 15%|█▌        | 5828/37963 [14:25:51<71:34:46,  8.02s/it]
 15%|█▌        | 5829/37963 [14:25:58<70:38:53,  7.91s/it]
 15%|█▌        | 5830/37963 [14:26:13<89:29:09, 10.03s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '2.05', 'learning_rate': '1.921e-05', 'epoch': '0.1536'}
+
 15%|█▌        | 5830/37963 [14:26:13<89:29:09, 10.03s/it]
 15%|█▌        | 5831/37963 [14:26:21<83:06:10,  9.31s/it]
 15%|█▌        | 5832/37963 [14:26:28<78:31:09,  8.80s/it]
 15%|█▌        | 5833/37963 [14:26:36<74:47:03,  8.38s/it]
 15%|█▌        | 5834/37963 [14:26:44<73:49:00,  8.27s/it]
 15%|█▌        | 5835/37963 [14:26:52<72:43:35,  8.15s/it]
 15%|█▌        | 5836/37963 [14:26:59<70:58:52,  7.95s/it]
 15%|█▌        | 5837/37963 [14:27:07<69:59:40,  7.84s/it]
 15%|█▌        | 5838/37963 [14:27:15<69:45:14,  7.82s/it]
 15%|█▌        | 5839/37963 [14:27:30<88:51:44,  9.96s/it]
 15%|█▌        | 5840/37963 [14:27:37<82:56:30,  9.30s/it]
                                                          
{'loss': '0.1527', 'grad_norm': '3.333', 'learning_rate': '1.921e-05', 'epoch': '0.1538'}
+
 15%|█▌        | 5840/37963 [14:27:37<82:56:30,  9.30s/it]
 15%|█▌        | 5841/37963 [14:27:45<78:20:27,  8.78s/it]
 15%|█▌        | 5842/37963 [14:27:53<75:22:39,  8.45s/it]
 15%|█▌        | 5843/37963 [14:28:00<73:09:07,  8.20s/it]
 15%|█▌        | 5844/37963 [14:28:08<71:41:07,  8.03s/it]
 15%|█▌        | 5845/37963 [14:28:22<88:34:47,  9.93s/it]
 15%|█▌        | 5846/37963 [14:28:30<82:23:01,  9.23s/it]
 15%|█▌        | 5847/37963 [14:28:37<77:26:03,  8.68s/it]
 15%|█▌        | 5848/37963 [14:28:45<74:50:58,  8.39s/it]
 15%|█▌        | 5849/37963 [14:28:59<90:18:07, 10.12s/it]
 15%|█▌        | 5850/37963 [14:29:07<83:51:55,  9.40s/it]
                                                          
{'loss': '0.1635', 'grad_norm': '2.01', 'learning_rate': '1.92e-05', 'epoch': '0.1541'}
+
 15%|█▌        | 5850/37963 [14:29:07<83:51:55,  9.40s/it]
 15%|█▌        | 5851/37963 [14:29:14<78:45:38,  8.83s/it]
 15%|█▌        | 5852/37963 [14:29:22<75:39:28,  8.48s/it]
 15%|█▌        | 5853/37963 [14:29:30<73:38:14,  8.26s/it]
 15%|█▌        | 5854/37963 [14:29:37<71:34:45,  8.03s/it]
 15%|█▌        | 5855/37963 [14:29:45<70:36:11,  7.92s/it]
 15%|█▌        | 5856/37963 [14:29:53<69:58:00,  7.85s/it]
 15%|█▌        | 5857/37963 [14:30:00<69:14:42,  7.76s/it]
 15%|█▌        | 5858/37963 [14:30:08<68:34:00,  7.69s/it]
 15%|█▌        | 5859/37963 [14:30:23<88:29:37,  9.92s/it]
 15%|█▌        | 5860/37963 [14:30:31<82:46:22,  9.28s/it]
                                                          
{'loss': '0.1654', 'grad_norm': '1.594', 'learning_rate': '1.92e-05', 'epoch': '0.1544'}
+
 15%|█▌        | 5860/37963 [14:30:31<82:46:22,  9.28s/it]
 15%|█▌        | 5861/37963 [14:30:45<97:44:46, 10.96s/it]
 15%|█▌        | 5862/37963 [14:31:00<107:08:43, 12.02s/it]
 15%|█▌        | 5863/37963 [14:31:08<95:37:01, 10.72s/it] 
 15%|█▌        | 5864/37963 [14:31:15<87:09:12,  9.77s/it]
 15%|█▌        | 5865/37963 [14:31:23<81:47:32,  9.17s/it]
 15%|█▌        | 5866/37963 [14:31:31<77:36:20,  8.70s/it]
 15%|█▌        | 5867/37963 [14:31:38<74:12:15,  8.32s/it]
 15%|█▌        | 5868/37963 [14:31:46<72:35:59,  8.14s/it]
 15%|█▌        | 5869/37963 [14:31:53<71:12:57,  7.99s/it]
 15%|█▌        | 5870/37963 [14:32:01<70:18:29,  7.89s/it]
                                                          
{'loss': '0.1607', 'grad_norm': '2.109', 'learning_rate': '1.92e-05', 'epoch': '0.1546'}
+
 15%|█▌        | 5870/37963 [14:32:01<70:18:29,  7.89s/it]
 15%|█▌        | 5871/37963 [14:32:08<69:20:50,  7.78s/it]
 15%|█▌        | 5872/37963 [14:32:16<68:31:00,  7.69s/it]
 15%|█▌        | 5873/37963 [14:32:24<68:11:09,  7.65s/it]
 15%|█▌        | 5874/37963 [14:32:37<84:47:00,  9.51s/it]
 15%|█▌        | 5875/37963 [14:32:45<78:56:44,  8.86s/it]
 15%|█▌        | 5876/37963 [14:32:53<76:09:31,  8.54s/it]
 15%|█▌        | 5877/37963 [14:33:08<93:38:53, 10.51s/it]
 15%|█▌        | 5878/37963 [14:33:15<85:54:23,  9.64s/it]
 15%|█▌        | 5879/37963 [14:33:23<80:37:50,  9.05s/it]
 15%|█▌        | 5880/37963 [14:33:31<77:47:58,  8.73s/it]
                                                          
{'loss': '0.1576', 'grad_norm': '4.162', 'learning_rate': '1.919e-05', 'epoch': '0.1549'}
+
 15%|█▌        | 5880/37963 [14:33:31<77:47:58,  8.73s/it]
 15%|█▌        | 5881/37963 [14:33:39<75:11:30,  8.44s/it]
 15%|█▌        | 5882/37963 [14:33:46<73:13:13,  8.22s/it]
 15%|█▌        | 5883/37963 [14:33:54<71:32:04,  8.03s/it]
 15%|█▌        | 5884/37963 [14:34:01<70:06:38,  7.87s/it]
 16%|█▌        | 5885/37963 [14:34:09<69:46:00,  7.83s/it]
 16%|█▌        | 5886/37963 [14:34:17<69:25:02,  7.79s/it]
 16%|█▌        | 5887/37963 [14:34:25<69:01:44,  7.75s/it]
 16%|█▌        | 5888/37963 [14:34:39<87:44:00,  9.85s/it]
 16%|█▌        | 5889/37963 [14:34:47<81:31:04,  9.15s/it]
 16%|█▌        | 5890/37963 [14:34:54<77:39:02,  8.72s/it]
                                                          
{'loss': '0.1621', 'grad_norm': '4.568', 'learning_rate': '1.919e-05', 'epoch': '0.1552'}
+
 16%|█▌        | 5890/37963 [14:34:54<77:39:02,  8.72s/it]
 16%|█▌        | 5891/37963 [14:35:02<74:40:37,  8.38s/it]
 16%|█▌        | 5892/37963 [14:35:10<72:20:55,  8.12s/it]
 16%|█▌        | 5893/37963 [14:35:24<88:31:20,  9.94s/it]
 16%|█▌        | 5894/37963 [14:35:32<82:41:21,  9.28s/it]
 16%|█▌        | 5895/37963 [14:35:46<96:03:08, 10.78s/it]
 16%|█▌        | 5896/37963 [14:35:54<88:33:43,  9.94s/it]
 16%|█▌        | 5897/37963 [14:36:02<82:38:50,  9.28s/it]
 16%|█▌        | 5898/37963 [14:36:09<78:22:46,  8.80s/it]
 16%|█▌        | 5899/37963 [14:36:17<74:52:15,  8.41s/it]
 16%|█▌        | 5900/37963 [14:36:24<72:57:05,  8.19s/it]
                                                          
{'loss': '0.1655', 'grad_norm': '1.759', 'learning_rate': '1.919e-05', 'epoch': '0.1554'}
+
 16%|█▌        | 5900/37963 [14:36:24<72:57:05,  8.19s/it]
 16%|█▌        | 5901/37963 [14:36:32<71:34:50,  8.04s/it]
 16%|█▌        | 5902/37963 [14:36:40<70:37:18,  7.93s/it]
 16%|█▌        | 5903/37963 [14:36:47<70:09:09,  7.88s/it]
 16%|█▌        | 5904/37963 [14:36:55<69:41:45,  7.83s/it]
 16%|█▌        | 5905/37963 [14:37:10<88:43:19,  9.96s/it]
 16%|█▌        | 5906/37963 [14:37:25<102:38:12, 11.53s/it]
 16%|█▌        | 5907/37963 [14:37:40<110:43:19, 12.43s/it]
 16%|█▌        | 5908/37963 [14:37:48<97:59:44, 11.01s/it] 
 16%|█▌        | 5909/37963 [14:37:55<88:28:08,  9.94s/it]
 16%|█▌        | 5910/37963 [14:38:03<82:54:35,  9.31s/it]
                                                          
{'loss': '0.168', 'grad_norm': '3.725', 'learning_rate': '1.918e-05', 'epoch': '0.1557'}
+
 16%|█▌        | 5910/37963 [14:38:03<82:54:35,  9.31s/it]
 16%|█▌        | 5911/37963 [14:38:11<78:33:37,  8.82s/it]
 16%|█▌        | 5912/37963 [14:38:18<75:17:05,  8.46s/it]
 16%|█▌        | 5913/37963 [14:38:26<72:56:24,  8.19s/it]
 16%|█▌        | 5914/37963 [14:38:33<71:47:24,  8.06s/it]
 16%|█▌        | 5915/37963 [14:38:41<70:29:56,  7.92s/it]
 16%|█▌        | 5916/37963 [14:38:49<69:45:42,  7.84s/it]
 16%|█▌        | 5917/37963 [14:38:56<69:30:07,  7.81s/it]
 16%|█▌        | 5918/37963 [14:39:04<69:12:09,  7.77s/it]
 16%|█▌        | 5919/37963 [14:39:12<68:58:12,  7.75s/it]
 16%|█▌        | 5920/37963 [14:39:20<69:00:02,  7.75s/it]
                                                          
{'loss': '0.168', 'grad_norm': '1.752', 'learning_rate': '1.918e-05', 'epoch': '0.1559'}
+
 16%|█▌        | 5920/37963 [14:39:20<69:00:02,  7.75s/it]
 16%|█▌        | 5921/37963 [14:39:27<68:44:37,  7.72s/it]
 16%|█▌        | 5922/37963 [14:39:35<68:01:11,  7.64s/it]
 16%|█▌        | 5923/37963 [14:39:42<67:41:18,  7.61s/it]
 16%|█▌        | 5924/37963 [14:39:57<87:37:00,  9.84s/it]
 16%|█▌        | 5925/37963 [14:40:05<80:46:14,  9.08s/it]
 16%|█▌        | 5926/37963 [14:40:19<93:54:47, 10.55s/it]
 16%|█▌        | 5927/37963 [14:40:26<86:45:48,  9.75s/it]
 16%|█▌        | 5928/37963 [14:40:34<81:09:32,  9.12s/it]
 16%|█▌        | 5929/37963 [14:40:41<76:19:31,  8.58s/it]
 16%|█▌        | 5930/37963 [14:40:49<73:30:04,  8.26s/it]
                                                          
{'loss': '0.1712', 'grad_norm': '1.751', 'learning_rate': '1.918e-05', 'epoch': '0.1562'}
+
 16%|█▌        | 5930/37963 [14:40:49<73:30:04,  8.26s/it]
 16%|█▌        | 5931/37963 [14:40:57<71:56:04,  8.08s/it]
 16%|█▌        | 5932/37963 [14:41:04<70:43:31,  7.95s/it]
 16%|█▌        | 5933/37963 [14:41:12<70:16:03,  7.90s/it]
 16%|█▌        | 5934/37963 [14:41:20<70:14:15,  7.89s/it]
 16%|█▌        | 5935/37963 [14:41:35<88:30:40,  9.95s/it]
 16%|█▌        | 5936/37963 [14:41:42<82:24:55,  9.26s/it]
 16%|█▌        | 5937/37963 [14:41:50<78:16:40,  8.80s/it]
 16%|█▌        | 5938/37963 [14:41:58<75:32:54,  8.49s/it]
 16%|█▌        | 5939/37963 [14:42:12<90:56:25, 10.22s/it]
 16%|█▌        | 5940/37963 [14:42:19<83:10:57,  9.35s/it]
                                                          
{'loss': '0.171', 'grad_norm': '2.401', 'learning_rate': '1.917e-05', 'epoch': '0.1565'}
+
 16%|█▌        | 5940/37963 [14:42:19<83:10:57,  9.35s/it]
 16%|█▌        | 5941/37963 [14:42:33<95:41:08, 10.76s/it]
 16%|█▌        | 5942/37963 [14:42:41<87:45:49,  9.87s/it]
 16%|█▌        | 5943/37963 [14:42:49<81:43:29,  9.19s/it]
 16%|█▌        | 5944/37963 [14:42:57<77:49:02,  8.75s/it]
 16%|█▌        | 5945/37963 [14:43:04<75:23:45,  8.48s/it]
 16%|█▌        | 5946/37963 [14:43:12<73:25:01,  8.26s/it]
 16%|█▌        | 5947/37963 [14:43:20<72:03:38,  8.10s/it]
 16%|█▌        | 5948/37963 [14:43:28<71:02:22,  7.99s/it]
 16%|█▌        | 5949/37963 [14:43:43<89:33:47, 10.07s/it]
 16%|█▌        | 5950/37963 [14:43:50<83:15:22,  9.36s/it]
                                                          
{'loss': '0.168', 'grad_norm': '1.6', 'learning_rate': '1.917e-05', 'epoch': '0.1567'}
+
 16%|█▌        | 5950/37963 [14:43:50<83:15:22,  9.36s/it]
 16%|█▌        | 5951/37963 [14:43:58<78:46:31,  8.86s/it]
 16%|█▌        | 5952/37963 [14:44:06<75:34:54,  8.50s/it]
 16%|█▌        | 5953/37963 [14:44:13<72:49:32,  8.19s/it]
 16%|█▌        | 5954/37963 [14:44:28<90:29:20, 10.18s/it]
 16%|█▌        | 5955/37963 [14:44:42<100:31:09, 11.31s/it]
 16%|█▌        | 5956/37963 [14:44:49<90:32:23, 10.18s/it] 
 16%|█▌        | 5957/37963 [14:44:57<83:46:51,  9.42s/it]
 16%|█▌        | 5958/37963 [14:45:05<79:14:31,  8.91s/it]
 16%|█▌        | 5959/37963 [14:45:12<75:43:13,  8.52s/it]
 16%|█▌        | 5960/37963 [14:45:20<73:44:33,  8.30s/it]
                                                          
{'loss': '0.156', 'grad_norm': '2.026', 'learning_rate': '1.917e-05', 'epoch': '0.157'}
+
 16%|█▌        | 5960/37963 [14:45:20<73:44:33,  8.30s/it]
 16%|█▌        | 5961/37963 [14:45:28<72:12:31,  8.12s/it]
 16%|█▌        | 5962/37963 [14:45:36<71:05:22,  8.00s/it]
 16%|█▌        | 5963/37963 [14:45:43<70:20:35,  7.91s/it]
 16%|█▌        | 5964/37963 [14:45:51<69:46:42,  7.85s/it]
 16%|█▌        | 5965/37963 [14:45:59<69:12:38,  7.79s/it]
 16%|█▌        | 5966/37963 [14:46:06<68:51:16,  7.75s/it]
 16%|█▌        | 5967/37963 [14:46:14<68:15:12,  7.68s/it]
 16%|█▌        | 5968/37963 [14:46:22<68:39:48,  7.73s/it]
 16%|█▌        | 5969/37963 [14:46:29<68:51:03,  7.75s/it]
 16%|█▌        | 5970/37963 [14:46:44<85:52:40,  9.66s/it]
                                                          
{'loss': '0.169', 'grad_norm': '2.539', 'learning_rate': '1.916e-05', 'epoch': '0.1573'}
+
 16%|█▌        | 5970/37963 [14:46:44<85:52:40,  9.66s/it]
 16%|█▌        | 5971/37963 [14:46:51<80:23:59,  9.05s/it]
 16%|█▌        | 5972/37963 [14:46:59<76:34:14,  8.62s/it]
 16%|█▌        | 5973/37963 [14:47:06<74:06:53,  8.34s/it]
 16%|█▌        | 5974/37963 [14:47:21<90:34:58, 10.19s/it]
 16%|█▌        | 5975/37963 [14:47:29<83:50:58,  9.44s/it]
 16%|█▌        | 5976/37963 [14:47:36<79:08:15,  8.91s/it]
 16%|█▌        | 5977/37963 [14:47:44<75:28:32,  8.49s/it]
 16%|█▌        | 5978/37963 [14:47:52<73:18:10,  8.25s/it]
 16%|█▌        | 5979/37963 [14:47:59<71:40:30,  8.07s/it]
 16%|█▌        | 5980/37963 [14:48:07<70:13:10,  7.90s/it]
                                                          
{'loss': '0.1674', 'grad_norm': '2.063', 'learning_rate': '1.916e-05', 'epoch': '0.1575'}
+
 16%|█▌        | 5980/37963 [14:48:07<70:13:10,  7.90s/it]
 16%|█▌        | 5981/37963 [14:48:21<88:36:25,  9.97s/it]
 16%|█▌        | 5982/37963 [14:48:29<81:48:21,  9.21s/it]
 16%|█▌        | 5983/37963 [14:48:37<77:37:56,  8.74s/it]
 16%|█▌        | 5984/37963 [14:48:44<74:41:59,  8.41s/it]
 16%|█▌        | 5985/37963 [14:48:52<72:50:36,  8.20s/it]
 16%|█▌        | 5986/37963 [14:49:06<88:16:54,  9.94s/it]
 16%|█▌        | 5987/37963 [14:49:20<99:11:37, 11.17s/it]
 16%|█▌        | 5988/37963 [14:49:28<89:55:55, 10.13s/it]
 16%|█▌        | 5989/37963 [14:49:35<83:19:16,  9.38s/it]
 16%|█▌        | 5990/37963 [14:49:43<78:52:18,  8.88s/it]
                                                          
{'loss': '0.17', 'grad_norm': '2.718', 'learning_rate': '1.916e-05', 'epoch': '0.1578'}
+
 16%|█▌        | 5990/37963 [14:49:43<78:52:18,  8.88s/it]
 16%|█▌        | 5991/37963 [14:49:51<75:47:03,  8.53s/it]
 16%|█▌        | 5992/37963 [14:49:58<73:39:44,  8.29s/it]
 16%|█▌        | 5993/37963 [14:50:06<71:04:23,  8.00s/it]
 16%|█▌        | 5994/37963 [14:50:13<69:50:41,  7.87s/it]
 16%|█▌        | 5995/37963 [14:50:28<88:51:18, 10.01s/it]
 16%|█▌        | 5996/37963 [14:50:36<81:53:45,  9.22s/it]
 16%|█▌        | 5997/37963 [14:50:43<77:04:31,  8.68s/it]
 16%|█▌        | 5998/37963 [14:50:51<74:15:46,  8.36s/it]
 16%|█▌        | 5999/37963 [14:50:58<72:25:08,  8.16s/it]
 16%|█▌        | 6000/37963 [14:51:06<71:00:25,  8.00s/it]
                                                          
{'loss': '0.176', 'grad_norm': '1.543', 'learning_rate': '1.915e-05', 'epoch': '0.158'}
+
 16%|█▌        | 6000/37963 [14:51:06<71:00:25,  8.00s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.04s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.04s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 16%|█▌        | 6001/37963 [14:52:09<216:33:03, 24.39s/it]
 16%|█▌        | 6002/37963 [14:52:16<172:07:27, 19.39s/it]
 16%|█▌        | 6003/37963 [14:52:24<140:57:32, 15.88s/it]
 16%|█▌        | 6004/37963 [14:52:32<119:12:37, 13.43s/it]
 16%|█▌        | 6005/37963 [14:52:46<121:51:05, 13.73s/it]
 16%|█▌        | 6006/37963 [14:52:54<106:23:24, 11.99s/it]
 16%|█▌        | 6007/37963 [14:53:02<94:56:54, 10.70s/it] 
 16%|█▌        | 6008/37963 [14:53:09<86:39:37,  9.76s/it]
 16%|█▌        | 6009/37963 [14:53:17<80:51:50,  9.11s/it]
 16%|█▌        | 6010/37963 [14:53:25<77:11:12,  8.70s/it]
                                                          
{'loss': '0.176', 'grad_norm': '6.026', 'learning_rate': '1.915e-05', 'epoch': '0.1583'}
+
 16%|█▌        | 6010/37963 [14:53:25<77:11:12,  8.70s/it]
 16%|█▌        | 6011/37963 [14:53:32<74:24:31,  8.38s/it]
 16%|█▌        | 6012/37963 [14:53:40<72:52:18,  8.21s/it]
 16%|█▌        | 6013/37963 [14:53:48<72:08:05,  8.13s/it]
 16%|█▌        | 6014/37963 [14:53:56<71:12:47,  8.02s/it]
 16%|█▌        | 6015/37963 [14:54:04<70:26:28,  7.94s/it]
 16%|█▌        | 6016/37963 [14:54:18<87:45:16,  9.89s/it]
 16%|█▌        | 6017/37963 [14:54:26<82:09:48,  9.26s/it]
 16%|█▌        | 6018/37963 [14:54:33<77:33:39,  8.74s/it]
 16%|█▌        | 6019/37963 [14:54:41<74:19:24,  8.38s/it]
 16%|█▌        | 6020/37963 [14:54:57<93:31:58, 10.54s/it]
                                                          
{'loss': '0.1768', 'grad_norm': '1.557', 'learning_rate': '1.915e-05', 'epoch': '0.1586'}
+
 16%|█▌        | 6020/37963 [14:54:57<93:31:58, 10.54s/it]
 16%|█▌        | 6021/37963 [14:55:04<85:57:11,  9.69s/it]
 16%|█▌        | 6022/37963 [14:55:12<80:33:57,  9.08s/it]
 16%|█▌        | 6023/37963 [14:55:20<77:45:17,  8.76s/it]
 16%|█▌        | 6024/37963 [14:55:28<75:25:49,  8.50s/it]
 16%|█▌        | 6025/37963 [14:55:35<73:09:47,  8.25s/it]
 16%|█▌        | 6026/37963 [14:55:43<71:36:29,  8.07s/it]
 16%|█▌        | 6027/37963 [14:55:51<70:18:19,  7.93s/it]
 16%|█▌        | 6028/37963 [14:55:58<69:10:03,  7.80s/it]
 16%|█▌        | 6029/37963 [14:56:06<68:48:34,  7.76s/it]
 16%|█▌        | 6030/37963 [14:56:20<87:02:08,  9.81s/it]
                                                          
{'loss': '0.1668', 'grad_norm': '2.042', 'learning_rate': '1.914e-05', 'epoch': '0.1588'}
+
 16%|█▌        | 6030/37963 [14:56:20<87:02:08,  9.81s/it]
 16%|█▌        | 6031/37963 [14:56:28<81:35:09,  9.20s/it]
 16%|█▌        | 6032/37963 [14:56:36<77:13:07,  8.71s/it]
 16%|█▌        | 6033/37963 [14:56:44<74:53:59,  8.44s/it]
 16%|█▌        | 6034/37963 [14:56:51<72:34:58,  8.18s/it]
 16%|█▌        | 6035/37963 [14:56:59<71:29:17,  8.06s/it]
 16%|█▌        | 6036/37963 [14:57:13<87:38:39,  9.88s/it]
 16%|█▌        | 6037/37963 [14:57:27<98:46:30, 11.14s/it]
 16%|█▌        | 6038/37963 [14:57:35<89:47:38, 10.13s/it]
 16%|█▌        | 6039/37963 [14:57:43<83:08:37,  9.38s/it]
 16%|█▌        | 6040/37963 [14:57:50<78:37:31,  8.87s/it]
                                                          
{'loss': '0.1674', 'grad_norm': '2.34', 'learning_rate': '1.914e-05', 'epoch': '0.1591'}
+
 16%|█▌        | 6040/37963 [14:57:50<78:37:31,  8.87s/it]
 16%|█▌        | 6041/37963 [14:57:58<74:36:28,  8.41s/it]
 16%|█▌        | 6042/37963 [14:58:05<72:39:22,  8.19s/it]
 16%|█▌        | 6043/37963 [14:58:20<89:45:46, 10.12s/it]
 16%|█▌        | 6044/37963 [14:58:28<83:17:56,  9.39s/it]
 16%|█▌        | 6045/37963 [14:58:35<78:41:08,  8.87s/it]
 16%|█▌        | 6046/37963 [14:58:43<74:49:24,  8.44s/it]
 16%|█▌        | 6047/37963 [14:58:50<72:40:05,  8.20s/it]
 16%|█▌        | 6048/37963 [14:59:05<89:36:48, 10.11s/it]
 16%|█▌        | 6049/37963 [14:59:13<83:09:27,  9.38s/it]
 16%|█▌        | 6050/37963 [14:59:20<78:55:06,  8.90s/it]
                                                          
{'loss': '0.171', 'grad_norm': '3.492', 'learning_rate': '1.914e-05', 'epoch': '0.1594'}
+
 16%|█▌        | 6050/37963 [14:59:20<78:55:06,  8.90s/it]
 16%|█▌        | 6051/37963 [14:59:28<74:48:11,  8.44s/it]
 16%|█▌        | 6052/37963 [14:59:35<72:25:18,  8.17s/it]
 16%|█▌        | 6053/37963 [14:59:43<71:12:09,  8.03s/it]
 16%|█▌        | 6054/37963 [14:59:57<87:25:57,  9.86s/it]
 16%|█▌        | 6055/37963 [15:00:05<81:22:17,  9.18s/it]
 16%|█▌        | 6056/37963 [15:00:12<77:38:38,  8.76s/it]
 16%|█▌        | 6057/37963 [15:00:20<74:37:17,  8.42s/it]
 16%|█▌        | 6058/37963 [15:00:28<72:33:47,  8.19s/it]
 16%|█▌        | 6059/37963 [15:00:35<70:41:05,  7.98s/it]
 16%|█▌        | 6060/37963 [15:00:50<87:38:57,  9.89s/it]
                                                          
{'loss': '0.1619', 'grad_norm': '3.87', 'learning_rate': '1.913e-05', 'epoch': '0.1596'}
+
 16%|█▌        | 6060/37963 [15:00:50<87:38:57,  9.89s/it]
 16%|█▌        | 6061/37963 [15:00:57<81:11:58,  9.16s/it]
 16%|█▌        | 6062/37963 [15:01:05<77:07:32,  8.70s/it]
 16%|█▌        | 6063/37963 [15:01:12<74:06:14,  8.36s/it]
 16%|█▌        | 6064/37963 [15:01:20<72:38:00,  8.20s/it]
 16%|█▌        | 6065/37963 [15:01:28<71:09:16,  8.03s/it]
 16%|█▌        | 6066/37963 [15:01:42<89:02:13, 10.05s/it]
 16%|█▌        | 6067/37963 [15:01:50<83:12:19,  9.39s/it]
 16%|█▌        | 6068/37963 [15:01:58<78:18:58,  8.84s/it]
 16%|█▌        | 6069/37963 [15:02:05<75:02:45,  8.47s/it]
 16%|█▌        | 6070/37963 [15:02:13<72:50:38,  8.22s/it]
                                                          
{'loss': '0.1654', 'grad_norm': '1.634', 'learning_rate': '1.913e-05', 'epoch': '0.1599'}
+
 16%|█▌        | 6070/37963 [15:02:13<72:50:38,  8.22s/it]
 16%|█▌        | 6071/37963 [15:02:21<71:12:01,  8.04s/it]
 16%|█▌        | 6072/37963 [15:02:29<70:33:07,  7.96s/it]
 16%|█▌        | 6073/37963 [15:02:36<69:35:54,  7.86s/it]
 16%|█▌        | 6074/37963 [15:02:44<68:57:06,  7.78s/it]
 16%|█▌        | 6075/37963 [15:02:51<68:30:39,  7.73s/it]
 16%|█▌        | 6076/37963 [15:02:59<68:07:09,  7.69s/it]
 16%|█▌        | 6077/37963 [15:03:07<68:21:02,  7.72s/it]
 16%|█▌        | 6078/37963 [15:03:22<87:26:57,  9.87s/it]
 16%|█▌        | 6079/37963 [15:03:29<81:38:09,  9.22s/it]
 16%|█▌        | 6080/37963 [15:03:37<77:53:09,  8.79s/it]
                                                          
{'loss': '0.1717', 'grad_norm': '4.015', 'learning_rate': '1.912e-05', 'epoch': '0.1602'}
+
 16%|█▌        | 6080/37963 [15:03:37<77:53:09,  8.79s/it]
 16%|█▌        | 6081/37963 [15:03:45<74:45:53,  8.44s/it]
 16%|█▌        | 6082/37963 [15:03:52<72:51:43,  8.23s/it]
 16%|█▌        | 6083/37963 [15:04:00<71:24:02,  8.06s/it]
 16%|█▌        | 6084/37963 [15:04:08<70:22:23,  7.95s/it]
 16%|█▌        | 6085/37963 [15:04:22<87:22:35,  9.87s/it]
 16%|█▌        | 6086/37963 [15:04:30<81:40:42,  9.22s/it]
 16%|█▌        | 6087/37963 [15:04:38<77:31:58,  8.76s/it]
 16%|█▌        | 6088/37963 [15:04:45<74:44:21,  8.44s/it]
 16%|█▌        | 6089/37963 [15:04:53<72:49:44,  8.23s/it]
 16%|█▌        | 6090/37963 [15:05:01<71:11:00,  8.04s/it]
                                                          
{'loss': '0.1696', 'grad_norm': '4.455', 'learning_rate': '1.912e-05', 'epoch': '0.1604'}
+
 16%|█▌        | 6090/37963 [15:05:01<71:11:00,  8.04s/it]
 16%|█▌        | 6091/37963 [15:05:22<107:30:55, 12.14s/it]
 16%|█▌        | 6092/37963 [15:05:30<96:05:06, 10.85s/it] 
 16%|█▌        | 6093/37963 [15:05:38<87:00:41,  9.83s/it]
 16%|█▌        | 6094/37963 [15:05:45<80:43:11,  9.12s/it]
 16%|█▌        | 6095/37963 [15:05:53<77:02:57,  8.70s/it]
 16%|█▌        | 6096/37963 [15:06:01<74:34:18,  8.42s/it]
 16%|█▌        | 6097/37963 [15:06:15<89:50:06, 10.15s/it]
 16%|█▌        | 6098/37963 [15:06:23<83:42:08,  9.46s/it]
 16%|█▌        | 6099/37963 [15:06:30<78:41:31,  8.89s/it]
 16%|█▌        | 6100/37963 [15:06:45<94:37:10, 10.69s/it]
                                                          
{'loss': '0.1689', 'grad_norm': '2.891', 'learning_rate': '1.912e-05', 'epoch': '0.1607'}
+
 16%|█▌        | 6100/37963 [15:06:45<94:37:10, 10.69s/it]
 16%|█▌        | 6101/37963 [15:06:53<87:13:06,  9.85s/it]
 16%|█▌        | 6102/37963 [15:07:01<81:26:01,  9.20s/it]
 16%|█▌        | 6103/37963 [15:07:08<77:30:21,  8.76s/it]
 16%|█▌        | 6104/37963 [15:07:16<74:27:36,  8.41s/it]
 16%|█▌        | 6105/37963 [15:07:24<72:31:39,  8.20s/it]
 16%|█▌        | 6106/37963 [15:07:31<71:07:54,  8.04s/it]
 16%|█▌        | 6107/37963 [15:07:39<70:10:07,  7.93s/it]
 16%|█▌        | 6108/37963 [15:07:54<88:14:35,  9.97s/it]
 16%|█▌        | 6109/37963 [15:08:01<82:14:42,  9.29s/it]
 16%|█▌        | 6110/37963 [15:08:09<77:57:05,  8.81s/it]
                                                          
{'loss': '0.1718', 'grad_norm': '1.654', 'learning_rate': '1.911e-05', 'epoch': '0.1609'}
+
 16%|█▌        | 6110/37963 [15:08:09<77:57:05,  8.81s/it]
 16%|█▌        | 6111/37963 [15:08:17<74:51:24,  8.46s/it]
 16%|█▌        | 6112/37963 [15:08:32<91:34:55, 10.35s/it]
 16%|█▌        | 6113/37963 [15:08:39<84:51:17,  9.59s/it]
 16%|█▌        | 6114/37963 [15:08:47<79:41:00,  9.01s/it]
 16%|█▌        | 6115/37963 [15:08:54<74:53:33,  8.47s/it]
 16%|█▌        | 6116/37963 [15:09:02<72:47:50,  8.23s/it]
 16%|█▌        | 6117/37963 [15:09:09<70:40:29,  7.99s/it]
 16%|█▌        | 6118/37963 [15:09:17<69:33:19,  7.86s/it]
 16%|█▌        | 6119/37963 [15:09:25<68:59:20,  7.80s/it]
 16%|█▌        | 6120/37963 [15:09:32<68:53:59,  7.79s/it]
                                                          
{'loss': '0.1751', 'grad_norm': '1.802', 'learning_rate': '1.911e-05', 'epoch': '0.1612'}
+
 16%|█▌        | 6120/37963 [15:09:32<68:53:59,  7.79s/it]
 16%|█▌        | 6121/37963 [15:09:40<68:45:48,  7.77s/it]
 16%|█▌        | 6122/37963 [15:09:48<68:04:28,  7.70s/it]
 16%|█▌        | 6123/37963 [15:09:55<67:35:06,  7.64s/it]
 16%|█▌        | 6124/37963 [15:10:10<86:22:34,  9.77s/it]
 16%|█▌        | 6125/37963 [15:10:18<81:30:21,  9.22s/it]
 16%|█▌        | 6126/37963 [15:10:25<77:23:43,  8.75s/it]
 16%|█▌        | 6127/37963 [15:10:33<74:11:08,  8.39s/it]
 16%|█▌        | 6128/37963 [15:10:41<72:11:06,  8.16s/it]
 16%|█▌        | 6129/37963 [15:10:48<71:07:08,  8.04s/it]
 16%|█▌        | 6130/37963 [15:10:56<69:45:29,  7.89s/it]
                                                          
{'loss': '0.1613', 'grad_norm': '2.449', 'learning_rate': '1.911e-05', 'epoch': '0.1615'}
+
 16%|█▌        | 6130/37963 [15:10:56<69:45:29,  7.89s/it]
 16%|█▌        | 6131/37963 [15:11:03<69:02:31,  7.81s/it]
 16%|█▌        | 6132/37963 [15:11:11<67:49:40,  7.67s/it]
 16%|█▌        | 6133/37963 [15:11:19<67:59:49,  7.69s/it]
 16%|█▌        | 6134/37963 [15:11:33<85:04:16,  9.62s/it]
 16%|█▌        | 6135/37963 [15:11:40<79:51:20,  9.03s/it]
 16%|█▌        | 6136/37963 [15:11:55<95:13:09, 10.77s/it]
 16%|█▌        | 6137/37963 [15:12:03<86:56:24,  9.83s/it]
 16%|█▌        | 6138/37963 [15:12:10<80:14:59,  9.08s/it]
 16%|█▌        | 6139/37963 [15:12:17<75:42:53,  8.57s/it]
 16%|█▌        | 6140/37963 [15:12:25<72:34:22,  8.21s/it]
                                                          
{'loss': '0.1746', 'grad_norm': '2.077', 'learning_rate': '1.91e-05', 'epoch': '0.1617'}
+
 16%|█▌        | 6140/37963 [15:12:25<72:34:22,  8.21s/it]
 16%|█▌        | 6141/37963 [15:12:39<87:19:58,  9.88s/it]
 16%|█▌        | 6142/37963 [15:12:46<81:04:41,  9.17s/it]
 16%|█▌        | 6143/37963 [15:12:54<77:09:28,  8.73s/it]
 16%|█▌        | 6144/37963 [15:13:01<74:14:11,  8.40s/it]
 16%|█▌        | 6145/37963 [15:13:09<72:11:44,  8.17s/it]
 16%|█▌        | 6146/37963 [15:13:17<70:08:26,  7.94s/it]
 16%|█▌        | 6147/37963 [15:13:24<69:25:56,  7.86s/it]
 16%|█▌        | 6148/37963 [15:13:32<68:44:07,  7.78s/it]
 16%|█▌        | 6149/37963 [15:13:39<67:34:09,  7.65s/it]
 16%|█▌        | 6150/37963 [15:13:47<67:42:24,  7.66s/it]
                                                          
{'loss': '0.1577', 'grad_norm': '3.55', 'learning_rate': '1.91e-05', 'epoch': '0.162'}
+
 16%|█▌        | 6150/37963 [15:13:47<67:42:24,  7.66s/it]
 16%|█▌        | 6151/37963 [15:13:54<67:01:46,  7.59s/it]
 16%|█▌        | 6152/37963 [15:14:08<84:38:03,  9.58s/it]
 16%|█▌        | 6153/37963 [15:14:24<99:46:55, 11.29s/it]
 16%|█▌        | 6154/37963 [15:14:38<106:22:33, 12.04s/it]
 16%|█▌        | 6155/37963 [15:14:45<94:54:07, 10.74s/it] 
 16%|█▌        | 6156/37963 [15:14:53<86:26:05,  9.78s/it]
 16%|█▌        | 6157/37963 [15:15:00<80:41:08,  9.13s/it]
 16%|█▌        | 6158/37963 [15:15:08<76:28:12,  8.66s/it]
 16%|█▌        | 6159/37963 [15:15:16<73:46:35,  8.35s/it]
 16%|█▌        | 6160/37963 [15:15:23<71:27:09,  8.09s/it]
                                                          
{'loss': '0.1632', 'grad_norm': '3.194', 'learning_rate': '1.91e-05', 'epoch': '0.1623'}
+
 16%|█▌        | 6160/37963 [15:15:23<71:27:09,  8.09s/it]
 16%|█▌        | 6161/37963 [15:15:31<69:55:39,  7.92s/it]
 16%|█▌        | 6162/37963 [15:15:38<68:26:08,  7.75s/it]
 16%|█▌        | 6163/37963 [15:15:46<68:29:15,  7.75s/it]
 16%|█▌        | 6164/37963 [15:15:53<68:35:04,  7.76s/it]
 16%|█▌        | 6165/37963 [15:16:08<86:56:41,  9.84s/it]
 16%|█▌        | 6166/37963 [15:16:16<80:29:07,  9.11s/it]
 16%|█▌        | 6167/37963 [15:16:23<76:29:49,  8.66s/it]
 16%|█▌        | 6168/37963 [15:16:31<72:57:51,  8.26s/it]
 16%|█▋        | 6169/37963 [15:16:38<71:20:06,  8.08s/it]
 16%|█▋        | 6170/37963 [15:16:46<70:55:01,  8.03s/it]
                                                          
{'loss': '0.161', 'grad_norm': '3.071', 'learning_rate': '1.909e-05', 'epoch': '0.1625'}
+
 16%|█▋        | 6170/37963 [15:16:46<70:55:01,  8.03s/it]
 16%|█▋        | 6171/37963 [15:16:54<69:57:37,  7.92s/it]
 16%|█▋        | 6172/37963 [15:17:01<69:11:24,  7.84s/it]
 16%|█▋        | 6173/37963 [15:17:16<86:30:25,  9.80s/it]
 16%|█▋        | 6174/37963 [15:17:24<81:25:27,  9.22s/it]
 16%|█▋        | 6175/37963 [15:17:31<77:01:38,  8.72s/it]
 16%|█▋        | 6176/37963 [15:17:39<74:00:42,  8.38s/it]
 16%|█▋        | 6177/37963 [15:17:47<72:18:19,  8.19s/it]
 16%|█▋        | 6178/37963 [15:17:54<70:21:31,  7.97s/it]
 16%|█▋        | 6179/37963 [15:18:02<69:26:55,  7.87s/it]
 16%|█▋        | 6180/37963 [15:18:16<86:05:28,  9.75s/it]
                                                          
{'loss': '0.1781', 'grad_norm': '2.431', 'learning_rate': '1.909e-05', 'epoch': '0.1628'}
+
 16%|█▋        | 6180/37963 [15:18:16<86:05:28,  9.75s/it]
 16%|█▋        | 6181/37963 [15:18:23<80:31:25,  9.12s/it]
 16%|█▋        | 6182/37963 [15:18:31<76:14:36,  8.64s/it]
 16%|█▋        | 6183/37963 [15:18:38<72:46:11,  8.24s/it]
 16%|█▋        | 6184/37963 [15:18:46<71:12:55,  8.07s/it]
 16%|█▋        | 6185/37963 [15:18:54<70:14:48,  7.96s/it]
 16%|█▋        | 6186/37963 [15:19:01<69:45:54,  7.90s/it]
 16%|█▋        | 6187/37963 [15:19:09<69:28:00,  7.87s/it]
 16%|█▋        | 6188/37963 [15:19:24<89:02:47, 10.09s/it]
 16%|█▋        | 6189/37963 [15:19:32<83:04:14,  9.41s/it]
 16%|█▋        | 6190/37963 [15:19:40<78:45:16,  8.92s/it]
                                                          
{'loss': '0.1673', 'grad_norm': '1.864', 'learning_rate': '1.909e-05', 'epoch': '0.1631'}
+
 16%|█▋        | 6190/37963 [15:19:40<78:45:16,  8.92s/it]
 16%|█▋        | 6191/37963 [15:19:48<75:34:00,  8.56s/it]
 16%|█▋        | 6192/37963 [15:19:55<73:16:13,  8.30s/it]
 16%|█▋        | 6193/37963 [15:20:03<71:33:00,  8.11s/it]
 16%|█▋        | 6194/37963 [15:20:11<70:13:58,  7.96s/it]
 16%|█▋        | 6195/37963 [15:20:25<86:45:23,  9.83s/it]
 16%|█▋        | 6196/37963 [15:20:33<81:00:52,  9.18s/it]
 16%|█▋        | 6197/37963 [15:20:40<77:35:12,  8.79s/it]
 16%|█▋        | 6198/37963 [15:20:48<74:37:15,  8.46s/it]
 16%|█▋        | 6199/37963 [15:20:56<72:24:19,  8.21s/it]
 16%|█▋        | 6200/37963 [15:21:03<70:52:19,  8.03s/it]
                                                          
{'loss': '0.1823', 'grad_norm': '7.396', 'learning_rate': '1.908e-05', 'epoch': '0.1633'}
+
 16%|█▋        | 6200/37963 [15:21:03<70:52:19,  8.03s/it]
 16%|█▋        | 6201/37963 [15:21:11<69:44:38,  7.91s/it]
 16%|█▋        | 6202/37963 [15:21:19<69:03:42,  7.83s/it]
 16%|█▋        | 6203/37963 [15:21:26<68:29:35,  7.76s/it]
 16%|█▋        | 6204/37963 [15:21:34<67:42:32,  7.68s/it]
 16%|█▋        | 6205/37963 [15:21:41<67:37:12,  7.67s/it]
 16%|█▋        | 6206/37963 [15:22:03<104:42:03, 11.87s/it]
 16%|█▋        | 6207/37963 [15:22:17<109:54:35, 12.46s/it]
 16%|█▋        | 6208/37963 [15:22:25<97:58:44, 11.11s/it] 
 16%|█▋        | 6209/37963 [15:22:32<88:34:27, 10.04s/it]
 16%|█▋        | 6210/37963 [15:22:40<82:17:26,  9.33s/it]
                                                          
{'loss': '0.1661', 'grad_norm': '4.233', 'learning_rate': '1.908e-05', 'epoch': '0.1636'}
+
 16%|█▋        | 6210/37963 [15:22:40<82:17:26,  9.33s/it]
 16%|█▋        | 6211/37963 [15:22:48<77:29:54,  8.79s/it]
 16%|█▋        | 6212/37963 [15:22:55<74:43:14,  8.47s/it]
 16%|█▋        | 6213/37963 [15:23:03<72:41:28,  8.24s/it]
 16%|█▋        | 6214/37963 [15:23:11<71:22:01,  8.09s/it]
 16%|█▋        | 6215/37963 [15:23:19<70:34:11,  8.00s/it]
 16%|█▋        | 6216/37963 [15:23:33<88:23:22, 10.02s/it]
 16%|█▋        | 6217/37963 [15:23:41<82:15:24,  9.33s/it]
 16%|█▋        | 6218/37963 [15:23:49<78:01:00,  8.85s/it]
 16%|█▋        | 6219/37963 [15:23:56<74:56:42,  8.50s/it]
 16%|█▋        | 6220/37963 [15:24:11<91:07:31, 10.33s/it]
                                                          
{'loss': '0.1757', 'grad_norm': '2.195', 'learning_rate': '1.908e-05', 'epoch': '0.1638'}
+
 16%|█▋        | 6220/37963 [15:24:11<91:07:31, 10.33s/it]
 16%|█▋        | 6221/37963 [15:24:19<83:58:31,  9.52s/it]
 16%|█▋        | 6222/37963 [15:24:26<78:22:53,  8.89s/it]
 16%|█▋        | 6223/37963 [15:24:34<74:55:19,  8.50s/it]
 16%|█▋        | 6224/37963 [15:24:41<72:02:42,  8.17s/it]
 16%|█▋        | 6225/37963 [15:24:49<70:31:37,  8.00s/it]
 16%|█▋        | 6226/37963 [15:24:56<69:30:02,  7.88s/it]
 16%|█▋        | 6227/37963 [15:25:04<68:58:40,  7.82s/it]
 16%|█▋        | 6228/37963 [15:25:18<86:18:11,  9.79s/it]
 16%|█▋        | 6229/37963 [15:25:26<80:32:01,  9.14s/it]
 16%|█▋        | 6230/37963 [15:25:34<76:36:58,  8.69s/it]
                                                          
{'loss': '0.1686', 'grad_norm': '1.186', 'learning_rate': '1.907e-05', 'epoch': '0.1641'}
+
 16%|█▋        | 6230/37963 [15:25:34<76:36:58,  8.69s/it]
 16%|█▋        | 6231/37963 [15:25:41<73:48:56,  8.37s/it]
 16%|█▋        | 6232/37963 [15:25:49<71:57:50,  8.16s/it]
 16%|█▋        | 6233/37963 [15:25:57<70:29:00,  8.00s/it]
 16%|█▋        | 6234/37963 [15:26:04<69:46:02,  7.92s/it]
 16%|█▋        | 6235/37963 [15:26:12<69:23:01,  7.87s/it]
 16%|█▋        | 6236/37963 [15:26:20<68:43:09,  7.80s/it]
 16%|█▋        | 6237/37963 [15:26:27<68:18:30,  7.75s/it]
 16%|█▋        | 6238/37963 [15:26:42<86:42:30,  9.84s/it]
 16%|█▋        | 6239/37963 [15:26:50<81:49:18,  9.29s/it]
 16%|█▋        | 6240/37963 [15:27:04<94:23:22, 10.71s/it]
                                                          
{'loss': '0.1601', 'grad_norm': '1.189', 'learning_rate': '1.907e-05', 'epoch': '0.1644'}
+
 16%|█▋        | 6240/37963 [15:27:04<94:23:22, 10.71s/it]
 16%|█▋        | 6241/37963 [15:27:12<86:45:52,  9.85s/it]
 16%|█▋        | 6242/37963 [15:27:20<81:16:29,  9.22s/it]
 16%|█▋        | 6243/37963 [15:27:28<77:39:29,  8.81s/it]
 16%|█▋        | 6244/37963 [15:27:35<74:50:11,  8.49s/it]
 16%|█▋        | 6245/37963 [15:27:43<72:35:12,  8.24s/it]
 16%|█▋        | 6246/37963 [15:27:51<71:07:38,  8.07s/it]
 16%|█▋        | 6247/37963 [15:27:58<69:36:50,  7.90s/it]
 16%|█▋        | 6248/37963 [15:28:06<69:00:11,  7.83s/it]
 16%|█▋        | 6249/37963 [15:28:13<67:30:53,  7.66s/it]
 16%|█▋        | 6250/37963 [15:28:28<87:12:19,  9.90s/it]
                                                          
{'loss': '0.1682', 'grad_norm': '4.977', 'learning_rate': '1.906e-05', 'epoch': '0.1646'}
+
 16%|█▋        | 6250/37963 [15:28:28<87:12:19,  9.90s/it]
 16%|█▋        | 6251/37963 [15:28:36<80:50:41,  9.18s/it]
 16%|█▋        | 6252/37963 [15:28:43<76:44:31,  8.71s/it]
 16%|█▋        | 6253/37963 [15:28:51<73:37:38,  8.36s/it]
 16%|█▋        | 6254/37963 [15:28:58<71:39:20,  8.14s/it]
 16%|█▋        | 6255/37963 [15:29:06<70:28:05,  8.00s/it]
 16%|█▋        | 6256/37963 [15:29:14<69:33:32,  7.90s/it]
 16%|█▋        | 6257/37963 [15:29:21<69:03:42,  7.84s/it]
 16%|█▋        | 6258/37963 [15:29:35<85:19:36,  9.69s/it]
 16%|█▋        | 6259/37963 [15:29:50<98:08:14, 11.14s/it]
 16%|█▋        | 6260/37963 [15:29:58<89:04:56, 10.12s/it]
                                                          
{'loss': '0.1662', 'grad_norm': '1.737', 'learning_rate': '1.906e-05', 'epoch': '0.1649'}
+
 16%|█▋        | 6260/37963 [15:29:58<89:04:56, 10.12s/it]
 16%|█▋        | 6261/37963 [15:30:05<82:34:35,  9.38s/it]
 16%|█▋        | 6262/37963 [15:30:13<77:35:05,  8.81s/it]
 16%|█▋        | 6263/37963 [15:30:21<74:30:18,  8.46s/it]
 17%|█▋        | 6264/37963 [15:30:28<72:21:47,  8.22s/it]
 17%|█▋        | 6265/37963 [15:30:43<90:09:54, 10.24s/it]
 17%|█▋        | 6266/37963 [15:30:58<102:05:06, 11.59s/it]
 17%|█▋        | 6267/37963 [15:31:06<92:09:05, 10.47s/it] 
 17%|█▋        | 6268/37963 [15:31:13<84:35:37,  9.61s/it]
 17%|█▋        | 6269/37963 [15:31:21<78:45:29,  8.95s/it]
 17%|█▋        | 6270/37963 [15:31:28<75:34:56,  8.59s/it]
                                                          
{'loss': '0.184', 'grad_norm': '1.809', 'learning_rate': '1.906e-05', 'epoch': '0.1652'}
+
 17%|█▋        | 6270/37963 [15:31:28<75:34:56,  8.59s/it]
 17%|█▋        | 6271/37963 [15:31:36<72:47:54,  8.27s/it]
 17%|█▋        | 6272/37963 [15:31:44<71:16:48,  8.10s/it]
 17%|█▋        | 6273/37963 [15:31:51<70:12:50,  7.98s/it]
 17%|█▋        | 6274/37963 [15:32:05<86:15:49,  9.80s/it]
 17%|█▋        | 6275/37963 [15:32:13<80:31:36,  9.15s/it]
 17%|█▋        | 6276/37963 [15:32:21<76:24:20,  8.68s/it]
 17%|█▋        | 6277/37963 [15:32:28<73:51:31,  8.39s/it]
 17%|█▋        | 6278/37963 [15:32:36<71:53:04,  8.17s/it]
 17%|█▋        | 6279/37963 [15:32:44<70:31:31,  8.01s/it]
 17%|█▋        | 6280/37963 [15:32:52<70:33:36,  8.02s/it]
                                                          
{'loss': '0.1797', 'grad_norm': '1.985', 'learning_rate': '1.905e-05', 'epoch': '0.1654'}
+
 17%|█▋        | 6280/37963 [15:32:52<70:33:36,  8.02s/it]
 17%|█▋        | 6281/37963 [15:32:59<69:43:30,  7.92s/it]
 17%|█▋        | 6282/37963 [15:33:07<68:47:45,  7.82s/it]
 17%|█▋        | 6283/37963 [15:33:22<87:15:48,  9.92s/it]
 17%|█▋        | 6284/37963 [15:33:36<99:30:57, 11.31s/it]
 17%|█▋        | 6285/37963 [15:33:44<90:07:22, 10.24s/it]
 17%|█▋        | 6286/37963 [15:33:52<82:55:29,  9.42s/it]
 17%|█▋        | 6287/37963 [15:33:59<76:33:20,  8.70s/it]
 17%|█▋        | 6288/37963 [15:34:06<73:28:50,  8.35s/it]
 17%|█▋        | 6289/37963 [15:34:14<70:57:23,  8.06s/it]
 17%|█▋        | 6290/37963 [15:34:21<70:05:29,  7.97s/it]
                                                          
{'loss': '0.1734', 'grad_norm': '5.202', 'learning_rate': '1.905e-05', 'epoch': '0.1657'}
+
 17%|█▋        | 6290/37963 [15:34:21<70:05:29,  7.97s/it]
 17%|█▋        | 6291/37963 [15:34:29<69:15:38,  7.87s/it]
 17%|█▋        | 6292/37963 [15:34:37<68:42:05,  7.81s/it]
 17%|█▋        | 6293/37963 [15:34:44<68:14:33,  7.76s/it]
 17%|█▋        | 6294/37963 [15:34:52<68:30:04,  7.79s/it]
 17%|█▋        | 6295/37963 [15:35:00<68:26:12,  7.78s/it]
 17%|█▋        | 6296/37963 [15:35:07<68:00:10,  7.73s/it]
 17%|█▋        | 6297/37963 [15:35:15<67:13:50,  7.64s/it]
 17%|█▋        | 6298/37963 [15:35:23<67:13:08,  7.64s/it]
 17%|█▋        | 6299/37963 [15:35:30<67:21:59,  7.66s/it]
 17%|█▋        | 6300/37963 [15:35:38<67:26:06,  7.67s/it]
                                                          
{'loss': '0.1542', 'grad_norm': '3.423', 'learning_rate': '1.905e-05', 'epoch': '0.166'}
+
 17%|█▋        | 6300/37963 [15:35:38<67:26:06,  7.67s/it]
 17%|█▋        | 6301/37963 [15:35:46<67:27:12,  7.67s/it]
 17%|█▋        | 6302/37963 [15:35:53<67:42:42,  7.70s/it]
 17%|█▋        | 6303/37963 [15:36:08<85:12:56,  9.69s/it]
 17%|█▋        | 6304/37963 [15:36:15<79:56:17,  9.09s/it]
 17%|█▋        | 6305/37963 [15:36:23<76:28:40,  8.70s/it]
 17%|█▋        | 6306/37963 [15:36:31<73:53:14,  8.40s/it]
 17%|█▋        | 6307/37963 [15:36:45<88:52:05, 10.11s/it]
 17%|█▋        | 6308/37963 [15:36:59<99:35:27, 11.33s/it]
 17%|█▋        | 6309/37963 [15:37:07<89:49:17, 10.22s/it]
 17%|█▋        | 6310/37963 [15:37:14<82:49:33,  9.42s/it]
                                                          
{'loss': '0.1616', 'grad_norm': '4.509', 'learning_rate': '1.904e-05', 'epoch': '0.1662'}
+
 17%|█▋        | 6310/37963 [15:37:14<82:49:33,  9.42s/it]
 17%|█▋        | 6311/37963 [15:37:30<98:06:45, 11.16s/it]
 17%|█▋        | 6312/37963 [15:37:45<109:35:17, 12.46s/it]
 17%|█▋        | 6313/37963 [15:37:53<97:02:24, 11.04s/it] 
 17%|█▋        | 6314/37963 [15:38:00<88:03:10, 10.02s/it]
 17%|█▋        | 6315/37963 [15:38:08<81:29:25,  9.27s/it]
 17%|█▋        | 6316/37963 [15:38:16<77:04:10,  8.77s/it]
 17%|█▋        | 6317/37963 [15:38:23<74:26:34,  8.47s/it]
 17%|█▋        | 6318/37963 [15:38:31<72:14:44,  8.22s/it]
 17%|█▋        | 6319/37963 [15:38:39<71:11:12,  8.10s/it]
 17%|█▋        | 6320/37963 [15:38:46<70:03:11,  7.97s/it]
                                                          
{'loss': '0.1601', 'grad_norm': '2.083', 'learning_rate': '1.904e-05', 'epoch': '0.1665'}
+
 17%|█▋        | 6320/37963 [15:38:46<70:03:11,  7.97s/it]
 17%|█▋        | 6321/37963 [15:39:01<86:41:06,  9.86s/it]
 17%|█▋        | 6322/37963 [15:39:09<81:32:58,  9.28s/it]
 17%|█▋        | 6323/37963 [15:39:16<77:34:39,  8.83s/it]
 17%|█▋        | 6324/37963 [15:39:24<74:11:15,  8.44s/it]
 17%|█▋        | 6325/37963 [15:39:32<72:05:35,  8.20s/it]
 17%|█▋        | 6326/37963 [15:39:39<70:40:29,  8.04s/it]
 17%|█▋        | 6327/37963 [15:39:47<69:36:21,  7.92s/it]
 17%|█▋        | 6328/37963 [15:39:55<69:11:11,  7.87s/it]
 17%|█▋        | 6329/37963 [15:40:02<67:26:45,  7.68s/it]
 17%|█▋        | 6330/37963 [15:40:09<67:17:47,  7.66s/it]
                                                          
{'loss': '0.1757', 'grad_norm': '3.094', 'learning_rate': '1.904e-05', 'epoch': '0.1667'}
+
 17%|█▋        | 6330/37963 [15:40:09<67:17:47,  7.66s/it]
 17%|█▋        | 6331/37963 [15:40:25<87:21:59,  9.94s/it]
 17%|█▋        | 6332/37963 [15:40:32<81:13:29,  9.24s/it]
 17%|█▋        | 6333/37963 [15:40:47<94:40:30, 10.78s/it]
 17%|█▋        | 6334/37963 [15:40:55<86:55:52,  9.89s/it]
 17%|█▋        | 6335/37963 [15:41:02<80:55:07,  9.21s/it]
 17%|█▋        | 6336/37963 [15:41:10<77:11:37,  8.79s/it]
 17%|█▋        | 6337/37963 [15:41:18<73:58:35,  8.42s/it]
 17%|█▋        | 6338/37963 [15:41:25<72:02:47,  8.20s/it]
 17%|█▋        | 6339/37963 [15:41:33<70:40:16,  8.05s/it]
 17%|█▋        | 6340/37963 [15:41:41<69:40:41,  7.93s/it]
                                                          
{'loss': '0.1574', 'grad_norm': '1.916', 'learning_rate': '1.903e-05', 'epoch': '0.167'}
+
 17%|█▋        | 6340/37963 [15:41:41<69:40:41,  7.93s/it]
 17%|█▋        | 6341/37963 [15:41:48<69:08:39,  7.87s/it]
 17%|█▋        | 6342/37963 [15:41:56<68:20:35,  7.78s/it]
 17%|█▋        | 6343/37963 [15:42:04<68:07:08,  7.76s/it]
 17%|█▋        | 6344/37963 [15:42:11<68:02:52,  7.75s/it]
 17%|█▋        | 6345/37963 [15:42:19<68:11:58,  7.77s/it]
 17%|█▋        | 6346/37963 [15:42:26<66:50:01,  7.61s/it]
 17%|█▋        | 6347/37963 [15:42:34<67:00:20,  7.63s/it]
 17%|█▋        | 6348/37963 [15:42:42<66:58:55,  7.63s/it]
 17%|█▋        | 6349/37963 [15:42:57<87:49:12, 10.00s/it]
 17%|█▋        | 6350/37963 [15:43:05<82:28:07,  9.39s/it]
                                                          
{'loss': '0.1583', 'grad_norm': '1.683', 'learning_rate': '1.903e-05', 'epoch': '0.1673'}
+
 17%|█▋        | 6350/37963 [15:43:05<82:28:07,  9.39s/it]
 17%|█▋        | 6351/37963 [15:43:13<77:58:43,  8.88s/it]
 17%|█▋        | 6352/37963 [15:43:20<74:02:59,  8.43s/it]
 17%|█▋        | 6353/37963 [15:43:28<71:30:31,  8.14s/it]
 17%|█▋        | 6354/37963 [15:43:42<88:38:11, 10.09s/it]
 17%|█▋        | 6355/37963 [15:43:50<82:18:44,  9.37s/it]
 17%|█▋        | 6356/37963 [15:43:58<77:43:08,  8.85s/it]
 17%|█▋        | 6357/37963 [15:44:19<110:09:18, 12.55s/it]
 17%|█▋        | 6358/37963 [15:44:26<97:13:12, 11.07s/it] 
 17%|█▋        | 6359/37963 [15:44:41<105:56:56, 12.07s/it]
 17%|█▋        | 6360/37963 [15:44:49<94:26:28, 10.76s/it] 
                                                          
{'loss': '0.1485', 'grad_norm': '1.925', 'learning_rate': '1.902e-05', 'epoch': '0.1675'}
+
 17%|█▋        | 6360/37963 [15:44:49<94:26:28, 10.76s/it]
 17%|█▋        | 6361/37963 [15:44:56<85:06:37,  9.70s/it]
 17%|█▋        | 6362/37963 [15:45:03<79:49:42,  9.09s/it]
 17%|█▋        | 6363/37963 [15:45:11<76:12:28,  8.68s/it]
 17%|█▋        | 6364/37963 [15:45:19<74:03:29,  8.44s/it]
 17%|█▋        | 6365/37963 [15:45:33<89:46:40, 10.23s/it]
 17%|█▋        | 6366/37963 [15:45:41<82:56:41,  9.45s/it]
 17%|█▋        | 6367/37963 [15:45:49<78:17:09,  8.92s/it]
 17%|█▋        | 6368/37963 [15:45:56<74:54:10,  8.53s/it]
 17%|█▋        | 6369/37963 [15:46:04<72:44:26,  8.29s/it]
 17%|█▋        | 6370/37963 [15:46:12<70:58:19,  8.09s/it]
                                                          
{'loss': '0.167', 'grad_norm': '2.846', 'learning_rate': '1.902e-05', 'epoch': '0.1678'}
+
 17%|█▋        | 6370/37963 [15:46:12<70:58:19,  8.09s/it]
 17%|█▋        | 6371/37963 [15:46:19<69:55:52,  7.97s/it]
 17%|█▋        | 6372/37963 [15:46:27<69:19:20,  7.90s/it]
 17%|█▋        | 6373/37963 [15:46:35<68:28:37,  7.80s/it]
 17%|█▋        | 6374/37963 [15:46:42<67:53:57,  7.74s/it]
 17%|█▋        | 6375/37963 [15:46:50<67:52:28,  7.74s/it]
 17%|█▋        | 6376/37963 [15:46:57<66:50:03,  7.62s/it]
 17%|█▋        | 6377/37963 [15:47:05<67:18:53,  7.67s/it]
 17%|█▋        | 6378/37963 [15:47:13<67:24:50,  7.68s/it]
 17%|█▋        | 6379/37963 [15:47:21<67:20:06,  7.67s/it]
 17%|█▋        | 6380/37963 [15:47:28<67:14:18,  7.66s/it]
                                                          
{'loss': '0.1597', 'grad_norm': '3.627', 'learning_rate': '1.902e-05', 'epoch': '0.1681'}
+
 17%|█▋        | 6380/37963 [15:47:28<67:14:18,  7.66s/it]
 17%|█▋        | 6381/37963 [15:47:36<67:26:30,  7.69s/it]
 17%|█▋        | 6382/37963 [15:47:50<85:08:08,  9.70s/it]
 17%|█▋        | 6383/37963 [15:47:58<79:42:18,  9.09s/it]
 17%|█▋        | 6384/37963 [15:48:06<75:39:59,  8.63s/it]
 17%|█▋        | 6385/37963 [15:48:13<73:25:04,  8.37s/it]
 17%|█▋        | 6386/37963 [15:48:21<71:29:33,  8.15s/it]
 17%|█▋        | 6387/37963 [15:48:35<86:46:04,  9.89s/it]
 17%|█▋        | 6388/37963 [15:48:43<80:38:17,  9.19s/it]
 17%|█▋        | 6389/37963 [15:48:50<76:53:52,  8.77s/it]
 17%|█▋        | 6390/37963 [15:48:58<73:44:07,  8.41s/it]
                                                          
{'loss': '0.1517', 'grad_norm': '2.921', 'learning_rate': '1.901e-05', 'epoch': '0.1683'}
+
 17%|█▋        | 6390/37963 [15:48:58<73:44:07,  8.41s/it]
 17%|█▋        | 6391/37963 [15:49:05<71:31:50,  8.16s/it]
 17%|█▋        | 6392/37963 [15:49:13<69:21:13,  7.91s/it]
 17%|█▋        | 6393/37963 [15:49:20<68:48:27,  7.85s/it]
 17%|█▋        | 6394/37963 [15:49:28<68:13:48,  7.78s/it]
 17%|█▋        | 6395/37963 [15:49:36<67:44:31,  7.73s/it]
 17%|█▋        | 6396/37963 [15:49:43<67:05:22,  7.65s/it]
 17%|█▋        | 6397/37963 [15:49:51<66:58:22,  7.64s/it]
 17%|█▋        | 6398/37963 [15:49:58<66:42:02,  7.61s/it]
 17%|█▋        | 6399/37963 [15:50:06<66:32:19,  7.59s/it]
 17%|█▋        | 6400/37963 [15:50:21<86:05:07,  9.82s/it]
                                                          
{'loss': '0.1606', 'grad_norm': '4.204', 'learning_rate': '1.901e-05', 'epoch': '0.1686'}
+
 17%|█▋        | 6400/37963 [15:50:21<86:05:07,  9.82s/it]
 17%|█▋        | 6401/37963 [15:50:28<80:05:04,  9.13s/it]
 17%|█▋        | 6402/37963 [15:50:42<92:20:19, 10.53s/it]
 17%|█▋        | 6403/37963 [15:50:56<102:12:06, 11.66s/it]
 17%|█▋        | 6404/37963 [15:51:04<92:21:34, 10.54s/it] 
 17%|█▋        | 6405/37963 [15:51:12<84:45:52,  9.67s/it]
 17%|█▋        | 6406/37963 [15:51:20<79:54:17,  9.12s/it]
 17%|█▋        | 6407/37963 [15:51:28<76:19:49,  8.71s/it]
 17%|█▋        | 6408/37963 [15:51:49<108:58:16, 12.43s/it]
 17%|█▋        | 6409/37963 [15:51:57<97:08:56, 11.08s/it] 
 17%|█▋        | 6410/37963 [15:52:04<88:10:26, 10.06s/it]
                                                          
{'loss': '0.1479', 'grad_norm': '1.44', 'learning_rate': '1.901e-05', 'epoch': '0.1688'}
+
 17%|█▋        | 6410/37963 [15:52:04<88:10:26, 10.06s/it]
 17%|█▋        | 6411/37963 [15:52:19<99:07:27, 11.31s/it]
 17%|█▋        | 6412/37963 [15:52:26<89:42:23, 10.24s/it]
 17%|█▋        | 6413/37963 [15:52:34<82:59:23,  9.47s/it]
 17%|█▋        | 6414/37963 [15:52:41<77:37:35,  8.86s/it]
 17%|█▋        | 6415/37963 [15:52:49<74:49:37,  8.54s/it]
 17%|█▋        | 6416/37963 [15:52:57<72:29:34,  8.27s/it]
 17%|█▋        | 6417/37963 [15:53:05<70:53:40,  8.09s/it]
 17%|█▋        | 6418/37963 [15:53:13<70:47:16,  8.08s/it]
 17%|█▋        | 6419/37963 [15:53:20<69:41:58,  7.95s/it]
 17%|█▋        | 6420/37963 [15:53:28<68:24:42,  7.81s/it]
                                                          
{'loss': '0.1552', 'grad_norm': '1.147', 'learning_rate': '1.9e-05', 'epoch': '0.1691'}
+
 17%|█▋        | 6420/37963 [15:53:28<68:24:42,  7.81s/it]
 17%|█▋        | 6421/37963 [15:53:35<67:59:24,  7.76s/it]
 17%|█▋        | 6422/37963 [15:53:43<67:22:08,  7.69s/it]
 17%|█▋        | 6423/37963 [15:53:51<67:37:11,  7.72s/it]
 17%|█▋        | 6424/37963 [15:53:58<67:21:42,  7.69s/it]
 17%|█▋        | 6425/37963 [15:54:06<67:25:01,  7.70s/it]
 17%|█▋        | 6426/37963 [15:54:13<66:46:30,  7.62s/it]
 17%|█▋        | 6427/37963 [15:54:21<66:59:17,  7.65s/it]
 17%|█▋        | 6428/37963 [15:54:29<66:44:59,  7.62s/it]
 17%|█▋        | 6429/37963 [15:54:36<66:45:02,  7.62s/it]
 17%|█▋        | 6430/37963 [15:54:44<66:44:29,  7.62s/it]
                                                          
{'loss': '0.1665', 'grad_norm': '3.838', 'learning_rate': '1.9e-05', 'epoch': '0.1694'}
+
 17%|█▋        | 6430/37963 [15:54:44<66:44:29,  7.62s/it]
 17%|█▋        | 6431/37963 [15:55:05<100:46:32, 11.51s/it]
 17%|█▋        | 6432/37963 [15:55:12<90:18:13, 10.31s/it] 
 17%|█▋        | 6433/37963 [15:55:20<83:30:28,  9.53s/it]
 17%|█▋        | 6434/37963 [15:55:27<78:04:11,  8.91s/it]
 17%|█▋        | 6435/37963 [15:55:35<74:48:56,  8.54s/it]
 17%|█▋        | 6436/37963 [15:55:43<72:27:43,  8.27s/it]
 17%|█▋        | 6437/37963 [15:55:50<70:43:18,  8.08s/it]
 17%|█▋        | 6438/37963 [15:55:58<70:29:39,  8.05s/it]
 17%|█▋        | 6439/37963 [15:56:06<69:00:18,  7.88s/it]
 17%|█▋        | 6440/37963 [15:56:13<68:26:45,  7.82s/it]
                                                          
{'loss': '0.1619', 'grad_norm': '1.974', 'learning_rate': '1.9e-05', 'epoch': '0.1696'}
+
 17%|█▋        | 6440/37963 [15:56:13<68:26:45,  7.82s/it]
 17%|█▋        | 6441/37963 [15:56:21<68:13:14,  7.79s/it]
 17%|█▋        | 6442/37963 [15:56:29<67:25:31,  7.70s/it]
 17%|█▋        | 6443/37963 [15:56:36<66:32:18,  7.60s/it]
 17%|█▋        | 6444/37963 [15:56:44<66:35:43,  7.61s/it]
 17%|█▋        | 6445/37963 [15:56:51<66:55:35,  7.64s/it]
 17%|█▋        | 6446/37963 [15:56:59<67:04:42,  7.66s/it]
 17%|█▋        | 6447/37963 [15:57:07<67:17:20,  7.69s/it]
 17%|█▋        | 6448/37963 [15:57:21<84:39:57,  9.67s/it]
 17%|█▋        | 6449/37963 [15:57:29<79:17:27,  9.06s/it]
 17%|█▋        | 6450/37963 [15:57:36<75:34:24,  8.63s/it]
                                                          
{'loss': '0.1671', 'grad_norm': '4.611', 'learning_rate': '1.899e-05', 'epoch': '0.1699'}
+
 17%|█▋        | 6450/37963 [15:57:36<75:34:24,  8.63s/it]
 17%|█▋        | 6451/37963 [15:57:44<73:31:31,  8.40s/it]
 17%|█▋        | 6452/37963 [15:57:59<90:14:49, 10.31s/it]
 17%|█▋        | 6453/37963 [15:58:07<83:54:20,  9.59s/it]
 17%|█▋        | 6454/37963 [15:58:14<78:54:34,  9.02s/it]
 17%|█▋        | 6455/37963 [15:58:29<94:12:46, 10.76s/it]
 17%|█▋        | 6456/37963 [15:58:43<103:06:15, 11.78s/it]
 17%|█▋        | 6457/37963 [15:59:05<127:51:20, 14.61s/it]
 17%|█▋        | 6458/37963 [15:59:12<108:39:36, 12.42s/it]
 17%|█▋        | 6459/37963 [15:59:20<95:55:49, 10.96s/it] 
 17%|█▋        | 6460/37963 [15:59:27<86:45:29,  9.91s/it]
                                                          
{'loss': '0.1898', 'grad_norm': '1.463', 'learning_rate': '1.899e-05', 'epoch': '0.1702'}
+
 17%|█▋        | 6460/37963 [15:59:27<86:45:29,  9.91s/it]
 17%|█▋        | 6461/37963 [15:59:35<80:54:59,  9.25s/it]
 17%|█▋        | 6462/37963 [15:59:42<76:17:56,  8.72s/it]
 17%|█▋        | 6463/37963 [15:59:50<73:16:54,  8.38s/it]
 17%|█▋        | 6464/37963 [15:59:57<71:20:23,  8.15s/it]
 17%|█▋        | 6465/37963 [16:00:05<69:51:50,  7.98s/it]
 17%|█▋        | 6466/37963 [16:00:13<69:03:43,  7.89s/it]
 17%|█▋        | 6467/37963 [16:00:21<68:50:52,  7.87s/it]
 17%|█▋        | 6468/37963 [16:00:28<68:19:36,  7.81s/it]
 17%|█▋        | 6469/37963 [16:00:36<67:55:33,  7.76s/it]
 17%|█▋        | 6470/37963 [16:00:43<67:16:21,  7.69s/it]
                                                          
{'loss': '0.1772', 'grad_norm': '5.11', 'learning_rate': '1.898e-05', 'epoch': '0.1704'}
+
 17%|█▋        | 6470/37963 [16:00:43<67:16:21,  7.69s/it]
 17%|█▋        | 6471/37963 [16:00:51<67:39:53,  7.74s/it]
 17%|█▋        | 6472/37963 [16:00:59<67:24:14,  7.71s/it]
 17%|█▋        | 6473/37963 [16:01:06<66:51:03,  7.64s/it]
 17%|█▋        | 6474/37963 [16:01:14<66:45:20,  7.63s/it]
 17%|█▋        | 6475/37963 [16:01:22<66:51:42,  7.64s/it]
 17%|█▋        | 6476/37963 [16:01:29<66:49:02,  7.64s/it]
 17%|█▋        | 6477/37963 [16:01:37<66:46:33,  7.63s/it]
 17%|█▋        | 6478/37963 [16:01:44<66:14:10,  7.57s/it]
 17%|█▋        | 6479/37963 [16:01:52<66:32:25,  7.61s/it]
 17%|█▋        | 6480/37963 [16:01:59<65:56:48,  7.54s/it]
                                                          
{'loss': '0.1698', 'grad_norm': '3.498', 'learning_rate': '1.898e-05', 'epoch': '0.1707'}
+
 17%|█▋        | 6480/37963 [16:01:59<65:56:48,  7.54s/it]
 17%|█▋        | 6481/37963 [16:02:07<66:10:54,  7.57s/it]
 17%|█▋        | 6482/37963 [16:02:22<84:58:10,  9.72s/it]
 17%|█▋        | 6483/37963 [16:02:29<79:27:30,  9.09s/it]
 17%|█▋        | 6484/37963 [16:02:37<75:29:32,  8.63s/it]
 17%|█▋        | 6485/37963 [16:02:51<90:53:36, 10.40s/it]
 17%|█▋        | 6486/37963 [16:02:59<83:36:54,  9.56s/it]
 17%|█▋        | 6487/37963 [16:03:07<78:10:35,  8.94s/it]
 17%|█▋        | 6488/37963 [16:03:14<73:53:37,  8.45s/it]
 17%|█▋        | 6489/37963 [16:03:21<71:08:56,  8.14s/it]
 17%|█▋        | 6490/37963 [16:03:29<69:47:06,  7.98s/it]
                                                          
{'loss': '0.1697', 'grad_norm': '4.421', 'learning_rate': '1.898e-05', 'epoch': '0.171'}
+
 17%|█▋        | 6490/37963 [16:03:29<69:47:06,  7.98s/it]
 17%|█▋        | 6491/37963 [16:03:36<68:48:15,  7.87s/it]
 17%|█▋        | 6492/37963 [16:03:44<67:28:58,  7.72s/it]
 17%|█▋        | 6493/37963 [16:03:58<85:12:58,  9.75s/it]
 17%|█▋        | 6494/37963 [16:04:06<79:30:46,  9.10s/it]
 17%|█▋        | 6495/37963 [16:04:14<75:41:33,  8.66s/it]
 17%|█▋        | 6496/37963 [16:04:21<73:32:32,  8.41s/it]
 17%|█▋        | 6497/37963 [16:04:29<71:23:18,  8.17s/it]
 17%|█▋        | 6498/37963 [16:04:36<69:21:12,  7.93s/it]
 17%|█▋        | 6499/37963 [16:04:44<68:11:36,  7.80s/it]
 17%|█▋        | 6500/37963 [16:04:52<67:57:22,  7.78s/it]
                                                          
{'loss': '0.1727', 'grad_norm': '2.544', 'learning_rate': '1.897e-05', 'epoch': '0.1712'}
+
 17%|█▋        | 6500/37963 [16:04:52<67:57:22,  7.78s/it]
 17%|█▋        | 6501/37963 [16:04:59<67:37:29,  7.74s/it]
 17%|█▋        | 6502/37963 [16:05:07<67:25:22,  7.72s/it]
 17%|█▋        | 6503/37963 [16:05:14<67:02:07,  7.67s/it]
 17%|█▋        | 6504/37963 [16:05:29<84:42:47,  9.69s/it]
 17%|█▋        | 6505/37963 [16:05:37<79:46:57,  9.13s/it]
 17%|█▋        | 6506/37963 [16:05:51<93:44:30, 10.73s/it]
 17%|█▋        | 6507/37963 [16:06:12<120:39:35, 13.81s/it]
 17%|█▋        | 6508/37963 [16:06:20<104:40:58, 11.98s/it]
 17%|█▋        | 6509/37963 [16:06:28<93:20:43, 10.68s/it] 
 17%|█▋        | 6510/37963 [16:06:42<102:36:56, 11.75s/it]
                                                           
{'loss': '0.163', 'grad_norm': '6.576', 'learning_rate': '1.897e-05', 'epoch': '0.1715'}
+
 17%|█▋        | 6510/37963 [16:06:42<102:36:56, 11.75s/it]
 17%|█▋        | 6511/37963 [16:06:50<92:13:47, 10.56s/it] 
 17%|█▋        | 6512/37963 [16:06:57<84:41:41,  9.69s/it]
 17%|█▋        | 6513/37963 [16:07:05<79:12:48,  9.07s/it]
 17%|█▋        | 6514/37963 [16:07:13<75:53:01,  8.69s/it]
 17%|█▋        | 6515/37963 [16:07:20<72:20:04,  8.28s/it]
 17%|█▋        | 6516/37963 [16:07:28<70:46:41,  8.10s/it]
 17%|█▋        | 6517/37963 [16:07:35<69:45:25,  7.99s/it]
 17%|█▋        | 6518/37963 [16:07:43<69:06:28,  7.91s/it]
 17%|█▋        | 6519/37963 [16:07:50<67:42:26,  7.75s/it]
 17%|█▋        | 6520/37963 [16:07:58<67:32:48,  7.73s/it]
                                                          
{'loss': '0.1695', 'grad_norm': '1.578', 'learning_rate': '1.897e-05', 'epoch': '0.1717'}
+
 17%|█▋        | 6520/37963 [16:07:58<67:32:48,  7.73s/it]
 17%|█▋        | 6521/37963 [16:08:06<67:24:12,  7.72s/it]
 17%|█▋        | 6522/37963 [16:08:13<66:42:43,  7.64s/it]
 17%|█▋        | 6523/37963 [16:08:21<66:52:26,  7.66s/it]
 17%|█▋        | 6524/37963 [16:08:29<66:48:29,  7.65s/it]
 17%|█▋        | 6525/37963 [16:08:36<67:19:08,  7.71s/it]
 17%|█▋        | 6526/37963 [16:08:44<66:25:20,  7.61s/it]
 17%|█▋        | 6527/37963 [16:08:52<66:46:55,  7.65s/it]
 17%|█▋        | 6528/37963 [16:08:59<66:09:49,  7.58s/it]
 17%|█▋        | 6529/37963 [16:09:07<66:38:24,  7.63s/it]
 17%|█▋        | 6530/37963 [16:09:14<66:39:42,  7.63s/it]
                                                          
{'loss': '0.1702', 'grad_norm': '1.941', 'learning_rate': '1.896e-05', 'epoch': '0.172'}
+
 17%|█▋        | 6530/37963 [16:09:14<66:39:42,  7.63s/it]
 17%|█▋        | 6531/37963 [16:09:29<85:32:41,  9.80s/it]
 17%|█▋        | 6532/37963 [16:09:37<80:14:59,  9.19s/it]
 17%|█▋        | 6533/37963 [16:09:45<76:10:56,  8.73s/it]
 17%|█▋        | 6534/37963 [16:09:52<72:48:15,  8.34s/it]
 17%|█▋        | 6535/37963 [16:09:59<70:20:18,  8.06s/it]
 17%|█▋        | 6536/37963 [16:10:14<86:38:25,  9.92s/it]
 17%|█▋        | 6537/37963 [16:10:28<98:29:43, 11.28s/it]
 17%|█▋        | 6538/37963 [16:10:36<88:54:39, 10.19s/it]
 17%|█▋        | 6539/37963 [16:10:43<81:38:03,  9.35s/it]
 17%|█���        | 6540/37963 [16:10:51<77:47:19,  8.91s/it]
                                                          
{'loss': '0.1716', 'grad_norm': '1.871', 'learning_rate': '1.896e-05', 'epoch': '0.1723'}
+
 17%|█▋        | 6540/37963 [16:10:51<77:47:19,  8.91s/it]
 17%|█▋        | 6541/37963 [16:10:59<74:10:00,  8.50s/it]
 17%|█▋        | 6542/37963 [16:11:06<71:43:00,  8.22s/it]
 17%|█▋        | 6543/37963 [16:11:14<69:24:16,  7.95s/it]
 17%|█▋        | 6544/37963 [16:11:21<67:43:24,  7.76s/it]
 17%|█▋        | 6545/37963 [16:11:29<67:38:17,  7.75s/it]
 17%|█▋        | 6546/37963 [16:11:36<67:28:22,  7.73s/it]
 17%|█▋        | 6547/37963 [16:11:44<67:30:21,  7.74s/it]
 17%|█▋        | 6548/37963 [16:11:52<67:08:51,  7.69s/it]
 17%|█▋        | 6549/37963 [16:11:59<66:44:09,  7.65s/it]
 17%|█▋        | 6550/37963 [16:12:13<84:04:20,  9.63s/it]
                                                          
{'loss': '0.1589', 'grad_norm': '1.175', 'learning_rate': '1.895e-05', 'epoch': '0.1725'}
+
 17%|█▋        | 6550/37963 [16:12:13<84:04:20,  9.63s/it]
 17%|█▋        | 6551/37963 [16:12:29<99:36:28, 11.42s/it]
 17%|█▋        | 6552/37963 [16:12:36<89:12:05, 10.22s/it]
 17%|█▋        | 6553/37963 [16:12:44<82:17:23,  9.43s/it]
 17%|█▋        | 6554/37963 [16:12:52<77:24:56,  8.87s/it]
 17%|█▋        | 6555/37963 [16:12:59<73:50:45,  8.46s/it]
 17%|█▋        | 6556/37963 [16:13:07<71:32:54,  8.20s/it]
 17%|█▋        | 6557/37963 [16:13:21<87:42:15, 10.05s/it]
 17%|█▋        | 6558/37963 [16:13:35<97:47:47, 11.21s/it]
 17%|█▋        | 6559/37963 [16:13:43<88:58:49, 10.20s/it]
 17%|█▋        | 6560/37963 [16:13:51<82:28:59,  9.46s/it]
                                                          
{'loss': '0.1813', 'grad_norm': '2.088', 'learning_rate': '1.895e-05', 'epoch': '0.1728'}
+
 17%|█▋        | 6560/37963 [16:13:51<82:28:59,  9.46s/it]
 17%|█▋        | 6561/37963 [16:14:05<94:28:40, 10.83s/it]
 17%|█▋        | 6562/37963 [16:14:12<86:17:00,  9.89s/it]
 17%|█▋        | 6563/37963 [16:14:20<80:29:24,  9.23s/it]
 17%|█▋        | 6564/37963 [16:14:28<76:32:38,  8.78s/it]
 17%|█▋        | 6565/37963 [16:14:35<73:31:30,  8.43s/it]
 17%|█▋        | 6566/37963 [16:14:43<71:28:13,  8.19s/it]
 17%|█▋        | 6567/37963 [16:14:51<70:16:20,  8.06s/it]
 17%|█▋        | 6568/37963 [16:14:58<69:08:33,  7.93s/it]
 17%|█▋        | 6569/37963 [16:15:06<68:28:40,  7.85s/it]
 17%|█▋        | 6570/37963 [16:15:14<67:51:54,  7.78s/it]
                                                          
{'loss': '0.1604', 'grad_norm': '1.609', 'learning_rate': '1.895e-05', 'epoch': '0.1731'}
+
 17%|█▋        | 6570/37963 [16:15:14<67:51:54,  7.78s/it]
 17%|█▋        | 6571/37963 [16:15:21<67:37:57,  7.76s/it]
 17%|█▋        | 6572/37963 [16:15:29<67:18:14,  7.72s/it]
 17%|█▋        | 6573/37963 [16:15:37<66:57:20,  7.68s/it]
 17%|█▋        | 6574/37963 [16:15:44<66:47:43,  7.66s/it]
 17%|█▋        | 6575/37963 [16:15:52<66:11:36,  7.59s/it]
 17%|█▋        | 6576/37963 [16:15:59<66:18:56,  7.61s/it]
 17%|█▋        | 6577/37963 [16:16:07<66:26:21,  7.62s/it]
 17%|█▋        | 6578/37963 [16:16:15<66:37:09,  7.64s/it]
 17%|█▋        | 6579/37963 [16:16:29<85:15:28,  9.78s/it]
 17%|█▋        | 6580/37963 [16:16:37<79:45:12,  9.15s/it]
                                                          
{'loss': '0.1723', 'grad_norm': '1.63', 'learning_rate': '1.894e-05', 'epoch': '0.1733'}
+
 17%|█▋        | 6580/37963 [16:16:37<79:45:12,  9.15s/it]
 17%|█▋        | 6581/37963 [16:16:45<75:48:28,  8.70s/it]
 17%|█▋        | 6582/37963 [16:16:52<73:23:46,  8.42s/it]
 17%|█▋        | 6583/37963 [16:17:06<87:15:10, 10.01s/it]
 17%|█▋        | 6584/37963 [16:17:14<81:38:38,  9.37s/it]
 17%|█▋        | 6585/37963 [16:17:21<76:38:32,  8.79s/it]
 17%|█▋        | 6586/37963 [16:17:29<73:19:12,  8.41s/it]
 17%|█▋        | 6587/37963 [16:17:36<70:53:54,  8.13s/it]
 17%|█▋        | 6588/37963 [16:17:44<69:28:41,  7.97s/it]
 17%|█▋        | 6589/37963 [16:17:52<68:47:33,  7.89s/it]
 17%|█▋        | 6590/37963 [16:18:06<85:31:28,  9.81s/it]
                                                          
{'loss': '0.1773', 'grad_norm': '3.357', 'learning_rate': '1.894e-05', 'epoch': '0.1736'}
+
 17%|█▋        | 6590/37963 [16:18:06<85:31:28,  9.81s/it]
 17%|█▋        | 6591/37963 [16:18:14<80:07:15,  9.19s/it]
 17%|█▋        | 6592/37963 [16:18:22<76:25:32,  8.77s/it]
 17%|█▋        | 6593/37963 [16:18:29<73:33:01,  8.44s/it]
 17%|█▋        | 6594/37963 [16:18:37<71:09:46,  8.17s/it]
 17%|█▋        | 6595/37963 [16:18:44<69:51:48,  8.02s/it]
 17%|█▋        | 6596/37963 [16:18:52<69:06:40,  7.93s/it]
 17%|█▋        | 6597/37963 [16:19:00<68:41:02,  7.88s/it]
 17%|█▋        | 6598/37963 [16:19:22<105:00:06, 12.05s/it]
 17%|█▋        | 6599/37963 [16:19:30<94:02:29, 10.79s/it] 
 17%|█▋        | 6600/37963 [16:19:37<85:56:40,  9.87s/it]
                                                          
{'loss': '0.1768', 'grad_norm': '1.341', 'learning_rate': '1.893e-05', 'epoch': '0.1739'}
+
 17%|█▋        | 6600/37963 [16:19:37<85:56:40,  9.87s/it]
 17%|█▋        | 6601/37963 [16:19:45<80:20:23,  9.22s/it]
 17%|█▋        | 6602/37963 [16:19:53<76:00:47,  8.73s/it]
 17%|█▋        | 6603/37963 [16:20:00<73:07:04,  8.39s/it]
 17%|█▋        | 6604/37963 [16:20:08<70:38:47,  8.11s/it]
 17%|█▋        | 6605/37963 [16:20:15<69:13:03,  7.95s/it]
 17%|█▋        | 6606/37963 [16:20:23<68:58:35,  7.92s/it]
 17%|█▋        | 6607/37963 [16:20:37<84:34:39,  9.71s/it]
 17%|█▋        | 6608/37963 [16:20:45<79:16:28,  9.10s/it]
 17%|█▋        | 6609/37963 [16:20:52<74:55:26,  8.60s/it]
 17%|█▋        | 6610/37963 [16:21:00<72:45:24,  8.35s/it]
                                                          
{'loss': '0.1609', 'grad_norm': '3.142', 'learning_rate': '1.893e-05', 'epoch': '0.1741'}
+
 17%|█▋        | 6610/37963 [16:21:00<72:45:24,  8.35s/it]
 17%|█▋        | 6611/37963 [16:21:08<70:57:10,  8.15s/it]
 17%|█▋        | 6612/37963 [16:21:29<105:25:24, 12.11s/it]
 17%|█▋        | 6613/37963 [16:21:37<93:44:50, 10.77s/it] 
 17%|█▋        | 6614/37963 [16:21:44<85:38:40,  9.84s/it]
 17%|█▋        | 6615/37963 [16:21:52<80:16:34,  9.22s/it]
 17%|█▋        | 6616/37963 [16:22:00<75:56:43,  8.72s/it]
 17%|█▋        | 6617/37963 [16:22:07<73:12:42,  8.41s/it]
 17%|█▋        | 6618/37963 [16:22:15<71:19:08,  8.19s/it]
 17%|█▋        | 6619/37963 [16:22:23<69:52:19,  8.03s/it]
 17%|█▋        | 6620/37963 [16:22:30<68:46:55,  7.90s/it]
                                                          
{'loss': '0.1663', 'grad_norm': '4.868', 'learning_rate': '1.893e-05', 'epoch': '0.1744'}
+
 17%|█▋        | 6620/37963 [16:22:30<68:46:55,  7.90s/it]
 17%|█▋        | 6621/37963 [16:22:38<68:09:01,  7.83s/it]
 17%|█▋        | 6622/37963 [16:22:45<67:12:57,  7.72s/it]
 17%|█▋        | 6623/37963 [16:22:53<67:02:09,  7.70s/it]
 17%|█▋        | 6624/37963 [16:23:00<66:41:28,  7.66s/it]
 17%|█▋        | 6625/37963 [16:23:08<66:26:02,  7.63s/it]
 17%|█▋        | 6626/37963 [16:23:16<66:28:51,  7.64s/it]
 17%|█▋        | 6627/37963 [16:23:30<84:51:40,  9.75s/it]
 17%|█▋        | 6628/37963 [16:23:38<79:27:48,  9.13s/it]
 17%|█▋        | 6629/37963 [16:23:46<75:15:22,  8.65s/it]
 17%|█▋        | 6630/37963 [16:23:53<72:38:28,  8.35s/it]
                                                          
{'loss': '0.1627', 'grad_norm': '3.491', 'learning_rate': '1.892e-05', 'epoch': '0.1746'}
+
 17%|█▋        | 6630/37963 [16:23:53<72:38:28,  8.35s/it]
 17%|█▋        | 6631/37963 [16:24:01<70:56:34,  8.15s/it]
 17%|█▋        | 6632/37963 [16:24:15<85:57:45,  9.88s/it]
 17%|█▋        | 6633/37963 [16:24:23<80:16:31,  9.22s/it]
 17%|█▋        | 6634/37963 [16:24:30<76:01:25,  8.74s/it]
 17%|█▋        | 6635/37963 [16:24:38<73:25:02,  8.44s/it]
 17%|█▋        | 6636/37963 [16:24:53<90:07:36, 10.36s/it]
 17%|█▋        | 6637/37963 [16:25:01<83:31:48,  9.60s/it]
 17%|█▋        | 6638/37963 [16:25:08<78:11:14,  8.99s/it]
 17%|█▋        | 6639/37963 [16:25:16<74:33:01,  8.57s/it]
 17%|█▋        | 6640/37963 [16:25:23<72:25:01,  8.32s/it]
                                                          
{'loss': '0.1746', 'grad_norm': '5.882', 'learning_rate': '1.892e-05', 'epoch': '0.1749'}
+
 17%|█▋        | 6640/37963 [16:25:23<72:25:01,  8.32s/it]
 17%|█▋        | 6641/37963 [16:25:31<70:40:00,  8.12s/it]
 17%|█▋        | 6642/37963 [16:25:45<86:43:21,  9.97s/it]
 17%|█▋        | 6643/37963 [16:25:53<81:05:31,  9.32s/it]
 18%|█▊        | 6644/37963 [16:26:01<77:22:26,  8.89s/it]
 18%|█▊        | 6645/37963 [16:26:08<73:04:15,  8.40s/it]
 18%|█▊        | 6646/37963 [16:26:24<90:53:22, 10.45s/it]
 18%|█▊        | 6647/37963 [16:26:31<83:43:49,  9.63s/it]
 18%|█▊        | 6648/37963 [16:26:39<78:17:11,  9.00s/it]
 18%|█▊        | 6649/37963 [16:26:47<75:07:30,  8.64s/it]
 18%|█▊        | 6650/37963 [16:26:54<73:03:53,  8.40s/it]
                                                          
{'loss': '0.1477', 'grad_norm': '1.042', 'learning_rate': '1.892e-05', 'epoch': '0.1752'}
+
 18%|█▊        | 6650/37963 [16:26:54<73:03:53,  8.40s/it]
 18%|█▊        | 6651/37963 [16:27:02<70:59:14,  8.16s/it]
 18%|█▊        | 6652/37963 [16:27:10<69:30:11,  7.99s/it]
 18%|█▊        | 6653/37963 [16:27:17<68:33:52,  7.88s/it]
 18%|█▊        | 6654/37963 [16:27:25<68:18:09,  7.85s/it]
 18%|█▊        | 6655/37963 [16:27:33<67:45:13,  7.79s/it]
 18%|█▊        | 6656/37963 [16:27:41<67:53:24,  7.81s/it]
 18%|█▊        | 6657/37963 [16:27:48<67:32:05,  7.77s/it]
 18%|█▊        | 6658/37963 [16:27:56<67:13:36,  7.73s/it]
 18%|█▊        | 6659/37963 [16:28:17<101:16:43, 11.65s/it]
 18%|█▊        | 6660/37963 [16:28:24<91:16:33, 10.50s/it] 
                                                          
{'loss': '0.1726', 'grad_norm': '4.726', 'learning_rate': '1.891e-05', 'epoch': '0.1754'}
+
 18%|█▊        | 6660/37963 [16:28:24<91:16:33, 10.50s/it]
 18%|█▊        | 6661/37963 [16:28:38<100:13:37, 11.53s/it]
 18%|█▊        | 6662/37963 [16:28:46<90:40:42, 10.43s/it] 
 18%|█▊        | 6663/37963 [16:28:54<83:37:21,  9.62s/it]
 18%|█▊        | 6664/37963 [16:29:02<78:34:15,  9.04s/it]
 18%|█▊        | 6665/37963 [16:29:09<75:10:25,  8.65s/it]
 18%|█▊        | 6666/37963 [16:29:17<72:37:21,  8.35s/it]
 18%|█▊        | 6667/37963 [16:29:25<70:43:49,  8.14s/it]
 18%|█▊        | 6668/37963 [16:29:32<69:24:18,  7.98s/it]
 18%|█▊        | 6669/37963 [16:29:40<67:41:28,  7.79s/it]
 18%|█▊        | 6670/37963 [16:29:47<67:46:06,  7.80s/it]
                                                          
{'loss': '0.169', 'grad_norm': '2.825', 'learning_rate': '1.891e-05', 'epoch': '0.1757'}
+
 18%|█▊        | 6670/37963 [16:29:47<67:46:06,  7.80s/it]
 18%|█▊        | 6671/37963 [16:29:55<67:26:23,  7.76s/it]
 18%|█▊        | 6672/37963 [16:30:03<66:56:36,  7.70s/it]
 18%|█▊        | 6673/37963 [16:30:10<66:18:52,  7.63s/it]
 18%|█▊        | 6674/37963 [16:30:18<66:28:01,  7.65s/it]
 18%|█▊        | 6675/37963 [16:30:26<66:34:23,  7.66s/it]
 18%|█▊        | 6676/37963 [16:30:41<85:38:34,  9.85s/it]
 18%|█▊        | 6677/37963 [16:30:48<80:01:52,  9.21s/it]
 18%|█▊        | 6678/37963 [16:30:56<75:56:23,  8.74s/it]
 18%|█▊        | 6679/37963 [16:31:04<73:08:59,  8.42s/it]
 18%|█▊        | 6680/37963 [16:31:18<88:47:44, 10.22s/it]
                                                          
{'loss': '0.169', 'grad_norm': '4.18', 'learning_rate': '1.89e-05', 'epoch': '0.176'}
+
 18%|█▊        | 6680/37963 [16:31:18<88:47:44, 10.22s/it]
 18%|█▊        | 6681/37963 [16:31:26<82:11:32,  9.46s/it]
 18%|█▊        | 6682/37963 [16:31:41<96:18:14, 11.08s/it]
 18%|█▊        | 6683/37963 [16:31:48<87:40:53, 10.09s/it]
 18%|█▊        | 6684/37963 [16:31:56<81:39:42,  9.40s/it]
 18%|█▊        | 6685/37963 [16:32:03<76:11:54,  8.77s/it]
 18%|█▊        | 6686/37963 [16:32:11<72:44:54,  8.37s/it]
 18%|█▊        | 6687/37963 [16:32:19<71:19:25,  8.21s/it]
 18%|█▊        | 6688/37963 [16:32:26<68:58:51,  7.94s/it]
 18%|█▊        | 6689/37963 [16:32:34<68:15:09,  7.86s/it]
 18%|█▊        | 6690/37963 [16:32:49<86:39:25,  9.98s/it]
                                                          
{'loss': '0.1777', 'grad_norm': '3.878', 'learning_rate': '1.89e-05', 'epoch': '0.1762'}
+
 18%|█▊        | 6690/37963 [16:32:49<86:39:25,  9.98s/it]
 18%|█▊        | 6691/37963 [16:32:56<80:48:22,  9.30s/it]
 18%|█▊        | 6692/37963 [16:33:04<76:03:36,  8.76s/it]
 18%|█▊        | 6693/37963 [16:33:11<73:03:40,  8.41s/it]
 18%|█▊        | 6694/37963 [16:33:19<71:16:49,  8.21s/it]
 18%|█▊        | 6695/37963 [16:33:26<69:04:23,  7.95s/it]
 18%|█▊        | 6696/37963 [16:33:34<68:23:32,  7.87s/it]
 18%|█▊        | 6697/37963 [16:33:42<67:20:10,  7.75s/it]
 18%|█▊        | 6698/37963 [16:33:49<67:16:52,  7.75s/it]
 18%|█▊        | 6699/37963 [16:34:04<85:27:00,  9.84s/it]
 18%|█▊        | 6700/37963 [16:34:12<80:41:29,  9.29s/it]
                                                          
{'loss': '0.169', 'grad_norm': '2.999', 'learning_rate': '1.89e-05', 'epoch': '0.1765'}
+
 18%|█▊        | 6700/37963 [16:34:12<80:41:29,  9.29s/it]
 18%|█▊        | 6701/37963 [16:34:20<76:32:52,  8.81s/it]
 18%|█▊        | 6702/37963 [16:34:27<73:08:52,  8.42s/it]
 18%|█▊        | 6703/37963 [16:34:35<70:41:01,  8.14s/it]
 18%|█▊        | 6704/37963 [16:34:42<69:25:31,  8.00s/it]
 18%|█▊        | 6705/37963 [16:34:57<85:57:55,  9.90s/it]
 18%|█▊        | 6706/37963 [16:35:04<80:03:34,  9.22s/it]
 18%|█▊        | 6707/37963 [16:35:19<93:44:56, 10.80s/it]
 18%|█▊        | 6708/37963 [16:35:27<85:52:35,  9.89s/it]
 18%|█▊        | 6709/37963 [16:35:34<80:03:44,  9.22s/it]
 18%|█▊        | 6710/37963 [16:35:42<76:01:19,  8.76s/it]
                                                          
{'loss': '0.1848', 'grad_norm': '2.529', 'learning_rate': '1.889e-05', 'epoch': '0.1768'}
+
 18%|█▊        | 6710/37963 [16:35:42<76:01:19,  8.76s/it]
 18%|█▊        | 6711/37963 [16:35:50<73:05:19,  8.42s/it]
 18%|█▊        | 6712/37963 [16:36:04<88:31:00, 10.20s/it]
 18%|█▊        | 6713/37963 [16:36:12<82:12:27,  9.47s/it]
 18%|█▊        | 6714/37963 [16:36:19<77:29:39,  8.93s/it]
 18%|█▊        | 6715/37963 [16:36:27<73:55:01,  8.52s/it]
 18%|█▊        | 6716/37963 [16:36:35<71:37:38,  8.25s/it]
 18%|█▊        | 6717/37963 [16:36:42<69:19:51,  7.99s/it]
 18%|█▊        | 6718/37963 [16:36:50<69:00:50,  7.95s/it]
 18%|█▊        | 6719/37963 [16:36:57<68:07:46,  7.85s/it]
 18%|█▊        | 6720/37963 [16:37:05<67:46:03,  7.81s/it]
                                                          
{'loss': '0.1643', 'grad_norm': '6.221', 'learning_rate': '1.889e-05', 'epoch': '0.177'}
+
 18%|█▊        | 6720/37963 [16:37:05<67:46:03,  7.81s/it]
 18%|█▊        | 6721/37963 [16:37:13<67:27:40,  7.77s/it]
 18%|█▊        | 6722/37963 [16:37:21<67:23:46,  7.77s/it]
 18%|█▊        | 6723/37963 [16:37:28<66:49:14,  7.70s/it]
 18%|█▊        | 6724/37963 [16:37:36<66:59:50,  7.72s/it]
 18%|█▊        | 6725/37963 [16:37:44<66:46:17,  7.70s/it]
 18%|█▊        | 6726/37963 [16:37:51<67:03:40,  7.73s/it]
 18%|█▊        | 6727/37963 [16:37:59<66:11:48,  7.63s/it]
 18%|█▊        | 6728/37963 [16:38:13<82:58:49,  9.56s/it]
 18%|█▊        | 6729/37963 [16:38:28<96:58:16, 11.18s/it]
 18%|█▊        | 6730/37963 [16:38:35<87:26:16, 10.08s/it]
                                                          
{'loss': '0.1683', 'grad_norm': '3.615', 'learning_rate': '1.888e-05', 'epoch': '0.1773'}
+
 18%|█▊        | 6730/37963 [16:38:35<87:26:16, 10.08s/it]
 18%|█▊        | 6731/37963 [16:38:43<81:13:50,  9.36s/it]
 18%|█▊        | 6732/37963 [16:38:50<76:23:18,  8.81s/it]
 18%|█▊        | 6733/37963 [16:38:58<73:19:13,  8.45s/it]
 18%|█▊        | 6734/37963 [16:39:06<70:50:57,  8.17s/it]
 18%|█▊        | 6735/37963 [16:39:13<68:28:50,  7.89s/it]
 18%|█▊        | 6736/37963 [16:39:28<87:24:25, 10.08s/it]
 18%|█▊        | 6737/37963 [16:39:36<81:04:22,  9.35s/it]
 18%|█▊        | 6738/37963 [16:39:43<76:38:44,  8.84s/it]
 18%|█▊        | 6739/37963 [16:39:51<73:39:59,  8.49s/it]
 18%|█▊        | 6740/37963 [16:39:58<70:56:35,  8.18s/it]
                                                          
{'loss': '0.1604', 'grad_norm': '3.591', 'learning_rate': '1.888e-05', 'epoch': '0.1775'}
+
 18%|█▊        | 6740/37963 [16:39:58<70:56:35,  8.18s/it]
 18%|█▊        | 6741/37963 [16:40:06<69:43:19,  8.04s/it]
 18%|█▊        | 6742/37963 [16:40:14<68:41:53,  7.92s/it]
 18%|█▊        | 6743/37963 [16:40:21<67:31:38,  7.79s/it]
 18%|█▊        | 6744/37963 [16:40:36<85:59:37,  9.92s/it]
 18%|█▊        | 6745/37963 [16:40:44<80:15:58,  9.26s/it]
 18%|█▊        | 6746/37963 [16:40:52<76:45:41,  8.85s/it]
 18%|█▊        | 6747/37963 [16:41:00<73:44:54,  8.51s/it]
 18%|█▊        | 6748/37963 [16:41:14<88:24:59, 10.20s/it]
 18%|█▊        | 6749/37963 [16:41:21<82:06:03,  9.47s/it]
 18%|█▊        | 6750/37963 [16:41:29<77:11:38,  8.90s/it]
                                                          
{'loss': '0.1754', 'grad_norm': '4.853', 'learning_rate': '1.888e-05', 'epoch': '0.1778'}
+
 18%|█▊        | 6750/37963 [16:41:29<77:11:38,  8.90s/it]
 18%|█▊        | 6751/37963 [16:41:37<74:08:08,  8.55s/it]
 18%|█▊        | 6752/37963 [16:41:44<71:47:18,  8.28s/it]
 18%|█▊        | 6753/37963 [16:41:59<88:16:28, 10.18s/it]
 18%|█▊        | 6754/37963 [16:42:07<81:41:20,  9.42s/it]
 18%|█▊        | 6755/37963 [16:42:21<94:28:11, 10.90s/it]
 18%|█▊        | 6756/37963 [16:42:29<86:18:52,  9.96s/it]
 18%|█▊        | 6757/37963 [16:42:36<80:19:18,  9.27s/it]
 18%|█▊        | 6758/37963 [16:42:51<93:14:18, 10.76s/it]
 18%|█▊        | 6759/37963 [16:42:58<85:28:06,  9.86s/it]
 18%|█▊        | 6760/37963 [16:43:06<79:51:06,  9.21s/it]
                                                          
{'loss': '0.1679', 'grad_norm': '3.026', 'learning_rate': '1.887e-05', 'epoch': '0.1781'}
+
 18%|█▊        | 6760/37963 [16:43:06<79:51:06,  9.21s/it]
 18%|█▊        | 6761/37963 [16:43:14<75:44:07,  8.74s/it]
 18%|█▊        | 6762/37963 [16:43:21<72:47:19,  8.40s/it]
 18%|█▊        | 6763/37963 [16:43:29<70:16:03,  8.11s/it]
 18%|█▊        | 6764/37963 [16:43:36<69:10:24,  7.98s/it]
 18%|█▊        | 6765/37963 [16:43:44<68:25:52,  7.90s/it]
 18%|█▊        | 6766/37963 [16:43:52<67:39:23,  7.81s/it]
 18%|█▊        | 6767/37963 [16:43:59<67:21:31,  7.77s/it]
 18%|█▊        | 6768/37963 [16:44:07<67:12:36,  7.76s/it]
 18%|█▊        | 6769/37963 [16:44:15<66:56:00,  7.72s/it]
 18%|█▊        | 6770/37963 [16:44:23<66:56:28,  7.73s/it]
                                                          
{'loss': '0.1614', 'grad_norm': '1.436', 'learning_rate': '1.887e-05', 'epoch': '0.1783'}
+
 18%|█▊        | 6770/37963 [16:44:23<66:56:28,  7.73s/it]
 18%|█▊        | 6771/37963 [16:44:30<66:45:11,  7.70s/it]
 18%|█▊        | 6772/37963 [16:44:44<83:13:28,  9.61s/it]
 18%|█▊        | 6773/37963 [16:44:59<96:39:45, 11.16s/it]
 18%|█▊        | 6774/37963 [16:45:07<87:32:58, 10.11s/it]
 18%|█▊        | 6775/37963 [16:45:14<80:21:19,  9.28s/it]
 18%|█▊        | 6776/37963 [16:45:22<76:21:50,  8.81s/it]
 18%|█▊        | 6777/37963 [16:45:29<73:16:58,  8.46s/it]
 18%|█▊        | 6778/37963 [16:45:37<70:56:35,  8.19s/it]
 18%|█▊        | 6779/37963 [16:45:44<69:03:42,  7.97s/it]
 18%|█▊        | 6780/37963 [16:45:52<67:35:32,  7.80s/it]
                                                          
{'loss': '0.166', 'grad_norm': '2.207', 'learning_rate': '1.886e-05', 'epoch': '0.1786'}
+
 18%|█▊        | 6780/37963 [16:45:52<67:35:32,  7.80s/it]
 18%|█▊        | 6781/37963 [16:46:00<67:16:24,  7.77s/it]
 18%|█▊        | 6782/37963 [16:46:07<66:50:29,  7.72s/it]
 18%|█▊        | 6783/37963 [16:46:15<66:34:58,  7.69s/it]
 18%|█▊        | 6784/37963 [16:46:22<66:10:11,  7.64s/it]
 18%|█▊        | 6785/37963 [16:46:30<66:37:31,  7.69s/it]
 18%|█▊        | 6786/37963 [16:46:38<66:32:37,  7.68s/it]
 18%|█▊        | 6787/37963 [16:46:53<85:23:25,  9.86s/it]
 18%|█▊        | 6788/37963 [16:47:00<79:46:47,  9.21s/it]
 18%|█▊        | 6789/37963 [16:47:08<75:39:13,  8.74s/it]
 18%|█▊        | 6790/37963 [16:47:16<72:41:08,  8.39s/it]
                                                          
{'loss': '0.1684', 'grad_norm': '5.601', 'learning_rate': '1.886e-05', 'epoch': '0.1789'}
+
 18%|█▊        | 6790/37963 [16:47:16<72:41:08,  8.39s/it]
 18%|█▊        | 6791/37963 [16:47:23<70:51:42,  8.18s/it]
 18%|█▊        | 6792/37963 [16:47:31<69:21:03,  8.01s/it]
 18%|█▊        | 6793/37963 [16:47:38<67:50:00,  7.83s/it]
 18%|█▊        | 6794/37963 [16:47:53<86:45:16, 10.02s/it]
 18%|█▊        | 6795/37963 [16:48:01<80:25:48,  9.29s/it]
 18%|█▊        | 6796/37963 [16:48:09<75:58:17,  8.78s/it]
 18%|█▊        | 6797/37963 [16:48:23<91:11:17, 10.53s/it]
 18%|█▊        | 6798/37963 [16:48:31<83:02:23,  9.59s/it]
 18%|█▊        | 6799/37963 [16:48:38<77:47:51,  8.99s/it]
 18%|█▊        | 6800/37963 [16:48:46<74:15:31,  8.58s/it]
                                                          
{'loss': '0.1675', 'grad_norm': '2.255', 'learning_rate': '1.886e-05', 'epoch': '0.1791'}
+
 18%|█▊        | 6800/37963 [16:48:46<74:15:31,  8.58s/it]
 18%|█▊        | 6801/37963 [16:48:54<71:58:41,  8.32s/it]
 18%|█▊        | 6802/37963 [16:49:01<70:30:16,  8.15s/it]
 18%|█▊        | 6803/37963 [16:49:09<69:22:47,  8.02s/it]
 18%|█▊        | 6804/37963 [16:49:17<68:53:10,  7.96s/it]
 18%|█▊        | 6805/37963 [16:49:30<83:30:17,  9.65s/it]
 18%|█▊        | 6806/37963 [16:49:38<78:23:29,  9.06s/it]
 18%|█▊        | 6807/37963 [16:49:59<109:32:29, 12.66s/it]
 18%|█▊        | 6808/37963 [16:50:07<96:33:03, 11.16s/it] 
 18%|█▊        | 6809/37963 [16:50:14<86:57:22, 10.05s/it]
 18%|█▊        | 6810/37963 [16:50:22<80:45:36,  9.33s/it]
                                                          
{'loss': '0.1689', 'grad_norm': '1.159', 'learning_rate': '1.885e-05', 'epoch': '0.1794'}
+
 18%|█▊        | 6810/37963 [16:50:22<80:45:36,  9.33s/it]
 18%|█▊        | 6811/37963 [16:50:30<76:13:19,  8.81s/it]
 18%|█▊        | 6812/37963 [16:50:37<73:12:58,  8.46s/it]
 18%|█▊        | 6813/37963 [16:50:45<70:21:49,  8.13s/it]
 18%|█▊        | 6814/37963 [16:50:52<68:32:07,  7.92s/it]
 18%|█▊        | 6815/37963 [16:51:06<83:08:36,  9.61s/it]
 18%|█▊        | 6816/37963 [16:51:13<78:24:02,  9.06s/it]
 18%|█▊        | 6817/37963 [16:51:21<74:36:22,  8.62s/it]
 18%|█▊        | 6818/37963 [16:51:28<71:56:58,  8.32s/it]
 18%|█▊        | 6819/37963 [16:51:36<70:31:10,  8.15s/it]
 18%|█▊        | 6820/37963 [16:51:44<69:24:51,  8.02s/it]
                                                          
{'loss': '0.1714', 'grad_norm': '2.894', 'learning_rate': '1.885e-05', 'epoch': '0.1796'}
+
 18%|█▊        | 6820/37963 [16:51:44<69:24:51,  8.02s/it]
 18%|█▊        | 6821/37963 [16:51:52<68:25:09,  7.91s/it]
 18%|█▊        | 6822/37963 [16:51:59<67:53:10,  7.85s/it]
 18%|█▊        | 6823/37963 [16:52:07<67:03:49,  7.75s/it]
 18%|█▊        | 6824/37963 [16:52:15<66:47:15,  7.72s/it]
 18%|█▊        | 6825/37963 [16:52:22<66:37:46,  7.70s/it]
 18%|█▊        | 6826/37963 [16:52:30<66:24:25,  7.68s/it]
 18%|█▊        | 6827/37963 [16:52:45<85:01:40,  9.83s/it]
 18%|█▊        | 6828/37963 [16:52:52<78:37:11,  9.09s/it]
 18%|█▊        | 6829/37963 [16:53:00<74:56:18,  8.67s/it]
 18%|█▊        | 6830/37963 [16:53:07<72:19:48,  8.36s/it]
                                                          
{'loss': '0.1604', 'grad_norm': '2.221', 'learning_rate': '1.884e-05', 'epoch': '0.1799'}
+
 18%|█▊        | 6830/37963 [16:53:07<72:19:48,  8.36s/it]
 18%|█▊        | 6831/37963 [16:53:15<70:29:55,  8.15s/it]
 18%|█▊        | 6832/37963 [16:53:30<88:03:12, 10.18s/it]
 18%|█▊        | 6833/37963 [16:53:38<81:50:26,  9.46s/it]
 18%|█▊        | 6834/37963 [16:53:45<77:12:17,  8.93s/it]
 18%|█▊        | 6835/37963 [16:53:53<74:11:16,  8.58s/it]
 18%|█▊        | 6836/37963 [16:54:01<71:58:24,  8.32s/it]
 18%|█▊        | 6837/37963 [16:54:08<70:04:29,  8.10s/it]
 18%|█▊        | 6838/37963 [16:54:23<87:02:42, 10.07s/it]
 18%|█▊        | 6839/37963 [16:54:31<81:01:55,  9.37s/it]
 18%|█▊        | 6840/37963 [16:54:38<76:25:44,  8.84s/it]
                                                          
{'loss': '0.1708', 'grad_norm': '2.512', 'learning_rate': '1.884e-05', 'epoch': '0.1802'}
+
 18%|█▊        | 6840/37963 [16:54:38<76:25:44,  8.84s/it]
 18%|█▊        | 6841/37963 [16:54:46<72:54:43,  8.43s/it]
 18%|█▊        | 6842/37963 [16:54:54<70:56:09,  8.21s/it]
 18%|█▊        | 6843/37963 [16:55:01<69:52:16,  8.08s/it]
 18%|█▊        | 6844/37963 [16:55:15<84:46:00,  9.81s/it]
 18%|█▊        | 6845/37963 [16:55:23<78:24:01,  9.07s/it]
 18%|█▊        | 6846/37963 [16:55:30<74:38:04,  8.63s/it]
 18%|█▊        | 6847/37963 [16:55:38<71:16:36,  8.25s/it]
 18%|█▊        | 6848/37963 [16:55:45<70:06:44,  8.11s/it]
 18%|█▊        | 6849/37963 [16:55:53<69:00:10,  7.98s/it]
 18%|█▊        | 6850/37963 [16:56:00<67:35:46,  7.82s/it]
                                                          
{'loss': '0.1773', 'grad_norm': '3.612', 'learning_rate': '1.884e-05', 'epoch': '0.1804'}
+
 18%|█▊        | 6850/37963 [16:56:00<67:35:46,  7.82s/it]
 18%|█▊        | 6851/37963 [16:56:15<84:23:49,  9.77s/it]
 18%|█▊        | 6852/37963 [16:56:22<79:00:05,  9.14s/it]
 18%|█▊        | 6853/37963 [16:56:37<92:32:03, 10.71s/it]
 18%|█▊        | 6854/37963 [16:56:51<102:32:29, 11.87s/it]
 18%|█▊        | 6855/37963 [16:56:59<91:42:31, 10.61s/it] 
 18%|█▊        | 6856/37963 [16:57:07<84:21:00,  9.76s/it]
 18%|█▊        | 6857/37963 [16:57:15<78:51:00,  9.13s/it]
 18%|█▊        | 6858/37963 [16:57:22<75:30:00,  8.74s/it]
 18%|█▊        | 6859/37963 [16:57:37<89:48:27, 10.39s/it]
 18%|█▊        | 6860/37963 [16:57:44<81:52:02,  9.48s/it]
                                                          
{'loss': '0.1768', 'grad_norm': '2.595', 'learning_rate': '1.883e-05', 'epoch': '0.1807'}
+
 18%|█▊        | 6860/37963 [16:57:44<81:52:02,  9.48s/it]
 18%|█▊        | 6861/37963 [16:57:52<76:59:34,  8.91s/it]
 18%|█▊        | 6862/37963 [16:57:59<73:08:56,  8.47s/it]
 18%|█▊        | 6863/37963 [16:58:06<70:02:14,  8.11s/it]
 18%|█▊        | 6864/37963 [16:58:14<68:25:54,  7.92s/it]
 18%|█▊        | 6865/37963 [16:58:21<68:02:33,  7.88s/it]
 18%|█▊        | 6866/37963 [16:58:29<67:31:01,  7.82s/it]
 18%|█▊        | 6867/37963 [16:58:37<67:10:53,  7.78s/it]
 18%|█▊        | 6868/37963 [16:58:45<67:24:37,  7.80s/it]
 18%|█▊        | 6869/37963 [16:58:52<66:58:30,  7.75s/it]
 18%|█▊        | 6870/37963 [16:59:00<66:42:12,  7.72s/it]
                                                          
{'loss': '0.1681', 'grad_norm': '2.12', 'learning_rate': '1.883e-05', 'epoch': '0.181'}
+
 18%|█▊        | 6870/37963 [16:59:00<66:42:12,  7.72s/it]
 18%|█▊        | 6871/37963 [16:59:08<66:51:09,  7.74s/it]
 18%|█▊        | 6872/37963 [16:59:16<66:53:52,  7.75s/it]
 18%|█▊        | 6873/37963 [16:59:30<85:21:32,  9.88s/it]
 18%|█▊        | 6874/37963 [16:59:38<79:43:36,  9.23s/it]
 18%|█▊        | 6875/37963 [16:59:46<75:39:39,  8.76s/it]
 18%|█▊        | 6876/37963 [16:59:54<73:26:57,  8.51s/it]
 18%|█▊        | 6877/37963 [17:00:01<71:15:14,  8.25s/it]
 18%|█▊        | 6878/37963 [17:00:09<69:05:17,  8.00s/it]
 18%|█▊        | 6879/37963 [17:00:16<68:10:08,  7.90s/it]
 18%|█▊        | 6880/37963 [17:00:31<86:41:46, 10.04s/it]
                                                          
{'loss': '0.1651', 'grad_norm': '1.393', 'learning_rate': '1.882e-05', 'epoch': '0.1812'}
+
 18%|█▊        | 6880/37963 [17:00:31<86:41:46, 10.04s/it]
 18%|█▊        | 6881/37963 [17:00:39<80:28:48,  9.32s/it]
 18%|█▊        | 6882/37963 [17:00:54<95:28:16, 11.06s/it]
 18%|█▊        | 6883/37963 [17:01:02<87:04:04, 10.09s/it]
 18%|█▊        | 6884/37963 [17:01:10<80:53:30,  9.37s/it]
 18%|█▊        | 6885/37963 [17:01:17<76:29:19,  8.86s/it]
 18%|█▊        | 6886/37963 [17:01:25<73:15:07,  8.49s/it]
 18%|█▊        | 6887/37963 [17:01:33<71:44:42,  8.31s/it]
 18%|█▊        | 6888/37963 [17:01:41<70:23:14,  8.15s/it]
 18%|█▊        | 6889/37963 [17:01:55<86:07:00,  9.98s/it]
 18%|█▊        | 6890/37963 [17:02:03<79:51:17,  9.25s/it]
                                                          
{'loss': '0.1627', 'grad_norm': '3.067', 'learning_rate': '1.882e-05', 'epoch': '0.1815'}
+
 18%|█▊        | 6890/37963 [17:02:03<79:51:17,  9.25s/it]
 18%|█▊        | 6891/37963 [17:02:10<75:41:15,  8.77s/it]
 18%|█▊        | 6892/37963 [17:02:18<72:59:46,  8.46s/it]
 18%|█▊        | 6893/37963 [17:02:25<70:47:14,  8.20s/it]
 18%|█▊        | 6894/37963 [17:02:33<69:12:14,  8.02s/it]
 18%|█▊        | 6895/37963 [17:02:41<68:35:58,  7.95s/it]
 18%|█▊        | 6896/37963 [17:02:49<68:01:06,  7.88s/it]
 18%|█▊        | 6897/37963 [17:02:56<67:24:46,  7.81s/it]
 18%|█▊        | 6898/37963 [17:03:10<83:36:41,  9.69s/it]
 18%|█▊        | 6899/37963 [17:03:18<78:19:35,  9.08s/it]
 18%|█▊        | 6900/37963 [17:03:25<74:13:39,  8.60s/it]
                                                          
{'loss': '0.1768', 'grad_norm': '2.982', 'learning_rate': '1.882e-05', 'epoch': '0.1818'}
+
 18%|█▊        | 6900/37963 [17:03:25<74:13:39,  8.60s/it]
 18%|█▊        | 6901/37963 [17:03:33<71:42:20,  8.31s/it]
 18%|���▊        | 6902/37963 [17:03:54<105:08:00, 12.19s/it]
 18%|█▊        | 6903/37963 [17:04:02<93:41:43, 10.86s/it] 
 18%|█▊        | 6904/37963 [17:04:10<85:06:55,  9.87s/it]
 18%|█▊        | 6905/37963 [17:04:17<79:26:40,  9.21s/it]
 18%|█▊        | 6906/37963 [17:04:25<75:39:58,  8.77s/it]
 18%|█▊        | 6907/37963 [17:04:39<90:12:47, 10.46s/it]
 18%|█▊        | 6908/37963 [17:04:47<82:40:13,  9.58s/it]
 18%|█▊        | 6909/37963 [17:04:55<77:44:47,  9.01s/it]
 18%|█▊        | 6910/37963 [17:05:02<74:27:45,  8.63s/it]
                                                          
{'loss': '0.1659', 'grad_norm': '1.915', 'learning_rate': '1.881e-05', 'epoch': '0.182'}
+
 18%|█▊        | 6910/37963 [17:05:02<74:27:45,  8.63s/it]
 18%|█▊        | 6911/37963 [17:05:10<71:06:51,  8.24s/it]
 18%|█▊        | 6912/37963 [17:05:17<69:36:02,  8.07s/it]
 18%|█▊        | 6913/37963 [17:05:25<68:38:05,  7.96s/it]
 18%|█▊        | 6914/37963 [17:05:33<67:59:27,  7.88s/it]
 18%|█▊        | 6915/37963 [17:05:40<67:12:03,  7.79s/it]
 18%|█▊        | 6916/37963 [17:05:48<66:50:48,  7.75s/it]
 18%|█▊        | 6917/37963 [17:06:03<85:42:30,  9.94s/it]
 18%|█▊        | 6918/37963 [17:06:11<80:27:31,  9.33s/it]
 18%|█▊        | 6919/37963 [17:06:19<76:38:23,  8.89s/it]
 18%|█▊        | 6920/37963 [17:06:26<72:51:51,  8.45s/it]
                                                          
{'loss': '0.1653', 'grad_norm': '1.466', 'learning_rate': '1.881e-05', 'epoch': '0.1823'}
+
 18%|█▊        | 6920/37963 [17:06:26<72:51:51,  8.45s/it]
 18%|█▊        | 6921/37963 [17:06:34<70:44:09,  8.20s/it]
 18%|█▊        | 6922/37963 [17:06:41<68:37:34,  7.96s/it]
 18%|█▊        | 6923/37963 [17:06:49<68:02:23,  7.89s/it]
 18%|█▊        | 6924/37963 [17:06:57<66:59:22,  7.77s/it]
 18%|█▊        | 6925/37963 [17:07:04<66:23:25,  7.70s/it]
 18%|█▊        | 6926/37963 [17:07:12<66:36:56,  7.73s/it]
 18%|█▊        | 6927/37963 [17:07:20<66:41:42,  7.74s/it]
 18%|█▊        | 6928/37963 [17:07:34<83:10:04,  9.65s/it]
 18%|█▊        | 6929/37963 [17:07:41<77:54:25,  9.04s/it]
 18%|█▊        | 6930/37963 [17:07:49<74:39:06,  8.66s/it]
                                                          
{'loss': '0.1709', 'grad_norm': '1.467', 'learning_rate': '1.88e-05', 'epoch': '0.1825'}
+
 18%|█▊        | 6930/37963 [17:07:49<74:39:06,  8.66s/it]
 18%|█▊        | 6931/37963 [17:07:57<72:04:43,  8.36s/it]
 18%|█▊        | 6932/37963 [17:08:18<105:40:16, 12.26s/it]
 18%|█▊        | 6933/37963 [17:08:26<94:00:59, 10.91s/it] 
 18%|█▊        | 6934/37963 [17:08:33<85:27:42,  9.92s/it]
 18%|█▊        | 6935/37963 [17:08:41<79:23:28,  9.21s/it]
 18%|█▊        | 6936/37963 [17:08:49<75:37:53,  8.78s/it]
 18%|█▊        | 6937/37963 [17:08:56<72:41:47,  8.44s/it]
 18%|█▊        | 6938/37963 [17:09:04<70:52:12,  8.22s/it]
 18%|█▊        | 6939/37963 [17:09:12<69:21:04,  8.05s/it]
 18%|█▊        | 6940/37963 [17:09:20<68:29:55,  7.95s/it]
                                                          
{'loss': '0.1681', 'grad_norm': '2.832', 'learning_rate': '1.88e-05', 'epoch': '0.1828'}
+
 18%|█▊        | 6940/37963 [17:09:20<68:29:55,  7.95s/it]
 18%|█▊        | 6941/37963 [17:09:27<67:32:20,  7.84s/it]
 18%|█▊        | 6942/37963 [17:09:42<84:42:49,  9.83s/it]
 18%|█▊        | 6943/37963 [17:09:49<78:45:36,  9.14s/it]
 18%|█▊        | 6944/37963 [17:09:57<74:47:21,  8.68s/it]
 18%|█▊        | 6945/37963 [17:10:04<72:24:30,  8.40s/it]
 18%|█▊        | 6946/37963 [17:10:12<70:23:14,  8.17s/it]
 18%|█▊        | 6947/37963 [17:10:20<69:13:27,  8.03s/it]
 18%|█▊        | 6948/37963 [17:10:27<68:09:07,  7.91s/it]
 18%|█▊        | 6949/37963 [17:10:43<88:02:49, 10.22s/it]
 18%|█▊        | 6950/37963 [17:10:57<98:33:17, 11.44s/it]
                                                          
{'loss': '0.161', 'grad_norm': '2.626', 'learning_rate': '1.88e-05', 'epoch': '0.1831'}
+
 18%|█▊        | 6950/37963 [17:10:57<98:33:17, 11.44s/it]
 18%|█▊        | 6951/37963 [17:11:05<88:44:56, 10.30s/it]
 18%|█▊        | 6952/37963 [17:11:12<81:06:32,  9.42s/it]
 18%|█▊        | 6953/37963 [17:11:20<76:45:38,  8.91s/it]
 18%|█▊        | 6954/37963 [17:11:28<73:49:20,  8.57s/it]
 18%|█▊        | 6955/37963 [17:11:42<87:52:22, 10.20s/it]
 18%|█▊        | 6956/37963 [17:11:50<82:12:59,  9.55s/it]
 18%|█▊        | 6957/37963 [17:11:57<77:14:53,  8.97s/it]
 18%|█▊        | 6958/37963 [17:12:05<73:53:28,  8.58s/it]
 18%|█▊        | 6959/37963 [17:12:13<71:23:55,  8.29s/it]
 18%|█▊        | 6960/37963 [17:12:20<69:23:00,  8.06s/it]
                                                          
{'loss': '0.1658', 'grad_norm': '2.916', 'learning_rate': '1.879e-05', 'epoch': '0.1833'}
+
 18%|█▊        | 6960/37963 [17:12:20<69:23:00,  8.06s/it]
 18%|█▊        | 6961/37963 [17:12:35<87:18:15, 10.14s/it]
 18%|█▊        | 6962/37963 [17:12:43<80:39:21,  9.37s/it]
 18%|█▊        | 6963/37963 [17:12:51<76:26:50,  8.88s/it]
 18%|█▊        | 6964/37963 [17:12:58<72:31:34,  8.42s/it]
 18%|█▊        | 6965/37963 [17:13:06<70:27:16,  8.18s/it]
 18%|█▊        | 6966/37963 [17:13:13<68:56:07,  8.01s/it]
 18%|█▊        | 6967/37963 [17:13:21<68:10:22,  7.92s/it]
 18%|█▊        | 6968/37963 [17:13:28<67:20:36,  7.82s/it]
 18%|█▊        | 6969/37963 [17:13:36<67:06:20,  7.79s/it]
 18%|█▊        | 6970/37963 [17:13:44<67:03:04,  7.79s/it]
                                                          
{'loss': '0.1617', 'grad_norm': '4.831', 'learning_rate': '1.879e-05', 'epoch': '0.1836'}
+
 18%|█▊        | 6970/37963 [17:13:44<67:03:04,  7.79s/it]
 18%|█▊        | 6971/37963 [17:13:51<66:17:27,  7.70s/it]
 18%|█▊        | 6972/37963 [17:13:59<66:19:24,  7.70s/it]
 18%|█▊        | 6973/37963 [17:14:07<66:11:34,  7.69s/it]
 18%|█▊        | 6974/37963 [17:14:14<65:24:03,  7.60s/it]
 18%|█▊        | 6975/37963 [17:14:22<65:34:57,  7.62s/it]
 18%|█▊        | 6976/37963 [17:14:37<83:45:41,  9.73s/it]
 18%|█▊        | 6977/37963 [17:14:44<78:36:22,  9.13s/it]
 18%|█▊        | 6978/37963 [17:14:58<90:53:39, 10.56s/it]
 18%|█▊        | 6979/37963 [17:15:06<84:00:30,  9.76s/it]
 18%|█▊        | 6980/37963 [17:15:14<78:38:31,  9.14s/it]
                                                          
{'loss': '0.1782', 'grad_norm': '2.051', 'learning_rate': '1.878e-05', 'epoch': '0.1839'}
+
 18%|█▊        | 6980/37963 [17:15:14<78:38:31,  9.14s/it]
 18%|█▊        | 6981/37963 [17:15:21<74:48:37,  8.69s/it]
 18%|█▊        | 6982/37963 [17:15:29<72:39:12,  8.44s/it]
 18%|█▊        | 6983/37963 [17:15:37<70:29:46,  8.19s/it]
 18%|█▊        | 6984/37963 [17:15:52<87:12:08, 10.13s/it]
 18%|█▊        | 6985/37963 [17:15:59<80:56:36,  9.41s/it]
 18%|█▊        | 6986/37963 [17:16:07<76:32:48,  8.90s/it]
 18%|█▊        | 6987/37963 [17:16:14<72:44:41,  8.45s/it]
 18%|█▊        | 6988/37963 [17:16:22<70:39:03,  8.21s/it]
 18%|█▊        | 6989/37963 [17:16:30<69:30:00,  8.08s/it]
 18%|█▊        | 6990/37963 [17:16:37<67:54:47,  7.89s/it]
                                                          
{'loss': '0.1725', 'grad_norm': '5.63', 'learning_rate': '1.878e-05', 'epoch': '0.1841'}
+
 18%|█▊        | 6990/37963 [17:16:37<67:54:47,  7.89s/it]
 18%|█▊        | 6991/37963 [17:16:45<67:14:49,  7.82s/it]
 18%|█▊        | 6992/37963 [17:16:53<66:57:07,  7.78s/it]
 18%|█▊        | 6993/37963 [17:17:14<102:05:01, 11.87s/it]
 18%|█▊        | 6994/37963 [17:17:22<91:23:09, 10.62s/it] 
 18%|█▊        | 6995/37963 [17:17:29<83:38:07,  9.72s/it]
 18%|█▊        | 6996/37963 [17:17:37<78:20:16,  9.11s/it]
 18%|█▊        | 6997/37963 [17:17:45<74:33:31,  8.67s/it]
 18%|█▊        | 6998/37963 [17:17:59<89:16:23, 10.38s/it]
 18%|█▊        | 6999/37963 [17:18:07<82:24:41,  9.58s/it]
 18%|█▊        | 7000/37963 [17:18:14<76:58:57,  8.95s/it]
                                                          
{'loss': '0.1722', 'grad_norm': '1.588', 'learning_rate': '1.878e-05', 'epoch': '0.1844'}
+
 18%|█▊        | 7000/37963 [17:18:14<76:58:57,  8.95s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.46s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.46s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 18%|█▊        | 7001/37963 [17:19:09<194:27:45, 22.61s/it]
 18%|█▊        | 7002/37963 [17:19:16<155:41:25, 18.10s/it]
 18%|█▊        | 7003/37963 [17:19:24<128:46:47, 14.97s/it]
 18%|█▊        | 7004/37963 [17:19:31<109:33:16, 12.74s/it]
 18%|█▊        | 7005/37963 [17:19:39<96:57:02, 11.27s/it] 
 18%|█▊        | 7006/37963 [17:19:47<87:49:07, 10.21s/it]
 18%|█▊        | 7007/37963 [17:19:55<81:11:13,  9.44s/it]
 18%|█▊        | 7008/37963 [17:20:09<93:02:12, 10.82s/it]
 18%|█▊        | 7009/37963 [17:20:17<85:07:23,  9.90s/it]
 18%|█▊        | 7010/37963 [17:20:24<79:39:05,  9.26s/it]
                                                          
{'loss': '0.1633', 'grad_norm': '3.471', 'learning_rate': '1.877e-05', 'epoch': '0.1847'}
+
 18%|█▊        | 7010/37963 [17:20:24<79:39:05,  9.26s/it]
 18%|█▊        | 7011/37963 [17:20:39<93:45:45, 10.91s/it]
 18%|█▊        | 7012/37963 [17:20:47<85:57:00, 10.00s/it]
 18%|█▊        | 7013/37963 [17:20:55<79:56:43,  9.30s/it]
 18%|█▊        | 7014/37963 [17:21:02<75:31:19,  8.78s/it]
 18%|█▊        | 7015/37963 [17:21:10<72:39:32,  8.45s/it]
 18%|█▊        | 7016/37963 [17:21:18<70:59:02,  8.26s/it]
 18%|█▊        | 7017/37963 [17:21:25<69:27:37,  8.08s/it]
 18%|█▊        | 7018/37963 [17:21:33<68:32:38,  7.97s/it]
 18%|���▊        | 7019/37963 [17:21:41<67:54:24,  7.90s/it]
 18%|█▊        | 7020/37963 [17:21:56<86:21:20, 10.05s/it]
                                                          
{'loss': '0.1659', 'grad_norm': '4.458', 'learning_rate': '1.877e-05', 'epoch': '0.1849'}
+
 18%|█▊        | 7020/37963 [17:21:56<86:21:20, 10.05s/it]
 18%|█▊        | 7021/37963 [17:22:03<80:06:27,  9.32s/it]
 18%|█▊        | 7022/37963 [17:22:11<75:48:33,  8.82s/it]
 18%|█▊        | 7023/37963 [17:22:19<73:11:59,  8.52s/it]
 19%|█▊        | 7024/37963 [17:22:27<71:27:06,  8.31s/it]
 19%|█▊        | 7025/37963 [17:22:34<69:48:55,  8.12s/it]
 19%|█▊        | 7026/37963 [17:22:42<68:52:45,  8.02s/it]
 19%|█▊        | 7027/37963 [17:22:50<68:11:31,  7.94s/it]
 19%|█▊        | 7028/37963 [17:23:04<84:18:55,  9.81s/it]
 19%|█▊        | 7029/37963 [17:23:12<78:50:11,  9.17s/it]
 19%|█▊        | 7030/37963 [17:23:20<75:19:27,  8.77s/it]
                                                          
{'loss': '0.1781', 'grad_norm': '3.456', 'learning_rate': '1.876e-05', 'epoch': '0.1852'}
+
 19%|█▊        | 7030/37963 [17:23:20<75:19:27,  8.77s/it]
 19%|█▊        | 7031/37963 [17:23:27<72:12:24,  8.40s/it]
 19%|█▊        | 7032/37963 [17:23:35<69:42:44,  8.11s/it]
 19%|█▊        | 7033/37963 [17:23:42<68:31:11,  7.98s/it]
 19%|█▊        | 7034/37963 [17:23:57<86:34:14, 10.08s/it]
 19%|█▊        | 7035/37963 [17:24:05<80:35:49,  9.38s/it]
 19%|█▊        | 7036/37963 [17:24:13<76:35:59,  8.92s/it]
 19%|█▊        | 7037/37963 [17:24:21<73:38:09,  8.57s/it]
 19%|█▊        | 7038/37963 [17:24:28<71:15:36,  8.30s/it]
 19%|█▊        | 7039/37963 [17:24:36<69:35:26,  8.10s/it]
 19%|█▊        | 7040/37963 [17:24:44<68:20:43,  7.96s/it]
                                                          
{'loss': '0.1714', 'grad_norm': '1.319', 'learning_rate': '1.876e-05', 'epoch': '0.1854'}
+
 19%|█▊        | 7040/37963 [17:24:44<68:20:43,  7.96s/it]
 19%|█▊        | 7041/37963 [17:24:58<84:56:30,  9.89s/it]
 19%|█▊        | 7042/37963 [17:25:12<96:46:59, 11.27s/it]
 19%|█▊        | 7043/37963 [17:25:20<87:50:53, 10.23s/it]
 19%|█▊        | 7044/37963 [17:25:28<80:34:31,  9.38s/it]
 19%|█▊        | 7045/37963 [17:25:42<94:21:44, 10.99s/it]
 19%|█▊        | 7046/37963 [17:25:50<85:41:28,  9.98s/it]
 19%|█▊        | 7047/37963 [17:25:57<78:52:27,  9.18s/it]
 19%|█▊        | 7048/37963 [17:26:05<75:08:13,  8.75s/it]
 19%|█▊        | 7049/37963 [17:26:13<72:24:41,  8.43s/it]
 19%|█▊        | 7050/37963 [17:26:20<70:38:29,  8.23s/it]
                                                          
{'loss': '0.1536', 'grad_norm': '2.316', 'learning_rate': '1.876e-05', 'epoch': '0.1857'}
+
 19%|█▊        | 7050/37963 [17:26:20<70:38:29,  8.23s/it]
 19%|█▊        | 7051/37963 [17:26:28<68:13:36,  7.95s/it]
 19%|█▊        | 7052/37963 [17:26:36<67:40:32,  7.88s/it]
 19%|█▊        | 7053/37963 [17:26:43<67:11:58,  7.83s/it]
 19%|█▊        | 7054/37963 [17:26:51<67:02:33,  7.81s/it]
 19%|█▊        | 7055/37963 [17:27:05<83:07:44,  9.68s/it]
 19%|█▊        | 7056/37963 [17:27:13<78:16:00,  9.12s/it]
 19%|█▊        | 7057/37963 [17:27:21<74:48:15,  8.71s/it]
 19%|█▊        | 7058/37963 [17:27:28<72:13:19,  8.41s/it]
 19%|█▊        | 7059/37963 [17:27:36<70:08:48,  8.17s/it]
 19%|█▊        | 7060/37963 [17:27:43<68:23:08,  7.97s/it]
                                                          
{'loss': '0.1774', 'grad_norm': '2.422', 'learning_rate': '1.875e-05', 'epoch': '0.186'}
+
 19%|█▊        | 7060/37963 [17:27:43<68:23:08,  7.97s/it]
 19%|█▊        | 7061/37963 [17:27:51<67:56:24,  7.91s/it]
 19%|█▊        | 7062/37963 [17:27:58<66:19:29,  7.73s/it]
 19%|█▊        | 7063/37963 [17:28:06<66:10:16,  7.71s/it]
 19%|█▊        | 7064/37963 [17:28:14<66:01:18,  7.69s/it]
 19%|█▊        | 7065/37963 [17:28:29<84:38:17,  9.86s/it]
 19%|█▊        | 7066/37963 [17:28:36<79:10:18,  9.22s/it]
 19%|█▊        | 7067/37963 [17:28:44<75:11:44,  8.76s/it]
 19%|█▊        | 7068/37963 [17:28:52<72:24:02,  8.44s/it]
 19%|█▊        | 7069/37963 [17:29:00<70:27:18,  8.21s/it]
 19%|█▊        | 7070/37963 [17:29:07<68:57:27,  8.04s/it]
                                                          
{'loss': '0.1684', 'grad_norm': '4.518', 'learning_rate': '1.875e-05', 'epoch': '0.1862'}
+
 19%|█▊        | 7070/37963 [17:29:07<68:57:27,  8.04s/it]
 19%|█▊        | 7071/37963 [17:29:22<86:37:01, 10.09s/it]
 19%|█▊        | 7072/37963 [17:29:30<80:20:57,  9.36s/it]
 19%|█▊        | 7073/37963 [17:29:37<75:54:13,  8.85s/it]
 19%|█▊        | 7074/37963 [17:29:45<72:09:41,  8.41s/it]
 19%|█▊        | 7075/37963 [17:29:52<70:28:01,  8.21s/it]
 19%|█▊        | 7076/37963 [17:30:00<69:02:55,  8.05s/it]
 19%|█▊        | 7077/37963 [17:30:08<67:16:23,  7.84s/it]
 19%|█▊        | 7078/37963 [17:30:22<83:07:59,  9.69s/it]
 19%|█▊        | 7079/37963 [17:30:29<78:15:37,  9.12s/it]
 19%|█▊        | 7080/37963 [17:30:37<74:30:59,  8.69s/it]
                                                          
{'loss': '0.1654', 'grad_norm': '1.736', 'learning_rate': '1.874e-05', 'epoch': '0.1865'}
+
 19%|█▊        | 7080/37963 [17:30:37<74:30:59,  8.69s/it]
 19%|█▊        | 7081/37963 [17:30:52<90:36:13, 10.56s/it]
 19%|█▊        | 7082/37963 [17:31:00<83:37:26,  9.75s/it]
 19%|█▊        | 7083/37963 [17:31:07<78:11:13,  9.12s/it]
 19%|█▊        | 7084/37963 [17:31:15<74:23:08,  8.67s/it]
 19%|█▊        | 7085/37963 [17:31:23<71:51:12,  8.38s/it]
 19%|█▊        | 7086/37963 [17:31:30<69:41:05,  8.12s/it]
 19%|█▊        | 7087/37963 [17:31:38<68:43:25,  8.01s/it]
 19%|█▊        | 7088/37963 [17:31:46<67:59:20,  7.93s/it]
 19%|█▊        | 7089/37963 [17:32:00<85:29:36,  9.97s/it]
 19%|█▊        | 7090/37963 [17:32:15<96:30:19, 11.25s/it]
                                                          
{'loss': '0.1783', 'grad_norm': '1.292', 'learning_rate': '1.874e-05', 'epoch': '0.1868'}
+
 19%|█▊        | 7090/37963 [17:32:15<96:30:19, 11.25s/it]
 19%|█▊        | 7091/37963 [17:32:23<88:01:11, 10.26s/it]
 19%|█▊        | 7092/37963 [17:32:30<81:14:16,  9.47s/it]
 19%|█▊        | 7093/37963 [17:32:38<76:39:33,  8.94s/it]
 19%|█▊        | 7094/37963 [17:32:45<72:48:22,  8.49s/it]
 19%|█▊        | 7095/37963 [17:32:53<70:35:05,  8.23s/it]
 19%|█▊        | 7096/37963 [17:33:00<68:25:59,  7.98s/it]
 19%|█▊        | 7097/37963 [17:33:15<85:40:55,  9.99s/it]
 19%|█▊        | 7098/37963 [17:33:23<79:50:07,  9.31s/it]
 19%|█▊        | 7099/37963 [17:33:30<75:27:32,  8.80s/it]
 19%|█▊        | 7100/37963 [17:33:38<72:17:46,  8.43s/it]
                                                          
{'loss': '0.1626', 'grad_norm': '3.802', 'learning_rate': '1.873e-05', 'epoch': '0.187'}
+
 19%|█▊        | 7100/37963 [17:33:38<72:17:46,  8.43s/it]
 19%|█▊        | 7101/37963 [17:33:46<70:54:53,  8.27s/it]
 19%|█▊        | 7102/37963 [17:33:53<68:53:52,  8.04s/it]
 19%|█▊        | 7103/37963 [17:34:08<85:50:47, 10.01s/it]
 19%|█▊        | 7104/37963 [17:34:16<79:56:35,  9.33s/it]
 19%|█▊        | 7105/37963 [17:34:24<75:53:52,  8.85s/it]
 19%|█▊        | 7106/37963 [17:34:31<72:43:40,  8.48s/it]
 19%|█▊        | 7107/37963 [17:34:39<70:14:02,  8.19s/it]
 19%|█▊        | 7108/37963 [17:34:46<68:26:32,  7.99s/it]
 19%|█▊        | 7109/37963 [17:34:54<67:07:38,  7.83s/it]
 19%|█▊        | 7110/37963 [17:35:01<66:59:13,  7.82s/it]
                                                          
{'loss': '0.1696', 'grad_norm': '5.147', 'learning_rate': '1.873e-05', 'epoch': '0.1873'}
+
 19%|█▊        | 7110/37963 [17:35:01<66:59:13,  7.82s/it]
 19%|█▊        | 7111/37963 [17:35:09<66:28:37,  7.76s/it]
 19%|█▊        | 7112/37963 [17:35:17<65:54:30,  7.69s/it]
 19%|█▊        | 7113/37963 [17:35:31<84:01:05,  9.80s/it]
 19%|█▊        | 7114/37963 [17:35:39<78:52:35,  9.20s/it]
 19%|█▊        | 7115/37963 [17:35:54<93:16:04, 10.88s/it]
 19%|█▊        | 7116/37963 [17:36:01<84:33:09,  9.87s/it]
 19%|█▊        | 7117/37963 [17:36:09<78:23:10,  9.15s/it]
 19%|█▊        | 7118/37963 [17:36:16<73:53:24,  8.62s/it]
 19%|█▉        | 7119/37963 [17:36:24<71:21:38,  8.33s/it]
 19%|█▉        | 7120/37963 [17:36:31<69:19:39,  8.09s/it]
                                                          
{'loss': '0.194', 'grad_norm': '4.269', 'learning_rate': '1.873e-05', 'epoch': '0.1876'}
+
 19%|█▉        | 7120/37963 [17:36:31<69:19:39,  8.09s/it]
 19%|█▉        | 7121/37963 [17:36:39<67:52:14,  7.92s/it]
 19%|█▉        | 7122/37963 [17:36:53<83:41:55,  9.77s/it]
 19%|█▉        | 7123/37963 [17:37:01<78:23:06,  9.15s/it]
 19%|█▉        | 7124/37963 [17:37:08<74:36:11,  8.71s/it]
 19%|█▉        | 7125/37963 [17:37:16<71:56:14,  8.40s/it]
 19%|█▉        | 7126/37963 [17:37:24<70:09:54,  8.19s/it]
 19%|█▉        | 7127/37963 [17:37:32<68:50:52,  8.04s/it]
 19%|█▉        | 7128/37963 [17:37:39<67:49:35,  7.92s/it]
 19%|█▉        | 7129/37963 [17:37:47<67:06:42,  7.84s/it]
 19%|█▉        | 7130/37963 [17:37:55<67:03:09,  7.83s/it]
                                                          
{'loss': '0.1739', 'grad_norm': '1.423', 'learning_rate': '1.872e-05', 'epoch': '0.1878'}
+
 19%|█▉        | 7130/37963 [17:37:55<67:03:09,  7.83s/it]
 19%|█▉        | 7131/37963 [17:38:02<66:37:16,  7.78s/it]
 19%|█▉        | 7132/37963 [17:38:10<66:15:48,  7.74s/it]
 19%|█▉        | 7133/37963 [17:38:25<84:26:57,  9.86s/it]
 19%|█▉        | 7134/37963 [17:38:33<79:08:20,  9.24s/it]
 19%|█▉        | 7135/37963 [17:38:40<75:00:21,  8.76s/it]
 19%|█▉        | 7136/37963 [17:38:48<72:13:46,  8.44s/it]
 19%|█▉        | 7137/37963 [17:39:02<87:09:03, 10.18s/it]
 19%|█▉        | 7138/37963 [17:39:17<98:30:23, 11.50s/it]
 19%|█▉        | 7139/37963 [17:39:24<88:33:45, 10.34s/it]
 19%|█▉        | 7140/37963 [17:39:32<81:35:09,  9.53s/it]
                                                          
{'loss': '0.1797', 'grad_norm': '2.412', 'learning_rate': '1.872e-05', 'epoch': '0.1881'}
+
 19%|█▉        | 7140/37963 [17:39:32<81:35:09,  9.53s/it]
 19%|█▉        | 7141/37963 [17:39:40<76:55:13,  8.98s/it]
 19%|█▉        | 7142/37963 [17:39:47<73:47:34,  8.62s/it]
 19%|█▉        | 7143/37963 [17:39:55<71:08:36,  8.31s/it]
 19%|█▉        | 7144/37963 [17:40:03<69:39:10,  8.14s/it]
 19%|█▉        | 7145/37963 [17:40:10<68:27:42,  8.00s/it]
 19%|█▉        | 7146/37963 [17:40:18<67:22:01,  7.87s/it]
 19%|█▉        | 7147/37963 [17:40:26<67:03:33,  7.83s/it]
 19%|█▉        | 7148/37963 [17:40:41<85:20:27,  9.97s/it]
 19%|█▉        | 7149/37963 [17:40:48<78:45:48,  9.20s/it]
 19%|█▉        | 7150/37963 [17:40:56<74:25:18,  8.69s/it]
                                                          
{'loss': '0.162', 'grad_norm': '2.764', 'learning_rate': '1.871e-05', 'epoch': '0.1883'}
+
 19%|█▉        | 7150/37963 [17:40:56<74:25:18,  8.69s/it]
 19%|█▉        | 7151/37963 [17:41:03<70:46:11,  8.27s/it]
 19%|█▉        | 7152/37963 [17:41:11<69:05:15,  8.07s/it]
 19%|█▉        | 7153/37963 [17:41:18<68:07:40,  7.96s/it]
 19%|█▉        | 7154/37963 [17:41:26<67:26:46,  7.88s/it]
 19%|█▉        | 7155/37963 [17:41:34<66:46:10,  7.80s/it]
 19%|█▉        | 7156/37963 [17:41:41<66:03:51,  7.72s/it]
 19%|█▉        | 7157/37963 [17:41:56<83:38:15,  9.77s/it]
 19%|█▉        | 7158/37963 [17:42:03<78:12:00,  9.14s/it]
 19%|█▉        | 7159/37963 [17:42:11<74:26:06,  8.70s/it]
 19%|█▉        | 7160/37963 [17:42:19<71:49:51,  8.40s/it]
                                                          
{'loss': '0.1859', 'grad_norm': '1.735', 'learning_rate': '1.871e-05', 'epoch': '0.1886'}
+
 19%|█▉        | 7160/37963 [17:42:19<71:49:51,  8.40s/it]
 19%|█▉        | 7161/37963 [17:42:33<88:19:25, 10.32s/it]
 19%|█▉        | 7162/37963 [17:42:41<81:30:56,  9.53s/it]
 19%|█▉        | 7163/37963 [17:42:49<77:08:40,  9.02s/it]
 19%|█▉        | 7164/37963 [17:43:04<92:20:55, 10.79s/it]
 19%|█▉        | 7165/37963 [17:43:18<100:37:59, 11.76s/it]
 19%|█▉        | 7166/37963 [17:43:26<91:02:44, 10.64s/it] 
 19%|█▉        | 7167/37963 [17:43:33<82:56:39,  9.70s/it]
 19%|█▉        | 7168/37963 [17:43:41<77:27:36,  9.06s/it]
 19%|█▉        | 7169/37963 [17:43:49<74:02:24,  8.66s/it]
 19%|█▉        | 7170/37963 [17:43:57<71:47:37,  8.39s/it]
                                                          
{'loss': '0.1657', 'grad_norm': '4.405', 'learning_rate': '1.871e-05', 'epoch': '0.1889'}
+
 19%|█▉        | 7170/37963 [17:43:57<71:47:37,  8.39s/it]
 19%|█▉        | 7171/37963 [17:44:04<69:51:11,  8.17s/it]
 19%|█▉        | 7172/37963 [17:44:12<68:55:54,  8.06s/it]
 19%|█▉        | 7173/37963 [17:44:20<67:42:01,  7.92s/it]
 19%|█▉        | 7174/37963 [17:44:27<67:02:33,  7.84s/it]
 19%|█▉        | 7175/37963 [17:44:35<66:36:26,  7.79s/it]
 19%|█▉        | 7176/37963 [17:44:43<66:29:23,  7.77s/it]
 19%|█▉        | 7177/37963 [17:44:50<66:20:08,  7.76s/it]
 19%|█▉        | 7178/37963 [17:44:58<65:50:54,  7.70s/it]
 19%|█▉        | 7179/37963 [17:45:06<65:52:24,  7.70s/it]
 19%|█▉        | 7180/37963 [17:45:13<65:52:39,  7.70s/it]
                                                          
{'loss': '0.1644', 'grad_norm': '2.991', 'learning_rate': '1.87e-05', 'epoch': '0.1891'}
+
 19%|█▉        | 7180/37963 [17:45:13<65:52:39,  7.70s/it]
 19%|█▉        | 7181/37963 [17:45:21<66:00:49,  7.72s/it]
 19%|█▉        | 7182/37963 [17:45:36<83:28:55,  9.76s/it]
 19%|█▉        | 7183/37963 [17:45:43<77:44:40,  9.09s/it]
 19%|█▉        | 7184/37963 [17:45:51<73:51:55,  8.64s/it]
 19%|█▉        | 7185/37963 [17:46:12<105:36:59, 12.35s/it]
 19%|█▉        | 7186/37963 [17:46:19<93:34:25, 10.95s/it] 
 19%|█▉        | 7187/37963 [17:46:27<84:39:46,  9.90s/it]
 19%|█▉        | 7188/37963 [17:46:35<79:00:39,  9.24s/it]
 19%|█▉        | 7189/37963 [17:46:42<74:48:27,  8.75s/it]
 19%|█▉        | 7190/37963 [17:46:50<72:15:17,  8.45s/it]
                                                          
{'loss': '0.1718', 'grad_norm': '3.122', 'learning_rate': '1.87e-05', 'epoch': '0.1894'}
+
 19%|█▉        | 7190/37963 [17:46:50<72:15:17,  8.45s/it]
 19%|█▉        | 7191/37963 [17:46:57<69:37:11,  8.14s/it]
 19%|█▉        | 7192/37963 [17:47:05<68:15:29,  7.99s/it]
 19%|█▉        | 7193/37963 [17:47:12<66:43:40,  7.81s/it]
 19%|█▉        | 7194/37963 [17:47:20<66:06:16,  7.73s/it]
 19%|█▉        | 7195/37963 [17:47:28<66:07:57,  7.74s/it]
 19%|█▉        | 7196/37963 [17:47:35<65:54:35,  7.71s/it]
 19%|█▉        | 7197/37963 [17:47:43<65:54:50,  7.71s/it]
 19%|█▉        | 7198/37963 [17:47:58<84:33:15,  9.89s/it]
 19%|█▉        | 7199/37963 [17:48:06<78:47:27,  9.22s/it]
 19%|█▉        | 7200/37963 [17:48:13<74:49:26,  8.76s/it]
                                                          
{'loss': '0.1604', 'grad_norm': '3.272', 'learning_rate': '1.869e-05', 'epoch': '0.1897'}
+
 19%|█▉        | 7200/37963 [17:48:13<74:49:26,  8.76s/it]
 19%|█▉        | 7201/37963 [17:48:21<72:12:51,  8.45s/it]
 19%|█▉        | 7202/37963 [17:48:29<70:09:10,  8.21s/it]
 19%|█▉        | 7203/37963 [17:48:36<68:45:53,  8.05s/it]
 19%|█▉        | 7204/37963 [17:48:51<84:16:30,  9.86s/it]
 19%|█▉        | 7205/37963 [17:49:06<98:08:14, 11.49s/it]
 19%|█▉        | 7206/37963 [17:49:13<88:16:45, 10.33s/it]
 19%|█▉        | 7207/37963 [17:49:21<81:17:30,  9.52s/it]
 19%|█▉        | 7208/37963 [17:49:29<76:24:04,  8.94s/it]
 19%|█▉        | 7209/37963 [17:49:43<89:41:56, 10.50s/it]
 19%|█▉        | 7210/37963 [17:49:50<81:58:50,  9.60s/it]
                                                          
{'loss': '0.173', 'grad_norm': '2.101', 'learning_rate': '1.869e-05', 'epoch': '0.1899'}
+
 19%|█▉        | 7210/37963 [17:49:50<81:58:50,  9.60s/it]
 19%|█▉        | 7211/37963 [17:49:58<76:58:51,  9.01s/it]
 19%|█▉        | 7212/37963 [17:50:05<73:20:11,  8.59s/it]
 19%|█▉        | 7213/37963 [17:50:13<70:41:27,  8.28s/it]
 19%|█▉        | 7214/37963 [17:50:28<88:11:08, 10.32s/it]
 19%|█▉        | 7215/37963 [17:50:36<81:13:34,  9.51s/it]
 19%|█▉        | 7216/37963 [17:50:43<75:47:41,  8.87s/it]
 19%|█▉        | 7217/37963 [17:50:51<72:45:17,  8.52s/it]
 19%|█▉        | 7218/37963 [17:50:58<70:22:35,  8.24s/it]
 19%|█▉        | 7219/37963 [17:51:06<68:20:12,  8.00s/it]
 19%|█▉        | 7220/37963 [17:51:13<67:19:31,  7.88s/it]
                                                          
{'loss': '0.1778', 'grad_norm': '1.653', 'learning_rate': '1.868e-05', 'epoch': '0.1902'}
+
 19%|█▉        | 7220/37963 [17:51:13<67:19:31,  7.88s/it]
 19%|█▉        | 7221/37963 [17:51:21<66:45:23,  7.82s/it]
 19%|█▉        | 7222/37963 [17:51:29<65:51:33,  7.71s/it]
 19%|█▉        | 7223/37963 [17:51:36<65:40:03,  7.69s/it]
 19%|█▉        | 7224/37963 [17:51:44<65:41:21,  7.69s/it]
 19%|█▉        | 7225/37963 [17:51:52<65:29:37,  7.67s/it]
 19%|█▉        | 7226/37963 [17:51:59<65:07:46,  7.63s/it]
 19%|█▉        | 7227/37963 [17:52:13<82:18:55,  9.64s/it]
 19%|█▉        | 7228/37963 [17:52:21<77:30:51,  9.08s/it]
 19%|█▉        | 7229/37963 [17:52:29<73:56:02,  8.66s/it]
 19%|█▉        | 7230/37963 [17:52:37<71:19:52,  8.36s/it]
                                                          
{'loss': '0.1658', 'grad_norm': '2.721', 'learning_rate': '1.868e-05', 'epoch': '0.1904'}
+
 19%|█▉        | 7230/37963 [17:52:37<71:19:52,  8.36s/it]
 19%|█▉        | 7231/37963 [17:52:44<69:44:07,  8.17s/it]
 19%|█▉        | 7232/37963 [17:52:52<67:39:57,  7.93s/it]
 19%|█▉        | 7233/37963 [17:52:59<66:29:36,  7.79s/it]
 19%|█▉        | 7234/37963 [17:53:07<66:17:33,  7.77s/it]
 19%|█▉        | 7235/37963 [17:53:14<65:36:10,  7.69s/it]
 19%|█▉        | 7236/37963 [17:53:22<65:27:00,  7.67s/it]
 19%|█▉        | 7237/37963 [17:53:37<84:07:09,  9.86s/it]
 19%|█▉        | 7238/37963 [17:53:45<78:32:03,  9.20s/it]
 19%|█▉        | 7239/37963 [17:53:59<91:13:38, 10.69s/it]
 19%|█▉        | 7240/37963 [17:54:07<84:08:37,  9.86s/it]
                                                          
{'loss': '0.164', 'grad_norm': '3.35', 'learning_rate': '1.868e-05', 'epoch': '0.1907'}
+
 19%|█▉        | 7240/37963 [17:54:07<84:08:37,  9.86s/it]
 19%|█▉        | 7241/37963 [17:54:14<78:13:19,  9.17s/it]
 19%|█▉        | 7242/37963 [17:54:29<92:22:16, 10.82s/it]
 19%|█▉        | 7243/37963 [17:54:37<84:33:52,  9.91s/it]
 19%|█▉        | 7244/37963 [17:54:44<78:32:14,  9.20s/it]
 19%|█▉        | 7245/37963 [17:54:52<74:49:22,  8.77s/it]
 19%|█▉        | 7246/37963 [17:55:00<72:00:43,  8.44s/it]
 19%|█▉        | 7247/37963 [17:55:07<69:56:17,  8.20s/it]
 19%|█▉        | 7248/37963 [17:55:21<85:01:51,  9.97s/it]
 19%|█▉        | 7249/37963 [17:55:29<79:07:00,  9.27s/it]
 19%|█▉        | 7250/37963 [17:55:37<74:36:33,  8.75s/it]
                                                          
{'loss': '0.1669', 'grad_norm': '2.214', 'learning_rate': '1.867e-05', 'epoch': '0.191'}
+
 19%|█▉        | 7250/37963 [17:55:37<74:36:33,  8.75s/it]
 19%|█▉        | 7251/37963 [17:55:44<71:42:00,  8.40s/it]
 19%|█▉        | 7252/37963 [17:55:59<87:25:59, 10.25s/it]
 19%|█▉        | 7253/37963 [17:56:06<80:54:13,  9.48s/it]
 19%|█▉        | 7254/37963 [17:56:14<76:13:14,  8.94s/it]
 19%|█▉        | 7255/37963 [17:56:22<73:22:17,  8.60s/it]
 19%|█▉        | 7256/37963 [17:56:30<71:08:40,  8.34s/it]
 19%|█▉        | 7257/37963 [17:56:37<69:32:43,  8.15s/it]
 19%|█▉        | 7258/37963 [17:56:59<104:10:45, 12.21s/it]
 19%|█▉        | 7259/37963 [17:57:07<92:35:18, 10.86s/it] 
 19%|█▉        | 7260/37963 [17:57:14<84:31:19,  9.91s/it]
                                                          
{'loss': '0.1705', 'grad_norm': '4.105', 'learning_rate': '1.867e-05', 'epoch': '0.1912'}
+
 19%|█▉        | 7260/37963 [17:57:14<84:31:19,  9.91s/it]
 19%|█▉        | 7261/37963 [17:57:22<79:00:56,  9.27s/it]
 19%|█▉        | 7262/37963 [17:57:30<75:19:45,  8.83s/it]
 19%|█▉        | 7263/37963 [17:57:38<72:27:58,  8.50s/it]
 19%|█▉        | 7264/37963 [17:57:45<70:15:29,  8.24s/it]
 19%|█▉        | 7265/37963 [17:57:53<68:48:51,  8.07s/it]
 19%|█▉        | 7266/37963 [17:58:00<66:49:56,  7.84s/it]
 19%|█▉        | 7267/37963 [17:58:08<66:29:40,  7.80s/it]
 19%|█▉        | 7268/37963 [17:58:16<66:17:55,  7.78s/it]
 19%|█▉        | 7269/37963 [17:58:24<66:19:13,  7.78s/it]
 19%|█▉        | 7270/37963 [17:58:31<65:54:31,  7.73s/it]
                                                          
{'loss': '0.1659', 'grad_norm': '1.92', 'learning_rate': '1.866e-05', 'epoch': '0.1915'}
+
 19%|█▉        | 7270/37963 [17:58:31<65:54:31,  7.73s/it]
 19%|█▉        | 7271/37963 [17:58:39<65:42:10,  7.71s/it]
 19%|█▉        | 7272/37963 [17:58:47<65:49:24,  7.72s/it]
 19%|█▉        | 7273/37963 [17:58:54<64:59:41,  7.62s/it]
 19%|█▉        | 7274/37963 [17:59:01<64:22:58,  7.55s/it]
 19%|█▉        | 7275/37963 [17:59:09<64:35:14,  7.58s/it]
 19%|█▉        | 7276/37963 [17:59:17<64:58:33,  7.62s/it]
 19%|█▉        | 7277/37963 [17:59:24<63:58:38,  7.51s/it]
 19%|█▉        | 7278/37963 [17:59:38<81:15:47,  9.53s/it]
 19%|█▉        | 7279/37963 [17:59:46<77:25:30,  9.08s/it]
 19%|█▉        | 7280/37963 [18:00:01<91:54:07, 10.78s/it]
                                                          
{'loss': '0.1633', 'grad_norm': '1.587', 'learning_rate': '1.866e-05', 'epoch': '0.1918'}
+
 19%|█▉        | 7280/37963 [18:00:01<91:54:07, 10.78s/it]
 19%|█▉        | 7281/37963 [18:00:09<83:55:35,  9.85s/it]
 19%|█▉        | 7282/37963 [18:00:16<78:33:42,  9.22s/it]
 19%|█▉        | 7283/37963 [18:00:30<90:50:12, 10.66s/it]
 19%|█▉        | 7284/37963 [18:00:38<82:59:34,  9.74s/it]
 19%|█▉        | 7285/37963 [18:00:46<77:32:15,  9.10s/it]
 19%|█▉        | 7286/37963 [18:00:53<73:30:49,  8.63s/it]
 19%|█▉        | 7287/37963 [18:01:01<70:38:23,  8.29s/it]
 19%|█▉        | 7288/37963 [18:01:08<69:07:58,  8.11s/it]
 19%|█▉        | 7289/37963 [18:01:16<67:58:15,  7.98s/it]
 19%|█▉        | 7290/37963 [18:01:24<67:00:15,  7.86s/it]
                                                          
{'loss': '0.173', 'grad_norm': '2.002', 'learning_rate': '1.865e-05', 'epoch': '0.192'}
+
 19%|█▉        | 7290/37963 [18:01:24<67:00:15,  7.86s/it]
 19%|█▉        | 7291/37963 [18:01:31<66:21:48,  7.79s/it]
 19%|█▉        | 7292/37963 [18:01:39<65:43:43,  7.71s/it]
 19%|█▉        | 7293/37963 [18:01:46<65:36:40,  7.70s/it]
 19%|█▉        | 7294/37963 [18:01:54<65:12:33,  7.65s/it]
 19%|█▉        | 7295/37963 [18:02:02<65:46:39,  7.72s/it]
 19%|█▉        | 7296/37963 [18:02:10<65:38:45,  7.71s/it]
 19%|█▉        | 7297/37963 [18:02:32<102:56:50, 12.09s/it]
 19%|█▉        | 7298/37963 [18:02:39<91:06:26, 10.70s/it] 
 19%|█▉        | 7299/37963 [18:02:47<83:18:51,  9.78s/it]
 19%|█▉        | 7300/37963 [18:03:01<94:42:12, 11.12s/it]
                                                          
{'loss': '0.167', 'grad_norm': '2.127', 'learning_rate': '1.865e-05', 'epoch': '0.1923'}
+
 19%|█▉        | 7300/37963 [18:03:01<94:42:12, 11.12s/it]
 19%|█▉        | 7301/37963 [18:03:15<102:30:16, 12.03s/it]
 19%|█▉        | 7302/37963 [18:03:23<90:58:32, 10.68s/it] 
 19%|█▉        | 7303/37963 [18:03:30<83:01:58,  9.75s/it]
 19%|█▉        | 7304/37963 [18:03:38<77:41:39,  9.12s/it]
 19%|█▉        | 7305/37963 [18:03:46<73:29:37,  8.63s/it]
 19%|█▉        | 7306/37963 [18:04:00<89:17:42, 10.49s/it]
 19%|█▉        | 7307/37963 [18:04:08<81:47:51,  9.61s/it]
 19%|█▉        | 7308/37963 [18:04:15<76:18:53,  8.96s/it]
 19%|█▉        | 7309/37963 [18:04:23<73:04:56,  8.58s/it]
 19%|█▉        | 7310/37963 [18:04:31<70:39:08,  8.30s/it]
                                                          
{'loss': '0.1594', 'grad_norm': '2.149', 'learning_rate': '1.865e-05', 'epoch': '0.1926'}
+
 19%|█▉        | 7310/37963 [18:04:31<70:39:08,  8.30s/it]
 19%|█▉        | 7311/37963 [18:04:38<69:07:53,  8.12s/it]
 19%|█▉        | 7312/37963 [18:04:46<67:49:45,  7.97s/it]
 19%|█▉        | 7313/37963 [18:04:54<67:06:11,  7.88s/it]
 19%|█▉        | 7314/37963 [18:05:01<65:37:33,  7.71s/it]
 19%|█▉        | 7315/37963 [18:05:09<65:37:36,  7.71s/it]
 19%|█▉        | 7316/37963 [18:05:17<65:55:28,  7.74s/it]
 19%|█▉        | 7317/37963 [18:05:24<65:55:23,  7.74s/it]
 19%|█▉        | 7318/37963 [18:05:32<65:38:59,  7.71s/it]
 19%|█▉        | 7319/37963 [18:05:40<65:27:08,  7.69s/it]
 19%|█▉        | 7320/37963 [18:05:47<65:33:30,  7.70s/it]
                                                          
{'loss': '0.1482', 'grad_norm': '6.848', 'learning_rate': '1.864e-05', 'epoch': '0.1928'}
+
 19%|█▉        | 7320/37963 [18:05:47<65:33:30,  7.70s/it]
 19%|█▉        | 7321/37963 [18:05:55<65:20:33,  7.68s/it]
 19%|█▉        | 7322/37963 [18:06:03<65:13:12,  7.66s/it]
 19%|█▉        | 7323/37963 [18:06:10<65:07:54,  7.65s/it]
 19%|█▉        | 7324/37963 [18:06:18<65:14:57,  7.67s/it]
 19%|█▉        | 7325/37963 [18:06:26<65:25:11,  7.69s/it]
 19%|█▉        | 7326/37963 [18:06:33<65:20:39,  7.68s/it]
 19%|█▉        | 7327/37963 [18:06:48<82:15:20,  9.67s/it]
 19%|█▉        | 7328/37963 [18:06:55<77:35:30,  9.12s/it]
 19%|█▉        | 7329/37963 [18:07:03<74:03:54,  8.70s/it]
 19%|█▉        | 7330/37963 [18:07:11<71:30:06,  8.40s/it]
                                                          
{'loss': '0.1738', 'grad_norm': '1.165', 'learning_rate': '1.864e-05', 'epoch': '0.1931'}
+
 19%|█▉        | 7330/37963 [18:07:11<71:30:06,  8.40s/it]
 19%|█▉        | 7331/37963 [18:07:25<86:56:12, 10.22s/it]
 19%|█▉        | 7332/37963 [18:07:33<80:37:05,  9.47s/it]
 19%|█▉        | 7333/37963 [18:07:41<75:50:46,  8.91s/it]
 19%|█▉        | 7334/37963 [18:07:56<91:21:35, 10.74s/it]
 19%|█▉        | 7335/37963 [18:08:03<83:31:21,  9.82s/it]
 19%|█▉        | 7336/37963 [18:08:11<78:20:10,  9.21s/it]
 19%|█▉        | 7337/37963 [18:08:19<74:36:13,  8.77s/it]
 19%|█▉        | 7338/37963 [18:08:26<71:37:56,  8.42s/it]
 19%|█▉        | 7339/37963 [18:08:34<69:39:21,  8.19s/it]
 19%|█▉        | 7340/37963 [18:08:42<68:11:32,  8.02s/it]
                                                          
{'loss': '0.1693', 'grad_norm': '0.6218', 'learning_rate': '1.863e-05', 'epoch': '0.1933'}
+
 19%|█▉        | 7340/37963 [18:08:42<68:11:32,  8.02s/it]
 19%|█▉        | 7341/37963 [18:08:49<67:13:58,  7.90s/it]
 19%|█▉        | 7342/37963 [18:08:57<66:25:54,  7.81s/it]
 19%|█▉        | 7343/37963 [18:09:05<66:53:30,  7.86s/it]
 19%|█▉        | 7344/37963 [18:09:13<66:14:03,  7.79s/it]
 19%|█▉        | 7345/37963 [18:09:27<84:20:03,  9.92s/it]
 19%|█▉        | 7346/37963 [18:09:35<78:52:59,  9.28s/it]
 19%|█▉        | 7347/37963 [18:09:50<92:10:07, 10.84s/it]
 19%|█▉        | 7348/37963 [18:09:58<84:21:33,  9.92s/it]
 19%|█▉        | 7349/37963 [18:10:19<113:01:03, 13.29s/it]
 19%|█▉        | 7350/37963 [18:10:33<114:53:55, 13.51s/it]
                                                           
{'loss': '0.1693', 'grad_norm': '3.397', 'learning_rate': '1.863e-05', 'epoch': '0.1936'}
+
 19%|█▉        | 7350/37963 [18:10:33<114:53:55, 13.51s/it]
 19%|█▉        | 7351/37963 [18:10:40<100:12:29, 11.78s/it]
 19%|█▉        | 7352/37963 [18:10:48<88:42:14, 10.43s/it] 
 19%|█▉        | 7353/37963 [18:10:55<81:47:58,  9.62s/it]
 19%|█▉        | 7354/37963 [18:11:03<76:39:41,  9.02s/it]
 19%|█▉        | 7355/37963 [18:11:11<72:46:46,  8.56s/it]
 19%|█▉        | 7356/37963 [18:11:18<70:47:30,  8.33s/it]
 19%|█▉        | 7357/37963 [18:11:26<67:53:30,  7.99s/it]
 19%|█▉        | 7358/37963 [18:11:33<66:54:56,  7.87s/it]
 19%|█▉        | 7359/37963 [18:11:41<66:46:36,  7.86s/it]
 19%|█▉        | 7360/37963 [18:11:49<67:00:26,  7.88s/it]
                                                          
{'loss': '0.1468', 'grad_norm': '2.361', 'learning_rate': '1.862e-05', 'epoch': '0.1939'}
+
 19%|█▉        | 7360/37963 [18:11:49<67:00:26,  7.88s/it]
 19%|█▉        | 7361/37963 [18:11:57<66:20:54,  7.81s/it]
 19%|█▉        | 7362/37963 [18:12:04<65:56:00,  7.76s/it]
 19%|█▉        | 7363/37963 [18:12:12<65:16:18,  7.68s/it]
 19%|█▉        | 7364/37963 [18:12:19<65:22:16,  7.69s/it]
 19%|█▉        | 7365/37963 [18:12:27<65:15:14,  7.68s/it]
 19%|█▉        | 7366/37963 [18:12:35<64:58:24,  7.64s/it]
 19%|█▉        | 7367/37963 [18:12:42<65:01:17,  7.65s/it]
 19%|█▉        | 7368/37963 [18:12:50<65:02:45,  7.65s/it]
 19%|█▉        | 7369/37963 [18:12:58<65:03:23,  7.66s/it]
 19%|█▉        | 7370/37963 [18:13:05<65:02:15,  7.65s/it]
                                                          
{'loss': '0.1648', 'grad_norm': '3.043', 'learning_rate': '1.862e-05', 'epoch': '0.1941'}
+
 19%|█▉        | 7370/37963 [18:13:05<65:02:15,  7.65s/it]
 19%|█▉        | 7371/37963 [18:13:13<65:03:52,  7.66s/it]
 19%|█▉        | 7372/37963 [18:13:21<65:26:53,  7.70s/it]
 19%|█▉        | 7373/37963 [18:13:28<65:09:02,  7.67s/it]
 19%|█▉        | 7374/37963 [18:13:36<65:16:38,  7.68s/it]
 19%|█▉        | 7375/37963 [18:13:50<81:51:35,  9.63s/it]
 19%|█▉        | 7376/37963 [18:14:05<93:53:04, 11.05s/it]
 19%|█▉        | 7377/37963 [18:14:12<85:03:17, 10.01s/it]
 19%|█▉        | 7378/37963 [18:14:20<78:50:57,  9.28s/it]
 19%|█▉        | 7379/37963 [18:14:35<93:50:10, 11.05s/it]
 19%|█▉        | 7380/37963 [18:14:43<85:18:08, 10.04s/it]
                                                          
{'loss': '0.1693', 'grad_norm': '3.001', 'learning_rate': '1.862e-05', 'epoch': '0.1944'}
+
 19%|█▉        | 7380/37963 [18:14:43<85:18:08, 10.04s/it]
 19%|█▉        | 7381/37963 [18:14:50<79:07:59,  9.32s/it]
 19%|█▉        | 7382/37963 [18:14:58<74:09:22,  8.73s/it]
 19%|█▉        | 7383/37963 [18:15:05<70:46:23,  8.33s/it]
 19%|█▉        | 7384/37963 [18:15:13<69:10:52,  8.14s/it]
 19%|█▉        | 7385/37963 [18:15:20<67:36:42,  7.96s/it]
 19%|█▉        | 7386/37963 [18:15:28<66:48:52,  7.87s/it]
 19%|█▉        | 7387/37963 [18:15:35<66:06:54,  7.78s/it]
 19%|█▉        | 7388/37963 [18:15:43<65:53:02,  7.76s/it]
 19%|█▉        | 7389/37963 [18:15:51<65:41:36,  7.74s/it]
 19%|█▉        | 7390/37963 [18:15:59<65:36:22,  7.73s/it]
                                                          
{'loss': '0.1713', 'grad_norm': '1.91', 'learning_rate': '1.861e-05', 'epoch': '0.1947'}
+
 19%|█▉        | 7390/37963 [18:15:59<65:36:22,  7.73s/it]
 19%|█▉        | 7391/37963 [18:16:13<82:36:03,  9.73s/it]
 19%|█▉        | 7392/37963 [18:16:21<77:29:06,  9.12s/it]
 19%|█▉        | 7393/37963 [18:16:42<107:57:37, 12.71s/it]
 19%|█▉        | 7394/37963 [18:16:57<115:20:31, 13.58s/it]
 19%|█▉        | 7395/37963 [18:17:05<100:16:12, 11.81s/it]
 19%|█▉        | 7396/37963 [18:17:13<89:37:55, 10.56s/it] 
 19%|█▉        | 7397/37963 [18:17:20<82:07:18,  9.67s/it]
 19%|█▉        | 7398/37963 [18:17:28<76:52:20,  9.05s/it]
 19%|█▉        | 7399/37963 [18:17:35<72:28:03,  8.54s/it]
 19%|█▉        | 7400/37963 [18:17:43<70:19:26,  8.28s/it]
                                                          
{'loss': '0.1611', 'grad_norm': '1.731', 'learning_rate': '1.861e-05', 'epoch': '0.1949'}
+
 19%|█▉        | 7400/37963 [18:17:43<70:19:26,  8.28s/it]
 19%|█▉        | 7401/37963 [18:17:50<68:11:54,  8.03s/it]
 19%|█▉        | 7402/37963 [18:17:58<66:03:13,  7.78s/it]
 20%|█▉        | 7403/37963 [18:18:12<82:35:26,  9.73s/it]
 20%|█▉        | 7404/37963 [18:18:19<77:19:30,  9.11s/it]
 20%|█▉        | 7405/37963 [18:18:27<73:35:31,  8.67s/it]
 20%|█▉        | 7406/37963 [18:18:35<71:09:37,  8.38s/it]
 20%|█▉        | 7407/37963 [18:18:42<69:03:28,  8.14s/it]
 20%|█▉        | 7408/37963 [18:18:50<68:00:08,  8.01s/it]
 20%|█▉        | 7409/37963 [18:18:57<66:19:26,  7.81s/it]
 20%|█▉        | 7410/37963 [18:19:05<66:05:03,  7.79s/it]
                                                          
{'loss': '0.1704', 'grad_norm': '1.113', 'learning_rate': '1.86e-05', 'epoch': '0.1952'}
+
 20%|█▉        | 7410/37963 [18:19:05<66:05:03,  7.79s/it]
 20%|█▉        | 7411/37963 [18:19:13<65:54:50,  7.77s/it]
 20%|█▉        | 7412/37963 [18:19:21<66:04:08,  7.79s/it]
 20%|█▉        | 7413/37963 [18:19:29<66:21:44,  7.82s/it]
 20%|█▉        | 7414/37963 [18:19:36<65:44:37,  7.75s/it]
 20%|█▉        | 7415/37963 [18:19:44<65:21:13,  7.70s/it]
 20%|█▉        | 7416/37963 [18:19:52<65:45:53,  7.75s/it]
 20%|█▉        | 7417/37963 [18:19:59<64:21:42,  7.59s/it]
 20%|█▉        | 7418/37963 [18:20:06<63:48:15,  7.52s/it]
 20%|█▉        | 7419/37963 [18:20:14<64:08:01,  7.56s/it]
 20%|█▉        | 7420/37963 [18:20:21<63:43:21,  7.51s/it]
                                                          
{'loss': '0.1581', 'grad_norm': '3.622', 'learning_rate': '1.86e-05', 'epoch': '0.1955'}
+
 20%|█▉        | 7420/37963 [18:20:21<63:43:21,  7.51s/it]
 20%|█▉        | 7421/37963 [18:20:29<64:49:04,  7.64s/it]
 20%|█▉        | 7422/37963 [18:20:44<82:30:19,  9.73s/it]
 20%|█▉        | 7423/37963 [18:20:51<77:16:28,  9.11s/it]
 20%|█▉        | 7424/37963 [18:21:06<89:58:58, 10.61s/it]
 20%|█▉        | 7425/37963 [18:21:13<82:13:48,  9.69s/it]
 20%|█▉        | 7426/37963 [18:21:20<76:12:19,  8.98s/it]
 20%|█▉        | 7427/37963 [18:21:35<91:22:09, 10.77s/it]
 20%|█▉        | 7428/37963 [18:21:43<83:23:02,  9.83s/it]
 20%|█▉        | 7429/37963 [18:21:51<78:06:16,  9.21s/it]
 20%|█▉        | 7430/37963 [18:21:58<73:14:54,  8.64s/it]
                                                          
{'loss': '0.1757', 'grad_norm': '1.073', 'learning_rate': '1.859e-05', 'epoch': '0.1957'}
+
 20%|█▉        | 7430/37963 [18:21:58<73:14:54,  8.64s/it]
 20%|█▉        | 7431/37963 [18:22:06<70:21:00,  8.29s/it]
 20%|█▉        | 7432/37963 [18:22:13<68:42:51,  8.10s/it]
 20%|█▉        | 7433/37963 [18:22:21<67:14:25,  7.93s/it]
 20%|█▉        | 7434/37963 [18:22:28<66:32:43,  7.85s/it]
 20%|█▉        | 7435/37963 [18:22:43<83:42:21,  9.87s/it]
 20%|█▉        | 7436/37963 [18:22:51<78:17:24,  9.23s/it]
 20%|█▉        | 7437/37963 [18:23:05<91:47:25, 10.83s/it]
 20%|█▉        | 7438/37963 [18:23:13<83:36:57,  9.86s/it]
 20%|█▉        | 7439/37963 [18:23:28<96:32:25, 11.39s/it]
 20%|█▉        | 7440/37963 [18:23:36<87:16:30, 10.29s/it]
                                                          
{'loss': '0.176', 'grad_norm': '1.588', 'learning_rate': '1.859e-05', 'epoch': '0.196'}
+
 20%|█▉        | 7440/37963 [18:23:36<87:16:30, 10.29s/it]
 20%|█▉        | 7441/37963 [18:23:43<80:43:50,  9.52s/it]
 20%|█▉        | 7442/37963 [18:23:51<76:18:59,  9.00s/it]
 20%|█▉        | 7443/37963 [18:23:59<72:45:59,  8.58s/it]
 20%|█▉        | 7444/37963 [18:24:06<70:03:10,  8.26s/it]
 20%|█▉        | 7445/37963 [18:24:14<68:21:22,  8.06s/it]
 20%|█▉        | 7446/37963 [18:24:21<67:11:24,  7.93s/it]
 20%|█▉        | 7447/37963 [18:24:36<83:07:55,  9.81s/it]
 20%|█▉        | 7448/37963 [18:24:43<77:41:54,  9.17s/it]
 20%|█▉        | 7449/37963 [18:24:51<73:53:32,  8.72s/it]
 20%|█▉        | 7450/37963 [18:24:59<71:09:29,  8.40s/it]
                                                          
{'loss': '0.1598', 'grad_norm': '0.9166', 'learning_rate': '1.859e-05', 'epoch': '0.1962'}
+
 20%|█▉        | 7450/37963 [18:24:59<71:09:29,  8.40s/it]
 20%|█▉        | 7451/37963 [18:25:06<69:15:15,  8.17s/it]
 20%|█▉        | 7452/37963 [18:25:14<67:36:13,  7.98s/it]
 20%|█▉        | 7453/37963 [18:25:21<66:28:15,  7.84s/it]
 20%|█▉        | 7454/37963 [18:25:29<65:45:22,  7.76s/it]
 20%|█▉        | 7455/37963 [18:25:37<65:40:05,  7.75s/it]
 20%|█▉        | 7456/37963 [18:25:44<64:50:02,  7.65s/it]
 20%|█▉        | 7457/37963 [18:25:59<82:10:11,  9.70s/it]
 20%|█▉        | 7458/37963 [18:26:06<76:59:22,  9.09s/it]
 20%|█▉        | 7459/37963 [18:26:14<73:20:45,  8.66s/it]
 20%|█▉        | 7460/37963 [18:26:22<70:53:41,  8.37s/it]
                                                          
{'loss': '0.1696', 'grad_norm': '1.114', 'learning_rate': '1.858e-05', 'epoch': '0.1965'}
+
 20%|█▉        | 7460/37963 [18:26:22<70:53:41,  8.37s/it]
 20%|█▉        | 7461/37963 [18:26:29<68:59:13,  8.14s/it]
 20%|█▉        | 7462/37963 [18:26:37<67:48:46,  8.00s/it]
 20%|█▉        | 7463/37963 [18:26:45<67:14:25,  7.94s/it]
 20%|█▉        | 7464/37963 [18:26:52<66:07:53,  7.81s/it]
 20%|█▉        | 7465/37963 [18:27:00<65:24:12,  7.72s/it]
 20%|█▉        | 7466/37963 [18:27:14<81:09:36,  9.58s/it]
 20%|█▉        | 7467/37963 [18:27:21<76:19:51,  9.01s/it]
 20%|█▉        | 7468/37963 [18:27:29<72:47:05,  8.59s/it]
 20%|█▉        | 7469/37963 [18:27:36<70:07:55,  8.28s/it]
 20%|█▉        | 7470/37963 [18:27:44<68:55:17,  8.14s/it]
                                                          
{'loss': '0.1795', 'grad_norm': '5.59', 'learning_rate': '1.858e-05', 'epoch': '0.1968'}
+
 20%|█▉        | 7470/37963 [18:27:44<68:55:17,  8.14s/it]
 20%|█▉        | 7471/37963 [18:27:58<83:46:47,  9.89s/it]
 20%|█▉        | 7472/37963 [18:28:06<78:03:10,  9.22s/it]
 20%|█▉        | 7473/37963 [18:28:13<73:54:40,  8.73s/it]
 20%|█▉        | 7474/37963 [18:28:21<71:34:58,  8.45s/it]
 20%|█▉        | 7475/37963 [18:28:36<88:25:51, 10.44s/it]
 20%|█▉        | 7476/37963 [18:28:44<81:52:13,  9.67s/it]
 20%|█▉        | 7477/37963 [18:28:52<76:38:38,  9.05s/it]
 20%|█▉        | 7478/37963 [18:29:00<73:21:33,  8.66s/it]
 20%|█▉        | 7479/37963 [18:29:07<70:21:08,  8.31s/it]
 20%|█▉        | 7480/37963 [18:29:15<68:27:01,  8.08s/it]
                                                          
{'loss': '0.1649', 'grad_norm': '2.68', 'learning_rate': '1.857e-05', 'epoch': '0.197'}
+
 20%|█▉        | 7480/37963 [18:29:15<68:27:01,  8.08s/it]
 20%|█▉        | 7481/37963 [18:29:22<66:52:59,  7.90s/it]
 20%|█▉        | 7482/37963 [18:29:37<84:29:14,  9.98s/it]
 20%|█▉        | 7483/37963 [18:29:52<97:33:26, 11.52s/it]
 20%|█▉        | 7484/37963 [18:30:00<87:34:42, 10.34s/it]
 20%|█▉        | 7485/37963 [18:30:07<80:02:38,  9.45s/it]
 20%|█▉        | 7486/37963 [18:30:15<75:28:31,  8.92s/it]
 20%|█▉        | 7487/37963 [18:30:29<89:56:57, 10.63s/it]
 20%|█▉        | 7488/37963 [18:30:37<82:59:25,  9.80s/it]
 20%|█▉        | 7489/37963 [18:30:45<77:09:57,  9.12s/it]
 20%|█▉        | 7490/37963 [18:30:52<73:15:54,  8.66s/it]
                                                          
{'loss': '0.155', 'grad_norm': '1.339', 'learning_rate': '1.857e-05', 'epoch': '0.1973'}
+
 20%|█▉        | 7490/37963 [18:30:52<73:15:54,  8.66s/it]
 20%|█▉        | 7491/37963 [18:31:00<69:57:47,  8.27s/it]
 20%|█▉        | 7492/37963 [18:31:07<68:27:15,  8.09s/it]
 20%|█▉        | 7493/37963 [18:31:15<67:11:30,  7.94s/it]
 20%|█▉        | 7494/37963 [18:31:23<66:33:30,  7.86s/it]
 20%|█▉        | 7495/37963 [18:31:30<65:55:29,  7.79s/it]
 20%|█▉        | 7496/37963 [18:31:38<65:42:05,  7.76s/it]
 20%|█▉        | 7497/37963 [18:31:45<65:13:30,  7.71s/it]
 20%|█▉        | 7498/37963 [18:31:53<65:02:34,  7.69s/it]
 20%|█▉        | 7499/37963 [18:32:01<64:49:35,  7.66s/it]
 20%|█▉        | 7500/37963 [18:32:08<64:50:10,  7.66s/it]
                                                          
{'loss': '0.1703', 'grad_norm': '2.285', 'learning_rate': '1.856e-05', 'epoch': '0.1976'}
+
 20%|█▉        | 7500/37963 [18:32:08<64:50:10,  7.66s/it]
 20%|█▉        | 7501/37963 [18:32:16<64:50:27,  7.66s/it]
 20%|█▉        | 7502/37963 [18:32:31<83:30:25,  9.87s/it]
 20%|█▉        | 7503/37963 [18:32:39<77:35:38,  9.17s/it]
 20%|█▉        | 7504/37963 [18:32:46<73:14:42,  8.66s/it]
 20%|█▉        | 7505/37963 [18:33:00<87:30:30, 10.34s/it]
 20%|█▉        | 7506/37963 [18:33:08<80:42:43,  9.54s/it]
 20%|█▉        | 7507/37963 [18:33:16<75:52:33,  8.97s/it]
 20%|█▉        | 7508/37963 [18:33:23<72:59:32,  8.63s/it]
 20%|█▉        | 7509/37963 [18:33:31<70:52:24,  8.38s/it]
 20%|█▉        | 7510/37963 [18:33:39<69:02:57,  8.16s/it]
                                                          
{'loss': '0.1686', 'grad_norm': '3.691', 'learning_rate': '1.856e-05', 'epoch': '0.1978'}
+
 20%|█▉        | 7510/37963 [18:33:39<69:02:57,  8.16s/it]
 20%|█▉        | 7511/37963 [18:33:47<68:00:43,  8.04s/it]
 20%|█▉        | 7512/37963 [18:33:54<66:59:17,  7.92s/it]
 20%|█▉        | 7513/37963 [18:34:02<66:28:05,  7.86s/it]
 20%|█▉        | 7514/37963 [18:34:16<82:57:44,  9.81s/it]
 20%|█▉        | 7515/37963 [18:34:24<78:01:29,  9.23s/it]
 20%|█▉        | 7516/37963 [18:34:32<74:08:10,  8.77s/it]
 20%|█▉        | 7517/37963 [18:34:40<71:21:17,  8.44s/it]
 20%|█▉        | 7518/37963 [18:34:53<84:44:41, 10.02s/it]
 20%|█▉        | 7519/37963 [18:35:08<96:59:48, 11.47s/it]
 20%|█▉        | 7520/37963 [18:35:16<87:18:58, 10.33s/it]
                                                          
{'loss': '0.1564', 'grad_norm': '1.643', 'learning_rate': '1.855e-05', 'epoch': '0.1981'}
+
 20%|█▉        | 7520/37963 [18:35:16<87:18:58, 10.33s/it]
 20%|█▉        | 7521/37963 [18:35:23<80:15:52,  9.49s/it]
 20%|█▉        | 7522/37963 [18:35:31<75:29:33,  8.93s/it]
 20%|█▉        | 7523/37963 [18:35:39<72:18:02,  8.55s/it]
 20%|█▉        | 7524/37963 [18:35:46<69:48:22,  8.26s/it]
 20%|█▉        | 7525/37963 [18:35:54<68:11:17,  8.06s/it]
 20%|█▉        | 7526/37963 [18:36:08<84:16:21,  9.97s/it]
 20%|█▉        | 7527/37963 [18:36:16<78:46:55,  9.32s/it]
 20%|█▉        | 7528/37963 [18:36:23<72:57:20,  8.63s/it]
 20%|█▉        | 7529/37963 [18:36:37<87:13:16, 10.32s/it]
 20%|█▉        | 7530/37963 [18:36:45<80:49:25,  9.56s/it]
                                                          
{'loss': '0.1614', 'grad_norm': '1.7', 'learning_rate': '1.855e-05', 'epoch': '0.1984'}
+
 20%|█▉        | 7530/37963 [18:36:45<80:49:25,  9.56s/it]
 20%|█▉        | 7531/37963 [18:36:53<76:03:37,  9.00s/it]
 20%|█▉        | 7532/37963 [18:37:01<72:50:36,  8.62s/it]
 20%|█▉        | 7533/37963 [18:37:08<69:37:02,  8.24s/it]
 20%|█▉        | 7534/37963 [18:37:16<68:17:14,  8.08s/it]
 20%|█▉        | 7535/37963 [18:37:23<67:36:14,  8.00s/it]
 20%|█▉        | 7536/37963 [18:37:31<66:47:57,  7.90s/it]
 20%|█▉        | 7537/37963 [18:37:39<66:14:46,  7.84s/it]
 20%|█▉        | 7538/37963 [18:37:54<84:24:39,  9.99s/it]
 20%|█▉        | 7539/37963 [18:38:01<78:10:37,  9.25s/it]
 20%|█▉        | 7540/37963 [18:38:09<73:27:28,  8.69s/it]
                                                          
{'loss': '0.1699', 'grad_norm': '1.549', 'learning_rate': '1.855e-05', 'epoch': '0.1986'}
+
 20%|█▉        | 7540/37963 [18:38:09<73:27:28,  8.69s/it]
 20%|█▉        | 7541/37963 [18:38:16<71:01:46,  8.41s/it]
 20%|█▉        | 7542/37963 [18:38:24<69:07:17,  8.18s/it]
 20%|█▉        | 7543/37963 [18:38:32<67:54:37,  8.04s/it]
 20%|█▉        | 7544/37963 [18:38:40<67:11:07,  7.95s/it]
 20%|█▉        | 7545/37963 [18:38:47<66:37:30,  7.89s/it]
 20%|█▉        | 7546/37963 [18:38:55<66:08:43,  7.83s/it]
 20%|█▉        | 7547/37963 [18:39:03<65:54:05,  7.80s/it]
 20%|█▉        | 7548/37963 [18:39:10<65:32:55,  7.76s/it]
 20%|█▉        | 7549/37963 [18:39:18<65:24:12,  7.74s/it]
 20%|█▉        | 7550/37963 [18:39:33<83:29:24,  9.88s/it]
                                                          
{'loss': '0.1732', 'grad_norm': '2.033', 'learning_rate': '1.854e-05', 'epoch': '0.1989'}
+
 20%|█▉        | 7550/37963 [18:39:33<83:29:24,  9.88s/it]
 20%|█▉        | 7551/37963 [18:39:40<77:19:25,  9.15s/it]
 20%|█▉        | 7552/37963 [18:39:55<90:02:16, 10.66s/it]
 20%|█▉        | 7553/37963 [18:40:02<82:34:04,  9.77s/it]
 20%|█▉        | 7554/37963 [18:40:10<77:24:24,  9.16s/it]
 20%|█▉        | 7555/37963 [18:40:18<73:39:55,  8.72s/it]
 20%|█▉        | 7556/37963 [18:40:25<70:47:24,  8.38s/it]
 20%|█▉        | 7557/37963 [18:40:33<68:56:34,  8.16s/it]
 20%|█▉        | 7558/37963 [18:40:40<66:45:54,  7.91s/it]
 20%|█▉        | 7559/37963 [18:40:48<66:11:59,  7.84s/it]
 20%|█▉        | 7560/37963 [18:40:55<65:04:00,  7.70s/it]
                                                          
{'loss': '0.172', 'grad_norm': '3.342', 'learning_rate': '1.854e-05', 'epoch': '0.1991'}
+
 20%|█▉        | 7560/37963 [18:40:55<65:04:00,  7.70s/it]
 20%|█▉        | 7561/37963 [18:41:03<65:07:38,  7.71s/it]
 20%|█▉        | 7562/37963 [18:41:11<64:57:44,  7.69s/it]
 20%|█▉        | 7563/37963 [18:41:25<81:45:32,  9.68s/it]
 20%|█▉        | 7564/37963 [18:41:33<76:18:19,  9.04s/it]
 20%|█▉        | 7565/37963 [18:41:47<91:02:50, 10.78s/it]
 20%|█▉        | 7566/37963 [18:41:55<82:41:19,  9.79s/it]
 20%|█▉        | 7567/37963 [18:42:09<93:58:58, 11.13s/it]
 20%|█▉        | 7568/37963 [18:42:17<85:36:59, 10.14s/it]
 20%|█▉        | 7569/37963 [18:42:25<79:21:34,  9.40s/it]
 20%|█▉        | 7570/37963 [18:42:32<74:19:02,  8.80s/it]
                                                          
{'loss': '0.1718', 'grad_norm': '1.862', 'learning_rate': '1.853e-05', 'epoch': '0.1994'}
+
 20%|█▉        | 7570/37963 [18:42:32<74:19:02,  8.80s/it]
 20%|█▉        | 7571/37963 [18:42:40<71:32:45,  8.47s/it]
 20%|█▉        | 7572/37963 [18:42:47<69:34:32,  8.24s/it]
 20%|█▉        | 7573/37963 [18:42:55<67:20:59,  7.98s/it]
 20%|█▉        | 7574/37963 [18:43:09<83:02:06,  9.84s/it]
 20%|█▉        | 7575/37963 [18:43:17<77:35:59,  9.19s/it]
 20%|█▉        | 7576/37963 [18:43:24<74:03:31,  8.77s/it]
 20%|█▉        | 7577/37963 [18:43:32<71:10:45,  8.43s/it]
 20%|█▉        | 7578/37963 [18:43:40<68:52:39,  8.16s/it]
 20%|█▉        | 7579/37963 [18:43:47<67:28:22,  7.99s/it]
 20%|█▉        | 7580/37963 [18:43:55<66:36:20,  7.89s/it]
                                                          
{'loss': '0.1655', 'grad_norm': '1.709', 'learning_rate': '1.853e-05', 'epoch': '0.1997'}
+
 20%|█▉        | 7580/37963 [18:43:55<66:36:20,  7.89s/it]
 20%|█▉        | 7581/37963 [18:44:09<82:07:06,  9.73s/it]
 20%|█▉        | 7582/37963 [18:44:17<77:06:19,  9.14s/it]
 20%|█▉        | 7583/37963 [18:44:32<91:50:00, 10.88s/it]
 20%|█▉        | 7584/37963 [18:44:39<83:47:12,  9.93s/it]
 20%|█▉        | 7585/37963 [18:44:47<78:19:11,  9.28s/it]
 20%|█▉        | 7586/37963 [18:44:54<73:35:55,  8.72s/it]
 20%|█▉        | 7587/37963 [18:45:02<70:58:32,  8.41s/it]
 20%|█▉        | 7588/37963 [18:45:10<69:05:01,  8.19s/it]
 20%|█▉        | 7589/37963 [18:45:18<67:55:12,  8.05s/it]
 20%|█▉        | 7590/37963 [18:45:25<66:00:56,  7.82s/it]
                                                          
{'loss': '0.1684', 'grad_norm': '2.094', 'learning_rate': '1.852e-05', 'epoch': '0.1999'}
+
 20%|█▉        | 7590/37963 [18:45:25<66:00:56,  7.82s/it]
 20%|█▉        | 7591/37963 [18:45:33<65:40:16,  7.78s/it]
 20%|█▉        | 7592/37963 [18:45:40<65:33:49,  7.77s/it]
 20%|██        | 7593/37963 [18:45:48<64:57:08,  7.70s/it]
 20%|██        | 7594/37963 [18:45:56<64:56:55,  7.70s/it]
 20%|██        | 7595/37963 [18:46:03<64:45:38,  7.68s/it]
 20%|██        | 7596/37963 [18:46:11<64:39:05,  7.66s/it]
 20%|██        | 7597/37963 [18:46:19<65:01:01,  7.71s/it]
 20%|██        | 7598/37963 [18:46:26<65:01:43,  7.71s/it]
 20%|██        | 7599/37963 [18:46:34<64:58:18,  7.70s/it]
 20%|██        | 7600/37963 [18:46:49<82:34:26,  9.79s/it]
                                                          
{'loss': '0.1572', 'grad_norm': '1.403', 'learning_rate': '1.852e-05', 'epoch': '0.2002'}
+
 20%|██        | 7600/37963 [18:46:49<82:34:26,  9.79s/it]
 20%|██        | 7601/37963 [18:47:03<93:29:13, 11.08s/it]
 20%|██        | 7602/37963 [18:47:10<84:47:37, 10.05s/it]
 20%|██        | 7603/37963 [18:47:18<78:53:55,  9.36s/it]
 20%|██        | 7604/37963 [18:47:26<74:20:44,  8.82s/it]
 20%|██        | 7605/37963 [18:47:33<71:23:41,  8.47s/it]
 20%|██        | 7606/37963 [18:47:41<69:27:03,  8.24s/it]
 20%|██        | 7607/37963 [18:47:49<68:21:07,  8.11s/it]
 20%|██        | 7608/37963 [18:47:57<67:12:24,  7.97s/it]
 20%|██        | 7609/37963 [18:48:04<66:35:37,  7.90s/it]
 20%|██        | 7610/37963 [18:48:12<66:00:05,  7.83s/it]
                                                          
{'loss': '0.1782', 'grad_norm': '1.555', 'learning_rate': '1.851e-05', 'epoch': '0.2005'}
+
 20%|██        | 7610/37963 [18:48:12<66:00:05,  7.83s/it]
 20%|██        | 7611/37963 [18:48:26<82:49:49,  9.82s/it]
 20%|██        | 7612/37963 [18:48:40<93:34:28, 11.10s/it]
 20%|██        | 7613/37963 [18:48:48<85:20:00, 10.12s/it]
 20%|██        | 7614/37963 [18:48:56<78:58:32,  9.37s/it]
 20%|██        | 7615/37963 [18:49:04<74:43:20,  8.86s/it]
 20%|██        | 7616/37963 [18:49:11<71:39:43,  8.50s/it]
 20%|██        | 7617/37963 [18:49:19<69:40:08,  8.26s/it]
 20%|██        | 7618/37963 [18:49:27<68:04:22,  8.08s/it]
 20%|██        | 7619/37963 [18:49:34<66:25:29,  7.88s/it]
 20%|██        | 7620/37963 [18:49:42<65:48:18,  7.81s/it]
                                                          
{'loss': '0.1745', 'grad_norm': '1.877', 'learning_rate': '1.851e-05', 'epoch': '0.2007'}
+
 20%|██        | 7620/37963 [18:49:42<65:48:18,  7.81s/it]
 20%|██        | 7621/37963 [18:49:56<82:03:01,  9.74s/it]
 20%|██        | 7622/37963 [18:50:04<77:05:37,  9.15s/it]
 20%|██        | 7623/37963 [18:50:19<91:53:33, 10.90s/it]
 20%|██        | 7624/37963 [18:50:26<83:52:02,  9.95s/it]
 20%|██        | 7625/37963 [18:50:40<94:01:06, 11.16s/it]
 20%|██        | 7626/37963 [18:50:48<85:07:29, 10.10s/it]
 20%|██        | 7627/37963 [18:50:56<79:03:26,  9.38s/it]
 20%|██        | 7628/37963 [18:51:03<74:36:23,  8.85s/it]
 20%|██        | 7629/37963 [18:51:11<71:29:44,  8.49s/it]
 20%|██        | 7630/37963 [18:51:19<69:20:29,  8.23s/it]
                                                          
{'loss': '0.1597', 'grad_norm': '6.026', 'learning_rate': '1.851e-05', 'epoch': '0.201'}
+
 20%|██        | 7630/37963 [18:51:19<69:20:29,  8.23s/it]
 20%|██        | 7631/37963 [18:51:26<67:51:53,  8.05s/it]
 20%|██        | 7632/37963 [18:51:41<85:13:59, 10.12s/it]
 20%|██        | 7633/37963 [18:51:49<79:39:31,  9.46s/it]
 20%|██        | 7634/37963 [18:51:57<75:20:09,  8.94s/it]
 20%|██        | 7635/37963 [18:52:04<72:02:41,  8.55s/it]
 20%|██        | 7636/37963 [18:52:12<69:52:06,  8.29s/it]
 20%|██        | 7637/37963 [18:52:20<68:28:54,  8.13s/it]
 20%|██        | 7638/37963 [18:52:28<67:35:06,  8.02s/it]
 20%|██        | 7639/37963 [18:52:35<66:59:22,  7.95s/it]
 20%|██        | 7640/37963 [18:52:43<66:10:16,  7.86s/it]
                                                          
{'loss': '0.1598', 'grad_norm': '2.864', 'learning_rate': '1.85e-05', 'epoch': '0.2012'}
+
 20%|██        | 7640/37963 [18:52:43<66:10:16,  7.86s/it]
 20%|██        | 7641/37963 [18:52:51<66:06:01,  7.85s/it]
 20%|██        | 7642/37963 [18:52:59<65:27:44,  7.77s/it]
 20%|██        | 7643/37963 [18:53:06<65:12:48,  7.74s/it]
 20%|██        | 7644/37963 [18:53:20<81:34:29,  9.69s/it]
 20%|██        | 7645/37963 [18:53:28<76:35:41,  9.09s/it]
 20%|██        | 7646/37963 [18:53:36<72:41:54,  8.63s/it]
 20%|██        | 7647/37963 [18:53:43<70:16:24,  8.34s/it]
 20%|██        | 7648/37963 [18:53:58<86:29:18, 10.27s/it]
 20%|██        | 7649/37963 [18:54:06<79:37:04,  9.46s/it]
 20%|██        | 7650/37963 [18:54:13<74:58:47,  8.90s/it]
                                                          
{'loss': '0.1578', 'grad_norm': '2.349', 'learning_rate': '1.85e-05', 'epoch': '0.2015'}
+
 20%|██        | 7650/37963 [18:54:13<74:58:47,  8.90s/it]
 20%|██        | 7651/37963 [18:54:21<72:18:32,  8.59s/it]
 20%|██        | 7652/37963 [18:54:29<70:06:04,  8.33s/it]
 20%|██        | 7653/37963 [18:54:36<67:39:27,  8.04s/it]
 20%|██        | 7654/37963 [18:54:44<66:41:56,  7.92s/it]
 20%|██        | 7655/37963 [18:54:52<66:01:39,  7.84s/it]
 20%|██        | 7656/37963 [18:54:59<65:01:09,  7.72s/it]
 20%|██        | 7657/37963 [18:55:07<64:43:08,  7.69s/it]
 20%|██        | 7658/37963 [18:55:14<64:45:18,  7.69s/it]
 20%|██        | 7659/37963 [18:55:22<64:14:38,  7.63s/it]
 20%|██        | 7660/37963 [18:55:29<64:08:09,  7.62s/it]
                                                          
{'loss': '0.1707', 'grad_norm': '1.542', 'learning_rate': '1.849e-05', 'epoch': '0.2018'}
+
 20%|██        | 7660/37963 [18:55:29<64:08:09,  7.62s/it]
 20%|██        | 7661/37963 [18:55:37<63:49:11,  7.58s/it]
 20%|██        | 7662/37963 [18:55:45<64:06:17,  7.62s/it]
 20%|██        | 7663/37963 [18:55:52<63:30:45,  7.55s/it]
 20%|██        | 7664/37963 [18:56:00<63:53:14,  7.59s/it]
 20%|██        | 7665/37963 [18:56:21<98:56:44, 11.76s/it]
 20%|██        | 7666/37963 [18:56:29<88:45:55, 10.55s/it]
 20%|██        | 7667/37963 [18:56:43<97:49:48, 11.62s/it]
 20%|██        | 7668/37963 [18:56:57<104:53:48, 12.47s/it]
 20%|██        | 7669/37963 [18:57:05<92:54:09, 11.04s/it] 
 20%|██        | 7670/37963 [18:57:13<83:48:30,  9.96s/it]
                                                          
{'loss': '0.1602', 'grad_norm': '1.593', 'learning_rate': '1.849e-05', 'epoch': '0.202'}
+
 20%|██        | 7670/37963 [18:57:13<83:48:30,  9.96s/it]
 20%|██        | 7671/37963 [18:57:20<77:55:17,  9.26s/it]
 20%|██        | 7672/37963 [18:57:35<91:40:28, 10.90s/it]
 20%|██        | 7673/37963 [18:57:43<83:52:07,  9.97s/it]
 20%|██        | 7674/37963 [18:57:50<77:37:36,  9.23s/it]
 20%|██        | 7675/37963 [18:57:58<72:48:24,  8.65s/it]
 20%|██        | 7676/37963 [18:58:05<70:06:04,  8.33s/it]
 20%|██        | 7677/37963 [18:58:13<68:13:49,  8.11s/it]
 20%|██        | 7678/37963 [18:58:20<66:55:33,  7.96s/it]
 20%|██        | 7679/37963 [18:58:28<66:05:44,  7.86s/it]
 20%|██        | 7680/37963 [18:58:42<82:46:13,  9.84s/it]
                                                          
{'loss': '0.1561', 'grad_norm': '1.02', 'learning_rate': '1.848e-05', 'epoch': '0.2023'}
+
 20%|██        | 7680/37963 [18:58:42<82:46:13,  9.84s/it]
 20%|██        | 7681/37963 [18:58:50<77:33:14,  9.22s/it]
 20%|██        | 7682/37963 [18:58:58<73:35:20,  8.75s/it]
 20%|██        | 7683/37963 [18:59:05<70:41:33,  8.40s/it]
 20%|██        | 7684/37963 [18:59:13<69:03:42,  8.21s/it]
 20%|██        | 7685/37963 [18:59:21<67:48:05,  8.06s/it]
 20%|██        | 7686/37963 [18:59:28<66:05:07,  7.86s/it]
 20%|██        | 7687/37963 [18:59:36<64:57:31,  7.72s/it]
 20%|██        | 7688/37963 [18:59:43<64:37:40,  7.68s/it]
 20%|██        | 7689/37963 [18:59:57<80:51:06,  9.61s/it]
 20%|██        | 7690/37963 [19:00:05<76:18:02,  9.07s/it]
                                                          
{'loss': '0.1736', 'grad_norm': '1.013', 'learning_rate': '1.848e-05', 'epoch': '0.2026'}
+
 20%|██        | 7690/37963 [19:00:05<76:18:02,  9.07s/it]
 20%|██        | 7691/37963 [19:00:13<72:24:43,  8.61s/it]
 20%|██        | 7692/37963 [19:00:20<70:04:29,  8.33s/it]
 20%|██        | 7693/37963 [19:00:28<68:25:16,  8.14s/it]
 20%|██        | 7694/37963 [19:00:36<67:24:13,  8.02s/it]
 20%|██        | 7695/37963 [19:00:43<66:25:48,  7.90s/it]
 20%|██        | 7696/37963 [19:00:51<65:59:40,  7.85s/it]
 20%|██        | 7697/37963 [19:00:59<65:34:58,  7.80s/it]
 20%|██        | 7698/37963 [19:01:07<65:15:53,  7.76s/it]
 20%|██        | 7699/37963 [19:01:14<64:50:58,  7.71s/it]
 20%|██        | 7700/37963 [19:01:22<65:02:02,  7.74s/it]
                                                          
{'loss': '0.1657', 'grad_norm': '1.481', 'learning_rate': '1.847e-05', 'epoch': '0.2028'}
+
 20%|██        | 7700/37963 [19:01:22<65:02:02,  7.74s/it]
 20%|██        | 7701/37963 [19:01:29<64:06:37,  7.63s/it]
 20%|██        | 7702/37963 [19:01:44<82:22:42,  9.80s/it]
 20%|██        | 7703/37963 [19:01:52<77:01:08,  9.16s/it]
 20%|██        | 7704/37963 [19:02:00<73:13:03,  8.71s/it]
 20%|██        | 7705/37963 [19:02:07<69:53:06,  8.31s/it]
 20%|██        | 7706/37963 [19:02:15<68:33:54,  8.16s/it]
 20%|██        | 7707/37963 [19:02:22<67:19:33,  8.01s/it]
 20%|██        | 7708/37963 [19:02:30<66:21:44,  7.90s/it]
 20%|██        | 7709/37963 [19:02:37<65:10:44,  7.76s/it]
 20%|██        | 7710/37963 [19:02:52<82:23:03,  9.80s/it]
                                                          
{'loss': '0.1755', 'grad_norm': '3.289', 'learning_rate': '1.847e-05', 'epoch': '0.2031'}
+
 20%|██        | 7710/37963 [19:02:52<82:23:03,  9.80s/it]
 20%|██        | 7711/37963 [19:03:00<76:47:29,  9.14s/it]
 20%|██        | 7712/37963 [19:03:07<72:52:39,  8.67s/it]
 20%|██        | 7713/37963 [19:03:15<70:28:49,  8.39s/it]
 20%|██        | 7714/37963 [19:03:29<84:46:12, 10.09s/it]
 20%|██        | 7715/37963 [19:03:37<78:33:11,  9.35s/it]
 20%|██        | 7716/37963 [19:03:44<74:08:29,  8.82s/it]
 20%|██        | 7717/37963 [19:03:52<70:24:50,  8.38s/it]
 20%|██        | 7718/37963 [19:03:59<68:45:01,  8.18s/it]
 20%|██        | 7719/37963 [19:04:20<101:23:49, 12.07s/it]
 20%|██        | 7720/37963 [19:04:28<90:28:38, 10.77s/it] 
                                                          
{'loss': '0.1655', 'grad_norm': '2.145', 'learning_rate': '1.847e-05', 'epoch': '0.2034'}
+
 20%|██        | 7720/37963 [19:04:28<90:28:38, 10.77s/it]
 20%|██        | 7721/37963 [19:04:36<82:14:38,  9.79s/it]
 20%|██        | 7722/37963 [19:04:50<94:07:08, 11.20s/it]
 20%|██        | 7723/37963 [19:04:58<85:09:40, 10.14s/it]
 20%|██        | 7724/37963 [19:05:05<78:30:16,  9.35s/it]
 20%|██        | 7725/37963 [19:05:13<74:13:58,  8.84s/it]
 20%|██        | 7726/37963 [19:05:21<71:05:48,  8.46s/it]
 20%|██        | 7727/37963 [19:05:28<69:31:45,  8.28s/it]
 20%|██        | 7728/37963 [19:05:43<86:15:00, 10.27s/it]
 20%|██        | 7729/37963 [19:05:51<79:49:12,  9.50s/it]
 20%|██        | 7730/37963 [19:05:59<75:18:30,  8.97s/it]
                                                          
{'loss': '0.1744', 'grad_norm': '1.843', 'learning_rate': '1.846e-05', 'epoch': '0.2036'}
+
 20%|██        | 7730/37963 [19:05:59<75:18:30,  8.97s/it]
 20%|██        | 7731/37963 [19:06:06<71:55:15,  8.56s/it]
 20%|██        | 7732/37963 [19:06:14<69:34:36,  8.29s/it]
 20%|██        | 7733/37963 [19:06:22<68:27:27,  8.15s/it]
 20%|██        | 7734/37963 [19:06:30<67:18:39,  8.02s/it]
 20%|██        | 7735/37963 [19:06:37<66:25:24,  7.91s/it]
 20%|██        | 7736/37963 [19:06:45<65:10:24,  7.76s/it]
 20%|██        | 7737/37963 [19:06:52<65:01:44,  7.75s/it]
 20%|██        | 7738/37963 [19:07:00<64:53:19,  7.73s/it]
 20%|██        | 7739/37963 [19:07:14<80:58:43,  9.65s/it]
 20%|██        | 7740/37963 [19:07:22<76:32:40,  9.12s/it]
                                                          
{'loss': '0.176', 'grad_norm': '2.042', 'learning_rate': '1.846e-05', 'epoch': '0.2039'}
+
 20%|██        | 7740/37963 [19:07:22<76:32:40,  9.12s/it]
 20%|██        | 7741/37963 [19:07:29<72:14:48,  8.61s/it]
 20%|██        | 7742/37963 [19:07:37<69:43:27,  8.31s/it]
 20%|██        | 7743/37963 [19:07:44<67:32:59,  8.05s/it]
 20%|██        | 7744/37963 [19:07:52<66:09:26,  7.88s/it]
 20%|██        | 7745/37963 [19:07:59<64:56:46,  7.74s/it]
 20%|██        | 7746/37963 [19:08:07<65:05:43,  7.76s/it]
 20%|██        | 7747/37963 [19:08:14<63:33:59,  7.57s/it]
 20%|██        | 7748/37963 [19:08:29<81:56:31,  9.76s/it]
 20%|██        | 7749/37963 [19:08:37<76:34:55,  9.12s/it]
 20%|██        | 7750/37963 [19:08:45<73:14:30,  8.73s/it]
                                                          
{'loss': '0.1631', 'grad_norm': '3.183', 'learning_rate': '1.845e-05', 'epoch': '0.2041'}
+
 20%|██        | 7750/37963 [19:08:45<73:14:30,  8.73s/it]
 20%|██        | 7751/37963 [19:08:52<70:30:54,  8.40s/it]
 20%|██        | 7752/37963 [19:09:00<67:49:31,  8.08s/it]
 20%|██        | 7753/37963 [19:09:08<67:37:24,  8.06s/it]
 20%|██        | 7754/37963 [19:09:15<66:31:17,  7.93s/it]
 20%|██        | 7755/37963 [19:09:23<65:40:42,  7.83s/it]
 20%|██        | 7756/37963 [19:09:30<64:51:56,  7.73s/it]
 20%|██        | 7757/37963 [19:09:38<64:42:48,  7.71s/it]
 20%|██        | 7758/37963 [19:09:46<64:29:27,  7.69s/it]
 20%|██        | 7759/37963 [19:09:53<64:33:27,  7.69s/it]
 20%|██        | 7760/37963 [19:10:08<80:53:43,  9.64s/it]
                                                          
{'loss': '0.1677', 'grad_norm': '1.549', 'learning_rate': '1.845e-05', 'epoch': '0.2044'}
+
 20%|██        | 7760/37963 [19:10:08<80:53:43,  9.64s/it]
 20%|██        | 7761/37963 [19:10:15<75:37:01,  9.01s/it]
 20%|██        | 7762/37963 [19:10:23<72:18:15,  8.62s/it]
 20%|██        | 7763/37963 [19:10:30<69:50:41,  8.33s/it]
 20%|██        | 7764/37963 [19:10:38<67:56:17,  8.10s/it]
 20%|██        | 7765/37963 [19:10:59<100:17:42, 11.96s/it]
 20%|██        | 7766/37963 [19:11:14<108:17:34, 12.91s/it]
 20%|██        | 7767/37963 [19:11:22<95:08:15, 11.34s/it] 
 20%|██        | 7768/37963 [19:11:29<85:04:31, 10.14s/it]
 20%|██        | 7769/37963 [19:11:37<78:39:21,  9.38s/it]
 20%|██        | 7770/37963 [19:11:44<74:02:44,  8.83s/it]
                                                          
{'loss': '0.1644', 'grad_norm': '2.894', 'learning_rate': '1.844e-05', 'epoch': '0.2047'}
+
 20%|██        | 7770/37963 [19:11:44<74:02:44,  8.83s/it]
 20%|██        | 7771/37963 [19:11:52<71:15:03,  8.50s/it]
 20%|██        | 7772/37963 [19:11:59<68:31:03,  8.17s/it]
 20%|██        | 7773/37963 [19:12:14<84:20:20, 10.06s/it]
 20%|██        | 7774/37963 [19:12:22<78:43:52,  9.39s/it]
 20%|██        | 7775/37963 [19:12:29<74:25:58,  8.88s/it]
 20%|██        | 7776/37963 [19:12:44<88:56:51, 10.61s/it]
 20%|██        | 7777/37963 [19:12:52<82:10:28,  9.80s/it]
 20%|██        | 7778/37963 [19:13:00<77:39:37,  9.26s/it]
 20%|██        | 7779/37963 [19:13:07<73:30:20,  8.77s/it]
 20%|██        | 7780/37963 [19:13:15<70:33:14,  8.42s/it]
                                                          
{'loss': '0.1754', 'grad_norm': '2.353', 'learning_rate': '1.844e-05', 'epoch': '0.2049'}
+
 20%|██        | 7780/37963 [19:13:15<70:33:14,  8.42s/it]
 20%|██        | 7781/37963 [19:13:23<68:46:33,  8.20s/it]
 20%|██        | 7782/37963 [19:13:30<67:26:44,  8.04s/it]
 21%|██        | 7783/37963 [19:13:38<66:54:43,  7.98s/it]
 21%|██        | 7784/37963 [19:13:46<65:57:19,  7.87s/it]
 21%|██        | 7785/37963 [19:13:53<65:09:59,  7.77s/it]
 21%|██        | 7786/37963 [19:14:01<64:45:57,  7.73s/it]
 21%|██        | 7787/37963 [19:14:09<64:23:47,  7.68s/it]
 21%|██        | 7788/37963 [19:14:23<80:35:52,  9.62s/it]
 21%|██        | 7789/37963 [19:14:30<75:02:19,  8.95s/it]
 21%|██        | 7790/37963 [19:14:38<71:00:19,  8.47s/it]
                                                          
{'loss': '0.1731', 'grad_norm': '1.535', 'learning_rate': '1.843e-05', 'epoch': '0.2052'}
+
 21%|██        | 7790/37963 [19:14:38<71:00:19,  8.47s/it]
 21%|██        | 7791/37963 [19:14:45<68:44:22,  8.20s/it]
 21%|██        | 7792/37963 [19:14:53<67:16:03,  8.03s/it]
 21%|██        | 7793/37963 [19:15:00<66:18:14,  7.91s/it]
 21%|██        | 7794/37963 [19:15:08<65:35:42,  7.83s/it]
 21%|██        | 7795/37963 [19:15:16<65:50:35,  7.86s/it]
 21%|██        | 7796/37963 [19:15:23<64:56:23,  7.75s/it]
 21%|██        | 7797/37963 [19:15:31<64:41:06,  7.72s/it]
 21%|██        | 7798/37963 [19:15:39<64:39:23,  7.72s/it]
 21%|██        | 7799/37963 [19:15:54<83:18:46,  9.94s/it]
 21%|██        | 7800/37963 [19:16:02<77:44:50,  9.28s/it]
                                                          
{'loss': '0.1728', 'grad_norm': '3.974', 'learning_rate': '1.843e-05', 'epoch': '0.2055'}
+
 21%|██        | 7800/37963 [19:16:02<77:44:50,  9.28s/it]
 21%|██        | 7801/37963 [19:16:09<73:21:39,  8.76s/it]
 21%|██        | 7802/37963 [19:16:17<71:00:35,  8.48s/it]
 21%|██        | 7803/37963 [19:16:25<69:08:19,  8.25s/it]
 21%|██        | 7804/37963 [19:16:32<67:36:27,  8.07s/it]
 21%|██        | 7805/37963 [19:16:40<66:34:59,  7.95s/it]
 21%|██        | 7806/37963 [19:16:47<65:12:40,  7.78s/it]
 21%|██        | 7807/37963 [19:16:55<64:54:19,  7.75s/it]
 21%|██        | 7808/37963 [19:17:03<64:33:55,  7.71s/it]
 21%|██        | 7809/37963 [19:17:17<81:08:23,  9.69s/it]
 21%|██        | 7810/37963 [19:17:25<75:58:11,  9.07s/it]
                                                          
{'loss': '0.1682', 'grad_norm': '5.51', 'learning_rate': '1.842e-05', 'epoch': '0.2057'}
+
 21%|██        | 7810/37963 [19:17:25<75:58:11,  9.07s/it]
 21%|██        | 7811/37963 [19:17:39<89:30:14, 10.69s/it]
 21%|██        | 7812/37963 [19:17:47<82:00:31,  9.79s/it]
 21%|██        | 7813/37963 [19:17:55<76:53:35,  9.18s/it]
 21%|██        | 7814/37963 [19:18:02<72:59:59,  8.72s/it]
 21%|██        | 7815/37963 [19:18:17<88:27:49, 10.56s/it]
 21%|██        | 7816/37963 [19:18:25<81:18:17,  9.71s/it]
 21%|██        | 7817/37963 [19:18:32<75:28:09,  9.01s/it]
 21%|██        | 7818/37963 [19:18:40<72:07:17,  8.61s/it]
 21%|██        | 7819/37963 [19:18:54<86:51:17, 10.37s/it]
 21%|██        | 7820/37963 [19:19:02<80:16:46,  9.59s/it]
                                                          
{'loss': '0.1636', 'grad_norm': '3.833', 'learning_rate': '1.842e-05', 'epoch': '0.206'}
+
 21%|██        | 7820/37963 [19:19:02<80:16:46,  9.59s/it]
 21%|██        | 7821/37963 [19:19:10<75:31:02,  9.02s/it]
 21%|██        | 7822/37963 [19:19:17<72:08:27,  8.62s/it]
 21%|██        | 7823/37963 [19:19:32<86:40:15, 10.35s/it]
 21%|██        | 7824/37963 [19:19:40<80:01:11,  9.56s/it]
 21%|██        | 7825/37963 [19:19:47<75:32:54,  9.02s/it]
 21%|██        | 7826/37963 [19:19:55<71:45:58,  8.57s/it]
 21%|██        | 7827/37963 [19:20:02<69:08:35,  8.26s/it]
 21%|██        | 7828/37963 [19:20:10<67:11:47,  8.03s/it]
 21%|██        | 7829/37963 [19:20:18<66:25:00,  7.93s/it]
 21%|██        | 7830/37963 [19:20:33<84:10:17, 10.06s/it]
                                                          
{'loss': '0.1738', 'grad_norm': '1.729', 'learning_rate': '1.841e-05', 'epoch': '0.2063'}
+
 21%|██        | 7830/37963 [19:20:33<84:10:17, 10.06s/it]
 21%|██        | 7831/37963 [19:20:40<77:34:25,  9.27s/it]
 21%|██        | 7832/37963 [19:20:48<73:41:19,  8.80s/it]
 21%|██        | 7833/37963 [19:20:56<71:02:49,  8.49s/it]
 21%|██        | 7834/37963 [19:21:03<68:40:30,  8.21s/it]
 21%|██        | 7835/37963 [19:21:11<67:13:15,  8.03s/it]
 21%|██        | 7836/37963 [19:21:19<66:43:28,  7.97s/it]
 21%|██        | 7837/37963 [19:21:26<65:53:13,  7.87s/it]
 21%|██        | 7838/37963 [19:21:34<65:19:04,  7.81s/it]
 21%|██        | 7839/37963 [19:21:41<64:49:47,  7.75s/it]
 21%|██        | 7840/37963 [19:21:49<64:57:34,  7.76s/it]
                                                          
{'loss': '0.1598', 'grad_norm': '5.009', 'learning_rate': '1.841e-05', 'epoch': '0.2065'}
+
 21%|██        | 7840/37963 [19:21:49<64:57:34,  7.76s/it]
 21%|██        | 7841/37963 [19:21:57<64:43:01,  7.73s/it]
 21%|██        | 7842/37963 [19:22:11<80:17:44,  9.60s/it]
 21%|██        | 7843/37963 [19:22:19<76:01:14,  9.09s/it]
 21%|██        | 7844/37963 [19:22:27<72:43:50,  8.69s/it]
 21%|██        | 7845/37963 [19:22:41<88:03:25, 10.53s/it]
 21%|██        | 7846/37963 [19:22:49<81:05:22,  9.69s/it]
 21%|██        | 7847/37963 [19:22:57<75:52:37,  9.07s/it]
 21%|██        | 7848/37963 [19:23:04<72:13:36,  8.63s/it]
 21%|██        | 7849/37963 [19:23:12<69:00:12,  8.25s/it]
 21%|██        | 7850/37963 [19:23:19<67:37:09,  8.08s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '1.049', 'learning_rate': '1.841e-05', 'epoch': '0.2068'}
+
 21%|██        | 7850/37963 [19:23:19<67:37:09,  8.08s/it]
 21%|██        | 7851/37963 [19:23:27<66:37:58,  7.97s/it]
 21%|██        | 7852/37963 [19:23:35<65:47:18,  7.87s/it]
 21%|██        | 7853/37963 [19:23:42<65:17:00,  7.81s/it]
 21%|██        | 7854/37963 [19:23:50<65:27:23,  7.83s/it]
 21%|██        | 7855/37963 [19:23:58<64:44:50,  7.74s/it]
 21%|██        | 7856/37963 [19:24:05<64:28:09,  7.71s/it]
 21%|██        | 7857/37963 [19:24:13<64:18:48,  7.69s/it]
 21%|██        | 7858/37963 [19:24:21<64:21:02,  7.70s/it]
 21%|██        | 7859/37963 [19:24:36<82:27:02,  9.86s/it]
 21%|██        | 7860/37963 [19:24:43<77:11:07,  9.23s/it]
                                                          
{'loss': '0.1766', 'grad_norm': '1.794', 'learning_rate': '1.84e-05', 'epoch': '0.207'}
+
 21%|██        | 7860/37963 [19:24:43<77:11:07,  9.23s/it]
 21%|██        | 7861/37963 [19:24:51<73:25:13,  8.78s/it]
 21%|██        | 7862/37963 [19:25:05<86:12:37, 10.31s/it]
 21%|██        | 7863/37963 [19:25:13<79:33:15,  9.51s/it]
 21%|██        | 7864/37963 [19:25:28<93:17:48, 11.16s/it]
 21%|██        | 7865/37963 [19:25:35<84:48:09, 10.14s/it]
 21%|██        | 7866/37963 [19:25:43<78:09:51,  9.35s/it]
 21%|██        | 7867/37963 [19:25:57<89:50:59, 10.75s/it]
 21%|██        | 7868/37963 [19:26:05<82:24:03,  9.86s/it]
 21%|██        | 7869/37963 [19:26:12<76:15:04,  9.12s/it]
 21%|██        | 7870/37963 [19:26:20<72:20:29,  8.65s/it]
                                                          
{'loss': '0.1618', 'grad_norm': '3.948', 'learning_rate': '1.84e-05', 'epoch': '0.2073'}
+
 21%|██        | 7870/37963 [19:26:20<72:20:29,  8.65s/it]
 21%|██        | 7871/37963 [19:26:34<86:09:27, 10.31s/it]
 21%|██        | 7872/37963 [19:26:42<79:45:14,  9.54s/it]
 21%|██        | 7873/37963 [19:26:49<75:22:44,  9.02s/it]
 21%|██        | 7874/37963 [19:26:57<71:45:22,  8.59s/it]
 21%|██        | 7875/37963 [19:27:05<69:08:09,  8.27s/it]
 21%|██        | 7876/37963 [19:27:12<67:30:47,  8.08s/it]
 21%|██        | 7877/37963 [19:27:20<66:07:53,  7.91s/it]
 21%|██        | 7878/37963 [19:27:34<82:52:37,  9.92s/it]
 21%|██        | 7879/37963 [19:27:42<77:27:22,  9.27s/it]
 21%|██        | 7880/37963 [19:27:50<74:11:48,  8.88s/it]
                                                          
{'loss': '0.173', 'grad_norm': '3.251', 'learning_rate': '1.839e-05', 'epoch': '0.2076'}
+
 21%|██        | 7880/37963 [19:27:50<74:11:48,  8.88s/it]
 21%|██        | 7881/37963 [19:27:57<70:29:43,  8.44s/it]
 21%|██        | 7882/37963 [19:28:05<68:22:30,  8.18s/it]
 21%|██        | 7883/37963 [19:28:13<66:54:59,  8.01s/it]
 21%|██        | 7884/37963 [19:28:20<66:12:05,  7.92s/it]
 21%|██        | 7885/37963 [19:28:28<65:26:35,  7.83s/it]
 21%|██        | 7886/37963 [19:28:36<64:54:58,  7.77s/it]
 21%|██        | 7887/37963 [19:28:43<64:10:07,  7.68s/it]
 21%|██        | 7888/37963 [19:28:51<64:19:29,  7.70s/it]
 21%|██        | 7889/37963 [19:28:58<63:21:22,  7.58s/it]
 21%|██        | 7890/37963 [19:29:06<63:36:33,  7.61s/it]
                                                          
{'loss': '0.1668', 'grad_norm': '1.541', 'learning_rate': '1.839e-05', 'epoch': '0.2078'}
+
 21%|██        | 7890/37963 [19:29:06<63:36:33,  7.61s/it]
 21%|██        | 7891/37963 [19:29:13<63:41:50,  7.63s/it]
 21%|██        | 7892/37963 [19:29:21<63:19:51,  7.58s/it]
 21%|██        | 7893/37963 [19:29:28<62:52:47,  7.53s/it]
 21%|██        | 7894/37963 [19:29:36<63:14:06,  7.57s/it]
 21%|██        | 7895/37963 [19:29:44<63:17:09,  7.58s/it]
 21%|██        | 7896/37963 [19:29:58<80:43:02,  9.66s/it]
 21%|██        | 7897/37963 [19:30:06<75:33:27,  9.05s/it]
 21%|██        | 7898/37963 [19:30:20<89:09:34, 10.68s/it]
 21%|██        | 7899/37963 [19:30:28<81:31:20,  9.76s/it]
 21%|██        | 7900/37963 [19:30:35<76:12:37,  9.13s/it]
                                                          
{'loss': '0.1576', 'grad_norm': '4.928', 'learning_rate': '1.838e-05', 'epoch': '0.2081'}
+
 21%|██        | 7900/37963 [19:30:35<76:12:37,  9.13s/it]
 21%|██        | 7901/37963 [19:30:43<71:54:27,  8.61s/it]
 21%|██        | 7902/37963 [19:30:51<69:29:19,  8.32s/it]
 21%|██        | 7903/37963 [19:30:58<67:38:20,  8.10s/it]
 21%|██        | 7904/37963 [19:31:06<66:33:48,  7.97s/it]
 21%|██        | 7905/37963 [19:31:13<65:45:10,  7.88s/it]
 21%|██        | 7906/37963 [19:31:28<81:25:17,  9.75s/it]
 21%|██        | 7907/37963 [19:31:42<93:28:26, 11.20s/it]
 21%|██        | 7908/37963 [19:31:50<85:08:34, 10.20s/it]
 21%|██        | 7909/37963 [19:31:58<78:51:08,  9.45s/it]
 21%|██        | 7910/37963 [19:32:05<73:33:00,  8.81s/it]
                                                          
{'loss': '0.1664', 'grad_norm': '1.334', 'learning_rate': '1.838e-05', 'epoch': '0.2084'}
+
 21%|██        | 7910/37963 [19:32:05<73:33:00,  8.81s/it]
 21%|██        | 7911/37963 [19:32:13<70:27:25,  8.44s/it]
 21%|██        | 7912/37963 [19:32:27<86:13:01, 10.33s/it]
 21%|██        | 7913/37963 [19:32:35<79:21:11,  9.51s/it]
 21%|██        | 7914/37963 [19:32:42<74:16:55,  8.90s/it]
 21%|██        | 7915/37963 [19:32:50<71:13:26,  8.53s/it]
 21%|██        | 7916/37963 [19:32:58<68:56:46,  8.26s/it]
 21%|██        | 7917/37963 [19:33:05<67:15:26,  8.06s/it]
 21%|██        | 7918/37963 [19:33:13<65:23:56,  7.84s/it]
 21%|██        | 7919/37963 [19:33:27<81:21:53,  9.75s/it]
 21%|██        | 7920/37963 [19:33:41<93:05:40, 11.16s/it]
                                                          
{'loss': '0.1582', 'grad_norm': '5.894', 'learning_rate': '1.837e-05', 'epoch': '0.2086'}
+
 21%|██        | 7920/37963 [19:33:41<93:05:40, 11.16s/it]
 21%|██        | 7921/37963 [19:33:49<84:35:32, 10.14s/it]
 21%|██        | 7922/37963 [19:33:57<77:59:43,  9.35s/it]
 21%|██        | 7923/37963 [19:34:04<73:13:46,  8.78s/it]
 21%|██        | 7924/37963 [19:34:12<70:35:14,  8.46s/it]
 21%|██        | 7925/37963 [19:34:19<68:41:09,  8.23s/it]
 21%|██        | 7926/37963 [19:34:27<67:06:13,  8.04s/it]
 21%|██        | 7927/37963 [19:34:35<66:04:09,  7.92s/it]
 21%|██        | 7928/37963 [19:34:42<64:46:07,  7.76s/it]
 21%|██        | 7929/37963 [19:34:50<64:37:08,  7.75s/it]
 21%|██        | 7930/37963 [19:34:57<64:04:52,  7.68s/it]
                                                          
{'loss': '0.1631', 'grad_norm': '3.464', 'learning_rate': '1.837e-05', 'epoch': '0.2089'}
+
 21%|██        | 7930/37963 [19:34:57<64:04:52,  7.68s/it]
 21%|██        | 7931/37963 [19:35:05<64:01:43,  7.68s/it]
 21%|██        | 7932/37963 [19:35:20<81:39:07,  9.79s/it]
 21%|██        | 7933/37963 [19:35:27<76:19:13,  9.15s/it]
 21%|██        | 7934/37963 [19:35:35<72:40:57,  8.71s/it]
 21%|██        | 7935/37963 [19:35:42<69:21:28,  8.32s/it]
 21%|██        | 7936/37963 [19:35:50<67:49:03,  8.13s/it]
 21%|██        | 7937/37963 [19:35:58<66:38:15,  7.99s/it]
 21%|██        | 7938/37963 [19:36:05<65:36:44,  7.87s/it]
 21%|██        | 7939/37963 [19:36:13<64:58:09,  7.79s/it]
 21%|██        | 7940/37963 [19:36:21<64:51:49,  7.78s/it]
                                                          
{'loss': '0.1675', 'grad_norm': '2.005', 'learning_rate': '1.836e-05', 'epoch': '0.2092'}
+
 21%|██        | 7940/37963 [19:36:21<64:51:49,  7.78s/it]
 21%|██        | 7941/37963 [19:36:28<64:34:02,  7.74s/it]
 21%|██        | 7942/37963 [19:36:36<64:16:49,  7.71s/it]
 21%|██        | 7943/37963 [19:36:44<64:09:26,  7.69s/it]
 21%|██        | 7944/37963 [19:36:51<64:09:24,  7.69s/it]
 21%|██        | 7945/37963 [19:36:59<63:40:33,  7.64s/it]
 21%|██        | 7946/37963 [19:37:14<81:30:44,  9.78s/it]
 21%|██        | 7947/37963 [19:37:21<76:22:11,  9.16s/it]
 21%|██        | 7948/37963 [19:37:29<72:30:39,  8.70s/it]
 21%|██        | 7949/37963 [19:37:37<69:54:17,  8.38s/it]
 21%|██        | 7950/37963 [19:37:51<85:02:17, 10.20s/it]
                                                          
{'loss': '0.1624', 'grad_norm': '5.866', 'learning_rate': '1.836e-05', 'epoch': '0.2094'}
+
 21%|██        | 7950/37963 [19:37:51<85:02:17, 10.20s/it]
 21%|██        | 7951/37963 [19:37:59<78:38:13,  9.43s/it]
 21%|██        | 7952/37963 [19:38:06<74:11:01,  8.90s/it]
 21%|██        | 7953/37963 [19:38:14<70:48:39,  8.49s/it]
 21%|██        | 7954/37963 [19:38:28<84:50:44, 10.18s/it]
 21%|██        | 7955/37963 [19:38:43<96:12:54, 11.54s/it]
 21%|██        | 7956/37963 [19:38:50<86:23:38, 10.36s/it]
 21%|██        | 7957/37963 [19:38:58<79:20:02,  9.52s/it]
 21%|██        | 7958/37963 [19:39:05<74:08:51,  8.90s/it]
 21%|██        | 7959/37963 [19:39:13<70:59:47,  8.52s/it]
 21%|██        | 7960/37963 [19:39:28<86:13:57, 10.35s/it]
                                                          
{'loss': '0.1685', 'grad_norm': '0.6929', 'learning_rate': '1.835e-05', 'epoch': '0.2097'}
+
 21%|██        | 7960/37963 [19:39:28<86:13:57, 10.35s/it]
 21%|██        | 7961/37963 [19:39:35<79:32:06,  9.54s/it]
 21%|██        | 7962/37963 [19:39:43<74:39:03,  8.96s/it]
 21%|██        | 7963/37963 [19:39:50<70:29:02,  8.46s/it]
 21%|██        | 7964/37963 [19:40:04<84:32:52, 10.15s/it]
 21%|██        | 7965/37963 [19:40:12<78:28:19,  9.42s/it]
 21%|██        | 7966/37963 [19:40:20<74:21:07,  8.92s/it]
 21%|██        | 7967/37963 [19:40:27<71:00:00,  8.52s/it]
 21%|██        | 7968/37963 [19:40:35<68:59:09,  8.28s/it]
 21%|██        | 7969/37963 [19:40:42<66:44:59,  8.01s/it]
 21%|██        | 7970/37963 [19:40:50<65:56:13,  7.91s/it]
                                                          
{'loss': '0.1573', 'grad_norm': '3.712', 'learning_rate': '1.835e-05', 'epoch': '0.2099'}
+
 21%|██        | 7970/37963 [19:40:50<65:56:13,  7.91s/it]
 21%|██        | 7971/37963 [19:40:58<64:50:32,  7.78s/it]
 21%|██        | 7972/37963 [19:41:05<64:16:22,  7.72s/it]
 21%|██        | 7973/37963 [19:41:13<63:50:41,  7.66s/it]
 21%|██        | 7974/37963 [19:41:27<80:45:30,  9.69s/it]
 21%|██        | 7975/37963 [19:41:35<75:53:05,  9.11s/it]
 21%|██        | 7976/37963 [19:41:42<72:09:13,  8.66s/it]
 21%|██        | 7977/37963 [19:41:50<69:41:30,  8.37s/it]
 21%|██        | 7978/37963 [19:41:58<67:54:26,  8.15s/it]
 21%|██        | 7979/37963 [19:42:05<66:07:53,  7.94s/it]
 21%|██        | 7980/37963 [19:42:13<64:44:35,  7.77s/it]
                                                          
{'loss': '0.1637', 'grad_norm': '2.429', 'learning_rate': '1.835e-05', 'epoch': '0.2102'}
+
 21%|██        | 7980/37963 [19:42:13<64:44:35,  7.77s/it]
 21%|██        | 7981/37963 [19:42:20<64:31:56,  7.75s/it]
 21%|██        | 7982/37963 [19:42:28<64:23:38,  7.73s/it]
 21%|██        | 7983/37963 [19:42:36<64:23:54,  7.73s/it]
 21%|██        | 7984/37963 [19:42:43<64:23:37,  7.73s/it]
 21%|██        | 7985/37963 [19:42:51<64:12:51,  7.71s/it]
 21%|██        | 7986/37963 [19:43:06<81:48:20,  9.82s/it]
 21%|██        | 7987/37963 [19:43:14<77:06:12,  9.26s/it]
 21%|██        | 7988/37963 [19:43:21<72:59:31,  8.77s/it]
 21%|██        | 7989/37963 [19:43:29<70:21:49,  8.45s/it]
 21%|██        | 7990/37963 [19:43:44<86:04:35, 10.34s/it]
                                                          
{'loss': '0.1697', 'grad_norm': '3.125', 'learning_rate': '1.834e-05', 'epoch': '0.2105'}
+
 21%|██        | 7990/37963 [19:43:44<86:04:35, 10.34s/it]
 21%|██        | 7991/37963 [19:43:52<80:06:29,  9.62s/it]
 21%|██        | 7992/37963 [19:43:59<74:54:42,  9.00s/it]
 21%|██        | 7993/37963 [19:44:07<71:22:05,  8.57s/it]
 21%|██        | 7994/37963 [19:44:15<68:55:40,  8.28s/it]
 21%|██        | 7995/37963 [19:44:22<67:27:14,  8.10s/it]
 21%|██        | 7996/37963 [19:44:29<65:16:00,  7.84s/it]
 21%|██        | 7997/37963 [19:44:43<80:31:53,  9.67s/it]
 21%|██        | 7998/37963 [19:44:51<75:41:27,  9.09s/it]
 21%|██        | 7999/37963 [19:44:59<72:15:56,  8.68s/it]
 21%|██        | 8000/37963 [19:45:07<69:52:48,  8.40s/it]
                                                          
{'loss': '0.1753', 'grad_norm': '3.901', 'learning_rate': '1.834e-05', 'epoch': '0.2107'}
+
 21%|██        | 8000/37963 [19:45:07<69:52:48,  8.40s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.45s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.45s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 21%|██        | 8001/37963 [19:46:03<188:37:59, 22.66s/it]
 21%|██        | 8002/37963 [19:46:17<167:00:58, 20.07s/it]
 21%|██        | 8003/37963 [19:46:24<135:38:15, 16.30s/it]
 21%|██        | 8004/37963 [19:46:32<113:27:34, 13.63s/it]
 21%|██        | 8005/37963 [19:46:39<98:38:45, 11.85s/it] 
 21%|██        | 8006/37963 [19:46:54<107:05:57, 12.87s/it]
 21%|██        | 8007/37963 [19:47:09<112:01:36, 13.46s/it]
 21%|██        | 8008/37963 [19:47:17<97:20:35, 11.70s/it] 
 21%|██        | 8009/37963 [19:47:25<87:19:54, 10.50s/it]
 21%|██        | 8010/37963 [19:47:32<80:01:42,  9.62s/it]
                                                          
{'loss': '0.1717', 'grad_norm': '1.285', 'learning_rate': '1.833e-05', 'epoch': '0.211'}
+
 21%|██        | 8010/37963 [19:47:32<80:01:42,  9.62s/it]
 21%|██        | 8011/37963 [19:47:47<92:21:19, 11.10s/it]
 21%|██        | 8012/37963 [19:47:54<83:45:07, 10.07s/it]
 21%|██        | 8013/37963 [19:48:02<77:54:54,  9.37s/it]
 21%|██        | 8014/37963 [19:48:10<73:36:06,  8.85s/it]
 21%|██        | 8015/37963 [19:48:17<70:45:45,  8.51s/it]
 21%|██        | 8016/37963 [19:48:25<68:43:41,  8.26s/it]
 21%|██        | 8017/37963 [19:48:33<67:33:56,  8.12s/it]
 21%|██        | 8018/37963 [19:48:40<66:08:33,  7.95s/it]
 21%|██        | 8019/37963 [19:48:48<64:50:34,  7.80s/it]
 21%|██        | 8020/37963 [19:48:56<64:23:28,  7.74s/it]
                                                          
{'loss': '0.1758', 'grad_norm': '3.158', 'learning_rate': '1.833e-05', 'epoch': '0.2113'}
+
 21%|██        | 8020/37963 [19:48:56<64:23:28,  7.74s/it]
 21%|██        | 8021/37963 [19:49:03<64:17:39,  7.73s/it]
 21%|██        | 8022/37963 [19:49:18<81:01:11,  9.74s/it]
 21%|██        | 8023/37963 [19:49:25<75:46:20,  9.11s/it]
 21%|██        | 8024/37963 [19:49:33<72:07:51,  8.67s/it]
 21%|██        | 8025/37963 [19:49:41<69:26:31,  8.35s/it]
 21%|██        | 8026/37963 [19:49:48<68:06:17,  8.19s/it]
 21%|██        | 8027/37963 [19:49:56<66:45:56,  8.03s/it]
 21%|██        | 8028/37963 [19:50:04<66:04:51,  7.95s/it]
 21%|██        | 8029/37963 [19:50:11<64:45:20,  7.79s/it]
 21%|██        | 8030/37963 [19:50:19<65:18:17,  7.85s/it]
                                                          
{'loss': '0.1833', 'grad_norm': '1.989', 'learning_rate': '1.832e-05', 'epoch': '0.2115'}
+
 21%|██        | 8030/37963 [19:50:19<65:18:17,  7.85s/it]
 21%|██        | 8031/37963 [19:50:34<83:11:10, 10.01s/it]
 21%|██        | 8032/37963 [19:50:42<77:19:52,  9.30s/it]
 21%|██        | 8033/37963 [19:50:50<73:10:48,  8.80s/it]
 21%|██        | 8034/37963 [19:50:57<70:15:26,  8.45s/it]
 21%|██        | 8035/37963 [19:51:05<68:10:06,  8.20s/it]
 21%|██        | 8036/37963 [19:51:12<66:54:16,  8.05s/it]
 21%|██        | 8037/37963 [19:51:20<66:26:06,  7.99s/it]
 21%|██        | 8038/37963 [19:51:28<65:53:46,  7.93s/it]
 21%|██        | 8039/37963 [19:51:42<81:21:41,  9.79s/it]
 21%|██        | 8040/37963 [19:51:50<76:02:41,  9.15s/it]
                                                          
{'loss': '0.164', 'grad_norm': '3.169', 'learning_rate': '1.832e-05', 'epoch': '0.2118'}
+
 21%|██        | 8040/37963 [19:51:50<76:02:41,  9.15s/it]
 21%|██        | 8041/37963 [19:51:58<72:21:35,  8.71s/it]
 21%|██        | 8042/37963 [19:52:12<85:42:33, 10.31s/it]
 21%|██        | 8043/37963 [19:52:19<78:58:43,  9.50s/it]
 21%|██        | 8044/37963 [19:52:27<74:30:01,  8.96s/it]
 21%|██        | 8045/37963 [19:52:35<71:12:50,  8.57s/it]
 21%|██        | 8046/37963 [19:52:49<85:36:17, 10.30s/it]
 21%|██        | 8047/37963 [19:52:57<78:57:48,  9.50s/it]
 21%|██        | 8048/37963 [19:53:04<74:17:51,  8.94s/it]
 21%|██        | 8049/37963 [19:53:12<71:14:10,  8.57s/it]
 21%|██        | 8050/37963 [19:53:20<69:24:07,  8.35s/it]
                                                          
{'loss': '0.1699', 'grad_norm': '2.087', 'learning_rate': '1.831e-05', 'epoch': '0.212'}
+
 21%|██        | 8050/37963 [19:53:20<69:24:07,  8.35s/it]
 21%|██        | 8051/37963 [19:53:27<67:35:05,  8.13s/it]
 21%|██        | 8052/37963 [19:53:35<65:56:43,  7.94s/it]
 21%|██        | 8053/37963 [19:53:42<64:53:45,  7.81s/it]
 21%|██        | 8054/37963 [19:54:04<99:58:13, 12.03s/it]
 21%|██        | 8055/37963 [19:54:12<88:17:32, 10.63s/it]
 21%|██        | 8056/37963 [19:54:19<80:21:36,  9.67s/it]
 21%|██        | 8057/37963 [19:54:27<75:27:41,  9.08s/it]
 21%|██        | 8058/37963 [19:54:34<71:45:17,  8.64s/it]
 21%|██        | 8059/37963 [19:54:42<69:56:14,  8.42s/it]
 21%|██        | 8060/37963 [19:54:56<83:49:25, 10.09s/it]
                                                          
{'loss': '0.1608', 'grad_norm': '1.569', 'learning_rate': '1.831e-05', 'epoch': '0.2123'}
+
 21%|██        | 8060/37963 [19:54:56<83:49:25, 10.09s/it]
 21%|██        | 8061/37963 [19:55:04<77:41:35,  9.35s/it]
 21%|██        | 8062/37963 [19:55:11<73:05:44,  8.80s/it]
 21%|██        | 8063/37963 [19:55:19<69:43:37,  8.40s/it]
 21%|██        | 8064/37963 [19:55:27<68:01:50,  8.19s/it]
 21%|██        | 8065/37963 [19:55:34<66:38:23,  8.02s/it]
 21%|██        | 8066/37963 [19:55:48<81:57:26,  9.87s/it]
 21%|██        | 8067/37963 [19:55:56<76:47:40,  9.25s/it]
 21%|██▏       | 8068/37963 [19:56:04<72:37:50,  8.75s/it]
 21%|██▏       | 8069/37963 [19:56:11<69:38:01,  8.39s/it]
 21%|██▏       | 8070/37963 [19:56:19<67:08:52,  8.09s/it]
                                                          
{'loss': '0.1507', 'grad_norm': '2.247', 'learning_rate': '1.83e-05', 'epoch': '0.2126'}
+
 21%|██▏       | 8070/37963 [19:56:19<67:08:52,  8.09s/it]
 21%|██▏       | 8071/37963 [19:56:26<65:47:39,  7.92s/it]
 21%|██▏       | 8072/37963 [19:56:34<65:10:54,  7.85s/it]
 21%|██▏       | 8073/37963 [19:56:42<65:00:44,  7.83s/it]
 21%|██▏       | 8074/37963 [19:56:49<64:47:44,  7.80s/it]
 21%|██▏       | 8075/37963 [19:56:57<64:25:54,  7.76s/it]
 21%|██▏       | 8076/37963 [19:57:05<64:12:05,  7.73s/it]
 21%|██▏       | 8077/37963 [19:57:12<63:56:09,  7.70s/it]
 21%|██▏       | 8078/37963 [19:57:20<63:40:17,  7.67s/it]
 21%|██▏       | 8079/37963 [19:57:28<63:34:49,  7.66s/it]
 21%|██▏       | 8080/37963 [19:57:35<63:46:01,  7.68s/it]
                                                          
{'loss': '0.1729', 'grad_norm': '1.342', 'learning_rate': '1.83e-05', 'epoch': '0.2128'}
+
 21%|██▏       | 8080/37963 [19:57:35<63:46:01,  7.68s/it]
 21%|██▏       | 8081/37963 [19:57:43<63:37:31,  7.67s/it]
 21%|██▏       | 8082/37963 [19:57:51<63:41:36,  7.67s/it]
 21%|██▏       | 8083/37963 [19:57:58<63:08:42,  7.61s/it]
 21%|██▏       | 8084/37963 [19:58:13<81:30:09,  9.82s/it]
 21%|██▏       | 8085/37963 [19:58:21<75:58:05,  9.15s/it]
 21%|██▏       | 8086/37963 [19:58:28<71:41:30,  8.64s/it]
 21%|██▏       | 8087/37963 [19:58:36<69:26:37,  8.37s/it]
 21%|██▏       | 8088/37963 [19:58:44<67:39:10,  8.15s/it]
 21%|██▏       | 8089/37963 [19:58:51<66:35:03,  8.02s/it]
 21%|██▏       | 8090/37963 [19:58:59<65:36:46,  7.91s/it]
                                                          
{'loss': '0.1694', 'grad_norm': '1.438', 'learning_rate': '1.829e-05', 'epoch': '0.2131'}
+
 21%|██▏       | 8090/37963 [19:58:59<65:36:46,  7.91s/it]
 21%|██▏       | 8091/37963 [19:59:07<65:28:13,  7.89s/it]
 21%|██▏       | 8092/37963 [19:59:27<97:32:01, 11.75s/it]
 21%|██▏       | 8093/37963 [19:59:35<87:27:36, 10.54s/it]
 21%|██▏       | 8094/37963 [19:59:43<80:11:24,  9.67s/it]
 21%|██▏       | 8095/37963 [19:59:50<74:49:19,  9.02s/it]
 21%|██▏       | 8096/37963 [19:59:58<71:21:15,  8.60s/it]
 21%|██▏       | 8097/37963 [20:00:05<68:37:58,  8.27s/it]
 21%|██▏       | 8098/37963 [20:00:13<66:47:37,  8.05s/it]
 21%|██▏       | 8099/37963 [20:00:27<81:54:07,  9.87s/it]
 21%|██▏       | 8100/37963 [20:00:35<75:43:06,  9.13s/it]
                                                          
{'loss': '0.187', 'grad_norm': '1.077', 'learning_rate': '1.829e-05', 'epoch': '0.2134'}
+
 21%|██▏       | 8100/37963 [20:00:35<75:43:06,  9.13s/it]
 21%|██▏       | 8101/37963 [20:00:49<89:28:18, 10.79s/it]
 21%|██▏       | 8102/37963 [20:00:57<81:19:01,  9.80s/it]
 21%|██▏       | 8103/37963 [20:01:04<75:19:47,  9.08s/it]
 21%|██▏       | 8104/37963 [20:01:19<88:38:13, 10.69s/it]
 21%|██▏       | 8105/37963 [20:01:26<80:51:49,  9.75s/it]
 21%|██▏       | 8106/37963 [20:01:34<75:47:19,  9.14s/it]
 21%|██▏       | 8107/37963 [20:01:48<89:17:41, 10.77s/it]
 21%|██▏       | 8108/37963 [20:01:56<81:50:16,  9.87s/it]
 21%|██▏       | 8109/37963 [20:02:04<76:12:38,  9.19s/it]
 21%|██▏       | 8110/37963 [20:02:11<71:43:21,  8.65s/it]
                                                          
{'loss': '0.1729', 'grad_norm': '3.061', 'learning_rate': '1.828e-05', 'epoch': '0.2136'}
+
 21%|██▏       | 8110/37963 [20:02:11<71:43:21,  8.65s/it]
 21%|██▏       | 8111/37963 [20:02:19<69:00:28,  8.32s/it]
 21%|██▏       | 8112/37963 [20:02:26<67:15:37,  8.11s/it]
 21%|██▏       | 8113/37963 [20:02:34<66:04:35,  7.97s/it]
 21%|██▏       | 8114/37963 [20:02:42<65:35:44,  7.91s/it]
 21%|██▏       | 8115/37963 [20:02:56<81:13:57,  9.80s/it]
 21%|██▏       | 8116/37963 [20:03:04<75:53:24,  9.15s/it]
 21%|██▏       | 8117/37963 [20:03:11<71:42:28,  8.65s/it]
 21%|██▏       | 8118/37963 [20:03:19<69:02:18,  8.33s/it]
 21%|██▏       | 8119/37963 [20:03:26<67:18:05,  8.12s/it]
 21%|██▏       | 8120/37963 [20:03:34<65:40:55,  7.92s/it]
                                                          
{'loss': '0.1553', 'grad_norm': '1.595', 'learning_rate': '1.828e-05', 'epoch': '0.2139'}
+
 21%|██▏       | 8120/37963 [20:03:34<65:40:55,  7.92s/it]
 21%|██▏       | 8121/37963 [20:03:41<64:52:57,  7.83s/it]
 21%|██▏       | 8122/37963 [20:03:49<64:08:54,  7.74s/it]
 21%|██▏       | 8123/37963 [20:03:56<63:01:56,  7.60s/it]
 21%|██▏       | 8124/37963 [20:04:04<63:03:20,  7.61s/it]
 21%|██▏       | 8125/37963 [20:04:11<62:36:23,  7.55s/it]
 21%|██▏       | 8126/37963 [20:04:19<63:00:49,  7.60s/it]
 21%|██▏       | 8127/37963 [20:04:27<63:14:30,  7.63s/it]
 21%|██▏       | 8128/37963 [20:04:34<63:19:27,  7.64s/it]
 21%|██▏       | 8129/37963 [20:04:42<63:20:59,  7.64s/it]
 21%|██▏       | 8130/37963 [20:04:57<81:24:28,  9.82s/it]
                                                          
{'loss': '0.1681', 'grad_norm': '1.251', 'learning_rate': '1.827e-05', 'epoch': '0.2142'}
+
 21%|██▏       | 8130/37963 [20:04:57<81:24:28,  9.82s/it]
 21%|██▏       | 8131/37963 [20:05:05<76:18:09,  9.21s/it]
 21%|██▏       | 8132/37963 [20:05:12<72:27:17,  8.74s/it]
 21%|██▏       | 8133/37963 [20:05:20<69:51:45,  8.43s/it]
 21%|██▏       | 8134/37963 [20:05:27<66:49:32,  8.07s/it]
 21%|██▏       | 8135/37963 [20:05:35<65:10:01,  7.87s/it]
 21%|██▏       | 8136/37963 [20:05:42<64:46:18,  7.82s/it]
 21%|██▏       | 8137/37963 [20:05:58<83:40:31, 10.10s/it]
 21%|██▏       | 8138/37963 [20:06:05<77:44:19,  9.38s/it]
 21%|██▏       | 8139/37963 [20:06:13<73:31:07,  8.87s/it]
 21%|██▏       | 8140/37963 [20:06:27<86:53:59, 10.49s/it]
                                                          
{'loss': '0.1728', 'grad_norm': '3.609', 'learning_rate': '1.827e-05', 'epoch': '0.2144'}
+
 21%|██▏       | 8140/37963 [20:06:27<86:53:59, 10.49s/it]
 21%|██▏       | 8141/37963 [20:06:35<79:46:48,  9.63s/it]
 21%|██▏       | 8142/37963 [20:06:43<74:53:34,  9.04s/it]
 21%|██▏       | 8143/37963 [20:06:50<71:38:23,  8.65s/it]
 21%|██▏       | 8144/37963 [20:06:58<69:47:48,  8.43s/it]
 21%|██▏       | 8145/37963 [20:07:06<67:58:35,  8.21s/it]
 21%|██▏       | 8146/37963 [20:07:14<66:48:18,  8.07s/it]
 21%|██▏       | 8147/37963 [20:07:28<83:05:27, 10.03s/it]
 21%|██▏       | 8148/37963 [20:07:36<77:27:31,  9.35s/it]
 21%|██▏       | 8149/37963 [20:07:44<73:08:28,  8.83s/it]
 21%|██▏       | 8150/37963 [20:07:51<70:23:19,  8.50s/it]
                                                          
{'loss': '0.1635', 'grad_norm': '3.528', 'learning_rate': '1.826e-05', 'epoch': '0.2147'}
+
 21%|██▏       | 8150/37963 [20:07:51<70:23:19,  8.50s/it]
 21%|██▏       | 8151/37963 [20:07:59<68:33:32,  8.28s/it]
 21%|██▏       | 8152/37963 [20:08:07<67:10:50,  8.11s/it]
 21%|██▏       | 8153/37963 [20:08:21<82:13:31,  9.93s/it]
 21%|██▏       | 8154/37963 [20:08:29<76:22:50,  9.22s/it]
 21%|██▏       | 8155/37963 [20:08:43<88:40:40, 10.71s/it]
 21%|██▏       | 8156/37963 [20:08:58<99:33:47, 12.02s/it]
 21%|██▏       | 8157/37963 [20:09:06<89:32:00, 10.81s/it]
 21%|██▏       | 8158/37963 [20:09:14<81:32:36,  9.85s/it]
 21%|██▏       | 8159/37963 [20:09:21<75:58:55,  9.18s/it]
 21%|██▏       | 8160/37963 [20:09:29<72:02:41,  8.70s/it]
                                                          
{'loss': '0.1651', 'grad_norm': '1.197', 'learning_rate': '1.826e-05', 'epoch': '0.2149'}
+
 21%|██▏       | 8160/37963 [20:09:29<72:02:41,  8.70s/it]
 21%|██▏       | 8161/37963 [20:09:36<68:12:41,  8.24s/it]
 21%|██▏       | 8162/37963 [20:09:44<66:37:56,  8.05s/it]
 22%|██▏       | 8163/37963 [20:09:58<82:42:07,  9.99s/it]
 22%|██▏       | 8164/37963 [20:10:06<76:56:02,  9.29s/it]
 22%|██▏       | 8165/37963 [20:10:13<72:47:07,  8.79s/it]
 22%|██▏       | 8166/37963 [20:10:21<69:56:35,  8.45s/it]
 22%|██▏       | 8167/37963 [20:10:29<68:28:01,  8.27s/it]
 22%|██▏       | 8168/37963 [20:10:36<66:41:28,  8.06s/it]
 22%|██▏       | 8169/37963 [20:10:44<65:34:16,  7.92s/it]
 22%|██▏       | 8170/37963 [20:10:52<64:59:44,  7.85s/it]
                                                          
{'loss': '0.1644', 'grad_norm': '1.795', 'learning_rate': '1.825e-05', 'epoch': '0.2152'}
+
 22%|██▏       | 8170/37963 [20:10:52<64:59:44,  7.85s/it]
 22%|██▏       | 8171/37963 [20:10:59<64:15:08,  7.76s/it]
 22%|██▏       | 8172/37963 [20:11:07<63:36:28,  7.69s/it]
 22%|██▏       | 8173/37963 [20:11:15<63:49:33,  7.71s/it]
 22%|██▏       | 8174/37963 [20:11:22<63:50:49,  7.72s/it]
 22%|██▏       | 8175/37963 [20:11:30<63:02:51,  7.62s/it]
 22%|██▏       | 8176/37963 [20:11:37<63:12:36,  7.64s/it]
 22%|██▏       | 8177/37963 [20:11:45<62:45:07,  7.58s/it]
 22%|██▏       | 8178/37963 [20:12:00<80:30:51,  9.73s/it]
 22%|██▏       | 8179/37963 [20:12:08<76:36:29,  9.26s/it]
 22%|██▏       | 8180/37963 [20:12:15<72:42:21,  8.79s/it]
                                                          
{'loss': '0.1586', 'grad_norm': '1.81', 'learning_rate': '1.825e-05', 'epoch': '0.2155'}
+
 22%|██▏       | 8180/37963 [20:12:15<72:42:21,  8.79s/it]
 22%|██▏       | 8181/37963 [20:12:23<69:51:20,  8.44s/it]
 22%|██▏       | 8182/37963 [20:12:38<85:20:54, 10.32s/it]
 22%|██▏       | 8183/37963 [20:12:46<79:33:50,  9.62s/it]
 22%|██▏       | 8184/37963 [20:13:00<91:05:46, 11.01s/it]
 22%|██▏       | 8185/37963 [20:13:08<83:09:03, 10.05s/it]
 22%|██▏       | 8186/37963 [20:13:15<76:31:43,  9.25s/it]
 22%|██▏       | 8187/37963 [20:13:23<72:54:27,  8.81s/it]
 22%|██▏       | 8188/37963 [20:13:31<70:02:55,  8.47s/it]
 22%|██▏       | 8189/37963 [20:13:38<68:01:18,  8.22s/it]
 22%|██▏       | 8190/37963 [20:13:46<67:04:43,  8.11s/it]
                                                          
{'loss': '0.1707', 'grad_norm': '3.666', 'learning_rate': '1.825e-05', 'epoch': '0.2157'}
+
 22%|██▏       | 8190/37963 [20:13:46<67:04:43,  8.11s/it]
 22%|██▏       | 8191/37963 [20:13:54<65:45:16,  7.95s/it]
 22%|██▏       | 8192/37963 [20:14:01<64:07:18,  7.75s/it]
 22%|██▏       | 8193/37963 [20:14:09<63:55:38,  7.73s/it]
 22%|██▏       | 8194/37963 [20:14:16<63:39:29,  7.70s/it]
 22%|██▏       | 8195/37963 [20:14:24<63:25:21,  7.67s/it]
 22%|██▏       | 8196/37963 [20:14:32<63:19:03,  7.66s/it]
 22%|██▏       | 8197/37963 [20:14:39<62:50:59,  7.60s/it]
 22%|██▏       | 8198/37963 [20:14:53<79:59:14,  9.67s/it]
 22%|██▏       | 8199/37963 [20:15:01<75:19:04,  9.11s/it]
 22%|██▏       | 8200/37963 [20:15:09<72:07:07,  8.72s/it]
                                                          
{'loss': '0.1738', 'grad_norm': '4.796', 'learning_rate': '1.824e-05', 'epoch': '0.216'}
+
 22%|██▏       | 8200/37963 [20:15:09<72:07:07,  8.72s/it]
 22%|██▏       | 8201/37963 [20:15:23<85:28:01, 10.34s/it]
 22%|██▏       | 8202/37963 [20:15:31<78:05:51,  9.45s/it]
 22%|██▏       | 8203/37963 [20:15:38<73:38:06,  8.91s/it]
 22%|██▏       | 8204/37963 [20:15:53<88:05:28, 10.66s/it]
 22%|██▏       | 8205/37963 [20:16:08<97:44:27, 11.82s/it]
 22%|██▏       | 8206/37963 [20:16:15<87:25:57, 10.58s/it]
 22%|██▏       | 8207/37963 [20:16:29<96:16:34, 11.65s/it]
 22%|██▏       | 8208/37963 [20:16:37<86:29:15, 10.46s/it]
 22%|██▏       | 8209/37963 [20:16:45<79:24:04,  9.61s/it]
 22%|██▏       | 8210/37963 [20:16:52<73:58:31,  8.95s/it]
                                                          
{'loss': '0.1749', 'grad_norm': '3.425', 'learning_rate': '1.824e-05', 'epoch': '0.2163'}
+
 22%|██▏       | 8210/37963 [20:16:52<73:58:31,  8.95s/it]
 22%|██▏       | 8211/37963 [20:17:00<70:27:07,  8.52s/it]
 22%|██▏       | 8212/37963 [20:17:07<68:30:58,  8.29s/it]
 22%|██▏       | 8213/37963 [20:17:15<66:52:25,  8.09s/it]
 22%|██▏       | 8214/37963 [20:17:22<65:23:48,  7.91s/it]
 22%|██▏       | 8215/37963 [20:17:30<64:00:10,  7.75s/it]
 22%|██▏       | 8216/37963 [20:17:38<63:59:11,  7.74s/it]
 22%|██▏       | 8217/37963 [20:17:45<63:49:51,  7.73s/it]
 22%|██▏       | 8218/37963 [20:17:53<63:21:05,  7.67s/it]
 22%|██▏       | 8219/37963 [20:18:00<63:03:28,  7.63s/it]
 22%|██▏       | 8220/37963 [20:18:08<63:08:46,  7.64s/it]
                                                          
{'loss': '0.1757', 'grad_norm': '1.977', 'learning_rate': '1.823e-05', 'epoch': '0.2165'}
+
 22%|██▏       | 8220/37963 [20:18:08<63:08:46,  7.64s/it]
 22%|██▏       | 8221/37963 [20:18:16<63:10:33,  7.65s/it]
 22%|██▏       | 8222/37963 [20:18:23<63:04:27,  7.63s/it]
 22%|██▏       | 8223/37963 [20:18:31<62:52:40,  7.61s/it]
 22%|██▏       | 8224/37963 [20:18:38<62:16:26,  7.54s/it]
 22%|██▏       | 8225/37963 [20:18:46<62:29:53,  7.57s/it]
 22%|██▏       | 8226/37963 [20:18:53<62:38:27,  7.58s/it]
 22%|██▏       | 8227/37963 [20:19:01<62:37:01,  7.58s/it]
 22%|██▏       | 8228/37963 [20:19:09<62:49:08,  7.61s/it]
 22%|██▏       | 8229/37963 [20:19:23<79:27:34,  9.62s/it]
 22%|██▏       | 8230/37963 [20:19:31<74:17:26,  8.99s/it]
                                                          
{'loss': '0.1626', 'grad_norm': '2.456', 'learning_rate': '1.823e-05', 'epoch': '0.2168'}
+
 22%|██▏       | 8230/37963 [20:19:31<74:17:26,  8.99s/it]
 22%|██▏       | 8231/37963 [20:19:45<89:06:21, 10.79s/it]
 22%|██▏       | 8232/37963 [20:20:00<97:15:19, 11.78s/it]
 22%|██▏       | 8233/37963 [20:20:07<87:00:20, 10.54s/it]
 22%|██▏       | 8234/37963 [20:20:15<79:52:37,  9.67s/it]
 22%|██▏       | 8235/37963 [20:20:23<74:50:58,  9.06s/it]
 22%|██▏       | 8236/37963 [20:20:30<71:13:26,  8.63s/it]
 22%|██▏       | 8237/37963 [20:20:38<68:49:19,  8.33s/it]
 22%|██▏       | 8238/37963 [20:20:46<67:20:20,  8.16s/it]
 22%|██▏       | 8239/37963 [20:20:53<65:56:34,  7.99s/it]
 22%|██▏       | 8240/37963 [20:21:01<64:52:58,  7.86s/it]
                                                          
{'loss': '0.1601', 'grad_norm': '0.7026', 'learning_rate': '1.822e-05', 'epoch': '0.2171'}
+
 22%|██▏       | 8240/37963 [20:21:01<64:52:58,  7.86s/it]
 22%|██▏       | 8241/37963 [20:21:08<64:47:25,  7.85s/it]
 22%|██▏       | 8242/37963 [20:21:23<81:00:40,  9.81s/it]
 22%|██▏       | 8243/37963 [20:21:31<75:58:23,  9.20s/it]
 22%|██▏       | 8244/37963 [20:21:38<72:32:54,  8.79s/it]
 22%|██▏       | 8245/37963 [20:21:53<85:57:19, 10.41s/it]
 22%|██▏       | 8246/37963 [20:22:00<79:22:37,  9.62s/it]
 22%|██▏       | 8247/37963 [20:22:08<74:13:23,  8.99s/it]
 22%|██▏       | 8248/37963 [20:22:16<70:48:43,  8.58s/it]
 22%|██▏       | 8249/37963 [20:22:23<68:27:53,  8.29s/it]
 22%|██▏       | 8250/37963 [20:22:31<65:59:18,  8.00s/it]
                                                          
{'loss': '0.1588', 'grad_norm': '1.439', 'learning_rate': '1.822e-05', 'epoch': '0.2173'}
+
 22%|██▏       | 8250/37963 [20:22:31<65:59:18,  8.00s/it]
 22%|██▏       | 8251/37963 [20:22:45<82:03:02,  9.94s/it]
 22%|██▏       | 8252/37963 [20:22:59<93:12:19, 11.29s/it]
 22%|██▏       | 8253/37963 [20:23:07<84:01:22, 10.18s/it]
 22%|██▏       | 8254/37963 [20:23:15<77:23:30,  9.38s/it]
 22%|██▏       | 8255/37963 [20:23:22<72:53:45,  8.83s/it]
 22%|██▏       | 8256/37963 [20:23:30<69:57:14,  8.48s/it]
 22%|██▏       | 8257/37963 [20:23:37<68:01:21,  8.24s/it]
 22%|██▏       | 8258/37963 [20:23:45<66:28:28,  8.06s/it]
 22%|██▏       | 8259/37963 [20:23:53<65:28:19,  7.93s/it]
 22%|██▏       | 8260/37963 [20:24:06<79:50:12,  9.68s/it]
                                                          
{'loss': '0.1723', 'grad_norm': '2.101', 'learning_rate': '1.821e-05', 'epoch': '0.2176'}
+
 22%|██▏       | 8260/37963 [20:24:06<79:50:12,  9.68s/it]
 22%|██▏       | 8261/37963 [20:24:14<75:25:09,  9.14s/it]
 22%|██▏       | 8262/37963 [20:24:22<71:43:59,  8.69s/it]
 22%|██▏       | 8263/37963 [20:24:30<68:50:28,  8.34s/it]
 22%|██▏       | 8264/37963 [20:24:37<67:08:54,  8.14s/it]
 22%|██▏       | 8265/37963 [20:24:45<65:35:49,  7.95s/it]
 22%|██▏       | 8266/37963 [20:24:52<64:49:03,  7.86s/it]
 22%|██▏       | 8267/37963 [20:25:00<64:09:33,  7.78s/it]
 22%|██▏       | 8268/37963 [20:25:08<63:51:47,  7.74s/it]
 22%|██▏       | 8269/37963 [20:25:15<62:59:31,  7.64s/it]
 22%|██▏       | 8270/37963 [20:25:22<62:20:05,  7.56s/it]
                                                          
{'loss': '0.1565', 'grad_norm': '1.355', 'learning_rate': '1.821e-05', 'epoch': '0.2178'}
+
 22%|██▏       | 8270/37963 [20:25:22<62:20:05,  7.56s/it]
 22%|██▏       | 8271/37963 [20:25:30<61:59:22,  7.52s/it]
 22%|██▏       | 8272/37963 [20:25:37<62:16:39,  7.55s/it]
 22%|██▏       | 8273/37963 [20:25:45<62:30:48,  7.58s/it]
 22%|██▏       | 8274/37963 [20:25:53<62:47:43,  7.61s/it]
 22%|██▏       | 8275/37963 [20:26:00<62:32:41,  7.58s/it]
 22%|██▏       | 8276/37963 [20:26:08<62:32:18,  7.58s/it]
 22%|██▏       | 8277/37963 [20:26:16<62:58:10,  7.64s/it]
 22%|██▏       | 8278/37963 [20:26:23<63:25:03,  7.69s/it]
 22%|██▏       | 8279/37963 [20:26:31<63:08:09,  7.66s/it]
 22%|██▏       | 8280/37963 [20:26:39<63:15:00,  7.67s/it]
                                                          
{'loss': '0.1608', 'grad_norm': '2.368', 'learning_rate': '1.82e-05', 'epoch': '0.2181'}
+
 22%|██▏       | 8280/37963 [20:26:39<63:15:00,  7.67s/it]
 22%|██▏       | 8281/37963 [20:26:46<62:47:40,  7.62s/it]
 22%|██▏       | 8282/37963 [20:27:01<81:06:26,  9.84s/it]
 22%|██▏       | 8283/37963 [20:27:16<92:49:37, 11.26s/it]
 22%|██▏       | 8284/37963 [20:27:30<100:02:58, 12.14s/it]
 22%|██▏       | 8285/37963 [20:27:38<89:13:54, 10.82s/it] 
 22%|██▏       | 8286/37963 [20:27:45<81:18:43,  9.86s/it]
 22%|██▏       | 8287/37963 [20:27:53<75:56:28,  9.21s/it]
 22%|██▏       | 8288/37963 [20:28:01<72:06:21,  8.75s/it]
 22%|██▏       | 8289/37963 [20:28:08<68:59:45,  8.37s/it]
 22%|██▏       | 8290/37963 [20:28:23<84:08:17, 10.21s/it]
                                                          
{'loss': '0.1688', 'grad_norm': '1.199', 'learning_rate': '1.82e-05', 'epoch': '0.2184'}
+
 22%|██▏       | 8290/37963 [20:28:23<84:08:17, 10.21s/it]
 22%|██▏       | 8291/37963 [20:28:30<77:50:08,  9.44s/it]
 22%|██▏       | 8292/37963 [20:28:38<73:12:11,  8.88s/it]
 22%|██▏       | 8293/37963 [20:28:46<70:14:40,  8.52s/it]
 22%|██▏       | 8294/37963 [20:28:53<67:59:12,  8.25s/it]
 22%|██▏       | 8295/37963 [20:29:01<65:52:50,  7.99s/it]
 22%|██▏       | 8296/37963 [20:29:15<80:55:03,  9.82s/it]
 22%|██▏       | 8297/37963 [20:29:23<76:03:05,  9.23s/it]
 22%|██▏       | 8298/37963 [20:29:30<72:07:13,  8.75s/it]
 22%|██▏       | 8299/37963 [20:29:38<69:13:37,  8.40s/it]
 22%|██▏       | 8300/37963 [20:29:52<84:26:55, 10.25s/it]
                                                          
{'loss': '0.1661', 'grad_norm': '2.018', 'learning_rate': '1.819e-05', 'epoch': '0.2186'}
+
 22%|██▏       | 8300/37963 [20:29:52<84:26:55, 10.25s/it]
 22%|██▏       | 8301/37963 [20:30:00<78:13:32,  9.49s/it]
 22%|██▏       | 8302/37963 [20:30:08<73:38:07,  8.94s/it]
 22%|██▏       | 8303/37963 [20:30:22<88:00:08, 10.68s/it]
 22%|██▏       | 8304/37963 [20:30:30<80:40:48,  9.79s/it]
 22%|██▏       | 8305/37963 [20:30:45<92:18:17, 11.20s/it]
 22%|██▏       | 8306/37963 [20:30:52<83:44:36, 10.17s/it]
 22%|██▏       | 8307/37963 [20:31:00<77:34:36,  9.42s/it]
 22%|██▏       | 8308/37963 [20:31:08<72:56:11,  8.85s/it]
 22%|██▏       | 8309/37963 [20:31:15<69:28:08,  8.43s/it]
 22%|██▏       | 8310/37963 [20:31:23<67:39:16,  8.21s/it]
                                                          
{'loss': '0.166', 'grad_norm': '1.395', 'learning_rate': '1.819e-05', 'epoch': '0.2189'}
+
 22%|██▏       | 8310/37963 [20:31:23<67:39:16,  8.21s/it]
 22%|██▏       | 8311/37963 [20:31:30<66:21:23,  8.06s/it]
 22%|██▏       | 8312/37963 [20:31:38<65:27:00,  7.95s/it]
 22%|██▏       | 8313/37963 [20:31:46<64:37:31,  7.85s/it]
 22%|██▏       | 8314/37963 [20:31:53<64:17:38,  7.81s/it]
 22%|██▏       | 8315/37963 [20:32:01<63:28:36,  7.71s/it]
 22%|██▏       | 8316/37963 [20:32:09<63:37:54,  7.73s/it]
 22%|██▏       | 8317/37963 [20:32:16<63:28:00,  7.71s/it]
 22%|██▏       | 8318/37963 [20:32:24<63:00:44,  7.65s/it]
 22%|██▏       | 8319/37963 [20:32:32<63:04:33,  7.66s/it]
 22%|██▏       | 8320/37963 [20:32:39<63:00:14,  7.65s/it]
                                                          
{'loss': '0.1645', 'grad_norm': '1.241', 'learning_rate': '1.818e-05', 'epoch': '0.2192'}
+
 22%|██▏       | 8320/37963 [20:32:39<63:00:14,  7.65s/it]
 22%|██▏       | 8321/37963 [20:32:47<62:51:37,  7.63s/it]
 22%|██▏       | 8322/37963 [20:32:54<62:52:36,  7.64s/it]
 22%|██▏       | 8323/37963 [20:33:02<62:42:54,  7.62s/it]
 22%|██▏       | 8324/37963 [20:33:10<62:45:45,  7.62s/it]
 22%|██▏       | 8325/37963 [20:33:17<62:55:28,  7.64s/it]
 22%|██▏       | 8326/37963 [20:33:25<63:09:54,  7.67s/it]
 22%|██▏       | 8327/37963 [20:33:32<62:18:30,  7.57s/it]
 22%|██▏       | 8328/37963 [20:33:40<62:31:02,  7.59s/it]
 22%|██▏       | 8329/37963 [20:33:55<80:33:17,  9.79s/it]
 22%|██▏       | 8330/37963 [20:34:02<74:48:46,  9.09s/it]
                                                          
{'loss': '0.1596', 'grad_norm': '2.883', 'learning_rate': '1.818e-05', 'epoch': '0.2194'}
+
 22%|██▏       | 8330/37963 [20:34:02<74:48:46,  9.09s/it]
 22%|██▏       | 8331/37963 [20:34:17<88:49:38, 10.79s/it]
 22%|██▏       | 8332/37963 [20:34:25<80:24:26,  9.77s/it]
 22%|██▏       | 8333/37963 [20:34:32<75:09:05,  9.13s/it]
 22%|██▏       | 8334/37963 [20:34:40<71:35:11,  8.70s/it]
 22%|██▏       | 8335/37963 [20:34:54<85:23:13, 10.38s/it]
 22%|██▏       | 8336/37963 [20:35:09<95:33:08, 11.61s/it]
 22%|██▏       | 8337/37963 [20:35:17<86:08:39, 10.47s/it]
 22%|██▏       | 8338/37963 [20:35:24<78:56:22,  9.59s/it]
 22%|██▏       | 8339/37963 [20:35:32<74:05:13,  9.00s/it]
 22%|██▏       | 8340/37963 [20:35:39<70:36:52,  8.58s/it]
                                                          
{'loss': '0.1834', 'grad_norm': '3.494', 'learning_rate': '1.817e-05', 'epoch': '0.2197'}
+
 22%|██▏       | 8340/37963 [20:35:39<70:36:52,  8.58s/it]
 22%|██▏       | 8341/37963 [20:35:47<68:32:53,  8.33s/it]
 22%|██▏       | 8342/37963 [20:35:54<66:22:49,  8.07s/it]
 22%|██▏       | 8343/37963 [20:36:09<81:44:27,  9.93s/it]
 22%|██▏       | 8344/37963 [20:36:16<74:57:02,  9.11s/it]
 22%|██▏       | 8345/37963 [20:36:24<71:36:39,  8.70s/it]
 22%|██▏       | 8346/37963 [20:36:38<85:05:52, 10.34s/it]
 22%|██▏       | 8347/37963 [20:36:46<78:34:06,  9.55s/it]
 22%|██▏       | 8348/37963 [20:37:01<92:04:04, 11.19s/it]
 22%|██▏       | 8349/37963 [20:37:08<83:22:19, 10.14s/it]
 22%|██▏       | 8350/37963 [20:37:16<77:37:05,  9.44s/it]
                                                          
{'loss': '0.1825', 'grad_norm': '1.923', 'learning_rate': '1.817e-05', 'epoch': '0.22'}
+
 22%|██▏       | 8350/37963 [20:37:16<77:37:05,  9.44s/it]
 22%|██▏       | 8351/37963 [20:37:24<73:20:47,  8.92s/it]
 22%|██▏       | 8352/37963 [20:37:32<70:32:15,  8.58s/it]
 22%|██▏       | 8353/37963 [20:37:39<68:37:05,  8.34s/it]
 22%|██▏       | 8354/37963 [20:37:54<83:35:09, 10.16s/it]
 22%|██▏       | 8355/37963 [20:38:01<77:09:34,  9.38s/it]
 22%|██▏       | 8356/37963 [20:38:09<72:55:45,  8.87s/it]
 22%|██▏       | 8357/37963 [20:38:17<69:47:38,  8.49s/it]
 22%|██▏       | 8358/37963 [20:38:24<67:58:08,  8.27s/it]
 22%|██▏       | 8359/37963 [20:38:32<67:01:22,  8.15s/it]
 22%|██▏       | 8360/37963 [20:38:40<65:11:49,  7.93s/it]
                                                          
{'loss': '0.1701', 'grad_norm': '2.582', 'learning_rate': '1.816e-05', 'epoch': '0.2202'}
+
 22%|██▏       | 8360/37963 [20:38:40<65:11:49,  7.93s/it]
 22%|██▏       | 8361/37963 [20:38:47<64:43:03,  7.87s/it]
 22%|██▏       | 8362/37963 [20:38:55<64:00:46,  7.79s/it]
 22%|██▏       | 8363/37963 [20:39:03<63:26:47,  7.72s/it]
 22%|██▏       | 8364/37963 [20:39:10<63:31:12,  7.73s/it]
 22%|██▏       | 8365/37963 [20:39:18<63:25:34,  7.71s/it]
 22%|██▏       | 8366/37963 [20:39:25<62:27:29,  7.60s/it]
 22%|██▏       | 8367/37963 [20:39:33<62:31:02,  7.60s/it]
 22%|██▏       | 8368/37963 [20:39:41<62:52:56,  7.65s/it]
 22%|██▏       | 8369/37963 [20:39:48<62:38:24,  7.62s/it]
 22%|██▏       | 8370/37963 [20:39:56<62:49:38,  7.64s/it]
                                                          
{'loss': '0.1597', 'grad_norm': '1.082', 'learning_rate': '1.816e-05', 'epoch': '0.2205'}
+
 22%|██▏       | 8370/37963 [20:39:56<62:49:38,  7.64s/it]
 22%|██▏       | 8371/37963 [20:40:04<63:01:11,  7.67s/it]
 22%|██▏       | 8372/37963 [20:40:11<62:58:18,  7.66s/it]
 22%|██▏       | 8373/37963 [20:40:19<62:50:19,  7.65s/it]
 22%|██▏       | 8374/37963 [20:40:26<62:34:58,  7.61s/it]
 22%|██▏       | 8375/37963 [20:40:34<62:15:52,  7.58s/it]
 22%|██▏       | 8376/37963 [20:40:42<62:30:41,  7.61s/it]
 22%|██▏       | 8377/37963 [20:40:49<62:43:37,  7.63s/it]
 22%|██▏       | 8378/37963 [20:40:57<62:16:37,  7.58s/it]
 22%|██▏       | 8379/37963 [20:41:12<80:33:13,  9.80s/it]
 22%|██▏       | 8380/37963 [20:41:19<74:47:53,  9.10s/it]
                                                          
{'loss': '0.167', 'grad_norm': '1.297', 'learning_rate': '1.815e-05', 'epoch': '0.2207'}
+
 22%|██▏       | 8380/37963 [20:41:19<74:47:53,  9.10s/it]
 22%|██▏       | 8381/37963 [20:41:34<87:55:03, 10.70s/it]
 22%|██▏       | 8382/37963 [20:41:49<98:20:45, 11.97s/it]
 22%|██▏       | 8383/37963 [20:41:56<88:02:50, 10.72s/it]
 22%|██▏       | 8384/37963 [20:42:04<80:12:43,  9.76s/it]
 22%|██▏       | 8385/37963 [20:42:18<91:18:17, 11.11s/it]
 22%|██▏       | 8386/37963 [20:42:26<82:42:11, 10.07s/it]
 22%|██▏       | 8387/37963 [20:42:33<76:49:21,  9.35s/it]
 22%|██▏       | 8388/37963 [20:42:48<88:49:15, 10.81s/it]
 22%|██▏       | 8389/37963 [20:42:55<81:16:24,  9.89s/it]
 22%|██▏       | 8390/37963 [20:43:10<91:44:20, 11.17s/it]
                                                          
{'loss': '0.1772', 'grad_norm': '1.688', 'learning_rate': '1.815e-05', 'epoch': '0.221'}
+
 22%|██▏       | 8390/37963 [20:43:10<91:44:20, 11.17s/it]
 22%|██▏       | 8391/37963 [20:43:17<83:21:20, 10.15s/it]
 22%|██▏       | 8392/37963 [20:43:25<77:07:42,  9.39s/it]
 22%|██▏       | 8393/37963 [20:43:33<72:49:09,  8.87s/it]
 22%|██▏       | 8394/37963 [20:43:40<69:53:56,  8.51s/it]
 22%|██▏       | 8395/37963 [20:43:48<67:48:20,  8.26s/it]
 22%|██▏       | 8396/37963 [20:44:03<85:08:25, 10.37s/it]
 22%|██▏       | 8397/37963 [20:44:11<78:07:17,  9.51s/it]
 22%|██▏       | 8398/37963 [20:44:18<73:35:10,  8.96s/it]
 22%|██▏       | 8399/37963 [20:44:26<70:12:26,  8.55s/it]
 22%|██▏       | 8400/37963 [20:44:34<68:01:57,  8.28s/it]
                                                          
{'loss': '0.1618', 'grad_norm': '0.9895', 'learning_rate': '1.814e-05', 'epoch': '0.2213'}
+
 22%|██▏       | 8400/37963 [20:44:34<68:01:57,  8.28s/it]
 22%|██▏       | 8401/37963 [20:44:41<66:23:20,  8.08s/it]
 22%|██▏       | 8402/37963 [20:44:49<65:35:07,  7.99s/it]
 22%|██▏       | 8403/37963 [20:45:03<80:31:22,  9.81s/it]
 22%|██▏       | 8404/37963 [20:45:11<75:14:27,  9.16s/it]
 22%|██▏       | 8405/37963 [20:45:19<71:47:21,  8.74s/it]
 22%|██▏       | 8406/37963 [20:45:26<69:14:58,  8.43s/it]
 22%|██▏       | 8407/37963 [20:45:34<66:44:01,  8.13s/it]
 22%|██▏       | 8408/37963 [20:45:41<65:51:47,  8.02s/it]
 22%|██▏       | 8409/37963 [20:45:49<65:23:52,  7.97s/it]
 22%|██▏       | 8410/37963 [20:45:57<64:35:53,  7.87s/it]
                                                          
{'loss': '0.1751', 'grad_norm': '1.701', 'learning_rate': '1.814e-05', 'epoch': '0.2215'}
+
 22%|██▏       | 8410/37963 [20:45:57<64:35:53,  7.87s/it]
 22%|██▏       | 8411/37963 [20:46:05<64:12:18,  7.82s/it]
 22%|██▏       | 8412/37963 [20:46:12<63:51:20,  7.78s/it]
 22%|██▏       | 8413/37963 [20:46:20<63:38:32,  7.75s/it]
 22%|██▏       | 8414/37963 [20:46:28<63:32:36,  7.74s/it]
 22%|██▏       | 8415/37963 [20:46:35<63:12:49,  7.70s/it]
 22%|██▏       | 8416/37963 [20:46:43<63:09:50,  7.70s/it]
 22%|██▏       | 8417/37963 [20:46:51<63:11:15,  7.70s/it]
 22%|██▏       | 8418/37963 [20:46:58<62:22:47,  7.60s/it]
 22%|██▏       | 8419/37963 [20:47:06<62:33:35,  7.62s/it]
 22%|██▏       | 8420/37963 [20:47:13<62:42:38,  7.64s/it]
                                                          
{'loss': '0.1612', 'grad_norm': '1.019', 'learning_rate': '1.813e-05', 'epoch': '0.2218'}
+
 22%|██▏       | 8420/37963 [20:47:13<62:42:38,  7.64s/it]
 22%|██▏       | 8421/37963 [20:47:21<62:58:41,  7.67s/it]
 22%|██▏       | 8422/37963 [20:47:29<63:31:49,  7.74s/it]
 22%|██▏       | 8423/37963 [20:47:37<63:08:48,  7.70s/it]
 22%|██▏       | 8424/37963 [20:47:51<79:13:46,  9.66s/it]
 22%|██▏       | 8425/37963 [20:47:59<74:37:17,  9.09s/it]
 22%|██▏       | 8426/37963 [20:48:06<70:54:31,  8.64s/it]
 22%|██▏       | 8427/37963 [20:48:14<68:16:24,  8.32s/it]
 22%|██▏       | 8428/37963 [20:48:21<66:10:06,  8.07s/it]
 22%|██▏       | 8429/37963 [20:48:36<82:20:18, 10.04s/it]
 22%|██▏       | 8430/37963 [20:48:51<93:46:00, 11.43s/it]
                                                          
{'loss': '0.1736', 'grad_norm': '1.261', 'learning_rate': '1.813e-05', 'epoch': '0.2221'}
+
 22%|██▏       | 8430/37963 [20:48:51<93:46:00, 11.43s/it]
 22%|██▏       | 8431/37963 [20:48:58<84:21:24, 10.28s/it]
 22%|██▏       | 8432/37963 [20:49:06<77:47:52,  9.48s/it]
 22%|██▏       | 8433/37963 [20:49:13<72:57:08,  8.89s/it]
 22%|██▏       | 8434/37963 [20:49:28<87:24:46, 10.66s/it]
 22%|██▏       | 8435/37963 [20:49:43<96:53:08, 11.81s/it]
 22%|██▏       | 8436/37963 [20:49:50<86:28:50, 10.54s/it]
 22%|██▏       | 8437/37963 [20:49:58<79:29:32,  9.69s/it]
 22%|██▏       | 8438/37963 [20:50:06<74:13:46,  9.05s/it]
 22%|██▏       | 8439/37963 [20:50:26<102:24:42, 12.49s/it]
 22%|██▏       | 8440/37963 [20:50:34<90:53:51, 11.08s/it] 
                                                          
{'loss': '0.1729', 'grad_norm': '3.693', 'learning_rate': '1.812e-05', 'epoch': '0.2223'}
+
 22%|██▏       | 8440/37963 [20:50:34<90:53:51, 11.08s/it]
 22%|██▏       | 8441/37963 [20:50:41<82:13:04, 10.03s/it]
 22%|██▏       | 8442/37963 [20:50:49<76:26:31,  9.32s/it]
 22%|██▏       | 8443/37963 [20:50:57<72:22:13,  8.83s/it]
 22%|██▏       | 8444/37963 [20:51:04<69:24:40,  8.47s/it]
 22%|██▏       | 8445/37963 [20:51:12<67:27:12,  8.23s/it]
 22%|██▏       | 8446/37963 [20:51:20<66:03:51,  8.06s/it]
 22%|██▏       | 8447/37963 [20:51:27<64:58:20,  7.92s/it]
 22%|██▏       | 8448/37963 [20:51:35<64:12:08,  7.83s/it]
 22%|██▏       | 8449/37963 [20:51:42<63:25:39,  7.74s/it]
 22%|██▏       | 8450/37963 [20:51:50<63:23:12,  7.73s/it]
                                                          
{'loss': '0.1655', 'grad_norm': '3.692', 'learning_rate': '1.812e-05', 'epoch': '0.2226'}
+
 22%|██▏       | 8450/37963 [20:51:50<63:23:12,  7.73s/it]
 22%|██▏       | 8451/37963 [20:51:58<63:05:59,  7.70s/it]
 22%|██▏       | 8452/37963 [20:52:05<62:24:57,  7.61s/it]
 22%|██▏       | 8453/37963 [20:52:13<62:27:22,  7.62s/it]
 22%|██▏       | 8454/37963 [20:52:20<62:17:43,  7.60s/it]
 22%|██▏       | 8455/37963 [20:52:28<62:05:00,  7.57s/it]
 22%|██▏       | 8456/37963 [20:52:42<78:52:08,  9.62s/it]
 22%|██▏       | 8457/37963 [20:52:50<75:06:21,  9.16s/it]
 22%|██▏       | 8458/37963 [20:52:58<71:33:31,  8.73s/it]
 22%|██▏       | 8459/37963 [20:53:06<68:55:56,  8.41s/it]
 22%|██▏       | 8460/37963 [20:53:13<67:00:15,  8.18s/it]
                                                          
{'loss': '0.1671', 'grad_norm': '2.027', 'learning_rate': '1.811e-05', 'epoch': '0.2228'}
+
 22%|██▏       | 8460/37963 [20:53:13<67:00:15,  8.18s/it]
 22%|██▏       | 8461/37963 [20:53:21<65:59:22,  8.05s/it]
 22%|██▏       | 8462/37963 [20:53:29<65:06:39,  7.95s/it]
 22%|██▏       | 8463/37963 [20:53:37<64:27:00,  7.87s/it]
 22%|██▏       | 8464/37963 [20:53:44<63:15:25,  7.72s/it]
 22%|██▏       | 8465/37963 [20:53:52<63:17:04,  7.72s/it]
 22%|██▏       | 8466/37963 [20:53:59<63:03:58,  7.70s/it]
 22%|██▏       | 8467/37963 [20:54:07<63:14:29,  7.72s/it]
 22%|██▏       | 8468/37963 [20:54:15<63:03:40,  7.70s/it]
 22%|██▏       | 8469/37963 [20:54:22<62:51:02,  7.67s/it]
 22%|██▏       | 8470/37963 [20:54:30<62:18:52,  7.61s/it]
                                                          
{'loss': '0.1657', 'grad_norm': '0.7056', 'learning_rate': '1.811e-05', 'epoch': '0.2231'}
+
 22%|██▏       | 8470/37963 [20:54:30<62:18:52,  7.61s/it]
 22%|██▏       | 8471/37963 [20:54:38<62:40:47,  7.65s/it]
 22%|██▏       | 8472/37963 [20:54:45<62:30:33,  7.63s/it]
 22%|██▏       | 8473/37963 [20:55:00<79:10:18,  9.66s/it]
 22%|██▏       | 8474/37963 [20:55:07<73:38:33,  8.99s/it]
 22%|██▏       | 8475/37963 [20:55:15<70:27:57,  8.60s/it]
 22%|██▏       | 8476/37963 [20:55:22<68:03:17,  8.31s/it]
 22%|██▏       | 8477/37963 [20:55:37<83:53:53, 10.24s/it]
 22%|██▏       | 8478/37963 [20:55:45<77:15:16,  9.43s/it]
 22%|██▏       | 8479/37963 [20:55:52<73:05:08,  8.92s/it]
 22%|██▏       | 8480/37963 [20:56:00<70:06:33,  8.56s/it]
                                                          
{'loss': '0.1692', 'grad_norm': '4.772', 'learning_rate': '1.81e-05', 'epoch': '0.2234'}
+
 22%|██▏       | 8480/37963 [20:56:00<70:06:33,  8.56s/it]
 22%|██▏       | 8481/37963 [20:56:21<101:17:14, 12.37s/it]
 22%|██▏       | 8482/37963 [20:56:36<108:10:49, 13.21s/it]
 22%|██▏       | 8483/37963 [20:56:44<94:56:03, 11.59s/it] 
 22%|██▏       | 8484/37963 [20:56:59<101:29:39, 12.39s/it]
 22%|██▏       | 8485/37963 [20:57:06<89:23:44, 10.92s/it] 
 22%|██▏       | 8486/37963 [20:57:13<80:49:18,  9.87s/it]
 22%|██▏       | 8487/37963 [20:57:21<75:28:11,  9.22s/it]
 22%|██▏       | 8488/37963 [20:57:29<71:14:44,  8.70s/it]
 22%|██▏       | 8489/37963 [20:57:36<68:33:37,  8.37s/it]
 22%|██▏       | 8490/37963 [20:57:44<66:52:54,  8.17s/it]
                                                          
{'loss': '0.1586', 'grad_norm': '2.959', 'learning_rate': '1.81e-05', 'epoch': '0.2236'}
+
 22%|██▏       | 8490/37963 [20:57:44<66:52:54,  8.17s/it]
 22%|██▏       | 8491/37963 [20:57:52<66:18:32,  8.10s/it]
 22%|██▏       | 8492/37963 [20:57:59<65:04:31,  7.95s/it]
 22%|██▏       | 8493/37963 [20:58:07<64:10:09,  7.84s/it]
 22%|██▏       | 8494/37963 [20:58:22<81:21:05,  9.94s/it]
 22%|██▏       | 8495/37963 [20:58:29<75:38:45,  9.24s/it]
 22%|██▏       | 8496/37963 [20:58:37<71:22:26,  8.72s/it]
 22%|██▏       | 8497/37963 [20:58:44<67:59:46,  8.31s/it]
 22%|██▏       | 8498/37963 [20:58:52<66:25:59,  8.12s/it]
 22%|██▏       | 8499/37963 [20:58:59<64:31:20,  7.88s/it]
 22%|██▏       | 8500/37963 [20:59:07<63:55:46,  7.81s/it]
                                                          
{'loss': '0.16', 'grad_norm': '3.748', 'learning_rate': '1.809e-05', 'epoch': '0.2239'}
+
 22%|██▏       | 8500/37963 [20:59:07<63:55:46,  7.81s/it]
 22%|██▏       | 8501/37963 [20:59:14<62:42:48,  7.66s/it]
 22%|██▏       | 8502/37963 [20:59:22<62:50:13,  7.68s/it]
 22%|██▏       | 8503/37963 [20:59:30<62:56:02,  7.69s/it]
 22%|██▏       | 8504/37963 [20:59:44<78:59:38,  9.65s/it]
 22%|██▏       | 8505/37963 [20:59:52<74:36:23,  9.12s/it]
 22%|██▏       | 8506/37963 [20:59:59<70:58:09,  8.67s/it]
 22%|██▏       | 8507/37963 [21:00:07<68:16:16,  8.34s/it]
 22%|██▏       | 8508/37963 [21:00:15<66:29:08,  8.13s/it]
 22%|██▏       | 8509/37963 [21:00:22<65:25:30,  8.00s/it]
 22%|██▏       | 8510/37963 [21:00:30<64:27:43,  7.88s/it]
                                                          
{'loss': '0.1653', 'grad_norm': '1.57', 'learning_rate': '1.809e-05', 'epoch': '0.2242'}
+
 22%|██▏       | 8510/37963 [21:00:30<64:27:43,  7.88s/it]
 22%|██▏       | 8511/37963 [21:00:38<63:56:04,  7.81s/it]
 22%|██▏       | 8512/37963 [21:00:45<63:44:16,  7.79s/it]
 22%|██▏       | 8513/37963 [21:00:53<63:28:07,  7.76s/it]
 22%|██▏       | 8514/37963 [21:01:01<62:52:33,  7.69s/it]
 22%|██▏       | 8515/37963 [21:01:08<63:10:02,  7.72s/it]
 22%|██▏       | 8516/37963 [21:01:16<62:40:37,  7.66s/it]
 22%|██▏       | 8517/37963 [21:01:23<62:32:36,  7.65s/it]
 22%|██▏       | 8518/37963 [21:01:31<62:41:12,  7.66s/it]
 22%|██▏       | 8519/37963 [21:01:45<78:31:00,  9.60s/it]
 22%|██▏       | 8520/37963 [21:01:53<73:33:31,  8.99s/it]
                                                          
{'loss': '0.1717', 'grad_norm': '3.306', 'learning_rate': '1.808e-05', 'epoch': '0.2244'}
+
 22%|██▏       | 8520/37963 [21:01:53<73:33:31,  8.99s/it]
 22%|██▏       | 8521/37963 [21:02:07<86:41:58, 10.60s/it]
 22%|██▏       | 8522/37963 [21:02:15<79:22:10,  9.71s/it]
 22%|██▏       | 8523/37963 [21:02:23<74:18:18,  9.09s/it]
 22%|██▏       | 8524/37963 [21:02:37<87:26:59, 10.69s/it]
 22%|██▏       | 8525/37963 [21:02:51<95:24:02, 11.67s/it]
 22%|██▏       | 8526/37963 [21:02:59<86:15:02, 10.55s/it]
 22%|██▏       | 8527/37963 [21:03:06<78:35:27,  9.61s/it]
 22%|██▏       | 8528/37963 [21:03:14<73:54:54,  9.04s/it]
 22%|██▏       | 8529/37963 [21:03:28<86:43:19, 10.61s/it]
 22%|██▏       | 8530/37963 [21:03:36<79:53:17,  9.77s/it]
                                                          
{'loss': '0.1688', 'grad_norm': '1.126', 'learning_rate': '1.808e-05', 'epoch': '0.2247'}
+
 22%|██▏       | 8530/37963 [21:03:36<79:53:17,  9.77s/it]
 22%|██▏       | 8531/37963 [21:03:44<74:44:28,  9.14s/it]
 22%|██▏       | 8532/37963 [21:03:51<71:05:46,  8.70s/it]
 22%|██▏       | 8533/37963 [21:03:59<68:21:13,  8.36s/it]
 22%|██▏       | 8534/37963 [21:04:06<66:14:09,  8.10s/it]
 22%|██▏       | 8535/37963 [21:04:14<65:01:03,  7.95s/it]
 22%|██▏       | 8536/37963 [21:04:28<80:00:44,  9.79s/it]
 22%|██▏       | 8537/37963 [21:04:36<74:20:22,  9.09s/it]
 22%|██▏       | 8538/37963 [21:04:43<70:41:42,  8.65s/it]
 22%|██▏       | 8539/37963 [21:04:51<67:39:14,  8.28s/it]
 22%|██▏       | 8540/37963 [21:04:58<65:56:45,  8.07s/it]
                                                          
{'loss': '0.1532', 'grad_norm': '2.305', 'learning_rate': '1.807e-05', 'epoch': '0.225'}
+
 22%|██▏       | 8540/37963 [21:04:58<65:56:45,  8.07s/it]
 22%|██▏       | 8541/37963 [21:05:06<65:03:19,  7.96s/it]
 23%|██▎       | 8542/37963 [21:05:21<81:50:08, 10.01s/it]
 23%|██▎       | 8543/37963 [21:05:28<75:34:53,  9.25s/it]
 23%|██▎       | 8544/37963 [21:05:36<71:40:41,  8.77s/it]
 23%|██▎       | 8545/37963 [21:05:44<69:03:57,  8.45s/it]
 23%|██▎       | 8546/37963 [21:05:51<67:13:27,  8.23s/it]
 23%|██▎       | 8547/37963 [21:05:59<66:07:21,  8.09s/it]
 23%|██▎       | 8548/37963 [21:06:07<64:54:16,  7.94s/it]
 23%|██▎       | 8549/37963 [21:06:14<64:03:03,  7.84s/it]
 23%|██▎       | 8550/37963 [21:06:22<63:32:00,  7.78s/it]
                                                          
{'loss': '0.1614', 'grad_norm': '2.619', 'learning_rate': '1.807e-05', 'epoch': '0.2252'}
+
 23%|██▎       | 8550/37963 [21:06:22<63:32:00,  7.78s/it]
 23%|██▎       | 8551/37963 [21:06:36<78:52:45,  9.65s/it]
 23%|██▎       | 8552/37963 [21:06:44<74:04:24,  9.07s/it]
 23%|██▎       | 8553/37963 [21:06:51<70:46:37,  8.66s/it]
 23%|██▎       | 8554/37963 [21:06:59<68:13:07,  8.35s/it]
 23%|██▎       | 8555/37963 [21:07:07<66:21:07,  8.12s/it]
 23%|██▎       | 8556/37963 [21:07:14<65:07:14,  7.97s/it]
 23%|██▎       | 8557/37963 [21:07:22<64:37:41,  7.91s/it]
 23%|██▎       | 8558/37963 [21:07:29<63:46:17,  7.81s/it]
 23%|██▎       | 8559/37963 [21:07:37<63:17:57,  7.75s/it]
 23%|██▎       | 8560/37963 [21:07:44<62:18:00,  7.63s/it]
                                                          
{'loss': '0.17', 'grad_norm': '2.501', 'learning_rate': '1.806e-05', 'epoch': '0.2255'}
+
 23%|██▎       | 8560/37963 [21:07:44<62:18:00,  7.63s/it]
 23%|██▎       | 8561/37963 [21:07:52<62:31:26,  7.66s/it]
 23%|██▎       | 8562/37963 [21:08:00<62:33:24,  7.66s/it]
 23%|██▎       | 8563/37963 [21:08:07<62:15:04,  7.62s/it]
 23%|██▎       | 8564/37963 [21:08:15<62:30:47,  7.65s/it]
 23%|██▎       | 8565/37963 [21:08:23<62:33:45,  7.66s/it]
 23%|██▎       | 8566/37963 [21:08:30<62:17:51,  7.63s/it]
 23%|██▎       | 8567/37963 [21:08:52<95:34:16, 11.70s/it]
 23%|██▎       | 8568/37963 [21:08:59<86:22:12, 10.58s/it]
 23%|██▎       | 8569/37963 [21:09:07<79:08:25,  9.69s/it]
 23%|██▎       | 8570/37963 [21:09:15<73:58:51,  9.06s/it]
                                                          
{'loss': '0.1536', 'grad_norm': '1.63', 'learning_rate': '1.806e-05', 'epoch': '0.2257'}
+
 23%|██▎       | 8570/37963 [21:09:15<73:58:51,  9.06s/it]
 23%|██▎       | 8571/37963 [21:09:22<70:52:45,  8.68s/it]
 23%|██▎       | 8572/37963 [21:09:30<68:30:14,  8.39s/it]
 23%|██▎       | 8573/37963 [21:09:52<100:43:31, 12.34s/it]
 23%|██▎       | 8574/37963 [21:09:59<89:12:27, 10.93s/it] 
 23%|██▎       | 8575/37963 [21:10:07<81:21:23,  9.97s/it]
 23%|██▎       | 8576/37963 [21:10:22<92:53:16, 11.38s/it]
 23%|██▎       | 8577/37963 [21:10:29<83:35:45, 10.24s/it]
 23%|██▎       | 8578/37963 [21:10:37<77:38:45,  9.51s/it]
 23%|██▎       | 8579/37963 [21:10:44<72:14:22,  8.85s/it]
 23%|██▎       | 8580/37963 [21:10:52<69:12:22,  8.48s/it]
                                                          
{'loss': '0.1695', 'grad_norm': '2.038', 'learning_rate': '1.805e-05', 'epoch': '0.226'}
+
 23%|██▎       | 8580/37963 [21:10:52<69:12:22,  8.48s/it]
 23%|██▎       | 8581/37963 [21:11:00<67:13:27,  8.24s/it]
 23%|██▎       | 8582/37963 [21:11:14<81:26:22,  9.98s/it]
 23%|██▎       | 8583/37963 [21:11:22<75:59:14,  9.31s/it]
 23%|██▎       | 8584/37963 [21:11:29<71:46:35,  8.80s/it]
 23%|██▎       | 8585/37963 [21:11:37<68:33:44,  8.40s/it]
 23%|██▎       | 8586/37963 [21:11:51<84:00:26, 10.29s/it]
 23%|██▎       | 8587/37963 [21:11:59<77:38:53,  9.52s/it]
 23%|██▎       | 8588/37963 [21:12:07<72:39:14,  8.90s/it]
 23%|██▎       | 8589/37963 [21:12:14<69:15:30,  8.49s/it]
 23%|██▎       | 8590/37963 [21:12:22<66:59:23,  8.21s/it]
                                                          
{'loss': '0.1665', 'grad_norm': '1.355', 'learning_rate': '1.805e-05', 'epoch': '0.2263'}
+
 23%|██▎       | 8590/37963 [21:12:22<66:59:23,  8.21s/it]
 23%|██▎       | 8591/37963 [21:12:29<65:37:13,  8.04s/it]
 23%|██▎       | 8592/37963 [21:12:37<64:55:31,  7.96s/it]
 23%|██▎       | 8593/37963 [21:12:45<64:11:22,  7.87s/it]
 23%|██▎       | 8594/37963 [21:12:52<63:51:28,  7.83s/it]
 23%|██▎       | 8595/37963 [21:13:07<79:38:09,  9.76s/it]
 23%|██▎       | 8596/37963 [21:13:14<74:46:44,  9.17s/it]
 23%|██▎       | 8597/37963 [21:13:22<70:27:57,  8.64s/it]
 23%|██▎       | 8598/37963 [21:13:30<68:02:50,  8.34s/it]
 23%|██▎       | 8599/37963 [21:13:37<66:13:13,  8.12s/it]
 23%|██▎       | 8600/37963 [21:13:45<65:00:02,  7.97s/it]
                                                          
{'loss': '0.1816', 'grad_norm': '2.086', 'learning_rate': '1.804e-05', 'epoch': '0.2265'}
+
 23%|██▎       | 8600/37963 [21:13:45<65:00:02,  7.97s/it]
 23%|██▎       | 8601/37963 [21:13:52<64:15:07,  7.88s/it]
 23%|██▎       | 8602/37963 [21:14:00<63:07:19,  7.74s/it]
 23%|██▎       | 8603/37963 [21:14:07<62:57:20,  7.72s/it]
 23%|██▎       | 8604/37963 [21:14:15<62:42:49,  7.69s/it]
 23%|██▎       | 8605/37963 [21:14:23<62:50:13,  7.71s/it]
 23%|██▎       | 8606/37963 [21:14:30<62:38:18,  7.68s/it]
 23%|██▎       | 8607/37963 [21:14:38<62:30:10,  7.66s/it]
 23%|██▎       | 8608/37963 [21:14:46<62:39:23,  7.68s/it]
 23%|██▎       | 8609/37963 [21:14:54<62:54:29,  7.72s/it]
 23%|██▎       | 8610/37963 [21:15:01<63:06:55,  7.74s/it]
                                                          
{'loss': '0.1653', 'grad_norm': '0.6403', 'learning_rate': '1.804e-05', 'epoch': '0.2268'}
+
 23%|██▎       | 8610/37963 [21:15:01<63:06:55,  7.74s/it]
 23%|██▎       | 8611/37963 [21:15:09<62:39:48,  7.69s/it]
 23%|██▎       | 8612/37963 [21:15:17<62:32:11,  7.67s/it]
 23%|██▎       | 8613/37963 [21:15:24<62:14:23,  7.63s/it]
 23%|██▎       | 8614/37963 [21:15:32<62:18:01,  7.64s/it]
 23%|██▎       | 8615/37963 [21:15:39<61:58:10,  7.60s/it]
 23%|██▎       | 8616/37963 [21:15:54<78:48:58,  9.67s/it]
 23%|██▎       | 8617/37963 [21:16:15<107:03:58, 13.13s/it]
 23%|██▎       | 8618/37963 [21:16:23<93:50:22, 11.51s/it] 
 23%|██▎       | 8619/37963 [21:16:30<83:32:34, 10.25s/it]
 23%|██▎       | 8620/37963 [21:16:45<94:47:48, 11.63s/it]
                                                          
{'loss': '0.1571', 'grad_norm': '1.842', 'learning_rate': '1.803e-05', 'epoch': '0.2271'}
+
 23%|██▎       | 8620/37963 [21:16:45<94:47:48, 11.63s/it]
 23%|██▎       | 8621/37963 [21:16:53<85:05:02, 10.44s/it]
 23%|██▎       | 8622/37963 [21:17:00<78:35:29,  9.64s/it]
 23%|██▎       | 8623/37963 [21:17:08<72:43:43,  8.92s/it]
 23%|██▎       | 8624/37963 [21:17:23<87:54:01, 10.79s/it]
 23%|██▎       | 8625/37963 [21:17:37<95:43:18, 11.75s/it]
 23%|██▎       | 8626/37963 [21:17:44<85:38:47, 10.51s/it]
 23%|██▎       | 8627/37963 [21:17:52<78:13:56,  9.60s/it]
 23%|██▎       | 8628/37963 [21:17:59<72:34:24,  8.91s/it]
 23%|██▎       | 8629/37963 [21:18:13<85:19:40, 10.47s/it]
 23%|██▎       | 8630/37963 [21:18:21<79:29:37,  9.76s/it]
                                                          
{'loss': '0.1564', 'grad_norm': '3.5', 'learning_rate': '1.803e-05', 'epoch': '0.2273'}
+
 23%|██▎       | 8630/37963 [21:18:21<79:29:37,  9.76s/it]
 23%|██▎       | 8631/37963 [21:18:29<73:42:40,  9.05s/it]
 23%|██▎       | 8632/37963 [21:18:36<69:36:50,  8.54s/it]
 23%|██▎       | 8633/37963 [21:18:44<66:55:56,  8.22s/it]
 23%|██▎       | 8634/37963 [21:18:51<65:25:14,  8.03s/it]
 23%|██▎       | 8635/37963 [21:18:59<65:07:43,  7.99s/it]
 23%|██▎       | 8636/37963 [21:19:07<64:15:21,  7.89s/it]
 23%|██▎       | 8637/37963 [21:19:14<63:20:09,  7.77s/it]
 23%|██▎       | 8638/37963 [21:19:22<62:57:59,  7.73s/it]
 23%|██▎       | 8639/37963 [21:19:29<62:40:05,  7.69s/it]
 23%|██▎       | 8640/37963 [21:19:37<62:33:52,  7.68s/it]
                                                          
{'loss': '0.1677', 'grad_norm': '1.814', 'learning_rate': '1.802e-05', 'epoch': '0.2276'}
+
 23%|██▎       | 8640/37963 [21:19:37<62:33:52,  7.68s/it]
 23%|██▎       | 8641/37963 [21:19:45<62:26:16,  7.67s/it]
 23%|██▎       | 8642/37963 [21:19:52<62:24:14,  7.66s/it]
 23%|██▎       | 8643/37963 [21:20:00<62:21:30,  7.66s/it]
 23%|██▎       | 8644/37963 [21:20:08<62:25:33,  7.67s/it]
 23%|██▎       | 8645/37963 [21:20:15<62:27:53,  7.67s/it]
 23%|██▎       | 8646/37963 [21:20:23<61:45:33,  7.58s/it]
 23%|██▎       | 8647/37963 [21:20:30<61:17:33,  7.53s/it]
 23%|██▎       | 8648/37963 [21:20:38<61:01:55,  7.49s/it]
 23%|██▎       | 8649/37963 [21:20:52<77:27:48,  9.51s/it]
 23%|██▎       | 8650/37963 [21:20:59<71:55:41,  8.83s/it]
                                                          
{'loss': '0.1736', 'grad_norm': '2.994', 'learning_rate': '1.802e-05', 'epoch': '0.2279'}
+
 23%|██▎       | 8650/37963 [21:20:59<71:55:41,  8.83s/it]
 23%|██▎       | 8651/37963 [21:21:07<69:01:17,  8.48s/it]
 23%|██▎       | 8652/37963 [21:21:14<66:26:04,  8.16s/it]
 23%|██▎       | 8653/37963 [21:21:22<65:08:56,  8.00s/it]
 23%|██▎       | 8654/37963 [21:21:29<64:14:42,  7.89s/it]
 23%|██▎       | 8655/37963 [21:21:37<63:28:39,  7.80s/it]
 23%|██▎       | 8656/37963 [21:21:45<63:04:11,  7.75s/it]
 23%|██▎       | 8657/37963 [21:21:52<63:06:37,  7.75s/it]
 23%|██▎       | 8658/37963 [21:22:00<62:45:12,  7.71s/it]
 23%|██▎       | 8659/37963 [21:22:08<62:36:30,  7.69s/it]
 23%|██▎       | 8660/37963 [21:22:15<62:31:15,  7.68s/it]
                                                          
{'loss': '0.174', 'grad_norm': '1.754', 'learning_rate': '1.801e-05', 'epoch': '0.2281'}
+
 23%|██▎       | 8660/37963 [21:22:15<62:31:15,  7.68s/it]
 23%|██▎       | 8661/37963 [21:22:23<62:23:37,  7.67s/it]
 23%|██▎       | 8662/37963 [21:22:31<62:37:53,  7.70s/it]
 23%|██▎       | 8663/37963 [21:22:38<61:44:11,  7.59s/it]
 23%|██▎       | 8664/37963 [21:22:52<77:44:41,  9.55s/it]
 23%|██▎       | 8665/37963 [21:23:07<90:37:55, 11.14s/it]
 23%|██▎       | 8666/37963 [21:23:15<82:04:44, 10.09s/it]
 23%|██▎       | 8667/37963 [21:23:22<76:28:34,  9.40s/it]
 23%|██▎       | 8668/37963 [21:23:37<88:51:20, 10.92s/it]
 23%|██▎       | 8669/37963 [21:23:51<97:31:05, 11.98s/it]
 23%|██▎       | 8670/37963 [21:24:05<101:52:26, 12.52s/it]
                                                           
{'loss': '0.1673', 'grad_norm': '1.688', 'learning_rate': '1.801e-05', 'epoch': '0.2284'}
+
 23%|██▎       | 8670/37963 [21:24:05<101:52:26, 12.52s/it]
 23%|██▎       | 8671/37963 [21:24:13<90:11:37, 11.08s/it] 
 23%|██▎       | 8672/37963 [21:24:28<99:19:58, 12.21s/it]
 23%|██▎       | 8673/37963 [21:24:35<88:32:14, 10.88s/it]
 23%|██▎       | 8674/37963 [21:24:43<80:41:44,  9.92s/it]
 23%|██▎       | 8675/37963 [21:24:51<75:10:06,  9.24s/it]
 23%|██▎       | 8676/37963 [21:24:58<71:19:08,  8.77s/it]
 23%|██▎       | 8677/37963 [21:25:06<68:12:23,  8.38s/it]
 23%|██▎       | 8678/37963 [21:25:14<66:23:15,  8.16s/it]
 23%|██▎       | 8679/37963 [21:25:21<65:29:34,  8.05s/it]
 23%|██▎       | 8680/37963 [21:25:36<82:15:41, 10.11s/it]
                                                          
{'loss': '0.1672', 'grad_norm': '2.087', 'learning_rate': '1.8e-05', 'epoch': '0.2286'}
+
 23%|██▎       | 8680/37963 [21:25:36<82:15:41, 10.11s/it]
 23%|██▎       | 8681/37963 [21:25:44<76:23:27,  9.39s/it]
 23%|██▎       | 8682/37963 [21:25:51<71:38:04,  8.81s/it]
 23%|██▎       | 8683/37963 [21:25:59<68:33:28,  8.43s/it]
 23%|██▎       | 8684/37963 [21:26:07<66:32:42,  8.18s/it]
 23%|██▎       | 8685/37963 [21:26:14<65:20:40,  8.03s/it]
 23%|██▎       | 8686/37963 [21:26:22<64:38:54,  7.95s/it]
 23%|██▎       | 8687/37963 [21:26:30<63:42:24,  7.83s/it]
 23%|██▎       | 8688/37963 [21:26:37<63:03:31,  7.75s/it]
 23%|██▎       | 8689/37963 [21:26:45<62:57:35,  7.74s/it]
 23%|██▎       | 8690/37963 [21:26:53<62:42:07,  7.71s/it]
                                                          
{'loss': '0.1688', 'grad_norm': '2.158', 'learning_rate': '1.8e-05', 'epoch': '0.2289'}
+
 23%|██▎       | 8690/37963 [21:26:53<62:42:07,  7.71s/it]
 23%|██▎       | 8691/37963 [21:27:00<62:26:11,  7.68s/it]
 23%|██▎       | 8692/37963 [21:27:08<61:49:29,  7.60s/it]
 23%|██▎       | 8693/37963 [21:27:15<61:48:31,  7.60s/it]
 23%|██���       | 8694/37963 [21:27:23<62:04:32,  7.64s/it]
 23%|██▎       | 8695/37963 [21:27:30<61:23:58,  7.55s/it]
 23%|██▎       | 8696/37963 [21:27:38<62:02:47,  7.63s/it]
 23%|██▎       | 8697/37963 [21:27:46<62:05:38,  7.64s/it]
 23%|██▎       | 8698/37963 [21:27:53<61:26:54,  7.56s/it]
 23%|██▎       | 8699/37963 [21:28:01<61:21:03,  7.55s/it]
 23%|██▎       | 8700/37963 [21:28:08<61:31:17,  7.57s/it]
                                                          
{'loss': '0.1595', 'grad_norm': '1.655', 'learning_rate': '1.799e-05', 'epoch': '0.2292'}
+
 23%|██▎       | 8700/37963 [21:28:08<61:31:17,  7.57s/it]
 23%|██▎       | 8701/37963 [21:28:22<77:39:44,  9.55s/it]
 23%|██▎       | 8702/37963 [21:28:30<73:06:38,  8.99s/it]
 23%|██▎       | 8703/37963 [21:28:38<69:51:25,  8.59s/it]
 23%|██▎       | 8704/37963 [21:28:45<67:30:24,  8.31s/it]
 23%|██▎       | 8705/37963 [21:28:53<66:16:18,  8.15s/it]
 23%|██▎       | 8706/37963 [21:29:01<64:53:02,  7.98s/it]
 23%|██▎       | 8707/37963 [21:29:09<64:16:53,  7.91s/it]
 23%|██▎       | 8708/37963 [21:29:16<63:05:32,  7.76s/it]
 23%|██▎       | 8709/37963 [21:29:31<80:23:38,  9.89s/it]
 23%|██▎       | 8710/37963 [21:29:38<74:46:16,  9.20s/it]
                                                          
{'loss': '0.1634', 'grad_norm': '1.683', 'learning_rate': '1.799e-05', 'epoch': '0.2294'}
+
 23%|██▎       | 8710/37963 [21:29:38<74:46:16,  9.20s/it]
 23%|██▎       | 8711/37963 [21:29:46<70:48:10,  8.71s/it]
 23%|██▎       | 8712/37963 [21:29:54<68:09:22,  8.39s/it]
 23%|██▎       | 8713/37963 [21:30:08<82:19:57, 10.13s/it]
 23%|██▎       | 8714/37963 [21:30:15<75:30:23,  9.29s/it]
 23%|██▎       | 8715/37963 [21:30:23<71:35:38,  8.81s/it]
 23%|██▎       | 8716/37963 [21:30:31<68:52:23,  8.48s/it]
 23%|██▎       | 8717/37963 [21:30:52<101:19:06, 12.47s/it]
 23%|██▎       | 8718/37963 [21:31:07<106:34:36, 13.12s/it]
 23%|██▎       | 8719/37963 [21:31:14<92:49:02, 11.43s/it] 
 23%|██▎       | 8720/37963 [21:31:30<102:04:31, 12.57s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '1.463', 'learning_rate': '1.798e-05', 'epoch': '0.2297'}
+
 23%|██▎       | 8720/37963 [21:31:30<102:04:31, 12.57s/it]
 23%|██▎       | 8721/37963 [21:31:37<90:12:59, 11.11s/it] 
 23%|██▎       | 8722/37963 [21:31:45<81:14:12, 10.00s/it]
 23%|██▎       | 8723/37963 [21:31:52<75:31:51,  9.30s/it]
 23%|██▎       | 8724/37963 [21:32:00<71:27:49,  8.80s/it]
 23%|██▎       | 8725/37963 [21:32:08<69:08:54,  8.51s/it]
 23%|██▎       | 8726/37963 [21:32:15<66:45:32,  8.22s/it]
 23%|██▎       | 8727/37963 [21:32:30<83:01:12, 10.22s/it]
 23%|██▎       | 8728/37963 [21:32:38<76:44:25,  9.45s/it]
 23%|██▎       | 8729/37963 [21:32:46<72:19:53,  8.91s/it]
 23%|██▎       | 8730/37963 [21:32:53<69:22:26,  8.54s/it]
                                                          
{'loss': '0.1645', 'grad_norm': '1.17', 'learning_rate': '1.798e-05', 'epoch': '0.23'}
+
 23%|██▎       | 8730/37963 [21:32:53<69:22:26,  8.54s/it]
 23%|██▎       | 8731/37963 [21:33:01<67:04:53,  8.26s/it]
 23%|██▎       | 8732/37963 [21:33:09<65:36:04,  8.08s/it]
 23%|██▎       | 8733/37963 [21:33:16<64:22:50,  7.93s/it]
 23%|██▎       | 8734/37963 [21:33:24<63:32:08,  7.83s/it]
 23%|██▎       | 8735/37963 [21:33:31<62:33:12,  7.70s/it]
 23%|██▎       | 8736/37963 [21:33:39<62:36:48,  7.71s/it]
 23%|██▎       | 8737/37963 [21:33:47<62:30:30,  7.70s/it]
 23%|██▎       | 8738/37963 [21:33:54<62:30:48,  7.70s/it]
 23%|██▎       | 8739/37963 [21:34:02<62:14:46,  7.67s/it]
 23%|██▎       | 8740/37963 [21:34:10<62:29:57,  7.70s/it]
                                                          
{'loss': '0.17', 'grad_norm': '2.457', 'learning_rate': '1.797e-05', 'epoch': '0.2302'}
+
 23%|██▎       | 8740/37963 [21:34:10<62:29:57,  7.70s/it]
 23%|██▎       | 8741/37963 [21:34:17<62:14:37,  7.67s/it]
 23%|██▎       | 8742/37963 [21:34:25<62:10:14,  7.66s/it]
 23%|██▎       | 8743/37963 [21:34:32<62:04:00,  7.65s/it]
 23%|██▎       | 8744/37963 [21:34:40<62:06:08,  7.65s/it]
 23%|██▎       | 8745/37963 [21:34:48<62:05:52,  7.65s/it]
 23%|██▎       | 8746/37963 [21:34:56<62:15:35,  7.67s/it]
 23%|██▎       | 8747/37963 [21:35:03<61:52:05,  7.62s/it]
 23%|██▎       | 8748/37963 [21:35:11<61:35:49,  7.59s/it]
 23%|██▎       | 8749/37963 [21:35:18<61:04:15,  7.53s/it]
 23%|██▎       | 8750/37963 [21:35:26<61:26:39,  7.57s/it]
                                                          
{'loss': '0.1634', 'grad_norm': '2.213', 'learning_rate': '1.797e-05', 'epoch': '0.2305'}
+
 23%|██▎       | 8750/37963 [21:35:26<61:26:39,  7.57s/it]
 23%|██▎       | 8751/37963 [21:35:33<61:04:00,  7.53s/it]
 23%|██▎       | 8752/37963 [21:35:41<61:19:44,  7.56s/it]
 23%|██▎       | 8753/37963 [21:35:48<61:57:50,  7.64s/it]
 23%|██▎       | 8754/37963 [21:35:56<61:58:25,  7.64s/it]
 23%|██▎       | 8755/37963 [21:36:10<76:59:59,  9.49s/it]
 23%|██▎       | 8756/37963 [21:36:18<72:37:55,  8.95s/it]
 23%|██▎       | 8757/37963 [21:36:25<69:20:12,  8.55s/it]
 23%|██▎       | 8758/37963 [21:36:33<67:08:12,  8.28s/it]
 23%|██▎       | 8759/37963 [21:36:40<65:30:57,  8.08s/it]
 23%|██▎       | 8760/37963 [21:36:48<64:37:26,  7.97s/it]
                                                          
{'loss': '0.1665', 'grad_norm': '1.167', 'learning_rate': '1.796e-05', 'epoch': '0.2308'}
+
 23%|██▎       | 8760/37963 [21:36:48<64:37:26,  7.97s/it]
 23%|██▎       | 8761/37963 [21:37:02<79:01:54,  9.74s/it]
 23%|██▎       | 8762/37963 [21:37:17<91:01:32, 11.22s/it]
 23%|██▎       | 8763/37963 [21:37:25<82:50:22, 10.21s/it]
 23%|██▎       | 8764/37963 [21:37:32<76:36:55,  9.45s/it]
 23%|██▎       | 8765/37963 [21:37:47<89:22:03, 11.02s/it]
 23%|██▎       | 8766/37963 [21:38:01<97:55:40, 12.07s/it]
 23%|██▎       | 8767/37963 [21:38:16<104:46:29, 12.92s/it]
 23%|██▎       | 8768/37963 [21:38:24<92:45:07, 11.44s/it] 
 23%|██▎       | 8769/37963 [21:38:32<82:48:57, 10.21s/it]
 23%|██▎       | 8770/37963 [21:38:39<76:38:05,  9.45s/it]
                                                          
{'loss': '0.169', 'grad_norm': '1.57', 'learning_rate': '1.796e-05', 'epoch': '0.231'}
+
 23%|██▎       | 8770/37963 [21:38:39<76:38:05,  9.45s/it]
 23%|██▎       | 8771/37963 [21:38:54<88:40:50, 10.94s/it]
 23%|██▎       | 8772/37963 [21:39:02<80:55:20,  9.98s/it]
 23%|██▎       | 8773/37963 [21:39:09<75:02:18,  9.25s/it]
 23%|██▎       | 8774/37963 [21:39:17<71:15:57,  8.79s/it]
 23%|██▎       | 8775/37963 [21:39:24<68:35:45,  8.46s/it]
 23%|██▎       | 8776/37963 [21:39:39<83:24:23, 10.29s/it]
 23%|██▎       | 8777/37963 [21:39:47<77:02:55,  9.50s/it]
 23%|██▎       | 8778/37963 [21:39:54<72:42:31,  8.97s/it]
 23%|██▎       | 8779/37963 [21:40:02<69:32:23,  8.58s/it]
 23%|██▎       | 8780/37963 [21:40:10<67:13:54,  8.29s/it]
                                                          
{'loss': '0.1572', 'grad_norm': '1.2', 'learning_rate': '1.795e-05', 'epoch': '0.2313'}
+
 23%|██▎       | 8780/37963 [21:40:10<67:13:54,  8.29s/it]
 23%|██▎       | 8781/37963 [21:40:17<65:45:32,  8.11s/it]
 23%|██▎       | 8782/37963 [21:40:25<64:48:01,  7.99s/it]
 23%|██▎       | 8783/37963 [21:40:33<63:39:24,  7.85s/it]
 23%|██▎       | 8784/37963 [21:40:40<63:26:31,  7.83s/it]
 23%|██▎       | 8785/37963 [21:40:48<63:04:40,  7.78s/it]
 23%|██▎       | 8786/37963 [21:40:56<62:46:29,  7.75s/it]
 23%|██▎       | 8787/37963 [21:41:03<61:41:18,  7.61s/it]
 23%|██▎       | 8788/37963 [21:41:11<61:57:17,  7.64s/it]
 23%|██▎       | 8789/37963 [21:41:18<62:02:10,  7.66s/it]
 23%|██▎       | 8790/37963 [21:41:26<61:25:37,  7.58s/it]
                                                          
{'loss': '0.1754', 'grad_norm': '0.7731', 'learning_rate': '1.794e-05', 'epoch': '0.2315'}
+
 23%|██▎       | 8790/37963 [21:41:26<61:25:37,  7.58s/it]
 23%|██▎       | 8791/37963 [21:41:33<61:28:04,  7.59s/it]
 23%|██▎       | 8792/37963 [21:41:41<61:56:57,  7.65s/it]
 23%|██▎       | 8793/37963 [21:41:49<61:58:12,  7.65s/it]
 23%|██▎       | 8794/37963 [21:41:56<61:36:42,  7.60s/it]
 23%|██▎       | 8795/37963 [21:42:04<61:30:25,  7.59s/it]
 23%|██▎       | 8796/37963 [21:42:12<61:26:09,  7.58s/it]
 23%|██▎       | 8797/37963 [21:42:19<61:34:17,  7.60s/it]
 23%|██▎       | 8798/37963 [21:42:27<60:59:15,  7.53s/it]
 23%|██▎       | 8799/37963 [21:42:34<61:18:32,  7.57s/it]
 23%|██▎       | 8800/37963 [21:42:42<61:45:00,  7.62s/it]
                                                          
{'loss': '0.1628', 'grad_norm': '2.981', 'learning_rate': '1.794e-05', 'epoch': '0.2318'}
+
 23%|██▎       | 8800/37963 [21:42:42<61:45:00,  7.62s/it]
 23%|██▎       | 8801/37963 [21:42:50<61:52:30,  7.64s/it]
 23%|██▎       | 8802/37963 [21:42:57<62:05:39,  7.67s/it]
 23%|██▎       | 8803/37963 [21:43:11<77:39:13,  9.59s/it]
 23%|██▎       | 8804/37963 [21:43:19<73:06:34,  9.03s/it]
 23%|██▎       | 8805/37963 [21:43:33<85:00:16, 10.50s/it]
 23%|██▎       | 8806/37963 [21:43:40<77:31:56,  9.57s/it]
 23%|██▎       | 8807/37963 [21:43:48<73:08:55,  9.03s/it]
 23%|██▎       | 8808/37963 [21:43:56<69:37:49,  8.60s/it]
 23%|██▎       | 8809/37963 [21:44:03<67:16:42,  8.31s/it]
 23%|██▎       | 8810/37963 [21:44:11<65:52:39,  8.13s/it]
                                                          
{'loss': '0.1986', 'grad_norm': '2.858', 'learning_rate': '1.793e-05', 'epoch': '0.2321'}
+
 23%|██▎       | 8810/37963 [21:44:11<65:52:39,  8.13s/it]
 23%|██▎       | 8811/37963 [21:44:33<98:00:10, 12.10s/it]
 23%|██▎       | 8812/37963 [21:44:40<87:33:43, 10.81s/it]
 23%|██▎       | 8813/37963 [21:44:48<80:18:49,  9.92s/it]
 23%|██▎       | 8814/37963 [21:44:56<74:43:13,  9.23s/it]
 23%|██▎       | 8815/37963 [21:45:11<88:52:29, 10.98s/it]
 23%|██▎       | 8816/37963 [21:45:18<80:37:52,  9.96s/it]
 23%|██▎       | 8817/37963 [21:45:26<74:40:03,  9.22s/it]
 23%|██▎       | 8818/37963 [21:45:41<88:01:28, 10.87s/it]
 23%|██▎       | 8819/37963 [21:45:55<95:26:29, 11.79s/it]
 23%|██▎       | 8820/37963 [21:46:02<85:31:56, 10.57s/it]
                                                          
{'loss': '0.1657', 'grad_norm': '1.912', 'learning_rate': '1.793e-05', 'epoch': '0.2323'}
+
 23%|██▎       | 8820/37963 [21:46:02<85:31:56, 10.57s/it]
 23%|██▎       | 8821/37963 [21:46:10<78:29:25,  9.70s/it]
 23%|██▎       | 8822/37963 [21:46:18<73:48:07,  9.12s/it]
 23%|██▎       | 8823/37963 [21:46:25<70:24:12,  8.70s/it]
 23%|██▎       | 8824/37963 [21:46:33<67:51:42,  8.38s/it]
 23%|██▎       | 8825/37963 [21:46:41<66:22:41,  8.20s/it]
 23%|██▎       | 8826/37963 [21:46:49<65:03:21,  8.04s/it]
 23%|██▎       | 8827/37963 [21:46:56<63:39:53,  7.87s/it]
 23%|██▎       | 8828/37963 [21:47:04<62:53:07,  7.77s/it]
 23%|██▎       | 8829/37963 [21:47:18<80:01:56,  9.89s/it]
 23%|██▎       | 8830/37963 [21:47:26<74:37:37,  9.22s/it]
                                                          
{'loss': '0.1601', 'grad_norm': '1.719', 'learning_rate': '1.792e-05', 'epoch': '0.2326'}
+
 23%|██▎       | 8830/37963 [21:47:26<74:37:37,  9.22s/it]
 23%|██▎       | 8831/37963 [21:47:33<70:14:58,  8.68s/it]
 23%|██▎       | 8832/37963 [21:47:41<67:39:01,  8.36s/it]
 23%|██▎       | 8833/37963 [21:47:49<66:03:14,  8.16s/it]
 23%|██▎       | 8834/37963 [21:47:56<64:32:51,  7.98s/it]
 23%|██▎       | 8835/37963 [21:48:04<63:53:43,  7.90s/it]
 23%|██▎       | 8836/37963 [21:48:11<62:37:41,  7.74s/it]
 23%|██▎       | 8837/37963 [21:48:19<62:30:36,  7.73s/it]
 23%|██▎       | 8838/37963 [21:48:27<62:00:17,  7.66s/it]
 23%|██▎       | 8839/37963 [21:48:34<61:51:40,  7.65s/it]
 23%|██▎       | 8840/37963 [21:48:41<60:46:14,  7.51s/it]
                                                          
{'loss': '0.1692', 'grad_norm': '6.145', 'learning_rate': '1.792e-05', 'epoch': '0.2329'}
+
 23%|██▎       | 8840/37963 [21:48:41<60:46:14,  7.51s/it]
 23%|██▎       | 8841/37963 [21:48:49<61:20:52,  7.58s/it]
 23%|██▎       | 8842/37963 [21:48:57<60:55:20,  7.53s/it]
 23%|██▎       | 8843/37963 [21:49:04<61:19:05,  7.58s/it]
 23%|██▎       | 8844/37963 [21:49:12<61:23:24,  7.59s/it]
 23%|██▎       | 8845/37963 [21:49:20<61:41:57,  7.63s/it]
 23%|██▎       | 8846/37963 [21:49:27<61:50:08,  7.65s/it]
 23%|██▎       | 8847/37963 [21:49:35<61:51:06,  7.65s/it]
 23%|██▎       | 8848/37963 [21:49:43<61:50:36,  7.65s/it]
 23%|██▎       | 8849/37963 [21:49:57<78:18:09,  9.68s/it]
 23%|██▎       | 8850/37963 [21:50:12<90:13:03, 11.16s/it]
                                                          
{'loss': '0.1698', 'grad_norm': '1.335', 'learning_rate': '1.791e-05', 'epoch': '0.2331'}
+
 23%|██▎       | 8850/37963 [21:50:12<90:13:03, 11.16s/it]
 23%|██▎       | 8851/37963 [21:50:19<81:51:52, 10.12s/it]
 23%|██▎       | 8852/37963 [21:50:27<75:46:46,  9.37s/it]
 23%|██▎       | 8853/37963 [21:50:35<71:32:25,  8.85s/it]
 23%|██▎       | 8854/37963 [21:50:42<68:31:57,  8.48s/it]
 23%|██▎       | 8855/37963 [21:50:50<66:32:08,  8.23s/it]
 23%|██▎       | 8856/37963 [21:50:57<64:01:27,  7.92s/it]
 23%|██▎       | 8857/37963 [21:51:05<63:11:49,  7.82s/it]
 23%|██▎       | 8858/37963 [21:51:12<62:39:26,  7.75s/it]
 23%|██▎       | 8859/37963 [21:51:34<96:22:14, 11.92s/it]
 23%|██▎       | 8860/37963 [21:51:41<85:57:24, 10.63s/it]
                                                          
{'loss': '0.1715', 'grad_norm': '4.3', 'learning_rate': '1.791e-05', 'epoch': '0.2334'}
+
 23%|██▎       | 8860/37963 [21:51:41<85:57:24, 10.63s/it]
 23%|██▎       | 8861/37963 [21:51:49<78:53:05,  9.76s/it]
 23%|██▎       | 8862/37963 [21:51:57<73:42:04,  9.12s/it]
 23%|██▎       | 8863/37963 [21:52:04<69:56:35,  8.65s/it]
 23%|██▎       | 8864/37963 [21:52:12<67:29:56,  8.35s/it]
 23%|██▎       | 8865/37963 [21:52:20<65:54:54,  8.16s/it]
 23%|██▎       | 8866/37963 [21:52:35<82:26:20, 10.20s/it]
 23%|██▎       | 8867/37963 [21:52:42<76:09:51,  9.42s/it]
 23%|██▎       | 8868/37963 [21:53:04<105:19:27, 13.03s/it]
 23%|██▎       | 8869/37963 [21:53:12<92:32:56, 11.45s/it] 
 23%|██▎       | 8870/37963 [21:53:19<83:29:33, 10.33s/it]
                                                          
{'loss': '0.1715', 'grad_norm': '2.474', 'learning_rate': '1.79e-05', 'epoch': '0.2336'}
+
 23%|██▎       | 8870/37963 [21:53:19<83:29:33, 10.33s/it]
 23%|██▎       | 8871/37963 [21:53:27<77:18:12,  9.57s/it]
 23%|██▎       | 8872/37963 [21:53:34<71:42:47,  8.87s/it]
 23%|██▎       | 8873/37963 [21:53:42<68:37:09,  8.49s/it]
 23%|██▎       | 8874/37963 [21:53:49<66:26:23,  8.22s/it]
 23%|██▎       | 8875/37963 [21:54:04<82:12:47, 10.17s/it]
 23%|██▎       | 8876/37963 [21:54:12<76:26:25,  9.46s/it]
 23%|██▎       | 8877/37963 [21:54:20<71:59:23,  8.91s/it]
 23%|██▎       | 8878/37963 [21:54:27<68:51:50,  8.52s/it]
 23%|██▎       | 8879/37963 [21:54:35<66:42:24,  8.26s/it]
 23%|██▎       | 8880/37963 [21:54:42<65:03:26,  8.05s/it]
                                                          
{'loss': '0.1715', 'grad_norm': '4.783', 'learning_rate': '1.79e-05', 'epoch': '0.2339'}
+
 23%|██▎       | 8880/37963 [21:54:42<65:03:26,  8.05s/it]
 23%|██▎       | 8881/37963 [21:54:50<63:57:45,  7.92s/it]
 23%|██▎       | 8882/37963 [21:54:58<63:09:35,  7.82s/it]
 23%|██▎       | 8883/37963 [21:55:05<62:43:56,  7.77s/it]
 23%|██▎       | 8884/37963 [21:55:13<62:13:20,  7.70s/it]
 23%|██▎       | 8885/37963 [21:55:21<62:27:23,  7.73s/it]
 23%|██▎       | 8886/37963 [21:55:28<61:27:38,  7.61s/it]
 23%|██▎       | 8887/37963 [21:55:36<61:27:48,  7.61s/it]
 23%|██▎       | 8888/37963 [21:55:43<61:40:11,  7.64s/it]
 23%|██▎       | 8889/37963 [21:55:51<61:58:29,  7.67s/it]
 23%|██▎       | 8890/37963 [21:55:59<61:45:00,  7.65s/it]
                                                          
{'loss': '0.1643', 'grad_norm': '5.362', 'learning_rate': '1.789e-05', 'epoch': '0.2342'}
+
 23%|██▎       | 8890/37963 [21:55:59<61:45:00,  7.65s/it]
 23%|██▎       | 8891/37963 [21:56:06<61:37:22,  7.63s/it]
 23%|██▎       | 8892/37963 [21:56:14<61:24:05,  7.60s/it]
 23%|██▎       | 8893/37963 [21:56:27<75:41:20,  9.37s/it]
 23%|██▎       | 8894/37963 [21:56:35<71:10:46,  8.82s/it]
 23%|██▎       | 8895/37963 [21:56:42<68:17:35,  8.46s/it]
 23%|██▎       | 8896/37963 [21:56:50<66:38:45,  8.25s/it]
 23%|██▎       | 8897/37963 [21:57:05<81:55:47, 10.15s/it]
 23%|██▎       | 8898/37963 [21:57:12<75:50:39,  9.39s/it]
 23%|██▎       | 8899/37963 [21:57:20<72:03:04,  8.92s/it]
 23%|██▎       | 8900/37963 [21:57:28<68:53:57,  8.53s/it]
                                                          
{'loss': '0.1759', 'grad_norm': '0.9846', 'learning_rate': '1.789e-05', 'epoch': '0.2344'}
+
 23%|██▎       | 8900/37963 [21:57:28<68:53:57,  8.53s/it]
 23%|██▎       | 8901/37963 [21:57:35<66:43:03,  8.26s/it]
 23%|██▎       | 8902/37963 [21:57:43<65:18:29,  8.09s/it]
 23%|██▎       | 8903/37963 [21:57:51<63:53:39,  7.92s/it]
 23%|██▎       | 8904/37963 [21:57:58<63:08:19,  7.82s/it]
 23%|██▎       | 8905/37963 [21:58:06<62:43:34,  7.77s/it]
 23%|██▎       | 8906/37963 [21:58:20<78:22:40,  9.71s/it]
 23%|██▎       | 8907/37963 [21:58:28<73:30:28,  9.11s/it]
 23%|██▎       | 8908/37963 [21:58:35<69:43:49,  8.64s/it]
 23%|██▎       | 8909/37963 [21:58:51<85:20:23, 10.57s/it]
 23%|██▎       | 8910/37963 [21:58:58<78:09:30,  9.68s/it]
                                                          
{'loss': '0.1763', 'grad_norm': '5.416', 'learning_rate': '1.788e-05', 'epoch': '0.2347'}
+
 23%|██▎       | 8910/37963 [21:58:58<78:09:30,  9.68s/it]
 23%|██▎       | 8911/37963 [21:59:06<72:59:20,  9.04s/it]
 23%|██▎       | 8912/37963 [21:59:13<69:37:56,  8.63s/it]
 23%|██▎       | 8913/37963 [21:59:28<85:12:57, 10.56s/it]
 23%|██▎       | 8914/37963 [21:59:50<111:25:06, 13.81s/it]
 23%|██▎       | 8915/37963 [21:59:58<96:43:20, 11.99s/it] 
 23%|██▎       | 8916/37963 [22:00:05<86:09:14, 10.68s/it]
 23%|██▎       | 8917/37963 [22:00:13<78:10:00,  9.69s/it]
 23%|██▎       | 8918/37963 [22:00:20<73:09:20,  9.07s/it]
 23%|██▎       | 8919/37963 [22:00:28<69:46:27,  8.65s/it]
 23%|██▎       | 8920/37963 [22:00:35<67:21:20,  8.35s/it]
                                                          
{'loss': '0.1725', 'grad_norm': '4.554', 'learning_rate': '1.788e-05', 'epoch': '0.235'}
+
 23%|██▎       | 8920/37963 [22:00:35<67:21:20,  8.35s/it]
 23%|██▎       | 8921/37963 [22:00:43<65:28:07,  8.12s/it]
 24%|██▎       | 8922/37963 [22:00:51<64:36:50,  8.01s/it]
 24%|██▎       | 8923/37963 [22:00:58<63:33:20,  7.88s/it]
 24%|██▎       | 8924/37963 [22:01:06<62:04:32,  7.70s/it]
 24%|██▎       | 8925/37963 [22:01:13<61:10:16,  7.58s/it]
 24%|██▎       | 8926/37963 [22:01:21<61:51:51,  7.67s/it]
 24%|██▎       | 8927/37963 [22:01:28<61:07:01,  7.58s/it]
 24%|██▎       | 8928/37963 [22:01:36<61:20:26,  7.61s/it]
 24%|██▎       | 8929/37963 [22:01:51<79:05:23,  9.81s/it]
 24%|██▎       | 8930/37963 [22:01:59<73:59:35,  9.17s/it]
                                                          
{'loss': '0.1677', 'grad_norm': '1.81', 'learning_rate': '1.787e-05', 'epoch': '0.2352'}
+
 24%|██▎       | 8930/37963 [22:01:59<73:59:35,  9.17s/it]
 24%|██▎       | 8931/37963 [22:02:06<70:13:17,  8.71s/it]
 24%|██▎       | 8932/37963 [22:02:14<67:38:24,  8.39s/it]
 24%|██▎       | 8933/37963 [22:02:22<66:19:33,  8.23s/it]
 24%|██▎       | 8934/37963 [22:02:29<64:05:55,  7.95s/it]
 24%|██▎       | 8935/37963 [22:02:37<63:41:48,  7.90s/it]
 24%|██▎       | 8936/37963 [22:02:44<62:46:59,  7.79s/it]
 24%|██▎       | 8937/37963 [22:02:52<62:38:21,  7.77s/it]
 24%|██▎       | 8938/37963 [22:02:59<61:33:22,  7.63s/it]
 24%|██▎       | 8939/37963 [22:03:07<61:16:25,  7.60s/it]
 24%|██▎       | 8940/37963 [22:03:14<61:18:31,  7.60s/it]
                                                          
{'loss': '0.1594', 'grad_norm': '6.71', 'learning_rate': '1.787e-05', 'epoch': '0.2355'}
+
 24%|██▎       | 8940/37963 [22:03:14<61:18:31,  7.60s/it]
 24%|██▎       | 8941/37963 [22:03:35<91:43:00, 11.38s/it]
 24%|██▎       | 8942/37963 [22:03:42<82:18:29, 10.21s/it]
 24%|██▎       | 8943/37963 [22:03:50<76:13:00,  9.45s/it]
 24%|██▎       | 8944/37963 [22:03:57<71:31:39,  8.87s/it]
 24%|██▎       | 8945/37963 [22:04:05<68:36:52,  8.51s/it]
 24%|██▎       | 8946/37963 [22:04:13<66:23:42,  8.24s/it]
 24%|██▎       | 8947/37963 [22:04:20<65:02:02,  8.07s/it]
 24%|██▎       | 8948/37963 [22:04:28<63:46:34,  7.91s/it]
 24%|██▎       | 8949/37963 [22:04:35<63:05:03,  7.83s/it]
 24%|██▎       | 8950/37963 [22:04:43<61:48:07,  7.67s/it]
                                                          
{'loss': '0.178', 'grad_norm': '1.828', 'learning_rate': '1.786e-05', 'epoch': '0.2358'}
+
 24%|██▎       | 8950/37963 [22:04:43<61:48:07,  7.67s/it]
 24%|██▎       | 8951/37963 [22:04:50<61:48:55,  7.67s/it]
 24%|██▎       | 8952/37963 [22:04:58<60:46:52,  7.54s/it]
 24%|██▎       | 8953/37963 [22:05:05<60:59:47,  7.57s/it]
 24%|██▎       | 8954/37963 [22:05:13<61:07:23,  7.59s/it]
 24%|██▎       | 8955/37963 [22:05:21<61:27:23,  7.63s/it]
 24%|██▎       | 8956/37963 [22:05:28<61:27:14,  7.63s/it]
 24%|██▎       | 8957/37963 [22:05:43<78:16:44,  9.72s/it]
 24%|██▎       | 8958/37963 [22:05:58<90:34:39, 11.24s/it]
 24%|██▎       | 8959/37963 [22:06:05<82:24:16, 10.23s/it]
 24%|██▎       | 8960/37963 [22:06:13<76:12:01,  9.46s/it]
                                                          
{'loss': '0.1602', 'grad_norm': '3.337', 'learning_rate': '1.786e-05', 'epoch': '0.236'}
+
 24%|██▎       | 8960/37963 [22:06:13<76:12:01,  9.46s/it]
 24%|██▎       | 8961/37963 [22:06:34<104:50:09, 13.01s/it]
 24%|██▎       | 8962/37963 [22:06:42<91:59:32, 11.42s/it] 
 24%|██▎       | 8963/37963 [22:06:50<82:48:08, 10.28s/it]
 24%|██▎       | 8964/37963 [22:06:57<75:42:08,  9.40s/it]
 24%|██▎       | 8965/37963 [22:07:05<71:22:26,  8.86s/it]
 24%|██▎       | 8966/37963 [22:07:20<85:46:28, 10.65s/it]
 24%|██▎       | 8967/37963 [22:07:27<78:18:40,  9.72s/it]
 24%|██▎       | 8968/37963 [22:07:34<72:19:33,  8.98s/it]
 24%|██▎       | 8969/37963 [22:07:42<69:04:58,  8.58s/it]
 24%|██▎       | 8970/37963 [22:07:50<66:48:41,  8.30s/it]
                                                          
{'loss': '0.1713', 'grad_norm': '2.181', 'learning_rate': '1.785e-05', 'epoch': '0.2363'}
+
 24%|██▎       | 8970/37963 [22:07:50<66:48:41,  8.30s/it]
 24%|██▎       | 8971/37963 [22:07:57<64:57:27,  8.07s/it]
 24%|██▎       | 8972/37963 [22:08:05<64:04:35,  7.96s/it]
 24%|██▎       | 8973/37963 [22:08:13<63:43:50,  7.91s/it]
 24%|██▎       | 8974/37963 [22:08:27<78:54:55,  9.80s/it]
 24%|██▎       | 8975/37963 [22:08:35<74:05:05,  9.20s/it]
 24%|██▎       | 8976/37963 [22:08:42<70:07:22,  8.71s/it]
 24%|██▎       | 8977/37963 [22:08:50<67:40:59,  8.41s/it]
 24%|██▎       | 8978/37963 [22:08:57<65:02:49,  8.08s/it]
 24%|██▎       | 8979/37963 [22:09:05<64:19:12,  7.99s/it]
 24%|██▎       | 8980/37963 [22:09:13<63:21:24,  7.87s/it]
                                                          
{'loss': '0.1836', 'grad_norm': '3.628', 'learning_rate': '1.785e-05', 'epoch': '0.2365'}
+
 24%|██▎       | 8980/37963 [22:09:13<63:21:24,  7.87s/it]
 24%|██▎       | 8981/37963 [22:09:20<62:55:43,  7.82s/it]
 24%|██▎       | 8982/37963 [22:09:28<62:39:00,  7.78s/it]
 24%|██▎       | 8983/37963 [22:09:36<62:17:16,  7.74s/it]
 24%|██▎       | 8984/37963 [22:09:43<62:07:42,  7.72s/it]
 24%|██▎       | 8985/37963 [22:10:04<93:31:59, 11.62s/it]
 24%|██▎       | 8986/37963 [22:10:12<83:53:33, 10.42s/it]
 24%|██▎       | 8987/37963 [22:10:19<76:09:07,  9.46s/it]
 24%|██▎       | 8988/37963 [22:10:26<71:29:00,  8.88s/it]
 24%|██▎       | 8989/37963 [22:10:34<68:28:42,  8.51s/it]
 24%|██▎       | 8990/37963 [22:10:42<66:08:48,  8.22s/it]
                                                          
{'loss': '0.1685', 'grad_norm': '1.739', 'learning_rate': '1.784e-05', 'epoch': '0.2368'}
+
 24%|██▎       | 8990/37963 [22:10:42<66:08:48,  8.22s/it]
 24%|██▎       | 8991/37963 [22:10:49<64:24:02,  8.00s/it]
 24%|██▎       | 8992/37963 [22:10:57<63:23:19,  7.88s/it]
 24%|██▎       | 8993/37963 [22:11:04<62:19:44,  7.75s/it]
 24%|██▎       | 8994/37963 [22:11:12<61:43:05,  7.67s/it]
 24%|██▎       | 8995/37963 [22:11:19<61:45:08,  7.67s/it]
 24%|██▎       | 8996/37963 [22:11:27<61:35:24,  7.65s/it]
 24%|██▎       | 8997/37963 [22:11:35<61:36:42,  7.66s/it]
 24%|██▎       | 8998/37963 [22:11:42<61:02:26,  7.59s/it]
 24%|██▎       | 8999/37963 [22:11:50<61:18:47,  7.62s/it]
 24%|██▎       | 9000/37963 [22:11:57<61:20:36,  7.62s/it]
                                                          
{'loss': '0.1704', 'grad_norm': '5.795', 'learning_rate': '1.783e-05', 'epoch': '0.2371'}
+
 24%|██▎       | 9000/37963 [22:11:57<61:20:36,  7.62s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.21s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.22s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 24%|██▎       | 9001/37963 [22:12:54<180:03:24, 22.38s/it]
 24%|██▎       | 9002/37963 [22:13:11<165:52:58, 20.62s/it]
 24%|██▎       | 9003/37963 [22:13:18<134:49:07, 16.76s/it]
 24%|██▎       | 9004/37963 [22:13:33<129:39:23, 16.12s/it]
 24%|██▎       | 9005/37963 [22:13:41<109:07:01, 13.57s/it]
 24%|██▎       | 9006/37963 [22:13:55<110:19:16, 13.72s/it]
 24%|██▎       | 9007/37963 [22:14:09<111:32:31, 13.87s/it]
 24%|██▎       | 9008/37963 [22:14:16<96:14:35, 11.97s/it] 
 24%|██▎       | 9009/37963 [22:14:24<86:06:25, 10.71s/it]
 24%|██▎       | 9010/37963 [22:14:32<79:10:34,  9.84s/it]
                                                          
{'loss': '0.1704', 'grad_norm': '1.573', 'learning_rate': '1.783e-05', 'epoch': '0.2373'}
+
 24%|██▎       | 9010/37963 [22:14:32<79:10:34,  9.84s/it]
 24%|██▎       | 9011/37963 [22:14:40<74:01:23,  9.20s/it]
 24%|██▎       | 9012/37963 [22:14:54<87:07:46, 10.83s/it]
 24%|██▎       | 9013/37963 [22:15:02<79:27:40,  9.88s/it]
 24%|██▎       | 9014/37963 [22:15:10<73:36:49,  9.15s/it]
 24%|██▎       | 9015/37963 [22:15:17<69:58:12,  8.70s/it]
 24%|██▎       | 9016/37963 [22:15:25<67:29:48,  8.39s/it]
 24%|██▍       | 9017/37963 [22:15:32<65:43:19,  8.17s/it]
 24%|██▍       | 9018/37963 [22:15:40<64:18:21,  8.00s/it]
 24%|██▍       | 9019/37963 [22:15:48<63:42:03,  7.92s/it]
 24%|██▍       | 9020/37963 [22:15:55<62:55:43,  7.83s/it]
                                                          
{'loss': '0.1624', 'grad_norm': '2.586', 'learning_rate': '1.782e-05', 'epoch': '0.2376'}
+
 24%|██▍       | 9020/37963 [22:15:55<62:55:43,  7.83s/it]
 24%|██▍       | 9021/37963 [22:16:03<62:50:34,  7.82s/it]
 24%|██▍       | 9022/37963 [22:16:11<61:45:32,  7.68s/it]
 24%|██▍       | 9023/37963 [22:16:18<62:02:25,  7.72s/it]
 24%|██▍       | 9024/37963 [22:16:33<78:21:20,  9.75s/it]
 24%|██▍       | 9025/37963 [22:16:41<73:16:37,  9.12s/it]
 24%|██▍       | 9026/37963 [22:16:48<69:24:41,  8.64s/it]
 24%|██▍       | 9027/37963 [22:16:56<67:22:53,  8.38s/it]
 24%|██▍       | 9028/37963 [22:17:10<81:47:48, 10.18s/it]
 24%|██▍       | 9029/37963 [22:17:18<75:49:11,  9.43s/it]
 24%|██▍       | 9030/37963 [22:17:25<71:18:15,  8.87s/it]
                                                          
{'loss': '0.1743', 'grad_norm': '4.492', 'learning_rate': '1.782e-05', 'epoch': '0.2379'}
+
 24%|██▍       | 9030/37963 [22:17:25<71:18:15,  8.87s/it]
 24%|██▍       | 9031/37963 [22:17:33<68:25:13,  8.51s/it]
 24%|██▍       | 9032/37963 [22:17:41<66:15:47,  8.25s/it]
 24%|██▍       | 9033/37963 [22:17:48<65:00:21,  8.09s/it]
 24%|██▍       | 9034/37963 [22:17:56<63:59:58,  7.96s/it]
 24%|██▍       | 9035/37963 [22:18:11<79:36:15,  9.91s/it]
 24%|██▍       | 9036/37963 [22:18:18<73:50:49,  9.19s/it]
 24%|██▍       | 9037/37963 [22:18:26<69:56:09,  8.70s/it]
 24%|██▍       | 9038/37963 [22:18:33<67:20:14,  8.38s/it]
 24%|██▍       | 9039/37963 [22:18:41<65:30:36,  8.15s/it]
 24%|██▍       | 9040/37963 [22:18:49<64:23:52,  8.02s/it]
                                                          
{'loss': '0.1474', 'grad_norm': '1.184', 'learning_rate': '1.781e-05', 'epoch': '0.2381'}
+
 24%|██▍       | 9040/37963 [22:18:49<64:23:52,  8.02s/it]
 24%|██▍       | 9041/37963 [22:18:56<62:57:58,  7.84s/it]
 24%|██▍       | 9042/37963 [22:19:03<61:59:56,  7.72s/it]
 24%|██▍       | 9043/37963 [22:19:11<61:56:20,  7.71s/it]
 24%|██▍       | 9044/37963 [22:19:19<61:50:57,  7.70s/it]
 24%|██▍       | 9045/37963 [22:19:27<61:51:02,  7.70s/it]
 24%|██▍       | 9046/37963 [22:19:34<61:38:03,  7.67s/it]
 24%|██▍       | 9047/37963 [22:19:42<61:32:54,  7.66s/it]
 24%|██▍       | 9048/37963 [22:19:49<61:29:24,  7.66s/it]
 24%|██▍       | 9049/37963 [22:19:57<61:05:20,  7.61s/it]
 24%|██▍       | 9050/37963 [22:20:19<95:20:39, 11.87s/it]
                                                          
{'loss': '0.1698', 'grad_norm': '2.747', 'learning_rate': '1.781e-05', 'epoch': '0.2384'}
+
 24%|██▍       | 9050/37963 [22:20:19<95:20:39, 11.87s/it]
 24%|██▍       | 9051/37963 [22:20:27<85:32:59, 10.65s/it]
 24%|██▍       | 9052/37963 [22:20:34<77:46:39,  9.68s/it]
 24%|██▍       | 9053/37963 [22:20:41<72:21:34,  9.01s/it]
 24%|██▍       | 9054/37963 [22:20:49<69:14:43,  8.62s/it]
 24%|██▍       | 9055/37963 [22:20:57<67:15:11,  8.38s/it]
 24%|██▍       | 9056/37963 [22:21:12<82:22:16, 10.26s/it]
 24%|██▍       | 9057/37963 [22:21:19<76:20:38,  9.51s/it]
 24%|██▍       | 9058/37963 [22:21:34<88:43:26, 11.05s/it]
 24%|██▍       | 9059/37963 [22:21:42<80:13:32,  9.99s/it]
 24%|██▍       | 9060/37963 [22:21:49<74:44:21,  9.31s/it]
                                                          
{'loss': '0.1653', 'grad_norm': '1.031', 'learning_rate': '1.78e-05', 'epoch': '0.2387'}
+
 24%|██▍       | 9060/37963 [22:21:49<74:44:21,  9.31s/it]
 24%|██▍       | 9061/37963 [22:21:57<70:17:33,  8.76s/it]
 24%|██▍       | 9062/37963 [22:22:04<67:50:23,  8.45s/it]
 24%|██▍       | 9063/37963 [22:22:12<65:39:43,  8.18s/it]
 24%|██▍       | 9064/37963 [22:22:20<64:32:20,  8.04s/it]
 24%|██▍       | 9065/37963 [22:22:27<63:29:08,  7.91s/it]
 24%|██▍       | 9066/37963 [22:22:35<63:01:34,  7.85s/it]
 24%|██▍       | 9067/37963 [22:22:43<62:34:05,  7.80s/it]
 24%|██▍       | 9068/37963 [22:22:50<62:10:46,  7.75s/it]
 24%|██▍       | 9069/37963 [22:22:58<61:20:00,  7.64s/it]
 24%|██▍       | 9070/37963 [22:23:05<61:09:33,  7.62s/it]
                                                          
{'loss': '0.1655', 'grad_norm': '2.002', 'learning_rate': '1.78e-05', 'epoch': '0.2389'}
+
 24%|██▍       | 9070/37963 [22:23:05<61:09:33,  7.62s/it]
 24%|██▍       | 9071/37963 [22:23:13<61:13:21,  7.63s/it]
 24%|██▍       | 9072/37963 [22:23:21<61:31:09,  7.67s/it]
 24%|██▍       | 9073/37963 [22:23:28<61:22:22,  7.65s/it]
 24%|██▍       | 9074/37963 [22:23:36<60:36:12,  7.55s/it]
 24%|██▍       | 9075/37963 [22:23:50<76:24:41,  9.52s/it]
 24%|██▍       | 9076/37963 [22:23:57<72:07:51,  8.99s/it]
 24%|██▍       | 9077/37963 [22:24:05<68:30:36,  8.54s/it]
 24%|██▍       | 9078/37963 [22:24:20<83:44:21, 10.44s/it]
 24%|██▍       | 9079/37963 [22:24:27<76:46:05,  9.57s/it]
 24%|██▍       | 9080/37963 [22:24:35<72:18:39,  9.01s/it]
                                                          
{'loss': '0.1715', 'grad_norm': '3.664', 'learning_rate': '1.779e-05', 'epoch': '0.2392'}
+
 24%|██▍       | 9080/37963 [22:24:35<72:18:39,  9.01s/it]
 24%|██▍       | 9081/37963 [22:24:49<84:59:07, 10.59s/it]
 24%|██▍       | 9082/37963 [22:24:57<78:00:11,  9.72s/it]
 24%|██▍       | 9083/37963 [22:25:05<72:32:16,  9.04s/it]
 24%|██▍       | 9084/37963 [22:25:12<69:03:45,  8.61s/it]
 24%|██▍       | 9085/37963 [22:25:20<66:41:02,  8.31s/it]
 24%|██▍       | 9086/37963 [22:25:27<65:11:07,  8.13s/it]
 24%|██▍       | 9087/37963 [22:25:35<64:21:24,  8.02s/it]
 24%|██▍       | 9088/37963 [22:25:43<63:18:08,  7.89s/it]
 24%|██▍       | 9089/37963 [22:25:51<63:11:25,  7.88s/it]
 24%|██▍       | 9090/37963 [22:25:58<62:15:42,  7.76s/it]
                                                          
{'loss': '0.1728', 'grad_norm': '1.217', 'learning_rate': '1.779e-05', 'epoch': '0.2394'}
+
 24%|██▍       | 9090/37963 [22:25:58<62:15:42,  7.76s/it]
 24%|██▍       | 9091/37963 [22:26:06<61:18:20,  7.64s/it]
 24%|██▍       | 9092/37963 [22:26:13<61:25:12,  7.66s/it]
 24%|██▍       | 9093/37963 [22:26:21<61:40:34,  7.69s/it]
 24%|██▍       | 9094/37963 [22:26:29<61:29:19,  7.67s/it]
 24%|██▍       | 9095/37963 [22:26:36<61:19:45,  7.65s/it]
 24%|██▍       | 9096/37963 [22:26:44<60:39:05,  7.56s/it]
 24%|██▍       | 9097/37963 [22:26:51<60:54:51,  7.60s/it]
 24%|██▍       | 9098/37963 [22:26:59<61:19:58,  7.65s/it]
 24%|██▍       | 9099/37963 [22:27:14<77:49:10,  9.71s/it]
 24%|██▍       | 9100/37963 [22:27:29<90:37:35, 11.30s/it]
                                                          
{'loss': '0.1671', 'grad_norm': '2.486', 'learning_rate': '1.778e-05', 'epoch': '0.2397'}
+
 24%|██▍       | 9100/37963 [22:27:29<90:37:35, 11.30s/it]
 24%|██▍       | 9101/37963 [22:27:50<116:15:11, 14.50s/it]
 24%|██▍       | 9102/37963 [22:27:58<100:04:12, 12.48s/it]
 24%|██▍       | 9103/37963 [22:28:06<88:35:10, 11.05s/it] 
 24%|██▍       | 9104/37963 [22:28:14<80:19:06, 10.02s/it]
 24%|██▍       | 9105/37963 [22:28:21<74:14:55,  9.26s/it]
 24%|██▍       | 9106/37963 [22:28:36<86:41:28, 10.81s/it]
 24%|██▍       | 9107/37963 [22:28:43<79:22:45,  9.90s/it]
 24%|██▍       | 9108/37963 [22:28:51<74:04:22,  9.24s/it]
 24%|██▍       | 9109/37963 [22:28:58<69:38:22,  8.69s/it]
 24%|██▍       | 9110/37963 [22:29:06<67:00:45,  8.36s/it]
                                                          
{'loss': '0.1697', 'grad_norm': '1.373', 'learning_rate': '1.778e-05', 'epoch': '0.24'}
+
 24%|██▍       | 9110/37963 [22:29:06<67:00:45,  8.36s/it]
 24%|██▍       | 9111/37963 [22:29:14<65:15:24,  8.14s/it]
 24%|██▍       | 9112/37963 [22:29:22<64:40:13,  8.07s/it]
 24%|██▍       | 9113/37963 [22:29:29<63:47:51,  7.96s/it]
 24%|██▍       | 9114/37963 [22:29:37<63:01:19,  7.86s/it]
 24%|██▍       | 9115/37963 [22:29:45<62:35:00,  7.81s/it]
 24%|██▍       | 9116/37963 [22:29:52<62:24:53,  7.79s/it]
 24%|██▍       | 9117/37963 [22:30:00<62:00:33,  7.74s/it]
 24%|██▍       | 9118/37963 [22:30:07<61:26:31,  7.67s/it]
 24%|██▍       | 9119/37963 [22:30:22<77:42:10,  9.70s/it]
 24%|██▍       | 9120/37963 [22:30:29<72:39:43,  9.07s/it]
                                                          
{'loss': '0.151', 'grad_norm': '1.395', 'learning_rate': '1.777e-05', 'epoch': '0.2402'}
+
 24%|██▍       | 9120/37963 [22:30:29<72:39:43,  9.07s/it]
 24%|██▍       | 9121/37963 [22:30:37<69:08:02,  8.63s/it]
 24%|██▍       | 9122/37963 [22:30:45<66:51:29,  8.35s/it]
 24%|██▍       | 9123/37963 [22:30:52<65:14:21,  8.14s/it]
 24%|██▍       | 9124/37963 [22:31:00<63:51:59,  7.97s/it]
 24%|██▍       | 9125/37963 [22:31:14<77:26:10,  9.67s/it]
 24%|██▍       | 9126/37963 [22:31:21<72:51:39,  9.10s/it]
 24%|██▍       | 9127/37963 [22:31:29<69:02:25,  8.62s/it]
 24%|██▍       | 9128/37963 [22:31:37<66:40:51,  8.33s/it]
 24%|██▍       | 9129/37963 [22:31:44<64:58:23,  8.11s/it]
 24%|██▍       | 9130/37963 [22:31:52<63:55:27,  7.98s/it]
                                                          
{'loss': '0.169', 'grad_norm': '2.433', 'learning_rate': '1.777e-05', 'epoch': '0.2405'}
+
 24%|██▍       | 9130/37963 [22:31:52<63:55:27,  7.98s/it]
 24%|██▍       | 9131/37963 [22:31:59<62:59:36,  7.87s/it]
 24%|██▍       | 9132/37963 [22:32:14<79:40:04,  9.95s/it]
 24%|██▍       | 9133/37963 [22:32:22<74:02:17,  9.25s/it]
 24%|██▍       | 9134/37963 [22:32:29<70:10:43,  8.76s/it]
 24%|██▍       | 9135/37963 [22:32:37<67:00:09,  8.37s/it]
 24%|██▍       | 9136/37963 [22:32:45<65:39:38,  8.20s/it]
 24%|██▍       | 9137/37963 [22:32:52<64:16:19,  8.03s/it]
 24%|██▍       | 9138/37963 [22:33:00<63:19:13,  7.91s/it]
 24%|██▍       | 9139/37963 [22:33:08<62:45:29,  7.84s/it]
 24%|██▍       | 9140/37963 [22:33:15<62:17:57,  7.78s/it]
                                                          
{'loss': '0.1722', 'grad_norm': '1.814', 'learning_rate': '1.776e-05', 'epoch': '0.2408'}
+
 24%|██▍       | 9140/37963 [22:33:15<62:17:57,  7.78s/it]
 24%|██▍       | 9141/37963 [22:33:23<62:03:55,  7.75s/it]
 24%|██▍       | 9142/37963 [22:33:31<61:50:32,  7.72s/it]
 24%|██▍       | 9143/37963 [22:33:38<61:20:29,  7.66s/it]
 24%|██▍       | 9144/37963 [22:33:46<61:22:40,  7.67s/it]
 24%|██▍       | 9145/37963 [22:33:53<60:37:37,  7.57s/it]
 24%|██▍       | 9146/37963 [22:34:01<60:21:05,  7.54s/it]
 24%|██▍       | 9147/37963 [22:34:08<60:36:58,  7.57s/it]
 24%|██▍       | 9148/37963 [22:34:23<77:43:36,  9.71s/it]
 24%|██▍       | 9149/37963 [22:34:31<72:52:46,  9.11s/it]
 24%|██▍       | 9150/37963 [22:34:46<87:06:40, 10.88s/it]
                                                          
{'loss': '0.1617', 'grad_norm': '1.054', 'learning_rate': '1.775e-05', 'epoch': '0.241'}
+
 24%|██▍       | 9150/37963 [22:34:46<87:06:40, 10.88s/it]
 24%|██▍       | 9151/37963 [22:34:54<79:50:38,  9.98s/it]
 24%|██▍       | 9152/37963 [22:35:01<74:24:54,  9.30s/it]
 24%|██▍       | 9153/37963 [22:35:15<86:07:37, 10.76s/it]
 24%|██▍       | 9154/37963 [22:35:37<112:28:42, 14.06s/it]
 24%|██▍       | 9155/37963 [22:35:45<96:37:10, 12.07s/it] 
 24%|██▍       | 9156/37963 [22:35:52<85:56:13, 10.74s/it]
 24%|██▍       | 9157/37963 [22:36:00<78:33:07,  9.82s/it]
 24%|██▍       | 9158/37963 [22:36:07<73:00:32,  9.12s/it]
 24%|██▍       | 9159/37963 [22:36:15<69:40:28,  8.71s/it]
 24%|██▍       | 9160/37963 [22:36:23<67:06:54,  8.39s/it]
                                                          
{'loss': '0.1604', 'grad_norm': '3.408', 'learning_rate': '1.775e-05', 'epoch': '0.2413'}
+
 24%|██▍       | 9160/37963 [22:36:23<67:06:54,  8.39s/it]
 24%|██▍       | 9161/37963 [22:36:30<65:20:42,  8.17s/it]
 24%|██▍       | 9162/37963 [22:36:38<63:46:10,  7.97s/it]
 24%|██▍       | 9163/37963 [22:36:52<78:01:50,  9.75s/it]
 24%|██▍       | 9164/37963 [22:37:00<72:55:06,  9.12s/it]
 24%|██▍       | 9165/37963 [22:37:07<69:33:43,  8.70s/it]
 24%|██▍       | 9166/37963 [22:37:15<66:38:52,  8.33s/it]
 24%|██▍       | 9167/37963 [22:37:22<65:04:09,  8.13s/it]
 24%|██▍       | 9168/37963 [22:37:30<63:35:53,  7.95s/it]
 24%|██▍       | 9169/37963 [22:37:38<62:41:38,  7.84s/it]
 24%|██▍       | 9170/37963 [22:37:45<62:02:52,  7.76s/it]
                                                          
{'loss': '0.1806', 'grad_norm': '1.618', 'learning_rate': '1.774e-05', 'epoch': '0.2416'}
+
 24%|██▍       | 9170/37963 [22:37:45<62:02:52,  7.76s/it]
 24%|██▍       | 9171/37963 [22:37:53<61:58:51,  7.75s/it]
 24%|██▍       | 9172/37963 [22:38:01<61:49:40,  7.73s/it]
 24%|██▍       | 9173/37963 [22:38:15<77:26:43,  9.68s/it]
 24%|██▍       | 9174/37963 [22:38:22<72:35:54,  9.08s/it]
 24%|██▍       | 9175/37963 [22:38:30<68:48:26,  8.60s/it]
 24%|██▍       | 9176/37963 [22:38:37<66:08:21,  8.27s/it]
 24%|██▍       | 9177/37963 [22:38:45<64:48:40,  8.11s/it]
 24%|██▍       | 9178/37963 [22:38:53<63:39:26,  7.96s/it]
 24%|██▍       | 9179/37963 [22:39:00<62:52:46,  7.86s/it]
 24%|██▍       | 9180/37963 [22:39:08<62:22:06,  7.80s/it]
                                                          
{'loss': '0.1779', 'grad_norm': '3.407', 'learning_rate': '1.774e-05', 'epoch': '0.2418'}
+
 24%|██▍       | 9180/37963 [22:39:08<62:22:06,  7.80s/it]
 24%|██▍       | 9181/37963 [22:39:23<79:50:28,  9.99s/it]
 24%|██▍       | 9182/37963 [22:39:31<74:14:36,  9.29s/it]
 24%|██▍       | 9183/37963 [22:39:38<69:59:06,  8.75s/it]
 24%|██▍       | 9184/37963 [22:39:46<67:11:51,  8.41s/it]
 24%|██▍       | 9185/37963 [22:39:54<65:25:49,  8.19s/it]
 24%|██▍       | 9186/37963 [22:40:01<64:38:16,  8.09s/it]
 24%|██▍       | 9187/37963 [22:40:09<63:42:29,  7.97s/it]
 24%|██▍       | 9188/37963 [22:40:17<62:45:31,  7.85s/it]
 24%|██▍       | 9189/37963 [22:40:24<62:20:22,  7.80s/it]
 24%|██▍       | 9190/37963 [22:40:32<61:57:59,  7.75s/it]
                                                          
{'loss': '0.1639', 'grad_norm': '2.322', 'learning_rate': '1.773e-05', 'epoch': '0.2421'}
+
 24%|██▍       | 9190/37963 [22:40:32<61:57:59,  7.75s/it]
 24%|██▍       | 9191/37963 [22:40:40<61:34:11,  7.70s/it]
 24%|██▍       | 9192/37963 [22:40:47<61:23:08,  7.68s/it]
 24%|██▍       | 9193/37963 [22:40:55<61:23:12,  7.68s/it]
 24%|██▍       | 9194/37963 [22:41:10<78:41:31,  9.85s/it]
 24%|██▍       | 9195/37963 [22:41:18<73:46:09,  9.23s/it]
 24%|██▍       | 9196/37963 [22:41:31<84:28:45, 10.57s/it]
 24%|██▍       | 9197/37963 [22:41:39<77:45:48,  9.73s/it]
 24%|██▍       | 9198/37963 [22:41:47<73:06:22,  9.15s/it]
 24%|██▍       | 9199/37963 [22:41:54<69:12:59,  8.66s/it]
 24%|██▍       | 9200/37963 [22:42:02<66:43:18,  8.35s/it]
                                                          
{'loss': '0.154', 'grad_norm': '1.752', 'learning_rate': '1.773e-05', 'epoch': '0.2423'}
+
 24%|██▍       | 9200/37963 [22:42:02<66:43:18,  8.35s/it]
 24%|██▍       | 9201/37963 [22:42:09<64:37:12,  8.09s/it]
 24%|██▍       | 9202/37963 [22:42:31<96:59:58, 12.14s/it]
 24%|██▍       | 9203/37963 [22:42:39<85:45:18, 10.73s/it]
 24%|██▍       | 9204/37963 [22:42:46<78:38:42,  9.84s/it]
 24%|██▍       | 9205/37963 [22:42:54<73:19:25,  9.18s/it]
 24%|██▍       | 9206/37963 [22:43:08<84:43:46, 10.61s/it]
 24%|██▍       | 9207/37963 [22:43:15<77:30:40,  9.70s/it]
 24%|██▍       | 9208/37963 [22:43:30<88:53:38, 11.13s/it]
 24%|██▍       | 9209/37963 [22:43:38<80:58:30, 10.14s/it]
 24%|██▍       | 9210/37963 [22:43:45<74:53:11,  9.38s/it]
                                                          
{'loss': '0.186', 'grad_norm': '0.88', 'learning_rate': '1.772e-05', 'epoch': '0.2426'}
+
 24%|██▍       | 9210/37963 [22:43:45<74:53:11,  9.38s/it]
 24%|██▍       | 9211/37963 [22:43:53<70:38:19,  8.84s/it]
 24%|██▍       | 9212/37963 [22:44:00<67:04:11,  8.40s/it]
 24%|██▍       | 9213/37963 [22:44:08<65:05:09,  8.15s/it]
 24%|██▍       | 9214/37963 [22:44:16<63:57:30,  8.01s/it]
 24%|██▍       | 9215/37963 [22:44:23<63:03:37,  7.90s/it]
 24%|██▍       | 9216/37963 [22:44:31<62:25:15,  7.82s/it]
 24%|██▍       | 9217/37963 [22:44:39<62:08:51,  7.78s/it]
 24%|██▍       | 9218/37963 [22:44:46<61:16:03,  7.67s/it]
 24%|██▍       | 9219/37963 [22:44:54<61:09:40,  7.66s/it]
 24%|██▍       | 9220/37963 [22:45:01<60:17:44,  7.55s/it]
                                                          
{'loss': '0.1595', 'grad_norm': '2.426', 'learning_rate': '1.772e-05', 'epoch': '0.2429'}
+
 24%|██▍       | 9220/37963 [22:45:01<60:17:44,  7.55s/it]
 24%|██▍       | 9221/37963 [22:45:09<60:56:40,  7.63s/it]
 24%|██▍       | 9222/37963 [22:45:16<60:50:37,  7.62s/it]
 24%|██▍       | 9223/37963 [22:45:24<61:14:58,  7.67s/it]
 24%|██▍       | 9224/37963 [22:45:32<61:28:07,  7.70s/it]
 24%|██▍       | 9225/37963 [22:45:46<76:50:24,  9.63s/it]
 24%|██▍       | 9226/37963 [22:45:54<72:37:22,  9.10s/it]
 24%|██▍       | 9227/37963 [22:46:09<86:16:39, 10.81s/it]
 24%|██▍       | 9228/37963 [22:46:17<79:15:05,  9.93s/it]
 24%|██▍       | 9229/37963 [22:46:24<73:49:27,  9.25s/it]
 24%|██▍       | 9230/37963 [22:46:32<69:51:09,  8.75s/it]
                                                          
{'loss': '0.1801', 'grad_norm': '2.711', 'learning_rate': '1.771e-05', 'epoch': '0.2431'}
+
 24%|██▍       | 9230/37963 [22:46:32<69:51:09,  8.75s/it]
 24%|██▍       | 9231/37963 [22:46:39<67:03:25,  8.40s/it]
 24%|██▍       | 9232/37963 [22:46:47<65:35:44,  8.22s/it]
 24%|██▍       | 9233/37963 [22:46:55<64:12:31,  8.05s/it]
 24%|██▍       | 9234/37963 [22:47:02<62:32:01,  7.84s/it]
 24%|██▍       | 9235/37963 [22:47:10<61:56:56,  7.76s/it]
 24%|██▍       | 9236/37963 [22:47:17<61:40:32,  7.73s/it]
 24%|██▍       | 9237/37963 [22:47:25<61:07:28,  7.66s/it]
 24%|██▍       | 9238/37963 [22:47:40<78:10:48,  9.80s/it]
 24%|██▍       | 9239/37963 [22:47:47<73:01:34,  9.15s/it]
 24%|██▍       | 9240/37963 [22:47:55<68:55:33,  8.64s/it]
                                                          
{'loss': '0.1706', 'grad_norm': '3.146', 'learning_rate': '1.771e-05', 'epoch': '0.2434'}
+
 24%|██▍       | 9240/37963 [22:47:55<68:55:33,  8.64s/it]
 24%|██▍       | 9241/37963 [22:48:02<66:30:22,  8.34s/it]
 24%|██▍       | 9242/37963 [22:48:10<64:46:48,  8.12s/it]
 24%|██▍       | 9243/37963 [22:48:18<63:39:40,  7.98s/it]
 24%|██▍       | 9244/37963 [22:48:25<62:50:04,  7.88s/it]
 24%|██▍       | 9245/37963 [22:48:40<78:26:01,  9.83s/it]
 24%|██▍       | 9246/37963 [22:48:55<91:25:47, 11.46s/it]
 24%|██▍       | 9247/37963 [22:49:02<82:04:12, 10.29s/it]
 24%|██▍       | 9248/37963 [22:49:10<75:54:25,  9.52s/it]
 24%|██▍       | 9249/37963 [22:49:24<87:19:52, 10.95s/it]
 24%|██▍       | 9250/37963 [22:49:32<79:20:32,  9.95s/it]
                                                          
{'loss': '0.1689', 'grad_norm': '2.001', 'learning_rate': '1.77e-05', 'epoch': '0.2437'}
+
 24%|██▍       | 9250/37963 [22:49:32<79:20:32,  9.95s/it]
 24%|██▍       | 9251/37963 [22:49:47<90:37:15, 11.36s/it]
 24%|██▍       | 9252/37963 [22:49:55<82:18:16, 10.32s/it]
 24%|██▍       | 9253/37963 [22:50:02<75:52:23,  9.51s/it]
 24%|██▍       | 9254/37963 [22:50:10<71:12:40,  8.93s/it]
 24%|██▍       | 9255/37963 [22:50:17<67:51:16,  8.51s/it]
 24%|██▍       | 9256/37963 [22:50:25<66:05:48,  8.29s/it]
 24%|██▍       | 9257/37963 [22:50:33<64:03:35,  8.03s/it]
 24%|██▍       | 9258/37963 [22:50:47<78:10:22,  9.80s/it]
 24%|██▍       | 9259/37963 [22:50:54<73:19:14,  9.20s/it]
 24%|██▍       | 9260/37963 [22:51:02<70:12:35,  8.81s/it]
                                                          
{'loss': '0.1689', 'grad_norm': '1.156', 'learning_rate': '1.769e-05', 'epoch': '0.2439'}
+
 24%|██▍       | 9260/37963 [22:51:02<70:12:35,  8.81s/it]
 24%|██▍       | 9261/37963 [22:51:10<66:41:54,  8.37s/it]
 24%|██▍       | 9262/37963 [22:51:17<64:59:14,  8.15s/it]
 24%|██▍       | 9263/37963 [22:51:25<63:47:29,  8.00s/it]
 24%|██▍       | 9264/37963 [22:51:32<62:32:23,  7.84s/it]
 24%|██▍       | 9265/37963 [22:51:40<62:04:28,  7.79s/it]
 24%|██▍       | 9266/37963 [22:51:48<61:45:03,  7.75s/it]
 24%|██▍       | 9267/37963 [22:51:55<61:04:58,  7.66s/it]
 24%|██▍       | 9268/37963 [22:52:03<60:56:51,  7.65s/it]
 24%|██▍       | 9269/37963 [22:52:10<60:17:38,  7.56s/it]
 24%|██▍       | 9270/37963 [22:52:17<59:56:08,  7.52s/it]
                                                          
{'loss': '0.1552', 'grad_norm': '1.699', 'learning_rate': '1.769e-05', 'epoch': '0.2442'}
+
 24%|██▍       | 9270/37963 [22:52:17<59:56:08,  7.52s/it]
 24%|██▍       | 9271/37963 [22:52:25<60:12:31,  7.55s/it]
 24%|██▍       | 9272/37963 [22:52:33<60:28:52,  7.59s/it]
 24%|██▍       | 9273/37963 [22:52:47<76:19:22,  9.58s/it]
 24%|██▍       | 9274/37963 [22:52:55<71:58:07,  9.03s/it]
 24%|██▍       | 9275/37963 [22:53:10<85:46:44, 10.76s/it]
 24%|██▍       | 9276/37963 [22:53:17<77:33:21,  9.73s/it]
 24%|██▍       | 9277/37963 [22:53:25<72:59:15,  9.16s/it]
 24%|██▍       | 9278/37963 [22:53:32<69:14:57,  8.69s/it]
 24%|██▍       | 9279/37963 [22:53:40<66:55:30,  8.40s/it]
 24%|██▍       | 9280/37963 [22:53:48<65:01:38,  8.16s/it]
                                                          
{'loss': '0.1552', 'grad_norm': '1.056', 'learning_rate': '1.768e-05', 'epoch': '0.2444'}
+
 24%|██▍       | 9280/37963 [22:53:48<65:01:38,  8.16s/it]
 24%|██▍       | 9281/37963 [22:53:55<64:10:03,  8.05s/it]
 24%|██▍       | 9282/37963 [22:54:03<63:09:53,  7.93s/it]
 24%|██▍       | 9283/37963 [22:54:11<62:34:10,  7.85s/it]
 24%|██▍       | 9284/37963 [22:54:18<61:43:44,  7.75s/it]
 24%|██▍       | 9285/37963 [22:54:33<78:07:37,  9.81s/it]
 24%|██▍       | 9286/37963 [22:54:41<73:33:42,  9.23s/it]
 24%|██▍       | 9287/37963 [22:54:48<69:40:02,  8.75s/it]
 24%|██▍       | 9288/37963 [22:54:56<66:32:54,  8.35s/it]
 24%|██▍       | 9289/37963 [22:55:03<64:20:39,  8.08s/it]
 24%|██▍       | 9290/37963 [22:55:11<63:27:43,  7.97s/it]
                                                          
{'loss': '0.1718', 'grad_norm': '4.624', 'learning_rate': '1.768e-05', 'epoch': '0.2447'}
+
 24%|██▍       | 9290/37963 [22:55:11<63:27:43,  7.97s/it]
 24%|██▍       | 9291/37963 [22:55:19<62:42:57,  7.87s/it]
 24%|██▍       | 9292/37963 [22:55:33<77:57:29,  9.79s/it]
 24%|██▍       | 9293/37963 [22:55:41<72:49:00,  9.14s/it]
 24%|██▍       | 9294/37963 [22:55:55<86:37:03, 10.88s/it]
 24%|██▍       | 9295/37963 [22:56:10<94:24:56, 11.86s/it]
 24%|██▍       | 9296/37963 [22:56:17<84:15:06, 10.58s/it]
 24%|██▍       | 9297/37963 [22:56:25<76:47:08,  9.64s/it]
 24%|██▍       | 9298/37963 [22:56:40<90:11:53, 11.33s/it]
 24%|██▍       | 9299/37963 [22:56:48<81:38:55, 10.25s/it]
 24%|██▍       | 9300/37963 [22:56:55<74:41:46,  9.38s/it]
                                                          
{'loss': '0.1591', 'grad_norm': '3.841', 'learning_rate': '1.767e-05', 'epoch': '0.245'}
+
 24%|██▍       | 9300/37963 [22:56:55<74:41:46,  9.38s/it]
 25%|██▍       | 9301/37963 [22:57:03<70:35:56,  8.87s/it]
 25%|██▍       | 9302/37963 [22:57:17<83:21:58, 10.47s/it]
 25%|██▍       | 9303/37963 [22:57:25<77:05:46,  9.68s/it]
 25%|██▍       | 9304/37963 [22:57:32<72:19:29,  9.09s/it]
 25%|██▍       | 9305/37963 [22:57:40<68:38:20,  8.62s/it]
 25%|██▍       | 9306/37963 [22:57:48<66:31:13,  8.36s/it]
 25%|██▍       | 9307/37963 [22:57:55<64:54:08,  8.15s/it]
 25%|██▍       | 9308/37963 [22:58:03<63:36:29,  7.99s/it]
 25%|██▍       | 9309/37963 [22:58:11<62:50:48,  7.90s/it]
 25%|██▍       | 9310/37963 [22:58:18<62:25:02,  7.84s/it]
                                                          
{'loss': '0.1591', 'grad_norm': '2.945', 'learning_rate': '1.767e-05', 'epoch': '0.2452'}
+
 25%|██▍       | 9310/37963 [22:58:18<62:25:02,  7.84s/it]
 25%|██▍       | 9311/37963 [22:58:26<61:45:38,  7.76s/it]
 25%|██▍       | 9312/37963 [22:58:33<60:57:25,  7.66s/it]
 25%|██▍       | 9313/37963 [22:58:41<60:57:33,  7.66s/it]
 25%|██▍       | 9314/37963 [22:58:49<60:58:13,  7.66s/it]
 25%|██▍       | 9315/37963 [22:58:56<60:57:12,  7.66s/it]
 25%|██▍       | 9316/37963 [22:59:04<60:58:08,  7.66s/it]
 25%|██▍       | 9317/37963 [22:59:12<60:52:48,  7.65s/it]
 25%|██▍       | 9318/37963 [22:59:19<61:00:56,  7.67s/it]
 25%|██▍       | 9319/37963 [22:59:27<60:52:38,  7.65s/it]
 25%|██▍       | 9320/37963 [22:59:41<76:29:17,  9.61s/it]
                                                          
{'loss': '0.1611', 'grad_norm': '1.108', 'learning_rate': '1.766e-05', 'epoch': '0.2455'}
+
 25%|██▍       | 9320/37963 [22:59:41<76:29:17,  9.61s/it]
 25%|██▍       | 9321/37963 [22:59:49<72:10:49,  9.07s/it]
 25%|██▍       | 9322/37963 [22:59:57<68:52:47,  8.66s/it]
 25%|██▍       | 9323/37963 [23:00:04<65:58:15,  8.29s/it]
 25%|██▍       | 9324/37963 [23:00:19<81:40:24, 10.27s/it]
 25%|██▍       | 9325/37963 [23:00:27<75:35:36,  9.50s/it]
 25%|██▍       | 9326/37963 [23:00:34<70:59:37,  8.92s/it]
 25%|██▍       | 9327/37963 [23:00:42<67:54:10,  8.54s/it]
 25%|██▍       | 9328/37963 [23:00:50<66:05:40,  8.31s/it]
 25%|██▍       | 9329/37963 [23:00:57<64:21:44,  8.09s/it]
 25%|██▍       | 9330/37963 [23:01:05<63:16:55,  7.96s/it]
                                                          
{'loss': '0.1651', 'grad_norm': '1.227', 'learning_rate': '1.766e-05', 'epoch': '0.2458'}
+
 25%|██▍       | 9330/37963 [23:01:05<63:16:55,  7.96s/it]
 25%|██▍       | 9331/37963 [23:01:13<62:36:25,  7.87s/it]
 25%|██▍       | 9332/37963 [23:01:20<62:20:02,  7.84s/it]
 25%|██▍       | 9333/37963 [23:01:28<62:01:53,  7.80s/it]
 25%|██▍       | 9334/37963 [23:01:36<61:18:54,  7.71s/it]
 25%|██▍       | 9335/37963 [23:01:43<61:08:36,  7.69s/it]
 25%|██▍       | 9336/37963 [23:01:57<76:39:11,  9.64s/it]
 25%|██▍       | 9337/37963 [23:02:05<72:04:04,  9.06s/it]
 25%|██▍       | 9338/37963 [23:02:20<86:02:10, 10.82s/it]
 25%|██▍       | 9339/37963 [23:02:28<78:41:01,  9.90s/it]
 25%|█���▍       | 9340/37963 [23:02:43<90:38:28, 11.40s/it]
                                                          
{'loss': '0.1594', 'grad_norm': '0.9115', 'learning_rate': '1.765e-05', 'epoch': '0.246'}
+
 25%|██▍       | 9340/37963 [23:02:43<90:38:28, 11.40s/it]
 25%|██▍       | 9341/37963 [23:02:50<81:47:12, 10.29s/it]
 25%|██▍       | 9342/37963 [23:02:58<75:37:40,  9.51s/it]
 25%|██▍       | 9343/37963 [23:03:13<88:19:01, 11.11s/it]
 25%|██▍       | 9344/37963 [23:03:21<80:29:10, 10.12s/it]
 25%|██▍       | 9345/37963 [23:03:28<74:24:50,  9.36s/it]
 25%|██▍       | 9346/37963 [23:03:43<86:31:22, 10.88s/it]
 25%|██▍       | 9347/37963 [23:03:50<78:33:37,  9.88s/it]
 25%|██▍       | 9348/37963 [23:03:58<73:10:11,  9.21s/it]
 25%|██▍       | 9349/37963 [23:04:12<84:53:11, 10.68s/it]
 25%|██▍       | 9350/37963 [23:04:20<77:55:08,  9.80s/it]
                                                          
{'loss': '0.1679', 'grad_norm': '7.023', 'learning_rate': '1.765e-05', 'epoch': '0.2463'}
+
 25%|██▍       | 9350/37963 [23:04:20<77:55:08,  9.80s/it]
 25%|██▍       | 9351/37963 [23:04:27<72:38:29,  9.14s/it]
 25%|██▍       | 9352/37963 [23:04:35<68:59:22,  8.68s/it]
 25%|██▍       | 9353/37963 [23:04:42<66:10:35,  8.33s/it]
 25%|██▍       | 9354/37963 [23:04:50<64:43:29,  8.14s/it]
 25%|██▍       | 9355/37963 [23:04:58<63:33:17,  8.00s/it]
 25%|██▍       | 9356/37963 [23:05:05<61:58:34,  7.80s/it]
 25%|██▍       | 9357/37963 [23:05:13<61:17:47,  7.71s/it]
 25%|██▍       | 9358/37963 [23:05:20<60:47:52,  7.65s/it]
 25%|██▍       | 9359/37963 [23:05:28<60:46:29,  7.65s/it]
 25%|██▍       | 9360/37963 [23:05:35<60:22:29,  7.60s/it]
                                                          
{'loss': '0.1585', 'grad_norm': '2.831', 'learning_rate': '1.764e-05', 'epoch': '0.2466'}
+
 25%|██▍       | 9360/37963 [23:05:35<60:22:29,  7.60s/it]
 25%|██▍       | 9361/37963 [23:05:43<60:25:45,  7.61s/it]
 25%|██▍       | 9362/37963 [23:05:50<60:00:47,  7.55s/it]
 25%|██▍       | 9363/37963 [23:05:58<59:48:45,  7.53s/it]
 25%|██▍       | 9364/37963 [23:06:06<60:19:58,  7.59s/it]
 25%|██▍       | 9365/37963 [23:06:13<60:18:05,  7.59s/it]
 25%|██▍       | 9366/37963 [23:06:21<60:49:42,  7.66s/it]
 25%|██▍       | 9367/37963 [23:06:29<60:56:24,  7.67s/it]
 25%|██▍       | 9368/37963 [23:06:36<60:35:20,  7.63s/it]
 25%|██▍       | 9369/37963 [23:06:44<60:37:05,  7.63s/it]
 25%|██▍       | 9370/37963 [23:06:51<59:55:57,  7.55s/it]
                                                          
{'loss': '0.1755', 'grad_norm': '1.312', 'learning_rate': '1.763e-05', 'epoch': '0.2468'}
+
 25%|██▍       | 9370/37963 [23:06:51<59:55:57,  7.55s/it]
 25%|██▍       | 9371/37963 [23:06:59<60:05:25,  7.57s/it]
 25%|██▍       | 9372/37963 [23:07:20<91:50:11, 11.56s/it]
 25%|██▍       | 9373/37963 [23:07:27<82:34:45, 10.40s/it]
 25%|██▍       | 9374/37963 [23:07:35<75:22:49,  9.49s/it]
 25%|██▍       | 9375/37963 [23:07:42<71:01:31,  8.94s/it]
 25%|██▍       | 9376/37963 [23:07:50<67:41:59,  8.53s/it]
 25%|██▍       | 9377/37963 [23:07:58<65:40:44,  8.27s/it]
 25%|██▍       | 9378/37963 [23:08:05<64:07:36,  8.08s/it]
 25%|██▍       | 9379/37963 [23:08:13<63:10:31,  7.96s/it]
 25%|██▍       | 9380/37963 [23:08:21<62:42:33,  7.90s/it]
                                                          
{'loss': '0.1564', 'grad_norm': '1.616', 'learning_rate': '1.763e-05', 'epoch': '0.2471'}
+
 25%|██▍       | 9380/37963 [23:08:21<62:42:33,  7.90s/it]
 25%|██▍       | 9381/37963 [23:08:28<62:12:40,  7.84s/it]
 25%|██▍       | 9382/37963 [23:08:43<78:47:59,  9.93s/it]
 25%|██▍       | 9383/37963 [23:08:58<89:33:50, 11.28s/it]
 25%|██▍       | 9384/37963 [23:09:05<81:07:09, 10.22s/it]
 25%|██▍       | 9385/37963 [23:09:13<74:41:07,  9.41s/it]
 25%|██▍       | 9386/37963 [23:09:21<70:32:15,  8.89s/it]
 25%|██▍       | 9387/37963 [23:09:28<67:31:58,  8.51s/it]
 25%|██▍       | 9388/37963 [23:09:43<82:25:22, 10.38s/it]
 25%|██▍       | 9389/37963 [23:09:57<91:59:16, 11.59s/it]
 25%|██▍       | 9390/37963 [23:10:05<82:59:54, 10.46s/it]
                                                          
{'loss': '0.1616', 'grad_norm': '1.337', 'learning_rate': '1.762e-05', 'epoch': '0.2473'}
+
 25%|██▍       | 9390/37963 [23:10:05<82:59:54, 10.46s/it]
 25%|██▍       | 9391/37963 [23:10:13<76:02:36,  9.58s/it]
 25%|██▍       | 9392/37963 [23:10:20<71:12:52,  8.97s/it]
 25%|██▍       | 9393/37963 [23:10:28<68:06:43,  8.58s/it]
 25%|██▍       | 9394/37963 [23:10:42<81:29:43, 10.27s/it]
 25%|██▍       | 9395/37963 [23:10:50<75:28:23,  9.51s/it]
 25%|██▍       | 9396/37963 [23:10:58<70:59:35,  8.95s/it]
 25%|██▍       | 9397/37963 [23:11:12<83:11:21, 10.48s/it]
 25%|██▍       | 9398/37963 [23:11:19<76:37:19,  9.66s/it]
 25%|██▍       | 9399/37963 [23:11:27<71:49:21,  9.05s/it]
 25%|██▍       | 9400/37963 [23:11:35<69:03:58,  8.70s/it]
                                                          
{'loss': '0.1666', 'grad_norm': '4.435', 'learning_rate': '1.762e-05', 'epoch': '0.2476'}
+
 25%|██▍       | 9400/37963 [23:11:35<69:03:58,  8.70s/it]
 25%|██▍       | 9401/37963 [23:11:42<66:27:14,  8.38s/it]
 25%|██▍       | 9402/37963 [23:11:50<64:40:31,  8.15s/it]
 25%|██▍       | 9403/37963 [23:11:58<63:37:22,  8.02s/it]
 25%|██▍       | 9404/37963 [23:12:06<62:59:39,  7.94s/it]
 25%|██▍       | 9405/37963 [23:12:13<61:46:48,  7.79s/it]
 25%|██▍       | 9406/37963 [23:12:20<60:52:45,  7.67s/it]
 25%|██▍       | 9407/37963 [23:12:28<60:49:30,  7.67s/it]
 25%|██▍       | 9408/37963 [23:12:36<60:28:04,  7.62s/it]
 25%|██▍       | 9409/37963 [23:12:43<59:54:22,  7.55s/it]
 25%|██▍       | 9410/37963 [23:12:51<60:13:19,  7.59s/it]
                                                          
{'loss': '0.1486', 'grad_norm': '1.446', 'learning_rate': '1.761e-05', 'epoch': '0.2479'}
+
 25%|██▍       | 9410/37963 [23:12:51<60:13:19,  7.59s/it]
 25%|██▍       | 9411/37963 [23:12:58<60:10:07,  7.59s/it]
 25%|██▍       | 9412/37963 [23:13:06<60:23:10,  7.61s/it]
 25%|██▍       | 9413/37963 [23:13:14<60:28:05,  7.62s/it]
 25%|██▍       | 9414/37963 [23:13:21<60:40:44,  7.65s/it]
 25%|██▍       | 9415/37963 [23:13:29<60:17:37,  7.60s/it]
 25%|██▍       | 9416/37963 [23:13:37<60:35:59,  7.64s/it]
 25%|██▍       | 9417/37963 [23:13:44<60:37:13,  7.64s/it]
 25%|██▍       | 9418/37963 [23:13:58<76:24:58,  9.64s/it]
 25%|██▍       | 9419/37963 [23:14:06<71:55:09,  9.07s/it]
 25%|██▍       | 9420/37963 [23:14:14<68:27:46,  8.63s/it]
                                                          
{'loss': '0.1622', 'grad_norm': '2.148', 'learning_rate': '1.761e-05', 'epoch': '0.2481'}
+
 25%|██▍       | 9420/37963 [23:14:14<68:27:46,  8.63s/it]
 25%|██▍       | 9421/37963 [23:14:28<81:53:04, 10.33s/it]
 25%|██▍       | 9422/37963 [23:14:36<75:28:38,  9.52s/it]
 25%|██▍       | 9423/37963 [23:14:43<71:02:01,  8.96s/it]
 25%|██▍       | 9424/37963 [23:14:51<68:10:57,  8.60s/it]
 25%|██▍       | 9425/37963 [23:14:59<66:04:28,  8.34s/it]
 25%|██▍       | 9426/37963 [23:15:06<63:58:29,  8.07s/it]
 25%|██▍       | 9427/37963 [23:15:21<79:57:44, 10.09s/it]
 25%|██▍       | 9428/37963 [23:15:29<74:56:18,  9.45s/it]
 25%|██▍       | 9429/37963 [23:15:37<71:04:26,  8.97s/it]
 25%|██▍       | 9430/37963 [23:15:45<68:08:28,  8.60s/it]
                                                          
{'loss': '0.1746', 'grad_norm': '3.603', 'learning_rate': '1.76e-05', 'epoch': '0.2484'}
+
 25%|██▍       | 9430/37963 [23:15:45<68:08:28,  8.60s/it]
 25%|██▍       | 9431/37963 [23:15:59<80:59:20, 10.22s/it]
 25%|██▍       | 9432/37963 [23:16:06<75:18:56,  9.50s/it]
 25%|██▍       | 9433/37963 [23:16:14<70:41:32,  8.92s/it]
 25%|██▍       | 9434/37963 [23:16:22<67:58:42,  8.58s/it]
 25%|██▍       | 9435/37963 [23:16:29<65:26:51,  8.26s/it]
 25%|██▍       | 9436/37963 [23:16:37<63:56:16,  8.07s/it]
 25%|██▍       | 9437/37963 [23:16:45<63:02:25,  7.96s/it]
 25%|██▍       | 9438/37963 [23:16:52<62:26:41,  7.88s/it]
 25%|██▍       | 9439/37963 [23:17:07<78:19:24,  9.89s/it]
 25%|██▍       | 9440/37963 [23:17:22<90:29:46, 11.42s/it]
                                                          
{'loss': '0.1587', 'grad_norm': '1.153', 'learning_rate': '1.76e-05', 'epoch': '0.2487'}
+
 25%|██▍       | 9440/37963 [23:17:22<90:29:46, 11.42s/it]
 25%|██▍       | 9441/37963 [23:17:36<97:48:18, 12.34s/it]
 25%|██▍       | 9442/37963 [23:17:44<86:22:54, 10.90s/it]
 25%|██▍       | 9443/37963 [23:17:51<78:19:34,  9.89s/it]
 25%|██▍       | 9444/37963 [23:17:59<73:00:25,  9.22s/it]
 25%|██▍       | 9445/37963 [23:18:07<69:16:35,  8.75s/it]
 25%|██▍       | 9446/37963 [23:18:14<66:25:54,  8.39s/it]
 25%|██▍       | 9447/37963 [23:18:22<64:53:27,  8.19s/it]
 25%|██▍       | 9448/37963 [23:18:30<63:29:12,  8.02s/it]
 25%|██▍       | 9449/37963 [23:18:37<62:40:07,  7.91s/it]
 25%|██▍       | 9450/37963 [23:18:45<62:10:46,  7.85s/it]
                                                          
{'loss': '0.1729', 'grad_norm': '3.99', 'learning_rate': '1.759e-05', 'epoch': '0.2489'}
+
 25%|██▍       | 9450/37963 [23:18:45<62:10:46,  7.85s/it]
 25%|██▍       | 9451/37963 [23:18:59<77:37:53,  9.80s/it]
 25%|██▍       | 9452/37963 [23:19:07<72:42:46,  9.18s/it]
 25%|██▍       | 9453/37963 [23:19:15<68:48:58,  8.69s/it]
 25%|██▍       | 9454/37963 [23:19:22<66:01:27,  8.34s/it]
 25%|██▍       | 9455/37963 [23:19:30<64:09:15,  8.10s/it]
 25%|██▍       | 9456/37963 [23:19:38<63:29:19,  8.02s/it]
 25%|██▍       | 9457/37963 [23:19:45<62:22:50,  7.88s/it]
 25%|██▍       | 9458/37963 [23:19:53<61:53:01,  7.82s/it]
 25%|██▍       | 9459/37963 [23:20:00<61:23:38,  7.75s/it]
 25%|██▍       | 9460/37963 [23:20:08<61:05:23,  7.72s/it]
                                                          
{'loss': '0.1634', 'grad_norm': '0.7947', 'learning_rate': '1.758e-05', 'epoch': '0.2492'}
+
 25%|██▍       | 9460/37963 [23:20:08<61:05:23,  7.72s/it]
 25%|██▍       | 9461/37963 [23:20:15<60:15:56,  7.61s/it]
 25%|██▍       | 9462/37963 [23:20:23<59:43:59,  7.54s/it]
 25%|██▍       | 9463/37963 [23:20:38<76:59:24,  9.73s/it]
 25%|██▍       | 9464/37963 [23:20:45<72:21:40,  9.14s/it]
 25%|██▍       | 9465/37963 [23:20:53<68:51:48,  8.70s/it]
 25%|██▍       | 9466/37963 [23:21:01<66:09:58,  8.36s/it]
 25%|██▍       | 9467/37963 [23:21:08<64:20:00,  8.13s/it]
 25%|██▍       | 9468/37963 [23:21:16<63:11:36,  7.98s/it]
 25%|██▍       | 9469/37963 [23:21:23<62:20:07,  7.88s/it]
 25%|██▍       | 9470/37963 [23:21:31<61:47:28,  7.81s/it]
                                                          
{'loss': '0.1687', 'grad_norm': '1.34', 'learning_rate': '1.758e-05', 'epoch': '0.2495'}
+
 25%|██▍       | 9470/37963 [23:21:31<61:47:28,  7.81s/it]
 25%|██▍       | 9471/37963 [23:21:39<61:24:55,  7.76s/it]
 25%|██▍       | 9472/37963 [23:21:54<78:01:37,  9.86s/it]
 25%|██▍       | 9473/37963 [23:22:01<72:34:55,  9.17s/it]
 25%|██▍       | 9474/37963 [23:22:09<68:41:09,  8.68s/it]
 25%|██▍       | 9475/37963 [23:22:23<82:18:21, 10.40s/it]
 25%|██▍       | 9476/37963 [23:22:31<75:26:07,  9.53s/it]
 25%|██▍       | 9477/37963 [23:22:38<71:04:06,  8.98s/it]
 25%|██▍       | 9478/37963 [23:22:45<66:49:30,  8.45s/it]
 25%|██▍       | 9479/37963 [23:22:53<65:18:10,  8.25s/it]
 25%|██▍       | 9480/37963 [23:23:01<63:27:12,  8.02s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '1.366', 'learning_rate': '1.757e-05', 'epoch': '0.2497'}
+
 25%|██▍       | 9480/37963 [23:23:01<63:27:12,  8.02s/it]
 25%|██▍       | 9481/37963 [23:23:08<62:27:12,  7.89s/it]
 25%|██▍       | 9482/37963 [23:23:16<61:48:57,  7.81s/it]
 25%|██▍       | 9483/37963 [23:23:24<61:25:12,  7.76s/it]
 25%|██▍       | 9484/37963 [23:23:31<60:21:54,  7.63s/it]
 25%|██▍       | 9485/37963 [23:23:59<109:09:53, 13.80s/it]
 25%|██▍       | 9486/37963 [23:24:07<94:40:38, 11.97s/it] 
 25%|██▍       | 9487/37963 [23:24:14<84:09:34, 10.64s/it]
 25%|██▍       | 9488/37963 [23:24:22<77:21:12,  9.78s/it]
 25%|██▍       | 9489/37963 [23:24:30<71:44:09,  9.07s/it]
 25%|██▍       | 9490/37963 [23:24:37<67:48:08,  8.57s/it]
                                                          
{'loss': '0.1632', 'grad_norm': '3.386', 'learning_rate': '1.757e-05', 'epoch': '0.25'}
+
 25%|██▍       | 9490/37963 [23:24:37<67:48:08,  8.57s/it]
 25%|██▌       | 9491/37963 [23:24:45<65:31:47,  8.29s/it]
 25%|██▌       | 9492/37963 [23:24:52<64:43:04,  8.18s/it]
 25%|██▌       | 9493/37963 [23:25:00<63:22:10,  8.01s/it]
 25%|██▌       | 9494/37963 [23:25:15<78:42:22,  9.95s/it]
 25%|██▌       | 9495/37963 [23:25:22<73:21:06,  9.28s/it]
 25%|██▌       | 9496/37963 [23:25:36<84:29:32, 10.69s/it]
 25%|██▌       | 9497/37963 [23:25:44<77:19:09,  9.78s/it]
 25%|██▌       | 9498/37963 [23:25:52<72:14:09,  9.14s/it]
 25%|██▌       | 9499/37963 [23:25:59<68:54:12,  8.71s/it]
 25%|██▌       | 9500/37963 [23:26:07<66:12:14,  8.37s/it]
                                                          
{'loss': '0.1549', 'grad_norm': '0.8659', 'learning_rate': '1.756e-05', 'epoch': '0.2502'}
+
 25%|██▌       | 9500/37963 [23:26:07<66:12:14,  8.37s/it]
 25%|██▌       | 9501/37963 [23:26:15<64:35:16,  8.17s/it]
 25%|██▌       | 9502/37963 [23:26:22<63:41:37,  8.06s/it]
 25%|██▌       | 9503/37963 [23:26:30<62:33:35,  7.91s/it]
 25%|██▌       | 9504/37963 [23:26:38<61:52:03,  7.83s/it]
 25%|██▌       | 9505/37963 [23:26:45<60:54:54,  7.71s/it]
 25%|██▌       | 9506/37963 [23:26:52<60:19:11,  7.63s/it]
 25%|██▌       | 9507/37963 [23:27:00<60:34:55,  7.66s/it]
 25%|██▌       | 9508/37963 [23:27:08<60:29:58,  7.65s/it]
 25%|██▌       | 9509/37963 [23:27:15<60:21:17,  7.64s/it]
 25%|██▌       | 9510/37963 [23:27:23<60:18:47,  7.63s/it]
                                                          
{'loss': '0.1678', 'grad_norm': '1.488', 'learning_rate': '1.756e-05', 'epoch': '0.2505'}
+
 25%|██▌       | 9510/37963 [23:27:23<60:18:47,  7.63s/it]
 25%|██▌       | 9511/37963 [23:27:38<76:57:51,  9.74s/it]
 25%|██▌       | 9512/37963 [23:27:45<71:50:28,  9.09s/it]
 25%|██▌       | 9513/37963 [23:27:53<68:33:54,  8.68s/it]
 25%|██▌       | 9514/37963 [23:28:01<65:59:37,  8.35s/it]
 25%|██▌       | 9515/37963 [23:28:08<64:11:58,  8.12s/it]
 25%|██▌       | 9516/37963 [23:28:16<63:02:46,  7.98s/it]
 25%|██▌       | 9517/37963 [23:28:31<79:34:47, 10.07s/it]
 25%|██▌       | 9518/37963 [23:28:38<73:45:11,  9.33s/it]
 25%|██▌       | 9519/37963 [23:28:46<69:50:45,  8.84s/it]
 25%|██▌       | 9520/37963 [23:28:53<66:10:05,  8.37s/it]
                                                          
{'loss': '0.1678', 'grad_norm': '2.507', 'learning_rate': '1.755e-05', 'epoch': '0.2508'}
+
 25%|██▌       | 9520/37963 [23:28:53<66:10:05,  8.37s/it]
 25%|██▌       | 9521/37963 [23:29:07<79:27:27, 10.06s/it]
 25%|██▌       | 9522/37963 [23:29:15<73:53:41,  9.35s/it]
 25%|██▌       | 9523/37963 [23:29:23<69:46:32,  8.83s/it]
 25%|██▌       | 9524/37963 [23:29:30<66:55:53,  8.47s/it]
 25%|██▌       | 9525/37963 [23:29:38<65:02:47,  8.23s/it]
 25%|██▌       | 9526/37963 [23:29:45<63:06:27,  7.99s/it]
 25%|██▌       | 9527/37963 [23:29:53<62:36:31,  7.93s/it]
 25%|██▌       | 9528/37963 [23:30:01<61:50:54,  7.83s/it]
 25%|██▌       | 9529/37963 [23:30:08<61:03:47,  7.73s/it]
 25%|██▌       | 9530/37963 [23:30:16<60:10:43,  7.62s/it]
                                                          
{'loss': '0.1735', 'grad_norm': '5.827', 'learning_rate': '1.755e-05', 'epoch': '0.251'}
+
 25%|██▌       | 9530/37963 [23:30:16<60:10:43,  7.62s/it]
 25%|██▌       | 9531/37963 [23:30:30<76:17:59,  9.66s/it]
 25%|██▌       | 9532/37963 [23:30:38<71:41:29,  9.08s/it]
 25%|██▌       | 9533/37963 [23:30:45<68:13:49,  8.64s/it]
 25%|██▌       | 9534/37963 [23:30:53<65:30:43,  8.30s/it]
 25%|██▌       | 9535/37963 [23:31:01<63:57:03,  8.10s/it]
 25%|██▌       | 9536/37963 [23:31:15<78:01:11,  9.88s/it]
 25%|██▌       | 9537/37963 [23:31:23<73:32:37,  9.31s/it]
 25%|██▌       | 9538/37963 [23:31:44<102:41:48, 13.01s/it]
 25%|██▌       | 9539/37963 [23:31:59<105:59:21, 13.42s/it]
 25%|██▌       | 9540/37963 [23:32:06<92:25:13, 11.71s/it] 
                                                          
{'loss': '0.1684', 'grad_norm': '1.07', 'learning_rate': '1.754e-05', 'epoch': '0.2513'}
+
 25%|██▌       | 9540/37963 [23:32:06<92:25:13, 11.71s/it]
 25%|██▌       | 9541/37963 [23:32:14<82:45:34, 10.48s/it]
 25%|██▌       | 9542/37963 [23:32:21<75:49:53,  9.61s/it]
 25%|██▌       | 9543/37963 [23:32:29<71:02:16,  9.00s/it]
 25%|██▌       | 9544/37963 [23:32:37<67:51:17,  8.60s/it]
 25%|██▌       | 9545/37963 [23:32:44<65:31:22,  8.30s/it]
 25%|██▌       | 9546/37963 [23:32:52<63:26:17,  8.04s/it]
 25%|██▌       | 9547/37963 [23:32:59<62:34:43,  7.93s/it]
 25%|██▌       | 9548/37963 [23:33:07<62:08:50,  7.87s/it]
 25%|██▌       | 9549/37963 [23:33:14<60:49:17,  7.71s/it]
 25%|██▌       | 9550/37963 [23:33:22<60:38:57,  7.68s/it]
                                                          
{'loss': '0.1728', 'grad_norm': '1.241', 'learning_rate': '1.753e-05', 'epoch': '0.2516'}
+
 25%|██▌       | 9550/37963 [23:33:22<60:38:57,  7.68s/it]
 25%|██▌       | 9551/37963 [23:33:30<60:23:30,  7.65s/it]
 25%|██▌       | 9552/37963 [23:33:37<60:15:19,  7.64s/it]
 25%|██▌       | 9553/37963 [23:33:45<60:22:05,  7.65s/it]
 25%|██▌       | 9554/37963 [23:33:53<60:27:22,  7.66s/it]
 25%|██▌       | 9555/37963 [23:34:00<60:13:40,  7.63s/it]
 25%|██▌       | 9556/37963 [23:34:08<60:21:54,  7.65s/it]
 25%|██▌       | 9557/37963 [23:34:16<60:28:15,  7.66s/it]
 25%|██▌       | 9558/37963 [23:34:31<78:44:10,  9.98s/it]
 25%|██▌       | 9559/37963 [23:34:39<73:28:19,  9.31s/it]
 25%|██▌       | 9560/37963 [23:34:54<86:35:56, 10.98s/it]
                                                          
{'loss': '0.1636', 'grad_norm': '4.924', 'learning_rate': '1.753e-05', 'epoch': '0.2518'}
+
 25%|██▌       | 9560/37963 [23:34:54<86:35:56, 10.98s/it]
 25%|██▌       | 9561/37963 [23:35:01<79:04:09, 10.02s/it]
 25%|██▌       | 9562/37963 [23:35:09<73:24:29,  9.30s/it]
 25%|██▌       | 9563/37963 [23:35:17<69:09:12,  8.77s/it]
 25%|██▌       | 9564/37963 [23:35:24<66:04:33,  8.38s/it]
 25%|██▌       | 9565/37963 [23:35:32<64:07:30,  8.13s/it]
 25%|██▌       | 9566/37963 [23:35:39<62:53:52,  7.97s/it]
 25%|██▌       | 9567/37963 [23:35:47<62:09:11,  7.88s/it]
 25%|██▌       | 9568/37963 [23:35:55<61:48:16,  7.84s/it]
 25%|██▌       | 9569/37963 [23:36:09<77:18:45,  9.80s/it]
 25%|██▌       | 9570/37963 [23:36:17<72:21:16,  9.17s/it]
                                                          
{'loss': '0.1597', 'grad_norm': '3.031', 'learning_rate': '1.752e-05', 'epoch': '0.2521'}
+
 25%|██▌       | 9570/37963 [23:36:17<72:21:16,  9.17s/it]
 25%|██▌       | 9571/37963 [23:36:24<68:27:10,  8.68s/it]
 25%|██▌       | 9572/37963 [23:36:32<65:57:02,  8.36s/it]
 25%|██▌       | 9573/37963 [23:36:39<64:21:47,  8.16s/it]
 25%|██▌       | 9574/37963 [23:36:47<63:27:46,  8.05s/it]
 25%|██▌       | 9575/37963 [23:36:55<62:40:18,  7.95s/it]
 25%|██▌       | 9576/37963 [23:37:03<62:35:49,  7.94s/it]
 25%|██▌       | 9577/37963 [23:37:11<61:57:07,  7.86s/it]
 25%|██▌       | 9578/37963 [23:37:24<76:05:55,  9.65s/it]
 25%|██▌       | 9579/37963 [23:37:32<71:22:06,  9.05s/it]
 25%|██▌       | 9580/37963 [23:37:40<67:56:31,  8.62s/it]
                                                          
{'loss': '0.1703', 'grad_norm': '2.385', 'learning_rate': '1.752e-05', 'epoch': '0.2524'}
+
 25%|██▌       | 9580/37963 [23:37:40<67:56:31,  8.62s/it]
 25%|██▌       | 9581/37963 [23:37:47<65:10:48,  8.27s/it]
 25%|██▌       | 9582/37963 [23:38:02<79:44:26, 10.11s/it]
 25%|██▌       | 9583/37963 [23:38:09<74:05:54,  9.40s/it]
 25%|██▌       | 9584/37963 [23:38:17<70:03:00,  8.89s/it]
 25%|██▌       | 9585/37963 [23:38:25<67:24:03,  8.55s/it]
 25%|██▌       | 9586/37963 [23:38:32<65:15:48,  8.28s/it]
 25%|██▌       | 9587/37963 [23:38:54<95:55:26, 12.17s/it]
 25%|██▌       | 9588/37963 [23:39:08<100:08:21, 12.70s/it]
 25%|██▌       | 9589/37963 [23:39:15<88:07:25, 11.18s/it] 
 25%|██▌       | 9590/37963 [23:39:23<79:39:09, 10.11s/it]
                                                          
{'loss': '0.1663', 'grad_norm': '1.149', 'learning_rate': '1.751e-05', 'epoch': '0.2526'}
+
 25%|██▌       | 9590/37963 [23:39:23<79:39:09, 10.11s/it]
 25%|██▌       | 9591/37963 [23:39:30<73:38:39,  9.34s/it]
 25%|██▌       | 9592/37963 [23:39:38<69:43:34,  8.85s/it]
 25%|██▌       | 9593/37963 [23:39:46<67:02:54,  8.51s/it]
 25%|██▌       | 9594/37963 [23:39:53<64:51:59,  8.23s/it]
 25%|██▌       | 9595/37963 [23:40:01<63:37:11,  8.07s/it]
 25%|██▌       | 9596/37963 [23:40:09<62:29:29,  7.93s/it]
 25%|██▌       | 9597/37963 [23:40:16<61:47:03,  7.84s/it]
 25%|██▌       | 9598/37963 [23:40:24<61:12:46,  7.77s/it]
 25%|██▌       | 9599/37963 [23:40:32<61:03:23,  7.75s/it]
 25%|██▌       | 9600/37963 [23:40:39<60:43:18,  7.71s/it]
                                                          
{'loss': '0.1661', 'grad_norm': '5.782', 'learning_rate': '1.751e-05', 'epoch': '0.2529'}
+
 25%|██▌       | 9600/37963 [23:40:39<60:43:18,  7.71s/it]
 25%|██▌       | 9601/37963 [23:40:47<60:28:33,  7.68s/it]
 25%|██▌       | 9602/37963 [23:40:54<59:52:56,  7.60s/it]
 25%|██▌       | 9603/37963 [23:41:02<59:47:56,  7.59s/it]
 25%|██▌       | 9604/37963 [23:41:09<59:49:37,  7.59s/it]
 25%|██▌       | 9605/37963 [23:41:17<60:18:02,  7.66s/it]
 25%|██▌       | 9606/37963 [23:41:32<77:27:55,  9.83s/it]
 25%|██▌       | 9607/37963 [23:41:47<89:07:30, 11.32s/it]
 25%|██▌       | 9608/37963 [23:41:55<80:51:22, 10.27s/it]
 25%|██▌       | 9609/37963 [23:42:03<75:03:14,  9.53s/it]
 25%|██▌       | 9610/37963 [23:42:10<70:46:09,  8.99s/it]
                                                          
{'loss': '0.1637', 'grad_norm': '4.588', 'learning_rate': '1.75e-05', 'epoch': '0.2531'}
+
 25%|██▌       | 9610/37963 [23:42:10<70:46:09,  8.99s/it]
 25%|██▌       | 9611/37963 [23:42:18<68:11:15,  8.66s/it]
 25%|██▌       | 9612/37963 [23:42:26<65:22:36,  8.30s/it]
 25%|██▌       | 9613/37963 [23:42:40<79:12:53, 10.06s/it]
 25%|██▌       | 9614/37963 [23:42:47<73:01:21,  9.27s/it]
 25%|██▌       | 9615/37963 [23:42:55<69:14:11,  8.79s/it]
 25%|██▌       | 9616/37963 [23:43:03<67:26:01,  8.56s/it]
 25%|██▌       | 9617/37963 [23:43:10<65:09:14,  8.27s/it]
 25%|██▌       | 9618/37963 [23:43:18<63:52:26,  8.11s/it]
 25%|██▌       | 9619/37963 [23:43:26<62:50:16,  7.98s/it]
 25%|██▌       | 9620/37963 [23:43:34<62:03:34,  7.88s/it]
                                                          
{'loss': '0.1792', 'grad_norm': '2.466', 'learning_rate': '1.75e-05', 'epoch': '0.2534'}
+
 25%|██▌       | 9620/37963 [23:43:34<62:03:34,  7.88s/it]
 25%|██▌       | 9621/37963 [23:43:41<61:22:37,  7.80s/it]
 25%|██▌       | 9622/37963 [23:43:49<61:05:38,  7.76s/it]
 25%|██▌       | 9623/37963 [23:43:56<60:38:26,  7.70s/it]
 25%|██▌       | 9624/37963 [23:44:10<75:30:37,  9.59s/it]
 25%|██▌       | 9625/37963 [23:44:18<71:11:18,  9.04s/it]
 25%|██▌       | 9626/37963 [23:44:26<68:03:25,  8.65s/it]
 25%|██▌       | 9627/37963 [23:44:33<64:58:15,  8.25s/it]
 25%|██▌       | 9628/37963 [23:44:41<63:45:30,  8.10s/it]
 25%|██▌       | 9629/37963 [23:44:49<62:29:45,  7.94s/it]
 25%|██▌       | 9630/37963 [23:45:03<77:53:09,  9.90s/it]
                                                          
{'loss': '0.1593', 'grad_norm': '3.488', 'learning_rate': '1.749e-05', 'epoch': '0.2537'}
+
 25%|██▌       | 9630/37963 [23:45:03<77:53:09,  9.90s/it]
 25%|██▌       | 9631/37963 [23:45:11<72:24:27,  9.20s/it]
 25%|██▌       | 9632/37963 [23:45:18<68:57:54,  8.76s/it]
 25%|██▌       | 9633/37963 [23:45:26<65:36:00,  8.34s/it]
 25%|██▌       | 9634/37963 [23:45:33<63:55:09,  8.12s/it]
 25%|██▌       | 9635/37963 [23:45:48<79:31:02, 10.11s/it]
 25%|██▌       | 9636/37963 [23:46:09<104:28:00, 13.28s/it]
 25%|██▌       | 9637/37963 [23:46:16<91:23:19, 11.61s/it] 
 25%|██▌       | 9638/37963 [23:46:24<81:55:33, 10.41s/it]
 25%|██▌       | 9639/37963 [23:46:32<75:37:33,  9.61s/it]
 25%|██▌       | 9640/37963 [23:46:39<71:05:36,  9.04s/it]
                                                          
{'loss': '0.1746', 'grad_norm': '1.131', 'learning_rate': '1.748e-05', 'epoch': '0.2539'}
+
 25%|██▌       | 9640/37963 [23:46:39<71:05:36,  9.04s/it]
 25%|██▌       | 9641/37963 [23:46:47<67:19:20,  8.56s/it]
 25%|██▌       | 9642/37963 [23:46:55<65:19:31,  8.30s/it]
 25%|██▌       | 9643/37963 [23:47:02<63:45:41,  8.11s/it]
 25%|██▌       | 9644/37963 [23:47:10<62:12:01,  7.91s/it]
 25%|██▌       | 9645/37963 [23:47:17<61:13:24,  7.78s/it]
 25%|██▌       | 9646/37963 [23:47:25<60:57:53,  7.75s/it]
 25%|██▌       | 9647/37963 [23:47:33<60:44:24,  7.72s/it]
 25%|██▌       | 9648/37963 [23:47:40<60:46:13,  7.73s/it]
 25%|██▌       | 9649/37963 [23:47:48<60:46:27,  7.73s/it]
 25%|██▌       | 9650/37963 [23:47:56<60:39:14,  7.71s/it]
                                                          
{'loss': '0.1561', 'grad_norm': '3.013', 'learning_rate': '1.748e-05', 'epoch': '0.2542'}
+
 25%|██▌       | 9650/37963 [23:47:56<60:39:14,  7.71s/it]
 25%|██▌       | 9651/37963 [23:48:03<60:02:39,  7.63s/it]
 25%|██▌       | 9652/37963 [23:48:18<76:52:43,  9.78s/it]
 25%|██▌       | 9653/37963 [23:48:33<89:44:53, 11.41s/it]
 25%|██▌       | 9654/37963 [23:48:41<81:18:53, 10.34s/it]
 25%|██▌       | 9655/37963 [23:48:49<75:01:45,  9.54s/it]
 25%|██▌       | 9656/37963 [23:48:56<70:32:35,  8.97s/it]
 25%|██▌       | 9657/37963 [23:49:04<67:52:35,  8.63s/it]
 25%|██▌       | 9658/37963 [23:49:18<81:14:30, 10.33s/it]
 25%|██▌       | 9659/37963 [23:49:26<75:08:04,  9.56s/it]
 25%|██▌       | 9660/37963 [23:49:34<70:29:57,  8.97s/it]
                                                          
{'loss': '0.165', 'grad_norm': '1.131', 'learning_rate': '1.747e-05', 'epoch': '0.2545'}
+
 25%|██▌       | 9660/37963 [23:49:34<70:29:57,  8.97s/it]
 25%|██▌       | 9661/37963 [23:49:41<67:30:31,  8.59s/it]
 25%|██▌       | 9662/37963 [23:49:49<65:27:14,  8.33s/it]
 25%|██▌       | 9663/37963 [23:49:57<63:57:27,  8.14s/it]
 25%|██▌       | 9664/37963 [23:50:04<62:40:35,  7.97s/it]
 25%|██▌       | 9665/37963 [23:50:12<61:42:33,  7.85s/it]
 25%|██▌       | 9666/37963 [23:50:20<61:17:31,  7.80s/it]
 25%|██▌       | 9667/37963 [23:50:27<60:50:49,  7.74s/it]
 25%|██▌       | 9668/37963 [23:50:35<60:39:52,  7.72s/it]
 25%|██▌       | 9669/37963 [23:50:43<60:19:37,  7.68s/it]
 25%|██▌       | 9670/37963 [23:50:50<60:19:49,  7.68s/it]
                                                          
{'loss': '0.1649', 'grad_norm': '5.163', 'learning_rate': '1.747e-05', 'epoch': '0.2547'}
+
 25%|██▌       | 9670/37963 [23:50:50<60:19:49,  7.68s/it]
 25%|██▌       | 9671/37963 [23:50:58<60:36:17,  7.71s/it]
 25%|██▌       | 9672/37963 [23:51:12<75:57:29,  9.67s/it]
 25%|██▌       | 9673/37963 [23:51:20<71:35:53,  9.11s/it]
 25%|██▌       | 9674/37963 [23:51:28<68:01:00,  8.66s/it]
 25%|██▌       | 9675/37963 [23:51:35<65:35:03,  8.35s/it]
 25%|██▌       | 9676/37963 [23:51:43<64:05:26,  8.16s/it]
 25%|██▌       | 9677/37963 [23:51:58<79:27:43, 10.11s/it]
 25%|██▌       | 9678/37963 [23:52:06<74:12:00,  9.44s/it]
 25%|██▌       | 9679/37963 [23:52:20<85:57:44, 10.94s/it]
 25%|██▌       | 9680/37963 [23:52:34<93:28:04, 11.90s/it]
                                                          
{'loss': '0.1658', 'grad_norm': '1.505', 'learning_rate': '1.746e-05', 'epoch': '0.255'}
+
 25%|██▌       | 9680/37963 [23:52:34<93:28:04, 11.90s/it]
 26%|██▌       | 9681/37963 [23:52:42<83:21:19, 10.61s/it]
 26%|██▌       | 9682/37963 [23:52:49<76:21:23,  9.72s/it]
 26%|██▌       | 9683/37963 [23:52:57<71:25:18,  9.09s/it]
 26%|██▌       | 9684/37963 [23:53:05<68:03:01,  8.66s/it]
 26%|██▌       | 9685/37963 [23:53:12<65:40:08,  8.36s/it]
 26%|██▌       | 9686/37963 [23:53:20<64:17:24,  8.18s/it]
 26%|██▌       | 9687/37963 [23:53:28<62:55:26,  8.01s/it]
 26%|██▌       | 9688/37963 [23:53:42<78:14:40,  9.96s/it]
 26%|██▌       | 9689/37963 [23:53:50<72:57:42,  9.29s/it]
 26%|██▌       | 9690/37963 [23:53:57<68:41:39,  8.75s/it]
                                                          
{'loss': '0.1795', 'grad_norm': '5.363', 'learning_rate': '1.746e-05', 'epoch': '0.2552'}
+
 26%|██▌       | 9690/37963 [23:53:57<68:41:39,  8.75s/it]
 26%|██▌       | 9691/37963 [23:54:05<65:57:47,  8.40s/it]
 26%|██▌       | 9692/37963 [23:54:12<63:26:18,  8.08s/it]
 26%|█���▌       | 9693/37963 [23:54:20<62:36:56,  7.97s/it]
 26%|██▌       | 9694/37963 [23:54:28<61:47:01,  7.87s/it]
 26%|██▌       | 9695/37963 [23:54:35<61:15:10,  7.80s/it]
 26%|██▌       | 9696/37963 [23:54:43<61:16:29,  7.80s/it]
 26%|██▌       | 9697/37963 [23:54:51<61:21:41,  7.82s/it]
 26%|██▌       | 9698/37963 [23:54:59<60:57:33,  7.76s/it]
 26%|██▌       | 9699/37963 [23:55:13<75:59:59,  9.68s/it]
 26%|██▌       | 9700/37963 [23:55:21<71:42:51,  9.13s/it]
                                                          
{'loss': '0.1732', 'grad_norm': '0.99', 'learning_rate': '1.745e-05', 'epoch': '0.2555'}
+
 26%|██▌       | 9700/37963 [23:55:21<71:42:51,  9.13s/it]
 26%|██▌       | 9701/37963 [23:55:28<68:38:12,  8.74s/it]
 26%|██▌       | 9702/37963 [23:55:36<66:03:56,  8.42s/it]
 26%|██▌       | 9703/37963 [23:55:43<63:38:22,  8.11s/it]
 26%|██▌       | 9704/37963 [23:55:59<80:01:37, 10.19s/it]
 26%|██▌       | 9705/37963 [23:56:06<74:01:52,  9.43s/it]
 26%|██▌       | 9706/37963 [23:56:14<69:36:24,  8.87s/it]
 26%|██▌       | 9707/37963 [23:56:21<66:45:18,  8.51s/it]
 26%|██▌       | 9708/37963 [23:56:36<80:47:50, 10.29s/it]
 26%|██▌       | 9709/37963 [23:56:44<74:38:29,  9.51s/it]
 26%|██▌       | 9710/37963 [23:56:51<70:20:50,  8.96s/it]
                                                          
{'loss': '0.1508', 'grad_norm': '1.86', 'learning_rate': '1.744e-05', 'epoch': '0.2558'}
+
 26%|██▌       | 9710/37963 [23:56:51<70:20:50,  8.96s/it]
 26%|██▌       | 9711/37963 [23:56:59<67:06:42,  8.55s/it]
 26%|██▌       | 9712/37963 [23:57:06<64:49:57,  8.26s/it]
 26%|██▌       | 9713/37963 [23:57:14<63:32:35,  8.10s/it]
 26%|██▌       | 9714/37963 [23:57:22<62:28:54,  7.96s/it]
 26%|██▌       | 9715/37963 [23:57:29<61:45:30,  7.87s/it]
 26%|██▌       | 9716/37963 [23:57:37<61:29:19,  7.84s/it]
 26%|██▌       | 9717/37963 [23:57:45<61:05:20,  7.79s/it]
 26%|██▌       | 9718/37963 [23:57:52<60:39:53,  7.73s/it]
 26%|██▌       | 9719/37963 [23:58:00<60:30:42,  7.71s/it]
 26%|██▌       | 9720/37963 [23:58:08<60:20:52,  7.69s/it]
                                                          
{'loss': '0.1763', 'grad_norm': '0.8098', 'learning_rate': '1.744e-05', 'epoch': '0.256'}
+
 26%|██▌       | 9720/37963 [23:58:08<60:20:52,  7.69s/it]
 26%|██▌       | 9721/37963 [23:58:15<59:51:25,  7.63s/it]
 26%|██▌       | 9722/37963 [23:58:23<59:46:53,  7.62s/it]
 26%|██▌       | 9723/37963 [23:58:31<59:45:57,  7.62s/it]
 26%|██▌       | 9724/37963 [23:58:44<74:30:48,  9.50s/it]
 26%|██▌       | 9725/37963 [23:58:59<87:07:39, 11.11s/it]
 26%|██▌       | 9726/37963 [23:59:14<95:12:58, 12.14s/it]
 26%|██▌       | 9727/37963 [23:59:22<84:51:48, 10.82s/it]
 26%|██▌       | 9728/37963 [23:59:36<92:33:57, 11.80s/it]
 26%|██▌       | 9729/37963 [23:59:43<82:53:12, 10.57s/it]
 26%|██▌       | 9730/37963 [23:59:51<75:46:46,  9.66s/it]
                                                          
{'loss': '0.1671', 'grad_norm': '3.413', 'learning_rate': '1.743e-05', 'epoch': '0.2563'}
+
 26%|██▌       | 9730/37963 [23:59:51<75:46:46,  9.66s/it]
 26%|██▌       | 9731/37963 [23:59:58<70:46:33,  9.02s/it]
 26%|██▌       | 9732/37963 [24:00:06<67:34:38,  8.62s/it]
 26%|██▌       | 9733/37963 [24:00:14<65:17:34,  8.33s/it]
 26%|██▌       | 9734/37963 [24:00:28<79:32:27, 10.14s/it]
 26%|██▌       | 9735/37963 [24:00:36<73:59:22,  9.44s/it]
 26%|██▌       | 9736/37963 [24:00:44<70:01:55,  8.93s/it]
 26%|██▌       | 9737/37963 [24:00:51<67:12:30,  8.57s/it]
 26%|██▌       | 9738/37963 [24:00:59<65:15:52,  8.32s/it]
 26%|██▌       | 9739/37963 [24:01:07<63:35:30,  8.11s/it]
 26%|██▌       | 9740/37963 [24:01:14<62:18:43,  7.95s/it]
                                                          
{'loss': '0.1699', 'grad_norm': '3.055', 'learning_rate': '1.743e-05', 'epoch': '0.2566'}
+
 26%|██▌       | 9740/37963 [24:01:14<62:18:43,  7.95s/it]
 26%|██▌       | 9741/37963 [24:01:22<60:56:33,  7.77s/it]
 26%|██▌       | 9742/37963 [24:01:29<60:54:18,  7.77s/it]
 26%|██▌       | 9743/37963 [24:01:37<60:39:16,  7.74s/it]
 26%|██▌       | 9744/37963 [24:01:52<77:21:31,  9.87s/it]
 26%|██▌       | 9745/37963 [24:02:00<72:12:27,  9.21s/it]
 26%|██▌       | 9746/37963 [24:02:07<68:50:49,  8.78s/it]
 26%|██▌       | 9747/37963 [24:02:15<66:14:09,  8.45s/it]
 26%|██▌       | 9748/37963 [24:02:23<64:20:14,  8.21s/it]
 26%|██▌       | 9749/37963 [24:02:30<62:16:04,  7.95s/it]
 26%|██▌       | 9750/37963 [24:02:38<61:36:12,  7.86s/it]
                                                          
{'loss': '0.149', 'grad_norm': '1.845', 'learning_rate': '1.742e-05', 'epoch': '0.2568'}
+
 26%|██▌       | 9750/37963 [24:02:38<61:36:12,  7.86s/it]
 26%|██▌       | 9751/37963 [24:02:45<61:11:46,  7.81s/it]
 26%|██▌       | 9752/37963 [24:02:59<75:55:51,  9.69s/it]
 26%|██▌       | 9753/37963 [24:03:07<71:44:37,  9.16s/it]
 26%|██▌       | 9754/37963 [24:03:15<68:27:38,  8.74s/it]
 26%|██▌       | 9755/37963 [24:03:30<82:49:53, 10.57s/it]
 26%|██▌       | 9756/37963 [24:03:38<75:55:10,  9.69s/it]
 26%|██▌       | 9757/37963 [24:03:45<70:42:06,  9.02s/it]
 26%|██▌       | 9758/37963 [24:03:53<67:07:40,  8.57s/it]
 26%|██▌       | 9759/37963 [24:04:00<64:52:59,  8.28s/it]
 26%|██▌       | 9760/37963 [24:04:08<63:10:03,  8.06s/it]
                                                          
{'loss': '0.1543', 'grad_norm': '3.419', 'learning_rate': '1.742e-05', 'epoch': '0.2571'}
+
 26%|██▌       | 9760/37963 [24:04:08<63:10:03,  8.06s/it]
 26%|██▌       | 9761/37963 [24:04:15<61:35:20,  7.86s/it]
 26%|██▌       | 9762/37963 [24:04:23<60:48:23,  7.76s/it]
 26%|██▌       | 9763/37963 [24:04:30<59:03:00,  7.54s/it]
 26%|██▌       | 9764/37963 [24:04:37<59:24:24,  7.58s/it]
 26%|██▌       | 9765/37963 [24:04:45<59:16:24,  7.57s/it]
 26%|██▌       | 9766/37963 [24:04:52<59:08:25,  7.55s/it]
 26%|██▌       | 9767/37963 [24:05:00<59:23:43,  7.58s/it]
 26%|██▌       | 9768/37963 [24:05:08<59:34:03,  7.61s/it]
 26%|██▌       | 9769/37963 [24:05:22<75:02:36,  9.58s/it]
 26%|██▌       | 9770/37963 [24:05:30<71:00:42,  9.07s/it]
                                                          
{'loss': '0.1328', 'grad_norm': '1.686', 'learning_rate': '1.741e-05', 'epoch': '0.2574'}
+
 26%|██▌       | 9770/37963 [24:05:30<71:00:42,  9.07s/it]
 26%|██▌       | 9771/37963 [24:05:37<67:38:10,  8.64s/it]
 26%|██▌       | 9772/37963 [24:05:52<82:36:59, 10.55s/it]
 26%|██▌       | 9773/37963 [24:06:08<93:41:03, 11.96s/it]
 26%|██▌       | 9774/37963 [24:06:15<83:21:49, 10.65s/it]
 26%|██▌       | 9775/37963 [24:06:23<76:32:39,  9.78s/it]
 26%|██▌       | 9776/37963 [24:06:31<71:25:15,  9.12s/it]
 26%|██▌       | 9777/37963 [24:06:38<68:04:20,  8.69s/it]
 26%|██▌       | 9778/37963 [24:06:53<81:37:05, 10.42s/it]
 26%|██▌       | 9779/37963 [24:07:01<75:49:36,  9.69s/it]
 26%|██▌       | 9780/37963 [24:07:08<71:03:24,  9.08s/it]
                                                          
{'loss': '0.166', 'grad_norm': '1.791', 'learning_rate': '1.74e-05', 'epoch': '0.2576'}
+
 26%|██▌       | 9780/37963 [24:07:08<71:03:24,  9.08s/it]
 26%|██▌       | 9781/37963 [24:07:23<83:00:01, 10.60s/it]
 26%|██▌       | 9782/37963 [24:07:30<76:12:44,  9.74s/it]
 26%|██▌       | 9783/37963 [24:07:38<70:57:51,  9.07s/it]
 26%|██▌       | 9784/37963 [24:07:46<67:55:49,  8.68s/it]
 26%|██▌       | 9785/37963 [24:07:53<65:20:19,  8.35s/it]
 26%|██▌       | 9786/37963 [24:08:01<63:31:03,  8.12s/it]
 26%|██▌       | 9787/37963 [24:08:08<62:20:31,  7.97s/it]
 26%|██▌       | 9788/37963 [24:08:16<61:35:23,  7.87s/it]
 26%|██▌       | 9789/37963 [24:08:24<61:02:00,  7.80s/it]
 26%|██▌       | 9790/37963 [24:08:31<60:32:33,  7.74s/it]
                                                          
{'loss': '0.1614', 'grad_norm': '2.37', 'learning_rate': '1.74e-05', 'epoch': '0.2579'}
+
 26%|██▌       | 9790/37963 [24:08:31<60:32:33,  7.74s/it]
 26%|██▌       | 9791/37963 [24:08:39<60:36:10,  7.74s/it]
 26%|██▌       | 9792/37963 [24:08:47<60:26:32,  7.72s/it]
 26%|██▌       | 9793/37963 [24:08:54<60:27:56,  7.73s/it]
 26%|██▌       | 9794/37963 [24:09:02<59:49:26,  7.65s/it]
 26%|██▌       | 9795/37963 [24:09:09<59:20:44,  7.58s/it]
 26%|██▌       | 9796/37963 [24:09:17<59:04:36,  7.55s/it]
 26%|██▌       | 9797/37963 [24:09:24<59:13:02,  7.57s/it]
 26%|██▌       | 9798/37963 [24:09:39<75:25:47,  9.64s/it]
 26%|██▌       | 9799/37963 [24:09:46<70:24:14,  9.00s/it]
 26%|██▌       | 9800/37963 [24:09:54<67:24:56,  8.62s/it]
                                                          
{'loss': '0.1695', 'grad_norm': '2.736', 'learning_rate': '1.739e-05', 'epoch': '0.2581'}
+
 26%|██▌       | 9800/37963 [24:09:54<67:24:56,  8.62s/it]
 26%|██▌       | 9801/37963 [24:10:01<64:22:43,  8.23s/it]
 26%|██▌       | 9802/37963 [24:10:09<62:30:48,  7.99s/it]
 26%|██▌       | 9803/37963 [24:10:16<61:36:18,  7.88s/it]
 26%|██▌       | 9804/37963 [24:10:24<61:03:10,  7.81s/it]
 26%|██▌       | 9805/37963 [24:10:32<60:46:14,  7.77s/it]
 26%|██▌       | 9806/37963 [24:10:46<75:25:16,  9.64s/it]
 26%|██▌       | 9807/37963 [24:10:54<71:05:15,  9.09s/it]
 26%|██▌       | 9808/37963 [24:11:01<67:50:01,  8.67s/it]
 26%|██▌       | 9809/37963 [24:11:16<81:50:25, 10.46s/it]
 26%|██▌       | 9810/37963 [24:11:24<75:49:26,  9.70s/it]
                                                          
{'loss': '0.1618', 'grad_norm': '3.262', 'learning_rate': '1.739e-05', 'epoch': '0.2584'}
+
 26%|██▌       | 9810/37963 [24:11:24<75:49:26,  9.70s/it]
 26%|██▌       | 9811/37963 [24:11:31<70:24:31,  9.00s/it]
 26%|██▌       | 9812/37963 [24:11:39<67:16:32,  8.60s/it]
 26%|██▌       | 9813/37963 [24:11:46<64:49:32,  8.29s/it]
 26%|██▌       | 9814/37963 [24:11:54<63:12:07,  8.08s/it]
 26%|██▌       | 9815/37963 [24:12:02<62:08:52,  7.95s/it]
 26%|██▌       | 9816/37963 [24:12:09<61:00:20,  7.80s/it]
 26%|██▌       | 9817/37963 [24:12:24<78:00:10,  9.98s/it]
 26%|██▌       | 9818/37963 [24:12:32<72:41:14,  9.30s/it]
 26%|██▌       | 9819/37963 [24:12:40<68:56:38,  8.82s/it]
 26%|██▌       | 9820/37963 [24:12:47<66:26:49,  8.50s/it]
                                                          
{'loss': '0.1541', 'grad_norm': '3.219', 'learning_rate': '1.738e-05', 'epoch': '0.2587'}
+
 26%|██▌       | 9820/37963 [24:12:47<66:26:49,  8.50s/it]
 26%|██▌       | 9821/37963 [24:12:55<64:05:29,  8.20s/it]
 26%|██▌       | 9822/37963 [24:13:09<78:33:29, 10.05s/it]
 26%|██▌       | 9823/37963 [24:13:17<72:51:22,  9.32s/it]
 26%|██▌       | 9824/37963 [24:13:25<68:59:16,  8.83s/it]
 26%|██▌       | 9825/37963 [24:13:45<97:22:09, 12.46s/it]
 26%|██▌       | 9826/37963 [24:14:00<102:44:02, 13.14s/it]
 26%|██▌       | 9827/37963 [24:14:08<90:00:00, 11.52s/it] 
 26%|██▌       | 9828/37963 [24:14:16<80:49:38, 10.34s/it]
 26%|██▌       | 9829/37963 [24:14:23<74:34:26,  9.54s/it]
 26%|██▌       | 9830/37963 [24:14:31<70:01:29,  8.96s/it]
                                                          
{'loss': '0.1649', 'grad_norm': '1.663', 'learning_rate': '1.738e-05', 'epoch': '0.2589'}
+
 26%|██▌       | 9830/37963 [24:14:31<70:01:29,  8.96s/it]
 26%|██▌       | 9831/37963 [24:14:38<66:56:27,  8.57s/it]
 26%|██▌       | 9832/37963 [24:14:46<64:09:54,  8.21s/it]
 26%|██▌       | 9833/37963 [24:14:53<62:51:43,  8.04s/it]
 26%|██▌       | 9834/37963 [24:15:01<61:58:43,  7.93s/it]
 26%|██▌       | 9835/37963 [24:15:08<60:19:37,  7.72s/it]
 26%|██▌       | 9836/37963 [24:15:16<60:10:07,  7.70s/it]
 26%|██▌       | 9837/37963 [24:15:24<60:15:15,  7.71s/it]
 26%|██▌       | 9838/37963 [24:15:31<60:00:28,  7.68s/it]
 26%|██▌       | 9839/37963 [24:15:39<59:46:34,  7.65s/it]
 26%|██▌       | 9840/37963 [24:15:46<59:25:13,  7.61s/it]
                                                          
{'loss': '0.1564', 'grad_norm': '1.588', 'learning_rate': '1.737e-05', 'epoch': '0.2592'}
+
 26%|██▌       | 9840/37963 [24:15:46<59:25:13,  7.61s/it]
 26%|██▌       | 9841/37963 [24:15:54<59:34:36,  7.63s/it]
 26%|██▌       | 9842/37963 [24:16:09<75:57:15,  9.72s/it]
 26%|██▌       | 9843/37963 [24:16:16<71:06:07,  9.10s/it]
 26%|██▌       | 9844/37963 [24:16:24<67:56:52,  8.70s/it]
 26%|██▌       | 9845/37963 [24:16:32<65:20:53,  8.37s/it]
 26%|██▌       | 9846/37963 [24:16:40<64:06:42,  8.21s/it]
 26%|██▌       | 9847/37963 [24:16:47<62:52:02,  8.05s/it]
 26%|██▌       | 9848/37963 [24:16:55<62:31:25,  8.01s/it]
 26%|██▌       | 9849/37963 [24:17:03<61:42:40,  7.90s/it]
 26%|██▌       | 9850/37963 [24:17:11<61:15:01,  7.84s/it]
                                                          
{'loss': '0.1582', 'grad_norm': '2.293', 'learning_rate': '1.736e-05', 'epoch': '0.2595'}
+
 26%|██▌       | 9850/37963 [24:17:11<61:15:01,  7.84s/it]
 26%|██▌       | 9851/37963 [24:17:18<60:59:20,  7.81s/it]
 26%|██▌       | 9852/37963 [24:17:26<60:42:30,  7.77s/it]
 26%|██▌       | 9853/37963 [24:17:33<60:00:24,  7.68s/it]
 26%|██▌       | 9854/37963 [24:17:41<59:48:46,  7.66s/it]
 26%|██▌       | 9855/37963 [24:17:56<77:18:20,  9.90s/it]
 26%|██▌       | 9856/37963 [24:18:11<88:19:44, 11.31s/it]
 26%|██▌       | 9857/37963 [24:18:19<80:07:23, 10.26s/it]
 26%|██▌       | 9858/37963 [24:18:26<74:01:49,  9.48s/it]
 26%|██▌       | 9859/37963 [24:18:34<69:47:51,  8.94s/it]
 26%|██▌       | 9860/37963 [24:18:41<66:09:23,  8.47s/it]
                                                          
{'loss': '0.1569', 'grad_norm': '2.709', 'learning_rate': '1.736e-05', 'epoch': '0.2597'}
+
 26%|██▌       | 9860/37963 [24:18:41<66:09:23,  8.47s/it]
 26%|██▌       | 9861/37963 [24:18:49<64:39:13,  8.28s/it]
 26%|██▌       | 9862/37963 [24:18:57<63:17:04,  8.11s/it]
 26%|██▌       | 9863/37963 [24:19:04<62:05:07,  7.95s/it]
 26%|██▌       | 9864/37963 [24:19:19<78:05:04, 10.00s/it]
 26%|██▌       | 9865/37963 [24:19:27<72:44:30,  9.32s/it]
 26%|██▌       | 9866/37963 [24:19:41<83:31:01, 10.70s/it]
 26%|██▌       | 9867/37963 [24:19:49<76:21:58,  9.78s/it]
 26%|██▌       | 9868/37963 [24:19:56<71:33:22,  9.17s/it]
 26%|██▌       | 9869/37963 [24:20:04<68:08:28,  8.73s/it]
 26%|██▌       | 9870/37963 [24:20:19<81:45:02, 10.48s/it]
                                                          
{'loss': '0.1686', 'grad_norm': '1.593', 'learning_rate': '1.735e-05', 'epoch': '0.26'}
+
 26%|██▌       | 9870/37963 [24:20:19<81:45:02, 10.48s/it]
 26%|██▌       | 9871/37963 [24:20:26<75:39:51,  9.70s/it]
 26%|██▌       | 9872/37963 [24:20:34<71:00:09,  9.10s/it]
 26%|██▌       | 9873/37963 [24:20:49<84:17:06, 10.80s/it]
 26%|██▌       | 9874/37963 [24:20:56<76:45:00,  9.84s/it]
 26%|██▌       | 9875/37963 [24:21:11<86:55:23, 11.14s/it]
 26%|██▌       | 9876/37963 [24:21:18<78:50:26, 10.11s/it]
 26%|██▌       | 9877/37963 [24:21:26<73:27:34,  9.42s/it]
 26%|██▌       | 9878/37963 [24:21:34<69:17:42,  8.88s/it]
 26%|██▌       | 9879/37963 [24:21:41<66:26:44,  8.52s/it]
 26%|██▌       | 9880/37963 [24:21:49<64:20:30,  8.25s/it]
                                                          
{'loss': '0.1791', 'grad_norm': '1.062', 'learning_rate': '1.735e-05', 'epoch': '0.2603'}
+
 26%|██▌       | 9880/37963 [24:21:49<64:20:30,  8.25s/it]
 26%|██▌       | 9881/37963 [24:21:57<62:50:03,  8.06s/it]
 26%|██▌       | 9882/37963 [24:22:04<61:53:35,  7.93s/it]
 26%|██▌       | 9883/37963 [24:22:12<61:09:02,  7.84s/it]
 26%|██▌       | 9884/37963 [24:22:20<60:45:27,  7.79s/it]
 26%|██▌       | 9885/37963 [24:22:27<60:24:56,  7.75s/it]
 26%|██▌       | 9886/37963 [24:22:35<59:34:36,  7.64s/it]
 26%|██▌       | 9887/37963 [24:22:42<59:32:45,  7.64s/it]
 26%|██▌       | 9888/37963 [24:22:50<59:39:54,  7.65s/it]
 26%|██▌       | 9889/37963 [24:22:57<59:24:56,  7.62s/it]
 26%|██▌       | 9890/37963 [24:23:12<75:52:45,  9.73s/it]
                                                          
{'loss': '0.1638', 'grad_norm': '1.052', 'learning_rate': '1.734e-05', 'epoch': '0.2605'}
+
 26%|██▌       | 9890/37963 [24:23:12<75:52:45,  9.73s/it]
 26%|██▌       | 9891/37963 [24:23:20<71:04:56,  9.12s/it]
 26%|██▌       | 9892/37963 [24:23:27<67:25:56,  8.65s/it]
 26%|██▌       | 9893/37963 [24:23:35<65:07:10,  8.35s/it]
 26%|██▌       | 9894/37963 [24:23:43<63:12:37,  8.11s/it]
 26%|██▌       | 9895/37963 [24:23:50<62:04:11,  7.96s/it]
 26%|██▌       | 9896/37963 [24:23:58<61:28:56,  7.89s/it]
 26%|██▌       | 9897/37963 [24:24:06<61:00:27,  7.83s/it]
 26%|██▌       | 9898/37963 [24:24:13<60:37:40,  7.78s/it]
 26%|██▌       | 9899/37963 [24:24:21<60:30:32,  7.76s/it]
 26%|██▌       | 9900/37963 [24:24:35<75:03:55,  9.63s/it]
                                                          
{'loss': '0.1767', 'grad_norm': '2.518', 'learning_rate': '1.733e-05', 'epoch': '0.2608'}
+
 26%|██▌       | 9900/37963 [24:24:35<75:03:55,  9.63s/it]
 26%|██▌       | 9901/37963 [24:24:43<70:43:05,  9.07s/it]
 26%|██▌       | 9902/37963 [24:24:57<83:07:31, 10.66s/it]
 26%|██▌       | 9903/37963 [24:25:05<76:08:58,  9.77s/it]
 26%|██▌       | 9904/37963 [24:25:12<70:43:54,  9.07s/it]
 26%|██▌       | 9905/37963 [24:25:20<67:28:50,  8.66s/it]
 26%|██▌       | 9906/37963 [24:25:28<65:06:39,  8.35s/it]
 26%|██▌       | 9907/37963 [24:25:35<63:12:43,  8.11s/it]
 26%|██▌       | 9908/37963 [24:25:43<62:04:36,  7.97s/it]
 26%|██▌       | 9909/37963 [24:25:51<61:52:23,  7.94s/it]
 26%|██▌       | 9910/37963 [24:25:58<60:59:28,  7.83s/it]
                                                          
{'loss': '0.17', 'grad_norm': '2.317', 'learning_rate': '1.733e-05', 'epoch': '0.261'}
+
 26%|██▌       | 9910/37963 [24:25:58<60:59:28,  7.83s/it]
 26%|██▌       | 9911/37963 [24:26:06<60:30:01,  7.76s/it]
 26%|██▌       | 9912/37963 [24:26:14<60:16:38,  7.74s/it]
 26%|██▌       | 9913/37963 [24:26:21<60:03:14,  7.71s/it]
 26%|██▌       | 9914/37963 [24:26:29<59:57:21,  7.70s/it]
 26%|██▌       | 9915/37963 [24:26:36<59:09:28,  7.59s/it]
 26%|██▌       | 9916/37963 [24:26:51<75:09:47,  9.65s/it]
 26%|██▌       | 9917/37963 [24:26:58<70:36:01,  9.06s/it]
 26%|██▌       | 9918/37963 [24:27:13<84:33:22, 10.85s/it]
 26%|██▌       | 9919/37963 [24:27:21<77:13:53,  9.91s/it]
 26%|██▌       | 9920/37963 [24:27:35<86:45:19, 11.14s/it]
                                                          
{'loss': '0.1602', 'grad_norm': '1.452', 'learning_rate': '1.732e-05', 'epoch': '0.2613'}
+
 26%|██▌       | 9920/37963 [24:27:35<86:45:19, 11.14s/it]
 26%|██▌       | 9921/37963 [24:27:42<77:42:01,  9.98s/it]
 26%|██▌       | 9922/37963 [24:27:56<87:29:08, 11.23s/it]
 26%|██▌       | 9923/37963 [24:28:10<93:58:37, 12.07s/it]
 26%|██▌       | 9924/37963 [24:28:18<83:48:44, 10.76s/it]
 26%|██▌       | 9925/37963 [24:28:25<75:29:45,  9.69s/it]
 26%|██▌       | 9926/37963 [24:28:33<70:41:28,  9.08s/it]
 26%|██▌       | 9927/37963 [24:28:40<66:51:10,  8.58s/it]
 26%|██▌       | 9928/37963 [24:28:48<64:07:32,  8.23s/it]
 26%|██▌       | 9929/37963 [24:28:55<62:36:13,  8.04s/it]
 26%|██▌       | 9930/37963 [24:29:03<61:24:52,  7.89s/it]
                                                          
{'loss': '0.1841', 'grad_norm': '1.43', 'learning_rate': '1.732e-05', 'epoch': '0.2616'}
+
 26%|██▌       | 9930/37963 [24:29:03<61:24:52,  7.89s/it]
 26%|██▌       | 9931/37963 [24:29:11<60:41:56,  7.80s/it]
 26%|██▌       | 9932/37963 [24:29:18<60:30:47,  7.77s/it]
 26%|██▌       | 9933/37963 [24:29:26<60:20:04,  7.75s/it]
 26%|██▌       | 9934/37963 [24:29:34<60:07:24,  7.72s/it]
 26%|██▌       | 9935/37963 [24:29:49<77:03:48,  9.90s/it]
 26%|██▌       | 9936/37963 [24:29:56<71:19:25,  9.16s/it]
 26%|██▌       | 9937/37963 [24:30:04<68:19:46,  8.78s/it]
 26%|██▌       | 9938/37963 [24:30:12<65:37:00,  8.43s/it]
 26%|██▌       | 9939/37963 [24:30:19<63:58:28,  8.22s/it]
 26%|██▌       | 9940/37963 [24:30:27<62:26:50,  8.02s/it]
                                                          
{'loss': '0.1555', 'grad_norm': '1.166', 'learning_rate': '1.731e-05', 'epoch': '0.2618'}
+
 26%|██▌       | 9940/37963 [24:30:27<62:26:50,  8.02s/it]
 26%|██▌       | 9941/37963 [24:30:34<61:21:57,  7.88s/it]
 26%|██▌       | 9942/37963 [24:30:42<60:37:43,  7.79s/it]
 26%|██▌       | 9943/37963 [24:30:50<60:09:48,  7.73s/it]
 26%|██▌       | 9944/37963 [24:30:57<59:57:21,  7.70s/it]
 26%|██▌       | 9945/37963 [24:31:05<60:02:56,  7.72s/it]
 26%|██▌       | 9946/37963 [24:31:20<77:12:56,  9.92s/it]
 26%|██▌       | 9947/37963 [24:31:28<71:49:08,  9.23s/it]
 26%|██▌       | 9948/37963 [24:31:35<68:05:11,  8.75s/it]
 26%|██▌       | 9949/37963 [24:31:43<65:42:18,  8.44s/it]
 26%|██▌       | 9950/37963 [24:31:50<63:14:26,  8.13s/it]
                                                          
{'loss': '0.1674', 'grad_norm': '3.079', 'learning_rate': '1.731e-05', 'epoch': '0.2621'}
+
 26%|██▌       | 9950/37963 [24:31:50<63:14:26,  8.13s/it]
 26%|██▌       | 9951/37963 [24:32:04<76:57:38,  9.89s/it]
 26%|██▌       | 9952/37963 [24:32:12<71:52:12,  9.24s/it]
 26%|██▌       | 9953/37963 [24:32:20<67:37:46,  8.69s/it]
 26%|██▌       | 9954/37963 [24:32:27<65:04:55,  8.37s/it]
 26%|██▌       | 9955/37963 [24:32:35<63:20:27,  8.14s/it]
 26%|██▌       | 9956/37963 [24:32:42<61:46:41,  7.94s/it]
 26%|██▌       | 9957/37963 [24:32:50<61:25:07,  7.89s/it]
 26%|██▌       | 9958/37963 [24:32:58<60:50:16,  7.82s/it]
 26%|██▌       | 9959/37963 [24:33:05<60:27:54,  7.77s/it]
 26%|██▌       | 9960/37963 [24:33:13<60:02:42,  7.72s/it]
                                                          
{'loss': '0.1592', 'grad_norm': '2.129', 'learning_rate': '1.73e-05', 'epoch': '0.2624'}
+
 26%|██▌       | 9960/37963 [24:33:13<60:02:42,  7.72s/it]
 26%|██▌       | 9961/37963 [24:33:21<59:59:48,  7.71s/it]
 26%|██▌       | 9962/37963 [24:33:28<60:02:14,  7.72s/it]
 26%|██▌       | 9963/37963 [24:33:36<59:49:40,  7.69s/it]
 26%|██▌       | 9964/37963 [24:33:44<59:45:07,  7.68s/it]
 26%|██▌       | 9965/37963 [24:33:51<59:40:42,  7.67s/it]
 26%|██▋       | 9966/37963 [24:33:59<59:19:12,  7.63s/it]
 26%|██▋       | 9967/37963 [24:34:06<59:14:26,  7.62s/it]
 26%|██▋       | 9968/37963 [24:34:14<58:56:59,  7.58s/it]
 26%|██▋       | 9969/37963 [24:34:22<59:14:26,  7.62s/it]
 26%|██▋       | 9970/37963 [24:34:43<90:26:45, 11.63s/it]
                                                          
{'loss': '0.1497', 'grad_norm': '1.257', 'learning_rate': '1.729e-05', 'epoch': '0.2626'}
+
 26%|██▋       | 9970/37963 [24:34:43<90:26:45, 11.63s/it]
 26%|██▋       | 9971/37963 [24:34:50<81:14:48, 10.45s/it]
 26%|██▋       | 9972/37963 [24:35:11<106:10:15, 13.65s/it]
 26%|██▋       | 9973/37963 [24:35:19<92:28:25, 11.89s/it] 
 26%|██▋       | 9974/37963 [24:35:34<98:12:48, 12.63s/it]
 26%|██▋       | 9975/37963 [24:35:41<86:43:08, 11.15s/it]
 26%|██▋       | 9976/37963 [24:35:49<78:42:16, 10.12s/it]
 26%|██▋       | 9977/37963 [24:35:56<72:08:41,  9.28s/it]
 26%|██▋       | 9978/37963 [24:36:04<68:39:50,  8.83s/it]
 26%|██▋       | 9979/37963 [24:36:12<65:50:52,  8.47s/it]
 26%|██▋       | 9980/37963 [24:36:19<63:54:31,  8.22s/it]
                                                          
{'loss': '0.1574', 'grad_norm': '1.569', 'learning_rate': '1.729e-05', 'epoch': '0.2629'}
+
 26%|██▋       | 9980/37963 [24:36:19<63:54:31,  8.22s/it]
 26%|██▋       | 9981/37963 [24:36:27<62:31:21,  8.04s/it]
 26%|██▋       | 9982/37963 [24:36:34<60:41:18,  7.81s/it]
 26%|██▋       | 9983/37963 [24:36:49<77:26:44,  9.96s/it]
 26%|██▋       | 9984/37963 [24:36:57<71:55:59,  9.26s/it]
 26%|██▋       | 9985/37963 [24:37:05<68:28:25,  8.81s/it]
 26%|██▋       | 9986/37963 [24:37:12<65:48:00,  8.47s/it]
 26%|██▋       | 9987/37963 [24:37:20<63:59:57,  8.24s/it]
 26%|██▋       | 9988/37963 [24:37:28<63:18:00,  8.15s/it]
 26%|██▋       | 9989/37963 [24:37:36<62:19:39,  8.02s/it]
 26%|██▋       | 9990/37963 [24:37:43<61:14:02,  7.88s/it]
                                                          
{'loss': '0.173', 'grad_norm': '4.341', 'learning_rate': '1.728e-05', 'epoch': '0.2632'}
+
 26%|██▋       | 9990/37963 [24:37:43<61:14:02,  7.88s/it]
 26%|██▋       | 9991/37963 [24:37:51<60:50:32,  7.83s/it]
 26%|██▋       | 9992/37963 [24:37:58<60:06:07,  7.74s/it]
 26%|██▋       | 9993/37963 [24:38:06<59:52:11,  7.71s/it]
 26%|██▋       | 9994/37963 [24:38:21<76:40:15,  9.87s/it]
 26%|██▋       | 9995/37963 [24:38:29<71:46:20,  9.24s/it]
 26%|██▋       | 9996/37963 [24:38:43<83:27:53, 10.74s/it]
 26%|██▋       | 9997/37963 [24:38:51<76:29:54,  9.85s/it]
 26%|██▋       | 9998/37963 [24:38:58<71:18:37,  9.18s/it]
 26%|██▋       | 9999/37963 [24:39:06<67:10:30,  8.65s/it]
 26%|██▋       | 10000/37963 [24:39:13<63:58:43,  8.24s/it]
                                                           
{'loss': '0.1802', 'grad_norm': '9.762', 'learning_rate': '1.728e-05', 'epoch': '0.2634'}
+
 26%|██▋       | 10000/37963 [24:39:13<63:58:43,  8.24s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.56s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.56s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 26%|██▋       | 10001/37963 [24:40:08<173:46:10, 22.37s/it]
 26%|██▋       | 10002/37963 [24:40:16<138:57:33, 17.89s/it]
 26%|██▋       | 10003/37963 [24:40:24<115:14:18, 14.84s/it]
 26%|██▋       | 10004/37963 [24:40:31<98:30:32, 12.68s/it] 
 26%|██▋       | 10005/37963 [24:40:39<87:05:32, 11.21s/it]
 26%|██▋       | 10006/37963 [24:40:47<79:12:49, 10.20s/it]
 26%|██▋       | 10007/37963 [24:40:55<73:36:11,  9.48s/it]
 26%|██▋       | 10008/37963 [24:41:02<69:36:22,  8.96s/it]
 26%|██▋       | 10009/37963 [24:41:10<66:30:42,  8.57s/it]
 26%|██▋       | 10010/37963 [24:41:18<64:05:22,  8.25s/it]
                                                           
{'loss': '0.1822', 'grad_norm': '2.77', 'learning_rate': '1.727e-05', 'epoch': '0.2637'}
+
 26%|██▋       | 10010/37963 [24:41:18<64:05:22,  8.25s/it]
 26%|██▋       | 10011/37963 [24:41:25<62:13:14,  8.01s/it]
 26%|██▋       | 10012/37963 [24:41:33<61:23:12,  7.91s/it]
 26%|██▋       | 10013/37963 [24:41:40<60:43:34,  7.82s/it]
 26%|██▋       | 10014/37963 [24:41:48<60:24:17,  7.78s/it]
 26%|██▋       | 10015/37963 [24:41:55<59:26:22,  7.66s/it]
 26%|██▋       | 10016/37963 [24:42:03<59:42:19,  7.69s/it]
 26%|██▋       | 10017/37963 [24:42:11<59:12:00,  7.63s/it]
 26%|██▋       | 10018/37963 [24:42:26<76:16:07,  9.83s/it]
 26%|██▋       | 10019/37963 [24:42:40<86:21:35, 11.13s/it]
 26%|██▋       | 10020/37963 [24:42:47<77:59:30, 10.05s/it]
                                                           
{'loss': '0.1665', 'grad_norm': '1.692', 'learning_rate': '1.726e-05', 'epoch': '0.2639'}
+
 26%|██▋       | 10020/37963 [24:42:47<77:59:30, 10.05s/it]
 26%|██▋       | 10021/37963 [24:43:02<88:20:08, 11.38s/it]
 26%|██▋       | 10022/37963 [24:43:09<79:38:42, 10.26s/it]
 26%|██▋       | 10023/37963 [24:43:23<88:25:28, 11.39s/it]
 26%|██▋       | 10024/37963 [24:43:38<95:06:18, 12.25s/it]
 26%|██▋       | 10025/37963 [24:43:45<84:22:26, 10.87s/it]
 26%|██▋       | 10026/37963 [24:43:53<77:02:08,  9.93s/it]
 26%|██▋       | 10027/37963 [24:44:08<87:40:26, 11.30s/it]
 26%|██▋       | 10028/37963 [24:44:15<79:14:29, 10.21s/it]
 26%|██▋       | 10029/37963 [24:44:23<73:17:18,  9.45s/it]
 26%|██▋       | 10030/37963 [24:44:31<69:00:50,  8.89s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '0.8887', 'learning_rate': '1.726e-05', 'epoch': '0.2642'}
+
 26%|██▋       | 10030/37963 [24:44:31<69:00:50,  8.89s/it]
 26%|██▋       | 10031/37963 [24:44:38<65:50:43,  8.49s/it]
 26%|██▋       | 10032/37963 [24:44:46<63:52:44,  8.23s/it]
 26%|██▋       | 10033/37963 [24:44:53<62:20:32,  8.04s/it]
 26%|██▋       | 10034/37963 [24:45:01<61:37:08,  7.94s/it]
 26%|██▋       | 10035/37963 [24:45:09<61:06:03,  7.88s/it]
 26%|██▋       | 10036/37963 [24:45:16<60:34:12,  7.81s/it]
 26%|██▋       | 10037/37963 [24:45:24<59:44:47,  7.70s/it]
 26%|██▋       | 10038/37963 [24:45:31<59:31:05,  7.67s/it]
 26%|██▋       | 10039/37963 [24:45:39<59:13:13,  7.63s/it]
 26%|██▋       | 10040/37963 [24:45:47<59:17:12,  7.64s/it]
                                                           
{'loss': '0.1791', 'grad_norm': '2.055', 'learning_rate': '1.725e-05', 'epoch': '0.2645'}
+
 26%|██▋       | 10040/37963 [24:45:47<59:17:12,  7.64s/it]
 26%|██▋       | 10041/37963 [24:45:54<59:23:44,  7.66s/it]
 26%|██▋       | 10042/37963 [24:46:09<74:51:14,  9.65s/it]
 26%|██▋       | 10043/37963 [24:46:23<86:40:05, 11.17s/it]
 26%|██▋       | 10044/37963 [24:46:31<78:11:50, 10.08s/it]
 26%|██▋       | 10045/37963 [24:46:38<71:49:58,  9.26s/it]
 26%|██▋       | 10046/37963 [24:46:45<67:07:38,  8.66s/it]
 26%|██▋       | 10047/37963 [24:46:53<64:46:18,  8.35s/it]
 26%|██▋       | 10048/37963 [24:47:01<62:33:06,  8.07s/it]
 26%|██▋       | 10049/37963 [24:47:08<61:37:12,  7.95s/it]
 26%|██▋       | 10050/37963 [24:47:16<60:57:07,  7.86s/it]
                                                           
{'loss': '0.1753', 'grad_norm': '1.692', 'learning_rate': '1.725e-05', 'epoch': '0.2647'}
+
 26%|██▋       | 10050/37963 [24:47:16<60:57:07,  7.86s/it]
 26%|██▋       | 10051/37963 [24:47:24<60:33:03,  7.81s/it]
 26%|██▋       | 10052/37963 [24:47:31<60:12:31,  7.77s/it]
 26%|██▋       | 10053/37963 [24:47:39<60:05:06,  7.75s/it]
 26%|██▋       | 10054/37963 [24:47:46<59:28:01,  7.67s/it]
 26%|██▋       | 10055/37963 [24:47:54<59:28:17,  7.67s/it]
 26%|██▋       | 10056/37963 [24:48:02<59:45:57,  7.71s/it]
 26%|██▋       | 10057/37963 [24:48:10<59:39:06,  7.70s/it]
 26%|██▋       | 10058/37963 [24:48:17<59:41:44,  7.70s/it]
 26%|██▋       | 10059/37963 [24:48:25<59:32:34,  7.68s/it]
 26%|██▋       | 10060/37963 [24:48:33<59:25:11,  7.67s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '0.8662', 'learning_rate': '1.724e-05', 'epoch': '0.265'}
+
 26%|██▋       | 10060/37963 [24:48:33<59:25:11,  7.67s/it]
 27%|██▋       | 10061/37963 [24:48:40<59:16:21,  7.65s/it]
 27%|██▋       | 10062/37963 [24:48:48<59:40:37,  7.70s/it]
 27%|██▋       | 10063/37963 [24:49:03<76:48:29,  9.91s/it]
 27%|██▋       | 10064/37963 [24:49:10<70:49:13,  9.14s/it]
 27%|██▋       | 10065/37963 [24:49:18<67:21:05,  8.69s/it]
 27%|██▋       | 10066/37963 [24:49:26<64:52:51,  8.37s/it]
 27%|██▋       | 10067/37963 [24:49:47<94:35:40, 12.21s/it]
 27%|██▋       | 10068/37963 [24:49:55<84:13:06, 10.87s/it]
 27%|██▋       | 10069/37963 [24:50:02<76:43:52,  9.90s/it]
 27%|██▋       | 10070/37963 [24:50:10<71:22:12,  9.21s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '1.349', 'learning_rate': '1.724e-05', 'epoch': '0.2653'}
+
 27%|██▋       | 10070/37963 [24:50:10<71:22:12,  9.21s/it]
 27%|██▋       | 10071/37963 [24:50:24<83:04:04, 10.72s/it]
 27%|██▋       | 10072/37963 [24:50:38<90:58:45, 11.74s/it]
 27%|██▋       | 10073/37963 [24:50:46<81:19:14, 10.50s/it]
 27%|██▋       | 10074/37963 [24:50:53<73:59:13,  9.55s/it]
 27%|██▋       | 10075/37963 [24:51:08<86:33:52, 11.17s/it]
 27%|██▋       | 10076/37963 [24:51:16<78:44:05, 10.16s/it]
 27%|██▋       | 10077/37963 [24:51:23<72:49:18,  9.40s/it]
 27%|██▋       | 10078/37963 [24:51:31<68:45:24,  8.88s/it]
 27%|██▋       | 10079/37963 [24:51:39<65:59:43,  8.52s/it]
 27%|██▋       | 10080/37963 [24:51:46<63:44:11,  8.23s/it]
                                                           
{'loss': '0.1803', 'grad_norm': '2.498', 'learning_rate': '1.723e-05', 'epoch': '0.2655'}
+
 27%|██▋       | 10080/37963 [24:51:46<63:44:11,  8.23s/it]
 27%|██▋       | 10081/37963 [24:51:54<62:24:18,  8.06s/it]
 27%|██▋       | 10082/37963 [24:52:02<61:27:07,  7.93s/it]
 27%|██▋       | 10083/37963 [24:52:09<60:47:18,  7.85s/it]
 27%|██▋       | 10084/37963 [24:52:17<59:47:33,  7.72s/it]
 27%|██▋       | 10085/37963 [24:52:24<59:47:43,  7.72s/it]
 27%|██▋       | 10086/37963 [24:52:32<59:35:30,  7.70s/it]
 27%|██▋       | 10087/37963 [24:52:40<59:46:18,  7.72s/it]
 27%|██▋       | 10088/37963 [24:52:47<59:24:23,  7.67s/it]
 27%|██▋       | 10089/37963 [24:52:55<59:16:52,  7.66s/it]
 27%|██▋       | 10090/37963 [24:53:10<75:10:46,  9.71s/it]
                                                           
{'loss': '0.1648', 'grad_norm': '3.786', 'learning_rate': '1.722e-05', 'epoch': '0.2658'}
+
 27%|██▋       | 10090/37963 [24:53:10<75:10:46,  9.71s/it]
 27%|██▋       | 10091/37963 [24:53:17<70:26:15,  9.10s/it]
 27%|██▋       | 10092/37963 [24:53:25<67:01:12,  8.66s/it]
 27%|██▋       | 10093/37963 [24:53:39<79:33:08, 10.28s/it]
 27%|██▋       | 10094/37963 [24:53:46<73:12:44,  9.46s/it]
 27%|██▋       | 10095/37963 [24:53:54<69:09:01,  8.93s/it]
 27%|██▋       | 10096/37963 [24:54:02<65:59:09,  8.52s/it]
 27%|██▋       | 10097/37963 [24:54:09<63:54:04,  8.26s/it]
 27%|██▋       | 10098/37963 [24:54:17<62:39:45,  8.10s/it]
 27%|██▋       | 10099/37963 [24:54:25<61:35:17,  7.96s/it]
 27%|██▋       | 10100/37963 [24:54:32<60:58:17,  7.88s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '0.8248', 'learning_rate': '1.722e-05', 'epoch': '0.266'}
+
 27%|██▋       | 10100/37963 [24:54:32<60:58:17,  7.88s/it]
 27%|██▋       | 10101/37963 [24:54:40<60:29:00,  7.81s/it]
 27%|██▋       | 10102/37963 [24:54:48<59:48:53,  7.73s/it]
 27%|██▋       | 10103/37963 [24:54:55<59:40:39,  7.71s/it]
 27%|██▋       | 10104/37963 [24:55:03<59:25:03,  7.68s/it]
 27%|██▋       | 10105/37963 [24:55:10<58:51:24,  7.61s/it]
 27%|██▋       | 10106/37963 [24:55:18<59:28:49,  7.69s/it]
 27%|██▋       | 10107/37963 [24:55:26<59:30:49,  7.69s/it]
 27%|██▋       | 10108/37963 [24:55:34<59:34:28,  7.70s/it]
 27%|██▋       | 10109/37963 [24:55:41<59:25:37,  7.68s/it]
 27%|██▋       | 10110/37963 [24:55:49<59:23:47,  7.68s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '2.729', 'learning_rate': '1.721e-05', 'epoch': '0.2663'}
+
 27%|██▋       | 10110/37963 [24:55:49<59:23:47,  7.68s/it]
 27%|██▋       | 10111/37963 [24:55:57<59:19:54,  7.67s/it]
 27%|██▋       | 10112/37963 [24:56:04<59:24:01,  7.68s/it]
 27%|██▋       | 10113/37963 [24:56:12<59:23:18,  7.68s/it]
 27%|██▋       | 10114/37963 [24:56:20<59:33:30,  7.70s/it]
 27%|██▋       | 10115/37963 [24:56:35<76:16:41,  9.86s/it]
 27%|██▋       | 10116/37963 [24:56:42<71:04:40,  9.19s/it]
 27%|██▋       | 10117/37963 [24:56:57<83:57:48, 10.85s/it]
 27%|██▋       | 10118/37963 [24:57:05<76:25:54,  9.88s/it]
 27%|██▋       | 10119/37963 [24:57:12<71:07:23,  9.20s/it]
 27%|██▋       | 10120/37963 [24:57:33<98:15:43, 12.70s/it]
                                                           
{'loss': '0.1703', 'grad_norm': '1.538', 'learning_rate': '1.721e-05', 'epoch': '0.2666'}
+
 27%|██▋       | 10120/37963 [24:57:33<98:15:43, 12.70s/it]
 27%|██▋       | 10121/37963 [24:57:54<117:16:56, 15.16s/it]
 27%|██▋       | 10122/37963 [24:58:01<99:33:32, 12.87s/it] 
 27%|██▋       | 10123/37963 [24:58:09<87:23:52, 11.30s/it]
 27%|██▋       | 10124/37963 [24:58:17<78:51:58, 10.20s/it]
 27%|██▋       | 10125/37963 [24:58:24<73:02:28,  9.45s/it]
 27%|██▋       | 10126/37963 [24:58:32<68:54:01,  8.91s/it]
 27%|██▋       | 10127/37963 [24:58:40<66:01:49,  8.54s/it]
 27%|██▋       | 10128/37963 [24:58:48<64:09:11,  8.30s/it]
 27%|██▋       | 10129/37963 [24:58:55<62:48:16,  8.12s/it]
 27%|██▋       | 10130/37963 [24:59:03<61:38:14,  7.97s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '3.01', 'learning_rate': '1.72e-05', 'epoch': '0.2668'}
+
 27%|██▋       | 10130/37963 [24:59:03<61:38:14,  7.97s/it]
 27%|██▋       | 10131/37963 [24:59:10<60:52:12,  7.87s/it]
 27%|██▋       | 10132/37963 [24:59:18<60:37:51,  7.84s/it]
 27%|██▋       | 10133/37963 [24:59:26<60:09:31,  7.78s/it]
 27%|██▋       | 10134/37963 [24:59:34<60:09:08,  7.78s/it]
 27%|██▋       | 10135/37963 [24:59:41<59:22:24,  7.68s/it]
 27%|██▋       | 10136/37963 [24:59:49<58:46:08,  7.60s/it]
 27%|██▋       | 10137/37963 [24:59:56<58:59:49,  7.63s/it]
 27%|██▋       | 10138/37963 [25:00:04<58:58:53,  7.63s/it]
 27%|██▋       | 10139/37963 [25:00:12<59:02:40,  7.64s/it]
 27%|██▋       | 10140/37963 [25:00:19<59:16:04,  7.67s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '3.444', 'learning_rate': '1.719e-05', 'epoch': '0.2671'}
+
 27%|██▋       | 10140/37963 [25:00:19<59:16:04,  7.67s/it]
 27%|██▋       | 10141/37963 [25:00:27<59:13:07,  7.66s/it]
 27%|██▋       | 10142/37963 [25:00:35<59:20:37,  7.68s/it]
 27%|██▋       | 10143/37963 [25:00:42<58:54:05,  7.62s/it]
 27%|██▋       | 10144/37963 [25:01:04<90:53:48, 11.76s/it]
 27%|██▋       | 10145/37963 [25:01:11<81:34:14, 10.56s/it]
 27%|██▋       | 10146/37963 [25:01:19<75:11:56,  9.73s/it]
 27%|██▋       | 10147/37963 [25:01:27<70:27:56,  9.12s/it]
 27%|██▋       | 10148/37963 [25:01:34<66:58:44,  8.67s/it]
 27%|██▋       | 10149/37963 [25:01:42<64:26:24,  8.34s/it]
 27%|██▋       | 10150/37963 [25:01:49<62:20:55,  8.07s/it]
                                                           
{'loss': '0.1678', 'grad_norm': '1.448', 'learning_rate': '1.719e-05', 'epoch': '0.2674'}
+
 27%|██▋       | 10150/37963 [25:01:49<62:20:55,  8.07s/it]
 27%|██▋       | 10151/37963 [25:01:57<61:26:58,  7.95s/it]
 27%|██▋       | 10152/37963 [25:02:04<60:07:12,  7.78s/it]
 27%|██▋       | 10153/37963 [25:02:12<59:39:33,  7.72s/it]
 27%|██▋       | 10154/37963 [25:02:20<59:49:58,  7.75s/it]
 27%|██▋       | 10155/37963 [25:02:27<59:32:22,  7.71s/it]
 27%|██▋       | 10156/37963 [25:02:35<59:16:48,  7.67s/it]
 27%|██▋       | 10157/37963 [25:02:43<59:09:04,  7.66s/it]
 27%|██▋       | 10158/37963 [25:02:50<59:17:16,  7.68s/it]
 27%|██▋       | 10159/37963 [25:03:05<75:50:44,  9.82s/it]
 27%|██▋       | 10160/37963 [25:03:13<70:42:02,  9.15s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '3.473', 'learning_rate': '1.718e-05', 'epoch': '0.2676'}
+
 27%|██▋       | 10160/37963 [25:03:13<70:42:02,  9.15s/it]
 27%|██▋       | 10161/37963 [25:03:27<83:17:47, 10.79s/it]
 27%|██▋       | 10162/37963 [25:03:35<75:53:55,  9.83s/it]
 27%|██▋       | 10163/37963 [25:03:43<70:49:13,  9.17s/it]
 27%|██▋       | 10164/37963 [25:03:50<67:25:35,  8.73s/it]
 27%|██▋       | 10165/37963 [25:03:58<64:42:38,  8.38s/it]
 27%|██▋       | 10166/37963 [25:04:19<93:37:02, 12.12s/it]
 27%|██▋       | 10167/37963 [25:04:26<83:21:53, 10.80s/it]
 27%|██▋       | 10168/37963 [25:04:34<76:06:55,  9.86s/it]
 27%|██▋       | 10169/37963 [25:04:49<86:50:54, 11.25s/it]
 27%|██▋       | 10170/37963 [25:04:56<78:18:26, 10.14s/it]
                                                           
{'loss': '0.1686', 'grad_norm': '2.463', 'learning_rate': '1.718e-05', 'epoch': '0.2679'}
+
 27%|██▋       | 10170/37963 [25:04:56<78:18:26, 10.14s/it]
 27%|██▋       | 10171/37963 [25:05:04<72:52:58,  9.44s/it]
 27%|██▋       | 10172/37963 [25:05:12<68:36:28,  8.89s/it]
 27%|██▋       | 10173/37963 [25:05:19<65:14:29,  8.45s/it]
 27%|██▋       | 10174/37963 [25:05:33<78:52:50, 10.22s/it]
 27%|██▋       | 10175/37963 [25:05:41<73:17:34,  9.50s/it]
 27%|██▋       | 10176/37963 [25:05:49<69:10:27,  8.96s/it]
 27%|██▋       | 10177/37963 [25:05:56<65:41:52,  8.51s/it]
 27%|██▋       | 10178/37963 [25:06:04<62:40:15,  8.12s/it]
 27%|██▋       | 10179/37963 [25:06:11<61:28:58,  7.97s/it]
 27%|██▋       | 10180/37963 [25:06:19<61:00:44,  7.91s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '3.623', 'learning_rate': '1.717e-05', 'epoch': '0.2682'}
+
 27%|██▋       | 10180/37963 [25:06:19<61:00:44,  7.91s/it]
 27%|██▋       | 10181/37963 [25:06:27<60:13:11,  7.80s/it]
 27%|██▋       | 10182/37963 [25:06:34<59:35:22,  7.72s/it]
 27%|██▋       | 10183/37963 [25:06:42<59:57:52,  7.77s/it]
 27%|██▋       | 10184/37963 [25:06:50<59:52:37,  7.76s/it]
 27%|██▋       | 10185/37963 [25:06:57<59:34:11,  7.72s/it]
 27%|██▋       | 10186/37963 [25:07:05<58:35:16,  7.59s/it]
 27%|██▋       | 10187/37963 [25:07:12<58:36:30,  7.60s/it]
 27%|██▋       | 10188/37963 [25:07:20<58:44:04,  7.61s/it]
 27%|██▋       | 10189/37963 [25:07:28<58:56:08,  7.64s/it]
 27%|██▋       | 10190/37963 [25:07:35<59:11:23,  7.67s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '1.957', 'learning_rate': '1.716e-05', 'epoch': '0.2684'}
+
 27%|██▋       | 10190/37963 [25:07:35<59:11:23,  7.67s/it]
 27%|██▋       | 10191/37963 [25:07:50<75:27:07,  9.78s/it]
 27%|██▋       | 10192/37963 [25:07:58<70:16:07,  9.11s/it]
 27%|██▋       | 10193/37963 [25:08:05<66:49:24,  8.66s/it]
 27%|██▋       | 10194/37963 [25:08:13<64:30:43,  8.36s/it]
 27%|██▋       | 10195/37963 [25:08:27<78:09:38, 10.13s/it]
 27%|██▋       | 10196/37963 [25:08:35<72:13:51,  9.36s/it]
 27%|██▋       | 10197/37963 [25:08:42<68:13:06,  8.84s/it]
 27%|██▋       | 10198/37963 [25:08:50<65:40:27,  8.52s/it]
 27%|██▋       | 10199/37963 [25:08:58<63:37:34,  8.25s/it]
 27%|██▋       | 10200/37963 [25:09:05<62:37:21,  8.12s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '1.905', 'learning_rate': '1.716e-05', 'epoch': '0.2687'}
+
 27%|██▋       | 10200/37963 [25:09:05<62:37:21,  8.12s/it]
 27%|██▋       | 10201/37963 [25:09:13<61:30:49,  7.98s/it]
 27%|██▋       | 10202/37963 [25:09:21<60:42:53,  7.87s/it]
 27%|██▋       | 10203/37963 [25:09:28<59:30:30,  7.72s/it]
 27%|██▋       | 10204/37963 [25:09:36<58:58:16,  7.65s/it]
 27%|██▋       | 10205/37963 [25:09:51<76:00:34,  9.86s/it]
 27%|██▋       | 10206/37963 [25:09:58<70:49:49,  9.19s/it]
 27%|██▋       | 10207/37963 [25:10:06<66:45:18,  8.66s/it]
 27%|██▋       | 10208/37963 [25:10:21<81:27:59, 10.57s/it]
 27%|██▋       | 10209/37963 [25:10:29<75:33:05,  9.80s/it]
 27%|██▋       | 10210/37963 [25:10:36<70:52:23,  9.19s/it]
                                                           
{'loss': '0.165', 'grad_norm': '0.6766', 'learning_rate': '1.715e-05', 'epoch': '0.2689'}
+
 27%|██▋       | 10210/37963 [25:10:36<70:52:23,  9.19s/it]
 27%|██▋       | 10211/37963 [25:10:44<66:42:54,  8.65s/it]
 27%|██▋       | 10212/37963 [25:10:52<64:27:43,  8.36s/it]
 27%|██▋       | 10213/37963 [25:11:13<93:43:11, 12.16s/it]
 27%|██▋       | 10214/37963 [25:11:20<83:16:51, 10.80s/it]
 27%|██▋       | 10215/37963 [25:11:28<75:31:07,  9.80s/it]
 27%|██▋       | 10216/37963 [25:11:35<70:28:07,  9.14s/it]
 27%|██▋       | 10217/37963 [25:11:43<66:59:24,  8.69s/it]
 27%|██▋       | 10218/37963 [25:11:51<64:51:20,  8.42s/it]
 27%|██▋       | 10219/37963 [25:11:58<62:43:24,  8.14s/it]
 27%|██▋       | 10220/37963 [25:12:06<61:36:06,  7.99s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '5.512', 'learning_rate': '1.715e-05', 'epoch': '0.2692'}
+
 27%|██▋       | 10220/37963 [25:12:06<61:36:06,  7.99s/it]
 27%|██▋       | 10221/37963 [25:12:14<61:05:54,  7.93s/it]
 27%|██▋       | 10222/37963 [25:12:21<59:57:53,  7.78s/it]
 27%|██▋       | 10223/37963 [25:12:35<74:57:44,  9.73s/it]
 27%|██▋       | 10224/37963 [25:12:43<70:12:15,  9.11s/it]
 27%|██▋       | 10225/37963 [25:12:57<82:05:00, 10.65s/it]
 27%|██▋       | 10226/37963 [25:13:05<75:14:26,  9.77s/it]
 27%|██▋       | 10227/37963 [25:13:13<70:18:52,  9.13s/it]
 27%|██▋       | 10228/37963 [25:13:20<66:55:20,  8.69s/it]
 27%|██▋       | 10229/37963 [25:13:28<64:02:32,  8.31s/it]
 27%|██▋       | 10230/37963 [25:13:35<62:43:08,  8.14s/it]
                                                           
{'loss': '0.1576', 'grad_norm': '1.221', 'learning_rate': '1.714e-05', 'epoch': '0.2695'}
+
 27%|██▋       | 10230/37963 [25:13:35<62:43:08,  8.14s/it]
 27%|██▋       | 10231/37963 [25:13:43<61:24:24,  7.97s/it]
 27%|██▋       | 10232/37963 [25:13:50<60:07:34,  7.81s/it]
 27%|██▋       | 10233/37963 [25:13:58<59:44:15,  7.76s/it]
 27%|██▋       | 10234/37963 [25:14:06<59:19:31,  7.70s/it]
 27%|██▋       | 10235/37963 [25:14:13<58:31:40,  7.60s/it]
 27%|██▋       | 10236/37963 [25:14:20<58:19:27,  7.57s/it]
 27%|██▋       | 10237/37963 [25:14:28<58:17:53,  7.57s/it]
 27%|██▋       | 10238/37963 [25:14:36<58:31:18,  7.60s/it]
 27%|██▋       | 10239/37963 [25:14:43<58:53:12,  7.65s/it]
 27%|██▋       | 10240/37963 [25:14:51<58:55:15,  7.65s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '1.428', 'learning_rate': '1.713e-05', 'epoch': '0.2697'}
+
 27%|██▋       | 10240/37963 [25:14:51<58:55:15,  7.65s/it]
 27%|██▋       | 10241/37963 [25:14:59<58:50:49,  7.64s/it]
 27%|██▋       | 10242/37963 [25:15:06<58:52:41,  7.65s/it]
 27%|██▋       | 10243/37963 [25:15:14<58:17:43,  7.57s/it]
 27%|██▋       | 10244/37963 [25:15:28<74:30:42,  9.68s/it]
 27%|██▋       | 10245/37963 [25:15:43<86:24:10, 11.22s/it]
 27%|██▋       | 10246/37963 [25:15:51<78:34:53, 10.21s/it]
 27%|██▋       | 10247/37963 [25:15:59<72:35:59,  9.43s/it]
 27%|██▋       | 10248/37963 [25:16:06<68:45:04,  8.93s/it]
 27%|██▋       | 10249/37963 [25:16:14<65:45:41,  8.54s/it]
 27%|██▋       | 10250/37963 [25:16:22<63:40:56,  8.27s/it]
                                                           
{'loss': '0.155', 'grad_norm': '2.38', 'learning_rate': '1.713e-05', 'epoch': '0.27'}
+
 27%|██▋       | 10250/37963 [25:16:22<63:40:56,  8.27s/it]
 27%|██▋       | 10251/37963 [25:16:29<62:16:18,  8.09s/it]
 27%|██▋       | 10252/37963 [25:16:37<61:19:59,  7.97s/it]
 27%|██▋       | 10253/37963 [25:16:44<59:43:16,  7.76s/it]
 27%|██▋       | 10254/37963 [25:16:52<59:25:59,  7.72s/it]
 27%|██▋       | 10255/37963 [25:17:07<75:26:57,  9.80s/it]
 27%|██▋       | 10256/37963 [25:17:14<70:34:47,  9.17s/it]
 27%|██▋       | 10257/37963 [25:17:35<98:14:39, 12.77s/it]
 27%|██▋       | 10258/37963 [25:17:43<86:31:28, 11.24s/it]
 27%|██▋       | 10259/37963 [25:17:51<77:48:11, 10.11s/it]
 27%|██▋       | 10260/37963 [25:17:58<71:58:57,  9.35s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '2.746', 'learning_rate': '1.712e-05', 'epoch': '0.2703'}
+
 27%|██▋       | 10260/37963 [25:17:58<71:58:57,  9.35s/it]
 27%|██▋       | 10261/37963 [25:18:06<67:57:13,  8.83s/it]
 27%|██▋       | 10262/37963 [25:18:13<65:01:47,  8.45s/it]
 27%|██▋       | 10263/37963 [25:18:21<63:12:18,  8.21s/it]
 27%|██▋       | 10264/37963 [25:18:29<62:23:25,  8.11s/it]
 27%|██▋       | 10265/37963 [25:18:37<61:12:55,  7.96s/it]
 27%|██▋       | 10266/37963 [25:18:44<60:14:11,  7.83s/it]
 27%|██▋       | 10267/37963 [25:18:58<74:45:52,  9.72s/it]
 27%|██▋       | 10268/37963 [25:19:06<70:00:32,  9.10s/it]
 27%|██▋       | 10269/37963 [25:19:21<83:33:35, 10.86s/it]
 27%|██▋       | 10270/37963 [25:19:29<76:28:27,  9.94s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '7.105', 'learning_rate': '1.712e-05', 'epoch': '0.2705'}
+
 27%|██▋       | 10270/37963 [25:19:29<76:28:27,  9.94s/it]
 27%|██▋       | 10271/37963 [25:19:43<86:32:09, 11.25s/it]
 27%|██▋       | 10272/37963 [25:19:50<77:56:45, 10.13s/it]
 27%|██▋       | 10273/37963 [25:19:58<72:00:43,  9.36s/it]
 27%|██▋       | 10274/37963 [25:20:05<67:30:13,  8.78s/it]
 27%|██▋       | 10275/37963 [25:20:13<64:18:48,  8.36s/it]
 27%|██▋       | 10276/37963 [25:20:20<62:29:54,  8.13s/it]
 27%|██▋       | 10277/37963 [25:20:28<61:18:33,  7.97s/it]
 27%|██▋       | 10278/37963 [25:20:36<60:35:50,  7.88s/it]
 27%|██▋       | 10279/37963 [25:20:43<59:43:04,  7.77s/it]
 27%|██▋       | 10280/37963 [25:20:51<59:40:36,  7.76s/it]
                                                           
{'loss': '0.163', 'grad_norm': '1.712', 'learning_rate': '1.711e-05', 'epoch': '0.2708'}
+
 27%|██▋       | 10280/37963 [25:20:51<59:40:36,  7.76s/it]
 27%|██▋       | 10281/37963 [25:20:59<59:45:03,  7.77s/it]
 27%|██▋       | 10282/37963 [25:21:06<59:22:37,  7.72s/it]
 27%|██▋       | 10283/37963 [25:21:14<59:45:16,  7.77s/it]
 27%|██▋       | 10284/37963 [25:21:22<59:39:20,  7.76s/it]
 27%|██▋       | 10285/37963 [25:21:30<59:21:41,  7.72s/it]
 27%|██▋       | 10286/37963 [25:21:37<59:05:01,  7.69s/it]
 27%|██▋       | 10287/37963 [25:21:45<58:54:59,  7.66s/it]
 27%|██▋       | 10288/37963 [25:21:59<73:46:05,  9.60s/it]
 27%|██▋       | 10289/37963 [25:22:07<69:15:53,  9.01s/it]
 27%|██▋       | 10290/37963 [25:22:14<66:09:08,  8.61s/it]
                                                           
{'loss': '0.1718', 'grad_norm': '4.115', 'learning_rate': '1.71e-05', 'epoch': '0.2711'}
+
 27%|██▋       | 10290/37963 [25:22:14<66:09:08,  8.61s/it]
 27%|██▋       | 10291/37963 [25:22:22<63:35:24,  8.27s/it]
 27%|██▋       | 10292/37963 [25:22:29<62:12:30,  8.09s/it]
 27%|██▋       | 10293/37963 [25:22:37<60:47:24,  7.91s/it]
 27%|██▋       | 10294/37963 [25:22:44<59:56:38,  7.80s/it]
 27%|██▋       | 10295/37963 [25:22:52<59:53:17,  7.79s/it]
 27%|██▋       | 10296/37963 [25:23:00<59:33:48,  7.75s/it]
 27%|██▋       | 10297/37963 [25:23:08<59:32:44,  7.75s/it]
 27%|██▋       | 10298/37963 [25:23:15<59:15:44,  7.71s/it]
 27%|██▋       | 10299/37963 [25:23:30<75:25:26,  9.82s/it]
 27%|██▋       | 10300/37963 [25:23:38<70:42:58,  9.20s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '2.616', 'learning_rate': '1.71e-05', 'epoch': '0.2713'}
+
 27%|██▋       | 10300/37963 [25:23:38<70:42:58,  9.20s/it]
 27%|██▋       | 10301/37963 [25:23:53<83:42:53, 10.89s/it]
 27%|██▋       | 10302/37963 [25:24:00<76:33:47,  9.96s/it]
 27%|██▋       | 10303/37963 [25:24:08<71:10:10,  9.26s/it]
 27%|██▋       | 10304/37963 [25:24:16<67:30:14,  8.79s/it]
 27%|██▋       | 10305/37963 [25:24:30<81:04:58, 10.55s/it]
 27%|██▋       | 10306/37963 [25:24:38<74:21:02,  9.68s/it]
 27%|██▋       | 10307/37963 [25:24:52<84:58:05, 11.06s/it]
 27%|██▋       | 10308/37963 [25:25:00<77:11:10, 10.05s/it]
 27%|██▋       | 10309/37963 [25:25:08<71:59:22,  9.37s/it]
 27%|██▋       | 10310/37963 [25:25:15<67:38:49,  8.81s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '1.548', 'learning_rate': '1.709e-05', 'epoch': '0.2716'}
+
 27%|██▋       | 10310/37963 [25:25:15<67:38:49,  8.81s/it]
 27%|██▋       | 10311/37963 [25:25:23<64:54:46,  8.45s/it]
 27%|██▋       | 10312/37963 [25:25:30<63:04:58,  8.21s/it]
 27%|██▋       | 10313/37963 [25:25:45<76:48:05, 10.00s/it]
 27%|██▋       | 10314/37963 [25:25:59<87:09:21, 11.35s/it]
 27%|██▋       | 10315/37963 [25:26:07<78:51:55, 10.27s/it]
 27%|██▋       | 10316/37963 [25:26:15<72:47:24,  9.48s/it]
 27%|██▋       | 10317/37963 [25:26:29<83:38:19, 10.89s/it]
 27%|██▋       | 10318/37963 [25:26:36<76:20:51,  9.94s/it]
 27%|██▋       | 10319/37963 [25:26:44<70:58:22,  9.24s/it]
 27%|██▋       | 10320/37963 [25:26:51<66:50:57,  8.71s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '1.709', 'learning_rate': '1.709e-05', 'epoch': '0.2718'}
+
 27%|██▋       | 10320/37963 [25:26:52<66:50:57,  8.71s/it]
 27%|██▋       | 10321/37963 [25:26:59<64:21:48,  8.38s/it]
 27%|██▋       | 10322/37963 [25:27:07<62:10:42,  8.10s/it]
 27%|██▋       | 10323/37963 [25:27:14<60:44:03,  7.91s/it]
 27%|██▋       | 10324/37963 [25:27:21<59:32:22,  7.76s/it]
 27%|██▋       | 10325/37963 [25:27:29<58:38:58,  7.64s/it]
 27%|██▋       | 10326/37963 [25:27:36<58:32:37,  7.63s/it]
 27%|██▋       | 10327/37963 [25:27:44<58:42:59,  7.65s/it]
 27%|██▋       | 10328/37963 [25:27:52<58:29:23,  7.62s/it]
 27%|██▋       | 10329/37963 [25:27:59<58:29:40,  7.62s/it]
 27%|██▋       | 10330/37963 [25:28:07<58:32:36,  7.63s/it]
                                                           
{'loss': '0.166', 'grad_norm': '2.961', 'learning_rate': '1.708e-05', 'epoch': '0.2721'}
+
 27%|██▋       | 10330/37963 [25:28:07<58:32:36,  7.63s/it]
 27%|██▋       | 10331/37963 [25:28:15<58:30:50,  7.62s/it]
 27%|██▋       | 10332/37963 [25:28:22<58:38:30,  7.64s/it]
 27%|█���▋       | 10333/37963 [25:28:30<58:41:22,  7.65s/it]
 27%|██▋       | 10334/37963 [25:28:38<58:40:58,  7.65s/it]
 27%|██▋       | 10335/37963 [25:28:45<58:40:32,  7.65s/it]
 27%|██▋       | 10336/37963 [25:28:53<59:07:30,  7.70s/it]
 27%|██▋       | 10337/37963 [25:29:01<58:51:39,  7.67s/it]
 27%|██▋       | 10338/37963 [25:29:08<58:50:30,  7.67s/it]
 27%|██▋       | 10339/37963 [25:29:16<58:41:21,  7.65s/it]
 27%|██▋       | 10340/37963 [25:29:23<58:41:14,  7.65s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '0.9416', 'learning_rate': '1.707e-05', 'epoch': '0.2724'}
+
 27%|██▋       | 10340/37963 [25:29:24<58:41:14,  7.65s/it]
 27%|██▋       | 10341/37963 [25:29:31<58:52:26,  7.67s/it]
 27%|██▋       | 10342/37963 [25:29:45<73:42:20,  9.61s/it]
 27%|██▋       | 10343/37963 [25:29:53<69:17:48,  9.03s/it]
 27%|██▋       | 10344/37963 [25:30:08<81:59:56, 10.69s/it]
 27%|██▋       | 10345/37963 [25:30:15<75:01:42,  9.78s/it]
 27%|██▋       | 10346/37963 [25:30:23<70:17:46,  9.16s/it]
 27%|██▋       | 10347/37963 [25:30:31<66:42:05,  8.70s/it]
 27%|██▋       | 10348/37963 [25:30:38<64:11:39,  8.37s/it]
 27%|██▋       | 10349/37963 [25:30:46<62:33:23,  8.16s/it]
 27%|██▋       | 10350/37963 [25:30:53<61:23:24,  8.00s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '1.873', 'learning_rate': '1.707e-05', 'epoch': '0.2726'}
+
 27%|██▋       | 10350/37963 [25:30:53<61:23:24,  8.00s/it]
 27%|██▋       | 10351/37963 [25:31:01<60:28:44,  7.89s/it]
 27%|██▋       | 10352/37963 [25:31:16<75:32:30,  9.85s/it]
 27%|██▋       | 10353/37963 [25:31:30<86:21:38, 11.26s/it]
 27%|██▋       | 10354/37963 [25:31:38<77:51:06, 10.15s/it]
 27%|██▋       | 10355/37963 [25:31:45<72:01:20,  9.39s/it]
 27%|██▋       | 10356/37963 [25:31:59<83:06:45, 10.84s/it]
 27%|██▋       | 10357/37963 [25:32:07<75:26:03,  9.84s/it]
 27%|██▋       | 10358/37963 [25:32:15<70:18:21,  9.17s/it]
 27%|██▋       | 10359/37963 [25:32:22<66:40:58,  8.70s/it]
 27%|██▋       | 10360/37963 [25:32:30<64:21:46,  8.39s/it]
                                                           
{'loss': '0.1743', 'grad_norm': '3.132', 'learning_rate': '1.706e-05', 'epoch': '0.2729'}
+
 27%|██▋       | 10360/37963 [25:32:30<64:21:46,  8.39s/it]
 27%|██▋       | 10361/37963 [25:32:44<78:11:41, 10.20s/it]
 27%|██▋       | 10362/37963 [25:32:52<72:59:59,  9.52s/it]
 27%|██▋       | 10363/37963 [25:33:00<68:36:30,  8.95s/it]
 27%|██▋       | 10364/37963 [25:33:07<65:38:01,  8.56s/it]
 27%|██▋       | 10365/37963 [25:33:15<63:05:44,  8.23s/it]
 27%|██▋       | 10366/37963 [25:33:23<61:53:46,  8.07s/it]
 27%|██▋       | 10367/37963 [25:33:37<76:06:43,  9.93s/it]
 27%|██▋       | 10368/37963 [25:33:45<71:03:45,  9.27s/it]
 27%|██▋       | 10369/37963 [25:33:52<67:32:21,  8.81s/it]
 27%|██▋       | 10370/37963 [25:34:00<64:53:12,  8.47s/it]
                                                           
{'loss': '0.168', 'grad_norm': '2.489', 'learning_rate': '1.706e-05', 'epoch': '0.2732'}
+
 27%|██▋       | 10370/37963 [25:34:00<64:53:12,  8.47s/it]
 27%|██▋       | 10371/37963 [25:34:15<78:40:58, 10.27s/it]
 27%|██▋       | 10372/37963 [25:34:22<72:59:45,  9.52s/it]
 27%|██▋       | 10373/37963 [25:34:30<68:37:45,  8.95s/it]
 27%|██▋       | 10374/37963 [25:34:38<65:33:21,  8.55s/it]
 27%|██▋       | 10375/37963 [25:34:45<63:29:16,  8.28s/it]
 27%|██▋       | 10376/37963 [25:34:53<62:39:03,  8.18s/it]
 27%|██▋       | 10377/37963 [25:35:01<61:15:38,  7.99s/it]
 27%|██▋       | 10378/37963 [25:35:08<60:18:33,  7.87s/it]
 27%|██▋       | 10379/37963 [25:35:16<59:15:13,  7.73s/it]
 27%|██▋       | 10380/37963 [25:35:23<59:11:04,  7.72s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '2.495', 'learning_rate': '1.705e-05', 'epoch': '0.2734'}
+
 27%|██▋       | 10380/37963 [25:35:23<59:11:04,  7.72s/it]
 27%|██▋       | 10381/37963 [25:35:31<58:57:54,  7.70s/it]
 27%|██▋       | 10382/37963 [25:35:39<58:54:04,  7.69s/it]
 27%|██▋       | 10383/37963 [25:35:46<58:51:01,  7.68s/it]
 27%|██▋       | 10384/37963 [25:35:54<58:50:18,  7.68s/it]
 27%|██▋       | 10385/37963 [25:36:01<58:03:07,  7.58s/it]
 27%|██▋       | 10386/37963 [25:36:09<58:24:52,  7.63s/it]
 27%|██▋       | 10387/37963 [25:36:23<73:54:35,  9.65s/it]
 27%|██▋       | 10388/37963 [25:36:31<70:06:22,  9.15s/it]
 27%|██▋       | 10389/37963 [25:36:39<66:31:27,  8.69s/it]
 27%|██▋       | 10390/37963 [25:36:47<64:09:18,  8.38s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '1.353', 'learning_rate': '1.704e-05', 'epoch': '0.2737'}
+
 27%|██▋       | 10390/37963 [25:36:47<64:09:18,  8.38s/it]
 27%|██▋       | 10391/37963 [25:36:55<62:47:22,  8.20s/it]
 27%|██▋       | 10392/37963 [25:37:09<77:34:26, 10.13s/it]
 27%|██▋       | 10393/37963 [25:37:17<72:02:25,  9.41s/it]
 27%|██▋       | 10394/37963 [25:37:25<67:56:19,  8.87s/it]
 27%|██▋       | 10395/37963 [25:37:32<65:23:20,  8.54s/it]
 27%|██▋       | 10396/37963 [25:37:40<63:12:16,  8.25s/it]
 27%|██▋       | 10397/37963 [25:37:55<78:15:37, 10.22s/it]
 27%|██▋       | 10398/37963 [25:38:02<72:38:55,  9.49s/it]
 27%|██▋       | 10399/37963 [25:38:10<68:16:07,  8.92s/it]
 27%|██▋       | 10400/37963 [25:38:25<82:36:00, 10.79s/it]
                                                           
{'loss': '0.1683', 'grad_norm': '2.916', 'learning_rate': '1.704e-05', 'epoch': '0.274'}
+
 27%|██▋       | 10400/37963 [25:38:25<82:36:00, 10.79s/it]
 27%|██▋       | 10401/37963 [25:38:33<75:25:33,  9.85s/it]
 27%|██▋       | 10402/37963 [25:38:41<70:40:08,  9.23s/it]
 27%|██▋       | 10403/37963 [25:38:48<67:12:29,  8.78s/it]
 27%|██▋       | 10404/37963 [25:39:03<81:04:45, 10.59s/it]
 27%|██▋       | 10405/37963 [25:39:11<74:08:22,  9.69s/it]
 27%|██▋       | 10406/37963 [25:39:18<69:15:43,  9.05s/it]
 27%|██▋       | 10407/37963 [25:39:26<66:30:48,  8.69s/it]
 27%|██▋       | 10408/37963 [25:39:34<64:03:48,  8.37s/it]
 27%|██▋       | 10409/37963 [25:39:41<62:26:28,  8.16s/it]
 27%|██▋       | 10410/37963 [25:39:49<60:57:14,  7.96s/it]
                                                           
{'loss': '0.1674', 'grad_norm': '2.255', 'learning_rate': '1.703e-05', 'epoch': '0.2742'}
+
 27%|██▋       | 10410/37963 [25:39:49<60:57:14,  7.96s/it]
 27%|██▋       | 10411/37963 [25:39:57<59:59:16,  7.84s/it]
 27%|██▋       | 10412/37963 [25:40:04<59:28:12,  7.77s/it]
 27%|██▋       | 10413/37963 [25:40:12<59:06:33,  7.72s/it]
 27%|██▋       | 10414/37963 [25:40:26<74:23:28,  9.72s/it]
 27%|██▋       | 10415/37963 [25:40:40<84:55:29, 11.10s/it]
 27%|██▋       | 10416/37963 [25:40:48<77:46:29, 10.16s/it]
 27%|██▋       | 10417/37963 [25:40:56<71:55:12,  9.40s/it]
 27%|██▋       | 10418/37963 [25:41:10<81:54:05, 10.70s/it]
 27%|██▋       | 10419/37963 [25:41:17<74:58:40,  9.80s/it]
 27%|██▋       | 10420/37963 [25:41:25<70:04:28,  9.16s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '5.57', 'learning_rate': '1.703e-05', 'epoch': '0.2745'}
+
 27%|██▋       | 10420/37963 [25:41:25<70:04:28,  9.16s/it]
 27%|██▋       | 10421/37963 [25:41:33<66:42:26,  8.72s/it]
 27%|██▋       | 10422/37963 [25:41:40<64:11:54,  8.39s/it]
 27%|██▋       | 10423/37963 [25:41:48<62:28:36,  8.17s/it]
 27%|██▋       | 10424/37963 [25:41:56<61:53:17,  8.09s/it]
 27%|██▋       | 10425/37963 [25:42:04<60:52:27,  7.96s/it]
 27%|██▋       | 10426/37963 [25:42:11<60:03:51,  7.85s/it]
 27%|██▋       | 10427/37963 [25:42:19<59:34:00,  7.79s/it]
 27%|██▋       | 10428/37963 [25:42:26<58:58:24,  7.71s/it]
 27%|██▋       | 10429/37963 [25:42:34<57:54:12,  7.57s/it]
 27%|██▋       | 10430/37963 [25:42:41<58:01:31,  7.59s/it]
                                                           
{'loss': '0.166', 'grad_norm': '1.878', 'learning_rate': '1.702e-05', 'epoch': '0.2747'}
+
 27%|██▋       | 10430/37963 [25:42:41<58:01:31,  7.59s/it]
 27%|██▋       | 10431/37963 [25:42:49<57:32:48,  7.52s/it]
 27%|██▋       | 10432/37963 [25:42:56<57:47:10,  7.56s/it]
 27%|██▋       | 10433/37963 [25:43:04<57:52:47,  7.57s/it]
 27%|██▋       | 10434/37963 [25:43:11<57:50:12,  7.56s/it]
 27%|██▋       | 10435/37963 [25:43:26<73:16:49,  9.58s/it]
 27%|██▋       | 10436/37963 [25:43:33<68:48:16,  9.00s/it]
 27%|██▋       | 10437/37963 [25:43:41<65:19:24,  8.54s/it]
 27%|██▋       | 10438/37963 [25:43:48<62:23:45,  8.16s/it]
 27%|██▋       | 10439/37963 [25:43:56<61:27:04,  8.04s/it]
 28%|██▊       | 10440/37963 [25:44:04<60:32:26,  7.92s/it]
                                                           
{'loss': '0.1706', 'grad_norm': '1.276', 'learning_rate': '1.701e-05', 'epoch': '0.275'}
+
 28%|██▊       | 10440/37963 [25:44:04<60:32:26,  7.92s/it]
 28%|██▊       | 10441/37963 [25:44:18<76:02:02,  9.95s/it]
 28%|██▊       | 10442/37963 [25:44:26<70:37:27,  9.24s/it]
 28%|██▊       | 10443/37963 [25:44:33<66:59:03,  8.76s/it]
 28%|██▊       | 10444/37963 [25:44:48<79:11:55, 10.36s/it]
 28%|██▊       | 10445/37963 [25:44:55<73:34:30,  9.63s/it]
 28%|██▊       | 10446/37963 [25:45:03<69:05:43,  9.04s/it]
 28%|██▊       | 10447/37963 [25:45:11<65:45:29,  8.60s/it]
 28%|██▊       | 10448/37963 [25:45:18<63:47:19,  8.35s/it]
 28%|██▊       | 10449/37963 [25:45:26<62:15:03,  8.15s/it]
 28%|██▊       | 10450/37963 [25:45:41<77:45:03, 10.17s/it]
                                                           
{'loss': '0.156', 'grad_norm': '1.41', 'learning_rate': '1.701e-05', 'epoch': '0.2753'}
+
 28%|██▊       | 10450/37963 [25:45:41<77:45:03, 10.17s/it]
 28%|██▊       | 10451/37963 [25:45:55<87:31:43, 11.45s/it]
 28%|██▊       | 10452/37963 [25:46:03<79:41:28, 10.43s/it]
 28%|██▊       | 10453/37963 [25:46:11<73:01:00,  9.56s/it]
 28%|██▊       | 10454/37963 [25:46:19<68:25:21,  8.95s/it]
 28%|██▊       | 10455/37963 [25:46:26<65:39:48,  8.59s/it]
 28%|██▊       | 10456/37963 [25:46:34<63:28:38,  8.31s/it]
 28%|██▊       | 10457/37963 [25:46:42<61:55:57,  8.11s/it]
 28%|██▊       | 10458/37963 [25:46:49<60:59:19,  7.98s/it]
 28%|██▊       | 10459/37963 [25:47:04<76:22:03, 10.00s/it]
 28%|██▊       | 10460/37963 [25:47:11<70:33:17,  9.24s/it]
                                                           
{'loss': '0.1722', 'grad_norm': '1.623', 'learning_rate': '1.7e-05', 'epoch': '0.2755'}
+
 28%|██▊       | 10460/37963 [25:47:11<70:33:17,  9.24s/it]
 28%|██▊       | 10461/37963 [25:47:26<82:22:55, 10.78s/it]
 28%|██▊       | 10462/37963 [25:47:34<75:20:37,  9.86s/it]
 28%|██▊       | 10463/37963 [25:47:41<70:11:15,  9.19s/it]
 28%|██▊       | 10464/37963 [25:47:49<66:28:24,  8.70s/it]
 28%|██▊       | 10465/37963 [25:47:56<63:59:54,  8.38s/it]
 28%|██▊       | 10466/37963 [25:48:11<77:17:05, 10.12s/it]
 28%|██▊       | 10467/37963 [25:48:18<71:41:06,  9.39s/it]
 28%|██▊       | 10468/37963 [25:48:26<67:45:11,  8.87s/it]
 28%|██▊       | 10469/37963 [25:48:34<65:23:54,  8.56s/it]
 28%|██▊       | 10470/37963 [25:48:41<63:08:32,  8.27s/it]
                                                           
{'loss': '0.1819', 'grad_norm': '3.242', 'learning_rate': '1.7e-05', 'epoch': '0.2758'}
+
 28%|██▊       | 10470/37963 [25:48:41<63:08:32,  8.27s/it]
 28%|██▊       | 10471/37963 [25:48:49<62:06:27,  8.13s/it]
 28%|██▊       | 10472/37963 [25:48:57<60:56:17,  7.98s/it]
 28%|██▊       | 10473/37963 [25:49:04<59:50:50,  7.84s/it]
 28%|██▊       | 10474/37963 [25:49:12<59:01:32,  7.73s/it]
 28%|██▊       | 10475/37963 [25:49:19<58:47:33,  7.70s/it]
 28%|██▊       | 10476/37963 [25:49:27<58:30:50,  7.66s/it]
 28%|██▊       | 10477/37963 [25:49:35<58:27:01,  7.66s/it]
 28%|██▊       | 10478/37963 [25:49:42<58:33:59,  7.67s/it]
 28%|██▊       | 10479/37963 [25:49:50<58:47:18,  7.70s/it]
 28%|██▊       | 10480/37963 [25:49:58<58:16:05,  7.63s/it]
                                                           
{'loss': '0.174', 'grad_norm': '1.088', 'learning_rate': '1.699e-05', 'epoch': '0.2761'}
+
 28%|██▊       | 10480/37963 [25:49:58<58:16:05,  7.63s/it]
 28%|██▊       | 10481/37963 [25:50:05<58:23:45,  7.65s/it]
 28%|██▊       | 10482/37963 [25:50:13<58:19:09,  7.64s/it]
 28%|██▊       | 10483/37963 [25:50:20<57:41:35,  7.56s/it]
 28%|██▊       | 10484/37963 [25:50:35<73:09:44,  9.58s/it]
 28%|██▊       | 10485/37963 [25:50:42<68:59:35,  9.04s/it]
 28%|██▊       | 10486/37963 [25:50:50<66:30:29,  8.71s/it]
 28%|██▊       | 10487/37963 [25:50:58<63:55:51,  8.38s/it]
 28%|██▊       | 10488/37963 [25:51:12<76:51:34, 10.07s/it]
 28%|██▊       | 10489/37963 [25:51:19<71:05:44,  9.32s/it]
 28%|██▊       | 10490/37963 [25:51:34<83:40:59, 10.97s/it]
                                                           
{'loss': '0.173', 'grad_norm': '4.335', 'learning_rate': '1.698e-05', 'epoch': '0.2763'}
+
 28%|██▊       | 10490/37963 [25:51:34<83:40:59, 10.97s/it]
 28%|██▊       | 10491/37963 [25:51:42<76:04:02,  9.97s/it]
 28%|██▊       | 10492/37963 [25:51:50<70:54:51,  9.29s/it]
 28%|██▊       | 10493/37963 [25:51:57<67:15:29,  8.81s/it]
 28%|██▊       | 10494/37963 [25:52:05<64:35:00,  8.46s/it]
 28%|██▊       | 10495/37963 [25:52:20<79:06:27, 10.37s/it]
 28%|██▊       | 10496/37963 [25:52:27<72:33:23,  9.51s/it]
 28%|██▊       | 10497/37963 [25:52:35<68:21:08,  8.96s/it]
 28%|██▊       | 10498/37963 [25:52:50<81:52:01, 10.73s/it]
 28%|██▊       | 10499/37963 [25:52:57<74:38:11,  9.78s/it]
 28%|██▊       | 10500/37963 [25:53:05<69:06:49,  9.06s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '2.91', 'learning_rate': '1.698e-05', 'epoch': '0.2766'}
+
 28%|██▊       | 10500/37963 [25:53:05<69:06:49,  9.06s/it]
 28%|██▊       | 10501/37963 [25:53:12<65:38:40,  8.61s/it]
 28%|██▊       | 10502/37963 [25:53:20<63:59:59,  8.39s/it]
 28%|██▊       | 10503/37963 [25:53:35<78:21:41, 10.27s/it]
 28%|██▊       | 10504/37963 [25:53:42<72:20:59,  9.49s/it]
 28%|██▊       | 10505/37963 [25:53:50<68:06:56,  8.93s/it]
 28%|██▊       | 10506/37963 [25:53:57<64:31:13,  8.46s/it]
 28%|██▊       | 10507/37963 [25:54:05<62:49:10,  8.24s/it]
 28%|██▊       | 10508/37963 [25:54:13<61:33:28,  8.07s/it]
 28%|██▊       | 10509/37963 [25:54:21<60:39:20,  7.95s/it]
 28%|██▊       | 10510/37963 [25:54:35<74:44:37,  9.80s/it]
                                                           
{'loss': '0.163', 'grad_norm': '2.828', 'learning_rate': '1.697e-05', 'epoch': '0.2768'}
+
 28%|██▊       | 10510/37963 [25:54:35<74:44:37,  9.80s/it]
 28%|██▊       | 10511/37963 [25:54:42<69:47:47,  9.15s/it]
 28%|██▊       | 10512/37963 [25:54:49<65:04:46,  8.53s/it]
 28%|██▊       | 10513/37963 [25:54:57<62:43:35,  8.23s/it]
 28%|██▊       | 10514/37963 [25:55:04<60:59:34,  8.00s/it]
 28%|██▊       | 10515/37963 [25:55:18<74:57:54,  9.83s/it]
 28%|██▊       | 10516/37963 [25:55:26<70:12:08,  9.21s/it]
 28%|██▊       | 10517/37963 [25:55:34<66:32:37,  8.73s/it]
 28%|██▊       | 10518/37963 [25:55:41<63:51:31,  8.38s/it]
 28%|██▊       | 10519/37963 [25:55:49<62:20:49,  8.18s/it]
 28%|██▊       | 10520/37963 [25:55:57<60:39:13,  7.96s/it]
                                                           
{'loss': '0.1657', 'grad_norm': '1.593', 'learning_rate': '1.697e-05', 'epoch': '0.2771'}
+
 28%|██▊       | 10520/37963 [25:55:57<60:39:13,  7.96s/it]
 28%|██▊       | 10521/37963 [25:56:04<59:44:08,  7.84s/it]
 28%|██▊       | 10522/37963 [25:56:12<59:14:06,  7.77s/it]
 28%|██▊       | 10523/37963 [25:56:19<59:04:08,  7.75s/it]
 28%|██▊       | 10524/37963 [25:56:27<58:14:34,  7.64s/it]
 28%|██▊       | 10525/37963 [25:56:34<58:10:51,  7.63s/it]
 28%|██▊       | 10526/37963 [25:56:42<57:35:43,  7.56s/it]
 28%|██▊       | 10527/37963 [25:56:50<58:04:57,  7.62s/it]
 28%|██▊       | 10528/37963 [25:56:57<57:37:04,  7.56s/it]
 28%|██▊       | 10529/37963 [25:57:05<57:39:44,  7.57s/it]
 28%|██▊       | 10530/37963 [25:57:12<58:27:17,  7.67s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '1.596', 'learning_rate': '1.696e-05', 'epoch': '0.2774'}
+
 28%|██▊       | 10530/37963 [25:57:12<58:27:17,  7.67s/it]
 28%|██▊       | 10531/37963 [25:57:20<58:24:14,  7.66s/it]
 28%|██▊       | 10532/37963 [25:57:28<58:21:20,  7.66s/it]
 28%|██▊       | 10533/37963 [25:57:35<58:12:50,  7.64s/it]
 28%|██▊       | 10534/37963 [25:57:43<57:23:43,  7.53s/it]
 28%|██▊       | 10535/37963 [25:58:03<87:14:05, 11.45s/it]
 28%|██▊       | 10536/37963 [25:58:11<78:47:54, 10.34s/it]
 28%|██▊       | 10537/37963 [25:58:26<89:37:00, 11.76s/it]
 28%|██▊       | 10538/37963 [25:58:34<80:15:31, 10.54s/it]
 28%|██▊       | 10539/37963 [25:58:42<73:56:04,  9.71s/it]
 28%|██▊       | 10540/37963 [25:58:49<69:31:06,  9.13s/it]
                                                           
{'loss': '0.1764', 'grad_norm': '1.726', 'learning_rate': '1.695e-05', 'epoch': '0.2776'}
+
 28%|██▊       | 10540/37963 [25:58:49<69:31:06,  9.13s/it]
 28%|██▊       | 10541/37963 [25:58:57<66:11:13,  8.69s/it]
 28%|██▊       | 10542/37963 [25:59:12<80:25:48, 10.56s/it]
 28%|██▊       | 10543/37963 [25:59:20<73:47:06,  9.69s/it]
 28%|██▊       | 10544/37963 [25:59:27<69:16:48,  9.10s/it]
 28%|██▊       | 10545/37963 [25:59:35<65:28:52,  8.60s/it]
 28%|██▊       | 10546/37963 [25:59:42<63:11:42,  8.30s/it]
 28%|██▊       | 10547/37963 [25:59:50<61:45:14,  8.11s/it]
 28%|██▊       | 10548/37963 [26:00:04<76:18:44, 10.02s/it]
 28%|██▊       | 10549/37963 [26:00:19<87:12:59, 11.45s/it]
 28%|██▊       | 10550/37963 [26:00:27<78:43:43, 10.34s/it]
                                                           
{'loss': '0.1738', 'grad_norm': '3.911', 'learning_rate': '1.695e-05', 'epoch': '0.2779'}
+
 28%|██▊       | 10550/37963 [26:00:27<78:43:43, 10.34s/it]
 28%|██▊       | 10551/37963 [26:00:35<72:32:09,  9.53s/it]
 28%|██▊       | 10552/37963 [26:00:42<68:20:55,  8.98s/it]
 28%|██▊       | 10553/37963 [26:00:50<65:27:24,  8.60s/it]
 28%|██▊       | 10554/37963 [26:00:57<62:49:50,  8.25s/it]
 28%|██▊       | 10555/37963 [26:01:05<61:33:47,  8.09s/it]
 28%|██▊       | 10556/37963 [26:01:13<60:27:11,  7.94s/it]
 28%|██▊       | 10557/37963 [26:01:20<59:55:39,  7.87s/it]
 28%|██▊       | 10558/37963 [26:01:28<59:22:21,  7.80s/it]
 28%|██▊       | 10559/37963 [26:01:36<58:53:59,  7.74s/it]
 28%|██▊       | 10560/37963 [26:01:43<58:42:34,  7.71s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '2.341', 'learning_rate': '1.694e-05', 'epoch': '0.2782'}
+
 28%|██▊       | 10560/37963 [26:01:43<58:42:34,  7.71s/it]
 28%|██▊       | 10561/37963 [26:01:51<58:36:12,  7.70s/it]
 28%|██▊       | 10562/37963 [26:02:05<73:32:53,  9.66s/it]
 28%|██▊       | 10563/37963 [26:02:13<68:53:40,  9.05s/it]
 28%|██▊       | 10564/37963 [26:02:27<80:42:46, 10.61s/it]
 28%|██▊       | 10565/37963 [26:02:35<74:12:38,  9.75s/it]
 28%|██▊       | 10566/37963 [26:02:42<68:44:25,  9.03s/it]
 28%|██▊       | 10567/37963 [26:02:50<65:39:23,  8.63s/it]
 28%|██▊       | 10568/37963 [26:02:58<63:44:44,  8.38s/it]
 28%|██▊       | 10569/37963 [26:03:05<62:09:13,  8.17s/it]
 28%|██▊       | 10570/37963 [26:03:13<61:16:37,  8.05s/it]
                                                           
{'loss': '0.1697', 'grad_norm': '2.207', 'learning_rate': '1.693e-05', 'epoch': '0.2784'}
+
 28%|██▊       | 10570/37963 [26:03:13<61:16:37,  8.05s/it]
 28%|██▊       | 10571/37963 [26:03:21<60:17:36,  7.92s/it]
 28%|██▊       | 10572/37963 [26:03:29<59:48:08,  7.86s/it]
 28%|██▊       | 10573/37963 [26:03:36<59:33:19,  7.83s/it]
 28%|██▊       | 10574/37963 [26:03:44<58:59:43,  7.75s/it]
 28%|██▊       | 10575/37963 [26:03:52<58:52:09,  7.74s/it]
 28%|██▊       | 10576/37963 [26:03:59<58:32:23,  7.70s/it]
 28%|██▊       | 10577/37963 [26:04:07<58:42:46,  7.72s/it]
 28%|██▊       | 10578/37963 [26:04:15<58:31:50,  7.69s/it]
 28%|██▊       | 10579/37963 [26:04:22<58:03:39,  7.63s/it]
 28%|██▊       | 10580/37963 [26:04:30<57:57:30,  7.62s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '1.781', 'learning_rate': '1.693e-05', 'epoch': '0.2787'}
+
 28%|██▊       | 10580/37963 [26:04:30<57:57:30,  7.62s/it]
 28%|██▊       | 10581/37963 [26:04:44<73:47:19,  9.70s/it]
 28%|██▊       | 10582/37963 [26:04:52<69:23:19,  9.12s/it]
 28%|██▊       | 10583/37963 [26:05:06<80:20:54, 10.56s/it]
 28%|██▊       | 10584/37963 [26:05:20<89:15:44, 11.74s/it]
 28%|██▊       | 10585/37963 [26:05:28<79:38:45, 10.47s/it]
 28%|██▊       | 10586/37963 [26:05:35<72:55:40,  9.59s/it]
 28%|██▊       | 10587/37963 [26:05:43<68:33:49,  9.02s/it]
 28%|██▊       | 10588/37963 [26:05:51<65:41:35,  8.64s/it]
 28%|██▊       | 10589/37963 [26:05:58<63:11:37,  8.31s/it]
 28%|██▊       | 10590/37963 [26:06:13<76:38:22, 10.08s/it]
                                                           
{'loss': '0.1677', 'grad_norm': '2.958', 'learning_rate': '1.692e-05', 'epoch': '0.279'}
+
 28%|██▊       | 10590/37963 [26:06:13<76:38:22, 10.08s/it]
 28%|██▊       | 10591/37963 [26:06:20<71:17:08,  9.38s/it]
 28%|██▊       | 10592/37963 [26:06:28<67:37:43,  8.89s/it]
 28%|██▊       | 10593/37963 [26:06:36<64:46:44,  8.52s/it]
 28%|██▊       | 10594/37963 [26:06:43<62:44:57,  8.25s/it]
 28%|██▊       | 10595/37963 [26:06:51<61:26:59,  8.08s/it]
 28%|██▊       | 10596/37963 [26:06:59<60:40:59,  7.98s/it]
 28%|██▊       | 10597/37963 [26:07:06<59:29:34,  7.83s/it]
 28%|██▊       | 10598/37963 [26:07:14<59:09:38,  7.78s/it]
 28%|██▊       | 10599/37963 [26:07:36<90:52:01, 11.95s/it]
 28%|██▊       | 10600/37963 [26:07:43<80:58:57, 10.65s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '3.606', 'learning_rate': '1.692e-05', 'epoch': '0.2792'}
+
 28%|██▊       | 10600/37963 [26:07:43<80:58:57, 10.65s/it]
 28%|██▊       | 10601/37963 [26:07:51<74:15:48,  9.77s/it]
 28%|██▊       | 10602/37963 [26:07:59<69:32:03,  9.15s/it]
 28%|██▊       | 10603/37963 [26:08:06<65:36:15,  8.63s/it]
 28%|██▊       | 10604/37963 [26:08:14<63:20:17,  8.33s/it]
 28%|██▊       | 10605/37963 [26:08:22<62:03:44,  8.17s/it]
 28%|██▊       | 10606/37963 [26:08:29<60:02:06,  7.90s/it]
 28%|██▊       | 10607/37963 [26:08:36<59:25:22,  7.82s/it]
 28%|██▊       | 10608/37963 [26:08:44<58:27:47,  7.69s/it]
 28%|██▊       | 10609/37963 [26:08:52<58:29:04,  7.70s/it]
 28%|██▊       | 10610/37963 [26:08:59<57:51:16,  7.61s/it]
                                                           
{'loss': '0.1732', 'grad_norm': '3.011', 'learning_rate': '1.691e-05', 'epoch': '0.2795'}
+
 28%|██▊       | 10610/37963 [26:08:59<57:51:16,  7.61s/it]
 28%|██▊       | 10611/37963 [26:09:13<72:52:53,  9.59s/it]
 28%|██▊       | 10612/37963 [26:09:28<83:45:55, 11.03s/it]
 28%|██▊       | 10613/37963 [26:09:35<76:18:29, 10.04s/it]
 28%|██▊       | 10614/37963 [26:09:43<70:50:20,  9.32s/it]
 28%|██▊       | 10615/37963 [26:09:51<67:44:46,  8.92s/it]
 28%|██▊       | 10616/37963 [26:09:59<64:55:20,  8.55s/it]
 28%|██▊       | 10617/37963 [26:10:06<62:09:54,  8.18s/it]
 28%|██▊       | 10618/37963 [26:10:13<60:45:33,  8.00s/it]
 28%|██▊       | 10619/37963 [26:10:21<59:54:17,  7.89s/it]
 28%|██▊       | 10620/37963 [26:10:29<59:22:59,  7.82s/it]
                                                           
{'loss': '0.1799', 'grad_norm': '2.474', 'learning_rate': '1.69e-05', 'epoch': '0.2797'}
+
 28%|██▊       | 10620/37963 [26:10:29<59:22:59,  7.82s/it]
 28%|██▊       | 10621/37963 [26:10:36<57:54:10,  7.62s/it]
 28%|██▊       | 10622/37963 [26:10:44<57:53:17,  7.62s/it]
 28%|██▊       | 10623/37963 [26:10:51<57:19:49,  7.55s/it]
 28%|██▊       | 10624/37963 [26:10:59<57:35:09,  7.58s/it]
 28%|██▊       | 10625/37963 [26:11:06<57:23:07,  7.56s/it]
 28%|██▊       | 10626/37963 [26:11:14<57:18:55,  7.55s/it]
 28%|██▊       | 10627/37963 [26:11:21<56:42:48,  7.47s/it]
 28%|██▊       | 10628/37963 [26:11:28<56:34:35,  7.45s/it]
 28%|██▊       | 10629/37963 [26:11:36<56:53:42,  7.49s/it]
 28%|██▊       | 10630/37963 [26:11:50<72:11:32,  9.51s/it]
                                                           
{'loss': '0.1703', 'grad_norm': '2.037', 'learning_rate': '1.69e-05', 'epoch': '0.28'}
+
 28%|██▊       | 10630/37963 [26:11:50<72:11:32,  9.51s/it]
 28%|██▊       | 10631/37963 [26:11:58<67:50:17,  8.94s/it]
 28%|██▊       | 10632/37963 [26:12:05<64:36:21,  8.51s/it]
 28%|██▊       | 10633/37963 [26:12:27<95:22:53, 12.56s/it]
 28%|██▊       | 10634/37963 [26:12:35<83:38:14, 11.02s/it]
 28%|██▊       | 10635/37963 [26:12:42<76:02:21, 10.02s/it]
 28%|██▊       | 10636/37963 [26:12:50<70:21:53,  9.27s/it]
 28%|██▊       | 10637/37963 [26:12:58<67:13:37,  8.86s/it]
 28%|██▊       | 10638/37963 [26:13:05<64:18:37,  8.47s/it]
 28%|██▊       | 10639/37963 [26:13:13<62:45:18,  8.27s/it]
 28%|██▊       | 10640/37963 [26:13:28<78:27:54, 10.34s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '2.791', 'learning_rate': '1.689e-05', 'epoch': '0.2803'}
+
 28%|██▊       | 10640/37963 [26:13:28<78:27:54, 10.34s/it]
 28%|██▊       | 10641/37963 [26:13:36<72:20:51,  9.53s/it]
 28%|██▊       | 10642/37963 [26:13:44<67:58:55,  8.96s/it]
 28%|██▊       | 10643/37963 [26:13:52<65:50:14,  8.68s/it]
 28%|██▊       | 10644/37963 [26:13:59<63:37:58,  8.39s/it]
 28%|██▊       | 10645/37963 [26:14:07<62:06:45,  8.19s/it]
 28%|██▊       | 10646/37963 [26:14:15<61:02:11,  8.04s/it]
 28%|██▊       | 10647/37963 [26:14:22<60:03:37,  7.92s/it]
 28%|██▊       | 10648/37963 [26:14:30<59:40:47,  7.87s/it]
 28%|██▊       | 10649/37963 [26:14:38<58:48:43,  7.75s/it]
 28%|██▊       | 10650/37963 [26:14:45<58:43:42,  7.74s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '1.318', 'learning_rate': '1.689e-05', 'epoch': '0.2805'}
+
 28%|██▊       | 10650/37963 [26:14:45<58:43:42,  7.74s/it]
 28%|██▊       | 10651/37963 [26:15:00<74:38:46,  9.84s/it]
 28%|██▊       | 10652/37963 [26:15:15<86:08:11, 11.35s/it]
 28%|██▊       | 10653/37963 [26:15:23<77:37:09, 10.23s/it]
 28%|██▊       | 10654/37963 [26:15:30<71:38:53,  9.45s/it]
 28%|██▊       | 10655/37963 [26:15:37<66:44:34,  8.80s/it]
 28%|██▊       | 10656/37963 [26:15:45<63:20:59,  8.35s/it]
 28%|██▊       | 10657/37963 [26:15:52<61:52:52,  8.16s/it]
 28%|██▊       | 10658/37963 [26:16:00<60:31:49,  7.98s/it]
 28%|██▊       | 10659/37963 [26:16:07<59:10:59,  7.80s/it]
 28%|██▊       | 10660/37963 [26:16:15<58:45:13,  7.75s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '2.899', 'learning_rate': '1.688e-05', 'epoch': '0.2808'}
+
 28%|██▊       | 10660/37963 [26:16:15<58:45:13,  7.75s/it]
 28%|██▊       | 10661/37963 [26:16:23<58:37:53,  7.73s/it]
 28%|██▊       | 10662/37963 [26:16:30<58:29:35,  7.71s/it]
 28%|██▊       | 10663/37963 [26:16:38<58:15:19,  7.68s/it]
 28%|██▊       | 10664/37963 [26:16:59<87:59:42, 11.60s/it]
 28%|██▊       | 10665/37963 [26:17:06<78:59:14, 10.42s/it]
 28%|██▊       | 10666/37963 [26:17:14<72:36:47,  9.58s/it]
 28%|██▊       | 10667/37963 [26:17:22<68:23:39,  9.02s/it]
 28%|██▊       | 10668/37963 [26:17:29<65:15:32,  8.61s/it]
 28%|██▊       | 10669/37963 [26:17:37<63:03:10,  8.32s/it]
 28%|██▊       | 10670/37963 [26:17:45<61:38:16,  8.13s/it]
                                                           
{'loss': '0.1696', 'grad_norm': '2.607', 'learning_rate': '1.687e-05', 'epoch': '0.2811'}
+
 28%|██▊       | 10670/37963 [26:17:45<61:38:16,  8.13s/it]
 28%|██▊       | 10671/37963 [26:17:52<60:30:50,  7.98s/it]
 28%|██▊       | 10672/37963 [26:18:00<59:27:37,  7.84s/it]
 28%|██▊       | 10673/37963 [26:18:07<58:09:22,  7.67s/it]
 28%|██▊       | 10674/37963 [26:18:15<58:04:24,  7.66s/it]
 28%|██▊       | 10675/37963 [26:18:23<58:16:37,  7.69s/it]
 28%|██▊       | 10676/37963 [26:18:30<57:31:23,  7.59s/it]
 28%|██▊       | 10677/37963 [26:18:37<57:01:47,  7.52s/it]
 28%|██▊       | 10678/37963 [26:18:45<57:15:18,  7.55s/it]
 28%|██▊       | 10679/37963 [26:18:53<57:37:03,  7.60s/it]
 28%|██▊       | 10680/37963 [26:19:00<57:32:21,  7.59s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '3.894', 'learning_rate': '1.687e-05', 'epoch': '0.2813'}
+
 28%|██▊       | 10680/37963 [26:19:00<57:32:21,  7.59s/it]
 28%|██▊       | 10681/37963 [26:19:22<89:06:11, 11.76s/it]
 28%|██▊       | 10682/37963 [26:19:29<79:35:46, 10.50s/it]
 28%|██▊       | 10683/37963 [26:19:37<72:32:47,  9.57s/it]
 28%|██▊       | 10684/37963 [26:19:44<68:04:26,  8.98s/it]
 28%|██▊       | 10685/37963 [26:19:52<64:32:24,  8.52s/it]
 28%|██▊       | 10686/37963 [26:19:59<61:55:18,  8.17s/it]
 28%|██▊       | 10687/37963 [26:20:07<60:42:04,  8.01s/it]
 28%|██▊       | 10688/37963 [26:20:14<59:43:07,  7.88s/it]
 28%|██▊       | 10689/37963 [26:20:22<59:28:45,  7.85s/it]
 28%|██▊       | 10690/37963 [26:20:30<58:51:45,  7.77s/it]
                                                           
{'loss': '0.1763', 'grad_norm': '4.044', 'learning_rate': '1.686e-05', 'epoch': '0.2816'}
+
 28%|██▊       | 10690/37963 [26:20:30<58:51:45,  7.77s/it]
 28%|██▊       | 10691/37963 [26:20:44<74:13:51,  9.80s/it]
 28%|██▊       | 10692/37963 [26:20:52<69:04:35,  9.12s/it]
 28%|██▊       | 10693/37963 [26:20:59<65:51:27,  8.69s/it]
 28%|██▊       | 10694/37963 [26:21:07<63:34:36,  8.39s/it]
 28%|██▊       | 10695/37963 [26:21:15<61:49:43,  8.16s/it]
 28%|██▊       | 10696/37963 [26:21:22<60:37:50,  8.00s/it]
 28%|██▊       | 10697/37963 [26:21:37<74:56:01,  9.89s/it]
 28%|██▊       | 10698/37963 [26:21:44<70:16:05,  9.28s/it]
 28%|██▊       | 10699/37963 [26:21:52<65:57:05,  8.71s/it]
 28%|██▊       | 10700/37963 [26:21:59<63:29:24,  8.38s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '1.648', 'learning_rate': '1.685e-05', 'epoch': '0.2819'}
+
 28%|██▊       | 10700/37963 [26:21:59<63:29:24,  8.38s/it]
 28%|██▊       | 10701/37963 [26:22:07<61:38:26,  8.14s/it]
 28%|██▊       | 10702/37963 [26:22:15<60:39:07,  8.01s/it]
 28%|██▊       | 10703/37963 [26:22:22<59:48:03,  7.90s/it]
 28%|██▊       | 10704/37963 [26:22:37<74:29:23,  9.84s/it]
 28%|██▊       | 10705/37963 [26:22:45<70:12:57,  9.27s/it]
 28%|██▊       | 10706/37963 [26:22:52<66:12:35,  8.74s/it]
 28%|██▊       | 10707/37963 [26:23:00<63:36:55,  8.40s/it]
 28%|██▊       | 10708/37963 [26:23:14<76:03:29, 10.05s/it]
 28%|██▊       | 10709/37963 [26:23:21<70:50:13,  9.36s/it]
 28%|██▊       | 10710/37963 [26:23:29<66:28:12,  8.78s/it]
                                                           
{'loss': '0.165', 'grad_norm': '0.7663', 'learning_rate': '1.685e-05', 'epoch': '0.2821'}
+
 28%|██▊       | 10710/37963 [26:23:29<66:28:12,  8.78s/it]
 28%|██▊       | 10711/37963 [26:23:37<64:12:52,  8.48s/it]
 28%|██▊       | 10712/37963 [26:23:51<77:08:36, 10.19s/it]
 28%|██▊       | 10713/37963 [26:23:59<71:22:14,  9.43s/it]
 28%|██▊       | 10714/37963 [26:24:06<67:30:53,  8.92s/it]
 28%|██▊       | 10715/37963 [26:24:14<64:14:24,  8.49s/it]
 28%|██▊       | 10716/37963 [26:24:21<62:29:31,  8.26s/it]
 28%|██▊       | 10717/37963 [26:24:29<60:26:56,  7.99s/it]
 28%|██▊       | 10718/37963 [26:24:36<59:07:51,  7.81s/it]
 28%|██▊       | 10719/37963 [26:24:44<58:51:02,  7.78s/it]
 28%|██▊       | 10720/37963 [26:24:51<57:51:32,  7.65s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '2.369', 'learning_rate': '1.684e-05', 'epoch': '0.2824'}
+
 28%|██▊       | 10720/37963 [26:24:51<57:51:32,  7.65s/it]
 28%|██▊       | 10721/37963 [26:24:59<57:44:12,  7.63s/it]
 28%|██▊       | 10722/37963 [26:25:07<58:08:31,  7.68s/it]
 28%|██▊       | 10723/37963 [26:25:14<58:05:19,  7.68s/it]
 28%|██▊       | 10724/37963 [26:25:22<57:37:53,  7.62s/it]
 28%|██▊       | 10725/37963 [26:25:36<72:52:43,  9.63s/it]
 28%|██▊       | 10726/37963 [26:25:50<82:33:37, 10.91s/it]
 28%|██▊       | 10727/37963 [26:25:58<75:29:10,  9.98s/it]
 28%|██▊       | 10728/37963 [26:26:05<70:06:31,  9.27s/it]
 28%|██▊       | 10729/37963 [26:26:13<66:21:08,  8.77s/it]
 28%|██▊       | 10730/37963 [26:26:28<80:51:37, 10.69s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '1.873', 'learning_rate': '1.684e-05', 'epoch': '0.2826'}
+
 28%|██▊       | 10730/37963 [26:26:28<80:51:37, 10.69s/it]
 28%|██▊       | 10731/37963 [26:26:36<73:35:43,  9.73s/it]
 28%|██▊       | 10732/37963 [26:26:43<68:34:41,  9.07s/it]
 28%|██▊       | 10733/37963 [26:26:51<65:12:26,  8.62s/it]
 28%|██▊       | 10734/37963 [26:26:58<63:02:37,  8.34s/it]
 28%|██▊       | 10735/37963 [26:27:06<61:34:52,  8.14s/it]
 28%|██▊       | 10736/37963 [26:27:14<60:25:36,  7.99s/it]
 28%|██▊       | 10737/37963 [26:27:21<59:43:43,  7.90s/it]
 28%|██▊       | 10738/37963 [26:27:36<75:21:04,  9.96s/it]
 28%|██▊       | 10739/37963 [26:27:44<70:41:25,  9.35s/it]
 28%|██▊       | 10740/37963 [26:27:52<66:52:40,  8.84s/it]
                                                           
{'loss': '0.1691', 'grad_norm': '1.688', 'learning_rate': '1.683e-05', 'epoch': '0.2829'}
+
 28%|██▊       | 10740/37963 [26:27:52<66:52:40,  8.84s/it]
 28%|██▊       | 10741/37963 [26:27:59<63:58:22,  8.46s/it]
 28%|██▊       | 10742/37963 [26:28:07<62:07:35,  8.22s/it]
 28%|██▊       | 10743/37963 [26:28:14<60:18:52,  7.98s/it]
 28%|██▊       | 10744/37963 [26:28:22<59:37:16,  7.89s/it]
 28%|██▊       | 10745/37963 [26:28:30<59:06:16,  7.82s/it]
 28%|██▊       | 10746/37963 [26:28:45<75:09:29,  9.94s/it]
 28%|██▊       | 10747/37963 [26:28:52<69:54:32,  9.25s/it]
 28%|██▊       | 10748/37963 [26:29:00<65:57:09,  8.72s/it]
 28%|██▊       | 10749/37963 [26:29:15<79:40:42, 10.54s/it]
 28%|██▊       | 10750/37963 [26:29:22<72:53:40,  9.64s/it]
                                                           
{'loss': '0.1745', 'grad_norm': '1.544', 'learning_rate': '1.682e-05', 'epoch': '0.2832'}
+
 28%|██▊       | 10750/37963 [26:29:22<72:53:40,  9.64s/it]
 28%|██▊       | 10751/37963 [26:29:30<68:30:39,  9.06s/it]
 28%|██▊       | 10752/37963 [26:29:38<65:25:34,  8.66s/it]
 28%|██▊       | 10753/37963 [26:29:45<62:31:49,  8.27s/it]
 28%|██▊       | 10754/37963 [26:29:53<60:55:00,  8.06s/it]
 28%|██▊       | 10755/37963 [26:30:00<59:22:31,  7.86s/it]
 28%|██▊       | 10756/37963 [26:30:15<75:14:29,  9.96s/it]
 28%|██▊       | 10757/37963 [26:30:22<70:10:07,  9.28s/it]
 28%|██▊       | 10758/37963 [26:30:30<66:28:52,  8.80s/it]
 28%|██▊       | 10759/37963 [26:30:38<63:36:09,  8.42s/it]
 28%|██▊       | 10760/37963 [26:30:45<61:59:30,  8.20s/it]
                                                           
{'loss': '0.1762', 'grad_norm': '1.524', 'learning_rate': '1.682e-05', 'epoch': '0.2834'}
+
 28%|██▊       | 10760/37963 [26:30:45<61:59:30,  8.20s/it]
 28%|██▊       | 10761/37963 [26:30:59<75:02:14,  9.93s/it]
 28%|██▊       | 10762/37963 [26:31:07<69:42:01,  9.22s/it]
 28%|██▊       | 10763/37963 [26:31:15<66:16:30,  8.77s/it]
 28%|██▊       | 10764/37963 [26:31:22<63:25:29,  8.39s/it]
 28%|██▊       | 10765/37963 [26:31:30<61:42:42,  8.17s/it]
 28%|██▊       | 10766/37963 [26:31:37<60:28:50,  8.01s/it]
 28%|██▊       | 10767/37963 [26:31:45<59:46:09,  7.91s/it]
 28%|██▊       | 10768/37963 [26:31:53<59:13:56,  7.84s/it]
 28%|██▊       | 10769/37963 [26:32:00<58:59:35,  7.81s/it]
 28%|██▊       | 10770/37963 [26:32:15<73:49:18,  9.77s/it]
                                                           
{'loss': '0.1761', 'grad_norm': '3.402', 'learning_rate': '1.681e-05', 'epoch': '0.2837'}
+
 28%|██▊       | 10770/37963 [26:32:15<73:49:18,  9.77s/it]
 28%|██▊       | 10771/37963 [26:32:23<69:13:12,  9.16s/it]
 28%|██▊       | 10772/37963 [26:32:30<65:48:57,  8.71s/it]
 28%|██▊       | 10773/37963 [26:32:38<62:40:54,  8.30s/it]
 28%|██▊       | 10774/37963 [26:32:45<61:14:16,  8.11s/it]
 28%|██▊       | 10775/37963 [26:33:00<76:36:35, 10.14s/it]
 28%|██▊       | 10776/37963 [26:33:08<70:48:49,  9.38s/it]
 28%|██▊       | 10777/37963 [26:33:15<67:07:45,  8.89s/it]
 28%|██▊       | 10778/37963 [26:33:30<79:08:11, 10.48s/it]
 28%|██▊       | 10779/37963 [26:33:37<73:03:40,  9.68s/it]
 28%|██▊       | 10780/37963 [26:33:45<68:33:20,  9.08s/it]
                                                           
{'loss': '0.1709', 'grad_norm': '1.108', 'learning_rate': '1.68e-05', 'epoch': '0.284'}
+
 28%|██▊       | 10780/37963 [26:33:45<68:33:20,  9.08s/it]
 28%|██▊       | 10781/37963 [26:33:53<65:23:43,  8.66s/it]
 28%|██▊       | 10782/37963 [26:34:00<63:00:50,  8.35s/it]
 28%|██▊       | 10783/37963 [26:34:08<61:37:08,  8.16s/it]
 28%|██▊       | 10784/37963 [26:34:16<60:05:36,  7.96s/it]
 28%|██▊       | 10785/37963 [26:34:23<59:41:58,  7.91s/it]
 28%|██▊       | 10786/37963 [26:34:31<58:57:55,  7.81s/it]
 28%|██▊       | 10787/37963 [26:34:39<58:45:13,  7.78s/it]
 28%|██▊       | 10788/37963 [26:34:47<58:49:39,  7.79s/it]
 28%|██▊       | 10789/37963 [26:35:02<75:07:59,  9.95s/it]
 28%|██▊       | 10790/37963 [26:35:09<69:12:39,  9.17s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '3.627', 'learning_rate': '1.68e-05', 'epoch': '0.2842'}
+
 28%|██▊       | 10790/37963 [26:35:09<69:12:39,  9.17s/it]
 28%|██▊       | 10791/37963 [26:35:16<65:23:58,  8.66s/it]
 28%|██▊       | 10792/37963 [26:35:31<79:02:05, 10.47s/it]
 28%|██▊       | 10793/37963 [26:35:46<89:29:28, 11.86s/it]
 28%|██▊       | 10794/37963 [26:35:54<80:11:16, 10.63s/it]
 28%|██▊       | 10795/37963 [26:36:02<73:21:47,  9.72s/it]
 28%|██▊       | 10796/37963 [26:36:09<68:25:07,  9.07s/it]
 28%|██▊       | 10797/37963 [26:36:17<65:14:25,  8.65s/it]
 28%|██▊       | 10798/37963 [26:36:25<63:17:21,  8.39s/it]
 28%|██▊       | 10799/37963 [26:36:32<61:49:11,  8.19s/it]
 28%|██▊       | 10800/37963 [26:36:40<60:42:25,  8.05s/it]
                                                           
{'loss': '0.1648', 'grad_norm': '3.229', 'learning_rate': '1.679e-05', 'epoch': '0.2845'}
+
 28%|██▊       | 10800/37963 [26:36:40<60:42:25,  8.05s/it]
 28%|██▊       | 10801/37963 [26:36:48<59:44:53,  7.92s/it]
 28%|██▊       | 10802/37963 [26:36:55<58:39:28,  7.77s/it]
 28%|██▊       | 10803/37963 [26:37:09<72:50:55,  9.66s/it]
 28%|██▊       | 10804/37963 [26:37:17<67:50:11,  8.99s/it]
 28%|██▊       | 10805/37963 [26:37:24<64:44:48,  8.58s/it]
 28%|██▊       | 10806/37963 [26:37:32<62:26:33,  8.28s/it]
 28%|██▊       | 10807/37963 [26:37:39<61:09:29,  8.11s/it]
 28%|██▊       | 10808/37963 [26:37:47<59:40:39,  7.91s/it]
 28%|██▊       | 10809/37963 [26:37:54<58:25:34,  7.75s/it]
 28%|██▊       | 10810/37963 [26:38:02<57:24:48,  7.61s/it]
                                                           
{'loss': '0.1684', 'grad_norm': '1.96', 'learning_rate': '1.679e-05', 'epoch': '0.2848'}
+
 28%|██▊       | 10810/37963 [26:38:02<57:24:48,  7.61s/it]
 28%|██▊       | 10811/37963 [26:38:09<57:43:46,  7.65s/it]
 28%|██▊       | 10812/37963 [26:38:23<72:05:06,  9.56s/it]
 28%|██▊       | 10813/37963 [26:38:31<67:49:57,  8.99s/it]
 28%|██▊       | 10814/37963 [26:38:45<79:59:11, 10.61s/it]
 28%|██▊       | 10815/37963 [26:38:53<72:55:19,  9.67s/it]
 28%|██▊       | 10816/37963 [26:39:01<68:38:20,  9.10s/it]
 28%|██▊       | 10817/37963 [26:39:08<64:59:44,  8.62s/it]
 28%|██▊       | 10818/37963 [26:39:16<62:44:38,  8.32s/it]
 28%|██▊       | 10819/37963 [26:39:23<61:27:34,  8.15s/it]
 29%|██▊       | 10820/37963 [26:39:31<60:00:06,  7.96s/it]
                                                           
{'loss': '0.1657', 'grad_norm': '5.585', 'learning_rate': '1.678e-05', 'epoch': '0.285'}
+
 29%|██▊       | 10820/37963 [26:39:31<60:00:06,  7.96s/it]
 29%|██▊       | 10821/37963 [26:39:39<59:17:20,  7.86s/it]
 29%|██▊       | 10822/37963 [26:39:46<58:53:56,  7.81s/it]
 29%|██▊       | 10823/37963 [26:39:54<58:42:38,  7.79s/it]
 29%|██▊       | 10824/37963 [26:40:09<73:48:05,  9.79s/it]
 29%|██▊       | 10825/37963 [26:40:16<68:59:51,  9.15s/it]
 29%|██▊       | 10826/37963 [26:40:24<65:14:59,  8.66s/it]
 29%|██▊       | 10827/37963 [26:40:31<63:11:28,  8.38s/it]
 29%|██▊       | 10828/37963 [26:40:39<61:22:20,  8.14s/it]
 29%|██▊       | 10829/37963 [26:40:54<76:00:13, 10.08s/it]
 29%|██▊       | 10830/37963 [26:41:01<70:46:36,  9.39s/it]
                                                           
{'loss': '0.1809', 'grad_norm': '6.163', 'learning_rate': '1.677e-05', 'epoch': '0.2853'}
+
 29%|██▊       | 10830/37963 [26:41:01<70:46:36,  9.39s/it]
 29%|██▊       | 10831/37963 [26:41:09<66:51:14,  8.87s/it]
 29%|██▊       | 10832/37963 [26:41:17<64:10:26,  8.52s/it]
 29%|██▊       | 10833/37963 [26:41:24<62:29:17,  8.29s/it]
 29%|██▊       | 10834/37963 [26:41:32<60:48:21,  8.07s/it]
 29%|██▊       | 10835/37963 [26:41:40<59:45:30,  7.93s/it]
 29%|██▊       | 10836/37963 [26:41:47<59:14:56,  7.86s/it]
 29%|██▊       | 10837/37963 [26:41:55<58:24:43,  7.75s/it]
 29%|██▊       | 10838/37963 [26:42:10<74:07:13,  9.84s/it]
 29%|██▊       | 10839/37963 [26:42:24<85:24:03, 11.33s/it]
 29%|██▊       | 10840/37963 [26:42:32<76:47:25, 10.19s/it]
                                                           
{'loss': '0.1636', 'grad_norm': '5.598', 'learning_rate': '1.677e-05', 'epoch': '0.2855'}
+
 29%|██▊       | 10840/37963 [26:42:32<76:47:25, 10.19s/it]
 29%|██▊       | 10841/37963 [26:42:40<71:02:44,  9.43s/it]
 29%|██▊       | 10842/37963 [26:42:47<67:21:39,  8.94s/it]
 29%|██▊       | 10843/37963 [26:42:55<63:39:11,  8.45s/it]
 29%|██▊       | 10844/37963 [26:43:02<61:52:59,  8.21s/it]
 29%|██▊       | 10845/37963 [26:43:17<76:26:50, 10.15s/it]
 29%|██▊       | 10846/37963 [26:43:25<70:48:51,  9.40s/it]
 29%|██▊       | 10847/37963 [26:43:32<66:53:33,  8.88s/it]
 29%|██▊       | 10848/37963 [26:43:40<64:03:47,  8.51s/it]
 29%|██▊       | 10849/37963 [26:43:48<62:10:59,  8.26s/it]
 29%|██▊       | 10850/37963 [26:43:55<60:34:45,  8.04s/it]
                                                           
{'loss': '0.159', 'grad_norm': '3.809', 'learning_rate': '1.676e-05', 'epoch': '0.2858'}
+
 29%|██▊       | 10850/37963 [26:43:55<60:34:45,  8.04s/it]
 29%|██▊       | 10851/37963 [26:44:03<59:28:07,  7.90s/it]
 29%|██▊       | 10852/37963 [26:44:10<58:27:08,  7.76s/it]
 29%|██▊       | 10853/37963 [26:44:18<57:51:55,  7.68s/it]
 29%|██▊       | 10854/37963 [26:44:25<57:52:25,  7.69s/it]
 29%|██▊       | 10855/37963 [26:44:33<58:12:14,  7.73s/it]
 29%|██▊       | 10856/37963 [26:44:41<58:06:19,  7.72s/it]
 29%|██▊       | 10857/37963 [26:44:55<72:31:37,  9.63s/it]
 29%|██▊       | 10858/37963 [26:45:03<68:38:35,  9.12s/it]
 29%|██▊       | 10859/37963 [26:45:10<64:51:51,  8.62s/it]
 29%|██▊       | 10860/37963 [26:45:18<62:19:09,  8.28s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '1.753', 'learning_rate': '1.675e-05', 'epoch': '0.2861'}
+
 29%|██▊       | 10860/37963 [26:45:18<62:19:09,  8.28s/it]
 29%|██▊       | 10861/37963 [26:45:32<75:45:02, 10.06s/it]
 29%|██▊       | 10862/37963 [26:45:46<85:32:33, 11.36s/it]
 29%|██▊       | 10863/37963 [26:45:54<76:43:52, 10.19s/it]
 29%|██▊       | 10864/37963 [26:46:02<71:10:47,  9.46s/it]
 29%|██▊       | 10865/37963 [26:46:09<67:10:20,  8.92s/it]
 29%|██▊       | 10866/37963 [26:46:17<64:26:21,  8.56s/it]
 29%|██▊       | 10867/37963 [26:46:25<62:26:42,  8.30s/it]
 29%|██▊       | 10868/37963 [26:46:32<60:52:16,  8.09s/it]
 29%|██▊       | 10869/37963 [26:46:40<59:48:48,  7.95s/it]
 29%|██▊       | 10870/37963 [26:46:48<59:09:48,  7.86s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '0.7432', 'learning_rate': '1.675e-05', 'epoch': '0.2863'}
+
 29%|██▊       | 10870/37963 [26:46:48<59:09:48,  7.86s/it]
 29%|██▊       | 10871/37963 [26:46:55<58:37:57,  7.79s/it]
 29%|██▊       | 10872/37963 [26:47:03<58:19:32,  7.75s/it]
 29%|██▊       | 10873/37963 [26:47:17<73:26:14,  9.76s/it]
 29%|██▊       | 10874/37963 [26:47:25<68:40:35,  9.13s/it]
 29%|██▊       | 10875/37963 [26:47:32<64:30:55,  8.57s/it]
 29%|██▊       | 10876/37963 [26:47:39<61:24:47,  8.16s/it]
 29%|██▊       | 10877/37963 [26:47:47<60:03:54,  7.98s/it]
 29%|██▊       | 10878/37963 [26:47:55<59:22:44,  7.89s/it]
 29%|██▊       | 10879/37963 [26:48:02<57:58:37,  7.71s/it]
 29%|██▊       | 10880/37963 [26:48:10<57:48:05,  7.68s/it]
                                                           
{'loss': '0.1716', 'grad_norm': '2.062', 'learning_rate': '1.674e-05', 'epoch': '0.2866'}
+
 29%|██▊       | 10880/37963 [26:48:10<57:48:05,  7.68s/it]
 29%|██▊       | 10881/37963 [26:48:17<57:33:13,  7.65s/it]
 29%|██▊       | 10882/37963 [26:48:25<57:44:54,  7.68s/it]
 29%|██▊       | 10883/37963 [26:48:47<89:33:52, 11.91s/it]
 29%|██▊       | 10884/37963 [26:48:55<80:34:56, 10.71s/it]
 29%|██▊       | 10885/37963 [26:49:02<73:55:05,  9.83s/it]
 29%|██▊       | 10886/37963 [26:49:10<69:01:06,  9.18s/it]
 29%|██▊       | 10887/37963 [26:49:18<65:28:09,  8.70s/it]
 29%|██▊       | 10888/37963 [26:49:32<78:44:54, 10.47s/it]
 29%|██▊       | 10889/37963 [26:49:40<72:41:14,  9.67s/it]
 29%|██▊       | 10890/37963 [26:49:48<68:08:30,  9.06s/it]
                                                           
{'loss': '0.1689', 'grad_norm': '1.853', 'learning_rate': '1.674e-05', 'epoch': '0.2869'}
+
 29%|██▊       | 10890/37963 [26:49:48<68:08:30,  9.06s/it]
 29%|██▊       | 10891/37963 [26:49:55<64:54:13,  8.63s/it]
 29%|██▊       | 10892/37963 [26:50:03<62:13:29,  8.27s/it]
 29%|██▊       | 10893/37963 [26:50:10<60:46:11,  8.08s/it]
 29%|██▊       | 10894/37963 [26:50:18<60:01:44,  7.98s/it]
 29%|██▊       | 10895/37963 [26:50:32<73:51:48,  9.82s/it]
 29%|██▊       | 10896/37963 [26:50:40<69:01:26,  9.18s/it]
 29%|██▊       | 10897/37963 [26:50:47<65:04:31,  8.66s/it]
 29%|██▊       | 10898/37963 [26:50:55<62:50:15,  8.36s/it]
 29%|██▊       | 10899/37963 [26:51:02<60:38:10,  8.07s/it]
 29%|██▊       | 10900/37963 [26:51:10<59:41:31,  7.94s/it]
                                                           
{'loss': '0.1728', 'grad_norm': '1.418', 'learning_rate': '1.673e-05', 'epoch': '0.2871'}
+
 29%|██▊       | 10900/37963 [26:51:10<59:41:31,  7.94s/it]
 29%|██▊       | 10901/37963 [26:51:18<59:11:14,  7.87s/it]
 29%|██▊       | 10902/37963 [26:51:25<58:46:24,  7.82s/it]
 29%|██▊       | 10903/37963 [26:51:33<58:21:26,  7.76s/it]
 29%|██▊       | 10904/37963 [26:51:41<57:40:03,  7.67s/it]
 29%|██▊       | 10905/37963 [26:51:54<71:42:27,  9.54s/it]
 29%|██▊       | 10906/37963 [26:52:02<67:42:29,  9.01s/it]
 29%|██▊       | 10907/37963 [26:52:10<64:25:49,  8.57s/it]
 29%|██▊       | 10908/37963 [26:52:18<62:33:53,  8.33s/it]
 29%|██▊       | 10909/37963 [26:52:25<60:50:50,  8.10s/it]
 29%|██▊       | 10910/37963 [26:52:40<75:08:38, 10.00s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '1.882', 'learning_rate': '1.672e-05', 'epoch': '0.2874'}
+
 29%|██▊       | 10910/37963 [26:52:40<75:08:38, 10.00s/it]
 29%|██▊       | 10911/37963 [26:52:47<70:02:29,  9.32s/it]
 29%|██▊       | 10912/37963 [26:52:55<66:18:57,  8.83s/it]
 29%|██▊       | 10913/37963 [26:53:09<77:59:21, 10.38s/it]
 29%|██▊       | 10914/37963 [26:53:17<72:05:14,  9.59s/it]
 29%|██▉       | 10915/37963 [26:53:24<67:41:05,  9.01s/it]
 29%|██▉       | 10916/37963 [26:53:32<64:49:03,  8.63s/it]
 29%|██▉       | 10917/37963 [26:53:40<62:29:55,  8.32s/it]
 29%|██▉       | 10918/37963 [26:53:47<61:10:06,  8.14s/it]
 29%|██▉       | 10919/37963 [26:53:55<60:04:18,  8.00s/it]
 29%|██▉       | 10920/37963 [26:54:03<59:12:39,  7.88s/it]
                                                           
{'loss': '0.1706', 'grad_norm': '6.327', 'learning_rate': '1.672e-05', 'epoch': '0.2876'}
+
 29%|██▉       | 10920/37963 [26:54:03<59:12:39,  7.88s/it]
 29%|██▉       | 10921/37963 [26:54:10<57:51:37,  7.70s/it]
 29%|██▉       | 10922/37963 [26:54:18<58:05:50,  7.73s/it]
 29%|██▉       | 10923/37963 [26:54:32<72:48:00,  9.69s/it]
 29%|██▉       | 10924/37963 [26:54:40<67:59:23,  9.05s/it]
 29%|██▉       | 10925/37963 [26:54:47<64:57:54,  8.65s/it]
 29%|██▉       | 10926/37963 [26:54:55<62:39:11,  8.34s/it]
 29%|██▉       | 10927/37963 [26:55:02<60:40:20,  8.08s/it]
 29%|██▉       | 10928/37963 [26:55:10<59:36:00,  7.94s/it]
 29%|██▉       | 10929/37963 [26:55:25<75:29:38, 10.05s/it]
 29%|██▉       | 10930/37963 [26:55:33<70:19:30,  9.37s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '2.866', 'learning_rate': '1.671e-05', 'epoch': '0.2879'}
+
 29%|██▉       | 10930/37963 [26:55:33<70:19:30,  9.37s/it]
 29%|██▉       | 10931/37963 [26:55:47<81:47:21, 10.89s/it]
 29%|██▉       | 10932/37963 [26:56:02<90:22:24, 12.04s/it]
 29%|██▉       | 10933/37963 [26:56:09<79:57:19, 10.65s/it]
 29%|██▉       | 10934/37963 [26:56:17<72:58:41,  9.72s/it]
 29%|██▉       | 10935/37963 [26:56:25<68:21:58,  9.11s/it]
 29%|██▉       | 10936/37963 [26:56:32<64:52:38,  8.64s/it]
 29%|██▉       | 10937/37963 [26:56:40<62:30:57,  8.33s/it]
 29%|██▉       | 10938/37963 [26:56:48<61:23:14,  8.18s/it]
 29%|██▉       | 10939/37963 [26:56:55<59:48:23,  7.97s/it]
 29%|██▉       | 10940/37963 [26:57:03<58:41:59,  7.82s/it]
                                                           
{'loss': '0.1665', 'grad_norm': '7.26', 'learning_rate': '1.67e-05', 'epoch': '0.2882'}
+
 29%|██▉       | 10940/37963 [26:57:03<58:41:59,  7.82s/it]
 29%|██▉       | 10941/37963 [26:57:10<58:32:02,  7.80s/it]
 29%|██▉       | 10942/37963 [26:57:18<58:34:51,  7.80s/it]
 29%|██▉       | 10943/37963 [26:57:26<58:13:41,  7.76s/it]
 29%|██▉       | 10944/37963 [26:57:40<73:14:02,  9.76s/it]
 29%|██▉       | 10945/37963 [26:57:48<68:42:10,  9.15s/it]
 29%|██▉       | 10946/37963 [26:57:56<65:25:14,  8.72s/it]
 29%|██▉       | 10947/37963 [26:58:03<62:55:20,  8.38s/it]
 29%|██▉       | 10948/37963 [26:58:11<61:36:03,  8.21s/it]
 29%|██▉       | 10949/37963 [26:58:19<60:23:16,  8.05s/it]
 29%|██▉       | 10950/37963 [26:58:26<59:26:12,  7.92s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '1.105', 'learning_rate': '1.67e-05', 'epoch': '0.2884'}
+
 29%|██▉       | 10950/37963 [26:58:26<59:26:12,  7.92s/it]
 29%|██▉       | 10951/37963 [26:58:34<58:41:38,  7.82s/it]
 29%|██▉       | 10952/37963 [26:58:41<58:03:00,  7.74s/it]
 29%|██▉       | 10953/37963 [26:58:56<72:31:22,  9.67s/it]
 29%|██▉       | 10954/37963 [26:59:03<67:38:43,  9.02s/it]
 29%|██▉       | 10955/37963 [26:59:11<64:11:01,  8.56s/it]
 29%|██▉       | 10956/37963 [26:59:18<62:17:31,  8.30s/it]
 29%|██▉       | 10957/37963 [26:59:32<75:10:17, 10.02s/it]
 29%|██▉       | 10958/37963 [26:59:40<69:59:54,  9.33s/it]
 29%|██▉       | 10959/37963 [26:59:48<66:00:53,  8.80s/it]
 29%|██▉       | 10960/37963 [26:59:55<63:33:05,  8.47s/it]
                                                           
{'loss': '0.1493', 'grad_norm': '4.043', 'learning_rate': '1.669e-05', 'epoch': '0.2887'}
+
 29%|██▉       | 10960/37963 [26:59:55<63:33:05,  8.47s/it]
 29%|██▉       | 10961/37963 [27:00:03<61:42:02,  8.23s/it]
 29%|██▉       | 10962/37963 [27:00:17<74:55:24,  9.99s/it]
 29%|██▉       | 10963/37963 [27:00:25<69:48:48,  9.31s/it]
 29%|██▉       | 10964/37963 [27:00:32<66:01:51,  8.80s/it]
 29%|██▉       | 10965/37963 [27:00:40<63:14:46,  8.43s/it]
 29%|██▉       | 10966/37963 [27:00:47<61:10:35,  8.16s/it]
 29%|██▉       | 10967/37963 [27:00:55<59:56:20,  7.99s/it]
 29%|██▉       | 10968/37963 [27:01:03<59:11:58,  7.89s/it]
 29%|██▉       | 10969/37963 [27:01:10<58:12:01,  7.76s/it]
 29%|██▉       | 10970/37963 [27:01:18<58:07:55,  7.75s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '1.82', 'learning_rate': '1.668e-05', 'epoch': '0.289'}
+
 29%|██▉       | 10970/37963 [27:01:18<58:07:55,  7.75s/it]
 29%|██▉       | 10971/37963 [27:01:25<57:16:50,  7.64s/it]
 29%|██▉       | 10972/37963 [27:01:33<57:28:00,  7.66s/it]
 29%|██▉       | 10973/37963 [27:01:41<57:23:28,  7.66s/it]
 29%|██▉       | 10974/37963 [27:01:48<57:30:48,  7.67s/it]
 29%|██▉       | 10975/37963 [27:02:02<71:50:33,  9.58s/it]
 29%|██▉       | 10976/37963 [27:02:17<83:10:45, 11.10s/it]
 29%|██▉       | 10977/37963 [27:02:25<75:37:23, 10.09s/it]
 29%|██▉       | 10978/37963 [27:02:32<70:05:00,  9.35s/it]
 29%|██▉       | 10979/37963 [27:02:47<82:44:05, 11.04s/it]
 29%|██▉       | 10980/37963 [27:02:55<75:12:48, 10.03s/it]
                                                           
{'loss': '0.1665', 'grad_norm': '1.56', 'learning_rate': '1.668e-05', 'epoch': '0.2892'}
+
 29%|██▉       | 10980/37963 [27:02:55<75:12:48, 10.03s/it]
 29%|██▉       | 10981/37963 [27:03:03<69:43:46,  9.30s/it]
 29%|██▉       | 10982/37963 [27:03:10<65:31:32,  8.74s/it]
 29%|██▉       | 10983/37963 [27:03:18<63:20:03,  8.45s/it]
 29%|██▉       | 10984/37963 [27:03:25<60:37:29,  8.09s/it]
 29%|██▉       | 10985/37963 [27:03:33<59:38:55,  7.96s/it]
 29%|██▉       | 10986/37963 [27:03:41<59:12:59,  7.90s/it]
 29%|██▉       | 10987/37963 [27:03:48<59:02:56,  7.88s/it]
 29%|██▉       | 10988/37963 [27:03:56<58:38:53,  7.83s/it]
 29%|██▉       | 10989/37963 [27:04:04<58:10:51,  7.76s/it]
 29%|██▉       | 10990/37963 [27:04:11<57:50:56,  7.72s/it]
                                                           
{'loss': '0.1831', 'grad_norm': '2.162', 'learning_rate': '1.667e-05', 'epoch': '0.2895'}
+
 29%|██▉       | 10990/37963 [27:04:11<57:50:56,  7.72s/it]
 29%|██▉       | 10991/37963 [27:04:19<57:40:48,  7.70s/it]
 29%|██▉       | 10992/37963 [27:04:27<57:41:42,  7.70s/it]
 29%|██▉       | 10993/37963 [27:04:34<57:25:45,  7.67s/it]
 29%|██▉       | 10994/37963 [27:04:42<57:27:27,  7.67s/it]
 29%|██▉       | 10995/37963 [27:04:49<57:06:58,  7.62s/it]
 29%|██▉       | 10996/37963 [27:04:57<56:35:48,  7.56s/it]
 29%|██▉       | 10997/37963 [27:05:04<56:18:48,  7.52s/it]
 29%|██▉       | 10998/37963 [27:05:19<72:50:13,  9.72s/it]
 29%|██▉       | 10999/37963 [27:05:27<68:07:45,  9.10s/it]
 29%|██▉       | 11000/37963 [27:05:41<78:56:46, 10.54s/it]
                                                           
{'loss': '0.1736', 'grad_norm': '1.88', 'learning_rate': '1.667e-05', 'epoch': '0.2898'}
+
 29%|██▉       | 11000/37963 [27:05:41<78:56:46, 10.54s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.13s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.14s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 29%|██▉       | 11001/37963 [27:06:43<196:10:40, 26.19s/it]
 29%|██▉       | 11002/37963 [27:06:51<154:38:24, 20.65s/it]
 29%|██▉       | 11003/37963 [27:06:59<125:23:29, 16.74s/it]
 29%|██▉       | 11004/37963 [27:07:06<105:02:03, 14.03s/it]
 29%|██▉       | 11005/37963 [27:07:14<90:24:41, 12.07s/it] 
 29%|██▉       | 11006/37963 [27:07:22<80:30:05, 10.75s/it]
 29%|██▉       | 11007/37963 [27:07:29<73:46:14,  9.85s/it]
 29%|██▉       | 11008/37963 [27:07:37<68:43:40,  9.18s/it]
 29%|██▉       | 11009/37963 [27:07:51<80:03:46, 10.69s/it]
 29%|██▉       | 11010/37963 [27:07:59<73:22:56,  9.80s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '1.16', 'learning_rate': '1.666e-05', 'epoch': '0.29'}
+
 29%|██▉       | 11010/37963 [27:07:59<73:22:56,  9.80s/it]
 29%|██▉       | 11011/37963 [27:08:07<68:57:15,  9.21s/it]
 29%|██▉       | 11012/37963 [27:08:14<65:27:18,  8.74s/it]
 29%|██▉       | 11013/37963 [27:08:22<63:15:52,  8.45s/it]
 29%|██▉       | 11014/37963 [27:08:30<61:26:01,  8.21s/it]
 29%|██▉       | 11015/37963 [27:08:38<60:17:48,  8.06s/it]
 29%|██▉       | 11016/37963 [27:08:45<59:24:13,  7.94s/it]
 29%|██▉       | 11017/37963 [27:08:53<58:28:17,  7.81s/it]
 29%|██▉       | 11018/37963 [27:09:00<58:21:55,  7.80s/it]
 29%|██▉       | 11019/37963 [27:09:08<57:53:33,  7.74s/it]
 29%|██▉       | 11020/37963 [27:09:16<57:47:02,  7.72s/it]
                                                           
{'loss': '0.1663', 'grad_norm': '1.331', 'learning_rate': '1.665e-05', 'epoch': '0.2903'}
+
 29%|██▉       | 11020/37963 [27:09:16<57:47:02,  7.72s/it]
 29%|██▉       | 11021/37963 [27:09:30<72:14:54,  9.65s/it]
 29%|██▉       | 11022/37963 [27:09:45<83:20:15, 11.14s/it]
 29%|██▉       | 11023/37963 [27:09:52<75:41:59, 10.12s/it]
 29%|██▉       | 11024/37963 [27:10:00<70:17:07,  9.39s/it]
 29%|██▉       | 11025/37963 [27:10:15<82:13:36, 10.99s/it]
 29%|██▉       | 11026/37963 [27:10:23<75:08:46, 10.04s/it]
 29%|██▉       | 11027/37963 [27:10:30<69:46:25,  9.33s/it]
 29%|██▉       | 11028/37963 [27:10:38<65:56:18,  8.81s/it]
 29%|██▉       | 11029/37963 [27:10:53<79:18:35, 10.60s/it]
 29%|██▉       | 11030/37963 [27:11:00<72:14:18,  9.66s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '1.186', 'learning_rate': '1.665e-05', 'epoch': '0.2905'}
+
 29%|██▉       | 11030/37963 [27:11:00<72:14:18,  9.66s/it]
 29%|██▉       | 11031/37963 [27:11:08<67:38:51,  9.04s/it]
 29%|██▉       | 11032/37963 [27:11:15<64:23:49,  8.61s/it]
 29%|██▉       | 11033/37963 [27:11:23<62:23:55,  8.34s/it]
 29%|██▉       | 11034/37963 [27:11:31<60:49:50,  8.13s/it]
 29%|██▉       | 11035/37963 [27:11:38<59:55:29,  8.01s/it]
 29%|██▉       | 11036/37963 [27:11:46<59:07:46,  7.91s/it]
 29%|██▉       | 11037/37963 [27:11:54<58:32:16,  7.83s/it]
 29%|██▉       | 11038/37963 [27:12:01<58:09:05,  7.78s/it]
 29%|██▉       | 11039/37963 [27:12:09<57:52:29,  7.74s/it]
 29%|██▉       | 11040/37963 [27:12:17<57:50:27,  7.73s/it]
                                                           
{'loss': '0.1735', 'grad_norm': '2.608', 'learning_rate': '1.664e-05', 'epoch': '0.2908'}
+
 29%|██▉       | 11040/37963 [27:12:17<57:50:27,  7.73s/it]
 29%|██▉       | 11041/37963 [27:12:24<57:30:27,  7.69s/it]
 29%|██▉       | 11042/37963 [27:12:32<57:06:43,  7.64s/it]
 29%|██▉       | 11043/37963 [27:12:39<57:08:40,  7.64s/it]
 29%|██▉       | 11044/37963 [27:12:54<73:37:19,  9.85s/it]
 29%|██▉       | 11045/37963 [27:13:09<83:29:08, 11.17s/it]
 29%|██▉       | 11046/37963 [27:13:16<74:48:51, 10.01s/it]
 29%|██▉       | 11047/37963 [27:13:24<69:41:47,  9.32s/it]
 29%|██▉       | 11048/37963 [27:13:31<65:50:45,  8.81s/it]
 29%|██▉       | 11049/37963 [27:13:39<63:19:19,  8.47s/it]
 29%|██▉       | 11050/37963 [27:13:46<60:42:21,  8.12s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '3.593', 'learning_rate': '1.663e-05', 'epoch': '0.2911'}
+
 29%|██▉       | 11050/37963 [27:13:46<60:42:21,  8.12s/it]
 29%|██▉       | 11051/37963 [27:13:53<58:29:05,  7.82s/it]
 29%|██▉       | 11052/37963 [27:14:08<73:34:14,  9.84s/it]
 29%|██▉       | 11053/37963 [27:14:16<68:45:53,  9.20s/it]
 29%|██▉       | 11054/37963 [27:14:23<65:34:46,  8.77s/it]
 29%|██▉       | 11055/37963 [27:14:31<62:40:21,  8.38s/it]
 29%|██▉       | 11056/37963 [27:14:45<76:38:17, 10.25s/it]
 29%|██▉       | 11057/37963 [27:14:53<71:13:40,  9.53s/it]
 29%|██▉       | 11058/37963 [27:15:01<66:52:57,  8.95s/it]
 29%|██▉       | 11059/37963 [27:15:09<64:05:18,  8.58s/it]
 29%|██▉       | 11060/37963 [27:15:16<61:55:26,  8.29s/it]
                                                           
{'loss': '0.1697', 'grad_norm': '2.762', 'learning_rate': '1.663e-05', 'epoch': '0.2913'}
+
 29%|██▉       | 11060/37963 [27:15:16<61:55:26,  8.29s/it]
 29%|██▉       | 11061/37963 [27:15:24<60:27:57,  8.09s/it]
 29%|██▉       | 11062/37963 [27:15:32<59:24:45,  7.95s/it]
 29%|██▉       | 11063/37963 [27:15:39<58:47:42,  7.87s/it]
 29%|██▉       | 11064/37963 [27:15:53<73:03:22,  9.78s/it]
 29%|██▉       | 11065/37963 [27:16:01<67:37:17,  9.05s/it]
 29%|██▉       | 11066/37963 [27:16:08<64:22:18,  8.62s/it]
 29%|██▉       | 11067/37963 [27:16:16<62:15:58,  8.33s/it]
 29%|██▉       | 11068/37963 [27:16:24<60:49:08,  8.14s/it]
 29%|██▉       | 11069/37963 [27:16:39<75:53:00, 10.16s/it]
 29%|██▉       | 11070/37963 [27:16:46<70:17:00,  9.41s/it]
                                                           
{'loss': '0.1777', 'grad_norm': '1.199', 'learning_rate': '1.662e-05', 'epoch': '0.2916'}
+
 29%|██▉       | 11070/37963 [27:16:46<70:17:00,  9.41s/it]
 29%|██▉       | 11071/37963 [27:16:54<65:47:18,  8.81s/it]
 29%|██▉       | 11072/37963 [27:17:01<63:10:00,  8.46s/it]
 29%|██▉       | 11073/37963 [27:17:09<61:20:00,  8.21s/it]
 29%|██▉       | 11074/37963 [27:17:17<60:09:09,  8.05s/it]
 29%|██▉       | 11075/37963 [27:17:24<59:26:18,  7.96s/it]
 29%|██▉       | 11076/37963 [27:17:39<74:20:23,  9.95s/it]
 29%|██▉       | 11077/37963 [27:17:47<69:22:21,  9.29s/it]
 29%|██▉       | 11078/37963 [27:17:54<65:48:34,  8.81s/it]
 29%|██▉       | 11079/37963 [27:18:02<62:59:16,  8.43s/it]
 29%|██▉       | 11080/37963 [27:18:10<61:11:29,  8.19s/it]
                                                           
{'loss': '0.1735', 'grad_norm': '4.057', 'learning_rate': '1.661e-05', 'epoch': '0.2919'}
+
 29%|██▉       | 11080/37963 [27:18:10<61:11:29,  8.19s/it]
 29%|██▉       | 11081/37963 [27:18:17<59:37:26,  7.98s/it]
 29%|██▉       | 11082/37963 [27:18:32<74:31:36,  9.98s/it]
 29%|██▉       | 11083/37963 [27:18:39<69:13:40,  9.27s/it]
 29%|██▉       | 11084/37963 [27:18:47<65:15:47,  8.74s/it]
 29%|██▉       | 11085/37963 [27:18:54<62:35:42,  8.38s/it]
 29%|██▉       | 11086/37963 [27:19:02<60:14:45,  8.07s/it]
 29%|██▉       | 11087/37963 [27:19:09<59:11:58,  7.93s/it]
 29%|██▉       | 11088/37963 [27:19:17<58:35:20,  7.85s/it]
 29%|██▉       | 11089/37963 [27:19:25<58:09:40,  7.79s/it]
 29%|██▉       | 11090/37963 [27:19:32<57:43:33,  7.73s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '3.893', 'learning_rate': '1.661e-05', 'epoch': '0.2921'}
+
 29%|██▉       | 11090/37963 [27:19:32<57:43:33,  7.73s/it]
 29%|██▉       | 11091/37963 [27:19:47<72:33:30,  9.72s/it]
 29%|██▉       | 11092/37963 [27:19:55<68:44:49,  9.21s/it]
 29%|██▉       | 11093/37963 [27:20:02<65:08:21,  8.73s/it]
 29%|██▉       | 11094/37963 [27:20:10<62:57:02,  8.43s/it]
 29%|██▉       | 11095/37963 [27:20:18<61:16:26,  8.21s/it]
 29%|██▉       | 11096/37963 [27:20:25<59:45:47,  8.01s/it]
 29%|██▉       | 11097/37963 [27:20:39<73:41:36,  9.87s/it]
 29%|██▉       | 11098/37963 [27:20:47<69:06:13,  9.26s/it]
 29%|██▉       | 11099/37963 [27:20:55<65:34:36,  8.79s/it]
 29%|██▉       | 11100/37963 [27:21:03<63:07:02,  8.46s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '1.792', 'learning_rate': '1.66e-05', 'epoch': '0.2924'}
+
 29%|██▉       | 11100/37963 [27:21:03<63:07:02,  8.46s/it]
 29%|██▉       | 11101/37963 [27:21:10<61:19:05,  8.22s/it]
 29%|██▉       | 11102/37963 [27:21:18<60:09:51,  8.06s/it]
 29%|██▉       | 11103/37963 [27:21:26<59:00:59,  7.91s/it]
 29%|██▉       | 11104/37963 [27:21:33<58:18:52,  7.82s/it]
 29%|██▉       | 11105/37963 [27:21:41<58:07:42,  7.79s/it]
 29%|██▉       | 11106/37963 [27:21:55<72:10:13,  9.67s/it]
 29%|██▉       | 11107/37963 [27:22:03<67:33:52,  9.06s/it]
 29%|██▉       | 11108/37963 [27:22:10<64:39:22,  8.67s/it]
 29%|██▉       | 11109/37963 [27:22:25<77:40:58, 10.41s/it]
 29%|██▉       | 11110/37963 [27:22:39<86:38:30, 11.62s/it]
                                                           
{'loss': '0.1688', 'grad_norm': '1.488', 'learning_rate': '1.66e-05', 'epoch': '0.2927'}
+
 29%|██▉       | 11110/37963 [27:22:39<86:38:30, 11.62s/it]
 29%|██▉       | 11111/37963 [27:22:47<77:51:18, 10.44s/it]
 29%|██▉       | 11112/37963 [27:22:55<71:28:43,  9.58s/it]
 29%|██▉       | 11113/37963 [27:23:02<66:25:00,  8.91s/it]
 29%|██▉       | 11114/37963 [27:23:10<63:38:33,  8.53s/it]
 29%|██▉       | 11115/37963 [27:23:17<60:51:10,  8.16s/it]
 29%|██▉       | 11116/37963 [27:23:25<59:53:47,  8.03s/it]
 29%|██▉       | 11117/37963 [27:23:39<74:22:03,  9.97s/it]
 29%|██▉       | 11118/37963 [27:23:47<69:21:15,  9.30s/it]
 29%|██▉       | 11119/37963 [27:23:54<65:34:30,  8.79s/it]
 29%|██▉       | 11120/37963 [27:24:09<79:42:16, 10.69s/it]
                                                           
{'loss': '0.1702', 'grad_norm': '1.265', 'learning_rate': '1.659e-05', 'epoch': '0.2929'}
+
 29%|██▉       | 11120/37963 [27:24:09<79:42:16, 10.69s/it]
 29%|██▉       | 11121/37963 [27:24:17<72:27:44,  9.72s/it]
 29%|██▉       | 11122/37963 [27:24:25<68:03:13,  9.13s/it]
 29%|██▉       | 11123/37963 [27:24:32<63:57:20,  8.58s/it]
 29%|██▉       | 11124/37963 [27:24:40<62:05:29,  8.33s/it]
 29%|██▉       | 11125/37963 [27:24:47<60:47:07,  8.15s/it]
 29%|██▉       | 11126/37963 [27:24:55<59:35:16,  7.99s/it]
 29%|██▉       | 11127/37963 [27:25:03<58:48:08,  7.89s/it]
 29%|██▉       | 11128/37963 [27:25:10<58:30:04,  7.85s/it]
 29%|██▉       | 11129/37963 [27:25:18<58:13:50,  7.81s/it]
 29%|██▉       | 11130/37963 [27:25:32<72:35:50,  9.74s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '3.218', 'learning_rate': '1.658e-05', 'epoch': '0.2932'}
+
 29%|██▉       | 11130/37963 [27:25:32<72:35:50,  9.74s/it]
 29%|██▉       | 11131/37963 [27:25:40<67:38:10,  9.07s/it]
 29%|██▉       | 11132/37963 [27:25:48<64:34:50,  8.66s/it]
 29%|██▉       | 11133/37963 [27:25:55<62:09:26,  8.34s/it]
 29%|██▉       | 11134/37963 [27:26:02<59:39:57,  8.01s/it]
 29%|██▉       | 11135/37963 [27:26:10<58:55:23,  7.91s/it]
 29%|██▉       | 11136/37963 [27:26:18<58:18:26,  7.82s/it]
 29%|██▉       | 11137/37963 [27:26:26<58:02:55,  7.79s/it]
 29%|██▉       | 11138/37963 [27:26:33<57:49:29,  7.76s/it]
 29%|██▉       | 11139/37963 [27:26:41<57:37:54,  7.73s/it]
 29%|██▉       | 11140/37963 [27:26:56<73:42:14,  9.89s/it]
                                                           
{'loss': '0.1727', 'grad_norm': '1.125', 'learning_rate': '1.658e-05', 'epoch': '0.2934'}
+
 29%|██▉       | 11140/37963 [27:26:56<73:42:14,  9.89s/it]
 29%|██▉       | 11141/37963 [27:27:03<68:39:14,  9.21s/it]
 29%|██▉       | 11142/37963 [27:27:18<80:09:02, 10.76s/it]
 29%|██▉       | 11143/37963 [27:27:26<73:21:34,  9.85s/it]
 29%|██▉       | 11144/37963 [27:27:33<68:11:06,  9.15s/it]
 29%|██▉       | 11145/37963 [27:27:41<64:40:24,  8.68s/it]
 29%|██▉       | 11146/37963 [27:27:48<62:23:11,  8.37s/it]
 29%|██▉       | 11147/37963 [27:27:56<60:38:11,  8.14s/it]
 29%|██▉       | 11148/37963 [27:28:04<59:44:18,  8.02s/it]
 29%|██▉       | 11149/37963 [27:28:11<59:00:11,  7.92s/it]
 29%|██▉       | 11150/37963 [27:28:19<58:35:39,  7.87s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '2.403', 'learning_rate': '1.657e-05', 'epoch': '0.2937'}
+
 29%|██▉       | 11150/37963 [27:28:19<58:35:39,  7.87s/it]
 29%|██▉       | 11151/37963 [27:28:27<57:56:56,  7.78s/it]
 29%|██▉       | 11152/37963 [27:28:34<57:36:33,  7.74s/it]
 29%|██▉       | 11153/37963 [27:28:42<57:37:57,  7.74s/it]
 29%|██▉       | 11154/37963 [27:28:56<72:27:45,  9.73s/it]
 29%|██▉       | 11155/37963 [27:29:04<67:22:31,  9.05s/it]
 29%|██▉       | 11156/37963 [27:29:11<64:00:50,  8.60s/it]
 29%|██▉       | 11157/37963 [27:29:26<77:07:45, 10.36s/it]
 29%|██▉       | 11158/37963 [27:29:33<70:45:50,  9.50s/it]
 29%|██▉       | 11159/37963 [27:29:41<67:03:30,  9.01s/it]
 29%|██▉       | 11160/37963 [27:29:49<64:05:06,  8.61s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '2.033', 'learning_rate': '1.656e-05', 'epoch': '0.294'}
+
 29%|██▉       | 11160/37963 [27:29:49<64:05:06,  8.61s/it]
 29%|██▉       | 11161/37963 [27:29:56<61:51:02,  8.31s/it]
 29%|██▉       | 11162/37963 [27:30:11<76:06:48, 10.22s/it]
 29%|██▉       | 11163/37963 [27:30:25<84:46:36, 11.39s/it]
 29%|██▉       | 11164/37963 [27:30:33<76:54:24, 10.33s/it]
 29%|██▉       | 11165/37963 [27:30:41<70:20:48,  9.45s/it]
 29%|██▉       | 11166/37963 [27:30:55<82:24:02, 11.07s/it]
 29%|██▉       | 11167/37963 [27:31:03<74:48:57, 10.05s/it]
 29%|██▉       | 11168/37963 [27:31:11<69:19:19,  9.31s/it]
 29%|██▉       | 11169/37963 [27:31:18<65:46:58,  8.84s/it]
 29%|██▉       | 11170/37963 [27:31:26<63:20:27,  8.51s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '3.58', 'learning_rate': '1.656e-05', 'epoch': '0.2942'}
+
 29%|██▉       | 11170/37963 [27:31:26<63:20:27,  8.51s/it]
 29%|██▉       | 11171/37963 [27:31:34<60:52:34,  8.18s/it]
 29%|██▉       | 11172/37963 [27:31:41<60:05:41,  8.08s/it]
 29%|██▉       | 11173/37963 [27:31:49<59:25:32,  7.99s/it]
 29%|██▉       | 11174/37963 [27:31:57<58:41:19,  7.89s/it]
 29%|██▉       | 11175/37963 [27:32:11<73:45:29,  9.91s/it]
 29%|██▉       | 11176/37963 [27:32:19<69:13:33,  9.30s/it]
 29%|██▉       | 11177/37963 [27:32:27<65:00:08,  8.74s/it]
 29%|██▉       | 11178/37963 [27:32:35<63:04:23,  8.48s/it]
 29%|██▉       | 11179/37963 [27:32:42<61:04:00,  8.21s/it]
 29%|██▉       | 11180/37963 [27:32:50<59:59:53,  8.06s/it]
                                                           
{'loss': '0.1729', 'grad_norm': '3.853', 'learning_rate': '1.655e-05', 'epoch': '0.2945'}
+
 29%|██▉       | 11180/37963 [27:32:50<59:59:53,  8.06s/it]
 29%|██▉       | 11181/37963 [27:32:58<59:03:16,  7.94s/it]
 29%|██▉       | 11182/37963 [27:33:05<57:39:18,  7.75s/it]
 29%|██▉       | 11183/37963 [27:33:13<57:33:20,  7.74s/it]
 29%|██▉       | 11184/37963 [27:33:20<57:25:57,  7.72s/it]
 29%|██▉       | 11185/37963 [27:33:28<57:20:21,  7.71s/it]
 29%|██▉       | 11186/37963 [27:33:43<72:57:45,  9.81s/it]
 29%|██▉       | 11187/37963 [27:33:50<68:06:39,  9.16s/it]
 29%|██▉       | 11188/37963 [27:33:58<64:21:06,  8.65s/it]
 29%|██▉       | 11189/37963 [27:34:05<62:02:55,  8.34s/it]
 29%|██▉       | 11190/37963 [27:34:13<60:32:24,  8.14s/it]
                                                           
{'loss': '0.166', 'grad_norm': '2.494', 'learning_rate': '1.654e-05', 'epoch': '0.2948'}
+
 29%|██▉       | 11190/37963 [27:34:13<60:32:24,  8.14s/it]
 29%|██▉       | 11191/37963 [27:34:27<74:05:04,  9.96s/it]
 29%|██▉       | 11192/37963 [27:34:35<69:01:33,  9.28s/it]
 29%|██▉       | 11193/37963 [27:34:42<64:58:00,  8.74s/it]
 29%|██▉       | 11194/37963 [27:34:50<62:46:30,  8.44s/it]
 29%|██▉       | 11195/37963 [27:34:58<61:04:11,  8.21s/it]
 29%|██▉       | 11196/37963 [27:35:05<59:28:58,  8.00s/it]
 29%|██▉       | 11197/37963 [27:35:13<58:34:01,  7.88s/it]
 29%|██▉       | 11198/37963 [27:35:20<57:25:44,  7.72s/it]
 29%|██▉       | 11199/37963 [27:35:28<57:11:17,  7.69s/it]
 30%|██▉       | 11200/37963 [27:35:36<57:03:19,  7.67s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '1.095', 'learning_rate': '1.654e-05', 'epoch': '0.295'}
+
 30%|██▉       | 11200/37963 [27:35:36<57:03:19,  7.67s/it]
 30%|██▉       | 11201/37963 [27:35:43<57:00:31,  7.67s/it]
 30%|██▉       | 11202/37963 [27:35:51<57:18:26,  7.71s/it]
 30%|██▉       | 11203/37963 [27:35:59<57:01:03,  7.67s/it]
 30%|██▉       | 11204/37963 [27:36:06<57:06:06,  7.68s/it]
 30%|██▉       | 11205/37963 [27:36:27<86:15:51, 11.61s/it]
 30%|██▉       | 11206/37963 [27:36:35<77:35:58, 10.44s/it]
 30%|██▉       | 11207/37963 [27:36:43<71:28:59,  9.62s/it]
 30%|██▉       | 11208/37963 [27:36:50<67:21:41,  9.06s/it]
 30%|██▉       | 11209/37963 [27:37:05<80:32:23, 10.84s/it]
 30%|██▉       | 11210/37963 [27:37:13<73:36:37,  9.91s/it]
                                                           
{'loss': '0.1698', 'grad_norm': '1.715', 'learning_rate': '1.653e-05', 'epoch': '0.2953'}
+
 30%|██▉       | 11210/37963 [27:37:13<73:36:37,  9.91s/it]
 30%|██▉       | 11211/37963 [27:37:20<67:56:30,  9.14s/it]
 30%|██▉       | 11212/37963 [27:37:28<64:55:51,  8.74s/it]
 30%|██▉       | 11213/37963 [27:37:36<62:12:54,  8.37s/it]
 30%|██▉       | 11214/37963 [27:37:43<60:34:43,  8.15s/it]
 30%|██▉       | 11215/37963 [27:37:51<59:07:21,  7.96s/it]
 30%|██▉       | 11216/37963 [27:37:59<58:33:43,  7.88s/it]
 30%|██▉       | 11217/37963 [27:38:12<71:59:38,  9.69s/it]
 30%|██▉       | 11218/37963 [27:38:27<83:21:03, 11.22s/it]
 30%|██▉       | 11219/37963 [27:38:35<75:13:49, 10.13s/it]
 30%|██▉       | 11220/37963 [27:38:42<69:44:08,  9.39s/it]
                                                           
{'loss': '0.1742', 'grad_norm': '4.05', 'learning_rate': '1.652e-05', 'epoch': '0.2956'}
+
 30%|██▉       | 11220/37963 [27:38:42<69:44:08,  9.39s/it]
 30%|██▉       | 11221/37963 [27:38:50<65:46:38,  8.85s/it]
 30%|██▉       | 11222/37963 [27:38:58<63:04:39,  8.49s/it]
 30%|██▉       | 11223/37963 [27:39:05<61:19:04,  8.26s/it]
 30%|██▉       | 11224/37963 [27:39:13<59:25:16,  8.00s/it]
 30%|██▉       | 11225/37963 [27:39:28<74:18:18, 10.00s/it]
 30%|██▉       | 11226/37963 [27:39:35<68:58:54,  9.29s/it]
 30%|██▉       | 11227/37963 [27:39:43<65:16:36,  8.79s/it]
 30%|██▉       | 11228/37963 [27:39:50<62:47:16,  8.45s/it]
 30%|██▉       | 11229/37963 [27:39:58<61:00:20,  8.22s/it]
 30%|██▉       | 11230/37963 [27:40:06<59:39:09,  8.03s/it]
                                                           
{'loss': '0.1742', 'grad_norm': '5.288', 'learning_rate': '1.652e-05', 'epoch': '0.2958'}
+
 30%|██▉       | 11230/37963 [27:40:06<59:39:09,  8.03s/it]
 30%|██▉       | 11231/37963 [27:40:13<58:32:09,  7.88s/it]
 30%|██▉       | 11232/37963 [27:40:21<58:21:01,  7.86s/it]
 30%|██▉       | 11233/37963 [27:40:29<57:52:48,  7.80s/it]
 30%|██▉       | 11234/37963 [27:40:36<57:08:31,  7.70s/it]
 30%|██▉       | 11235/37963 [27:40:44<57:00:58,  7.68s/it]
 30%|██▉       | 11236/37963 [27:40:51<57:06:03,  7.69s/it]
 30%|██▉       | 11237/37963 [27:40:59<57:12:10,  7.71s/it]
 30%|██▉       | 11238/37963 [27:41:14<72:39:26,  9.79s/it]
 30%|██▉       | 11239/37963 [27:41:22<67:58:03,  9.16s/it]
 30%|██▉       | 11240/37963 [27:41:29<64:35:28,  8.70s/it]
                                                           
{'loss': '0.1796', 'grad_norm': '3.262', 'learning_rate': '1.651e-05', 'epoch': '0.2961'}
+
 30%|██▉       | 11240/37963 [27:41:29<64:35:28,  8.70s/it]
 30%|██▉       | 11241/37963 [27:41:43<77:01:27, 10.38s/it]
 30%|██▉       | 11242/37963 [27:41:51<70:59:24,  9.56s/it]
 30%|██▉       | 11243/37963 [27:41:59<66:38:17,  8.98s/it]
 30%|██▉       | 11244/37963 [27:42:06<63:32:50,  8.56s/it]
 30%|██▉       | 11245/37963 [27:42:14<61:27:12,  8.28s/it]
 30%|██▉       | 11246/37963 [27:42:22<59:59:46,  8.08s/it]
 30%|██▉       | 11247/37963 [27:42:29<58:59:34,  7.95s/it]
 30%|██▉       | 11248/37963 [27:42:37<58:15:25,  7.85s/it]
 30%|██▉       | 11249/37963 [27:42:44<56:36:06,  7.63s/it]
 30%|██▉       | 11250/37963 [27:42:52<56:37:58,  7.63s/it]
                                                           
{'loss': '0.1679', 'grad_norm': '3.726', 'learning_rate': '1.651e-05', 'epoch': '0.2963'}
+
 30%|██▉       | 11250/37963 [27:42:52<56:37:58,  7.63s/it]
 30%|██▉       | 11251/37963 [27:42:59<56:45:22,  7.65s/it]
 30%|██▉       | 11252/37963 [27:43:07<56:44:38,  7.65s/it]
 30%|██▉       | 11253/37963 [27:43:21<72:00:01,  9.70s/it]
 30%|██▉       | 11254/37963 [27:43:29<67:37:39,  9.12s/it]
 30%|██▉       | 11255/37963 [27:43:44<79:21:36, 10.70s/it]
 30%|██▉       | 11256/37963 [27:43:51<72:35:25,  9.78s/it]
 30%|██▉       | 11257/37963 [27:43:59<67:41:49,  9.13s/it]
 30%|██▉       | 11258/37963 [27:44:06<64:10:58,  8.65s/it]
 30%|██▉       | 11259/37963 [27:44:14<62:00:49,  8.36s/it]
 30%|██▉       | 11260/37963 [27:44:22<60:29:00,  8.15s/it]
                                                           
{'loss': '0.1684', 'grad_norm': '2.458', 'learning_rate': '1.65e-05', 'epoch': '0.2966'}
+
 30%|██▉       | 11260/37963 [27:44:22<60:29:00,  8.15s/it]
 30%|██▉       | 11261/37963 [27:44:29<59:15:29,  7.99s/it]
 30%|██▉       | 11262/37963 [27:44:44<74:08:06, 10.00s/it]
 30%|██▉       | 11263/37963 [27:44:52<69:00:06,  9.30s/it]
 30%|██▉       | 11264/37963 [27:44:59<65:18:16,  8.81s/it]
 30%|██▉       | 11265/37963 [27:45:07<62:38:20,  8.45s/it]
 30%|██▉       | 11266/37963 [27:45:15<61:03:29,  8.23s/it]
 30%|██▉       | 11267/37963 [27:45:29<73:30:06,  9.91s/it]
 30%|██▉       | 11268/37963 [27:45:36<68:29:37,  9.24s/it]
 30%|██▉       | 11269/37963 [27:45:44<65:17:22,  8.81s/it]
 30%|██▉       | 11270/37963 [27:45:52<62:39:59,  8.45s/it]
                                                           
{'loss': '0.1676', 'grad_norm': '1.943', 'learning_rate': '1.649e-05', 'epoch': '0.2969'}
+
 30%|██▉       | 11270/37963 [27:45:52<62:39:59,  8.45s/it]
 30%|██▉       | 11271/37963 [27:45:59<60:34:17,  8.17s/it]
 30%|██▉       | 11272/37963 [27:46:07<59:27:02,  8.02s/it]
 30%|██▉       | 11273/37963 [27:46:22<74:47:37, 10.09s/it]
 30%|██▉       | 11274/37963 [27:46:36<84:15:55, 11.37s/it]
 30%|██▉       | 11275/37963 [27:46:43<75:29:04, 10.18s/it]
 30%|██▉       | 11276/37963 [27:46:51<69:49:27,  9.42s/it]
 30%|██▉       | 11277/37963 [27:46:59<65:51:12,  8.88s/it]
 30%|██▉       | 11278/37963 [27:47:06<63:19:59,  8.54s/it]
 30%|██▉       | 11279/37963 [27:47:14<61:11:53,  8.26s/it]
 30%|██▉       | 11280/37963 [27:47:22<59:49:00,  8.07s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '1.608', 'learning_rate': '1.649e-05', 'epoch': '0.2971'}
+
 30%|██▉       | 11280/37963 [27:47:22<59:49:00,  8.07s/it]
 30%|██▉       | 11281/37963 [27:47:29<58:46:00,  7.93s/it]
 30%|██▉       | 11282/37963 [27:47:37<57:53:19,  7.81s/it]
 30%|██▉       | 11283/37963 [27:47:44<57:25:52,  7.75s/it]
 30%|██▉       | 11284/37963 [27:47:52<57:32:21,  7.76s/it]
 30%|██▉       | 11285/37963 [27:48:00<56:42:16,  7.65s/it]
 30%|██▉       | 11286/37963 [27:48:07<56:34:55,  7.64s/it]
 30%|██▉       | 11287/37963 [27:48:15<56:43:51,  7.66s/it]
 30%|██▉       | 11288/37963 [27:48:23<56:47:37,  7.66s/it]
 30%|██▉       | 11289/37963 [27:48:30<56:42:12,  7.65s/it]
 30%|██▉       | 11290/37963 [27:48:38<56:31:39,  7.63s/it]
                                                           
{'loss': '0.1736', 'grad_norm': '0.8572', 'learning_rate': '1.648e-05', 'epoch': '0.2974'}
+
 30%|██▉       | 11290/37963 [27:48:38<56:31:39,  7.63s/it]
 30%|██▉       | 11291/37963 [27:48:52<70:42:40,  9.54s/it]
 30%|██▉       | 11292/37963 [27:49:06<81:39:03, 11.02s/it]
 30%|██▉       | 11293/37963 [27:49:14<73:26:29,  9.91s/it]
 30%|██▉       | 11294/37963 [27:49:21<68:01:09,  9.18s/it]
 30%|██▉       | 11295/37963 [27:49:29<64:50:13,  8.75s/it]
 30%|██▉       | 11296/37963 [27:49:43<76:55:50, 10.39s/it]
 30%|██▉       | 11297/37963 [27:49:51<70:55:25,  9.57s/it]
 30%|██▉       | 11298/37963 [27:49:58<66:21:13,  8.96s/it]
 30%|██▉       | 11299/37963 [27:50:12<77:49:05, 10.51s/it]
 30%|██▉       | 11300/37963 [27:50:20<71:27:28,  9.65s/it]
                                                           
{'loss': '0.1494', 'grad_norm': '2.459', 'learning_rate': '1.647e-05', 'epoch': '0.2977'}
+
 30%|██▉       | 11300/37963 [27:50:20<71:27:28,  9.65s/it]
 30%|██▉       | 11301/37963 [27:50:28<67:11:32,  9.07s/it]
 30%|██▉       | 11302/37963 [27:50:35<64:09:03,  8.66s/it]
 30%|██▉       | 11303/37963 [27:50:43<61:40:08,  8.33s/it]
 30%|██▉       | 11304/37963 [27:50:50<59:47:15,  8.07s/it]
 30%|██▉       | 11305/37963 [27:50:58<58:45:15,  7.93s/it]
 30%|██▉       | 11306/37963 [27:51:06<57:41:33,  7.79s/it]
 30%|██▉       | 11307/37963 [27:51:13<57:04:06,  7.71s/it]
 30%|██▉       | 11308/37963 [27:51:21<57:03:05,  7.71s/it]
 30%|██▉       | 11309/37963 [27:51:28<56:54:09,  7.69s/it]
 30%|██▉       | 11310/37963 [27:51:36<56:55:32,  7.69s/it]
                                                           
{'loss': '0.1751', 'grad_norm': '2.725', 'learning_rate': '1.647e-05', 'epoch': '0.2979'}
+
 30%|██▉       | 11310/37963 [27:51:36<56:55:32,  7.69s/it]
 30%|██▉       | 11311/37963 [27:51:44<56:30:55,  7.63s/it]
 30%|██▉       | 11312/37963 [27:51:58<71:02:05,  9.60s/it]
 30%|██▉       | 11313/37963 [27:52:05<66:47:31,  9.02s/it]
 30%|██▉       | 11314/37963 [27:52:13<63:53:43,  8.63s/it]
 30%|██▉       | 11315/37963 [27:52:29<78:52:08, 10.65s/it]
 30%|██▉       | 11316/37963 [27:52:36<72:16:18,  9.76s/it]
 30%|██▉       | 11317/37963 [27:52:44<67:48:29,  9.16s/it]
 30%|██▉       | 11318/37963 [27:52:52<64:38:21,  8.73s/it]
 30%|██▉       | 11319/37963 [27:52:59<61:52:45,  8.36s/it]
 30%|██▉       | 11320/37963 [27:53:07<60:02:17,  8.11s/it]
                                                           
{'loss': '0.1724', 'grad_norm': '2.039', 'learning_rate': '1.646e-05', 'epoch': '0.2982'}
+
 30%|██▉       | 11320/37963 [27:53:07<60:02:17,  8.11s/it]
 30%|██▉       | 11321/37963 [27:53:14<58:34:14,  7.91s/it]
 30%|██▉       | 11322/37963 [27:53:22<58:05:37,  7.85s/it]
 30%|██▉       | 11323/37963 [27:53:36<72:46:29,  9.83s/it]
 30%|██▉       | 11324/37963 [27:53:44<68:31:52,  9.26s/it]
 30%|██▉       | 11325/37963 [27:53:52<64:58:02,  8.78s/it]
 30%|██▉       | 11326/37963 [27:54:00<62:22:47,  8.43s/it]
 30%|██▉       | 11327/37963 [27:54:15<76:52:16, 10.39s/it]
 30%|██▉       | 11328/37963 [27:54:22<70:46:07,  9.57s/it]
 30%|██▉       | 11329/37963 [27:54:30<66:27:46,  8.98s/it]
 30%|██▉       | 11330/37963 [27:54:37<63:30:38,  8.58s/it]
                                                           
{'loss': '0.1665', 'grad_norm': '3.558', 'learning_rate': '1.645e-05', 'epoch': '0.2984'}
+
 30%|██▉       | 11330/37963 [27:54:37<63:30:38,  8.58s/it]
 30%|██▉       | 11331/37963 [27:54:45<61:29:57,  8.31s/it]
 30%|██▉       | 11332/37963 [27:54:53<59:51:48,  8.09s/it]
 30%|██▉       | 11333/37963 [27:55:00<58:51:35,  7.96s/it]
 30%|██▉       | 11334/37963 [27:55:08<57:50:02,  7.82s/it]
 30%|██▉       | 11335/37963 [27:55:15<57:20:39,  7.75s/it]
 30%|██▉       | 11336/37963 [27:55:30<71:43:17,  9.70s/it]
 30%|██▉       | 11337/37963 [27:55:37<67:02:09,  9.06s/it]
 30%|██▉       | 11338/37963 [27:55:45<63:41:18,  8.61s/it]
 30%|██▉       | 11339/37963 [27:55:52<61:28:56,  8.31s/it]
 30%|██▉       | 11340/37963 [27:56:00<60:25:11,  8.17s/it]
                                                           
{'loss': '0.1712', 'grad_norm': '1.89', 'learning_rate': '1.645e-05', 'epoch': '0.2987'}
+
 30%|██▉       | 11340/37963 [27:56:00<60:25:11,  8.17s/it]
 30%|██▉       | 11341/37963 [27:56:14<73:39:30,  9.96s/it]
 30%|██▉       | 11342/37963 [27:56:29<84:40:09, 11.45s/it]
 30%|██▉       | 11343/37963 [27:56:37<75:33:46, 10.22s/it]
 30%|██▉       | 11344/37963 [27:56:44<69:24:54,  9.39s/it]
 30%|██▉       | 11345/37963 [27:56:52<65:34:24,  8.87s/it]
 30%|██▉       | 11346/37963 [27:56:59<62:31:34,  8.46s/it]
 30%|██▉       | 11347/37963 [27:57:07<60:20:29,  8.16s/it]
 30%|██▉       | 11348/37963 [27:57:14<59:08:07,  8.00s/it]
 30%|██▉       | 11349/37963 [27:57:22<58:19:26,  7.89s/it]
 30%|██▉       | 11350/37963 [27:57:37<73:08:22,  9.89s/it]
                                                           
{'loss': '0.169', 'grad_norm': '2.626', 'learning_rate': '1.644e-05', 'epoch': '0.299'}
+
 30%|██▉       | 11350/37963 [27:57:37<73:08:22,  9.89s/it]
 30%|██▉       | 11351/37963 [27:57:44<68:31:29,  9.27s/it]
 30%|██▉       | 11352/37963 [27:57:52<65:02:17,  8.80s/it]
 30%|██▉       | 11353/37963 [27:58:00<62:33:21,  8.46s/it]
 30%|██▉       | 11354/37963 [27:58:07<59:55:03,  8.11s/it]
 30%|██▉       | 11355/37963 [27:58:15<58:41:45,  7.94s/it]
 30%|██▉       | 11356/37963 [27:58:22<58:06:28,  7.86s/it]
 30%|██▉       | 11357/37963 [27:58:30<57:46:54,  7.82s/it]
 30%|██▉       | 11358/37963 [27:58:38<57:37:41,  7.80s/it]
 30%|██▉       | 11359/37963 [27:58:53<73:13:01,  9.91s/it]
 30%|██▉       | 11360/37963 [27:59:00<68:27:46,  9.26s/it]
                                                           
{'loss': '0.1766', 'grad_norm': '1.001', 'learning_rate': '1.643e-05', 'epoch': '0.2992'}
+
 30%|██▉       | 11360/37963 [27:59:00<68:27:46,  9.26s/it]
 30%|██▉       | 11361/37963 [27:59:08<65:02:19,  8.80s/it]
 30%|██▉       | 11362/37963 [27:59:22<76:47:20, 10.39s/it]
 30%|██▉       | 11363/37963 [27:59:30<70:55:19,  9.60s/it]
 30%|██▉       | 11364/37963 [27:59:37<66:24:31,  8.99s/it]
 30%|██▉       | 11365/37963 [27:59:45<63:23:50,  8.58s/it]
 30%|██▉       | 11366/37963 [27:59:53<61:11:51,  8.28s/it]
 30%|██▉       | 11367/37963 [28:00:00<60:05:16,  8.13s/it]
 30%|██▉       | 11368/37963 [28:00:08<58:47:39,  7.96s/it]
 30%|██▉       | 11369/37963 [28:00:16<57:48:42,  7.83s/it]
 30%|██▉       | 11370/37963 [28:00:23<56:42:26,  7.68s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '2.532', 'learning_rate': '1.643e-05', 'epoch': '0.2995'}
+
 30%|██▉       | 11370/37963 [28:00:23<56:42:26,  7.68s/it]
 30%|██▉       | 11371/37963 [28:00:31<56:49:09,  7.69s/it]
 30%|██▉       | 11372/37963 [28:00:38<56:54:27,  7.70s/it]
 30%|██▉       | 11373/37963 [28:00:46<57:05:49,  7.73s/it]
 30%|██▉       | 11374/37963 [28:01:01<72:10:36,  9.77s/it]
 30%|██▉       | 11375/37963 [28:01:08<67:39:03,  9.16s/it]
 30%|██▉       | 11376/37963 [28:01:16<64:13:32,  8.70s/it]
 30%|██▉       | 11377/37963 [28:01:31<78:33:06, 10.64s/it]
 30%|██▉       | 11378/37963 [28:01:39<71:27:24,  9.68s/it]
 30%|██▉       | 11379/37963 [28:01:46<67:07:04,  9.09s/it]
 30%|██▉       | 11380/37963 [28:01:54<63:55:10,  8.66s/it]
                                                           
{'loss': '0.1543', 'grad_norm': '1.576', 'learning_rate': '1.642e-05', 'epoch': '0.2998'}
+
 30%|██▉       | 11380/37963 [28:01:54<63:55:10,  8.66s/it]
 30%|██▉       | 11381/37963 [28:02:02<61:27:52,  8.32s/it]
 30%|██▉       | 11382/37963 [28:02:09<60:12:11,  8.15s/it]
 30%|██▉       | 11383/37963 [28:02:17<58:50:14,  7.97s/it]
 30%|██▉       | 11384/37963 [28:02:24<57:58:15,  7.85s/it]
 30%|██▉       | 11385/37963 [28:02:32<57:20:13,  7.77s/it]
 30%|██▉       | 11386/37963 [28:02:40<57:32:15,  7.79s/it]
 30%|██▉       | 11387/37963 [28:02:48<57:33:00,  7.80s/it]
 30%|██▉       | 11388/37963 [28:03:02<71:35:19,  9.70s/it]
 30%|███       | 11389/37963 [28:03:16<81:43:51, 11.07s/it]
 30%|███       | 11390/37963 [28:03:31<89:23:02, 12.11s/it]
                                                           
{'loss': '0.163', 'grad_norm': '1.522', 'learning_rate': '1.641e-05', 'epoch': '0.3'}
+
 30%|███       | 11390/37963 [28:03:31<89:23:02, 12.11s/it]
 30%|███       | 11391/37963 [28:03:38<79:41:33, 10.80s/it]
 30%|███       | 11392/37963 [28:03:46<72:28:22,  9.82s/it]
 30%|███       | 11393/37963 [28:03:53<67:40:12,  9.17s/it]
 30%|███       | 11394/37963 [28:04:01<64:11:04,  8.70s/it]
 30%|███       | 11395/37963 [28:04:09<61:50:51,  8.38s/it]
 30%|███       | 11396/37963 [28:04:16<60:24:38,  8.19s/it]
 30%|███       | 11397/37963 [28:04:24<59:25:24,  8.05s/it]
 30%|███       | 11398/37963 [28:04:32<58:26:58,  7.92s/it]
 30%|███       | 11399/37963 [28:04:40<57:57:23,  7.85s/it]
 30%|███       | 11400/37963 [28:04:47<57:43:32,  7.82s/it]
                                                           
{'loss': '0.1679', 'grad_norm': '2.084', 'learning_rate': '1.641e-05', 'epoch': '0.3003'}
+
 30%|███       | 11400/37963 [28:04:47<57:43:32,  7.82s/it]
 30%|███       | 11401/37963 [28:04:55<57:28:24,  7.79s/it]
 30%|███       | 11402/37963 [28:05:03<57:15:28,  7.76s/it]
 30%|███       | 11403/37963 [28:05:10<56:52:43,  7.71s/it]
 30%|███       | 11404/37963 [28:05:24<70:51:58,  9.61s/it]
 30%|███       | 11405/37963 [28:05:32<66:36:06,  9.03s/it]
 30%|███       | 11406/37963 [28:05:47<79:44:46, 10.81s/it]
 30%|███       | 11407/37963 [28:05:55<72:41:48,  9.85s/it]
 30%|███       | 11408/37963 [28:06:02<67:35:39,  9.16s/it]
 30%|███       | 11409/37963 [28:06:10<64:07:49,  8.69s/it]
 30%|███       | 11410/37963 [28:06:24<76:30:04, 10.37s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '0.8625', 'learning_rate': '1.64e-05', 'epoch': '0.3006'}
+
 30%|███       | 11410/37963 [28:06:24<76:30:04, 10.37s/it]
 30%|███       | 11411/37963 [28:06:32<70:27:23,  9.55s/it]
 30%|███       | 11412/37963 [28:06:39<66:08:12,  8.97s/it]
 30%|███       | 11413/37963 [28:06:47<63:15:52,  8.58s/it]
 30%|███       | 11414/37963 [28:06:54<60:21:07,  8.18s/it]
 30%|███       | 11415/37963 [28:07:02<59:05:12,  8.01s/it]
 30%|███       | 11416/37963 [28:07:09<58:14:26,  7.90s/it]
 30%|███       | 11417/37963 [28:07:17<57:42:58,  7.83s/it]
 30%|███       | 11418/37963 [28:07:32<72:52:04,  9.88s/it]
 30%|███       | 11419/37963 [28:07:40<68:41:44,  9.32s/it]
 30%|███       | 11420/37963 [28:07:47<65:04:00,  8.82s/it]
                                                           
{'loss': '0.5316', 'grad_norm': '24.66', 'learning_rate': '1.639e-05', 'epoch': '0.3008'}
+
 30%|███       | 11420/37963 [28:07:47<65:04:00,  8.82s/it]
 30%|███       | 11421/37963 [28:07:55<62:33:56,  8.49s/it]
 30%|███       | 11422/37963 [28:08:03<60:48:37,  8.25s/it]
 30%|███       | 11423/37963 [28:08:10<59:31:28,  8.07s/it]
 30%|███       | 11424/37963 [28:08:18<58:28:16,  7.93s/it]
 30%|███       | 11425/37963 [28:08:33<73:00:02,  9.90s/it]
 30%|███       | 11426/37963 [28:08:40<68:15:35,  9.26s/it]
 30%|███       | 11427/37963 [28:08:48<64:55:43,  8.81s/it]
 30%|███       | 11428/37963 [28:08:56<61:52:06,  8.39s/it]
 30%|███       | 11429/37963 [28:09:03<60:04:04,  8.15s/it]
 30%|███       | 11430/37963 [28:09:11<59:02:35,  8.01s/it]
                                                           
{'loss': '1.207', 'grad_norm': '8.89', 'learning_rate': '1.639e-05', 'epoch': '0.3011'}
+
 30%|███       | 11430/37963 [28:09:11<59:02:35,  8.01s/it]
 30%|███       | 11431/37963 [28:09:18<58:12:56,  7.90s/it]
 30%|███       | 11432/37963 [28:09:26<57:41:38,  7.83s/it]
 30%|███       | 11433/37963 [28:09:34<56:51:11,  7.71s/it]
 30%|███       | 11434/37963 [28:09:41<57:01:30,  7.74s/it]
 30%|███       | 11435/37963 [28:09:49<56:49:29,  7.71s/it]
 30%|███       | 11436/37963 [28:09:57<56:34:28,  7.68s/it]
 30%|███       | 11437/37963 [28:10:17<85:49:46, 11.65s/it]
 30%|███       | 11438/37963 [28:10:25<77:12:17, 10.48s/it]
 30%|███       | 11439/37963 [28:10:33<70:52:15,  9.62s/it]
 30%|███       | 11440/37963 [28:10:48<82:12:01, 11.16s/it]
                                                           
{'loss': '0.1915', 'grad_norm': '3.556', 'learning_rate': '1.638e-05', 'epoch': '0.3013'}
+
 30%|███       | 11440/37963 [28:10:48<82:12:01, 11.16s/it]
 30%|███       | 11441/37963 [28:10:56<75:01:01, 10.18s/it]
 30%|███       | 11442/37963 [28:11:03<69:26:29,  9.43s/it]
 30%|███       | 11443/37963 [28:11:11<65:28:30,  8.89s/it]
 30%|███       | 11444/37963 [28:11:19<62:51:54,  8.53s/it]
 30%|███       | 11445/37963 [28:11:26<60:48:13,  8.25s/it]
 30%|███       | 11446/37963 [28:11:34<59:23:50,  8.06s/it]
 30%|███       | 11447/37963 [28:11:41<58:32:29,  7.95s/it]
 30%|███       | 11448/37963 [28:11:49<58:10:47,  7.90s/it]
 30%|███       | 11449/37963 [28:11:57<57:27:41,  7.80s/it]
 30%|███       | 11450/37963 [28:12:04<57:14:03,  7.77s/it]
                                                           
{'loss': '0.1693', 'grad_norm': '1.396', 'learning_rate': '1.637e-05', 'epoch': '0.3016'}
+
 30%|███       | 11450/37963 [28:12:04<57:14:03,  7.77s/it]
 30%|███       | 11451/37963 [28:12:18<70:54:35,  9.63s/it]
 30%|███       | 11452/37963 [28:12:26<66:32:40,  9.04s/it]
 30%|███       | 11453/37963 [28:12:33<62:44:34,  8.52s/it]
 30%|███       | 11454/37963 [28:12:48<76:43:46, 10.42s/it]
 30%|███       | 11455/37963 [28:12:56<70:38:42,  9.59s/it]
 30%|███       | 11456/37963 [28:13:04<66:20:50,  9.01s/it]
 30%|███       | 11457/37963 [28:13:11<62:56:45,  8.55s/it]
 30%|███       | 11458/37963 [28:13:19<61:08:14,  8.30s/it]
 30%|███       | 11459/37963 [28:13:26<59:34:16,  8.09s/it]
 30%|███       | 11460/37963 [28:13:34<58:34:59,  7.96s/it]
                                                           
{'loss': '0.1687', 'grad_norm': '1.726', 'learning_rate': '1.637e-05', 'epoch': '0.3019'}
+
 30%|███       | 11460/37963 [28:13:34<58:34:59,  7.96s/it]
 30%|███       | 11461/37963 [28:13:42<58:18:08,  7.92s/it]
 30%|███       | 11462/37963 [28:13:50<57:50:48,  7.86s/it]
 30%|███       | 11463/37963 [28:14:03<70:55:33,  9.64s/it]
 30%|███       | 11464/37963 [28:14:11<67:08:13,  9.12s/it]
 30%|███       | 11465/37963 [28:14:19<64:05:35,  8.71s/it]
 30%|███       | 11466/37963 [28:14:27<61:39:48,  8.38s/it]
 30%|███       | 11467/37963 [28:14:34<59:56:57,  8.15s/it]
 30%|███       | 11468/37963 [28:14:42<58:18:20,  7.92s/it]
 30%|███       | 11469/37963 [28:14:49<57:43:13,  7.84s/it]
 30%|███       | 11470/37963 [28:15:04<72:59:02,  9.92s/it]
                                                           
{'loss': '0.1836', 'grad_norm': '2.532', 'learning_rate': '1.636e-05', 'epoch': '0.3021'}
+
 30%|███       | 11470/37963 [28:15:04<72:59:02,  9.92s/it]
 30%|███       | 11471/37963 [28:15:12<68:03:32,  9.25s/it]
 30%|███       | 11472/37963 [28:15:27<80:42:37, 10.97s/it]
 30%|███       | 11473/37963 [28:15:34<73:16:15,  9.96s/it]
 30%|███       | 11474/37963 [28:15:42<68:23:28,  9.29s/it]
 30%|███       | 11475/37963 [28:15:50<64:46:14,  8.80s/it]
 30%|███       | 11476/37963 [28:15:57<62:04:06,  8.44s/it]
 30%|███       | 11477/37963 [28:16:05<60:14:05,  8.19s/it]
 30%|███       | 11478/37963 [28:16:12<58:29:56,  7.95s/it]
 30%|███       | 11479/37963 [28:16:20<58:37:36,  7.97s/it]
 30%|███       | 11480/37963 [28:16:28<57:22:37,  7.80s/it]
                                                           
{'loss': '0.1516', 'grad_norm': '4.111', 'learning_rate': '1.635e-05', 'epoch': '0.3024'}
+
 30%|███       | 11480/37963 [28:16:28<57:22:37,  7.80s/it]
 30%|███       | 11481/37963 [28:16:42<71:42:51,  9.75s/it]
 30%|███       | 11482/37963 [28:16:50<67:12:09,  9.14s/it]
 30%|███       | 11483/37963 [28:16:57<63:07:03,  8.58s/it]
 30%|███       | 11484/37963 [28:17:19<91:37:37, 12.46s/it]
 30%|███       | 11485/37963 [28:17:26<81:33:12, 11.09s/it]
 30%|███       | 11486/37963 [28:17:34<74:02:53, 10.07s/it]
 30%|███       | 11487/37963 [28:17:42<68:55:45,  9.37s/it]
 30%|███       | 11488/37963 [28:17:49<65:05:06,  8.85s/it]
 30%|███       | 11489/37963 [28:17:57<62:39:30,  8.52s/it]
 30%|███       | 11490/37963 [28:18:05<60:43:22,  8.26s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '1.873', 'learning_rate': '1.635e-05', 'epoch': '0.3027'}
+
 30%|███       | 11490/37963 [28:18:05<60:43:22,  8.26s/it]
 30%|███       | 11491/37963 [28:18:13<59:37:52,  8.11s/it]
 30%|███       | 11492/37963 [28:18:20<58:37:25,  7.97s/it]
 30%|███       | 11493/37963 [28:18:28<58:02:43,  7.89s/it]
 30%|███       | 11494/37963 [28:18:35<56:56:49,  7.75s/it]
 30%|███       | 11495/37963 [28:18:43<56:11:33,  7.64s/it]
 30%|███       | 11496/37963 [28:18:50<56:18:56,  7.66s/it]
 30%|███       | 11497/37963 [28:18:58<56:26:48,  7.68s/it]
 30%|███       | 11498/37963 [28:19:06<56:19:55,  7.66s/it]
 30%|███       | 11499/37963 [28:19:20<71:15:55,  9.69s/it]
 30%|███       | 11500/37963 [28:19:28<66:19:01,  9.02s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '1.349', 'learning_rate': '1.634e-05', 'epoch': '0.3029'}
+
 30%|███       | 11500/37963 [28:19:28<66:19:01,  9.02s/it]
 30%|███       | 11501/37963 [28:19:43<79:14:32, 10.78s/it]
 30%|███       | 11502/37963 [28:19:50<72:24:12,  9.85s/it]
 30%|███       | 11503/37963 [28:19:58<67:09:35,  9.14s/it]
 30%|███       | 11504/37963 [28:20:05<63:17:26,  8.61s/it]
 30%|███       | 11505/37963 [28:20:13<61:10:30,  8.32s/it]
 30%|███       | 11506/37963 [28:20:27<73:44:35, 10.03s/it]
 30%|███       | 11507/37963 [28:20:34<68:29:43,  9.32s/it]
 30%|███       | 11508/37963 [28:20:42<64:25:58,  8.77s/it]
 30%|███       | 11509/37963 [28:20:50<62:13:40,  8.47s/it]
 30%|███       | 11510/37963 [28:20:57<60:32:58,  8.24s/it]
                                                           
{'loss': '0.1805', 'grad_norm': '2.602', 'learning_rate': '1.634e-05', 'epoch': '0.3032'}
+
 30%|███       | 11510/37963 [28:20:57<60:32:58,  8.24s/it]
 30%|███       | 11511/37963 [28:21:05<58:51:12,  8.01s/it]
 30%|███       | 11512/37963 [28:21:13<57:59:16,  7.89s/it]
 30%|███       | 11513/37963 [28:21:20<57:34:13,  7.84s/it]
 30%|███       | 11514/37963 [28:21:28<56:58:00,  7.75s/it]
 30%|███       | 11515/37963 [28:21:35<56:38:43,  7.71s/it]
 30%|███       | 11516/37963 [28:21:43<56:27:53,  7.69s/it]
 30%|███       | 11517/37963 [28:21:51<56:20:22,  7.67s/it]
 30%|███       | 11518/37963 [28:21:58<56:08:06,  7.64s/it]
 30%|███       | 11519/37963 [28:22:06<55:56:20,  7.62s/it]
 30%|███       | 11520/37963 [28:22:13<55:51:34,  7.60s/it]
                                                           
{'loss': '0.1692', 'grad_norm': '6.208', 'learning_rate': '1.633e-05', 'epoch': '0.3035'}
+
 30%|███       | 11520/37963 [28:22:13<55:51:34,  7.60s/it]
 30%|███       | 11521/37963 [28:22:21<56:09:43,  7.65s/it]
 30%|███       | 11522/37963 [28:22:29<56:13:19,  7.65s/it]
 30%|███       | 11523/37963 [28:22:44<71:50:22,  9.78s/it]
 30%|███       | 11524/37963 [28:22:51<67:28:42,  9.19s/it]
 30%|███       | 11525/37963 [28:23:06<79:34:15, 10.83s/it]
 30%|███       | 11526/37963 [28:23:20<86:57:24, 11.84s/it]
 30%|███       | 11527/37963 [28:23:28<77:54:18, 10.61s/it]
 30%|███       | 11528/37963 [28:23:36<71:36:18,  9.75s/it]
 30%|███       | 11529/37963 [28:23:43<67:00:52,  9.13s/it]
 30%|███       | 11530/37963 [28:23:58<78:22:17, 10.67s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '1.774', 'learning_rate': '1.632e-05', 'epoch': '0.3037'}
+
 30%|███       | 11530/37963 [28:23:58<78:22:17, 10.67s/it]
 30%|███       | 11531/37963 [28:24:05<71:31:55,  9.74s/it]
 30%|███       | 11532/37963 [28:24:13<67:07:56,  9.14s/it]
 30%|███       | 11533/37963 [28:24:21<64:10:08,  8.74s/it]
 30%|███       | 11534/37963 [28:24:29<61:58:10,  8.44s/it]
 30%|███       | 11535/37963 [28:24:36<59:34:51,  8.12s/it]
 30%|███       | 11536/37963 [28:24:51<74:17:18, 10.12s/it]
 30%|███       | 11537/37963 [28:24:58<69:10:57,  9.42s/it]
 30%|███       | 11538/37963 [28:25:06<65:56:14,  8.98s/it]
 30%|███       | 11539/37963 [28:25:14<62:59:53,  8.58s/it]
 30%|███       | 11540/37963 [28:25:22<60:53:25,  8.30s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '3.408', 'learning_rate': '1.632e-05', 'epoch': '0.304'}
+
 30%|███       | 11540/37963 [28:25:22<60:53:25,  8.30s/it]
 30%|███       | 11541/37963 [28:25:29<59:08:01,  8.06s/it]
 30%|███       | 11542/37963 [28:25:37<58:09:46,  7.93s/it]
 30%|███       | 11543/37963 [28:25:44<56:57:38,  7.76s/it]
 30%|███       | 11544/37963 [28:25:52<55:59:57,  7.63s/it]
 30%|███       | 11545/37963 [28:25:59<55:57:23,  7.63s/it]
 30%|███       | 11546/37963 [28:26:13<70:03:42,  9.55s/it]
 30%|███       | 11547/37963 [28:26:28<81:11:02, 11.06s/it]
 30%|███       | 11548/37963 [28:26:35<73:14:20,  9.98s/it]
 30%|███       | 11549/37963 [28:26:43<68:26:11,  9.33s/it]
 30%|███       | 11550/37963 [28:26:51<64:47:38,  8.83s/it]
                                                           
{'loss': '0.1708', 'grad_norm': '1.667', 'learning_rate': '1.631e-05', 'epoch': '0.3042'}
+
 30%|███       | 11550/37963 [28:26:51<64:47:38,  8.83s/it]
 30%|███       | 11551/37963 [28:26:58<62:09:27,  8.47s/it]
 30%|███       | 11552/37963 [28:27:06<60:33:58,  8.26s/it]
 30%|███       | 11553/37963 [28:27:14<59:09:54,  8.06s/it]
 30%|███       | 11554/37963 [28:27:21<58:19:19,  7.95s/it]
 30%|███       | 11555/37963 [28:27:36<72:27:19,  9.88s/it]
 30%|███       | 11556/37963 [28:27:43<67:18:30,  9.18s/it]
 30%|███       | 11557/37963 [28:27:51<64:13:49,  8.76s/it]
 30%|███       | 11558/37963 [28:27:59<61:49:23,  8.43s/it]
 30%|███       | 11559/37963 [28:28:06<60:07:07,  8.20s/it]
 30%|███       | 11560/37963 [28:28:14<58:56:45,  8.04s/it]
                                                           
{'loss': '0.1744', 'grad_norm': '1.353', 'learning_rate': '1.63e-05', 'epoch': '0.3045'}
+
 30%|███       | 11560/37963 [28:28:14<58:56:45,  8.04s/it]
 30%|███       | 11561/37963 [28:28:22<58:02:53,  7.92s/it]
 30%|███       | 11562/37963 [28:28:30<57:55:56,  7.90s/it]
 30%|███       | 11563/37963 [28:28:37<57:29:04,  7.84s/it]
 30%|███       | 11564/37963 [28:28:45<57:03:31,  7.78s/it]
 30%|███       | 11565/37963 [28:28:53<57:05:05,  7.78s/it]
 30%|███       | 11566/37963 [28:29:00<56:13:35,  7.67s/it]
 30%|███       | 11567/37963 [28:29:08<56:19:24,  7.68s/it]
 30%|███       | 11568/37963 [28:29:15<55:57:36,  7.63s/it]
 30%|███       | 11569/37963 [28:29:23<55:52:53,  7.62s/it]
 30%|███       | 11570/37963 [28:29:37<70:37:14,  9.63s/it]
                                                           
{'loss': '0.1739', 'grad_norm': '1.697', 'learning_rate': '1.63e-05', 'epoch': '0.3048'}
+
 30%|███       | 11570/37963 [28:29:37<70:37:14,  9.63s/it]
 30%|███       | 11571/37963 [28:29:45<66:22:07,  9.05s/it]
 30%|███       | 11572/37963 [28:29:53<63:17:33,  8.63s/it]
 30%|███       | 11573/37963 [28:30:00<60:43:59,  8.28s/it]
 30%|███       | 11574/37963 [28:30:08<59:21:24,  8.10s/it]
 30%|███       | 11575/37963 [28:30:15<58:36:36,  8.00s/it]
 30%|███       | 11576/37963 [28:30:23<58:06:49,  7.93s/it]
 30%|███       | 11577/37963 [28:30:38<72:59:03,  9.96s/it]
 30%|███       | 11578/37963 [28:30:53<83:56:27, 11.45s/it]
 31%|███       | 11579/37963 [28:31:07<89:28:04, 12.21s/it]
 31%|███       | 11580/37963 [28:31:15<79:38:56, 10.87s/it]
                                                           
{'loss': '0.1703', 'grad_norm': '0.9523', 'learning_rate': '1.629e-05', 'epoch': '0.305'}
+
 31%|███       | 11580/37963 [28:31:15<79:38:56, 10.87s/it]
 31%|███       | 11581/37963 [28:31:22<72:55:13,  9.95s/it]
 31%|███       | 11582/37963 [28:31:30<67:55:45,  9.27s/it]
 31%|███       | 11583/37963 [28:31:38<64:14:00,  8.77s/it]
 31%|███       | 11584/37963 [28:31:45<61:36:38,  8.41s/it]
 31%|███       | 11585/37963 [28:31:53<60:01:08,  8.19s/it]
 31%|███       | 11586/37963 [28:32:01<58:48:28,  8.03s/it]
 31%|███       | 11587/37963 [28:32:08<57:36:57,  7.86s/it]
 31%|███       | 11588/37963 [28:32:16<57:14:49,  7.81s/it]
 31%|███       | 11589/37963 [28:32:23<56:07:35,  7.66s/it]
 31%|███       | 11590/37963 [28:32:38<71:28:58,  9.76s/it]
                                                           
{'loss': '0.1727', 'grad_norm': '3.557', 'learning_rate': '1.628e-05', 'epoch': '0.3053'}
+
 31%|███       | 11590/37963 [28:32:38<71:28:58,  9.76s/it]
 31%|███       | 11591/37963 [28:32:45<66:48:02,  9.12s/it]
 31%|███       | 11592/37963 [28:32:53<63:42:23,  8.70s/it]
 31%|███       | 11593/37963 [28:33:01<61:12:32,  8.36s/it]
 31%|███       | 11594/37963 [28:33:08<59:30:48,  8.13s/it]
 31%|███       | 11595/37963 [28:33:22<72:57:41,  9.96s/it]
 31%|███       | 11596/37963 [28:33:30<67:39:52,  9.24s/it]
 31%|███       | 11597/37963 [28:33:44<78:18:03, 10.69s/it]
 31%|███       | 11598/37963 [28:33:52<71:08:36,  9.71s/it]
 31%|███       | 11599/37963 [28:33:59<66:12:43,  9.04s/it]
 31%|███       | 11600/37963 [28:34:07<63:16:23,  8.64s/it]
                                                           
{'loss': '0.1684', 'grad_norm': '1.66', 'learning_rate': '1.628e-05', 'epoch': '0.3056'}
+
 31%|███       | 11600/37963 [28:34:07<63:16:23,  8.64s/it]
 31%|███       | 11601/37963 [28:34:21<75:27:54, 10.31s/it]
 31%|███       | 11602/37963 [28:34:29<69:48:19,  9.53s/it]
 31%|███       | 11603/37963 [28:34:36<65:51:37,  8.99s/it]
 31%|███       | 11604/37963 [28:34:44<62:48:10,  8.58s/it]
 31%|███       | 11605/37963 [28:34:51<60:27:02,  8.26s/it]
 31%|███       | 11606/37963 [28:34:59<59:11:07,  8.08s/it]
 31%|███       | 11607/37963 [28:35:07<58:21:40,  7.97s/it]
 31%|███       | 11608/37963 [28:35:14<57:03:33,  7.79s/it]
 31%|███       | 11609/37963 [28:35:22<57:06:27,  7.80s/it]
 31%|███       | 11610/37963 [28:35:30<56:44:00,  7.75s/it]
                                                           
{'loss': '0.1644', 'grad_norm': '1.55', 'learning_rate': '1.627e-05', 'epoch': '0.3058'}
+
 31%|███       | 11610/37963 [28:35:30<56:44:00,  7.75s/it]
 31%|███       | 11611/37963 [28:35:37<56:18:35,  7.69s/it]
 31%|███       | 11612/37963 [28:35:45<56:37:47,  7.74s/it]
 31%|███       | 11613/37963 [28:35:53<56:38:42,  7.74s/it]
 31%|███       | 11614/37963 [28:36:00<56:20:11,  7.70s/it]
 31%|███       | 11615/37963 [28:36:08<56:13:26,  7.68s/it]
 31%|███       | 11616/37963 [28:36:16<55:55:20,  7.64s/it]
 31%|███       | 11617/37963 [28:36:23<55:58:56,  7.65s/it]
 31%|███       | 11618/37963 [28:36:31<56:03:12,  7.66s/it]
 31%|███       | 11619/37963 [28:36:38<55:18:57,  7.56s/it]
 31%|███       | 11620/37963 [28:36:46<55:29:15,  7.58s/it]
                                                           
{'loss': '0.1743', 'grad_norm': '0.8927', 'learning_rate': '1.626e-05', 'epoch': '0.3061'}
+
 31%|███       | 11620/37963 [28:36:46<55:29:15,  7.58s/it]
 31%|███       | 11621/37963 [28:37:00<70:18:09,  9.61s/it]
 31%|███       | 11622/37963 [28:37:15<80:37:40, 11.02s/it]
 31%|███       | 11623/37963 [28:37:22<73:22:18, 10.03s/it]
 31%|███       | 11624/37963 [28:37:30<68:03:49,  9.30s/it]
 31%|███       | 11625/37963 [28:37:37<63:54:50,  8.74s/it]
 31%|███       | 11626/37963 [28:37:51<75:45:01, 10.35s/it]
 31%|███       | 11627/37963 [28:37:59<69:59:22,  9.57s/it]
 31%|███       | 11628/37963 [28:38:07<65:39:31,  8.98s/it]
 31%|███       | 11629/37963 [28:38:14<62:23:08,  8.53s/it]
 31%|███       | 11630/37963 [28:38:29<76:15:24, 10.43s/it]
                                                           
{'loss': '0.1696', 'grad_norm': '1.396', 'learning_rate': '1.626e-05', 'epoch': '0.3064'}
+
 31%|███       | 11630/37963 [28:38:29<76:15:24, 10.43s/it]
 31%|███       | 11631/37963 [28:38:37<70:08:11,  9.59s/it]
 31%|███       | 11632/37963 [28:38:44<65:48:50,  9.00s/it]
 31%|███       | 11633/37963 [28:38:52<63:06:13,  8.63s/it]
 31%|███       | 11634/37963 [28:39:00<60:56:36,  8.33s/it]
 31%|███       | 11635/37963 [28:39:08<59:46:51,  8.17s/it]
 31%|███       | 11636/37963 [28:39:15<58:35:10,  8.01s/it]
 31%|███       | 11637/37963 [28:39:23<57:28:02,  7.86s/it]
 31%|███       | 11638/37963 [28:39:30<56:51:32,  7.78s/it]
 31%|███       | 11639/37963 [28:39:38<56:52:00,  7.78s/it]
 31%|███       | 11640/37963 [28:39:46<56:07:35,  7.68s/it]
                                                           
{'loss': '0.1759', 'grad_norm': '3.556', 'learning_rate': '1.625e-05', 'epoch': '0.3066'}
+
 31%|███       | 11640/37963 [28:39:46<56:07:35,  7.68s/it]
 31%|███       | 11641/37963 [28:40:00<70:59:54,  9.71s/it]
 31%|███       | 11642/37963 [28:40:08<66:17:35,  9.07s/it]
 31%|███       | 11643/37963 [28:40:15<63:10:01,  8.64s/it]
 31%|███       | 11644/37963 [28:40:37<93:01:54, 12.73s/it]
 31%|███       | 11645/37963 [28:40:45<81:46:46, 11.19s/it]
 31%|███       | 11646/37963 [28:40:53<74:00:13, 10.12s/it]
 31%|███       | 11647/37963 [28:41:00<68:40:06,  9.39s/it]
 31%|███       | 11648/37963 [28:41:08<65:10:18,  8.92s/it]
 31%|███       | 11649/37963 [28:41:22<77:02:33, 10.54s/it]
 31%|███       | 11650/37963 [28:41:30<70:01:52,  9.58s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '2.702', 'learning_rate': '1.624e-05', 'epoch': '0.3069'}
+
 31%|███       | 11650/37963 [28:41:30<70:01:52,  9.58s/it]
 31%|███       | 11651/37963 [28:41:37<65:39:28,  8.98s/it]
 31%|███       | 11652/37963 [28:41:45<62:38:10,  8.57s/it]
 31%|███       | 11653/37963 [28:41:53<60:40:52,  8.30s/it]
 31%|███       | 11654/37963 [28:42:00<59:06:50,  8.09s/it]
 31%|███       | 11655/37963 [28:42:08<58:11:25,  7.96s/it]
 31%|███       | 11656/37963 [28:42:16<57:19:19,  7.84s/it]
 31%|███       | 11657/37963 [28:42:23<57:06:37,  7.82s/it]
 31%|███       | 11658/37963 [28:42:31<57:09:28,  7.82s/it]
 31%|███       | 11659/37963 [28:42:39<56:47:04,  7.77s/it]
 31%|███       | 11660/37963 [28:42:46<56:23:01,  7.72s/it]
                                                           
{'loss': '0.1667', 'grad_norm': '1.701', 'learning_rate': '1.624e-05', 'epoch': '0.3071'}
+
 31%|███       | 11660/37963 [28:42:46<56:23:01,  7.72s/it]
 31%|███       | 11661/37963 [28:42:54<55:56:00,  7.66s/it]
 31%|███       | 11662/37963 [28:43:02<56:12:57,  7.69s/it]
 31%|███       | 11663/37963 [28:43:09<55:56:46,  7.66s/it]
 31%|███       | 11664/37963 [28:43:17<55:58:29,  7.66s/it]
 31%|███       | 11665/37963 [28:43:24<55:35:03,  7.61s/it]
 31%|███       | 11666/37963 [28:43:32<55:33:55,  7.61s/it]
 31%|███       | 11667/37963 [28:43:40<55:46:00,  7.63s/it]
 31%|███       | 11668/37963 [28:43:47<55:52:34,  7.65s/it]
 31%|███       | 11669/37963 [28:43:55<55:51:40,  7.65s/it]
 31%|███       | 11670/37963 [28:44:03<55:39:10,  7.62s/it]
                                                           
{'loss': '0.1636', 'grad_norm': '1.346', 'learning_rate': '1.623e-05', 'epoch': '0.3074'}
+
 31%|███       | 11670/37963 [28:44:03<55:39:10,  7.62s/it]
 31%|███       | 11671/37963 [28:44:10<56:02:42,  7.67s/it]
 31%|███       | 11672/37963 [28:44:18<56:20:41,  7.72s/it]
 31%|███       | 11673/37963 [28:44:26<56:17:37,  7.71s/it]
 31%|███       | 11674/37963 [28:44:34<56:12:29,  7.70s/it]
 31%|███       | 11675/37963 [28:44:48<71:17:42,  9.76s/it]
 31%|███       | 11676/37963 [28:45:03<81:54:05, 11.22s/it]
 31%|███       | 11677/37963 [28:45:10<74:05:18, 10.15s/it]
 31%|███       | 11678/37963 [28:45:18<68:43:21,  9.41s/it]
 31%|███       | 11679/37963 [28:45:32<78:46:18, 10.79s/it]
 31%|███       | 11680/37963 [28:45:40<72:02:58,  9.87s/it]
                                                           
{'loss': '0.151', 'grad_norm': '3.599', 'learning_rate': '1.622e-05', 'epoch': '0.3077'}
+
 31%|███       | 11680/37963 [28:45:40<72:02:58,  9.87s/it]
 31%|███       | 11681/37963 [28:45:48<67:16:27,  9.21s/it]
 31%|███       | 11682/37963 [28:45:55<63:06:39,  8.64s/it]
 31%|███       | 11683/37963 [28:46:02<60:50:23,  8.33s/it]
 31%|███       | 11684/37963 [28:46:10<59:19:14,  8.13s/it]
 31%|███       | 11685/37963 [28:46:25<74:21:46, 10.19s/it]
 31%|███       | 11686/37963 [28:46:33<68:55:01,  9.44s/it]
 31%|███       | 11687/37963 [28:46:47<79:25:14, 10.88s/it]
 31%|███       | 11688/37963 [28:47:02<87:29:30, 11.99s/it]
 31%|███       | 11689/37963 [28:47:09<77:51:25, 10.67s/it]
 31%|███       | 11690/37963 [28:47:17<71:26:41,  9.79s/it]
                                                           
{'loss': '0.1697', 'grad_norm': '3.435', 'learning_rate': '1.622e-05', 'epoch': '0.3079'}
+
 31%|███       | 11690/37963 [28:47:17<71:26:41,  9.79s/it]
 31%|███       | 11691/37963 [28:47:25<66:59:55,  9.18s/it]
 31%|███       | 11692/37963 [28:47:32<63:42:45,  8.73s/it]
 31%|███       | 11693/37963 [28:47:47<76:17:26, 10.45s/it]
 31%|███       | 11694/37963 [28:48:01<84:56:41, 11.64s/it]
 31%|███       | 11695/37963 [28:48:09<76:14:52, 10.45s/it]
 31%|███       | 11696/37963 [28:48:17<70:27:33,  9.66s/it]
 31%|███       | 11697/37963 [28:48:24<66:05:16,  9.06s/it]
 31%|███       | 11698/37963 [28:48:32<63:06:39,  8.65s/it]
 31%|███       | 11699/37963 [28:48:40<60:31:57,  8.30s/it]
 31%|███       | 11700/37963 [28:48:47<59:12:08,  8.12s/it]
                                                           
{'loss': '0.1685', 'grad_norm': '2.187', 'learning_rate': '1.621e-05', 'epoch': '0.3082'}
+
 31%|███       | 11700/37963 [28:48:47<59:12:08,  8.12s/it]
 31%|███       | 11701/37963 [28:48:55<58:34:42,  8.03s/it]
 31%|███       | 11702/37963 [28:49:03<57:17:16,  7.85s/it]
 31%|███       | 11703/37963 [28:49:10<56:46:51,  7.78s/it]
 31%|███       | 11704/37963 [28:49:18<56:36:37,  7.76s/it]
 31%|███       | 11705/37963 [28:49:25<56:23:05,  7.73s/it]
 31%|███       | 11706/37963 [28:49:33<56:07:17,  7.69s/it]
 31%|███       | 11707/37963 [28:49:41<55:33:52,  7.62s/it]
 31%|███       | 11708/37963 [28:49:48<55:39:38,  7.63s/it]
 31%|███       | 11709/37963 [28:49:56<55:41:59,  7.64s/it]
 31%|███       | 11710/37963 [28:50:03<55:32:36,  7.62s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '1.649', 'learning_rate': '1.62e-05', 'epoch': '0.3085'}
+
 31%|███       | 11710/37963 [28:50:03<55:32:36,  7.62s/it]
 31%|███       | 11711/37963 [28:50:11<55:20:31,  7.59s/it]
 31%|███       | 11712/37963 [28:50:19<55:28:07,  7.61s/it]
 31%|███       | 11713/37963 [28:50:26<55:39:28,  7.63s/it]
 31%|███       | 11714/37963 [28:50:34<55:39:28,  7.63s/it]
 31%|███       | 11715/37963 [28:50:42<55:35:27,  7.62s/it]
 31%|███       | 11716/37963 [28:50:49<55:50:10,  7.66s/it]
 31%|███       | 11717/37963 [28:50:57<55:47:20,  7.65s/it]
 31%|███       | 11718/37963 [28:51:05<56:04:15,  7.69s/it]
 31%|███       | 11719/37963 [28:51:12<55:49:30,  7.66s/it]
 31%|███       | 11720/37963 [28:51:20<55:54:21,  7.67s/it]
                                                           
{'loss': '0.172', 'grad_norm': '1.744', 'learning_rate': '1.62e-05', 'epoch': '0.3087'}
+
 31%|███       | 11720/37963 [28:51:20<55:54:21,  7.67s/it]
 31%|███       | 11721/37963 [28:51:27<55:34:35,  7.62s/it]
 31%|███       | 11722/37963 [28:51:35<55:42:21,  7.64s/it]
 31%|███       | 11723/37963 [28:51:43<55:37:58,  7.63s/it]
 31%|███       | 11724/37963 [28:51:58<72:56:42, 10.01s/it]
 31%|███       | 11725/37963 [28:52:06<67:57:46,  9.32s/it]
 31%|███       | 11726/37963 [28:52:14<64:08:57,  8.80s/it]
 31%|███       | 11727/37963 [28:52:28<75:58:41, 10.43s/it]
 31%|███       | 11728/37963 [28:52:42<83:40:47, 11.48s/it]
 31%|███       | 11729/37963 [28:52:50<75:55:26, 10.42s/it]
 31%|███       | 11730/37963 [28:52:57<69:44:57,  9.57s/it]
                                                           
{'loss': '0.1775', 'grad_norm': '2.15', 'learning_rate': '1.619e-05', 'epoch': '0.309'}
+
 31%|███       | 11730/37963 [28:52:57<69:44:57,  9.57s/it]
 31%|███       | 11731/37963 [28:53:05<64:43:52,  8.88s/it]
 31%|███       | 11732/37963 [28:53:19<77:27:32, 10.63s/it]
 31%|███       | 11733/37963 [28:53:27<71:01:16,  9.75s/it]
 31%|███       | 11734/37963 [28:53:35<66:17:12,  9.10s/it]
 31%|███       | 11735/37963 [28:53:42<63:06:15,  8.66s/it]
 31%|███       | 11736/37963 [28:53:50<61:04:25,  8.38s/it]
 31%|███       | 11737/37963 [28:54:11<89:26:15, 12.28s/it]
 31%|███       | 11738/37963 [28:54:19<79:01:54, 10.85s/it]
 31%|███       | 11739/37963 [28:54:27<72:18:38,  9.93s/it]
 31%|███       | 11740/37963 [28:54:34<67:36:45,  9.28s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '3.405', 'learning_rate': '1.618e-05', 'epoch': '0.3092'}
+
 31%|███       | 11740/37963 [28:54:34<67:36:45,  9.28s/it]
 31%|███       | 11741/37963 [28:54:49<78:37:34, 10.79s/it]
 31%|███       | 11742/37963 [28:55:03<86:23:07, 11.86s/it]
 31%|███       | 11743/37963 [28:55:11<77:08:24, 10.59s/it]
 31%|███       | 11744/37963 [28:55:18<70:44:17,  9.71s/it]
 31%|███       | 11745/37963 [28:55:26<65:35:53,  9.01s/it]
 31%|███       | 11746/37963 [28:55:33<62:29:29,  8.58s/it]
 31%|███       | 11747/37963 [28:55:41<60:01:02,  8.24s/it]
 31%|███       | 11748/37963 [28:55:48<58:52:33,  8.09s/it]
 31%|███       | 11749/37963 [28:55:56<58:10:52,  7.99s/it]
 31%|███       | 11750/37963 [28:56:04<57:22:05,  7.88s/it]
                                                           
{'loss': '0.1661', 'grad_norm': '2.468', 'learning_rate': '1.618e-05', 'epoch': '0.3095'}
+
 31%|███       | 11750/37963 [28:56:04<57:22:05,  7.88s/it]
 31%|███       | 11751/37963 [28:56:12<56:51:57,  7.81s/it]
 31%|███       | 11752/37963 [28:56:19<56:29:12,  7.76s/it]
 31%|███       | 11753/37963 [28:56:27<56:19:37,  7.74s/it]
 31%|███       | 11754/37963 [28:56:34<55:42:47,  7.65s/it]
 31%|███       | 11755/37963 [28:56:42<55:50:38,  7.67s/it]
 31%|███       | 11756/37963 [28:56:50<55:53:18,  7.68s/it]
 31%|███       | 11757/37963 [28:56:57<55:55:43,  7.68s/it]
 31%|███       | 11758/37963 [28:57:05<55:53:47,  7.68s/it]
 31%|███       | 11759/37963 [28:57:13<55:43:21,  7.66s/it]
 31%|███       | 11760/37963 [28:57:20<55:58:48,  7.69s/it]
                                                           
{'loss': '0.1703', 'grad_norm': '1.751', 'learning_rate': '1.617e-05', 'epoch': '0.3098'}
+
 31%|███       | 11760/37963 [28:57:20<55:58:48,  7.69s/it]
 31%|███       | 11761/37963 [28:57:28<55:52:31,  7.68s/it]
 31%|███       | 11762/37963 [28:57:35<55:14:29,  7.59s/it]
 31%|███       | 11763/37963 [28:57:43<55:14:48,  7.59s/it]
 31%|███       | 11764/37963 [28:57:51<55:16:13,  7.59s/it]
 31%|███       | 11765/37963 [28:57:58<55:15:43,  7.59s/it]
 31%|███       | 11766/37963 [28:58:06<55:38:14,  7.65s/it]
 31%|███       | 11767/37963 [28:58:14<55:17:54,  7.60s/it]
 31%|███       | 11768/37963 [28:58:21<55:35:57,  7.64s/it]
 31%|███       | 11769/37963 [28:58:29<55:06:58,  7.57s/it]
 31%|███       | 11770/37963 [28:58:36<54:48:41,  7.53s/it]
                                                           
{'loss': '0.1652', 'grad_norm': '4.52', 'learning_rate': '1.616e-05', 'epoch': '0.31'}
+
 31%|███       | 11770/37963 [28:58:36<54:48:41,  7.53s/it]
 31%|███       | 11771/37963 [28:58:44<55:09:07,  7.58s/it]
 31%|███       | 11772/37963 [28:58:59<70:46:14,  9.73s/it]
 31%|███       | 11773/37963 [28:59:13<80:03:20, 11.00s/it]
 31%|███       | 11774/37963 [28:59:20<73:21:02, 10.08s/it]
 31%|███       | 11775/37963 [28:59:28<68:01:25,  9.35s/it]
 31%|███       | 11776/37963 [28:59:36<64:02:06,  8.80s/it]
 31%|███       | 11777/37963 [28:59:43<61:25:28,  8.44s/it]
 31%|███       | 11778/37963 [28:59:51<59:51:56,  8.23s/it]
 31%|███       | 11779/37963 [28:59:59<58:41:16,  8.07s/it]
 31%|███       | 11780/37963 [29:00:06<57:45:43,  7.94s/it]
                                                           
{'loss': '0.1618', 'grad_norm': '2.689', 'learning_rate': '1.616e-05', 'epoch': '0.3103'}
+
 31%|███       | 11780/37963 [29:00:06<57:45:43,  7.94s/it]
 31%|███       | 11781/37963 [29:00:28<87:17:56, 12.00s/it]
 31%|███       | 11782/37963 [29:00:42<91:49:45, 12.63s/it]
 31%|███       | 11783/37963 [29:00:50<81:01:10, 11.14s/it]
 31%|███       | 11784/37963 [29:00:57<73:29:00, 10.11s/it]
 31%|███       | 11785/37963 [29:01:05<67:56:47,  9.34s/it]
 31%|███       | 11786/37963 [29:01:12<63:27:13,  8.73s/it]
 31%|███       | 11787/37963 [29:01:20<61:31:25,  8.46s/it]
 31%|███       | 11788/37963 [29:01:28<59:44:04,  8.22s/it]
 31%|███       | 11789/37963 [29:01:35<58:26:12,  8.04s/it]
 31%|███       | 11790/37963 [29:01:43<57:34:40,  7.92s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '1.43', 'learning_rate': '1.615e-05', 'epoch': '0.3106'}
+
 31%|███       | 11790/37963 [29:01:43<57:34:40,  7.92s/it]
 31%|███       | 11791/37963 [29:01:51<57:13:05,  7.87s/it]
 31%|███       | 11792/37963 [29:01:58<56:43:30,  7.80s/it]
 31%|███       | 11793/37963 [29:02:13<72:11:27,  9.93s/it]
 31%|███       | 11794/37963 [29:02:21<67:26:11,  9.28s/it]
 31%|███       | 11795/37963 [29:02:35<78:03:29, 10.74s/it]
 31%|███       | 11796/37963 [29:02:42<70:52:52,  9.75s/it]
 31%|███       | 11797/37963 [29:02:50<66:19:47,  9.13s/it]
 31%|███       | 11798/37963 [29:02:58<63:01:20,  8.67s/it]
 31%|███       | 11799/37963 [29:03:05<60:46:26,  8.36s/it]
 31%|███       | 11800/37963 [29:03:13<59:07:57,  8.14s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '1.208', 'learning_rate': '1.614e-05', 'epoch': '0.3108'}
+
 31%|███       | 11800/37963 [29:03:13<59:07:57,  8.14s/it]
 31%|███       | 11801/37963 [29:03:21<57:54:13,  7.97s/it]
 31%|███       | 11802/37963 [29:03:28<57:06:35,  7.86s/it]
 31%|███       | 11803/37963 [29:03:36<57:06:53,  7.86s/it]
 31%|███       | 11804/37963 [29:03:44<56:44:05,  7.81s/it]
 31%|███       | 11805/37963 [29:03:51<56:27:58,  7.77s/it]
 31%|███       | 11806/37963 [29:03:59<56:10:54,  7.73s/it]
 31%|███       | 11807/37963 [29:04:06<55:13:23,  7.60s/it]
 31%|███       | 11808/37963 [29:04:14<55:20:41,  7.62s/it]
 31%|███       | 11809/37963 [29:04:22<55:28:10,  7.64s/it]
 31%|███       | 11810/37963 [29:04:30<55:50:22,  7.69s/it]
                                                           
{'loss': '0.1722', 'grad_norm': '3.011', 'learning_rate': '1.614e-05', 'epoch': '0.3111'}
+
 31%|███       | 11810/37963 [29:04:30<55:50:22,  7.69s/it]
 31%|███       | 11811/37963 [29:04:37<54:59:50,  7.57s/it]
 31%|███       | 11812/37963 [29:04:44<55:07:20,  7.59s/it]
 31%|███       | 11813/37963 [29:04:52<55:17:19,  7.61s/it]
 31%|███       | 11814/37963 [29:05:00<55:16:07,  7.61s/it]
 31%|███       | 11815/37963 [29:05:14<69:28:15,  9.56s/it]
 31%|███       | 11816/37963 [29:05:22<65:48:38,  9.06s/it]
 31%|███       | 11817/37963 [29:05:29<62:36:47,  8.62s/it]
 31%|███       | 11818/37963 [29:05:37<60:24:17,  8.32s/it]
 31%|███       | 11819/37963 [29:05:45<58:56:02,  8.12s/it]
 31%|███       | 11820/37963 [29:05:52<57:59:23,  7.99s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '1.283', 'learning_rate': '1.613e-05', 'epoch': '0.3114'}
+
 31%|███       | 11820/37963 [29:05:52<57:59:23,  7.99s/it]
 31%|███       | 11821/37963 [29:06:00<56:43:19,  7.81s/it]
 31%|███       | 11822/37963 [29:06:07<56:11:05,  7.74s/it]
 31%|███       | 11823/37963 [29:06:15<55:58:37,  7.71s/it]
 31%|███       | 11824/37963 [29:06:23<55:50:47,  7.69s/it]
 31%|███       | 11825/37963 [29:06:30<56:02:05,  7.72s/it]
 31%|███       | 11826/37963 [29:06:38<55:35:56,  7.66s/it]
 31%|███       | 11827/37963 [29:06:52<70:24:39,  9.70s/it]
 31%|███       | 11828/37963 [29:07:00<66:22:26,  9.14s/it]
 31%|███       | 11829/37963 [29:07:15<78:47:15, 10.85s/it]
 31%|███       | 11830/37963 [29:07:29<86:32:31, 11.92s/it]
                                                           
{'loss': '0.1716', 'grad_norm': '1.685', 'learning_rate': '1.612e-05', 'epoch': '0.3116'}
+
 31%|███       | 11830/37963 [29:07:29<86:32:31, 11.92s/it]
 31%|███       | 11831/37963 [29:07:43<91:16:53, 12.58s/it]
 31%|███       | 11832/37963 [29:07:51<81:17:01, 11.20s/it]
 31%|███       | 11833/37963 [29:07:59<73:31:58, 10.13s/it]
 31%|███       | 11834/37963 [29:08:13<82:39:59, 11.39s/it]
 31%|███       | 11835/37963 [29:08:21<74:42:38, 10.29s/it]
 31%|███       | 11836/37963 [29:08:29<68:35:59,  9.45s/it]
 31%|███       | 11837/37963 [29:08:36<64:36:11,  8.90s/it]
 31%|███       | 11838/37963 [29:08:44<62:02:07,  8.55s/it]
 31%|███       | 11839/37963 [29:08:52<60:06:13,  8.28s/it]
 31%|███       | 11840/37963 [29:08:59<58:50:25,  8.11s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '1.943', 'learning_rate': '1.611e-05', 'epoch': '0.3119'}
+
 31%|███       | 11840/37963 [29:08:59<58:50:25,  8.11s/it]
 31%|███       | 11841/37963 [29:09:07<57:21:09,  7.90s/it]
 31%|███       | 11842/37963 [29:09:14<56:38:33,  7.81s/it]
 31%|███       | 11843/37963 [29:09:22<56:29:48,  7.79s/it]
 31%|███       | 11844/37963 [29:09:36<70:05:50,  9.66s/it]
 31%|███       | 11845/37963 [29:09:44<66:09:03,  9.12s/it]
 31%|███       | 11846/37963 [29:09:52<63:27:49,  8.75s/it]
 31%|███       | 11847/37963 [29:10:07<76:45:31, 10.58s/it]
 31%|███       | 11848/37963 [29:10:14<70:38:21,  9.74s/it]
 31%|███       | 11849/37963 [29:10:22<66:06:29,  9.11s/it]
 31%|███       | 11850/37963 [29:10:30<62:34:10,  8.63s/it]
                                                           
{'loss': '0.1779', 'grad_norm': '1.441', 'learning_rate': '1.611e-05', 'epoch': '0.3121'}
+
 31%|███       | 11850/37963 [29:10:30<62:34:10,  8.63s/it]
 31%|███       | 11851/37963 [29:10:37<60:24:38,  8.33s/it]
 31%|███       | 11852/37963 [29:10:45<59:16:26,  8.17s/it]
 31%|███       | 11853/37963 [29:10:53<58:00:18,  8.00s/it]
 31%|███       | 11854/37963 [29:11:00<56:56:09,  7.85s/it]
 31%|███       | 11855/37963 [29:11:08<56:47:21,  7.83s/it]
 31%|███       | 11856/37963 [29:11:16<56:41:30,  7.82s/it]
 31%|███       | 11857/37963 [29:11:23<55:39:38,  7.68s/it]
 31%|███       | 11858/37963 [29:11:31<55:15:17,  7.62s/it]
 31%|███       | 11859/37963 [29:11:45<70:34:17,  9.73s/it]
 31%|███       | 11860/37963 [29:11:53<66:13:58,  9.13s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '3.31', 'learning_rate': '1.61e-05', 'epoch': '0.3124'}
+
 31%|███       | 11860/37963 [29:11:53<66:13:58,  9.13s/it]
 31%|███       | 11861/37963 [29:12:01<62:59:34,  8.69s/it]
 31%|███       | 11862/37963 [29:12:08<60:29:13,  8.34s/it]
 31%|███       | 11863/37963 [29:12:16<59:00:59,  8.14s/it]
 31%|███▏      | 11864/37963 [29:12:23<57:56:43,  7.99s/it]
 31%|███▏      | 11865/37963 [29:12:31<57:02:28,  7.87s/it]
 31%|███▏      | 11866/37963 [29:12:39<56:28:14,  7.79s/it]
 31%|███▏      | 11867/37963 [29:12:46<55:29:03,  7.65s/it]
 31%|███▏      | 11868/37963 [29:12:54<55:32:58,  7.66s/it]
 31%|███▏      | 11869/37963 [29:13:01<55:25:05,  7.65s/it]
 31%|███▏      | 11870/37963 [29:13:09<55:23:19,  7.64s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '1.923', 'learning_rate': '1.609e-05', 'epoch': '0.3127'}
+
 31%|███▏      | 11870/37963 [29:13:09<55:23:19,  7.64s/it]
 31%|███▏      | 11871/37963 [29:13:17<55:25:44,  7.65s/it]
 31%|███▏      | 11872/37963 [29:13:24<55:24:26,  7.65s/it]
 31%|███▏      | 11873/37963 [29:13:32<55:13:16,  7.62s/it]
 31%|███▏      | 11874/37963 [29:13:39<55:19:41,  7.63s/it]
 31%|███▏      | 11875/37963 [29:13:47<55:37:24,  7.68s/it]
 31%|███▏      | 11876/37963 [29:13:55<55:21:45,  7.64s/it]
 31%|███▏      | 11877/37963 [29:14:02<55:17:59,  7.63s/it]
 31%|███▏      | 11878/37963 [29:14:17<70:58:41,  9.80s/it]
 31%|███▏      | 11879/37963 [29:14:25<66:29:02,  9.18s/it]
 31%|███▏      | 11880/37963 [29:14:33<63:04:46,  8.71s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '1.273', 'learning_rate': '1.609e-05', 'epoch': '0.3129'}
+
 31%|███▏      | 11880/37963 [29:14:33<63:04:46,  8.71s/it]
 31%|███▏      | 11881/37963 [29:14:47<75:43:52, 10.45s/it]
 31%|███▏      | 11882/37963 [29:15:02<85:26:24, 11.79s/it]
 31%|███▏      | 11883/37963 [29:15:16<90:52:31, 12.54s/it]
 31%|███▏      | 11884/37963 [29:15:24<80:47:03, 11.15s/it]
 31%|███▏      | 11885/37963 [29:15:32<73:36:40, 10.16s/it]
 31%|███▏      | 11886/37963 [29:15:46<82:39:56, 11.41s/it]
 31%|███▏      | 11887/37963 [29:15:54<74:53:40, 10.34s/it]
 31%|███▏      | 11888/37963 [29:16:02<69:01:58,  9.53s/it]
 31%|███▏      | 11889/37963 [29:16:09<64:43:28,  8.94s/it]
 31%|███▏      | 11890/37963 [29:16:24<76:55:26, 10.62s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '4.675', 'learning_rate': '1.608e-05', 'epoch': '0.3132'}
+
 31%|███▏      | 11890/37963 [29:16:24<76:55:26, 10.62s/it]
 31%|███▏      | 11891/37963 [29:16:32<70:45:14,  9.77s/it]
 31%|███▏      | 11892/37963 [29:16:40<66:23:13,  9.17s/it]
 31%|███▏      | 11893/37963 [29:16:47<63:13:59,  8.73s/it]
 31%|███▏      | 11894/37963 [29:16:55<60:31:49,  8.36s/it]
 31%|███▏      | 11895/37963 [29:17:02<59:03:25,  8.16s/it]
 31%|███▏      | 11896/37963 [29:17:10<58:13:42,  8.04s/it]
 31%|███▏      | 11897/37963 [29:17:18<57:48:59,  7.99s/it]
 31%|███▏      | 11898/37963 [29:17:26<57:17:27,  7.91s/it]
 31%|███▏      | 11899/37963 [29:17:33<56:12:36,  7.76s/it]
 31%|███▏      | 11900/37963 [29:17:41<55:52:46,  7.72s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '2.341', 'learning_rate': '1.607e-05', 'epoch': '0.3135'}
+
 31%|███▏      | 11900/37963 [29:17:41<55:52:46,  7.72s/it]
 31%|███▏      | 11901/37963 [29:17:56<71:42:12,  9.90s/it]
 31%|███▏      | 11902/37963 [29:18:03<66:47:26,  9.23s/it]
 31%|███▏      | 11903/37963 [29:18:11<63:01:02,  8.71s/it]
 31%|███▏      | 11904/37963 [29:18:18<60:16:19,  8.33s/it]
 31%|███▏      | 11905/37963 [29:18:33<73:54:53, 10.21s/it]
 31%|███▏      | 11906/37963 [29:18:41<68:42:12,  9.49s/it]
 31%|███▏      | 11907/37963 [29:18:49<65:17:36,  9.02s/it]
 31%|███▏      | 11908/37963 [29:18:56<62:29:36,  8.63s/it]
 31%|███▏      | 11909/37963 [29:19:04<60:25:24,  8.35s/it]
 31%|███▏      | 11910/37963 [29:19:11<58:07:03,  8.03s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '1.044', 'learning_rate': '1.607e-05', 'epoch': '0.3137'}
+
 31%|███▏      | 11910/37963 [29:19:11<58:07:03,  8.03s/it]
 31%|███▏      | 11911/37963 [29:19:19<57:22:34,  7.93s/it]
 31%|███▏      | 11912/37963 [29:19:27<57:00:00,  7.88s/it]
 31%|███▏      | 11913/37963 [29:19:35<56:31:32,  7.81s/it]
 31%|███▏      | 11914/37963 [29:19:42<56:08:41,  7.76s/it]
 31%|███▏      | 11915/37963 [29:19:50<55:10:01,  7.62s/it]
 31%|███▏      | 11916/37963 [29:19:57<54:45:31,  7.57s/it]
 31%|███▏      | 11917/37963 [29:20:05<54:55:43,  7.59s/it]
 31%|███▏      | 11918/37963 [29:20:12<54:53:53,  7.59s/it]
 31%|███▏      | 11919/37963 [29:20:20<55:33:27,  7.68s/it]
 31%|███▏      | 11920/37963 [29:20:28<55:03:11,  7.61s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '0.9213', 'learning_rate': '1.606e-05', 'epoch': '0.314'}
+
 31%|███▏      | 11920/37963 [29:20:28<55:03:11,  7.61s/it]
 31%|███▏      | 11921/37963 [29:20:35<55:12:48,  7.63s/it]
 31%|███▏      | 11922/37963 [29:20:43<54:53:58,  7.59s/it]
 31%|███▏      | 11923/37963 [29:20:50<54:58:01,  7.60s/it]
 31%|███▏      | 11924/37963 [29:20:58<55:08:05,  7.62s/it]
 31%|███▏      | 11925/37963 [29:21:06<55:19:54,  7.65s/it]
 31%|███▏      | 11926/37963 [29:21:13<55:22:13,  7.66s/it]
 31%|███▏      | 11927/37963 [29:21:21<55:25:22,  7.66s/it]
 31%|███▏      | 11928/37963 [29:21:28<54:38:28,  7.56s/it]
 31%|███▏      | 11929/37963 [29:21:43<68:58:11,  9.54s/it]
 31%|███▏      | 11930/37963 [29:22:04<95:29:53, 13.21s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '2.461', 'learning_rate': '1.605e-05', 'epoch': '0.3143'}
+
 31%|███▏      | 11930/37963 [29:22:04<95:29:53, 13.21s/it]
 31%|███▏      | 11931/37963 [29:22:19<98:01:08, 13.56s/it]
 31%|███▏      | 11932/37963 [29:22:27<85:38:43, 11.84s/it]
 31%|███▏      | 11933/37963 [29:22:34<75:48:37, 10.48s/it]
 31%|███▏      | 11934/37963 [29:22:48<83:58:10, 11.61s/it]
 31%|███▏      | 11935/37963 [29:22:56<75:19:43, 10.42s/it]
 31%|███▏      | 11936/37963 [29:23:03<69:24:56,  9.60s/it]
 31%|███▏      | 11937/37963 [29:23:11<65:14:51,  9.03s/it]
 31%|███▏      | 11938/37963 [29:23:18<61:24:15,  8.49s/it]
 31%|███▏      | 11939/37963 [29:23:33<73:57:06, 10.23s/it]
 31%|███▏      | 11940/37963 [29:23:40<68:29:03,  9.47s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '2.045', 'learning_rate': '1.605e-05', 'epoch': '0.3145'}
+
 31%|███▏      | 11940/37963 [29:23:40<68:29:03,  9.47s/it]
 31%|███▏      | 11941/37963 [29:23:48<64:47:40,  8.96s/it]
 31%|███▏      | 11942/37963 [29:23:56<61:55:30,  8.57s/it]
 31%|███▏      | 11943/37963 [29:24:04<60:23:08,  8.35s/it]
 31%|███▏      | 11944/37963 [29:24:11<58:43:25,  8.13s/it]
 31%|███▏      | 11945/37963 [29:24:19<57:47:44,  8.00s/it]
 31%|███▏      | 11946/37963 [29:24:34<72:43:47, 10.06s/it]
 31%|███▏      | 11947/37963 [29:24:41<67:37:28,  9.36s/it]
 31%|███▏      | 11948/37963 [29:24:49<64:06:53,  8.87s/it]
 31%|███▏      | 11949/37963 [29:24:57<61:24:15,  8.50s/it]
 31%|███▏      | 11950/37963 [29:25:12<74:49:31, 10.36s/it]
                                                           
{'loss': '0.1687', 'grad_norm': '1.329', 'learning_rate': '1.604e-05', 'epoch': '0.3148'}
+
 31%|███▏      | 11950/37963 [29:25:12<74:49:31, 10.36s/it]
 31%|███▏      | 11951/37963 [29:25:19<69:02:07,  9.55s/it]
 31%|███▏      | 11952/37963 [29:25:27<64:30:10,  8.93s/it]
 31%|███▏      | 11953/37963 [29:25:34<61:37:58,  8.53s/it]
 31%|███▏      | 11954/37963 [29:25:42<59:55:13,  8.29s/it]
 31%|███▏      | 11955/37963 [29:25:50<58:42:37,  8.13s/it]
 31%|███▏      | 11956/37963 [29:25:57<57:47:56,  8.00s/it]
 31%|███▏      | 11957/37963 [29:26:05<56:57:44,  7.89s/it]
 31%|███▏      | 11958/37963 [29:26:13<56:13:04,  7.78s/it]
 32%|███▏      | 11959/37963 [29:26:20<56:13:17,  7.78s/it]
 32%|██���▏      | 11960/37963 [29:26:28<55:27:32,  7.68s/it]
                                                           
{'loss': '0.1461', 'grad_norm': '1.371', 'learning_rate': '1.603e-05', 'epoch': '0.315'}
+
 32%|███▏      | 11960/37963 [29:26:28<55:27:32,  7.68s/it]
 32%|███▏      | 11961/37963 [29:26:36<55:28:37,  7.68s/it]
 32%|███▏      | 11962/37963 [29:26:43<55:30:37,  7.69s/it]
 32%|███▏      | 11963/37963 [29:26:51<55:48:08,  7.73s/it]
 32%|███▏      | 11964/37963 [29:26:58<54:40:39,  7.57s/it]
 32%|███▏      | 11965/37963 [29:27:06<54:31:34,  7.55s/it]
 32%|███▏      | 11966/37963 [29:27:14<55:04:48,  7.63s/it]
 32%|███▏      | 11967/37963 [29:27:21<55:13:41,  7.65s/it]
 32%|███▏      | 11968/37963 [29:27:29<55:22:38,  7.67s/it]
 32%|███▏      | 11969/37963 [29:27:36<54:56:05,  7.61s/it]
 32%|███▏      | 11970/37963 [29:27:44<55:00:49,  7.62s/it]
                                                           
{'loss': '0.1713', 'grad_norm': '1.617', 'learning_rate': '1.603e-05', 'epoch': '0.3153'}
+
 32%|███▏      | 11970/37963 [29:27:44<55:00:49,  7.62s/it]
 32%|███▏      | 11971/37963 [29:27:52<55:08:52,  7.64s/it]
 32%|███▏      | 11972/37963 [29:27:59<54:48:12,  7.59s/it]
 32%|███▏      | 11973/37963 [29:28:07<54:55:37,  7.61s/it]
 32%|███▏      | 11974/37963 [29:28:21<69:03:54,  9.57s/it]
 32%|███▏      | 11975/37963 [29:28:29<64:59:43,  9.00s/it]
 32%|███▏      | 11976/37963 [29:28:36<61:32:04,  8.52s/it]
 32%|███▏      | 11977/37963 [29:28:44<59:58:42,  8.31s/it]
 32%|███▏      | 11978/37963 [29:28:52<58:49:45,  8.15s/it]
 32%|███▏      | 11979/37963 [29:28:59<57:44:59,  8.00s/it]
 32%|███▏      | 11980/37963 [29:29:20<85:42:49, 11.88s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '1.787', 'learning_rate': '1.602e-05', 'epoch': '0.3156'}
+
 32%|███▏      | 11980/37963 [29:29:20<85:42:49, 11.88s/it]
 32%|███▏      | 11981/37963 [29:29:36<92:58:37, 12.88s/it]
 32%|███▏      | 11982/37963 [29:29:50<96:19:31, 13.35s/it]
 32%|███▏      | 11983/37963 [29:29:58<84:02:35, 11.65s/it]
 32%|███▏      | 11984/37963 [29:30:05<75:15:38, 10.43s/it]
 32%|███▏      | 11985/37963 [29:30:13<69:17:35,  9.60s/it]
 32%|███▏      | 11986/37963 [29:30:21<65:02:53,  9.01s/it]
 32%|███▏      | 11987/37963 [29:30:28<61:40:36,  8.55s/it]
 32%|███▏      | 11988/37963 [29:30:36<59:55:54,  8.31s/it]
 32%|███▏      | 11989/37963 [29:30:51<74:11:39, 10.28s/it]
 32%|███▏      | 11990/37963 [29:30:58<68:44:45,  9.53s/it]
                                                           
{'loss': '0.16', 'grad_norm': '1.375', 'learning_rate': '1.601e-05', 'epoch': '0.3158'}
+
 32%|███▏      | 11990/37963 [29:30:58<68:44:45,  9.53s/it]
 32%|███▏      | 11991/37963 [29:31:06<64:40:47,  8.97s/it]
 32%|███▏      | 11992/37963 [29:31:14<61:46:21,  8.56s/it]
 32%|███▏      | 11993/37963 [29:31:28<74:03:24, 10.27s/it]
 32%|███▏      | 11994/37963 [29:31:36<69:16:40,  9.60s/it]
 32%|███▏      | 11995/37963 [29:31:43<64:32:25,  8.95s/it]
 32%|███▏      | 11996/37963 [29:31:58<77:01:40, 10.68s/it]
 32%|███▏      | 11997/37963 [29:32:06<70:23:07,  9.76s/it]
 32%|███▏      | 11998/37963 [29:32:13<65:18:54,  9.06s/it]
 32%|███▏      | 11999/37963 [29:32:21<62:36:32,  8.68s/it]
 32%|███▏      | 12000/37963 [29:32:28<60:08:28,  8.34s/it]
                                                           
{'loss': '0.1693', 'grad_norm': '1.196', 'learning_rate': '1.601e-05', 'epoch': '0.3161'}
+
 32%|███▏      | 12000/37963 [29:32:28<60:08:28,  8.34s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.75s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.76s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 32%|███▏      | 12001/37963 [29:33:23<160:50:16, 22.30s/it]
 32%|███▏      | 12002/37963 [29:33:31<129:13:49, 17.92s/it]
 32%|███▏      | 12003/37963 [29:33:39<106:36:10, 14.78s/it]
 32%|███▏      | 12004/37963 [29:33:46<91:10:26, 12.64s/it] 
 32%|███▏      | 12005/37963 [29:33:54<80:15:36, 11.13s/it]
 32%|███▏      | 12006/37963 [29:34:01<72:49:01, 10.10s/it]
 32%|███▏      | 12007/37963 [29:34:09<67:32:04,  9.37s/it]
 32%|███▏      | 12008/37963 [29:34:17<63:45:30,  8.84s/it]
 32%|███▏      | 12009/37963 [29:34:24<61:04:14,  8.47s/it]
 32%|███▏      | 12010/37963 [29:34:32<59:16:40,  8.22s/it]
                                                           
{'loss': '0.1689', 'grad_norm': '1.201', 'learning_rate': '1.6e-05', 'epoch': '0.3164'}
+
 32%|███▏      | 12010/37963 [29:34:32<59:16:40,  8.22s/it]
 32%|███▏      | 12011/37963 [29:34:40<57:59:34,  8.04s/it]
 32%|███▏      | 12012/37963 [29:34:47<57:01:27,  7.91s/it]
 32%|███▏      | 12013/37963 [29:34:55<56:25:58,  7.83s/it]
 32%|███▏      | 12014/37963 [29:35:03<56:01:02,  7.77s/it]
 32%|███▏      | 12015/37963 [29:35:10<55:13:57,  7.66s/it]
 32%|███▏      | 12016/37963 [29:35:18<55:16:56,  7.67s/it]
 32%|███▏      | 12017/37963 [29:35:25<55:37:28,  7.72s/it]
 32%|███▏      | 12018/37963 [29:35:33<54:51:23,  7.61s/it]
 32%|███▏      | 12019/37963 [29:35:40<54:52:47,  7.62s/it]
 32%|███▏      | 12020/37963 [29:35:48<55:19:55,  7.68s/it]
                                                           
{'loss': '0.173', 'grad_norm': '2.422', 'learning_rate': '1.599e-05', 'epoch': '0.3166'}
+
 32%|███▏      | 12020/37963 [29:35:48<55:19:55,  7.68s/it]
 32%|███▏      | 12021/37963 [29:35:56<55:21:05,  7.68s/it]
 32%|███▏      | 12022/37963 [29:36:10<68:56:08,  9.57s/it]
 32%|███▏      | 12023/37963 [29:36:18<65:04:49,  9.03s/it]
 32%|███▏      | 12024/37963 [29:36:25<61:39:18,  8.56s/it]
 32%|███▏      | 12025/37963 [29:36:33<59:09:52,  8.21s/it]
 32%|███▏      | 12026/37963 [29:36:47<72:40:00, 10.09s/it]
 32%|███▏      | 12027/37963 [29:37:08<96:00:23, 13.33s/it]
 32%|███▏      | 12028/37963 [29:37:16<83:46:36, 11.63s/it]
 32%|███▏      | 12029/37963 [29:37:23<75:33:29, 10.49s/it]
 32%|███▏      | 12030/37963 [29:37:31<68:59:43,  9.58s/it]
                                                           
{'loss': '0.15', 'grad_norm': '0.7297', 'learning_rate': '1.599e-05', 'epoch': '0.3169'}
+
 32%|███▏      | 12030/37963 [29:37:31<68:59:43,  9.58s/it]
 32%|███▏      | 12031/37963 [29:37:38<64:48:56,  9.00s/it]
 32%|███▏      | 12032/37963 [29:37:53<76:10:04, 10.57s/it]
 32%|███▏      | 12033/37963 [29:38:00<70:05:11,  9.73s/it]
 32%|███▏      | 12034/37963 [29:38:08<65:35:48,  9.11s/it]
 32%|███▏      | 12035/37963 [29:38:16<62:40:08,  8.70s/it]
 32%|███▏      | 12036/37963 [29:38:24<60:31:56,  8.40s/it]
 32%|███▏      | 12037/37963 [29:38:31<58:12:35,  8.08s/it]
 32%|███▏      | 12038/37963 [29:38:45<71:52:46,  9.98s/it]
 32%|███▏      | 12039/37963 [29:38:53<66:33:50,  9.24s/it]
 32%|███▏      | 12040/37963 [29:39:08<78:41:30, 10.93s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '2.324', 'learning_rate': '1.598e-05', 'epoch': '0.3172'}
+
 32%|███▏      | 12040/37963 [29:39:08<78:41:30, 10.93s/it]
 32%|███▏      | 12041/37963 [29:39:16<71:52:19,  9.98s/it]
 32%|███▏      | 12042/37963 [29:39:30<80:56:03, 11.24s/it]
 32%|███▏      | 12043/37963 [29:39:37<73:11:52, 10.17s/it]
 32%|███▏      | 12044/37963 [29:39:45<67:46:53,  9.41s/it]
 32%|███▏      | 12045/37963 [29:39:53<64:06:15,  8.90s/it]
 32%|███▏      | 12046/37963 [29:40:00<61:17:51,  8.51s/it]
 32%|███▏      | 12047/37963 [29:40:08<59:19:42,  8.24s/it]
 32%|███▏      | 12048/37963 [29:40:16<58:28:23,  8.12s/it]
 32%|███▏      | 12049/37963 [29:40:24<57:43:05,  8.02s/it]
 32%|███▏      | 12050/37963 [29:40:31<57:04:01,  7.93s/it]
                                                           
{'loss': '0.1697', 'grad_norm': '1.312', 'learning_rate': '1.597e-05', 'epoch': '0.3174'}
+
 32%|███▏      | 12050/37963 [29:40:31<57:04:01,  7.93s/it]
 32%|███▏      | 12051/37963 [29:40:39<56:07:21,  7.80s/it]
 32%|███▏      | 12052/37963 [29:40:46<55:40:48,  7.74s/it]
 32%|███▏      | 12053/37963 [29:40:54<55:51:46,  7.76s/it]
 32%|███▏      | 12054/37963 [29:41:02<55:47:08,  7.75s/it]
 32%|███▏      | 12055/37963 [29:41:10<55:32:36,  7.72s/it]
 32%|███▏      | 12056/37963 [29:41:17<55:33:14,  7.72s/it]
 32%|███▏      | 12057/37963 [29:41:25<54:36:39,  7.59s/it]
 32%|███▏      | 12058/37963 [29:41:32<54:43:25,  7.60s/it]
 32%|███▏      | 12059/37963 [29:41:40<54:15:07,  7.54s/it]
 32%|███▏      | 12060/37963 [29:41:47<54:27:14,  7.57s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '1.48', 'learning_rate': '1.597e-05', 'epoch': '0.3177'}
+
 32%|███▏      | 12060/37963 [29:41:47<54:27:14,  7.57s/it]
 32%|███▏      | 12061/37963 [29:41:55<54:27:41,  7.57s/it]
 32%|███▏      | 12062/37963 [29:42:02<54:35:20,  7.59s/it]
 32%|███▏      | 12063/37963 [29:42:10<53:43:42,  7.47s/it]
 32%|███▏      | 12064/37963 [29:42:17<53:50:37,  7.48s/it]
 32%|███▏      | 12065/37963 [29:42:25<54:07:33,  7.52s/it]
 32%|███▏      | 12066/37963 [29:42:32<54:26:52,  7.57s/it]
 32%|███▏      | 12067/37963 [29:42:40<54:42:25,  7.61s/it]
 32%|███▏      | 12068/37963 [29:42:48<54:48:43,  7.62s/it]
 32%|███▏      | 12069/37963 [29:43:03<70:17:56,  9.77s/it]
 32%|███▏      | 12070/37963 [29:43:10<65:42:56,  9.14s/it]
                                                           
{'loss': '0.1543', 'grad_norm': '1.326', 'learning_rate': '1.596e-05', 'epoch': '0.3179'}
+
 32%|███▏      | 12070/37963 [29:43:10<65:42:56,  9.14s/it]
 32%|███▏      | 12071/37963 [29:43:18<62:48:12,  8.73s/it]
 32%|███▏      | 12072/37963 [29:43:32<75:01:28, 10.43s/it]
 32%|███▏      | 12073/37963 [29:43:54<99:37:47, 13.85s/it]
 32%|███▏      | 12074/37963 [29:44:02<86:27:19, 12.02s/it]
 32%|███▏      | 12075/37963 [29:44:10<77:00:55, 10.71s/it]
 32%|███▏      | 12076/37963 [29:44:17<69:51:48,  9.72s/it]
 32%|███▏      | 12077/37963 [29:44:25<65:22:50,  9.09s/it]
 32%|███▏      | 12078/37963 [29:44:32<62:21:34,  8.67s/it]
 32%|███▏      | 12079/37963 [29:44:47<74:16:00, 10.33s/it]
 32%|███▏      | 12080/37963 [29:44:54<68:34:53,  9.54s/it]
                                                           
{'loss': '0.163', 'grad_norm': '0.7849', 'learning_rate': '1.595e-05', 'epoch': '0.3182'}
+
 32%|███▏      | 12080/37963 [29:44:54<68:34:53,  9.54s/it]
 32%|███▏      | 12081/37963 [29:45:02<64:39:33,  8.99s/it]
 32%|███▏      | 12082/37963 [29:45:09<61:24:53,  8.54s/it]
 32%|███▏      | 12083/37963 [29:45:17<59:44:12,  8.31s/it]
 32%|███▏      | 12084/37963 [29:45:25<58:11:02,  8.09s/it]
 32%|███▏      | 12085/37963 [29:45:32<56:55:08,  7.92s/it]
 32%|███▏      | 12086/37963 [29:45:47<71:38:52,  9.97s/it]
 32%|███▏      | 12087/37963 [29:45:55<66:47:40,  9.29s/it]
 32%|███▏      | 12088/37963 [29:46:09<76:59:41, 10.71s/it]
 32%|███▏      | 12089/37963 [29:46:23<84:58:23, 11.82s/it]
 32%|███▏      | 12090/37963 [29:46:31<76:39:46, 10.67s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '3.991', 'learning_rate': '1.594e-05', 'epoch': '0.3185'}
+
 32%|███▏      | 12090/37963 [29:46:31<76:39:46, 10.67s/it]
 32%|███▏      | 12091/37963 [29:46:39<69:42:41,  9.70s/it]
 32%|███▏      | 12092/37963 [29:46:46<65:17:06,  9.08s/it]
 32%|███▏      | 12093/37963 [29:46:54<62:23:20,  8.68s/it]
 32%|███▏      | 12094/37963 [29:47:02<59:46:16,  8.32s/it]
 32%|███▏      | 12095/37963 [29:47:09<58:18:41,  8.12s/it]
 32%|███▏      | 12096/37963 [29:47:17<57:16:14,  7.97s/it]
 32%|███▏      | 12097/37963 [29:47:25<56:54:16,  7.92s/it]
 32%|███▏      | 12098/37963 [29:47:32<56:22:07,  7.85s/it]
 32%|███▏      | 12099/37963 [29:47:40<55:51:18,  7.77s/it]
 32%|███▏      | 12100/37963 [29:47:48<55:45:50,  7.76s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '0.6621', 'learning_rate': '1.594e-05', 'epoch': '0.3187'}
+
 32%|███▏      | 12100/37963 [29:47:48<55:45:50,  7.76s/it]
 32%|███▏      | 12101/37963 [29:47:55<55:33:49,  7.73s/it]
 32%|███▏      | 12102/37963 [29:48:03<55:43:49,  7.76s/it]
 32%|███▏      | 12103/37963 [29:48:11<55:53:19,  7.78s/it]
 32%|███▏      | 12104/37963 [29:48:19<55:57:35,  7.79s/it]
 32%|███▏      | 12105/37963 [29:48:26<55:39:13,  7.75s/it]
 32%|███▏      | 12106/37963 [29:48:34<55:27:04,  7.72s/it]
 32%|███▏      | 12107/37963 [29:48:42<55:23:53,  7.71s/it]
 32%|███▏      | 12108/37963 [29:48:49<55:26:14,  7.72s/it]
 32%|███▏      | 12109/37963 [29:48:57<55:21:24,  7.71s/it]
 32%|███▏      | 12110/37963 [29:49:05<55:16:46,  7.70s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '1.993', 'learning_rate': '1.593e-05', 'epoch': '0.319'}
+
 32%|███▏      | 12110/37963 [29:49:05<55:16:46,  7.70s/it]
 32%|███▏      | 12111/37963 [29:49:13<55:20:42,  7.71s/it]
 32%|███▏      | 12112/37963 [29:49:20<54:58:07,  7.65s/it]
 32%|███▏      | 12113/37963 [29:49:28<54:58:33,  7.66s/it]
 32%|███▏      | 12114/37963 [29:49:35<54:32:22,  7.60s/it]
 32%|███▏      | 12115/37963 [29:49:43<54:35:22,  7.60s/it]
 32%|███▏      | 12116/37963 [29:49:57<68:29:27,  9.54s/it]
 32%|███▏      | 12117/37963 [29:50:11<79:19:17, 11.05s/it]
 32%|███▏      | 12118/37963 [29:50:19<72:10:30, 10.05s/it]
 32%|███▏      | 12119/37963 [29:50:27<66:43:11,  9.29s/it]
 32%|███▏      | 12120/37963 [29:50:48<91:58:20, 12.81s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '1.203', 'learning_rate': '1.592e-05', 'epoch': '0.3193'}
+
 32%|███▏      | 12120/37963 [29:50:48<91:58:20, 12.81s/it]
 32%|███▏      | 12121/37963 [29:50:55<81:07:12, 11.30s/it]
 32%|███▏      | 12122/37963 [29:51:03<73:28:15, 10.24s/it]
 32%|███▏      | 12123/37963 [29:51:11<68:00:08,  9.47s/it]
 32%|███▏      | 12124/37963 [29:51:19<64:09:24,  8.94s/it]
 32%|███▏      | 12125/37963 [29:51:26<61:26:16,  8.56s/it]
 32%|███▏      | 12126/37963 [29:51:41<74:01:02, 10.31s/it]
 32%|███▏      | 12127/37963 [29:51:48<68:22:40,  9.53s/it]
 32%|███▏      | 12128/37963 [29:51:56<64:16:45,  8.96s/it]
 32%|███▏      | 12129/37963 [29:52:04<61:11:21,  8.53s/it]
 32%|███▏      | 12130/37963 [29:52:11<59:06:01,  8.24s/it]
                                                           
{'loss': '0.1735', 'grad_norm': '1.508', 'learning_rate': '1.592e-05', 'epoch': '0.3195'}
+
 32%|███▏      | 12130/37963 [29:52:11<59:06:01,  8.24s/it]
 32%|███▏      | 12131/37963 [29:52:19<58:16:58,  8.12s/it]
 32%|███▏      | 12132/37963 [29:52:27<57:04:11,  7.95s/it]
 32%|███▏      | 12133/37963 [29:52:34<56:17:58,  7.85s/it]
 32%|███▏      | 12134/37963 [29:52:42<56:04:18,  7.82s/it]
 32%|███▏      | 12135/37963 [29:52:50<55:43:29,  7.77s/it]
 32%|███▏      | 12136/37963 [29:52:57<55:41:09,  7.76s/it]
 32%|███▏      | 12137/37963 [29:53:25<98:24:31, 13.72s/it]
 32%|███▏      | 12138/37963 [29:53:33<86:20:24, 12.04s/it]
 32%|███▏      | 12139/37963 [29:53:41<76:46:42, 10.70s/it]
 32%|███▏      | 12140/37963 [29:53:48<70:35:22,  9.84s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '0.9241', 'learning_rate': '1.591e-05', 'epoch': '0.3198'}
+
 32%|███▏      | 12140/37963 [29:53:48<70:35:22,  9.84s/it]
 32%|███▏      | 12141/37963 [29:53:56<65:51:35,  9.18s/it]
 32%|███▏      | 12142/37963 [29:54:04<62:36:04,  8.73s/it]
 32%|███▏      | 12143/37963 [29:54:11<60:18:20,  8.41s/it]
 32%|███▏      | 12144/37963 [29:54:19<58:51:21,  8.21s/it]
 32%|███▏      | 12145/37963 [29:54:27<57:05:37,  7.96s/it]
 32%|███▏      | 12146/37963 [29:54:34<56:21:28,  7.86s/it]
 32%|███▏      | 12147/37963 [29:54:42<55:57:17,  7.80s/it]
 32%|███▏      | 12148/37963 [29:54:49<55:25:41,  7.73s/it]
 32%|███▏      | 12149/37963 [29:54:57<55:16:42,  7.71s/it]
 32%|███▏      | 12150/37963 [29:55:05<55:12:59,  7.70s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '2.868', 'learning_rate': '1.59e-05', 'epoch': '0.32'}
+
 32%|███▏      | 12150/37963 [29:55:05<55:12:59,  7.70s/it]
 32%|███▏      | 12151/37963 [29:55:12<54:33:26,  7.61s/it]
 32%|███▏      | 12152/37963 [29:55:20<54:41:13,  7.63s/it]
 32%|███▏      | 12153/37963 [29:55:27<54:50:15,  7.65s/it]
 32%|███▏      | 12154/37963 [29:55:35<54:24:51,  7.59s/it]
 32%|███▏      | 12155/37963 [29:55:43<54:47:16,  7.64s/it]
 32%|███▏      | 12156/37963 [29:55:50<54:05:22,  7.55s/it]
 32%|███▏      | 12157/37963 [29:55:58<54:20:59,  7.58s/it]
 32%|███▏      | 12158/37963 [29:56:05<54:35:06,  7.62s/it]
 32%|███▏      | 12159/37963 [29:56:13<54:44:46,  7.64s/it]
 32%|███▏      | 12160/37963 [29:56:21<54:56:53,  7.67s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '2.295', 'learning_rate': '1.59e-05', 'epoch': '0.3203'}
+
 32%|███▏      | 12160/37963 [29:56:21<54:56:53,  7.67s/it]
 32%|███▏      | 12161/37963 [29:56:28<54:51:07,  7.65s/it]
 32%|███▏      | 12162/37963 [29:56:36<54:50:35,  7.65s/it]
 32%|███▏      | 12163/37963 [29:56:57<84:15:06, 11.76s/it]
 32%|███▏      | 12164/37963 [29:57:11<88:45:45, 12.39s/it]
 32%|███▏      | 12165/37963 [29:57:19<78:47:25, 10.99s/it]
 32%|███▏      | 12166/37963 [29:57:27<71:33:17,  9.99s/it]
 32%|███▏      | 12167/37963 [29:57:41<82:02:18, 11.45s/it]
 32%|███▏      | 12168/37963 [29:57:49<73:58:40, 10.32s/it]
 32%|███▏      | 12169/37963 [29:57:57<68:09:46,  9.51s/it]
 32%|███▏      | 12170/37963 [29:58:04<63:54:05,  8.92s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '2.569', 'learning_rate': '1.589e-05', 'epoch': '0.3206'}
+
 32%|███▏      | 12170/37963 [29:58:04<63:54:05,  8.92s/it]
 32%|███▏      | 12171/37963 [29:58:12<60:49:26,  8.49s/it]
 32%|███▏      | 12172/37963 [29:58:20<59:09:01,  8.26s/it]
 32%|███▏      | 12173/37963 [29:58:27<58:09:19,  8.12s/it]
 32%|███▏      | 12174/37963 [29:58:35<57:20:55,  8.01s/it]
 32%|███▏      | 12175/37963 [29:58:43<56:30:40,  7.89s/it]
 32%|███▏      | 12176/37963 [29:58:50<55:58:49,  7.82s/it]
 32%|███▏      | 12177/37963 [29:58:58<55:56:13,  7.81s/it]
 32%|███▏      | 12178/37963 [29:59:06<55:37:42,  7.77s/it]
 32%|███▏      | 12179/37963 [29:59:13<55:03:10,  7.69s/it]
 32%|███▏      | 12180/37963 [29:59:28<69:17:13,  9.67s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '5.33', 'learning_rate': '1.588e-05', 'epoch': '0.3208'}
+
 32%|███▏      | 12180/37963 [29:59:28<69:17:13,  9.67s/it]
 32%|███▏      | 12181/37963 [29:59:35<64:42:11,  9.03s/it]
 32%|███▏      | 12182/37963 [29:59:43<61:31:40,  8.59s/it]
 32%|███▏      | 12183/37963 [29:59:50<58:51:55,  8.22s/it]
 32%|███▏      | 12184/37963 [29:59:58<57:33:19,  8.04s/it]
 32%|███▏      | 12185/37963 [30:00:05<56:35:44,  7.90s/it]
 32%|███▏      | 12186/37963 [30:00:20<70:16:57,  9.82s/it]
 32%|███▏      | 12187/37963 [30:00:27<65:44:50,  9.18s/it]
 32%|███▏      | 12188/37963 [30:00:35<62:25:50,  8.72s/it]
 32%|███▏      | 12189/37963 [30:00:49<74:23:36, 10.39s/it]
 32%|███▏      | 12190/37963 [30:00:57<68:28:45,  9.57s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '1.009', 'learning_rate': '1.588e-05', 'epoch': '0.3211'}
+
 32%|███▏      | 12190/37963 [30:00:57<68:28:45,  9.57s/it]
 32%|███▏      | 12191/37963 [30:01:12<79:42:57, 11.14s/it]
 32%|███▏      | 12192/37963 [30:01:19<72:37:44, 10.15s/it]
 32%|███▏      | 12193/37963 [30:01:27<67:12:11,  9.39s/it]
 32%|███▏      | 12194/37963 [30:01:35<63:04:42,  8.81s/it]
 32%|███▏      | 12195/37963 [30:01:42<60:47:58,  8.49s/it]
 32%|███▏      | 12196/37963 [30:01:50<58:56:34,  8.24s/it]
 32%|███▏      | 12197/37963 [30:01:58<57:37:44,  8.05s/it]
 32%|███▏      | 12198/37963 [30:02:05<56:36:17,  7.91s/it]
 32%|███▏      | 12199/37963 [30:02:13<56:02:39,  7.83s/it]
 32%|███▏      | 12200/37963 [30:02:20<55:35:41,  7.77s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '0.9202', 'learning_rate': '1.587e-05', 'epoch': '0.3214'}
+
 32%|███▏      | 12200/37963 [30:02:20<55:35:41,  7.77s/it]
 32%|███▏      | 12201/37963 [30:02:28<55:17:05,  7.73s/it]
 32%|███▏      | 12202/37963 [30:02:36<54:46:37,  7.65s/it]
 32%|███▏      | 12203/37963 [30:02:43<54:24:16,  7.60s/it]
 32%|███▏      | 12204/37963 [30:02:51<54:37:12,  7.63s/it]
 32%|███▏      | 12205/37963 [30:02:58<54:54:18,  7.67s/it]
 32%|███▏      | 12206/37963 [30:03:06<54:37:51,  7.64s/it]
 32%|███▏      | 12207/37963 [30:03:14<54:39:31,  7.64s/it]
 32%|███▏      | 12208/37963 [30:03:21<54:56:35,  7.68s/it]
 32%|███▏      | 12209/37963 [30:03:29<54:41:21,  7.64s/it]
 32%|███▏      | 12210/37963 [30:03:37<54:51:51,  7.67s/it]
                                                           
{'loss': '0.153', 'grad_norm': '2.49', 'learning_rate': '1.586e-05', 'epoch': '0.3216'}
+
 32%|███▏      | 12210/37963 [30:03:37<54:51:51,  7.67s/it]
 32%|███▏      | 12211/37963 [30:04:05<98:22:19, 13.75s/it]
 32%|███▏      | 12212/37963 [30:04:12<84:49:26, 11.86s/it]
 32%|███▏      | 12213/37963 [30:04:20<75:57:53, 10.62s/it]
 32%|███▏      | 12214/37963 [30:04:27<69:31:53,  9.72s/it]
 32%|███▏      | 12215/37963 [30:04:35<64:56:15,  9.08s/it]
 32%|███▏      | 12216/37963 [30:04:49<75:42:51, 10.59s/it]
 32%|███▏      | 12217/37963 [30:04:57<69:21:51,  9.70s/it]
 32%|███▏      | 12218/37963 [30:05:05<65:12:18,  9.12s/it]
 32%|███▏      | 12219/37963 [30:05:12<62:10:46,  8.70s/it]
 32%|███▏      | 12220/37963 [30:05:20<59:27:02,  8.31s/it]
                                                           
{'loss': '0.1785', 'grad_norm': '1.247', 'learning_rate': '1.586e-05', 'epoch': '0.3219'}
+
 32%|███▏      | 12220/37963 [30:05:20<59:27:02,  8.31s/it]
 32%|███▏      | 12221/37963 [30:05:27<57:56:29,  8.10s/it]
 32%|███▏      | 12222/37963 [30:05:35<56:53:52,  7.96s/it]
 32%|███▏      | 12223/37963 [30:05:43<56:25:05,  7.89s/it]
 32%|███▏      | 12224/37963 [30:05:50<56:08:26,  7.85s/it]
 32%|███▏      | 12225/37963 [30:05:58<55:42:10,  7.79s/it]
 32%|███▏      | 12226/37963 [30:06:06<55:31:54,  7.77s/it]
 32%|███▏      | 12227/37963 [30:06:20<68:26:28,  9.57s/it]
 32%|███▏      | 12228/37963 [30:06:27<64:32:58,  9.03s/it]
 32%|███▏      | 12229/37963 [30:06:35<60:59:11,  8.53s/it]
 32%|███▏      | 12230/37963 [30:06:42<59:03:55,  8.26s/it]
                                                           
{'loss': '0.145', 'grad_norm': '0.7396', 'learning_rate': '1.585e-05', 'epoch': '0.3222'}
+
 32%|███▏      | 12230/37963 [30:06:42<59:03:55,  8.26s/it]
 32%|███▏      | 12231/37963 [30:06:50<56:59:28,  7.97s/it]
 32%|███▏      | 12232/37963 [30:06:57<56:29:05,  7.90s/it]
 32%|███▏      | 12233/37963 [30:07:05<55:23:13,  7.75s/it]
 32%|███▏      | 12234/37963 [30:07:12<55:20:42,  7.74s/it]
 32%|███▏      | 12235/37963 [30:07:27<69:03:59,  9.66s/it]
 32%|███▏      | 12236/37963 [30:07:34<64:41:32,  9.05s/it]
 32%|███▏      | 12237/37963 [30:07:42<62:00:15,  8.68s/it]
 32%|███▏      | 12238/37963 [30:07:50<60:04:55,  8.41s/it]
 32%|███▏      | 12239/37963 [30:08:04<73:15:17, 10.25s/it]
 32%|███▏      | 12240/37963 [30:08:12<67:46:39,  9.49s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '3.916', 'learning_rate': '1.584e-05', 'epoch': '0.3224'}
+
 32%|███▏      | 12240/37963 [30:08:12<67:46:39,  9.49s/it]
 32%|███▏      | 12241/37963 [30:08:20<63:26:16,  8.88s/it]
 32%|███▏      | 12242/37963 [30:08:27<61:00:54,  8.54s/it]
 32%|███▏      | 12243/37963 [30:08:35<58:45:34,  8.22s/it]
 32%|███▏      | 12244/37963 [30:08:42<57:12:15,  8.01s/it]
 32%|███▏      | 12245/37963 [30:08:57<71:54:06, 10.06s/it]
 32%|███▏      | 12246/37963 [30:09:05<66:53:48,  9.36s/it]
 32%|███▏      | 12247/37963 [30:09:12<62:23:56,  8.74s/it]
 32%|███▏      | 12248/37963 [30:09:20<60:30:20,  8.47s/it]
 32%|███▏      | 12249/37963 [30:09:28<58:55:15,  8.25s/it]
 32%|███▏      | 12250/37963 [30:09:35<57:33:31,  8.06s/it]
                                                           
{'loss': '0.173', 'grad_norm': '1.121', 'learning_rate': '1.583e-05', 'epoch': '0.3227'}
+
 32%|███▏      | 12250/37963 [30:09:35<57:33:31,  8.06s/it]
 32%|███▏      | 12251/37963 [30:09:43<56:11:19,  7.87s/it]
 32%|███▏      | 12252/37963 [30:09:50<55:47:08,  7.81s/it]
 32%|███▏      | 12253/37963 [30:09:58<55:28:52,  7.77s/it]
 32%|███▏      | 12254/37963 [30:10:06<55:05:39,  7.71s/it]
 32%|███▏      | 12255/37963 [30:10:20<69:54:50,  9.79s/it]
 32%|███▏      | 12256/37963 [30:10:28<65:20:51,  9.15s/it]
 32%|███▏      | 12257/37963 [30:10:36<62:04:43,  8.69s/it]
 32%|███▏      | 12258/37963 [30:10:43<59:56:23,  8.39s/it]
 32%|███▏      | 12259/37963 [30:10:58<72:57:19, 10.22s/it]
 32%|███▏      | 12260/37963 [30:11:05<67:17:21,  9.42s/it]
                                                           
{'loss': '0.1732', 'grad_norm': '3.107', 'learning_rate': '1.583e-05', 'epoch': '0.3229'}
+
 32%|███▏      | 12260/37963 [30:11:05<67:17:21,  9.42s/it]
 32%|███▏      | 12261/37963 [30:11:13<63:07:43,  8.84s/it]
 32%|███▏      | 12262/37963 [30:11:27<74:38:58, 10.46s/it]
 32%|███▏      | 12263/37963 [30:11:35<68:41:51,  9.62s/it]
 32%|███▏      | 12264/37963 [30:11:50<80:25:01, 11.27s/it]
 32%|███▏      | 12265/37963 [30:11:58<72:43:05, 10.19s/it]
 32%|███▏      | 12266/37963 [30:12:05<67:20:48,  9.43s/it]
 32%|███▏      | 12267/37963 [30:12:13<63:34:52,  8.91s/it]
 32%|███▏      | 12268/37963 [30:12:21<61:26:45,  8.61s/it]
 32%|███▏      | 12269/37963 [30:12:28<58:29:45,  8.20s/it]
 32%|███▏      | 12270/37963 [30:12:42<71:09:21,  9.97s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '1.91', 'learning_rate': '1.582e-05', 'epoch': '0.3232'}
+
 32%|███▏      | 12270/37963 [30:12:42<71:09:21,  9.97s/it]
 32%|███▏      | 12271/37963 [30:12:50<66:28:52,  9.32s/it]
 32%|███▏      | 12272/37963 [30:12:58<62:53:24,  8.81s/it]
 32%|███▏      | 12273/37963 [30:13:05<60:24:49,  8.47s/it]
 32%|███▏      | 12274/37963 [30:13:13<59:02:56,  8.28s/it]
 32%|███▏      | 12275/37963 [30:13:21<57:44:26,  8.09s/it]
 32%|███▏      | 12276/37963 [30:13:28<57:03:04,  8.00s/it]
 32%|███▏      | 12277/37963 [30:13:36<56:07:11,  7.87s/it]
 32%|███▏      | 12278/37963 [30:13:44<56:06:18,  7.86s/it]
 32%|███▏      | 12279/37963 [30:13:52<55:41:17,  7.81s/it]
 32%|███▏      | 12280/37963 [30:14:06<68:51:56,  9.65s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '1.401', 'learning_rate': '1.581e-05', 'epoch': '0.3235'}
+
 32%|███▏      | 12280/37963 [30:14:06<68:51:56,  9.65s/it]
 32%|███▏      | 12281/37963 [30:14:13<64:12:02,  9.00s/it]
 32%|███▏      | 12282/37963 [30:14:21<61:39:08,  8.64s/it]
 32%|███▏      | 12283/37963 [30:14:29<59:42:08,  8.37s/it]
 32%|███▏      | 12284/37963 [30:14:36<58:09:45,  8.15s/it]
 32%|███▏      | 12285/37963 [30:14:44<57:03:54,  8.00s/it]
 32%|███▏      | 12286/37963 [30:14:52<56:39:02,  7.94s/it]
 32%|███▏      | 12287/37963 [30:14:59<55:35:41,  7.79s/it]
 32%|███▏      | 12288/37963 [30:15:07<55:13:12,  7.74s/it]
 32%|███▏      | 12289/37963 [30:15:14<54:48:27,  7.69s/it]
 32%|███▏      | 12290/37963 [30:15:28<68:43:38,  9.64s/it]
                                                           
{'loss': '0.1724', 'grad_norm': '0.9282', 'learning_rate': '1.581e-05', 'epoch': '0.3237'}
+
 32%|███▏      | 12290/37963 [30:15:28<68:43:38,  9.64s/it]
 32%|███▏      | 12291/37963 [30:15:36<64:28:02,  9.04s/it]
 32%|███▏      | 12292/37963 [30:15:44<61:31:37,  8.63s/it]
 32%|███▏      | 12293/37963 [30:15:59<74:36:27, 10.46s/it]
 32%|███▏      | 12294/37963 [30:16:06<68:11:24,  9.56s/it]
 32%|███▏      | 12295/37963 [30:16:14<64:03:21,  8.98s/it]
 32%|███▏      | 12296/37963 [30:16:21<61:26:10,  8.62s/it]
 32%|███▏      | 12297/37963 [30:16:29<59:07:13,  8.29s/it]
 32%|███▏      | 12298/37963 [30:16:36<57:32:59,  8.07s/it]
 32%|███▏      | 12299/37963 [30:16:44<56:41:15,  7.95s/it]
 32%|███▏      | 12300/37963 [30:16:52<56:11:31,  7.88s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '1.057', 'learning_rate': '1.58e-05', 'epoch': '0.324'}
+
 32%|███▏      | 12300/37963 [30:16:52<56:11:31,  7.88s/it]
 32%|███▏      | 12301/37963 [30:17:06<70:30:18,  9.89s/it]
 32%|███▏      | 12302/37963 [30:17:14<65:32:48,  9.20s/it]
 32%|███▏      | 12303/37963 [30:17:22<62:17:58,  8.74s/it]
 32%|███▏      | 12304/37963 [30:17:29<59:53:52,  8.40s/it]
 32%|███▏      | 12305/37963 [30:17:37<58:34:29,  8.22s/it]
 32%|███▏      | 12306/37963 [30:17:45<57:10:34,  8.02s/it]
 32%|███▏      | 12307/37963 [30:17:59<69:57:20,  9.82s/it]
 32%|███▏      | 12308/37963 [30:18:06<64:49:26,  9.10s/it]
 32%|███▏      | 12309/37963 [30:18:21<77:46:53, 10.91s/it]
 32%|███▏      | 12310/37963 [30:18:29<70:32:24,  9.90s/it]
                                                           
{'loss': '0.1712', 'grad_norm': '1.833', 'learning_rate': '1.579e-05', 'epoch': '0.3243'}
+
 32%|███▏      | 12310/37963 [30:18:29<70:32:24,  9.90s/it]
 32%|███▏      | 12311/37963 [30:18:36<65:47:11,  9.23s/it]
 32%|███▏      | 12312/37963 [30:18:51<76:29:31, 10.74s/it]
 32%|███▏      | 12313/37963 [30:18:59<70:50:00,  9.94s/it]
 32%|███▏      | 12314/37963 [30:19:13<79:54:08, 11.21s/it]
 32%|███▏      | 12315/37963 [30:19:21<72:39:28, 10.20s/it]
 32%|███▏      | 12316/37963 [30:19:28<66:53:19,  9.39s/it]
 32%|███▏      | 12317/37963 [30:19:36<63:22:46,  8.90s/it]
 32%|███▏      | 12318/37963 [30:19:44<60:43:47,  8.53s/it]
 32%|███▏      | 12319/37963 [30:19:51<58:57:11,  8.28s/it]
 32%|███▏      | 12320/37963 [30:19:59<57:26:45,  8.06s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '3.085', 'learning_rate': '1.579e-05', 'epoch': '0.3245'}
+
 32%|███▏      | 12320/37963 [30:19:59<57:26:45,  8.06s/it]
 32%|███▏      | 12321/37963 [30:20:07<56:50:44,  7.98s/it]
 32%|███▏      | 12322/37963 [30:20:14<56:03:49,  7.87s/it]
 32%|███▏      | 12323/37963 [30:20:22<55:33:32,  7.80s/it]
 32%|███▏      | 12324/37963 [30:20:30<55:20:30,  7.77s/it]
 32%|███▏      | 12325/37963 [30:20:37<55:06:36,  7.74s/it]
 32%|███▏      | 12326/37963 [30:20:52<68:57:08,  9.68s/it]
 32%|███▏      | 12327/37963 [30:20:59<64:37:04,  9.07s/it]
 32%|███▏      | 12328/37963 [30:21:07<61:26:15,  8.63s/it]
 32%|███▏      | 12329/37963 [30:21:14<59:12:08,  8.31s/it]
 32%|███▏      | 12330/37963 [30:21:22<58:04:18,  8.16s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '1.507', 'learning_rate': '1.578e-05', 'epoch': '0.3248'}
+
 32%|███▏      | 12330/37963 [30:21:22<58:04:18,  8.16s/it]
 32%|███▏      | 12331/37963 [30:21:29<56:03:01,  7.87s/it]
 32%|███▏      | 12332/37963 [30:21:37<55:34:23,  7.81s/it]
 32%|███▏      | 12333/37963 [30:21:45<55:20:16,  7.77s/it]
 32%|███▏      | 12334/37963 [30:21:52<55:07:43,  7.74s/it]
 32%|███▏      | 12335/37963 [30:22:00<55:09:57,  7.75s/it]
 32%|███▏      | 12336/37963 [30:22:08<54:41:42,  7.68s/it]
 32%|███▏      | 12337/37963 [30:22:15<54:37:10,  7.67s/it]
 33%|███▎      | 12338/37963 [30:22:30<69:19:58,  9.74s/it]
 33%|███▎      | 12339/37963 [30:22:38<65:01:57,  9.14s/it]
 33%|███▎      | 12340/37963 [30:22:52<76:58:37, 10.82s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '1.635', 'learning_rate': '1.577e-05', 'epoch': '0.3251'}
+
 33%|███▎      | 12340/37963 [30:22:52<76:58:37, 10.82s/it]
 33%|███▎      | 12341/37963 [30:23:00<70:48:45,  9.95s/it]
 33%|███▎      | 12342/37963 [30:23:08<65:16:10,  9.17s/it]
 33%|███▎      | 12343/37963 [30:23:15<62:00:15,  8.71s/it]
 33%|███▎      | 12344/37963 [30:23:23<59:45:38,  8.40s/it]
 33%|███▎      | 12345/37963 [30:23:31<57:56:31,  8.14s/it]
 33%|███▎      | 12346/37963 [30:23:38<57:03:21,  8.02s/it]
 33%|███▎      | 12347/37963 [30:23:46<56:19:35,  7.92s/it]
 33%|███▎      | 12348/37963 [30:23:53<55:28:59,  7.80s/it]
 33%|███▎      | 12349/37963 [30:24:01<54:39:19,  7.68s/it]
 33%|███▎      | 12350/37963 [30:24:08<54:04:32,  7.60s/it]
                                                           
{'loss': '0.1669', 'grad_norm': '0.5576', 'learning_rate': '1.576e-05', 'epoch': '0.3253'}
+
 33%|███▎      | 12350/37963 [30:24:08<54:04:32,  7.60s/it]
 33%|███▎      | 12351/37963 [30:24:16<54:10:29,  7.61s/it]
 33%|███▎      | 12352/37963 [30:24:24<54:14:14,  7.62s/it]
 33%|███▎      | 12353/37963 [30:24:31<54:31:27,  7.66s/it]
 33%|███▎      | 12354/37963 [30:24:39<54:29:38,  7.66s/it]
 33%|███▎      | 12355/37963 [30:25:00<83:35:44, 11.75s/it]
 33%|███▎      | 12356/37963 [30:25:08<74:56:42, 10.54s/it]
 33%|███▎      | 12357/37963 [30:25:16<69:07:04,  9.72s/it]
 33%|███▎      | 12358/37963 [30:25:24<65:08:34,  9.16s/it]
 33%|███▎      | 12359/37963 [30:25:31<61:56:29,  8.71s/it]
 33%|███▎      | 12360/37963 [30:25:46<74:42:01, 10.50s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '0.9277', 'learning_rate': '1.576e-05', 'epoch': '0.3256'}
+
 33%|███▎      | 12360/37963 [30:25:46<74:42:01, 10.50s/it]
 33%|███▎      | 12361/37963 [30:25:54<68:35:45,  9.65s/it]
 33%|███▎      | 12362/37963 [30:26:14<91:34:28, 12.88s/it]
 33%|███▎      | 12363/37963 [30:26:22<80:40:46, 11.35s/it]
 33%|███▎      | 12364/37963 [30:26:30<73:16:54, 10.31s/it]
 33%|███▎      | 12365/37963 [30:26:37<67:40:36,  9.52s/it]
 33%|███▎      | 12366/37963 [30:26:45<63:38:22,  8.95s/it]
 33%|███▎      | 12367/37963 [30:26:52<60:22:30,  8.49s/it]
 33%|███▎      | 12368/37963 [30:27:00<58:31:13,  8.23s/it]
 33%|███▎      | 12369/37963 [30:27:08<57:03:47,  8.03s/it]
 33%|███▎      | 12370/37963 [30:27:22<70:55:50,  9.98s/it]
                                                           
{'loss': '0.1556', 'grad_norm': '0.6184', 'learning_rate': '1.575e-05', 'epoch': '0.3258'}
+
 33%|███▎      | 12370/37963 [30:27:22<70:55:50,  9.98s/it]
 33%|███▎      | 12371/37963 [30:27:30<65:51:20,  9.26s/it]
 33%|███▎      | 12372/37963 [30:27:37<62:23:10,  8.78s/it]
 33%|███▎      | 12373/37963 [30:27:45<59:50:21,  8.42s/it]
 33%|███▎      | 12374/37963 [30:27:53<58:14:30,  8.19s/it]
 33%|███▎      | 12375/37963 [30:28:00<56:30:18,  7.95s/it]
 33%|███▎      | 12376/37963 [30:28:08<55:56:14,  7.87s/it]
 33%|███▎      | 12377/37963 [30:28:15<55:35:43,  7.82s/it]
 33%|███▎      | 12378/37963 [30:28:23<55:22:19,  7.79s/it]
 33%|███▎      | 12379/37963 [30:28:31<55:24:26,  7.80s/it]
 33%|███▎      | 12380/37963 [30:28:39<55:03:44,  7.75s/it]
                                                           
{'loss': '0.1702', 'grad_norm': '3.608', 'learning_rate': '1.574e-05', 'epoch': '0.3261'}
+
 33%|███▎      | 12380/37963 [30:28:39<55:03:44,  7.75s/it]
 33%|███▎      | 12381/37963 [30:28:46<54:44:19,  7.70s/it]
 33%|███▎      | 12382/37963 [30:28:54<54:44:23,  7.70s/it]
 33%|███▎      | 12383/37963 [30:29:01<54:27:24,  7.66s/it]
 33%|███▎      | 12384/37963 [30:29:09<54:18:42,  7.64s/it]
 33%|███▎      | 12385/37963 [30:29:17<54:22:09,  7.65s/it]
 33%|███▎      | 12386/37963 [30:29:32<69:56:38,  9.84s/it]
 33%|███▎      | 12387/37963 [30:29:40<65:39:40,  9.24s/it]
 33%|███▎      | 12388/37963 [30:29:47<62:19:45,  8.77s/it]
 33%|███▎      | 12389/37963 [30:29:55<59:56:57,  8.44s/it]
 33%|███▎      | 12390/37963 [30:30:03<58:19:45,  8.21s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '2.057', 'learning_rate': '1.574e-05', 'epoch': '0.3264'}
+
 33%|███▎      | 12390/37963 [30:30:03<58:19:45,  8.21s/it]
 33%|███▎      | 12391/37963 [30:30:10<56:25:55,  7.94s/it]
 33%|███▎      | 12392/37963 [30:30:18<56:09:43,  7.91s/it]
 33%|███▎      | 12393/37963 [30:30:25<55:31:12,  7.82s/it]
 33%|███▎      | 12394/37963 [30:30:40<69:51:25,  9.84s/it]
 33%|███▎      | 12395/37963 [30:30:47<65:05:08,  9.16s/it]
 33%|███▎      | 12396/37963 [30:30:55<61:58:53,  8.73s/it]
 33%|███▎      | 12397/37963 [30:31:03<59:45:15,  8.41s/it]
 33%|███▎      | 12398/37963 [30:31:10<58:02:51,  8.17s/it]
 33%|███▎      | 12399/37963 [30:31:18<56:33:35,  7.96s/it]
 33%|███▎      | 12400/37963 [30:31:26<55:52:25,  7.87s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '1.117', 'learning_rate': '1.573e-05', 'epoch': '0.3266'}
+
 33%|███▎      | 12400/37963 [30:31:26<55:52:25,  7.87s/it]
 33%|███▎      | 12401/37963 [30:31:33<55:20:18,  7.79s/it]
 33%|███▎      | 12402/37963 [30:31:41<54:59:07,  7.74s/it]
 33%|███▎      | 12403/37963 [30:31:48<54:44:51,  7.71s/it]
 33%|███▎      | 12404/37963 [30:31:56<54:38:13,  7.70s/it]
 33%|███▎      | 12405/37963 [30:32:11<69:09:40,  9.74s/it]
 33%|███▎      | 12406/37963 [30:32:18<64:48:05,  9.13s/it]
 33%|███▎      | 12407/37963 [30:32:32<74:25:38, 10.48s/it]
 33%|███▎      | 12408/37963 [30:32:46<82:22:05, 11.60s/it]
 33%|███▎      | 12409/37963 [30:32:54<73:25:41, 10.34s/it]
 33%|███▎      | 12410/37963 [30:33:08<81:44:05, 11.52s/it]
                                                           
{'loss': '0.1726', 'grad_norm': '3.052', 'learning_rate': '1.572e-05', 'epoch': '0.3269'}
+
 33%|███▎      | 12410/37963 [30:33:08<81:44:05, 11.52s/it]
 33%|███▎      | 12411/37963 [30:33:15<73:31:15, 10.36s/it]
 33%|███▎      | 12412/37963 [30:33:23<67:10:05,  9.46s/it]
 33%|███▎      | 12413/37963 [30:33:30<62:52:28,  8.86s/it]
 33%|███▎      | 12414/37963 [30:33:45<75:14:22, 10.60s/it]
 33%|███▎      | 12415/37963 [30:33:59<82:57:21, 11.69s/it]
 33%|███▎      | 12416/37963 [30:34:07<73:55:10, 10.42s/it]
 33%|███▎      | 12417/37963 [30:34:14<67:59:30,  9.58s/it]
 33%|███▎      | 12418/37963 [30:34:22<63:55:32,  9.01s/it]
 33%|███▎      | 12419/37963 [30:34:30<61:03:57,  8.61s/it]
 33%|███▎      | 12420/37963 [30:34:37<59:12:05,  8.34s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '1.786', 'learning_rate': '1.572e-05', 'epoch': '0.3272'}
+
 33%|███▎      | 12420/37963 [30:34:37<59:12:05,  8.34s/it]
 33%|███▎      | 12421/37963 [30:34:45<58:09:25,  8.20s/it]
 33%|███▎      | 12422/37963 [30:34:53<57:02:39,  8.04s/it]
 33%|███▎      | 12423/37963 [30:35:01<56:15:20,  7.93s/it]
 33%|███▎      | 12424/37963 [30:35:08<55:30:27,  7.82s/it]
 33%|███▎      | 12425/37963 [30:35:16<55:02:03,  7.76s/it]
 33%|███▎      | 12426/37963 [30:35:23<54:53:56,  7.74s/it]
 33%|███▎      | 12427/37963 [30:35:31<54:02:14,  7.62s/it]
 33%|███▎      | 12428/37963 [30:35:38<54:04:04,  7.62s/it]
 33%|███▎      | 12429/37963 [30:35:46<54:10:31,  7.64s/it]
 33%|███▎      | 12430/37963 [30:35:54<53:52:54,  7.60s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '2.703', 'learning_rate': '1.571e-05', 'epoch': '0.3274'}
+
 33%|███▎      | 12430/37963 [30:35:54<53:52:54,  7.60s/it]
 33%|███▎      | 12431/37963 [30:36:01<54:04:21,  7.62s/it]
 33%|███▎      | 12432/37963 [30:36:09<54:13:55,  7.65s/it]
 33%|███▎      | 12433/37963 [30:36:17<54:14:16,  7.65s/it]
 33%|███▎      | 12434/37963 [30:36:31<69:32:42,  9.81s/it]
 33%|███▎      | 12435/37963 [30:36:39<65:12:18,  9.20s/it]
 33%|███▎      | 12436/37963 [30:36:47<61:45:18,  8.71s/it]
 33%|███▎      | 12437/37963 [30:36:55<59:37:35,  8.41s/it]
 33%|███▎      | 12438/37963 [30:37:02<57:57:36,  8.17s/it]
 33%|███▎      | 12439/37963 [30:37:10<56:44:09,  8.00s/it]
 33%|███▎      | 12440/37963 [30:37:17<56:08:05,  7.92s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '1.522', 'learning_rate': '1.57e-05', 'epoch': '0.3277'}
+
 33%|███▎      | 12440/37963 [30:37:17<56:08:05,  7.92s/it]
 33%|███▎      | 12441/37963 [30:37:25<55:44:53,  7.86s/it]
 33%|███▎      | 12442/37963 [30:37:33<55:09:22,  7.78s/it]
 33%|███▎      | 12443/37963 [30:37:40<55:00:07,  7.76s/it]
 33%|███▎      | 12444/37963 [30:37:48<54:46:59,  7.73s/it]
 33%|███▎      | 12445/37963 [30:37:56<55:10:15,  7.78s/it]
 33%|███▎      | 12446/37963 [30:38:04<54:48:35,  7.73s/it]
 33%|███▎      | 12447/37963 [30:38:11<54:53:18,  7.74s/it]
 33%|███▎      | 12448/37963 [30:38:26<69:44:23,  9.84s/it]
 33%|███▎      | 12449/37963 [30:38:34<65:10:36,  9.20s/it]
 33%|███▎      | 12450/37963 [30:38:49<77:23:32, 10.92s/it]
                                                           
{'loss': '0.1684', 'grad_norm': '4.7', 'learning_rate': '1.57e-05', 'epoch': '0.328'}
+
 33%|███▎      | 12450/37963 [30:38:49<77:23:32, 10.92s/it]
 33%|███▎      | 12451/37963 [30:38:56<70:29:04,  9.95s/it]
 33%|███▎      | 12452/37963 [30:39:04<65:18:35,  9.22s/it]
 33%|███▎      | 12453/37963 [30:39:12<61:54:57,  8.74s/it]
 33%|███▎      | 12454/37963 [30:39:26<72:55:47, 10.29s/it]
 33%|███▎      | 12455/37963 [30:39:33<67:44:10,  9.56s/it]
 33%|███▎      | 12456/37963 [30:39:41<64:09:24,  9.05s/it]
 33%|███▎      | 12457/37963 [30:39:56<75:11:52, 10.61s/it]
 33%|███▎      | 12458/37963 [30:40:10<83:41:17, 11.81s/it]
 33%|███▎      | 12459/37963 [30:40:18<75:03:12, 10.59s/it]
 33%|███▎      | 12460/37963 [30:40:26<69:00:43,  9.74s/it]
                                                           
{'loss': '0.1574', 'grad_norm': '5.823', 'learning_rate': '1.569e-05', 'epoch': '0.3282'}
+
 33%|███▎      | 12460/37963 [30:40:26<69:00:43,  9.74s/it]
 33%|███▎      | 12461/37963 [30:40:39<77:39:58, 10.96s/it]
 33%|███▎      | 12462/37963 [30:40:47<70:23:12,  9.94s/it]
 33%|███▎      | 12463/37963 [30:40:54<65:12:50,  9.21s/it]
 33%|███▎      | 12464/37963 [30:41:02<61:53:45,  8.74s/it]
 33%|███▎      | 12465/37963 [30:41:10<59:01:19,  8.33s/it]
 33%|███▎      | 12466/37963 [30:41:17<57:33:48,  8.13s/it]
 33%|███▎      | 12467/37963 [30:41:32<71:21:58, 10.08s/it]
 33%|███▎      | 12468/37963 [30:41:40<66:22:24,  9.37s/it]
 33%|███▎      | 12469/37963 [30:41:47<62:17:47,  8.80s/it]
 33%|███▎      | 12470/37963 [30:41:54<59:21:50,  8.38s/it]
                                                           
{'loss': '0.1503', 'grad_norm': '0.7653', 'learning_rate': '1.568e-05', 'epoch': '0.3285'}
+
 33%|███▎      | 12470/37963 [30:41:54<59:21:50,  8.38s/it]
 33%|███▎      | 12471/37963 [30:42:02<57:45:20,  8.16s/it]
 33%|███▎      | 12472/37963 [30:42:10<56:41:01,  8.01s/it]
 33%|███▎      | 12473/37963 [30:42:17<55:41:11,  7.86s/it]
 33%|███▎      | 12474/37963 [30:42:25<55:05:38,  7.78s/it]
 33%|███▎      | 12475/37963 [30:42:33<55:06:43,  7.78s/it]
 33%|███▎      | 12476/37963 [30:42:40<54:17:05,  7.67s/it]
 33%|███▎      | 12477/37963 [30:42:48<54:21:38,  7.68s/it]
 33%|███▎      | 12478/37963 [30:42:55<54:18:38,  7.67s/it]
 33%|███▎      | 12479/37963 [30:43:03<54:33:35,  7.71s/it]
 33%|███▎      | 12480/37963 [30:43:11<54:00:56,  7.63s/it]
                                                           
{'loss': '0.1494', 'grad_norm': '3.822', 'learning_rate': '1.567e-05', 'epoch': '0.3287'}
+
 33%|███▎      | 12480/37963 [30:43:11<54:00:56,  7.63s/it]
 33%|███▎      | 12481/37963 [30:43:18<54:24:46,  7.69s/it]
 33%|███▎      | 12482/37963 [30:43:33<69:39:57,  9.84s/it]
 33%|███▎      | 12483/37963 [30:43:41<64:40:00,  9.14s/it]
 33%|███▎      | 12484/37963 [30:43:48<61:15:55,  8.66s/it]
 33%|███▎      | 12485/37963 [30:43:56<59:13:38,  8.37s/it]
 33%|███▎      | 12486/37963 [30:44:03<57:18:49,  8.10s/it]
 33%|███▎      | 12487/37963 [30:44:11<56:16:24,  7.95s/it]
 33%|███▎      | 12488/37963 [30:44:19<55:47:56,  7.89s/it]
 33%|███▎      | 12489/37963 [30:44:27<55:31:33,  7.85s/it]
 33%|███▎      | 12490/37963 [30:44:34<55:04:53,  7.78s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '2.04', 'learning_rate': '1.567e-05', 'epoch': '0.329'}
+
 33%|███▎      | 12490/37963 [30:44:34<55:04:53,  7.78s/it]
 33%|███▎      | 12491/37963 [30:44:42<54:30:11,  7.70s/it]
 33%|███▎      | 12492/37963 [30:44:49<54:37:22,  7.72s/it]
 33%|███▎      | 12493/37963 [30:44:57<54:22:58,  7.69s/it]
 33%|███▎      | 12494/37963 [30:45:05<54:08:50,  7.65s/it]
 33%|███▎      | 12495/37963 [30:45:13<54:37:23,  7.72s/it]
 33%|███▎      | 12496/37963 [30:45:27<69:26:37,  9.82s/it]
 33%|███▎      | 12497/37963 [30:45:35<64:53:46,  9.17s/it]
 33%|███▎      | 12498/37963 [30:45:43<61:41:03,  8.72s/it]
 33%|███▎      | 12499/37963 [30:45:50<59:37:48,  8.43s/it]
 33%|███▎      | 12500/37963 [30:45:58<58:12:04,  8.23s/it]
                                                           
{'loss': '0.1631', 'grad_norm': '2.004', 'learning_rate': '1.566e-05', 'epoch': '0.3293'}
+
 33%|███▎      | 12500/37963 [30:45:58<58:12:04,  8.23s/it]
 33%|███▎      | 12501/37963 [30:46:13<71:25:56, 10.10s/it]
 33%|███▎      | 12502/37963 [30:46:20<66:21:05,  9.38s/it]
 33%|███▎      | 12503/37963 [30:46:28<62:33:50,  8.85s/it]
 33%|███▎      | 12504/37963 [30:46:42<73:32:17, 10.40s/it]
 33%|███▎      | 12505/37963 [30:46:56<81:51:36, 11.58s/it]
 33%|███▎      | 12506/37963 [30:47:17<101:39:55, 14.38s/it]
 33%|███▎      | 12507/37963 [30:47:25<88:09:02, 12.47s/it] 
 33%|███▎      | 12508/37963 [30:47:33<77:53:55, 11.02s/it]
 33%|███▎      | 12509/37963 [30:47:40<70:26:56,  9.96s/it]
 33%|███▎      | 12510/37963 [30:47:55<80:32:16, 11.39s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '1.688', 'learning_rate': '1.565e-05', 'epoch': '0.3295'}
+
 33%|███▎      | 12510/37963 [30:47:55<80:32:16, 11.39s/it]
 33%|███▎      | 12511/37963 [30:48:03<72:59:24, 10.32s/it]
 33%|███▎      | 12512/37963 [30:48:11<67:35:05,  9.56s/it]
 33%|███▎      | 12513/37963 [30:48:18<63:16:51,  8.95s/it]
 33%|███▎      | 12514/37963 [30:48:26<60:23:04,  8.54s/it]
 33%|███▎      | 12515/37963 [30:48:33<58:27:39,  8.27s/it]
 33%|███▎      | 12516/37963 [30:48:41<56:59:53,  8.06s/it]
 33%|███▎      | 12517/37963 [30:48:48<55:20:55,  7.83s/it]
 33%|███▎      | 12518/37963 [30:48:56<54:22:49,  7.69s/it]
 33%|███▎      | 12519/37963 [30:49:03<54:13:46,  7.67s/it]
 33%|███▎      | 12520/37963 [30:49:11<54:09:14,  7.66s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '1.647', 'learning_rate': '1.565e-05', 'epoch': '0.3298'}
+
 33%|███▎      | 12520/37963 [30:49:11<54:09:14,  7.66s/it]
 33%|███▎      | 12521/37963 [30:49:19<54:14:55,  7.68s/it]
 33%|███▎      | 12522/37963 [30:49:26<54:30:14,  7.71s/it]
 33%|███▎      | 12523/37963 [30:49:34<54:15:59,  7.68s/it]
 33%|███▎      | 12524/37963 [30:49:42<54:09:54,  7.67s/it]
 33%|███▎      | 12525/37963 [30:49:49<54:01:00,  7.64s/it]
 33%|███▎      | 12526/37963 [30:49:57<54:22:42,  7.70s/it]
 33%|███▎      | 12527/37963 [30:50:05<54:18:41,  7.69s/it]
 33%|███▎      | 12528/37963 [30:50:12<54:12:33,  7.67s/it]
 33%|███▎      | 12529/37963 [30:50:20<54:21:28,  7.69s/it]
 33%|███▎      | 12530/37963 [30:50:28<54:18:25,  7.69s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '0.8715', 'learning_rate': '1.564e-05', 'epoch': '0.3301'}
+
 33%|███▎      | 12530/37963 [30:50:28<54:18:25,  7.69s/it]
 33%|███▎      | 12531/37963 [30:50:36<54:42:25,  7.74s/it]
 33%|███▎      | 12532/37963 [30:50:43<54:44:40,  7.75s/it]
 33%|███▎      | 12533/37963 [30:50:51<54:38:38,  7.74s/it]
 33%|███▎      | 12534/37963 [30:50:59<54:26:28,  7.71s/it]
 33%|███▎      | 12535/37963 [30:51:13<69:17:01,  9.81s/it]
 33%|███▎      | 12536/37963 [30:51:21<64:53:23,  9.19s/it]
 33%|███▎      | 12537/37963 [30:51:29<61:53:27,  8.76s/it]
 33%|███▎      | 12538/37963 [30:51:37<59:41:40,  8.45s/it]
 33%|███▎      | 12539/37963 [30:51:44<57:37:44,  8.16s/it]
 33%|███▎      | 12540/37963 [30:51:52<56:38:49,  8.02s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '2.335', 'learning_rate': '1.563e-05', 'epoch': '0.3303'}
+
 33%|███▎      | 12540/37963 [30:51:52<56:38:49,  8.02s/it]
 33%|███▎      | 12541/37963 [30:52:00<55:58:18,  7.93s/it]
 33%|███▎      | 12542/37963 [30:52:07<54:51:01,  7.77s/it]
 33%|███▎      | 12543/37963 [30:52:15<54:35:44,  7.73s/it]
 33%|███▎      | 12544/37963 [30:52:22<54:03:20,  7.66s/it]
 33%|███▎      | 12545/37963 [30:52:30<53:58:51,  7.65s/it]
 33%|███▎      | 12546/37963 [30:52:37<53:32:58,  7.58s/it]
 33%|███▎      | 12547/37963 [30:52:45<53:41:36,  7.61s/it]
 33%|███▎      | 12548/37963 [30:52:59<67:39:47,  9.58s/it]
 33%|███▎      | 12549/37963 [30:53:07<63:22:22,  8.98s/it]
 33%|███▎      | 12550/37963 [30:53:21<74:51:24, 10.60s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '0.9783', 'learning_rate': '1.562e-05', 'epoch': '0.3306'}
+
 33%|███▎      | 12550/37963 [30:53:21<74:51:24, 10.60s/it]
 33%|███▎      | 12551/37963 [30:53:42<97:01:37, 13.75s/it]
 33%|███▎      | 12552/37963 [30:53:50<84:20:24, 11.95s/it]
 33%|███▎      | 12553/37963 [30:53:57<75:03:06, 10.63s/it]
 33%|███▎      | 12554/37963 [30:54:12<83:52:28, 11.88s/it]
 33%|███▎      | 12555/37963 [30:54:20<75:06:20, 10.64s/it]
 33%|███▎      | 12556/37963 [30:54:27<68:27:54,  9.70s/it]
 33%|███▎      | 12557/37963 [30:54:42<78:38:43, 11.14s/it]
 33%|███▎      | 12558/37963 [30:54:50<71:35:49, 10.15s/it]
 33%|███▎      | 12559/37963 [30:54:57<66:28:25,  9.42s/it]
 33%|███▎      | 12560/37963 [30:55:12<76:23:59, 10.83s/it]
                                                           
{'loss': '0.1527', 'grad_norm': '1.929', 'learning_rate': '1.562e-05', 'epoch': '0.3308'}
+
 33%|███▎      | 12560/37963 [30:55:12<76:23:59, 10.83s/it]
 33%|███▎      | 12561/37963 [30:55:19<69:42:51,  9.88s/it]
 33%|███▎      | 12562/37963 [30:55:27<65:06:20,  9.23s/it]
 33%|███▎      | 12563/37963 [30:55:35<61:45:05,  8.75s/it]
 33%|███▎      | 12564/37963 [30:55:42<59:34:58,  8.45s/it]
 33%|███▎      | 12565/37963 [30:55:50<58:15:28,  8.26s/it]
 33%|███▎      | 12566/37963 [30:55:58<56:55:05,  8.07s/it]
 33%|███▎      | 12567/37963 [30:56:05<55:26:50,  7.86s/it]
 33%|███▎      | 12568/37963 [30:56:13<55:12:16,  7.83s/it]
 33%|███▎      | 12569/37963 [30:56:21<54:57:29,  7.79s/it]
 33%|███▎      | 12570/37963 [30:56:28<55:07:57,  7.82s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '2.308', 'learning_rate': '1.561e-05', 'epoch': '0.3311'}
+
 33%|███▎      | 12570/37963 [30:56:28<55:07:57,  7.82s/it]
 33%|███▎      | 12571/37963 [30:56:36<54:52:30,  7.78s/it]
 33%|███▎      | 12572/37963 [30:56:44<54:32:36,  7.73s/it]
 33%|███▎      | 12573/37963 [30:56:51<54:04:36,  7.67s/it]
 33%|███▎      | 12574/37963 [30:56:59<54:01:15,  7.66s/it]
 33%|███▎      | 12575/37963 [30:57:06<53:42:17,  7.62s/it]
 33%|███▎      | 12576/37963 [30:57:14<53:43:19,  7.62s/it]
 33%|███▎      | 12577/37963 [30:57:22<54:09:17,  7.68s/it]
 33%|███▎      | 12578/37963 [30:57:29<53:52:36,  7.64s/it]
 33%|███▎      | 12579/37963 [30:57:37<53:54:32,  7.65s/it]
 33%|███▎      | 12580/37963 [30:57:45<54:09:08,  7.68s/it]
                                                           
{'loss': '0.1636', 'grad_norm': '2.721', 'learning_rate': '1.56e-05', 'epoch': '0.3314'}
+
 33%|███▎      | 12580/37963 [30:57:45<54:09:08,  7.68s/it]
 33%|███▎      | 12581/37963 [30:57:52<53:33:37,  7.60s/it]
 33%|███▎      | 12582/37963 [30:58:00<53:36:22,  7.60s/it]
 33%|███▎      | 12583/37963 [30:58:15<68:34:27,  9.73s/it]
 33%|███▎      | 12584/37963 [30:58:22<64:23:35,  9.13s/it]
 33%|███▎      | 12585/37963 [30:58:30<61:10:33,  8.68s/it]
 33%|███▎      | 12586/37963 [30:58:37<58:18:38,  8.27s/it]
 33%|███▎      | 12587/37963 [30:58:45<56:49:48,  8.06s/it]
 33%|███▎      | 12588/37963 [30:58:52<55:22:52,  7.86s/it]
 33%|███▎      | 12589/37963 [30:59:00<54:49:56,  7.78s/it]
 33%|███▎      | 12590/37963 [30:59:08<54:41:11,  7.76s/it]
                                                           
{'loss': '0.16', 'grad_norm': '2.65', 'learning_rate': '1.56e-05', 'epoch': '0.3316'}
+
 33%|███▎      | 12590/37963 [30:59:08<54:41:11,  7.76s/it]
 33%|███▎      | 12591/37963 [30:59:15<54:26:08,  7.72s/it]
 33%|███▎      | 12592/37963 [30:59:23<53:55:12,  7.65s/it]
 33%|███▎      | 12593/37963 [30:59:30<53:47:22,  7.63s/it]
 33%|███▎      | 12594/37963 [30:59:38<53:23:42,  7.58s/it]
 33%|███▎      | 12595/37963 [30:59:52<67:18:26,  9.55s/it]
 33%|███▎      | 12596/37963 [31:00:13<92:12:48, 13.09s/it]
 33%|███▎      | 12597/37963 [31:00:21<80:54:50, 11.48s/it]
 33%|███▎      | 12598/37963 [31:00:28<72:29:43, 10.29s/it]
 33%|███▎      | 12599/37963 [31:00:36<66:52:29,  9.49s/it]
 33%|███▎      | 12600/37963 [31:00:51<78:19:36, 11.12s/it]
                                                           
{'loss': '0.1576', 'grad_norm': '0.9311', 'learning_rate': '1.559e-05', 'epoch': '0.3319'}
+
 33%|███▎      | 12600/37963 [31:00:51<78:19:36, 11.12s/it]
 33%|███▎      | 12601/37963 [31:01:05<85:03:11, 12.07s/it]
 33%|███▎      | 12602/37963 [31:01:20<89:59:44, 12.77s/it]
 33%|███▎      | 12603/37963 [31:01:27<79:09:26, 11.24s/it]
 33%|███▎      | 12604/37963 [31:01:35<71:12:49, 10.11s/it]
 33%|███▎      | 12605/37963 [31:01:42<65:55:58,  9.36s/it]
 33%|███▎      | 12606/37963 [31:01:50<62:24:16,  8.86s/it]
 33%|███▎      | 12607/37963 [31:01:57<59:10:57,  8.40s/it]
 33%|███▎      | 12608/37963 [31:02:05<57:43:52,  8.20s/it]
 33%|███▎      | 12609/37963 [31:02:13<56:23:36,  8.01s/it]
 33%|███▎      | 12610/37963 [31:02:20<55:45:15,  7.92s/it]
                                                           
{'loss': '0.1802', 'grad_norm': '2.105', 'learning_rate': '1.558e-05', 'epoch': '0.3322'}
+
 33%|███▎      | 12610/37963 [31:02:20<55:45:15,  7.92s/it]
 33%|███▎      | 12611/37963 [31:02:28<55:01:10,  7.81s/it]
 33%|███▎      | 12612/37963 [31:02:36<54:24:19,  7.73s/it]
 33%|███▎      | 12613/37963 [31:02:43<54:18:11,  7.71s/it]
 33%|███▎      | 12614/37963 [31:02:57<67:59:34,  9.66s/it]
 33%|███▎      | 12615/37963 [31:03:05<63:36:32,  9.03s/it]
 33%|███▎      | 12616/37963 [31:03:12<59:56:37,  8.51s/it]
 33%|███▎      | 12617/37963 [31:03:20<58:17:21,  8.28s/it]
 33%|███▎      | 12618/37963 [31:03:28<56:54:45,  8.08s/it]
 33%|███▎      | 12619/37963 [31:03:35<56:15:13,  7.99s/it]
 33%|███▎      | 12620/37963 [31:03:43<55:39:19,  7.91s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '1.258', 'learning_rate': '1.558e-05', 'epoch': '0.3324'}
+
 33%|███▎      | 12620/37963 [31:03:43<55:39:19,  7.91s/it]
 33%|███▎      | 12621/37963 [31:03:51<55:25:56,  7.87s/it]
 33%|███▎      | 12622/37963 [31:03:59<55:02:30,  7.82s/it]
 33%|███▎      | 12623/37963 [31:04:06<54:24:12,  7.73s/it]
 33%|███▎      | 12624/37963 [31:04:14<54:09:00,  7.69s/it]
 33%|███▎      | 12625/37963 [31:04:21<54:15:15,  7.71s/it]
 33%|███▎      | 12626/37963 [31:04:29<54:28:15,  7.74s/it]
 33%|███▎      | 12627/37963 [31:04:37<54:25:00,  7.73s/it]
 33%|███▎      | 12628/37963 [31:04:45<54:24:38,  7.73s/it]
 33%|███▎      | 12629/37963 [31:04:52<53:47:02,  7.64s/it]
 33%|███▎      | 12630/37963 [31:05:00<53:47:50,  7.64s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '1.313', 'learning_rate': '1.557e-05', 'epoch': '0.3327'}
+
 33%|███▎      | 12630/37963 [31:05:00<53:47:50,  7.64s/it]
 33%|███▎      | 12631/37963 [31:05:07<52:34:58,  7.47s/it]
 33%|███▎      | 12632/37963 [31:05:14<52:47:51,  7.50s/it]
 33%|███▎      | 12633/37963 [31:05:22<53:18:19,  7.58s/it]
 33%|███▎      | 12634/37963 [31:05:30<53:18:29,  7.58s/it]
 33%|███▎      | 12635/37963 [31:05:37<53:35:09,  7.62s/it]
 33%|███▎      | 12636/37963 [31:05:45<53:42:33,  7.63s/it]
 33%|███▎      | 12637/37963 [31:06:00<68:18:39,  9.71s/it]
 33%|███▎      | 12638/37963 [31:06:08<64:21:54,  9.15s/it]
 33%|███▎      | 12639/37963 [31:06:22<74:29:19, 10.59s/it]
 33%|███▎      | 12640/37963 [31:06:29<68:16:40,  9.71s/it]
                                                           
{'loss': '0.1657', 'grad_norm': '3.091', 'learning_rate': '1.556e-05', 'epoch': '0.333'}
+
 33%|███▎      | 12640/37963 [31:06:29<68:16:40,  9.71s/it]
 33%|███▎      | 12641/37963 [31:06:44<78:13:22, 11.12s/it]
 33%|███▎      | 12642/37963 [31:06:51<71:00:26, 10.10s/it]
 33%|███▎      | 12643/37963 [31:06:59<65:49:28,  9.36s/it]
 33%|███▎      | 12644/37963 [31:07:20<91:33:28, 13.02s/it]
 33%|███▎      | 12645/37963 [31:07:35<93:57:06, 13.36s/it]
 33%|███▎      | 12646/37963 [31:07:42<82:04:46, 11.67s/it]
 33%|███▎      | 12647/37963 [31:07:50<73:31:22, 10.46s/it]
 33%|███▎      | 12648/37963 [31:07:57<67:17:18,  9.57s/it]
 33%|███▎      | 12649/37963 [31:08:05<63:09:10,  8.98s/it]
 33%|███▎      | 12650/37963 [31:08:13<60:10:49,  8.56s/it]
                                                           
{'loss': '0.16', 'grad_norm': '1.815', 'learning_rate': '1.555e-05', 'epoch': '0.3332'}
+
 33%|███▎      | 12650/37963 [31:08:13<60:10:49,  8.56s/it]
 33%|███▎      | 12651/37963 [31:08:20<57:53:46,  8.23s/it]
 33%|███▎      | 12652/37963 [31:08:28<56:05:17,  7.98s/it]
 33%|███▎      | 12653/37963 [31:08:35<54:53:36,  7.81s/it]
 33%|███▎      | 12654/37963 [31:08:43<54:26:10,  7.74s/it]
 33%|███▎      | 12655/37963 [31:08:50<54:26:57,  7.75s/it]
 33%|███▎      | 12656/37963 [31:09:05<68:26:01,  9.73s/it]
 33%|███▎      | 12657/37963 [31:09:12<63:34:24,  9.04s/it]
 33%|███▎      | 12658/37963 [31:09:20<60:47:47,  8.65s/it]
 33%|███▎      | 12659/37963 [31:09:28<58:51:44,  8.37s/it]
 33%|███▎      | 12660/37963 [31:09:35<57:15:50,  8.15s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '1.521', 'learning_rate': '1.555e-05', 'epoch': '0.3335'}
+
 33%|███▎      | 12660/37963 [31:09:35<57:15:50,  8.15s/it]
 33%|███▎      | 12661/37963 [31:09:43<56:28:09,  8.03s/it]
 33%|███▎      | 12662/37963 [31:09:57<70:13:02,  9.99s/it]
 33%|███▎      | 12663/37963 [31:10:05<65:30:01,  9.32s/it]
 33%|███▎      | 12664/37963 [31:10:13<62:01:36,  8.83s/it]
 33%|███▎      | 12665/37963 [31:10:21<59:38:41,  8.49s/it]
 33%|███▎      | 12666/37963 [31:10:28<57:51:36,  8.23s/it]
 33%|███▎      | 12667/37963 [31:10:36<56:33:54,  8.05s/it]
 33%|███▎      | 12668/37963 [31:10:44<55:45:55,  7.94s/it]
 33%|███▎      | 12669/37963 [31:10:51<55:21:15,  7.88s/it]
 33%|███▎      | 12670/37963 [31:10:59<54:33:05,  7.76s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '2.356', 'learning_rate': '1.554e-05', 'epoch': '0.3337'}
+
 33%|███▎      | 12670/37963 [31:10:59<54:33:05,  7.76s/it]
 33%|███▎      | 12671/37963 [31:11:06<54:21:37,  7.74s/it]
 33%|███▎      | 12672/37963 [31:11:14<54:04:26,  7.70s/it]
 33%|███▎      | 12673/37963 [31:11:22<54:09:30,  7.71s/it]
 33%|███▎      | 12674/37963 [31:11:30<54:19:35,  7.73s/it]
 33%|███▎      | 12675/37963 [31:11:37<54:10:00,  7.71s/it]
 33%|███▎      | 12676/37963 [31:11:45<54:11:14,  7.71s/it]
 33%|███▎      | 12677/37963 [31:11:53<53:56:51,  7.68s/it]
 33%|███▎      | 12678/37963 [31:12:00<53:56:06,  7.68s/it]
 33%|███▎      | 12679/37963 [31:12:08<53:44:03,  7.65s/it]
 33%|███▎      | 12680/37963 [31:12:15<53:00:06,  7.55s/it]
                                                           
{'loss': '0.1552', 'grad_norm': '1.647', 'learning_rate': '1.553e-05', 'epoch': '0.334'}
+
 33%|███▎      | 12680/37963 [31:12:15<53:00:06,  7.55s/it]
 33%|███▎      | 12681/37963 [31:12:23<53:11:14,  7.57s/it]
 33%|███▎      | 12682/37963 [31:12:37<67:04:15,  9.55s/it]
 33%|███▎      | 12683/37963 [31:12:45<63:27:29,  9.04s/it]
 33%|███▎      | 12684/37963 [31:12:53<61:11:20,  8.71s/it]
 33%|███▎      | 12685/37963 [31:13:01<59:15:35,  8.44s/it]
 33%|███▎      | 12686/37963 [31:13:08<57:29:36,  8.19s/it]
 33%|███▎      | 12687/37963 [31:13:16<56:05:09,  7.99s/it]
 33%|███▎      | 12688/37963 [31:13:23<55:20:15,  7.88s/it]
 33%|███▎      | 12689/37963 [31:13:38<69:58:41,  9.97s/it]
 33%|███▎      | 12690/37963 [31:13:46<65:04:20,  9.27s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '3.112', 'learning_rate': '1.553e-05', 'epoch': '0.3343'}
+
 33%|███▎      | 12690/37963 [31:13:46<65:04:20,  9.27s/it]
 33%|███▎      | 12691/37963 [31:14:01<77:16:52, 11.01s/it]
 33%|███▎      | 12692/37963 [31:14:16<85:05:26, 12.12s/it]
 33%|███▎      | 12693/37963 [31:14:30<90:50:22, 12.94s/it]
 33%|███▎      | 12694/37963 [31:14:38<79:54:56, 11.39s/it]
 33%|███▎      | 12695/37963 [31:14:46<72:09:54, 10.28s/it]
 33%|███▎      | 12696/37963 [31:14:54<66:57:13,  9.54s/it]
 33%|███▎      | 12697/37963 [31:15:01<62:47:56,  8.95s/it]
 33%|███▎      | 12698/37963 [31:15:09<59:15:06,  8.44s/it]
 33%|███▎      | 12699/37963 [31:15:16<57:43:11,  8.22s/it]
 33%|███▎      | 12700/37963 [31:15:24<56:41:16,  8.08s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '2.26', 'learning_rate': '1.552e-05', 'epoch': '0.3345'}
+
 33%|███▎      | 12700/37963 [31:15:24<56:41:16,  8.08s/it]
 33%|███▎      | 12701/37963 [31:15:32<55:51:23,  7.96s/it]
 33%|███▎      | 12702/37963 [31:15:39<55:12:03,  7.87s/it]
 33%|███▎      | 12703/37963 [31:15:47<54:51:01,  7.82s/it]
 33%|███▎      | 12704/37963 [31:15:55<54:32:46,  7.77s/it]
 33%|███▎      | 12705/37963 [31:16:09<67:45:29,  9.66s/it]
 33%|███▎      | 12706/37963 [31:16:16<63:21:16,  9.03s/it]
 33%|███▎      | 12707/37963 [31:16:24<60:36:15,  8.64s/it]
 33%|███▎      | 12708/37963 [31:16:32<58:56:24,  8.40s/it]
 33%|███▎      | 12709/37963 [31:16:40<57:20:37,  8.17s/it]
 33%|███▎      | 12710/37963 [31:16:47<56:25:07,  8.04s/it]
                                                           
{'loss': '0.162', 'grad_norm': '1.512', 'learning_rate': '1.551e-05', 'epoch': '0.3348'}
+
 33%|███▎      | 12710/37963 [31:16:47<56:25:07,  8.04s/it]
 33%|███▎      | 12711/37963 [31:16:55<55:51:30,  7.96s/it]
 33%|███▎      | 12712/37963 [31:17:03<55:11:39,  7.87s/it]
 33%|███▎      | 12713/37963 [31:17:10<54:58:52,  7.84s/it]
 33%|███▎      | 12714/37963 [31:17:25<68:17:38,  9.74s/it]
 33%|███▎      | 12715/37963 [31:17:33<64:27:46,  9.19s/it]
 33%|███▎      | 12716/37963 [31:17:40<61:12:38,  8.73s/it]
 33%|███▎      | 12717/37963 [31:17:48<58:59:20,  8.41s/it]
 34%|███▎      | 12718/37963 [31:17:55<57:08:14,  8.15s/it]
 34%|███▎      | 12719/37963 [31:18:03<56:25:48,  8.05s/it]
 34%|███▎      | 12720/37963 [31:18:11<55:32:33,  7.92s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '2.497', 'learning_rate': '1.55e-05', 'epoch': '0.3351'}
+
 34%|███▎      | 12720/37963 [31:18:11<55:32:33,  7.92s/it]
 34%|███▎      | 12721/37963 [31:18:18<54:34:21,  7.78s/it]
 34%|███▎      | 12722/37963 [31:18:26<54:18:50,  7.75s/it]
 34%|███▎      | 12723/37963 [31:18:34<54:20:09,  7.75s/it]
 34%|███▎      | 12724/37963 [31:18:41<53:59:31,  7.70s/it]
 34%|███▎      | 12725/37963 [31:18:49<54:05:56,  7.72s/it]
 34%|███▎      | 12726/37963 [31:18:56<53:29:52,  7.63s/it]
 34%|███▎      | 12727/37963 [31:19:11<67:02:10,  9.56s/it]
 34%|███▎      | 12728/37963 [31:19:18<63:28:51,  9.06s/it]
 34%|███▎      | 12729/37963 [31:19:26<60:18:37,  8.60s/it]
 34%|███▎      | 12730/37963 [31:19:34<58:20:40,  8.32s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '1.673', 'learning_rate': '1.55e-05', 'epoch': '0.3353'}
+
 34%|███▎      | 12730/37963 [31:19:34<58:20:40,  8.32s/it]
 34%|███▎      | 12731/37963 [31:19:41<56:51:10,  8.11s/it]
 34%|███▎      | 12732/37963 [31:19:49<55:58:22,  7.99s/it]
 34%|███▎      | 12733/37963 [31:19:57<55:15:55,  7.89s/it]
 34%|███▎      | 12734/37963 [31:20:04<54:53:05,  7.83s/it]
 34%|███▎      | 12735/37963 [31:20:12<54:20:43,  7.75s/it]
 34%|███▎      | 12736/37963 [31:20:26<67:35:30,  9.65s/it]
 34%|███▎      | 12737/37963 [31:20:34<63:23:13,  9.05s/it]
 34%|███▎      | 12738/37963 [31:20:41<59:27:03,  8.48s/it]
 34%|███▎      | 12739/37963 [31:20:48<56:58:20,  8.13s/it]
 34%|███▎      | 12740/37963 [31:21:03<71:02:17, 10.14s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '1.211', 'learning_rate': '1.549e-05', 'epoch': '0.3356'}
+
 34%|███▎      | 12740/37963 [31:21:03<71:02:17, 10.14s/it]
 34%|███▎      | 12741/37963 [31:21:11<65:44:09,  9.38s/it]
 34%|███▎      | 12742/37963 [31:21:25<76:37:08, 10.94s/it]
 34%|███▎      | 12743/37963 [31:21:40<85:05:18, 12.15s/it]
 34%|███▎      | 12744/37963 [31:21:55<91:49:20, 13.11s/it]
 34%|███▎      | 12745/37963 [31:22:03<80:17:32, 11.46s/it]
 34%|███▎      | 12746/37963 [31:22:11<72:16:40, 10.32s/it]
 34%|███▎      | 12747/37963 [31:22:18<66:47:35,  9.54s/it]
 34%|███▎      | 12748/37963 [31:22:26<62:47:13,  8.96s/it]
 34%|███▎      | 12749/37963 [31:22:34<60:05:49,  8.58s/it]
 34%|███▎      | 12750/37963 [31:22:41<58:13:21,  8.31s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '3.298', 'learning_rate': '1.548e-05', 'epoch': '0.3359'}
+
 34%|███▎      | 12750/37963 [31:22:41<58:13:21,  8.31s/it]
 34%|███▎      | 12751/37963 [31:22:49<56:57:24,  8.13s/it]
 34%|███▎      | 12752/37963 [31:22:57<55:34:30,  7.94s/it]
 34%|███▎      | 12753/37963 [31:23:04<54:40:41,  7.81s/it]
 34%|███▎      | 12754/37963 [31:23:12<54:19:17,  7.76s/it]
 34%|███▎      | 12755/37963 [31:23:19<54:15:19,  7.75s/it]
 34%|███▎      | 12756/37963 [31:23:33<67:21:51,  9.62s/it]
 34%|███▎      | 12757/37963 [31:23:41<63:21:35,  9.05s/it]
 34%|███▎      | 12758/37963 [31:23:49<60:42:57,  8.67s/it]
 34%|███▎      | 12759/37963 [31:23:57<58:33:14,  8.36s/it]
 34%|███▎      | 12760/37963 [31:24:04<57:09:08,  8.16s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '2.306', 'learning_rate': '1.548e-05', 'epoch': '0.3361'}
+
 34%|███▎      | 12760/37963 [31:24:04<57:09:08,  8.16s/it]
 34%|███▎      | 12761/37963 [31:24:12<56:28:55,  8.07s/it]
 34%|███▎      | 12762/37963 [31:24:20<55:32:24,  7.93s/it]
 34%|███▎      | 12763/37963 [31:24:27<54:58:56,  7.85s/it]
 34%|███▎      | 12764/37963 [31:24:35<54:36:17,  7.80s/it]
 34%|███▎      | 12765/37963 [31:24:43<54:17:48,  7.76s/it]
 34%|███▎      | 12766/37963 [31:24:50<54:03:52,  7.72s/it]
 34%|███▎      | 12767/37963 [31:24:58<53:29:41,  7.64s/it]
 34%|███▎      | 12768/37963 [31:25:12<67:47:14,  9.69s/it]
 34%|███▎      | 12769/37963 [31:25:20<63:20:17,  9.05s/it]
 34%|███▎      | 12770/37963 [31:25:34<73:48:40, 10.55s/it]
                                                           
{'loss': '0.1795', 'grad_norm': '3.453', 'learning_rate': '1.547e-05', 'epoch': '0.3364'}
+
 34%|███▎      | 12770/37963 [31:25:34<73:48:40, 10.55s/it]
 34%|███▎      | 12771/37963 [31:25:42<67:48:39,  9.69s/it]
 34%|███▎      | 12772/37963 [31:25:49<63:20:34,  9.05s/it]
 34%|███▎      | 12773/37963 [31:25:57<60:25:02,  8.63s/it]
 34%|███▎      | 12774/37963 [31:26:04<58:15:52,  8.33s/it]
 34%|███▎      | 12775/37963 [31:26:12<56:56:13,  8.14s/it]
 34%|███▎      | 12776/37963 [31:26:20<56:17:28,  8.05s/it]
 34%|███▎      | 12777/37963 [31:26:28<55:28:58,  7.93s/it]
 34%|███▎      | 12778/37963 [31:26:35<54:51:29,  7.84s/it]
 34%|███▎      | 12779/37963 [31:26:43<53:47:13,  7.69s/it]
 34%|███▎      | 12780/37963 [31:26:50<53:47:39,  7.69s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '3.353', 'learning_rate': '1.546e-05', 'epoch': '0.3366'}
+
 34%|███▎      | 12780/37963 [31:26:50<53:47:39,  7.69s/it]
 34%|███▎      | 12781/37963 [31:26:58<53:16:40,  7.62s/it]
 34%|███▎      | 12782/37963 [31:27:05<53:21:44,  7.63s/it]
 34%|███▎      | 12783/37963 [31:27:13<53:31:04,  7.65s/it]
 34%|███▎      | 12784/37963 [31:27:21<53:41:21,  7.68s/it]
 34%|███▎      | 12785/37963 [31:27:29<53:53:41,  7.71s/it]
 34%|███▎      | 12786/37963 [31:27:36<53:25:12,  7.64s/it]
 34%|███▎      | 12787/37963 [31:28:04<96:42:53, 13.83s/it]
 34%|███▎      | 12788/37963 [31:28:19<97:41:56, 13.97s/it]
 34%|███▎      | 12789/37963 [31:28:26<84:34:04, 12.09s/it]
 34%|███▎      | 12790/37963 [31:28:34<75:27:24, 10.79s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '2.773', 'learning_rate': '1.545e-05', 'epoch': '0.3369'}
+
 34%|███▎      | 12790/37963 [31:28:34<75:27:24, 10.79s/it]
 34%|███▎      | 12791/37963 [31:28:42<68:50:26,  9.85s/it]
 34%|███▎      | 12792/37963 [31:28:50<64:26:35,  9.22s/it]
 34%|███▎      | 12793/37963 [31:28:57<61:04:18,  8.73s/it]
 34%|███▎      | 12794/37963 [31:29:11<72:00:25, 10.30s/it]
 34%|███▎      | 12795/37963 [31:29:19<66:43:52,  9.55s/it]
 34%|███▎      | 12796/37963 [31:29:26<62:40:23,  8.97s/it]
 34%|███▎      | 12797/37963 [31:29:34<60:01:02,  8.59s/it]
 34%|███▎      | 12798/37963 [31:29:42<57:50:02,  8.27s/it]
 34%|███▎      | 12799/37963 [31:29:49<56:25:57,  8.07s/it]
 34%|███▎      | 12800/37963 [31:29:57<55:39:06,  7.96s/it]
                                                           
{'loss': '0.1727', 'grad_norm': '2.273', 'learning_rate': '1.545e-05', 'epoch': '0.3372'}
+
 34%|███▎      | 12800/37963 [31:29:57<55:39:06,  7.96s/it]
 34%|███▎      | 12801/37963 [31:30:05<54:43:10,  7.83s/it]
 34%|███▎      | 12802/37963 [31:30:12<54:18:04,  7.77s/it]
 34%|███▎      | 12803/37963 [31:30:20<53:29:03,  7.65s/it]
 34%|███▎      | 12804/37963 [31:30:27<53:26:25,  7.65s/it]
 34%|███▎      | 12805/37963 [31:30:35<53:09:33,  7.61s/it]
 34%|███▎      | 12806/37963 [31:30:49<67:27:23,  9.65s/it]
 34%|███▎      | 12807/37963 [31:30:57<63:11:22,  9.04s/it]
 34%|███▎      | 12808/37963 [31:31:04<60:12:41,  8.62s/it]
 34%|███▎      | 12809/37963 [31:31:12<58:01:01,  8.30s/it]
 34%|███▎      | 12810/37963 [31:31:20<56:46:45,  8.13s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '2.3', 'learning_rate': '1.544e-05', 'epoch': '0.3374'}
+
 34%|███▎      | 12810/37963 [31:31:20<56:46:45,  8.13s/it]
 34%|███▎      | 12811/37963 [31:31:27<55:53:13,  8.00s/it]
 34%|███▎      | 12812/37963 [31:31:35<55:10:41,  7.90s/it]
 34%|███▍      | 12813/37963 [31:31:43<54:39:28,  7.82s/it]
 34%|███▍      | 12814/37963 [31:31:50<54:34:09,  7.81s/it]
 34%|███▍      | 12815/37963 [31:31:58<54:19:22,  7.78s/it]
 34%|███▍      | 12816/37963 [31:32:06<54:00:57,  7.73s/it]
 34%|███▍      | 12817/37963 [31:32:13<53:55:14,  7.72s/it]
 34%|███▍      | 12818/37963 [31:32:21<54:12:06,  7.76s/it]
 34%|███▍      | 12819/37963 [31:32:35<67:27:13,  9.66s/it]
 34%|███▍      | 12820/37963 [31:32:43<63:25:44,  9.08s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '1.049', 'learning_rate': '1.543e-05', 'epoch': '0.3377'}
+
 34%|███▍      | 12820/37963 [31:32:43<63:25:44,  9.08s/it]
 34%|███▍      | 12821/37963 [31:32:51<60:10:45,  8.62s/it]
 34%|███▍      | 12822/37963 [31:33:05<71:25:17, 10.23s/it]
 34%|███▍      | 12823/37963 [31:33:12<66:03:16,  9.46s/it]
 34%|███▍      | 12824/37963 [31:33:20<62:07:11,  8.90s/it]
 34%|███▍      | 12825/37963 [31:33:28<59:30:14,  8.52s/it]
 34%|███▍      | 12826/37963 [31:33:35<57:49:12,  8.28s/it]
 34%|███▍      | 12827/37963 [31:33:43<56:38:51,  8.11s/it]
 34%|███▍      | 12828/37963 [31:33:51<55:28:01,  7.94s/it]
 34%|███▍      | 12829/37963 [31:33:58<54:52:31,  7.86s/it]
 34%|███▍      | 12830/37963 [31:34:06<53:46:23,  7.70s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '2.597', 'learning_rate': '1.543e-05', 'epoch': '0.338'}
+
 34%|███▍      | 12830/37963 [31:34:06<53:46:23,  7.70s/it]
 34%|███▍      | 12831/37963 [31:34:13<53:13:10,  7.62s/it]
 34%|███▍      | 12832/37963 [31:34:21<53:27:01,  7.66s/it]
 34%|███▍      | 12833/37963 [31:34:28<53:19:41,  7.64s/it]
 34%|███▍      | 12834/37963 [31:34:36<52:48:54,  7.57s/it]
 34%|███▍      | 12835/37963 [31:34:51<68:00:55,  9.74s/it]
 34%|███▍      | 12836/37963 [31:35:05<78:35:24, 11.26s/it]
 34%|███▍      | 12837/37963 [31:35:13<70:37:33, 10.12s/it]
 34%|███▍      | 12838/37963 [31:35:20<64:50:08,  9.29s/it]
 34%|███▍      | 12839/37963 [31:35:28<60:56:24,  8.73s/it]
 34%|███▍      | 12840/37963 [31:35:41<71:35:40, 10.26s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '1.308', 'learning_rate': '1.542e-05', 'epoch': '0.3382'}
+
 34%|███▍      | 12840/37963 [31:35:41<71:35:40, 10.26s/it]
 34%|███▍      | 12841/37963 [31:35:49<66:24:38,  9.52s/it]
 34%|███▍      | 12842/37963 [31:36:04<76:30:40, 10.96s/it]
 34%|███▍      | 12843/37963 [31:36:18<84:42:59, 12.14s/it]
 34%|███▍      | 12844/37963 [31:36:26<75:38:25, 10.84s/it]
 34%|███▍      | 12845/37963 [31:36:34<68:59:18,  9.89s/it]
 34%|███▍      | 12846/37963 [31:36:41<63:58:11,  9.17s/it]
 34%|███▍      | 12847/37963 [31:36:49<61:10:26,  8.77s/it]
 34%|███▍      | 12848/37963 [31:36:57<58:41:46,  8.41s/it]
 34%|███▍      | 12849/37963 [31:37:04<57:02:36,  8.18s/it]
 34%|███▍      | 12850/37963 [31:37:12<55:38:18,  7.98s/it]
                                                           
{'loss': '0.153', 'grad_norm': '2.612', 'learning_rate': '1.541e-05', 'epoch': '0.3385'}
+
 34%|███▍      | 12850/37963 [31:37:12<55:38:18,  7.98s/it]
 34%|███▍      | 12851/37963 [31:37:20<55:00:43,  7.89s/it]
 34%|███▍      | 12852/37963 [31:37:27<54:28:17,  7.81s/it]
 34%|███▍      | 12853/37963 [31:37:35<54:01:43,  7.75s/it]
 34%|███▍      | 12854/37963 [31:37:43<53:51:56,  7.72s/it]
 34%|███▍      | 12855/37963 [31:37:57<67:57:00,  9.74s/it]
 34%|███▍      | 12856/37963 [31:38:05<63:22:05,  9.09s/it]
 34%|███▍      | 12857/37963 [31:38:12<60:34:59,  8.69s/it]
 34%|███▍      | 12858/37963 [31:38:20<58:43:18,  8.42s/it]
 34%|███▍      | 12859/37963 [31:38:28<57:16:51,  8.21s/it]
 34%|███▍      | 12860/37963 [31:38:35<56:08:19,  8.05s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '1.929', 'learning_rate': '1.54e-05', 'epoch': '0.3388'}
+
 34%|███▍      | 12860/37963 [31:38:35<56:08:19,  8.05s/it]
 34%|███▍      | 12861/37963 [31:38:43<55:14:42,  7.92s/it]
 34%|███▍      | 12862/37963 [31:38:51<54:48:28,  7.86s/it]
 34%|███▍      | 12863/37963 [31:38:58<54:26:42,  7.81s/it]
 34%|███▍      | 12864/37963 [31:39:06<54:12:18,  7.77s/it]
 34%|███▍      | 12865/37963 [31:39:14<53:59:43,  7.74s/it]
 34%|███▍      | 12866/37963 [31:39:28<67:23:17,  9.67s/it]
 34%|███▍      | 12867/37963 [31:39:43<77:29:34, 11.12s/it]
 34%|███▍      | 12868/37963 [31:39:50<69:35:47,  9.98s/it]
 34%|███▍      | 12869/37963 [31:39:58<64:41:46,  9.28s/it]
 34%|███▍      | 12870/37963 [31:40:05<61:27:32,  8.82s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '2.173', 'learning_rate': '1.54e-05', 'epoch': '0.339'}
+
 34%|███▍      | 12870/37963 [31:40:05<61:27:32,  8.82s/it]
 34%|███▍      | 12871/37963 [31:40:13<58:48:43,  8.44s/it]
 34%|███▍      | 12872/37963 [31:40:21<57:20:52,  8.23s/it]
 34%|███▍      | 12873/37963 [31:40:28<56:10:26,  8.06s/it]
 34%|███▍      | 12874/37963 [31:40:36<55:17:15,  7.93s/it]
 34%|███▍      | 12875/37963 [31:40:44<55:10:50,  7.92s/it]
 34%|███▍      | 12876/37963 [31:40:51<54:46:21,  7.86s/it]
 34%|███▍      | 12877/37963 [31:40:59<54:13:08,  7.78s/it]
 34%|███▍      | 12878/37963 [31:41:07<54:11:15,  7.78s/it]
 34%|███▍      | 12879/37963 [31:41:14<53:59:06,  7.75s/it]
 34%|███▍      | 12880/37963 [31:41:22<53:20:09,  7.65s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '1.449', 'learning_rate': '1.539e-05', 'epoch': '0.3393'}
+
 34%|███▍      | 12880/37963 [31:41:22<53:20:09,  7.65s/it]
 34%|███▍      | 12881/37963 [31:41:30<53:18:23,  7.65s/it]
 34%|███▍      | 12882/37963 [31:41:37<52:51:14,  7.59s/it]
 34%|███▍      | 12883/37963 [31:41:45<52:55:38,  7.60s/it]
 34%|███▍      | 12884/37963 [31:41:59<67:49:22,  9.74s/it]
 34%|███▍      | 12885/37963 [31:42:07<63:52:30,  9.17s/it]
 34%|███▍      | 12886/37963 [31:42:21<73:52:16, 10.60s/it]
 34%|███▍      | 12887/37963 [31:42:29<67:48:59,  9.74s/it]
 34%|███▍      | 12888/37963 [31:42:44<78:05:30, 11.21s/it]
 34%|███▍      | 12889/37963 [31:42:51<70:36:23, 10.14s/it]
 34%|███▍      | 12890/37963 [31:42:59<65:31:45,  9.41s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '1.038', 'learning_rate': '1.538e-05', 'epoch': '0.3395'}
+
 34%|███▍      | 12890/37963 [31:42:59<65:31:45,  9.41s/it]
 34%|███▍      | 12891/37963 [31:43:14<77:03:12, 11.06s/it]
 34%|███▍      | 12892/37963 [31:43:22<70:10:53, 10.08s/it]
 34%|███▍      | 12893/37963 [31:43:29<65:04:13,  9.34s/it]
 34%|███▍      | 12894/37963 [31:43:44<76:06:54, 10.93s/it]
 34%|███▍      | 12895/37963 [31:43:52<69:34:33,  9.99s/it]
 34%|███▍      | 12896/37963 [31:43:59<64:34:22,  9.27s/it]
 34%|███▍      | 12897/37963 [31:44:07<61:15:49,  8.80s/it]
 34%|███▍      | 12898/37963 [31:44:14<58:28:43,  8.40s/it]
 34%|███▍      | 12899/37963 [31:44:22<57:02:00,  8.19s/it]
 34%|███▍      | 12900/37963 [31:44:30<55:51:05,  8.02s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '1.847', 'learning_rate': '1.538e-05', 'epoch': '0.3398'}
+
 34%|███▍      | 12900/37963 [31:44:30<55:51:05,  8.02s/it]
 34%|███▍      | 12901/37963 [31:44:37<55:01:11,  7.90s/it]
 34%|███▍      | 12902/37963 [31:44:45<54:32:57,  7.84s/it]
 34%|███▍      | 12903/37963 [31:44:53<54:15:21,  7.79s/it]
 34%|███▍      | 12904/37963 [31:45:00<53:53:14,  7.74s/it]
 34%|███▍      | 12905/37963 [31:45:08<53:41:43,  7.71s/it]
 34%|███▍      | 12906/37963 [31:45:22<66:58:38,  9.62s/it]
 34%|███▍      | 12907/37963 [31:45:30<62:48:11,  9.02s/it]
 34%|███▍      | 12908/37963 [31:45:37<59:50:16,  8.60s/it]
 34%|███▍      | 12909/37963 [31:45:45<57:59:49,  8.33s/it]
 34%|███▍      | 12910/37963 [31:45:53<56:38:07,  8.14s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '3.777', 'learning_rate': '1.537e-05', 'epoch': '0.3401'}
+
 34%|███▍      | 12910/37963 [31:45:53<56:38:07,  8.14s/it]
 34%|███▍      | 12911/37963 [31:46:01<55:59:12,  8.05s/it]
 34%|███▍      | 12912/37963 [31:46:08<55:42:52,  8.01s/it]
 34%|███▍      | 12913/37963 [31:46:16<55:06:08,  7.92s/it]
 34%|███▍      | 12914/37963 [31:46:31<68:41:21,  9.87s/it]
 34%|███▍      | 12915/37963 [31:46:45<78:05:48, 11.22s/it]
 34%|███▍      | 12916/37963 [31:46:53<71:07:14, 10.22s/it]
 34%|███▍      | 12917/37963 [31:47:00<65:45:03,  9.45s/it]
 34%|███▍      | 12918/37963 [31:47:08<61:59:06,  8.91s/it]
 34%|███▍      | 12919/37963 [31:47:16<59:10:57,  8.51s/it]
 34%|███▍      | 12920/37963 [31:47:23<57:05:52,  8.21s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '2.989', 'learning_rate': '1.536e-05', 'epoch': '0.3403'}
+
 34%|███▍      | 12920/37963 [31:47:23<57:05:52,  8.21s/it]
 34%|███▍      | 12921/37963 [31:47:31<55:57:03,  8.04s/it]
 34%|███▍      | 12922/37963 [31:47:39<55:07:55,  7.93s/it]
 34%|███▍      | 12923/37963 [31:47:46<54:45:38,  7.87s/it]
 34%|███▍      | 12924/37963 [31:47:54<53:50:28,  7.74s/it]
 34%|███▍      | 12925/37963 [31:48:01<53:35:19,  7.71s/it]
 34%|███▍      | 12926/37963 [31:48:09<53:23:29,  7.68s/it]
 34%|███▍      | 12927/37963 [31:48:17<53:21:13,  7.67s/it]
 34%|███▍      | 12928/37963 [31:48:24<53:13:29,  7.65s/it]
 34%|███▍      | 12929/37963 [31:48:32<52:54:44,  7.61s/it]
 34%|███▍      | 12930/37963 [31:48:39<52:41:43,  7.58s/it]
                                                           
{'loss': '0.161', 'grad_norm': '1.155', 'learning_rate': '1.535e-05', 'epoch': '0.3406'}
+
 34%|███▍      | 12930/37963 [31:48:39<52:41:43,  7.58s/it]
 34%|███▍      | 12931/37963 [31:48:47<52:35:37,  7.56s/it]
 34%|███▍      | 12932/37963 [31:49:08<81:34:42, 11.73s/it]
 34%|███▍      | 12933/37963 [31:49:16<72:41:27, 10.45s/it]
 34%|███▍      | 12934/37963 [31:49:31<82:13:06, 11.83s/it]
 34%|███▍      | 12935/37963 [31:49:38<73:16:07, 10.54s/it]
 34%|███▍      | 12936/37963 [31:49:46<67:04:44,  9.65s/it]
 34%|███▍      | 12937/37963 [31:49:54<63:10:28,  9.09s/it]
 34%|███▍      | 12938/37963 [31:50:01<60:03:52,  8.64s/it]
 34%|███▍      | 12939/37963 [31:50:09<57:56:04,  8.33s/it]
 34%|███▍      | 12940/37963 [31:50:16<56:24:52,  8.12s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '4.062', 'learning_rate': '1.535e-05', 'epoch': '0.3409'}
+
 34%|███▍      | 12940/37963 [31:50:16<56:24:52,  8.12s/it]
 34%|███▍      | 12941/37963 [31:50:24<55:26:21,  7.98s/it]
 34%|███▍      | 12942/37963 [31:50:32<54:54:19,  7.90s/it]
 34%|███▍      | 12943/37963 [31:50:47<69:25:24,  9.99s/it]
 34%|███▍      | 12944/37963 [31:50:54<64:37:13,  9.30s/it]
 34%|███▍      | 12945/37963 [31:51:02<61:26:06,  8.84s/it]
 34%|███▍      | 12946/37963 [31:51:17<73:41:40, 10.60s/it]
 34%|███▍      | 12947/37963 [31:51:24<67:33:18,  9.72s/it]
 34%|███▍      | 12948/37963 [31:51:32<62:37:25,  9.01s/it]
 34%|███▍      | 12949/37963 [31:51:39<59:39:53,  8.59s/it]
 34%|███▍      | 12950/37963 [31:51:47<57:46:56,  8.32s/it]
                                                           
{'loss': '0.1511', 'grad_norm': '4.208', 'learning_rate': '1.534e-05', 'epoch': '0.3411'}
+
 34%|███▍      | 12950/37963 [31:51:47<57:46:56,  8.32s/it]
 34%|███▍      | 12951/37963 [31:51:55<55:57:32,  8.05s/it]
 34%|███▍      | 12952/37963 [31:52:02<54:14:11,  7.81s/it]
 34%|███▍      | 12953/37963 [31:52:09<53:47:35,  7.74s/it]
 34%|███▍      | 12954/37963 [31:52:24<67:07:00,  9.66s/it]
 34%|███▍      | 12955/37963 [31:52:31<62:50:20,  9.05s/it]
 34%|███▍      | 12956/37963 [31:52:39<60:25:05,  8.70s/it]
 34%|███▍      | 12957/37963 [31:52:47<58:05:49,  8.36s/it]
 34%|███▍      | 12958/37963 [31:52:54<56:33:12,  8.14s/it]
 34%|███▍      | 12959/37963 [31:53:08<68:15:49,  9.83s/it]
 34%|███▍      | 12960/37963 [31:53:16<64:02:19,  9.22s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '0.9811', 'learning_rate': '1.533e-05', 'epoch': '0.3414'}
+
 34%|███▍      | 12960/37963 [31:53:16<64:02:19,  9.22s/it]
 34%|███▍      | 12961/37963 [31:53:23<60:44:01,  8.74s/it]
 34%|███▍      | 12962/37963 [31:53:31<59:09:30,  8.52s/it]
 34%|███▍      | 12963/37963 [31:53:39<57:20:08,  8.26s/it]
 34%|███▍      | 12964/37963 [31:53:47<56:21:23,  8.12s/it]
 34%|███▍      | 12965/37963 [31:53:54<55:03:13,  7.93s/it]
 34%|███▍      | 12966/37963 [31:54:08<67:28:45,  9.72s/it]
 34%|███▍      | 12967/37963 [31:54:16<63:29:13,  9.14s/it]
 34%|███▍      | 12968/37963 [31:54:24<60:09:00,  8.66s/it]
 34%|███▍      | 12969/37963 [31:54:31<57:46:19,  8.32s/it]
 34%|███▍      | 12970/37963 [31:54:39<56:20:44,  8.12s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '1.655', 'learning_rate': '1.532e-05', 'epoch': '0.3416'}
+
 34%|███▍      | 12970/37963 [31:54:39<56:20:44,  8.12s/it]
 34%|███▍      | 12971/37963 [31:54:46<55:27:11,  7.99s/it]
 34%|███▍      | 12972/37963 [31:54:54<54:57:11,  7.92s/it]
 34%|███▍      | 12973/37963 [31:55:02<54:40:18,  7.88s/it]
 34%|███▍      | 12974/37963 [31:55:10<54:08:55,  7.80s/it]
 34%|███▍      | 12975/37963 [31:55:17<53:59:24,  7.78s/it]
 34%|███▍      | 12976/37963 [31:55:25<53:45:52,  7.75s/it]
 34%|███▍      | 12977/37963 [31:55:33<53:29:47,  7.71s/it]
 34%|███▍      | 12978/37963 [31:55:47<68:03:23,  9.81s/it]
 34%|███▍      | 12979/37963 [31:55:55<64:15:12,  9.26s/it]
 34%|███▍      | 12980/37963 [31:56:03<60:53:35,  8.77s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '3.148', 'learning_rate': '1.532e-05', 'epoch': '0.3419'}
+
 34%|███▍      | 12980/37963 [31:56:03<60:53:35,  8.77s/it]
 34%|███▍      | 12981/37963 [31:56:11<58:24:52,  8.42s/it]
 34%|███▍      | 12982/37963 [31:56:25<71:32:06, 10.31s/it]
 34%|███▍      | 12983/37963 [31:56:39<79:19:38, 11.43s/it]
 34%|███▍      | 12984/37963 [31:56:47<72:04:01, 10.39s/it]
 34%|███▍      | 12985/37963 [31:56:55<66:17:59,  9.56s/it]
 34%|███▍      | 12986/37963 [31:57:02<62:15:32,  8.97s/it]
 34%|███▍      | 12987/37963 [31:57:10<59:34:07,  8.59s/it]
 34%|███▍      | 12988/37963 [31:57:25<72:31:31, 10.45s/it]
 34%|███▍      | 12989/37963 [31:57:33<66:30:02,  9.59s/it]
 34%|███▍      | 12990/37963 [31:57:40<62:01:56,  8.94s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '1.578', 'learning_rate': '1.531e-05', 'epoch': '0.3422'}
+
 34%|███▍      | 12990/37963 [31:57:40<62:01:56,  8.94s/it]
 34%|███▍      | 12991/37963 [31:57:48<59:23:19,  8.56s/it]
 34%|███▍      | 12992/37963 [31:58:02<72:18:18, 10.42s/it]
 34%|███▍      | 12993/37963 [31:58:10<66:15:37,  9.55s/it]
 34%|███▍      | 12994/37963 [31:58:17<61:58:24,  8.94s/it]
 34%|███▍      | 12995/37963 [31:58:25<59:07:27,  8.52s/it]
 34%|███▍      | 12996/37963 [31:58:33<57:15:41,  8.26s/it]
 34%|███▍      | 12997/37963 [31:58:40<55:52:58,  8.06s/it]
 34%|███▍      | 12998/37963 [31:58:55<69:28:34, 10.02s/it]
 34%|███▍      | 12999/37963 [31:59:02<64:30:36,  9.30s/it]
 34%|███▍      | 13000/37963 [31:59:10<61:05:29,  8.81s/it]
                                                           
{'loss': '0.1638', 'grad_norm': '2.134', 'learning_rate': '1.53e-05', 'epoch': '0.3424'}
+
 34%|███▍      | 13000/37963 [31:59:10<61:05:29,  8.81s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.53s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.54s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 34%|███▍      | 13001/37963 [32:00:05<156:40:23, 22.60s/it]
 34%|███▍      | 13002/37963 [32:00:13<125:47:01, 18.14s/it]
 34%|███▍      | 13003/37963 [32:00:20<103:51:07, 14.98s/it]
 34%|███▍      | 13004/37963 [32:00:35<102:57:01, 14.85s/it]
 34%|███▍      | 13005/37963 [32:00:42<88:03:14, 12.70s/it] 
 34%|███▍      | 13006/37963 [32:00:50<77:54:05, 11.24s/it]
 34%|███▍      | 13007/37963 [32:00:58<70:24:24, 10.16s/it]
 34%|███▍      | 13008/37963 [32:01:05<64:43:23,  9.34s/it]
 34%|███▍      | 13009/37963 [32:01:13<61:07:01,  8.82s/it]
 34%|███▍      | 13010/37963 [32:01:21<58:42:00,  8.47s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '3.507', 'learning_rate': '1.53e-05', 'epoch': '0.3427'}
+
 34%|███▍      | 13010/37963 [32:01:21<58:42:00,  8.47s/it]
 34%|███▍      | 13011/37963 [32:01:28<56:53:56,  8.21s/it]
 34%|███▍      | 13012/37963 [32:01:36<55:03:30,  7.94s/it]
 34%|███▍      | 13013/37963 [32:01:43<54:00:11,  7.79s/it]
 34%|███▍      | 13014/37963 [32:01:51<53:45:38,  7.76s/it]
 34%|███▍      | 13015/37963 [32:01:58<53:41:50,  7.75s/it]
 34%|███▍      | 13016/37963 [32:02:06<53:25:44,  7.71s/it]
 34%|███▍      | 13017/37963 [32:02:14<53:30:00,  7.72s/it]
 34%|███▍      | 13018/37963 [32:02:28<67:07:17,  9.69s/it]
 34%|███▍      | 13019/37963 [32:02:36<63:03:31,  9.10s/it]
 34%|███▍      | 13020/37963 [32:02:43<60:09:38,  8.68s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '2.401', 'learning_rate': '1.529e-05', 'epoch': '0.343'}
+
 34%|███▍      | 13020/37963 [32:02:43<60:09:38,  8.68s/it]
 34%|███▍      | 13021/37963 [32:02:51<58:04:26,  8.38s/it]
 34%|███▍      | 13022/37963 [32:02:59<56:26:20,  8.15s/it]
 34%|███▍      | 13023/37963 [32:03:06<55:23:05,  7.99s/it]
 34%|███▍      | 13024/37963 [32:03:14<54:43:45,  7.90s/it]
 34%|███▍      | 13025/37963 [32:03:22<54:11:23,  7.82s/it]
 34%|███▍      | 13026/37963 [32:03:29<53:16:04,  7.69s/it]
 34%|███▍      | 13027/37963 [32:03:36<52:41:10,  7.61s/it]
 34%|███▍      | 13028/37963 [32:03:44<52:17:32,  7.55s/it]
 34%|███▍      | 13029/37963 [32:03:58<66:32:12,  9.61s/it]
 34%|███▍      | 13030/37963 [32:04:06<62:54:15,  9.08s/it]
                                                           
{'loss': '0.1819', 'grad_norm': '3.004', 'learning_rate': '1.528e-05', 'epoch': '0.3432'}
+
 34%|███▍      | 13030/37963 [32:04:06<62:54:15,  9.08s/it]
 34%|███▍      | 13031/37963 [32:04:21<74:52:53, 10.81s/it]
 34%|███▍      | 13032/37963 [32:04:36<83:47:33, 12.10s/it]
 34%|███▍      | 13033/37963 [32:04:44<74:41:35, 10.79s/it]
 34%|███▍      | 13034/37963 [32:04:52<68:13:30,  9.85s/it]
 34%|███▍      | 13035/37963 [32:04:59<63:34:54,  9.18s/it]
 34%|███▍      | 13036/37963 [32:05:07<60:20:53,  8.72s/it]
 34%|███▍      | 13037/37963 [32:05:22<72:56:43, 10.54s/it]
 34%|███▍      | 13038/37963 [32:05:29<66:50:08,  9.65s/it]
 34%|███▍      | 13039/37963 [32:05:44<76:50:28, 11.10s/it]
 34%|███▍      | 13040/37963 [32:05:51<69:59:08, 10.11s/it]
                                                           
{'loss': '0.157', 'grad_norm': '2.275', 'learning_rate': '1.527e-05', 'epoch': '0.3435'}
+
 34%|███▍      | 13040/37963 [32:05:51<69:59:08, 10.11s/it]
 34%|███▍      | 13041/37963 [32:05:59<64:55:07,  9.38s/it]
 34%|███▍      | 13042/37963 [32:06:07<61:18:15,  8.86s/it]
 34%|███▍      | 13043/37963 [32:06:21<72:49:48, 10.52s/it]
 34%|███▍      | 13044/37963 [32:06:29<67:14:40,  9.71s/it]
 34%|███▍      | 13045/37963 [32:06:37<62:47:06,  9.07s/it]
 34%|███▍      | 13046/37963 [32:06:44<59:51:23,  8.65s/it]
 34%|███▍      | 13047/37963 [32:06:52<57:59:52,  8.38s/it]
 34%|███▍      | 13048/37963 [32:07:00<56:42:19,  8.19s/it]
 34%|███▍      | 13049/37963 [32:07:07<55:30:31,  8.02s/it]
 34%|███▍      | 13050/37963 [32:07:15<54:29:09,  7.87s/it]
                                                           
{'loss': '0.161', 'grad_norm': '4.833', 'learning_rate': '1.527e-05', 'epoch': '0.3438'}
+
 34%|███▍      | 13050/37963 [32:07:15<54:29:09,  7.87s/it]
 34%|███▍      | 13051/37963 [32:07:29<67:57:13,  9.82s/it]
 34%|███▍      | 13052/37963 [32:07:37<63:20:48,  9.15s/it]
 34%|███▍      | 13053/37963 [32:07:45<60:35:38,  8.76s/it]
 34%|███▍      | 13054/37963 [32:07:52<58:18:12,  8.43s/it]
 34%|███▍      | 13055/37963 [32:08:00<56:38:29,  8.19s/it]
 34%|███▍      | 13056/37963 [32:08:08<55:28:44,  8.02s/it]
 34%|███▍      | 13057/37963 [32:08:15<54:42:19,  7.91s/it]
 34%|███▍      | 13058/37963 [32:08:23<53:59:39,  7.80s/it]
 34%|███▍      | 13059/37963 [32:08:30<53:40:12,  7.76s/it]
 34%|███▍      | 13060/37963 [32:08:38<53:40:39,  7.76s/it]
                                                           
{'loss': '0.158', 'grad_norm': '3.287', 'learning_rate': '1.526e-05', 'epoch': '0.344'}
+
 34%|███▍      | 13060/37963 [32:08:38<53:40:39,  7.76s/it]
 34%|███▍      | 13061/37963 [32:08:46<53:24:54,  7.72s/it]
 34%|███▍      | 13062/37963 [32:09:00<66:47:47,  9.66s/it]
 34%|███▍      | 13063/37963 [32:09:08<62:51:19,  9.09s/it]
 34%|███▍      | 13064/37963 [32:09:15<59:54:43,  8.66s/it]
 34%|███▍      | 13065/37963 [32:09:23<57:40:16,  8.34s/it]
 34%|███▍      | 13066/37963 [32:09:31<56:02:08,  8.10s/it]
 34%|███▍      | 13067/37963 [32:09:38<55:14:42,  7.99s/it]
 34%|███▍      | 13068/37963 [32:09:46<54:17:20,  7.85s/it]
 34%|███▍      | 13069/37963 [32:09:54<54:00:39,  7.81s/it]
 34%|███▍      | 13070/37963 [32:10:01<53:35:17,  7.75s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '2.855', 'learning_rate': '1.525e-05', 'epoch': '0.3443'}
+
 34%|███▍      | 13070/37963 [32:10:01<53:35:17,  7.75s/it]
 34%|███▍      | 13071/37963 [32:10:09<53:40:39,  7.76s/it]
 34%|███▍      | 13072/37963 [32:10:17<53:31:51,  7.74s/it]
 34%|███▍      | 13073/37963 [32:10:24<53:06:33,  7.68s/it]
 34%|███▍      | 13074/37963 [32:10:38<66:01:10,  9.55s/it]
 34%|███▍      | 13075/37963 [32:10:46<62:22:17,  9.02s/it]
 34%|███▍      | 13076/37963 [32:10:54<59:51:34,  8.66s/it]
 34%|███▍      | 13077/37963 [32:11:01<57:44:31,  8.35s/it]
 34%|███▍      | 13078/37963 [32:11:09<55:56:17,  8.09s/it]
 34%|███▍      | 13079/37963 [32:11:24<70:37:59, 10.22s/it]
 34%|███▍      | 13080/37963 [32:11:31<64:52:55,  9.39s/it]
                                                           
{'loss': '0.1663', 'grad_norm': '2.707', 'learning_rate': '1.525e-05', 'epoch': '0.3445'}
+
 34%|███▍      | 13080/37963 [32:11:31<64:52:55,  9.39s/it]
 34%|███▍      | 13081/37963 [32:11:39<61:16:42,  8.87s/it]
 34%|███▍      | 13082/37963 [32:11:47<58:57:52,  8.53s/it]
 34%|███▍      | 13083/37963 [32:11:55<57:13:00,  8.28s/it]
 34%|███▍      | 13084/37963 [32:12:09<70:43:40, 10.23s/it]
 34%|███▍      | 13085/37963 [32:12:17<65:23:22,  9.46s/it]
 34%|███▍      | 13086/37963 [32:12:32<76:10:02, 11.02s/it]
 34%|███▍      | 13087/37963 [32:12:46<84:08:15, 12.18s/it]
 34%|███▍      | 13088/37963 [32:12:54<75:06:48, 10.87s/it]
 34%|███▍      | 13089/37963 [32:13:02<68:22:31,  9.90s/it]
 34%|███▍      | 13090/37963 [32:13:10<63:46:13,  9.23s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '0.8102', 'learning_rate': '1.524e-05', 'epoch': '0.3448'}
+
 34%|███▍      | 13090/37963 [32:13:10<63:46:13,  9.23s/it]
 34%|███▍      | 13091/37963 [32:13:17<60:34:41,  8.77s/it]
 34%|███▍      | 13092/37963 [32:13:25<58:15:25,  8.43s/it]
 34%|███▍      | 13093/37963 [32:13:32<56:14:47,  8.14s/it]
 34%|███▍      | 13094/37963 [32:13:40<55:10:00,  7.99s/it]
 34%|███▍      | 13095/37963 [32:13:54<68:01:04,  9.85s/it]
 34%|███▍      | 13096/37963 [32:14:02<63:36:01,  9.21s/it]
 34%|███▍      | 13097/37963 [32:14:10<60:18:50,  8.73s/it]
 35%|███▍      | 13098/37963 [32:14:24<71:09:30, 10.30s/it]
 35%|███▍      | 13099/37963 [32:14:31<66:09:53,  9.58s/it]
 35%|███▍      | 13100/37963 [32:14:39<62:06:42,  8.99s/it]
                                                           
{'loss': '0.156', 'grad_norm': '0.9327', 'learning_rate': '1.523e-05', 'epoch': '0.3451'}
+
 35%|███▍      | 13100/37963 [32:14:39<62:06:42,  8.99s/it]
 35%|███▍      | 13101/37963 [32:14:47<59:18:13,  8.59s/it]
 35%|███▍      | 13102/37963 [32:14:54<57:25:02,  8.31s/it]
 35%|███▍      | 13103/37963 [32:15:02<56:04:54,  8.12s/it]
 35%|███▍      | 13104/37963 [32:15:10<55:02:53,  7.97s/it]
 35%|███▍      | 13105/37963 [32:15:17<54:05:28,  7.83s/it]
 35%|███▍      | 13106/37963 [32:15:25<53:39:05,  7.77s/it]
 35%|███▍      | 13107/37963 [32:15:32<53:03:51,  7.69s/it]
 35%|███▍      | 13108/37963 [32:15:40<52:40:11,  7.63s/it]
 35%|███▍      | 13109/37963 [32:15:48<52:52:12,  7.66s/it]
 35%|███▍      | 13110/37963 [32:15:55<52:47:55,  7.65s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '2.914', 'learning_rate': '1.522e-05', 'epoch': '0.3453'}
+
 35%|███▍      | 13110/37963 [32:15:55<52:47:55,  7.65s/it]
 35%|███▍      | 13111/37963 [32:16:03<52:46:44,  7.65s/it]
 35%|███▍      | 13112/37963 [32:16:10<52:19:16,  7.58s/it]
 35%|███▍      | 13113/37963 [32:16:18<52:38:54,  7.63s/it]
 35%|███▍      | 13114/37963 [32:16:26<52:33:44,  7.61s/it]
 35%|███▍      | 13115/37963 [32:16:33<52:53:00,  7.66s/it]
 35%|███▍      | 13116/37963 [32:16:47<66:20:29,  9.61s/it]
 35%|███▍      | 13117/37963 [32:16:55<62:25:09,  9.04s/it]
 35%|███▍      | 13118/37963 [32:17:03<59:34:12,  8.63s/it]
 35%|███▍      | 13119/37963 [32:17:10<57:30:57,  8.33s/it]
 35%|███▍      | 13120/37963 [32:17:18<56:31:12,  8.19s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '3.55', 'learning_rate': '1.522e-05', 'epoch': '0.3456'}
+
 35%|███▍      | 13120/37963 [32:17:18<56:31:12,  8.19s/it]
 35%|███▍      | 13121/37963 [32:17:26<56:21:13,  8.17s/it]
 35%|███▍      | 13122/37963 [32:17:41<68:32:52,  9.93s/it]
 35%|███▍      | 13123/37963 [32:17:48<64:06:29,  9.29s/it]
 35%|███▍      | 13124/37963 [32:17:56<60:26:40,  8.76s/it]
 35%|███▍      | 13125/37963 [32:18:04<58:28:40,  8.48s/it]
 35%|███▍      | 13126/37963 [32:18:18<71:10:35, 10.32s/it]
 35%|███▍      | 13127/37963 [32:18:26<65:27:37,  9.49s/it]
 35%|███▍      | 13128/37963 [32:18:34<61:45:41,  8.95s/it]
 35%|███▍      | 13129/37963 [32:18:41<59:12:48,  8.58s/it]
 35%|███▍      | 13130/37963 [32:18:49<57:17:37,  8.31s/it]
                                                           
{'loss': '0.18', 'grad_norm': '2.369', 'learning_rate': '1.521e-05', 'epoch': '0.3459'}
+
 35%|███▍      | 13130/37963 [32:18:49<57:17:37,  8.31s/it]
 35%|███▍      | 13131/37963 [32:18:56<55:45:52,  8.08s/it]
 35%|███▍      | 13132/37963 [32:19:04<55:05:31,  7.99s/it]
 35%|███▍      | 13133/37963 [32:19:12<54:25:19,  7.89s/it]
 35%|███▍      | 13134/37963 [32:19:20<53:59:15,  7.83s/it]
 35%|███▍      | 13135/37963 [32:19:34<68:12:48,  9.89s/it]
 35%|███▍      | 13136/37963 [32:19:42<63:40:52,  9.23s/it]
 35%|███▍      | 13137/37963 [32:19:50<60:27:58,  8.77s/it]
 35%|███▍      | 13138/37963 [32:20:11<87:23:28, 12.67s/it]
 35%|███▍      | 13139/37963 [32:20:19<76:51:51, 11.15s/it]
 35%|███▍      | 13140/37963 [32:20:27<69:32:30, 10.09s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '1.517', 'learning_rate': '1.52e-05', 'epoch': '0.3461'}
+
 35%|███▍      | 13140/37963 [32:20:27<69:32:30, 10.09s/it]
 35%|███▍      | 13141/37963 [32:20:34<64:38:57,  9.38s/it]
 35%|███▍      | 13142/37963 [32:20:49<75:14:03, 10.91s/it]
 35%|███▍      | 13143/37963 [32:20:56<68:16:39,  9.90s/it]
 35%|███▍      | 13144/37963 [32:21:10<76:23:20, 11.08s/it]
 35%|███▍      | 13145/37963 [32:21:18<69:40:38, 10.11s/it]
 35%|███▍      | 13146/37963 [32:21:26<64:34:29,  9.37s/it]
 35%|███▍      | 13147/37963 [32:21:33<60:51:35,  8.83s/it]
 35%|███▍      | 13148/37963 [32:21:41<58:12:39,  8.44s/it]
 35%|███▍      | 13149/37963 [32:21:48<56:23:58,  8.18s/it]
 35%|███▍      | 13150/37963 [32:21:56<55:08:32,  8.00s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '1.754', 'learning_rate': '1.519e-05', 'epoch': '0.3464'}
+
 35%|███▍      | 13150/37963 [32:21:56<55:08:32,  8.00s/it]
 35%|███▍      | 13151/37963 [32:22:04<54:19:39,  7.88s/it]
 35%|███▍      | 13152/37963 [32:22:11<53:56:46,  7.83s/it]
 35%|███▍      | 13153/37963 [32:22:19<53:42:22,  7.79s/it]
 35%|███▍      | 13154/37963 [32:22:27<53:39:15,  7.79s/it]
 35%|███▍      | 13155/37963 [32:22:34<53:21:15,  7.74s/it]
 35%|███▍      | 13156/37963 [32:22:42<53:15:05,  7.73s/it]
 35%|███▍      | 13157/37963 [32:22:50<53:17:40,  7.73s/it]
 35%|███▍      | 13158/37963 [32:22:57<53:02:27,  7.70s/it]
 35%|███▍      | 13159/37963 [32:23:05<52:54:16,  7.68s/it]
 35%|███▍      | 13160/37963 [32:23:13<52:58:03,  7.69s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '1.509', 'learning_rate': '1.519e-05', 'epoch': '0.3467'}
+
 35%|███▍      | 13160/37963 [32:23:13<52:58:03,  7.69s/it]
 35%|███▍      | 13161/37963 [32:23:20<52:37:43,  7.64s/it]
 35%|███▍      | 13162/37963 [32:23:28<52:36:45,  7.64s/it]
 35%|███▍      | 13163/37963 [32:23:35<52:18:25,  7.59s/it]
 35%|███▍      | 13164/37963 [32:23:43<52:31:04,  7.62s/it]
 35%|███▍      | 13165/37963 [32:23:51<52:16:07,  7.59s/it]
 35%|███▍      | 13166/37963 [32:23:58<52:21:00,  7.60s/it]
 35%|███▍      | 13167/37963 [32:24:06<52:20:23,  7.60s/it]
 35%|███▍      | 13168/37963 [32:24:13<52:18:05,  7.59s/it]
 35%|███▍      | 13169/37963 [32:24:21<52:32:09,  7.63s/it]
 35%|███▍      | 13170/37963 [32:24:42<79:54:11, 11.60s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '1.654', 'learning_rate': '1.518e-05', 'epoch': '0.3469'}
+
 35%|███▍      | 13170/37963 [32:24:42<79:54:11, 11.60s/it]
 35%|███▍      | 13171/37963 [32:24:50<72:00:26, 10.46s/it]
 35%|███▍      | 13172/37963 [32:24:58<66:26:13,  9.65s/it]
 35%|███▍      | 13173/37963 [32:25:05<62:22:42,  9.06s/it]
 35%|███▍      | 13174/37963 [32:25:13<59:18:26,  8.61s/it]
 35%|███▍      | 13175/37963 [32:25:20<57:15:07,  8.31s/it]
 35%|███▍      | 13176/37963 [32:25:28<55:48:50,  8.11s/it]
 35%|███▍      | 13177/37963 [32:25:35<53:47:18,  7.81s/it]
 35%|███▍      | 13178/37963 [32:25:43<53:40:14,  7.80s/it]
 35%|███▍      | 13179/37963 [32:25:58<68:05:42,  9.89s/it]
 35%|███▍      | 13180/37963 [32:26:06<63:46:57,  9.27s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '3.962', 'learning_rate': '1.517e-05', 'epoch': '0.3472'}
+
 35%|███▍      | 13180/37963 [32:26:06<63:46:57,  9.27s/it]
 35%|███▍      | 13181/37963 [32:26:13<60:32:11,  8.79s/it]
 35%|███▍      | 13182/37963 [32:26:21<58:16:41,  8.47s/it]
 35%|███▍      | 13183/37963 [32:26:36<71:26:50, 10.38s/it]
 35%|███▍      | 13184/37963 [32:26:51<80:32:11, 11.70s/it]
 35%|███▍      | 13185/37963 [32:26:59<73:10:27, 10.63s/it]
 35%|███▍      | 13186/37963 [32:27:13<80:33:30, 11.70s/it]
 35%|███▍      | 13187/37963 [32:27:21<72:27:31, 10.53s/it]
 35%|███▍      | 13188/37963 [32:27:28<66:38:57,  9.68s/it]
 35%|███▍      | 13189/37963 [32:27:43<76:01:41, 11.05s/it]
 35%|███▍      | 13190/37963 [32:27:50<69:12:28, 10.06s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '3.205', 'learning_rate': '1.517e-05', 'epoch': '0.3474'}
+
 35%|███▍      | 13190/37963 [32:27:50<69:12:28, 10.06s/it]
 35%|███▍      | 13191/37963 [32:27:58<64:22:34,  9.36s/it]
 35%|███▍      | 13192/37963 [32:28:06<60:50:34,  8.84s/it]
 35%|███▍      | 13193/37963 [32:28:13<58:12:26,  8.46s/it]
 35%|███▍      | 13194/37963 [32:28:21<56:22:15,  8.19s/it]
 35%|███▍      | 13195/37963 [32:28:28<54:44:38,  7.96s/it]
 35%|███▍      | 13196/37963 [32:28:43<67:58:03,  9.88s/it]
 35%|███▍      | 13197/37963 [32:28:50<63:31:56,  9.24s/it]
 35%|███▍      | 13198/37963 [32:28:58<59:32:49,  8.66s/it]
 35%|███▍      | 13199/37963 [32:29:05<57:23:23,  8.34s/it]
 35%|███▍      | 13200/37963 [32:29:13<55:58:39,  8.14s/it]
                                                           
{'loss': '0.1736', 'grad_norm': '3.999', 'learning_rate': '1.516e-05', 'epoch': '0.3477'}
+
 35%|███▍      | 13200/37963 [32:29:13<55:58:39,  8.14s/it]
 35%|███▍      | 13201/37963 [32:29:21<55:11:35,  8.02s/it]
 35%|███▍      | 13202/37963 [32:29:28<54:22:43,  7.91s/it]
 35%|███▍      | 13203/37963 [32:29:36<53:53:17,  7.84s/it]
 35%|███▍      | 13204/37963 [32:29:43<52:57:48,  7.70s/it]
 35%|███▍      | 13205/37963 [32:29:51<52:52:57,  7.69s/it]
 35%|███▍      | 13206/37963 [32:29:58<52:17:54,  7.60s/it]
 35%|███▍      | 13207/37963 [32:30:06<52:17:34,  7.60s/it]
 35%|███▍      | 13208/37963 [32:30:14<52:32:24,  7.64s/it]
 35%|███▍      | 13209/37963 [32:30:22<52:51:40,  7.69s/it]
 35%|███▍      | 13210/37963 [32:30:29<52:52:09,  7.69s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '2.786', 'learning_rate': '1.515e-05', 'epoch': '0.348'}
+
 35%|███▍      | 13210/37963 [32:30:29<52:52:09,  7.69s/it]
 35%|███▍      | 13211/37963 [32:30:37<52:43:58,  7.67s/it]
 35%|███▍      | 13212/37963 [32:30:44<52:32:16,  7.64s/it]
 35%|███▍      | 13213/37963 [32:30:52<52:11:52,  7.59s/it]
 35%|███▍      | 13214/37963 [32:31:00<52:21:58,  7.62s/it]
 35%|███▍      | 13215/37963 [32:31:14<66:19:15,  9.65s/it]
 35%|███▍      | 13216/37963 [32:31:22<62:25:42,  9.08s/it]
 35%|███▍      | 13217/37963 [32:31:29<58:32:28,  8.52s/it]
 35%|███▍      | 13218/37963 [32:31:37<57:08:54,  8.31s/it]
 35%|███▍      | 13219/37963 [32:31:45<55:56:29,  8.14s/it]
 35%|███▍      | 13220/37963 [32:31:52<54:24:22,  7.92s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '1.649', 'learning_rate': '1.514e-05', 'epoch': '0.3482'}
+
 35%|███▍      | 13220/37963 [32:31:52<54:24:22,  7.92s/it]
 35%|███▍      | 13221/37963 [32:32:00<53:44:26,  7.82s/it]
 35%|███▍      | 13222/37963 [32:32:14<67:09:58,  9.77s/it]
 35%|███▍      | 13223/37963 [32:32:22<63:03:32,  9.18s/it]
 35%|███▍      | 13224/37963 [32:32:29<59:47:27,  8.70s/it]
 35%|███▍      | 13225/37963 [32:32:37<57:42:56,  8.40s/it]
 35%|███▍      | 13226/37963 [32:32:45<56:15:47,  8.19s/it]
 35%|███▍      | 13227/37963 [32:32:52<55:11:56,  8.03s/it]
 35%|███▍      | 13228/37963 [32:33:07<68:50:49, 10.02s/it]
 35%|███▍      | 13229/37963 [32:33:15<64:02:59,  9.32s/it]
 35%|███▍      | 13230/37963 [32:33:36<89:39:39, 13.05s/it]
                                                           
{'loss': '0.1715', 'grad_norm': '2.713', 'learning_rate': '1.514e-05', 'epoch': '0.3485'}
+
 35%|███▍      | 13230/37963 [32:33:36<89:39:39, 13.05s/it]
 35%|███▍      | 13231/37963 [32:33:44<78:00:58, 11.36s/it]
 35%|███▍      | 13232/37963 [32:33:52<70:39:23, 10.29s/it]
 35%|███▍      | 13233/37963 [32:33:59<64:37:19,  9.41s/it]
 35%|███▍      | 13234/37963 [32:34:06<60:45:00,  8.84s/it]
 35%|███▍      | 13235/37963 [32:34:22<73:35:02, 10.71s/it]
 35%|███▍      | 13236/37963 [32:34:29<67:14:23,  9.79s/it]
 35%|███▍      | 13237/37963 [32:34:37<62:39:35,  9.12s/it]
 35%|███▍      | 13238/37963 [32:34:44<59:02:29,  8.60s/it]
 35%|███▍      | 13239/37963 [32:34:52<57:11:21,  8.33s/it]
 35%|███▍      | 13240/37963 [32:35:00<55:59:45,  8.15s/it]
                                                           
{'loss': '0.151', 'grad_norm': '1.158', 'learning_rate': '1.513e-05', 'epoch': '0.3488'}
+
 35%|███▍      | 13240/37963 [32:35:00<55:59:45,  8.15s/it]
 35%|███▍      | 13241/37963 [32:35:07<55:06:37,  8.03s/it]
 35%|███▍      | 13242/37963 [32:35:22<67:52:28,  9.88s/it]
 35%|███▍      | 13243/37963 [32:35:29<63:27:27,  9.24s/it]
 35%|███▍      | 13244/37963 [32:35:37<60:15:56,  8.78s/it]
 35%|███▍      | 13245/37963 [32:35:45<57:51:34,  8.43s/it]
 35%|███▍      | 13246/37963 [32:35:52<56:17:14,  8.20s/it]
 35%|███▍      | 13247/37963 [32:36:00<55:13:47,  8.04s/it]
 35%|███▍      | 13248/37963 [32:36:07<54:12:32,  7.90s/it]
 35%|███▍      | 13249/37963 [32:36:15<53:35:58,  7.81s/it]
 35%|███▍      | 13250/37963 [32:36:30<67:41:30,  9.86s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '2.297', 'learning_rate': '1.512e-05', 'epoch': '0.349'}
+
 35%|███▍      | 13250/37963 [32:36:30<67:41:30,  9.86s/it]
 35%|███▍      | 13251/37963 [32:36:37<63:04:21,  9.19s/it]
 35%|███▍      | 13252/37963 [32:36:45<59:59:10,  8.74s/it]
 35%|███▍      | 13253/37963 [32:36:53<57:56:04,  8.44s/it]
 35%|███▍      | 13254/37963 [32:37:00<56:14:24,  8.19s/it]
 35%|███▍      | 13255/37963 [32:37:08<55:05:32,  8.03s/it]
 35%|███▍      | 13256/37963 [32:37:15<53:48:35,  7.84s/it]
 35%|███▍      | 13257/37963 [32:37:23<53:19:28,  7.77s/it]
 35%|███▍      | 13258/37963 [32:37:30<52:33:28,  7.66s/it]
 35%|███▍      | 13259/37963 [32:37:38<52:36:25,  7.67s/it]
 35%|███▍      | 13260/37963 [32:37:46<52:34:34,  7.66s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '2.751', 'learning_rate': '1.511e-05', 'epoch': '0.3493'}
+
 35%|███▍      | 13260/37963 [32:37:46<52:34:34,  7.66s/it]
 35%|███▍      | 13261/37963 [32:37:53<52:31:39,  7.66s/it]
 35%|███▍      | 13262/37963 [32:38:01<52:21:46,  7.63s/it]
 35%|███▍      | 13263/37963 [32:38:09<52:36:10,  7.67s/it]
 35%|███▍      | 13264/37963 [32:38:17<52:52:29,  7.71s/it]
 35%|███▍      | 13265/37963 [32:38:24<52:45:06,  7.69s/it]
 35%|███▍      | 13266/37963 [32:38:32<52:44:38,  7.69s/it]
 35%|███▍      | 13267/37963 [32:38:46<65:59:22,  9.62s/it]
 35%|███▍      | 13268/37963 [32:38:54<63:02:22,  9.19s/it]
 35%|███▍      | 13269/37963 [32:39:09<73:33:37, 10.72s/it]
 35%|███▍      | 13270/37963 [32:39:16<67:27:39,  9.84s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '1.591', 'learning_rate': '1.511e-05', 'epoch': '0.3496'}
+
 35%|███▍      | 13270/37963 [32:39:16<67:27:39,  9.84s/it]
 35%|███▍      | 13271/37963 [32:39:24<63:24:42,  9.25s/it]
 35%|███▍      | 13272/37963 [32:39:32<59:58:50,  8.75s/it]
 35%|███▍      | 13273/37963 [32:39:39<57:43:11,  8.42s/it]
 35%|███▍      | 13274/37963 [32:39:54<70:40:32, 10.31s/it]
 35%|███▍      | 13275/37963 [32:40:09<80:13:41, 11.70s/it]
 35%|███▍      | 13276/37963 [32:40:16<71:24:02, 10.41s/it]
 35%|███▍      | 13277/37963 [32:40:24<65:52:51,  9.61s/it]
 35%|███▍      | 13278/37963 [32:40:32<62:01:56,  9.05s/it]
 35%|███▍      | 13279/37963 [32:40:40<59:19:22,  8.65s/it]
 35%|███▍      | 13280/37963 [32:40:54<72:02:13, 10.51s/it]
                                                           
{'loss': '0.1498', 'grad_norm': '1.555', 'learning_rate': '1.51e-05', 'epoch': '0.3498'}
+
 35%|███▍      | 13280/37963 [32:40:54<72:02:13, 10.51s/it]
 35%|███▍      | 13281/37963 [32:41:02<65:58:24,  9.62s/it]
 35%|███▍      | 13282/37963 [32:41:10<62:07:58,  9.06s/it]
 35%|███▍      | 13283/37963 [32:41:17<59:18:27,  8.65s/it]
 35%|███▍      | 13284/37963 [32:41:25<57:12:14,  8.34s/it]
 35%|███▍      | 13285/37963 [32:41:33<55:39:43,  8.12s/it]
 35%|███▍      | 13286/37963 [32:41:40<54:40:19,  7.98s/it]
 35%|███▍      | 13287/37963 [32:41:55<69:10:29, 10.09s/it]
 35%|███▌      | 13288/37963 [32:42:03<64:09:09,  9.36s/it]
 35%|███▌      | 13289/37963 [32:42:11<60:42:45,  8.86s/it]
 35%|███▌      | 13290/37963 [32:42:18<58:19:02,  8.51s/it]
                                                           
{'loss': '0.1827', 'grad_norm': '4.509', 'learning_rate': '1.509e-05', 'epoch': '0.3501'}
+
 35%|███▌      | 13290/37963 [32:42:19<58:19:02,  8.51s/it]
 35%|███▌      | 13291/37963 [32:42:26<56:43:24,  8.28s/it]
 35%|███▌      | 13292/37963 [32:42:34<55:46:18,  8.14s/it]
 35%|███▌      | 13293/37963 [32:42:42<54:42:41,  7.98s/it]
 35%|███▌      | 13294/37963 [32:42:49<53:58:21,  7.88s/it]
 35%|███▌      | 13295/37963 [32:43:04<67:11:39,  9.81s/it]
 35%|███▌      | 13296/37963 [32:43:11<62:30:13,  9.12s/it]
 35%|███▌      | 13297/37963 [32:43:19<59:36:37,  8.70s/it]
 35%|███▌      | 13298/37963 [32:43:26<57:24:27,  8.38s/it]
 35%|███▌      | 13299/37963 [32:43:34<55:55:00,  8.16s/it]
 35%|███▌      | 13300/37963 [32:43:42<54:50:30,  8.01s/it]
                                                           
{'loss': '0.16', 'grad_norm': '4.373', 'learning_rate': '1.508e-05', 'epoch': '0.3503'}
+
 35%|███▌      | 13300/37963 [32:43:42<54:50:30,  8.01s/it]
 35%|███▌      | 13301/37963 [32:43:49<53:40:41,  7.84s/it]
 35%|███▌      | 13302/37963 [32:43:57<53:16:28,  7.78s/it]
 35%|███▌      | 13303/37963 [32:44:04<53:00:44,  7.74s/it]
 35%|███▌      | 13304/37963 [32:44:19<66:35:51,  9.72s/it]
 35%|███▌      | 13305/37963 [32:44:26<62:20:18,  9.10s/it]
 35%|███▌      | 13306/37963 [32:44:34<59:03:19,  8.62s/it]
 35%|███▌      | 13307/37963 [32:44:41<56:29:06,  8.25s/it]
 35%|███▌      | 13308/37963 [32:44:49<55:27:45,  8.10s/it]
 35%|███▌      | 13309/37963 [32:44:57<54:21:58,  7.94s/it]
 35%|███▌      | 13310/37963 [32:45:04<53:45:31,  7.85s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '1.687', 'learning_rate': '1.508e-05', 'epoch': '0.3506'}
+
 35%|███▌      | 13310/37963 [32:45:04<53:45:31,  7.85s/it]
 35%|███▌      | 13311/37963 [32:45:12<53:23:10,  7.80s/it]
 35%|███▌      | 13312/37963 [32:45:20<53:13:40,  7.77s/it]
 35%|███▌      | 13313/37963 [32:45:34<66:32:36,  9.72s/it]
 35%|███▌      | 13314/37963 [32:45:41<61:51:23,  9.03s/it]
 35%|███▌      | 13315/37963 [32:45:49<59:08:12,  8.64s/it]
 35%|███▌      | 13316/37963 [32:45:57<57:08:44,  8.35s/it]
 35%|███▌      | 13317/37963 [32:46:04<55:38:46,  8.13s/it]
 35%|███▌      | 13318/37963 [32:46:12<54:43:24,  7.99s/it]
 35%|███▌      | 13319/37963 [32:46:19<53:39:42,  7.84s/it]
 35%|███▌      | 13320/37963 [32:46:35<69:08:16, 10.10s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '0.8417', 'learning_rate': '1.507e-05', 'epoch': '0.3509'}
+
 35%|███▌      | 13320/37963 [32:46:35<69:08:16, 10.10s/it]
 35%|███▌      | 13321/37963 [32:46:43<64:04:33,  9.36s/it]
 35%|███▌      | 13322/37963 [32:46:50<60:42:55,  8.87s/it]
 35%|███▌      | 13323/37963 [32:47:11<85:28:33, 12.49s/it]
 35%|███▌      | 13324/37963 [32:47:19<76:05:26, 11.12s/it]
 35%|███▌      | 13325/37963 [32:47:26<68:27:17, 10.00s/it]
 35%|███▌      | 13326/37963 [32:47:34<63:35:55,  9.29s/it]
 35%|███▌      | 13327/37963 [32:47:42<60:19:32,  8.82s/it]
 35%|███▌      | 13328/37963 [32:47:50<58:16:43,  8.52s/it]
 35%|███▌      | 13329/37963 [32:47:57<56:27:33,  8.25s/it]
 35%|███▌      | 13330/37963 [32:48:11<68:24:21, 10.00s/it]
                                                           
{'loss': '0.1758', 'grad_norm': '2.554', 'learning_rate': '1.506e-05', 'epoch': '0.3511'}
+
 35%|███▌      | 13330/37963 [32:48:11<68:24:21, 10.00s/it]
 35%|███▌      | 13331/37963 [32:48:19<64:06:34,  9.37s/it]
 35%|███▌      | 13332/37963 [32:48:27<60:40:28,  8.87s/it]
 35%|███▌      | 13333/37963 [32:48:34<57:50:19,  8.45s/it]
 35%|███▌      | 13334/37963 [32:48:42<56:14:58,  8.22s/it]
 35%|███▌      | 13335/37963 [32:48:50<55:18:42,  8.09s/it]
 35%|███▌      | 13336/37963 [32:48:58<54:37:11,  7.98s/it]
 35%|███▌      | 13337/37963 [32:49:05<53:53:42,  7.88s/it]
 35%|███▌      | 13338/37963 [32:49:19<66:48:54,  9.77s/it]
 35%|███▌      | 13339/37963 [32:49:27<62:45:29,  9.18s/it]
 35%|███▌      | 13340/37963 [32:49:35<59:07:42,  8.64s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '2.868', 'learning_rate': '1.506e-05', 'epoch': '0.3514'}
+
 35%|███▌      | 13340/37963 [32:49:35<59:07:42,  8.64s/it]
 35%|███▌      | 13341/37963 [32:49:42<57:04:07,  8.34s/it]
 35%|███▌      | 13342/37963 [32:49:50<55:32:29,  8.12s/it]
 35%|███▌      | 13343/37963 [32:50:04<68:06:11,  9.96s/it]
 35%|███▌      | 13344/37963 [32:50:12<63:09:30,  9.24s/it]
 35%|███▌      | 13345/37963 [32:50:19<60:04:23,  8.78s/it]
 35%|███▌      | 13346/37963 [32:50:27<57:10:17,  8.36s/it]
 35%|███▌      | 13347/37963 [32:50:34<55:49:34,  8.16s/it]
 35%|███▌      | 13348/37963 [32:50:42<54:08:12,  7.92s/it]
 35%|███▌      | 13349/37963 [32:50:56<67:44:51,  9.91s/it]
 35%|███▌      | 13350/37963 [32:51:04<63:19:03,  9.26s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '2.241', 'learning_rate': '1.505e-05', 'epoch': '0.3517'}
+
 35%|███▌      | 13350/37963 [32:51:04<63:19:03,  9.26s/it]
 35%|███▌      | 13351/37963 [32:51:12<60:13:53,  8.81s/it]
 35%|███▌      | 13352/37963 [32:51:20<58:04:12,  8.49s/it]
 35%|███▌      | 13353/37963 [32:51:27<55:59:52,  8.19s/it]
 35%|███▌      | 13354/37963 [32:51:35<54:50:41,  8.02s/it]
 35%|███▌      | 13355/37963 [32:51:42<53:47:24,  7.87s/it]
 35%|███▌      | 13356/37963 [32:51:50<53:21:47,  7.81s/it]
 35%|███▌      | 13357/37963 [32:52:04<66:04:05,  9.67s/it]
 35%|███▌      | 13358/37963 [32:52:11<61:33:31,  9.01s/it]
 35%|███▌      | 13359/37963 [32:52:19<58:55:33,  8.62s/it]
 35%|███▌      | 13360/37963 [32:52:27<56:48:22,  8.31s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '1.403', 'learning_rate': '1.504e-05', 'epoch': '0.3519'}
+
 35%|███▌      | 13360/37963 [32:52:27<56:48:22,  8.31s/it]
 35%|███▌      | 13361/37963 [32:52:34<55:18:07,  8.09s/it]
 35%|███▌      | 13362/37963 [32:52:42<54:39:43,  8.00s/it]
 35%|███▌      | 13363/37963 [32:52:50<54:00:45,  7.90s/it]
 35%|███▌      | 13364/37963 [32:52:57<53:13:09,  7.79s/it]
 35%|███▌      | 13365/37963 [32:53:05<53:04:08,  7.77s/it]
 35%|███▌      | 13366/37963 [32:53:13<52:58:06,  7.75s/it]
 35%|███▌      | 13367/37963 [32:53:27<66:32:32,  9.74s/it]
 35%|███▌      | 13368/37963 [32:53:35<62:02:06,  9.08s/it]
 35%|███▌      | 13369/37963 [32:53:49<73:41:17, 10.79s/it]
 35%|███▌      | 13370/37963 [32:53:57<67:22:24,  9.86s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '2.488', 'learning_rate': '1.503e-05', 'epoch': '0.3522'}
+
 35%|███▌      | 13370/37963 [32:53:57<67:22:24,  9.86s/it]
 35%|███▌      | 13371/37963 [32:54:05<62:48:25,  9.19s/it]
 35%|███▌      | 13372/37963 [32:54:12<59:42:47,  8.74s/it]
 35%|███▌      | 13373/37963 [32:54:20<57:32:08,  8.42s/it]
 35%|███▌      | 13374/37963 [32:54:28<55:53:37,  8.18s/it]
 35%|███▌      | 13375/37963 [32:54:35<54:42:35,  8.01s/it]
 35%|███▌      | 13376/37963 [32:54:43<54:11:15,  7.93s/it]
 35%|███▌      | 13377/37963 [32:54:58<68:20:37, 10.01s/it]
 35%|███▌      | 13378/37963 [32:55:06<63:43:53,  9.33s/it]
 35%|███▌      | 13379/37963 [32:55:13<60:27:52,  8.85s/it]
 35%|███▌      | 13380/37963 [32:55:21<58:08:28,  8.51s/it]
                                                           
{'loss': '0.1731', 'grad_norm': '1.083', 'learning_rate': '1.503e-05', 'epoch': '0.3524'}
+
 35%|███▌      | 13380/37963 [32:55:21<58:08:28,  8.51s/it]
 35%|███▌      | 13381/37963 [32:55:29<56:37:49,  8.29s/it]
 35%|███▌      | 13382/37963 [32:55:44<69:42:28, 10.21s/it]
 35%|███▌      | 13383/37963 [32:55:51<64:44:20,  9.48s/it]
 35%|███▌      | 13384/37963 [32:55:59<61:12:30,  8.96s/it]
 35%|███▌      | 13385/37963 [32:56:07<58:42:59,  8.60s/it]
 35%|███▌      | 13386/37963 [32:56:14<55:38:13,  8.15s/it]
 35%|███▌      | 13387/37963 [32:56:29<69:30:44, 10.18s/it]
 35%|███▌      | 13388/37963 [32:56:37<64:25:49,  9.44s/it]
 35%|███▌      | 13389/37963 [32:56:44<60:51:12,  8.91s/it]
 35%|███▌      | 13390/37963 [32:56:52<58:15:31,  8.54s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '2.926', 'learning_rate': '1.502e-05', 'epoch': '0.3527'}
+
 35%|███▌      | 13390/37963 [32:56:52<58:15:31,  8.54s/it]
 35%|███▌      | 13391/37963 [32:56:59<55:44:29,  8.17s/it]
 35%|███▌      | 13392/37963 [32:57:13<67:49:44,  9.94s/it]
 35%|███▌      | 13393/37963 [32:57:28<77:00:18, 11.28s/it]
 35%|███▌      | 13394/37963 [32:57:35<69:31:03, 10.19s/it]
 35%|███▌      | 13395/37963 [32:57:43<64:17:29,  9.42s/it]
 35%|███▌      | 13396/37963 [32:57:50<60:15:14,  8.83s/it]
 35%|███▌      | 13397/37963 [32:57:58<57:49:06,  8.47s/it]
 35%|███▌      | 13398/37963 [32:58:06<56:19:16,  8.25s/it]
 35%|███▌      | 13399/37963 [32:58:14<55:16:23,  8.10s/it]
 35%|███▌      | 13400/37963 [32:58:21<54:09:53,  7.94s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '1.659', 'learning_rate': '1.501e-05', 'epoch': '0.353'}
+
 35%|███▌      | 13400/37963 [32:58:21<54:09:53,  7.94s/it]
 35%|███▌      | 13401/37963 [32:58:29<53:38:13,  7.86s/it]
 35%|███▌      | 13402/37963 [32:58:36<53:11:19,  7.80s/it]
 35%|███▌      | 13403/37963 [32:58:44<53:00:56,  7.77s/it]
 35%|███▌      | 13404/37963 [32:58:52<53:02:41,  7.78s/it]
 35%|███▌      | 13405/37963 [32:59:00<52:49:22,  7.74s/it]
 35%|███▌      | 13406/37963 [32:59:07<52:36:22,  7.71s/it]
 35%|███▌      | 13407/37963 [32:59:15<52:26:21,  7.69s/it]
 35%|███▌      | 13408/37963 [32:59:29<65:28:14,  9.60s/it]
 35%|███▌      | 13409/37963 [32:59:37<61:58:09,  9.09s/it]
 35%|███▌      | 13410/37963 [32:59:45<59:06:50,  8.67s/it]
                                                           
{'loss': '0.1634', 'grad_norm': '4.315', 'learning_rate': '1.5e-05', 'epoch': '0.3532'}
+
 35%|███▌      | 13410/37963 [32:59:45<59:06:50,  8.67s/it]
 35%|███▌      | 13411/37963 [32:59:52<57:08:55,  8.38s/it]
 35%|███▌      | 13412/37963 [33:00:00<55:38:07,  8.16s/it]
 35%|███▌      | 13413/37963 [33:00:08<54:33:48,  8.00s/it]
 35%|███▌      | 13414/37963 [33:00:15<53:50:57,  7.90s/it]
 35%|███▌      | 13415/37963 [33:00:23<52:54:46,  7.76s/it]
 35%|███▌      | 13416/37963 [33:00:30<52:48:51,  7.75s/it]
 35%|███▌      | 13417/37963 [33:00:38<52:35:53,  7.71s/it]
 35%|███▌      | 13418/37963 [33:00:53<68:15:18, 10.01s/it]
 35%|███▌      | 13419/37963 [33:01:01<63:23:34,  9.30s/it]
 35%|███▌      | 13420/37963 [33:01:09<60:08:39,  8.82s/it]
                                                           
{'loss': '0.1705', 'grad_norm': '4.974', 'learning_rate': '1.5e-05', 'epoch': '0.3535'}
+
 35%|███▌      | 13420/37963 [33:01:09<60:08:39,  8.82s/it]
 35%|███▌      | 13421/37963 [33:01:23<70:27:00, 10.33s/it]
 35%|███▌      | 13422/37963 [33:01:30<64:36:28,  9.48s/it]
 35%|███▌      | 13423/37963 [33:01:38<60:30:02,  8.88s/it]
 35%|███▌      | 13424/37963 [33:01:45<58:05:46,  8.52s/it]
 35%|███▌      | 13425/37963 [33:01:53<56:36:29,  8.31s/it]
 35%|███▌      | 13426/37963 [33:02:01<55:31:01,  8.15s/it]
 35%|███▌      | 13427/37963 [33:02:09<54:38:32,  8.02s/it]
 35%|███▌      | 13428/37963 [33:02:16<53:23:34,  7.83s/it]
 35%|███▌      | 13429/37963 [33:02:23<52:16:16,  7.67s/it]
 35%|███▌      | 13430/37963 [33:02:31<52:29:33,  7.70s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '1.525', 'learning_rate': '1.499e-05', 'epoch': '0.3538'}
+
 35%|███▌      | 13430/37963 [33:02:31<52:29:33,  7.70s/it]
 35%|███▌      | 13431/37963 [33:02:46<66:35:02,  9.77s/it]
 35%|███▌      | 13432/37963 [33:02:53<62:25:33,  9.16s/it]
 35%|███▌      | 13433/37963 [33:03:01<59:11:21,  8.69s/it]
 35%|███▌      | 13434/37963 [33:03:15<71:08:47, 10.44s/it]
 35%|███▌      | 13435/37963 [33:03:30<79:46:42, 11.71s/it]
 35%|███▌      | 13436/37963 [33:03:38<71:54:55, 10.56s/it]
 35%|███▌      | 13437/37963 [33:03:46<66:03:15,  9.70s/it]
 35%|███▌      | 13438/37963 [33:03:53<62:04:58,  9.11s/it]
 35%|███▌      | 13439/37963 [33:04:01<59:07:53,  8.68s/it]
 35%|███▌      | 13440/37963 [33:04:15<69:47:00, 10.24s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '5.758', 'learning_rate': '1.498e-05', 'epoch': '0.354'}
+
 35%|███▌      | 13440/37963 [33:04:15<69:47:00, 10.24s/it]
 35%|███▌      | 13441/37963 [33:04:23<64:31:15,  9.47s/it]
 35%|███▌      | 13442/37963 [33:04:36<73:05:46, 10.73s/it]
 35%|███▌      | 13443/37963 [33:04:44<66:54:10,  9.82s/it]
 35%|███▌      | 13444/37963 [33:04:52<62:11:06,  9.13s/it]
 35%|███▌      | 13445/37963 [33:04:59<59:12:46,  8.69s/it]
 35%|███▌      | 13446/37963 [33:05:07<56:50:38,  8.35s/it]
 35%|███▌      | 13447/37963 [33:05:14<55:19:38,  8.12s/it]
 35%|███▌      | 13448/37963 [33:05:22<54:39:35,  8.03s/it]
 35%|███▌      | 13449/37963 [33:05:30<53:52:32,  7.91s/it]
 35%|███▌      | 13450/37963 [33:05:37<52:56:11,  7.77s/it]
                                                           
{'loss': '0.1673', 'grad_norm': '3.854', 'learning_rate': '1.497e-05', 'epoch': '0.3543'}
+
 35%|███▌      | 13450/37963 [33:05:37<52:56:11,  7.77s/it]
 35%|███▌      | 13451/37963 [33:05:45<52:39:25,  7.73s/it]
 35%|███▌      | 13452/37963 [33:05:53<52:45:38,  7.75s/it]
 35%|███▌      | 13453/37963 [33:06:00<52:29:38,  7.71s/it]
 35%|███▌      | 13454/37963 [33:06:08<52:11:24,  7.67s/it]
 35%|███▌      | 13455/37963 [33:06:15<51:44:53,  7.60s/it]
 35%|███▌      | 13456/37963 [33:06:29<64:57:17,  9.54s/it]
 35%|███▌      | 13457/37963 [33:06:37<61:14:51,  9.00s/it]
 35%|███▌      | 13458/37963 [33:06:45<58:32:48,  8.60s/it]
 35%|███▌      | 13459/37963 [33:06:52<56:43:06,  8.33s/it]
 35%|███▌      | 13460/37963 [33:07:00<54:36:44,  8.02s/it]
                                                           
{'loss': '0.1511', 'grad_norm': '2.351', 'learning_rate': '1.497e-05', 'epoch': '0.3546'}
+
 35%|███▌      | 13460/37963 [33:07:00<54:36:44,  8.02s/it]
 35%|███▌      | 13461/37963 [33:07:07<53:52:11,  7.91s/it]
 35%|███▌      | 13462/37963 [33:07:15<53:02:44,  7.79s/it]
 35%|███▌      | 13463/37963 [33:07:23<52:49:45,  7.76s/it]
 35%|███▌      | 13464/37963 [33:07:30<52:47:18,  7.76s/it]
 35%|███▌      | 13465/37963 [33:07:38<52:40:25,  7.74s/it]
 35%|███▌      | 13466/37963 [33:07:46<52:37:41,  7.73s/it]
 35%|███▌      | 13467/37963 [33:07:53<52:25:53,  7.71s/it]
 35%|███▌      | 13468/37963 [33:08:01<51:48:56,  7.62s/it]
 35%|███▌      | 13469/37963 [33:08:15<65:38:57,  9.65s/it]
 35%|███▌      | 13470/37963 [33:08:23<61:51:26,  9.09s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '4.277', 'learning_rate': '1.496e-05', 'epoch': '0.3548'}
+
 35%|███▌      | 13470/37963 [33:08:23<61:51:26,  9.09s/it]
 35%|███▌      | 13471/37963 [33:08:31<58:35:07,  8.61s/it]
 35%|███▌      | 13472/37963 [33:08:45<70:56:23, 10.43s/it]
 35%|███▌      | 13473/37963 [33:08:52<64:30:20,  9.48s/it]
 35%|███▌      | 13474/37963 [33:09:00<60:40:44,  8.92s/it]
 35%|███▌      | 13475/37963 [33:09:08<58:15:14,  8.56s/it]
 35%|███▌      | 13476/37963 [33:09:15<56:21:02,  8.28s/it]
 36%|███▌      | 13477/37963 [33:09:30<69:11:54, 10.17s/it]
 36%|███▌      | 13478/37963 [33:09:38<64:31:14,  9.49s/it]
 36%|███▌      | 13479/37963 [33:09:46<60:46:12,  8.94s/it]
 36%|███▌      | 13480/37963 [33:09:53<57:25:33,  8.44s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '1.574', 'learning_rate': '1.495e-05', 'epoch': '0.3551'}
+
 36%|███▌      | 13480/37963 [33:09:53<57:25:33,  8.44s/it]
 36%|███▌      | 13481/37963 [33:10:00<55:27:22,  8.15s/it]
 36%|███▌      | 13482/37963 [33:10:15<68:29:33, 10.07s/it]
 36%|███▌      | 13483/37963 [33:10:30<78:05:14, 11.48s/it]
 36%|███▌      | 13484/37963 [33:10:37<69:43:33, 10.25s/it]
 36%|███▌      | 13485/37963 [33:10:51<77:57:21, 11.47s/it]
 36%|███▌      | 13486/37963 [33:10:59<69:59:55, 10.30s/it]
 36%|███▌      | 13487/37963 [33:11:06<64:24:21,  9.47s/it]
 36%|███▌      | 13488/37963 [33:11:21<73:54:17, 10.87s/it]
 36%|███▌      | 13489/37963 [33:11:28<67:25:59,  9.92s/it]
 36%|███▌      | 13490/37963 [33:11:36<62:38:47,  9.22s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '1.169', 'learning_rate': '1.494e-05', 'epoch': '0.3553'}
+
 36%|███▌      | 13490/37963 [33:11:36<62:38:47,  9.22s/it]
 36%|███▌      | 13491/37963 [33:11:44<59:39:00,  8.77s/it]
 36%|███▌      | 13492/37963 [33:11:51<57:30:35,  8.46s/it]
 36%|███▌      | 13493/37963 [33:11:59<55:21:18,  8.14s/it]
 36%|███▌      | 13494/37963 [33:12:06<54:24:13,  8.00s/it]
 36%|███▌      | 13495/37963 [33:12:14<53:43:12,  7.90s/it]
 36%|███▌      | 13496/37963 [33:12:22<53:14:31,  7.83s/it]
 36%|███▌      | 13497/37963 [33:12:29<52:42:01,  7.75s/it]
 36%|███▌      | 13498/37963 [33:12:37<52:32:16,  7.73s/it]
 36%|███▌      | 13499/37963 [33:12:45<52:16:03,  7.69s/it]
 36%|███▌      | 13500/37963 [33:12:59<66:41:59,  9.82s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '1.146', 'learning_rate': '1.494e-05', 'epoch': '0.3556'}
+
 36%|███▌      | 13500/37963 [33:12:59<66:41:59,  9.82s/it]
 36%|███▌      | 13501/37963 [33:13:07<62:23:00,  9.18s/it]
 36%|███▌      | 13502/37963 [33:13:14<58:40:51,  8.64s/it]
 36%|███▌      | 13503/37963 [33:13:22<56:45:53,  8.35s/it]
 36%|███▌      | 13504/37963 [33:13:30<55:13:50,  8.13s/it]
 36%|███▌      | 13505/37963 [33:13:38<54:29:35,  8.02s/it]
 36%|███▌      | 13506/37963 [33:13:45<53:33:53,  7.88s/it]
 36%|███▌      | 13507/37963 [33:13:53<53:25:50,  7.87s/it]
 36%|███▌      | 13508/37963 [33:14:01<53:03:34,  7.81s/it]
 36%|███▌      | 13509/37963 [33:14:08<52:35:07,  7.74s/it]
 36%|███▌      | 13510/37963 [33:14:16<52:16:32,  7.70s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '3.365', 'learning_rate': '1.493e-05', 'epoch': '0.3559'}
+
 36%|███▌      | 13510/37963 [33:14:16<52:16:32,  7.70s/it]
 36%|███▌      | 13511/37963 [33:14:23<51:50:37,  7.63s/it]
 36%|███▌      | 13512/37963 [33:14:31<51:49:33,  7.63s/it]
 36%|███▌      | 13513/37963 [33:14:39<52:01:22,  7.66s/it]
 36%|███▌      | 13514/37963 [33:14:46<52:03:17,  7.66s/it]
 36%|███▌      | 13515/37963 [33:14:54<52:16:28,  7.70s/it]
 36%|███▌      | 13516/37963 [33:15:09<66:13:11,  9.75s/it]
 36%|███▌      | 13517/37963 [33:15:16<62:08:38,  9.15s/it]
 36%|███▌      | 13518/37963 [33:15:30<71:58:57, 10.60s/it]
 36%|███▌      | 13519/37963 [33:15:38<65:14:21,  9.61s/it]
 36%|███▌      | 13520/37963 [33:15:45<61:22:37,  9.04s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '1.745', 'learning_rate': '1.492e-05', 'epoch': '0.3561'}
+
 36%|███▌      | 13520/37963 [33:15:45<61:22:37,  9.04s/it]
 36%|███▌      | 13521/37963 [33:15:53<58:58:07,  8.69s/it]
 36%|███▌      | 13522/37963 [33:16:01<56:48:50,  8.37s/it]
 36%|███▌      | 13523/37963 [33:16:08<55:22:33,  8.16s/it]
 36%|███▌      | 13524/37963 [33:16:23<69:04:45, 10.18s/it]
 36%|███▌      | 13525/37963 [33:16:31<64:08:17,  9.45s/it]
 36%|███▌      | 13526/37963 [33:16:39<60:28:45,  8.91s/it]
 36%|███▌      | 13527/37963 [33:16:46<58:04:18,  8.56s/it]
 36%|███▌      | 13528/37963 [33:16:54<56:26:03,  8.31s/it]
 36%|███▌      | 13529/37963 [33:17:02<55:11:52,  8.13s/it]
 36%|███▌      | 13530/37963 [33:17:10<54:13:40,  7.99s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '2.966', 'learning_rate': '1.491e-05', 'epoch': '0.3564'}
+
 36%|███▌      | 13530/37963 [33:17:10<54:13:40,  7.99s/it]
 36%|███▌      | 13531/37963 [33:17:17<53:45:36,  7.92s/it]
 36%|███▌      | 13532/37963 [33:17:32<66:43:48,  9.83s/it]
 36%|███▌      | 13533/37963 [33:17:39<62:24:38,  9.20s/it]
 36%|███▌      | 13534/37963 [33:17:47<59:07:09,  8.71s/it]
 36%|███▌      | 13535/37963 [33:18:01<70:11:51, 10.35s/it]
 36%|███▌      | 13536/37963 [33:18:23<93:12:55, 13.74s/it]
 36%|███▌      | 13537/37963 [33:18:30<80:47:35, 11.91s/it]
 36%|███▌      | 13538/37963 [33:18:38<72:05:45, 10.63s/it]
 36%|███▌      | 13539/37963 [33:18:46<66:12:09,  9.76s/it]
 36%|███▌      | 13540/37963 [33:18:53<61:50:33,  9.12s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '1.421', 'learning_rate': '1.491e-05', 'epoch': '0.3567'}
+
 36%|███▌      | 13540/37963 [33:18:53<61:50:33,  9.12s/it]
 36%|███▌      | 13541/37963 [33:19:01<58:27:49,  8.62s/it]
 36%|███▌      | 13542/37963 [33:19:09<56:30:16,  8.33s/it]
 36%|███▌      | 13543/37963 [33:19:16<55:19:54,  8.16s/it]
 36%|███▌      | 13544/37963 [33:19:24<54:24:11,  8.02s/it]
 36%|███▌      | 13545/37963 [33:19:32<53:32:59,  7.89s/it]
 36%|███▌      | 13546/37963 [33:19:39<52:58:33,  7.81s/it]
 36%|███▌      | 13547/37963 [33:19:47<52:26:47,  7.73s/it]
 36%|███▌      | 13548/37963 [33:19:54<52:28:08,  7.74s/it]
 36%|███▌      | 13549/37963 [33:20:02<52:15:26,  7.71s/it]
 36%|███▌      | 13550/37963 [33:20:10<52:08:23,  7.69s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '1.354', 'learning_rate': '1.49e-05', 'epoch': '0.3569'}
+
 36%|███▌      | 13550/37963 [33:20:10<52:08:23,  7.69s/it]
 36%|███▌      | 13551/37963 [33:20:17<52:12:14,  7.70s/it]
 36%|███▌      | 13552/37963 [33:20:25<52:05:55,  7.68s/it]
 36%|███▌      | 13553/37963 [33:20:33<51:34:57,  7.61s/it]
 36%|███▌      | 13554/37963 [33:20:47<65:15:58,  9.63s/it]
 36%|███▌      | 13555/37963 [33:20:55<61:27:24,  9.06s/it]
 36%|███▌      | 13556/37963 [33:21:02<58:45:54,  8.67s/it]
 36%|███▌      | 13557/37963 [33:21:10<56:38:03,  8.35s/it]
 36%|███▌      | 13558/37963 [33:21:18<55:10:39,  8.14s/it]
 36%|███▌      | 13559/37963 [33:21:25<54:13:23,  8.00s/it]
 36%|███▌      | 13560/37963 [33:21:33<53:54:22,  7.95s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '2.619', 'learning_rate': '1.489e-05', 'epoch': '0.3572'}
+
 36%|███▌      | 13560/37963 [33:21:33<53:54:22,  7.95s/it]
 36%|███▌      | 13561/37963 [33:21:47<66:24:54,  9.80s/it]
 36%|███▌      | 13562/37963 [33:22:02<76:50:51, 11.34s/it]
 36%|███▌      | 13563/37963 [33:22:10<69:29:24, 10.25s/it]
 36%|███▌      | 13564/37963 [33:22:17<63:29:33,  9.37s/it]
 36%|███▌      | 13565/37963 [33:22:25<60:05:19,  8.87s/it]
 36%|███▌      | 13566/37963 [33:22:32<56:59:34,  8.41s/it]
 36%|███▌      | 13567/37963 [33:22:40<54:44:44,  8.08s/it]
 36%|███▌      | 13568/37963 [33:22:47<54:09:47,  7.99s/it]
 36%|███▌      | 13569/37963 [33:22:55<53:25:13,  7.88s/it]
 36%|███▌      | 13570/37963 [33:23:03<53:02:37,  7.83s/it]
                                                           
{'loss': '0.1527', 'grad_norm': '0.9476', 'learning_rate': '1.488e-05', 'epoch': '0.3575'}
+
 36%|███▌      | 13570/37963 [33:23:03<53:02:37,  7.83s/it]
 36%|███▌      | 13571/37963 [33:23:10<52:36:48,  7.77s/it]
 36%|███▌      | 13572/37963 [33:23:18<52:23:44,  7.73s/it]
 36%|███▌      | 13573/37963 [33:23:26<52:10:31,  7.70s/it]
 36%|███▌      | 13574/37963 [33:23:33<52:05:11,  7.69s/it]
 36%|███▌      | 13575/37963 [33:23:41<52:16:49,  7.72s/it]
 36%|███▌      | 13576/37963 [33:23:48<51:43:14,  7.63s/it]
 36%|███▌      | 13577/37963 [33:23:56<51:54:46,  7.66s/it]
 36%|███▌      | 13578/37963 [33:24:11<66:34:56,  9.83s/it]
 36%|███▌      | 13579/37963 [33:24:19<62:29:27,  9.23s/it]
 36%|███▌      | 13580/37963 [33:24:27<59:22:31,  8.77s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '1.613', 'learning_rate': '1.488e-05', 'epoch': '0.3577'}
+
 36%|███▌      | 13580/37963 [33:24:27<59:22:31,  8.77s/it]
 36%|███▌      | 13581/37963 [33:24:41<70:02:36, 10.34s/it]
 36%|███▌      | 13582/37963 [33:24:55<77:50:58, 11.49s/it]
 36%|███▌      | 13583/37963 [33:25:03<70:09:25, 10.36s/it]
 36%|███▌      | 13584/37963 [33:25:10<64:26:20,  9.52s/it]
 36%|███▌      | 13585/37963 [33:25:25<76:00:14, 11.22s/it]
 36%|███▌      | 13586/37963 [33:25:33<68:16:24, 10.08s/it]
 36%|███▌      | 13587/37963 [33:25:40<63:16:54,  9.35s/it]
 36%|███▌      | 13588/37963 [33:25:55<74:42:22, 11.03s/it]
 36%|███▌      | 13589/37963 [33:26:03<67:50:09, 10.02s/it]
 36%|███▌      | 13590/37963 [33:26:11<63:00:46,  9.31s/it]
                                                           
{'loss': '0.1645', 'grad_norm': '1.513', 'learning_rate': '1.487e-05', 'epoch': '0.358'}
+
 36%|███▌      | 13590/37963 [33:26:11<63:00:46,  9.31s/it]
 36%|███▌      | 13591/37963 [33:26:18<59:38:49,  8.81s/it]
 36%|███▌      | 13592/37963 [33:26:26<57:14:29,  8.46s/it]
 36%|███▌      | 13593/37963 [33:26:33<55:28:53,  8.20s/it]
 36%|███▌      | 13594/37963 [33:26:41<54:20:58,  8.03s/it]
 36%|███▌      | 13595/37963 [33:26:49<53:40:45,  7.93s/it]
 36%|███▌      | 13596/37963 [33:26:56<53:00:55,  7.83s/it]
 36%|███▌      | 13597/37963 [33:27:04<52:36:17,  7.77s/it]
 36%|███▌      | 13598/37963 [33:27:12<52:26:51,  7.75s/it]
 36%|███▌      | 13599/37963 [33:27:19<52:17:44,  7.73s/it]
 36%|███▌      | 13600/37963 [33:27:27<52:14:28,  7.72s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '1.841', 'learning_rate': '1.486e-05', 'epoch': '0.3582'}
+
 36%|███▌      | 13600/37963 [33:27:27<52:14:28,  7.72s/it]
 36%|███▌      | 13601/37963 [33:27:41<65:36:52,  9.70s/it]
 36%|███▌      | 13602/37963 [33:27:49<61:36:44,  9.10s/it]
 36%|███▌      | 13603/37963 [33:27:57<58:41:42,  8.67s/it]
 36%|███▌      | 13604/37963 [33:28:04<56:34:52,  8.36s/it]
 36%|███▌      | 13605/37963 [33:28:12<55:44:36,  8.24s/it]
 36%|███▌      | 13606/37963 [33:28:20<54:59:31,  8.13s/it]
 36%|███▌      | 13607/37963 [33:28:28<54:10:18,  8.01s/it]
 36%|███▌      | 13608/37963 [33:28:42<66:45:37,  9.87s/it]
 36%|███▌      | 13609/37963 [33:28:50<61:52:51,  9.15s/it]
 36%|███▌      | 13610/37963 [33:29:04<73:10:11, 10.82s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '2.229', 'learning_rate': '1.485e-05', 'epoch': '0.3585'}
+
 36%|███▌      | 13610/37963 [33:29:04<73:10:11, 10.82s/it]
 36%|███▌      | 13611/37963 [33:29:12<66:37:42,  9.85s/it]
 36%|███▌      | 13612/37963 [33:29:20<62:19:27,  9.21s/it]
 36%|███▌      | 13613/37963 [33:29:27<58:45:41,  8.69s/it]
 36%|███▌      | 13614/37963 [33:29:35<56:24:53,  8.34s/it]
 36%|███▌      | 13615/37963 [33:29:42<54:34:30,  8.07s/it]
 36%|███▌      | 13616/37963 [33:29:50<53:45:55,  7.95s/it]
 36%|███▌      | 13617/37963 [33:29:57<53:10:32,  7.86s/it]
 36%|███▌      | 13618/37963 [33:30:05<52:26:13,  7.75s/it]
 36%|███▌      | 13619/37963 [33:30:12<51:38:51,  7.64s/it]
 36%|███▌      | 13620/37963 [33:30:20<51:48:23,  7.66s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '3.274', 'learning_rate': '1.485e-05', 'epoch': '0.3588'}
+
 36%|███▌      | 13620/37963 [33:30:20<51:48:23,  7.66s/it]
 36%|███▌      | 13621/37963 [33:30:28<51:52:49,  7.67s/it]
 36%|███▌      | 13622/37963 [33:30:35<51:45:31,  7.66s/it]
 36%|███▌      | 13623/37963 [33:30:43<52:10:46,  7.72s/it]
 36%|███▌      | 13624/37963 [33:30:51<51:53:53,  7.68s/it]
 36%|███▌      | 13625/37963 [33:30:58<51:46:29,  7.66s/it]
 36%|███▌      | 13626/37963 [33:31:06<51:49:49,  7.67s/it]
 36%|███▌      | 13627/37963 [33:31:14<51:35:06,  7.63s/it]
 36%|███▌      | 13628/37963 [33:31:29<66:22:48,  9.82s/it]
 36%|███▌      | 13629/37963 [33:31:49<88:47:25, 13.14s/it]
 36%|███▌      | 13630/37963 [33:31:57<78:05:52, 11.55s/it]
                                                           
{'loss': '0.1634', 'grad_norm': '0.8076', 'learning_rate': '1.484e-05', 'epoch': '0.359'}
+
 36%|███▌      | 13630/37963 [33:31:57<78:05:52, 11.55s/it]
 36%|███▌      | 13631/37963 [33:32:05<69:45:02, 10.32s/it]
 36%|███▌      | 13632/37963 [33:32:12<64:30:43,  9.55s/it]
 36%|███▌      | 13633/37963 [33:32:27<75:06:47, 11.11s/it]
 36%|███▌      | 13634/37963 [33:32:35<67:54:48, 10.05s/it]
 36%|███▌      | 13635/37963 [33:32:43<63:09:37,  9.35s/it]
 36%|███▌      | 13636/37963 [33:32:50<60:02:27,  8.89s/it]
 36%|███▌      | 13637/37963 [33:33:05<72:22:59, 10.71s/it]
 36%|███▌      | 13638/37963 [33:33:13<66:00:24,  9.77s/it]
 36%|███▌      | 13639/37963 [33:33:21<61:51:30,  9.16s/it]
 36%|███▌      | 13640/37963 [33:33:28<59:05:21,  8.75s/it]
                                                           
{'loss': '0.133', 'grad_norm': '3.012', 'learning_rate': '1.483e-05', 'epoch': '0.3593'}
+
 36%|███▌      | 13640/37963 [33:33:28<59:05:21,  8.75s/it]
 36%|███▌      | 13641/37963 [33:33:36<56:51:16,  8.42s/it]
 36%|███▌      | 13642/37963 [33:33:44<55:05:05,  8.15s/it]
 36%|███▌      | 13643/37963 [33:33:51<54:04:18,  8.00s/it]
 36%|███▌      | 13644/37963 [33:33:59<53:14:55,  7.88s/it]
 36%|███▌      | 13645/37963 [33:34:06<52:42:01,  7.80s/it]
 36%|███▌      | 13646/37963 [33:34:14<52:21:38,  7.75s/it]
 36%|███▌      | 13647/37963 [33:34:22<52:33:26,  7.78s/it]
 36%|███▌      | 13648/37963 [33:34:36<65:09:55,  9.65s/it]
 36%|███▌      | 13649/37963 [33:34:44<61:04:54,  9.04s/it]
 36%|███▌      | 13650/37963 [33:34:51<58:42:10,  8.69s/it]
                                                           
{'loss': '0.1387', 'grad_norm': '1.205', 'learning_rate': '1.483e-05', 'epoch': '0.3596'}
+
 36%|███▌      | 13650/37963 [33:34:51<58:42:10,  8.69s/it]
 36%|███▌      | 13651/37963 [33:34:59<56:09:24,  8.32s/it]
 36%|███▌      | 13652/37963 [33:35:06<54:26:18,  8.06s/it]
 36%|███▌      | 13653/37963 [33:35:14<53:45:16,  7.96s/it]
 36%|███▌      | 13654/37963 [33:35:22<53:13:30,  7.88s/it]
 36%|███▌      | 13655/37963 [33:35:29<52:36:51,  7.79s/it]
 36%|███▌      | 13656/37963 [33:35:37<52:27:36,  7.77s/it]
 36%|███▌      | 13657/37963 [33:35:51<65:22:49,  9.68s/it]
 36%|███▌      | 13658/37963 [33:35:59<61:30:27,  9.11s/it]
 36%|███▌      | 13659/37963 [33:36:07<58:29:02,  8.66s/it]
 36%|███▌      | 13660/37963 [33:36:14<56:31:14,  8.37s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '3.113', 'learning_rate': '1.482e-05', 'epoch': '0.3598'}
+
 36%|███▌      | 13660/37963 [33:36:14<56:31:14,  8.37s/it]
 36%|███▌      | 13661/37963 [33:36:22<55:02:52,  8.15s/it]
 36%|███▌      | 13662/37963 [33:36:29<53:47:18,  7.97s/it]
 36%|███▌      | 13663/37963 [33:36:37<52:45:47,  7.82s/it]
 36%|███▌      | 13664/37963 [33:36:52<66:57:28,  9.92s/it]
 36%|███▌      | 13665/37963 [33:36:59<62:25:59,  9.25s/it]
 36%|███▌      | 13666/37963 [33:37:07<59:12:22,  8.77s/it]
 36%|███▌      | 13667/37963 [33:37:15<56:58:39,  8.44s/it]
 36%|███▌      | 13668/37963 [33:37:23<56:04:17,  8.31s/it]
 36%|███▌      | 13669/37963 [33:37:31<54:50:31,  8.13s/it]
 36%|███▌      | 13670/37963 [33:37:38<53:33:39,  7.94s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '1.274', 'learning_rate': '1.481e-05', 'epoch': '0.3601'}
+
 36%|███▌      | 13670/37963 [33:37:38<53:33:39,  7.94s/it]
 36%|███▌      | 13671/37963 [33:37:46<53:03:04,  7.86s/it]
 36%|███▌      | 13672/37963 [33:37:53<52:37:48,  7.80s/it]
 36%|███▌      | 13673/37963 [33:38:08<66:40:04,  9.88s/it]
 36%|███▌      | 13674/37963 [33:38:16<62:09:59,  9.21s/it]
 36%|███▌      | 13675/37963 [33:38:24<59:21:10,  8.80s/it]
 36%|███▌      | 13676/37963 [33:38:38<70:16:19, 10.42s/it]
 36%|███▌      | 13677/37963 [33:38:45<64:43:41,  9.59s/it]
 36%|███▌      | 13678/37963 [33:38:53<60:50:21,  9.02s/it]
 36%|███▌      | 13679/37963 [33:39:01<58:01:32,  8.60s/it]
 36%|███▌      | 13680/37963 [33:39:08<56:05:01,  8.31s/it]
                                                           
{'loss': '0.1705', 'grad_norm': '1.4', 'learning_rate': '1.48e-05', 'epoch': '0.3604'}
+
 36%|███▌      | 13680/37963 [33:39:08<56:05:01,  8.31s/it]
 36%|███▌      | 13681/37963 [33:39:24<69:59:58, 10.38s/it]
 36%|███▌      | 13682/37963 [33:39:31<64:07:12,  9.51s/it]
 36%|███▌      | 13683/37963 [33:39:45<73:40:29, 10.92s/it]
 36%|███▌      | 13684/37963 [33:39:53<66:57:29,  9.93s/it]
 36%|███▌      | 13685/37963 [33:40:00<62:07:43,  9.21s/it]
 36%|███▌      | 13686/37963 [33:40:08<58:53:13,  8.73s/it]
 36%|███▌      | 13687/37963 [33:40:16<56:42:13,  8.41s/it]
 36%|███▌      | 13688/37963 [33:40:24<55:33:26,  8.24s/it]
 36%|███▌      | 13689/37963 [33:40:31<54:37:26,  8.10s/it]
 36%|███▌      | 13690/37963 [33:40:46<68:11:33, 10.11s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '3.231', 'learning_rate': '1.48e-05', 'epoch': '0.3606'}
+
 36%|███▌      | 13690/37963 [33:40:46<68:11:33, 10.11s/it]
 36%|███▌      | 13691/37963 [33:40:54<63:13:47,  9.38s/it]
 36%|███▌      | 13692/37963 [33:41:01<59:50:19,  8.88s/it]
 36%|███▌      | 13693/37963 [33:41:09<57:14:53,  8.49s/it]
 36%|███▌      | 13694/37963 [33:41:17<55:41:50,  8.26s/it]
 36%|███▌      | 13695/37963 [33:41:24<54:26:11,  8.08s/it]
 36%|███▌      | 13696/37963 [33:41:39<66:34:03,  9.88s/it]
 36%|███▌      | 13697/37963 [33:41:46<62:12:46,  9.23s/it]
 36%|███▌      | 13698/37963 [33:41:54<58:54:58,  8.74s/it]
 36%|███▌      | 13699/37963 [33:42:02<56:48:37,  8.43s/it]
 36%|███▌      | 13700/37963 [33:42:09<55:15:54,  8.20s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '1.267', 'learning_rate': '1.479e-05', 'epoch': '0.3609'}
+
 36%|███▌      | 13700/37963 [33:42:09<55:15:54,  8.20s/it]
 36%|███▌      | 13701/37963 [33:42:17<54:19:20,  8.06s/it]
 36%|███▌      | 13702/37963 [33:42:25<53:51:37,  7.99s/it]
 36%|███▌      | 13703/37963 [33:42:32<53:12:04,  7.89s/it]
 36%|███▌      | 13704/37963 [33:42:47<66:17:36,  9.84s/it]
 36%|███▌      | 13705/37963 [33:42:55<62:40:09,  9.30s/it]
 36%|███▌      | 13706/37963 [33:43:02<59:15:43,  8.80s/it]
 36%|███▌      | 13707/37963 [33:43:10<56:55:45,  8.45s/it]
 36%|███▌      | 13708/37963 [33:43:18<55:01:03,  8.17s/it]
 36%|███▌      | 13709/37963 [33:43:25<54:15:08,  8.05s/it]
 36%|███▌      | 13710/37963 [33:43:33<53:15:56,  7.91s/it]
                                                           
{'loss': '0.158', 'grad_norm': '3.68', 'learning_rate': '1.478e-05', 'epoch': '0.3611'}
+
 36%|███▌      | 13710/37963 [33:43:33<53:15:56,  7.91s/it]
 36%|███▌      | 13711/37963 [33:43:41<52:42:07,  7.82s/it]
 36%|███▌      | 13712/37963 [33:43:48<52:21:57,  7.77s/it]
 36%|███▌      | 13713/37963 [33:43:56<52:08:05,  7.74s/it]
 36%|███▌      | 13714/37963 [33:44:04<52:02:51,  7.73s/it]
 36%|███▌      | 13715/37963 [33:44:11<51:45:26,  7.68s/it]
 36%|███▌      | 13716/37963 [33:44:19<51:58:01,  7.72s/it]
 36%|███▌      | 13717/37963 [33:44:27<51:55:20,  7.71s/it]
 36%|███▌      | 13718/37963 [33:44:42<66:30:26,  9.88s/it]
 36%|███▌      | 13719/37963 [33:44:50<62:32:10,  9.29s/it]
 36%|███▌      | 13720/37963 [33:45:04<72:12:10, 10.72s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '1.281', 'learning_rate': '1.477e-05', 'epoch': '0.3614'}
+
 36%|███▌      | 13720/37963 [33:45:04<72:12:10, 10.72s/it]
 36%|███▌      | 13721/37963 [33:45:11<66:04:28,  9.81s/it]
 36%|███▌      | 13722/37963 [33:45:19<61:57:38,  9.20s/it]
 36%|███▌      | 13723/37963 [33:45:34<73:14:41, 10.88s/it]
 36%|███▌      | 13724/37963 [33:45:42<66:53:02,  9.93s/it]
 36%|███▌      | 13725/37963 [33:45:49<62:20:30,  9.26s/it]
 36%|███▌      | 13726/37963 [33:45:57<59:08:48,  8.79s/it]
 36%|███▌      | 13727/37963 [33:46:04<56:10:01,  8.34s/it]
 36%|███▌      | 13728/37963 [33:46:12<54:46:44,  8.14s/it]
 36%|███▌      | 13729/37963 [33:46:20<54:09:37,  8.05s/it]
 36%|███▌      | 13730/37963 [33:46:27<53:30:57,  7.95s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '1.397', 'learning_rate': '1.477e-05', 'epoch': '0.3617'}
+
 36%|███▌      | 13730/37963 [33:46:27<53:30:57,  7.95s/it]
 36%|███▌      | 13731/37963 [33:46:35<52:38:44,  7.82s/it]
 36%|███▌      | 13732/37963 [33:46:49<65:50:27,  9.78s/it]
 36%|███▌      | 13733/37963 [33:46:57<61:28:09,  9.13s/it]
 36%|███▌      | 13734/37963 [33:47:05<58:27:16,  8.69s/it]
 36%|███▌      | 13735/37963 [33:47:12<56:06:41,  8.34s/it]
 36%|███▌      | 13736/37963 [33:47:20<54:59:15,  8.17s/it]
 36%|███▌      | 13737/37963 [33:47:34<66:42:08,  9.91s/it]
 36%|███▌      | 13738/37963 [33:47:42<62:15:31,  9.25s/it]
 36%|███▌      | 13739/37963 [33:47:49<59:01:31,  8.77s/it]
 36%|███▌      | 13740/37963 [33:47:57<56:45:55,  8.44s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '3.003', 'learning_rate': '1.476e-05', 'epoch': '0.3619'}
+
 36%|███▌      | 13740/37963 [33:47:57<56:45:55,  8.44s/it]
 36%|███▌      | 13741/37963 [33:48:05<55:18:50,  8.22s/it]
 36%|███▌      | 13742/37963 [33:48:12<54:04:25,  8.04s/it]
 36%|███▌      | 13743/37963 [33:48:20<53:30:30,  7.95s/it]
 36%|███▌      | 13744/37963 [33:48:35<67:01:39,  9.96s/it]
 36%|███▌      | 13745/37963 [33:48:49<76:14:41, 11.33s/it]
 36%|███▌      | 13746/37963 [33:48:57<68:45:57, 10.22s/it]
 36%|███▌      | 13747/37963 [33:49:05<63:38:36,  9.46s/it]
 36%|███▌      | 13748/37963 [33:49:12<59:48:19,  8.89s/it]
 36%|███▌      | 13749/37963 [33:49:20<57:17:39,  8.52s/it]
 36%|███▌      | 13750/37963 [33:49:27<55:13:58,  8.21s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '1.759', 'learning_rate': '1.475e-05', 'epoch': '0.3622'}
+
 36%|███▌      | 13750/37963 [33:49:27<55:13:58,  8.21s/it]
 36%|███▌      | 13751/37963 [33:49:35<54:12:14,  8.06s/it]
 36%|███▌      | 13752/37963 [33:49:43<53:21:35,  7.93s/it]
 36%|███▌      | 13753/37963 [33:49:50<52:55:33,  7.87s/it]
 36%|███▌      | 13754/37963 [33:50:04<65:34:17,  9.75s/it]
 36%|███▌      | 13755/37963 [33:50:12<61:29:44,  9.15s/it]
 36%|███▌      | 13756/37963 [33:50:20<58:37:25,  8.72s/it]
 36%|███▌      | 13757/37963 [33:50:28<56:30:25,  8.40s/it]
 36%|███▌      | 13758/37963 [33:50:35<54:24:44,  8.09s/it]
 36%|███▌      | 13759/37963 [33:50:43<53:28:29,  7.95s/it]
 36%|███▌      | 13760/37963 [33:50:50<53:06:24,  7.90s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '5.171', 'learning_rate': '1.474e-05', 'epoch': '0.3625'}
+
 36%|███▌      | 13760/37963 [33:50:50<53:06:24,  7.90s/it]
 36%|███▌      | 13761/37963 [33:50:58<52:40:22,  7.83s/it]
 36%|███▋      | 13762/37963 [33:51:06<52:05:52,  7.75s/it]
 36%|███▋      | 13763/37963 [33:51:13<51:32:11,  7.67s/it]
 36%|███▋      | 13764/37963 [33:51:21<51:32:43,  7.67s/it]
 36%|███▋      | 13765/37963 [33:51:28<51:44:32,  7.70s/it]
 36%|███▋      | 13766/37963 [33:51:50<79:06:50, 11.77s/it]
 36%|███▋      | 13767/37963 [33:51:57<70:54:05, 10.55s/it]
 36%|███▋      | 13768/37963 [33:52:05<65:08:20,  9.69s/it]
 36%|███▋      | 13769/37963 [33:52:13<60:49:55,  9.05s/it]
 36%|███▋      | 13770/37963 [33:52:20<58:04:00,  8.64s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '1.691', 'learning_rate': '1.474e-05', 'epoch': '0.3627'}
+
 36%|███▋      | 13770/37963 [33:52:20<58:04:00,  8.64s/it]
 36%|███▋      | 13771/37963 [33:52:28<55:58:17,  8.33s/it]
 36%|███▋      | 13772/37963 [33:52:35<54:05:02,  8.05s/it]
 36%|███▋      | 13773/37963 [33:52:43<53:15:26,  7.93s/it]
 36%|███▋      | 13774/37963 [33:52:51<52:47:13,  7.86s/it]
 36%|███▋      | 13775/37963 [33:53:05<65:17:01,  9.72s/it]
 36%|███▋      | 13776/37963 [33:53:12<61:03:49,  9.09s/it]
 36%|███▋      | 13777/37963 [33:53:20<58:16:06,  8.67s/it]
 36%|███▋      | 13778/37963 [33:53:28<56:10:50,  8.36s/it]
 36%|███▋      | 13779/37963 [33:53:42<68:49:11, 10.24s/it]
 36%|███▋      | 13780/37963 [33:53:50<64:16:34,  9.57s/it]
                                                           
{'loss': '0.1724', 'grad_norm': '2.489', 'learning_rate': '1.473e-05', 'epoch': '0.363'}
+
 36%|███▋      | 13780/37963 [33:53:50<64:16:34,  9.57s/it]
 36%|███▋      | 13781/37963 [33:53:58<60:27:52,  9.00s/it]
 36%|███▋      | 13782/37963 [33:54:06<57:55:25,  8.62s/it]
 36%|███▋      | 13783/37963 [33:54:13<55:00:23,  8.19s/it]
 36%|███▋      | 13784/37963 [33:54:21<53:58:09,  8.04s/it]
 36%|███▋      | 13785/37963 [33:54:28<53:25:16,  7.95s/it]
 36%|███▋      | 13786/37963 [33:54:43<65:50:26,  9.80s/it]
 36%|███▋      | 13787/37963 [33:54:50<61:58:31,  9.23s/it]
 36%|███▋      | 13788/37963 [33:54:58<59:19:37,  8.83s/it]
 36%|███▋      | 13789/37963 [33:55:06<57:18:22,  8.53s/it]
 36%|███▋      | 13790/37963 [33:55:14<55:40:16,  8.29s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '5.206', 'learning_rate': '1.472e-05', 'epoch': '0.3632'}
+
 36%|███▋      | 13790/37963 [33:55:14<55:40:16,  8.29s/it]
 36%|███▋      | 13791/37963 [33:55:29<69:20:34, 10.33s/it]
 36%|███▋      | 13792/37963 [33:55:37<64:09:38,  9.56s/it]
 36%|███▋      | 13793/37963 [33:55:44<59:45:11,  8.90s/it]
 36%|███▋      | 13794/37963 [33:55:52<57:32:12,  8.57s/it]
 36%|███▋      | 13795/37963 [33:56:00<55:53:58,  8.33s/it]
 36%|███▋      | 13796/37963 [33:56:07<54:39:01,  8.14s/it]
 36%|███▋      | 13797/37963 [33:56:15<53:54:49,  8.03s/it]
 36%|███▋      | 13798/37963 [33:56:30<66:44:01,  9.94s/it]
 36%|███▋      | 13799/37963 [33:56:44<75:52:56, 11.31s/it]
 36%|███▋      | 13800/37963 [33:56:52<68:16:43, 10.17s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '2.907', 'learning_rate': '1.471e-05', 'epoch': '0.3635'}
+
 36%|███▋      | 13800/37963 [33:56:52<68:16:43, 10.17s/it]
 36%|███▋      | 13801/37963 [33:56:59<63:21:55,  9.44s/it]
 36%|███▋      | 13802/37963 [33:57:07<59:53:30,  8.92s/it]
 36%|███▋      | 13803/37963 [33:57:15<57:31:44,  8.57s/it]
 36%|███▋      | 13804/37963 [33:57:22<55:33:17,  8.28s/it]
 36%|███▋      | 13805/37963 [33:57:30<54:26:14,  8.11s/it]
 36%|███▋      | 13806/37963 [33:57:38<53:30:09,  7.97s/it]
 36%|███▋      | 13807/37963 [33:57:45<53:09:59,  7.92s/it]
 36%|███▋      | 13808/37963 [33:57:53<52:15:22,  7.79s/it]
 36%|███▋      | 13809/37963 [33:58:01<52:24:08,  7.81s/it]
 36%|███▋      | 13810/37963 [33:58:09<52:27:33,  7.82s/it]
                                                           
{'loss': '0.1729', 'grad_norm': '3.222', 'learning_rate': '1.471e-05', 'epoch': '0.3638'}
+
 36%|███▋      | 13810/37963 [33:58:09<52:27:33,  7.82s/it]
 36%|███▋      | 13811/37963 [33:58:16<52:24:15,  7.81s/it]
 36%|███▋      | 13812/37963 [33:58:24<51:50:18,  7.73s/it]
 36%|███▋      | 13813/37963 [33:58:32<51:52:50,  7.73s/it]
 36%|███▋      | 13814/37963 [33:58:46<65:49:52,  9.81s/it]
 36%|███▋      | 13815/37963 [33:58:54<62:04:59,  9.26s/it]
 36%|███▋      | 13816/37963 [33:59:02<58:57:25,  8.79s/it]
 36%|███▋      | 13817/37963 [33:59:10<56:46:15,  8.46s/it]
 36%|███▋      | 13818/37963 [33:59:25<70:26:34, 10.50s/it]
 36%|███▋      | 13819/37963 [33:59:33<64:57:37,  9.69s/it]
 36%|███▋      | 13820/37963 [33:59:41<61:11:42,  9.12s/it]
                                                           
{'loss': '0.1675', 'grad_norm': '3.437', 'learning_rate': '1.47e-05', 'epoch': '0.364'}
+
 36%|███▋      | 13820/37963 [33:59:41<61:11:42,  9.12s/it]
 36%|███▋      | 13821/37963 [33:59:48<58:26:06,  8.71s/it]
 36%|███▋      | 13822/37963 [33:59:56<55:51:16,  8.33s/it]
 36%|███▋      | 13823/37963 [34:00:03<54:25:36,  8.12s/it]
 36%|███▋      | 13824/37963 [34:00:18<68:22:58, 10.20s/it]
 36%|███▋      | 13825/37963 [34:00:26<63:00:11,  9.40s/it]
 36%|███▋      | 13826/37963 [34:00:34<59:40:32,  8.90s/it]
 36%|███▋      | 13827/37963 [34:00:41<57:12:44,  8.53s/it]
 36%|███▋      | 13828/37963 [34:00:56<68:34:09, 10.23s/it]
 36%|███▋      | 13829/37963 [34:01:03<63:28:17,  9.47s/it]
 36%|███▋      | 13830/37963 [34:01:11<59:43:41,  8.91s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '1.429', 'learning_rate': '1.469e-05', 'epoch': '0.3643'}
+
 36%|███▋      | 13830/37963 [34:01:11<59:43:41,  8.91s/it]
 36%|███▋      | 13831/37963 [34:01:19<57:30:50,  8.58s/it]
 36%|███▋      | 13832/37963 [34:01:26<55:52:27,  8.34s/it]
 36%|███▋      | 13833/37963 [34:01:34<54:51:45,  8.19s/it]
 36%|███▋      | 13834/37963 [34:01:42<53:47:28,  8.03s/it]
 36%|███▋      | 13835/37963 [34:01:50<53:13:43,  7.94s/it]
 36%|███▋      | 13836/37963 [34:01:57<52:45:21,  7.87s/it]
 36%|███▋      | 13837/37963 [34:02:05<52:11:01,  7.79s/it]
 36%|███▋      | 13838/37963 [34:02:13<51:49:37,  7.73s/it]
 36%|███▋      | 13839/37963 [34:02:27<65:31:34,  9.78s/it]
 36%|███▋      | 13840/37963 [34:02:34<60:28:27,  9.02s/it]
                                                           
{'loss': '0.166', 'grad_norm': '1.231', 'learning_rate': '1.468e-05', 'epoch': '0.3646'}
+
 36%|███▋      | 13840/37963 [34:02:34<60:28:27,  9.02s/it]
 36%|███▋      | 13841/37963 [34:02:42<57:45:39,  8.62s/it]
 36%|███▋      | 13842/37963 [34:02:50<56:01:44,  8.36s/it]
 36%|███▋      | 13843/37963 [34:03:05<69:29:16, 10.37s/it]
 36%|███▋      | 13844/37963 [34:03:13<64:07:49,  9.57s/it]
 36%|███▋      | 13845/37963 [34:03:20<60:16:54,  9.00s/it]
 36%|███▋      | 13846/37963 [34:03:28<57:39:44,  8.61s/it]
 36%|███▋      | 13847/37963 [34:03:36<55:47:21,  8.33s/it]
 36%|███▋      | 13848/37963 [34:03:43<54:25:06,  8.12s/it]
 36%|███▋      | 13849/37963 [34:03:51<53:29:07,  7.98s/it]
 36%|███▋      | 13850/37963 [34:03:59<52:50:15,  7.89s/it]
                                                           
{'loss': '0.1727', 'grad_norm': '1.862', 'learning_rate': '1.467e-05', 'epoch': '0.3648'}
+
 36%|███▋      | 13850/37963 [34:03:59<52:50:15,  7.89s/it]
 36%|███▋      | 13851/37963 [34:04:06<52:21:20,  7.82s/it]
 36%|███▋      | 13852/37963 [34:04:21<65:25:55,  9.77s/it]
 36%|███▋      | 13853/37963 [34:04:35<74:41:11, 11.15s/it]
 36%|███▋      | 13854/37963 [34:04:43<67:46:54, 10.12s/it]
 36%|███▋      | 13855/37963 [34:04:50<62:48:21,  9.38s/it]
 36%|███▋      | 13856/37963 [34:04:58<59:23:26,  8.87s/it]
 37%|███▋      | 13857/37963 [34:05:06<57:03:34,  8.52s/it]
 37%|███▋      | 13858/37963 [34:05:13<55:27:58,  8.28s/it]
 37%|███▋      | 13859/37963 [34:05:21<54:24:40,  8.13s/it]
 37%|███▋      | 13860/37963 [34:05:29<52:48:07,  7.89s/it]
                                                           
{'loss': '0.1602', 'grad_norm': '2.807', 'learning_rate': '1.467e-05', 'epoch': '0.3651'}
+
 37%|███▋      | 13860/37963 [34:05:29<52:48:07,  7.89s/it]
 37%|███▋      | 13861/37963 [34:05:36<52:25:01,  7.83s/it]
 37%|███▋      | 13862/37963 [34:05:51<66:18:29,  9.90s/it]
 37%|███▋      | 13863/37963 [34:05:59<61:36:36,  9.20s/it]
 37%|███▋      | 13864/37963 [34:06:06<58:23:50,  8.72s/it]
 37%|███▋      | 13865/37963 [34:06:14<56:06:47,  8.38s/it]
 37%|███▋      | 13866/37963 [34:06:21<54:46:39,  8.18s/it]
 37%|███▋      | 13867/37963 [34:06:29<53:52:15,  8.05s/it]
 37%|███▋      | 13868/37963 [34:06:51<80:44:49, 12.06s/it]
 37%|███▋      | 13869/37963 [34:06:58<72:09:07, 10.78s/it]
 37%|███▋      | 13870/37963 [34:07:06<65:51:14,  9.84s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '1.421', 'learning_rate': '1.466e-05', 'epoch': '0.3654'}
+
 37%|███▋      | 13870/37963 [34:07:06<65:51:14,  9.84s/it]
 37%|███▋      | 13871/37963 [34:07:14<61:32:10,  9.20s/it]
 37%|███▋      | 13872/37963 [34:07:22<58:38:53,  8.76s/it]
 37%|███▋      | 13873/37963 [34:07:29<56:36:04,  8.46s/it]
 37%|███▋      | 13874/37963 [34:07:37<55:05:47,  8.23s/it]
 37%|███▋      | 13875/37963 [34:07:45<54:09:34,  8.09s/it]
 37%|███▋      | 13876/37963 [34:07:52<53:15:28,  7.96s/it]
 37%|███▋      | 13877/37963 [34:08:00<52:55:04,  7.91s/it]
 37%|███▋      | 13878/37963 [34:08:08<52:27:08,  7.84s/it]
 37%|███▋      | 13879/37963 [34:08:22<64:56:37,  9.71s/it]
 37%|███▋      | 13880/37963 [34:08:30<60:44:24,  9.08s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '3.375', 'learning_rate': '1.465e-05', 'epoch': '0.3656'}
+
 37%|███▋      | 13880/37963 [34:08:30<60:44:24,  9.08s/it]
 37%|███▋      | 13881/37963 [34:08:37<57:44:01,  8.63s/it]
 37%|███▋      | 13882/37963 [34:08:45<56:00:34,  8.37s/it]
 37%|███▋      | 13883/37963 [34:08:53<54:44:19,  8.18s/it]
 37%|███▋      | 13884/37963 [34:09:00<53:36:58,  8.02s/it]
 37%|███▋      | 13885/37963 [34:09:08<52:50:39,  7.90s/it]
 37%|███▋      | 13886/37963 [34:09:22<65:40:51,  9.82s/it]
 37%|███▋      | 13887/37963 [34:09:30<61:33:08,  9.20s/it]
 37%|███▋      | 13888/37963 [34:09:38<58:29:29,  8.75s/it]
 37%|███▋      | 13889/37963 [34:09:45<56:13:30,  8.41s/it]
 37%|███▋      | 13890/37963 [34:09:53<54:47:41,  8.19s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '2.467', 'learning_rate': '1.464e-05', 'epoch': '0.3659'}
+
 37%|███▋      | 13890/37963 [34:09:53<54:47:41,  8.19s/it]
 37%|███▋      | 13891/37963 [34:10:00<53:13:16,  7.96s/it]
 37%|███▋      | 13892/37963 [34:10:08<52:35:23,  7.87s/it]
 37%|███▋      | 13893/37963 [34:10:23<66:10:20,  9.90s/it]
 37%|███▋      | 13894/37963 [34:10:30<61:48:35,  9.24s/it]
 37%|███▋      | 13895/37963 [34:10:38<58:33:13,  8.76s/it]
 37%|███▋      | 13896/37963 [34:10:46<56:18:35,  8.42s/it]
 37%|███▋      | 13897/37963 [34:10:53<53:57:54,  8.07s/it]
 37%|███▋      | 13898/37963 [34:11:01<53:17:16,  7.97s/it]
 37%|███▋      | 13899/37963 [34:11:08<52:47:59,  7.90s/it]
 37%|███▋      | 13900/37963 [34:11:16<52:12:53,  7.81s/it]
                                                           
{'loss': '0.157', 'grad_norm': '2.697', 'learning_rate': '1.464e-05', 'epoch': '0.3661'}
+
 37%|███▋      | 13900/37963 [34:11:16<52:12:53,  7.81s/it]
 37%|███▋      | 13901/37963 [34:11:24<51:51:18,  7.76s/it]
 37%|███▋      | 13902/37963 [34:11:38<64:36:36,  9.67s/it]
 37%|███▋      | 13903/37963 [34:11:46<60:51:52,  9.11s/it]
 37%|███▋      | 13904/37963 [34:12:00<71:12:13, 10.65s/it]
 37%|███▋      | 13905/37963 [34:12:07<65:11:53,  9.76s/it]
 37%|███▋      | 13906/37963 [34:12:15<61:00:30,  9.13s/it]
 37%|███▋      | 13907/37963 [34:12:23<57:32:15,  8.61s/it]
 37%|███▋      | 13908/37963 [34:12:30<55:53:42,  8.37s/it]
 37%|███▋      | 13909/37963 [34:12:38<54:35:43,  8.17s/it]
 37%|███▋      | 13910/37963 [34:12:46<53:13:55,  7.97s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '0.8628', 'learning_rate': '1.463e-05', 'epoch': '0.3664'}
+
 37%|███▋      | 13910/37963 [34:12:46<53:13:55,  7.97s/it]
 37%|███▋      | 13911/37963 [34:12:53<52:39:43,  7.88s/it]
 37%|███▋      | 13912/37963 [34:13:08<66:59:00, 10.03s/it]
 37%|███▋      | 13913/37963 [34:13:16<62:11:43,  9.31s/it]
 37%|███▋      | 13914/37963 [34:13:24<59:00:42,  8.83s/it]
 37%|███▋      | 13915/37963 [34:13:31<56:45:39,  8.50s/it]
 37%|███▋      | 13916/37963 [34:13:46<69:39:32, 10.43s/it]
 37%|███▋      | 13917/37963 [34:13:54<63:50:17,  9.56s/it]
 37%|███▋      | 13918/37963 [34:14:01<60:01:47,  8.99s/it]
 37%|███▋      | 13919/37963 [34:14:09<57:18:23,  8.58s/it]
 37%|███▋      | 13920/37963 [34:14:17<55:19:45,  8.28s/it]
                                                           
{'loss': '0.1648', 'grad_norm': '3.637', 'learning_rate': '1.462e-05', 'epoch': '0.3667'}
+
 37%|███▋      | 13920/37963 [34:14:17<55:19:45,  8.28s/it]
 37%|███▋      | 13921/37963 [34:14:31<68:22:47, 10.24s/it]
 37%|███▋      | 13922/37963 [34:14:39<63:16:08,  9.47s/it]
 37%|███▋      | 13923/37963 [34:14:46<58:52:58,  8.82s/it]
 37%|███▋      | 13924/37963 [34:14:54<56:29:16,  8.46s/it]
 37%|███▋      | 13925/37963 [34:15:02<54:51:07,  8.21s/it]
 37%|███▋      | 13926/37963 [34:15:09<53:38:16,  8.03s/it]
 37%|███▋      | 13927/37963 [34:15:17<52:57:21,  7.93s/it]
 37%|███▋      | 13928/37963 [34:15:25<52:18:24,  7.83s/it]
 37%|███▋      | 13929/37963 [34:15:32<51:24:48,  7.70s/it]
 37%|███▋      | 13930/37963 [34:15:46<64:19:59,  9.64s/it]
                                                           
{'loss': '0.1689', 'grad_norm': '1.151', 'learning_rate': '1.461e-05', 'epoch': '0.3669'}
+
 37%|███▋      | 13930/37963 [34:15:46<64:19:59,  9.64s/it]
 37%|███▋      | 13931/37963 [34:15:54<60:38:21,  9.08s/it]
 37%|███▋      | 13932/37963 [34:16:02<57:37:26,  8.63s/it]
 37%|███▋      | 13933/37963 [34:16:09<55:39:46,  8.34s/it]
 37%|███▋      | 13934/37963 [34:16:17<54:30:47,  8.17s/it]
 37%|███▋      | 13935/37963 [34:16:25<53:34:07,  8.03s/it]
 37%|███▋      | 13936/37963 [34:16:32<52:47:38,  7.91s/it]
 37%|███▋      | 13937/37963 [34:16:40<52:10:59,  7.82s/it]
 37%|███▋      | 13938/37963 [34:16:54<65:08:09,  9.76s/it]
 37%|███▋      | 13939/37963 [34:17:02<61:09:48,  9.17s/it]
 37%|███▋      | 13940/37963 [34:17:16<71:28:28, 10.71s/it]
                                                           
{'loss': '0.1651', 'grad_norm': '0.7811', 'learning_rate': '1.461e-05', 'epoch': '0.3672'}
+
 37%|███▋      | 13940/37963 [34:17:16<71:28:28, 10.71s/it]
 37%|███▋      | 13941/37963 [34:17:24<65:38:56,  9.84s/it]
 37%|███▋      | 13942/37963 [34:17:32<61:06:22,  9.16s/it]
 37%|███▋      | 13943/37963 [34:17:39<58:07:47,  8.71s/it]
 37%|███▋      | 13944/37963 [34:17:47<56:09:57,  8.42s/it]
 37%|███▋      | 13945/37963 [34:17:54<54:11:45,  8.12s/it]
 37%|███▋      | 13946/37963 [34:18:02<52:26:39,  7.86s/it]
 37%|███▋      | 13947/37963 [34:18:09<51:56:10,  7.79s/it]
 37%|███▋      | 13948/37963 [34:18:17<51:53:34,  7.78s/it]
 37%|███▋      | 13949/37963 [34:18:25<51:46:06,  7.76s/it]
 37%|███▋      | 13950/37963 [34:18:39<64:30:44,  9.67s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '2.781', 'learning_rate': '1.46e-05', 'epoch': '0.3675'}
+
 37%|███▋      | 13950/37963 [34:18:39<64:30:44,  9.67s/it]
 37%|███▋      | 13951/37963 [34:18:47<60:27:06,  9.06s/it]
 37%|███▋      | 13952/37963 [34:19:01<70:47:49, 10.61s/it]
 37%|███▋      | 13953/37963 [34:19:08<64:51:42,  9.73s/it]
 37%|███▋      | 13954/37963 [34:19:16<61:21:36,  9.20s/it]
 37%|███▋      | 13955/37963 [34:19:31<72:27:15, 10.86s/it]
 37%|███▋      | 13956/37963 [34:19:39<66:10:34,  9.92s/it]
 37%|███▋      | 13957/37963 [34:19:46<61:08:46,  9.17s/it]
 37%|███▋      | 13958/37963 [34:19:54<57:53:41,  8.68s/it]
 37%|███▋      | 13959/37963 [34:20:02<55:52:32,  8.38s/it]
 37%|███▋      | 13960/37963 [34:20:09<54:25:21,  8.16s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '1.609', 'learning_rate': '1.459e-05', 'epoch': '0.3677'}
+
 37%|███▋      | 13960/37963 [34:20:09<54:25:21,  8.16s/it]
 37%|███▋      | 13961/37963 [34:20:17<53:17:27,  7.99s/it]
 37%|███▋      | 13962/37963 [34:20:24<52:32:38,  7.88s/it]
 37%|███▋      | 13963/37963 [34:20:32<51:38:46,  7.75s/it]
 37%|███▋      | 13964/37963 [34:20:40<51:25:45,  7.71s/it]
 37%|███▋      | 13965/37963 [34:20:47<51:13:52,  7.69s/it]
 37%|███▋      | 13966/37963 [34:20:55<51:05:26,  7.66s/it]
 37%|███▋      | 13967/37963 [34:21:10<65:53:04,  9.88s/it]
 37%|███▋      | 13968/37963 [34:21:18<62:02:44,  9.31s/it]
 37%|███▋      | 13969/37963 [34:21:26<58:59:42,  8.85s/it]
 37%|███▋      | 13970/37963 [34:21:40<70:23:58, 10.56s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '1.364', 'learning_rate': '1.458e-05', 'epoch': '0.368'}
+
 37%|███▋      | 13970/37963 [34:21:40<70:23:58, 10.56s/it]
 37%|███▋      | 13971/37963 [34:21:48<65:10:55,  9.78s/it]
 37%|███▋      | 13972/37963 [34:21:56<60:43:32,  9.11s/it]
 37%|███▋      | 13973/37963 [34:22:03<57:53:01,  8.69s/it]
 37%|███▋      | 13974/37963 [34:22:11<55:43:45,  8.36s/it]
 37%|███▋      | 13975/37963 [34:22:19<54:45:00,  8.22s/it]
 37%|███▋      | 13976/37963 [34:22:26<53:13:26,  7.99s/it]
 37%|███▋      | 13977/37963 [34:22:34<52:16:24,  7.85s/it]
 37%|███▋      | 13978/37963 [34:22:48<65:03:22,  9.76s/it]
 37%|███▋      | 13979/37963 [34:22:56<60:48:55,  9.13s/it]
 37%|███▋      | 13980/37963 [34:23:03<58:11:48,  8.74s/it]
                                                           
{'loss': '0.1602', 'grad_norm': '0.9818', 'learning_rate': '1.458e-05', 'epoch': '0.3683'}
+
 37%|███▋      | 13980/37963 [34:23:03<58:11:48,  8.74s/it]
 37%|███▋      | 13981/37963 [34:23:11<56:02:31,  8.41s/it]
 37%|███▋      | 13982/37963 [34:23:19<54:35:10,  8.19s/it]
 37%|███▋      | 13983/37963 [34:23:26<53:25:22,  8.02s/it]
 37%|███▋      | 13984/37963 [34:23:41<66:05:08,  9.92s/it]
 37%|███▋      | 13985/37963 [34:23:49<62:02:25,  9.31s/it]
 37%|███▋      | 13986/37963 [34:23:56<58:11:20,  8.74s/it]
 37%|███▋      | 13987/37963 [34:24:04<56:04:11,  8.42s/it]
 37%|███▋      | 13988/37963 [34:24:19<68:49:08, 10.33s/it]
 37%|███▋      | 13989/37963 [34:24:26<63:28:36,  9.53s/it]
 37%|███▋      | 13990/37963 [34:24:34<59:38:21,  8.96s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '1.96', 'learning_rate': '1.457e-05', 'epoch': '0.3685'}
+
 37%|███▋      | 13990/37963 [34:24:34<59:38:21,  8.96s/it]
 37%|███▋      | 13991/37963 [34:24:42<57:09:11,  8.58s/it]
 37%|███▋      | 13992/37963 [34:24:49<55:08:51,  8.28s/it]
 37%|███▋      | 13993/37963 [34:24:57<53:45:13,  8.07s/it]
 37%|███▋      | 13994/37963 [34:25:04<52:49:39,  7.93s/it]
 37%|███▋      | 13995/37963 [34:25:12<51:44:47,  7.77s/it]
 37%|███▋      | 13996/37963 [34:25:19<51:00:30,  7.66s/it]
 37%|███▋      | 13997/37963 [34:25:27<51:04:50,  7.67s/it]
 37%|███▋      | 13998/37963 [34:25:34<50:57:42,  7.66s/it]
 37%|███▋      | 13999/37963 [34:25:42<50:53:06,  7.64s/it]
 37%|███▋      | 14000/37963 [34:25:56<64:01:52,  9.62s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '0.9786', 'learning_rate': '1.456e-05', 'epoch': '0.3688'}
+
 37%|███▋      | 14000/37963 [34:25:56<64:01:52,  9.62s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.60s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.60s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 37%|███▋      | 14001/37963 [34:26:51<154:32:54, 23.22s/it]
 37%|███▋      | 14002/37963 [34:26:59<123:30:54, 18.56s/it]
 37%|███▋      | 14003/37963 [34:27:14<116:47:42, 17.55s/it]
 37%|███▋      | 14004/37963 [34:27:28<110:16:19, 16.57s/it]
 37%|███▋      | 14005/37963 [34:27:36<92:42:59, 13.93s/it] 
 37%|███▋      | 14006/37963 [34:27:44<79:56:05, 12.01s/it]
 37%|███▋      | 14007/37963 [34:27:51<71:19:20, 10.72s/it]
 37%|███▋      | 14008/37963 [34:27:59<65:07:31,  9.79s/it]
 37%|███▋      | 14009/37963 [34:28:07<60:45:04,  9.13s/it]
 37%|███▋      | 14010/37963 [34:28:14<57:51:04,  8.69s/it]
                                                           
{'loss': '0.1757', 'grad_norm': '2.05', 'learning_rate': '1.455e-05', 'epoch': '0.369'}
+
 37%|███▋      | 14010/37963 [34:28:14<57:51:04,  8.69s/it]
 37%|███▋      | 14011/37963 [34:28:29<69:58:15, 10.52s/it]
 37%|███▋      | 14012/37963 [34:28:37<64:16:48,  9.66s/it]
 37%|███▋      | 14013/37963 [34:28:44<60:18:40,  9.07s/it]
 37%|███▋      | 14014/37963 [34:28:52<57:38:41,  8.67s/it]
 37%|███▋      | 14015/37963 [34:29:00<55:39:11,  8.37s/it]
 37%|███▋      | 14016/37963 [34:29:07<53:51:45,  8.10s/it]
 37%|███▋      | 14017/37963 [34:29:15<52:54:46,  7.95s/it]
 37%|███▋      | 14018/37963 [34:29:23<52:27:02,  7.89s/it]
 37%|███▋      | 14019/37963 [34:29:30<51:52:38,  7.80s/it]
 37%|███▋      | 14020/37963 [34:29:45<65:47:32,  9.89s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '0.6663', 'learning_rate': '1.455e-05', 'epoch': '0.3693'}
+
 37%|███▋      | 14020/37963 [34:29:45<65:47:32,  9.89s/it]
 37%|███▋      | 14021/37963 [34:29:53<61:35:15,  9.26s/it]
 37%|███▋      | 14022/37963 [34:30:00<58:02:57,  8.73s/it]
 37%|███▋      | 14023/37963 [34:30:08<56:04:08,  8.43s/it]
 37%|███▋      | 14024/37963 [34:30:16<54:40:38,  8.22s/it]
 37%|███▋      | 14025/37963 [34:30:23<53:28:40,  8.04s/it]
 37%|███▋      | 14026/37963 [34:30:31<52:12:55,  7.85s/it]
 37%|███▋      | 14027/37963 [34:30:38<51:44:33,  7.78s/it]
 37%|███▋      | 14028/37963 [34:30:52<64:20:25,  9.68s/it]
 37%|███▋      | 14029/37963 [34:31:07<73:33:16, 11.06s/it]
 37%|███▋      | 14030/37963 [34:31:14<66:26:30,  9.99s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '1.056', 'learning_rate': '1.454e-05', 'epoch': '0.3696'}
+
 37%|███▋      | 14030/37963 [34:31:14<66:26:30,  9.99s/it]
 37%|███▋      | 14031/37963 [34:31:22<61:36:24,  9.27s/it]
 37%|███▋      | 14032/37963 [34:31:36<71:53:53, 10.82s/it]
 37%|███▋      | 14033/37963 [34:31:44<65:42:06,  9.88s/it]
 37%|███▋      | 14034/37963 [34:31:52<61:20:53,  9.23s/it]
 37%|███▋      | 14035/37963 [34:31:59<58:19:17,  8.77s/it]
 37%|███▋      | 14036/37963 [34:32:07<56:10:45,  8.45s/it]
 37%|███▋      | 14037/37963 [34:32:15<54:34:12,  8.21s/it]
 37%|███▋      | 14038/37963 [34:32:22<53:23:23,  8.03s/it]
 37%|███▋      | 14039/37963 [34:32:30<52:34:24,  7.91s/it]
 37%|███▋      | 14040/37963 [34:32:38<52:04:25,  7.84s/it]
                                                           
{'loss': '0.1638', 'grad_norm': '4.76', 'learning_rate': '1.453e-05', 'epoch': '0.3698'}
+
 37%|███▋      | 14040/37963 [34:32:38<52:04:25,  7.84s/it]
 37%|███▋      | 14041/37963 [34:32:45<51:43:06,  7.78s/it]
 37%|███▋      | 14042/37963 [34:32:53<51:25:57,  7.74s/it]
 37%|███▋      | 14043/37963 [34:33:01<51:09:54,  7.70s/it]
 37%|███▋      | 14044/37963 [34:33:15<64:12:02,  9.66s/it]
 37%|███▋      | 14045/37963 [34:33:23<60:18:14,  9.08s/it]
 37%|███▋      | 14046/37963 [34:33:30<56:49:51,  8.55s/it]
 37%|███▋      | 14047/37963 [34:33:37<54:37:46,  8.22s/it]
 37%|██��▋      | 14048/37963 [34:33:45<52:56:56,  7.97s/it]
 37%|███▋      | 14049/37963 [34:33:52<52:23:54,  7.89s/it]
 37%|███▋      | 14050/37963 [34:34:00<51:36:21,  7.77s/it]
                                                           
{'loss': '0.1757', 'grad_norm': '1.218', 'learning_rate': '1.452e-05', 'epoch': '0.3701'}
+
 37%|███▋      | 14050/37963 [34:34:00<51:36:21,  7.77s/it]
 37%|███▋      | 14051/37963 [34:34:08<51:28:44,  7.75s/it]
 37%|███▋      | 14052/37963 [34:34:15<51:19:40,  7.73s/it]
 37%|███▋      | 14053/37963 [34:34:23<51:17:06,  7.72s/it]
 37%|███▋      | 14054/37963 [34:34:37<64:17:58,  9.68s/it]
 37%|███▋      | 14055/37963 [34:34:45<60:24:19,  9.10s/it]
 37%|███▋      | 14056/37963 [34:34:59<70:54:43, 10.68s/it]
 37%|███▋      | 14057/37963 [34:35:07<65:06:06,  9.80s/it]
 37%|███▋      | 14058/37963 [34:35:15<60:55:55,  9.18s/it]
 37%|███▋      | 14059/37963 [34:35:30<72:09:06, 10.87s/it]
 37%|███▋      | 14060/37963 [34:35:37<65:48:07,  9.91s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '1.921', 'learning_rate': '1.452e-05', 'epoch': '0.3704'}
+
 37%|███▋      | 14060/37963 [34:35:37<65:48:07,  9.91s/it]
 37%|███▋      | 14061/37963 [34:35:45<61:23:28,  9.25s/it]
 37%|███▋      | 14062/37963 [34:35:53<58:26:37,  8.80s/it]
 37%|███▋      | 14063/37963 [34:36:00<56:16:28,  8.48s/it]
 37%|███▋      | 14064/37963 [34:36:08<54:50:47,  8.26s/it]
 37%|███▋      | 14065/37963 [34:36:16<53:39:04,  8.08s/it]
 37%|███▋      | 14066/37963 [34:36:24<52:57:26,  7.98s/it]
 37%|███▋      | 14067/37963 [34:36:38<66:09:32,  9.97s/it]
 37%|███▋      | 14068/37963 [34:36:46<61:36:18,  9.28s/it]
 37%|███▋      | 14069/37963 [34:36:54<58:14:51,  8.78s/it]
 37%|███▋      | 14070/37963 [34:37:01<55:56:02,  8.43s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '2.116', 'learning_rate': '1.451e-05', 'epoch': '0.3706'}
+
 37%|███▋      | 14070/37963 [34:37:01<55:56:02,  8.43s/it]
 37%|███▋      | 14071/37963 [34:37:09<54:27:05,  8.20s/it]
 37%|███▋      | 14072/37963 [34:37:17<53:39:18,  8.08s/it]
 37%|███▋      | 14073/37963 [34:37:31<66:44:49, 10.06s/it]
 37%|███▋      | 14074/37963 [34:37:39<62:10:01,  9.37s/it]
 37%|███▋      | 14075/37963 [34:37:47<59:01:47,  8.90s/it]
 37%|███▋      | 14076/37963 [34:37:55<56:43:31,  8.55s/it]
 37%|███▋      | 14077/37963 [34:38:02<55:03:04,  8.30s/it]
 37%|███▋      | 14078/37963 [34:38:10<53:45:08,  8.10s/it]
 37%|███▋      | 14079/37963 [34:38:24<66:11:12,  9.98s/it]
 37%|███▋      | 14080/37963 [34:38:38<74:32:09, 11.24s/it]
                                                           
{'loss': '0.1678', 'grad_norm': '1.382', 'learning_rate': '1.45e-05', 'epoch': '0.3709'}
+
 37%|███▋      | 14080/37963 [34:38:38<74:32:09, 11.24s/it]
 37%|███▋      | 14081/37963 [34:38:46<67:32:19, 10.18s/it]
 37%|███▋      | 14082/37963 [34:38:54<62:27:52,  9.42s/it]
 37%|███▋      | 14083/37963 [34:39:01<58:54:32,  8.88s/it]
 37%|███▋      | 14084/37963 [34:39:09<56:04:20,  8.45s/it]
 37%|███▋      | 14085/37963 [34:39:17<54:33:39,  8.23s/it]
 37%|███▋      | 14086/37963 [34:39:24<53:30:02,  8.07s/it]
 37%|███▋      | 14087/37963 [34:39:32<52:37:23,  7.93s/it]
 37%|███▋      | 14088/37963 [34:39:40<52:05:31,  7.85s/it]
 37%|███▋      | 14089/37963 [34:39:54<65:15:59,  9.84s/it]
 37%|███▋      | 14090/37963 [34:40:02<60:41:58,  9.15s/it]
                                                           
{'loss': '0.1636', 'grad_norm': '1.854', 'learning_rate': '1.449e-05', 'epoch': '0.3712'}
+
 37%|███▋      | 14090/37963 [34:40:02<60:41:58,  9.15s/it]
 37%|███▋      | 14091/37963 [34:40:09<57:41:10,  8.70s/it]
 37%|███▋      | 14092/37963 [34:40:17<55:39:17,  8.39s/it]
 37%|███▋      | 14093/37963 [34:40:24<53:51:04,  8.12s/it]
 37%|███▋      | 14094/37963 [34:40:32<52:17:25,  7.89s/it]
 37%|███▋      | 14095/37963 [34:40:39<51:54:18,  7.83s/it]
 37%|███▋      | 14096/37963 [34:40:47<51:06:52,  7.71s/it]
 37%|███▋      | 14097/37963 [34:40:54<50:43:35,  7.65s/it]
 37%|███▋      | 14098/37963 [34:41:08<63:33:07,  9.59s/it]
 37%|███▋      | 14099/37963 [34:41:16<60:01:40,  9.06s/it]
 37%|███▋      | 14100/37963 [34:41:31<70:37:05, 10.65s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '1.512', 'learning_rate': '1.449e-05', 'epoch': '0.3714'}
+
 37%|███▋      | 14100/37963 [34:41:31<70:37:05, 10.65s/it]
 37%|███▋      | 14101/37963 [34:41:39<65:01:04,  9.81s/it]
 37%|███▋      | 14102/37963 [34:41:46<60:37:32,  9.15s/it]
 37%|███▋      | 14103/37963 [34:41:54<57:32:19,  8.68s/it]
 37%|���██▋      | 14104/37963 [34:42:01<55:19:51,  8.35s/it]
 37%|███▋      | 14105/37963 [34:42:09<53:42:59,  8.11s/it]
 37%|███▋      | 14106/37963 [34:42:17<52:51:21,  7.98s/it]
 37%|███▋      | 14107/37963 [34:42:24<52:37:00,  7.94s/it]
 37%|███▋      | 14108/37963 [34:42:39<66:22:50, 10.02s/it]
 37%|███▋      | 14109/37963 [34:42:47<62:13:26,  9.39s/it]
 37%|███▋      | 14110/37963 [34:42:55<58:49:08,  8.88s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '2.324', 'learning_rate': '1.448e-05', 'epoch': '0.3717'}
+
 37%|███▋      | 14110/37963 [34:42:55<58:49:08,  8.88s/it]
 37%|███▋      | 14111/37963 [34:43:02<56:16:25,  8.49s/it]
 37%|███▋      | 14112/37963 [34:43:10<54:29:56,  8.23s/it]
 37%|███▋      | 14113/37963 [34:43:18<53:25:04,  8.06s/it]
 37%|███▋      | 14114/37963 [34:43:25<52:17:56,  7.89s/it]
 37%|███▋      | 14115/37963 [34:43:40<65:36:34,  9.90s/it]
 37%|███▋      | 14116/37963 [34:43:47<61:04:33,  9.22s/it]
 37%|███▋      | 14117/37963 [34:43:55<57:57:30,  8.75s/it]
 37%|███▋      | 14118/37963 [34:44:03<55:51:04,  8.43s/it]
 37%|███▋      | 14119/37963 [34:44:17<67:29:09, 10.19s/it]
 37%|███▋      | 14120/37963 [34:44:25<62:18:31,  9.41s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '1.69', 'learning_rate': '1.447e-05', 'epoch': '0.3719'}
+
 37%|███▋      | 14120/37963 [34:44:25<62:18:31,  9.41s/it]
 37%|███▋      | 14121/37963 [34:44:32<58:48:08,  8.88s/it]
 37%|███▋      | 14122/37963 [34:44:40<56:15:14,  8.49s/it]
 37%|███▋      | 14123/37963 [34:44:54<68:04:21, 10.28s/it]
 37%|███▋      | 14124/37963 [34:45:09<76:31:15, 11.56s/it]
 37%|███▋      | 14125/37963 [34:45:17<69:08:54, 10.44s/it]
 37%|███▋      | 14126/37963 [34:45:24<63:29:52,  9.59s/it]
 37%|███▋      | 14127/37963 [34:45:32<59:11:43,  8.94s/it]
 37%|███▋      | 14128/37963 [34:45:39<56:04:07,  8.47s/it]
 37%|███▋      | 14129/37963 [34:45:47<54:25:17,  8.22s/it]
 37%|███▋      | 14130/37963 [34:45:54<52:45:23,  7.97s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '4.621', 'learning_rate': '1.446e-05', 'epoch': '0.3722'}
+
 37%|███▋      | 14130/37963 [34:45:54<52:45:23,  7.97s/it]
 37%|███▋      | 14131/37963 [34:46:02<51:41:40,  7.81s/it]
 37%|███▋      | 14132/37963 [34:46:09<51:22:17,  7.76s/it]
 37%|███▋      | 14133/37963 [34:46:17<51:11:50,  7.73s/it]
 37%|███▋      | 14134/37963 [34:46:24<50:55:35,  7.69s/it]
 37%|███▋      | 14135/37963 [34:46:32<51:05:29,  7.72s/it]
 37%|███▋      | 14136/37963 [34:46:40<50:27:21,  7.62s/it]
 37%|███▋      | 14137/37963 [34:46:54<63:43:10,  9.63s/it]
 37%|███▋      | 14138/37963 [34:47:01<59:26:14,  8.98s/it]
 37%|███▋      | 14139/37963 [34:47:09<56:58:52,  8.61s/it]
 37%|███▋      | 14140/37963 [34:47:17<55:03:26,  8.32s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '1.662', 'learning_rate': '1.445e-05', 'epoch': '0.3725'}
+
 37%|███▋      | 14140/37963 [34:47:17<55:03:26,  8.32s/it]
 37%|███▋      | 14141/37963 [34:47:24<53:39:00,  8.11s/it]
 37%|███▋      | 14142/37963 [34:47:32<52:52:43,  7.99s/it]
 37%|███▋      | 14143/37963 [34:47:40<52:08:25,  7.88s/it]
 37%|███▋      | 14144/37963 [34:47:47<51:29:18,  7.78s/it]
 37%|███▋      | 14145/37963 [34:47:55<51:20:13,  7.76s/it]
 37%|███▋      | 14146/37963 [34:48:03<50:58:45,  7.71s/it]
 37%|███▋      | 14147/37963 [34:48:17<63:44:14,  9.63s/it]
 37%|███▋      | 14148/37963 [34:48:24<59:46:42,  9.04s/it]
 37%|███▋      | 14149/37963 [34:48:32<56:26:41,  8.53s/it]
 37%|███▋      | 14150/37963 [34:48:46<68:24:16, 10.34s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '2.006', 'learning_rate': '1.445e-05', 'epoch': '0.3727'}
+
 37%|███▋      | 14150/37963 [34:48:46<68:24:16, 10.34s/it]
 37%|███▋      | 14151/37963 [34:48:54<63:21:32,  9.58s/it]
 37%|███▋      | 14152/37963 [34:49:02<59:31:40,  9.00s/it]
 37%|███▋      | 14153/37963 [34:49:09<56:48:30,  8.59s/it]
 37%|███▋      | 14154/37963 [34:49:17<55:17:56,  8.36s/it]
 37%|███▋      | 14155/37963 [34:49:32<68:25:43, 10.35s/it]
 37%|███▋      | 14156/37963 [34:49:40<63:09:08,  9.55s/it]
 37%|███▋      | 14157/37963 [34:49:48<59:32:17,  9.00s/it]
 37%|███▋      | 14158/37963 [34:49:55<56:21:25,  8.52s/it]
 37%|███▋      | 14159/37963 [34:50:03<54:43:34,  8.28s/it]
 37%|███▋      | 14160/37963 [34:50:10<53:31:43,  8.10s/it]
                                                           
{'loss': '0.163', 'grad_norm': '1.065', 'learning_rate': '1.444e-05', 'epoch': '0.373'}
+
 37%|███▋      | 14160/37963 [34:50:10<53:31:43,  8.10s/it]
 37%|███▋      | 14161/37963 [34:50:18<52:45:10,  7.98s/it]
 37%|███▋      | 14162/37963 [34:50:26<52:15:47,  7.91s/it]
 37%|███▋      | 14163/37963 [34:50:41<66:32:47, 10.07s/it]
 37%|███▋      | 14164/37963 [34:50:49<61:46:21,  9.34s/it]
 37%|███▋      | 14165/37963 [34:50:56<58:21:34,  8.83s/it]
 37%|███▋      | 14166/37963 [34:51:04<56:09:03,  8.49s/it]
 37%|███▋      | 14167/37963 [34:51:11<54:05:25,  8.18s/it]
 37%|███▋      | 14168/37963 [34:51:26<67:39:34, 10.24s/it]
 37%|███▋      | 14169/37963 [34:51:34<61:54:10,  9.37s/it]
 37%|███▋      | 14170/37963 [34:51:41<58:35:28,  8.87s/it]
                                                           
{'loss': '0.1652', 'grad_norm': '2.404', 'learning_rate': '1.443e-05', 'epoch': '0.3733'}
+
 37%|███▋      | 14170/37963 [34:51:41<58:35:28,  8.87s/it]
 37%|███▋      | 14171/37963 [34:51:49<56:19:04,  8.52s/it]
 37%|███▋      | 14172/37963 [34:51:57<54:27:01,  8.24s/it]
 37%|███▋      | 14173/37963 [34:52:04<53:14:58,  8.06s/it]
 37%|███▋      | 14174/37963 [34:52:12<52:21:11,  7.92s/it]
 37%|███▋      | 14175/37963 [34:52:20<52:11:59,  7.90s/it]
 37%|███▋      | 14176/37963 [34:52:27<51:32:46,  7.80s/it]
 37%|███▋      | 14177/37963 [34:52:42<63:59:17,  9.68s/it]
 37%|███▋      | 14178/37963 [34:52:49<59:55:50,  9.07s/it]
 37%|███▋      | 14179/37963 [34:52:57<57:08:51,  8.65s/it]
 37%|███▋      | 14180/37963 [34:53:04<54:22:03,  8.23s/it]
                                                           
{'loss': '0.1719', 'grad_norm': '1.594', 'learning_rate': '1.442e-05', 'epoch': '0.3735'}
+
 37%|███▋      | 14180/37963 [34:53:04<54:22:03,  8.23s/it]
 37%|███▋      | 14181/37963 [34:53:12<53:32:17,  8.10s/it]
 37%|███▋      | 14182/37963 [34:53:20<52:46:23,  7.99s/it]
 37%|███▋      | 14183/37963 [34:53:27<52:02:47,  7.88s/it]
 37%|███▋      | 14184/37963 [34:53:35<51:36:59,  7.81s/it]
 37%|███▋      | 14185/37963 [34:53:43<51:21:49,  7.78s/it]
 37%|███▋      | 14186/37963 [34:53:50<51:23:22,  7.78s/it]
 37%|███▋      | 14187/37963 [34:53:58<51:26:34,  7.79s/it]
 37%|███▋      | 14188/37963 [34:54:12<64:17:46,  9.74s/it]
 37%|███▋      | 14189/37963 [34:54:20<60:20:51,  9.14s/it]
 37%|███▋      | 14190/37963 [34:54:28<57:30:43,  8.71s/it]
                                                           
{'loss': '0.147', 'grad_norm': '1.384', 'learning_rate': '1.442e-05', 'epoch': '0.3738'}
+
 37%|███▋      | 14190/37963 [34:54:28<57:30:43,  8.71s/it]
 37%|███▋      | 14191/37963 [34:54:36<55:28:27,  8.40s/it]
 37%|███▋      | 14192/37963 [34:54:43<54:07:06,  8.20s/it]
 37%|███▋      | 14193/37963 [34:54:51<52:40:23,  7.98s/it]
 37%|███▋      | 14194/37963 [34:54:58<52:08:44,  7.90s/it]
 37%|███▋      | 14195/37963 [34:55:06<51:43:50,  7.84s/it]
 37%|███▋      | 14196/37963 [34:55:14<51:35:11,  7.81s/it]
 37%|███▋      | 14197/37963 [34:55:22<51:29:34,  7.80s/it]
 37%|███▋      | 14198/37963 [34:55:29<51:02:47,  7.73s/it]
 37%|███▋      | 14199/37963 [34:55:44<65:05:28,  9.86s/it]
 37%|███▋      | 14200/37963 [34:55:52<60:40:28,  9.19s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '2.725', 'learning_rate': '1.441e-05', 'epoch': '0.374'}
+
 37%|███▋      | 14200/37963 [34:55:52<60:40:28,  9.19s/it]
 37%|███▋      | 14201/37963 [34:56:06<69:58:29, 10.60s/it]
 37%|███▋      | 14202/37963 [34:56:20<77:33:57, 11.75s/it]
 37%|███▋      | 14203/37963 [34:56:28<69:34:23, 10.54s/it]
 37%|███▋      | 14204/37963 [34:56:35<63:46:14,  9.66s/it]
 37%|███▋      | 14205/37963 [34:56:43<59:37:42,  9.04s/it]
 37%|███▋      | 14206/37963 [34:56:51<56:54:00,  8.62s/it]
 37%|███▋      | 14207/37963 [34:57:06<69:33:01, 10.54s/it]
 37%|███▋      | 14208/37963 [34:57:13<64:09:19,  9.72s/it]
 37%|███▋      | 14209/37963 [34:57:21<60:02:10,  9.10s/it]
 37%|███▋      | 14210/37963 [34:57:29<57:10:01,  8.66s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '3.479', 'learning_rate': '1.44e-05', 'epoch': '0.3743'}
+
 37%|███▋      | 14210/37963 [34:57:29<57:10:01,  8.66s/it]
 37%|███▋      | 14211/37963 [34:57:36<55:12:41,  8.37s/it]
 37%|███▋      | 14212/37963 [34:57:44<53:42:26,  8.14s/it]
 37%|███▋      | 14213/37963 [34:57:52<52:41:03,  7.99s/it]
 37%|███▋      | 14214/37963 [34:57:59<52:14:03,  7.92s/it]
 37%|███▋      | 14215/37963 [34:58:07<51:36:31,  7.82s/it]
 37%|███▋      | 14216/37963 [34:58:15<51:19:44,  7.78s/it]
 37%|███▋      | 14217/37963 [34:58:29<63:36:19,  9.64s/it]
 37%|███▋      | 14218/37963 [34:58:36<59:55:31,  9.09s/it]
 37%|██���▋      | 14219/37963 [34:58:51<71:27:27, 10.83s/it]
 37%|███▋      | 14220/37963 [34:58:59<65:22:39,  9.91s/it]
                                                           
{'loss': '0.1657', 'grad_norm': '1.249', 'learning_rate': '1.439e-05', 'epoch': '0.3746'}
+
 37%|███▋      | 14220/37963 [34:58:59<65:22:39,  9.91s/it]
 37%|███▋      | 14221/37963 [34:59:07<61:04:13,  9.26s/it]
 37%|███▋      | 14222/37963 [34:59:15<57:59:42,  8.79s/it]
 37%|███▋      | 14223/37963 [34:59:22<55:57:05,  8.48s/it]
 37%|███▋      | 14224/37963 [34:59:30<54:22:53,  8.25s/it]
 37%|███▋      | 14225/37963 [34:59:38<53:08:02,  8.06s/it]
 37%|███▋      | 14226/37963 [34:59:52<65:34:30,  9.95s/it]
 37%|███▋      | 14227/37963 [35:00:00<61:16:01,  9.29s/it]
 37%|███▋      | 14228/37963 [35:00:07<58:04:56,  8.81s/it]
 37%|███▋      | 14229/37963 [35:00:15<55:48:08,  8.46s/it]
 37%|███▋      | 14230/37963 [35:00:23<53:46:53,  8.16s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '3.653', 'learning_rate': '1.439e-05', 'epoch': '0.3748'}
+
 37%|███▋      | 14230/37963 [35:00:23<53:46:53,  8.16s/it]
 37%|███▋      | 14231/37963 [35:00:30<52:53:31,  8.02s/it]
 37%|███▋      | 14232/37963 [35:00:38<52:04:11,  7.90s/it]
 37%|███▋      | 14233/37963 [35:00:45<51:19:24,  7.79s/it]
 37%|███▋      | 14234/37963 [35:01:00<64:27:44,  9.78s/it]
 37%|███▋      | 14235/37963 [35:01:07<59:43:36,  9.06s/it]
 37%|███▋      | 14236/37963 [35:01:15<56:59:08,  8.65s/it]
 38%|███▊      | 14237/37963 [35:01:22<54:51:19,  8.32s/it]
 38%|███▊      | 14238/37963 [35:01:30<53:36:54,  8.14s/it]
 38%|███▊      | 14239/37963 [35:01:38<52:44:42,  8.00s/it]
 38%|███▊      | 14240/37963 [35:01:45<51:53:13,  7.87s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '2.056', 'learning_rate': '1.438e-05', 'epoch': '0.3751'}
+
 38%|███▊      | 14240/37963 [35:01:45<51:53:13,  7.87s/it]
 38%|███▊      | 14241/37963 [35:01:53<51:04:30,  7.75s/it]
 38%|███▊      | 14242/37963 [35:02:00<50:24:43,  7.65s/it]
 38%|███▊      | 14243/37963 [35:02:08<50:27:20,  7.66s/it]
 38%|███▊      | 14244/37963 [35:02:16<50:33:38,  7.67s/it]
 38%|███▊      | 14245/37963 [35:02:24<50:56:18,  7.73s/it]
 38%|███▊      | 14246/37963 [35:02:38<64:20:41,  9.77s/it]
 38%|███▊      | 14247/37963 [35:02:46<60:23:10,  9.17s/it]
 38%|███▊      | 14248/37963 [35:02:53<57:21:25,  8.71s/it]
 38%|███▊      | 14249/37963 [35:03:01<55:15:49,  8.39s/it]
 38%|███▊      | 14250/37963 [35:03:16<67:17:54, 10.22s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '1.102', 'learning_rate': '1.437e-05', 'epoch': '0.3754'}
+
 38%|███▊      | 14250/37963 [35:03:16<67:17:54, 10.22s/it]
 38%|███▊      | 14251/37963 [35:03:24<62:55:59,  9.55s/it]
 38%|███▊      | 14252/37963 [35:03:31<59:18:24,  9.00s/it]
 38%|███▊      | 14253/37963 [35:03:53<84:37:09, 12.85s/it]
 38%|███▊      | 14254/37963 [35:04:01<74:32:11, 11.32s/it]
 38%|███▊      | 14255/37963 [35:04:09<67:17:04, 10.22s/it]
 38%|███▊      | 14256/37963 [35:04:16<61:40:35,  9.37s/it]
 38%|███▊      | 14257/37963 [35:04:24<58:33:50,  8.89s/it]
 38%|███▊      | 14258/37963 [35:04:31<55:45:08,  8.47s/it]
 38%|███▊      | 14259/37963 [35:04:39<53:38:30,  8.15s/it]
 38%|███▊      | 14260/37963 [35:04:46<52:51:45,  8.03s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '1.639', 'learning_rate': '1.436e-05', 'epoch': '0.3756'}
+
 38%|███▊      | 14260/37963 [35:04:46<52:51:45,  8.03s/it]
 38%|███▊      | 14261/37963 [35:04:54<52:06:24,  7.91s/it]
 38%|███▊      | 14262/37963 [35:05:08<63:50:18,  9.70s/it]
 38%|███▊      | 14263/37963 [35:05:15<59:41:37,  9.07s/it]
 38%|███▊      | 14264/37963 [35:05:23<56:58:08,  8.65s/it]
 38%|███▊      | 14265/37963 [35:05:31<54:36:53,  8.30s/it]
 38%|███▊      | 14266/37963 [35:05:38<53:10:28,  8.08s/it]
 38%|███▊      | 14267/37963 [35:05:46<52:07:23,  7.92s/it]
 38%|███▊      | 14268/37963 [35:05:53<51:34:32,  7.84s/it]
 38%|███▊      | 14269/37963 [35:06:01<51:09:40,  7.77s/it]
 38%|███▊      | 14270/37963 [35:06:22<78:01:45, 11.86s/it]
                                                           
{'loss': '0.1652', 'grad_norm': '1.54', 'learning_rate': '1.436e-05', 'epoch': '0.3759'}
+
 38%|███▊      | 14270/37963 [35:06:22<78:01:45, 11.86s/it]
 38%|███▊      | 14271/37963 [35:06:30<69:44:28, 10.60s/it]
 38%|███▊      | 14272/37963 [35:06:38<63:53:26,  9.71s/it]
 38%|███▊      | 14273/37963 [35:06:45<59:57:34,  9.11s/it]
 38%|███▊      | 14274/37963 [35:06:53<57:04:35,  8.67s/it]
 38%|███▊      | 14275/37963 [35:07:01<55:13:43,  8.39s/it]
 38%|███▊      | 14276/37963 [35:07:08<53:53:10,  8.19s/it]
 38%|███▊      | 14277/37963 [35:07:16<52:52:49,  8.04s/it]
 38%|███▊      | 14278/37963 [35:07:24<51:48:20,  7.87s/it]
 38%|███▊      | 14279/37963 [35:07:31<51:20:16,  7.80s/it]
 38%|███▊      | 14280/37963 [35:07:39<50:29:53,  7.68s/it]
                                                           
{'loss': '0.1763', 'grad_norm': '1.198', 'learning_rate': '1.435e-05', 'epoch': '0.3762'}
+
 38%|███▊      | 14280/37963 [35:07:39<50:29:53,  7.68s/it]
 38%|███▊      | 14281/37963 [35:07:53<63:17:14,  9.62s/it]
 38%|███▊      | 14282/37963 [35:08:01<59:46:12,  9.09s/it]
 38%|███▊      | 14283/37963 [35:08:08<57:03:57,  8.68s/it]
 38%|███▊      | 14284/37963 [35:08:16<55:09:59,  8.39s/it]
 38%|███▊      | 14285/37963 [35:08:24<53:37:45,  8.15s/it]
 38%|███▊      | 14286/37963 [35:08:31<51:48:09,  7.88s/it]
 38%|███▊      | 14287/37963 [35:08:39<51:26:18,  7.82s/it]
 38%|███▊      | 14288/37963 [35:08:46<51:07:26,  7.77s/it]
 38%|███▊      | 14289/37963 [35:08:54<50:50:12,  7.73s/it]
 38%|███▊      | 14290/37963 [35:09:02<50:39:05,  7.70s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '3.378', 'learning_rate': '1.434e-05', 'epoch': '0.3764'}
+
 38%|███▊      | 14290/37963 [35:09:02<50:39:05,  7.70s/it]
 38%|███▊      | 14291/37963 [35:09:09<50:06:41,  7.62s/it]
 38%|███▊      | 14292/37963 [35:09:17<50:18:06,  7.65s/it]
 38%|███▊      | 14293/37963 [35:09:24<50:26:42,  7.67s/it]
 38%|███▊      | 14294/37963 [35:09:32<50:33:37,  7.69s/it]
 38%|███▊      | 14295/37963 [35:09:40<50:30:13,  7.68s/it]
 38%|███▊      | 14296/37963 [35:09:48<50:34:37,  7.69s/it]
 38%|███▊      | 14297/37963 [35:09:55<50:34:19,  7.69s/it]
 38%|███▊      | 14298/37963 [35:10:03<50:52:26,  7.74s/it]
 38%|███▊      | 14299/37963 [35:10:32<91:36:55, 13.94s/it]
 38%|███▊      | 14300/37963 [35:10:39<79:41:41, 12.12s/it]
                                                           
{'loss': '0.176', 'grad_norm': '5.037', 'learning_rate': '1.433e-05', 'epoch': '0.3767'}
+
 38%|███▊      | 14300/37963 [35:10:39<79:41:41, 12.12s/it]
 38%|███▊      | 14301/37963 [35:10:47<70:55:49, 10.79s/it]
 38%|███▊      | 14302/37963 [35:10:55<64:45:13,  9.85s/it]
 38%|███▊      | 14303/37963 [35:11:02<60:24:09,  9.19s/it]
 38%|███▊      | 14304/37963 [35:11:10<57:28:39,  8.75s/it]
 38%|███▊      | 14305/37963 [35:11:18<55:27:52,  8.44s/it]
 38%|███▊      | 14306/37963 [35:11:32<66:41:49, 10.15s/it]
 38%|███▊      | 14307/37963 [35:11:40<61:52:35,  9.42s/it]
 38%|███▊      | 14308/37963 [35:11:55<73:05:40, 11.12s/it]
 38%|███▊      | 14309/37963 [35:12:02<66:17:14, 10.09s/it]
 38%|███▊      | 14310/37963 [35:12:10<61:40:20,  9.39s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '1.107', 'learning_rate': '1.432e-05', 'epoch': '0.3769'}
+
 38%|███▊      | 14310/37963 [35:12:10<61:40:20,  9.39s/it]
 38%|███▊      | 14311/37963 [35:12:18<57:36:44,  8.77s/it]
 38%|███▊      | 14312/37963 [35:12:25<55:37:46,  8.47s/it]
 38%|███▊      | 14313/37963 [35:12:33<53:55:34,  8.21s/it]
 38%|███▊      | 14314/37963 [35:12:47<65:30:45,  9.97s/it]
 38%|███▊      | 14315/37963 [35:12:55<61:18:33,  9.33s/it]
 38%|███▊      | 14316/37963 [35:13:02<58:00:35,  8.83s/it]
 38%|███▊      | 14317/37963 [35:13:10<55:30:48,  8.45s/it]
 38%|███▊      | 14318/37963 [35:13:18<53:53:35,  8.21s/it]
 38%|███▊      | 14319/37963 [35:13:25<52:28:48,  7.99s/it]
 38%|███▊      | 14320/37963 [35:13:33<51:43:53,  7.88s/it]
                                                           
{'loss': '0.1521', 'grad_norm': '1.561', 'learning_rate': '1.432e-05', 'epoch': '0.3772'}
+
 38%|███▊      | 14320/37963 [35:13:33<51:43:53,  7.88s/it]
 38%|███▊      | 14321/37963 [35:13:40<51:19:21,  7.81s/it]
 38%|███▊      | 14322/37963 [35:13:48<51:19:17,  7.82s/it]
 38%|███▊      | 14323/37963 [35:14:03<64:51:48,  9.88s/it]
 38%|███▊      | 14324/37963 [35:14:11<60:35:44,  9.23s/it]
 38%|███▊      | 14325/37963 [35:14:18<57:25:21,  8.75s/it]
 38%|███▊      | 14326/37963 [35:14:26<55:16:30,  8.42s/it]
 38%|███▊      | 14327/37963 [35:14:34<53:52:00,  8.20s/it]
 38%|███▊      | 14328/37963 [35:14:48<65:33:40,  9.99s/it]
 38%|███▊      | 14329/37963 [35:14:56<61:16:27,  9.33s/it]
 38%|███▊      | 14330/37963 [35:15:03<57:04:24,  8.69s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.735', 'learning_rate': '1.431e-05', 'epoch': '0.3775'}
+
 38%|███▊      | 14330/37963 [35:15:03<57:04:24,  8.69s/it]
 38%|███▊      | 14331/37963 [35:15:10<54:58:02,  8.37s/it]
 38%|███▊      | 14332/37963 [35:15:18<53:41:46,  8.18s/it]
 38%|███▊      | 14333/37963 [35:15:26<52:28:37,  7.99s/it]
 38%|███▊      | 14334/37963 [35:15:33<51:44:13,  7.88s/it]
 38%|███▊      | 14335/37963 [35:15:41<51:14:26,  7.81s/it]
 38%|███▊      | 14336/37963 [35:15:49<50:58:00,  7.77s/it]
 38%|███▊      | 14337/37963 [35:15:56<50:46:03,  7.74s/it]
 38%|███▊      | 14338/37963 [35:16:04<50:08:48,  7.64s/it]
 38%|███▊      | 14339/37963 [35:16:11<50:02:12,  7.62s/it]
 38%|███▊      | 14340/37963 [35:16:19<50:03:37,  7.63s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '1.083', 'learning_rate': '1.43e-05', 'epoch': '0.3777'}
+
 38%|███▊      | 14340/37963 [35:16:19<50:03:37,  7.63s/it]
 38%|███▊      | 14341/37963 [35:16:27<50:11:24,  7.65s/it]
 38%|███▊      | 14342/37963 [35:16:34<49:41:35,  7.57s/it]
 38%|███▊      | 14343/37963 [35:16:42<49:50:17,  7.60s/it]
 38%|███▊      | 14344/37963 [35:16:49<49:33:57,  7.55s/it]
 38%|███▊      | 14345/37963 [35:16:57<49:45:07,  7.58s/it]
 38%|███▊      | 14346/37963 [35:17:04<49:45:46,  7.59s/it]
 38%|███▊      | 14347/37963 [35:17:19<64:06:12,  9.77s/it]
 38%|███▊      | 14348/37963 [35:17:27<60:18:12,  9.19s/it]
 38%|███▊      | 14349/37963 [35:17:49<84:20:51, 12.86s/it]
 38%|███▊      | 14350/37963 [35:17:56<74:33:39, 11.37s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '2.767', 'learning_rate': '1.429e-05', 'epoch': '0.378'}
+
 38%|███▊      | 14350/37963 [35:17:56<74:33:39, 11.37s/it]
 38%|███▊      | 14351/37963 [35:18:04<67:18:25, 10.26s/it]
 38%|███▊      | 14352/37963 [35:18:12<62:10:26,  9.48s/it]
 38%|███▊      | 14353/37963 [35:18:26<71:05:12, 10.84s/it]
 38%|███▊      | 14354/37963 [35:18:33<64:49:40,  9.89s/it]
 38%|███▊      | 14355/37963 [35:18:41<60:18:59,  9.20s/it]
 38%|███▊      | 14356/37963 [35:18:49<57:22:42,  8.75s/it]
 38%|███▊      | 14357/37963 [35:18:56<54:43:52,  8.35s/it]
 38%|███▊      | 14358/37963 [35:19:04<53:33:41,  8.17s/it]
 38%|███▊      | 14359/37963 [35:19:11<51:45:44,  7.89s/it]
 38%|███▊      | 14360/37963 [35:19:19<51:19:55,  7.83s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '2.628', 'learning_rate': '1.429e-05', 'epoch': '0.3783'}
+
 38%|███▊      | 14360/37963 [35:19:19<51:19:55,  7.83s/it]
 38%|███▊      | 14361/37963 [35:19:26<50:12:06,  7.66s/it]
 38%|███▊      | 14362/37963 [35:19:47<77:03:45, 11.75s/it]
 38%|███▊      | 14363/37963 [35:19:55<69:05:27, 10.54s/it]
 38%|███▊      | 14364/37963 [35:20:03<63:20:21,  9.66s/it]
 38%|███▊      | 14365/37963 [35:20:10<59:24:06,  9.06s/it]
 38%|███▊      | 14366/37963 [35:20:18<56:35:26,  8.63s/it]
 38%|███▊      | 14367/37963 [35:20:26<54:25:07,  8.30s/it]
 38%|███▊      | 14368/37963 [35:20:33<52:39:49,  8.04s/it]
 38%|███▊      | 14369/37963 [35:20:47<65:00:11,  9.92s/it]
 38%|███▊      | 14370/37963 [35:20:55<60:26:45,  9.22s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '1.473', 'learning_rate': '1.428e-05', 'epoch': '0.3785'}
+
 38%|███▊      | 14370/37963 [35:20:55<60:26:45,  9.22s/it]
 38%|███▊      | 14371/37963 [35:21:02<57:10:46,  8.73s/it]
 38%|███▊      | 14372/37963 [35:21:17<68:13:13, 10.41s/it]
 38%|███▊      | 14373/37963 [35:21:24<62:33:47,  9.55s/it]
 38%|███▊      | 14374/37963 [35:21:32<58:54:52,  8.99s/it]
 38%|███▊      | 14375/37963 [35:21:40<56:01:30,  8.55s/it]
 38%|███▊      | 14376/37963 [35:21:47<54:12:52,  8.27s/it]
 38%|███▊      | 14377/37963 [35:21:55<52:55:44,  8.08s/it]
 38%|███▊      | 14378/37963 [35:22:02<51:45:36,  7.90s/it]
 38%|███▊      | 14379/37963 [35:22:10<51:18:52,  7.83s/it]
 38%|███▊      | 14380/37963 [35:22:17<50:43:34,  7.74s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '2.05', 'learning_rate': '1.427e-05', 'epoch': '0.3788'}
+
 38%|███▊      | 14380/37963 [35:22:17<50:43:34,  7.74s/it]
 38%|███▊      | 14381/37963 [35:22:25<50:28:52,  7.71s/it]
 38%|███▊      | 14382/37963 [35:22:33<50:07:11,  7.65s/it]
 38%|███▊      | 14383/37963 [35:22:40<49:55:55,  7.62s/it]
 38%|███▊      | 14384/37963 [35:22:48<50:02:01,  7.64s/it]
 38%|███▊      | 14385/37963 [35:22:55<49:24:25,  7.54s/it]
 38%|███▊      | 14386/37963 [35:23:03<49:32:36,  7.56s/it]
 38%|███▊      | 14387/37963 [35:23:10<49:39:54,  7.58s/it]
 38%|███▊      | 14388/37963 [35:23:18<49:55:07,  7.62s/it]
 38%|███▊      | 14389/37963 [35:23:26<49:57:13,  7.63s/it]
 38%|█���█▊      | 14390/37963 [35:23:33<49:56:44,  7.63s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '2.98', 'learning_rate': '1.426e-05', 'epoch': '0.3791'}
+
 38%|███▊      | 14390/37963 [35:23:33<49:56:44,  7.63s/it]
 38%|███▊      | 14391/37963 [35:23:41<49:45:53,  7.60s/it]
 38%|███▊      | 14392/37963 [35:23:49<50:00:22,  7.64s/it]
 38%|███▊      | 14393/37963 [35:23:56<49:37:04,  7.58s/it]
 38%|███▊      | 14394/37963 [35:24:04<49:45:32,  7.60s/it]
 38%|███▊      | 14395/37963 [35:24:19<64:12:36,  9.81s/it]
 38%|███▊      | 14396/37963 [35:24:26<60:05:29,  9.18s/it]
 38%|███▊      | 14397/37963 [35:24:40<69:26:30, 10.61s/it]
 38%|███▊      | 14398/37963 [35:24:48<64:12:00,  9.81s/it]
 38%|███▊      | 14399/37963 [35:24:56<59:41:07,  9.12s/it]
 38%|███▊      | 14400/37963 [35:25:10<69:27:36, 10.61s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '2.479', 'learning_rate': '1.426e-05', 'epoch': '0.3793'}
+
 38%|███▊      | 14400/37963 [35:25:10<69:27:36, 10.61s/it]
 38%|███▊      | 14401/37963 [35:25:18<63:43:12,  9.74s/it]
 38%|███▊      | 14402/37963 [35:25:25<59:36:02,  9.11s/it]
 38%|███▊      | 14403/37963 [35:25:39<69:14:39, 10.58s/it]
 38%|███▊      | 14404/37963 [35:25:47<63:34:57,  9.72s/it]
 38%|███▊      | 14405/37963 [35:25:55<59:36:37,  9.11s/it]
 38%|███▊      | 14406/37963 [35:26:02<56:41:19,  8.66s/it]
 38%|███▊      | 14407/37963 [35:26:10<54:45:46,  8.37s/it]
 38%|███▊      | 14408/37963 [35:26:17<53:07:27,  8.12s/it]
 38%|███▊      | 14409/37963 [35:26:32<65:50:32, 10.06s/it]
 38%|███▊      | 14410/37963 [35:26:40<60:52:35,  9.30s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '1.768', 'learning_rate': '1.425e-05', 'epoch': '0.3796'}
+
 38%|███▊      | 14410/37963 [35:26:40<60:52:35,  9.30s/it]
 38%|███▊      | 14411/37963 [35:26:47<57:31:03,  8.79s/it]
 38%|███▊      | 14412/37963 [35:26:55<55:15:24,  8.45s/it]
 38%|███▊      | 14413/37963 [35:27:09<66:38:32, 10.19s/it]
 38%|███▊      | 14414/37963 [35:27:17<61:14:10,  9.36s/it]
 38%|███▊      | 14415/37963 [35:27:31<71:23:07, 10.91s/it]
 38%|███▊      | 14416/37963 [35:27:39<65:03:19,  9.95s/it]
 38%|███▊      | 14417/37963 [35:27:46<60:30:17,  9.25s/it]
 38%|███▊      | 14418/37963 [35:27:54<57:27:18,  8.78s/it]
 38%|███▊      | 14419/37963 [35:28:02<55:28:25,  8.48s/it]
 38%|███▊      | 14420/37963 [35:28:16<67:12:10, 10.28s/it]
                                                           
{'loss': '0.1667', 'grad_norm': '0.9915', 'learning_rate': '1.424e-05', 'epoch': '0.3798'}
+
 38%|███▊      | 14420/37963 [35:28:16<67:12:10, 10.28s/it]
 38%|███▊      | 14421/37963 [35:28:24<62:05:37,  9.50s/it]
 38%|███▊      | 14422/37963 [35:28:32<58:24:34,  8.93s/it]
 38%|███▊      | 14423/37963 [35:28:39<55:36:30,  8.50s/it]
 38%|███▊      | 14424/37963 [35:28:47<53:50:49,  8.24s/it]
 38%|███▊      | 14425/37963 [35:28:54<52:36:37,  8.05s/it]
 38%|███▊      | 14426/37963 [35:29:02<51:52:18,  7.93s/it]
 38%|███▊      | 14427/37963 [35:29:10<51:27:16,  7.87s/it]
 38%|███▊      | 14428/37963 [35:29:17<50:57:56,  7.80s/it]
 38%|███▊      | 14429/37963 [35:29:25<50:44:15,  7.76s/it]
 38%|███▊      | 14430/37963 [35:29:33<50:22:20,  7.71s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '3.844', 'learning_rate': '1.423e-05', 'epoch': '0.3801'}
+
 38%|███▊      | 14430/37963 [35:29:33<50:22:20,  7.71s/it]
 38%|███▊      | 14431/37963 [35:29:40<50:10:44,  7.68s/it]
 38%|███▊      | 14432/37963 [35:29:48<50:19:41,  7.70s/it]
 38%|███▊      | 14433/37963 [35:29:56<50:12:50,  7.68s/it]
 38%|███▊      | 14434/37963 [35:30:03<49:44:39,  7.61s/it]
 38%|███▊      | 14435/37963 [35:30:11<49:53:10,  7.63s/it]
 38%|███▊      | 14436/37963 [35:30:18<50:08:19,  7.67s/it]
 38%|███▊      | 14437/37963 [35:30:26<50:12:38,  7.68s/it]
 38%|███▊      | 14438/37963 [35:30:34<50:14:42,  7.69s/it]
 38%|███▊      | 14439/37963 [35:30:48<63:42:41,  9.75s/it]
 38%|███▊      | 14440/37963 [35:30:56<59:50:00,  9.16s/it]
                                                           
{'loss': '0.1679', 'grad_norm': '0.9494', 'learning_rate': '1.422e-05', 'epoch': '0.3804'}
+
 38%|███▊      | 14440/37963 [35:30:56<59:50:00,  9.16s/it]
 38%|███▊      | 14441/37963 [35:31:04<56:40:09,  8.67s/it]
 38%|███▊      | 14442/37963 [35:31:11<54:43:32,  8.38s/it]
 38%|███▊      | 14443/37963 [35:31:19<53:31:47,  8.19s/it]
 38%|███▊      | 14444/37963 [35:31:33<65:18:20, 10.00s/it]
 38%|███▊      | 14445/37963 [35:31:41<60:58:43,  9.33s/it]
 38%|███▊      | 14446/37963 [35:31:49<57:48:31,  8.85s/it]
 38%|███▊      | 14447/37963 [35:31:57<55:23:03,  8.48s/it]
 38%|███▊      | 14448/37963 [35:32:11<67:38:32, 10.36s/it]
 38%|███▊      | 14449/37963 [35:32:19<62:34:13,  9.58s/it]
 38%|███▊      | 14450/37963 [35:32:27<58:33:08,  8.96s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '2.35', 'learning_rate': '1.422e-05', 'epoch': '0.3806'}
+
 38%|███▊      | 14450/37963 [35:32:27<58:33:08,  8.96s/it]
 38%|███▊      | 14451/37963 [35:32:34<55:29:04,  8.50s/it]
 38%|███▊      | 14452/37963 [35:32:42<53:48:50,  8.24s/it]
 38%|███▊      | 14453/37963 [35:32:49<52:52:26,  8.10s/it]
 38%|███▊      | 14454/37963 [35:32:57<51:59:22,  7.96s/it]
 38%|███▊      | 14455/37963 [35:33:05<51:32:54,  7.89s/it]
 38%|███▊      | 14456/37963 [35:33:19<64:22:04,  9.86s/it]
 38%|███▊      | 14457/37963 [35:33:27<60:02:04,  9.19s/it]
 38%|███▊      | 14458/37963 [35:33:35<57:04:31,  8.74s/it]
 38%|███▊      | 14459/37963 [35:33:42<54:44:59,  8.39s/it]
 38%|███▊      | 14460/37963 [35:33:50<53:22:42,  8.18s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '1.405', 'learning_rate': '1.421e-05', 'epoch': '0.3809'}
+
 38%|███▊      | 14460/37963 [35:33:50<53:22:42,  8.18s/it]
 38%|███▊      | 14461/37963 [35:34:05<66:50:30, 10.24s/it]
 38%|███▊      | 14462/37963 [35:34:12<61:41:30,  9.45s/it]
 38%|███▊      | 14463/37963 [35:34:20<58:13:22,  8.92s/it]
 38%|███▊      | 14464/37963 [35:34:28<55:42:21,  8.53s/it]
 38%|███▊      | 14465/37963 [35:34:35<53:57:11,  8.27s/it]
 38%|███▊      | 14466/37963 [35:34:50<66:04:29, 10.12s/it]
 38%|███▊      | 14467/37963 [35:35:10<86:12:36, 13.21s/it]
 38%|███▊      | 14468/37963 [35:35:18<75:27:00, 11.56s/it]
 38%|███▊      | 14469/37963 [35:35:26<67:52:13, 10.40s/it]
 38%|███▊      | 14470/37963 [35:35:33<62:11:05,  9.53s/it]
                                                           
{'loss': '0.1697', 'grad_norm': '2.715', 'learning_rate': '1.42e-05', 'epoch': '0.3812'}
+
 38%|███▊      | 14470/37963 [35:35:33<62:11:05,  9.53s/it]
 38%|███▊      | 14471/37963 [35:35:40<57:49:12,  8.86s/it]
 38%|███▊      | 14472/37963 [35:35:48<55:49:17,  8.55s/it]
 38%|███▊      | 14473/37963 [35:35:56<54:03:29,  8.28s/it]
 38%|███▊      | 14474/37963 [35:36:04<52:43:18,  8.08s/it]
 38%|███▊      | 14475/37963 [35:36:11<51:48:48,  7.94s/it]
 38%|███▊      | 14476/37963 [35:36:19<51:20:13,  7.87s/it]
 38%|███▊      | 14477/37963 [35:36:27<51:10:27,  7.84s/it]
 38%|███▊      | 14478/37963 [35:36:34<50:34:18,  7.75s/it]
 38%|███▊      | 14479/37963 [35:36:42<50:18:47,  7.71s/it]
 38%|███▊      | 14480/37963 [35:36:50<50:34:33,  7.75s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '1.013', 'learning_rate': '1.419e-05', 'epoch': '0.3814'}
+
 38%|███▊      | 14480/37963 [35:36:50<50:34:33,  7.75s/it]
 38%|███▊      | 14481/37963 [35:36:57<50:33:09,  7.75s/it]
 38%|███▊      | 14482/37963 [35:37:05<50:16:34,  7.71s/it]
 38%|███▊      | 14483/37963 [35:37:20<63:59:48,  9.81s/it]
 38%|███▊      | 14484/37963 [35:37:27<59:31:39,  9.13s/it]
 38%|███▊      | 14485/37963 [35:37:35<56:39:32,  8.69s/it]
 38%|███▊      | 14486/37963 [35:37:43<54:34:08,  8.37s/it]
 38%|███▊      | 14487/37963 [35:37:50<53:20:41,  8.18s/it]
 38%|███▊      | 14488/37963 [35:37:58<52:07:19,  7.99s/it]
 38%|███▊      | 14489/37963 [35:38:06<51:49:47,  7.95s/it]
 38%|███▊      | 14490/37963 [35:38:14<51:35:20,  7.91s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '1.475', 'learning_rate': '1.419e-05', 'epoch': '0.3817'}
+
 38%|███▊      | 14490/37963 [35:38:14<51:35:20,  7.91s/it]
 38%|███▊      | 14491/37963 [35:38:21<51:02:50,  7.83s/it]
 38%|███▊      | 14492/37963 [35:38:29<50:19:20,  7.72s/it]
 38%|███▊      | 14493/37963 [35:38:36<50:09:10,  7.69s/it]
 38%|███▊      | 14494/37963 [35:38:44<49:42:15,  7.62s/it]
 38%|███▊      | 14495/37963 [35:38:58<62:46:40,  9.63s/it]
 38%|███▊      | 14496/37963 [35:39:06<58:51:10,  9.03s/it]
 38%|███▊      | 14497/37963 [35:39:13<56:27:30,  8.66s/it]
 38%|███▊      | 14498/37963 [35:39:28<68:20:44, 10.49s/it]
 38%|███▊      | 14499/37963 [35:39:36<63:04:24,  9.68s/it]
 38%|███▊      | 14500/37963 [35:39:43<58:43:23,  9.01s/it]
                                                           
{'loss': '0.1545', 'grad_norm': '5.149', 'learning_rate': '1.418e-05', 'epoch': '0.382'}
+
 38%|███▊      | 14500/37963 [35:39:43<58:43:23,  9.01s/it]
 38%|███▊      | 14501/37963 [35:39:51<56:10:34,  8.62s/it]
 38%|███▊      | 14502/37963 [35:39:59<54:49:25,  8.41s/it]
 38%|███▊      | 14503/37963 [35:40:07<52:56:12,  8.12s/it]
 38%|███▊      | 14504/37963 [35:40:14<51:13:56,  7.86s/it]
 38%|███▊      | 14505/37963 [35:40:29<65:14:59, 10.01s/it]
 38%|███▊      | 14506/37963 [35:40:36<60:36:21,  9.30s/it]
 38%|███▊      | 14507/37963 [35:40:44<56:59:23,  8.75s/it]
 38%|███▊      | 14508/37963 [35:40:58<67:23:28, 10.34s/it]
 38%|███▊      | 14509/37963 [35:41:06<62:05:35,  9.53s/it]
 38%|███▊      | 14510/37963 [35:41:13<58:34:20,  8.99s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '6.033', 'learning_rate': '1.417e-05', 'epoch': '0.3822'}
+
 38%|███▊      | 14510/37963 [35:41:13<58:34:20,  8.99s/it]
 38%|███▊      | 14511/37963 [35:41:27<68:35:26, 10.53s/it]
 38%|███▊      | 14512/37963 [35:41:42<76:24:51, 11.73s/it]
 38%|███▊      | 14513/37963 [35:41:50<69:13:36, 10.63s/it]
 38%|███▊      | 14514/37963 [35:41:58<63:18:00,  9.72s/it]
 38%|███▊      | 14515/37963 [35:42:05<58:44:58,  9.02s/it]
 38%|███▊      | 14516/37963 [35:42:13<56:18:44,  8.65s/it]
 38%|███▊      | 14517/37963 [35:42:21<54:42:21,  8.40s/it]
 38%|███▊      | 14518/37963 [35:42:35<66:51:19, 10.27s/it]
 38%|███▊      | 14519/37963 [35:42:43<61:24:59,  9.43s/it]
 38%|███▊      | 14520/37963 [35:42:51<58:18:05,  8.95s/it]
                                                           
{'loss': '0.1709', 'grad_norm': '3.074', 'learning_rate': '1.416e-05', 'epoch': '0.3825'}
+
 38%|███▊      | 14520/37963 [35:42:51<58:18:05,  8.95s/it]
 38%|███▊      | 14521/37963 [35:42:58<55:29:48,  8.52s/it]
 38%|███▊      | 14522/37963 [35:43:06<53:46:11,  8.26s/it]
 38%|███▊      | 14523/37963 [35:43:13<52:27:25,  8.06s/it]
 38%|███▊      | 14524/37963 [35:43:21<51:38:10,  7.93s/it]
 38%|███▊      | 14525/37963 [35:43:29<51:07:11,  7.85s/it]
 38%|███▊      | 14526/37963 [35:43:36<50:43:47,  7.79s/it]
 38%|███▊      | 14527/37963 [35:43:44<50:40:57,  7.79s/it]
 38%|███▊      | 14528/37963 [35:43:52<50:35:57,  7.77s/it]
 38%|███▊      | 14529/37963 [35:43:59<50:21:22,  7.74s/it]
 38%|███▊      | 14530/37963 [35:44:07<50:16:00,  7.72s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '2.529', 'learning_rate': '1.415e-05', 'epoch': '0.3827'}
+
 38%|███▊      | 14530/37963 [35:44:07<50:16:00,  7.72s/it]
 38%|███▊      | 14531/37963 [35:44:15<50:07:27,  7.70s/it]
 38%|███▊      | 14532/37963 [35:44:22<49:38:05,  7.63s/it]
 38%|███▊      | 14533/37963 [35:44:37<63:38:03,  9.78s/it]
 38%|███▊      | 14534/37963 [35:44:45<59:17:43,  9.11s/it]
 38%|███▊      | 14535/37963 [35:44:52<56:17:59,  8.65s/it]
 38%|███▊      | 14536/37963 [35:45:00<54:20:55,  8.35s/it]
 38%|███▊      | 14537/37963 [35:45:07<52:52:27,  8.13s/it]
 38%|███▊      | 14538/37963 [35:45:15<51:47:27,  7.96s/it]
 38%|███▊      | 14539/37963 [35:45:23<51:15:30,  7.88s/it]
 38%|███▊      | 14540/37963 [35:45:30<50:43:05,  7.80s/it]
                                                           
{'loss': '0.1625', 'grad_norm': '1.077', 'learning_rate': '1.415e-05', 'epoch': '0.383'}
+
 38%|███▊      | 14540/37963 [35:45:30<50:43:05,  7.80s/it]
 38%|███▊      | 14541/37963 [35:45:38<50:00:28,  7.69s/it]
 38%|███▊      | 14542/37963 [35:45:45<49:30:04,  7.61s/it]
 38%|███▊      | 14543/37963 [35:45:53<49:51:02,  7.66s/it]
 38%|███▊      | 14544/37963 [35:46:01<50:09:47,  7.71s/it]
 38%|███▊      | 14545/37963 [35:46:08<49:57:27,  7.68s/it]
 38%|███▊      | 14546/37963 [35:46:16<50:05:27,  7.70s/it]
 38%|███▊      | 14547/37963 [35:46:24<50:28:26,  7.76s/it]
 38%|███▊      | 14548/37963 [35:46:39<63:35:00,  9.78s/it]
 38%|███▊      | 14549/37963 [35:46:46<59:32:48,  9.16s/it]
 38%|███▊      | 14550/37963 [35:47:01<70:46:35, 10.88s/it]
                                                           
{'loss': '0.1698', 'grad_norm': '1.2', 'learning_rate': '1.414e-05', 'epoch': '0.3833'}
+
 38%|███▊      | 14550/37963 [35:47:01<70:46:35, 10.88s/it]
 38%|███▊      | 14551/37963 [35:47:16<78:16:22, 12.04s/it]
 38%|███▊      | 14552/37963 [35:47:24<70:04:37, 10.78s/it]
 38%|███▊      | 14553/37963 [35:47:31<63:54:44,  9.83s/it]
 38%|███▊      | 14554/37963 [35:47:39<59:56:13,  9.22s/it]
 38%|███▊      | 14555/37963 [35:47:47<56:58:45,  8.76s/it]
 38%|███▊      | 14556/37963 [35:47:55<55:10:18,  8.49s/it]
 38%|███▊      | 14557/37963 [35:48:02<53:28:28,  8.22s/it]
 38%|███▊      | 14558/37963 [35:48:10<52:19:25,  8.05s/it]
 38%|███▊      | 14559/37963 [35:48:30<76:37:35, 11.79s/it]
 38%|███▊      | 14560/37963 [35:48:45<81:41:19, 12.57s/it]
                                                           
{'loss': '0.1818', 'grad_norm': '1.129', 'learning_rate': '1.413e-05', 'epoch': '0.3835'}
+
 38%|███▊      | 14560/37963 [35:48:45<81:41:19, 12.57s/it]
 38%|███▊      | 14561/37963 [35:48:53<72:17:59, 11.12s/it]
 38%|███▊      | 14562/37963 [35:49:00<65:39:26, 10.10s/it]
 38%|███▊      | 14563/37963 [35:49:08<61:01:46,  9.39s/it]
 38%|███▊      | 14564/37963 [35:49:16<57:50:41,  8.90s/it]
 38%|███▊      | 14565/37963 [35:49:23<55:32:10,  8.54s/it]
 38%|███▊      | 14566/37963 [35:49:31<53:33:42,  8.24s/it]
 38%|███▊      | 14567/37963 [35:49:39<52:15:46,  8.04s/it]
 38%|███▊      | 14568/37963 [35:49:46<51:28:54,  7.92s/it]
 38%|███▊      | 14569/37963 [35:49:54<50:59:31,  7.85s/it]
 38%|███▊      | 14570/37963 [35:50:02<50:34:16,  7.78s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '1.141', 'learning_rate': '1.412e-05', 'epoch': '0.3838'}
+
 38%|███▊      | 14570/37963 [35:50:02<50:34:16,  7.78s/it]
 38%|███▊      | 14571/37963 [35:50:09<50:29:26,  7.77s/it]
 38%|███▊      | 14572/37963 [35:50:24<64:26:34,  9.92s/it]
 38%|███▊      | 14573/37963 [35:50:32<60:15:47,  9.28s/it]
 38%|███▊      | 14574/37963 [35:50:39<56:46:13,  8.74s/it]
 38%|███▊      | 14575/37963 [35:50:47<54:40:23,  8.42s/it]
 38%|███▊      | 14576/37963 [35:50:55<53:11:43,  8.19s/it]
 38%|███▊      | 14577/37963 [35:51:02<52:16:21,  8.05s/it]
 38%|███▊      | 14578/37963 [35:51:10<51:30:30,  7.93s/it]
 38%|███▊      | 14579/37963 [35:51:18<51:05:00,  7.86s/it]
 38%|███▊      | 14580/37963 [35:51:25<50:20:43,  7.75s/it]
                                                           
{'loss': '0.1684', 'grad_norm': '1.76', 'learning_rate': '1.412e-05', 'epoch': '0.3841'}
+
 38%|███▊      | 14580/37963 [35:51:25<50:20:43,  7.75s/it]
 38%|███▊      | 14581/37963 [35:51:33<49:46:58,  7.66s/it]
 38%|███▊      | 14582/37963 [35:51:40<49:48:25,  7.67s/it]
 38%|███▊      | 14583/37963 [35:51:48<50:00:46,  7.70s/it]
 38%|███▊      | 14584/37963 [35:51:56<50:01:02,  7.70s/it]
 38%|███▊      | 14585/37963 [35:52:04<50:00:45,  7.70s/it]
 38%|███▊      | 14586/37963 [35:52:11<50:07:07,  7.72s/it]
 38%|███▊      | 14587/37963 [35:52:26<63:46:38,  9.82s/it]
 38%|███▊      | 14588/37963 [35:52:34<59:43:56,  9.20s/it]
 38%|███▊      | 14589/37963 [35:52:41<56:19:32,  8.68s/it]
 38%|███▊      | 14590/37963 [35:52:49<54:22:40,  8.38s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '5.189', 'learning_rate': '1.411e-05', 'epoch': '0.3843'}
+
 38%|███▊      | 14590/37963 [35:52:49<54:22:40,  8.38s/it]
 38%|███▊      | 14591/37963 [35:53:03<65:13:55, 10.05s/it]
 38%|███▊      | 14592/37963 [35:53:11<60:35:07,  9.33s/it]
 38%|███▊      | 14593/37963 [35:53:18<57:33:12,  8.87s/it]
 38%|███▊      | 14594/37963 [35:53:26<55:11:37,  8.50s/it]
 38%|███▊      | 14595/37963 [35:53:41<67:30:37, 10.40s/it]
 38%|███▊      | 14596/37963 [35:53:49<62:25:53,  9.62s/it]
 38%|███▊      | 14597/37963 [35:54:03<72:20:02, 11.14s/it]
 38%|███▊      | 14598/37963 [35:54:11<65:33:52, 10.10s/it]
 38%|███▊      | 14599/37963 [35:54:19<61:03:11,  9.41s/it]
 38%|███▊      | 14600/37963 [35:54:27<57:55:33,  8.93s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '3.876', 'learning_rate': '1.41e-05', 'epoch': '0.3846'}
+
 38%|███▊      | 14600/37963 [35:54:27<57:55:33,  8.93s/it]
 38%|███▊      | 14601/37963 [35:54:34<55:40:16,  8.58s/it]
 38%|███▊      | 14602/37963 [35:54:42<53:33:50,  8.25s/it]
 38%|███▊      | 14603/37963 [35:54:50<52:15:30,  8.05s/it]
 38%|███▊      | 14604/37963 [35:54:57<51:04:53,  7.87s/it]
 38%|███▊      | 14605/37963 [35:55:04<50:19:48,  7.76s/it]
 38%|███▊      | 14606/37963 [35:55:18<62:08:15,  9.58s/it]
 38%|███▊      | 14607/37963 [35:55:26<58:47:32,  9.06s/it]
 38%|███▊      | 14608/37963 [35:55:34<55:34:13,  8.57s/it]
 38%|███▊      | 14609/37963 [35:55:55<80:16:25, 12.37s/it]
 38%|███▊      | 14610/37963 [35:56:03<71:23:36, 11.01s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '1.192', 'learning_rate': '1.409e-05', 'epoch': '0.3848'}
+
 38%|███▊      | 14610/37963 [35:56:03<71:23:36, 11.01s/it]
 38%|███▊      | 14611/37963 [35:56:10<64:51:16, 10.00s/it]
 38%|███▊      | 14612/37963 [35:56:18<60:23:52,  9.31s/it]
 38%|███▊      | 14613/37963 [35:56:25<56:37:53,  8.73s/it]
 38%|███▊      | 14614/37963 [35:56:33<54:28:26,  8.40s/it]
 38%|███▊      | 14615/37963 [35:56:40<52:11:32,  8.05s/it]
 39%|███▊      | 14616/37963 [35:56:48<51:38:36,  7.96s/it]
 39%|███▊      | 14617/37963 [35:56:56<51:04:36,  7.88s/it]
 39%|███▊      | 14618/37963 [35:57:03<50:10:46,  7.74s/it]
 39%|███▊      | 14619/37963 [35:57:11<49:47:52,  7.68s/it]
 39%|███▊      | 14620/37963 [35:57:18<49:37:57,  7.65s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '1.274', 'learning_rate': '1.408e-05', 'epoch': '0.3851'}
+
 39%|███▊      | 14620/37963 [35:57:18<49:37:57,  7.65s/it]
 39%|███▊      | 14621/37963 [35:57:26<49:44:25,  7.67s/it]
 39%|███▊      | 14622/37963 [35:57:34<49:41:39,  7.66s/it]
 39%|███▊      | 14623/37963 [35:57:48<63:29:57,  9.79s/it]
 39%|███▊      | 14624/37963 [35:57:56<59:26:05,  9.17s/it]
 39%|███▊      | 14625/37963 [35:58:04<56:32:54,  8.72s/it]
 39%|███▊      | 14626/37963 [35:58:11<54:22:40,  8.39s/it]
 39%|███▊      | 14627/37963 [35:58:19<53:12:02,  8.21s/it]
 39%|███▊      | 14628/37963 [35:58:26<51:20:03,  7.92s/it]
 39%|███▊      | 14629/37963 [35:58:34<51:04:14,  7.88s/it]
 39%|███▊      | 14630/37963 [35:58:42<50:18:56,  7.76s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '2.063', 'learning_rate': '1.408e-05', 'epoch': '0.3854'}
+
 39%|███▊      | 14630/37963 [35:58:42<50:18:56,  7.76s/it]
 39%|███▊      | 14631/37963 [35:58:49<49:37:23,  7.66s/it]
 39%|███▊      | 14632/37963 [35:58:57<49:52:14,  7.70s/it]
 39%|███▊      | 14633/37963 [35:59:04<49:48:33,  7.69s/it]
 39%|███▊      | 14634/37963 [35:59:12<49:53:41,  7.70s/it]
 39%|███▊      | 14635/37963 [35:59:20<49:56:20,  7.71s/it]
 39%|███▊      | 14636/37963 [35:59:28<49:52:17,  7.70s/it]
 39%|███▊      | 14637/37963 [35:59:35<49:35:53,  7.65s/it]
 39%|███▊      | 14638/37963 [35:59:43<49:22:39,  7.62s/it]
 39%|███▊      | 14639/37963 [36:00:04<75:41:41, 11.68s/it]
 39%|███▊      | 14640/37963 [36:00:19<81:41:59, 12.61s/it]
                                                           
{'loss': '0.1711', 'grad_norm': '1.388', 'learning_rate': '1.407e-05', 'epoch': '0.3856'}
+
 39%|███▊      | 14640/37963 [36:00:19<81:41:59, 12.61s/it]
 39%|███▊      | 14641/37963 [36:00:26<72:13:15, 11.15s/it]
 39%|███▊      | 14642/37963 [36:00:34<65:24:36, 10.10s/it]
 39%|███▊      | 14643/37963 [36:00:42<60:42:20,  9.37s/it]
 39%|███▊      | 14644/37963 [36:00:57<71:17:23, 11.01s/it]
 39%|███▊      | 14645/37963 [36:01:04<64:46:59, 10.00s/it]
 39%|███▊      | 14646/37963 [36:01:12<60:19:28,  9.31s/it]
 39%|███▊      | 14647/37963 [36:01:20<57:20:20,  8.85s/it]
 39%|███▊      | 14648/37963 [36:01:27<54:56:48,  8.48s/it]
 39%|███▊      | 14649/37963 [36:01:35<52:59:42,  8.18s/it]
 39%|███▊      | 14650/37963 [36:01:42<51:56:58,  8.02s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '1.721', 'learning_rate': '1.406e-05', 'epoch': '0.3859'}
+
 39%|███▊      | 14650/37963 [36:01:42<51:56:58,  8.02s/it]
 39%|███▊      | 14651/37963 [36:01:50<51:06:03,  7.89s/it]
 39%|███▊      | 14652/37963 [36:01:58<50:44:55,  7.84s/it]
 39%|███▊      | 14653/37963 [36:02:05<50:01:37,  7.73s/it]
 39%|███▊      | 14654/37963 [36:02:13<49:57:30,  7.72s/it]
 39%|███▊      | 14655/37963 [36:02:21<50:11:03,  7.75s/it]
 39%|███▊      | 14656/37963 [36:02:35<62:35:56,  9.67s/it]
 39%|███▊      | 14657/37963 [36:02:43<58:50:43,  9.09s/it]
 39%|███▊      | 14658/37963 [36:03:03<81:48:20, 12.64s/it]
 39%|███▊      | 14659/37963 [36:03:11<72:20:32, 11.18s/it]
 39%|███▊      | 14660/37963 [36:03:19<65:30:50, 10.12s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '2.797', 'learning_rate': '1.405e-05', 'epoch': '0.3862'}
+
 39%|███▊      | 14660/37963 [36:03:19<65:30:50, 10.12s/it]
 39%|███▊      | 14661/37963 [36:03:27<60:50:23,  9.40s/it]
 39%|███▊      | 14662/37963 [36:03:34<57:05:26,  8.82s/it]
 39%|███▊      | 14663/37963 [36:03:42<54:46:23,  8.46s/it]
 39%|███▊      | 14664/37963 [36:03:50<53:36:32,  8.28s/it]
 39%|███▊      | 14665/37963 [36:03:57<52:43:31,  8.15s/it]
 39%|███▊      | 14666/37963 [36:04:05<51:43:27,  7.99s/it]
 39%|███▊      | 14667/37963 [36:04:13<51:04:33,  7.89s/it]
 39%|███▊      | 14668/37963 [36:04:20<50:31:21,  7.81s/it]
 39%|███▊      | 14669/37963 [36:04:28<50:21:55,  7.78s/it]
 39%|███▊      | 14670/37963 [36:04:36<50:11:40,  7.76s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '2.119', 'learning_rate': '1.405e-05', 'epoch': '0.3864'}
+
 39%|███▊      | 14670/37963 [36:04:36<50:11:40,  7.76s/it]
 39%|███▊      | 14671/37963 [36:04:43<49:41:34,  7.68s/it]
 39%|███▊      | 14672/37963 [36:04:51<49:49:22,  7.70s/it]
 39%|███▊      | 14673/37963 [36:04:58<49:22:38,  7.63s/it]
 39%|███▊      | 14674/37963 [36:05:06<49:22:03,  7.63s/it]
 39%|███▊      | 14675/37963 [36:05:14<49:22:56,  7.63s/it]
 39%|███▊      | 14676/37963 [36:05:21<49:32:10,  7.66s/it]
 39%|███▊      | 14677/37963 [36:05:36<63:04:44,  9.75s/it]
 39%|███▊      | 14678/37963 [36:05:44<58:47:30,  9.09s/it]
 39%|███▊      | 14679/37963 [36:05:51<55:51:27,  8.64s/it]
 39%|███▊      | 14680/37963 [36:05:59<53:56:42,  8.34s/it]
                                                           
{'loss': '0.1469', 'grad_norm': '1.601', 'learning_rate': '1.404e-05', 'epoch': '0.3867'}
+
 39%|███▊      | 14680/37963 [36:05:59<53:56:42,  8.34s/it]
 39%|███▊      | 14681/37963 [36:06:06<52:16:18,  8.08s/it]
 39%|███▊      | 14682/37963 [36:06:14<51:23:18,  7.95s/it]
 39%|███▊      | 14683/37963 [36:06:29<64:59:02, 10.05s/it]
 39%|███▊      | 14684/37963 [36:06:37<60:15:50,  9.32s/it]
 39%|███▊      | 14685/37963 [36:06:44<56:56:23,  8.81s/it]
 39%|███▊      | 14686/37963 [36:06:52<54:45:25,  8.47s/it]
 39%|███▊      | 14687/37963 [36:07:06<66:16:52, 10.25s/it]
 39%|███▊      | 14688/37963 [36:07:14<61:22:41,  9.49s/it]
 39%|███▊      | 14689/37963 [36:07:22<57:55:22,  8.96s/it]
 39%|███▊      | 14690/37963 [36:07:29<55:28:22,  8.58s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '1.637', 'learning_rate': '1.403e-05', 'epoch': '0.387'}
+
 39%|███▊      | 14690/37963 [36:07:29<55:28:22,  8.58s/it]
 39%|███▊      | 14691/37963 [36:07:44<67:47:46, 10.49s/it]
 39%|███▊      | 14692/37963 [36:07:52<62:17:44,  9.64s/it]
 39%|███▊      | 14693/37963 [36:08:00<58:36:57,  9.07s/it]
 39%|███▊      | 14694/37963 [36:08:15<69:47:40, 10.80s/it]
 39%|███▊      | 14695/37963 [36:08:22<63:32:46,  9.83s/it]
 39%|███▊      | 14696/37963 [36:08:30<58:52:36,  9.11s/it]
 39%|███▊      | 14697/37963 [36:08:37<55:53:41,  8.65s/it]
 39%|███▊      | 14698/37963 [36:08:45<53:55:04,  8.34s/it]
 39%|███▊      | 14699/37963 [36:08:52<52:36:11,  8.14s/it]
 39%|███▊      | 14700/37963 [36:09:07<64:13:01,  9.94s/it]
                                                           
{'loss': '0.1487', 'grad_norm': '1.526', 'learning_rate': '1.402e-05', 'epoch': '0.3872'}
+
 39%|███▊      | 14700/37963 [36:09:07<64:13:01,  9.94s/it]
 39%|███▊      | 14701/37963 [36:09:14<60:01:35,  9.29s/it]
 39%|███▊      | 14702/37963 [36:09:28<69:23:52, 10.74s/it]
 39%|███▊      | 14703/37963 [36:09:36<62:53:17,  9.73s/it]
 39%|███▊      | 14704/37963 [36:09:43<58:49:47,  9.11s/it]
 39%|███▊      | 14705/37963 [36:09:58<68:42:28, 10.63s/it]
 39%|███▊      | 14706/37963 [36:10:06<63:31:43,  9.83s/it]
 39%|███▊      | 14707/37963 [36:10:13<59:22:17,  9.19s/it]
 39%|███▊      | 14708/37963 [36:10:21<56:18:40,  8.72s/it]
 39%|███▊      | 14709/37963 [36:10:29<54:16:44,  8.40s/it]
 39%|███▊      | 14710/37963 [36:10:36<52:48:23,  8.18s/it]
                                                           
{'loss': '0.162', 'grad_norm': '1.443', 'learning_rate': '1.401e-05', 'epoch': '0.3875'}
+
 39%|███▊      | 14710/37963 [36:10:36<52:48:23,  8.18s/it]
 39%|███▉      | 14711/37963 [36:10:44<51:47:23,  8.02s/it]
 39%|███▉      | 14712/37963 [36:10:52<51:28:02,  7.97s/it]
 39%|███▉      | 14713/37963 [36:10:59<50:53:23,  7.88s/it]
 39%|███▉      | 14714/37963 [36:11:07<50:29:20,  7.82s/it]
 39%|███▉      | 14715/37963 [36:11:15<49:58:44,  7.74s/it]
 39%|███▉      | 14716/37963 [36:11:22<49:41:08,  7.69s/it]
 39%|███▉      | 14717/37963 [36:11:30<49:50:38,  7.72s/it]
 39%|███▉      | 14718/37963 [36:11:38<49:43:00,  7.70s/it]
 39%|███▉      | 14719/37963 [36:11:45<49:37:18,  7.69s/it]
 39%|███▉      | 14720/37963 [36:11:53<49:31:36,  7.67s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '3.31', 'learning_rate': '1.401e-05', 'epoch': '0.3877'}
+
 39%|███▉      | 14720/37963 [36:11:53<49:31:36,  7.67s/it]
 39%|███▉      | 14721/37963 [36:12:08<63:06:03,  9.77s/it]
 39%|███▉      | 14722/37963 [36:12:15<59:07:24,  9.16s/it]
 39%|███▉      | 14723/37963 [36:12:23<56:05:15,  8.69s/it]
 39%|███▉      | 14724/37963 [36:12:30<53:34:40,  8.30s/it]
 39%|███▉      | 14725/37963 [36:12:38<52:39:23,  8.16s/it]
 39%|███▉      | 14726/37963 [36:12:46<51:54:12,  8.04s/it]
 39%|███▉      | 14727/37963 [36:12:53<50:49:17,  7.87s/it]
 39%|███▉      | 14728/37963 [36:13:01<50:13:40,  7.78s/it]
 39%|███▉      | 14729/37963 [36:13:08<49:33:36,  7.68s/it]
 39%|███▉      | 14730/37963 [36:13:16<49:36:26,  7.69s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '2.568', 'learning_rate': '1.4e-05', 'epoch': '0.388'}
+
 39%|███▉      | 14730/37963 [36:13:16<49:36:26,  7.69s/it]
 39%|███▉      | 14731/37963 [36:13:31<63:12:15,  9.79s/it]
 39%|███▉      | 14732/37963 [36:13:39<59:07:32,  9.16s/it]
 39%|███▉      | 14733/37963 [36:13:46<56:25:58,  8.75s/it]
 39%|███▉      | 14734/37963 [36:13:54<54:04:12,  8.38s/it]
 39%|███▉      | 14735/37963 [36:14:08<65:32:39, 10.16s/it]
 39%|███▉      | 14736/37963 [36:14:16<60:37:43,  9.40s/it]
 39%|███▉      | 14737/37963 [36:14:23<56:55:29,  8.82s/it]
 39%|███▉      | 14738/37963 [36:14:31<54:42:57,  8.48s/it]
 39%|███▉      | 14739/37963 [36:14:39<53:04:01,  8.23s/it]
 39%|███▉      | 14740/37963 [36:14:46<52:18:14,  8.11s/it]
                                                           
{'loss': '0.16', 'grad_norm': '2.671', 'learning_rate': '1.399e-05', 'epoch': '0.3883'}
+
 39%|███▉      | 14740/37963 [36:14:46<52:18:14,  8.11s/it]
 39%|███▉      | 14741/37963 [36:14:54<51:30:02,  7.98s/it]
 39%|███▉      | 14742/37963 [36:15:02<50:30:50,  7.83s/it]
 39%|███▉      | 14743/37963 [36:15:09<50:08:07,  7.77s/it]
 39%|███▉      | 14744/37963 [36:15:23<62:34:30,  9.70s/it]
 39%|███▉      | 14745/37963 [36:15:38<71:32:08, 11.09s/it]
 39%|███▉      | 14746/37963 [36:15:45<64:50:35, 10.05s/it]
 39%|███▉      | 14747/37963 [36:15:53<60:08:05,  9.32s/it]
 39%|███▉      | 14748/37963 [36:16:14<83:13:12, 12.91s/it]
 39%|███▉      | 14749/37963 [36:16:22<73:14:32, 11.36s/it]
 39%|███▉      | 14750/37963 [36:16:30<66:05:46, 10.25s/it]
                                                           
{'loss': '0.1766', 'grad_norm': '1.151', 'learning_rate': '1.398e-05', 'epoch': '0.3885'}
+
 39%|███▉      | 14750/37963 [36:16:30<66:05:46, 10.25s/it]
 39%|███▉      | 14751/37963 [36:16:38<61:25:18,  9.53s/it]
 39%|███▉      | 14752/37963 [36:16:45<57:44:48,  8.96s/it]
 39%|███▉      | 14753/37963 [36:16:53<55:13:54,  8.57s/it]
 39%|███▉      | 14754/37963 [36:17:00<53:07:57,  8.24s/it]
 39%|███▉      | 14755/37963 [36:17:14<64:26:28, 10.00s/it]
 39%|███▉      | 14756/37963 [36:17:22<60:06:00,  9.32s/it]
 39%|███▉      | 14757/37963 [36:17:30<57:00:52,  8.84s/it]
 39%|███▉      | 14758/37963 [36:17:38<54:58:59,  8.53s/it]
 39%|███▉      | 14759/37963 [36:17:45<53:18:25,  8.27s/it]
 39%|███▉      | 14760/37963 [36:17:53<52:19:47,  8.12s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '3.808', 'learning_rate': '1.398e-05', 'epoch': '0.3888'}
+
 39%|███▉      | 14760/37963 [36:17:53<52:19:47,  8.12s/it]
 39%|███▉      | 14761/37963 [36:18:01<51:38:33,  8.01s/it]
 39%|███▉      | 14762/37963 [36:18:09<50:56:02,  7.90s/it]
 39%|███▉      | 14763/37963 [36:18:16<50:43:25,  7.87s/it]
 39%|███▉      | 14764/37963 [36:18:24<50:30:44,  7.84s/it]
 39%|███▉      | 14765/37963 [36:18:32<50:18:34,  7.81s/it]
 39%|███▉      | 14766/37963 [36:18:39<50:04:16,  7.77s/it]
 39%|███▉      | 14767/37963 [36:18:47<50:02:27,  7.77s/it]
 39%|███▉      | 14768/37963 [36:18:55<50:03:06,  7.77s/it]
 39%|███▉      | 14769/37963 [36:19:09<62:21:17,  9.68s/it]
 39%|███▉      | 14770/37963 [36:19:17<59:05:05,  9.17s/it]
                                                           
{'loss': '0.1673', 'grad_norm': '2.179', 'learning_rate': '1.397e-05', 'epoch': '0.3891'}
+
 39%|███▉      | 14770/37963 [36:19:17<59:05:05,  9.17s/it]
 39%|███▉      | 14771/37963 [36:19:25<56:19:26,  8.74s/it]
 39%|███▉      | 14772/37963 [36:19:33<54:36:47,  8.48s/it]
 39%|███▉      | 14773/37963 [36:19:40<52:50:29,  8.20s/it]
 39%|███▉      | 14774/37963 [36:19:48<52:03:28,  8.08s/it]
 39%|███▉      | 14775/37963 [36:20:03<64:38:54, 10.04s/it]
 39%|███▉      | 14776/37963 [36:20:10<60:01:11,  9.32s/it]
 39%|███▉      | 14777/37963 [36:20:18<57:18:25,  8.90s/it]
 39%|███▉      | 14778/37963 [36:20:26<54:30:25,  8.46s/it]
 39%|███▉      | 14779/37963 [36:20:40<66:03:11, 10.26s/it]
 39%|███▉      | 14780/37963 [36:20:48<61:05:00,  9.49s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '1.86', 'learning_rate': '1.396e-05', 'epoch': '0.3893'}
+
 39%|███▉      | 14780/37963 [36:20:48<61:05:00,  9.49s/it]
 39%|███▉      | 14781/37963 [36:20:55<57:32:37,  8.94s/it]
 39%|███▉      | 14782/37963 [36:21:03<55:06:19,  8.56s/it]
 39%|███▉      | 14783/37963 [36:21:11<53:29:24,  8.31s/it]
 39%|███▉      | 14784/37963 [36:21:19<52:43:08,  8.19s/it]
 39%|███▉      | 14785/37963 [36:21:26<51:43:50,  8.03s/it]
 39%|███▉      | 14786/37963 [36:21:34<51:09:50,  7.95s/it]
 39%|███▉      | 14787/37963 [36:21:42<50:18:51,  7.82s/it]
 39%|███▉      | 14788/37963 [36:21:49<50:10:38,  7.79s/it]
 39%|███▉      | 14789/37963 [36:21:57<49:54:41,  7.75s/it]
 39%|███▉      | 14790/37963 [36:22:05<49:13:38,  7.65s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '3.567', 'learning_rate': '1.395e-05', 'epoch': '0.3896'}
+
 39%|███▉      | 14790/37963 [36:22:05<49:13:38,  7.65s/it]
 39%|███▉      | 14791/37963 [36:22:12<49:23:04,  7.67s/it]
 39%|███▉      | 14792/37963 [36:22:27<63:26:44,  9.86s/it]
 39%|███▉      | 14793/37963 [36:22:41<71:46:05, 11.15s/it]
 39%|███▉      | 14794/37963 [36:22:49<65:06:25, 10.12s/it]
 39%|███▉      | 14795/37963 [36:23:03<73:12:09, 11.37s/it]
 39%|███▉      | 14796/37963 [36:23:11<66:07:11, 10.27s/it]
 39%|███▉      | 14797/37963 [36:23:26<74:14:26, 11.54s/it]
 39%|███▉      | 14798/37963 [36:23:34<67:19:44, 10.46s/it]
 39%|███▉      | 14799/37963 [36:23:48<75:19:33, 11.71s/it]
 39%|███▉      | 14800/37963 [36:23:56<67:59:19, 10.57s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '0.9674', 'learning_rate': '1.394e-05', 'epoch': '0.3899'}
+
 39%|███▉      | 14800/37963 [36:23:56<67:59:19, 10.57s/it]
 39%|███▉      | 14801/37963 [36:24:04<62:27:56,  9.71s/it]
 39%|███▉      | 14802/37963 [36:24:11<58:30:18,  9.09s/it]
 39%|███▉      | 14803/37963 [36:24:19<55:57:19,  8.70s/it]
 39%|███▉      | 14804/37963 [36:24:27<53:51:38,  8.37s/it]
 39%|███▉      | 14805/37963 [36:24:34<52:25:10,  8.15s/it]
 39%|███▉      | 14806/37963 [36:24:42<51:33:07,  8.01s/it]
 39%|███▉      | 14807/37963 [36:24:50<50:40:47,  7.88s/it]
 39%|███▉      | 14808/37963 [36:24:57<49:51:33,  7.75s/it]
 39%|███▉      | 14809/37963 [36:25:05<49:42:18,  7.73s/it]
 39%|███▉      | 14810/37963 [36:25:13<49:42:16,  7.73s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '2.363', 'learning_rate': '1.394e-05', 'epoch': '0.3901'}
+
 39%|███▉      | 14810/37963 [36:25:13<49:42:16,  7.73s/it]
 39%|███▉      | 14811/37963 [36:25:20<49:35:40,  7.71s/it]
 39%|███▉      | 14812/37963 [36:25:28<49:14:45,  7.66s/it]
 39%|███▉      | 14813/37963 [36:25:35<49:10:47,  7.65s/it]
 39%|███▉      | 14814/37963 [36:25:43<49:15:01,  7.66s/it]
 39%|███▉      | 14815/37963 [36:25:51<49:18:21,  7.67s/it]
 39%|███▉      | 14816/37963 [36:25:58<49:12:24,  7.65s/it]
 39%|███▉      | 14817/37963 [36:26:13<62:23:53,  9.71s/it]
 39%|███▉      | 14818/37963 [36:26:21<58:38:57,  9.12s/it]
 39%|███▉      | 14819/37963 [36:26:35<69:12:11, 10.76s/it]
 39%|███▉      | 14820/37963 [36:26:43<63:24:01,  9.86s/it]
                                                           
{'loss': '0.16', 'grad_norm': '4.902', 'learning_rate': '1.393e-05', 'epoch': '0.3904'}
+
 39%|███▉      | 14820/37963 [36:26:43<63:24:01,  9.86s/it]
 39%|███▉      | 14821/37963 [36:26:51<59:08:36,  9.20s/it]
 39%|███▉      | 14822/37963 [36:26:58<56:09:24,  8.74s/it]
 39%|███▉      | 14823/37963 [36:27:06<53:56:16,  8.39s/it]
 39%|███▉      | 14824/37963 [36:27:13<52:14:31,  8.13s/it]
 39%|███▉      | 14825/37963 [36:27:21<51:35:28,  8.03s/it]
 39%|███▉      | 14826/37963 [36:27:29<50:44:52,  7.90s/it]
 39%|███▉      | 14827/37963 [36:27:36<50:02:22,  7.79s/it]
 39%|███▉      | 14828/37963 [36:27:44<49:48:50,  7.75s/it]
 39%|███▉      | 14829/37963 [36:27:52<49:38:03,  7.72s/it]
 39%|███▉      | 14830/37963 [36:27:59<49:39:52,  7.73s/it]
                                                           
{'loss': '0.159', 'grad_norm': '3.704', 'learning_rate': '1.392e-05', 'epoch': '0.3906'}
+
 39%|███▉      | 14830/37963 [36:27:59<49:39:52,  7.73s/it]
 39%|███▉      | 14831/37963 [36:28:07<49:32:58,  7.71s/it]
 39%|███▉      | 14832/37963 [36:28:15<49:38:54,  7.73s/it]
 39%|███▉      | 14833/37963 [36:28:29<62:43:54,  9.76s/it]
 39%|███▉      | 14834/37963 [36:28:37<58:42:31,  9.14s/it]
 39%|███▉      | 14835/37963 [36:28:45<55:56:06,  8.71s/it]
 39%|███▉      | 14836/37963 [36:28:52<53:54:30,  8.39s/it]
 39%|███▉      | 14837/37963 [36:29:00<52:15:12,  8.13s/it]
 39%|███▉      | 14838/37963 [36:29:08<51:13:56,  7.98s/it]
 39%|███▉      | 14839/37963 [36:29:22<64:35:15, 10.06s/it]
 39%|███▉      | 14840/37963 [36:29:30<59:36:24,  9.28s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '1.498', 'learning_rate': '1.391e-05', 'epoch': '0.3909'}
+
 39%|███▉      | 14840/37963 [36:29:30<59:36:24,  9.28s/it]
 39%|███▉      | 14841/37963 [36:29:37<56:21:11,  8.77s/it]
 39%|███▉      | 14842/37963 [36:29:45<54:16:16,  8.45s/it]
 39%|███▉      | 14843/37963 [36:30:07<79:23:24, 12.36s/it]
 39%|███▉      | 14844/37963 [36:30:14<70:17:25, 10.95s/it]
 39%|███▉      | 14845/37963 [36:30:35<89:13:44, 13.89s/it]
 39%|███▉      | 14846/37963 [36:30:43<77:41:50, 12.10s/it]
 39%|███▉      | 14847/37963 [36:30:50<68:46:20, 10.71s/it]
 39%|███▉      | 14848/37963 [36:30:58<63:16:21,  9.85s/it]
 39%|███▉      | 14849/37963 [36:31:06<58:57:00,  9.18s/it]
 39%|███▉      | 14850/37963 [36:31:14<55:57:33,  8.72s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '1.593', 'learning_rate': '1.39e-05', 'epoch': '0.3912'}
+
 39%|███▉      | 14850/37963 [36:31:14<55:57:33,  8.72s/it]
 39%|███▉      | 14851/37963 [36:31:21<54:05:20,  8.43s/it]
 39%|███▉      | 14852/37963 [36:31:29<52:35:46,  8.19s/it]
 39%|███▉      | 14853/37963 [36:31:37<51:31:11,  8.03s/it]
 39%|███▉      | 14854/37963 [36:31:44<50:40:27,  7.89s/it]
 39%|███▉      | 14855/37963 [36:31:52<50:11:53,  7.82s/it]
 39%|███▉      | 14856/37963 [36:32:00<49:55:08,  7.78s/it]
 39%|███▉      | 14857/37963 [36:32:07<49:32:11,  7.72s/it]
 39%|███▉      | 14858/37963 [36:32:15<49:18:43,  7.68s/it]
 39%|███▉      | 14859/37963 [36:32:22<49:17:58,  7.68s/it]
 39%|███▉      | 14860/37963 [36:32:30<49:08:42,  7.66s/it]
                                                           
{'loss': '0.156', 'grad_norm': '2.481', 'learning_rate': '1.39e-05', 'epoch': '0.3914'}
+
 39%|███▉      | 14860/37963 [36:32:30<49:08:42,  7.66s/it]
 39%|███▉      | 14861/37963 [36:32:38<48:59:49,  7.64s/it]
 39%|███▉      | 14862/37963 [36:32:45<48:42:01,  7.59s/it]
 39%|███▉      | 14863/37963 [36:32:53<48:54:38,  7.62s/it]
 39%|███▉      | 14864/37963 [36:33:00<48:42:22,  7.59s/it]
 39%|███▉      | 14865/37963 [36:33:08<48:50:38,  7.61s/it]
 39%|███▉      | 14866/37963 [36:33:16<48:56:28,  7.63s/it]
 39%|███▉      | 14867/37963 [36:33:23<49:02:20,  7.64s/it]
 39%|███▉      | 14868/37963 [36:33:31<48:57:47,  7.63s/it]
 39%|███▉      | 14869/37963 [36:33:46<62:54:02,  9.81s/it]
 39%|███▉      | 14870/37963 [36:33:54<59:01:58,  9.20s/it]
                                                           
{'loss': '0.153', 'grad_norm': '3.608', 'learning_rate': '1.389e-05', 'epoch': '0.3917'}
+
 39%|███▉      | 14870/37963 [36:33:54<59:01:58,  9.20s/it]
 39%|███▉      | 14871/37963 [36:34:01<55:58:50,  8.73s/it]
 39%|███▉      | 14872/37963 [36:34:08<53:07:14,  8.28s/it]
 39%|███▉      | 14873/37963 [36:34:24<66:55:29, 10.43s/it]
 39%|███▉      | 14874/37963 [36:34:32<61:38:37,  9.61s/it]
 39%|███▉      | 14875/37963 [36:34:39<57:51:25,  9.02s/it]
 39%|███▉      | 14876/37963 [36:34:47<55:15:51,  8.62s/it]
 39%|███▉      | 14877/37963 [36:34:55<53:28:44,  8.34s/it]
 39%|███▉      | 14878/37963 [36:35:02<52:04:44,  8.12s/it]
 39%|███▉      | 14879/37963 [36:35:10<51:26:05,  8.02s/it]
 39%|███▉      | 14880/37963 [36:35:18<50:42:09,  7.91s/it]
                                                           
{'loss': '0.159', 'grad_norm': '2.024', 'learning_rate': '1.388e-05', 'epoch': '0.392'}
+
 39%|███▉      | 14880/37963 [36:35:18<50:42:09,  7.91s/it]
 39%|███▉      | 14881/37963 [36:35:32<62:28:29,  9.74s/it]
 39%|███▉      | 14882/37963 [36:35:39<58:25:52,  9.11s/it]
 39%|███▉      | 14883/37963 [36:35:47<56:00:32,  8.74s/it]
 39%|███▉      | 14884/37963 [36:35:55<53:51:59,  8.40s/it]
 39%|███▉      | 14885/37963 [36:36:02<52:13:53,  8.15s/it]
 39%|███▉      | 14886/37963 [36:36:17<64:02:35,  9.99s/it]
 39%|███▉      | 14887/37963 [36:36:24<59:22:28,  9.26s/it]
 39%|███▉      | 14888/37963 [36:36:32<56:26:29,  8.81s/it]
 39%|███▉      | 14889/37963 [36:36:40<54:14:42,  8.46s/it]
 39%|███▉      | 14890/37963 [36:37:01<78:54:13, 12.31s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '1.269', 'learning_rate': '1.387e-05', 'epoch': '0.3922'}
+
 39%|███▉      | 14890/37963 [36:37:01<78:54:13, 12.31s/it]
 39%|███▉      | 14891/37963 [36:37:15<82:23:26, 12.86s/it]
 39%|███▉      | 14892/37963 [36:37:23<72:27:51, 11.31s/it]
 39%|███▉      | 14893/37963 [36:37:30<65:17:47, 10.19s/it]
 39%|███▉      | 14894/37963 [36:37:44<72:35:28, 11.33s/it]
 39%|███▉      | 14895/37963 [36:37:53<67:17:27, 10.50s/it]
 39%|███▉      | 14896/37963 [36:38:00<61:51:52,  9.66s/it]
 39%|███▉      | 14897/37963 [36:38:08<58:02:47,  9.06s/it]
 39%|███▉      | 14898/37963 [36:38:16<55:19:53,  8.64s/it]
 39%|███▉      | 14899/37963 [36:38:23<53:29:50,  8.35s/it]
 39%|███▉      | 14900/37963 [36:38:31<52:11:03,  8.15s/it]
                                                           
{'loss': '0.1464', 'grad_norm': '2.557', 'learning_rate': '1.387e-05', 'epoch': '0.3925'}
+
 39%|███▉      | 14900/37963 [36:38:31<52:11:03,  8.15s/it]
 39%|███▉      | 14901/37963 [36:38:39<51:43:13,  8.07s/it]
 39%|███▉      | 14902/37963 [36:38:47<51:09:48,  7.99s/it]
 39%|███▉      | 14903/37963 [36:38:54<50:29:08,  7.88s/it]
 39%|███▉      | 14904/37963 [36:39:02<49:32:32,  7.73s/it]
 39%|███▉      | 14905/37963 [36:39:09<49:10:08,  7.68s/it]
 39%|███▉      | 14906/37963 [36:39:17<49:20:46,  7.70s/it]
 39%|███▉      | 14907/37963 [36:39:25<48:51:08,  7.63s/it]
 39%|███▉      | 14908/37963 [36:39:32<49:11:08,  7.68s/it]
 39%|███▉      | 14909/37963 [36:39:40<48:39:05,  7.60s/it]
 39%|███▉      | 14910/37963 [36:39:48<48:50:33,  7.63s/it]
                                                           
{'loss': '0.1709', 'grad_norm': '1.798', 'learning_rate': '1.386e-05', 'epoch': '0.3928'}
+
 39%|███▉      | 14910/37963 [36:39:48<48:50:33,  7.63s/it]
 39%|███▉      | 14911/37963 [36:39:55<48:51:42,  7.63s/it]
 39%|███▉      | 14912/37963 [36:40:03<49:12:01,  7.68s/it]
 39%|███▉      | 14913/37963 [36:40:11<49:00:49,  7.66s/it]
 39%|███▉      | 14914/37963 [36:40:18<49:29:45,  7.73s/it]
 39%|███▉      | 14915/37963 [36:40:26<49:29:25,  7.73s/it]
 39%|███▉      | 14916/37963 [36:40:34<49:21:57,  7.71s/it]
 39%|███▉      | 14917/37963 [36:40:42<49:39:40,  7.76s/it]
 39%|███▉      | 14918/37963 [36:40:57<63:20:41,  9.90s/it]
 39%|███▉      | 14919/37963 [36:41:04<59:08:15,  9.24s/it]
 39%|███▉      | 14920/37963 [36:41:19<69:21:59, 10.84s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '1.825', 'learning_rate': '1.385e-05', 'epoch': '0.393'}
+
 39%|███▉      | 14920/37963 [36:41:19<69:21:59, 10.84s/it]
 39%|███▉      | 14921/37963 [36:41:26<62:53:35,  9.83s/it]
 39%|███▉      | 14922/37963 [36:41:34<58:54:57,  9.21s/it]
 39%|███▉      | 14923/37963 [36:41:42<56:09:16,  8.77s/it]
 39%|███▉      | 14924/37963 [36:41:50<54:21:01,  8.49s/it]
 39%|███▉      | 14925/37963 [36:41:57<52:37:24,  8.22s/it]
 39%|███▉      | 14926/37963 [36:42:05<51:38:48,  8.07s/it]
 39%|███▉      | 14927/37963 [36:42:13<50:47:51,  7.94s/it]
 39%|███▉      | 14928/37963 [36:42:20<50:04:46,  7.83s/it]
 39%|███▉      | 14929/37963 [36:42:28<49:38:54,  7.76s/it]
 39%|███▉      | 14930/37963 [36:42:42<62:19:19,  9.74s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '1.743', 'learning_rate': '1.384e-05', 'epoch': '0.3933'}
+
 39%|███▉      | 14930/37963 [36:42:42<62:19:19,  9.74s/it]
 39%|███▉      | 14931/37963 [36:42:50<57:43:48,  9.02s/it]
 39%|███▉      | 14932/37963 [36:42:57<54:46:08,  8.56s/it]
 39%|███▉      | 14933/37963 [36:43:05<53:16:41,  8.33s/it]
 39%|███▉      | 14934/37963 [36:43:19<65:01:33, 10.17s/it]
 39%|███▉      | 14935/37963 [36:43:27<60:25:17,  9.45s/it]
 39%|███▉      | 14936/37963 [36:43:34<56:33:30,  8.84s/it]
 39%|███▉      | 14937/37963 [36:43:49<66:32:38, 10.40s/it]
 39%|███▉      | 14938/37963 [36:44:03<75:09:05, 11.75s/it]
 39%|███▉      | 14939/37963 [36:44:11<67:11:00, 10.50s/it]
 39%|███▉      | 14940/37963 [36:44:26<75:03:03, 11.74s/it]
                                                           
{'loss': '0.1602', 'grad_norm': '3.053', 'learning_rate': '1.383e-05', 'epoch': '0.3935'}
+
 39%|███▉      | 14940/37963 [36:44:26<75:03:03, 11.74s/it]
 39%|███▉      | 14941/37963 [36:44:40<79:55:31, 12.50s/it]
 39%|███▉      | 14942/37963 [36:44:47<70:22:51, 11.01s/it]
 39%|███▉      | 14943/37963 [36:44:55<63:58:24, 10.00s/it]
 39%|███▉      | 14944/37963 [36:45:03<59:19:07,  9.28s/it]
 39%|███▉      | 14945/37963 [36:45:10<56:08:37,  8.78s/it]
 39%|███▉      | 14946/37963 [36:45:18<54:07:29,  8.47s/it]
 39%|███▉      | 14947/37963 [36:45:26<52:28:16,  8.21s/it]
 39%|███▉      | 14948/37963 [36:45:33<51:30:58,  8.06s/it]
 39%|███▉      | 14949/37963 [36:45:41<50:47:05,  7.94s/it]
 39%|███▉      | 14950/37963 [36:45:49<50:25:55,  7.89s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '2.13', 'learning_rate': '1.383e-05', 'epoch': '0.3938'}
+
 39%|███▉      | 14950/37963 [36:45:49<50:25:55,  7.89s/it]
 39%|███▉      | 14951/37963 [36:45:56<50:00:24,  7.82s/it]
 39%|███▉      | 14952/37963 [36:46:04<49:06:23,  7.68s/it]
 39%|███▉      | 14953/37963 [36:46:11<48:41:04,  7.62s/it]
 39%|███▉      | 14954/37963 [36:46:19<48:58:53,  7.66s/it]
 39%|███▉      | 14955/37963 [36:46:27<48:55:53,  7.66s/it]
 39%|███▉      | 14956/37963 [36:46:34<49:00:19,  7.67s/it]
 39%|███▉      | 14957/37963 [36:46:42<48:59:33,  7.67s/it]
 39%|███▉      | 14958/37963 [36:46:50<49:00:46,  7.67s/it]
 39%|███▉      | 14959/37963 [36:46:57<48:58:37,  7.66s/it]
 39%|███▉      | 14960/37963 [36:47:05<49:16:48,  7.71s/it]
                                                           
{'loss': '0.157', 'grad_norm': '1.163', 'learning_rate': '1.382e-05', 'epoch': '0.3941'}
+
 39%|███▉      | 14960/37963 [36:47:05<49:16:48,  7.71s/it]
 39%|███▉      | 14961/37963 [36:47:13<49:24:07,  7.73s/it]
 39%|███▉      | 14962/37963 [36:47:21<49:01:57,  7.67s/it]
 39%|███▉      | 14963/37963 [36:47:28<48:44:03,  7.63s/it]
 39%|███▉      | 14964/37963 [36:47:36<48:54:02,  7.65s/it]
 39%|███▉      | 14965/37963 [36:47:51<63:11:33,  9.89s/it]
 39%|███▉      | 14966/37963 [36:47:59<59:14:47,  9.27s/it]
 39%|███▉      | 14967/37963 [36:48:06<56:25:44,  8.83s/it]
 39%|███▉      | 14968/37963 [36:48:14<54:08:48,  8.48s/it]
 39%|███▉      | 14969/37963 [36:48:29<65:33:25, 10.26s/it]
 39%|███▉      | 14970/37963 [36:48:36<60:43:37,  9.51s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '1.244', 'learning_rate': '1.381e-05', 'epoch': '0.3943'}
+
 39%|███▉      | 14970/37963 [36:48:36<60:43:37,  9.51s/it]
 39%|███▉      | 14971/37963 [36:48:44<57:05:48,  8.94s/it]
 39%|███▉      | 14972/37963 [36:48:52<54:59:16,  8.61s/it]
 39%|███▉      | 14973/37963 [36:48:59<53:07:13,  8.32s/it]
 39%|███▉      | 14974/37963 [36:49:07<51:38:58,  8.09s/it]
 39%|███▉      | 14975/37963 [36:49:15<50:43:48,  7.94s/it]
 39%|███▉      | 14976/37963 [36:49:22<49:53:09,  7.81s/it]
 39%|███▉      | 14977/37963 [36:49:30<49:25:40,  7.74s/it]
 39%|███▉      | 14978/37963 [36:49:37<49:01:29,  7.68s/it]
 39%|███▉      | 14979/37963 [36:49:45<48:52:45,  7.66s/it]
 39%|███▉      | 14980/37963 [36:49:52<48:26:51,  7.59s/it]
                                                           
{'loss': '0.1545', 'grad_norm': '1.058', 'learning_rate': '1.38e-05', 'epoch': '0.3946'}
+
 39%|███▉      | 14980/37963 [36:49:52<48:26:51,  7.59s/it]
 39%|███▉      | 14981/37963 [36:50:07<61:39:45,  9.66s/it]
 39%|███▉      | 14982/37963 [36:50:21<71:20:44, 11.18s/it]
 39%|███▉      | 14983/37963 [36:50:35<76:43:55, 12.02s/it]
 39%|███▉      | 14984/37963 [36:50:50<82:05:31, 12.86s/it]
 39%|███▉      | 14985/37963 [36:50:58<72:16:16, 11.32s/it]
 39%|███▉      | 14986/37963 [36:51:06<65:19:35, 10.24s/it]
 39%|███▉      | 14987/37963 [36:51:20<72:21:56, 11.34s/it]
 39%|███▉      | 14988/37963 [36:51:27<65:35:41, 10.28s/it]
 39%|███▉      | 14989/37963 [36:51:42<73:07:48, 11.46s/it]
 39%|███▉      | 14990/37963 [36:51:49<65:59:35, 10.34s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '1.782', 'learning_rate': '1.379e-05', 'epoch': '0.3949'}
+
 39%|███▉      | 14990/37963 [36:51:49<65:59:35, 10.34s/it]
 39%|███▉      | 14991/37963 [36:51:57<60:49:53,  9.53s/it]
 39%|███▉      | 14992/37963 [36:52:05<57:11:48,  8.96s/it]
 39%|███▉      | 14993/37963 [36:52:12<54:39:51,  8.57s/it]
 39%|███▉      | 14994/37963 [36:52:20<52:42:19,  8.26s/it]
 39%|███▉      | 14995/37963 [36:52:27<51:28:20,  8.07s/it]
 40%|███▉      | 14996/37963 [36:52:35<50:40:57,  7.94s/it]
 40%|███▉      | 14997/37963 [36:52:43<50:01:09,  7.84s/it]
 40%|███▉      | 14998/37963 [36:52:50<49:30:52,  7.76s/it]
 40%|███▉      | 14999/37963 [36:52:58<48:46:31,  7.65s/it]
 40%|███▉      | 15000/37963 [36:53:05<48:33:37,  7.61s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '1.191', 'learning_rate': '1.379e-05', 'epoch': '0.3951'}
+
 40%|███▉      | 15000/37963 [36:53:05<48:33:37,  7.61s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.71s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.71s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 40%|███▉      | 15001/37963 [36:54:01<140:12:23, 21.98s/it]
 40%|███▉      | 15002/37963 [36:54:08<112:49:01, 17.69s/it]
 40%|███▉      | 15003/37963 [36:54:16<93:40:00, 14.69s/it] 
 40%|███▉      | 15004/37963 [36:54:24<80:25:35, 12.61s/it]
 40%|███▉      | 15005/37963 [36:54:32<71:12:19, 11.17s/it]
 40%|███▉      | 15006/37963 [36:54:39<64:54:11, 10.18s/it]
 40%|███▉      | 15007/37963 [36:54:47<60:26:15,  9.48s/it]
 40%|███▉      | 15008/37963 [36:54:55<57:08:46,  8.96s/it]
 40%|███▉      | 15009/37963 [36:55:03<54:49:40,  8.60s/it]
 40%|███▉      | 15010/37963 [36:55:11<53:26:09,  8.38s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '3.846', 'learning_rate': '1.378e-05', 'epoch': '0.3954'}
+
 40%|███▉      | 15010/37963 [36:55:11<53:26:09,  8.38s/it]
 40%|███▉      | 15011/37963 [36:55:26<66:07:44, 10.37s/it]
 40%|███▉      | 15012/37963 [36:55:33<61:08:28,  9.59s/it]
 40%|███▉      | 15013/37963 [36:55:41<58:07:13,  9.12s/it]
 40%|███▉      | 15014/37963 [36:55:49<55:41:36,  8.74s/it]
 40%|███▉      | 15015/37963 [36:55:57<53:34:53,  8.41s/it]
 40%|███▉      | 15016/37963 [36:56:05<52:30:55,  8.24s/it]
 40%|███▉      | 15017/37963 [36:56:20<64:55:24, 10.19s/it]
 40%|███▉      | 15018/37963 [36:56:27<60:36:23,  9.51s/it]
 40%|███▉      | 15019/37963 [36:56:35<56:57:21,  8.94s/it]
 40%|███▉      | 15020/37963 [36:56:43<54:52:16,  8.61s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '1.395', 'learning_rate': '1.377e-05', 'epoch': '0.3956'}
+
 40%|███▉      | 15020/37963 [36:56:43<54:52:16,  8.61s/it]
 40%|███▉      | 15021/37963 [36:56:50<52:53:10,  8.30s/it]
 40%|███▉      | 15022/37963 [36:56:58<51:58:34,  8.16s/it]
 40%|███▉      | 15023/37963 [36:57:06<51:02:56,  8.01s/it]
 40%|███▉      | 15024/37963 [36:57:14<50:18:04,  7.89s/it]
 40%|███▉      | 15025/37963 [36:57:28<63:27:02,  9.96s/it]
 40%|███▉      | 15026/37963 [36:57:36<59:17:42,  9.31s/it]
 40%|███▉      | 15027/37963 [36:57:43<55:17:07,  8.68s/it]
 40%|███▉      | 15028/37963 [36:57:59<68:03:41, 10.68s/it]
 40%|███▉      | 15029/37963 [36:58:06<62:16:04,  9.77s/it]
 40%|███▉      | 15030/37963 [36:58:14<58:21:07,  9.16s/it]
                                                           
{'loss': '0.167', 'grad_norm': '1.315', 'learning_rate': '1.376e-05', 'epoch': '0.3959'}
+
 40%|███▉      | 15030/37963 [36:58:14<58:21:07,  9.16s/it]
 40%|███▉      | 15031/37963 [36:58:28<67:49:45, 10.65s/it]
 40%|███▉      | 15032/37963 [36:58:36<62:16:08,  9.78s/it]
 40%|███▉      | 15033/37963 [36:58:57<83:38:14, 13.13s/it]
 40%|███▉      | 15034/37963 [36:59:05<73:16:23, 11.50s/it]
 40%|███▉      | 15035/37963 [36:59:12<65:53:46, 10.35s/it]
 40%|███▉      | 15036/37963 [36:59:20<61:15:04,  9.62s/it]
 40%|███▉      | 15037/37963 [36:59:28<56:58:56,  8.95s/it]
 40%|███▉      | 15038/37963 [36:59:42<67:06:10, 10.54s/it]
 40%|███▉      | 15039/37963 [36:59:50<61:45:06,  9.70s/it]
 40%|███▉      | 15040/37963 [36:59:57<58:02:23,  9.12s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '3.749', 'learning_rate': '1.375e-05', 'epoch': '0.3962'}
+
 40%|███▉      | 15040/37963 [36:59:57<58:02:23,  9.12s/it]
 40%|███▉      | 15041/37963 [37:00:05<54:52:41,  8.62s/it]
 40%|███▉      | 15042/37963 [37:00:12<53:06:13,  8.34s/it]
 40%|███▉      | 15043/37963 [37:00:20<52:14:10,  8.20s/it]
 40%|███▉      | 15044/37963 [37:00:28<51:09:25,  8.04s/it]
 40%|███▉      | 15045/37963 [37:00:36<50:16:58,  7.90s/it]
 40%|███▉      | 15046/37963 [37:00:43<49:41:44,  7.81s/it]
 40%|███▉      | 15047/37963 [37:00:51<49:31:13,  7.78s/it]
 40%|███▉      | 15048/37963 [37:00:59<49:17:47,  7.74s/it]
 40%|███▉      | 15049/37963 [37:01:06<49:12:54,  7.73s/it]
 40%|███▉      | 15050/37963 [37:01:14<49:04:49,  7.71s/it]
                                                           
{'loss': '0.1541', 'grad_norm': '1.453', 'learning_rate': '1.375e-05', 'epoch': '0.3964'}
+
 40%|███▉      | 15050/37963 [37:01:14<49:04:49,  7.71s/it]
 40%|███▉      | 15051/37963 [37:01:22<48:53:49,  7.68s/it]
 40%|███▉      | 15052/37963 [37:01:29<48:51:51,  7.68s/it]
 40%|███▉      | 15053/37963 [37:01:37<48:44:21,  7.66s/it]
 40%|███▉      | 15054/37963 [37:01:45<48:47:33,  7.67s/it]
 40%|███▉      | 15055/37963 [37:01:52<48:45:18,  7.66s/it]
 40%|███▉      | 15056/37963 [37:02:00<48:42:31,  7.65s/it]
 40%|███▉      | 15057/37963 [37:02:07<48:33:38,  7.63s/it]
 40%|███▉      | 15058/37963 [37:02:22<62:42:35,  9.86s/it]
 40%|███▉      | 15059/37963 [37:02:30<58:46:20,  9.24s/it]
 40%|███▉      | 15060/37963 [37:02:38<55:32:23,  8.73s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '1.039', 'learning_rate': '1.374e-05', 'epoch': '0.3967'}
+
 40%|███▉      | 15060/37963 [37:02:38<55:32:23,  8.73s/it]
 40%|███▉      | 15061/37963 [37:02:45<53:24:03,  8.39s/it]
 40%|███▉      | 15062/37963 [37:02:53<52:04:18,  8.19s/it]
 40%|███▉      | 15063/37963 [37:03:01<50:55:57,  8.01s/it]
 40%|███▉      | 15064/37963 [37:03:08<50:09:47,  7.89s/it]
 40%|███▉      | 15065/37963 [37:03:16<49:37:01,  7.80s/it]
 40%|███▉      | 15066/37963 [37:03:24<49:17:44,  7.75s/it]
 40%|███▉      | 15067/37963 [37:03:31<49:24:33,  7.77s/it]
 40%|███▉      | 15068/37963 [37:03:53<75:02:36, 11.80s/it]
 40%|███▉      | 15069/37963 [37:04:00<66:50:35, 10.51s/it]
 40%|███▉      | 15070/37963 [37:04:07<60:46:35,  9.56s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '1.644', 'learning_rate': '1.373e-05', 'epoch': '0.397'}
+
 40%|███▉      | 15070/37963 [37:04:07<60:46:35,  9.56s/it]
 40%|███▉      | 15071/37963 [37:04:15<57:23:09,  9.02s/it]
 40%|███▉      | 15072/37963 [37:04:23<54:41:13,  8.60s/it]
 40%|███▉      | 15073/37963 [37:04:30<52:44:08,  8.29s/it]
 40%|███▉      | 15074/37963 [37:04:38<51:14:11,  8.06s/it]
 40%|███▉      | 15075/37963 [37:04:45<50:17:04,  7.91s/it]
 40%|███▉      | 15076/37963 [37:04:53<49:56:05,  7.85s/it]
 40%|███▉      | 15077/37963 [37:05:07<62:07:15,  9.77s/it]
 40%|███▉      | 15078/37963 [37:05:15<57:39:43,  9.07s/it]
 40%|███▉      | 15079/37963 [37:05:23<55:35:08,  8.74s/it]
 40%|███▉      | 15080/37963 [37:05:38<67:18:29, 10.59s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '3.384', 'learning_rate': '1.372e-05', 'epoch': '0.3972'}
+
 40%|███▉      | 15080/37963 [37:05:38<67:18:29, 10.59s/it]
 40%|███▉      | 15081/37963 [37:05:45<61:36:31,  9.69s/it]
 40%|███▉      | 15082/37963 [37:06:00<71:00:04, 11.17s/it]
 40%|███▉      | 15083/37963 [37:06:14<77:25:07, 12.18s/it]
 40%|███▉      | 15084/37963 [37:06:22<69:09:47, 10.88s/it]
 40%|███▉      | 15085/37963 [37:06:30<63:17:03,  9.96s/it]
 40%|███▉      | 15086/37963 [37:06:37<58:19:05,  9.18s/it]
 40%|███▉      | 15087/37963 [37:06:52<68:53:33, 10.84s/it]
 40%|███▉      | 15088/37963 [37:07:00<63:01:11,  9.92s/it]
 40%|███▉      | 15089/37963 [37:07:08<58:44:21,  9.24s/it]
 40%|███▉      | 15090/37963 [37:07:15<55:40:23,  8.76s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '1.048', 'learning_rate': '1.372e-05', 'epoch': '0.3975'}
+
 40%|███▉      | 15090/37963 [37:07:15<55:40:23,  8.76s/it]
 40%|███▉      | 15091/37963 [37:07:23<53:26:13,  8.41s/it]
 40%|███▉      | 15092/37963 [37:07:30<51:19:46,  8.08s/it]
 40%|███▉      | 15093/37963 [37:07:38<50:22:57,  7.93s/it]
 40%|███▉      | 15094/37963 [37:07:45<49:21:03,  7.77s/it]
 40%|███▉      | 15095/37963 [37:07:53<49:10:16,  7.74s/it]
 40%|███▉      | 15096/37963 [37:08:01<49:09:30,  7.74s/it]
 40%|███▉      | 15097/37963 [37:08:08<49:14:58,  7.75s/it]
 40%|███▉      | 15098/37963 [37:08:16<49:06:53,  7.73s/it]
 40%|███▉      | 15099/37963 [37:08:24<48:45:45,  7.68s/it]
 40%|███▉      | 15100/37963 [37:08:31<48:44:33,  7.67s/it]
                                                           
{'loss': '0.169', 'grad_norm': '2.933', 'learning_rate': '1.371e-05', 'epoch': '0.3978'}
+
 40%|███▉      | 15100/37963 [37:08:31<48:44:33,  7.67s/it]
 40%|███▉      | 15101/37963 [37:08:39<48:44:08,  7.67s/it]
 40%|███▉      | 15102/37963 [37:08:54<63:02:16,  9.93s/it]
 40%|███▉      | 15103/37963 [37:09:02<59:04:03,  9.30s/it]
 40%|███▉      | 15104/37963 [37:09:10<55:46:56,  8.79s/it]
 40%|███▉      | 15105/37963 [37:09:17<53:39:31,  8.45s/it]
 40%|███▉      | 15106/37963 [37:09:25<52:20:17,  8.24s/it]
 40%|███▉      | 15107/37963 [37:09:33<51:11:53,  8.06s/it]
 40%|███▉      | 15108/37963 [37:09:40<50:38:10,  7.98s/it]
 40%|███▉      | 15109/37963 [37:09:48<50:12:56,  7.91s/it]
 40%|███▉      | 15110/37963 [37:09:56<49:41:03,  7.83s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '1.547', 'learning_rate': '1.37e-05', 'epoch': '0.398'}
+
 40%|███▉      | 15110/37963 [37:09:56<49:41:03,  7.83s/it]
 40%|███▉      | 15111/37963 [37:10:03<49:16:54,  7.76s/it]
 40%|███▉      | 15112/37963 [37:10:18<62:35:53,  9.86s/it]
 40%|███▉      | 15113/37963 [37:10:26<58:39:07,  9.24s/it]
 40%|███▉      | 15114/37963 [37:10:34<55:36:15,  8.76s/it]
 40%|███▉      | 15115/37963 [37:10:41<53:48:51,  8.48s/it]
 40%|███▉      | 15116/37963 [37:10:49<52:27:16,  8.27s/it]
 40%|███▉      | 15117/37963 [37:10:57<51:17:39,  8.08s/it]
 40%|███▉      | 15118/37963 [37:11:11<63:20:59,  9.98s/it]
 40%|███▉      | 15119/37963 [37:11:19<59:33:44,  9.39s/it]
 40%|███▉      | 15120/37963 [37:11:27<56:12:03,  8.86s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '1.667', 'learning_rate': '1.369e-05', 'epoch': '0.3983'}
+
 40%|███▉      | 15120/37963 [37:11:27<56:12:03,  8.86s/it]
 40%|███▉      | 15121/37963 [37:11:35<54:05:51,  8.53s/it]
 40%|███▉      | 15122/37963 [37:11:42<52:20:55,  8.25s/it]
 40%|███▉      | 15123/37963 [37:11:57<64:22:22, 10.15s/it]
 40%|███▉      | 15124/37963 [37:12:04<59:44:00,  9.42s/it]
 40%|███▉      | 15125/37963 [37:12:12<56:43:44,  8.94s/it]
 40%|███▉      | 15126/37963 [37:12:27<67:55:44, 10.71s/it]
 40%|███▉      | 15127/37963 [37:12:35<62:22:23,  9.83s/it]
 40%|███▉      | 15128/37963 [37:12:50<71:27:14, 11.26s/it]
 40%|███▉      | 15129/37963 [37:12:57<64:37:07, 10.19s/it]
 40%|███▉      | 15130/37963 [37:13:05<59:41:28,  9.41s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '1.419', 'learning_rate': '1.368e-05', 'epoch': '0.3985'}
+
 40%|███▉      | 15130/37963 [37:13:05<59:41:28,  9.41s/it]
 40%|███▉      | 15131/37963 [37:13:19<68:35:37, 10.82s/it]
 40%|███▉      | 15132/37963 [37:13:27<63:03:48,  9.94s/it]
 40%|███▉      | 15133/37963 [37:13:34<58:29:13,  9.22s/it]
 40%|███▉      | 15134/37963 [37:13:42<55:41:49,  8.78s/it]
 40%|███▉      | 15135/37963 [37:13:50<53:29:24,  8.44s/it]
 40%|███▉      | 15136/37963 [37:13:57<51:56:22,  8.19s/it]
 40%|███▉      | 15137/37963 [37:14:05<50:59:06,  8.04s/it]
 40%|███▉      | 15138/37963 [37:14:13<50:08:30,  7.91s/it]
 40%|███▉      | 15139/37963 [37:14:20<49:41:32,  7.84s/it]
 40%|███▉      | 15140/37963 [37:14:28<49:23:49,  7.79s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '2.41', 'learning_rate': '1.368e-05', 'epoch': '0.3988'}
+
 40%|███▉      | 15140/37963 [37:14:28<49:23:49,  7.79s/it]
 40%|███▉      | 15141/37963 [37:14:42<61:33:28,  9.71s/it]
 40%|███▉      | 15142/37963 [37:14:50<57:51:57,  9.13s/it]
 40%|███▉      | 15143/37963 [37:14:58<54:51:04,  8.65s/it]
 40%|███▉      | 15144/37963 [37:15:05<53:20:55,  8.42s/it]
 40%|███▉      | 15145/37963 [37:15:13<51:39:41,  8.15s/it]
 40%|███▉      | 15146/37963 [37:15:21<50:40:43,  8.00s/it]
 40%|███▉      | 15147/37963 [37:15:28<49:57:18,  7.88s/it]
 40%|███▉      | 15148/37963 [37:15:36<49:11:53,  7.76s/it]
 40%|███▉      | 15149/37963 [37:15:43<49:01:02,  7.73s/it]
 40%|███▉      | 15150/37963 [37:15:58<62:10:53,  9.81s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '1.534', 'learning_rate': '1.367e-05', 'epoch': '0.3991'}
+
 40%|███▉      | 15150/37963 [37:15:58<62:10:53,  9.81s/it]
 40%|███▉      | 15151/37963 [37:16:06<58:45:45,  9.27s/it]
 40%|███▉      | 15152/37963 [37:16:13<55:25:11,  8.75s/it]
 40%|███▉      | 15153/37963 [37:16:21<53:28:41,  8.44s/it]
 40%|███▉      | 15154/37963 [37:16:29<51:58:25,  8.20s/it]
 40%|███▉      | 15155/37963 [37:16:37<50:55:38,  8.04s/it]
 40%|███▉      | 15156/37963 [37:16:44<50:11:57,  7.92s/it]
 40%|███▉      | 15157/37963 [37:16:51<48:56:23,  7.73s/it]
 40%|███▉      | 15158/37963 [37:16:59<48:58:20,  7.73s/it]
 40%|███▉      | 15159/37963 [37:17:07<48:39:31,  7.68s/it]
 40%|███▉      | 15160/37963 [37:17:15<48:56:01,  7.73s/it]
                                                           
{'loss': '0.165', 'grad_norm': '3.245', 'learning_rate': '1.366e-05', 'epoch': '0.3993'}
+
 40%|███▉      | 15160/37963 [37:17:15<48:56:01,  7.73s/it]
 40%|███▉      | 15161/37963 [37:17:22<47:59:16,  7.58s/it]
 40%|███▉      | 15162/37963 [37:17:36<61:15:38,  9.67s/it]
 40%|███▉      | 15163/37963 [37:17:44<57:51:15,  9.13s/it]
 40%|███▉      | 15164/37963 [37:17:52<54:24:50,  8.59s/it]
 40%|███▉      | 15165/37963 [37:17:59<52:42:23,  8.32s/it]
 40%|███▉      | 15166/37963 [37:18:14<64:55:51, 10.25s/it]
 40%|███▉      | 15167/37963 [37:18:22<60:07:00,  9.49s/it]
 40%|███▉      | 15168/37963 [37:18:29<56:30:09,  8.92s/it]
 40%|███▉      | 15169/37963 [37:18:37<54:08:34,  8.55s/it]
 40%|███▉      | 15170/37963 [37:18:51<65:19:38, 10.32s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '3.998', 'learning_rate': '1.365e-05', 'epoch': '0.3996'}
+
 40%|███▉      | 15170/37963 [37:18:51<65:19:38, 10.32s/it]
 40%|███▉      | 15171/37963 [37:18:59<60:23:51,  9.54s/it]
 40%|███▉      | 15172/37963 [37:19:07<56:32:22,  8.93s/it]
 40%|███▉      | 15173/37963 [37:19:14<54:06:22,  8.55s/it]
 40%|███▉      | 15174/37963 [37:19:22<52:46:32,  8.34s/it]
 40%|███▉      | 15175/37963 [37:19:30<51:21:14,  8.11s/it]
 40%|███▉      | 15176/37963 [37:19:51<77:08:59, 12.19s/it]
 40%|███▉      | 15177/37963 [37:19:59<68:42:32, 10.86s/it]
 40%|███▉      | 15178/37963 [37:20:07<62:34:57,  9.89s/it]
 40%|███▉      | 15179/37963 [37:20:14<58:01:06,  9.17s/it]
 40%|███▉      | 15180/37963 [37:20:22<55:12:32,  8.72s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '1.823', 'learning_rate': '1.364e-05', 'epoch': '0.3999'}
+
 40%|███▉      | 15180/37963 [37:20:22<55:12:32,  8.72s/it]
 40%|███▉      | 15181/37963 [37:20:30<53:00:53,  8.38s/it]
 40%|███▉      | 15182/37963 [37:20:37<51:20:45,  8.11s/it]
 40%|███▉      | 15183/37963 [37:20:45<50:20:18,  7.96s/it]
 40%|███▉      | 15184/37963 [37:20:59<62:06:50,  9.82s/it]
 40%|███▉      | 15185/37963 [37:21:07<58:06:54,  9.18s/it]
 40%|████      | 15186/37963 [37:21:14<55:19:28,  8.74s/it]
 40%|████      | 15187/37963 [37:21:22<53:16:25,  8.42s/it]
 40%|████      | 15188/37963 [37:21:30<51:56:08,  8.21s/it]
 40%|████      | 15189/37963 [37:21:37<50:57:08,  8.05s/it]
 40%|████      | 15190/37963 [37:21:45<49:56:53,  7.90s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '1.359', 'learning_rate': '1.364e-05', 'epoch': '0.4001'}
+
 40%|████      | 15190/37963 [37:21:45<49:56:53,  7.90s/it]
 40%|████      | 15191/37963 [37:21:52<49:12:28,  7.78s/it]
 40%|████      | 15192/37963 [37:22:00<48:55:46,  7.74s/it]
 40%|████      | 15193/37963 [37:22:07<48:20:20,  7.64s/it]
 40%|████      | 15194/37963 [37:22:15<48:20:29,  7.64s/it]
 40%|████      | 15195/37963 [37:22:29<60:40:25,  9.59s/it]
 40%|████      | 15196/37963 [37:22:37<57:00:03,  9.01s/it]
 40%|████      | 15197/37963 [37:22:44<54:07:23,  8.56s/it]
 40%|████      | 15198/37963 [37:22:52<52:23:19,  8.28s/it]
 40%|████      | 15199/37963 [37:23:00<51:06:57,  8.08s/it]
 40%|████      | 15200/37963 [37:23:07<50:18:15,  7.96s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '2.785', 'learning_rate': '1.363e-05', 'epoch': '0.4004'}
+
 40%|████      | 15200/37963 [37:23:07<50:18:15,  7.96s/it]
 40%|████      | 15201/37963 [37:23:15<50:17:49,  7.95s/it]
 40%|████      | 15202/37963 [37:23:30<62:56:34,  9.96s/it]
 40%|████      | 15203/37963 [37:23:38<59:01:54,  9.34s/it]
 40%|████      | 15204/37963 [37:23:45<55:32:05,  8.78s/it]
 40%|████      | 15205/37963 [37:23:53<53:31:16,  8.47s/it]
 40%|████      | 15206/37963 [37:24:01<52:04:46,  8.24s/it]
 40%|████      | 15207/37963 [37:24:08<51:13:22,  8.10s/it]
 40%|████      | 15208/37963 [37:24:16<50:45:56,  8.03s/it]
 40%|████      | 15209/37963 [37:24:24<49:44:48,  7.87s/it]
 40%|████      | 15210/37963 [37:24:32<49:20:05,  7.81s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '1.75', 'learning_rate': '1.362e-05', 'epoch': '0.4007'}
+
 40%|████      | 15210/37963 [37:24:32<49:20:05,  7.81s/it]
 40%|████      | 15211/37963 [37:24:39<48:59:28,  7.75s/it]
 40%|████      | 15212/37963 [37:24:47<48:55:10,  7.74s/it]
 40%|████      | 15213/37963 [37:24:54<48:34:52,  7.69s/it]
 40%|████      | 15214/37963 [37:25:02<47:57:32,  7.59s/it]
 40%|████      | 15215/37963 [37:25:17<61:38:11,  9.75s/it]
 40%|████      | 15216/37963 [37:25:24<57:59:18,  9.18s/it]
 40%|████      | 15217/37963 [37:25:32<55:27:39,  8.78s/it]
 40%|████      | 15218/37963 [37:25:47<66:42:33, 10.56s/it]
 40%|████      | 15219/37963 [37:25:54<60:48:08,  9.62s/it]
 40%|████      | 15220/37963 [37:26:08<69:12:08, 10.95s/it]
                                                           
{'loss': '0.1541', 'grad_norm': '2.78', 'learning_rate': '1.361e-05', 'epoch': '0.4009'}
+
 40%|████      | 15220/37963 [37:26:08<69:12:08, 10.95s/it]
 40%|████      | 15221/37963 [37:26:16<62:59:56,  9.97s/it]
 40%|████      | 15222/37963 [37:26:24<58:39:03,  9.28s/it]
 40%|████      | 15223/37963 [37:26:31<55:21:21,  8.76s/it]
 40%|████      | 15224/37963 [37:26:53<79:05:54, 12.52s/it]
 40%|████      | 15225/37963 [37:27:00<69:58:49, 11.08s/it]
 40%|████      | 15226/37963 [37:27:08<63:24:50, 10.04s/it]
 40%|████      | 15227/37963 [37:27:16<58:48:49,  9.31s/it]
 40%|████      | 15228/37963 [37:27:23<55:34:49,  8.80s/it]
 40%|████      | 15229/37963 [37:27:31<53:07:53,  8.41s/it]
 40%|████      | 15230/37963 [37:27:38<51:38:53,  8.18s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '2.99', 'learning_rate': '1.36e-05', 'epoch': '0.4012'}
+
 40%|████      | 15230/37963 [37:27:38<51:38:53,  8.18s/it]
 40%|████      | 15231/37963 [37:27:46<50:36:25,  8.01s/it]
 40%|████      | 15232/37963 [37:27:54<49:50:14,  7.89s/it]
 40%|████      | 15233/37963 [37:28:01<49:35:16,  7.85s/it]
 40%|████      | 15234/37963 [37:28:09<49:02:27,  7.77s/it]
 40%|████      | 15235/37963 [37:28:17<48:52:54,  7.74s/it]
 40%|████      | 15236/37963 [37:28:24<48:52:13,  7.74s/it]
 40%|████      | 15237/37963 [37:28:32<48:51:15,  7.74s/it]
 40%|████      | 15238/37963 [37:28:47<61:39:26,  9.77s/it]
 40%|████      | 15239/37963 [37:28:54<57:12:16,  9.06s/it]
 40%|████      | 15240/37963 [37:29:02<54:39:14,  8.66s/it]
                                                           
{'loss': '0.162', 'grad_norm': '1.643', 'learning_rate': '1.36e-05', 'epoch': '0.4014'}
+
 40%|████      | 15240/37963 [37:29:02<54:39:14,  8.66s/it]
 40%|████      | 15241/37963 [37:29:09<52:51:38,  8.38s/it]
 40%|████      | 15242/37963 [37:29:17<51:37:33,  8.18s/it]
 40%|████      | 15243/37963 [37:29:31<62:56:50,  9.97s/it]
 40%|████      | 15244/37963 [37:29:39<58:25:47,  9.26s/it]
 40%|████      | 15245/37963 [37:29:46<54:50:28,  8.69s/it]
 40%|████      | 15246/37963 [37:29:54<53:02:00,  8.40s/it]
 40%|████      | 15247/37963 [37:30:02<51:51:21,  8.22s/it]
 40%|████      | 15248/37963 [37:30:09<50:38:20,  8.03s/it]
 40%|████      | 15249/37963 [37:30:25<64:05:43, 10.16s/it]
 40%|████      | 15250/37963 [37:30:32<59:16:57,  9.40s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '1.657', 'learning_rate': '1.359e-05', 'epoch': '0.4017'}
+
 40%|████      | 15250/37963 [37:30:32<59:16:57,  9.40s/it]
 40%|████      | 15251/37963 [37:30:40<55:55:35,  8.86s/it]
 40%|████      | 15252/37963 [37:30:48<54:19:00,  8.61s/it]
 40%|████      | 15253/37963 [37:30:55<52:29:39,  8.32s/it]
 40%|████      | 15254/37963 [37:31:03<51:15:15,  8.13s/it]
 40%|████      | 15255/37963 [37:31:11<50:18:37,  7.98s/it]
 40%|████      | 15256/37963 [37:31:18<49:48:12,  7.90s/it]
 40%|████      | 15257/37963 [37:31:26<49:18:34,  7.82s/it]
 40%|████      | 15258/37963 [37:31:34<48:56:24,  7.76s/it]
 40%|████      | 15259/37963 [37:31:41<48:36:12,  7.71s/it]
 40%|████      | 15260/37963 [37:31:49<48:12:45,  7.65s/it]
                                                           
{'loss': '0.151', 'grad_norm': '1.238', 'learning_rate': '1.358e-05', 'epoch': '0.402'}
+
 40%|████      | 15260/37963 [37:31:49<48:12:45,  7.65s/it]
 40%|████      | 15261/37963 [37:31:56<48:15:22,  7.65s/it]
 40%|████      | 15262/37963 [37:32:11<61:52:41,  9.81s/it]
 40%|████      | 15263/37963 [37:32:19<58:18:42,  9.25s/it]
 40%|████      | 15264/37963 [37:32:27<55:12:30,  8.76s/it]
 40%|████      | 15265/37963 [37:32:34<53:03:37,  8.42s/it]
 40%|████      | 15266/37963 [37:32:42<51:39:55,  8.19s/it]
 40%|████      | 15267/37963 [37:32:50<50:50:24,  8.06s/it]
 40%|████      | 15268/37963 [37:33:04<62:36:26,  9.93s/it]
 40%|████      | 15269/37963 [37:33:19<71:01:44, 11.27s/it]
 40%|████      | 15270/37963 [37:33:33<77:49:25, 12.35s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '2.985', 'learning_rate': '1.357e-05', 'epoch': '0.4022'}
+
 40%|████      | 15270/37963 [37:33:33<77:49:25, 12.35s/it]
 40%|████      | 15271/37963 [37:33:41<69:17:08, 10.99s/it]
 40%|████      | 15272/37963 [37:33:55<75:19:29, 11.95s/it]
 40%|████      | 15273/37963 [37:34:03<67:11:17, 10.66s/it]
 40%|████      | 15274/37963 [37:34:11<61:28:35,  9.75s/it]
 40%|████      | 15275/37963 [37:34:18<57:39:15,  9.15s/it]
 40%|████      | 15276/37963 [37:34:26<54:44:38,  8.69s/it]
 40%|████      | 15277/37963 [37:34:34<52:45:45,  8.37s/it]
 40%|████      | 15278/37963 [37:34:41<51:16:06,  8.14s/it]
 40%|████      | 15279/37963 [37:34:49<50:27:12,  8.01s/it]
 40%|████      | 15280/37963 [37:34:57<49:41:05,  7.89s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '2.181', 'learning_rate': '1.356e-05', 'epoch': '0.4025'}
+
 40%|████      | 15280/37963 [37:34:57<49:41:05,  7.89s/it]
 40%|████      | 15281/37963 [37:35:04<49:05:33,  7.79s/it]
 40%|████      | 15282/37963 [37:35:12<48:56:06,  7.77s/it]
 40%|████      | 15283/37963 [37:35:20<48:52:43,  7.76s/it]
 40%|████      | 15284/37963 [37:35:27<48:31:30,  7.70s/it]
 40%|████      | 15285/37963 [37:35:35<48:11:28,  7.65s/it]
 40%|████      | 15286/37963 [37:35:42<48:08:24,  7.64s/it]
 40%|████      | 15287/37963 [37:35:57<60:59:55,  9.68s/it]
 40%|████      | 15288/37963 [37:36:11<69:16:54, 11.00s/it]
 40%|████      | 15289/37963 [37:36:19<63:32:26, 10.09s/it]
 40%|████      | 15290/37963 [37:36:26<58:52:31,  9.35s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '1.611', 'learning_rate': '1.356e-05', 'epoch': '0.4028'}
+
 40%|████      | 15290/37963 [37:36:26<58:52:31,  9.35s/it]
 40%|████      | 15291/37963 [37:36:34<55:38:42,  8.84s/it]
 40%|████      | 15292/37963 [37:36:42<53:28:00,  8.49s/it]
 40%|████      | 15293/37963 [37:36:49<51:50:48,  8.23s/it]
 40%|████      | 15294/37963 [37:36:57<50:40:14,  8.05s/it]
 40%|████      | 15295/37963 [37:37:12<63:32:02, 10.09s/it]
 40%|████      | 15296/37963 [37:37:20<59:04:13,  9.38s/it]
 40%|████      | 15297/37963 [37:37:27<55:35:47,  8.83s/it]
 40%|████      | 15298/37963 [37:37:35<53:27:53,  8.49s/it]
 40%|████      | 15299/37963 [37:37:42<51:36:50,  8.20s/it]
 40%|████      | 15300/37963 [37:37:50<50:19:54,  8.00s/it]
                                                           
{'loss': '0.1383', 'grad_norm': '4.45', 'learning_rate': '1.355e-05', 'epoch': '0.403'}
+
 40%|████      | 15300/37963 [37:37:50<50:19:54,  8.00s/it]
 40%|████      | 15301/37963 [37:37:57<49:16:01,  7.83s/it]
 40%|████      | 15302/37963 [37:38:05<48:56:58,  7.78s/it]
 40%|████      | 15303/37963 [37:38:13<48:49:11,  7.76s/it]
 40%|████      | 15304/37963 [37:38:20<48:03:18,  7.63s/it]
 40%|████      | 15305/37963 [37:38:27<47:35:42,  7.56s/it]
 40%|████      | 15306/37963 [37:38:35<47:38:23,  7.57s/it]
 40%|████      | 15307/37963 [37:38:43<47:46:45,  7.59s/it]
 40%|████      | 15308/37963 [37:38:58<61:32:48,  9.78s/it]
 40%|████      | 15309/37963 [37:39:05<57:35:49,  9.15s/it]
 40%|████      | 15310/37963 [37:39:13<54:14:09,  8.62s/it]
                                                           
{'loss': '0.1671', 'grad_norm': '1.534', 'learning_rate': '1.354e-05', 'epoch': '0.4033'}
+
 40%|████      | 15310/37963 [37:39:13<54:14:09,  8.62s/it]
 40%|████      | 15311/37963 [37:39:20<52:21:47,  8.32s/it]
 40%|████      | 15312/37963 [37:39:28<51:07:17,  8.12s/it]
 40%|████      | 15313/37963 [37:39:36<50:32:00,  8.03s/it]
 40%|████      | 15314/37963 [37:39:43<49:49:15,  7.92s/it]
 40%|████      | 15315/37963 [37:39:51<49:25:07,  7.86s/it]
 40%|████      | 15316/37963 [37:40:06<62:17:37,  9.90s/it]
 40%|████      | 15317/37963 [37:40:20<70:16:53, 11.17s/it]
 40%|████      | 15318/37963 [37:40:35<77:02:53, 12.25s/it]
 40%|████      | 15319/37963 [37:40:42<68:34:37, 10.90s/it]
 40%|████      | 15320/37963 [37:40:50<62:31:25,  9.94s/it]
                                                           
{'loss': '0.1577', 'grad_norm': '1.083', 'learning_rate': '1.353e-05', 'epoch': '0.4036'}
+
 40%|████      | 15320/37963 [37:40:50<62:31:25,  9.94s/it]
 40%|████      | 15321/37963 [37:40:58<58:25:30,  9.29s/it]
 40%|████      | 15322/37963 [37:41:12<67:58:04, 10.81s/it]
 40%|████      | 15323/37963 [37:41:20<61:53:37,  9.84s/it]
 40%|████      | 15324/37963 [37:41:27<57:42:41,  9.18s/it]
 40%|████      | 15325/37963 [37:41:35<54:57:15,  8.74s/it]
 40%|████      | 15326/37963 [37:41:43<52:57:09,  8.42s/it]
 40%|████      | 15327/37963 [37:41:51<51:58:21,  8.27s/it]
 40%|████      | 15328/37963 [37:41:58<50:58:39,  8.11s/it]
 40%|████      | 15329/37963 [37:42:06<50:01:54,  7.96s/it]
 40%|████      | 15330/37963 [37:42:14<49:21:29,  7.85s/it]
                                                           
{'loss': '0.1587', 'grad_norm': '2.182', 'learning_rate': '1.352e-05', 'epoch': '0.4038'}
+
 40%|████      | 15330/37963 [37:42:14<49:21:29,  7.85s/it]
 40%|████      | 15331/37963 [37:42:21<48:32:28,  7.72s/it]
 40%|████      | 15332/37963 [37:42:35<60:58:30,  9.70s/it]
 40%|████      | 15333/37963 [37:42:50<69:33:09, 11.06s/it]
 40%|████      | 15334/37963 [37:42:57<63:05:45, 10.04s/it]
 40%|████      | 15335/37963 [37:43:05<58:37:15,  9.33s/it]
 40%|████      | 15336/37963 [37:43:13<55:34:31,  8.84s/it]
 40%|████      | 15337/37963 [37:43:20<53:27:43,  8.51s/it]
 40%|████      | 15338/37963 [37:43:28<51:34:21,  8.21s/it]
 40%|████      | 15339/37963 [37:43:36<50:30:04,  8.04s/it]
 40%|████      | 15340/37963 [37:43:43<49:45:46,  7.92s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '2.614', 'learning_rate': '1.352e-05', 'epoch': '0.4041'}
+
 40%|████      | 15340/37963 [37:43:43<49:45:46,  7.92s/it]
 40%|████      | 15341/37963 [37:43:51<49:31:19,  7.88s/it]
 40%|████      | 15342/37963 [37:43:59<49:08:00,  7.82s/it]
 40%|████      | 15343/37963 [37:44:13<62:01:47,  9.87s/it]
 40%|████      | 15344/37963 [37:44:21<58:29:45,  9.31s/it]
 40%|████      | 15345/37963 [37:44:29<55:14:20,  8.79s/it]
 40%|████      | 15346/37963 [37:44:37<53:01:55,  8.44s/it]
 40%|████      | 15347/37963 [37:44:44<51:43:11,  8.23s/it]
 40%|████      | 15348/37963 [37:44:52<50:36:23,  8.06s/it]
 40%|████      | 15349/37963 [37:45:00<49:58:03,  7.95s/it]
 40%|████      | 15350/37963 [37:45:07<49:35:51,  7.90s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '1.172', 'learning_rate': '1.351e-05', 'epoch': '0.4043'}
+
 40%|████      | 15350/37963 [37:45:07<49:35:51,  7.90s/it]
 40%|████      | 15351/37963 [37:45:15<49:10:51,  7.83s/it]
 40%|████      | 15352/37963 [37:45:30<62:40:25,  9.98s/it]
 40%|████      | 15353/37963 [37:45:38<58:03:37,  9.24s/it]
 40%|████      | 15354/37963 [37:45:45<55:01:02,  8.76s/it]
 40%|████      | 15355/37963 [37:45:53<52:42:20,  8.39s/it]
 40%|████      | 15356/37963 [37:46:00<51:19:25,  8.17s/it]
 40%|████      | 15357/37963 [37:46:08<50:27:41,  8.04s/it]
 40%|████      | 15358/37963 [37:46:16<49:20:52,  7.86s/it]
 40%|████      | 15359/37963 [37:46:23<48:57:33,  7.80s/it]
 40%|████      | 15360/37963 [37:46:31<48:04:08,  7.66s/it]
                                                           
{'loss': '0.1521', 'grad_norm': '0.9641', 'learning_rate': '1.35e-05', 'epoch': '0.4046'}
+
 40%|████      | 15360/37963 [37:46:31<48:04:08,  7.66s/it]
 40%|████      | 15361/37963 [37:46:45<60:26:28,  9.63s/it]
 40%|████      | 15362/37963 [37:46:59<68:57:49, 10.98s/it]
 40%|████      | 15363/37963 [37:47:06<62:27:22,  9.95s/it]
 40%|████      | 15364/37963 [37:47:14<58:13:14,  9.27s/it]
 40%|████      | 15365/37963 [37:47:22<55:16:58,  8.81s/it]
 40%|████      | 15366/37963 [37:47:36<66:00:05, 10.51s/it]
 40%|████      | 15367/37963 [37:47:44<60:48:20,  9.69s/it]
 40%|████      | 15368/37963 [37:47:52<57:00:41,  9.08s/it]
 40%|████      | 15369/37963 [37:48:06<66:46:25, 10.64s/it]
 40%|████      | 15370/37963 [37:48:14<61:14:47,  9.76s/it]
                                                           
{'loss': '0.1679', 'grad_norm': '3.368', 'learning_rate': '1.349e-05', 'epoch': '0.4049'}
+
 40%|████      | 15370/37963 [37:48:14<61:14:47,  9.76s/it]
 40%|████      | 15371/37963 [37:48:22<57:29:11,  9.16s/it]
 40%|████      | 15372/37963 [37:48:29<54:41:52,  8.72s/it]
 40%|████      | 15373/37963 [37:48:37<52:46:51,  8.41s/it]
 40%|████      | 15374/37963 [37:48:45<51:16:18,  8.17s/it]
 40%|████      | 15375/37963 [37:48:52<50:18:18,  8.02s/it]
 41%|████      | 15376/37963 [37:49:00<49:23:18,  7.87s/it]
 41%|████      | 15377/37963 [37:49:07<48:54:37,  7.80s/it]
 41%|████      | 15378/37963 [37:49:15<48:45:21,  7.77s/it]
 41%|████      | 15379/37963 [37:49:22<47:50:22,  7.63s/it]
 41%|████      | 15380/37963 [37:49:30<47:51:30,  7.63s/it]
                                                           
{'loss': '0.1472', 'grad_norm': '2.019', 'learning_rate': '1.348e-05', 'epoch': '0.4051'}
+
 41%|████      | 15380/37963 [37:49:30<47:51:30,  7.63s/it]
 41%|████      | 15381/37963 [37:49:37<47:26:19,  7.56s/it]
 41%|████      | 15382/37963 [37:49:52<59:48:28,  9.53s/it]
 41%|████      | 15383/37963 [37:49:59<56:22:10,  8.99s/it]
 41%|████      | 15384/37963 [37:50:07<53:34:57,  8.54s/it]
 41%|████      | 15385/37963 [37:50:21<64:39:10, 10.31s/it]
 41%|████      | 15386/37963 [37:50:29<60:04:18,  9.58s/it]
 41%|████      | 15387/37963 [37:50:37<56:32:25,  9.02s/it]
 41%|████      | 15388/37963 [37:50:44<53:49:42,  8.58s/it]
 41%|████      | 15389/37963 [37:50:52<51:38:01,  8.23s/it]
 41%|████      | 15390/37963 [37:51:07<64:13:47, 10.24s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '3.947', 'learning_rate': '1.348e-05', 'epoch': '0.4054'}
+
 41%|████      | 15390/37963 [37:51:07<64:13:47, 10.24s/it]
 41%|████      | 15391/37963 [37:51:14<59:30:47,  9.49s/it]
 41%|████      | 15392/37963 [37:51:22<56:05:51,  8.95s/it]
 41%|████      | 15393/37963 [37:51:30<53:50:13,  8.59s/it]
 41%|████      | 15394/37963 [37:51:38<52:19:49,  8.35s/it]
 41%|████      | 15395/37963 [37:51:52<64:23:14, 10.27s/it]
 41%|████      | 15396/37963 [37:52:00<59:31:39,  9.50s/it]
 41%|████      | 15397/37963 [37:52:08<56:03:47,  8.94s/it]
 41%|████      | 15398/37963 [37:52:15<53:11:14,  8.49s/it]
 41%|████      | 15399/37963 [37:52:23<51:41:08,  8.25s/it]
 41%|████      | 15400/37963 [37:52:31<50:41:11,  8.09s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '1.207', 'learning_rate': '1.347e-05', 'epoch': '0.4057'}
+
 41%|████      | 15400/37963 [37:52:31<50:41:11,  8.09s/it]
 41%|████      | 15401/37963 [37:52:38<49:56:34,  7.97s/it]
 41%|████      | 15402/37963 [37:52:46<49:25:47,  7.89s/it]
 41%|████      | 15403/37963 [37:52:54<49:13:46,  7.86s/it]
 41%|████      | 15404/37963 [37:53:02<49:06:24,  7.84s/it]
 41%|████      | 15405/37963 [37:53:09<48:34:58,  7.75s/it]
 41%|████      | 15406/37963 [37:53:17<48:41:18,  7.77s/it]
 41%|████      | 15407/37963 [37:53:24<48:06:55,  7.68s/it]
 41%|████      | 15408/37963 [37:53:32<48:11:54,  7.69s/it]
 41%|████      | 15409/37963 [37:53:40<48:05:34,  7.68s/it]
 41%|████      | 15410/37963 [37:53:54<60:33:26,  9.67s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '1.462', 'learning_rate': '1.346e-05', 'epoch': '0.4059'}
+
 41%|████      | 15410/37963 [37:53:54<60:33:26,  9.67s/it]
 41%|████      | 15411/37963 [37:54:02<56:54:53,  9.09s/it]
 41%|████      | 15412/37963 [37:54:10<54:29:49,  8.70s/it]
 41%|████      | 15413/37963 [37:54:25<66:34:04, 10.63s/it]
 41%|████      | 15414/37963 [37:54:39<74:04:54, 11.83s/it]
 41%|████      | 15415/37963 [37:54:53<78:27:33, 12.53s/it]
 41%|████      | 15416/37963 [37:55:01<69:12:49, 11.05s/it]
 41%|████      | 15417/37963 [37:55:09<63:06:54, 10.08s/it]
 41%|████      | 15418/37963 [37:55:17<58:42:06,  9.37s/it]
 41%|████      | 15419/37963 [37:55:24<55:26:17,  8.85s/it]
 41%|████      | 15420/37963 [37:55:32<53:21:00,  8.52s/it]
                                                           
{'loss': '0.1541', 'grad_norm': '2.462', 'learning_rate': '1.345e-05', 'epoch': '0.4062'}
+
 41%|████      | 15420/37963 [37:55:32<53:21:00,  8.52s/it]
 41%|████      | 15421/37963 [37:55:40<51:47:02,  8.27s/it]
 41%|████      | 15422/37963 [37:55:48<51:12:14,  8.18s/it]
 41%|████      | 15423/37963 [37:55:55<49:42:57,  7.94s/it]
 41%|████      | 15424/37963 [37:56:03<49:05:21,  7.84s/it]
 41%|████      | 15425/37963 [37:56:10<48:59:53,  7.83s/it]
 41%|████      | 15426/37963 [37:56:18<48:51:14,  7.80s/it]
 41%|████      | 15427/37963 [37:56:26<49:04:58,  7.84s/it]
 41%|████      | 15428/37963 [37:56:41<61:24:15,  9.81s/it]
 41%|████      | 15429/37963 [37:56:48<57:39:08,  9.21s/it]
 41%|████      | 15430/37963 [37:56:56<54:45:01,  8.75s/it]
                                                           
{'loss': '0.1651', 'grad_norm': '2.638', 'learning_rate': '1.344e-05', 'epoch': '0.4064'}
+
 41%|████      | 15430/37963 [37:56:56<54:45:01,  8.75s/it]
 41%|████      | 15431/37963 [37:57:04<52:41:01,  8.42s/it]
 41%|████      | 15432/37963 [37:57:11<51:12:28,  8.18s/it]
 41%|████      | 15433/37963 [37:57:26<62:33:42, 10.00s/it]
 41%|████      | 15434/37963 [37:57:33<58:01:04,  9.27s/it]
 41%|████      | 15435/37963 [37:57:48<69:26:08, 11.10s/it]
 41%|████      | 15436/37963 [37:57:56<62:24:14,  9.97s/it]
 41%|████      | 15437/37963 [37:58:04<58:08:52,  9.29s/it]
 41%|████      | 15438/37963 [37:58:11<55:02:38,  8.80s/it]
 41%|████      | 15439/37963 [37:58:26<66:14:41, 10.59s/it]
 41%|████      | 15440/37963 [37:58:34<60:43:10,  9.71s/it]
                                                           
{'loss': '0.1545', 'grad_norm': '2.277', 'learning_rate': '1.344e-05', 'epoch': '0.4067'}
+
 41%|████      | 15440/37963 [37:58:34<60:43:10,  9.71s/it]
 41%|████      | 15441/37963 [37:58:41<56:48:56,  9.08s/it]
 41%|████      | 15442/37963 [37:58:49<53:28:24,  8.55s/it]
 41%|████      | 15443/37963 [37:58:56<51:46:05,  8.28s/it]
 41%|████      | 15444/37963 [37:59:04<50:28:57,  8.07s/it]
 41%|████      | 15445/37963 [37:59:11<49:40:50,  7.94s/it]
 41%|████      | 15446/37963 [37:59:19<49:45:09,  7.95s/it]
 41%|████      | 15447/37963 [37:59:27<49:04:08,  7.85s/it]
 41%|████      | 15448/37963 [37:59:35<48:33:13,  7.76s/it]
 41%|████      | 15449/37963 [37:59:42<48:27:43,  7.75s/it]
 41%|████      | 15450/37963 [37:59:50<48:26:48,  7.75s/it]
                                                           
{'loss': '0.1691', 'grad_norm': '2.118', 'learning_rate': '1.343e-05', 'epoch': '0.407'}
+
 41%|████      | 15450/37963 [37:59:50<48:26:48,  7.75s/it]
 41%|████      | 15451/37963 [37:59:58<48:28:15,  7.75s/it]
 41%|████      | 15452/37963 [38:00:05<48:05:55,  7.69s/it]
 41%|████      | 15453/37963 [38:00:13<47:59:24,  7.68s/it]
 41%|████      | 15454/37963 [38:00:27<59:44:48,  9.56s/it]
 41%|████      | 15455/37963 [38:00:35<56:28:36,  9.03s/it]
 41%|████      | 15456/37963 [38:00:42<53:30:22,  8.56s/it]
 41%|████      | 15457/37963 [38:00:50<51:52:27,  8.30s/it]
 41%|████      | 15458/37963 [38:00:58<50:42:33,  8.11s/it]
 41%|████      | 15459/37963 [38:01:05<50:03:30,  8.01s/it]
 41%|████      | 15460/37963 [38:01:20<63:23:29, 10.14s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '3.978', 'learning_rate': '1.342e-05', 'epoch': '0.4072'}
+
 41%|████      | 15460/37963 [38:01:20<63:23:29, 10.14s/it]
 41%|████      | 15461/37963 [38:01:35<72:04:21, 11.53s/it]
 41%|████      | 15462/37963 [38:01:43<64:48:06, 10.37s/it]
 41%|████      | 15463/37963 [38:01:50<59:35:00,  9.53s/it]
 41%|████      | 15464/37963 [38:01:58<55:59:12,  8.96s/it]
 41%|████      | 15465/37963 [38:02:12<65:46:57, 10.53s/it]
 41%|████      | 15466/37963 [38:02:20<61:11:00,  9.79s/it]
 41%|████      | 15467/37963 [38:02:28<57:17:12,  9.17s/it]
 41%|████      | 15468/37963 [38:02:35<54:05:07,  8.66s/it]
 41%|████      | 15469/37963 [38:02:43<52:17:04,  8.37s/it]
 41%|████      | 15470/37963 [38:02:51<50:50:38,  8.14s/it]
                                                           
{'loss': '0.1403', 'grad_norm': '1.106', 'learning_rate': '1.341e-05', 'epoch': '0.4075'}
+
 41%|████      | 15470/37963 [38:02:51<50:50:38,  8.14s/it]
 41%|████      | 15471/37963 [38:02:58<49:30:32,  7.92s/it]
 41%|████      | 15472/37963 [38:03:06<48:44:08,  7.80s/it]
 41%|████      | 15473/37963 [38:03:13<47:50:38,  7.66s/it]
 41%|████      | 15474/37963 [38:03:20<47:13:00,  7.56s/it]
 41%|████      | 15475/37963 [38:03:28<47:18:42,  7.57s/it]
 41%|████      | 15476/37963 [38:03:36<47:33:46,  7.61s/it]
 41%|████      | 15477/37963 [38:03:50<59:23:42,  9.51s/it]
 41%|████      | 15478/37963 [38:03:57<56:03:22,  8.97s/it]
 41%|████      | 15479/37963 [38:04:05<53:52:04,  8.63s/it]
 41%|████      | 15480/37963 [38:04:13<52:20:08,  8.38s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '1.082', 'learning_rate': '1.34e-05', 'epoch': '0.4078'}
+
 41%|████      | 15480/37963 [38:04:13<52:20:08,  8.38s/it]
 41%|████      | 15481/37963 [38:04:27<62:55:18, 10.08s/it]
 41%|████      | 15482/37963 [38:04:35<58:13:56,  9.33s/it]
 41%|████      | 15483/37963 [38:04:49<68:38:39, 10.99s/it]
 41%|████      | 15484/37963 [38:04:57<62:22:23,  9.99s/it]
 41%|████      | 15485/37963 [38:05:05<57:37:07,  9.23s/it]
 41%|████      | 15486/37963 [38:05:12<54:32:27,  8.74s/it]
 41%|████      | 15487/37963 [38:05:20<52:46:29,  8.45s/it]
 41%|████      | 15488/37963 [38:05:28<51:24:01,  8.23s/it]
 41%|████      | 15489/37963 [38:05:42<63:37:31, 10.19s/it]
 41%|████      | 15490/37963 [38:05:50<58:56:45,  9.44s/it]
                                                           
{'loss': '0.15', 'grad_norm': '2.814', 'learning_rate': '1.34e-05', 'epoch': '0.408'}
+
 41%|████      | 15490/37963 [38:05:50<58:56:45,  9.44s/it]
 41%|████      | 15491/37963 [38:05:58<55:45:52,  8.93s/it]
 41%|████      | 15492/37963 [38:06:05<53:22:16,  8.55s/it]
 41%|████      | 15493/37963 [38:06:13<51:40:46,  8.28s/it]
 41%|████      | 15494/37963 [38:06:21<50:53:09,  8.15s/it]
 41%|████      | 15495/37963 [38:06:29<49:55:42,  8.00s/it]
 41%|████      | 15496/37963 [38:06:36<49:17:26,  7.90s/it]
 41%|████      | 15497/37963 [38:06:44<48:49:03,  7.82s/it]
 41%|████      | 15498/37963 [38:06:58<60:57:54,  9.77s/it]
 41%|████      | 15499/37963 [38:07:06<57:02:10,  9.14s/it]
 41%|████      | 15500/37963 [38:07:14<54:14:00,  8.69s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '3.166', 'learning_rate': '1.339e-05', 'epoch': '0.4083'}
+
 41%|████      | 15500/37963 [38:07:14<54:14:00,  8.69s/it]
 41%|████      | 15501/37963 [38:07:21<52:27:56,  8.41s/it]
 41%|████      | 15502/37963 [38:07:29<51:15:26,  8.22s/it]
 41%|████      | 15503/37963 [38:07:36<49:44:59,  7.97s/it]
 41%|████      | 15504/37963 [38:07:44<49:15:59,  7.90s/it]
 41%|████      | 15505/37963 [38:07:52<48:33:35,  7.78s/it]
 41%|████      | 15506/37963 [38:07:59<48:22:55,  7.76s/it]
 41%|████      | 15507/37963 [38:08:07<48:15:56,  7.74s/it]
 41%|████      | 15508/37963 [38:08:15<48:19:14,  7.75s/it]
 41%|████      | 15509/37963 [38:08:23<48:20:24,  7.75s/it]
 41%|████      | 15510/37963 [38:08:30<47:49:27,  7.67s/it]
                                                           
{'loss': '0.142', 'grad_norm': '1.366', 'learning_rate': '1.338e-05', 'epoch': '0.4086'}
+
 41%|████      | 15510/37963 [38:08:30<47:49:27,  7.67s/it]
 41%|████      | 15511/37963 [38:08:38<48:00:42,  7.70s/it]
 41%|████      | 15512/37963 [38:08:46<48:08:17,  7.72s/it]
 41%|████      | 15513/37963 [38:09:00<60:59:07,  9.78s/it]
 41%|████      | 15514/37963 [38:09:15<70:27:53, 11.30s/it]
 41%|████      | 15515/37963 [38:09:23<63:51:30, 10.24s/it]
 41%|████      | 15516/37963 [38:09:30<58:39:26,  9.41s/it]
 41%|████      | 15517/37963 [38:09:38<55:15:16,  8.86s/it]
 41%|████      | 15518/37963 [38:09:52<65:54:56, 10.57s/it]
 41%|████      | 15519/37963 [38:10:00<60:24:14,  9.69s/it]
 41%|████      | 15520/37963 [38:10:07<55:59:27,  8.98s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '2.4', 'learning_rate': '1.337e-05', 'epoch': '0.4088'}
+
 41%|████      | 15520/37963 [38:10:07<55:59:27,  8.98s/it]
 41%|████      | 15521/37963 [38:10:22<65:38:25, 10.53s/it]
 41%|████      | 15522/37963 [38:10:29<60:36:56,  9.72s/it]
 41%|████      | 15523/37963 [38:10:37<56:38:06,  9.09s/it]
 41%|████      | 15524/37963 [38:10:45<53:52:05,  8.64s/it]
 41%|████      | 15525/37963 [38:10:52<52:01:28,  8.35s/it]
 41%|████      | 15526/37963 [38:11:07<63:25:24, 10.18s/it]
 41%|████      | 15527/37963 [38:11:14<58:47:16,  9.43s/it]
 41%|████      | 15528/37963 [38:11:22<55:38:03,  8.93s/it]
 41%|████      | 15529/37963 [38:11:30<52:46:21,  8.47s/it]
 41%|████      | 15530/37963 [38:11:37<51:15:45,  8.23s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '2.118', 'learning_rate': '1.336e-05', 'epoch': '0.4091'}
+
 41%|████      | 15530/37963 [38:11:37<51:15:45,  8.23s/it]
 41%|████      | 15531/37963 [38:11:52<63:54:24, 10.26s/it]
 41%|████      | 15532/37963 [38:12:00<58:53:20,  9.45s/it]
 41%|████      | 15533/37963 [38:12:15<68:57:13, 11.07s/it]
 41%|████      | 15534/37963 [38:12:22<62:44:33, 10.07s/it]
 41%|████      | 15535/37963 [38:12:30<58:20:21,  9.36s/it]
 41%|████      | 15536/37963 [38:12:38<55:14:04,  8.87s/it]
 41%|████      | 15537/37963 [38:12:45<52:47:33,  8.47s/it]
 41%|████      | 15538/37963 [38:12:53<51:11:03,  8.22s/it]
 41%|████      | 15539/37963 [38:13:01<49:59:52,  8.03s/it]
 41%|████      | 15540/37963 [38:13:09<49:51:35,  8.00s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '1.566', 'learning_rate': '1.336e-05', 'epoch': '0.4093'}
+
 41%|████      | 15540/37963 [38:13:09<49:51:35,  8.00s/it]
 41%|████      | 15541/37963 [38:13:23<61:40:57,  9.90s/it]
 41%|████      | 15542/37963 [38:13:31<57:52:03,  9.29s/it]
 41%|████      | 15543/37963 [38:13:38<54:32:57,  8.76s/it]
 41%|████      | 15544/37963 [38:13:46<52:28:26,  8.43s/it]
 41%|████      | 15545/37963 [38:13:54<51:15:07,  8.23s/it]
 41%|████      | 15546/37963 [38:14:01<50:12:06,  8.06s/it]
 41%|████      | 15547/37963 [38:14:09<49:11:00,  7.90s/it]
 41%|████      | 15548/37963 [38:14:16<48:14:01,  7.75s/it]
 41%|████      | 15549/37963 [38:14:24<47:27:34,  7.62s/it]
 41%|████      | 15550/37963 [38:14:31<47:52:16,  7.69s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '1.058', 'learning_rate': '1.335e-05', 'epoch': '0.4096'}
+
 41%|████      | 15550/37963 [38:14:31<47:52:16,  7.69s/it]
 41%|████      | 15551/37963 [38:14:39<47:42:40,  7.66s/it]
 41%|████      | 15552/37963 [38:14:47<47:41:41,  7.66s/it]
 41%|████      | 15553/37963 [38:14:54<47:36:25,  7.65s/it]
 41%|████      | 15554/37963 [38:15:02<47:26:02,  7.62s/it]
 41%|████      | 15555/37963 [38:15:10<47:54:27,  7.70s/it]
 41%|████      | 15556/37963 [38:15:17<47:57:10,  7.70s/it]
 41%|████      | 15557/37963 [38:15:25<47:28:35,  7.63s/it]
 41%|████      | 15558/37963 [38:15:33<47:42:23,  7.67s/it]
 41%|████      | 15559/37963 [38:15:40<47:35:13,  7.65s/it]
 41%|████      | 15560/37963 [38:15:48<47:51:23,  7.69s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '1.365', 'learning_rate': '1.334e-05', 'epoch': '0.4099'}
+
 41%|████      | 15560/37963 [38:15:48<47:51:23,  7.69s/it]
 41%|████      | 15561/37963 [38:15:56<47:58:04,  7.71s/it]
 41%|████      | 15562/37963 [38:16:11<61:03:06,  9.81s/it]
 41%|████      | 15563/37963 [38:16:18<57:19:46,  9.21s/it]
 41%|████      | 15564/37963 [38:16:26<54:21:58,  8.74s/it]
 41%|████      | 15565/37963 [38:16:34<52:23:58,  8.42s/it]
 41%|████      | 15566/37963 [38:16:48<63:14:00, 10.16s/it]
 41%|████      | 15567/37963 [38:16:55<58:29:47,  9.40s/it]
 41%|████      | 15568/37963 [38:17:10<68:43:37, 11.05s/it]
 41%|████      | 15569/37963 [38:17:18<62:24:14, 10.03s/it]
 41%|████      | 15570/37963 [38:17:26<57:52:46,  9.30s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '1.249', 'learning_rate': '1.333e-05', 'epoch': '0.4101'}
+
 41%|████      | 15570/37963 [38:17:26<57:52:46,  9.30s/it]
 41%|████      | 15571/37963 [38:17:40<67:20:28, 10.83s/it]
 41%|████      | 15572/37963 [38:17:55<74:23:27, 11.96s/it]
 41%|████      | 15573/37963 [38:18:02<66:23:44, 10.68s/it]
 41%|████      | 15574/37963 [38:18:10<60:48:07,  9.78s/it]
 41%|████      | 15575/37963 [38:18:18<56:55:08,  9.15s/it]
 41%|████      | 15576/37963 [38:18:25<53:47:02,  8.65s/it]
 41%|████      | 15577/37963 [38:18:33<51:42:20,  8.32s/it]
 41%|████      | 15578/37963 [38:18:40<50:26:54,  8.11s/it]
 41%|████      | 15579/37963 [38:18:55<62:41:02, 10.08s/it]
 41%|████      | 15580/37963 [38:19:03<57:53:58,  9.31s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '0.7506', 'learning_rate': '1.332e-05', 'epoch': '0.4104'}
+
 41%|████      | 15580/37963 [38:19:03<57:53:58,  9.31s/it]
 41%|████      | 15581/37963 [38:19:10<54:35:40,  8.78s/it]
 41%|████      | 15582/37963 [38:19:18<52:30:46,  8.45s/it]
 41%|████      | 15583/37963 [38:19:25<51:12:54,  8.24s/it]
 41%|████      | 15584/37963 [38:19:33<49:40:40,  7.99s/it]
 41%|████      | 15585/37963 [38:19:54<75:01:59, 12.07s/it]
 41%|████      | 15586/37963 [38:20:02<66:55:11, 10.77s/it]
 41%|████      | 15587/37963 [38:20:10<60:35:45,  9.75s/it]
 41%|████      | 15588/37963 [38:20:17<56:43:33,  9.13s/it]
 41%|████      | 15589/37963 [38:20:25<54:32:04,  8.77s/it]
 41%|████      | 15590/37963 [38:20:33<52:26:56,  8.44s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '3.438', 'learning_rate': '1.332e-05', 'epoch': '0.4107'}
+
 41%|████      | 15590/37963 [38:20:33<52:26:56,  8.44s/it]
 41%|████      | 15591/37963 [38:20:41<50:56:37,  8.20s/it]
 41%|████      | 15592/37963 [38:20:48<49:57:00,  8.04s/it]
 41%|████      | 15593/37963 [38:20:56<49:23:01,  7.95s/it]
 41%|████      | 15594/37963 [38:21:04<49:08:12,  7.91s/it]
 41%|████      | 15595/37963 [38:21:11<48:41:36,  7.84s/it]
 41%|████      | 15596/37963 [38:21:19<47:52:19,  7.71s/it]
 41%|████      | 15597/37963 [38:21:26<47:43:35,  7.68s/it]
 41%|████      | 15598/37963 [38:21:34<47:13:19,  7.60s/it]
 41%|████      | 15599/37963 [38:21:42<47:43:12,  7.68s/it]
 41%|████      | 15600/37963 [38:21:49<47:36:44,  7.66s/it]
                                                           
{'loss': '0.1669', 'grad_norm': '2.192', 'learning_rate': '1.331e-05', 'epoch': '0.4109'}
+
 41%|████      | 15600/37963 [38:21:49<47:36:44,  7.66s/it]
 41%|████      | 15601/37963 [38:21:57<47:39:19,  7.67s/it]
 41%|████      | 15602/37963 [38:22:05<47:29:24,  7.65s/it]
 41%|████      | 15603/37963 [38:22:12<47:26:01,  7.64s/it]
 41%|████      | 15604/37963 [38:22:20<47:44:47,  7.69s/it]
 41%|████      | 15605/37963 [38:22:28<47:47:37,  7.70s/it]
 41%|████      | 15606/37963 [38:22:35<47:45:11,  7.69s/it]
 41%|████      | 15607/37963 [38:22:43<47:10:26,  7.60s/it]
 41%|████      | 15608/37963 [38:22:51<47:37:53,  7.67s/it]
 41%|████      | 15609/37963 [38:22:58<46:56:46,  7.56s/it]
 41%|████      | 15610/37963 [38:23:06<47:00:50,  7.57s/it]
                                                           
{'loss': '0.1663', 'grad_norm': '3.155', 'learning_rate': '1.33e-05', 'epoch': '0.4112'}
+
 41%|████      | 15610/37963 [38:23:06<47:00:50,  7.57s/it]
 41%|████      | 15611/37963 [38:23:13<47:09:18,  7.59s/it]
 41%|████      | 15612/37963 [38:23:21<47:32:16,  7.66s/it]
 41%|████      | 15613/37963 [38:23:29<47:34:56,  7.66s/it]
 41%|████      | 15614/37963 [38:23:36<47:25:08,  7.64s/it]
 41%|████      | 15615/37963 [38:23:51<60:16:09,  9.71s/it]
 41%|████      | 15616/37963 [38:24:06<70:34:04, 11.37s/it]
 41%|████      | 15617/37963 [38:24:21<77:29:21, 12.48s/it]
 41%|████      | 15618/37963 [38:24:29<68:41:26, 11.07s/it]
 41%|████      | 15619/37963 [38:24:43<74:00:24, 11.92s/it]
 41%|████      | 15620/37963 [38:24:51<66:11:47, 10.67s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '1.555', 'learning_rate': '1.329e-05', 'epoch': '0.4115'}
+
 41%|████      | 15620/37963 [38:24:51<66:11:47, 10.67s/it]
 41%|████      | 15621/37963 [38:24:58<60:32:41,  9.76s/it]
 41%|████      | 15622/37963 [38:25:06<56:06:08,  9.04s/it]
 41%|████      | 15623/37963 [38:25:20<65:30:00, 10.56s/it]
 41%|████      | 15624/37963 [38:25:27<60:13:58,  9.71s/it]
 41%|████      | 15625/37963 [38:25:35<56:30:01,  9.11s/it]
 41%|████      | 15626/37963 [38:25:43<53:26:12,  8.61s/it]
 41%|████      | 15627/37963 [38:25:50<51:41:41,  8.33s/it]
 41%|████      | 15628/37963 [38:25:58<50:24:47,  8.13s/it]
 41%|████      | 15629/37963 [38:26:05<49:28:10,  7.97s/it]
 41%|████      | 15630/37963 [38:26:20<60:55:35,  9.82s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '1.505', 'learning_rate': '1.328e-05', 'epoch': '0.4117'}
+
 41%|████      | 15630/37963 [38:26:20<60:55:35,  9.82s/it]
 41%|████      | 15631/37963 [38:26:27<57:07:05,  9.21s/it]
 41%|████      | 15632/37963 [38:26:35<54:13:46,  8.74s/it]
 41%|████      | 15633/37963 [38:26:49<64:35:27, 10.41s/it]
 41%|████      | 15634/37963 [38:26:57<59:41:42,  9.62s/it]
 41%|████      | 15635/37963 [38:27:05<55:58:41,  9.03s/it]
 41%|████      | 15636/37963 [38:27:12<53:29:21,  8.62s/it]
 41%|████      | 15637/37963 [38:27:20<51:59:07,  8.38s/it]
 41%|████      | 15638/37963 [38:27:28<50:41:39,  8.17s/it]
 41%|████      | 15639/37963 [38:27:43<62:37:21, 10.10s/it]
 41%|████      | 15640/37963 [38:27:50<58:09:03,  9.38s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '1.514', 'learning_rate': '1.328e-05', 'epoch': '0.412'}
+
 41%|████      | 15640/37963 [38:27:50<58:09:03,  9.38s/it]
 41%|████      | 15641/37963 [38:27:58<54:56:44,  8.86s/it]
 41%|████      | 15642/37963 [38:28:06<52:42:45,  8.50s/it]
 41%|████      | 15643/37963 [38:28:13<51:18:56,  8.28s/it]
 41%|████      | 15644/37963 [38:28:21<49:50:37,  8.04s/it]
 41%|████      | 15645/37963 [38:28:28<48:51:31,  7.88s/it]
 41%|████      | 15646/37963 [38:28:36<48:23:23,  7.81s/it]
 41%|████      | 15647/37963 [38:28:43<47:57:20,  7.74s/it]
 41%|████      | 15648/37963 [38:28:51<47:59:19,  7.74s/it]
 41%|████      | 15649/37963 [38:28:59<47:38:59,  7.69s/it]
 41%|████      | 15650/37963 [38:29:06<47:37:31,  7.68s/it]
                                                           
{'loss': '0.1657', 'grad_norm': '3.212', 'learning_rate': '1.327e-05', 'epoch': '0.4122'}
+
 41%|████      | 15650/37963 [38:29:06<47:37:31,  7.68s/it]
 41%|████      | 15651/37963 [38:29:14<47:37:18,  7.68s/it]
 41%|████      | 15652/37963 [38:29:22<47:30:37,  7.67s/it]
 41%|████      | 15653/37963 [38:29:29<47:28:29,  7.66s/it]
 41%|████      | 15654/37963 [38:29:37<47:37:03,  7.68s/it]
 41%|████      | 15655/37963 [38:29:45<47:34:35,  7.68s/it]
 41%|████      | 15656/37963 [38:29:53<48:01:20,  7.75s/it]
 41%|████      | 15657/37963 [38:30:00<47:48:45,  7.72s/it]
 41%|████      | 15658/37963 [38:30:08<47:52:51,  7.73s/it]
 41%|████      | 15659/37963 [38:30:16<47:14:24,  7.62s/it]
 41%|████▏     | 15660/37963 [38:30:23<47:27:22,  7.66s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '1.474', 'learning_rate': '1.326e-05', 'epoch': '0.4125'}
+
 41%|████▏     | 15660/37963 [38:30:23<47:27:22,  7.66s/it]
 41%|████▏     | 15661/37963 [38:30:31<47:30:11,  7.67s/it]
 41%|████▏     | 15662/37963 [38:30:39<47:27:11,  7.66s/it]
 41%|████▏     | 15663/37963 [38:30:46<47:37:17,  7.69s/it]
 41%|████▏     | 15664/37963 [38:31:01<59:55:25,  9.67s/it]
 41%|████▏     | 15665/37963 [38:31:09<56:34:02,  9.13s/it]
 41%|████▏     | 15666/37963 [38:31:16<53:59:20,  8.72s/it]
 41%|████▏     | 15667/37963 [38:31:31<65:21:31, 10.55s/it]
 41%|████▏     | 15668/37963 [38:31:39<60:04:42,  9.70s/it]
 41%|████▏     | 15669/37963 [38:32:00<81:52:55, 13.22s/it]
 41%|████▏     | 15670/37963 [38:32:08<71:57:20, 11.62s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '2.609', 'learning_rate': '1.325e-05', 'epoch': '0.4128'}
+
 41%|████▏     | 15670/37963 [38:32:08<71:57:20, 11.62s/it]
 41%|████▏     | 15671/37963 [38:32:16<64:33:47, 10.43s/it]
 41%|████▏     | 15672/37963 [38:32:23<59:08:08,  9.55s/it]
 41%|████▏     | 15673/37963 [38:32:37<67:42:51, 10.94s/it]
 41%|████▏     | 15674/37963 [38:32:45<61:33:17,  9.94s/it]
 41%|████▏     | 15675/37963 [38:32:53<57:17:55,  9.26s/it]
 41%|████▏     | 15676/37963 [38:33:00<54:20:26,  8.78s/it]
 41%|████▏     | 15677/37963 [38:33:08<52:13:38,  8.44s/it]
 41%|████▏     | 15678/37963 [38:33:16<50:26:52,  8.15s/it]
 41%|████▏     | 15679/37963 [38:33:30<61:27:35,  9.93s/it]
 41%|████▏     | 15680/37963 [38:33:37<57:19:38,  9.26s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '3.116', 'learning_rate': '1.324e-05', 'epoch': '0.413'}
+
 41%|████▏     | 15680/37963 [38:33:37<57:19:38,  9.26s/it]
 41%|████▏     | 15681/37963 [38:33:52<67:39:18, 10.93s/it]
 41%|████▏     | 15682/37963 [38:34:00<62:04:32, 10.03s/it]
 41%|████▏     | 15683/37963 [38:34:07<57:14:14,  9.25s/it]
 41%|████▏     | 15684/37963 [38:34:15<54:22:08,  8.79s/it]
 41%|████▏     | 15685/37963 [38:34:23<52:00:04,  8.40s/it]
 41%|████▏     | 15686/37963 [38:34:30<50:21:54,  8.14s/it]
 41%|████▏     | 15687/37963 [38:34:38<49:27:54,  7.99s/it]
 41%|████▏     | 15688/37963 [38:34:46<48:50:00,  7.89s/it]
 41%|████▏     | 15689/37963 [38:34:53<48:18:58,  7.81s/it]
 41%|████▏     | 15690/37963 [38:35:01<47:54:26,  7.74s/it]
                                                           
{'loss': '0.156', 'grad_norm': '2.153', 'learning_rate': '1.324e-05', 'epoch': '0.4133'}
+
 41%|████▏     | 15690/37963 [38:35:01<47:54:26,  7.74s/it]
 41%|████▏     | 15691/37963 [38:35:08<47:36:35,  7.70s/it]
 41%|████▏     | 15692/37963 [38:35:16<47:15:51,  7.64s/it]
 41%|████▏     | 15693/37963 [38:35:31<60:30:11,  9.78s/it]
 41%|████▏     | 15694/37963 [38:35:38<56:36:47,  9.15s/it]
 41%|████▏     | 15695/37963 [38:35:46<53:54:11,  8.71s/it]
 41%|████▏     | 15696/37963 [38:35:54<51:55:24,  8.39s/it]
 41%|████▏     | 15697/37963 [38:36:01<50:07:51,  8.11s/it]
 41%|████▏     | 15698/37963 [38:36:09<49:23:19,  7.99s/it]
 41%|████▏     | 15699/37963 [38:36:16<48:41:28,  7.87s/it]
 41%|████▏     | 15700/37963 [38:36:24<48:15:06,  7.80s/it]
                                                           
{'loss': '0.159', 'grad_norm': '3.991', 'learning_rate': '1.323e-05', 'epoch': '0.4136'}
+
 41%|████▏     | 15700/37963 [38:36:24<48:15:06,  7.80s/it]
 41%|████▏     | 15701/37963 [38:36:32<48:00:00,  7.76s/it]
 41%|████▏     | 15702/37963 [38:36:39<47:53:31,  7.75s/it]
 41%|████▏     | 15703/37963 [38:36:47<47:28:53,  7.68s/it]
 41%|████▏     | 15704/37963 [38:36:55<47:30:29,  7.68s/it]
 41%|████▏     | 15705/37963 [38:37:03<48:04:05,  7.77s/it]
 41%|████▏     | 15706/37963 [38:37:10<48:02:43,  7.77s/it]
 41%|████▏     | 15707/37963 [38:37:18<47:57:23,  7.76s/it]
 41%|████▏     | 15708/37963 [38:37:26<47:38:54,  7.71s/it]
 41%|████▏     | 15709/37963 [38:37:33<47:31:03,  7.69s/it]
 41%|████▏     | 15710/37963 [38:37:41<47:24:10,  7.67s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '4.172', 'learning_rate': '1.322e-05', 'epoch': '0.4138'}
+
 41%|████▏     | 15710/37963 [38:37:41<47:24:10,  7.67s/it]
 41%|████▏     | 15711/37963 [38:37:49<47:35:37,  7.70s/it]
 41%|████▏     | 15712/37963 [38:38:03<59:29:12,  9.62s/it]
 41%|████▏     | 15713/37963 [38:38:10<55:46:43,  9.02s/it]
 41%|████▏     | 15714/37963 [38:38:26<67:12:04, 10.87s/it]
 41%|████▏     | 15715/37963 [38:38:34<61:45:04,  9.99s/it]
 41%|████▏     | 15716/37963 [38:38:41<57:23:47,  9.29s/it]
 41%|████▏     | 15717/37963 [38:38:55<66:25:45, 10.75s/it]
 41%|████▏     | 15718/37963 [38:39:03<60:44:05,  9.83s/it]
 41%|████▏     | 15719/37963 [38:39:11<57:06:32,  9.24s/it]
 41%|████▏     | 15720/37963 [38:39:26<67:53:30, 10.99s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '1.804', 'learning_rate': '1.321e-05', 'epoch': '0.4141'}
+
 41%|████▏     | 15720/37963 [38:39:26<67:53:30, 10.99s/it]
 41%|████▏     | 15721/37963 [38:39:34<61:53:51, 10.02s/it]
 41%|████▏     | 15722/37963 [38:39:42<57:42:05,  9.34s/it]
 41%|████▏     | 15723/37963 [38:39:56<66:56:50, 10.84s/it]
 41%|████▏     | 15724/37963 [38:40:04<61:11:14,  9.90s/it]
 41%|████▏     | 15725/37963 [38:40:11<56:43:05,  9.18s/it]
 41%|████▏     | 15726/37963 [38:40:19<53:58:27,  8.74s/it]
 41%|████▏     | 15727/37963 [38:40:27<52:17:30,  8.47s/it]
 41%|████▏     | 15728/37963 [38:40:34<50:43:47,  8.21s/it]
 41%|████▏     | 15729/37963 [38:40:42<49:38:01,  8.04s/it]
 41%|████▏     | 15730/37963 [38:40:57<62:37:33, 10.14s/it]
                                                           
{'loss': '0.1707', 'grad_norm': '1.897', 'learning_rate': '1.32e-05', 'epoch': '0.4144'}
+
 41%|████▏     | 15730/37963 [38:40:57<62:37:33, 10.14s/it]
 41%|████▏     | 15731/37963 [38:41:04<57:51:32,  9.37s/it]
 41%|████▏     | 15732/37963 [38:41:12<54:38:16,  8.85s/it]
 41%|████▏     | 15733/37963 [38:41:20<52:40:51,  8.53s/it]
 41%|████▏     | 15734/37963 [38:41:28<51:10:06,  8.29s/it]
 41%|████▏     | 15735/37963 [38:41:35<50:03:20,  8.11s/it]
 41%|████▏     | 15736/37963 [38:41:43<49:15:07,  7.98s/it]
 41%|████▏     | 15737/37963 [38:41:51<48:46:20,  7.90s/it]
 41%|████▏     | 15738/37963 [38:41:58<48:04:53,  7.79s/it]
 41%|████▏     | 15739/37963 [38:42:06<47:45:51,  7.74s/it]
 41%|████▏     | 15740/37963 [38:42:21<60:48:58,  9.85s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '2.613', 'learning_rate': '1.32e-05', 'epoch': '0.4146'}
+
 41%|████▏     | 15740/37963 [38:42:21<60:48:58,  9.85s/it]
 41%|████▏     | 15741/37963 [38:42:28<56:55:20,  9.22s/it]
 41%|████▏     | 15742/37963 [38:42:36<53:56:45,  8.74s/it]
 41%|████▏     | 15743/37963 [38:42:44<51:59:55,  8.42s/it]
 41%|████▏     | 15744/37963 [38:42:51<50:40:28,  8.21s/it]
 41%|████▏     | 15745/37963 [38:42:59<49:55:20,  8.09s/it]
 41%|████▏     | 15746/37963 [38:43:07<48:50:51,  7.92s/it]
 41%|████▏     | 15747/37963 [38:43:14<48:18:42,  7.83s/it]
 41%|████▏     | 15748/37963 [38:43:22<47:57:37,  7.77s/it]
 41%|████▏     | 15749/37963 [38:43:29<47:12:47,  7.65s/it]
 41%|████▏     | 15750/37963 [38:43:37<47:08:07,  7.64s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '2.422', 'learning_rate': '1.319e-05', 'epoch': '0.4149'}
+
 41%|████▏     | 15750/37963 [38:43:37<47:08:07,  7.64s/it]
 41%|████▏     | 15751/37963 [38:43:45<47:19:52,  7.67s/it]
 41%|████▏     | 15752/37963 [38:43:52<47:20:03,  7.67s/it]
 41%|████▏     | 15753/37963 [38:44:00<46:53:55,  7.60s/it]
 41%|████▏     | 15754/37963 [38:44:08<47:04:38,  7.63s/it]
 42%|████▏     | 15755/37963 [38:44:15<46:43:35,  7.57s/it]
 42%|████▏     | 15756/37963 [38:44:23<46:54:53,  7.61s/it]
 42%|████▏     | 15757/37963 [38:44:30<47:13:17,  7.66s/it]
 42%|████▏     | 15758/37963 [38:44:38<47:21:32,  7.68s/it]
 42%|████▏     | 15759/37963 [38:44:46<47:02:42,  7.63s/it]
 42%|████▏     | 15760/37963 [38:44:53<47:02:59,  7.63s/it]
                                                           
{'loss': '0.1634', 'grad_norm': '2.867', 'learning_rate': '1.318e-05', 'epoch': '0.4151'}
+
 42%|████▏     | 15760/37963 [38:44:53<47:02:59,  7.63s/it]
 42%|████▏     | 15761/37963 [38:45:07<58:45:40,  9.53s/it]
 42%|████▏     | 15762/37963 [38:45:22<68:23:45, 11.09s/it]
 42%|████▏     | 15763/37963 [38:45:36<74:30:19, 12.08s/it]
 42%|████▏     | 15764/37963 [38:45:44<66:31:56, 10.79s/it]
 42%|████▏     | 15765/37963 [38:45:58<72:45:10, 11.80s/it]
 42%|████▏     | 15766/37963 [38:46:06<64:58:10, 10.54s/it]
 42%|████▏     | 15767/37963 [38:46:13<59:21:51,  9.63s/it]
 42%|████▏     | 15768/37963 [38:46:21<55:44:06,  9.04s/it]
 42%|████▏     | 15769/37963 [38:46:29<53:06:46,  8.62s/it]
 42%|████▏     | 15770/37963 [38:46:43<63:29:36, 10.30s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '2.212', 'learning_rate': '1.317e-05', 'epoch': '0.4154'}
+
 42%|████▏     | 15770/37963 [38:46:43<63:29:36, 10.30s/it]
 42%|████▏     | 15771/37963 [38:46:51<58:41:52,  9.52s/it]
 42%|████▏     | 15772/37963 [38:47:05<67:17:48, 10.92s/it]
 42%|████▏     | 15773/37963 [38:47:12<61:14:20,  9.94s/it]
 42%|████▏     | 15774/37963 [38:47:20<57:01:53,  9.25s/it]
 42%|████▏     | 15775/37963 [38:47:28<53:50:34,  8.74s/it]
 42%|████▏     | 15776/37963 [38:47:35<51:30:24,  8.36s/it]
 42%|████▏     | 15777/37963 [38:47:43<49:59:37,  8.11s/it]
 42%|████▏     | 15778/37963 [38:47:57<61:37:48, 10.00s/it]
 42%|████▏     | 15779/37963 [38:48:05<57:17:37,  9.30s/it]
 42%|████▏     | 15780/37963 [38:48:12<54:21:39,  8.82s/it]
                                                           
{'loss': '0.158', 'grad_norm': '1.913', 'learning_rate': '1.316e-05', 'epoch': '0.4157'}
+
 42%|████▏     | 15780/37963 [38:48:12<54:21:39,  8.82s/it]
 42%|████▏     | 15781/37963 [38:48:20<52:07:24,  8.46s/it]
 42%|████▏     | 15782/37963 [38:48:28<50:52:10,  8.26s/it]
 42%|████▏     | 15783/37963 [38:48:36<49:58:26,  8.11s/it]
 42%|████▏     | 15784/37963 [38:48:43<48:55:44,  7.94s/it]
 42%|████▏     | 15785/37963 [38:48:51<48:35:38,  7.89s/it]
 42%|████▏     | 15786/37963 [38:49:06<61:28:48,  9.98s/it]
 42%|████▏     | 15787/37963 [38:49:14<57:34:30,  9.35s/it]
 42%|████▏     | 15788/37963 [38:49:21<54:35:25,  8.86s/it]
 42%|████▏     | 15789/37963 [38:49:29<52:31:36,  8.53s/it]
 42%|████▏     | 15790/37963 [38:49:37<50:43:15,  8.24s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '1.358', 'learning_rate': '1.315e-05', 'epoch': '0.4159'}
+
 42%|████▏     | 15790/37963 [38:49:37<50:43:15,  8.24s/it]
 42%|████▏     | 15791/37963 [38:49:44<49:44:57,  8.08s/it]
 42%|████▏     | 15792/37963 [38:49:52<49:03:03,  7.96s/it]
 42%|████▏     | 15793/37963 [38:50:00<48:32:40,  7.88s/it]
 42%|████▏     | 15794/37963 [38:50:07<48:06:38,  7.81s/it]
 42%|████▏     | 15795/37963 [38:50:15<47:36:46,  7.73s/it]
 42%|████▏     | 15796/37963 [38:50:23<47:33:42,  7.72s/it]
 42%|████▏     | 15797/37963 [38:50:30<47:31:36,  7.72s/it]
 42%|████▏     | 15798/37963 [38:50:38<47:07:48,  7.65s/it]
 42%|████▏     | 15799/37963 [38:50:45<46:47:15,  7.60s/it]
 42%|████▏     | 15800/37963 [38:50:53<47:04:42,  7.65s/it]
                                                           
{'loss': '0.1595', 'grad_norm': '1.253', 'learning_rate': '1.315e-05', 'epoch': '0.4162'}
+
 42%|████▏     | 15800/37963 [38:50:53<47:04:42,  7.65s/it]
 42%|████▏     | 15801/37963 [38:51:01<47:12:40,  7.67s/it]
 42%|████▏     | 15802/37963 [38:51:08<47:02:35,  7.64s/it]
 42%|████▏     | 15803/37963 [38:51:16<47:09:32,  7.66s/it]
 42%|████▏     | 15804/37963 [38:51:24<46:54:48,  7.62s/it]
 42%|████▏     | 15805/37963 [38:51:31<46:52:24,  7.62s/it]
 42%|████▏     | 15806/37963 [38:51:39<47:13:00,  7.67s/it]
 42%|████▏     | 15807/37963 [38:52:00<72:23:39, 11.76s/it]
 42%|████▏     | 15808/37963 [38:52:08<64:31:17, 10.48s/it]
 42%|████▏     | 15809/37963 [38:52:15<59:14:28,  9.63s/it]
 42%|████▏     | 15810/37963 [38:52:23<55:40:52,  9.05s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '1.641', 'learning_rate': '1.314e-05', 'epoch': '0.4165'}
+
 42%|████▏     | 15810/37963 [38:52:23<55:40:52,  9.05s/it]
 42%|████▏     | 15811/37963 [38:52:31<53:00:11,  8.61s/it]
 42%|████▏     | 15812/37963 [38:52:39<51:50:10,  8.42s/it]
 42%|████▏     | 15813/37963 [38:52:54<63:53:43, 10.38s/it]
 42%|████▏     | 15814/37963 [38:53:08<71:08:04, 11.56s/it]
 42%|████▏     | 15815/37963 [38:53:16<64:07:05, 10.42s/it]
 42%|████▏     | 15816/37963 [38:53:36<82:46:43, 13.46s/it]
 42%|████▏     | 15817/37963 [38:53:44<72:04:04, 11.72s/it]
 42%|████▏     | 15818/37963 [38:53:52<64:49:21, 10.54s/it]
 42%|████▏     | 15819/37963 [38:53:59<59:30:47,  9.68s/it]
 42%|████▏     | 15820/37963 [38:54:07<55:41:48,  9.06s/it]
                                                           
{'loss': '0.1672', 'grad_norm': '3.977', 'learning_rate': '1.313e-05', 'epoch': '0.4167'}
+
 42%|████▏     | 15820/37963 [38:54:07<55:41:48,  9.06s/it]
 42%|████▏     | 15821/37963 [38:54:15<53:27:18,  8.69s/it]
 42%|████▏     | 15822/37963 [38:54:23<51:49:51,  8.43s/it]
 42%|████▏     | 15823/37963 [38:54:31<50:54:46,  8.28s/it]
 42%|████▏     | 15824/37963 [38:54:38<49:50:56,  8.11s/it]
 42%|████▏     | 15825/37963 [38:54:46<49:03:03,  7.98s/it]
 42%|████▏     | 15826/37963 [38:54:53<47:56:30,  7.80s/it]
 42%|████▏     | 15827/37963 [38:55:09<61:30:08, 10.00s/it]
 42%|████▏     | 15828/37963 [38:55:16<56:48:48,  9.24s/it]
 42%|████▏     | 15829/37963 [38:55:24<53:53:44,  8.77s/it]
 42%|████▏     | 15830/37963 [38:55:39<65:48:20, 10.70s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '1.26', 'learning_rate': '1.312e-05', 'epoch': '0.417'}
+
 42%|████▏     | 15830/37963 [38:55:39<65:48:20, 10.70s/it]
 42%|████▏     | 15831/37963 [38:55:47<60:32:31,  9.85s/it]
 42%|████▏     | 15832/37963 [38:55:54<56:29:59,  9.19s/it]
 42%|████▏     | 15833/37963 [38:56:02<53:16:56,  8.67s/it]
 42%|████▏     | 15834/37963 [38:56:09<51:03:00,  8.30s/it]
 42%|████▏     | 15835/37963 [38:56:17<50:05:27,  8.15s/it]
 42%|████▏     | 15836/37963 [38:56:25<49:45:29,  8.10s/it]
 42%|████▏     | 15837/37963 [38:56:33<49:11:27,  8.00s/it]
 42%|████▏     | 15838/37963 [38:56:41<48:33:24,  7.90s/it]
 42%|████▏     | 15839/37963 [38:56:48<48:20:57,  7.87s/it]
 42%|████▏     | 15840/37963 [38:56:56<47:40:53,  7.76s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '1.131', 'learning_rate': '1.311e-05', 'epoch': '0.4172'}
+
 42%|████▏     | 15840/37963 [38:56:56<47:40:53,  7.76s/it]
 42%|████▏     | 15841/37963 [38:57:03<47:12:50,  7.68s/it]
 42%|████▏     | 15842/37963 [38:57:11<47:14:00,  7.69s/it]
 42%|████▏     | 15843/37963 [38:57:19<47:41:11,  7.76s/it]
 42%|████▏     | 15844/37963 [38:57:27<47:27:39,  7.72s/it]
 42%|████▏     | 15845/37963 [38:57:35<48:02:10,  7.82s/it]
 42%|████▏     | 15846/37963 [38:57:42<48:05:48,  7.83s/it]
 42%|████▏     | 15847/37963 [38:57:50<47:28:35,  7.73s/it]
 42%|████▏     | 15848/37963 [38:57:58<47:27:32,  7.73s/it]
 42%|████▏     | 15849/37963 [38:58:05<46:39:43,  7.60s/it]
 42%|████▏     | 15850/37963 [38:58:13<46:32:25,  7.58s/it]
                                                           
{'loss': '0.141', 'grad_norm': '1.633', 'learning_rate': '1.311e-05', 'epoch': '0.4175'}
+
 42%|████▏     | 15850/37963 [38:58:13<46:32:25,  7.58s/it]
 42%|████▏     | 15851/37963 [38:58:20<47:04:01,  7.66s/it]
 42%|████▏     | 15852/37963 [38:58:28<47:32:23,  7.74s/it]
 42%|████▏     | 15853/37963 [38:58:36<47:49:54,  7.79s/it]
 42%|████▏     | 15854/37963 [38:58:44<47:36:37,  7.75s/it]
 42%|████▏     | 15855/37963 [38:58:52<47:39:20,  7.76s/it]
 42%|████▏     | 15856/37963 [38:59:06<59:53:56,  9.75s/it]
 42%|████▏     | 15857/37963 [38:59:14<56:25:02,  9.19s/it]
 42%|████▏     | 15858/37963 [38:59:29<67:09:46, 10.94s/it]
 42%|█��██▏     | 15859/37963 [38:59:37<61:28:58, 10.01s/it]
 42%|████▏     | 15860/37963 [38:59:45<57:25:37,  9.35s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '1.197', 'learning_rate': '1.31e-05', 'epoch': '0.4178'}
+
 42%|████▏     | 15860/37963 [38:59:45<57:25:37,  9.35s/it]
 42%|████▏     | 15861/37963 [38:59:59<67:28:38, 10.99s/it]
 42%|████▏     | 15862/37963 [39:00:07<61:53:45, 10.08s/it]
 42%|████▏     | 15863/37963 [39:00:22<69:25:47, 11.31s/it]
 42%|████▏     | 15864/37963 [39:00:36<75:08:28, 12.24s/it]
 42%|████▏     | 15865/37963 [39:00:50<78:56:52, 12.86s/it]
 42%|████▏     | 15866/37963 [39:00:59<70:34:55, 11.50s/it]
 42%|████▏     | 15867/37963 [39:01:06<63:46:59, 10.39s/it]
 42%|████▏     | 15868/37963 [39:01:14<58:10:36,  9.48s/it]
 42%|████▏     | 15869/37963 [39:01:22<55:06:02,  8.98s/it]
 42%|████▏     | 15870/37963 [39:01:29<52:47:29,  8.60s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '5.512', 'learning_rate': '1.309e-05', 'epoch': '0.418'}
+
 42%|████▏     | 15870/37963 [39:01:29<52:47:29,  8.60s/it]
 42%|████▏     | 15871/37963 [39:01:37<50:51:33,  8.29s/it]
 42%|████▏     | 15872/37963 [39:01:45<49:53:08,  8.13s/it]
 42%|████▏     | 15873/37963 [39:02:00<62:27:24, 10.18s/it]
 42%|████▏     | 15874/37963 [39:02:07<58:16:52,  9.50s/it]
 42%|████▏     | 15875/37963 [39:02:15<55:07:56,  8.99s/it]
 42%|████▏     | 15876/37963 [39:02:23<52:55:48,  8.63s/it]
 42%|████▏     | 15877/37963 [39:02:31<51:15:05,  8.35s/it]
 42%|████▏     | 15878/37963 [39:02:39<50:26:57,  8.22s/it]
 42%|████▏     | 15879/37963 [39:02:47<49:49:47,  8.12s/it]
 42%|████▏     | 15880/37963 [39:02:54<49:02:11,  7.99s/it]
                                                           
{'loss': '0.1651', 'grad_norm': '1.543', 'learning_rate': '1.308e-05', 'epoch': '0.4183'}
+
 42%|████▏     | 15880/37963 [39:02:54<49:02:11,  7.99s/it]
 42%|████▏     | 15881/37963 [39:03:09<61:43:56, 10.06s/it]
 42%|████▏     | 15882/37963 [39:03:17<57:43:47,  9.41s/it]
 42%|████▏     | 15883/37963 [39:03:25<54:37:54,  8.91s/it]
 42%|████▏     | 15884/37963 [39:03:32<52:19:18,  8.53s/it]
 42%|████▏     | 15885/37963 [39:03:40<50:09:26,  8.18s/it]
 42%|████▏     | 15886/37963 [39:03:48<49:27:48,  8.07s/it]
 42%|████▏     | 15887/37963 [39:03:55<48:08:48,  7.85s/it]
 42%|████▏     | 15888/37963 [39:04:03<48:06:43,  7.85s/it]
 42%|████▏     | 15889/37963 [39:04:10<47:48:12,  7.80s/it]
 42%|████▏     | 15890/37963 [39:04:18<48:02:01,  7.83s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '1.194', 'learning_rate': '1.307e-05', 'epoch': '0.4186'}
+
 42%|████▏     | 15890/37963 [39:04:18<48:02:01,  7.83s/it]
 42%|████▏     | 15891/37963 [39:04:26<47:45:45,  7.79s/it]
 42%|████▏     | 15892/37963 [39:04:34<47:48:12,  7.80s/it]
 42%|████▏     | 15893/37963 [39:04:42<47:32:01,  7.75s/it]
 42%|████▏     | 15894/37963 [39:04:49<47:29:09,  7.75s/it]
 42%|████▏     | 15895/37963 [39:04:57<47:15:40,  7.71s/it]
 42%|████▏     | 15896/37963 [39:05:04<46:36:42,  7.60s/it]
 42%|████▏     | 15897/37963 [39:05:12<46:37:17,  7.61s/it]
 42%|████▏     | 15898/37963 [39:05:19<46:21:29,  7.56s/it]
 42%|████▏     | 15899/37963 [39:05:27<46:22:40,  7.57s/it]
 42%|████▏     | 15900/37963 [39:05:34<46:13:30,  7.54s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '3.103', 'learning_rate': '1.307e-05', 'epoch': '0.4188'}
+
 42%|████▏     | 15900/37963 [39:05:34<46:13:30,  7.54s/it]
 42%|████▏     | 15901/37963 [39:05:42<46:32:04,  7.59s/it]
 42%|████▏     | 15902/37963 [39:05:50<46:44:18,  7.63s/it]
 42%|████▏     | 15903/37963 [39:06:04<58:49:22,  9.60s/it]
 42%|████▏     | 15904/37963 [39:06:12<55:09:16,  9.00s/it]
 42%|████▏     | 15905/37963 [39:06:19<52:05:02,  8.50s/it]
 42%|████▏     | 15906/37963 [39:06:33<62:33:56, 10.21s/it]
 42%|████▏     | 15907/37963 [39:06:41<58:01:34,  9.47s/it]
 42%|████▏     | 15908/37963 [39:06:49<54:53:39,  8.96s/it]
 42%|████▏     | 15909/37963 [39:06:56<52:24:44,  8.56s/it]
 42%|████▏     | 15910/37963 [39:07:10<62:44:18, 10.24s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '1.201', 'learning_rate': '1.306e-05', 'epoch': '0.4191'}
+
 42%|████▏     | 15910/37963 [39:07:10<62:44:18, 10.24s/it]
 42%|████▏     | 15911/37963 [39:07:18<57:50:01,  9.44s/it]
 42%|████▏     | 15912/37963 [39:07:32<66:36:05, 10.87s/it]
 42%|████▏     | 15913/37963 [39:07:40<61:12:16,  9.99s/it]
 42%|████▏     | 15914/37963 [39:07:55<69:46:20, 11.39s/it]
 42%|████▏     | 15915/37963 [39:08:09<74:42:31, 12.20s/it]
 42%|████▏     | 15916/37963 [39:08:17<66:35:10, 10.87s/it]
 42%|████▏     | 15917/37963 [39:08:32<73:56:56, 12.08s/it]
 42%|████▏     | 15918/37963 [39:08:39<65:55:29, 10.77s/it]
 42%|████▏     | 15919/37963 [39:08:47<59:36:44,  9.74s/it]
 42%|████▏     | 15920/37963 [39:08:54<55:14:07,  9.02s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '1.635', 'learning_rate': '1.305e-05', 'epoch': '0.4194'}
+
 42%|████▏     | 15920/37963 [39:08:54<55:14:07,  9.02s/it]
 42%|████▏     | 15921/37963 [39:09:02<52:44:52,  8.62s/it]
 42%|████▏     | 15922/37963 [39:09:09<51:01:07,  8.33s/it]
 42%|████▏     | 15923/37963 [39:09:17<50:14:00,  8.21s/it]
 42%|████▏     | 15924/37963 [39:09:25<48:44:54,  7.96s/it]
 42%|████▏     | 15925/37963 [39:09:32<48:12:22,  7.87s/it]
 42%|████▏     | 15926/37963 [39:09:40<47:48:05,  7.81s/it]
 42%|████▏     | 15927/37963 [39:09:48<47:59:31,  7.84s/it]
 42%|████▏     | 15928/37963 [39:09:55<47:32:18,  7.77s/it]
 42%|████▏     | 15929/37963 [39:10:03<47:19:42,  7.73s/it]
 42%|████▏     | 15930/37963 [39:10:11<47:09:55,  7.71s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '1.355', 'learning_rate': '1.304e-05', 'epoch': '0.4196'}
+
 42%|████▏     | 15930/37963 [39:10:11<47:09:55,  7.71s/it]
 42%|████▏     | 15931/37963 [39:10:26<61:05:16,  9.98s/it]
 42%|████▏     | 15932/37963 [39:10:34<56:49:08,  9.28s/it]
 42%|████▏     | 15933/37963 [39:10:41<54:01:12,  8.83s/it]
 42%|████▏     | 15934/37963 [39:10:49<52:03:40,  8.51s/it]
 42%|████▏     | 15935/37963 [39:10:57<50:37:12,  8.27s/it]
 42%|████▏     | 15936/37963 [39:11:05<49:31:27,  8.09s/it]
 42%|████▏     | 15937/37963 [39:11:12<48:48:42,  7.98s/it]
 42%|████▏     | 15938/37963 [39:11:20<48:18:44,  7.90s/it]
 42%|████▏     | 15939/37963 [39:11:28<47:32:52,  7.77s/it]
 42%|████▏     | 15940/37963 [39:11:35<47:06:18,  7.70s/it]
                                                           
{'loss': '0.152', 'grad_norm': '1.113', 'learning_rate': '1.303e-05', 'epoch': '0.4199'}
+
 42%|████▏     | 15940/37963 [39:11:35<47:06:18,  7.70s/it]
 42%|████▏     | 15941/37963 [39:11:43<46:50:02,  7.66s/it]
 42%|████▏     | 15942/37963 [39:11:50<46:59:01,  7.68s/it]
 42%|████▏     | 15943/37963 [39:11:58<46:33:53,  7.61s/it]
 42%|████▏     | 15944/37963 [39:12:06<46:49:25,  7.66s/it]
 42%|████▏     | 15945/37963 [39:12:13<46:26:27,  7.59s/it]
 42%|████▏     | 15946/37963 [39:12:20<46:09:01,  7.55s/it]
 42%|████▏     | 15947/37963 [39:12:28<46:04:47,  7.53s/it]
 42%|████▏     | 15948/37963 [39:12:35<46:02:28,  7.53s/it]
 42%|████▏     | 15949/37963 [39:12:43<45:56:58,  7.51s/it]
 42%|████▏     | 15950/37963 [39:12:57<57:16:13,  9.37s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '0.8152', 'learning_rate': '1.302e-05', 'epoch': '0.4201'}
+
 42%|████▏     | 15950/37963 [39:12:57<57:16:13,  9.37s/it]
 42%|████▏     | 15951/37963 [39:13:04<54:17:17,  8.88s/it]
 42%|████▏     | 15952/37963 [39:13:12<51:40:44,  8.45s/it]
 42%|████▏     | 15953/37963 [39:13:19<49:44:36,  8.14s/it]
 42%|████▏     | 15954/37963 [39:13:27<48:55:39,  8.00s/it]
 42%|████▏     | 15955/37963 [39:13:35<48:26:34,  7.92s/it]
 42%|████▏     | 15956/37963 [39:13:42<48:11:27,  7.88s/it]
 42%|████▏     | 15957/37963 [39:13:50<48:02:57,  7.86s/it]
 42%|████▏     | 15958/37963 [39:14:04<59:10:56,  9.68s/it]
 42%|████▏     | 15959/37963 [39:14:12<55:59:31,  9.16s/it]
 42%|████▏     | 15960/37963 [39:14:27<66:29:53, 10.88s/it]
                                                           
{'loss': '0.1691', 'grad_norm': '0.8945', 'learning_rate': '1.302e-05', 'epoch': '0.4204'}
+
 42%|████▏     | 15960/37963 [39:14:27<66:29:53, 10.88s/it]
 42%|████▏     | 15961/37963 [39:14:35<60:54:08,  9.96s/it]
 42%|████▏     | 15962/37963 [39:14:43<57:18:06,  9.38s/it]
 42%|████▏     | 15963/37963 [39:14:58<68:00:02, 11.13s/it]
 42%|████▏     | 15964/37963 [39:15:13<74:29:55, 12.19s/it]
 42%|████▏     | 15965/37963 [39:15:28<79:58:19, 13.09s/it]
 42%|████▏     | 15966/37963 [39:15:42<82:21:43, 13.48s/it]
 42%|████▏     | 15967/37963 [39:15:50<72:18:39, 11.83s/it]
 42%|████▏     | 15968/37963 [39:15:58<65:10:47, 10.67s/it]
 42%|████▏     | 15969/37963 [39:16:06<59:53:45,  9.80s/it]
 42%|████▏     | 15970/37963 [39:16:14<56:07:12,  9.19s/it]
                                                           
{'loss': '0.1658', 'grad_norm': '1.268', 'learning_rate': '1.301e-05', 'epoch': '0.4207'}
+
 42%|████▏     | 15970/37963 [39:16:14<56:07:12,  9.19s/it]
 42%|████▏     | 15971/37963 [39:16:22<53:35:25,  8.77s/it]
 42%|████▏     | 15972/37963 [39:16:29<51:46:57,  8.48s/it]
 42%|████▏     | 15973/37963 [39:16:37<50:20:24,  8.24s/it]
 42%|████▏     | 15974/37963 [39:16:45<49:22:44,  8.08s/it]
 42%|████▏     | 15975/37963 [39:16:53<49:03:07,  8.03s/it]
 42%|████▏     | 15976/37963 [39:17:01<48:56:35,  8.01s/it]
 42%|████▏     | 15977/37963 [39:17:08<48:29:55,  7.94s/it]
 42%|████▏     | 15978/37963 [39:17:16<47:47:54,  7.83s/it]
 42%|████▏     | 15979/37963 [39:17:24<47:25:25,  7.77s/it]
 42%|████▏     | 15980/37963 [39:17:31<47:22:55,  7.76s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '3.142', 'learning_rate': '1.3e-05', 'epoch': '0.4209'}
+
 42%|████▏     | 15980/37963 [39:17:31<47:22:55,  7.76s/it]
 42%|████▏     | 15981/37963 [39:17:39<47:20:11,  7.75s/it]
 42%|████▏     | 15982/37963 [39:17:54<60:12:36,  9.86s/it]
 42%|████▏     | 15983/37963 [39:18:02<56:26:10,  9.24s/it]
 42%|████▏     | 15984/37963 [39:18:09<53:39:04,  8.79s/it]
 42%|████▏     | 15985/37963 [39:18:17<51:54:54,  8.50s/it]
 42%|████▏     | 15986/37963 [39:18:25<50:40:25,  8.30s/it]
 42%|████▏     | 15987/37963 [39:18:33<49:14:13,  8.07s/it]
 42%|████▏     | 15988/37963 [39:18:40<48:08:14,  7.89s/it]
 42%|████▏     | 15989/37963 [39:18:48<48:11:16,  7.89s/it]
 42%|████▏     | 15990/37963 [39:18:56<48:10:45,  7.89s/it]
                                                           
{'loss': '0.161', 'grad_norm': '2.109', 'learning_rate': '1.299e-05', 'epoch': '0.4212'}
+
 42%|████▏     | 15990/37963 [39:18:56<48:10:45,  7.89s/it]
 42%|████▏     | 15991/37963 [39:19:04<48:09:45,  7.89s/it]
 42%|████▏     | 15992/37963 [39:19:12<48:09:42,  7.89s/it]
 42%|████▏     | 15993/37963 [39:19:20<48:07:15,  7.89s/it]
 42%|████▏     | 15994/37963 [39:19:27<47:55:34,  7.85s/it]
 42%|████▏     | 15995/37963 [39:19:35<47:45:22,  7.83s/it]
 42%|████▏     | 15996/37963 [39:19:43<47:39:14,  7.81s/it]
 42%|████▏     | 15997/37963 [39:19:51<47:26:04,  7.77s/it]
 42%|████▏     | 15998/37963 [39:19:58<47:07:17,  7.72s/it]
 42%|████▏     | 15999/37963 [39:20:12<59:12:02,  9.70s/it]
 42%|████▏     | 16000/37963 [39:20:20<55:21:18,  9.07s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '2.168', 'learning_rate': '1.298e-05', 'epoch': '0.4215'}
+
 42%|████▏     | 16000/37963 [39:20:20<55:21:18,  9.07s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.41s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.41s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 42%|████▏     | 16001/37963 [39:21:16<140:43:50, 23.07s/it]
 42%|████▏     | 16002/37963 [39:21:30<124:46:26, 20.45s/it]
 42%|████▏     | 16003/37963 [39:21:38<101:14:31, 16.60s/it]
 42%|████▏     | 16004/37963 [39:21:45<84:44:43, 13.89s/it] 
 42%|████▏     | 16005/37963 [39:22:02<89:02:33, 14.60s/it]
 42%|████▏     | 16006/37963 [39:22:09<76:21:00, 12.52s/it]
 42%|████▏     | 16007/37963 [39:22:23<79:31:25, 13.04s/it]
 42%|████▏     | 16008/37963 [39:22:31<69:35:55, 11.41s/it]
 42%|████▏     | 16009/37963 [39:22:39<62:46:20, 10.29s/it]
 42%|████▏     | 16010/37963 [39:22:46<57:09:35,  9.37s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '1.123', 'learning_rate': '1.298e-05', 'epoch': '0.4217'}
+
 42%|████▏     | 16010/37963 [39:22:46<57:09:35,  9.37s/it]
 42%|████▏     | 16011/37963 [39:23:00<66:15:03, 10.86s/it]
 42%|████▏     | 16012/37963 [39:23:08<60:22:50,  9.90s/it]
 42%|████▏     | 16013/37963 [39:23:23<69:30:49, 11.40s/it]
 42%|████▏     | 16014/37963 [39:23:31<63:00:47, 10.34s/it]
 42%|████▏     | 16015/37963 [39:23:38<57:56:33,  9.50s/it]
 42%|████▏     | 16016/37963 [39:23:46<54:34:32,  8.95s/it]
 42%|████▏     | 16017/37963 [39:24:00<63:53:31, 10.48s/it]
 42%|████▏     | 16018/37963 [39:24:08<59:17:19,  9.73s/it]
 42%|████▏     | 16019/37963 [39:24:16<55:21:25,  9.08s/it]
 42%|████▏     | 16020/37963 [39:24:23<52:13:41,  8.57s/it]
                                                           
{'loss': '0.1439', 'grad_norm': '3.272', 'learning_rate': '1.297e-05', 'epoch': '0.422'}
+
 42%|████▏     | 16020/37963 [39:24:23<52:13:41,  8.57s/it]
 42%|████▏     | 16021/37963 [39:24:30<50:01:29,  8.21s/it]
 42%|████▏     | 16022/37963 [39:24:38<49:07:50,  8.06s/it]
 42%|████▏     | 16023/37963 [39:24:46<48:26:20,  7.95s/it]
 42%|████▏     | 16024/37963 [39:24:54<48:24:02,  7.94s/it]
 42%|████▏     | 16025/37963 [39:25:01<47:21:57,  7.77s/it]
 42%|████▏     | 16026/37963 [39:25:09<47:12:29,  7.75s/it]
 42%|████▏     | 16027/37963 [39:25:23<60:06:22,  9.86s/it]
 42%|████▏     | 16028/37963 [39:25:31<56:30:08,  9.27s/it]
 42%|████▏     | 16029/37963 [39:25:39<53:19:42,  8.75s/it]
 42%|████▏     | 16030/37963 [39:25:47<51:30:15,  8.45s/it]
                                                           
{'loss': '0.1428', 'grad_norm': '1.509', 'learning_rate': '1.296e-05', 'epoch': '0.4223'}
+
 42%|████▏     | 16030/37963 [39:25:47<51:30:15,  8.45s/it]
 42%|████▏     | 16031/37963 [39:25:54<50:17:32,  8.26s/it]
 42%|████▏     | 16032/37963 [39:26:02<49:13:31,  8.08s/it]
 42%|████▏     | 16033/37963 [39:26:10<48:11:38,  7.91s/it]
 42%|████▏     | 16034/37963 [39:26:17<47:51:32,  7.86s/it]
 42%|████▏     | 16035/37963 [39:26:25<47:33:10,  7.81s/it]
 42%|████▏     | 16036/37963 [39:26:33<47:20:51,  7.77s/it]
 42%|████▏     | 16037/37963 [39:26:40<47:10:50,  7.75s/it]
 42%|████▏     | 16038/37963 [39:26:48<47:04:29,  7.73s/it]
 42%|████▏     | 16039/37963 [39:26:56<47:02:44,  7.73s/it]
 42%|████▏     | 16040/37963 [39:27:04<47:12:51,  7.75s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '1.649', 'learning_rate': '1.295e-05', 'epoch': '0.4225'}
+
 42%|████▏     | 16040/37963 [39:27:04<47:12:51,  7.75s/it]
 42%|████▏     | 16041/37963 [39:27:11<47:04:25,  7.73s/it]
 42%|████▏     | 16042/37963 [39:27:19<47:04:01,  7.73s/it]
 42%|████▏     | 16043/37963 [39:27:27<46:57:32,  7.71s/it]
 42%|████▏     | 16044/37963 [39:27:34<46:28:06,  7.63s/it]
 42%|████▏     | 16045/37963 [39:27:42<46:49:53,  7.69s/it]
 42%|████▏     | 16046/37963 [39:27:50<46:45:39,  7.68s/it]
 42%|████▏     | 16047/37963 [39:27:57<46:50:31,  7.69s/it]
 42%|████▏     | 16048/37963 [39:28:12<58:53:31,  9.67s/it]
 42%|████▏     | 16049/37963 [39:28:26<67:49:19, 11.14s/it]
 42%|████▏     | 16050/37963 [39:28:34<61:34:29, 10.12s/it]
                                                           
{'loss': '0.1678', 'grad_norm': '1.292', 'learning_rate': '1.294e-05', 'epoch': '0.4228'}
+
 42%|████▏     | 16050/37963 [39:28:34<61:34:29, 10.12s/it]
 42%|████▏     | 16051/37963 [39:28:42<56:59:23,  9.36s/it]
 42%|████▏     | 16052/37963 [39:28:49<54:16:26,  8.92s/it]
 42%|████▏     | 16053/37963 [39:29:05<65:39:18, 10.79s/it]
 42%|████▏     | 16054/37963 [39:29:12<60:00:03,  9.86s/it]
 42%|████▏     | 16055/37963 [39:29:20<56:04:08,  9.21s/it]
 42%|████▏     | 16056/37963 [39:29:28<53:08:43,  8.73s/it]
 42%|████▏     | 16057/37963 [39:29:42<63:32:19, 10.44s/it]
 42%|████▏     | 16058/37963 [39:29:56<69:51:20, 11.48s/it]
 42%|████▏     | 16059/37963 [39:30:04<62:58:48, 10.35s/it]
 42%|████▏     | 16060/37963 [39:30:11<57:51:16,  9.51s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '0.947', 'learning_rate': '1.294e-05', 'epoch': '0.423'}
+
 42%|████▏     | 16060/37963 [39:30:11<57:51:16,  9.51s/it]
 42%|████▏     | 16061/37963 [39:30:19<54:49:42,  9.01s/it]
 42%|████▏     | 16062/37963 [39:30:33<64:08:25, 10.54s/it]
 42%|████▏     | 16063/37963 [39:30:48<72:18:28, 11.89s/it]
 42%|████▏     | 16064/37963 [39:30:56<65:13:10, 10.72s/it]
 42%|████▏     | 16065/37963 [39:31:04<59:39:57,  9.81s/it]
 42%|████▏     | 16066/37963 [39:31:12<55:36:25,  9.14s/it]
 42%|████▏     | 16067/37963 [39:31:19<53:08:23,  8.74s/it]
 42%|████▏     | 16068/37963 [39:31:27<51:15:40,  8.43s/it]
 42%|████▏     | 16069/37963 [39:31:35<49:50:30,  8.20s/it]
 42%|████▏     | 16070/37963 [39:31:42<48:57:34,  8.05s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '2.871', 'learning_rate': '1.293e-05', 'epoch': '0.4233'}
+
 42%|████▏     | 16070/37963 [39:31:42<48:57:34,  8.05s/it]
 42%|████▏     | 16071/37963 [39:31:50<48:20:24,  7.95s/it]
 42%|████▏     | 16072/37963 [39:31:58<47:40:33,  7.84s/it]
 42%|████▏     | 16073/37963 [39:32:05<47:03:38,  7.74s/it]
 42%|████▏     | 16074/37963 [39:32:13<46:50:25,  7.70s/it]
 42%|████▏     | 16075/37963 [39:32:21<46:52:42,  7.71s/it]
 42%|████▏     | 16076/37963 [39:32:28<47:10:39,  7.76s/it]
 42%|████▏     | 16077/37963 [39:32:36<46:58:24,  7.73s/it]
 42%|████▏     | 16078/37963 [39:32:44<46:54:20,  7.72s/it]
 42%|████▏     | 16079/37963 [39:32:52<46:59:59,  7.73s/it]
 42%|████▏     | 16080/37963 [39:33:06<60:02:19,  9.88s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '1.548', 'learning_rate': '1.292e-05', 'epoch': '0.4236'}
+
 42%|████▏     | 16080/37963 [39:33:06<60:02:19,  9.88s/it]
 42%|████▏     | 16081/37963 [39:33:14<56:06:51,  9.23s/it]
 42%|████▏     | 16082/37963 [39:33:22<53:23:49,  8.79s/it]
 42%|████▏     | 16083/37963 [39:33:30<51:21:23,  8.45s/it]
 42%|████▏     | 16084/37963 [39:33:37<50:04:40,  8.24s/it]
 42%|████▏     | 16085/37963 [39:33:45<48:59:17,  8.06s/it]
 42%|████▏     | 16086/37963 [39:33:53<48:23:41,  7.96s/it]
 42%|████▏     | 16087/37963 [39:34:00<47:52:34,  7.88s/it]
 42%|████▏     | 16088/37963 [39:34:08<47:08:20,  7.76s/it]
 42%|████▏     | 16089/37963 [39:34:15<46:56:05,  7.72s/it]
 42%|████▏     | 16090/37963 [39:34:23<46:31:44,  7.66s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '1.951', 'learning_rate': '1.291e-05', 'epoch': '0.4238'}
+
 42%|████▏     | 16090/37963 [39:34:23<46:31:44,  7.66s/it]
 42%|████▏     | 16091/37963 [39:34:31<46:29:50,  7.65s/it]
 42%|████▏     | 16092/37963 [39:34:38<46:35:09,  7.67s/it]
 42%|████▏     | 16093/37963 [39:34:46<46:40:48,  7.68s/it]
 42%|████▏     | 16094/37963 [39:34:53<46:05:52,  7.59s/it]
 42%|████▏     | 16095/37963 [39:35:01<46:10:04,  7.60s/it]
 42%|████▏     | 16096/37963 [39:35:09<46:15:11,  7.61s/it]
 42%|████▏     | 16097/37963 [39:35:16<46:22:03,  7.63s/it]
 42%|████▏     | 16098/37963 [39:35:24<46:29:31,  7.65s/it]
 42%|████▏     | 16099/37963 [39:35:39<59:18:36,  9.77s/it]
 42%|████▏     | 16100/37963 [39:35:46<55:25:56,  9.13s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '0.9165', 'learning_rate': '1.29e-05', 'epoch': '0.4241'}
+
 42%|████▏     | 16100/37963 [39:35:46<55:25:56,  9.13s/it]
 42%|████▏     | 16101/37963 [39:35:54<52:02:05,  8.57s/it]
 42%|████▏     | 16102/37963 [39:36:08<61:55:42, 10.20s/it]
 42%|████▏     | 16103/37963 [39:36:22<69:29:12, 11.44s/it]
 42%|████▏     | 16104/37963 [39:36:36<74:30:53, 12.27s/it]
 42%|████▏     | 16105/37963 [39:36:44<66:26:55, 10.94s/it]
 42%|████▏     | 16106/37963 [39:36:52<60:35:15,  9.98s/it]
 42%|████▏     | 16107/37963 [39:37:06<69:14:05, 11.40s/it]
 42%|████▏     | 16108/37963 [39:37:14<61:48:12, 10.18s/it]
 42%|████▏     | 16109/37963 [39:37:29<70:04:17, 11.54s/it]
 42%|████▏     | 16110/37963 [39:37:43<74:36:22, 12.29s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '0.6162', 'learning_rate': '1.289e-05', 'epoch': '0.4244'}
+
 42%|████▏     | 16110/37963 [39:37:43<74:36:22, 12.29s/it]
 42%|████▏     | 16111/37963 [39:37:50<66:30:18, 10.96s/it]
 42%|████▏     | 16112/37963 [39:37:58<60:55:07, 10.04s/it]
 42%|████▏     | 16113/37963 [39:38:06<56:30:45,  9.31s/it]
 42%|████▏     | 16114/37963 [39:38:14<53:33:17,  8.82s/it]
 42%|████▏     | 16115/37963 [39:38:21<51:37:59,  8.51s/it]
 42%|████▏     | 16116/37963 [39:38:29<50:04:16,  8.25s/it]
 42%|████▏     | 16117/37963 [39:38:37<48:47:49,  8.04s/it]
 42%|████▏     | 16118/37963 [39:38:44<48:08:16,  7.93s/it]
 42%|████▏     | 16119/37963 [39:38:52<47:43:03,  7.86s/it]
 42%|████▏     | 16120/37963 [39:39:00<47:23:17,  7.81s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '1.1', 'learning_rate': '1.289e-05', 'epoch': '0.4246'}
+
 42%|████▏     | 16120/37963 [39:39:00<47:23:17,  7.81s/it]
 42%|████▏     | 16121/37963 [39:39:07<47:09:18,  7.77s/it]
 42%|████▏     | 16122/37963 [39:39:15<46:50:52,  7.72s/it]
 42%|████▏     | 16123/37963 [39:39:23<46:46:36,  7.71s/it]
 42%|████▏     | 16124/37963 [39:39:37<59:19:27,  9.78s/it]
 42%|████▏     | 16125/37963 [39:39:45<55:33:04,  9.16s/it]
 42%|████▏     | 16126/37963 [39:39:52<52:17:11,  8.62s/it]
 42%|████▏     | 16127/37963 [39:40:00<50:30:50,  8.33s/it]
 42%|████▏     | 16128/37963 [39:40:08<49:35:41,  8.18s/it]
 42%|████▏     | 16129/37963 [39:40:15<48:35:58,  8.01s/it]
 42%|████▏     | 16130/37963 [39:40:23<47:47:32,  7.88s/it]
                                                           
{'loss': '0.1653', 'grad_norm': '2.271', 'learning_rate': '1.288e-05', 'epoch': '0.4249'}
+
 42%|████▏     | 16130/37963 [39:40:23<47:47:32,  7.88s/it]
 42%|████▏     | 16131/37963 [39:40:31<47:09:18,  7.78s/it]
 42%|████▏     | 16132/37963 [39:40:38<46:41:16,  7.70s/it]
 42%|████▏     | 16133/37963 [39:40:46<46:36:22,  7.69s/it]
 42%|████▏     | 16134/37963 [39:40:53<46:47:00,  7.72s/it]
 43%|████▎     | 16135/37963 [39:41:01<46:38:56,  7.69s/it]
 43%|████▎     | 16136/37963 [39:41:09<46:37:19,  7.69s/it]
 43%|████▎     | 16137/37963 [39:41:17<46:41:05,  7.70s/it]
 43%|████▎     | 16138/37963 [39:41:24<46:55:10,  7.74s/it]
 43%|████▎     | 16139/37963 [39:41:32<46:45:42,  7.71s/it]
 43%|████▎     | 16140/37963 [39:41:39<46:17:07,  7.64s/it]
                                                           
{'loss': '0.1636', 'grad_norm': '1.935', 'learning_rate': '1.287e-05', 'epoch': '0.4252'}
+
 43%|████▎     | 16140/37963 [39:41:39<46:17:07,  7.64s/it]
 43%|████▎     | 16141/37963 [39:41:47<46:30:24,  7.67s/it]
 43%|████▎     | 16142/37963 [39:41:55<46:30:19,  7.67s/it]
 43%|████▎     | 16143/37963 [39:42:02<46:10:17,  7.62s/it]
 43%|████▎     | 16144/37963 [39:42:10<46:27:16,  7.66s/it]
 43%|████▎     | 16145/37963 [39:42:18<46:14:35,  7.63s/it]
 43%|████▎     | 16146/37963 [39:42:33<59:47:59,  9.87s/it]
 43%|████▎     | 16147/37963 [39:42:40<55:51:29,  9.22s/it]
 43%|████▎     | 16148/37963 [39:42:48<53:12:37,  8.78s/it]
 43%|████▎     | 16149/37963 [39:43:02<62:50:12, 10.37s/it]
 43%|████▎     | 16150/37963 [39:43:17<69:58:30, 11.55s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '2.322', 'learning_rate': '1.286e-05', 'epoch': '0.4254'}
+
 43%|████▎     | 16150/37963 [39:43:17<69:58:30, 11.55s/it]
 43%|████▎     | 16151/37963 [39:43:24<63:11:14, 10.43s/it]
 43%|████▎     | 16152/37963 [39:43:32<58:00:25,  9.57s/it]
 43%|████▎     | 16153/37963 [39:43:40<54:29:19,  8.99s/it]
 43%|████▎     | 16154/37963 [39:43:54<65:02:40, 10.74s/it]
 43%|████▎     | 16155/37963 [39:44:09<72:00:32, 11.89s/it]
 43%|████▎     | 16156/37963 [39:44:17<64:13:00, 10.60s/it]
 43%|████▎     | 16157/37963 [39:44:31<71:13:48, 11.76s/it]
 43%|████▎     | 16158/37963 [39:44:45<75:44:27, 12.50s/it]
 43%|████▎     | 16159/37963 [39:44:53<67:23:55, 11.13s/it]
 43%|████▎     | 16160/37963 [39:45:01<61:20:15, 10.13s/it]
                                                           
{'loss': '0.1713', 'grad_norm': '2.122', 'learning_rate': '1.285e-05', 'epoch': '0.4257'}
+
 43%|████▎     | 16160/37963 [39:45:01<61:20:15, 10.13s/it]
 43%|████▎     | 16161/37963 [39:45:09<56:44:45,  9.37s/it]
 43%|████▎     | 16162/37963 [39:45:16<53:30:44,  8.84s/it]
 43%|████▎     | 16163/37963 [39:45:24<51:17:08,  8.47s/it]
 43%|████▎     | 16164/37963 [39:45:32<50:08:46,  8.28s/it]
 43%|████▎     | 16165/37963 [39:45:40<49:22:55,  8.16s/it]
 43%|████▎     | 16166/37963 [39:45:47<48:23:53,  7.99s/it]
 43%|████▎     | 16167/37963 [39:45:55<47:38:35,  7.87s/it]
 43%|████▎     | 16168/37963 [39:46:09<59:19:29,  9.80s/it]
 43%|████▎     | 16169/37963 [39:46:17<55:35:36,  9.18s/it]
 43%|████▎     | 16170/37963 [39:46:25<53:00:19,  8.76s/it]
                                                           
{'loss': '0.1516', 'grad_norm': '1.163', 'learning_rate': '1.285e-05', 'epoch': '0.4259'}
+
 43%|████▎     | 16170/37963 [39:46:25<53:00:19,  8.76s/it]
 43%|████▎     | 16171/37963 [39:46:32<50:48:07,  8.39s/it]
 43%|████▎     | 16172/37963 [39:46:40<49:21:09,  8.15s/it]
 43%|████▎     | 16173/37963 [39:46:47<48:29:09,  8.01s/it]
 43%|████▎     | 16174/37963 [39:46:55<47:43:51,  7.89s/it]
 43%|████▎     | 16175/37963 [39:47:03<47:32:37,  7.86s/it]
 43%|████▎     | 16176/37963 [39:47:10<47:02:11,  7.77s/it]
 43%|████▎     | 16177/37963 [39:47:18<47:04:36,  7.78s/it]
 43%|████▎     | 16178/37963 [39:47:26<46:50:52,  7.74s/it]
 43%|████▎     | 16179/37963 [39:47:33<46:37:41,  7.71s/it]
 43%|████▎     | 16180/37963 [39:47:41<46:23:57,  7.67s/it]
                                                           
{'loss': '0.1437', 'grad_norm': '0.6703', 'learning_rate': '1.284e-05', 'epoch': '0.4262'}
+
 43%|████▎     | 16180/37963 [39:47:41<46:23:57,  7.67s/it]
 43%|████▎     | 16181/37963 [39:47:49<46:40:28,  7.71s/it]
 43%|████▎     | 16182/37963 [39:47:57<46:39:03,  7.71s/it]
 43%|████▎     | 16183/37963 [39:48:04<46:29:28,  7.68s/it]
 43%|████▎     | 16184/37963 [39:48:12<46:26:56,  7.68s/it]
 43%|████▎     | 16185/37963 [39:48:19<46:25:11,  7.67s/it]
 43%|���███▎     | 16186/37963 [39:48:27<46:36:36,  7.71s/it]
 43%|████▎     | 16187/37963 [39:48:35<46:28:24,  7.68s/it]
 43%|████▎     | 16188/37963 [39:48:43<46:34:26,  7.70s/it]
 43%|████▎     | 16189/37963 [39:48:57<58:11:07,  9.62s/it]
 43%|████▎     | 16190/37963 [39:49:05<54:51:40,  9.07s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '1.391', 'learning_rate': '1.283e-05', 'epoch': '0.4265'}
+
 43%|████▎     | 16190/37963 [39:49:05<54:51:40,  9.07s/it]
 43%|████▎     | 16191/37963 [39:49:12<52:10:52,  8.63s/it]
 43%|████▎     | 16192/37963 [39:49:20<50:14:39,  8.31s/it]
 43%|████▎     | 16193/37963 [39:49:27<48:58:34,  8.10s/it]
 43%|████▎     | 16194/37963 [39:49:35<48:05:27,  7.95s/it]
 43%|████▎     | 16195/37963 [39:49:43<47:37:40,  7.88s/it]
 43%|████▎     | 16196/37963 [39:49:51<47:49:52,  7.91s/it]
 43%|████▎     | 16197/37963 [39:50:05<59:23:12,  9.82s/it]
 43%|████▎     | 16198/37963 [39:50:13<55:38:55,  9.20s/it]
 43%|████▎     | 16199/37963 [39:50:20<52:53:54,  8.75s/it]
 43%|████▎     | 16200/37963 [39:50:34<61:57:01, 10.25s/it]
                                                           
{'loss': '0.1696', 'grad_norm': '2.088', 'learning_rate': '1.282e-05', 'epoch': '0.4267'}
+
 43%|████▎     | 16200/37963 [39:50:34<61:57:01, 10.25s/it]
 43%|████▎     | 16201/37963 [39:50:42<57:20:28,  9.49s/it]
 43%|████▎     | 16202/37963 [39:50:57<67:18:32, 11.14s/it]
 43%|████▎     | 16203/37963 [39:51:04<60:58:30, 10.09s/it]
 43%|████▎     | 16204/37963 [39:51:19<69:07:59, 11.44s/it]
 43%|████▎     | 16205/37963 [39:51:33<74:40:04, 12.35s/it]
 43%|████▎     | 16206/37963 [39:51:41<66:11:23, 10.95s/it]
 43%|████▎     | 16207/37963 [39:51:55<71:51:08, 11.89s/it]
 43%|████▎     | 16208/37963 [39:52:03<63:53:46, 10.57s/it]
 43%|████▎     | 16209/37963 [39:52:10<58:03:47,  9.61s/it]
 43%|████▎     | 16210/37963 [39:52:18<54:31:14,  9.02s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '1.588', 'learning_rate': '1.281e-05', 'epoch': '0.427'}
+
 43%|████▎     | 16210/37963 [39:52:18<54:31:14,  9.02s/it]
 43%|████▎     | 16211/37963 [39:52:25<52:11:23,  8.64s/it]
 43%|████▎     | 16212/37963 [39:52:33<50:21:49,  8.34s/it]
 43%|████▎     | 16213/37963 [39:52:41<49:07:59,  8.13s/it]
 43%|████▎     | 16214/37963 [39:52:48<48:16:21,  7.99s/it]
 43%|████▎     | 16215/37963 [39:52:56<47:31:38,  7.87s/it]
 43%|████▎     | 16216/37963 [39:53:04<47:12:25,  7.81s/it]
 43%|████▎     | 16217/37963 [39:53:11<46:51:54,  7.76s/it]
 43%|████▎     | 16218/37963 [39:53:26<59:17:35,  9.82s/it]
 43%|████▎     | 16219/37963 [39:53:34<55:28:57,  9.19s/it]
 43%|████▎     | 16220/37963 [39:53:41<52:45:07,  8.73s/it]
                                                           
{'loss': '0.143', 'grad_norm': '2.13', 'learning_rate': '1.28e-05', 'epoch': '0.4273'}
+
 43%|████▎     | 16220/37963 [39:53:41<52:45:07,  8.73s/it]
 43%|████▎     | 16221/37963 [39:53:49<50:54:07,  8.43s/it]
 43%|████▎     | 16222/37963 [39:53:57<49:25:08,  8.18s/it]
 43%|████▎     | 16223/37963 [39:54:04<47:53:15,  7.93s/it]
 43%|████▎     | 16224/37963 [39:54:11<47:02:04,  7.79s/it]
 43%|████▎     | 16225/37963 [39:54:19<46:50:39,  7.76s/it]
 43%|████▎     | 16226/37963 [39:54:27<46:27:24,  7.69s/it]
 43%|████▎     | 16227/37963 [39:54:34<46:25:30,  7.69s/it]
 43%|████▎     | 16228/37963 [39:54:42<46:18:59,  7.67s/it]
 43%|████▎     | 16229/37963 [39:54:50<46:21:31,  7.68s/it]
 43%|████▎     | 16230/37963 [39:54:57<46:11:12,  7.65s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '1.699', 'learning_rate': '1.28e-05', 'epoch': '0.4275'}
+
 43%|████▎     | 16230/37963 [39:54:57<46:11:12,  7.65s/it]
 43%|████▎     | 16231/37963 [39:55:05<46:24:06,  7.69s/it]
 43%|████▎     | 16232/37963 [39:55:13<46:21:55,  7.68s/it]
 43%|████▎     | 16233/37963 [39:55:20<46:25:53,  7.69s/it]
 43%|████▎     | 16234/37963 [39:55:28<46:12:48,  7.66s/it]
 43%|████▎     | 16235/37963 [39:55:36<46:03:59,  7.63s/it]
 43%|████▎     | 16236/37963 [39:55:43<46:09:54,  7.65s/it]
 43%|████▎     | 16237/37963 [39:55:51<46:16:14,  7.67s/it]
 43%|████▎     | 16238/37963 [39:56:06<59:11:46,  9.81s/it]
 43%|████▎     | 16239/37963 [39:56:13<55:10:32,  9.14s/it]
 43%|████▎     | 16240/37963 [39:56:21<52:33:44,  8.71s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '2.52', 'learning_rate': '1.279e-05', 'epoch': '0.4278'}
+
 43%|████▎     | 16240/37963 [39:56:21<52:33:44,  8.71s/it]
 43%|████▎     | 16241/37963 [39:56:35<62:07:40, 10.30s/it]
 43%|████▎     | 16242/37963 [39:56:43<57:24:24,  9.51s/it]
 43%|████▎     | 16243/37963 [39:56:57<65:27:51, 10.85s/it]
 43%|████▎     | 16244/37963 [39:57:05<59:51:07,  9.92s/it]
 43%|████▎     | 16245/37963 [39:57:12<55:44:47,  9.24s/it]
 43%|████▎     | 16246/37963 [39:57:20<53:13:07,  8.82s/it]
 43%|████▎     | 16247/37963 [39:57:28<51:14:20,  8.49s/it]
 43%|████▎     | 16248/37963 [39:57:36<50:08:22,  8.31s/it]
 43%|████▎     | 16249/37963 [39:57:43<49:19:25,  8.18s/it]
 43%|████▎     | 16250/37963 [39:57:51<48:32:47,  8.05s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '0.8658', 'learning_rate': '1.278e-05', 'epoch': '0.428'}
+
 43%|████▎     | 16250/37963 [39:57:51<48:32:47,  8.05s/it]
 43%|████▎     | 16251/37963 [39:58:05<59:44:18,  9.91s/it]
 43%|████▎     | 16252/37963 [39:58:13<55:42:49,  9.24s/it]
 43%|████▎     | 16253/37963 [39:58:27<64:19:38, 10.67s/it]
 43%|████▎     | 16254/37963 [39:58:35<58:57:45,  9.78s/it]
 43%|████▎     | 16255/37963 [39:58:42<55:01:09,  9.12s/it]
 43%|████▎     | 16256/37963 [39:58:57<65:07:33, 10.80s/it]
 43%|████▎     | 16257/37963 [39:59:11<71:25:06, 11.84s/it]
 43%|████▎     | 16258/37963 [39:59:19<64:17:52, 10.66s/it]
 43%|████▎     | 16259/37963 [39:59:27<58:48:33,  9.75s/it]
 43%|████▎     | 16260/37963 [39:59:35<54:49:30,  9.09s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '1.485', 'learning_rate': '1.277e-05', 'epoch': '0.4283'}
+
 43%|████▎     | 16260/37963 [39:59:35<54:49:30,  9.09s/it]
 43%|████▎     | 16261/37963 [39:59:42<52:34:08,  8.72s/it]
 43%|████▎     | 16262/37963 [39:59:50<50:33:15,  8.39s/it]
 43%|████▎     | 16263/37963 [39:59:58<49:18:55,  8.18s/it]
 43%|████▎     | 16264/37963 [40:00:05<47:55:09,  7.95s/it]
 43%|████▎     | 16265/37963 [40:00:13<47:20:09,  7.85s/it]
 43%|████▎     | 16266/37963 [40:00:20<47:01:43,  7.80s/it]
 43%|████▎     | 16267/37963 [40:00:28<46:47:29,  7.76s/it]
 43%|████▎     | 16268/37963 [40:00:36<46:26:50,  7.71s/it]
 43%|████▎     | 16269/37963 [40:00:43<45:56:04,  7.62s/it]
 43%|████▎     | 16270/37963 [40:00:51<45:41:26,  7.58s/it]
                                                           
{'loss': '0.1557', 'grad_norm': '5.434', 'learning_rate': '1.276e-05', 'epoch': '0.4286'}
+
 43%|████▎     | 16270/37963 [40:00:51<45:41:26,  7.58s/it]
 43%|████▎     | 16271/37963 [40:00:58<45:25:42,  7.54s/it]
 43%|████▎     | 16272/37963 [40:01:13<58:30:22,  9.71s/it]
 43%|████▎     | 16273/37963 [40:01:20<54:41:20,  9.08s/it]
 43%|████▎     | 16274/37963 [40:01:28<52:06:41,  8.65s/it]
 43%|████▎     | 16275/37963 [40:01:36<50:09:41,  8.33s/it]
 43%|████▎     | 16276/37963 [40:01:43<48:43:43,  8.09s/it]
 43%|████▎     | 16277/37963 [40:01:51<48:14:04,  8.01s/it]
 43%|████▎     | 16278/37963 [40:01:58<47:11:43,  7.84s/it]
 43%|████▎     | 16279/37963 [40:02:06<46:39:24,  7.75s/it]
 43%|████▎     | 16280/37963 [40:02:14<46:28:34,  7.72s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '1.543', 'learning_rate': '1.276e-05', 'epoch': '0.4288'}
+
 43%|████▎     | 16280/37963 [40:02:14<46:28:34,  7.72s/it]
 43%|████▎     | 16281/37963 [40:02:21<46:22:20,  7.70s/it]
 43%|████▎     | 16282/37963 [40:02:29<46:11:06,  7.67s/it]
 43%|████▎     | 16283/37963 [40:02:36<45:56:11,  7.63s/it]
 43%|████▎     | 16284/37963 [40:02:44<45:51:09,  7.61s/it]
 43%|████▎     | 16285/37963 [40:02:52<46:14:44,  7.68s/it]
 43%|████▎     | 16286/37963 [40:02:59<46:02:56,  7.65s/it]
 43%|████▎     | 16287/37963 [40:03:07<46:13:21,  7.68s/it]
 43%|████▎     | 16288/37963 [40:03:15<46:14:20,  7.68s/it]
 43%|████▎     | 16289/37963 [40:03:29<58:23:18,  9.70s/it]
 43%|████▎     | 16290/37963 [40:03:37<54:25:27,  9.04s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '2.69', 'learning_rate': '1.275e-05', 'epoch': '0.4291'}
+
 43%|████▎     | 16290/37963 [40:03:37<54:25:27,  9.04s/it]
 43%|████▎     | 16291/37963 [40:03:51<63:00:53, 10.47s/it]
 43%|████▎     | 16292/37963 [40:04:05<70:53:42, 11.78s/it]
 43%|████▎     | 16293/37963 [40:04:13<63:32:00, 10.55s/it]
 43%|████▎     | 16294/37963 [40:04:21<57:56:34,  9.63s/it]
 43%|████▎     | 16295/37963 [40:04:28<54:23:30,  9.04s/it]
 43%|████▎     | 16296/37963 [40:04:36<51:54:43,  8.63s/it]
 43%|████▎     | 16297/37963 [40:04:43<49:58:23,  8.30s/it]
 43%|████▎     | 16298/37963 [40:04:51<49:13:55,  8.18s/it]
 43%|████▎     | 16299/37963 [40:05:06<61:03:33, 10.15s/it]
 43%|████▎     | 16300/37963 [40:05:14<56:43:01,  9.43s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '1.218', 'learning_rate': '1.274e-05', 'epoch': '0.4294'}
+
 43%|████▎     | 16300/37963 [40:05:14<56:43:01,  9.43s/it]
 43%|████▎     | 16301/37963 [40:05:21<53:25:07,  8.88s/it]
 43%|████▎     | 16302/37963 [40:05:29<51:22:42,  8.54s/it]
 43%|████▎     | 16303/37963 [40:05:37<50:03:59,  8.32s/it]
 43%|████▎     | 16304/37963 [40:05:51<61:13:52, 10.18s/it]
 43%|████▎     | 16305/37963 [40:06:06<68:54:45, 11.45s/it]
 43%|████▎     | 16306/37963 [40:06:13<61:36:45, 10.24s/it]
 43%|████▎     | 16307/37963 [40:06:28<69:30:46, 11.56s/it]
 43%|████▎     | 16308/37963 [40:06:36<62:29:09, 10.39s/it]
 43%|████▎     | 16309/37963 [40:06:43<57:29:03,  9.56s/it]
 43%|████▎     | 16310/37963 [40:06:51<54:09:35,  9.00s/it]
                                                           
{'loss': '0.1423', 'grad_norm': '3.744', 'learning_rate': '1.273e-05', 'epoch': '0.4296'}
+
 43%|████▎     | 16310/37963 [40:06:51<54:09:35,  9.00s/it]
 43%|████▎     | 16311/37963 [40:06:59<51:39:13,  8.59s/it]
 43%|████▎     | 16312/37963 [40:07:06<49:56:59,  8.31s/it]
 43%|████▎     | 16313/37963 [40:07:14<48:43:15,  8.10s/it]
 43%|████▎     | 16314/37963 [40:07:21<47:37:30,  7.92s/it]
 43%|████▎     | 16315/37963 [40:07:29<47:17:15,  7.86s/it]
 43%|████▎     | 16316/37963 [40:07:37<46:50:12,  7.79s/it]
 43%|████▎     | 16317/37963 [40:07:44<46:32:48,  7.74s/it]
 43%|████▎     | 16318/37963 [40:07:52<46:27:00,  7.73s/it]
 43%|████▎     | 16319/37963 [40:08:00<46:28:42,  7.73s/it]
 43%|████▎     | 16320/37963 [40:08:07<46:22:51,  7.71s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '4.096', 'learning_rate': '1.272e-05', 'epoch': '0.4299'}
+
 43%|████▎     | 16320/37963 [40:08:07<46:22:51,  7.71s/it]
 43%|████▎     | 16321/37963 [40:08:15<46:04:15,  7.66s/it]
 43%|████▎     | 16322/37963 [40:08:30<59:04:33,  9.83s/it]
 43%|████▎     | 16323/37963 [40:08:38<55:19:56,  9.21s/it]
 43%|████▎     | 16324/37963 [40:08:45<52:32:44,  8.74s/it]
 43%|████▎     | 16325/37963 [40:08:53<50:02:59,  8.33s/it]
 43%|████▎     | 16326/37963 [40:09:00<48:49:54,  8.12s/it]
 43%|████▎     | 16327/37963 [40:09:08<47:59:28,  7.99s/it]
 43%|████▎     | 16328/37963 [40:09:15<47:10:01,  7.85s/it]
 43%|████▎     | 16329/37963 [40:09:23<46:46:54,  7.78s/it]
 43%|████▎     | 16330/37963 [40:09:31<46:48:00,  7.79s/it]
                                                           
{'loss': '0.156', 'grad_norm': '1.654', 'learning_rate': '1.271e-05', 'epoch': '0.4302'}
+
 43%|████▎     | 16330/37963 [40:09:31<46:48:00,  7.79s/it]
 43%|████▎     | 16331/37963 [40:09:38<46:29:27,  7.74s/it]
 43%|████▎     | 16332/37963 [40:09:46<46:23:24,  7.72s/it]
 43%|████▎     | 16333/37963 [40:10:00<57:48:24,  9.62s/it]
 43%|████▎     | 16334/37963 [40:10:08<54:23:48,  9.05s/it]
 43%|████▎     | 16335/37963 [40:10:16<51:56:50,  8.65s/it]
 43%|████▎     | 16336/37963 [40:10:23<50:17:14,  8.37s/it]
 43%|████▎     | 16337/37963 [40:10:31<49:05:01,  8.17s/it]
 43%|████▎     | 16338/37963 [40:10:38<47:41:12,  7.94s/it]
 43%|████▎     | 16339/37963 [40:10:46<47:11:30,  7.86s/it]
 43%|████▎     | 16340/37963 [40:11:01<59:20:22,  9.88s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '2.761', 'learning_rate': '1.271e-05', 'epoch': '0.4304'}
+
 43%|████▎     | 16340/37963 [40:11:01<59:20:22,  9.88s/it]
 43%|████▎     | 16341/37963 [40:11:08<55:02:08,  9.16s/it]
 43%|████▎     | 16342/37963 [40:11:16<52:17:07,  8.71s/it]
 43%|████▎     | 16343/37963 [40:11:23<50:18:03,  8.38s/it]
 43%|████▎     | 16344/37963 [40:11:31<48:44:31,  8.12s/it]
 43%|████▎     | 16345/37963 [40:11:39<47:43:26,  7.95s/it]
 43%|████▎     | 16346/37963 [40:11:54<60:26:23, 10.07s/it]
 43%|████▎     | 16347/37963 [40:12:01<56:01:13,  9.33s/it]
 43%|████▎     | 16348/37963 [40:12:09<52:41:34,  8.78s/it]
 43%|████▎     | 16349/37963 [40:12:24<65:07:48, 10.85s/it]
 43%|████▎     | 16350/37963 [40:12:39<72:07:33, 12.01s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '3.697', 'learning_rate': '1.27e-05', 'epoch': '0.4307'}
+
 43%|████▎     | 16350/37963 [40:12:39<72:07:33, 12.01s/it]
 43%|████▎     | 16351/37963 [40:12:53<75:39:22, 12.60s/it]
 43%|████▎     | 16352/37963 [40:13:01<66:43:50, 11.12s/it]
 43%|████▎     | 16353/37963 [40:13:08<60:40:34, 10.11s/it]
 43%|████▎     | 16354/37963 [40:13:16<56:27:17,  9.41s/it]
 43%|████▎     | 16355/37963 [40:13:24<53:41:55,  8.95s/it]
 43%|████▎     | 16356/37963 [40:13:32<51:10:23,  8.53s/it]
 43%|████▎     | 16357/37963 [40:13:39<49:36:18,  8.27s/it]
 43%|████▎     | 16358/37963 [40:13:47<48:46:19,  8.13s/it]
 43%|████▎     | 16359/37963 [40:13:55<47:54:24,  7.98s/it]
 43%|████▎     | 16360/37963 [40:14:02<47:10:18,  7.86s/it]
                                                           
{'loss': '0.1755', 'grad_norm': '1.754', 'learning_rate': '1.269e-05', 'epoch': '0.4309'}
+
 43%|████▎     | 16360/37963 [40:14:02<47:10:18,  7.86s/it]
 43%|████▎     | 16361/37963 [40:14:17<58:47:58,  9.80s/it]
 43%|████▎     | 16362/37963 [40:14:24<54:49:41,  9.14s/it]
 43%|████▎     | 16363/37963 [40:14:32<51:56:44,  8.66s/it]
 43%|████▎     | 16364/37963 [40:14:39<49:49:21,  8.30s/it]
 43%|████▎     | 16365/37963 [40:14:47<48:17:25,  8.05s/it]
 43%|████▎     | 16366/37963 [40:14:54<47:23:05,  7.90s/it]
 43%|████▎     | 16367/37963 [40:15:02<46:58:06,  7.83s/it]
 43%|████▎     | 16368/37963 [40:15:10<46:44:38,  7.79s/it]
 43%|████▎     | 16369/37963 [40:15:17<46:14:54,  7.71s/it]
 43%|████▎     | 16370/37963 [40:15:32<59:07:57,  9.86s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '1.794', 'learning_rate': '1.268e-05', 'epoch': '0.4312'}
+
 43%|████▎     | 16370/37963 [40:15:32<59:07:57,  9.86s/it]
 43%|████▎     | 16371/37963 [40:15:40<55:08:17,  9.19s/it]
 43%|████▎     | 16372/37963 [40:15:47<52:18:36,  8.72s/it]
 43%|████▎     | 16373/37963 [40:15:55<50:24:03,  8.40s/it]
 43%|████▎     | 16374/37963 [40:16:03<49:05:01,  8.18s/it]
 43%|████▎     | 16375/37963 [40:16:10<48:11:53,  8.04s/it]
 43%|████▎     | 16376/37963 [40:16:18<47:31:21,  7.93s/it]
 43%|████▎     | 16377/37963 [40:16:26<47:08:12,  7.86s/it]
 43%|████▎     | 16378/37963 [40:16:33<47:01:48,  7.84s/it]
 43%|████▎     | 16379/37963 [40:16:41<46:30:53,  7.76s/it]
 43%|████▎     | 16380/37963 [40:16:49<46:31:11,  7.76s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '2.365', 'learning_rate': '1.267e-05', 'epoch': '0.4315'}
+
 43%|████▎     | 16380/37963 [40:16:49<46:31:11,  7.76s/it]
 43%|████▎     | 16381/37963 [40:16:56<45:41:25,  7.62s/it]
 43%|████▎     | 16382/37963 [40:17:04<45:51:01,  7.65s/it]
 43%|████▎     | 16383/37963 [40:17:11<45:48:26,  7.64s/it]
 43%|████▎     | 16384/37963 [40:17:19<46:04:13,  7.69s/it]
 43%|████▎     | 16385/37963 [40:17:27<46:00:00,  7.67s/it]
 43%|████▎     | 16386/37963 [40:17:34<45:57:28,  7.67s/it]
 43%|████▎     | 16387/37963 [40:17:55<69:42:02, 11.63s/it]
 43%|████▎     | 16388/37963 [40:18:03<62:19:44, 10.40s/it]
 43%|████▎     | 16389/37963 [40:18:11<57:18:11,  9.56s/it]
 43%|████▎     | 16390/37963 [40:18:18<54:08:25,  9.03s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '0.964', 'learning_rate': '1.267e-05', 'epoch': '0.4317'}
+
 43%|████▎     | 16390/37963 [40:18:18<54:08:25,  9.03s/it]
 43%|████▎     | 16391/37963 [40:18:26<51:28:58,  8.59s/it]
 43%|████▎     | 16392/37963 [40:18:34<49:54:49,  8.33s/it]
 43%|████▎     | 16393/37963 [40:18:48<61:21:02, 10.24s/it]
 43%|████▎     | 16394/37963 [40:18:56<56:43:44,  9.47s/it]
 43%|████▎     | 16395/37963 [40:19:04<53:45:48,  8.97s/it]
 43%|████▎     | 16396/37963 [40:19:25<75:53:24, 12.67s/it]
 43%|████▎     | 16397/37963 [40:19:40<79:35:15, 13.29s/it]
 43%|████▎     | 16398/37963 [40:19:47<69:23:04, 11.58s/it]
 43%|████▎     | 16399/37963 [40:19:55<62:18:25, 10.40s/it]
 43%|████▎     | 16400/37963 [40:20:03<57:21:38,  9.58s/it]
                                                           
{'loss': '0.162', 'grad_norm': '3.55', 'learning_rate': '1.266e-05', 'epoch': '0.432'}
+
 43%|████▎     | 16400/37963 [40:20:03<57:21:38,  9.58s/it]
 43%|████▎     | 16401/37963 [40:20:10<53:54:43,  9.00s/it]
 43%|████▎     | 16402/37963 [40:20:18<51:17:23,  8.56s/it]
 43%|████▎     | 16403/37963 [40:20:26<49:35:11,  8.28s/it]
 43%|████▎     | 16404/37963 [40:20:33<48:26:10,  8.09s/it]
 43%|████▎     | 16405/37963 [40:20:41<47:59:17,  8.01s/it]
 43%|████▎     | 16406/37963 [40:20:48<46:50:30,  7.82s/it]
 43%|████▎     | 16407/37963 [40:20:56<46:47:40,  7.82s/it]
 43%|████▎     | 16408/37963 [40:21:04<46:35:26,  7.78s/it]
 43%|████▎     | 16409/37963 [40:21:18<58:13:43,  9.73s/it]
 43%|████▎     | 16410/37963 [40:21:26<54:18:57,  9.07s/it]
                                                           
{'loss': '0.1456', 'grad_norm': '1.457', 'learning_rate': '1.265e-05', 'epoch': '0.4323'}
+
 43%|████▎     | 16410/37963 [40:21:26<54:18:57,  9.07s/it]
 43%|████▎     | 16411/37963 [40:21:33<51:35:28,  8.62s/it]
 43%|████▎     | 16412/37963 [40:21:41<50:12:02,  8.39s/it]
 43%|████▎     | 16413/37963 [40:21:49<49:01:55,  8.19s/it]
 43%|████▎     | 16414/37963 [40:22:03<60:34:09, 10.12s/it]
 43%|████▎     | 16415/37963 [40:22:11<55:30:53,  9.27s/it]
 43%|████▎     | 16416/37963 [40:22:19<52:50:54,  8.83s/it]
 43%|████▎     | 16417/37963 [40:22:26<50:56:55,  8.51s/it]
 43%|████▎     | 16418/37963 [40:22:34<49:31:27,  8.28s/it]
 43%|████▎     | 16419/37963 [40:22:42<48:24:29,  8.09s/it]
 43%|████▎     | 16420/37963 [40:22:49<47:51:17,  8.00s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '1.043', 'learning_rate': '1.264e-05', 'epoch': '0.4325'}
+
 43%|████▎     | 16420/37963 [40:22:49<47:51:17,  8.00s/it]
 43%|████▎     | 16421/37963 [40:22:57<47:12:17,  7.89s/it]
 43%|████▎     | 16422/37963 [40:23:05<46:47:19,  7.82s/it]
 43%|████▎     | 16423/37963 [40:23:13<46:51:40,  7.83s/it]
 43%|████▎     | 16424/37963 [40:23:20<46:39:32,  7.80s/it]
 43%|████▎     | 16425/37963 [40:23:28<46:33:30,  7.78s/it]
 43%|████▎     | 16426/37963 [40:23:36<46:19:40,  7.74s/it]
 43%|████▎     | 16427/37963 [40:23:43<45:57:59,  7.68s/it]
 43%|████▎     | 16428/37963 [40:23:51<45:51:11,  7.67s/it]
 43%|████▎     | 16429/37963 [40:23:59<45:44:50,  7.65s/it]
 43%|████▎     | 16430/37963 [40:24:06<45:38:35,  7.63s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '0.6557', 'learning_rate': '1.263e-05', 'epoch': '0.4328'}
+
 43%|████▎     | 16430/37963 [40:24:06<45:38:35,  7.63s/it]
 43%|████▎     | 16431/37963 [40:24:14<45:40:53,  7.64s/it]
 43%|████▎     | 16432/37963 [40:24:21<45:06:41,  7.54s/it]
 43%|████▎     | 16433/37963 [40:24:35<56:44:12,  9.49s/it]
 43%|████▎     | 16434/37963 [40:24:43<53:41:34,  8.98s/it]
 43%|████▎     | 16435/37963 [40:24:51<51:34:11,  8.62s/it]
 43%|████▎     | 16436/37963 [40:24:58<49:49:52,  8.33s/it]
 43%|████▎     | 16437/37963 [40:25:06<48:17:35,  8.08s/it]
 43%|████▎     | 16438/37963 [40:25:13<46:58:46,  7.86s/it]
 43%|████▎     | 16439/37963 [40:25:21<46:45:12,  7.82s/it]
 43%|████▎     | 16440/37963 [40:25:29<46:26:30,  7.77s/it]
                                                           
{'loss': '0.158', 'grad_norm': '1.515', 'learning_rate': '1.262e-05', 'epoch': '0.4331'}
+
 43%|████▎     | 16440/37963 [40:25:29<46:26:30,  7.77s/it]
 43%|████▎     | 16441/37963 [40:25:43<57:56:03,  9.69s/it]
 43%|████▎     | 16442/37963 [40:25:51<54:51:10,  9.18s/it]
 43%|████▎     | 16443/37963 [40:26:05<63:21:51, 10.60s/it]
 43%|████▎     | 16444/37963 [40:26:12<58:11:39,  9.74s/it]
 43%|████▎     | 16445/37963 [40:26:20<54:29:20,  9.12s/it]
 43%|████▎     | 16446/37963 [40:26:35<64:13:26, 10.75s/it]
 43%|████▎     | 16447/37963 [40:26:56<84:04:26, 14.07s/it]
 43%|████▎     | 16448/37963 [40:27:04<72:18:17, 12.10s/it]
 43%|████▎     | 16449/37963 [40:27:12<64:24:19, 10.78s/it]
 43%|████▎     | 16450/37963 [40:27:19<59:01:03,  9.88s/it]
                                                           
{'loss': '0.1498', 'grad_norm': '1.929', 'learning_rate': '1.262e-05', 'epoch': '0.4333'}
+
 43%|████▎     | 16450/37963 [40:27:19<59:01:03,  9.88s/it]
 43%|████▎     | 16451/37963 [40:27:27<54:53:18,  9.19s/it]
 43%|████▎     | 16452/37963 [40:27:35<52:01:04,  8.71s/it]
 43%|████▎     | 16453/37963 [40:27:42<50:23:24,  8.43s/it]
 43%|████▎     | 16454/37963 [40:27:50<49:10:28,  8.23s/it]
 43%|████▎     | 16455/37963 [40:27:58<48:03:33,  8.04s/it]
 43%|████▎     | 16456/37963 [40:28:05<47:17:12,  7.92s/it]
 43%|████▎     | 16457/37963 [40:28:27<71:47:22, 12.02s/it]
 43%|████▎     | 16458/37963 [40:28:34<63:53:58, 10.70s/it]
 43%|████▎     | 16459/37963 [40:28:42<58:48:16,  9.84s/it]
 43%|████▎     | 16460/37963 [40:28:50<54:58:12,  9.20s/it]
                                                           
{'loss': '0.1574', 'grad_norm': '2.602', 'learning_rate': '1.261e-05', 'epoch': '0.4336'}
+
 43%|████▎     | 16460/37963 [40:28:50<54:58:12,  9.20s/it]
 43%|████▎     | 16461/37963 [40:28:58<52:20:30,  8.76s/it]
 43%|████▎     | 16462/37963 [40:29:06<50:28:47,  8.45s/it]
 43%|██���█▎     | 16463/37963 [40:29:13<48:33:26,  8.13s/it]
 43%|████▎     | 16464/37963 [40:29:21<47:43:29,  7.99s/it]
 43%|████▎     | 16465/37963 [40:29:28<47:14:59,  7.91s/it]
 43%|████▎     | 16466/37963 [40:29:36<46:12:49,  7.74s/it]
 43%|████▎     | 16467/37963 [40:29:43<46:17:02,  7.75s/it]
 43%|████▎     | 16468/37963 [40:29:51<45:43:08,  7.66s/it]
 43%|████▎     | 16469/37963 [40:29:59<45:49:13,  7.67s/it]
 43%|████▎     | 16470/37963 [40:30:06<45:52:19,  7.68s/it]
                                                           
{'loss': '0.1683', 'grad_norm': '0.7002', 'learning_rate': '1.26e-05', 'epoch': '0.4338'}
+
 43%|████▎     | 16470/37963 [40:30:06<45:52:19,  7.68s/it]
 43%|████▎     | 16471/37963 [40:30:14<45:38:42,  7.65s/it]
 43%|████▎     | 16472/37963 [40:30:22<45:54:48,  7.69s/it]
 43%|████▎     | 16473/37963 [40:30:29<45:51:10,  7.68s/it]
 43%|████▎     | 16474/37963 [40:30:37<45:45:32,  7.67s/it]
 43%|████▎     | 16475/37963 [40:30:45<45:43:12,  7.66s/it]
 43%|████▎     | 16476/37963 [40:30:52<45:50:45,  7.68s/it]
 43%|████▎     | 16477/37963 [40:31:00<46:04:43,  7.72s/it]
 43%|████▎     | 16478/37963 [40:31:08<45:47:20,  7.67s/it]
 43%|████▎     | 16479/37963 [40:31:15<45:41:32,  7.66s/it]
 43%|████▎     | 16480/37963 [40:31:30<57:37:13,  9.66s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '3.398', 'learning_rate': '1.259e-05', 'epoch': '0.4341'}
+
 43%|████▎     | 16480/37963 [40:31:30<57:37:13,  9.66s/it]
 43%|████▎     | 16481/37963 [40:31:37<54:21:08,  9.11s/it]
 43%|████▎     | 16482/37963 [40:31:45<51:45:38,  8.67s/it]
 43%|████▎     | 16483/37963 [40:31:53<49:42:58,  8.33s/it]
 43%|████▎     | 16484/37963 [40:32:00<48:14:46,  8.09s/it]
 43%|████▎     | 16485/37963 [40:32:08<47:38:04,  7.98s/it]
 43%|████▎     | 16486/37963 [40:32:16<47:19:35,  7.93s/it]
 43%|████▎     | 16487/37963 [40:32:30<58:19:37,  9.78s/it]
 43%|████▎     | 16488/37963 [40:32:38<55:21:10,  9.28s/it]
 43%|████▎     | 16489/37963 [40:32:45<52:08:55,  8.74s/it]
 43%|████▎     | 16490/37963 [40:32:53<50:12:15,  8.42s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '1.485', 'learning_rate': '1.258e-05', 'epoch': '0.4344'}
+
 43%|████▎     | 16490/37963 [40:32:53<50:12:15,  8.42s/it]
 43%|████▎     | 16491/37963 [40:33:01<48:49:18,  8.19s/it]
 43%|████▎     | 16492/37963 [40:33:16<61:03:33, 10.24s/it]
 43%|████▎     | 16493/37963 [40:33:24<57:00:21,  9.56s/it]
 43%|████▎     | 16494/37963 [40:33:31<53:21:03,  8.95s/it]
 43%|████▎     | 16495/37963 [40:33:45<62:52:18, 10.54s/it]
 43%|████▎     | 16496/37963 [40:34:00<70:26:26, 11.81s/it]
 43%|████▎     | 16497/37963 [40:34:08<63:01:04, 10.57s/it]
 43%|████▎     | 16498/37963 [40:34:23<70:58:07, 11.90s/it]
 43%|████▎     | 16499/37963 [40:34:30<63:03:52, 10.58s/it]
 43%|████▎     | 16500/37963 [40:34:45<69:39:50, 11.68s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '2.612', 'learning_rate': '1.257e-05', 'epoch': '0.4346'}
+
 43%|████▎     | 16500/37963 [40:34:45<69:39:50, 11.68s/it]
 43%|████▎     | 16501/37963 [40:34:52<62:32:31, 10.49s/it]
 43%|████▎     | 16502/37963 [40:35:00<57:18:13,  9.61s/it]
 43%|████▎     | 16503/37963 [40:35:08<53:49:56,  9.03s/it]
 43%|████▎     | 16504/37963 [40:35:23<64:41:01, 10.85s/it]
 43%|████▎     | 16505/37963 [40:35:30<58:58:27,  9.89s/it]
 43%|████▎     | 16506/37963 [40:35:38<55:00:15,  9.23s/it]
 43%|████▎     | 16507/37963 [40:35:46<52:19:07,  8.78s/it]
 43%|████▎     | 16508/37963 [40:35:54<50:28:57,  8.47s/it]
 43%|████▎     | 16509/37963 [40:36:01<48:43:23,  8.18s/it]
 43%|████▎     | 16510/37963 [40:36:09<47:45:55,  8.02s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '0.7836', 'learning_rate': '1.257e-05', 'epoch': '0.4349'}
+
 43%|████▎     | 16510/37963 [40:36:09<47:45:55,  8.02s/it]
 43%|████▎     | 16511/37963 [40:36:17<47:28:24,  7.97s/it]
 43%|████▎     | 16512/37963 [40:36:24<46:53:06,  7.87s/it]
 43%|████▎     | 16513/37963 [40:36:32<46:33:43,  7.81s/it]
 44%|████▎     | 16514/37963 [40:36:40<46:22:22,  7.78s/it]
 44%|████▎     | 16515/37963 [40:36:47<46:14:48,  7.76s/it]
 44%|████▎     | 16516/37963 [40:36:55<46:06:04,  7.74s/it]
 44%|████▎     | 16517/37963 [40:37:03<45:58:47,  7.72s/it]
 44%|████▎     | 16518/37963 [40:37:10<45:53:15,  7.70s/it]
 44%|████▎     | 16519/37963 [40:37:18<45:36:33,  7.66s/it]
 44%|████▎     | 16520/37963 [40:37:26<45:37:24,  7.66s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '1.175', 'learning_rate': '1.256e-05', 'epoch': '0.4352'}
+
 44%|████▎     | 16520/37963 [40:37:26<45:37:24,  7.66s/it]
 44%|████▎     | 16521/37963 [40:37:33<45:09:15,  7.58s/it]
 44%|████▎     | 16522/37963 [40:37:41<45:19:15,  7.61s/it]
 44%|████▎     | 16523/37963 [40:37:48<45:36:02,  7.66s/it]
 44%|████▎     | 16524/37963 [40:37:56<45:37:54,  7.66s/it]
 44%|████▎     | 16525/37963 [40:38:04<45:38:36,  7.66s/it]
 44%|████▎     | 16526/37963 [40:38:11<45:16:57,  7.60s/it]
 44%|████▎     | 16527/37963 [40:38:19<45:12:56,  7.59s/it]
 44%|████▎     | 16528/37963 [40:38:26<45:14:06,  7.60s/it]
 44%|████▎     | 16529/37963 [40:38:34<45:27:16,  7.63s/it]
 44%|████▎     | 16530/37963 [40:38:42<45:30:34,  7.64s/it]
                                                           
{'loss': '0.1511', 'grad_norm': '1.41', 'learning_rate': '1.255e-05', 'epoch': '0.4354'}
+
 44%|████▎     | 16530/37963 [40:38:42<45:30:34,  7.64s/it]
 44%|████▎     | 16531/37963 [40:38:56<57:12:12,  9.61s/it]
 44%|████▎     | 16532/37963 [40:39:04<53:48:53,  9.04s/it]
 44%|████▎     | 16533/37963 [40:39:11<51:13:32,  8.61s/it]
 44%|████▎     | 16534/37963 [40:39:25<61:09:09, 10.27s/it]
 44%|████▎     | 16535/37963 [40:39:33<56:30:51,  9.49s/it]
 44%|████▎     | 16536/37963 [40:39:41<53:15:33,  8.95s/it]
 44%|████▎     | 16537/37963 [40:39:48<51:01:01,  8.57s/it]
 44%|████▎     | 16538/37963 [40:39:56<49:31:50,  8.32s/it]
 44%|████▎     | 16539/37963 [40:40:11<61:01:23, 10.25s/it]
 44%|████▎     | 16540/37963 [40:40:19<56:42:18,  9.53s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '1.875', 'learning_rate': '1.254e-05', 'epoch': '0.4357'}
+
 44%|████▎     | 16540/37963 [40:40:19<56:42:18,  9.53s/it]
 44%|████▎     | 16541/37963 [40:40:26<53:22:09,  8.97s/it]
 44%|████▎     | 16542/37963 [40:40:42<64:31:50, 10.85s/it]
 44%|████▎     | 16543/37963 [40:40:49<58:53:55,  9.90s/it]
 44%|████▎     | 16544/37963 [40:41:10<78:11:04, 13.14s/it]
 44%|████▎     | 16545/37963 [40:41:18<68:30:09, 11.51s/it]
 44%|████▎     | 16546/37963 [40:41:25<61:35:13, 10.35s/it]
 44%|████▎     | 16547/37963 [40:41:40<69:31:31, 11.69s/it]
 44%|████▎     | 16548/37963 [40:41:48<62:27:55, 10.50s/it]
 44%|████▎     | 16549/37963 [40:41:56<58:15:08,  9.79s/it]
 44%|████▎     | 16550/37963 [40:42:04<54:31:29,  9.17s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '2.116', 'learning_rate': '1.253e-05', 'epoch': '0.436'}
+
 44%|████▎     | 16550/37963 [40:42:04<54:31:29,  9.17s/it]
 44%|████▎     | 16551/37963 [40:42:18<64:17:38, 10.81s/it]
 44%|████▎     | 16552/37963 [40:42:26<58:25:23,  9.82s/it]
 44%|████▎     | 16553/37963 [40:42:34<54:36:13,  9.18s/it]
 44%|████▎     | 16554/37963 [40:42:41<51:42:19,  8.69s/it]
 44%|████▎     | 16555/37963 [40:42:49<49:53:57,  8.39s/it]
 44%|████▎     | 16556/37963 [40:42:57<48:47:12,  8.20s/it]
 44%|████▎     | 16557/37963 [40:43:04<48:04:37,  8.09s/it]
 44%|████▎     | 16558/37963 [40:43:12<47:20:57,  7.96s/it]
 44%|████▎     | 16559/37963 [40:43:20<47:01:17,  7.91s/it]
 44%|████▎     | 16560/37963 [40:43:28<46:27:50,  7.82s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '0.8396', 'learning_rate': '1.252e-05', 'epoch': '0.4362'}
+
 44%|████▎     | 16560/37963 [40:43:28<46:27:50,  7.82s/it]
 44%|████▎     | 16561/37963 [40:43:35<46:16:15,  7.78s/it]
 44%|████▎     | 16562/37963 [40:43:43<46:12:00,  7.77s/it]
 44%|████▎     | 16563/37963 [40:43:50<45:46:21,  7.70s/it]
 44%|████▎     | 16564/37963 [40:43:58<45:45:01,  7.70s/it]
 44%|████▎     | 16565/37963 [40:44:06<45:30:12,  7.66s/it]
 44%|████▎     | 16566/37963 [40:44:13<45:28:31,  7.65s/it]
 44%|████▎     | 16567/37963 [40:44:21<45:39:36,  7.68s/it]
 44%|████▎     | 16568/37963 [40:44:29<45:21:17,  7.63s/it]
 44%|████▎     | 16569/37963 [40:44:36<45:38:33,  7.68s/it]
 44%|████▎     | 16570/37963 [40:44:44<45:32:54,  7.66s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '1.035', 'learning_rate': '1.252e-05', 'epoch': '0.4365'}
+
 44%|████▎     | 16570/37963 [40:44:44<45:32:54,  7.66s/it]
 44%|████▎     | 16571/37963 [40:44:52<45:10:27,  7.60s/it]
 44%|████▎     | 16572/37963 [40:44:59<44:55:20,  7.56s/it]
 44%|████▎     | 16573/37963 [40:45:07<45:13:15,  7.61s/it]
 44%|████▎     | 16574/37963 [40:45:14<45:20:52,  7.63s/it]
 44%|████▎     | 16575/37963 [40:45:22<45:34:48,  7.67s/it]
 44%|████▎     | 16576/37963 [40:45:37<57:37:14,  9.70s/it]
 44%|████▎     | 16577/37963 [40:45:44<54:01:25,  9.09s/it]
 44%|████▎     | 16578/37963 [40:45:52<50:46:06,  8.55s/it]
 44%|████▎     | 16579/37963 [40:45:59<49:14:00,  8.29s/it]
 44%|████▎     | 16580/37963 [40:46:07<47:39:08,  8.02s/it]
                                                           
{'loss': '0.1582', 'grad_norm': '2.009', 'learning_rate': '1.251e-05', 'epoch': '0.4367'}
+
 44%|████▎     | 16580/37963 [40:46:07<47:39:08,  8.02s/it]
 44%|████▎     | 16581/37963 [40:46:14<47:06:29,  7.93s/it]
 44%|████▎     | 16582/37963 [40:46:22<46:40:34,  7.86s/it]
 44%|████▎     | 16583/37963 [40:46:36<57:55:44,  9.75s/it]
 44%|████▎     | 16584/37963 [40:46:44<54:25:06,  9.16s/it]
 44%|████▎     | 16585/37963 [40:46:52<51:50:50,  8.73s/it]
 44%|████▎     | 16586/37963 [40:46:59<49:38:42,  8.36s/it]
 44%|████▎     | 16587/37963 [40:47:07<48:18:43,  8.14s/it]
 44%|████▎     | 16588/37963 [40:47:21<59:38:06, 10.04s/it]
 44%|████▎     | 16589/37963 [40:47:29<55:07:29,  9.28s/it]
 44%|████▎     | 16590/37963 [40:47:36<51:44:39,  8.72s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '1.212', 'learning_rate': '1.25e-05', 'epoch': '0.437'}
+
 44%|████▎     | 16590/37963 [40:47:36<51:44:39,  8.72s/it]
 44%|████▎     | 16591/37963 [40:47:51<61:59:48, 10.44s/it]
 44%|████▎     | 16592/37963 [40:48:12<80:32:05, 13.57s/it]
 44%|████▎     | 16593/37963 [40:48:19<70:16:51, 11.84s/it]
 44%|████▎     | 16594/37963 [40:48:34<75:06:26, 12.65s/it]
 44%|████▎     | 16595/37963 [40:48:42<66:14:23, 11.16s/it]
 44%|████▎     | 16596/37963 [40:48:49<60:19:15, 10.16s/it]
 44%|████▎     | 16597/37963 [40:48:57<55:43:24,  9.39s/it]
 44%|████▎     | 16598/37963 [40:49:05<52:39:01,  8.87s/it]
 44%|████▎     | 16599/37963 [40:49:12<50:26:37,  8.50s/it]
 44%|████▎     | 16600/37963 [40:49:20<49:05:06,  8.27s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '3.77', 'learning_rate': '1.249e-05', 'epoch': '0.4373'}
+
 44%|████▎     | 16600/37963 [40:49:20<49:05:06,  8.27s/it]
 44%|████▎     | 16601/37963 [40:49:35<60:23:19, 10.18s/it]
 44%|████▎     | 16602/37963 [40:49:43<56:13:43,  9.48s/it]
 44%|████▎     | 16603/37963 [40:49:50<53:00:26,  8.93s/it]
 44%|████▎     | 16604/37963 [40:49:58<50:32:29,  8.52s/it]
 44%|████▎     | 16605/37963 [40:50:05<49:09:14,  8.29s/it]
 44%|████▎     | 16606/37963 [40:50:13<47:56:12,  8.08s/it]
 44%|████▎     | 16607/37963 [40:50:21<47:12:12,  7.96s/it]
 44%|████▎     | 16608/37963 [40:50:28<46:32:02,  7.84s/it]
 44%|████▍     | 16609/37963 [40:50:36<46:01:31,  7.76s/it]
 44%|████▍     | 16610/37963 [40:50:44<46:04:38,  7.77s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '3.936', 'learning_rate': '1.248e-05', 'epoch': '0.4375'}
+
 44%|████▍     | 16610/37963 [40:50:44<46:04:38,  7.77s/it]
 44%|████▍     | 16611/37963 [40:50:51<45:34:37,  7.68s/it]
 44%|████▍     | 16612/37963 [40:50:59<45:50:22,  7.73s/it]
 44%|████▍     | 16613/37963 [40:51:07<45:33:29,  7.68s/it]
 44%|████▍     | 16614/37963 [40:51:14<45:07:01,  7.61s/it]
 44%|████▍     | 16615/37963 [40:51:22<45:26:22,  7.66s/it]
 44%|████▍     | 16616/37963 [40:51:29<45:22:14,  7.65s/it]
 44%|████▍     | 16617/37963 [40:51:37<45:19:51,  7.65s/it]
 44%|████▍     | 16618/37963 [40:51:45<45:14:51,  7.63s/it]
 44%|████▍     | 16619/37963 [40:51:52<45:12:37,  7.63s/it]
 44%|████▍     | 16620/37963 [40:52:00<45:06:19,  7.61s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '0.8056', 'learning_rate': '1.248e-05', 'epoch': '0.4378'}
+
 44%|████▍     | 16620/37963 [40:52:00<45:06:19,  7.61s/it]
 44%|████▍     | 16621/37963 [40:52:07<44:52:16,  7.57s/it]
 44%|████▍     | 16622/37963 [40:52:15<44:52:35,  7.57s/it]
 44%|████▍     | 16623/37963 [40:52:23<45:10:18,  7.62s/it]
 44%|████▍     | 16624/37963 [40:52:30<45:12:07,  7.63s/it]
 44%|████▍     | 16625/37963 [40:52:38<45:01:13,  7.60s/it]
 44%|████▍     | 16626/37963 [40:52:45<45:13:15,  7.63s/it]
 44%|████▍     | 16627/37963 [40:52:53<44:51:59,  7.57s/it]
 44%|████▍     | 16628/37963 [40:53:01<44:57:38,  7.59s/it]
 44%|████▍     | 16629/37963 [40:53:08<45:03:22,  7.60s/it]
 44%|████▍     | 16630/37963 [40:53:22<56:57:51,  9.61s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '1.808', 'learning_rate': '1.247e-05', 'epoch': '0.4381'}
+
 44%|████▍     | 16630/37963 [40:53:23<56:57:51,  9.61s/it]
 44%|████▍     | 16631/37963 [40:53:30<53:30:13,  9.03s/it]
 44%|████▍     | 16632/37963 [40:53:38<51:02:17,  8.61s/it]
 44%|████▍     | 16633/37963 [40:53:45<49:18:08,  8.32s/it]
 44%|████▍     | 16634/37963 [40:53:53<48:05:38,  8.12s/it]
 44%|████▍     | 16635/37963 [40:54:07<58:50:23,  9.93s/it]
 44%|████▍     | 16636/37963 [40:54:15<54:28:46,  9.20s/it]
 44%|████▍     | 16637/37963 [40:54:36<76:20:44, 12.89s/it]
 44%|████▍     | 16638/37963 [40:54:44<67:07:58, 11.33s/it]
 44%|████▍     | 16639/37963 [40:54:52<60:47:51, 10.26s/it]
 44%|████▍     | 16640/37963 [40:54:59<56:14:25,  9.50s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '2.032', 'learning_rate': '1.246e-05', 'epoch': '0.4383'}
+
 44%|████▍     | 16640/37963 [40:54:59<56:14:25,  9.50s/it]
 44%|████▍     | 16641/37963 [40:55:14<65:21:28, 11.03s/it]
 44%|████▍     | 16642/37963 [40:55:29<71:32:29, 12.08s/it]
 44%|████▍     | 16643/37963 [40:55:36<63:55:27, 10.79s/it]
 44%|████▍     | 16644/37963 [40:55:44<57:59:05,  9.79s/it]
 44%|████▍     | 16645/37963 [40:55:51<54:06:16,  9.14s/it]
 44%|████▍     | 16646/37963 [40:55:59<51:26:50,  8.69s/it]
 44%|████▍     | 16647/37963 [40:56:07<49:34:00,  8.37s/it]
 44%|████▍     | 16648/37963 [40:56:14<48:08:50,  8.13s/it]
 44%|████▍     | 16649/37963 [40:56:22<47:18:27,  7.99s/it]
 44%|████▍     | 16650/37963 [40:56:29<46:33:02,  7.86s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '0.9354', 'learning_rate': '1.245e-05', 'epoch': '0.4386'}
+
 44%|████▍     | 16650/37963 [40:56:29<46:33:02,  7.86s/it]
 44%|████▍     | 16651/37963 [40:56:37<46:06:13,  7.79s/it]
 44%|████▍     | 16652/37963 [40:56:45<45:48:29,  7.74s/it]
 44%|████▍     | 16653/37963 [40:56:53<45:53:38,  7.75s/it]
 44%|████▍     | 16654/37963 [40:57:07<58:39:56,  9.91s/it]
 44%|████▍     | 16655/37963 [40:57:15<54:55:06,  9.28s/it]
 44%|████▍     | 16656/37963 [40:57:23<51:46:59,  8.75s/it]
 44%|████▍     | 16657/37963 [40:57:30<49:53:27,  8.43s/it]
 44%|████▍     | 16658/37963 [40:57:38<48:27:55,  8.19s/it]
 44%|████▍     | 16659/37963 [40:57:46<47:34:03,  8.04s/it]
 44%|████▍     | 16660/37963 [40:57:53<46:40:37,  7.89s/it]
                                                           
{'loss': '0.1648', 'grad_norm': '1.175', 'learning_rate': '1.244e-05', 'epoch': '0.4388'}
+
 44%|████▍     | 16660/37963 [40:57:53<46:40:37,  7.89s/it]
 44%|████▍     | 16661/37963 [40:58:01<45:57:18,  7.77s/it]
 44%|████▍     | 16662/37963 [40:58:08<45:44:04,  7.73s/it]
 44%|████▍     | 16663/37963 [40:58:16<45:19:41,  7.66s/it]
 44%|████▍     | 16664/37963 [40:58:24<45:19:32,  7.66s/it]
 44%|████▍     | 16665/37963 [40:58:31<45:15:46,  7.65s/it]
 44%|████▍     | 16666/37963 [40:58:39<45:05:24,  7.62s/it]
 44%|████▍     | 16667/37963 [40:58:47<45:18:54,  7.66s/it]
 44%|████▍     | 16668/37963 [40:58:54<45:15:02,  7.65s/it]
 44%|████▍     | 16669/37963 [40:59:02<45:15:32,  7.65s/it]
 44%|████▍     | 16670/37963 [40:59:09<45:01:59,  7.61s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '2.551', 'learning_rate': '1.243e-05', 'epoch': '0.4391'}
+
 44%|████▍     | 16670/37963 [40:59:09<45:01:59,  7.61s/it]
 44%|████▍     | 16671/37963 [40:59:17<45:23:38,  7.68s/it]
 44%|████▍     | 16672/37963 [40:59:25<45:24:11,  7.68s/it]
 44%|████▍     | 16673/37963 [40:59:32<45:22:43,  7.67s/it]
 44%|████▍     | 16674/37963 [40:59:40<45:09:22,  7.64s/it]
 44%|████▍     | 16675/37963 [40:59:48<45:16:12,  7.66s/it]
 44%|████▍     | 16676/37963 [40:59:55<45:10:25,  7.64s/it]
 44%|████▍     | 16677/37963 [41:00:03<45:10:54,  7.64s/it]
 44%|████▍     | 16678/37963 [41:00:11<45:17:41,  7.66s/it]
 44%|████▍     | 16679/37963 [41:00:18<45:26:53,  7.69s/it]
 44%|████▍     | 16680/37963 [41:00:32<56:31:05,  9.56s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '1.636', 'learning_rate': '1.243e-05', 'epoch': '0.4394'}
+
 44%|████▍     | 16680/37963 [41:00:32<56:31:05,  9.56s/it]
 44%|████▍     | 16681/37963 [41:00:47<65:13:27, 11.03s/it]
 44%|████▍     | 16682/37963 [41:00:55<59:22:36, 10.04s/it]
 44%|████▍     | 16683/37963 [41:01:02<55:07:24,  9.33s/it]
 44%|████▍     | 16684/37963 [41:01:10<52:04:01,  8.81s/it]
 44%|████▍     | 16685/37963 [41:01:17<49:58:07,  8.45s/it]
 44%|████▍     | 16686/37963 [41:01:32<60:46:32, 10.28s/it]
 44%|████▍     | 16687/37963 [41:01:40<56:04:49,  9.49s/it]
 44%|████▍     | 16688/37963 [41:01:47<53:05:05,  8.98s/it]
 44%|████▍     | 16689/37963 [41:02:02<62:53:02, 10.64s/it]
 44%|████▍     | 16690/37963 [41:02:09<57:17:34,  9.70s/it]
                                                           
{'loss': '0.1527', 'grad_norm': '1.786', 'learning_rate': '1.242e-05', 'epoch': '0.4396'}
+
 44%|████▍     | 16690/37963 [41:02:09<57:17:34,  9.70s/it]
 44%|████▍     | 16691/37963 [41:02:31<78:33:04, 13.29s/it]
 44%|████▍     | 16692/37963 [41:02:39<68:31:16, 11.60s/it]
 44%|████▍     | 16693/37963 [41:02:47<61:48:50, 10.46s/it]
 44%|████▍     | 16694/37963 [41:02:54<56:21:21,  9.54s/it]
 44%|████▍     | 16695/37963 [41:03:02<53:03:42,  8.98s/it]
 44%|████▍     | 16696/37963 [41:03:16<63:24:49, 10.73s/it]
 44%|████▍     | 16697/37963 [41:03:24<57:35:12,  9.75s/it]
 44%|████▍     | 16698/37963 [41:03:32<53:54:16,  9.13s/it]
 44%|████▍     | 16699/37963 [41:03:39<51:11:55,  8.67s/it]
 44%|████▍     | 16700/37963 [41:03:47<49:37:49,  8.40s/it]
                                                           
{'loss': '0.1453', 'grad_norm': '2.207', 'learning_rate': '1.241e-05', 'epoch': '0.4399'}
+
 44%|████▍     | 16700/37963 [41:03:47<49:37:49,  8.40s/it]
 44%|████▍     | 16701/37963 [41:03:55<48:20:50,  8.19s/it]
 44%|████▍     | 16702/37963 [41:04:09<59:17:06, 10.04s/it]
 44%|████▍     | 16703/37963 [41:04:17<55:39:14,  9.42s/it]
 44%|████▍     | 16704/37963 [41:04:25<52:50:37,  8.95s/it]
 44%|████▍     | 16705/37963 [41:04:33<50:39:17,  8.58s/it]
 44%|████▍     | 16706/37963 [41:04:40<48:51:22,  8.27s/it]
 44%|████▍     | 16707/37963 [41:04:48<48:11:38,  8.16s/it]
 44%|████▍     | 16708/37963 [41:04:56<47:10:34,  7.99s/it]
 44%|████▍     | 16709/37963 [41:05:03<46:40:18,  7.91s/it]
 44%|████▍     | 16710/37963 [41:05:11<46:13:35,  7.83s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '2.546', 'learning_rate': '1.24e-05', 'epoch': '0.4402'}
+
 44%|████▍     | 16710/37963 [41:05:11<46:13:35,  7.83s/it]
 44%|████▍     | 16711/37963 [41:05:19<45:49:57,  7.76s/it]
 44%|████▍     | 16712/37963 [41:05:26<45:39:35,  7.73s/it]
 44%|████▍     | 16713/37963 [41:05:34<45:15:16,  7.67s/it]
 44%|████▍     | 16714/37963 [41:05:41<45:13:48,  7.66s/it]
 44%|████▍     | 16715/37963 [41:05:49<45:06:06,  7.64s/it]
 44%|████▍     | 16716/37963 [41:05:57<44:48:40,  7.59s/it]
 44%|████▍     | 16717/37963 [41:06:04<44:43:28,  7.58s/it]
 44%|████▍     | 16718/37963 [41:06:11<44:24:53,  7.53s/it]
 44%|████▍     | 16719/37963 [41:06:19<44:46:28,  7.59s/it]
 44%|████▍     | 16720/37963 [41:06:27<44:34:52,  7.56s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '3.385', 'learning_rate': '1.239e-05', 'epoch': '0.4404'}
+
 44%|████▍     | 16720/37963 [41:06:27<44:34:52,  7.56s/it]
 44%|████▍     | 16721/37963 [41:06:34<44:43:24,  7.58s/it]
 44%|████▍     | 16722/37963 [41:06:42<44:56:28,  7.62s/it]
 44%|████▍     | 16723/37963 [41:06:50<44:48:32,  7.59s/it]
 44%|████▍     | 16724/37963 [41:06:57<44:17:00,  7.51s/it]
 44%|████▍     | 16725/37963 [41:07:05<44:38:57,  7.57s/it]
 44%|████▍     | 16726/37963 [41:07:12<44:43:13,  7.58s/it]
 44%|████▍     | 16727/37963 [41:07:20<45:06:09,  7.65s/it]
 44%|████▍     | 16728/37963 [41:07:41<68:15:31, 11.57s/it]
 44%|████▍     | 16729/37963 [41:07:49<61:47:55, 10.48s/it]
 44%|████▍     | 16730/37963 [41:08:04<69:56:14, 11.86s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '1.127', 'learning_rate': '1.238e-05', 'epoch': '0.4407'}
+
 44%|████▍     | 16730/37963 [41:08:04<69:56:14, 11.86s/it]
 44%|████▍     | 16731/37963 [41:08:11<62:32:40, 10.60s/it]
 44%|████▍     | 16732/37963 [41:08:19<57:28:27,  9.75s/it]
 44%|████▍     | 16733/37963 [41:08:34<65:41:52, 11.14s/it]
 44%|████▍     | 16734/37963 [41:08:41<59:44:19, 10.13s/it]
 44%|████▍     | 16735/37963 [41:08:49<55:17:59,  9.38s/it]
 44%|████▍     | 16736/37963 [41:08:57<52:35:49,  8.92s/it]
 44%|████▍     | 16737/37963 [41:09:04<50:26:25,  8.55s/it]
 44%|████▍     | 16738/37963 [41:09:12<49:01:58,  8.32s/it]
 44%|████▍     | 16739/37963 [41:09:20<48:02:30,  8.15s/it]
 44%|████▍     | 16740/37963 [41:09:34<58:46:58,  9.97s/it]
                                                           
{'loss': '0.1665', 'grad_norm': '1.527', 'learning_rate': '1.238e-05', 'epoch': '0.441'}
+
 44%|█���██▍     | 16740/37963 [41:09:34<58:46:58,  9.97s/it]
 44%|████▍     | 16741/37963 [41:09:42<54:41:21,  9.28s/it]
 44%|████▍     | 16742/37963 [41:09:50<51:57:49,  8.82s/it]
 44%|████▍     | 16743/37963 [41:09:57<49:53:31,  8.46s/it]
 44%|████▍     | 16744/37963 [41:10:05<48:21:48,  8.21s/it]
 44%|████▍     | 16745/37963 [41:10:20<60:27:39, 10.26s/it]
 44%|████▍     | 16746/37963 [41:10:28<55:49:15,  9.47s/it]
 44%|████▍     | 16747/37963 [41:10:35<52:12:46,  8.86s/it]
 44%|████▍     | 16748/37963 [41:10:43<50:12:16,  8.52s/it]
 44%|████▍     | 16749/37963 [41:10:50<48:46:36,  8.28s/it]
 44%|████▍     | 16750/37963 [41:11:05<59:52:09, 10.16s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '2.406', 'learning_rate': '1.237e-05', 'epoch': '0.4412'}
+
 44%|████▍     | 16750/37963 [41:11:05<59:52:09, 10.16s/it]
 44%|████▍     | 16751/37963 [41:11:13<55:40:02,  9.45s/it]
 44%|████▍     | 16752/37963 [41:11:28<65:17:59, 11.08s/it]
 44%|████▍     | 16753/37963 [41:11:35<59:16:13, 10.06s/it]
 44%|████▍     | 16754/37963 [41:11:43<55:00:38,  9.34s/it]
 44%|████▍     | 16755/37963 [41:11:51<52:10:03,  8.86s/it]
 44%|████▍     | 16756/37963 [41:11:59<50:26:07,  8.56s/it]
 44%|████▍     | 16757/37963 [41:12:06<48:45:48,  8.28s/it]
 44%|████▍     | 16758/37963 [41:12:14<47:36:41,  8.08s/it]
 44%|████▍     | 16759/37963 [41:12:22<47:13:26,  8.02s/it]
 44%|████▍     | 16760/37963 [41:12:29<46:51:02,  7.95s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '3.814', 'learning_rate': '1.236e-05', 'epoch': '0.4415'}
+
 44%|████▍     | 16760/37963 [41:12:29<46:51:02,  7.95s/it]
 44%|████▍     | 16761/37963 [41:12:37<46:23:58,  7.88s/it]
 44%|████▍     | 16762/37963 [41:12:45<45:56:28,  7.80s/it]
 44%|████▍     | 16763/37963 [41:12:52<45:43:39,  7.77s/it]
 44%|████▍     | 16764/37963 [41:13:00<45:31:17,  7.73s/it]
 44%|████▍     | 16765/37963 [41:13:08<45:26:42,  7.72s/it]
 44%|████▍     | 16766/37963 [41:13:15<45:20:36,  7.70s/it]
 44%|████▍     | 16767/37963 [41:13:23<45:29:37,  7.73s/it]
 44%|████▍     | 16768/37963 [41:13:31<45:19:10,  7.70s/it]
 44%|████▍     | 16769/37963 [41:13:39<45:29:12,  7.73s/it]
 44%|████▍     | 16770/37963 [41:13:46<45:30:24,  7.73s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '2.133', 'learning_rate': '1.235e-05', 'epoch': '0.4417'}
+
 44%|████▍     | 16770/37963 [41:13:46<45:30:24,  7.73s/it]
 44%|████▍     | 16771/37963 [41:13:54<45:11:40,  7.68s/it]
 44%|████▍     | 16772/37963 [41:14:02<45:07:36,  7.67s/it]
 44%|████▍     | 16773/37963 [41:14:09<45:06:16,  7.66s/it]
 44%|████▍     | 16774/37963 [41:14:17<45:08:19,  7.67s/it]
 44%|████▍     | 16775/37963 [41:14:25<45:04:00,  7.66s/it]
 44%|████▍     | 16776/37963 [41:14:32<45:01:18,  7.65s/it]
 44%|████▍     | 16777/37963 [41:14:40<45:02:36,  7.65s/it]
 44%|████▍     | 16778/37963 [41:15:01<68:53:11, 11.71s/it]
 44%|████▍     | 16779/37963 [41:15:16<73:52:38, 12.55s/it]
 44%|████▍     | 16780/37963 [41:15:23<65:06:17, 11.06s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '2.344', 'learning_rate': '1.234e-05', 'epoch': '0.442'}
+
 44%|████▍     | 16780/37963 [41:15:23<65:06:17, 11.06s/it]
 44%|████▍     | 16781/37963 [41:15:31<59:10:18, 10.06s/it]
 44%|████▍     | 16782/37963 [41:15:45<66:37:28, 11.32s/it]
 44%|████▍     | 16783/37963 [41:15:53<60:31:13, 10.29s/it]
 44%|████▍     | 16784/37963 [41:16:01<55:55:07,  9.51s/it]
 44%|████▍     | 16785/37963 [41:16:08<52:45:52,  8.97s/it]
 44%|████▍     | 16786/37963 [41:16:16<49:55:31,  8.49s/it]
 44%|████▍     | 16787/37963 [41:16:23<48:14:48,  8.20s/it]
 44%|████▍     | 16788/37963 [41:16:37<58:34:25,  9.96s/it]
 44%|████▍     | 16789/37963 [41:16:45<54:35:28,  9.28s/it]
 44%|████▍     | 16790/37963 [41:16:53<51:59:01,  8.84s/it]
                                                           
{'loss': '0.149', 'grad_norm': '1.56', 'learning_rate': '1.233e-05', 'epoch': '0.4423'}
+
 44%|████▍     | 16790/37963 [41:16:53<51:59:01,  8.84s/it]
 44%|████▍     | 16791/37963 [41:17:01<49:53:44,  8.48s/it]
 44%|████▍     | 16792/37963 [41:17:08<48:20:30,  8.22s/it]
 44%|████▍     | 16793/37963 [41:17:16<47:30:41,  8.08s/it]
 44%|████▍     | 16794/37963 [41:17:24<46:58:29,  7.99s/it]
 44%|████▍     | 16795/37963 [41:17:31<46:21:02,  7.88s/it]
 44%|████▍     | 16796/37963 [41:17:46<58:29:18,  9.95s/it]
 44%|████▍     | 16797/37963 [41:17:54<54:39:44,  9.30s/it]
 44%|████▍     | 16798/37963 [41:18:01<51:40:03,  8.79s/it]
 44%|████▍     | 16799/37963 [41:18:09<49:32:38,  8.43s/it]
 44%|████▍     | 16800/37963 [41:18:24<60:57:27, 10.37s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '2', 'learning_rate': '1.233e-05', 'epoch': '0.4425'}
+
 44%|████▍     | 16800/37963 [41:18:24<60:57:27, 10.37s/it]
 44%|████▍     | 16801/37963 [41:18:32<56:13:15,  9.56s/it]
 44%|████▍     | 16802/37963 [41:18:39<52:44:54,  8.97s/it]
 44%|████▍     | 16803/37963 [41:18:47<50:24:30,  8.58s/it]
 44%|████▍     | 16804/37963 [41:19:02<61:21:35, 10.44s/it]
 44%|████▍     | 16805/37963 [41:19:10<56:47:24,  9.66s/it]
 44%|████▍     | 16806/37963 [41:19:17<53:32:24,  9.11s/it]
 44%|████▍     | 16807/37963 [41:19:25<50:45:24,  8.64s/it]
 44%|████▍     | 16808/37963 [41:19:32<48:49:26,  8.31s/it]
 44%|████▍     | 16809/37963 [41:19:40<47:38:28,  8.11s/it]
 44%|████▍     | 16810/37963 [41:19:48<46:55:27,  7.99s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '3.508', 'learning_rate': '1.232e-05', 'epoch': '0.4428'}
+
 44%|████▍     | 16810/37963 [41:19:48<46:55:27,  7.99s/it]
 44%|████▍     | 16811/37963 [41:19:56<46:35:33,  7.93s/it]
 44%|████▍     | 16812/37963 [41:20:03<45:47:18,  7.79s/it]
 44%|████▍     | 16813/37963 [41:20:11<45:30:46,  7.75s/it]
 44%|████▍     | 16814/37963 [41:20:18<45:03:52,  7.67s/it]
 44%|████▍     | 16815/37963 [41:20:26<45:07:17,  7.68s/it]
 44%|████▍     | 16816/37963 [41:20:34<45:06:25,  7.68s/it]
 44%|████▍     | 16817/37963 [41:20:41<45:06:47,  7.68s/it]
 44%|████▍     | 16818/37963 [41:20:49<44:44:14,  7.62s/it]
 44%|████▍     | 16819/37963 [41:20:56<44:49:03,  7.63s/it]
 44%|████▍     | 16820/37963 [41:21:04<44:34:44,  7.59s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '1.558', 'learning_rate': '1.231e-05', 'epoch': '0.4431'}
+
 44%|████▍     | 16820/37963 [41:21:04<44:34:44,  7.59s/it]
 44%|████▍     | 16821/37963 [41:21:12<44:44:31,  7.62s/it]
 44%|████▍     | 16822/37963 [41:21:19<44:46:31,  7.62s/it]
 44%|████▍     | 16823/37963 [41:21:27<44:56:59,  7.65s/it]
 44%|████▍     | 16824/37963 [41:21:34<44:34:09,  7.59s/it]
 44%|████▍     | 16825/37963 [41:21:42<44:23:29,  7.56s/it]
 44%|████▍     | 16826/37963 [41:21:49<44:29:05,  7.58s/it]
 44%|████▍     | 16827/37963 [41:22:03<55:30:27,  9.45s/it]
 44%|████▍     | 16828/37963 [41:22:11<52:23:09,  8.92s/it]
 44%|████▍     | 16829/37963 [41:22:19<50:07:53,  8.54s/it]
 44%|████▍     | 16830/37963 [41:22:40<72:35:44, 12.37s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '1.167', 'learning_rate': '1.23e-05', 'epoch': '0.4433'}
+
 44%|████▍     | 16830/37963 [41:22:40<72:35:44, 12.37s/it]
 44%|████▍     | 16831/37963 [41:22:54<76:02:31, 12.95s/it]
 44%|████▍     | 16832/37963 [41:23:02<66:58:25, 11.41s/it]
 44%|████▍     | 16833/37963 [41:23:10<60:27:20, 10.30s/it]
 44%|████▍     | 16834/37963 [41:23:18<56:00:23,  9.54s/it]
 44%|████▍     | 16835/37963 [41:23:25<52:56:58,  9.02s/it]
 44%|████▍     | 16836/37963 [41:23:40<62:19:17, 10.62s/it]
 44%|████▍     | 16837/37963 [41:23:47<57:13:36,  9.75s/it]
 44%|████▍     | 16838/37963 [41:23:55<53:50:37,  9.18s/it]
 44%|████▍     | 16839/37963 [41:24:03<51:06:54,  8.71s/it]
 44%|████▍     | 16840/37963 [41:24:10<49:08:29,  8.38s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '2.24', 'learning_rate': '1.229e-05', 'epoch': '0.4436'}
+
 44%|████▍     | 16840/37963 [41:24:10<49:08:29,  8.38s/it]
 44%|████▍     | 16841/37963 [41:24:25<60:38:04, 10.33s/it]
 44%|████▍     | 16842/37963 [41:24:33<55:46:50,  9.51s/it]
 44%|████▍     | 16843/37963 [41:24:41<52:36:58,  8.97s/it]
 44%|████▍     | 16844/37963 [41:24:48<50:18:56,  8.58s/it]
 44%|████▍     | 16845/37963 [41:24:56<48:32:25,  8.27s/it]
 44%|████▍     | 16846/37963 [41:25:04<47:28:18,  8.09s/it]
 44%|████▍     | 16847/37963 [41:25:11<46:43:26,  7.97s/it]
 44%|████▍     | 16848/37963 [41:25:26<59:28:55, 10.14s/it]
 44%|████▍     | 16849/37963 [41:25:34<55:26:21,  9.45s/it]
 44%|████▍     | 16850/37963 [41:25:49<64:03:27, 10.92s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '0.7602', 'learning_rate': '1.228e-05', 'epoch': '0.4439'}
+
 44%|████▍     | 16850/37963 [41:25:49<64:03:27, 10.92s/it]
 44%|████▍     | 16851/37963 [41:25:56<57:44:25,  9.85s/it]
 44%|████▍     | 16852/37963 [41:26:04<53:54:15,  9.19s/it]
 44%|████▍     | 16853/37963 [41:26:11<50:45:57,  8.66s/it]
 44%|████▍     | 16854/37963 [41:26:19<48:52:02,  8.33s/it]
 44%|████▍     | 16855/37963 [41:26:26<46:57:45,  8.01s/it]
 44%|████▍     | 16856/37963 [41:26:34<46:44:32,  7.97s/it]
 44%|████▍     | 16857/37963 [41:26:41<46:19:09,  7.90s/it]
 44%|████▍     | 16858/37963 [41:26:49<46:00:27,  7.85s/it]
 44%|████▍     | 16859/37963 [41:26:57<45:38:05,  7.78s/it]
 44%|████▍     | 16860/37963 [41:27:05<45:27:50,  7.76s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '2.533', 'learning_rate': '1.228e-05', 'epoch': '0.4441'}
+
 44%|████▍     | 16860/37963 [41:27:05<45:27:50,  7.76s/it]
 44%|████▍     | 16861/37963 [41:27:12<44:49:22,  7.65s/it]
 44%|████▍     | 16862/37963 [41:27:20<45:02:11,  7.68s/it]
 44%|████▍     | 16863/37963 [41:27:27<44:55:10,  7.66s/it]
 44%|████▍     | 16864/37963 [41:27:35<44:43:14,  7.63s/it]
 44%|████▍     | 16865/37963 [41:27:42<44:15:28,  7.55s/it]
 44%|████▍     | 16866/37963 [41:27:50<44:08:14,  7.53s/it]
 44%|████▍     | 16867/37963 [41:27:57<44:01:35,  7.51s/it]
 44%|████▍     | 16868/37963 [41:28:05<43:55:15,  7.50s/it]
 44%|████▍     | 16869/37963 [41:28:12<43:53:20,  7.49s/it]
 44%|████▍     | 16870/37963 [41:28:20<44:12:07,  7.54s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '2.81', 'learning_rate': '1.227e-05', 'epoch': '0.4444'}
+
 44%|████▍     | 16870/37963 [41:28:20<44:12:07,  7.54s/it]
 44%|████▍     | 16871/37963 [41:28:28<44:33:30,  7.61s/it]
 44%|████▍     | 16872/37963 [41:28:35<44:34:12,  7.61s/it]
 44%|████▍     | 16873/37963 [41:28:43<44:56:20,  7.67s/it]
 44%|████▍     | 16874/37963 [41:28:51<44:58:46,  7.68s/it]
 44%|████▍     | 16875/37963 [41:29:05<57:01:53,  9.74s/it]
 44%|████▍     | 16876/37963 [41:29:19<64:38:17, 11.04s/it]
 44%|████▍     | 16877/37963 [41:29:34<71:01:22, 12.13s/it]
 44%|████▍     | 16878/37963 [41:29:42<63:09:28, 10.78s/it]
 44%|████▍     | 16879/37963 [41:29:49<57:54:48,  9.89s/it]
 44%|████▍     | 16880/37963 [41:29:57<53:42:08,  9.17s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '1.743', 'learning_rate': '1.226e-05', 'epoch': '0.4446'}
+
 44%|████▍     | 16880/37963 [41:29:57<53:42:08,  9.17s/it]
 44%|████▍     | 16881/37963 [41:30:05<51:01:43,  8.71s/it]
 44%|████▍     | 16882/37963 [41:30:19<61:28:45, 10.50s/it]
 44%|████▍     | 16883/37963 [41:30:27<56:55:04,  9.72s/it]
 44%|████▍     | 16884/37963 [41:30:35<53:23:55,  9.12s/it]
 44%|████▍     | 16885/37963 [41:30:49<62:18:51, 10.64s/it]
 44%|████▍     | 16886/37963 [41:30:57<56:57:50,  9.73s/it]
 44%|████▍     | 16887/37963 [41:31:04<52:58:13,  9.05s/it]
 44%|████▍     | 16888/37963 [41:31:12<50:45:51,  8.67s/it]
 44%|████▍     | 16889/37963 [41:31:20<49:06:17,  8.39s/it]
 44%|████▍     | 16890/37963 [41:31:27<47:39:48,  8.14s/it]
                                                           
{'loss': '0.152', 'grad_norm': '2.815', 'learning_rate': '1.225e-05', 'epoch': '0.4449'}
+
 44%|████▍     | 16890/37963 [41:31:27<47:39:48,  8.14s/it]
 44%|████▍     | 16891/37963 [41:31:35<46:45:26,  7.99s/it]
 44%|████▍     | 16892/37963 [41:31:43<46:16:39,  7.91s/it]
 44%|████▍     | 16893/37963 [41:31:50<45:53:05,  7.84s/it]
 45%|████▍     | 16894/37963 [41:32:05<58:40:14, 10.02s/it]
 45%|████▍     | 16895/37963 [41:32:13<54:13:54,  9.27s/it]
 45%|████▍     | 16896/37963 [41:32:28<64:42:09, 11.06s/it]
 45%|████▍     | 16897/37963 [41:32:36<58:45:09, 10.04s/it]
 45%|████▍     | 16898/37963 [41:32:43<54:30:16,  9.31s/it]
 45%|████▍     | 16899/37963 [41:32:58<64:21:42, 11.00s/it]
 45%|████▍     | 16900/37963 [41:33:06<58:28:46, 10.00s/it]
                                                           
{'loss': '0.147', 'grad_norm': '1.048', 'learning_rate': '1.224e-05', 'epoch': '0.4452'}
+
 45%|████▍     | 16900/37963 [41:33:06<58:28:46, 10.00s/it]
 45%|████▍     | 16901/37963 [41:33:14<54:24:20,  9.30s/it]
 45%|████▍     | 16902/37963 [41:33:21<51:48:06,  8.85s/it]
 45%|████▍     | 16903/37963 [41:33:29<49:39:41,  8.49s/it]
 45%|████▍     | 16904/37963 [41:33:37<48:23:59,  8.27s/it]
 45%|████▍     | 16905/37963 [41:33:44<47:11:40,  8.07s/it]
 45%|████▍     | 16906/37963 [41:33:52<46:27:27,  7.94s/it]
 45%|████▍     | 16907/37963 [41:34:00<45:39:40,  7.81s/it]
 45%|████▍     | 16908/37963 [41:34:07<45:20:38,  7.75s/it]
 45%|████▍     | 16909/37963 [41:34:15<45:12:14,  7.73s/it]
 45%|████▍     | 16910/37963 [41:34:22<44:54:22,  7.68s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '1.829', 'learning_rate': '1.223e-05', 'epoch': '0.4454'}
+
 45%|████▍     | 16910/37963 [41:34:22<44:54:22,  7.68s/it]
 45%|████▍     | 16911/37963 [41:34:30<44:56:43,  7.69s/it]
 45%|████▍     | 16912/37963 [41:34:38<44:50:57,  7.67s/it]
 45%|████▍     | 16913/37963 [41:34:45<44:46:17,  7.66s/it]
 45%|████▍     | 16914/37963 [41:34:53<44:35:35,  7.63s/it]
 45%|████▍     | 16915/37963 [41:35:01<44:39:03,  7.64s/it]
 45%|████▍     | 16916/37963 [41:35:08<44:36:01,  7.63s/it]
 45%|████▍     | 16917/37963 [41:35:16<44:52:33,  7.68s/it]
 45%|████▍     | 16918/37963 [41:35:24<45:27:01,  7.77s/it]
 45%|████▍     | 16919/37963 [41:35:32<45:13:46,  7.74s/it]
 45%|████▍     | 16920/37963 [41:35:39<45:19:36,  7.75s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '1.776', 'learning_rate': '1.223e-05', 'epoch': '0.4457'}
+
 45%|████▍     | 16920/37963 [41:35:39<45:19:36,  7.75s/it]
 45%|████▍     | 16921/37963 [41:35:47<45:17:19,  7.75s/it]
 45%|████▍     | 16922/37963 [41:35:55<45:12:27,  7.73s/it]
 45%|████▍     | 16923/37963 [41:36:03<44:59:25,  7.70s/it]
 45%|████▍     | 16924/37963 [41:36:10<44:54:53,  7.69s/it]
 45%|████▍     | 16925/37963 [41:36:25<57:29:34,  9.84s/it]
 45%|████▍     | 16926/37963 [41:36:33<53:40:05,  9.18s/it]
 45%|████▍     | 16927/37963 [41:36:40<51:11:38,  8.76s/it]
 45%|████▍     | 16928/37963 [41:36:55<60:45:09, 10.40s/it]
 45%|████▍     | 16929/37963 [41:37:09<67:52:12, 11.62s/it]
 45%|████▍     | 16930/37963 [41:37:17<61:13:24, 10.48s/it]
                                                           
{'loss': '0.142', 'grad_norm': '1.406', 'learning_rate': '1.222e-05', 'epoch': '0.446'}
+
 45%|████▍     | 16930/37963 [41:37:17<61:13:24, 10.48s/it]
 45%|████▍     | 16931/37963 [41:37:25<56:16:25,  9.63s/it]
 45%|████▍     | 16932/37963 [41:37:39<64:19:41, 11.01s/it]
 45%|████▍     | 16933/37963 [41:37:46<58:26:23, 10.00s/it]
 45%|████▍     | 16934/37963 [41:38:01<65:51:31, 11.27s/it]
 45%|████▍     | 16935/37963 [41:38:08<59:29:52, 10.19s/it]
 45%|████▍     | 16936/37963 [41:38:16<55:01:04,  9.42s/it]
 45%|████▍     | 16937/37963 [41:38:24<51:55:00,  8.89s/it]
 45%|████▍     | 16938/37963 [41:38:31<49:40:39,  8.51s/it]
 45%|████▍     | 16939/37963 [41:38:39<47:48:20,  8.19s/it]
 45%|████▍     | 16940/37963 [41:38:54<60:13:24, 10.31s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '2.057', 'learning_rate': '1.221e-05', 'epoch': '0.4462'}
+
 45%|████▍     | 16940/37963 [41:38:54<60:13:24, 10.31s/it]
 45%|████▍     | 16941/37963 [41:39:02<55:26:21,  9.49s/it]
 45%|████▍     | 16942/37963 [41:39:09<52:12:22,  8.94s/it]
 45%|████▍     | 16943/37963 [41:39:17<49:54:39,  8.55s/it]
 45%|████▍     | 16944/37963 [41:39:24<48:12:54,  8.26s/it]
 45%|████▍     | 16945/37963 [41:39:32<47:10:05,  8.08s/it]
 45%|████▍     | 16946/37963 [41:39:40<46:13:31,  7.92s/it]
 45%|████▍     | 16947/37963 [41:39:55<58:29:23, 10.02s/it]
 45%|████▍     | 16948/37963 [41:40:02<54:20:20,  9.31s/it]
 45%|████▍     | 16949/37963 [41:40:10<51:25:04,  8.81s/it]
 45%|████▍     | 16950/37963 [41:40:25<62:42:41, 10.74s/it]
                                                           
{'loss': '0.1595', 'grad_norm': '4.515', 'learning_rate': '1.22e-05', 'epoch': '0.4465'}
+
 45%|████▍     | 16950/37963 [41:40:25<62:42:41, 10.74s/it]
 45%|████▍     | 16951/37963 [41:40:33<57:12:27,  9.80s/it]
 45%|████▍     | 16952/37963 [41:40:40<53:32:46,  9.17s/it]
 45%|████▍     | 16953/37963 [41:40:48<51:05:47,  8.76s/it]
 45%|████▍     | 16954/37963 [41:40:56<49:10:25,  8.43s/it]
 45%|████▍     | 16955/37963 [41:41:03<47:39:26,  8.17s/it]
 45%|████▍     | 16956/37963 [41:41:11<46:42:32,  8.00s/it]
 45%|████▍     | 16957/37963 [41:41:19<46:10:13,  7.91s/it]
 45%|████▍     | 16958/37963 [41:41:26<45:28:39,  7.79s/it]
 45%|████▍     | 16959/37963 [41:41:34<45:27:33,  7.79s/it]
 45%|████▍     | 16960/37963 [41:41:42<45:08:29,  7.74s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '1.235', 'learning_rate': '1.219e-05', 'epoch': '0.4468'}
+
 45%|████▍     | 16960/37963 [41:41:42<45:08:29,  7.74s/it]
 45%|████▍     | 16961/37963 [41:41:50<45:20:25,  7.77s/it]
 45%|████▍     | 16962/37963 [41:41:57<45:19:41,  7.77s/it]
 45%|█���██▍     | 16963/37963 [41:42:05<45:03:13,  7.72s/it]
 45%|████▍     | 16964/37963 [41:42:12<44:41:40,  7.66s/it]
 45%|████▍     | 16965/37963 [41:42:20<44:14:49,  7.59s/it]
 45%|████▍     | 16966/37963 [41:42:27<44:23:50,  7.61s/it]
 45%|████▍     | 16967/37963 [41:42:35<44:30:24,  7.63s/it]
 45%|████▍     | 16968/37963 [41:42:43<44:40:14,  7.66s/it]
 45%|████▍     | 16969/37963 [41:42:51<44:58:41,  7.71s/it]
 45%|████▍     | 16970/37963 [41:42:58<44:50:52,  7.69s/it]
                                                           
{'loss': '0.1494', 'grad_norm': '0.9404', 'learning_rate': '1.219e-05', 'epoch': '0.447'}
+
 45%|████▍     | 16970/37963 [41:42:58<44:50:52,  7.69s/it]
 45%|████▍     | 16971/37963 [41:43:06<44:35:26,  7.65s/it]
 45%|████▍     | 16972/37963 [41:43:14<44:40:52,  7.66s/it]
 45%|████▍     | 16973/37963 [41:43:28<56:50:28,  9.75s/it]
 45%|████▍     | 16974/37963 [41:43:36<53:12:50,  9.13s/it]
 45%|████▍     | 16975/37963 [41:43:43<50:12:40,  8.61s/it]
 45%|████▍     | 16976/37963 [41:43:58<60:02:47, 10.30s/it]
 45%|████▍     | 16977/37963 [41:44:12<67:17:05, 11.54s/it]
 45%|████▍     | 16978/37963 [41:44:26<71:54:05, 12.33s/it]
 45%|████▍     | 16979/37963 [41:44:34<63:34:05, 10.91s/it]
 45%|████▍     | 16980/37963 [41:44:41<57:48:18,  9.92s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '1.669', 'learning_rate': '1.218e-05', 'epoch': '0.4473'}
+
 45%|████▍     | 16980/37963 [41:44:41<57:48:18,  9.92s/it]
 45%|████▍     | 16981/37963 [41:44:49<53:54:51,  9.25s/it]
 45%|████▍     | 16982/37963 [41:44:57<51:17:40,  8.80s/it]
 45%|████▍     | 16983/37963 [41:45:11<61:02:47, 10.48s/it]
 45%|████▍     | 16984/37963 [41:45:19<56:16:02,  9.66s/it]
 45%|████▍     | 16985/37963 [41:45:26<52:36:23,  9.03s/it]
 45%|████▍     | 16986/37963 [41:45:34<50:11:36,  8.61s/it]
 45%|████▍     | 16987/37963 [41:45:42<48:05:04,  8.25s/it]
 45%|████▍     | 16988/37963 [41:45:56<59:37:04, 10.23s/it]
 45%|████▍     | 16989/37963 [41:46:04<55:23:19,  9.51s/it]
 45%|████▍     | 16990/37963 [41:46:12<52:08:32,  8.95s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '3.321', 'learning_rate': '1.217e-05', 'epoch': '0.4475'}
+
 45%|████▍     | 16990/37963 [41:46:12<52:08:32,  8.95s/it]
 45%|████▍     | 16991/37963 [41:46:26<61:54:05, 10.63s/it]
 45%|████▍     | 16992/37963 [41:46:34<56:57:42,  9.78s/it]
 45%|████▍     | 16993/37963 [41:46:42<53:11:26,  9.13s/it]
 45%|████▍     | 16994/37963 [41:46:49<50:27:03,  8.66s/it]
 45%|████▍     | 16995/37963 [41:47:04<61:06:43, 10.49s/it]
 45%|████▍     | 16996/37963 [41:47:12<56:42:10,  9.74s/it]
 45%|████▍     | 16997/37963 [41:47:20<52:51:11,  9.08s/it]
 45%|████▍     | 16998/37963 [41:47:27<50:10:32,  8.62s/it]
 45%|████▍     | 16999/37963 [41:47:35<48:25:12,  8.31s/it]
 45%|████▍     | 17000/37963 [41:47:42<47:14:38,  8.11s/it]
                                                           
{'loss': '0.1411', 'grad_norm': '0.8656', 'learning_rate': '1.216e-05', 'epoch': '0.4478'}
+
 45%|████▍     | 17000/37963 [41:47:42<47:14:38,  8.11s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.71s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.71s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 45%|████▍     | 17001/37963 [41:48:38<130:24:48, 22.40s/it]
 45%|████▍     | 17002/37963 [41:48:46<104:28:43, 17.94s/it]
 45%|████▍     | 17003/37963 [41:48:54<86:48:39, 14.91s/it] 
 45%|████▍     | 17004/37963 [41:49:01<74:31:27, 12.80s/it]
 45%|████▍     | 17005/37963 [41:49:09<66:02:43, 11.34s/it]
 45%|████▍     | 17006/37963 [41:49:17<59:50:00, 10.28s/it]
 45%|████▍     | 17007/37963 [41:49:25<55:23:22,  9.52s/it]
 45%|████▍     | 17008/37963 [41:49:33<52:08:35,  8.96s/it]
 45%|████▍     | 17009/37963 [41:49:40<50:07:04,  8.61s/it]
 45%|████▍     | 17010/37963 [41:49:48<48:57:05,  8.41s/it]
                                                           
{'loss': '0.143', 'grad_norm': '2.55', 'learning_rate': '1.215e-05', 'epoch': '0.4481'}
+
 45%|████▍     | 17010/37963 [41:49:48<48:57:05,  8.41s/it]
 45%|████▍     | 17011/37963 [41:49:56<47:35:00,  8.18s/it]
 45%|████▍     | 17012/37963 [41:50:04<46:37:10,  8.01s/it]
 45%|��███▍     | 17013/37963 [41:50:11<46:05:16,  7.92s/it]
 45%|████▍     | 17014/37963 [41:50:19<45:41:23,  7.85s/it]
 45%|████▍     | 17015/37963 [41:50:27<45:26:45,  7.81s/it]
 45%|████▍     | 17016/37963 [41:50:34<45:16:47,  7.78s/it]
 45%|████▍     | 17017/37963 [41:50:42<44:59:39,  7.73s/it]
 45%|████▍     | 17018/37963 [41:50:50<45:01:00,  7.74s/it]
 45%|████▍     | 17019/37963 [41:50:57<44:38:46,  7.67s/it]
 45%|████▍     | 17020/37963 [41:51:05<44:50:10,  7.71s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '3.655', 'learning_rate': '1.214e-05', 'epoch': '0.4483'}
+
 45%|████▍     | 17020/37963 [41:51:05<44:50:10,  7.71s/it]
 45%|████▍     | 17021/37963 [41:51:13<44:45:54,  7.70s/it]
 45%|████▍     | 17022/37963 [41:51:20<44:46:50,  7.70s/it]
 45%|████▍     | 17023/37963 [41:51:28<44:39:36,  7.68s/it]
 45%|████▍     | 17024/37963 [41:51:49<68:23:36, 11.76s/it]
 45%|████▍     | 17025/37963 [41:51:57<60:54:52, 10.47s/it]
 45%|████▍     | 17026/37963 [41:52:04<55:53:28,  9.61s/it]
 45%|████▍     | 17027/37963 [41:52:19<64:19:48, 11.06s/it]
 45%|████▍     | 17028/37963 [41:52:27<58:32:04, 10.07s/it]
 45%|████▍     | 17029/37963 [41:52:34<54:19:31,  9.34s/it]
 45%|████▍     | 17030/37963 [41:52:42<51:14:37,  8.81s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '3.576', 'learning_rate': '1.214e-05', 'epoch': '0.4486'}
+
 45%|████▍     | 17030/37963 [41:52:42<51:14:37,  8.81s/it]
 45%|████▍     | 17031/37963 [41:52:50<49:17:05,  8.48s/it]
 45%|████▍     | 17032/37963 [41:52:57<47:45:21,  8.21s/it]
 45%|████▍     | 17033/37963 [41:53:05<46:38:53,  8.02s/it]
 45%|████▍     | 17034/37963 [41:53:13<46:15:10,  7.96s/it]
 45%|████▍     | 17035/37963 [41:53:27<56:48:58,  9.77s/it]
 45%|████▍     | 17036/37963 [41:53:41<65:13:49, 11.22s/it]
 45%|████▍     | 17037/37963 [41:53:49<59:36:53, 10.26s/it]
 45%|████▍     | 17038/37963 [41:53:57<55:05:23,  9.48s/it]
 45%|████▍     | 17039/37963 [41:54:04<51:32:16,  8.87s/it]
 45%|████▍     | 17040/37963 [41:54:12<49:11:50,  8.46s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '1.157', 'learning_rate': '1.213e-05', 'epoch': '0.4489'}
+
 45%|████▍     | 17040/37963 [41:54:12<49:11:50,  8.46s/it]
 45%|████▍     | 17041/37963 [41:54:27<60:29:38, 10.41s/it]
 45%|████▍     | 17042/37963 [41:54:34<55:46:49,  9.60s/it]
 45%|████▍     | 17043/37963 [41:54:42<51:51:54,  8.93s/it]
 45%|████▍     | 17044/37963 [41:54:49<49:37:43,  8.54s/it]
 45%|████▍     | 17045/37963 [41:54:57<47:57:35,  8.25s/it]
 45%|████▍     | 17046/37963 [41:55:04<46:35:51,  8.02s/it]
 45%|████▍     | 17047/37963 [41:55:12<45:56:47,  7.91s/it]
 45%|████▍     | 17048/37963 [41:55:27<57:57:20,  9.98s/it]
 45%|████▍     | 17049/37963 [41:55:34<53:40:55,  9.24s/it]
 45%|████▍     | 17050/37963 [41:55:42<50:52:43,  8.76s/it]
                                                           
{'loss': '0.1658', 'grad_norm': '1.186', 'learning_rate': '1.212e-05', 'epoch': '0.4491'}
+
 45%|████▍     | 17050/37963 [41:55:42<50:52:43,  8.76s/it]
 45%|████▍     | 17051/37963 [41:55:50<49:02:23,  8.44s/it]
 45%|████▍     | 17052/37963 [41:55:58<47:51:29,  8.24s/it]
 45%|████▍     | 17053/37963 [41:56:05<46:45:33,  8.05s/it]
 45%|████▍     | 17054/37963 [41:56:13<45:48:24,  7.89s/it]
 45%|████▍     | 17055/37963 [41:56:20<45:10:33,  7.78s/it]
 45%|████▍     | 17056/37963 [41:56:28<44:53:12,  7.73s/it]
 45%|████▍     | 17057/37963 [41:56:35<44:42:37,  7.70s/it]
 45%|████▍     | 17058/37963 [41:56:43<44:21:57,  7.64s/it]
 45%|████▍     | 17059/37963 [41:56:51<44:19:26,  7.63s/it]
 45%|████▍     | 17060/37963 [41:56:58<44:45:45,  7.71s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '5.154', 'learning_rate': '1.211e-05', 'epoch': '0.4494'}
+
 45%|████▍     | 17060/37963 [41:56:58<44:45:45,  7.71s/it]
 45%|████▍     | 17061/37963 [41:57:06<44:38:40,  7.69s/it]
 45%|████▍     | 17062/37963 [41:57:14<44:13:03,  7.62s/it]
 45%|████▍     | 17063/37963 [41:57:21<44:10:21,  7.61s/it]
 45%|████▍     | 17064/37963 [41:57:29<44:07:32,  7.60s/it]
 45%|████▍     | 17065/37963 [41:57:36<43:57:39,  7.57s/it]
 45%|████▍     | 17066/37963 [41:57:44<44:02:49,  7.59s/it]
 45%|████▍     | 17067/37963 [41:57:51<43:48:57,  7.55s/it]
 45%|████▍     | 17068/37963 [41:57:59<44:01:25,  7.58s/it]
 45%|████▍     | 17069/37963 [41:58:07<44:18:54,  7.64s/it]
 45%|████▍     | 17070/37963 [41:58:14<44:27:02,  7.66s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '1.538', 'learning_rate': '1.21e-05', 'epoch': '0.4496'}
+
 45%|████▍     | 17070/37963 [41:58:14<44:27:02,  7.66s/it]
 45%|████▍     | 17071/37963 [41:58:22<44:32:31,  7.68s/it]
 45%|████▍     | 17072/37963 [41:58:37<56:57:48,  9.82s/it]
 45%|████▍     | 17073/37963 [41:58:45<53:28:26,  9.22s/it]
 45%|████▍     | 17074/37963 [41:58:52<50:45:00,  8.75s/it]
 45%|████▍     | 17075/37963 [41:59:00<48:57:14,  8.44s/it]
 45%|████▍     | 17076/37963 [41:59:14<58:47:17, 10.13s/it]
 45%|████▍     | 17077/37963 [41:59:22<54:38:38,  9.42s/it]
 45%|████▍     | 17078/37963 [41:59:36<63:10:24, 10.89s/it]
 45%|████▍     | 17079/37963 [41:59:50<68:35:43, 11.82s/it]
 45%|████▍     | 17080/37963 [42:00:04<72:28:11, 12.49s/it]
                                                           
{'loss': '0.1425', 'grad_norm': '1.723', 'learning_rate': '1.209e-05', 'epoch': '0.4499'}
+
 45%|████▍     | 17080/37963 [42:00:04<72:28:11, 12.49s/it]
 45%|████▍     | 17081/37963 [42:00:12<64:07:57, 11.06s/it]
 45%|████▍     | 17082/37963 [42:00:20<58:21:01, 10.06s/it]
 45%|████▍     | 17083/37963 [42:00:27<54:11:29,  9.34s/it]
 45%|████▌     | 17084/37963 [42:00:35<51:09:04,  8.82s/it]
 45%|████▌     | 17085/37963 [42:00:50<61:58:10, 10.69s/it]
 45%|████▌     | 17086/37963 [42:00:58<56:57:07,  9.82s/it]
 45%|████▌     | 17087/37963 [42:01:13<65:28:16, 11.29s/it]
 45%|████▌     | 17088/37963 [42:01:20<59:20:00, 10.23s/it]
 45%|████▌     | 17089/37963 [42:01:28<54:41:41,  9.43s/it]
 45%|████▌     | 17090/37963 [42:01:36<51:26:23,  8.87s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '4.284', 'learning_rate': '1.209e-05', 'epoch': '0.4502'}
+
 45%|████▌     | 17090/37963 [42:01:36<51:26:23,  8.87s/it]
 45%|████▌     | 17091/37963 [42:01:43<49:15:36,  8.50s/it]
 45%|████▌     | 17092/37963 [42:01:51<47:44:53,  8.24s/it]
 45%|████▌     | 17093/37963 [42:01:58<46:39:43,  8.05s/it]
 45%|████▌     | 17094/37963 [42:02:06<45:49:39,  7.91s/it]
 45%|████▌     | 17095/37963 [42:02:14<45:35:08,  7.86s/it]
 45%|████▌     | 17096/37963 [42:02:21<45:07:44,  7.79s/it]
 45%|████▌     | 17097/37963 [42:02:29<44:56:18,  7.75s/it]
 45%|████▌     | 17098/37963 [42:02:37<44:39:32,  7.71s/it]
 45%|████▌     | 17099/37963 [42:02:44<44:54:24,  7.75s/it]
 45%|████▌     | 17100/37963 [42:02:52<44:33:49,  7.69s/it]
                                                           
{'loss': '0.1507', 'grad_norm': '1.638', 'learning_rate': '1.208e-05', 'epoch': '0.4504'}
+
 45%|████▌     | 17100/37963 [42:02:52<44:33:49,  7.69s/it]
 45%|████▌     | 17101/37963 [42:03:00<44:33:48,  7.69s/it]
 45%|████▌     | 17102/37963 [42:03:14<56:47:59,  9.80s/it]
 45%|████▌     | 17103/37963 [42:03:22<53:03:34,  9.16s/it]
 45%|████▌     | 17104/37963 [42:03:29<49:35:05,  8.56s/it]
 45%|████▌     | 17105/37963 [42:03:37<47:45:27,  8.24s/it]
 45%|████▌     | 17106/37963 [42:03:44<46:35:44,  8.04s/it]
 45%|████▌     | 17107/37963 [42:03:52<45:58:15,  7.94s/it]
 45%|████▌     | 17108/37963 [42:04:00<45:38:21,  7.88s/it]
 45%|████▌     | 17109/37963 [42:04:07<45:14:17,  7.81s/it]
 45%|████▌     | 17110/37963 [42:04:15<45:04:23,  7.78s/it]
                                                           
{'loss': '0.1692', 'grad_norm': '4.075', 'learning_rate': '1.207e-05', 'epoch': '0.4507'}
+
 45%|████▌     | 17110/37963 [42:04:15<45:04:23,  7.78s/it]
 45%|████▌     | 17111/37963 [42:04:23<44:57:13,  7.76s/it]
 45%|████▌     | 17112/37963 [42:04:30<44:13:37,  7.64s/it]
 45%|████▌     | 17113/37963 [42:04:38<44:17:08,  7.65s/it]
 45%|████▌     | 17114/37963 [42:04:45<44:17:01,  7.65s/it]
 45%|████▌     | 17115/37963 [42:04:53<44:21:10,  7.66s/it]
 45%|████▌     | 17116/37963 [42:05:01<44:20:47,  7.66s/it]
 45%|████▌     | 17117/37963 [42:05:08<44:09:44,  7.63s/it]
 45%|████▌     | 17118/37963 [42:05:16<44:14:49,  7.64s/it]
 45%|████▌     | 17119/37963 [42:05:30<55:21:40,  9.56s/it]
 45%|████▌     | 17120/37963 [42:05:38<52:05:47,  9.00s/it]
                                                           
{'loss': '0.1587', 'grad_norm': '1.515', 'learning_rate': '1.206e-05', 'epoch': '0.451'}
+
 45%|████▌     | 17120/37963 [42:05:38<52:05:47,  9.00s/it]
 45%|████▌     | 17121/37963 [42:05:46<50:06:27,  8.66s/it]
 45%|████▌     | 17122/37963 [42:05:53<48:24:30,  8.36s/it]
 45%|████▌     | 17123/37963 [42:06:01<46:55:55,  8.11s/it]
 45%|████▌     | 17124/37963 [42:06:15<57:52:23, 10.00s/it]
 45%|████▌     | 17125/37963 [42:06:23<53:22:42,  9.22s/it]
 45%|████▌     | 17126/37963 [42:06:30<50:12:30,  8.67s/it]
 45%|████▌     | 17127/37963 [42:06:38<48:30:47,  8.38s/it]
 45%|████▌     | 17128/37963 [42:06:45<47:00:15,  8.12s/it]
 45%|████▌     | 17129/37963 [42:06:53<46:14:08,  7.99s/it]
 45%|████▌     | 17130/37963 [42:07:14<68:22:57, 11.82s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '4.301', 'learning_rate': '1.205e-05', 'epoch': '0.4512'}
+
 45%|████▌     | 17130/37963 [42:07:14<68:22:57, 11.82s/it]
 45%|████▌     | 17131/37963 [42:07:22<61:37:55, 10.65s/it]
 45%|████▌     | 17132/37963 [42:07:29<56:31:53,  9.77s/it]
 45%|████▌     | 17133/37963 [42:07:45<65:53:09, 11.39s/it]
 45%|████▌     | 17134/37963 [42:08:06<83:28:24, 14.43s/it]
 45%|████▌     | 17135/37963 [42:08:13<71:10:16, 12.30s/it]
 45%|████▌     | 17136/37963 [42:08:21<63:25:20, 10.96s/it]
 45%|████▌     | 17137/37963 [42:08:29<57:50:16, 10.00s/it]
 45%|████▌     | 17138/37963 [42:08:37<53:55:13,  9.32s/it]
 45%|████▌     | 17139/37963 [42:08:44<50:57:11,  8.81s/it]
 45%|████▌     | 17140/37963 [42:08:52<48:37:58,  8.41s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '1.027', 'learning_rate': '1.204e-05', 'epoch': '0.4515'}
+
 45%|████▌     | 17140/37963 [42:08:52<48:37:58,  8.41s/it]
 45%|████▌     | 17141/37963 [42:08:59<47:14:12,  8.17s/it]
 45%|████▌     | 17142/37963 [42:09:07<46:04:55,  7.97s/it]
 45%|████▌     | 17143/37963 [42:09:15<45:38:29,  7.89s/it]
 45%|████▌     | 17144/37963 [42:09:22<45:15:57,  7.83s/it]
 45%|████▌     | 17145/37963 [42:09:30<44:55:23,  7.77s/it]
 45%|████▌     | 17146/37963 [42:09:44<55:58:40,  9.68s/it]
 45%|████▌     | 17147/37963 [42:09:52<52:52:09,  9.14s/it]
 45%|████▌     | 17148/37963 [42:10:00<50:13:15,  8.69s/it]
 45%|████▌     | 17149/37963 [42:10:07<48:19:35,  8.36s/it]
 45%|████▌     | 17150/37963 [42:10:15<47:11:08,  8.16s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '1.546', 'learning_rate': '1.203e-05', 'epoch': '0.4518'}
+
 45%|████▌     | 17150/37963 [42:10:15<47:11:08,  8.16s/it]
 45%|████▌     | 17151/37963 [42:10:22<46:09:36,  7.98s/it]
 45%|████▌     | 17152/37963 [42:10:30<45:27:29,  7.86s/it]
 45%|████▌     | 17153/37963 [42:10:38<45:07:51,  7.81s/it]
 45%|████▌     | 17154/37963 [42:10:45<44:32:17,  7.71s/it]
 45%|████▌     | 17155/37963 [42:10:53<44:25:49,  7.69s/it]
 45%|████▌     | 17156/37963 [42:11:00<44:20:10,  7.67s/it]
 45%|████▌     | 17157/37963 [42:11:08<44:24:16,  7.68s/it]
 45%|████▌     | 17158/37963 [42:11:16<44:18:48,  7.67s/it]
 45%|████▌     | 17159/37963 [42:11:23<44:22:10,  7.68s/it]
 45%|████▌     | 17160/37963 [42:11:31<44:21:30,  7.68s/it]
                                                           
{'loss': '0.1443', 'grad_norm': '2.537', 'learning_rate': '1.203e-05', 'epoch': '0.452'}
+
 45%|████▌     | 17160/37963 [42:11:31<44:21:30,  7.68s/it]
 45%|████▌     | 17161/37963 [42:11:39<44:00:35,  7.62s/it]
 45%|████▌     | 17162/37963 [42:11:46<44:16:35,  7.66s/it]
 45%|████▌     | 17163/37963 [42:11:54<44:23:46,  7.68s/it]
 45%|████▌     | 17164/37963 [42:12:02<44:03:11,  7.62s/it]
 45%|████▌     | 17165/37963 [42:12:09<44:14:16,  7.66s/it]
 45%|████▌     | 17166/37963 [42:12:17<44:26:03,  7.69s/it]
 45%|████▌     | 17167/37963 [42:12:25<44:21:08,  7.68s/it]
 45%|████▌     | 17168/37963 [42:12:32<44:13:21,  7.66s/it]
 45%|████▌     | 17169/37963 [42:12:54<68:22:48, 11.84s/it]
 45%|████▌     | 17170/37963 [42:13:02<60:58:40, 10.56s/it]
                                                           
{'loss': '0.151', 'grad_norm': '1.216', 'learning_rate': '1.202e-05', 'epoch': '0.4523'}
+
 45%|████▌     | 17170/37963 [42:13:02<60:58:40, 10.56s/it]
 45%|████▌     | 17171/37963 [42:13:09<55:33:35,  9.62s/it]
 45%|████▌     | 17172/37963 [42:13:17<52:11:07,  9.04s/it]
 45%|████▌     | 17173/37963 [42:13:24<49:54:23,  8.64s/it]
 45%|████▌     | 17174/37963 [42:13:32<47:52:04,  8.29s/it]
 45%|████▌     | 17175/37963 [42:13:39<46:44:49,  8.10s/it]
 45%|████▌     | 17176/37963 [42:13:47<46:21:59,  8.03s/it]
 45%|████▌     | 17177/37963 [42:13:55<45:49:36,  7.94s/it]
 45%|████▌     | 17178/37963 [42:14:03<45:16:40,  7.84s/it]
 45%|████▌     | 17179/37963 [42:14:10<44:43:55,  7.75s/it]
 45%|████▌     | 17180/37963 [42:14:39<80:44:12, 13.99s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '1.028', 'learning_rate': '1.201e-05', 'epoch': '0.4525'}
+
 45%|████▌     | 17180/37963 [42:14:39<80:44:12, 13.99s/it]
 45%|████▌     | 17181/37963 [42:14:53<80:32:27, 13.95s/it]
 45%|████▌     | 17182/37963 [42:15:01<70:04:28, 12.14s/it]
 45%|████▌     | 17183/37963 [42:15:08<62:22:21, 10.81s/it]
 45%|████▌     | 17184/37963 [42:15:16<56:22:23,  9.77s/it]
 45%|████▌     | 17185/37963 [42:15:23<52:56:08,  9.17s/it]
 45%|████▌     | 17186/37963 [42:15:31<50:09:32,  8.69s/it]
 45%|████▌     | 17187/37963 [42:15:39<48:18:31,  8.37s/it]
 45%|████▌     | 17188/37963 [42:15:53<58:18:52, 10.11s/it]
 45%|████▌     | 17189/37963 [42:16:00<54:01:23,  9.36s/it]
 45%|████▌     | 17190/37963 [42:16:08<50:31:28,  8.76s/it]
                                                           
{'loss': '0.1404', 'grad_norm': '3.08', 'learning_rate': '1.2e-05', 'epoch': '0.4528'}
+
 45%|████▌     | 17190/37963 [42:16:08<50:31:28,  8.76s/it]
 45%|████▌     | 17191/37963 [42:16:15<48:33:54,  8.42s/it]
 45%|████▌     | 17192/37963 [42:16:30<59:24:59, 10.30s/it]
 45%|████▌     | 17193/37963 [42:16:38<54:50:49,  9.51s/it]
 45%|████▌     | 17194/37963 [42:16:45<51:36:22,  8.95s/it]
 45%|████▌     | 17195/37963 [42:16:53<49:33:05,  8.59s/it]
 45%|████▌     | 17196/37963 [42:17:00<47:34:38,  8.25s/it]
 45%|████▌     | 17197/37963 [42:17:08<46:42:53,  8.10s/it]
 45%|████▌     | 17198/37963 [42:17:16<45:53:53,  7.96s/it]
 45%|████▌     | 17199/37963 [42:17:24<45:26:10,  7.88s/it]
 45%|████▌     | 17200/37963 [42:17:31<44:50:53,  7.78s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '0.6648', 'learning_rate': '1.199e-05', 'epoch': '0.4531'}
+
 45%|████▌     | 17200/37963 [42:17:31<44:50:53,  7.78s/it]
 45%|████▌     | 17201/37963 [42:17:39<44:42:36,  7.75s/it]
 45%|████▌     | 17202/37963 [42:17:46<44:27:48,  7.71s/it]
 45%|████▌     | 17203/37963 [42:17:54<44:32:54,  7.73s/it]
 45%|████▌     | 17204/37963 [42:18:02<44:42:51,  7.75s/it]
 45%|████▌     | 17205/37963 [42:18:09<44:07:01,  7.65s/it]
 45%|████▌     | 17206/37963 [42:18:17<44:09:03,  7.66s/it]
 45%|████▌     | 17207/37963 [42:18:25<44:17:09,  7.68s/it]
 45%|████▌     | 17208/37963 [42:18:33<44:18:10,  7.68s/it]
 45%|████▌     | 17209/37963 [42:18:40<44:10:28,  7.66s/it]
 45%|████▌     | 17210/37963 [42:18:48<44:17:11,  7.68s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '1.347', 'learning_rate': '1.198e-05', 'epoch': '0.4533'}
+
 45%|████▌     | 17210/37963 [42:18:48<44:17:11,  7.68s/it]
 45%|████▌     | 17211/37963 [42:18:56<44:21:32,  7.70s/it]
 45%|████▌     | 17212/37963 [42:19:03<44:10:34,  7.66s/it]
 45%|████▌     | 17213/37963 [42:19:11<43:57:12,  7.63s/it]
 45%|████▌     | 17214/37963 [42:19:18<44:08:18,  7.66s/it]
 45%|████▌     | 17215/37963 [42:19:26<44:05:55,  7.65s/it]
 45%|████▌     | 17216/37963 [42:19:34<44:04:42,  7.65s/it]
 45%|████▌     | 17217/37963 [42:19:48<56:19:17,  9.77s/it]
 45%|████▌     | 17218/37963 [42:19:56<52:44:08,  9.15s/it]
 45%|████▌     | 17219/37963 [42:20:04<50:07:32,  8.70s/it]
 45%|████▌     | 17220/37963 [42:20:18<59:26:37, 10.32s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '2.19', 'learning_rate': '1.198e-05', 'epoch': '0.4536'}
+
 45%|████▌     | 17220/37963 [42:20:18<59:26:37, 10.32s/it]
 45%|████▌     | 17221/37963 [42:20:26<55:38:54,  9.66s/it]
 45%|████▌     | 17222/37963 [42:20:34<52:51:51,  9.18s/it]
 45%|████▌     | 17223/37963 [42:20:42<50:20:46,  8.74s/it]
 45%|████▌     | 17224/37963 [42:20:56<59:35:25, 10.34s/it]
 45%|████▌     | 17225/37963 [42:21:10<66:34:41, 11.56s/it]
 45%|████▌     | 17226/37963 [42:21:18<60:04:55, 10.43s/it]
 45%|████▌     | 17227/37963 [42:21:26<55:14:09,  9.59s/it]
 45%|████▌     | 17228/37963 [42:21:41<64:37:06, 11.22s/it]
 45%|████▌     | 17229/37963 [42:21:55<70:41:40, 12.27s/it]
 45%|████▌     | 17230/37963 [42:22:03<62:57:03, 10.93s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '1.736', 'learning_rate': '1.197e-05', 'epoch': '0.4539'}
+
 45%|████▌     | 17230/37963 [42:22:03<62:57:03, 10.93s/it]
 45%|████▌     | 17231/37963 [42:22:11<57:15:00,  9.94s/it]
 45%|████▌     | 17232/37963 [42:22:19<53:21:09,  9.26s/it]
 45%|████▌     | 17233/37963 [42:22:26<50:37:50,  8.79s/it]
 45%|████▌     | 17234/37963 [42:22:34<48:39:13,  8.45s/it]
 45%|████▌     | 17235/37963 [42:22:42<47:18:25,  8.22s/it]
 45%|████▌     | 17236/37963 [42:22:49<45:52:07,  7.97s/it]
 45%|████▌     | 17237/37963 [42:23:03<56:41:49,  9.85s/it]
 45%|████▌     | 17238/37963 [42:23:11<52:55:49,  9.19s/it]
 45%|████▌     | 17239/37963 [42:23:18<50:14:59,  8.73s/it]
 45%|████▌     | 17240/37963 [42:23:33<60:42:54, 10.55s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '2.237', 'learning_rate': '1.196e-05', 'epoch': '0.4541'}
+
 45%|████▌     | 17240/37963 [42:23:33<60:42:54, 10.55s/it]
 45%|████▌     | 17241/37963 [42:23:41<56:02:21,  9.74s/it]
 45%|████▌     | 17242/37963 [42:23:49<52:48:24,  9.17s/it]
 45%|████▌     | 17243/37963 [42:23:57<50:11:06,  8.72s/it]
 45%|████▌     | 17244/37963 [42:24:04<47:47:47,  8.30s/it]
 45%|████▌     | 17245/37963 [42:24:12<46:42:22,  8.12s/it]
 45%|████▌     | 17246/37963 [42:24:19<46:06:30,  8.01s/it]
 45%|████▌     | 17247/37963 [42:24:27<45:36:06,  7.92s/it]
 45%|████▌     | 17248/37963 [42:24:35<45:07:21,  7.84s/it]
 45%|████▌     | 17249/37963 [42:24:42<44:43:20,  7.77s/it]
 45%|████▌     | 17250/37963 [42:24:50<44:44:16,  7.78s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '2.605', 'learning_rate': '1.195e-05', 'epoch': '0.4544'}
+
 45%|████▌     | 17250/37963 [42:24:50<44:44:16,  7.78s/it]
 45%|████▌     | 17251/37963 [42:24:58<44:31:12,  7.74s/it]
 45%|████▌     | 17252/37963 [42:25:05<44:01:12,  7.65s/it]
 45%|████▌     | 17253/37963 [42:25:13<43:30:39,  7.56s/it]
 45%|████▌     | 17254/37963 [42:25:20<43:41:55,  7.60s/it]
 45%|████▌     | 17255/37963 [42:25:28<43:48:06,  7.61s/it]
 45%|████▌     | 17256/37963 [42:25:36<43:45:11,  7.61s/it]
 45%|████▌     | 17257/37963 [42:25:43<43:56:23,  7.64s/it]
 45%|████▌     | 17258/37963 [42:25:51<44:03:56,  7.66s/it]
 45%|████▌     | 17259/37963 [42:25:59<43:59:24,  7.65s/it]
 45%|████▌     | 17260/37963 [42:26:06<43:28:36,  7.56s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '3.195', 'learning_rate': '1.194e-05', 'epoch': '0.4547'}
+
 45%|████▌     | 17260/37963 [42:26:06<43:28:36,  7.56s/it]
 45%|████▌     | 17261/37963 [42:26:14<43:33:47,  7.58s/it]
 45%|████▌     | 17262/37963 [42:26:21<43:31:34,  7.57s/it]
 45%|████▌     | 17263/37963 [42:26:29<43:40:20,  7.60s/it]
 45%|████▌     | 17264/37963 [42:26:37<43:52:05,  7.63s/it]
 45%|████▌     | 17265/37963 [42:26:58<67:48:03, 11.79s/it]
 45%|████▌     | 17266/37963 [42:27:06<61:13:36, 10.65s/it]
 45%|████▌     | 17267/37963 [42:27:14<55:57:46,  9.73s/it]
 45%|████▌     | 17268/37963 [42:27:21<52:33:15,  9.14s/it]
 45%|████▌     | 17269/37963 [42:27:29<50:00:47,  8.70s/it]
 45%|████▌     | 17270/37963 [42:27:37<48:11:47,  8.38s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '1.842', 'learning_rate': '1.193e-05', 'epoch': '0.4549'}
+
 45%|████▌     | 17270/37963 [42:27:37<48:11:47,  8.38s/it]
 45%|████▌     | 17271/37963 [42:27:44<47:01:03,  8.18s/it]
 45%|████▌     | 17272/37963 [42:27:52<46:12:59,  8.04s/it]
 45%|████▌     | 17273/37963 [42:28:00<45:35:40,  7.93s/it]
 46%|████▌     | 17274/37963 [42:28:07<45:00:59,  7.83s/it]
 46%|████▌     | 17275/37963 [42:28:22<56:26:27,  9.82s/it]
 46%|████▌     | 17276/37963 [42:28:30<52:47:05,  9.19s/it]
 46%|████▌     | 17277/37963 [42:28:44<62:38:30, 10.90s/it]
 46%|████▌     | 17278/37963 [42:28:59<68:27:13, 11.91s/it]
 46%|████▌     | 17279/37963 [42:29:06<60:58:26, 10.61s/it]
 46%|████▌     | 17280/37963 [42:29:21<68:47:38, 11.97s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '0.8945', 'learning_rate': '1.193e-05', 'epoch': '0.4552'}
+
 46%|████▌     | 17280/37963 [42:29:21<68:47:38, 11.97s/it]
 46%|████▌     | 17281/37963 [42:29:29<61:25:04, 10.69s/it]
 46%|████▌     | 17282/37963 [42:29:43<67:38:49, 11.78s/it]
 46%|████▌     | 17283/37963 [42:29:51<60:44:04, 10.57s/it]
 46%|████▌     | 17284/37963 [42:29:59<55:43:32,  9.70s/it]
 46%|████▌     | 17285/37963 [42:30:07<52:11:06,  9.09s/it]
 46%|████▌     | 17286/37963 [42:30:14<49:43:49,  8.66s/it]
 46%|████▌     | 17287/37963 [42:30:29<59:35:55, 10.38s/it]
 46%|████▌     | 17288/37963 [42:30:36<54:57:23,  9.57s/it]
 46%|████▌     | 17289/37963 [42:30:43<50:52:36,  8.86s/it]
 46%|████▌     | 17290/37963 [42:30:51<49:00:17,  8.53s/it]
                                                           
{'loss': '0.1681', 'grad_norm': '1.61', 'learning_rate': '1.192e-05', 'epoch': '0.4554'}
+
 46%|████▌     | 17290/37963 [42:30:51<49:00:17,  8.53s/it]
 46%|████▌     | 17291/37963 [42:30:59<47:31:54,  8.28s/it]
 46%|████▌     | 17292/37963 [42:31:06<46:02:05,  8.02s/it]
 46%|████▌     | 17293/37963 [42:31:14<45:18:21,  7.89s/it]
 46%|████▌     | 17294/37963 [42:31:22<44:54:02,  7.82s/it]
 46%|████▌     | 17295/37963 [42:31:29<44:42:07,  7.79s/it]
 46%|████▌     | 17296/37963 [42:31:37<44:23:27,  7.73s/it]
 46%|████▌     | 17297/37963 [42:31:45<44:19:25,  7.72s/it]
 46%|████▌     | 17298/37963 [42:31:52<44:09:19,  7.69s/it]
 46%|████▌     | 17299/37963 [42:32:00<44:04:48,  7.68s/it]
 46%|████▌     | 17300/37963 [42:32:07<43:45:56,  7.63s/it]
                                                           
{'loss': '0.17', 'grad_norm': '1.615', 'learning_rate': '1.191e-05', 'epoch': '0.4557'}
+
 46%|████▌     | 17300/37963 [42:32:07<43:45:56,  7.63s/it]
 46%|████▌     | 17301/37963 [42:32:15<43:25:41,  7.57s/it]
 46%|████▌     | 17302/37963 [42:32:22<43:32:28,  7.59s/it]
 46%|████▌     | 17303/37963 [42:32:30<43:37:31,  7.60s/it]
 46%|████▌     | 17304/37963 [42:32:38<43:44:59,  7.62s/it]
 46%|████▌     | 17305/37963 [42:32:45<43:55:27,  7.65s/it]
 46%|████▌     | 17306/37963 [42:32:53<43:54:37,  7.65s/it]
 46%|████▌     | 17307/37963 [42:33:01<43:48:28,  7.63s/it]
 46%|████▌     | 17308/37963 [42:33:08<43:39:52,  7.61s/it]
 46%|████▌     | 17309/37963 [42:33:16<43:42:26,  7.62s/it]
 46%|████▌     | 17310/37963 [42:33:24<43:54:40,  7.65s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '2.986', 'learning_rate': '1.19e-05', 'epoch': '0.456'}
+
 46%|████▌     | 17310/37963 [42:33:24<43:54:40,  7.65s/it]
 46%|████▌     | 17311/37963 [42:33:31<43:21:11,  7.56s/it]
 46%|████▌     | 17312/37963 [42:33:39<43:30:17,  7.58s/it]
 46%|████▌     | 17313/37963 [42:33:46<43:43:24,  7.62s/it]
 46%|████▌     | 17314/37963 [42:34:01<55:53:47,  9.75s/it]
 46%|████▌     | 17315/37963 [42:34:09<52:17:25,  9.12s/it]
 46%|████▌     | 17316/37963 [42:34:16<49:38:36,  8.66s/it]
 46%|████▌     | 17317/37963 [42:34:30<58:59:23, 10.29s/it]
 46%|████▌     | 17318/37963 [42:34:38<54:25:00,  9.49s/it]
 46%|████▌     | 17319/37963 [42:34:46<51:06:56,  8.91s/it]
 46%|████▌     | 17320/37963 [42:34:59<59:39:17, 10.40s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '1.673', 'learning_rate': '1.189e-05', 'epoch': '0.4562'}
+
 46%|████▌     | 17320/37963 [42:34:59<59:39:17, 10.40s/it]
 46%|████▌     | 17321/37963 [42:35:07<54:51:45,  9.57s/it]
 46%|████▌     | 17322/37963 [42:35:15<51:39:42,  9.01s/it]
 46%|████▌     | 17323/37963 [42:35:22<49:09:23,  8.57s/it]
 46%|████▌     | 17324/37963 [42:35:30<47:39:54,  8.31s/it]
 46%|████▌     | 17325/37963 [42:35:45<58:34:45, 10.22s/it]
 46%|████▌     | 17326/37963 [42:35:52<54:12:13,  9.46s/it]
 46%|████▌     | 17327/37963 [42:36:06<62:10:00, 10.85s/it]
 46%|████▌     | 17328/37963 [42:36:21<68:10:35, 11.89s/it]
 46%|████▌     | 17329/37963 [42:36:28<60:30:47, 10.56s/it]
 46%|████▌     | 17330/37963 [42:36:43<67:41:59, 11.81s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '0.5933', 'learning_rate': '1.188e-05', 'epoch': '0.4565'}
+
 46%|████▌     | 17330/37963 [42:36:43<67:41:59, 11.81s/it]
 46%|████▌     | 17331/37963 [42:36:50<60:19:48, 10.53s/it]
 46%|████▌     | 17332/37963 [42:36:58<55:25:09,  9.67s/it]
 46%|████▌     | 17333/37963 [42:37:06<52:00:27,  9.08s/it]
 46%|████▌     | 17334/37963 [42:37:14<49:36:00,  8.66s/it]
 46%|████▌     | 17335/37963 [42:37:21<47:52:56,  8.36s/it]
 46%|████▌     | 17336/37963 [42:37:29<46:48:06,  8.17s/it]
 46%|████▌     | 17337/37963 [42:37:37<46:08:05,  8.05s/it]
 46%|████▌     | 17338/37963 [42:37:44<45:28:12,  7.94s/it]
 46%|████▌     | 17339/37963 [42:37:59<56:53:42,  9.93s/it]
 46%|████▌     | 17340/37963 [42:38:07<53:16:37,  9.30s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '1.948', 'learning_rate': '1.188e-05', 'epoch': '0.4568'}
+
 46%|████▌     | 17340/37963 [42:38:07<53:16:37,  9.30s/it]
 46%|████▌     | 17341/37963 [42:38:14<50:25:54,  8.80s/it]
 46%|████▌     | 17342/37963 [42:38:22<48:42:01,  8.50s/it]
 46%|████▌     | 17343/37963 [42:38:30<47:05:15,  8.22s/it]
 46%|████▌     | 17344/37963 [42:38:37<46:12:05,  8.07s/it]
 46%|████▌     | 17345/37963 [42:38:45<45:18:48,  7.91s/it]
 46%|████▌     | 17346/37963 [42:38:53<45:00:30,  7.86s/it]
 46%|████▌     | 17347/37963 [42:39:00<44:30:43,  7.77s/it]
 46%|████▌     | 17348/37963 [42:39:08<44:10:35,  7.71s/it]
 46%|████▌     | 17349/37963 [42:39:16<44:08:16,  7.71s/it]
 46%|████▌     | 17350/37963 [42:39:23<44:10:35,  7.72s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '4.443', 'learning_rate': '1.187e-05', 'epoch': '0.457'}
+
 46%|████▌     | 17350/37963 [42:39:23<44:10:35,  7.72s/it]
 46%|████▌     | 17351/37963 [42:39:31<44:00:56,  7.69s/it]
 46%|████▌     | 17352/37963 [42:39:39<44:04:07,  7.70s/it]
 46%|████▌     | 17353/37963 [42:39:46<44:00:55,  7.69s/it]
 46%|████▌     | 17354/37963 [42:39:54<44:02:52,  7.69s/it]
 46%|████▌     | 17355/37963 [42:40:02<43:53:37,  7.67s/it]
 46%|████▌     | 17356/37963 [42:40:09<43:56:49,  7.68s/it]
 46%|████▌     | 17357/37963 [42:40:17<43:53:17,  7.67s/it]
 46%|████▌     | 17358/37963 [42:40:32<55:38:23,  9.72s/it]
 46%|████▌     | 17359/37963 [42:40:39<51:40:36,  9.03s/it]
 46%|████▌     | 17360/37963 [42:40:47<49:33:42,  8.66s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '1.696', 'learning_rate': '1.186e-05', 'epoch': '0.4573'}
+
 46%|████▌     | 17360/37963 [42:40:47<49:33:42,  8.66s/it]
 46%|████▌     | 17361/37963 [42:40:54<47:34:26,  8.31s/it]
 46%|████▌     | 17362/37963 [42:41:02<46:32:38,  8.13s/it]
 46%|████▌     | 17363/37963 [42:41:10<45:41:47,  7.99s/it]
 46%|████▌     | 17364/37963 [42:41:24<56:50:15,  9.93s/it]
 46%|████▌     | 17365/37963 [42:41:32<52:50:43,  9.24s/it]
 46%|████▌     | 17366/37963 [42:41:46<61:08:43, 10.69s/it]
 46%|████▌     | 17367/37963 [42:41:54<56:52:28,  9.94s/it]
 46%|████▌     | 17368/37963 [42:42:02<53:01:30,  9.27s/it]
 46%|████▌     | 17369/37963 [42:42:09<50:20:35,  8.80s/it]
 46%|████▌     | 17370/37963 [42:42:17<48:02:11,  8.40s/it]
                                                           
{'loss': '0.1595', 'grad_norm': '5.622', 'learning_rate': '1.185e-05', 'epoch': '0.4576'}
+
 46%|████▌     | 17370/37963 [42:42:17<48:02:11,  8.40s/it]
 46%|████▌     | 17371/37963 [42:42:25<46:48:05,  8.18s/it]
 46%|████▌     | 17372/37963 [42:42:32<45:59:37,  8.04s/it]
 46%|████▌     | 17373/37963 [42:42:47<57:28:08, 10.05s/it]
 46%|████▌     | 17374/37963 [42:43:02<65:24:56, 11.44s/it]
 46%|████▌     | 17375/37963 [42:43:16<70:22:41, 12.31s/it]
 46%|████▌     | 17376/37963 [42:43:24<62:34:15, 10.94s/it]
 46%|████▌     | 17377/37963 [42:43:32<57:11:04, 10.00s/it]
 46%|████▌     | 17378/37963 [42:43:46<64:33:47, 11.29s/it]
 46%|████▌     | 17379/37963 [42:43:54<58:38:59, 10.26s/it]
 46%|████▌     | 17380/37963 [42:44:01<54:17:14,  9.49s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '1.468', 'learning_rate': '1.184e-05', 'epoch': '0.4578'}
+
 46%|████▌     | 17380/37963 [42:44:01<54:17:14,  9.49s/it]
 46%|████▌     | 17381/37963 [42:44:09<51:06:14,  8.94s/it]
 46%|████▌     | 17382/37963 [42:44:17<49:03:01,  8.58s/it]
 46%|████▌     | 17383/37963 [42:44:24<47:25:55,  8.30s/it]
 46%|████▌     | 17384/37963 [42:44:38<57:19:18, 10.03s/it]
 46%|████▌     | 17385/37963 [42:44:46<53:25:25,  9.35s/it]
 46%|████▌     | 17386/37963 [42:44:54<50:41:31,  8.87s/it]
 46%|████▌     | 17387/37963 [42:45:02<48:47:02,  8.54s/it]
 46%|████▌     | 17388/37963 [42:45:09<47:16:53,  8.27s/it]
 46%|████▌     | 17389/37963 [42:45:17<46:11:45,  8.08s/it]
 46%|████▌     | 17390/37963 [42:45:25<45:28:43,  7.96s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '2.137', 'learning_rate': '1.183e-05', 'epoch': '0.4581'}
+
 46%|████▌     | 17390/37963 [42:45:25<45:28:43,  7.96s/it]
 46%|████▌     | 17391/37963 [42:45:32<44:43:09,  7.83s/it]
 46%|████▌     | 17392/37963 [42:45:40<44:20:30,  7.76s/it]
 46%|████▌     | 17393/37963 [42:45:48<44:28:42,  7.78s/it]
 46%|████▌     | 17394/37963 [42:45:55<44:14:32,  7.74s/it]
 46%|████▌     | 17395/37963 [42:46:03<44:05:37,  7.72s/it]
 46%|████▌     | 17396/37963 [42:46:11<43:52:06,  7.68s/it]
 46%|████▌     | 17397/37963 [42:46:18<43:55:19,  7.69s/it]
 46%|████▌     | 17398/37963 [42:46:26<44:01:11,  7.71s/it]
 46%|████▌     | 17399/37963 [42:46:34<43:47:44,  7.67s/it]
 46%|████▌     | 17400/37963 [42:46:41<43:46:54,  7.66s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '1.549', 'learning_rate': '1.183e-05', 'epoch': '0.4583'}
+
 46%|████▌     | 17400/37963 [42:46:41<43:46:54,  7.66s/it]
 46%|████▌     | 17401/37963 [42:46:49<44:13:59,  7.74s/it]
 46%|████▌     | 17402/37963 [42:46:57<44:01:25,  7.71s/it]
 46%|████▌     | 17403/37963 [42:47:05<44:10:58,  7.74s/it]
 46%|████▌     | 17404/37963 [42:47:12<44:02:45,  7.71s/it]
 46%|████▌     | 17405/37963 [42:47:20<44:03:19,  7.71s/it]
 46%|████▌     | 17406/37963 [42:47:35<55:44:52,  9.76s/it]
 46%|████▌     | 17407/37963 [42:47:42<52:24:13,  9.18s/it]
 46%|████▌     | 17408/37963 [42:47:50<49:55:07,  8.74s/it]
 46%|████▌     | 17409/37963 [42:47:58<47:47:00,  8.37s/it]
 46%|████▌     | 17410/37963 [42:48:05<46:41:53,  8.18s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '2.927', 'learning_rate': '1.182e-05', 'epoch': '0.4586'}
+
 46%|████▌     | 17410/37963 [42:48:05<46:41:53,  8.18s/it]
 46%|████▌     | 17411/37963 [42:48:19<56:45:32,  9.94s/it]
 46%|████▌     | 17412/37963 [42:48:27<53:29:39,  9.37s/it]
 46%|████▌     | 17413/37963 [42:48:35<50:32:07,  8.85s/it]
 46%|████▌     | 17414/37963 [42:48:43<48:23:33,  8.48s/it]
 46%|████▌     | 17415/37963 [42:48:50<47:14:05,  8.28s/it]
 46%|████▌     | 17416/37963 [42:49:05<57:41:08, 10.11s/it]
 46%|████▌     | 17417/37963 [42:49:13<53:32:09,  9.38s/it]
 46%|████▌     | 17418/37963 [42:49:27<61:52:44, 10.84s/it]
 46%|████▌     | 17419/37963 [42:49:35<56:34:18,  9.91s/it]
 46%|████▌     | 17420/37963 [42:49:42<52:34:09,  9.21s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '0.8519', 'learning_rate': '1.181e-05', 'epoch': '0.4589'}
+
 46%|████▌     | 17420/37963 [42:49:42<52:34:09,  9.21s/it]
 46%|████▌     | 17421/37963 [42:49:57<61:39:47, 10.81s/it]
 46%|████▌     | 17422/37963 [42:50:11<67:36:01, 11.85s/it]
 46%|████▌     | 17423/37963 [42:50:19<60:44:13, 10.65s/it]
 46%|████▌     | 17424/37963 [42:50:26<55:38:41,  9.75s/it]
 46%|████▌     | 17425/37963 [42:50:34<52:14:56,  9.16s/it]
 46%|████▌     | 17426/37963 [42:50:49<61:51:06, 10.84s/it]
 46%|████▌     | 17427/37963 [42:50:57<56:37:43,  9.93s/it]
 46%|████▌     | 17428/37963 [42:51:04<52:54:22,  9.28s/it]
 46%|████▌     | 17429/37963 [42:51:12<50:08:03,  8.79s/it]
 46%|████▌     | 17430/37963 [42:51:20<48:03:04,  8.42s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '4.164', 'learning_rate': '1.18e-05', 'epoch': '0.4591'}
+
 46%|████▌     | 17430/37963 [42:51:20<48:03:04,  8.42s/it]
 46%|████▌     | 17431/37963 [42:51:27<46:26:17,  8.14s/it]
 46%|████▌     | 17432/37963 [42:51:35<45:39:07,  8.00s/it]
 46%|████▌     | 17433/37963 [42:51:42<44:56:44,  7.88s/it]
 46%|████▌     | 17434/37963 [42:51:50<44:20:52,  7.78s/it]
 46%|████▌     | 17435/37963 [42:51:57<43:40:08,  7.66s/it]
 46%|████▌     | 17436/37963 [42:52:05<43:37:13,  7.65s/it]
 46%|████▌     | 17437/37963 [42:52:13<43:21:32,  7.60s/it]
 46%|████▌     | 17438/37963 [42:52:20<43:28:29,  7.63s/it]
 46%|████▌     | 17439/37963 [42:52:35<55:30:17,  9.74s/it]
 46%|████▌     | 17440/37963 [42:52:43<51:55:05,  9.11s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '2.869', 'learning_rate': '1.179e-05', 'epoch': '0.4594'}
+
 46%|████▌     | 17440/37963 [42:52:43<51:55:05,  9.11s/it]
 46%|████▌     | 17441/37963 [42:52:50<49:42:25,  8.72s/it]
 46%|████▌     | 17442/37963 [42:52:58<47:42:37,  8.37s/it]
 46%|████▌     | 17443/37963 [42:53:05<46:21:58,  8.13s/it]
 46%|████▌     | 17444/37963 [42:53:13<45:30:03,  7.98s/it]
 46%|████▌     | 17445/37963 [42:53:21<45:08:31,  7.92s/it]
 46%|████▌     | 17446/37963 [42:53:29<45:12:51,  7.93s/it]
 46%|████▌     | 17447/37963 [42:53:37<44:50:53,  7.87s/it]
 46%|████▌     | 17448/37963 [42:53:44<44:25:24,  7.80s/it]
 46%|████▌     | 17449/37963 [42:53:52<43:53:36,  7.70s/it]
 46%|████▌     | 17450/37963 [42:53:59<43:29:10,  7.63s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '4.633', 'learning_rate': '1.178e-05', 'epoch': '0.4597'}
+
 46%|████▌     | 17450/37963 [42:53:59<43:29:10,  7.63s/it]
 46%|████▌     | 17451/37963 [42:54:07<43:27:54,  7.63s/it]
 46%|████▌     | 17452/37963 [42:54:14<43:24:29,  7.62s/it]
 46%|████▌     | 17453/37963 [42:54:22<43:29:38,  7.63s/it]
 46%|████▌     | 17454/37963 [42:54:37<55:54:55,  9.81s/it]
 46%|████▌     | 17455/37963 [42:54:45<52:14:54,  9.17s/it]
 46%|████▌     | 17456/37963 [42:54:52<49:09:06,  8.63s/it]
 46%|████▌     | 17457/37963 [42:54:59<47:01:28,  8.26s/it]
 46%|████▌     | 17458/37963 [42:55:07<45:50:53,  8.05s/it]
 46%|████▌     | 17459/37963 [42:55:14<44:57:26,  7.89s/it]
 46%|████▌     | 17460/37963 [42:55:22<44:08:19,  7.75s/it]
                                                           
{'loss': '0.153', 'grad_norm': '2.46', 'learning_rate': '1.178e-05', 'epoch': '0.4599'}
+
 46%|████▌     | 17460/37963 [42:55:22<44:08:19,  7.75s/it]
 46%|████▌     | 17461/37963 [42:55:30<44:05:07,  7.74s/it]
 46%|████▌     | 17462/37963 [42:55:37<43:59:20,  7.72s/it]
 46%|████▌     | 17463/37963 [42:55:45<43:50:35,  7.70s/it]
 46%|████▌     | 17464/37963 [42:55:53<43:48:09,  7.69s/it]
 46%|████▌     | 17465/37963 [42:56:00<43:52:31,  7.71s/it]
 46%|████▌     | 17466/37963 [42:56:15<55:02:04,  9.67s/it]
 46%|████▌     | 17467/37963 [42:56:22<51:16:53,  9.01s/it]
 46%|████▌     | 17468/37963 [42:56:30<48:52:46,  8.59s/it]
 46%|████▌     | 17469/37963 [42:56:37<47:19:53,  8.31s/it]
 46%|████▌     | 17470/37963 [42:56:59<69:40:59, 12.24s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '1.541', 'learning_rate': '1.177e-05', 'epoch': '0.4602'}
+
 46%|████▌     | 17470/37963 [42:56:59<69:40:59, 12.24s/it]
 46%|████▌     | 17471/37963 [42:57:06<61:48:29, 10.86s/it]
 46%|████▌     | 17472/37963 [42:57:28<79:34:26, 13.98s/it]
 46%|████▌     | 17473/37963 [42:57:35<68:50:55, 12.10s/it]
 46%|████▌     | 17474/37963 [42:57:43<61:21:55, 10.78s/it]
 46%|████▌     | 17475/37963 [42:57:51<56:21:36,  9.90s/it]
 46%|████▌     | 17476/37963 [42:57:59<52:41:30,  9.26s/it]
 46%|████▌     | 17477/37963 [42:58:06<50:12:08,  8.82s/it]
 46%|████▌     | 17478/37963 [42:58:14<48:23:46,  8.51s/it]
 46%|████▌     | 17479/37963 [42:58:22<47:03:24,  8.27s/it]
 46%|████▌     | 17480/37963 [42:58:37<58:09:28, 10.22s/it]
                                                           
{'loss': '0.1665', 'grad_norm': '1.453', 'learning_rate': '1.176e-05', 'epoch': '0.4604'}
+
 46%|████▌     | 17480/37963 [42:58:37<58:09:28, 10.22s/it]
 46%|████▌     | 17481/37963 [42:58:44<54:01:04,  9.49s/it]
 46%|████▌     | 17482/37963 [42:58:59<62:40:59, 11.02s/it]
 46%|████▌     | 17483/37963 [42:59:07<57:10:10, 10.05s/it]
 46%|████▌     | 17484/37963 [42:59:15<53:07:20,  9.34s/it]
 46%|████▌     | 17485/37963 [42:59:22<49:44:40,  8.75s/it]
 46%|████▌     | 17486/37963 [42:59:29<47:36:20,  8.37s/it]
 46%|████▌     | 17487/37963 [42:59:37<46:20:06,  8.15s/it]
 46%|████▌     | 17488/37963 [42:59:45<45:30:12,  8.00s/it]
 46%|████▌     | 17489/37963 [42:59:52<44:44:48,  7.87s/it]
 46%|████▌     | 17490/37963 [43:00:00<44:27:29,  7.82s/it]
                                                           
{'loss': '0.1396', 'grad_norm': '1.026', 'learning_rate': '1.175e-05', 'epoch': '0.4607'}
+
 46%|████▌     | 17490/37963 [43:00:00<44:27:29,  7.82s/it]
 46%|████▌     | 17491/37963 [43:00:08<44:11:37,  7.77s/it]
 46%|████▌     | 17492/37963 [43:00:15<43:57:14,  7.73s/it]
 46%|████▌     | 17493/37963 [43:00:23<44:01:40,  7.74s/it]
 46%|████▌     | 17494/37963 [43:00:31<43:49:56,  7.71s/it]
 46%|████▌     | 17495/37963 [43:00:38<43:43:30,  7.69s/it]
 46%|████▌     | 17496/37963 [43:00:46<43:35:42,  7.67s/it]
 46%|████▌     | 17497/37963 [43:00:53<43:10:23,  7.59s/it]
 46%|████▌     | 17498/37963 [43:01:01<43:26:47,  7.64s/it]
 46%|████▌     | 17499/37963 [43:01:09<43:40:24,  7.68s/it]
 46%|████▌     | 17500/37963 [43:01:16<43:33:51,  7.66s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '3.692', 'learning_rate': '1.174e-05', 'epoch': '0.461'}
+
 46%|████▌     | 17500/37963 [43:01:16<43:33:51,  7.66s/it]
 46%|████▌     | 17501/37963 [43:01:24<43:38:43,  7.68s/it]
 46%|████▌     | 17502/37963 [43:01:32<43:34:38,  7.67s/it]
 46%|████▌     | 17503/37963 [43:01:40<43:55:47,  7.73s/it]
 46%|████▌     | 17504/37963 [43:01:47<43:20:14,  7.63s/it]
 46%|████▌     | 17505/37963 [43:01:55<43:14:02,  7.61s/it]
 46%|████▌     | 17506/37963 [43:02:10<56:11:39,  9.89s/it]
 46%|████▌     | 17507/37963 [43:02:17<52:11:57,  9.19s/it]
 46%|████▌     | 17508/37963 [43:02:25<49:31:33,  8.72s/it]
 46%|████▌     | 17509/37963 [43:02:33<47:25:36,  8.35s/it]
 46%|████▌     | 17510/37963 [43:02:40<46:16:28,  8.14s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '3.138', 'learning_rate': '1.173e-05', 'epoch': '0.4612'}
+
 46%|████▌     | 17510/37963 [43:02:40<46:16:28,  8.14s/it]
 46%|████▌     | 17511/37963 [43:02:48<45:41:27,  8.04s/it]
 46%|████▌     | 17512/37963 [43:02:56<44:50:37,  7.89s/it]
 46%|████▌     | 17513/37963 [43:03:10<55:12:40,  9.72s/it]
 46%|████▌     | 17514/37963 [43:03:17<51:45:28,  9.11s/it]
 46%|████▌     | 17515/37963 [43:03:25<49:02:37,  8.63s/it]
 46%|████▌     | 17516/37963 [43:03:32<47:32:50,  8.37s/it]
 46%|████▌     | 17517/37963 [43:03:40<46:00:32,  8.10s/it]
 46%|████▌     | 17518/37963 [43:03:55<57:45:40, 10.17s/it]
 46%|████▌     | 17519/37963 [43:04:09<64:15:48, 11.32s/it]
 46%|████▌     | 17520/37963 [43:04:17<58:18:18, 10.27s/it]
                                                           
{'loss': '0.145', 'grad_norm': '1.87', 'learning_rate': '1.172e-05', 'epoch': '0.4615'}
+
 46%|████▌     | 17520/37963 [43:04:17<58:18:18, 10.27s/it]
 46%|████▌     | 17521/37963 [43:04:24<53:44:22,  9.46s/it]
 46%|████▌     | 17522/37963 [43:04:32<50:12:02,  8.84s/it]
 46%|████▌     | 17523/37963 [43:04:40<48:26:09,  8.53s/it]
 46%|████▌     | 17524/37963 [43:04:54<58:07:14, 10.24s/it]
 46%|████▌     | 17525/37963 [43:05:01<53:47:49,  9.48s/it]
 46%|████▌     | 17526/37963 [43:05:16<61:50:29, 10.89s/it]
 46%|████▌     | 17527/37963 [43:05:30<68:27:55, 12.06s/it]
 46%|████▌     | 17528/37963 [43:05:38<60:54:27, 10.73s/it]
 46%|████▌     | 17529/37963 [43:05:45<55:14:40,  9.73s/it]
 46%|████▌     | 17530/37963 [43:06:00<63:12:48, 11.14s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '1.346', 'learning_rate': '1.172e-05', 'epoch': '0.4618'}
+
 46%|████▌     | 17530/37963 [43:06:00<63:12:48, 11.14s/it]
 46%|████▌     | 17531/37963 [43:06:08<57:28:53, 10.13s/it]
 46%|████▌     | 17532/37963 [43:06:16<53:35:16,  9.44s/it]
 46%|████▌     | 17533/37963 [43:06:23<50:38:18,  8.92s/it]
 46%|████▌     | 17534/37963 [43:06:31<48:25:07,  8.53s/it]
 46%|████▌     | 17535/37963 [43:06:38<46:24:24,  8.18s/it]
 46%|████▌     | 17536/37963 [43:06:46<45:38:33,  8.04s/it]
 46%|████▌     | 17537/37963 [43:06:54<45:03:35,  7.94s/it]
 46%|████▌     | 17538/37963 [43:07:01<44:48:59,  7.90s/it]
 46%|████▌     | 17539/37963 [43:07:09<44:29:27,  7.84s/it]
 46%|████▌     | 17540/37963 [43:07:17<44:17:36,  7.81s/it]
                                                           
{'loss': '0.15', 'grad_norm': '1.816', 'learning_rate': '1.171e-05', 'epoch': '0.462'}
+
 46%|████▌     | 17540/37963 [43:07:17<44:17:36,  7.81s/it]
 46%|████▌     | 17541/37963 [43:07:24<43:49:57,  7.73s/it]
 46%|████▌     | 17542/37963 [43:07:32<43:46:10,  7.72s/it]
 46%|████▌     | 17543/37963 [43:07:40<43:40:49,  7.70s/it]
 46%|████▌     | 17544/37963 [43:07:48<43:48:42,  7.72s/it]
 46%|████▌     | 17545/37963 [43:07:55<43:49:05,  7.73s/it]
 46%|████▌     | 17546/37963 [43:08:03<43:36:24,  7.69s/it]
 46%|████▌     | 17547/37963 [43:08:10<43:28:20,  7.67s/it]
 46%|████▌     | 17548/37963 [43:08:18<43:35:44,  7.69s/it]
 46%|████▌     | 17549/37963 [43:08:26<43:15:02,  7.63s/it]
 46%|████▌     | 17550/37963 [43:08:33<43:03:25,  7.59s/it]
                                                           
{'loss': '0.1436', 'grad_norm': '2.398', 'learning_rate': '1.17e-05', 'epoch': '0.4623'}
+
 46%|████▌     | 17550/37963 [43:08:33<43:03:25,  7.59s/it]
 46%|████▌     | 17551/37963 [43:08:41<43:05:01,  7.60s/it]
 46%|████▌     | 17552/37963 [43:08:49<43:14:23,  7.63s/it]
 46%|████▌     | 17553/37963 [43:08:56<43:15:17,  7.63s/it]
 46%|████▌     | 17554/37963 [43:09:11<55:34:13,  9.80s/it]
 46%|████▌     | 17555/37963 [43:09:19<52:04:43,  9.19s/it]
 46%|████▌     | 17556/37963 [43:09:26<49:30:50,  8.73s/it]
 46%|████▌     | 17557/37963 [43:09:34<47:35:39,  8.40s/it]
 46%|████▋     | 17558/37963 [43:09:42<46:26:31,  8.19s/it]
 46%|████▋     | 17559/37963 [43:09:49<45:13:10,  7.98s/it]
 46%|████▋     | 17560/37963 [43:09:57<44:48:59,  7.91s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '2.36', 'learning_rate': '1.169e-05', 'epoch': '0.4626'}
+
 46%|████▋     | 17560/37963 [43:09:57<44:48:59,  7.91s/it]
 46%|████▋     | 17561/37963 [43:10:12<56:06:31,  9.90s/it]
 46%|████▋     | 17562/37963 [43:10:19<52:36:43,  9.28s/it]
 46%|████▋     | 17563/37963 [43:10:27<49:50:52,  8.80s/it]
 46%|████▋     | 17564/37963 [43:10:35<48:03:41,  8.48s/it]
 46%|████▋     | 17565/37963 [43:10:42<46:29:04,  8.20s/it]
 46%|████▋     | 17566/37963 [43:10:50<45:35:06,  8.05s/it]
 46%|████▋     | 17567/37963 [43:11:05<56:33:18,  9.98s/it]
 46%|████▋     | 17568/37963 [43:11:20<65:29:47, 11.56s/it]
 46%|████▋     | 17569/37963 [43:11:28<59:08:21, 10.44s/it]
 46%|████▋     | 17570/37963 [43:11:35<54:25:28,  9.61s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '2.496', 'learning_rate': '1.168e-05', 'epoch': '0.4628'}
+
 46%|████▋     | 17570/37963 [43:11:35<54:25:28,  9.61s/it]
 46%|████▋     | 17571/37963 [43:11:43<51:08:55,  9.03s/it]
 46%|████▋     | 17572/37963 [43:11:57<59:27:13, 10.50s/it]
 46%|████▋     | 17573/37963 [43:12:11<66:09:20, 11.68s/it]
 46%|████▋     | 17574/37963 [43:12:19<59:19:24, 10.47s/it]
 46%|████▋     | 17575/37963 [43:12:34<66:48:28, 11.80s/it]
 46%|████▋     | 17576/37963 [43:12:41<59:40:22, 10.54s/it]
 46%|████▋     | 17577/37963 [43:12:49<55:02:39,  9.72s/it]
 46%|████▋     | 17578/37963 [43:13:04<63:16:24, 11.17s/it]
 46%|████▋     | 17579/37963 [43:13:11<57:13:13, 10.11s/it]
 46%|████▋     | 17580/37963 [43:13:19<53:16:57,  9.41s/it]
                                                           
{'loss': '0.1557', 'grad_norm': '2.38', 'learning_rate': '1.167e-05', 'epoch': '0.4631'}
+
 46%|████▋     | 17580/37963 [43:13:19<53:16:57,  9.41s/it]
 46%|████▋     | 17581/37963 [43:13:27<50:21:38,  8.90s/it]
 46%|████▋     | 17582/37963 [43:13:35<48:15:27,  8.52s/it]
 46%|████▋     | 17583/37963 [43:13:42<46:23:45,  8.20s/it]
 46%|████▋     | 17584/37963 [43:13:50<45:25:56,  8.03s/it]
 46%|████▋     | 17585/37963 [43:13:57<44:42:07,  7.90s/it]
 46%|████▋     | 17586/37963 [43:14:05<44:13:36,  7.81s/it]
 46%|████▋     | 17587/37963 [43:14:12<43:24:58,  7.67s/it]
 46%|████▋     | 17588/37963 [43:14:20<42:57:10,  7.59s/it]
 46%|████▋     | 17589/37963 [43:14:27<42:57:40,  7.59s/it]
 46%|████▋     | 17590/37963 [43:14:35<43:15:47,  7.64s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '4.096', 'learning_rate': '1.167e-05', 'epoch': '0.4633'}
+
 46%|████▋     | 17590/37963 [43:14:35<43:15:47,  7.64s/it]
 46%|████▋     | 17591/37963 [43:14:42<42:59:13,  7.60s/it]
 46%|████▋     | 17592/37963 [43:14:50<43:15:50,  7.65s/it]
 46%|████▋     | 17593/37963 [43:14:58<43:24:04,  7.67s/it]
 46%|████▋     | 17594/37963 [43:15:06<43:27:54,  7.68s/it]
 46%|████▋     | 17595/37963 [43:15:13<43:23:55,  7.67s/it]
 46%|████▋     | 17596/37963 [43:15:21<43:36:30,  7.71s/it]
 46%|████▋     | 17597/37963 [43:15:29<43:22:12,  7.67s/it]
 46%|████▋     | 17598/37963 [43:15:43<55:22:35,  9.79s/it]
 46%|████▋     | 17599/37963 [43:15:51<51:55:24,  9.18s/it]
 46%|████▋     | 17600/37963 [43:15:59<49:03:13,  8.67s/it]
                                                           
{'loss': '0.1425', 'grad_norm': '1.131', 'learning_rate': '1.166e-05', 'epoch': '0.4636'}
+
 46%|████▋     | 17600/37963 [43:15:59<49:03:13,  8.67s/it]
 46%|████▋     | 17601/37963 [43:16:06<47:02:10,  8.32s/it]
 46%|████▋     | 17602/37963 [43:16:14<45:46:00,  8.09s/it]
 46%|████▋     | 17603/37963 [43:16:22<45:16:41,  8.01s/it]
 46%|████▋     | 17604/37963 [43:16:29<44:39:32,  7.90s/it]
 46%|████▋     | 17605/37963 [43:16:37<44:23:59,  7.85s/it]
 46%|████▋     | 17606/37963 [43:16:44<43:44:29,  7.74s/it]
 46%|████▋     | 17607/37963 [43:16:59<54:55:18,  9.71s/it]
 46%|████▋     | 17608/37963 [43:17:06<51:31:10,  9.11s/it]
 46%|████▋     | 17609/37963 [43:17:14<49:23:14,  8.74s/it]
 46%|████▋     | 17610/37963 [43:17:22<47:33:26,  8.41s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '1.6', 'learning_rate': '1.165e-05', 'epoch': '0.4639'}
+
 46%|████▋     | 17610/37963 [43:17:22<47:33:26,  8.41s/it]
 46%|████▋     | 17611/37963 [43:17:30<46:23:11,  8.21s/it]
 46%|████▋     | 17612/37963 [43:17:37<45:33:08,  8.06s/it]
 46%|████▋     | 17613/37963 [43:17:45<44:30:49,  7.87s/it]
 46%|████▋     | 17614/37963 [43:17:53<44:24:01,  7.86s/it]
 46%|████▋     | 17615/37963 [43:18:00<43:34:06,  7.71s/it]
 46%|████▋     | 17616/37963 [43:18:14<54:28:58,  9.64s/it]
 46%|████▋     | 17617/37963 [43:18:22<51:22:24,  9.09s/it]
 46%|████▋     | 17618/37963 [43:18:29<48:44:44,  8.63s/it]
 46%|████▋     | 17619/37963 [43:18:37<47:05:44,  8.33s/it]
 46%|████▋     | 17620/37963 [43:18:51<57:04:10, 10.10s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '3.424', 'learning_rate': '1.164e-05', 'epoch': '0.4641'}
+
 46%|████▋     | 17620/37963 [43:18:51<57:04:10, 10.10s/it]
 46%|████▋     | 17621/37963 [43:19:06<64:48:44, 11.47s/it]
 46%|████▋     | 17622/37963 [43:19:14<58:31:58, 10.36s/it]
 46%|████▋     | 17623/37963 [43:19:35<77:07:41, 13.65s/it]
 46%|████▋     | 17624/37963 [43:19:43<66:59:46, 11.86s/it]
 46%|████▋     | 17625/37963 [43:19:58<72:05:14, 12.76s/it]
 46%|████▋     | 17626/37963 [43:20:05<62:57:11, 11.14s/it]
 46%|████▋     | 17627/37963 [43:20:12<56:34:10, 10.01s/it]
 46%|████▋     | 17628/37963 [43:20:20<52:36:34,  9.31s/it]
 46%|████▋     | 17629/37963 [43:20:28<49:42:05,  8.80s/it]
 46%|████▋     | 17630/37963 [43:20:35<47:20:24,  8.38s/it]
                                                           
{'loss': '0.146', 'grad_norm': '3.002', 'learning_rate': '1.163e-05', 'epoch': '0.4644'}
+
 46%|████▋     | 17630/37963 [43:20:35<47:20:24,  8.38s/it]
 46%|████▋     | 17631/37963 [43:20:43<45:49:39,  8.11s/it]
 46%|████▋     | 17632/37963 [43:20:50<45:07:28,  7.99s/it]
 46%|████▋     | 17633/37963 [43:20:58<44:29:10,  7.88s/it]
 46%|████▋     | 17634/37963 [43:21:05<44:01:34,  7.80s/it]
 46%|████▋     | 17635/37963 [43:21:13<43:55:49,  7.78s/it]
 46%|████▋     | 17636/37963 [43:21:21<43:48:40,  7.76s/it]
 46%|████▋     | 17637/37963 [43:21:29<43:45:50,  7.75s/it]
 46%|████▋     | 17638/37963 [43:21:36<43:36:42,  7.72s/it]
 46%|████▋     | 17639/37963 [43:21:44<43:15:10,  7.66s/it]
 46%|████▋     | 17640/37963 [43:21:52<43:19:38,  7.67s/it]
                                                           
{'loss': '0.1548', 'grad_norm': '1.22', 'learning_rate': '1.162e-05', 'epoch': '0.4647'}
+
 46%|████▋     | 17640/37963 [43:21:52<43:19:38,  7.67s/it]
 46%|████▋     | 17641/37963 [43:21:59<43:23:39,  7.69s/it]
 46%|████▋     | 17642/37963 [43:22:07<43:24:59,  7.69s/it]
 46%|████▋     | 17643/37963 [43:22:15<43:21:24,  7.68s/it]
 46%|████▋     | 17644/37963 [43:22:22<43:30:54,  7.71s/it]
 46%|████▋     | 17645/37963 [43:22:30<43:16:14,  7.67s/it]
 46%|████▋     | 17646/37963 [43:22:38<43:34:45,  7.72s/it]
 46%|████▋     | 17647/37963 [43:22:46<43:33:46,  7.72s/it]
 46%|████▋     | 17648/37963 [43:22:53<42:47:06,  7.58s/it]
 46%|████▋     | 17649/37963 [43:23:01<43:02:02,  7.63s/it]
 46%|████▋     | 17650/37963 [43:23:15<55:16:04,  9.79s/it]
                                                           
{'loss': '0.152', 'grad_norm': '2.689', 'learning_rate': '1.162e-05', 'epoch': '0.4649'}
+
 46%|████▋     | 17650/37963 [43:23:15<55:16:04,  9.79s/it]
 46%|████▋     | 17651/37963 [43:23:23<51:48:01,  9.18s/it]
 46%|████▋     | 17652/37963 [43:23:31<49:18:32,  8.74s/it]
 47%|████▋     | 17653/37963 [43:23:38<47:20:45,  8.39s/it]
 47%|████▋     | 17654/37963 [43:23:46<46:04:40,  8.17s/it]
 47%|████▋     | 17655/37963 [43:24:01<56:48:00, 10.07s/it]
 47%|████▋     | 17656/37963 [43:24:08<52:21:12,  9.28s/it]
 47%|████▋     | 17657/37963 [43:24:16<49:36:43,  8.80s/it]
 47%|████▋     | 17658/37963 [43:24:23<47:44:17,  8.46s/it]
 47%|████▋     | 17659/37963 [43:24:31<46:30:26,  8.25s/it]
 47%|████▋     | 17660/37963 [43:24:39<45:14:40,  8.02s/it]
                                                           
{'loss': '0.1634', 'grad_norm': '1.893', 'learning_rate': '1.161e-05', 'epoch': '0.4652'}
+
 47%|████▋     | 17660/37963 [43:24:39<45:14:40,  8.02s/it]
 47%|████▋     | 17661/37963 [43:24:46<44:37:37,  7.91s/it]
 47%|████▋     | 17662/37963 [43:24:54<44:10:14,  7.83s/it]
 47%|████▋     | 17663/37963 [43:25:02<43:51:12,  7.78s/it]
 47%|████▋     | 17664/37963 [43:25:16<54:30:59,  9.67s/it]
 47%|████▋     | 17665/37963 [43:25:23<50:33:07,  8.97s/it]
 47%|████▋     | 17666/37963 [43:25:31<48:22:58,  8.58s/it]
 47%|████▋     | 17667/37963 [43:25:38<46:31:51,  8.25s/it]
 47%|████▋     | 17668/37963 [43:25:46<45:23:54,  8.05s/it]
 47%|████▋     | 17669/37963 [43:26:00<56:10:47,  9.97s/it]
 47%|████▋     | 17670/37963 [43:26:08<52:04:42,  9.24s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '2.392', 'learning_rate': '1.16e-05', 'epoch': '0.4655'}
+
 47%|████▋     | 17670/37963 [43:26:08<52:04:42,  9.24s/it]
 47%|████▋     | 17671/37963 [43:26:22<60:13:43, 10.69s/it]
 47%|████▋     | 17672/37963 [43:26:29<54:58:00,  9.75s/it]
 47%|████▋     | 17673/37963 [43:26:44<63:48:07, 11.32s/it]
 47%|████▋     | 17674/37963 [43:26:52<57:12:59, 10.15s/it]
 47%|████▋     | 17675/37963 [43:27:06<64:56:49, 11.52s/it]
 47%|████▋     | 17676/37963 [43:27:14<58:34:02, 10.39s/it]
 47%|████▋     | 17677/37963 [43:27:28<64:51:26, 11.51s/it]
 47%|████▋     | 17678/37963 [43:27:36<58:27:42, 10.38s/it]
 47%|████▋     | 17679/37963 [43:27:44<54:06:58,  9.60s/it]
 47%|████▋     | 17680/37963 [43:27:51<50:34:12,  8.98s/it]
                                                           
{'loss': '0.1556', 'grad_norm': '1.885', 'learning_rate': '1.159e-05', 'epoch': '0.4657'}
+
 47%|████▋     | 17680/37963 [43:27:51<50:34:12,  8.98s/it]
 47%|████▋     | 17681/37963 [43:27:59<48:28:19,  8.60s/it]
 47%|████▋     | 17682/37963 [43:28:07<46:46:27,  8.30s/it]
 47%|████▋     | 17683/37963 [43:28:14<45:39:54,  8.11s/it]
 47%|████▋     | 17684/37963 [43:28:22<45:02:15,  8.00s/it]
 47%|████▋     | 17685/37963 [43:28:30<44:29:43,  7.90s/it]
 47%|████▋     | 17686/37963 [43:28:37<44:08:26,  7.84s/it]
 47%|████▋     | 17687/37963 [43:28:45<43:47:03,  7.77s/it]
 47%|████▋     | 17688/37963 [43:28:53<43:33:52,  7.74s/it]
 47%|████▋     | 17689/37963 [43:29:00<43:31:58,  7.73s/it]
 47%|████▋     | 17690/37963 [43:29:08<43:22:05,  7.70s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '1.601', 'learning_rate': '1.158e-05', 'epoch': '0.466'}
+
 47%|████▋     | 17690/37963 [43:29:08<43:22:05,  7.70s/it]
 47%|████▋     | 17691/37963 [43:29:16<43:22:23,  7.70s/it]
 47%|████▋     | 17692/37963 [43:29:24<43:25:49,  7.71s/it]
 47%|████▋     | 17693/37963 [43:29:38<54:09:38,  9.62s/it]
 47%|████▋     | 17694/37963 [43:29:45<50:35:30,  8.99s/it]
 47%|████▋     | 17695/37963 [43:29:53<48:24:47,  8.60s/it]
 47%|████▋     | 17696/37963 [43:30:00<46:46:30,  8.31s/it]
 47%|████▋     | 17697/37963 [43:30:08<45:42:11,  8.12s/it]
 47%|████▋     | 17698/37963 [43:30:16<44:31:32,  7.91s/it]
 47%|████▋     | 17699/37963 [43:30:30<55:22:51,  9.84s/it]
 47%|████▋     | 17700/37963 [43:30:37<51:20:15,  9.12s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '3.734', 'learning_rate': '1.157e-05', 'epoch': '0.4662'}
+
 47%|████▋     | 17700/37963 [43:30:37<51:20:15,  9.12s/it]
 47%|████▋     | 17701/37963 [43:30:45<48:24:16,  8.60s/it]
 47%|████▋     | 17702/37963 [43:30:52<46:47:54,  8.32s/it]
 47%|████▋     | 17703/37963 [43:31:00<45:45:18,  8.13s/it]
 47%|████▋     | 17704/37963 [43:31:08<45:00:30,  8.00s/it]
 47%|████▋     | 17705/37963 [43:31:15<43:52:11,  7.80s/it]
 47%|████▋     | 17706/37963 [43:31:23<43:38:35,  7.76s/it]
 47%|████▋     | 17707/37963 [43:31:30<43:28:19,  7.73s/it]
 47%|████▋     | 17708/37963 [43:31:38<43:30:55,  7.73s/it]
 47%|████▋     | 17709/37963 [43:31:46<43:26:16,  7.72s/it]
 47%|████▋     | 17710/37963 [43:31:54<43:49:13,  7.79s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '1.421', 'learning_rate': '1.157e-05', 'epoch': '0.4665'}
+
 47%|████▋     | 17710/37963 [43:31:54<43:49:13,  7.79s/it]
 47%|████▋     | 17711/37963 [43:32:02<43:48:46,  7.79s/it]
 47%|████▋     | 17712/37963 [43:32:16<54:48:06,  9.74s/it]
 47%|████▋     | 17713/37963 [43:32:31<63:47:51, 11.34s/it]
 47%|████▋     | 17714/37963 [43:32:39<57:35:27, 10.24s/it]
 47%|████▋     | 17715/37963 [43:32:46<52:45:29,  9.38s/it]
 47%|████▋     | 17716/37963 [43:32:54<49:57:16,  8.88s/it]
 47%|████▋     | 17717/37963 [43:33:01<48:00:08,  8.54s/it]
 47%|████▋     | 17718/37963 [43:33:09<46:37:32,  8.29s/it]
 47%|████▋     | 17719/37963 [43:33:17<45:36:56,  8.11s/it]
 47%|████▋     | 17720/37963 [43:33:24<44:49:00,  7.97s/it]
                                                           
{'loss': '0.1503', 'grad_norm': '1.151', 'learning_rate': '1.156e-05', 'epoch': '0.4668'}
+
 47%|████▋     | 17720/37963 [43:33:24<44:49:00,  7.97s/it]
 47%|████▋     | 17721/37963 [43:33:46<67:26:48, 12.00s/it]
 47%|████▋     | 17722/37963 [43:33:54<60:12:17, 10.71s/it]
 47%|████▋     | 17723/37963 [43:34:01<54:52:25,  9.76s/it]
 47%|████▋     | 17724/37963 [43:34:09<51:22:24,  9.14s/it]
 47%|████▋     | 17725/37963 [43:34:16<48:53:44,  8.70s/it]
 47%|████▋     | 17726/37963 [43:34:31<58:29:38, 10.41s/it]
 47%|████▋     | 17727/37963 [43:34:39<53:52:18,  9.58s/it]
 47%|████▋     | 17728/37963 [43:34:46<50:39:03,  9.01s/it]
 47%|████▋     | 17729/37963 [43:35:01<60:04:18, 10.69s/it]
 47%|████▋     | 17730/37963 [43:35:08<54:47:37,  9.75s/it]
                                                           
{'loss': '0.1487', 'grad_norm': '4.593', 'learning_rate': '1.155e-05', 'epoch': '0.467'}
+
 47%|████▋     | 17730/37963 [43:35:08<54:47:37,  9.75s/it]
 47%|████▋     | 17731/37963 [43:35:16<50:49:09,  9.04s/it]
 47%|████▋     | 17732/37963 [43:35:23<48:26:22,  8.62s/it]
 47%|████▋     | 17733/37963 [43:35:31<46:46:45,  8.32s/it]
 47%|████▋     | 17734/37963 [43:35:39<45:35:08,  8.11s/it]
 47%|████▋     | 17735/37963 [43:35:46<44:55:53,  8.00s/it]
 47%|████▋     | 17736/37963 [43:35:54<44:26:14,  7.91s/it]
 47%|████▋     | 17737/37963 [43:36:02<44:12:56,  7.87s/it]
 47%|████▋     | 17738/37963 [43:36:10<44:30:10,  7.92s/it]
 47%|████▋     | 17739/37963 [43:36:18<44:13:54,  7.87s/it]
 47%|████▋     | 17740/37963 [43:36:32<55:39:48,  9.91s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '1.548', 'learning_rate': '1.154e-05', 'epoch': '0.4673'}
+
 47%|████▋     | 17740/37963 [43:36:32<55:39:48,  9.91s/it]
 47%|████▋     | 17741/37963 [43:36:40<51:34:55,  9.18s/it]
 47%|████▋     | 17742/37963 [43:36:54<59:54:34, 10.67s/it]
 47%|████▋     | 17743/37963 [43:37:01<54:34:34,  9.72s/it]
 47%|████▋     | 17744/37963 [43:37:09<51:06:14,  9.10s/it]
 47%|████▋     | 17745/37963 [43:37:17<48:42:33,  8.67s/it]
 47%|████▋     | 17746/37963 [43:37:24<47:05:43,  8.39s/it]
 47%|████▋     | 17747/37963 [43:37:32<45:43:33,  8.14s/it]
 47%|████▋     | 17748/37963 [43:37:40<45:38:25,  8.13s/it]
 47%|████▋     | 17749/37963 [43:37:48<45:24:49,  8.09s/it]
 47%|████▋     | 17750/37963 [43:37:56<44:41:47,  7.96s/it]
                                                           
{'loss': '0.1418', 'grad_norm': '1.301', 'learning_rate': '1.153e-05', 'epoch': '0.4676'}
+
 47%|████▋     | 17750/37963 [43:37:56<44:41:47,  7.96s/it]
 47%|████▋     | 17751/37963 [43:38:03<44:13:46,  7.88s/it]
 47%|████▋     | 17752/37963 [43:38:11<44:00:25,  7.84s/it]
 47%|████▋     | 17753/37963 [43:38:19<43:38:15,  7.77s/it]
 47%|████▋     | 17754/37963 [43:38:27<43:27:50,  7.74s/it]
 47%|████▋     | 17755/37963 [43:38:34<43:17:41,  7.71s/it]
 47%|████▋     | 17756/37963 [43:38:42<43:16:56,  7.71s/it]
 47%|████▋     | 17757/37963 [43:38:50<43:19:04,  7.72s/it]
 47%|████▋     | 17758/37963 [43:38:57<43:20:35,  7.72s/it]
 47%|████▋     | 17759/37963 [43:39:05<43:07:06,  7.68s/it]
 47%|████▋     | 17760/37963 [43:39:19<54:11:44,  9.66s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '2.334', 'learning_rate': '1.152e-05', 'epoch': '0.4678'}
+
 47%|████▋     | 17760/37963 [43:39:19<54:11:44,  9.66s/it]
 47%|████▋     | 17761/37963 [43:39:27<50:49:13,  9.06s/it]
 47%|████▋     | 17762/37963 [43:39:35<48:27:49,  8.64s/it]
 47%|████▋     | 17763/37963 [43:39:42<46:43:46,  8.33s/it]
 47%|████▋     | 17764/37963 [43:39:57<56:54:37, 10.14s/it]
 47%|████▋     | 17765/37963 [43:40:11<64:26:53, 11.49s/it]
 47%|████▋     | 17766/37963 [43:40:19<58:20:12, 10.40s/it]
 47%|████▋     | 17767/37963 [43:40:27<53:38:21,  9.56s/it]
 47%|████▋     | 17768/37963 [43:40:34<50:08:37,  8.94s/it]
 47%|████▋     | 17769/37963 [43:40:42<48:01:35,  8.56s/it]
 47%|████▋     | 17770/37963 [43:40:49<46:33:50,  8.30s/it]
                                                           
{'loss': '0.1448', 'grad_norm': '1.351', 'learning_rate': '1.151e-05', 'epoch': '0.4681'}
+
 47%|████▋     | 17770/37963 [43:40:49<46:33:50,  8.30s/it]
 47%|████▋     | 17771/37963 [43:40:57<45:35:13,  8.13s/it]
 47%|████▋     | 17772/37963 [43:41:11<55:55:36,  9.97s/it]
 47%|████▋     | 17773/37963 [43:41:34<76:28:27, 13.64s/it]
 47%|████▋     | 17774/37963 [43:41:41<66:33:24, 11.87s/it]
 47%|████▋     | 17775/37963 [43:41:49<59:53:57, 10.68s/it]
 47%|████▋     | 17776/37963 [43:41:57<54:49:19,  9.78s/it]
 47%|████▋     | 17777/37963 [43:42:05<51:15:48,  9.14s/it]
 47%|████▋     | 17778/37963 [43:42:12<48:31:04,  8.65s/it]
 47%|████▋     | 17779/37963 [43:42:20<47:13:28,  8.42s/it]
 47%|████▋     | 17780/37963 [43:42:28<45:45:07,  8.16s/it]
                                                           
{'loss': '0.1556', 'grad_norm': '0.9229', 'learning_rate': '1.151e-05', 'epoch': '0.4684'}
+
 47%|████▋     | 17780/37963 [43:42:28<45:45:07,  8.16s/it]
 47%|████▋     | 17781/37963 [43:42:35<44:54:05,  8.01s/it]
 47%|████▋     | 17782/37963 [43:42:43<44:23:14,  7.92s/it]
 47%|████▋     | 17783/37963 [43:42:51<44:03:38,  7.86s/it]
 47%|████▋     | 17784/37963 [43:42:58<43:39:59,  7.79s/it]
 47%|████▋     | 17785/37963 [43:43:06<43:32:19,  7.77s/it]
 47%|████▋     | 17786/37963 [43:43:21<55:24:57,  9.89s/it]
 47%|████▋     | 17787/37963 [43:43:28<51:12:13,  9.14s/it]
 47%|████▋     | 17788/37963 [43:43:36<48:39:56,  8.68s/it]
 47%|████▋     | 17789/37963 [43:43:44<47:21:16,  8.45s/it]
 47%|████▋     | 17790/37963 [43:43:58<56:49:14, 10.14s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '4.421', 'learning_rate': '1.15e-05', 'epoch': '0.4686'}
+
 47%|████▋     | 17790/37963 [43:43:58<56:49:14, 10.14s/it]
 47%|████▋     | 17791/37963 [43:44:06<53:06:11,  9.48s/it]
 47%|████▋     | 17792/37963 [43:44:14<50:13:19,  8.96s/it]
 47%|████▋     | 17793/37963 [43:44:21<48:05:57,  8.58s/it]
 47%|████▋     | 17794/37963 [43:44:29<46:22:09,  8.28s/it]
 47%|████▋     | 17795/37963 [43:44:36<45:19:56,  8.09s/it]
 47%|████▋     | 17796/37963 [43:44:44<44:39:04,  7.97s/it]
 47%|████▋     | 17797/37963 [43:44:52<44:00:25,  7.86s/it]
 47%|████▋     | 17798/37963 [43:44:59<43:38:38,  7.79s/it]
 47%|████▋     | 17799/37963 [43:45:07<43:32:11,  7.77s/it]
 47%|████▋     | 17800/37963 [43:45:15<43:15:17,  7.72s/it]
                                                           
{'loss': '0.1658', 'grad_norm': '3.243', 'learning_rate': '1.149e-05', 'epoch': '0.4689'}
+
 47%|████▋     | 17800/37963 [43:45:15<43:15:17,  7.72s/it]
 47%|████▋     | 17801/37963 [43:45:22<43:02:42,  7.69s/it]
 47%|████▋     | 17802/37963 [43:45:30<43:02:38,  7.69s/it]
 47%|████▋     | 17803/37963 [43:45:37<42:37:04,  7.61s/it]
 47%|████▋     | 17804/37963 [43:45:45<42:46:17,  7.64s/it]
 47%|████▋     | 17805/37963 [43:45:53<42:47:32,  7.64s/it]
 47%|████▋     | 17806/37963 [43:46:00<42:22:08,  7.57s/it]
 47%|████▋     | 17807/37963 [43:46:08<42:37:46,  7.61s/it]
 47%|████▋     | 17808/37963 [43:46:29<64:29:32, 11.52s/it]
 47%|████▋     | 17809/37963 [43:46:37<58:36:30, 10.47s/it]
 47%|████▋     | 17810/37963 [43:46:44<53:49:53,  9.62s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '0.8832', 'learning_rate': '1.148e-05', 'epoch': '0.4691'}
+
 47%|████▋     | 17810/37963 [43:46:44<53:49:53,  9.62s/it]
 47%|████▋     | 17811/37963 [43:46:59<61:54:44, 11.06s/it]
 47%|████▋     | 17812/37963 [43:47:06<55:41:02,  9.95s/it]
 47%|████▋     | 17813/37963 [43:47:14<52:14:55,  9.33s/it]
 47%|████▋     | 17814/37963 [43:47:22<49:29:32,  8.84s/it]
 47%|████▋     | 17815/37963 [43:47:29<47:37:59,  8.51s/it]
 47%|████▋     | 17816/37963 [43:47:37<46:14:38,  8.26s/it]
 47%|████▋     | 17817/37963 [43:47:45<45:13:49,  8.08s/it]
 47%|████▋     | 17818/37963 [43:48:00<56:41:19, 10.13s/it]
 47%|████▋     | 17819/37963 [43:48:07<52:31:28,  9.39s/it]
 47%|████▋     | 17820/37963 [43:48:15<49:42:47,  8.88s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '2.536', 'learning_rate': '1.147e-05', 'epoch': '0.4694'}
+
 47%|████▋     | 17820/37963 [43:48:15<49:42:47,  8.88s/it]
 47%|████▋     | 17821/37963 [43:48:30<60:21:14, 10.79s/it]
 47%|████▋     | 17822/37963 [43:48:38<55:15:53,  9.88s/it]
 47%|████▋     | 17823/37963 [43:48:46<51:29:19,  9.20s/it]
 47%|████▋     | 17824/37963 [43:48:53<48:50:03,  8.73s/it]
 47%|████▋     | 17825/37963 [43:49:07<57:22:36, 10.26s/it]
 47%|████▋     | 17826/37963 [43:49:15<53:09:02,  9.50s/it]
 47%|████▋     | 17827/37963 [43:49:22<49:57:47,  8.93s/it]
 47%|████▋     | 17828/37963 [43:49:30<47:49:17,  8.55s/it]
 47%|████▋     | 17829/37963 [43:49:37<46:00:33,  8.23s/it]
 47%|████▋     | 17830/37963 [43:49:45<44:58:50,  8.04s/it]
                                                           
{'loss': '0.1552', 'grad_norm': '1.929', 'learning_rate': '1.146e-05', 'epoch': '0.4697'}
+
 47%|████▋     | 17830/37963 [43:49:45<44:58:50,  8.04s/it]
 47%|████▋     | 17831/37963 [43:49:53<44:24:29,  7.94s/it]
 47%|████▋     | 17832/37963 [43:50:00<43:49:19,  7.84s/it]
 47%|████▋     | 17833/37963 [43:50:15<54:56:41,  9.83s/it]
 47%|████▋     | 17834/37963 [43:50:23<51:31:52,  9.22s/it]
 47%|████▋     | 17835/37963 [43:50:30<49:02:43,  8.77s/it]
 47%|████▋     | 17836/37963 [43:50:38<47:02:53,  8.42s/it]
 47%|████▋     | 17837/37963 [43:50:46<46:12:47,  8.27s/it]
 47%|████▋     | 17838/37963 [43:50:53<44:34:47,  7.97s/it]
 47%|████▋     | 17839/37963 [43:51:01<44:07:42,  7.89s/it]
 47%|████▋     | 17840/37963 [43:51:15<54:21:37,  9.73s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '2.531', 'learning_rate': '1.146e-05', 'epoch': '0.4699'}
+
 47%|████▋     | 17840/37963 [43:51:15<54:21:37,  9.73s/it]
 47%|████▋     | 17841/37963 [43:51:22<50:42:27,  9.07s/it]
 47%|████▋     | 17842/37963 [43:51:30<48:19:53,  8.65s/it]
 47%|████▋     | 17843/37963 [43:51:38<46:36:01,  8.34s/it]
 47%|████▋     | 17844/37963 [43:51:45<45:21:37,  8.12s/it]
 47%|████▋     | 17845/37963 [43:51:53<44:12:07,  7.91s/it]
 47%|████▋     | 17846/37963 [43:52:00<43:53:30,  7.85s/it]
 47%|████▋     | 17847/37963 [43:52:08<43:43:00,  7.82s/it]
 47%|████▋     | 17848/37963 [43:52:16<43:02:17,  7.70s/it]
 47%|████▋     | 17849/37963 [43:52:23<43:06:37,  7.72s/it]
 47%|████▋     | 17850/37963 [43:52:31<43:05:38,  7.71s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '1.223', 'learning_rate': '1.145e-05', 'epoch': '0.4702'}
+
 47%|████▋     | 17850/37963 [43:52:31<43:05:38,  7.71s/it]
 47%|████▋     | 17851/37963 [43:52:39<43:04:24,  7.71s/it]
 47%|████▋     | 17852/37963 [43:52:46<43:05:28,  7.71s/it]
 47%|████▋     | 17853/37963 [43:52:54<42:50:32,  7.67s/it]
 47%|████▋     | 17854/37963 [43:53:02<42:59:26,  7.70s/it]
 47%|████▋     | 17855/37963 [43:53:09<42:47:21,  7.66s/it]
 47%|████▋     | 17856/37963 [43:53:24<54:09:54,  9.70s/it]
 47%|████▋     | 17857/37963 [43:53:38<61:06:37, 10.94s/it]
 47%|████▋     | 17858/37963 [43:53:46<56:17:03, 10.08s/it]
 47%|████▋     | 17859/37963 [43:53:53<52:15:07,  9.36s/it]
 47%|████▋     | 17860/37963 [43:54:01<49:03:37,  8.79s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '1.108', 'learning_rate': '1.144e-05', 'epoch': '0.4705'}
+
 47%|████▋     | 17860/37963 [43:54:01<49:03:37,  8.79s/it]
 47%|████▋     | 17861/37963 [43:54:08<47:05:52,  8.43s/it]
 47%|████▋     | 17862/37963 [43:54:16<45:59:10,  8.24s/it]
 47%|████▋     | 17863/37963 [43:54:24<45:04:37,  8.07s/it]
 47%|████▋     | 17864/37963 [43:54:39<56:14:54, 10.07s/it]
 47%|████▋     | 17865/37963 [43:54:54<64:26:26, 11.54s/it]
 47%|████▋     | 17866/37963 [43:55:01<58:12:33, 10.43s/it]
 47%|████▋     | 17867/37963 [43:55:09<53:21:41,  9.56s/it]
 47%|████▋     | 17868/37963 [43:55:17<50:13:27,  9.00s/it]
 47%|████▋     | 17869/37963 [43:55:24<47:51:55,  8.58s/it]
 47%|████▋     | 17870/37963 [43:55:32<46:16:04,  8.29s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '1.7', 'learning_rate': '1.143e-05', 'epoch': '0.4707'}
+
 47%|████▋     | 17870/37963 [43:55:32<46:16:04,  8.29s/it]
 47%|████▋     | 17871/37963 [43:55:46<55:52:02, 10.01s/it]
 47%|████▋     | 17872/37963 [43:55:54<52:10:01,  9.35s/it]
 47%|████▋     | 17873/37963 [43:56:01<49:11:50,  8.82s/it]
 47%|████▋     | 17874/37963 [43:56:09<47:19:41,  8.48s/it]
 47%|████▋     | 17875/37963 [43:56:24<58:06:26, 10.41s/it]
 47%|████▋     | 17876/37963 [43:56:32<53:29:51,  9.59s/it]
 47%|████▋     | 17877/37963 [43:56:39<50:08:56,  8.99s/it]
 47%|████▋     | 17878/37963 [43:56:47<47:55:20,  8.59s/it]
 47%|████▋     | 17879/37963 [43:56:55<46:26:39,  8.33s/it]
 47%|████▋     | 17880/37963 [43:57:02<44:45:51,  8.02s/it]
                                                           
{'loss': '0.1425', 'grad_norm': '1.501', 'learning_rate': '1.142e-05', 'epoch': '0.471'}
+
 47%|████▋     | 17880/37963 [43:57:02<44:45:51,  8.02s/it]
 47%|████▋     | 17881/37963 [43:57:09<43:47:50,  7.85s/it]
 47%|████▋     | 17882/37963 [43:57:17<43:37:11,  7.82s/it]
 47%|████▋     | 17883/37963 [43:57:25<43:30:01,  7.80s/it]
 47%|████▋     | 17884/37963 [43:57:39<54:43:02,  9.81s/it]
 47%|████▋     | 17885/37963 [43:57:53<61:53:44, 11.10s/it]
 47%|████▋     | 17886/37963 [43:58:01<56:12:19, 10.08s/it]
 47%|████▋     | 17887/37963 [43:58:09<52:06:11,  9.34s/it]
 47%|████▋     | 17888/37963 [43:58:16<49:25:30,  8.86s/it]
 47%|████▋     | 17889/37963 [43:58:24<47:24:30,  8.50s/it]
 47%|████▋     | 17890/37963 [43:58:32<45:55:32,  8.24s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '1.547', 'learning_rate': '1.141e-05', 'epoch': '0.4712'}
+
 47%|████▋     | 17890/37963 [43:58:32<45:55:32,  8.24s/it]
 47%|████▋     | 17891/37963 [43:58:39<44:53:36,  8.05s/it]
 47%|████▋     | 17892/37963 [43:58:47<43:58:00,  7.89s/it]
 47%|████▋     | 17893/37963 [43:58:55<43:36:11,  7.82s/it]
 47%|████▋     | 17894/37963 [43:59:02<42:33:16,  7.63s/it]
 47%|████▋     | 17895/37963 [43:59:09<42:35:09,  7.64s/it]
 47%|████▋     | 17896/37963 [43:59:17<42:38:40,  7.65s/it]
 47%|████▋     | 17897/37963 [43:59:25<42:33:59,  7.64s/it]
 47%|████▋     | 17898/37963 [43:59:32<42:28:21,  7.62s/it]
 47%|████▋     | 17899/37963 [43:59:40<42:32:47,  7.63s/it]
 47%|████▋     | 17900/37963 [43:59:54<53:27:01,  9.59s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '2.157', 'learning_rate': '1.14e-05', 'epoch': '0.4715'}
+
 47%|████▋     | 17900/37963 [43:59:54<53:27:01,  9.59s/it]
 47%|████▋     | 17901/37963 [44:00:02<50:03:31,  8.98s/it]
 47%|████▋     | 17902/37963 [44:00:09<47:52:18,  8.59s/it]
 47%|████▋     | 17903/37963 [44:00:17<46:30:34,  8.35s/it]
 47%|████▋     | 17904/37963 [44:00:25<45:17:34,  8.13s/it]
 47%|████▋     | 17905/37963 [44:00:32<44:29:01,  7.98s/it]
 47%|████▋     | 17906/37963 [44:00:46<54:08:37,  9.72s/it]
 47%|████▋     | 17907/37963 [44:00:54<51:22:03,  9.22s/it]
 47%|████▋     | 17908/37963 [44:01:02<48:43:00,  8.74s/it]
 47%|████▋     | 17909/37963 [44:01:10<47:11:11,  8.47s/it]
 47%|████▋     | 17910/37963 [44:01:17<45:50:04,  8.23s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '1.341', 'learning_rate': '1.14e-05', 'epoch': '0.4718'}
+
 47%|████▋     | 17910/37963 [44:01:17<45:50:04,  8.23s/it]
 47%|████▋     | 17911/37963 [44:01:25<44:45:59,  8.04s/it]
 47%|████▋     | 17912/37963 [44:01:33<44:06:58,  7.92s/it]
 47%|████▋     | 17913/37963 [44:01:47<55:37:34,  9.99s/it]
 47%|████▋     | 17914/37963 [44:01:55<51:50:22,  9.31s/it]
 47%|████▋     | 17915/37963 [44:02:03<49:04:48,  8.81s/it]
 47%|████▋     | 17916/37963 [44:02:10<47:03:28,  8.45s/it]
 47%|████▋     | 17917/37963 [44:02:18<45:25:52,  8.16s/it]
 47%|████▋     | 17918/37963 [44:02:25<44:25:31,  7.98s/it]
 47%|████▋     | 17919/37963 [44:02:40<55:13:49,  9.92s/it]
 47%|████▋     | 17920/37963 [44:02:48<51:41:23,  9.28s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '1.981', 'learning_rate': '1.139e-05', 'epoch': '0.472'}
+
 47%|████▋     | 17920/37963 [44:02:48<51:41:23,  9.28s/it]
 47%|████▋     | 17921/37963 [44:03:02<60:44:23, 10.91s/it]
 47%|████▋     | 17922/37963 [44:03:10<55:51:53, 10.04s/it]
 47%|████▋     | 17923/37963 [44:03:18<51:32:01,  9.26s/it]
 47%|████▋     | 17924/37963 [44:03:25<48:21:18,  8.69s/it]
 47%|████▋     | 17925/37963 [44:03:39<57:13:59, 10.28s/it]
 47%|████▋     | 17926/37963 [44:03:47<52:25:29,  9.42s/it]
 47%|████▋     | 17927/37963 [44:03:54<49:21:46,  8.87s/it]
 47%|████▋     | 17928/37963 [44:04:08<58:26:50, 10.50s/it]
 47%|████▋     | 17929/37963 [44:04:16<54:18:29,  9.76s/it]
 47%|████▋     | 17930/37963 [44:04:24<50:37:10,  9.10s/it]
                                                           
{'loss': '0.1402', 'grad_norm': '1.652', 'learning_rate': '1.138e-05', 'epoch': '0.4723'}
+
 47%|████▋     | 17930/37963 [44:04:24<50:37:10,  9.10s/it]
 47%|████▋     | 17931/37963 [44:04:32<48:11:39,  8.66s/it]
 47%|████▋     | 17932/37963 [44:04:39<46:18:36,  8.32s/it]
 47%|████▋     | 17933/37963 [44:04:47<45:13:13,  8.13s/it]
 47%|████▋     | 17934/37963 [44:04:54<44:19:18,  7.97s/it]
 47%|████▋     | 17935/37963 [44:05:02<43:33:31,  7.83s/it]
 47%|████▋     | 17936/37963 [44:05:09<42:56:02,  7.72s/it]
 47%|████▋     | 17937/37963 [44:05:24<54:53:03,  9.87s/it]
 47%|████▋     | 17938/37963 [44:05:32<51:20:37,  9.23s/it]
 47%|████▋     | 17939/37963 [44:05:40<48:23:44,  8.70s/it]
 47%|████▋     | 17940/37963 [44:05:47<46:44:52,  8.40s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '1.079', 'learning_rate': '1.137e-05', 'epoch': '0.4726'}
+
 47%|████▋     | 17940/37963 [44:05:47<46:44:52,  8.40s/it]
 47%|████▋     | 17941/37963 [44:05:55<45:30:38,  8.18s/it]
 47%|████▋     | 17942/37963 [44:06:03<44:34:10,  8.01s/it]
 47%|████▋     | 17943/37963 [44:06:10<43:43:19,  7.86s/it]
 47%|████▋     | 17944/37963 [44:06:18<43:20:38,  7.79s/it]
 47%|████▋     | 17945/37963 [44:06:25<43:13:46,  7.77s/it]
 47%|████▋     | 17946/37963 [44:06:33<42:38:23,  7.67s/it]
 47%|████▋     | 17947/37963 [44:06:41<42:49:54,  7.70s/it]
 47%|████▋     | 17948/37963 [44:06:55<54:09:47,  9.74s/it]
 47%|████▋     | 17949/37963 [44:07:03<51:16:36,  9.22s/it]
 47%|████▋     | 17950/37963 [44:07:11<48:40:16,  8.76s/it]
                                                           
{'loss': '0.1669', 'grad_norm': '4.211', 'learning_rate': '1.136e-05', 'epoch': '0.4728'}
+
 47%|████▋     | 17950/37963 [44:07:11<48:40:16,  8.76s/it]
 47%|████▋     | 17951/37963 [44:07:18<46:37:40,  8.39s/it]
 47%|████▋     | 17952/37963 [44:07:26<45:24:38,  8.17s/it]
 47%|████▋     | 17953/37963 [44:07:34<44:33:38,  8.02s/it]
 47%|████▋     | 17954/37963 [44:07:48<54:54:07,  9.88s/it]
 47%|████▋     | 17955/37963 [44:07:56<51:17:37,  9.23s/it]
 47%|████▋     | 17956/37963 [44:08:03<48:46:33,  8.78s/it]
 47%|████▋     | 17957/37963 [44:08:11<46:54:28,  8.44s/it]
 47%|████▋     | 17958/37963 [44:08:18<45:18:07,  8.15s/it]
 47%|████▋     | 17959/37963 [44:08:26<44:25:14,  7.99s/it]
 47%|████▋     | 17960/37963 [44:08:34<43:53:35,  7.90s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '1.255', 'learning_rate': '1.135e-05', 'epoch': '0.4731'}
+
 47%|████▋     | 17960/37963 [44:08:34<43:53:35,  7.90s/it]
 47%|████▋     | 17961/37963 [44:08:41<43:06:13,  7.76s/it]
 47%|████▋     | 17962/37963 [44:08:49<42:53:51,  7.72s/it]
 47%|████▋     | 17963/37963 [44:09:03<54:28:49,  9.81s/it]
 47%|████▋     | 17964/37963 [44:09:11<50:55:37,  9.17s/it]
 47%|████▋     | 17965/37963 [44:09:19<48:29:32,  8.73s/it]
 47%|████▋     | 17966/37963 [44:09:26<46:12:03,  8.32s/it]
 47%|████▋     | 17967/37963 [44:09:34<45:10:38,  8.13s/it]
 47%|████▋     | 17968/37963 [44:09:49<56:25:09, 10.16s/it]
 47%|████▋     | 17969/37963 [44:10:04<64:34:51, 11.63s/it]
 47%|████▋     | 17970/37963 [44:10:12<57:58:48, 10.44s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '2.199', 'learning_rate': '1.135e-05', 'epoch': '0.4734'}
+
 47%|████▋     | 17970/37963 [44:10:12<57:58:48, 10.44s/it]
 47%|████▋     | 17971/37963 [44:10:19<53:33:34,  9.64s/it]
 47%|████▋     | 17972/37963 [44:10:27<50:16:32,  9.05s/it]
 47%|████▋     | 17973/37963 [44:10:35<47:59:19,  8.64s/it]
 47%|████▋     | 17974/37963 [44:10:49<57:21:48, 10.33s/it]
 47%|████▋     | 17975/37963 [44:11:03<64:08:39, 11.55s/it]
 47%|████▋     | 17976/37963 [44:11:11<57:27:30, 10.35s/it]
 47%|████▋     | 17977/37963 [44:11:18<52:48:00,  9.51s/it]
 47%|████▋     | 17978/37963 [44:11:26<49:42:43,  8.95s/it]
 47%|████▋     | 17979/37963 [44:11:33<47:06:50,  8.49s/it]
 47%|████▋     | 17980/37963 [44:11:41<45:45:13,  8.24s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '2.889', 'learning_rate': '1.134e-05', 'epoch': '0.4736'}
+
 47%|████▋     | 17980/37963 [44:11:41<45:45:13,  8.24s/it]
 47%|████▋     | 17981/37963 [44:11:49<45:01:24,  8.11s/it]
 47%|████▋     | 17982/37963 [44:11:57<44:16:39,  7.98s/it]
 47%|████▋     | 17983/37963 [44:12:04<43:22:15,  7.81s/it]
 47%|████▋     | 17984/37963 [44:12:12<43:09:36,  7.78s/it]
 47%|████▋     | 17985/37963 [44:12:20<43:17:42,  7.80s/it]
 47%|████▋     | 17986/37963 [44:12:34<54:32:02,  9.83s/it]
 47%|████▋     | 17987/37963 [44:12:42<51:05:59,  9.21s/it]
 47%|████▋     | 17988/37963 [44:12:49<48:14:31,  8.69s/it]
 47%|████▋     | 17989/37963 [44:12:57<46:31:20,  8.38s/it]
 47%|████▋     | 17990/37963 [44:13:05<45:02:40,  8.12s/it]
                                                           
{'loss': '0.1444', 'grad_norm': '1.831', 'learning_rate': '1.133e-05', 'epoch': '0.4739'}
+
 47%|████▋     | 17990/37963 [44:13:05<45:02:40,  8.12s/it]
 47%|████▋     | 17991/37963 [44:13:12<44:20:17,  7.99s/it]
 47%|████▋     | 17992/37963 [44:13:20<43:45:31,  7.89s/it]
 47%|████▋     | 17993/37963 [44:13:28<43:27:42,  7.83s/it]
 47%|████▋     | 17994/37963 [44:13:35<43:09:39,  7.78s/it]
 47%|████▋     | 17995/37963 [44:13:43<43:04:56,  7.77s/it]
 47%|████▋     | 17996/37963 [44:13:51<43:03:03,  7.76s/it]
 47%|████▋     | 17997/37963 [44:13:58<42:38:01,  7.69s/it]
 47%|████▋     | 17998/37963 [44:14:13<53:52:33,  9.71s/it]
 47%|████▋     | 17999/37963 [44:14:21<51:01:28,  9.20s/it]
 47%|████▋     | 18000/37963 [44:14:28<48:25:18,  8.73s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '2.459', 'learning_rate': '1.132e-05', 'epoch': '0.4741'}
+
 47%|████▋     | 18000/37963 [44:14:28<48:25:18,  8.73s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.28s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.28s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 47%|████▋     | 18001/37963 [44:15:22<122:35:32, 22.11s/it]
 47%|████▋     | 18002/37963 [44:15:36<109:46:15, 19.80s/it]
 47%|████▋     | 18003/37963 [44:15:44<89:47:43, 16.20s/it] 
 47%|████▋     | 18004/37963 [44:15:51<74:58:03, 13.52s/it]
 47%|████▋     | 18005/37963 [44:15:59<65:16:46, 11.78s/it]
 47%|████▋     | 18006/37963 [44:16:07<58:32:34, 10.56s/it]
 47%|████▋     | 18007/37963 [44:16:14<53:39:15,  9.68s/it]
 47%|████▋     | 18008/37963 [44:16:22<50:14:28,  9.06s/it]
 47%|████▋     | 18009/37963 [44:16:37<59:34:23, 10.75s/it]
 47%|████▋     | 18010/37963 [44:16:44<53:59:22,  9.74s/it]
                                                           
{'loss': '0.1602', 'grad_norm': '4.513', 'learning_rate': '1.131e-05', 'epoch': '0.4744'}
+
 47%|████▋     | 18010/37963 [44:16:44<53:59:22,  9.74s/it]
 47%|████▋     | 18011/37963 [44:16:52<50:52:53,  9.18s/it]
 47%|████▋     | 18012/37963 [44:16:59<48:24:27,  8.73s/it]
 47%|████▋     | 18013/37963 [44:17:14<58:10:39, 10.50s/it]
 47%|████▋     | 18014/37963 [44:17:29<65:25:50, 11.81s/it]
 47%|████▋     | 18015/37963 [44:17:37<58:42:22, 10.59s/it]
 47%|████▋     | 18016/37963 [44:17:44<53:19:55,  9.63s/it]
 47%|████▋     | 18017/37963 [44:17:52<50:05:13,  9.04s/it]
 47%|████▋     | 18018/37963 [44:17:59<47:51:51,  8.64s/it]
 47%|████▋     | 18019/37963 [44:18:07<46:34:14,  8.41s/it]
 47%|████▋     | 18020/37963 [44:18:15<45:15:36,  8.17s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '2.93', 'learning_rate': '1.13e-05', 'epoch': '0.4747'}
+
 47%|████▋     | 18020/37963 [44:18:15<45:15:36,  8.17s/it]
 47%|████▋     | 18021/37963 [44:18:23<44:22:36,  8.01s/it]
 47%|████▋     | 18022/37963 [44:18:30<43:47:57,  7.91s/it]
 47%|████▋     | 18023/37963 [44:18:44<54:04:50,  9.76s/it]
 47%|████▋     | 18024/37963 [44:18:52<50:38:27,  9.14s/it]
 47%|████▋     | 18025/37963 [44:19:00<48:14:00,  8.71s/it]
 47%|████▋     | 18026/37963 [44:19:14<57:41:30, 10.42s/it]
 47%|████▋     | 18027/37963 [44:19:22<53:14:21,  9.61s/it]
 47%|████▋     | 18028/37963 [44:19:30<50:02:20,  9.04s/it]
 47%|████▋     | 18029/37963 [44:19:37<47:47:34,  8.63s/it]
 47%|████▋     | 18030/37963 [44:19:45<46:13:32,  8.35s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '2.142', 'learning_rate': '1.129e-05', 'epoch': '0.4749'}
+
 47%|████▋     | 18030/37963 [44:19:45<46:13:32,  8.35s/it]
 47%|████▋     | 18031/37963 [44:19:53<45:05:07,  8.14s/it]
 47%|████▋     | 18032/37963 [44:20:00<44:09:26,  7.98s/it]
 48%|████▊     | 18033/37963 [44:20:15<55:08:34,  9.96s/it]
 48%|████▊     | 18034/37963 [44:20:23<51:27:59,  9.30s/it]
 48%|████▊     | 18035/37963 [44:20:30<48:40:08,  8.79s/it]
 48%|████▊     | 18036/37963 [44:20:38<46:43:26,  8.44s/it]
 48%|████▊     | 18037/37963 [44:20:45<45:18:57,  8.19s/it]
 48%|████▊     | 18038/37963 [44:20:53<44:29:04,  8.04s/it]
 48%|████▊     | 18039/37963 [44:21:01<43:33:15,  7.87s/it]
 48%|████▊     | 18040/37963 [44:21:08<43:21:53,  7.84s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '1.084', 'learning_rate': '1.129e-05', 'epoch': '0.4752'}
+
 48%|████▊     | 18040/37963 [44:21:08<43:21:53,  7.84s/it]
 48%|████▊     | 18041/37963 [44:21:16<43:08:04,  7.79s/it]
 48%|████▊     | 18042/37963 [44:21:24<42:56:14,  7.76s/it]
 48%|████▊     | 18043/37963 [44:21:31<42:49:51,  7.74s/it]
 48%|████▊     | 18044/37963 [44:21:39<42:34:52,  7.70s/it]
 48%|████▊     | 18045/37963 [44:21:47<42:39:18,  7.71s/it]
 48%|████▊     | 18046/37963 [44:21:54<42:44:47,  7.73s/it]
 48%|████▊     | 18047/37963 [44:22:09<53:53:05,  9.74s/it]
 48%|████▊     | 18048/37963 [44:22:17<50:35:40,  9.15s/it]
 48%|████▊     | 18049/37963 [44:22:31<58:49:55, 10.64s/it]
 48%|████▊     | 18050/37963 [44:22:38<53:49:00,  9.73s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '1.959', 'learning_rate': '1.128e-05', 'epoch': '0.4755'}
+
 48%|████▊     | 18050/37963 [44:22:38<53:49:00,  9.73s/it]
 48%|████▊     | 18051/37963 [44:22:46<50:24:48,  9.11s/it]
 48%|████▊     | 18052/37963 [44:23:00<58:50:00, 10.64s/it]
 48%|████▊     | 18053/37963 [44:23:08<54:07:11,  9.79s/it]
 48%|████▊     | 18054/37963 [44:23:16<50:30:59,  9.13s/it]
 48%|████▊     | 18055/37963 [44:23:23<47:57:10,  8.67s/it]
 48%|████▊     | 18056/37963 [44:23:31<45:55:54,  8.31s/it]
 48%|████▊     | 18057/37963 [44:23:38<44:37:35,  8.07s/it]
 48%|████▊     | 18058/37963 [44:23:46<43:57:54,  7.95s/it]
 48%|████▊     | 18059/37963 [44:23:54<43:31:43,  7.87s/it]
 48%|████▊     | 18060/37963 [44:24:01<43:24:23,  7.85s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '2.934', 'learning_rate': '1.127e-05', 'epoch': '0.4757'}
+
 48%|████▊     | 18060/37963 [44:24:01<43:24:23,  7.85s/it]
 48%|████▊     | 18061/37963 [44:24:09<43:01:14,  7.78s/it]
 48%|████▊     | 18062/37963 [44:24:17<43:00:02,  7.78s/it]
 48%|████▊     | 18063/37963 [44:24:24<42:46:00,  7.74s/it]
 48%|████▊     | 18064/37963 [44:24:39<54:05:35,  9.79s/it]
 48%|████▊     | 18065/37963 [44:24:47<51:35:15,  9.33s/it]
 48%|████▊     | 18066/37963 [44:24:55<48:40:37,  8.81s/it]
 48%|████▊     | 18067/37963 [44:25:16<69:34:33, 12.59s/it]
 48%|████▊     | 18068/37963 [44:25:24<62:03:09, 11.23s/it]
 48%|████▊     | 18069/37963 [44:25:32<55:52:07, 10.11s/it]
 48%|████▊     | 18070/37963 [44:25:40<51:54:20,  9.39s/it]
                                                           
{'loss': '0.1357', 'grad_norm': '1.849', 'learning_rate': '1.126e-05', 'epoch': '0.476'}
+
 48%|████▊     | 18070/37963 [44:25:40<51:54:20,  9.39s/it]
 48%|████▊     | 18071/37963 [44:25:47<49:04:27,  8.88s/it]
 48%|████▊     | 18072/37963 [44:25:55<47:14:32,  8.55s/it]
 48%|████▊     | 18073/37963 [44:26:09<56:10:54, 10.17s/it]
 48%|████▊     | 18074/37963 [44:26:17<52:26:19,  9.49s/it]
 48%|████▊     | 18075/37963 [44:26:25<49:29:52,  8.96s/it]
 48%|████▊     | 18076/37963 [44:26:32<47:19:54,  8.57s/it]
 48%|████▊     | 18077/37963 [44:26:40<46:09:21,  8.36s/it]
 48%|████▊     | 18078/37963 [44:26:48<44:36:57,  8.08s/it]
 48%|████▊     | 18079/37963 [44:26:55<44:12:20,  8.00s/it]
 48%|████▊     | 18080/37963 [44:27:03<43:20:49,  7.85s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '2.348', 'learning_rate': '1.125e-05', 'epoch': '0.4763'}
+
 48%|████▊     | 18080/37963 [44:27:03<43:20:49,  7.85s/it]
 48%|████▊     | 18081/37963 [44:27:11<43:02:54,  7.79s/it]
 48%|████▊     | 18082/37963 [44:27:18<42:57:19,  7.78s/it]
 48%|████▊     | 18083/37963 [44:27:26<42:51:09,  7.76s/it]
 48%|████▊     | 18084/37963 [44:27:41<54:19:10,  9.84s/it]
 48%|████▊     | 18085/37963 [44:27:49<51:02:10,  9.24s/it]
 48%|████▊     | 18086/37963 [44:27:56<48:26:47,  8.77s/it]
 48%|████▊     | 18087/37963 [44:28:04<46:33:14,  8.43s/it]
 48%|████▊     | 18088/37963 [44:28:12<45:22:05,  8.22s/it]
 48%|████▊     | 18089/37963 [44:28:19<44:29:39,  8.06s/it]
 48%|████▊     | 18090/37963 [44:28:27<43:56:13,  7.96s/it]
                                                           
{'loss': '0.1486', 'grad_norm': '2.985', 'learning_rate': '1.124e-05', 'epoch': '0.4765'}
+
 48%|████▊     | 18090/37963 [44:28:27<43:56:13,  7.96s/it]
 48%|████▊     | 18091/37963 [44:28:41<54:19:13,  9.84s/it]
 48%|████▊     | 18092/37963 [44:28:49<50:43:45,  9.19s/it]
 48%|████▊     | 18093/37963 [44:29:03<59:03:17, 10.70s/it]
 48%|████▊     | 18094/37963 [44:29:11<54:34:30,  9.89s/it]
 48%|████▊     | 18095/37963 [44:29:19<50:53:29,  9.22s/it]
 48%|████▊     | 18096/37963 [44:29:26<47:49:28,  8.67s/it]
 48%|████▊     | 18097/37963 [44:29:34<45:53:16,  8.32s/it]
 48%|████▊     | 18098/37963 [44:29:41<44:42:54,  8.10s/it]
 48%|████▊     | 18099/37963 [44:29:49<43:56:39,  7.96s/it]
 48%|████▊     | 18100/37963 [44:29:57<43:33:35,  7.89s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '1.984', 'learning_rate': '1.124e-05', 'epoch': '0.4768'}
+
 48%|████▊     | 18100/37963 [44:29:57<43:33:35,  7.89s/it]
 48%|████▊     | 18101/37963 [44:30:04<43:05:31,  7.81s/it]
 48%|████▊     | 18102/37963 [44:30:19<53:50:48,  9.76s/it]
 48%|████▊     | 18103/37963 [44:30:26<50:25:43,  9.14s/it]
 48%|████▊     | 18104/37963 [44:30:34<48:02:52,  8.71s/it]
 48%|████▊     | 18105/37963 [44:30:42<46:30:42,  8.43s/it]
 48%|████▊     | 18106/37963 [44:30:49<45:00:46,  8.16s/it]
 48%|████▊     | 18107/37963 [44:30:57<43:50:07,  7.95s/it]
 48%|████▊     | 18108/37963 [44:31:04<43:23:48,  7.87s/it]
 48%|████▊     | 18109/37963 [44:31:12<42:57:24,  7.79s/it]
 48%|████▊     | 18110/37963 [44:31:20<42:58:27,  7.79s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '2.423', 'learning_rate': '1.123e-05', 'epoch': '0.477'}
+
 48%|████▊     | 18110/37963 [44:31:20<42:58:27,  7.79s/it]
 48%|████▊     | 18111/37963 [44:31:27<42:50:06,  7.77s/it]
 48%|████▊     | 18112/37963 [44:31:42<53:18:35,  9.67s/it]
 48%|████▊     | 18113/37963 [44:31:49<50:01:53,  9.07s/it]
 48%|████▊     | 18114/37963 [44:32:04<59:51:09, 10.86s/it]
 48%|████▊     | 18115/37963 [44:32:12<54:40:16,  9.92s/it]
 48%|████▊     | 18116/37963 [44:32:26<61:39:22, 11.18s/it]
 48%|████▊     | 18117/37963 [44:32:34<56:11:22, 10.19s/it]
 48%|████▊     | 18118/37963 [44:32:42<52:04:33,  9.45s/it]
 48%|████▊     | 18119/37963 [44:32:50<49:17:58,  8.94s/it]
 48%|████▊     | 18120/37963 [44:32:57<47:15:37,  8.57s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '1.143', 'learning_rate': '1.122e-05', 'epoch': '0.4773'}
+
 48%|████▊     | 18120/37963 [44:32:57<47:15:37,  8.57s/it]
 48%|████▊     | 18121/37963 [44:33:05<45:43:15,  8.30s/it]
 48%|████▊     | 18122/37963 [44:33:13<44:55:12,  8.15s/it]
 48%|████▊     | 18123/37963 [44:33:21<44:23:14,  8.05s/it]
 48%|████▊     | 18124/37963 [44:33:35<54:31:56,  9.90s/it]
 48%|████▊     | 18125/37963 [44:33:42<50:57:24,  9.25s/it]
 48%|████▊     | 18126/37963 [44:33:50<48:19:24,  8.77s/it]
 48%|████▊     | 18127/37963 [44:33:58<46:31:05,  8.44s/it]
 48%|████▊     | 18128/37963 [44:34:05<44:47:21,  8.13s/it]
 48%|████▊     | 18129/37963 [44:34:13<44:02:04,  7.99s/it]
 48%|████▊     | 18130/37963 [44:34:21<44:04:50,  8.00s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '1.916', 'learning_rate': '1.121e-05', 'epoch': '0.4776'}
+
 48%|████▊     | 18130/37963 [44:34:21<44:04:50,  8.00s/it]
 48%|████▊     | 18131/37963 [44:34:35<54:10:45,  9.83s/it]
 48%|████▊     | 18132/37963 [44:34:43<50:51:07,  9.23s/it]
 48%|████▊     | 18133/37963 [44:34:51<48:19:50,  8.77s/it]
 48%|████▊     | 18134/37963 [44:34:58<46:27:53,  8.44s/it]
 48%|████▊     | 18135/37963 [44:35:12<56:05:28, 10.18s/it]
 48%|████▊     | 18136/37963 [44:35:20<52:04:41,  9.46s/it]
 48%|████▊     | 18137/37963 [44:35:28<49:06:28,  8.92s/it]
 48%|████▊     | 18138/37963 [44:35:42<58:19:44, 10.59s/it]
 48%|████▊     | 18139/37963 [44:35:50<53:46:30,  9.77s/it]
 48%|████▊     | 18140/37963 [44:35:58<50:20:39,  9.14s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '4.56', 'learning_rate': '1.12e-05', 'epoch': '0.4778'}
+
 48%|████▊     | 18140/37963 [44:35:58<50:20:39,  9.14s/it]
 48%|████▊     | 18141/37963 [44:36:05<47:25:49,  8.61s/it]
 48%|████▊     | 18142/37963 [44:36:13<45:45:31,  8.31s/it]
 48%|████▊     | 18143/37963 [44:36:21<44:45:58,  8.13s/it]
 48%|████▊     | 18144/37963 [44:36:28<43:36:31,  7.92s/it]
 48%|████▊     | 18145/37963 [44:36:36<43:17:40,  7.86s/it]
 48%|████▊     | 18146/37963 [44:36:43<42:53:32,  7.79s/it]
 48%|████▊     | 18147/37963 [44:36:51<42:37:47,  7.74s/it]
 48%|████▊     | 18148/37963 [44:36:59<42:22:37,  7.70s/it]
 48%|████▊     | 18149/37963 [44:37:06<42:15:26,  7.68s/it]
 48%|████▊     | 18150/37963 [44:37:20<53:06:28,  9.65s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '2.063', 'learning_rate': '1.119e-05', 'epoch': '0.4781'}
+
 48%|████▊     | 18150/37963 [44:37:20<53:06:28,  9.65s/it]
 48%|████▊     | 18151/37963 [44:37:28<49:44:13,  9.04s/it]
 48%|████▊     | 18152/37963 [44:37:36<47:24:01,  8.61s/it]
 48%|████▊     | 18153/37963 [44:37:44<46:17:09,  8.41s/it]
 48%|████▊     | 18154/37963 [44:37:51<45:13:32,  8.22s/it]
 48%|████▊     | 18155/37963 [44:37:59<44:12:08,  8.03s/it]
 48%|████▊     | 18156/37963 [44:38:07<43:33:53,  7.92s/it]
 48%|████▊     | 18157/37963 [44:38:14<43:11:47,  7.85s/it]
 48%|████▊     | 18158/37963 [44:38:29<54:55:40,  9.98s/it]
 48%|████▊     | 18159/37963 [44:38:37<51:18:32,  9.33s/it]
 48%|████▊     | 18160/37963 [44:38:45<48:30:12,  8.82s/it]
                                                           
{'loss': '0.1436', 'grad_norm': '1.812', 'learning_rate': '1.118e-05', 'epoch': '0.4784'}
+
 48%|████▊     | 18160/37963 [44:38:45<48:30:12,  8.82s/it]
 48%|████▊     | 18161/37963 [44:38:52<46:45:22,  8.50s/it]
 48%|████▊     | 18162/37963 [44:39:00<45:23:11,  8.25s/it]
 48%|████▊     | 18163/37963 [44:39:08<44:23:09,  8.07s/it]
 48%|████▊     | 18164/37963 [44:39:15<43:25:30,  7.90s/it]
 48%|████▊     | 18165/37963 [44:39:30<54:04:14,  9.83s/it]
 48%|████▊     | 18166/37963 [44:39:37<50:39:57,  9.21s/it]
 48%|████▊     | 18167/37963 [44:39:45<47:40:54,  8.67s/it]
 48%|████▊     | 18168/37963 [44:39:59<57:12:01, 10.40s/it]
 48%|████▊     | 18169/37963 [44:40:07<52:37:23,  9.57s/it]
 48%|████▊     | 18170/37963 [44:40:14<49:12:46,  8.95s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '2.346', 'learning_rate': '1.118e-05', 'epoch': '0.4786'}
+
 48%|████▊     | 18170/37963 [44:40:14<49:12:46,  8.95s/it]
 48%|████▊     | 18171/37963 [44:40:22<47:03:14,  8.56s/it]
 48%|████▊     | 18172/37963 [44:40:30<45:30:45,  8.28s/it]
 48%|████▊     | 18173/37963 [44:40:37<44:29:01,  8.09s/it]
 48%|████▊     | 18174/37963 [44:40:45<43:44:41,  7.96s/it]
 48%|████▊     | 18175/37963 [44:40:53<43:16:54,  7.87s/it]
 48%|████▊     | 18176/37963 [44:41:00<42:52:26,  7.80s/it]
 48%|████▊     | 18177/37963 [44:41:08<42:25:54,  7.72s/it]
 48%|████▊     | 18178/37963 [44:41:22<52:56:41,  9.63s/it]
 48%|████▊     | 18179/37963 [44:41:37<61:25:55, 11.18s/it]
 48%|████▊     | 18180/37963 [44:41:44<55:19:36, 10.07s/it]
                                                           
{'loss': '0.1437', 'grad_norm': '1.787', 'learning_rate': '1.117e-05', 'epoch': '0.4789'}
+
 48%|████▊     | 18180/37963 [44:41:44<55:19:36, 10.07s/it]
 48%|████▊     | 18181/37963 [44:42:05<72:34:33, 13.21s/it]
 48%|████▊     | 18182/37963 [44:42:12<63:36:15, 11.58s/it]
 48%|████▊     | 18183/37963 [44:42:20<57:17:44, 10.43s/it]
 48%|████▊     | 18184/37963 [44:42:28<52:41:16,  9.59s/it]
 48%|████▊     | 18185/37963 [44:42:36<49:34:45,  9.02s/it]
 48%|████▊     | 18186/37963 [44:42:43<47:20:12,  8.62s/it]
 48%|████▊     | 18187/37963 [44:42:51<45:54:50,  8.36s/it]
 48%|████▊     | 18188/37963 [44:42:58<44:22:21,  8.08s/it]
 48%|████▊     | 18189/37963 [44:43:06<43:44:24,  7.96s/it]
 48%|████▊     | 18190/37963 [44:43:14<43:14:19,  7.87s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '1.695', 'learning_rate': '1.116e-05', 'epoch': '0.4792'}
+
 48%|████▊     | 18190/37963 [44:43:14<43:14:19,  7.87s/it]
 48%|████▊     | 18191/37963 [44:43:21<42:34:36,  7.75s/it]
 48%|████▊     | 18192/37963 [44:43:29<42:38:18,  7.76s/it]
 48%|████▊     | 18193/37963 [44:43:37<42:26:48,  7.73s/it]
 48%|████▊     | 18194/37963 [44:43:44<42:21:14,  7.71s/it]
 48%|████▊     | 18195/37963 [44:43:52<42:17:37,  7.70s/it]
 48%|████▊     | 18196/37963 [44:44:00<42:11:30,  7.68s/it]
 48%|████▊     | 18197/37963 [44:44:07<42:09:57,  7.68s/it]
 48%|████▊     | 18198/37963 [44:44:15<42:10:45,  7.68s/it]
 48%|████▊     | 18199/37963 [44:44:23<42:12:44,  7.69s/it]
 48%|████▊     | 18200/37963 [44:44:30<42:13:26,  7.69s/it]
                                                           
{'loss': '0.155', 'grad_norm': '3.966', 'learning_rate': '1.115e-05', 'epoch': '0.4794'}
+
 48%|████▊     | 18200/37963 [44:44:30<42:13:26,  7.69s/it]
 48%|████▊     | 18201/37963 [44:44:38<42:05:00,  7.67s/it]
 48%|████▊     | 18202/37963 [44:44:46<42:05:19,  7.67s/it]
 48%|████▊     | 18203/37963 [44:45:00<53:48:08,  9.80s/it]
 48%|████▊     | 18204/37963 [44:45:08<50:20:26,  9.17s/it]
 48%|████▊     | 18205/37963 [44:45:16<47:49:11,  8.71s/it]
 48%|████▊     | 18206/37963 [44:45:30<57:14:48, 10.43s/it]
 48%|████▊     | 18207/37963 [44:45:38<52:54:23,  9.64s/it]
 48%|████▊     | 18208/37963 [44:45:46<49:38:11,  9.05s/it]
 48%|████▊     | 18209/37963 [44:45:53<47:26:52,  8.65s/it]
 48%|████▊     | 18210/37963 [44:46:01<45:22:10,  8.27s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '1.842', 'learning_rate': '1.114e-05', 'epoch': '0.4797'}
+
 48%|████▊     | 18210/37963 [44:46:01<45:22:10,  8.27s/it]
 48%|████▊     | 18211/37963 [44:46:09<44:53:53,  8.18s/it]
 48%|████▊     | 18212/37963 [44:46:16<43:40:25,  7.96s/it]
 48%|████▊     | 18213/37963 [44:46:24<43:20:21,  7.90s/it]
 48%|████▊     | 18214/37963 [44:46:32<42:58:07,  7.83s/it]
 48%|████▊     | 18215/37963 [44:46:46<53:02:22,  9.67s/it]
 48%|████▊     | 18216/37963 [44:47:00<60:54:26, 11.10s/it]
 48%|████▊     | 18217/37963 [44:47:08<55:12:08, 10.06s/it]
 48%|████▊     | 18218/37963 [44:47:15<50:59:11,  9.30s/it]
 48%|████▊     | 18219/37963 [44:47:23<48:13:54,  8.79s/it]
 48%|████▊     | 18220/37963 [44:47:30<46:18:31,  8.44s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '1.665', 'learning_rate': '1.113e-05', 'epoch': '0.4799'}
+
 48%|████▊     | 18220/37963 [44:47:30<46:18:31,  8.44s/it]
 48%|████▊     | 18221/37963 [44:47:38<44:51:42,  8.18s/it]
 48%|████▊     | 18222/37963 [44:47:46<44:04:06,  8.04s/it]
 48%|████▊     | 18223/37963 [44:48:00<55:06:56, 10.05s/it]
 48%|████▊     | 18224/37963 [44:48:08<50:59:43,  9.30s/it]
 48%|████▊     | 18225/37963 [44:48:22<59:00:18, 10.76s/it]
 48%|████▊     | 18226/37963 [44:48:30<53:55:57,  9.84s/it]
 48%|████▊     | 18227/37963 [44:48:37<50:15:06,  9.17s/it]
 48%|████▊     | 18228/37963 [44:48:45<47:47:51,  8.72s/it]
 48%|████▊     | 18229/37963 [44:48:53<45:48:25,  8.36s/it]
 48%|████▊     | 18230/37963 [44:49:00<44:31:13,  8.12s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '1.079', 'learning_rate': '1.113e-05', 'epoch': '0.4802'}
+
 48%|████▊     | 18230/37963 [44:49:00<44:31:13,  8.12s/it]
 48%|████▊     | 18231/37963 [44:49:08<43:53:42,  8.01s/it]
 48%|████▊     | 18232/37963 [44:49:29<65:05:58, 11.88s/it]
 48%|████▊     | 18233/37963 [44:49:37<58:08:57, 10.61s/it]
 48%|████▊     | 18234/37963 [44:49:44<53:16:42,  9.72s/it]
 48%|████▊     | 18235/37963 [44:49:51<49:08:17,  8.97s/it]
 48%|████▊     | 18236/37963 [44:49:59<46:59:13,  8.57s/it]
 48%|████▊     | 18237/37963 [44:50:07<45:14:49,  8.26s/it]
 48%|████▊     | 18238/37963 [44:50:14<44:06:49,  8.05s/it]
 48%|████▊     | 18239/37963 [44:50:22<43:23:57,  7.92s/it]
 48%|████▊     | 18240/37963 [44:50:29<42:58:28,  7.84s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '1.343', 'learning_rate': '1.112e-05', 'epoch': '0.4805'}
+
 48%|████▊     | 18240/37963 [44:50:29<42:58:28,  7.84s/it]
 48%|████▊     | 18241/37963 [44:50:37<42:32:56,  7.77s/it]
 48%|████▊     | 18242/37963 [44:50:45<42:19:33,  7.73s/it]
 48%|████▊     | 18243/37963 [44:50:52<42:26:01,  7.75s/it]
 48%|████▊     | 18244/37963 [44:51:00<42:18:55,  7.73s/it]
 48%|████▊     | 18245/37963 [44:51:08<42:18:41,  7.72s/it]
 48%|████▊     | 18246/37963 [44:51:15<42:08:39,  7.69s/it]
 48%|████▊     | 18247/37963 [44:51:23<42:08:55,  7.70s/it]
 48%|████▊     | 18248/37963 [44:51:31<41:51:19,  7.64s/it]
 48%|████▊     | 18249/37963 [44:51:39<42:08:21,  7.70s/it]
 48%|████▊     | 18250/37963 [44:51:46<42:09:24,  7.70s/it]
                                                           
{'loss': '0.1437', 'grad_norm': '2.063', 'learning_rate': '1.111e-05', 'epoch': '0.4807'}
+
 48%|████▊     | 18250/37963 [44:51:46<42:09:24,  7.70s/it]
 48%|████▊     | 18251/37963 [44:51:54<42:24:35,  7.75s/it]
 48%|████▊     | 18252/37963 [44:52:09<54:30:22,  9.95s/it]
 48%|████▊     | 18253/37963 [44:52:17<50:59:59,  9.32s/it]
 48%|████▊     | 18254/37963 [44:52:24<47:57:00,  8.76s/it]
 48%|████▊     | 18255/37963 [44:52:32<45:53:42,  8.38s/it]
 48%|████▊     | 18256/37963 [44:52:40<44:41:22,  8.16s/it]
 48%|████▊     | 18257/37963 [44:52:54<55:32:30, 10.15s/it]
 48%|████▊     | 18258/37963 [44:53:02<51:29:15,  9.41s/it]
 48%|████▊     | 18259/37963 [44:53:16<59:04:13, 10.79s/it]
 48%|████▊     | 18260/37963 [44:53:31<65:44:28, 12.01s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '1.823', 'learning_rate': '1.11e-05', 'epoch': '0.481'}
+
 48%|████▊     | 18260/37963 [44:53:31<65:44:28, 12.01s/it]
 48%|████▊     | 18261/37963 [44:53:38<58:22:54, 10.67s/it]
 48%|████▊     | 18262/37963 [44:53:46<53:53:50,  9.85s/it]
 48%|████▊     | 18263/37963 [44:53:54<50:23:15,  9.21s/it]
 48%|████▊     | 18264/37963 [44:54:02<47:59:40,  8.77s/it]
 48%|████▊     | 18265/37963 [44:54:09<45:56:25,  8.40s/it]
 48%|████▊     | 18266/37963 [44:54:17<44:48:41,  8.19s/it]
 48%|████▊     | 18267/37963 [44:54:25<43:58:47,  8.04s/it]
 48%|████▊     | 18268/37963 [44:54:33<43:31:53,  7.96s/it]
 48%|████▊     | 18269/37963 [44:54:40<43:03:03,  7.87s/it]
 48%|████▊     | 18270/37963 [44:54:48<42:14:43,  7.72s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '4.066', 'learning_rate': '1.109e-05', 'epoch': '0.4813'}
+
 48%|████▊     | 18270/37963 [44:54:48<42:14:43,  7.72s/it]
 48%|████▊     | 18271/37963 [44:55:02<53:26:14,  9.77s/it]
 48%|████▊     | 18272/37963 [44:55:10<49:56:22,  9.13s/it]
 48%|████▊     | 18273/37963 [44:55:17<47:20:41,  8.66s/it]
 48%|████▊     | 18274/37963 [44:55:25<45:33:22,  8.33s/it]
 48%|████▊     | 18275/37963 [44:55:33<44:27:58,  8.13s/it]
 48%|████▊     | 18276/37963 [44:55:40<43:30:40,  7.96s/it]
 48%|████▊     | 18277/37963 [44:55:55<54:05:31,  9.89s/it]
 48%|████▊     | 18278/37963 [44:56:09<61:20:05, 11.22s/it]
 48%|████▊     | 18279/37963 [44:56:16<55:16:57, 10.11s/it]
 48%|████▊     | 18280/37963 [44:56:24<50:55:33,  9.31s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '1.23', 'learning_rate': '1.108e-05', 'epoch': '0.4815'}
+
 48%|████▊     | 18280/37963 [44:56:24<50:55:33,  9.31s/it]
 48%|████▊     | 18281/37963 [44:56:38<59:03:57, 10.80s/it]
 48%|████▊     | 18282/37963 [44:56:46<53:47:07,  9.84s/it]
 48%|████▊     | 18283/37963 [44:56:53<50:25:03,  9.22s/it]
 48%|████▊     | 18284/37963 [44:57:01<47:36:35,  8.71s/it]
 48%|████▊     | 18285/37963 [44:57:09<45:56:06,  8.40s/it]
 48%|████▊     | 18286/37963 [44:57:16<44:31:28,  8.15s/it]
 48%|████▊     | 18287/37963 [44:57:24<43:18:08,  7.92s/it]
 48%|████▊     | 18288/37963 [44:57:31<43:01:15,  7.87s/it]
 48%|████▊     | 18289/37963 [44:57:39<42:36:40,  7.80s/it]
 48%|████▊     | 18290/37963 [44:57:47<42:10:27,  7.72s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '2.133', 'learning_rate': '1.107e-05', 'epoch': '0.4818'}
+
 48%|████▊     | 18290/37963 [44:57:47<42:10:27,  7.72s/it]
 48%|████▊     | 18291/37963 [44:57:54<42:08:27,  7.71s/it]
 48%|████▊     | 18292/37963 [44:58:02<42:12:16,  7.72s/it]
 48%|████▊     | 18293/37963 [44:58:10<42:11:01,  7.72s/it]
 48%|████▊     | 18294/37963 [44:58:17<42:14:32,  7.73s/it]
 48%|████▊     | 18295/37963 [44:58:25<42:07:16,  7.71s/it]
 48%|████▊     | 18296/37963 [44:58:33<41:44:33,  7.64s/it]
 48%|████▊     | 18297/37963 [44:58:40<41:48:33,  7.65s/it]
 48%|████▊     | 18298/37963 [44:58:48<41:40:18,  7.63s/it]
 48%|████▊     | 18299/37963 [44:58:56<41:42:33,  7.64s/it]
 48%|████▊     | 18300/37963 [44:59:03<41:40:29,  7.63s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '1.165', 'learning_rate': '1.107e-05', 'epoch': '0.482'}
+
 48%|████▊     | 18300/37963 [44:59:03<41:40:29,  7.63s/it]
 48%|████▊     | 18301/37963 [44:59:11<41:40:46,  7.63s/it]
 48%|████▊     | 18302/37963 [44:59:18<41:22:09,  7.57s/it]
 48%|████▊     | 18303/37963 [44:59:33<52:56:29,  9.69s/it]
 48%|████▊     | 18304/37963 [44:59:40<49:06:58,  8.99s/it]
 48%|████▊     | 18305/37963 [44:59:48<46:49:12,  8.57s/it]
 48%|████▊     | 18306/37963 [45:00:03<57:27:29, 10.52s/it]
 48%|████▊     | 18307/37963 [45:00:11<52:53:43,  9.69s/it]
 48%|████▊     | 18308/37963 [45:00:18<49:37:56,  9.09s/it]
 48%|████▊     | 18309/37963 [45:00:33<58:58:43, 10.80s/it]
 48%|████▊     | 18310/37963 [45:00:41<53:56:10,  9.88s/it]
                                                           
{'loss': '0.1459', 'grad_norm': '0.9541', 'learning_rate': '1.106e-05', 'epoch': '0.4823'}
+
 48%|████▊     | 18310/37963 [45:00:41<53:56:10,  9.88s/it]
 48%|████▊     | 18311/37963 [45:00:49<50:25:18,  9.24s/it]
 48%|████▊     | 18312/37963 [45:00:56<47:50:57,  8.77s/it]
 48%|████▊     | 18313/37963 [45:01:11<56:55:14, 10.43s/it]
 48%|████▊     | 18314/37963 [45:01:18<52:27:18,  9.61s/it]
 48%|████▊     | 18315/37963 [45:01:26<49:19:34,  9.04s/it]
 48%|████▊     | 18316/37963 [45:01:33<46:50:37,  8.58s/it]
 48%|████▊     | 18317/37963 [45:01:41<45:13:20,  8.29s/it]
 48%|████▊     | 18318/37963 [45:01:49<44:12:51,  8.10s/it]
 48%|████▊     | 18319/37963 [45:01:56<43:10:09,  7.91s/it]
 48%|████▊     | 18320/37963 [45:02:04<42:48:55,  7.85s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '0.6989', 'learning_rate': '1.105e-05', 'epoch': '0.4826'}
+
 48%|████▊     | 18320/37963 [45:02:04<42:48:55,  7.85s/it]
 48%|████▊     | 18321/37963 [45:02:12<42:30:30,  7.79s/it]
 48%|████▊     | 18322/37963 [45:02:19<42:23:11,  7.77s/it]
 48%|████▊     | 18323/37963 [45:02:27<42:17:45,  7.75s/it]
 48%|████▊     | 18324/37963 [45:02:41<53:17:06,  9.77s/it]
 48%|████▊     | 18325/37963 [45:03:03<72:04:39, 13.21s/it]
 48%|████▊     | 18326/37963 [45:03:10<62:33:40, 11.47s/it]
 48%|████▊     | 18327/37963 [45:03:18<56:27:45, 10.35s/it]
 48%|████▊     | 18328/37963 [45:03:26<52:09:54,  9.56s/it]
 48%|████▊     | 18329/37963 [45:03:33<49:14:30,  9.03s/it]
 48%|████▊     | 18330/37963 [45:03:48<58:22:43, 10.70s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '1.179', 'learning_rate': '1.104e-05', 'epoch': '0.4828'}
+
 48%|████▊     | 18330/37963 [45:03:48<58:22:43, 10.70s/it]
 48%|████▊     | 18331/37963 [45:03:56<53:25:21,  9.80s/it]
 48%|████▊     | 18332/37963 [45:04:03<49:54:31,  9.15s/it]
 48%|████▊     | 18333/37963 [45:04:11<47:28:24,  8.71s/it]
 48%|████▊     | 18334/37963 [45:04:19<45:42:03,  8.38s/it]
 48%|████▊     | 18335/37963 [45:04:26<44:31:42,  8.17s/it]
 48%|████▊     | 18336/37963 [45:04:34<43:40:50,  8.01s/it]
 48%|████▊     | 18337/37963 [45:04:41<42:38:55,  7.82s/it]
 48%|████▊     | 18338/37963 [45:04:49<41:53:32,  7.68s/it]
 48%|████▊     | 18339/37963 [45:04:56<41:50:32,  7.68s/it]
 48%|████▊     | 18340/37963 [45:05:04<41:41:11,  7.65s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '1.083', 'learning_rate': '1.103e-05', 'epoch': '0.4831'}
+
 48%|████▊     | 18340/37963 [45:05:04<41:41:11,  7.65s/it]
 48%|████▊     | 18341/37963 [45:05:12<41:47:08,  7.67s/it]
 48%|████▊     | 18342/37963 [45:05:19<42:01:28,  7.71s/it]
 48%|████▊     | 18343/37963 [45:05:27<42:00:46,  7.71s/it]
 48%|████▊     | 18344/37963 [45:05:35<41:49:34,  7.67s/it]
 48%|████▊     | 18345/37963 [45:05:42<41:11:41,  7.56s/it]
 48%|████▊     | 18346/37963 [45:05:50<41:28:41,  7.61s/it]
 48%|████▊     | 18347/37963 [45:05:57<41:35:24,  7.63s/it]
 48%|████▊     | 18348/37963 [45:06:05<41:31:55,  7.62s/it]
 48%|████▊     | 18349/37963 [45:06:13<41:43:24,  7.66s/it]
 48%|████▊     | 18350/37963 [45:06:21<41:51:49,  7.68s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '3.399', 'learning_rate': '1.102e-05', 'epoch': '0.4834'}
+
 48%|████▊     | 18350/37963 [45:06:21<41:51:49,  7.68s/it]
 48%|████▊     | 18351/37963 [45:06:35<53:46:39,  9.87s/it]
 48%|████▊     | 18352/37963 [45:06:43<49:55:13,  9.16s/it]
 48%|████▊     | 18353/37963 [45:06:51<47:57:36,  8.80s/it]
 48%|████▊     | 18354/37963 [45:06:59<46:09:13,  8.47s/it]
 48%|████▊     | 18355/37963 [45:07:06<44:44:34,  8.21s/it]
 48%|████▊     | 18356/37963 [45:07:14<43:46:41,  8.04s/it]
 48%|████▊     | 18357/37963 [45:07:28<54:29:20, 10.01s/it]
 48%|████▊     | 18358/37963 [45:07:36<50:51:08,  9.34s/it]
 48%|████▊     | 18359/37963 [45:07:44<48:08:48,  8.84s/it]
 48%|████▊     | 18360/37963 [45:07:52<46:13:23,  8.49s/it]
                                                           
{'loss': '0.1461', 'grad_norm': '1.328', 'learning_rate': '1.102e-05', 'epoch': '0.4836'}
+
 48%|████▊     | 18360/37963 [45:07:52<46:13:23,  8.49s/it]
 48%|████▊     | 18361/37963 [45:07:59<45:01:57,  8.27s/it]
 48%|████▊     | 18362/37963 [45:08:14<55:32:11, 10.20s/it]
 48%|████▊     | 18363/37963 [45:08:22<51:46:02,  9.51s/it]
 48%|████▊     | 18364/37963 [45:08:30<48:45:24,  8.96s/it]
 48%|████▊     | 18365/37963 [45:08:37<46:38:18,  8.57s/it]
 48%|████▊     | 18366/37963 [45:08:45<45:07:52,  8.29s/it]
 48%|████▊     | 18367/37963 [45:08:59<55:14:44, 10.15s/it]
 48%|████▊     | 18368/37963 [45:09:07<50:47:34,  9.33s/it]
 48%|████▊     | 18369/37963 [45:09:14<47:50:59,  8.79s/it]
 48%|████▊     | 18370/37963 [45:09:22<46:11:03,  8.49s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '1.023', 'learning_rate': '1.101e-05', 'epoch': '0.4839'}
+
 48%|████▊     | 18370/37963 [45:09:22<46:11:03,  8.49s/it]
 48%|████▊     | 18371/37963 [45:09:30<44:49:07,  8.24s/it]
 48%|████▊     | 18372/37963 [45:09:43<53:39:57,  9.86s/it]
 48%|████▊     | 18373/37963 [45:09:51<50:34:44,  9.29s/it]
 48%|████▊     | 18374/37963 [45:09:59<47:53:38,  8.80s/it]
 48%|████▊     | 18375/37963 [45:10:07<45:44:43,  8.41s/it]
 48%|████▊     | 18376/37963 [45:10:14<44:07:46,  8.11s/it]
 48%|████▊     | 18377/37963 [45:10:22<43:25:39,  7.98s/it]
 48%|████▊     | 18378/37963 [45:10:30<43:16:13,  7.95s/it]
 48%|████▊     | 18379/37963 [45:10:57<74:46:55, 13.75s/it]
 48%|████▊     | 18380/37963 [45:11:04<64:45:54, 11.91s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '2.014', 'learning_rate': '1.1e-05', 'epoch': '0.4842'}
+
 48%|████▊     | 18380/37963 [45:11:04<64:45:54, 11.91s/it]
 48%|████▊     | 18381/37963 [45:11:12<57:31:03, 10.57s/it]
 48%|████▊     | 18382/37963 [45:11:19<52:33:30,  9.66s/it]
 48%|████▊     | 18383/37963 [45:11:27<49:14:11,  9.05s/it]
 48%|████▊     | 18384/37963 [45:11:35<47:06:20,  8.66s/it]
 48%|████▊     | 18385/37963 [45:11:43<45:30:56,  8.37s/it]
 48%|████▊     | 18386/37963 [45:11:50<44:43:44,  8.23s/it]
 48%|████▊     | 18387/37963 [45:11:58<43:54:05,  8.07s/it]
 48%|████▊     | 18388/37963 [45:12:06<42:57:59,  7.90s/it]
 48%|████▊     | 18389/37963 [45:12:13<42:23:44,  7.80s/it]
 48%|████▊     | 18390/37963 [45:12:21<42:27:36,  7.81s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '2.306', 'learning_rate': '1.099e-05', 'epoch': '0.4844'}
+
 48%|████▊     | 18390/37963 [45:12:21<42:27:36,  7.81s/it]
 48%|████▊     | 18391/37963 [45:12:29<42:14:27,  7.77s/it]
 48%|████▊     | 18392/37963 [45:12:36<42:02:06,  7.73s/it]
 48%|████▊     | 18393/37963 [45:12:44<41:45:55,  7.68s/it]
 48%|████▊     | 18394/37963 [45:12:59<53:05:17,  9.77s/it]
 48%|████▊     | 18395/37963 [45:13:06<49:53:56,  9.18s/it]
 48%|████▊     | 18396/37963 [45:13:14<47:33:58,  8.75s/it]
 48%|████▊     | 18397/37963 [45:13:22<45:46:33,  8.42s/it]
 48%|████▊     | 18398/37963 [45:13:29<44:35:37,  8.21s/it]
 48%|████▊     | 18399/37963 [45:13:37<43:46:12,  8.05s/it]
 48%|████▊     | 18400/37963 [45:13:45<43:14:51,  7.96s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '2.391', 'learning_rate': '1.098e-05', 'epoch': '0.4847'}
+
 48%|████▊     | 18400/37963 [45:13:45<43:14:51,  7.96s/it]
 48%|████▊     | 18401/37963 [45:13:53<42:44:00,  7.86s/it]
 48%|████▊     | 18402/37963 [45:14:00<42:23:02,  7.80s/it]
 48%|████▊     | 18403/37963 [45:14:08<42:00:04,  7.73s/it]
 48%|████▊     | 18404/37963 [45:14:15<41:50:36,  7.70s/it]
 48%|████▊     | 18405/37963 [45:14:30<53:47:30,  9.90s/it]
 48%|████▊     | 18406/37963 [45:14:38<50:17:30,  9.26s/it]
 48%|████▊     | 18407/37963 [45:14:46<47:48:40,  8.80s/it]
 48%|████▊     | 18408/37963 [45:14:54<46:06:21,  8.49s/it]
 48%|████▊     | 18409/37963 [45:15:01<44:16:33,  8.15s/it]
 48%|████▊     | 18410/37963 [45:15:09<43:33:14,  8.02s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '1.753', 'learning_rate': '1.097e-05', 'epoch': '0.4849'}
+
 48%|████▊     | 18410/37963 [45:15:09<43:33:14,  8.02s/it]
 48%|████▊     | 18411/37963 [45:15:17<43:11:16,  7.95s/it]
 48%|████▊     | 18412/37963 [45:15:24<42:46:49,  7.88s/it]
 49%|████▊     | 18413/37963 [45:15:32<42:23:54,  7.81s/it]
 49%|████▊     | 18414/37963 [45:15:40<42:13:23,  7.78s/it]
 49%|████▊     | 18415/37963 [45:15:47<41:52:44,  7.71s/it]
 49%|████▊     | 18416/37963 [45:16:02<53:23:11,  9.83s/it]
 49%|████▊     | 18417/37963 [45:16:09<49:34:50,  9.13s/it]
 49%|████▊     | 18418/37963 [45:16:17<47:23:40,  8.73s/it]
 49%|████▊     | 18419/37963 [45:16:25<45:26:10,  8.37s/it]
 49%|████▊     | 18420/37963 [45:16:45<64:48:16, 11.94s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '2.589', 'learning_rate': '1.096e-05', 'epoch': '0.4852'}
+
 49%|████▊     | 18420/37963 [45:16:45<64:48:16, 11.94s/it]
 49%|████▊     | 18421/37963 [45:16:53<58:12:50, 10.72s/it]
 49%|████▊     | 18422/37963 [45:17:01<53:13:12,  9.80s/it]
 49%|████▊     | 18423/37963 [45:17:15<61:20:39, 11.30s/it]
 49%|████▊     | 18424/37963 [45:17:23<55:35:19, 10.24s/it]
 49%|████▊     | 18425/37963 [45:17:31<50:58:26,  9.39s/it]
 49%|████▊     | 18426/37963 [45:17:45<59:05:08, 10.89s/it]
 49%|████▊     | 18427/37963 [45:17:53<53:46:05,  9.91s/it]
 49%|████▊     | 18428/37963 [45:18:00<50:05:40,  9.23s/it]
 49%|████▊     | 18429/37963 [45:18:08<47:35:05,  8.77s/it]
 49%|████▊     | 18430/37963 [45:18:16<46:03:15,  8.49s/it]
                                                           
{'loss': '0.1458', 'grad_norm': '1.241', 'learning_rate': '1.096e-05', 'epoch': '0.4855'}
+
 49%|████▊     | 18430/37963 [45:18:16<46:03:15,  8.49s/it]
 49%|████▊     | 18431/37963 [45:18:30<55:44:57, 10.28s/it]
 49%|████▊     | 18432/37963 [45:18:38<51:25:29,  9.48s/it]
 49%|████▊     | 18433/37963 [45:18:45<48:32:14,  8.95s/it]
 49%|████▊     | 18434/37963 [45:18:53<46:30:41,  8.57s/it]
 49%|████▊     | 18435/37963 [45:19:01<44:47:44,  8.26s/it]
 49%|████▊     | 18436/37963 [45:19:08<43:57:05,  8.10s/it]
 49%|████▊     | 18437/37963 [45:19:16<43:27:03,  8.01s/it]
 49%|████▊     | 18438/37963 [45:19:24<43:08:26,  7.95s/it]
 49%|████▊     | 18439/37963 [45:19:32<42:38:03,  7.86s/it]
 49%|████▊     | 18440/37963 [45:19:39<42:20:47,  7.81s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '3.391', 'learning_rate': '1.095e-05', 'epoch': '0.4857'}
+
 49%|████▊     | 18440/37963 [45:19:39<42:20:47,  7.81s/it]
 49%|████▊     | 18441/37963 [45:19:47<42:06:17,  7.76s/it]
 49%|████▊     | 18442/37963 [45:20:02<52:58:03,  9.77s/it]
 49%|████▊     | 18443/37963 [45:20:09<49:42:30,  9.17s/it]
 49%|████▊     | 18444/37963 [45:20:17<47:20:35,  8.73s/it]
 49%|████▊     | 18445/37963 [45:20:25<45:34:07,  8.40s/it]
 49%|████▊     | 18446/37963 [45:20:32<44:34:29,  8.22s/it]
 49%|████▊     | 18447/37963 [45:20:40<43:40:06,  8.06s/it]
 49%|████▊     | 18448/37963 [45:20:48<42:54:44,  7.92s/it]
 49%|████▊     | 18449/37963 [45:20:55<42:33:25,  7.85s/it]
 49%|████▊     | 18450/37963 [45:21:03<41:42:13,  7.69s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '0.8694', 'learning_rate': '1.094e-05', 'epoch': '0.486'}
+
 49%|████▊     | 18450/37963 [45:21:03<41:42:13,  7.69s/it]
 49%|████▊     | 18451/37963 [45:21:18<53:22:13,  9.85s/it]
 49%|████▊     | 18452/37963 [45:21:26<50:14:16,  9.27s/it]
 49%|████▊     | 18453/37963 [45:21:33<47:43:13,  8.81s/it]
 49%|████▊     | 18454/37963 [45:21:41<45:30:09,  8.40s/it]
 49%|████▊     | 18455/37963 [45:21:48<44:24:58,  8.20s/it]
 49%|████▊     | 18456/37963 [45:21:56<43:35:18,  8.04s/it]
 49%|████▊     | 18457/37963 [45:22:04<42:59:31,  7.93s/it]
 49%|████▊     | 18458/37963 [45:22:11<41:50:57,  7.72s/it]
 49%|████▊     | 18459/37963 [45:22:19<41:46:58,  7.71s/it]
 49%|████▊     | 18460/37963 [45:22:26<41:07:47,  7.59s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '1.249', 'learning_rate': '1.093e-05', 'epoch': '0.4863'}
+
 49%|████▊     | 18460/37963 [45:22:26<41:07:47,  7.59s/it]
 49%|████▊     | 18461/37963 [45:22:34<41:15:14,  7.62s/it]
 49%|████▊     | 18462/37963 [45:22:41<41:24:54,  7.65s/it]
 49%|████▊     | 18463/37963 [45:22:49<41:31:48,  7.67s/it]
 49%|████▊     | 18464/37963 [45:22:57<41:54:13,  7.74s/it]
 49%|████▊     | 18465/37963 [45:23:05<41:50:59,  7.73s/it]
 49%|████▊     | 18466/37963 [45:23:12<41:26:40,  7.65s/it]
 49%|████▊     | 18467/37963 [45:23:20<41:05:09,  7.59s/it]
 49%|████▊     | 18468/37963 [45:23:27<41:13:56,  7.61s/it]
 49%|████▊     | 18469/37963 [45:23:42<51:58:31,  9.60s/it]
 49%|████▊     | 18470/37963 [45:23:49<48:54:44,  9.03s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '1.153', 'learning_rate': '1.092e-05', 'epoch': '0.4865'}
+
 49%|████▊     | 18470/37963 [45:23:49<48:54:44,  9.03s/it]
 49%|████▊     | 18471/37963 [45:24:04<58:13:23, 10.75s/it]
 49%|████▊     | 18472/37963 [45:24:18<63:40:17, 11.76s/it]
 49%|████▊     | 18473/37963 [45:24:26<57:12:28, 10.57s/it]
 49%|████▊     | 18474/37963 [45:24:40<62:55:19, 11.62s/it]
 49%|████▊     | 18475/37963 [45:24:48<56:38:07, 10.46s/it]
 49%|████▊     | 18476/37963 [45:24:55<52:03:30,  9.62s/it]
 49%|████▊     | 18477/37963 [45:25:10<60:13:21, 11.13s/it]
 49%|████▊     | 18478/37963 [45:25:18<54:36:15, 10.09s/it]
 49%|████▊     | 18479/37963 [45:25:32<61:44:16, 11.41s/it]
 49%|████▊     | 18480/37963 [45:25:40<55:38:02, 10.28s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '2.468', 'learning_rate': '1.091e-05', 'epoch': '0.4868'}
+
 49%|████▊     | 18480/37963 [45:25:40<55:38:02, 10.28s/it]
 49%|████▊     | 18481/37963 [45:25:48<51:32:25,  9.52s/it]
 49%|████▊     | 18482/37963 [45:25:55<48:37:26,  8.99s/it]
 49%|████▊     | 18483/37963 [45:26:03<46:36:29,  8.61s/it]
 49%|████▊     | 18484/37963 [45:26:11<45:03:51,  8.33s/it]
 49%|████▊     | 18485/37963 [45:26:18<43:37:04,  8.06s/it]
 49%|████▊     | 18486/37963 [45:26:26<43:01:39,  7.95s/it]
 49%|████▊     | 18487/37963 [45:26:33<42:28:12,  7.85s/it]
 49%|████▊     | 18488/37963 [45:26:41<41:59:15,  7.76s/it]
 49%|████▊     | 18489/37963 [45:26:49<41:45:02,  7.72s/it]
 49%|████▊     | 18490/37963 [45:26:56<41:07:37,  7.60s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '1.988', 'learning_rate': '1.09e-05', 'epoch': '0.4871'}
+
 49%|████▊     | 18490/37963 [45:26:56<41:07:37,  7.60s/it]
 49%|████▊     | 18491/37963 [45:27:04<41:04:07,  7.59s/it]
 49%|████▊     | 18492/37963 [45:27:11<41:16:32,  7.63s/it]
 49%|████▊     | 18493/37963 [45:27:19<41:19:33,  7.64s/it]
 49%|████▊     | 18494/37963 [45:27:27<41:27:07,  7.66s/it]
 49%|████▊     | 18495/37963 [45:27:34<41:39:13,  7.70s/it]
 49%|████▊     | 18496/37963 [45:27:49<53:29:07,  9.89s/it]
 49%|████▊     | 18497/37963 [45:28:05<62:11:01, 11.50s/it]
 49%|████▊     | 18498/37963 [45:28:12<56:02:51, 10.37s/it]
 49%|████▊     | 18499/37963 [45:28:20<51:59:49,  9.62s/it]
 49%|████▊     | 18500/37963 [45:28:28<48:40:03,  9.00s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '2.838', 'learning_rate': '1.09e-05', 'epoch': '0.4873'}
+
 49%|████▊     | 18500/37963 [45:28:28<48:40:03,  9.00s/it]
 49%|████▊     | 18501/37963 [45:28:36<46:31:23,  8.61s/it]
 49%|████▊     | 18502/37963 [45:28:43<44:54:36,  8.31s/it]
 49%|████▊     | 18503/37963 [45:28:51<43:58:14,  8.13s/it]
 49%|████▊     | 18504/37963 [45:28:59<43:20:38,  8.02s/it]
 49%|████▊     | 18505/37963 [45:29:06<42:46:18,  7.91s/it]
 49%|████▊     | 18506/37963 [45:29:14<42:09:27,  7.80s/it]
 49%|████▉     | 18507/37963 [45:29:21<41:50:27,  7.74s/it]
 49%|████▉     | 18508/37963 [45:29:29<41:34:09,  7.69s/it]
 49%|████▉     | 18509/37963 [45:29:37<41:18:03,  7.64s/it]
 49%|████▉     | 18510/37963 [45:29:44<41:09:30,  7.62s/it]
                                                           
{'loss': '0.1437', 'grad_norm': '1.611', 'learning_rate': '1.089e-05', 'epoch': '0.4876'}
+
 49%|████▉     | 18510/37963 [45:29:44<41:09:30,  7.62s/it]
 49%|████▉     | 18511/37963 [45:29:52<41:16:59,  7.64s/it]
 49%|████▉     | 18512/37963 [45:29:59<41:23:46,  7.66s/it]
 49%|████▉     | 18513/37963 [45:30:07<41:29:58,  7.68s/it]
 49%|████▉     | 18514/37963 [45:30:15<41:32:27,  7.69s/it]
 49%|████▉     | 18515/37963 [45:30:29<52:06:44,  9.65s/it]
 49%|████▉     | 18516/37963 [45:30:37<48:49:16,  9.04s/it]
 49%|████▉     | 18517/37963 [45:30:44<46:38:48,  8.64s/it]
 49%|████▉     | 18518/37963 [45:30:59<55:59:20, 10.37s/it]
 49%|████▉     | 18519/37963 [45:31:07<51:39:33,  9.56s/it]
 49%|████▉     | 18520/37963 [45:31:14<48:30:24,  8.98s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '1.175', 'learning_rate': '1.088e-05', 'epoch': '0.4878'}
+
 49%|████▉     | 18520/37963 [45:31:14<48:30:24,  8.98s/it]
 49%|████▉     | 18521/37963 [45:31:22<46:28:41,  8.61s/it]
 49%|████▉     | 18522/37963 [45:31:36<55:29:00, 10.27s/it]
 49%|████▉     | 18523/37963 [45:31:44<51:44:58,  9.58s/it]
 49%|████▉     | 18524/37963 [45:31:58<58:47:09, 10.89s/it]
 49%|████▉     | 18525/37963 [45:32:06<53:44:57,  9.95s/it]
 49%|████▉     | 18526/37963 [45:32:13<50:05:34,  9.28s/it]
 49%|████▉     | 18527/37963 [45:32:21<47:22:26,  8.77s/it]
 49%|████▉     | 18528/37963 [45:32:35<56:04:01, 10.39s/it]
 49%|████▉     | 18529/37963 [45:32:43<51:37:20,  9.56s/it]
 49%|████▉     | 18530/37963 [45:32:51<48:37:30,  9.01s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '0.9671', 'learning_rate': '1.087e-05', 'epoch': '0.4881'}
+
 49%|████▉     | 18530/37963 [45:32:51<48:37:30,  9.01s/it]
 49%|████▉     | 18531/37963 [45:33:06<58:19:46, 10.81s/it]
 49%|████▉     | 18532/37963 [45:33:13<53:14:26,  9.86s/it]
 49%|████▉     | 18533/37963 [45:33:21<49:34:15,  9.18s/it]
 49%|████▉     | 18534/37963 [45:33:29<47:17:08,  8.76s/it]
 49%|████▉     | 18535/37963 [45:33:36<45:42:43,  8.47s/it]
 49%|████▉     | 18536/37963 [45:33:44<44:25:35,  8.23s/it]
 49%|████▉     | 18537/37963 [45:33:52<43:48:08,  8.12s/it]
 49%|████▉     | 18538/37963 [45:34:00<43:05:53,  7.99s/it]
 49%|████▉     | 18539/37963 [45:34:07<42:36:03,  7.90s/it]
 49%|████▉     | 18540/37963 [45:34:15<42:18:28,  7.84s/it]
                                                           
{'loss': '0.1448', 'grad_norm': '1.638', 'learning_rate': '1.086e-05', 'epoch': '0.4884'}
+
 49%|████▉     | 18540/37963 [45:34:15<42:18:28,  7.84s/it]
 49%|████▉     | 18541/37963 [45:34:23<42:10:50,  7.82s/it]
 49%|████▉     | 18542/37963 [45:34:30<41:44:28,  7.74s/it]
 49%|████▉     | 18543/37963 [45:34:38<41:34:51,  7.71s/it]
 49%|████▉     | 18544/37963 [45:34:46<41:27:57,  7.69s/it]
 49%|████▉     | 18545/37963 [45:34:53<41:19:35,  7.66s/it]
 49%|████▉     | 18546/37963 [45:35:08<53:35:24,  9.94s/it]
 49%|████▉     | 18547/37963 [45:35:23<61:23:03, 11.38s/it]
 49%|████▉     | 18548/37963 [45:35:31<55:22:35, 10.27s/it]
 49%|████▉     | 18549/37963 [45:35:39<51:10:17,  9.49s/it]
 49%|████▉     | 18550/37963 [45:35:46<48:15:52,  8.95s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '2.983', 'learning_rate': '1.085e-05', 'epoch': '0.4886'}
+
 49%|████▉     | 18550/37963 [45:35:46<48:15:52,  8.95s/it]
 49%|████▉     | 18551/37963 [45:35:54<46:16:35,  8.58s/it]
 49%|████▉     | 18552/37963 [45:36:02<44:44:11,  8.30s/it]
 49%|████▉     | 18553/37963 [45:36:09<43:58:58,  8.16s/it]
 49%|████▉     | 18554/37963 [45:36:17<43:15:45,  8.02s/it]
 49%|████▉     | 18555/37963 [45:36:25<43:04:37,  7.99s/it]
 49%|████▉     | 18556/37963 [45:36:32<42:05:41,  7.81s/it]
 49%|████▉     | 18557/37963 [45:36:40<41:50:59,  7.76s/it]
 49%|████▉     | 18558/37963 [45:36:48<41:59:20,  7.79s/it]
 49%|████▉     | 18559/37963 [45:36:56<41:40:21,  7.73s/it]
 49%|████▉     | 18560/37963 [45:37:03<41:34:19,  7.71s/it]
                                                           
{'loss': '0.1545', 'grad_norm': '4.291', 'learning_rate': '1.085e-05', 'epoch': '0.4889'}
+
 49%|████▉     | 18560/37963 [45:37:03<41:34:19,  7.71s/it]
 49%|████▉     | 18561/37963 [45:37:11<41:27:51,  7.69s/it]
 49%|████▉     | 18562/37963 [45:37:25<52:36:48,  9.76s/it]
 49%|████▉     | 18563/37963 [45:37:40<59:34:22, 11.05s/it]
 49%|████▉     | 18564/37963 [45:37:47<54:32:01, 10.12s/it]
 49%|████▉     | 18565/37963 [45:37:55<50:45:14,  9.42s/it]
 49%|████▉     | 18566/37963 [45:38:03<47:55:37,  8.90s/it]
 49%|████▉     | 18567/37963 [45:38:11<46:00:06,  8.54s/it]
 49%|████▉     | 18568/37963 [45:38:19<44:59:29,  8.35s/it]
 49%|████▉     | 18569/37963 [45:38:26<44:06:41,  8.19s/it]
 49%|████▉     | 18570/37963 [45:38:34<43:08:37,  8.01s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '1.901', 'learning_rate': '1.084e-05', 'epoch': '0.4892'}
+
 49%|████▉     | 18570/37963 [45:38:34<43:08:37,  8.01s/it]
 49%|████▉     | 18571/37963 [45:38:42<42:50:29,  7.95s/it]
 49%|████▉     | 18572/37963 [45:38:49<42:30:11,  7.89s/it]
 49%|████▉     | 18573/37963 [45:39:04<53:28:40,  9.93s/it]
 49%|████▉     | 18574/37963 [45:39:12<49:49:13,  9.25s/it]
 49%|████▉     | 18575/37963 [45:39:26<57:29:53, 10.68s/it]
 49%|████▉     | 18576/37963 [45:39:33<52:30:25,  9.75s/it]
 49%|████▉     | 18577/37963 [45:39:41<49:33:09,  9.20s/it]
 49%|████▉     | 18578/37963 [45:39:55<57:22:27, 10.66s/it]
 49%|████▉     | 18579/37963 [45:40:10<64:00:05, 11.89s/it]
 49%|████▉     | 18580/37963 [45:40:18<57:18:50, 10.64s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '1.329', 'learning_rate': '1.083e-05', 'epoch': '0.4894'}
+
 49%|████▉     | 18580/37963 [45:40:18<57:18:50, 10.64s/it]
 49%|████▉     | 18581/37963 [45:40:25<52:13:43,  9.70s/it]
 49%|████▉     | 18582/37963 [45:40:33<48:48:09,  9.07s/it]
 49%|████▉     | 18583/37963 [45:40:41<46:42:25,  8.68s/it]
 49%|████▉     | 18584/37963 [45:40:49<45:15:04,  8.41s/it]
 49%|████▉     | 18585/37963 [45:40:56<44:08:28,  8.20s/it]
 49%|████▉     | 18586/37963 [45:41:04<43:21:32,  8.06s/it]
 49%|████▉     | 18587/37963 [45:41:12<42:49:01,  7.96s/it]
 49%|████▉     | 18588/37963 [45:41:19<42:27:58,  7.89s/it]
 49%|████▉     | 18589/37963 [45:41:27<42:03:36,  7.82s/it]
 49%|████▉     | 18590/37963 [45:41:35<41:53:12,  7.78s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '1.785', 'learning_rate': '1.082e-05', 'epoch': '0.4897'}
+
 49%|████▉     | 18590/37963 [45:41:35<41:53:12,  7.78s/it]
 49%|████▉     | 18591/37963 [45:41:42<41:38:53,  7.74s/it]
 49%|████▉     | 18592/37963 [45:41:50<41:15:50,  7.67s/it]
 49%|████▉     | 18593/37963 [45:41:57<40:56:35,  7.61s/it]
 49%|████▉     | 18594/37963 [45:42:05<41:05:54,  7.64s/it]
 49%|████▉     | 18595/37963 [45:42:13<41:12:31,  7.66s/it]
 49%|████▉     | 18596/37963 [45:42:21<41:17:10,  7.67s/it]
 49%|████▉     | 18597/37963 [45:42:36<53:05:37,  9.87s/it]
 49%|████▉     | 18598/37963 [45:42:43<49:38:06,  9.23s/it]
 49%|████▉     | 18599/37963 [45:42:51<46:49:10,  8.70s/it]
 49%|████▉     | 18600/37963 [45:43:06<57:23:12, 10.67s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '2.043', 'learning_rate': '1.081e-05', 'epoch': '0.49'}
+
 49%|████▉     | 18600/37963 [45:43:06<57:23:12, 10.67s/it]
 49%|████▉     | 18601/37963 [45:43:14<52:44:39,  9.81s/it]
 49%|████▉     | 18602/37963 [45:43:22<49:44:57,  9.25s/it]
 49%|████▉     | 18603/37963 [45:43:29<47:22:15,  8.81s/it]
 49%|████▉     | 18604/37963 [45:43:37<45:29:56,  8.46s/it]
 49%|████▉     | 18605/37963 [45:43:45<43:57:18,  8.17s/it]
 49%|████▉     | 18606/37963 [45:43:52<43:04:19,  8.01s/it]
 49%|████▉     | 18607/37963 [45:44:00<42:32:52,  7.91s/it]
 49%|████▉     | 18608/37963 [45:44:08<42:07:57,  7.84s/it]
 49%|████▉     | 18609/37963 [45:44:22<52:07:23,  9.70s/it]
 49%|████▉     | 18610/37963 [45:44:30<49:24:15,  9.19s/it]
                                                           
{'loss': '0.1557', 'grad_norm': '2.279', 'learning_rate': '1.08e-05', 'epoch': '0.4902'}
+
 49%|████▉     | 18610/37963 [45:44:30<49:24:15,  9.19s/it]
 49%|████▉     | 18611/37963 [45:44:37<47:00:08,  8.74s/it]
 49%|████▉     | 18612/37963 [45:44:52<56:13:28, 10.46s/it]
 49%|████▉     | 18613/37963 [45:44:59<51:30:37,  9.58s/it]
 49%|████▉     | 18614/37963 [45:45:07<48:23:11,  9.00s/it]
 49%|████▉     | 18615/37963 [45:45:15<46:06:14,  8.58s/it]
 49%|████▉     | 18616/37963 [45:45:22<44:23:16,  8.26s/it]
 49%|████▉     | 18617/37963 [45:45:30<43:32:12,  8.10s/it]
 49%|████▉     | 18618/37963 [45:45:38<42:49:58,  7.97s/it]
 49%|████▉     | 18619/37963 [45:45:45<42:17:03,  7.87s/it]
 49%|████▉     | 18620/37963 [45:45:53<41:34:29,  7.74s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '2.758', 'learning_rate': '1.079e-05', 'epoch': '0.4905'}
+
 49%|████▉     | 18620/37963 [45:45:53<41:34:29,  7.74s/it]
 49%|████▉     | 18621/37963 [45:46:07<52:04:13,  9.69s/it]
 49%|████▉     | 18622/37963 [45:46:15<49:19:14,  9.18s/it]
 49%|████▉     | 18623/37963 [45:46:22<46:48:30,  8.71s/it]
 49%|████▉     | 18624/37963 [45:46:30<45:06:01,  8.40s/it]
 49%|████▉     | 18625/37963 [45:46:38<43:57:13,  8.18s/it]
 49%|████▉     | 18626/37963 [45:46:52<53:23:58,  9.94s/it]
 49%|████▉     | 18627/37963 [45:47:00<50:20:30,  9.37s/it]
 49%|████▉     | 18628/37963 [45:47:07<47:19:45,  8.81s/it]
 49%|████▉     | 18629/37963 [45:47:22<56:12:59, 10.47s/it]
 49%|████▉     | 18630/37963 [45:47:30<52:10:58,  9.72s/it]
                                                           
{'loss': '0.1444', 'grad_norm': '0.6755', 'learning_rate': '1.079e-05', 'epoch': '0.4907'}
+
 49%|████▉     | 18630/37963 [45:47:30<52:10:58,  9.72s/it]
 49%|████▉     | 18631/37963 [45:47:37<48:50:19,  9.09s/it]
 49%|████▉     | 18632/37963 [45:47:45<46:18:59,  8.63s/it]
 49%|████▉     | 18633/37963 [45:48:00<56:27:17, 10.51s/it]
 49%|████▉     | 18634/37963 [45:48:08<52:13:54,  9.73s/it]
 49%|████▉     | 18635/37963 [45:48:16<49:21:19,  9.19s/it]
 49%|████▉     | 18636/37963 [45:48:23<46:55:10,  8.74s/it]
 49%|████▉     | 18637/37963 [45:48:31<45:09:40,  8.41s/it]
 49%|████▉     | 18638/37963 [45:48:39<43:51:44,  8.17s/it]
 49%|████▉     | 18639/37963 [45:48:46<42:50:33,  7.98s/it]
 49%|████▉     | 18640/37963 [45:48:54<42:21:30,  7.89s/it]
                                                           
{'loss': '0.1471', 'grad_norm': '0.9154', 'learning_rate': '1.078e-05', 'epoch': '0.491'}
+
 49%|████▉     | 18640/37963 [45:48:54<42:21:30,  7.89s/it]
 49%|████▉     | 18641/37963 [45:49:01<42:02:15,  7.83s/it]
 49%|████▉     | 18642/37963 [45:49:09<41:45:38,  7.78s/it]
 49%|████▉     | 18643/37963 [45:49:24<53:41:35, 10.00s/it]
 49%|████▉     | 18644/37963 [45:49:32<50:01:00,  9.32s/it]
 49%|████▉     | 18645/37963 [45:49:47<58:53:25, 10.97s/it]
 49%|████▉     | 18646/37963 [45:49:55<53:36:51,  9.99s/it]
 49%|████▉     | 18647/37963 [45:50:02<49:25:39,  9.21s/it]
 49%|████▉     | 18648/37963 [45:50:10<47:00:26,  8.76s/it]
 49%|████▉     | 18649/37963 [45:50:17<45:21:21,  8.45s/it]
 49%|████▉     | 18650/37963 [45:50:25<44:01:12,  8.21s/it]
                                                           
{'loss': '0.1576', 'grad_norm': '1.657', 'learning_rate': '1.077e-05', 'epoch': '0.4913'}
+
 49%|████▉     | 18650/37963 [45:50:25<44:01:12,  8.21s/it]
 49%|████▉     | 18651/37963 [45:50:33<43:19:40,  8.08s/it]
 49%|████▉     | 18652/37963 [45:50:40<42:35:56,  7.94s/it]
 49%|████▉     | 18653/37963 [45:50:48<41:59:11,  7.83s/it]
 49%|████▉     | 18654/37963 [45:50:55<41:18:37,  7.70s/it]
 49%|████▉     | 18655/37963 [45:51:03<41:27:27,  7.73s/it]
 49%|████▉     | 18656/37963 [45:51:11<41:27:50,  7.73s/it]
 49%|████▉     | 18657/37963 [45:51:25<51:58:31,  9.69s/it]
 49%|████▉     | 18658/37963 [45:51:33<48:46:53,  9.10s/it]
 49%|████▉     | 18659/37963 [45:51:41<46:28:49,  8.67s/it]
 49%|████▉     | 18660/37963 [45:51:48<45:00:36,  8.39s/it]
                                                           
{'loss': '0.153', 'grad_norm': '0.9779', 'learning_rate': '1.076e-05', 'epoch': '0.4915'}
+
 49%|████▉     | 18660/37963 [45:51:48<45:00:36,  8.39s/it]
 49%|████▉     | 18661/37963 [45:52:02<54:06:26, 10.09s/it]
 49%|████▉     | 18662/37963 [45:52:10<50:16:24,  9.38s/it]
 49%|████▉     | 18663/37963 [45:52:18<47:42:10,  8.90s/it]
 49%|████▉     | 18664/37963 [45:52:26<45:47:58,  8.54s/it]
 49%|████▉     | 18665/37963 [45:52:33<44:24:07,  8.28s/it]
 49%|████▉     | 18666/37963 [45:52:41<43:28:39,  8.11s/it]
 49%|████▉     | 18667/37963 [45:52:49<42:47:40,  7.98s/it]
 49%|████▉     | 18668/37963 [45:52:56<42:23:17,  7.91s/it]
 49%|████▉     | 18669/37963 [45:53:04<42:03:10,  7.85s/it]
 49%|████▉     | 18670/37963 [45:53:18<52:17:28,  9.76s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '1.763', 'learning_rate': '1.075e-05', 'epoch': '0.4918'}
+
 49%|████▉     | 18670/37963 [45:53:18<52:17:28,  9.76s/it]
 49%|████▉     | 18671/37963 [45:53:26<49:17:34,  9.20s/it]
 49%|████▉     | 18672/37963 [45:53:34<46:55:20,  8.76s/it]
 49%|████▉     | 18673/37963 [45:53:48<56:07:37, 10.47s/it]
 49%|████▉     | 18674/37963 [45:53:56<51:45:14,  9.66s/it]
 49%|████▉     | 18675/37963 [45:54:11<60:21:41, 11.27s/it]
 49%|████▉     | 18676/37963 [45:54:19<54:46:02, 10.22s/it]
 49%|████▉     | 18677/37963 [45:54:27<50:34:29,  9.44s/it]
 49%|████▉     | 18678/37963 [45:54:34<47:50:18,  8.93s/it]
 49%|████▉     | 18679/37963 [45:54:42<45:37:20,  8.52s/it]
 49%|████▉     | 18680/37963 [45:54:50<44:21:21,  8.28s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '3.817', 'learning_rate': '1.074e-05', 'epoch': '0.4921'}
+
 49%|████▉     | 18680/37963 [45:54:50<44:21:21,  8.28s/it]
 49%|████▉     | 18681/37963 [45:54:57<43:05:27,  8.05s/it]
 49%|████▉     | 18682/37963 [45:55:05<42:02:37,  7.85s/it]
 49%|████▉     | 18683/37963 [45:55:12<41:59:49,  7.84s/it]
 49%|████▉     | 18684/37963 [45:55:20<41:50:45,  7.81s/it]
 49%|████▉     | 18685/37963 [45:55:28<41:38:11,  7.78s/it]
 49%|████▉     | 18686/37963 [45:55:35<41:30:36,  7.75s/it]
 49%|████▉     | 18687/37963 [45:55:50<53:11:42,  9.93s/it]
 49%|████▉     | 18688/37963 [45:55:58<50:04:00,  9.35s/it]
 49%|████▉     | 18689/37963 [45:56:06<47:24:20,  8.85s/it]
 49%|████▉     | 18690/37963 [45:56:21<57:38:41, 10.77s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '1.28', 'learning_rate': '1.073e-05', 'epoch': '0.4923'}
+
 49%|████▉     | 18690/37963 [45:56:21<57:38:41, 10.77s/it]
 49%|████▉     | 18691/37963 [45:56:29<52:33:13,  9.82s/it]
 49%|████▉     | 18692/37963 [45:56:36<48:46:04,  9.11s/it]
 49%|████▉     | 18693/37963 [45:56:44<46:26:49,  8.68s/it]
 49%|████▉     | 18694/37963 [45:56:52<44:32:46,  8.32s/it]
 49%|████▉     | 18695/37963 [45:56:59<43:35:16,  8.14s/it]
 49%|████▉     | 18696/37963 [45:57:07<42:52:01,  8.01s/it]
 49%|████▉     | 18697/37963 [45:57:15<42:30:50,  7.94s/it]
 49%|████▉     | 18698/37963 [45:57:23<42:25:11,  7.93s/it]
 49%|████▉     | 18699/37963 [45:57:38<53:37:18, 10.02s/it]
 49%|████▉     | 18700/37963 [45:57:45<49:48:58,  9.31s/it]
                                                           
{'loss': '0.1503', 'grad_norm': '0.911', 'learning_rate': '1.073e-05', 'epoch': '0.4926'}
+
 49%|████▉     | 18700/37963 [45:57:45<49:48:58,  9.31s/it]
 49%|████▉     | 18701/37963 [45:57:53<46:56:12,  8.77s/it]
 49%|████▉     | 18702/37963 [45:58:00<44:52:29,  8.39s/it]
 49%|████▉     | 18703/37963 [45:58:08<43:25:16,  8.12s/it]
 49%|████▉     | 18704/37963 [45:58:16<42:56:33,  8.03s/it]
 49%|████▉     | 18705/37963 [45:58:23<42:21:45,  7.92s/it]
 49%|████▉     | 18706/37963 [45:58:31<41:33:40,  7.77s/it]
 49%|████▉     | 18707/37963 [45:58:38<41:25:34,  7.74s/it]
 49%|████▉     | 18708/37963 [45:58:46<41:25:44,  7.75s/it]
 49%|████▉     | 18709/37963 [45:59:00<51:57:23,  9.71s/it]
 49%|████▉     | 18710/37963 [45:59:08<48:40:33,  9.10s/it]
                                                           
{'loss': '0.141', 'grad_norm': '2.343', 'learning_rate': '1.072e-05', 'epoch': '0.4928'}
+
 49%|████▉     | 18710/37963 [45:59:08<48:40:33,  9.10s/it]
 49%|████▉     | 18711/37963 [45:59:16<46:08:38,  8.63s/it]
 49%|████▉     | 18712/37963 [45:59:23<44:43:10,  8.36s/it]
 49%|████▉     | 18713/37963 [45:59:31<43:40:11,  8.17s/it]
 49%|████▉     | 18714/37963 [45:59:45<53:32:16, 10.01s/it]
 49%|████▉     | 18715/37963 [45:59:53<50:04:21,  9.37s/it]
 49%|████▉     | 18716/37963 [46:00:01<46:43:32,  8.74s/it]
 49%|████▉     | 18717/37963 [46:00:08<45:07:43,  8.44s/it]
 49%|████▉     | 18718/37963 [46:00:23<54:23:42, 10.18s/it]
 49%|████▉     | 18719/37963 [46:00:30<50:30:21,  9.45s/it]
 49%|████▉     | 18720/37963 [46:00:38<47:40:14,  8.92s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '2.76', 'learning_rate': '1.071e-05', 'epoch': '0.4931'}
+
 49%|████▉     | 18720/37963 [46:00:38<47:40:14,  8.92s/it]
 49%|████▉     | 18721/37963 [46:00:46<45:38:04,  8.54s/it]
 49%|████▉     | 18722/37963 [46:00:53<44:18:53,  8.29s/it]
 49%|████▉     | 18723/37963 [46:01:01<43:25:15,  8.12s/it]
 49%|████▉     | 18724/37963 [46:01:09<42:47:56,  8.01s/it]
 49%|████▉     | 18725/37963 [46:01:16<42:18:17,  7.92s/it]
 49%|████▉     | 18726/37963 [46:01:31<53:03:56,  9.93s/it]
 49%|████▉     | 18727/37963 [46:01:39<50:08:53,  9.39s/it]
 49%|████▉     | 18728/37963 [46:01:47<47:03:30,  8.81s/it]
 49%|████▉     | 18729/37963 [46:02:02<57:01:18, 10.67s/it]
 49%|████▉     | 18730/37963 [46:02:10<52:27:09,  9.82s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '4.011', 'learning_rate': '1.07e-05', 'epoch': '0.4934'}
+
 49%|████▉     | 18730/37963 [46:02:10<52:27:09,  9.82s/it]
 49%|████▉     | 18731/37963 [46:02:17<48:49:21,  9.14s/it]
 49%|████▉     | 18732/37963 [46:02:25<46:32:10,  8.71s/it]
 49%|████▉     | 18733/37963 [46:02:32<44:49:22,  8.39s/it]
 49%|████▉     | 18734/37963 [46:02:47<54:02:27, 10.12s/it]
 49%|████▉     | 18735/37963 [46:02:54<50:02:46,  9.37s/it]
 49%|████▉     | 18736/37963 [46:03:02<47:28:17,  8.89s/it]
 49%|████▉     | 18737/37963 [46:03:09<44:51:48,  8.40s/it]
 49%|████▉     | 18738/37963 [46:03:24<55:25:34, 10.38s/it]
 49%|████▉     | 18739/37963 [46:03:32<50:34:51,  9.47s/it]
 49%|████▉     | 18740/37963 [46:03:39<47:21:44,  8.87s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '2.269', 'learning_rate': '1.069e-05', 'epoch': '0.4936'}
+
 49%|████▉     | 18740/37963 [46:03:39<47:21:44,  8.87s/it]
 49%|████▉     | 18741/37963 [46:03:47<45:31:26,  8.53s/it]
 49%|████▉     | 18742/37963 [46:03:54<44:08:03,  8.27s/it]
 49%|████▉     | 18743/37963 [46:04:02<43:16:44,  8.11s/it]
 49%|████▉     | 18744/37963 [46:04:10<42:42:01,  8.00s/it]
 49%|████▉     | 18745/37963 [46:04:18<42:16:24,  7.92s/it]
 49%|████▉     | 18746/37963 [46:04:25<41:52:12,  7.84s/it]
 49%|████▉     | 18747/37963 [46:04:33<41:04:21,  7.69s/it]
 49%|████▉     | 18748/37963 [46:04:40<41:02:16,  7.69s/it]
 49%|████▉     | 18749/37963 [46:04:48<40:56:07,  7.67s/it]
 49%|████▉     | 18750/37963 [46:04:56<40:51:56,  7.66s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '1.549', 'learning_rate': '1.068e-05', 'epoch': '0.4939'}
+
 49%|████▉     | 18750/37963 [46:04:56<40:51:56,  7.66s/it]
 49%|████▉     | 18751/37963 [46:05:03<41:07:52,  7.71s/it]
 49%|████▉     | 18752/37963 [46:05:19<53:03:15,  9.94s/it]
 49%|████▉     | 18753/37963 [46:05:26<49:46:00,  9.33s/it]
 49%|████▉     | 18754/37963 [46:05:34<46:28:22,  8.71s/it]
 49%|████▉     | 18755/37963 [46:05:42<45:01:04,  8.44s/it]
 49%|████▉     | 18756/37963 [46:05:49<43:52:39,  8.22s/it]
 49%|████▉     | 18757/37963 [46:06:04<53:30:21, 10.03s/it]
 49%|████▉     | 18758/37963 [46:06:18<60:11:06, 11.28s/it]
 49%|████▉     | 18759/37963 [46:06:26<55:08:48, 10.34s/it]
 49%|████▉     | 18760/37963 [46:06:34<51:02:01,  9.57s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '1.724', 'learning_rate': '1.068e-05', 'epoch': '0.4942'}
+
 49%|████▉     | 18760/37963 [46:06:34<51:02:01,  9.57s/it]
 49%|████▉     | 18761/37963 [46:06:41<48:19:22,  9.06s/it]
 49%|████▉     | 18762/37963 [46:06:49<45:54:05,  8.61s/it]
 49%|████▉     | 18763/37963 [46:06:57<44:46:05,  8.39s/it]
 49%|████▉     | 18764/37963 [46:07:04<43:17:06,  8.12s/it]
 49%|████▉     | 18765/37963 [46:07:12<42:43:48,  8.01s/it]
 49%|████▉     | 18766/37963 [46:07:27<53:06:30,  9.96s/it]
 49%|████▉     | 18767/37963 [46:07:35<50:01:23,  9.38s/it]
 49%|████▉     | 18768/37963 [46:07:43<47:31:25,  8.91s/it]
 49%|████▉     | 18769/37963 [46:07:51<46:06:00,  8.65s/it]
 49%|████▉     | 18770/37963 [46:08:05<54:51:08, 10.29s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '2.697', 'learning_rate': '1.067e-05', 'epoch': '0.4944'}
+
 49%|████▉     | 18770/37963 [46:08:05<54:51:08, 10.29s/it]
 49%|████▉     | 18771/37963 [46:08:12<50:36:52,  9.49s/it]
 49%|████▉     | 18772/37963 [46:08:20<48:06:25,  9.02s/it]
 49%|████▉     | 18773/37963 [46:08:28<45:56:48,  8.62s/it]
 49%|████▉     | 18774/37963 [46:08:36<44:23:52,  8.33s/it]
 49%|████▉     | 18775/37963 [46:08:43<43:19:27,  8.13s/it]
 49%|████▉     | 18776/37963 [46:08:51<42:33:56,  7.99s/it]
 49%|████▉     | 18777/37963 [46:08:59<42:16:35,  7.93s/it]
 49%|████▉     | 18778/37963 [46:09:14<53:39:21, 10.07s/it]
 49%|████▉     | 18779/37963 [46:09:21<49:49:28,  9.35s/it]
 49%|████▉     | 18780/37963 [46:09:29<47:13:11,  8.86s/it]
                                                           
{'loss': '0.1644', 'grad_norm': '3.106', 'learning_rate': '1.066e-05', 'epoch': '0.4947'}
+
 49%|████▉     | 18780/37963 [46:09:29<47:13:11,  8.86s/it]
 49%|████▉     | 18781/37963 [46:09:37<45:16:36,  8.50s/it]
 49%|████▉     | 18782/37963 [46:09:44<43:54:28,  8.24s/it]
 49%|████▉     | 18783/37963 [46:09:52<42:47:42,  8.03s/it]
 49%|████▉     | 18784/37963 [46:10:07<54:30:49, 10.23s/it]
 49%|████▉     | 18785/37963 [46:10:15<50:34:17,  9.49s/it]
 49%|████▉     | 18786/37963 [46:10:23<47:47:49,  8.97s/it]
 49%|████▉     | 18787/37963 [46:10:30<45:32:17,  8.55s/it]
 49%|████▉     | 18788/37963 [46:10:45<55:36:54, 10.44s/it]
 49%|████▉     | 18789/37963 [46:10:53<50:57:29,  9.57s/it]
 49%|████▉     | 18790/37963 [46:11:00<47:34:39,  8.93s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '2.343', 'learning_rate': '1.065e-05', 'epoch': '0.495'}
+
 49%|████▉     | 18790/37963 [46:11:00<47:34:39,  8.93s/it]
 49%|████▉     | 18791/37963 [46:11:08<45:29:25,  8.54s/it]
 50%|████▉     | 18792/37963 [46:11:15<43:54:34,  8.25s/it]
 50%|████▉     | 18793/37963 [46:11:23<43:05:14,  8.09s/it]
 50%|████▉     | 18794/37963 [46:11:30<41:48:54,  7.85s/it]
 50%|████▉     | 18795/37963 [46:11:38<41:31:34,  7.80s/it]
 50%|████▉     | 18796/37963 [46:11:46<41:18:32,  7.76s/it]
 50%|████▉     | 18797/37963 [46:11:53<41:09:15,  7.73s/it]
 50%|████▉     | 18798/37963 [46:12:01<41:10:47,  7.74s/it]
 50%|████▉     | 18799/37963 [46:12:09<41:02:36,  7.71s/it]
 50%|████▉     | 18800/37963 [46:12:24<52:40:03,  9.89s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '1.262', 'learning_rate': '1.064e-05', 'epoch': '0.4952'}
+
 50%|████▉     | 18800/37963 [46:12:24<52:40:03,  9.89s/it]
 50%|████▉     | 18801/37963 [46:12:32<49:21:40,  9.27s/it]
 50%|████▉     | 18802/37963 [46:12:46<57:18:04, 10.77s/it]
 50%|████▉     | 18803/37963 [46:12:54<52:23:10,  9.84s/it]
 50%|████▉     | 18804/37963 [46:13:01<49:00:18,  9.21s/it]
 50%|████▉     | 18805/37963 [46:13:16<57:28:41, 10.80s/it]
 50%|████▉     | 18806/37963 [46:13:24<52:37:43,  9.89s/it]
 50%|████▉     | 18807/37963 [46:13:31<49:18:09,  9.27s/it]
 50%|████▉     | 18808/37963 [46:13:39<46:51:04,  8.81s/it]
 50%|████▉     | 18809/37963 [46:13:47<45:05:17,  8.47s/it]
 50%|████▉     | 18810/37963 [46:13:54<43:30:15,  8.18s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '1.417', 'learning_rate': '1.063e-05', 'epoch': '0.4955'}
+
 50%|████▉     | 18810/37963 [46:13:54<43:30:15,  8.18s/it]
 50%|████▉     | 18811/37963 [46:14:02<42:38:33,  8.02s/it]
 50%|████▉     | 18812/37963 [46:14:09<41:40:04,  7.83s/it]
 50%|████▉     | 18813/37963 [46:14:24<52:35:42,  9.89s/it]
 50%|████▉     | 18814/37963 [46:14:38<59:39:35, 11.22s/it]
 50%|████▉     | 18815/37963 [46:14:47<54:49:53, 10.31s/it]
 50%|████▉     | 18816/37963 [46:14:54<50:40:56,  9.53s/it]
 50%|████▉     | 18817/37963 [46:15:02<47:36:32,  8.95s/it]
 50%|████▉     | 18818/37963 [46:15:09<45:23:18,  8.53s/it]
 50%|████▉     | 18819/37963 [46:15:17<44:01:36,  8.28s/it]
 50%|████▉     | 18820/37963 [46:15:25<43:08:10,  8.11s/it]
                                                           
{'loss': '0.1631', 'grad_norm': '1.79', 'learning_rate': '1.062e-05', 'epoch': '0.4957'}
+
 50%|████▉     | 18820/37963 [46:15:25<43:08:10,  8.11s/it]
 50%|████▉     | 18821/37963 [46:15:33<42:28:56,  7.99s/it]
 50%|████▉     | 18822/37963 [46:15:40<41:56:31,  7.89s/it]
 50%|████▉     | 18823/37963 [46:15:48<41:36:43,  7.83s/it]
 50%|████▉     | 18824/37963 [46:15:55<41:07:13,  7.73s/it]
 50%|████▉     | 18825/37963 [46:16:03<40:59:00,  7.71s/it]
 50%|████▉     | 18826/37963 [46:16:11<40:54:24,  7.70s/it]
 50%|████▉     | 18827/37963 [46:16:18<40:58:32,  7.71s/it]
 50%|████▉     | 18828/37963 [46:16:26<41:06:56,  7.74s/it]
 50%|████▉     | 18829/37963 [46:16:34<41:03:56,  7.73s/it]
 50%|████▉     | 18830/37963 [46:16:49<52:31:50,  9.88s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '5.559', 'learning_rate': '1.062e-05', 'epoch': '0.496'}
+
 50%|████▉     | 18830/37963 [46:16:49<52:31:50,  9.88s/it]
 50%|████▉     | 18831/37963 [46:16:57<49:21:25,  9.29s/it]
 50%|████▉     | 18832/37963 [46:17:12<58:33:40, 11.02s/it]
 50%|████▉     | 18833/37963 [46:17:20<53:18:53, 10.03s/it]
 50%|████▉     | 18834/37963 [46:17:27<49:40:43,  9.35s/it]
 50%|████▉     | 18835/37963 [46:17:42<57:51:36, 10.89s/it]
 50%|████▉     | 18836/37963 [46:17:49<52:40:21,  9.91s/it]
 50%|████▉     | 18837/37963 [46:17:57<49:06:44,  9.24s/it]
 50%|████▉     | 18838/37963 [46:18:05<46:34:53,  8.77s/it]
 50%|████▉     | 18839/37963 [46:18:12<44:32:06,  8.38s/it]
 50%|████▉     | 18840/37963 [46:18:20<43:27:24,  8.18s/it]
                                                           
{'loss': '0.1487', 'grad_norm': '1.139', 'learning_rate': '1.061e-05', 'epoch': '0.4963'}
+
 50%|████▉     | 18840/37963 [46:18:20<43:27:24,  8.18s/it]
 50%|████▉     | 18841/37963 [46:18:28<42:38:46,  8.03s/it]
 50%|████▉     | 18842/37963 [46:18:36<42:31:14,  8.01s/it]
 50%|████▉     | 18843/37963 [46:18:43<41:53:27,  7.89s/it]
 50%|████▉     | 18844/37963 [46:18:51<41:43:47,  7.86s/it]
 50%|████▉     | 18845/37963 [46:18:59<41:20:32,  7.78s/it]
 50%|████▉     | 18846/37963 [46:19:06<41:03:02,  7.73s/it]
 50%|████▉     | 18847/37963 [46:19:14<40:57:47,  7.71s/it]
 50%|████▉     | 18848/37963 [46:19:22<41:05:08,  7.74s/it]
 50%|████▉     | 18849/37963 [46:19:36<51:35:11,  9.72s/it]
 50%|████▉     | 18850/37963 [46:19:50<58:26:40, 11.01s/it]
                                                           
{'loss': '0.1367', 'grad_norm': '3.049', 'learning_rate': '1.06e-05', 'epoch': '0.4965'}
+
 50%|████▉     | 18850/37963 [46:19:50<58:26:40, 11.01s/it]
 50%|████▉     | 18851/37963 [46:19:58<53:28:45, 10.07s/it]
 50%|████▉     | 18852/37963 [46:20:06<49:32:46,  9.33s/it]
 50%|████▉     | 18853/37963 [46:20:13<46:33:15,  8.77s/it]
 50%|████▉     | 18854/37963 [46:20:28<56:31:55, 10.65s/it]
 50%|████▉     | 18855/37963 [46:20:36<51:58:52,  9.79s/it]
 50%|████▉     | 18856/37963 [46:20:44<48:42:48,  9.18s/it]
 50%|████▉     | 18857/37963 [46:20:51<46:21:18,  8.73s/it]
 50%|████▉     | 18858/37963 [46:20:59<44:40:34,  8.42s/it]
 50%|████▉     | 18859/37963 [46:21:07<43:35:09,  8.21s/it]
 50%|████▉     | 18860/37963 [46:21:14<42:43:42,  8.05s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '1.491', 'learning_rate': '1.059e-05', 'epoch': '0.4968'}
+
 50%|████▉     | 18860/37963 [46:21:14<42:43:42,  8.05s/it]
 50%|████▉     | 18861/37963 [46:21:29<52:33:28,  9.91s/it]
 50%|████▉     | 18862/37963 [46:21:36<48:57:50,  9.23s/it]
 50%|████▉     | 18863/37963 [46:21:44<46:22:07,  8.74s/it]
 50%|████▉     | 18864/37963 [46:21:52<44:58:15,  8.48s/it]
 50%|████▉     | 18865/37963 [46:22:00<43:56:01,  8.28s/it]
 50%|████▉     | 18866/37963 [46:22:07<42:50:50,  8.08s/it]
 50%|████▉     | 18867/37963 [46:22:21<52:44:54,  9.94s/it]
 50%|████▉     | 18868/37963 [46:22:29<49:29:07,  9.33s/it]
 50%|████▉     | 18869/37963 [46:22:37<46:42:25,  8.81s/it]
 50%|████▉     | 18870/37963 [46:22:45<44:53:32,  8.46s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '3.717', 'learning_rate': '1.058e-05', 'epoch': '0.4971'}
+
 50%|████▉     | 18870/37963 [46:22:45<44:53:32,  8.46s/it]
 50%|████▉     | 18871/37963 [46:22:52<43:22:11,  8.18s/it]
 50%|████▉     | 18872/37963 [46:23:00<42:11:30,  7.96s/it]
 50%|████▉     | 18873/37963 [46:23:07<41:48:26,  7.88s/it]
 50%|████▉     | 18874/37963 [46:23:15<41:17:43,  7.79s/it]
 50%|████▉     | 18875/37963 [46:23:30<52:50:56,  9.97s/it]
 50%|████▉     | 18876/37963 [46:23:38<49:10:29,  9.27s/it]
 50%|████▉     | 18877/37963 [46:23:53<58:35:19, 11.05s/it]
 50%|████▉     | 18878/37963 [46:24:00<53:15:32, 10.05s/it]
 50%|████▉     | 18879/37963 [46:24:08<49:30:19,  9.34s/it]
 50%|████▉     | 18880/37963 [46:24:16<47:02:29,  8.87s/it]
                                                           
{'loss': '0.1633', 'grad_norm': '1.352', 'learning_rate': '1.057e-05', 'epoch': '0.4973'}
+
 50%|████▉     | 18880/37963 [46:24:16<47:02:29,  8.87s/it]
 50%|████▉     | 18881/37963 [46:24:24<45:02:40,  8.50s/it]
 50%|████▉     | 18882/37963 [46:24:31<43:39:50,  8.24s/it]
 50%|████▉     | 18883/37963 [46:24:46<54:18:37, 10.25s/it]
 50%|████▉     | 18884/37963 [46:24:54<50:33:16,  9.54s/it]
 50%|████▉     | 18885/37963 [46:25:02<47:38:43,  8.99s/it]
 50%|████▉     | 18886/37963 [46:25:09<45:30:46,  8.59s/it]
 50%|████▉     | 18887/37963 [46:25:17<43:48:02,  8.27s/it]
 50%|████▉     | 18888/37963 [46:25:25<42:59:31,  8.11s/it]
 50%|████▉     | 18889/37963 [46:25:32<42:15:38,  7.98s/it]
 50%|████▉     | 18890/37963 [46:25:40<41:48:39,  7.89s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '0.83', 'learning_rate': '1.056e-05', 'epoch': '0.4976'}
+
 50%|████▉     | 18890/37963 [46:25:40<41:48:39,  7.89s/it]
 50%|████▉     | 18891/37963 [46:25:47<41:09:16,  7.77s/it]
 50%|████▉     | 18892/37963 [46:25:55<41:11:33,  7.78s/it]
 50%|████▉     | 18893/37963 [46:26:03<41:04:34,  7.75s/it]
 50%|████▉     | 18894/37963 [46:26:11<41:02:27,  7.75s/it]
 50%|████▉     | 18895/37963 [46:26:19<41:08:04,  7.77s/it]
 50%|████▉     | 18896/37963 [46:26:26<41:08:17,  7.77s/it]
 50%|███��▉     | 18897/37963 [46:26:34<40:48:42,  7.71s/it]
 50%|████▉     | 18898/37963 [46:26:49<52:38:34,  9.94s/it]
 50%|████▉     | 18899/37963 [46:27:04<60:00:31, 11.33s/it]
 50%|████▉     | 18900/37963 [46:27:18<64:58:22, 12.27s/it]
                                                           
{'loss': '0.148', 'grad_norm': '1.691', 'learning_rate': '1.056e-05', 'epoch': '0.4979'}
+
 50%|████▉     | 18900/37963 [46:27:18<64:58:22, 12.27s/it]
 50%|████▉     | 18901/37963 [46:27:26<57:59:41, 10.95s/it]
 50%|████▉     | 18902/37963 [46:27:34<52:54:52,  9.99s/it]
 50%|████▉     | 18903/37963 [46:27:41<49:17:50,  9.31s/it]
 50%|████▉     | 18904/37963 [46:27:49<46:51:48,  8.85s/it]
 50%|████▉     | 18905/37963 [46:27:57<45:00:44,  8.50s/it]
 50%|████▉     | 18906/37963 [46:28:05<43:43:31,  8.26s/it]
 50%|████▉     | 18907/37963 [46:28:12<42:31:18,  8.03s/it]
 50%|████▉     | 18908/37963 [46:28:20<42:00:28,  7.94s/it]
 50%|████▉     | 18909/37963 [46:28:34<51:46:26,  9.78s/it]
 50%|████▉     | 18910/37963 [46:28:41<48:03:36,  9.08s/it]
                                                           
{'loss': '0.1344', 'grad_norm': '1.441', 'learning_rate': '1.055e-05', 'epoch': '0.4981'}
+
 50%|████▉     | 18910/37963 [46:28:41<48:03:36,  9.08s/it]
 50%|████▉     | 18911/37963 [46:28:49<45:56:03,  8.68s/it]
 50%|████▉     | 18912/37963 [46:29:03<54:30:33, 10.30s/it]
 50%|████▉     | 18913/37963 [46:29:11<49:52:46,  9.43s/it]
 50%|████▉     | 18914/37963 [46:29:18<46:51:05,  8.85s/it]
 50%|████▉     | 18915/37963 [46:29:25<44:34:30,  8.42s/it]
 50%|████▉     | 18916/37963 [46:29:33<43:35:16,  8.24s/it]
 50%|████▉     | 18917/37963 [46:29:41<42:26:36,  8.02s/it]
 50%|████▉     | 18918/37963 [46:29:49<42:06:57,  7.96s/it]
 50%|████▉     | 18919/37963 [46:29:56<41:15:18,  7.80s/it]
 50%|████▉     | 18920/37963 [46:30:04<41:05:42,  7.77s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '2.287', 'learning_rate': '1.054e-05', 'epoch': '0.4984'}
+
 50%|████▉     | 18920/37963 [46:30:04<41:05:42,  7.77s/it]
 50%|████▉     | 18921/37963 [46:30:11<40:58:46,  7.75s/it]
 50%|████▉     | 18922/37963 [46:30:19<40:54:14,  7.73s/it]
 50%|████▉     | 18923/37963 [46:30:27<41:01:41,  7.76s/it]
 50%|████▉     | 18924/37963 [46:30:35<41:01:43,  7.76s/it]
 50%|████▉     | 18925/37963 [46:30:50<52:40:31,  9.96s/it]
 50%|████▉     | 18926/37963 [46:30:58<49:09:38,  9.30s/it]
 50%|████▉     | 18927/37963 [46:31:05<46:36:03,  8.81s/it]
 50%|████▉     | 18928/37963 [46:31:13<44:47:01,  8.47s/it]
 50%|████▉     | 18929/37963 [46:31:28<54:46:38, 10.36s/it]
 50%|████▉     | 18930/37963 [46:31:35<50:42:10,  9.59s/it]
                                                           
{'loss': '0.152', 'grad_norm': '3.578', 'learning_rate': '1.053e-05', 'epoch': '0.4986'}
+
 50%|████▉     | 18930/37963 [46:31:35<50:42:10,  9.59s/it]
 50%|████▉     | 18931/37963 [46:31:43<47:39:28,  9.01s/it]
 50%|████▉     | 18932/37963 [46:31:58<57:13:29, 10.82s/it]
 50%|████▉     | 18933/37963 [46:32:06<52:01:24,  9.84s/it]
 50%|████▉     | 18934/37963 [46:32:13<48:36:49,  9.20s/it]
 50%|████▉     | 18935/37963 [46:32:21<45:50:34,  8.67s/it]
 50%|████▉     | 18936/37963 [46:32:29<44:23:11,  8.40s/it]
 50%|████▉     | 18937/37963 [46:32:36<43:17:49,  8.19s/it]
 50%|████▉     | 18938/37963 [46:32:44<42:14:44,  7.99s/it]
 50%|████▉     | 18939/37963 [46:32:52<42:01:22,  7.95s/it]
 50%|████▉     | 18940/37963 [46:32:59<41:45:04,  7.90s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '2.384', 'learning_rate': '1.052e-05', 'epoch': '0.4989'}
+
 50%|████▉     | 18940/37963 [46:32:59<41:45:04,  7.90s/it]
 50%|████▉     | 18941/37963 [46:33:07<40:57:51,  7.75s/it]
 50%|████▉     | 18942/37963 [46:33:15<40:58:01,  7.75s/it]
 50%|████▉     | 18943/37963 [46:33:22<40:45:51,  7.72s/it]
 50%|████▉     | 18944/37963 [46:33:30<40:17:15,  7.63s/it]
 50%|████▉     | 18945/37963 [46:33:37<40:21:40,  7.64s/it]
 50%|████▉     | 18946/37963 [46:33:45<40:25:53,  7.65s/it]
 50%|████▉     | 18947/37963 [46:33:59<50:56:52,  9.65s/it]
 50%|████▉     | 18948/37963 [46:34:14<59:38:48, 11.29s/it]
 50%|████▉     | 18949/37963 [46:34:22<54:06:43, 10.25s/it]
 50%|████▉     | 18950/37963 [46:34:36<60:04:03, 11.37s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '1.739', 'learning_rate': '1.051e-05', 'epoch': '0.4992'}
+
 50%|████▉     | 18950/37963 [46:34:36<60:04:03, 11.37s/it]
 50%|████▉     | 18951/37963 [46:34:44<54:12:42, 10.27s/it]
 50%|████▉     | 18952/37963 [46:34:52<50:15:53,  9.52s/it]
 50%|████▉     | 18953/37963 [46:34:59<47:21:51,  8.97s/it]
 50%|████▉     | 18954/37963 [46:35:07<44:52:50,  8.50s/it]
 50%|████▉     | 18955/37963 [46:35:15<43:35:40,  8.26s/it]
 50%|████▉     | 18956/37963 [46:35:22<42:51:16,  8.12s/it]
 50%|████▉     | 18957/37963 [46:35:37<52:37:04,  9.97s/it]
 50%|████▉     | 18958/37963 [46:35:44<48:59:58,  9.28s/it]
 50%|████▉     | 18959/37963 [46:35:52<46:31:35,  8.81s/it]
 50%|████▉     | 18960/37963 [46:36:00<44:46:59,  8.48s/it]
                                                           
{'loss': '0.16', 'grad_norm': '3.162', 'learning_rate': '1.05e-05', 'epoch': '0.4994'}
+
 50%|████▉     | 18960/37963 [46:36:00<44:46:59,  8.48s/it]
 50%|████▉     | 18961/37963 [46:36:07<43:26:18,  8.23s/it]
 50%|████▉     | 18962/37963 [46:36:15<42:28:22,  8.05s/it]
 50%|████▉     | 18963/37963 [46:36:23<41:55:25,  7.94s/it]
 50%|████▉     | 18964/37963 [46:36:30<41:40:55,  7.90s/it]
 50%|████▉     | 18965/37963 [46:36:44<51:01:18,  9.67s/it]
 50%|████▉     | 18966/37963 [46:36:52<48:09:51,  9.13s/it]
 50%|████▉     | 18967/37963 [46:37:00<45:38:03,  8.65s/it]
 50%|████▉     | 18968/37963 [46:37:07<44:00:32,  8.34s/it]
 50%|████▉     | 18969/37963 [46:37:15<43:04:23,  8.16s/it]
 50%|████▉     | 18970/37963 [46:37:23<42:34:51,  8.07s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '0.8327', 'learning_rate': '1.05e-05', 'epoch': '0.4997'}
+
 50%|████▉     | 18970/37963 [46:37:23<42:34:51,  8.07s/it]
 50%|████▉     | 18971/37963 [46:37:31<41:56:18,  7.95s/it]
 50%|████▉     | 18972/37963 [46:37:38<41:21:49,  7.84s/it]
 50%|████▉     | 18973/37963 [46:37:46<41:12:39,  7.81s/it]
 50%|████▉     | 18974/37963 [46:37:54<41:07:26,  7.80s/it]
 50%|████▉     | 18975/37963 [46:38:01<40:57:26,  7.77s/it]
 50%|████▉     | 18976/37963 [46:38:09<40:48:54,  7.74s/it]
 50%|████▉     | 18977/37963 [46:38:24<52:37:25,  9.98s/it]
 50%|████▉     | 18978/37963 [46:38:39<60:59:38, 11.57s/it]
 50%|████▉     | 18979/37963 [46:38:47<55:17:54, 10.49s/it]
 50%|████▉     | 18980/37963 [46:38:55<50:55:36,  9.66s/it]
                                                           
{'loss': '0.1521', 'grad_norm': '1.943', 'learning_rate': '1.049e-05', 'epoch': '0.5'}
+
 50%|████▉     | 18980/37963 [46:38:55<50:55:36,  9.66s/it]
 50%|████▉     | 18981/37963 [46:39:03<47:48:41,  9.07s/it]
 50%|█████     | 18982/37963 [46:39:11<45:42:56,  8.67s/it]
 50%|█████     | 18983/37963 [46:39:18<44:16:26,  8.40s/it]
 50%|█████     | 18984/37963 [46:39:26<42:35:06,  8.08s/it]
 50%|█████     | 18985/37963 [46:39:34<42:07:14,  7.99s/it]
 50%|█████     | 18986/37963 [46:39:49<53:21:08, 10.12s/it]
 50%|█████     | 18987/37963 [46:39:56<49:50:08,  9.45s/it]
 50%|█████     | 18988/37963 [46:40:04<47:00:22,  8.92s/it]
 50%|█████     | 18989/37963 [46:40:12<45:00:55,  8.54s/it]
 50%|█████     | 18990/37963 [46:40:20<43:50:11,  8.32s/it]
                                                           
{'loss': '0.1535', 'grad_norm': '2.746', 'learning_rate': '1.048e-05', 'epoch': '0.5002'}
+
 50%|█████     | 18990/37963 [46:40:20<43:50:11,  8.32s/it]
 50%|█████     | 18991/37963 [46:40:27<43:00:06,  8.16s/it]
 50%|█████     | 18992/37963 [46:40:35<42:09:02,  8.00s/it]
 50%|█████     | 18993/37963 [46:40:43<41:25:54,  7.86s/it]
 50%|█████     | 18994/37963 [46:40:50<41:30:20,  7.88s/it]
 50%|█████     | 18995/37963 [46:40:58<41:11:26,  7.82s/it]
 50%|█████     | 18996/37963 [46:41:06<41:00:32,  7.78s/it]
 50%|█████     | 18997/37963 [46:41:13<40:36:24,  7.71s/it]
 50%|█████     | 18998/37963 [46:41:21<40:06:36,  7.61s/it]
 50%|█████     | 18999/37963 [46:41:29<40:49:48,  7.75s/it]
 50%|█████     | 19000/37963 [46:41:43<50:43:55,  9.63s/it]
                                                           
{'loss': '0.1439', 'grad_norm': '2.625', 'learning_rate': '1.047e-05', 'epoch': '0.5005'}
+
 50%|█████     | 19000/37963 [46:41:43<50:43:55,  9.63s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.94s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.94s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 50%|█████     | 19001/37963 [46:42:53<146:16:53, 27.77s/it]
 50%|█████     | 19002/37963 [46:43:01<114:39:34, 21.77s/it]
 50%|█████     | 19003/37963 [46:43:08<92:27:38, 17.56s/it] 
 50%|█████     | 19004/37963 [46:43:16<77:10:10, 14.65s/it]
 50%|█████     | 19005/37963 [46:43:31<76:58:56, 14.62s/it]
 50%|█████     | 19006/37963 [46:43:39<66:17:32, 12.59s/it]
 50%|█████     | 19007/37963 [46:43:47<58:39:10, 11.14s/it]
 50%|█████     | 19008/37963 [46:43:54<53:15:40, 10.12s/it]
 50%|█████     | 19009/37963 [46:44:02<49:26:11,  9.39s/it]
 50%|█████     | 19010/37963 [46:44:10<46:56:20,  8.92s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '1.711', 'learning_rate': '1.046e-05', 'epoch': '0.5008'}
+
 50%|█████     | 19010/37963 [46:44:10<46:56:20,  8.92s/it]
 50%|█████     | 19011/37963 [46:44:17<45:00:40,  8.55s/it]
 50%|█████     | 19012/37963 [46:44:25<43:49:40,  8.33s/it]
 50%|█████     | 19013/37963 [46:44:33<42:51:38,  8.14s/it]
 50%|█████     | 19014/37963 [46:44:47<52:42:27, 10.01s/it]
 50%|█████     | 19015/37963 [46:44:55<49:06:23,  9.33s/it]
 50%|█████     | 19016/37963 [46:45:03<46:34:39,  8.85s/it]
 50%|█████     | 19017/37963 [46:45:10<44:40:02,  8.49s/it]
 50%|█████     | 19018/37963 [46:45:18<43:25:32,  8.25s/it]
 50%|█████     | 19019/37963 [46:45:26<42:11:46,  8.02s/it]
 50%|█████     | 19020/37963 [46:45:33<41:38:15,  7.91s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '1.762', 'learning_rate': '1.045e-05', 'epoch': '0.501'}
+
 50%|█████     | 19020/37963 [46:45:33<41:38:15,  7.91s/it]
 50%|█████     | 19021/37963 [46:45:41<41:28:12,  7.88s/it]
 50%|█████     | 19022/37963 [46:45:49<41:18:47,  7.85s/it]
 50%|█████     | 19023/37963 [46:45:57<41:00:20,  7.79s/it]
 50%|█████     | 19024/37963 [46:46:11<51:48:31,  9.85s/it]
 50%|█████     | 19025/37963 [46:46:19<48:25:54,  9.21s/it]
 50%|█████     | 19026/37963 [46:46:27<46:04:32,  8.76s/it]
 50%|█████     | 19027/37963 [46:46:34<44:06:15,  8.38s/it]
 50%|█████     | 19028/37963 [46:46:50<55:13:02, 10.50s/it]
 50%|█████     | 19029/37963 [46:46:58<51:16:20,  9.75s/it]
 50%|█████     | 19030/37963 [46:47:05<47:49:35,  9.09s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '1.872', 'learning_rate': '1.045e-05', 'epoch': '0.5013'}
+
 50%|█████     | 19030/37963 [46:47:05<47:49:35,  9.09s/it]
 50%|█████     | 19031/37963 [46:47:13<45:33:27,  8.66s/it]
 50%|█████     | 19032/37963 [46:47:20<43:53:28,  8.35s/it]
 50%|█████     | 19033/37963 [46:47:28<42:34:52,  8.10s/it]
 50%|█████     | 19034/37963 [46:47:36<41:53:21,  7.97s/it]
 50%|█████     | 19035/37963 [46:47:50<52:48:42, 10.04s/it]
 50%|█████     | 19036/37963 [46:47:58<48:42:59,  9.27s/it]
 50%|█████     | 19037/37963 [46:48:05<45:57:59,  8.74s/it]
 50%|█████     | 19038/37963 [46:48:13<44:12:48,  8.41s/it]
 50%|█████     | 19039/37963 [46:48:21<43:26:53,  8.27s/it]
 50%|█████     | 19040/37963 [46:48:28<42:08:44,  8.02s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '2.784', 'learning_rate': '1.044e-05', 'epoch': '0.5015'}
+
 50%|█████     | 19040/37963 [46:48:28<42:08:44,  8.02s/it]
 50%|█████     | 19041/37963 [46:48:36<41:40:35,  7.93s/it]
 50%|█████     | 19042/37963 [46:48:44<41:23:38,  7.88s/it]
 50%|█████     | 19043/37963 [46:48:52<41:08:38,  7.83s/it]
 50%|█████     | 19044/37963 [46:48:59<40:39:18,  7.74s/it]
 50%|█████     | 19045/37963 [46:49:07<40:30:00,  7.71s/it]
 50%|█████     | 19046/37963 [46:49:21<51:00:47,  9.71s/it]
 50%|█████     | 19047/37963 [46:49:29<48:02:01,  9.14s/it]
 50%|█████     | 19048/37963 [46:49:37<45:40:08,  8.69s/it]
 50%|█████     | 19049/37963 [46:49:58<65:58:55, 12.56s/it]
 50%|█████     | 19050/37963 [46:50:13<69:13:25, 13.18s/it]
                                                           
{'loss': '0.155', 'grad_norm': '1.927', 'learning_rate': '1.043e-05', 'epoch': '0.5018'}
+
 50%|█████     | 19050/37963 [46:50:13<69:13:25, 13.18s/it]
 50%|█████     | 19051/37963 [46:50:20<60:33:39, 11.53s/it]
 50%|█████     | 19052/37963 [46:50:28<54:32:14, 10.38s/it]
 50%|█████     | 19053/37963 [46:50:36<50:18:58,  9.58s/it]
 50%|█████     | 19054/37963 [46:50:43<46:43:34,  8.90s/it]
 50%|█████     | 19055/37963 [46:50:51<44:32:11,  8.48s/it]
 50%|█████     | 19056/37963 [46:50:58<43:09:54,  8.22s/it]
 50%|█████     | 19057/37963 [46:51:06<42:14:48,  8.04s/it]
 50%|█████     | 19058/37963 [46:51:20<52:03:44,  9.91s/it]
 50%|█████     | 19059/37963 [46:51:28<48:37:25,  9.26s/it]
 50%|█████     | 19060/37963 [46:51:36<46:14:25,  8.81s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '1.931', 'learning_rate': '1.042e-05', 'epoch': '0.5021'}
+
 50%|█████     | 19060/37963 [46:51:36<46:14:25,  8.81s/it]
 50%|█████     | 19061/37963 [46:51:44<44:40:28,  8.51s/it]
 50%|█████     | 19062/37963 [46:51:51<43:37:59,  8.31s/it]
 50%|█████     | 19063/37963 [46:51:59<42:30:14,  8.10s/it]
 50%|█████     | 19064/37963 [46:52:07<41:50:33,  7.97s/it]
 50%|█████     | 19065/37963 [46:52:15<41:47:27,  7.96s/it]
 50%|█████     | 19066/37963 [46:52:22<41:10:03,  7.84s/it]
 50%|█████     | 19067/37963 [46:52:30<40:37:11,  7.74s/it]
 50%|█████     | 19068/37963 [46:52:37<40:05:22,  7.64s/it]
 50%|█████     | 19069/37963 [46:52:45<40:24:05,  7.70s/it]
 50%|█████     | 19070/37963 [46:52:53<40:30:45,  7.72s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '3.113', 'learning_rate': '1.041e-05', 'epoch': '0.5023'}
+
 50%|█████     | 19070/37963 [46:52:53<40:30:45,  7.72s/it]
 50%|█████     | 19071/37963 [46:53:00<40:26:44,  7.71s/it]
 50%|█████     | 19072/37963 [46:53:15<52:10:22,  9.94s/it]
 50%|█████     | 19073/37963 [46:53:23<48:25:29,  9.23s/it]
 50%|█████     | 19074/37963 [46:53:31<46:04:46,  8.78s/it]
 50%|█████     | 19075/37963 [46:53:46<56:16:04, 10.72s/it]
 50%|█████     | 19076/37963 [46:53:53<50:57:33,  9.71s/it]
 50%|█████     | 19077/37963 [46:54:01<47:44:59,  9.10s/it]
 50%|█████     | 19078/37963 [46:54:09<45:35:08,  8.69s/it]
 50%|█████     | 19079/37963 [46:54:24<55:16:43, 10.54s/it]
 50%|█████     | 19080/37963 [46:54:31<50:58:56,  9.72s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '1.334', 'learning_rate': '1.04e-05', 'epoch': '0.5026'}
+
 50%|█████     | 19080/37963 [46:54:31<50:58:56,  9.72s/it]
 50%|█████     | 19081/37963 [46:54:39<47:41:34,  9.09s/it]
 50%|█████     | 19082/37963 [46:54:47<45:30:05,  8.68s/it]
 50%|█████     | 19083/37963 [46:54:54<43:46:39,  8.35s/it]
 50%|█████     | 19084/37963 [46:55:02<42:47:43,  8.16s/it]
 50%|█████     | 19085/37963 [46:55:10<41:57:00,  8.00s/it]
 50%|█████     | 19086/37963 [46:55:18<41:41:09,  7.95s/it]
 50%|█████     | 19087/37963 [46:55:25<41:13:30,  7.86s/it]
 50%|█████     | 19088/37963 [46:55:33<41:01:20,  7.82s/it]
 50%|█████     | 19089/37963 [46:55:41<40:52:23,  7.80s/it]
 50%|█████     | 19090/37963 [46:55:48<40:25:44,  7.71s/it]
                                                           
{'loss': '0.141', 'grad_norm': '1.242', 'learning_rate': '1.039e-05', 'epoch': '0.5029'}
+
 50%|█████     | 19090/37963 [46:55:48<40:25:44,  7.71s/it]
 50%|█████     | 19091/37963 [46:55:56<40:24:55,  7.71s/it]
 50%|█████     | 19092/37963 [46:56:04<40:23:04,  7.70s/it]
 50%|█████     | 19093/37963 [46:56:18<50:11:12,  9.57s/it]
 50%|█████     | 19094/37963 [46:56:31<57:02:49, 10.88s/it]
 50%|█████     | 19095/37963 [46:56:47<64:34:55, 12.32s/it]
 50%|█████     | 19096/37963 [46:56:55<57:29:25, 10.97s/it]
 50%|█████     | 19097/37963 [46:57:03<52:41:29, 10.05s/it]
 50%|█████     | 19098/37963 [46:57:17<59:49:07, 11.42s/it]
 50%|█████     | 19099/37963 [46:57:25<54:11:48, 10.34s/it]
 50%|█████     | 19100/37963 [46:57:33<49:35:44,  9.47s/it]
                                                           
{'loss': '0.1403', 'grad_norm': '2.049', 'learning_rate': '1.039e-05', 'epoch': '0.5031'}
+
 50%|█████     | 19100/37963 [46:57:33<49:35:44,  9.47s/it]
 50%|█████     | 19101/37963 [46:57:40<46:44:53,  8.92s/it]
 50%|█████     | 19102/37963 [46:57:48<44:30:25,  8.50s/it]
 50%|█████     | 19103/37963 [46:58:02<53:42:58, 10.25s/it]
 50%|█████     | 19104/37963 [46:58:10<49:24:24,  9.43s/it]
 50%|█████     | 19105/37963 [46:58:18<46:48:44,  8.94s/it]
 50%|█████     | 19106/37963 [46:58:25<44:59:07,  8.59s/it]
 50%|█████     | 19107/37963 [46:58:33<42:57:31,  8.20s/it]
 50%|█████     | 19108/37963 [46:58:40<42:08:36,  8.05s/it]
 50%|█████     | 19109/37963 [46:58:48<41:15:54,  7.88s/it]
 50%|█████     | 19110/37963 [46:58:56<41:05:12,  7.85s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '0.8579', 'learning_rate': '1.038e-05', 'epoch': '0.5034'}
+
 50%|█████     | 19110/37963 [46:58:56<41:05:12,  7.85s/it]
 50%|█████     | 19111/37963 [46:59:03<40:39:31,  7.76s/it]
 50%|█████     | 19112/37963 [46:59:11<40:31:21,  7.74s/it]
 50%|█████     | 19113/37963 [46:59:18<40:25:33,  7.72s/it]
 50%|█████     | 19114/37963 [46:59:26<40:26:16,  7.72s/it]
 50%|█████     | 19115/37963 [46:59:34<39:57:17,  7.63s/it]
 50%|█████     | 19116/37963 [46:59:41<39:59:19,  7.64s/it]
 50%|█████     | 19117/37963 [46:59:56<51:39:28,  9.87s/it]
 50%|█████     | 19118/37963 [47:00:04<48:23:05,  9.24s/it]
 50%|█████     | 19119/37963 [47:00:12<46:09:06,  8.82s/it]
 50%|█████     | 19120/37963 [47:00:20<44:10:35,  8.44s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '1.424', 'learning_rate': '1.037e-05', 'epoch': '0.5036'}
+
 50%|█████     | 19120/37963 [47:00:20<44:10:35,  8.44s/it]
 50%|█████     | 19121/37963 [47:00:35<54:27:45, 10.41s/it]
 50%|█████     | 19122/37963 [47:00:43<50:44:49,  9.70s/it]
 50%|█████     | 19123/37963 [47:00:51<48:13:57,  9.22s/it]
 50%|█████     | 19124/37963 [47:00:58<45:23:30,  8.67s/it]
 50%|█████     | 19125/37963 [47:01:13<55:37:57, 10.63s/it]
 50%|█████     | 19126/37963 [47:01:21<51:48:19,  9.90s/it]
 50%|█████     | 19127/37963 [47:01:29<48:42:35,  9.31s/it]
 50%|█████     | 19128/37963 [47:01:37<46:24:31,  8.87s/it]
 50%|█████     | 19129/37963 [47:01:45<44:53:14,  8.58s/it]
 50%|█████     | 19130/37963 [47:01:53<43:37:06,  8.34s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '4.904', 'learning_rate': '1.036e-05', 'epoch': '0.5039'}
+
 50%|█████     | 19130/37963 [47:01:53<43:37:06,  8.34s/it]
 50%|█████     | 19131/37963 [47:02:01<42:47:28,  8.18s/it]
 50%|█████     | 19132/37963 [47:02:09<42:11:16,  8.07s/it]
 50%|█████     | 19133/37963 [47:02:16<41:12:50,  7.88s/it]
 50%|█████     | 19134/37963 [47:02:24<41:02:57,  7.85s/it]
 50%|█████     | 19135/37963 [47:02:31<40:48:36,  7.80s/it]
 50%|█████     | 19136/37963 [47:02:39<40:35:36,  7.76s/it]
 50%|█████     | 19137/37963 [47:02:47<40:22:22,  7.72s/it]
 50%|█████     | 19138/37963 [47:02:54<40:22:13,  7.72s/it]
 50%|█████     | 19139/37963 [47:03:02<40:20:58,  7.72s/it]
 50%|█████     | 19140/37963 [47:03:10<40:24:17,  7.73s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '1.458', 'learning_rate': '1.035e-05', 'epoch': '0.5042'}
+
 50%|█████     | 19140/37963 [47:03:10<40:24:17,  7.73s/it]
 50%|█████     | 19141/37963 [47:03:24<50:57:30,  9.75s/it]
 50%|█████     | 19142/37963 [47:03:32<47:29:56,  9.09s/it]
 50%|█████     | 19143/37963 [47:03:46<55:29:31, 10.61s/it]
 50%|█████     | 19144/37963 [47:03:54<51:21:39,  9.83s/it]
 50%|█████     | 19145/37963 [47:04:02<47:57:57,  9.18s/it]
 50%|█████     | 19146/37963 [47:04:16<55:40:19, 10.65s/it]
 50%|█████     | 19147/37963 [47:04:24<51:38:18,  9.88s/it]
 50%|█████     | 19148/37963 [47:04:32<48:11:05,  9.22s/it]
 50%|█████     | 19149/37963 [47:04:47<57:18:32, 10.97s/it]
 50%|█████     | 19150/37963 [47:05:01<62:23:25, 11.94s/it]
                                                           
{'loss': '0.153', 'grad_norm': '1.14', 'learning_rate': '1.034e-05', 'epoch': '0.5044'}
+
 50%|█████     | 19150/37963 [47:05:01<62:23:25, 11.94s/it]
 50%|█████     | 19151/37963 [47:05:09<55:43:21, 10.66s/it]
 50%|█████     | 19152/37963 [47:05:16<51:07:56,  9.79s/it]
 50%|█████     | 19153/37963 [47:05:24<47:51:32,  9.16s/it]
 50%|█████     | 19154/37963 [47:05:32<45:24:48,  8.69s/it]
 50%|█████     | 19155/37963 [47:05:39<44:02:46,  8.43s/it]
 50%|█████     | 19156/37963 [47:05:47<42:56:42,  8.22s/it]
 50%|█████     | 19157/37963 [47:05:55<42:19:28,  8.10s/it]
 50%|█████     | 19158/37963 [47:06:03<41:51:03,  8.01s/it]
 50%|█████     | 19159/37963 [47:06:11<41:57:58,  8.03s/it]
 50%|█████     | 19160/37963 [47:06:27<54:57:36, 10.52s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '1.265', 'learning_rate': '1.033e-05', 'epoch': '0.5047'}
+
 50%|█████     | 19160/37963 [47:06:27<54:57:36, 10.52s/it]
 50%|█████     | 19161/37963 [47:06:35<51:26:35,  9.85s/it]
 50%|█████     | 19162/37963 [47:06:44<49:15:01,  9.43s/it]
 50%|█████     | 19163/37963 [47:06:52<47:20:52,  9.07s/it]
 50%|█████     | 19164/37963 [47:07:00<46:14:52,  8.86s/it]
 50%|█████     | 19165/37963 [47:07:09<45:19:30,  8.68s/it]
 50%|█████     | 19166/37963 [47:07:17<44:19:19,  8.49s/it]
 50%|█████     | 19167/37963 [47:07:25<43:21:55,  8.31s/it]
 50%|█████     | 19168/37963 [47:07:33<43:06:08,  8.26s/it]
 50%|█████     | 19169/37963 [47:07:41<42:36:02,  8.16s/it]
 50%|██���██     | 19170/37963 [47:07:49<42:49:31,  8.20s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '0.8469', 'learning_rate': '1.033e-05', 'epoch': '0.505'}
+
 50%|█████     | 19170/37963 [47:07:49<42:49:31,  8.20s/it]
 50%|█████     | 19171/37963 [47:07:57<42:45:15,  8.19s/it]
 51%|█████     | 19172/37963 [47:08:05<42:49:54,  8.21s/it]
 51%|█████     | 19173/37963 [47:08:22<55:43:58, 10.68s/it]
 51%|█████     | 19174/37963 [47:08:31<52:31:57, 10.07s/it]
 51%|█████     | 19175/37963 [47:08:47<63:12:02, 12.11s/it]
 51%|█████     | 19176/37963 [47:08:56<57:31:29, 11.02s/it]
 51%|█████     | 19177/37963 [47:09:04<53:18:23, 10.22s/it]
 51%|█████     | 19178/37963 [47:09:12<50:06:19,  9.60s/it]
 51%|█████     | 19179/37963 [47:09:21<47:58:53,  9.20s/it]
 51%|█████     | 19180/37963 [47:09:29<46:27:12,  8.90s/it]
                                                           
{'loss': '0.157', 'grad_norm': '1.959', 'learning_rate': '1.032e-05', 'epoch': '0.5052'}
+
 51%|█████     | 19180/37963 [47:09:29<46:27:12,  8.90s/it]
 51%|█████     | 19181/37963 [47:09:37<45:27:24,  8.71s/it]
 51%|█████     | 19182/37963 [47:09:45<44:38:02,  8.56s/it]
 51%|█████     | 19183/37963 [47:09:54<44:04:04,  8.45s/it]
 51%|█████     | 19184/37963 [47:10:02<43:39:43,  8.37s/it]
 51%|█████     | 19185/37963 [47:10:17<53:52:51, 10.33s/it]
 51%|█████     | 19186/37963 [47:10:25<50:51:12,  9.75s/it]
 51%|█████     | 19187/37963 [47:10:40<58:50:38, 11.28s/it]
 51%|█████     | 19188/37963 [47:10:48<53:54:50, 10.34s/it]
 51%|█████     | 19189/37963 [47:10:56<50:32:17,  9.69s/it]
 51%|█████     | 19190/37963 [47:11:05<48:30:34,  9.30s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '2.136', 'learning_rate': '1.031e-05', 'epoch': '0.5055'}
+
 51%|█████     | 19190/37963 [47:11:05<48:30:34,  9.30s/it]
 51%|█████     | 19191/37963 [47:11:13<47:17:57,  9.07s/it]
 51%|█████     | 19192/37963 [47:11:21<46:01:34,  8.83s/it]
 51%|█████     | 19193/37963 [47:11:30<45:02:48,  8.64s/it]
 51%|█████     | 19194/37963 [47:11:45<55:49:41, 10.71s/it]
 51%|█████     | 19195/37963 [47:11:54<52:13:27, 10.02s/it]
 51%|█████     | 19196/37963 [47:12:01<48:56:25,  9.39s/it]
 51%|█████     | 19197/37963 [47:12:09<46:13:27,  8.87s/it]
 51%|█████     | 19198/37963 [47:12:17<44:33:05,  8.55s/it]
 51%|█████     | 19199/37963 [47:12:25<43:14:19,  8.30s/it]
 51%|█████     | 19200/37963 [47:12:32<42:16:28,  8.11s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '1.796', 'learning_rate': '1.03e-05', 'epoch': '0.5058'}
+
 51%|█████     | 19200/37963 [47:12:32<42:16:28,  8.11s/it]
 51%|█████     | 19201/37963 [47:12:40<41:50:35,  8.03s/it]
 51%|█████     | 19202/37963 [47:12:55<52:47:29, 10.13s/it]
 51%|█████     | 19203/37963 [47:13:03<48:34:03,  9.32s/it]
 51%|█████     | 19204/37963 [47:13:10<45:51:38,  8.80s/it]
 51%|█████     | 19205/37963 [47:13:18<44:07:59,  8.47s/it]
 51%|█████     | 19206/37963 [47:13:26<42:55:06,  8.24s/it]
 51%|█████     | 19207/37963 [47:13:33<42:03:04,  8.07s/it]
 51%|█████     | 19208/37963 [47:13:41<41:15:52,  7.92s/it]
 51%|█████     | 19209/37963 [47:13:48<40:30:14,  7.78s/it]
 51%|█████     | 19210/37963 [47:13:56<40:07:07,  7.70s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '0.7847', 'learning_rate': '1.029e-05', 'epoch': '0.506'}
+
 51%|█████     | 19210/37963 [47:13:56<40:07:07,  7.70s/it]
 51%|█████     | 19211/37963 [47:14:03<39:38:10,  7.61s/it]
 51%|█████     | 19212/37963 [47:14:11<39:42:43,  7.62s/it]
 51%|█████     | 19213/37963 [47:14:19<39:53:38,  7.66s/it]
 51%|█████     | 19214/37963 [47:14:26<39:58:12,  7.67s/it]
 51%|█████     | 19215/37963 [47:14:42<52:00:19,  9.99s/it]
 51%|█████     | 19216/37963 [47:14:50<48:46:09,  9.37s/it]
 51%|█████     | 19217/37963 [47:14:57<46:08:20,  8.86s/it]
 51%|█████     | 19218/37963 [47:15:05<44:39:42,  8.58s/it]
 51%|█████     | 19219/37963 [47:15:13<43:12:27,  8.30s/it]
 51%|█████     | 19220/37963 [47:15:21<42:29:33,  8.16s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '1.298', 'learning_rate': '1.028e-05', 'epoch': '0.5063'}
+
 51%|█████     | 19220/37963 [47:15:21<42:29:33,  8.16s/it]
 51%|█████     | 19221/37963 [47:15:36<53:01:55, 10.19s/it]
 51%|█████     | 19222/37963 [47:15:44<49:42:20,  9.55s/it]
 51%|█████     | 19223/37963 [47:15:59<58:46:03, 11.29s/it]
 51%|█████     | 19224/37963 [47:16:07<53:10:07, 10.21s/it]
 51%|█████     | 19225/37963 [47:16:15<49:37:54,  9.54s/it]
 51%|█████     | 19226/37963 [47:16:22<46:41:24,  8.97s/it]
 51%|█████     | 19227/37963 [47:16:30<44:36:28,  8.57s/it]
 51%|█████     | 19228/37963 [47:16:38<43:23:33,  8.34s/it]
 51%|█████     | 19229/37963 [47:16:52<52:23:36, 10.07s/it]
 51%|█████     | 19230/37963 [47:17:00<48:57:02,  9.41s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '0.8303', 'learning_rate': '1.027e-05', 'epoch': '0.5065'}
+
 51%|█████     | 19230/37963 [47:17:00<48:57:02,  9.41s/it]
 51%|█████     | 19231/37963 [47:17:08<47:03:55,  9.05s/it]
 51%|█████     | 19232/37963 [47:17:16<45:09:28,  8.68s/it]
 51%|█████     | 19233/37963 [47:17:23<43:42:31,  8.40s/it]
 51%|█████     | 19234/37963 [47:17:38<53:15:03, 10.24s/it]
 51%|█████     | 19235/37963 [47:17:46<49:32:50,  9.52s/it]
 51%|█████     | 19236/37963 [47:17:54<46:59:36,  9.03s/it]
 51%|█████     | 19237/37963 [47:18:02<45:06:46,  8.67s/it]
 51%|█████     | 19238/37963 [47:18:09<43:40:43,  8.40s/it]
 51%|█████     | 19239/37963 [47:18:17<42:59:55,  8.27s/it]
 51%|█████     | 19240/37963 [47:18:25<42:19:24,  8.14s/it]
                                                           
{'loss': '0.1516', 'grad_norm': '2.968', 'learning_rate': '1.027e-05', 'epoch': '0.5068'}
+
 51%|█████     | 19240/37963 [47:18:25<42:19:24,  8.14s/it]
 51%|█████     | 19241/37963 [47:18:33<41:47:36,  8.04s/it]
 51%|█████     | 19242/37963 [47:18:53<61:11:13, 11.77s/it]
 51%|█████     | 19243/37963 [47:19:01<55:18:36, 10.64s/it]
 51%|█████     | 19244/37963 [47:19:09<50:16:32,  9.67s/it]
 51%|█████     | 19245/37963 [47:19:17<47:34:03,  9.15s/it]
 51%|█████     | 19246/37963 [47:19:32<56:30:30, 10.87s/it]
 51%|█████     | 19247/37963 [47:19:40<52:03:39, 10.01s/it]
 51%|█████     | 19248/37963 [47:19:48<49:04:56,  9.44s/it]
 51%|█████     | 19249/37963 [47:19:56<46:40:52,  8.98s/it]
 51%|█████     | 19250/37963 [47:20:03<44:48:10,  8.62s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '2.205', 'learning_rate': '1.026e-05', 'epoch': '0.5071'}
+
 51%|█████     | 19250/37963 [47:20:03<44:48:10,  8.62s/it]
 51%|█████     | 19251/37963 [47:20:11<43:12:54,  8.31s/it]
 51%|█████     | 19252/37963 [47:20:19<42:16:08,  8.13s/it]
 51%|█████     | 19253/37963 [47:20:26<41:38:11,  8.01s/it]
 51%|█████     | 19254/37963 [47:20:34<40:53:07,  7.87s/it]
 51%|█████     | 19255/37963 [47:20:42<40:43:31,  7.84s/it]
 51%|█████     | 19256/37963 [47:20:50<40:53:54,  7.87s/it]
 51%|█████     | 19257/37963 [47:20:58<41:08:21,  7.92s/it]
 51%|█████     | 19258/37963 [47:21:06<41:12:25,  7.93s/it]
 51%|█████     | 19259/37963 [47:21:14<41:33:34,  8.00s/it]
 51%|█████     | 19260/37963 [47:21:22<42:11:27,  8.12s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '1.609', 'learning_rate': '1.025e-05', 'epoch': '0.5073'}
+
 51%|█████     | 19260/37963 [47:21:22<42:11:27,  8.12s/it]
 51%|█████     | 19261/37963 [47:21:31<42:28:52,  8.18s/it]
 51%|█████     | 19262/37963 [47:21:39<42:48:42,  8.24s/it]
 51%|█████     | 19263/37963 [47:21:47<42:42:46,  8.22s/it]
 51%|█████     | 19264/37963 [47:21:55<42:45:41,  8.23s/it]
 51%|█████     | 19265/37963 [47:22:03<42:28:54,  8.18s/it]
 51%|█████     | 19266/37963 [47:22:12<42:28:41,  8.18s/it]
 51%|█████     | 19267/37963 [47:22:20<42:23:49,  8.16s/it]
 51%|█████     | 19268/37963 [47:22:37<55:49:01, 10.75s/it]
 51%|█████     | 19269/37963 [47:22:53<65:05:50, 12.54s/it]
 51%|█████     | 19270/37963 [47:23:02<58:54:37, 11.35s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '1.613', 'learning_rate': '1.024e-05', 'epoch': '0.5076'}
+
 51%|█████     | 19270/37963 [47:23:02<58:54:37, 11.35s/it]
 51%|█████     | 19271/37963 [47:23:19<67:14:02, 12.95s/it]
 51%|█████     | 19272/37963 [47:23:26<59:25:08, 11.44s/it]
 51%|█████     | 19273/37963 [47:23:35<54:27:21, 10.49s/it]
 51%|█████     | 19274/37963 [47:23:43<50:29:10,  9.73s/it]
 51%|█████     | 19275/37963 [47:23:51<48:17:32,  9.30s/it]
 51%|█████     | 19276/37963 [47:24:06<56:54:32, 10.96s/it]
 51%|█████     | 19277/37963 [47:24:21<63:24:41, 12.22s/it]
 51%|█████     | 19278/37963 [47:24:29<57:06:45, 11.00s/it]
 51%|█████     | 19279/37963 [47:24:37<52:48:51, 10.18s/it]
 51%|█████     | 19280/37963 [47:24:45<49:26:49,  9.53s/it]
                                                           
{'loss': '0.1464', 'grad_norm': '1.237', 'learning_rate': '1.023e-05', 'epoch': '0.5079'}
+
 51%|█████     | 19280/37963 [47:24:45<49:26:49,  9.53s/it]
 51%|█████     | 19281/37963 [47:24:54<47:29:29,  9.15s/it]
 51%|█████     | 19282/37963 [47:25:02<45:51:21,  8.84s/it]
 51%|█████     | 19283/37963 [47:25:10<44:58:00,  8.67s/it]
 51%|█████     | 19284/37963 [47:25:18<44:05:52,  8.50s/it]
 51%|█████     | 19285/37963 [47:25:26<43:33:41,  8.40s/it]
 51%|█████     | 19286/37963 [47:25:41<53:56:41, 10.40s/it]
 51%|█████     | 19287/37963 [47:25:49<50:23:10,  9.71s/it]
 51%|█████     | 19288/37963 [47:25:58<48:07:17,  9.28s/it]
 51%|█████     | 19289/37963 [47:26:06<46:04:40,  8.88s/it]
 51%|█████     | 19290/37963 [47:26:14<44:58:43,  8.67s/it]
                                                           
{'loss': '0.1444', 'grad_norm': '1.801', 'learning_rate': '1.022e-05', 'epoch': '0.5081'}
+
 51%|█████     | 19290/37963 [47:26:14<44:58:43,  8.67s/it]
 51%|█████     | 19291/37963 [47:26:22<44:06:16,  8.50s/it]
 51%|█████     | 19292/37963 [47:26:30<43:24:50,  8.37s/it]
 51%|█████     | 19293/37963 [47:26:38<43:04:25,  8.31s/it]
 51%|█████     | 19294/37963 [47:26:46<42:50:50,  8.26s/it]
 51%|█████     | 19295/37963 [47:27:01<53:19:03, 10.28s/it]
 51%|█████     | 19296/37963 [47:27:10<50:18:30,  9.70s/it]
 51%|█████     | 19297/37963 [47:27:18<48:10:35,  9.29s/it]
 51%|█████     | 19298/37963 [47:27:27<47:01:21,  9.07s/it]
 51%|█████     | 19299/37963 [47:27:35<45:30:10,  8.78s/it]
 51%|█████     | 19300/37963 [47:27:52<59:28:50, 11.47s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '1.054', 'learning_rate': '1.021e-05', 'epoch': '0.5084'}
+
 51%|█████     | 19300/37963 [47:27:52<59:28:50, 11.47s/it]
 51%|█████     | 19301/37963 [47:28:01<54:33:00, 10.52s/it]
 51%|█████     | 19302/37963 [47:28:09<51:00:47,  9.84s/it]
 51%|█████     | 19303/37963 [47:28:17<48:41:40,  9.39s/it]
 51%|█████     | 19304/37963 [47:28:26<46:55:56,  9.05s/it]
 51%|█████     | 19305/37963 [47:28:34<46:03:21,  8.89s/it]
 51%|█████     | 19306/37963 [47:28:42<44:47:53,  8.64s/it]
 51%|█████     | 19307/37963 [47:28:51<44:19:58,  8.55s/it]
 51%|█████     | 19308/37963 [47:28:59<43:52:37,  8.47s/it]
 51%|█████     | 19309/37963 [47:29:07<43:23:58,  8.38s/it]
 51%|█████     | 19310/37963 [47:29:15<42:57:41,  8.29s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '1.569', 'learning_rate': '1.021e-05', 'epoch': '0.5087'}
+
 51%|█████     | 19310/37963 [47:29:15<42:57:41,  8.29s/it]
 51%|█████     | 19311/37963 [47:29:23<42:29:01,  8.20s/it]
 51%|█████     | 19312/37963 [47:29:40<55:35:01, 10.73s/it]
 51%|█████     | 19313/37963 [47:29:56<63:39:13, 12.29s/it]
 51%|█████     | 19314/37963 [47:30:04<57:39:59, 11.13s/it]
 51%|█████     | 19315/37963 [47:30:21<66:32:07, 12.84s/it]
 51%|█████     | 19316/37963 [47:30:30<60:10:16, 11.62s/it]
 51%|█████     | 19317/37963 [47:30:38<54:51:57, 10.59s/it]
 51%|█████     | 19318/37963 [47:30:46<51:32:24,  9.95s/it]
 51%|█████     | 19319/37963 [47:30:54<48:44:07,  9.41s/it]
 51%|█████     | 19320/37963 [47:31:02<46:24:46,  8.96s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '1.673', 'learning_rate': '1.02e-05', 'epoch': '0.5089'}
+
 51%|█████     | 19320/37963 [47:31:02<46:24:46,  8.96s/it]
 51%|█████     | 19321/37963 [47:31:18<56:09:40, 10.85s/it]
 51%|█████     | 19322/37963 [47:31:26<52:45:48, 10.19s/it]
 51%|█████     | 19323/37963 [47:31:34<49:28:30,  9.56s/it]
 51%|█████     | 19324/37963 [47:31:43<47:21:57,  9.15s/it]
 51%|█████     | 19325/37963 [47:31:51<45:41:13,  8.82s/it]
 51%|█████     | 19326/37963 [47:31:59<44:26:13,  8.58s/it]
 51%|█████     | 19327/37963 [47:32:07<43:49:27,  8.47s/it]
 51%|█████     | 19328/37963 [47:32:14<42:36:31,  8.23s/it]
 51%|█████     | 19329/37963 [47:32:23<42:24:11,  8.19s/it]
 51%|█████     | 19330/37963 [47:32:45<63:42:39, 12.31s/it]
                                                           
{'loss': '0.1548', 'grad_norm': '1.396', 'learning_rate': '1.019e-05', 'epoch': '0.5092'}
+
 51%|█████     | 19330/37963 [47:32:45<63:42:39, 12.31s/it]
 51%|█████     | 19331/37963 [47:32:53<57:41:29, 11.15s/it]
 51%|█████     | 19332/37963 [47:33:01<52:29:56, 10.14s/it]
 51%|█████     | 19333/37963 [47:33:09<49:30:57,  9.57s/it]
 51%|█████     | 19334/37963 [47:33:17<47:00:37,  9.08s/it]
 51%|█████     | 19335/37963 [47:33:25<45:46:01,  8.84s/it]
 51%|█████     | 19336/37963 [47:33:33<44:49:31,  8.66s/it]
 51%|█████     | 19337/37963 [47:33:41<43:43:36,  8.45s/it]
 51%|█████     | 19338/37963 [47:33:50<43:18:01,  8.37s/it]
 51%|█████     | 19339/37963 [47:33:57<42:31:18,  8.22s/it]
 51%|█████     | 19340/37963 [47:34:06<42:16:45,  8.17s/it]
                                                           
{'loss': '0.1453', 'grad_norm': '1.074', 'learning_rate': '1.018e-05', 'epoch': '0.5094'}
+
 51%|█████     | 19340/37963 [47:34:06<42:16:45,  8.17s/it]
 51%|█████     | 19341/37963 [47:34:14<42:17:25,  8.18s/it]
 51%|█████     | 19342/37963 [47:34:22<42:51:57,  8.29s/it]
 51%|█████     | 19343/37963 [47:34:37<52:50:52, 10.22s/it]
 51%|█████     | 19344/37963 [47:34:45<49:48:24,  9.63s/it]
 51%|█████     | 19345/37963 [47:34:53<47:15:24,  9.14s/it]
 51%|█████     | 19346/37963 [47:35:01<45:40:25,  8.83s/it]
 51%|█████     | 19347/37963 [47:35:10<44:54:39,  8.68s/it]
 51%|█████     | 19348/37963 [47:35:18<43:50:46,  8.48s/it]
 51%|█████     | 19349/37963 [47:35:26<43:09:57,  8.35s/it]
 51%|█████     | 19350/37963 [47:35:34<43:00:37,  8.32s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '4.051', 'learning_rate': '1.017e-05', 'epoch': '0.5097'}
+
 51%|█████     | 19350/37963 [47:35:34<43:00:37,  8.32s/it]
 51%|█████     | 19351/37963 [47:35:42<42:41:41,  8.26s/it]
 51%|█████     | 19352/37963 [47:35:59<55:33:15, 10.75s/it]
 51%|█████     | 19353/37963 [47:36:07<52:23:17, 10.13s/it]
 51%|█████     | 19354/37963 [47:36:16<49:29:10,  9.57s/it]
 51%|█████     | 19355/37963 [47:36:24<47:10:59,  9.13s/it]
 51%|█████     | 19356/37963 [47:36:32<46:05:59,  8.92s/it]
 51%|█████     | 19357/37963 [47:36:40<44:35:12,  8.63s/it]
 51%|█████     | 19358/37963 [47:36:48<43:34:27,  8.43s/it]
 51%|█████     | 19359/37963 [47:36:56<43:08:00,  8.35s/it]
 51%|█████     | 19360/37963 [47:37:13<55:29:38, 10.74s/it]
                                                           
{'loss': '0.1411', 'grad_norm': '1.426', 'learning_rate': '1.016e-05', 'epoch': '0.51'}
+
 51%|█████     | 19360/37963 [47:37:13<55:29:38, 10.74s/it]
 51%|█████     | 19361/37963 [47:37:21<52:03:59, 10.08s/it]
 51%|█████     | 19362/37963 [47:37:37<61:30:52, 11.91s/it]
 51%|█████     | 19363/37963 [47:37:53<67:59:30, 13.16s/it]
 51%|█████     | 19364/37963 [47:38:02<60:36:41, 11.73s/it]
 51%|█████     | 19365/37963 [47:38:10<54:52:08, 10.62s/it]
 51%|█████     | 19366/37963 [47:38:18<50:44:52,  9.82s/it]
 51%|█████     | 19367/37963 [47:38:26<47:37:25,  9.22s/it]
 51%|█████     | 19368/37963 [47:38:33<45:24:06,  8.79s/it]
 51%|█████     | 19369/37963 [47:38:41<44:18:10,  8.58s/it]
 51%|█████     | 19370/37963 [47:38:56<54:05:30, 10.47s/it]
                                                           
{'loss': '0.1493', 'grad_norm': '2.294', 'learning_rate': '1.016e-05', 'epoch': '0.5102'}
+
 51%|█████     | 19370/37963 [47:38:56<54:05:30, 10.47s/it]
 51%|█████     | 19371/37963 [47:39:04<50:08:09,  9.71s/it]
 51%|█████     | 19372/37963 [47:39:12<47:30:31,  9.20s/it]
 51%|█████     | 19373/37963 [47:39:20<45:32:03,  8.82s/it]
 51%|█████     | 19374/37963 [47:39:35<54:49:38, 10.62s/it]
 51%|█████     | 19375/37963 [47:39:43<50:59:16,  9.88s/it]
 51%|█████     | 19376/37963 [47:39:51<48:24:28,  9.38s/it]
 51%|█████     | 19377/37963 [47:39:59<46:01:25,  8.91s/it]
 51%|█████     | 19378/37963 [47:40:07<44:29:19,  8.62s/it]
 51%|█████     | 19379/37963 [47:40:15<43:23:39,  8.41s/it]
 51%|█████     | 19380/37963 [47:40:23<42:20:43,  8.20s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '2.9', 'learning_rate': '1.015e-05', 'epoch': '0.5105'}
+
 51%|█████     | 19380/37963 [47:40:23<42:20:43,  8.20s/it]
 51%|█████     | 19381/37963 [47:40:31<41:51:17,  8.11s/it]
 51%|█████     | 19382/37963 [47:40:39<41:52:21,  8.11s/it]
 51%|█████     | 19383/37963 [47:40:47<41:40:24,  8.07s/it]
 51%|█████     | 19384/37963 [47:41:02<52:12:21, 10.12s/it]
 51%|█████     | 19385/37963 [47:41:10<48:56:45,  9.48s/it]
 51%|█████     | 19386/37963 [47:41:17<46:21:51,  8.98s/it]
 51%|█████     | 19387/37963 [47:41:32<55:26:50, 10.75s/it]
 51%|█████     | 19388/37963 [47:41:41<51:39:42, 10.01s/it]
 51%|█████     | 19389/37963 [47:41:49<48:34:55,  9.42s/it]
 51%|█████     | 19390/37963 [47:41:57<46:13:14,  8.96s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '1.959', 'learning_rate': '1.014e-05', 'epoch': '0.5108'}
+
 51%|█████     | 19390/37963 [47:41:57<46:13:14,  8.96s/it]
 51%|█████     | 19391/37963 [47:42:04<44:01:34,  8.53s/it]
 51%|█████     | 19392/37963 [47:42:12<43:02:37,  8.34s/it]
 51%|█████     | 19393/37963 [47:42:20<42:03:56,  8.15s/it]
 51%|█████     | 19394/37963 [47:42:28<41:49:54,  8.11s/it]
 51%|█████     | 19395/37963 [47:42:36<42:03:25,  8.15s/it]
 51%|█████     | 19396/37963 [47:42:44<41:54:35,  8.13s/it]
 51%|█████     | 19397/37963 [47:42:52<41:36:54,  8.07s/it]
 51%|█████     | 19398/37963 [47:43:00<41:29:12,  8.04s/it]
 51%|█████     | 19399/37963 [47:43:08<41:02:48,  7.96s/it]
 51%|█████     | 19400/37963 [47:43:15<40:35:36,  7.87s/it]
                                                           
{'loss': '0.155', 'grad_norm': '1.874', 'learning_rate': '1.013e-05', 'epoch': '0.511'}
+
 51%|█████     | 19400/37963 [47:43:15<40:35:36,  7.87s/it]
 51%|█████     | 19401/37963 [47:43:30<51:35:07, 10.00s/it]
 51%|█████     | 19402/37963 [47:43:38<48:44:26,  9.45s/it]
 51%|█████     | 19403/37963 [47:43:46<46:13:27,  8.97s/it]
 51%|█████     | 19404/37963 [47:43:54<44:43:16,  8.67s/it]
 51%|█████     | 19405/37963 [47:44:02<43:47:09,  8.49s/it]
 51%|█████     | 19406/37963 [47:44:11<43:12:38,  8.38s/it]
 51%|█████     | 19407/37963 [47:44:18<42:33:05,  8.26s/it]
 51%|█████     | 19408/37963 [47:44:34<53:41:38, 10.42s/it]
 51%|█████     | 19409/37963 [47:44:50<61:59:17, 12.03s/it]
 51%|█████     | 19410/37963 [47:44:58<55:40:15, 10.80s/it]
                                                           
{'loss': '0.1386', 'grad_norm': '2.522', 'learning_rate': '1.012e-05', 'epoch': '0.5113'}
+
 51%|█████     | 19410/37963 [47:44:58<55:40:15, 10.80s/it]
 51%|█████     | 19411/37963 [47:45:05<51:04:51,  9.91s/it]
 51%|█████     | 19412/37963 [47:45:13<47:50:32,  9.28s/it]
 51%|█████     | 19413/37963 [47:45:21<45:42:11,  8.87s/it]
 51%|█████     | 19414/37963 [47:45:36<54:29:15, 10.57s/it]
 51%|█████     | 19415/37963 [47:45:51<61:54:05, 12.01s/it]
 51%|█████     | 19416/37963 [47:45:59<55:37:18, 10.80s/it]
 51%|█████     | 19417/37963 [47:46:07<50:32:24,  9.81s/it]
 51%|█████     | 19418/37963 [47:46:14<47:18:06,  9.18s/it]
 51%|█████     | 19419/37963 [47:46:22<45:09:21,  8.77s/it]
 51%|█████     | 19420/37963 [47:46:30<43:35:24,  8.46s/it]
                                                           
{'loss': '0.1398', 'grad_norm': '2.512', 'learning_rate': '1.011e-05', 'epoch': '0.5116'}
+
 51%|█████     | 19420/37963 [47:46:30<43:35:24,  8.46s/it]
 51%|█████     | 19421/37963 [47:46:37<42:11:51,  8.19s/it]
 51%|█████     | 19422/37963 [47:46:52<51:49:41, 10.06s/it]
 51%|█████     | 19423/37963 [47:47:00<48:30:01,  9.42s/it]
 51%|█████     | 19424/37963 [47:47:07<45:51:21,  8.90s/it]
 51%|█████     | 19425/37963 [47:47:15<44:08:19,  8.57s/it]
 51%|█████     | 19426/37963 [47:47:23<42:43:57,  8.30s/it]
 51%|█████     | 19427/37963 [47:47:30<41:26:56,  8.05s/it]
 51%|█████     | 19428/37963 [47:47:38<41:03:17,  7.97s/it]
 51%|█████     | 19429/37963 [47:47:46<40:42:33,  7.91s/it]
 51%|█████     | 19430/37963 [47:47:54<40:24:08,  7.85s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '1.861', 'learning_rate': '1.01e-05', 'epoch': '0.5118'}
+
 51%|█████     | 19430/37963 [47:47:54<40:24:08,  7.85s/it]
 51%|█████     | 19431/37963 [47:48:08<50:46:15,  9.86s/it]
 51%|█████     | 19432/37963 [47:48:16<47:09:50,  9.16s/it]
 51%|█████     | 19433/37963 [47:48:31<55:55:21, 10.86s/it]
 51%|█████     | 19434/37963 [47:48:38<51:16:13,  9.96s/it]
 51%|█████     | 19435/37963 [47:48:46<47:55:11,  9.31s/it]
 51%|█████     | 19436/37963 [47:48:54<45:16:22,  8.80s/it]
 51%|█████     | 19437/37963 [47:49:01<43:16:32,  8.41s/it]
 51%|█████     | 19438/37963 [47:49:09<42:27:38,  8.25s/it]
 51%|█████     | 19439/37963 [47:49:17<41:48:30,  8.13s/it]
 51%|█████     | 19440/37963 [47:49:25<41:17:52,  8.03s/it]
                                                           
{'loss': '0.1364', 'grad_norm': '2.844', 'learning_rate': '1.01e-05', 'epoch': '0.5121'}
+
 51%|█████     | 19440/37963 [47:49:25<41:17:52,  8.03s/it]
 51%|█████     | 19441/37963 [47:49:33<41:02:49,  7.98s/it]
 51%|█████     | 19442/37963 [47:49:40<40:20:10,  7.84s/it]
 51%|█████     | 19443/37963 [47:49:48<40:15:24,  7.83s/it]
 51%|█████     | 19444/37963 [47:49:56<39:57:56,  7.77s/it]
 51%|█████     | 19445/37963 [47:50:03<39:51:30,  7.75s/it]
 51%|█████     | 19446/37963 [47:50:11<39:45:59,  7.73s/it]
 51%|███��█     | 19447/37963 [47:50:19<39:55:49,  7.76s/it]
 51%|█████     | 19448/37963 [47:50:27<39:57:01,  7.77s/it]
 51%|█████     | 19449/37963 [47:50:34<39:44:35,  7.73s/it]
 51%|█████     | 19450/37963 [47:50:42<39:48:00,  7.74s/it]
                                                           
{'loss': '0.1618', 'grad_norm': '1.71', 'learning_rate': '1.009e-05', 'epoch': '0.5123'}
+
 51%|█████     | 19450/37963 [47:50:42<39:48:00,  7.74s/it]
 51%|█████     | 19451/37963 [47:50:50<39:52:54,  7.76s/it]
 51%|█████     | 19452/37963 [47:50:58<39:44:51,  7.73s/it]
 51%|█████     | 19453/37963 [47:51:05<39:40:49,  7.72s/it]
 51%|█████     | 19454/37963 [47:51:20<49:55:45,  9.71s/it]
 51%|█████     | 19455/37963 [47:51:34<57:44:47, 11.23s/it]
 51%|█████     | 19456/37963 [47:51:42<51:59:54, 10.11s/it]
 51%|█████▏    | 19457/37963 [47:51:57<58:59:47, 11.48s/it]
 51%|█████▏    | 19458/37963 [47:52:04<53:31:45, 10.41s/it]
 51%|█████▏    | 19459/37963 [47:52:12<49:32:11,  9.64s/it]
 51%|█████▏    | 19460/37963 [47:52:20<46:40:14,  9.08s/it]
                                                           
{'loss': '0.1618', 'grad_norm': '3.009', 'learning_rate': '1.008e-05', 'epoch': '0.5126'}
+
 51%|█████▏    | 19460/37963 [47:52:20<46:40:14,  9.08s/it]
 51%|█████▏    | 19461/37963 [47:52:28<44:40:52,  8.69s/it]
 51%|█████▏    | 19462/37963 [47:52:42<53:35:31, 10.43s/it]
 51%|█████▏    | 19463/37963 [47:52:50<49:44:05,  9.68s/it]
 51%|█████▏    | 19464/37963 [47:52:58<46:36:25,  9.07s/it]
 51%|█████▏    | 19465/37963 [47:53:06<44:31:58,  8.67s/it]
 51%|█████▏    | 19466/37963 [47:53:21<54:05:46, 10.53s/it]
 51%|█████▏    | 19467/37963 [47:53:28<49:41:30,  9.67s/it]
 51%|█████▏    | 19468/37963 [47:53:36<46:32:02,  9.06s/it]
 51%|█████▏    | 19469/37963 [47:53:44<44:38:34,  8.69s/it]
 51%|█████▏    | 19470/37963 [47:53:51<42:53:06,  8.35s/it]
                                                           
{'loss': '0.1521', 'grad_norm': '0.9234', 'learning_rate': '1.007e-05', 'epoch': '0.5129'}
+
 51%|█████▏    | 19470/37963 [47:53:51<42:53:06,  8.35s/it]
 51%|█████▏    | 19471/37963 [47:54:06<52:05:56, 10.14s/it]
 51%|█████▏    | 19472/37963 [47:54:13<48:41:17,  9.48s/it]
 51%|█████▏    | 19473/37963 [47:54:21<45:36:49,  8.88s/it]
 51%|█████▏    | 19474/37963 [47:54:29<43:48:39,  8.53s/it]
 51%|█████▏    | 19475/37963 [47:54:43<52:54:27, 10.30s/it]
 51%|█████▏    | 19476/37963 [47:54:51<49:03:39,  9.55s/it]
 51%|█████▏    | 19477/37963 [47:54:59<46:09:34,  8.99s/it]
 51%|█████▏    | 19478/37963 [47:55:06<44:15:04,  8.62s/it]
 51%|█████▏    | 19479/37963 [47:55:14<42:52:23,  8.35s/it]
 51%|█████▏    | 19480/37963 [47:55:22<42:10:59,  8.22s/it]
                                                           
{'loss': '0.1448', 'grad_norm': '1.893', 'learning_rate': '1.006e-05', 'epoch': '0.5131'}
+
 51%|█████▏    | 19480/37963 [47:55:22<42:10:59,  8.22s/it]
 51%|█████▏    | 19481/37963 [47:55:36<51:47:12, 10.09s/it]
 51%|█████▏    | 19482/37963 [47:55:44<48:15:33,  9.40s/it]
 51%|█████▏    | 19483/37963 [47:55:52<45:48:20,  8.92s/it]
 51%|█████▏    | 19484/37963 [47:56:00<44:00:46,  8.57s/it]
 51%|█████▏    | 19485/37963 [47:56:08<42:42:52,  8.32s/it]
 51%|█████▏    | 19486/37963 [47:56:15<41:26:09,  8.07s/it]
 51%|█████▏    | 19487/37963 [47:56:22<40:17:10,  7.85s/it]
 51%|█████▏    | 19488/37963 [47:56:30<39:51:59,  7.77s/it]
 51%|█████▏    | 19489/37963 [47:56:37<39:15:16,  7.65s/it]
 51%|█████▏    | 19490/37963 [47:56:45<39:09:04,  7.63s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '3.55', 'learning_rate': '1.005e-05', 'epoch': '0.5134'}
+
 51%|█████▏    | 19490/37963 [47:56:45<39:09:04,  7.63s/it]
 51%|█████▏    | 19491/37963 [47:56:52<38:55:34,  7.59s/it]
 51%|█████▏    | 19492/37963 [47:57:00<39:29:53,  7.70s/it]
 51%|█████▏    | 19493/37963 [47:57:08<39:33:01,  7.71s/it]
 51%|█████▏    | 19494/37963 [47:57:16<39:35:18,  7.72s/it]
 51%|█████▏    | 19495/37963 [47:57:24<39:52:44,  7.77s/it]
 51%|█████▏    | 19496/37963 [47:57:31<39:41:21,  7.74s/it]
 51%|█████▏    | 19497/37963 [47:57:39<39:37:31,  7.73s/it]
 51%|█████▏    | 19498/37963 [47:57:47<39:28:31,  7.70s/it]
 51%|█████▏    | 19499/37963 [47:57:54<39:23:22,  7.68s/it]
 51%|█████▏    | 19500/37963 [47:58:02<39:36:23,  7.72s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '1.476', 'learning_rate': '1.004e-05', 'epoch': '0.5137'}
+
 51%|█████▏    | 19500/37963 [47:58:02<39:36:23,  7.72s/it]
 51%|█████▏    | 19501/37963 [47:58:10<39:41:37,  7.74s/it]
 51%|█████▏    | 19502/37963 [47:58:18<40:33:18,  7.91s/it]
 51%|█████▏    | 19503/37963 [47:58:26<40:19:29,  7.86s/it]
 51%|█████▏    | 19504/37963 [47:58:33<39:48:35,  7.76s/it]
 51%|█████▏    | 19505/37963 [47:58:41<39:33:28,  7.72s/it]
 51%|█████▏    | 19506/37963 [47:59:03<61:17:11, 11.95s/it]
 51%|█████▏    | 19507/37963 [47:59:11<54:54:52, 10.71s/it]
 51%|█████▏    | 19508/37963 [47:59:26<61:53:39, 12.07s/it]
 51%|█████▏    | 19509/37963 [47:59:40<65:21:20, 12.75s/it]
 51%|█████▏    | 19510/37963 [47:59:48<57:29:41, 11.22s/it]
                                                           
{'loss': '0.1468', 'grad_norm': '1.198', 'learning_rate': '1.004e-05', 'epoch': '0.5139'}
+
 51%|█████▏    | 19510/37963 [47:59:48<57:29:41, 11.22s/it]
 51%|█████▏    | 19511/37963 [47:59:56<52:10:22, 10.18s/it]
 51%|█████▏    | 19512/37963 [48:00:03<48:23:49,  9.44s/it]
 51%|█████▏    | 19513/37963 [48:00:11<45:36:32,  8.90s/it]
 51%|█████▏    | 19514/37963 [48:00:19<43:30:17,  8.49s/it]
 51%|█████▏    | 19515/37963 [48:00:26<42:03:13,  8.21s/it]
 51%|█████▏    | 19516/37963 [48:00:34<41:24:20,  8.08s/it]
 51%|█████▏    | 19517/37963 [48:00:42<40:47:26,  7.96s/it]
 51%|█████▏    | 19518/37963 [48:00:57<51:36:10, 10.07s/it]
 51%|█████▏    | 19519/37963 [48:01:04<48:07:36,  9.39s/it]
 51%|█████▏    | 19520/37963 [48:01:12<45:32:51,  8.89s/it]
                                                           
{'loss': '0.1499', 'grad_norm': '1.829', 'learning_rate': '1.003e-05', 'epoch': '0.5142'}
+
 51%|█████▏    | 19520/37963 [48:01:12<45:32:51,  8.89s/it]
 51%|█████▏    | 19521/37963 [48:01:20<43:56:48,  8.58s/it]
 51%|█████▏    | 19522/37963 [48:01:28<42:42:09,  8.34s/it]
 51%|█████▏    | 19523/37963 [48:01:42<51:57:57, 10.15s/it]
 51%|█████▏    | 19524/37963 [48:01:50<48:38:41,  9.50s/it]
 51%|█████▏    | 19525/37963 [48:02:06<58:26:53, 11.41s/it]
 51%|█████▏    | 19526/37963 [48:02:14<52:42:52, 10.29s/it]
 51%|█████▏    | 19527/37963 [48:02:22<49:01:26,  9.57s/it]
 51%|█████▏    | 19528/37963 [48:02:36<56:27:46, 11.03s/it]
 51%|█████▏    | 19529/37963 [48:02:44<51:18:18, 10.02s/it]
 51%|█████▏    | 19530/37963 [48:02:51<47:46:19,  9.33s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '2.886', 'learning_rate': '1.002e-05', 'epoch': '0.5144'}
+
 51%|█████▏    | 19530/37963 [48:02:51<47:46:19,  9.33s/it]
 51%|█████▏    | 19531/37963 [48:02:59<45:14:29,  8.84s/it]
 51%|█████▏    | 19532/37963 [48:03:07<43:32:51,  8.51s/it]
 51%|█████▏    | 19533/37963 [48:03:14<42:01:35,  8.21s/it]
 51%|█████▏    | 19534/37963 [48:03:22<41:19:24,  8.07s/it]
 51%|█████▏    | 19535/37963 [48:03:30<40:45:36,  7.96s/it]
 51%|█████▏    | 19536/37963 [48:03:37<40:06:43,  7.84s/it]
 51%|█████▏    | 19537/37963 [48:03:45<39:56:55,  7.81s/it]
 51%|█████▏    | 19538/37963 [48:03:52<39:13:34,  7.66s/it]
 51%|█████▏    | 19539/37963 [48:04:00<39:11:07,  7.66s/it]
 51%|█████▏    | 19540/37963 [48:04:08<39:13:11,  7.66s/it]
                                                           
{'loss': '0.154', 'grad_norm': '1.278', 'learning_rate': '1.001e-05', 'epoch': '0.5147'}
+
 51%|█████▏    | 19540/37963 [48:04:08<39:13:11,  7.66s/it]
 51%|█████▏    | 19541/37963 [48:04:15<38:57:51,  7.61s/it]
 51%|█████▏    | 19542/37963 [48:04:23<38:42:33,  7.56s/it]
 51%|█████▏    | 19543/37963 [48:04:30<39:05:29,  7.64s/it]
 51%|█████▏    | 19544/37963 [48:04:38<39:07:00,  7.65s/it]
 51%|█████▏    | 19545/37963 [48:04:46<39:25:15,  7.71s/it]
 51%|█████▏    | 19546/37963 [48:04:54<39:30:30,  7.72s/it]
 51%|█████▏    | 19547/37963 [48:05:01<39:13:55,  7.67s/it]
 51%|█████▏    | 19548/37963 [48:05:09<39:32:30,  7.73s/it]
 51%|█████▏    | 19549/37963 [48:05:17<39:57:39,  7.81s/it]
 51%|█████▏    | 19550/37963 [48:05:32<50:43:08,  9.92s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '1.85', 'learning_rate': '1e-05', 'epoch': '0.515'}
+
 51%|█████▏    | 19550/37963 [48:05:32<50:43:08,  9.92s/it]
 52%|█████▏    | 19551/37963 [48:05:40<47:28:21,  9.28s/it]
 52%|█████▏    | 19552/37963 [48:05:54<55:34:47, 10.87s/it]
 52%|█████▏    | 19553/37963 [48:06:09<60:50:56, 11.90s/it]
 52%|█████▏    | 19554/37963 [48:06:17<55:01:09, 10.76s/it]
 52%|█████▏    | 19555/37963 [48:06:25<50:23:06,  9.85s/it]
 52%|█████▏    | 19556/37963 [48:06:32<46:39:12,  9.12s/it]
 52%|█████▏    | 19557/37963 [48:06:39<44:10:20,  8.64s/it]
 52%|█████▏    | 19558/37963 [48:06:47<42:28:56,  8.31s/it]
 52%|█████▏    | 19559/37963 [48:07:02<52:50:28, 10.34s/it]
 52%|█████▏    | 19560/37963 [48:07:10<48:55:30,  9.57s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '2.613', 'learning_rate': '9.993e-06', 'epoch': '0.5152'}
+
 52%|█████▏    | 19560/37963 [48:07:10<48:55:30,  9.57s/it]
 52%|█████▏    | 19561/37963 [48:07:18<46:07:15,  9.02s/it]
 52%|█████▏    | 19562/37963 [48:07:25<44:02:46,  8.62s/it]
 52%|█████▏    | 19563/37963 [48:07:40<53:46:32, 10.52s/it]
 52%|█████▏    | 19564/37963 [48:07:48<49:47:49,  9.74s/it]
 52%|█████▏    | 19565/37963 [48:07:56<46:44:17,  9.15s/it]
 52%|█████▏    | 19566/37963 [48:08:04<44:35:13,  8.72s/it]
 52%|█████▏    | 19567/37963 [48:08:11<42:58:06,  8.41s/it]
 52%|█████▏    | 19568/37963 [48:08:19<42:09:06,  8.25s/it]
 52%|█████▏    | 19569/37963 [48:08:27<41:08:16,  8.05s/it]
 52%|█████▏    | 19570/37963 [48:08:41<50:51:24,  9.95s/it]
                                                           
{'loss': '0.153', 'grad_norm': '1.016', 'learning_rate': '9.985e-06', 'epoch': '0.5155'}
+
 52%|█████▏    | 19570/37963 [48:08:41<50:51:24,  9.95s/it]
 52%|█████▏    | 19571/37963 [48:08:49<48:07:43,  9.42s/it]
 52%|█████▏    | 19572/37963 [48:08:57<45:41:06,  8.94s/it]
 52%|█████▏    | 19573/37963 [48:09:05<43:28:47,  8.51s/it]
 52%|█████▏    | 19574/37963 [48:09:20<53:40:18, 10.51s/it]
 52%|█████▏    | 19575/37963 [48:09:34<60:01:10, 11.75s/it]
 52%|█████▏    | 19576/37963 [48:09:42<54:12:36, 10.61s/it]
 52%|█████▏    | 19577/37963 [48:09:50<49:45:29,  9.74s/it]
 52%|█████▏    | 19578/37963 [48:09:58<46:36:24,  9.13s/it]
 52%|█████▏    | 19579/37963 [48:10:06<44:21:11,  8.69s/it]
 52%|█████▏    | 19580/37963 [48:10:13<43:00:33,  8.42s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '4.472', 'learning_rate': '9.976e-06', 'epoch': '0.5158'}
+
 52%|█████▏    | 19580/37963 [48:10:13<43:00:33,  8.42s/it]
 52%|█████▏    | 19581/37963 [48:10:21<42:16:45,  8.28s/it]
 52%|█████▏    | 19582/37963 [48:10:29<41:09:58,  8.06s/it]
 52%|█████▏    | 19583/37963 [48:10:36<40:22:14,  7.91s/it]
 52%|█████▏    | 19584/37963 [48:10:44<39:54:56,  7.82s/it]
 52%|█████▏    | 19585/37963 [48:10:52<39:59:29,  7.83s/it]
 52%|█████▏    | 19586/37963 [48:11:00<39:51:08,  7.81s/it]
 52%|█████▏    | 19587/37963 [48:11:08<40:30:34,  7.94s/it]
 52%|█████▏    | 19588/37963 [48:11:16<40:14:21,  7.88s/it]
 52%|█████▏    | 19589/37963 [48:11:23<40:14:36,  7.88s/it]
 52%|█████▏    | 19590/37963 [48:11:31<40:07:22,  7.86s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '1.03', 'learning_rate': '9.968e-06', 'epoch': '0.516'}
+
 52%|█████▏    | 19590/37963 [48:11:31<40:07:22,  7.86s/it]
 52%|█████▏    | 19591/37963 [48:11:39<40:06:21,  7.86s/it]
 52%|█████▏    | 19592/37963 [48:11:47<39:54:44,  7.82s/it]
 52%|█████▏    | 19593/37963 [48:12:01<49:45:20,  9.75s/it]
 52%|█████▏    | 19594/37963 [48:12:09<46:47:35,  9.17s/it]
 52%|█████▏    | 19595/37963 [48:12:16<44:06:34,  8.65s/it]
 52%|█████▏    | 19596/37963 [48:12:24<42:28:57,  8.33s/it]
 52%|█████▏    | 19597/37963 [48:12:32<41:31:16,  8.14s/it]
 52%|█████▏    | 19598/37963 [48:12:46<51:41:55, 10.13s/it]
 52%|█████▏    | 19599/37963 [48:12:54<47:50:25,  9.38s/it]
 52%|█████▏    | 19600/37963 [48:13:09<55:47:26, 10.94s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '1.315', 'learning_rate': '9.959e-06', 'epoch': '0.5163'}
+
 52%|█████▏    | 19600/37963 [48:13:09<55:47:26, 10.94s/it]
 52%|█████▏    | 19601/37963 [48:13:17<51:07:23, 10.02s/it]
 52%|█████▏    | 19602/37963 [48:13:32<58:45:40, 11.52s/it]
 52%|█████▏    | 19603/37963 [48:13:39<53:04:17, 10.41s/it]
 52%|█████▏    | 19604/37963 [48:13:47<48:48:12,  9.57s/it]
 52%|█████▏    | 19605/37963 [48:13:55<45:55:19,  9.01s/it]
 52%|█████▏    | 19606/37963 [48:14:03<44:13:43,  8.67s/it]
 52%|█████▏    | 19607/37963 [48:14:10<42:10:58,  8.27s/it]
 52%|█████▏    | 19608/37963 [48:14:18<41:27:47,  8.13s/it]
 52%|█████▏    | 19609/37963 [48:14:25<40:49:18,  8.01s/it]
 52%|█████▏    | 19610/37963 [48:14:33<40:32:12,  7.95s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '2.621', 'learning_rate': '9.951e-06', 'epoch': '0.5166'}
+
 52%|█████▏    | 19610/37963 [48:14:33<40:32:12,  7.95s/it]
 52%|█████▏    | 19611/37963 [48:14:41<39:48:37,  7.81s/it]
 52%|█████▏    | 19612/37963 [48:14:49<39:53:10,  7.82s/it]
 52%|█████▏    | 19613/37963 [48:15:03<49:47:03,  9.77s/it]
 52%|█████▏    | 19614/37963 [48:15:18<57:21:48, 11.25s/it]
 52%|█████▏    | 19615/37963 [48:15:26<52:21:09, 10.27s/it]
 52%|█████▏    | 19616/37963 [48:15:33<48:27:04,  9.51s/it]
 52%|█████▏    | 19617/37963 [48:15:48<56:30:44, 11.09s/it]
 52%|█████▏    | 19618/37963 [48:15:56<51:36:54, 10.13s/it]
 52%|█████▏    | 19619/37963 [48:16:04<47:56:12,  9.41s/it]
 52%|█████▏    | 19620/37963 [48:16:18<55:22:27, 10.87s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '0.8247', 'learning_rate': '9.942e-06', 'epoch': '0.5168'}
+
 52%|█████▏    | 19620/37963 [48:16:18<55:22:27, 10.87s/it]
 52%|█████▏    | 19621/37963 [48:16:26<50:29:03,  9.91s/it]
 52%|█████▏    | 19622/37963 [48:16:33<47:22:30,  9.30s/it]
 52%|█████▏    | 19623/37963 [48:16:41<45:04:17,  8.85s/it]
 52%|█████▏    | 19624/37963 [48:16:49<43:44:06,  8.59s/it]
 52%|█████▏    | 19625/37963 [48:16:57<42:20:29,  8.31s/it]
 52%|█████▏    | 19626/37963 [48:17:05<41:27:20,  8.14s/it]
 52%|█████▏    | 19627/37963 [48:17:12<40:57:56,  8.04s/it]
 52%|█████▏    | 19628/37963 [48:17:20<40:31:52,  7.96s/it]
 52%|█████▏    | 19629/37963 [48:17:28<40:00:26,  7.86s/it]
 52%|█████▏    | 19630/37963 [48:17:35<39:36:23,  7.78s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '1.635', 'learning_rate': '9.933e-06', 'epoch': '0.5171'}
+
 52%|█████▏    | 19630/37963 [48:17:35<39:36:23,  7.78s/it]
 52%|█████▏    | 19631/37963 [48:17:43<39:30:34,  7.76s/it]
 52%|█████▏    | 19632/37963 [48:17:51<39:45:21,  7.81s/it]
 52%|█████▏    | 19633/37963 [48:17:59<39:24:01,  7.74s/it]
 52%|█████▏    | 19634/37963 [48:18:06<39:23:53,  7.74s/it]
 52%|█████▏    | 19635/37963 [48:18:14<39:05:30,  7.68s/it]
 52%|█████▏    | 19636/37963 [48:18:22<39:10:19,  7.69s/it]
 52%|█████▏    | 19637/37963 [48:18:29<38:42:44,  7.60s/it]
 52%|█████▏    | 19638/37963 [48:18:37<38:57:01,  7.65s/it]
 52%|█████▏    | 19639/37963 [48:18:52<50:27:40,  9.91s/it]
 52%|█████▏    | 19640/37963 [48:19:00<47:12:39,  9.28s/it]
                                                           
{'loss': '0.1425', 'grad_norm': '1.803', 'learning_rate': '9.925e-06', 'epoch': '0.5173'}
+
 52%|█████▏    | 19640/37963 [48:19:00<47:12:39,  9.28s/it]
 52%|█████▏    | 19641/37963 [48:19:07<44:39:49,  8.78s/it]
 52%|█████▏    | 19642/37963 [48:19:22<53:31:19, 10.52s/it]
 52%|█████▏    | 19643/37963 [48:19:30<49:18:05,  9.69s/it]
 52%|█████▏    | 19644/37963 [48:19:37<46:09:03,  9.07s/it]
 52%|█████▏    | 19645/37963 [48:19:45<43:36:55,  8.57s/it]
 52%|█████▏    | 19646/37963 [48:20:00<53:28:32, 10.51s/it]
 52%|█████▏    | 19647/37963 [48:20:08<49:11:12,  9.67s/it]
 52%|█████▏    | 19648/37963 [48:20:22<56:45:43, 11.16s/it]
 52%|█████▏    | 19649/37963 [48:20:30<51:18:49, 10.09s/it]
 52%|█████▏    | 19650/37963 [48:20:37<47:24:24,  9.32s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '1.198', 'learning_rate': '9.916e-06', 'epoch': '0.5176'}
+
 52%|█████▏    | 19650/37963 [48:20:37<47:24:24,  9.32s/it]
 52%|█████▏    | 19651/37963 [48:20:45<44:52:51,  8.82s/it]
 52%|█████▏    | 19652/37963 [48:20:53<43:12:44,  8.50s/it]
 52%|█████▏    | 19653/37963 [48:21:01<42:20:52,  8.33s/it]
 52%|█████▏    | 19654/37963 [48:21:08<41:22:37,  8.14s/it]
 52%|█████▏    | 19655/37963 [48:21:16<40:42:11,  8.00s/it]
 52%|█████▏    | 19656/37963 [48:21:24<40:15:14,  7.92s/it]
 52%|█████▏    | 19657/37963 [48:21:31<40:02:44,  7.88s/it]
 52%|█████▏    | 19658/37963 [48:21:39<39:47:02,  7.82s/it]
 52%|█████▏    | 19659/37963 [48:21:47<39:36:15,  7.79s/it]
 52%|█████▏    | 19660/37963 [48:21:55<39:35:03,  7.79s/it]
                                                           
{'loss': '0.152', 'grad_norm': '2.986', 'learning_rate': '9.908e-06', 'epoch': '0.5179'}
+
 52%|█████▏    | 19660/37963 [48:21:55<39:35:03,  7.79s/it]
 52%|█████▏    | 19661/37963 [48:22:09<49:55:02,  9.82s/it]
 52%|█████▏    | 19662/37963 [48:22:25<58:14:13, 11.46s/it]
 52%|█████▏    | 19663/37963 [48:22:32<52:34:49, 10.34s/it]
 52%|█████▏    | 19664/37963 [48:22:40<48:27:24,  9.53s/it]
 52%|█████▏    | 19665/37963 [48:22:48<45:34:11,  8.97s/it]
 52%|█████▏    | 19666/37963 [48:23:02<54:11:19, 10.66s/it]
 52%|█████▏    | 19667/37963 [48:23:10<49:56:36,  9.83s/it]
 52%|█████▏    | 19668/37963 [48:23:25<57:34:13, 11.33s/it]
 52%|█████▏    | 19669/37963 [48:23:33<52:16:59, 10.29s/it]
 52%|█████▏    | 19670/37963 [48:23:41<48:28:29,  9.54s/it]
                                                           
{'loss': '0.156', 'grad_norm': '2.299', 'learning_rate': '9.899e-06', 'epoch': '0.5181'}
+
 52%|█████▏    | 19670/37963 [48:23:41<48:28:29,  9.54s/it]
 52%|█████▏    | 19671/37963 [48:23:48<45:35:25,  8.97s/it]
 52%|█████▏    | 19672/37963 [48:23:56<43:37:04,  8.58s/it]
 52%|█████▏    | 19673/37963 [48:24:04<42:24:44,  8.35s/it]
 52%|█████▏    | 19674/37963 [48:24:11<41:34:42,  8.18s/it]
 52%|█████▏    | 19675/37963 [48:24:19<40:50:57,  8.04s/it]
 52%|█████▏    | 19676/37963 [48:24:27<39:55:36,  7.86s/it]
 52%|█████▏    | 19677/37963 [48:24:34<39:16:43,  7.73s/it]
 52%|█████▏    | 19678/37963 [48:24:42<39:15:06,  7.73s/it]
 52%|█████▏    | 19679/37963 [48:24:49<38:59:01,  7.68s/it]
 52%|█████▏    | 19680/37963 [48:24:57<39:13:13,  7.72s/it]
                                                           
{'loss': '0.1401', 'grad_norm': '1.64', 'learning_rate': '9.891e-06', 'epoch': '0.5184'}
+
 52%|█████▏    | 19680/37963 [48:24:57<39:13:13,  7.72s/it]
 52%|█████▏    | 19681/37963 [48:25:05<38:55:51,  7.67s/it]
 52%|█████▏    | 19682/37963 [48:25:12<39:02:46,  7.69s/it]
 52%|█████▏    | 19683/37963 [48:25:20<39:19:33,  7.74s/it]
 52%|█████▏    | 19684/37963 [48:25:28<39:17:56,  7.74s/it]
 52%|█████▏    | 19685/37963 [48:25:43<49:40:26,  9.78s/it]
 52%|█████▏    | 19686/37963 [48:25:50<46:48:17,  9.22s/it]
 52%|█████▏    | 19687/37963 [48:25:58<44:22:48,  8.74s/it]
 52%|█████▏    | 19688/37963 [48:26:13<53:20:46, 10.51s/it]
 52%|█████▏    | 19689/37963 [48:26:21<49:38:49,  9.78s/it]
 52%|█████▏    | 19690/37963 [48:26:36<57:37:16, 11.35s/it]
                                                           
{'loss': '0.1406', 'grad_norm': '3.021', 'learning_rate': '9.882e-06', 'epoch': '0.5187'}
+
 52%|█████▏    | 19690/37963 [48:26:36<57:37:16, 11.35s/it]
 52%|█████▏    | 19691/37963 [48:26:44<52:08:26, 10.27s/it]
 52%|█████▏    | 19692/37963 [48:26:51<48:15:17,  9.51s/it]
 52%|█████▏    | 19693/37963 [48:26:59<45:24:23,  8.95s/it]
 52%|█████▏    | 19694/37963 [48:27:07<43:30:20,  8.57s/it]
 52%|█████▏    | 19695/37963 [48:27:14<42:13:40,  8.32s/it]
 52%|█████▏    | 19696/37963 [48:27:22<41:28:19,  8.17s/it]
 52%|█████▏    | 19697/37963 [48:27:30<40:45:55,  8.03s/it]
 52%|█████▏    | 19698/37963 [48:27:38<40:10:58,  7.92s/it]
 52%|█████▏    | 19699/37963 [48:27:46<40:19:49,  7.95s/it]
 52%|█████▏    | 19700/37963 [48:27:53<40:05:36,  7.90s/it]
                                                           
{'loss': '0.1412', 'grad_norm': '1.303', 'learning_rate': '9.874e-06', 'epoch': '0.5189'}
+
 52%|█████▏    | 19700/37963 [48:27:53<40:05:36,  7.90s/it]
 52%|█████▏    | 19701/37963 [48:28:01<39:33:42,  7.80s/it]
 52%|█████▏    | 19702/37963 [48:28:15<49:36:19,  9.78s/it]
 52%|█████▏    | 19703/37963 [48:28:23<46:58:57,  9.26s/it]
 52%|█████▏    | 19704/37963 [48:28:31<44:43:10,  8.82s/it]
 52%|█████▏    | 19705/37963 [48:28:39<43:07:42,  8.50s/it]
 52%|█████▏    | 19706/37963 [48:28:47<42:08:38,  8.31s/it]
 52%|█████▏    | 19707/37963 [48:28:55<41:27:15,  8.17s/it]
 52%|█████▏    | 19708/37963 [48:29:10<52:33:51, 10.37s/it]
 52%|█████▏    | 19709/37963 [48:29:25<59:48:39, 11.80s/it]
 52%|█████▏    | 19710/37963 [48:29:33<53:19:58, 10.52s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '1.723', 'learning_rate': '9.865e-06', 'epoch': '0.5192'}
+
 52%|█████▏    | 19710/37963 [48:29:33<53:19:58, 10.52s/it]
 52%|█████▏    | 19711/37963 [48:29:41<49:06:15,  9.69s/it]
 52%|█████▏    | 19712/37963 [48:29:48<46:07:37,  9.10s/it]
 52%|█████▏    | 19713/37963 [48:29:56<44:02:31,  8.69s/it]
 52%|█████▏    | 19714/37963 [48:30:04<42:26:57,  8.37s/it]
 52%|█████▏    | 19715/37963 [48:30:18<51:57:46, 10.25s/it]
 52%|█████▏    | 19716/37963 [48:30:26<48:23:01,  9.55s/it]
 52%|█████▏    | 19717/37963 [48:30:34<45:37:25,  9.00s/it]
 52%|█████▏    | 19718/37963 [48:30:42<43:45:28,  8.63s/it]
 52%|████��▏    | 19719/37963 [48:30:50<42:35:22,  8.40s/it]
 52%|█████▏    | 19720/37963 [48:31:04<51:34:03, 10.18s/it]
                                                           
{'loss': '0.1384', 'grad_norm': '3.378', 'learning_rate': '9.857e-06', 'epoch': '0.5195'}
+
 52%|█████▏    | 19720/37963 [48:31:04<51:34:03, 10.18s/it]
 52%|█████▏    | 19721/37963 [48:31:12<47:55:20,  9.46s/it]
 52%|█████▏    | 19722/37963 [48:31:20<45:28:35,  8.98s/it]
 52%|█████▏    | 19723/37963 [48:31:27<43:28:30,  8.58s/it]
 52%|█████▏    | 19724/37963 [48:31:35<42:52:46,  8.46s/it]
 52%|█████▏    | 19725/37963 [48:31:43<41:57:37,  8.28s/it]
 52%|█████▏    | 19726/37963 [48:31:51<41:17:39,  8.15s/it]
 52%|█████▏    | 19727/37963 [48:31:59<40:50:22,  8.06s/it]
 52%|█████▏    | 19728/37963 [48:32:07<40:19:06,  7.96s/it]
 52%|█████▏    | 19729/37963 [48:32:15<40:16:49,  7.95s/it]
 52%|█████▏    | 19730/37963 [48:32:22<39:55:28,  7.88s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '1.32', 'learning_rate': '9.848e-06', 'epoch': '0.5197'}
+
 52%|█████▏    | 19730/37963 [48:32:22<39:55:28,  7.88s/it]
 52%|█████▏    | 19731/37963 [48:32:30<39:16:14,  7.75s/it]
 52%|█████▏    | 19732/37963 [48:32:37<39:11:16,  7.74s/it]
 52%|█████▏    | 19733/37963 [48:32:45<39:17:47,  7.76s/it]
 52%|█████▏    | 19734/37963 [48:32:53<39:10:40,  7.74s/it]
 52%|█████▏    | 19735/37963 [48:33:08<49:50:39,  9.84s/it]
 52%|█████▏    | 19736/37963 [48:33:22<56:57:01, 11.25s/it]
 52%|█████▏    | 19737/37963 [48:33:37<62:37:29, 12.37s/it]
 52%|█████▏    | 19738/37963 [48:33:45<55:27:17, 10.95s/it]
 52%|█████▏    | 19739/37963 [48:33:53<50:38:49, 10.00s/it]
 52%|█████▏    | 19740/37963 [48:34:00<46:51:30,  9.26s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '3.649', 'learning_rate': '9.84e-06', 'epoch': '0.52'}
+
 52%|█████▏    | 19740/37963 [48:34:00<46:51:30,  9.26s/it]
 52%|█████▏    | 19741/37963 [48:34:08<44:37:12,  8.82s/it]
 52%|█████▏    | 19742/37963 [48:34:16<43:05:44,  8.51s/it]
 52%|█████▏    | 19743/37963 [48:34:23<41:44:22,  8.25s/it]
 52%|█████▏    | 19744/37963 [48:34:31<41:08:12,  8.13s/it]
 52%|█████▏    | 19745/37963 [48:34:39<40:13:37,  7.95s/it]
 52%|█████▏    | 19746/37963 [48:34:47<39:55:39,  7.89s/it]
 52%|█████▏    | 19747/37963 [48:34:54<39:32:58,  7.82s/it]
 52%|█████▏    | 19748/37963 [48:35:02<39:22:51,  7.78s/it]
 52%|█████▏    | 19749/37963 [48:35:10<39:14:39,  7.76s/it]
 52%|█████▏    | 19750/37963 [48:35:17<39:14:28,  7.76s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '1.806', 'learning_rate': '9.831e-06', 'epoch': '0.5202'}
+
 52%|█████▏    | 19750/37963 [48:35:17<39:14:28,  7.76s/it]
 52%|█████▏    | 19751/37963 [48:35:32<49:59:36,  9.88s/it]
 52%|█████▏    | 19752/37963 [48:35:46<56:31:13, 11.17s/it]
 52%|█████▏    | 19753/37963 [48:36:02<62:52:24, 12.43s/it]
 52%|█████▏    | 19754/37963 [48:36:10<55:50:02, 11.04s/it]
 52%|█████▏    | 19755/37963 [48:36:17<50:36:56, 10.01s/it]
 52%|█████▏    | 19756/37963 [48:36:25<47:13:19,  9.34s/it]
 52%|█████▏    | 19757/37963 [48:36:33<44:48:33,  8.86s/it]
 52%|█████▏    | 19758/37963 [48:36:40<43:16:38,  8.56s/it]
 52%|█████▏    | 19759/37963 [48:36:48<41:58:29,  8.30s/it]
 52%|█████▏    | 19760/37963 [48:36:56<41:09:07,  8.14s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '1.577', 'learning_rate': '9.823e-06', 'epoch': '0.5205'}
+
 52%|█████▏    | 19760/37963 [48:36:56<41:09:07,  8.14s/it]
 52%|█████▏    | 19761/37963 [48:37:04<40:35:09,  8.03s/it]
 52%|█████▏    | 19762/37963 [48:37:18<50:08:47,  9.92s/it]
 52%|█████▏    | 19763/37963 [48:37:26<47:08:06,  9.32s/it]
 52%|█████▏    | 19764/37963 [48:37:34<44:35:25,  8.82s/it]
 52%|█████▏    | 19765/37963 [48:37:41<42:51:59,  8.48s/it]
 52%|█████▏    | 19766/37963 [48:37:49<41:50:13,  8.28s/it]
 52%|█████▏    | 19767/37963 [48:37:57<40:39:39,  8.04s/it]
 52%|█████▏    | 19768/37963 [48:38:04<39:51:41,  7.89s/it]
 52%|█████▏    | 19769/37963 [48:38:12<39:32:28,  7.82s/it]
 52%|█████▏    | 19770/37963 [48:38:20<39:38:35,  7.84s/it]
                                                           
{'loss': '0.1408', 'grad_norm': '3.595', 'learning_rate': '9.814e-06', 'epoch': '0.5208'}
+
 52%|█████▏    | 19770/37963 [48:38:20<39:38:35,  7.84s/it]
 52%|█████▏    | 19771/37963 [48:38:27<39:13:12,  7.76s/it]
 52%|█████▏    | 19772/37963 [48:38:35<39:01:47,  7.72s/it]
 52%|█████▏    | 19773/37963 [48:38:49<48:58:12,  9.69s/it]
 52%|█████▏    | 19774/37963 [48:38:57<46:05:25,  9.12s/it]
 52%|█████▏    | 19775/37963 [48:39:05<43:45:20,  8.66s/it]
 52%|█████▏    | 19776/37963 [48:39:13<42:44:01,  8.46s/it]
 52%|█████▏    | 19777/37963 [48:39:20<41:43:33,  8.26s/it]
 52%|█████▏    | 19778/37963 [48:39:28<40:46:24,  8.07s/it]
 52%|█████▏    | 19779/37963 [48:39:36<40:02:45,  7.93s/it]
 52%|█████▏    | 19780/37963 [48:39:43<39:44:44,  7.87s/it]
                                                           
{'loss': '0.1392', 'grad_norm': '0.9131', 'learning_rate': '9.805e-06', 'epoch': '0.521'}
+
 52%|█████▏    | 19780/37963 [48:39:43<39:44:44,  7.87s/it]
 52%|█████▏    | 19781/37963 [48:39:51<39:35:31,  7.84s/it]
 52%|█████▏    | 19782/37963 [48:39:59<39:24:25,  7.80s/it]
 52%|█████▏    | 19783/37963 [48:40:20<60:26:49, 11.97s/it]
 52%|█████▏    | 19784/37963 [48:40:35<64:55:33, 12.86s/it]
 52%|█████▏    | 19785/37963 [48:40:43<56:55:35, 11.27s/it]
 52%|█████▏    | 19786/37963 [48:40:51<51:44:15, 10.25s/it]
 52%|█████▏    | 19787/37963 [48:40:59<48:01:19,  9.51s/it]
 52%|█████▏    | 19788/37963 [48:41:06<45:13:17,  8.96s/it]
 52%|█████▏    | 19789/37963 [48:41:14<42:46:00,  8.47s/it]
 52%|█████▏    | 19790/37963 [48:41:21<41:03:05,  8.13s/it]
                                                           
{'loss': '0.1416', 'grad_norm': '0.8483', 'learning_rate': '9.797e-06', 'epoch': '0.5213'}
+
 52%|█████▏    | 19790/37963 [48:41:21<41:03:05,  8.13s/it]
 52%|█████▏    | 19791/37963 [48:41:29<40:24:15,  8.00s/it]
 52%|█████▏    | 19792/37963 [48:41:36<39:40:52,  7.86s/it]
 52%|█████▏    | 19793/37963 [48:41:44<39:28:25,  7.82s/it]
 52%|█████▏    | 19794/37963 [48:41:52<39:16:15,  7.78s/it]
 52%|█████▏    | 19795/37963 [48:42:06<48:41:17,  9.65s/it]
 52%|█████▏    | 19796/37963 [48:42:13<45:36:55,  9.04s/it]
 52%|█████▏    | 19797/37963 [48:42:21<43:51:09,  8.69s/it]
 52%|█████▏    | 19798/37963 [48:42:29<42:23:34,  8.40s/it]
 52%|█████▏    | 19799/37963 [48:42:37<41:18:44,  8.19s/it]
 52%|█████▏    | 19800/37963 [48:42:58<61:54:26, 12.27s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '1.489', 'learning_rate': '9.788e-06', 'epoch': '0.5216'}
+
 52%|█████▏    | 19800/37963 [48:42:58<61:54:26, 12.27s/it]
 52%|█████▏    | 19801/37963 [48:43:06<54:41:31, 10.84s/it]
 52%|█████▏    | 19802/37963 [48:43:14<49:57:23,  9.90s/it]
 52%|█████▏    | 19803/37963 [48:43:21<46:50:23,  9.29s/it]
 52%|█████▏    | 19804/37963 [48:43:29<44:31:47,  8.83s/it]
 52%|█████▏    | 19805/37963 [48:43:37<42:48:57,  8.49s/it]
 52%|█████▏    | 19806/37963 [48:43:44<41:29:07,  8.23s/it]
 52%|█████▏    | 19807/37963 [48:43:52<40:38:18,  8.06s/it]
 52%|█████▏    | 19808/37963 [48:44:00<40:12:36,  7.97s/it]
 52%|█████▏    | 19809/37963 [48:44:08<39:46:52,  7.89s/it]
 52%|█████▏    | 19810/37963 [48:44:22<49:29:43,  9.82s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '2.479', 'learning_rate': '9.78e-06', 'epoch': '0.5218'}
+
 52%|█████▏    | 19810/37963 [48:44:22<49:29:43,  9.82s/it]
 52%|█████▏    | 19811/37963 [48:44:30<46:14:30,  9.17s/it]
 52%|█████▏    | 19812/37963 [48:44:37<43:59:45,  8.73s/it]
 52%|█████▏    | 19813/37963 [48:44:45<42:27:29,  8.42s/it]
 52%|█████▏    | 19814/37963 [48:44:53<41:27:50,  8.22s/it]
 52%|█████▏    | 19815/37963 [48:45:00<40:34:24,  8.05s/it]
 52%|█████▏    | 19816/37963 [48:45:08<40:02:41,  7.94s/it]
 52%|█████▏    | 19817/37963 [48:45:16<39:33:04,  7.85s/it]
 52%|█████▏    | 19818/37963 [48:45:23<39:12:46,  7.78s/it]
 52%|█████▏    | 19819/37963 [48:45:31<39:13:29,  7.78s/it]
 52%|█████▏    | 19820/37963 [48:45:39<39:13:02,  7.78s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '1.026', 'learning_rate': '9.771e-06', 'epoch': '0.5221'}
+
 52%|█████▏    | 19820/37963 [48:45:39<39:13:02,  7.78s/it]
 52%|█████▏    | 19821/37963 [48:45:47<39:13:46,  7.78s/it]
 52%|█████▏    | 19822/37963 [48:45:55<39:26:53,  7.83s/it]
 52%|█████▏    | 19823/37963 [48:46:02<39:28:59,  7.84s/it]
 52%|█████▏    | 19824/37963 [48:46:10<39:16:46,  7.80s/it]
 52%|█████▏    | 19825/37963 [48:46:18<39:10:07,  7.77s/it]
 52%|█████▏    | 19826/37963 [48:46:32<49:15:47,  9.78s/it]
 52%|█████▏    | 19827/37963 [48:46:40<46:14:28,  9.18s/it]
 52%|█████▏    | 19828/37963 [48:46:55<54:41:08, 10.86s/it]
 52%|█████▏    | 19829/37963 [48:47:10<60:29:28, 12.01s/it]
 52%|█████▏    | 19830/37963 [48:47:17<53:53:40, 10.70s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '1.108', 'learning_rate': '9.763e-06', 'epoch': '0.5224'}
+
 52%|█████▏    | 19830/37963 [48:47:17<53:53:40, 10.70s/it]
 52%|█████▏    | 19831/37963 [48:47:25<49:21:04,  9.80s/it]
 52%|█████▏    | 19832/37963 [48:47:33<46:02:37,  9.14s/it]
 52%|█████▏    | 19833/37963 [48:47:40<43:32:40,  8.65s/it]
 52%|█████▏    | 19834/37963 [48:47:48<42:17:23,  8.40s/it]
 52%|█████▏    | 19835/37963 [48:47:55<41:00:04,  8.14s/it]
 52%|█████▏    | 19836/37963 [48:48:10<51:22:28, 10.20s/it]
 52%|█████▏    | 19837/37963 [48:48:18<47:40:02,  9.47s/it]
 52%|█████▏    | 19838/37963 [48:48:26<45:11:36,  8.98s/it]
 52%|█████▏    | 19839/37963 [48:48:34<43:16:47,  8.60s/it]
 52%|█████▏    | 19840/37963 [48:48:41<41:23:45,  8.22s/it]
                                                           
{'loss': '0.1396', 'grad_norm': '3.532', 'learning_rate': '9.754e-06', 'epoch': '0.5226'}
+
 52%|█████▏    | 19840/37963 [48:48:41<41:23:45,  8.22s/it]
 52%|█████▏    | 19841/37963 [48:48:49<40:47:09,  8.10s/it]
 52%|█████▏    | 19842/37963 [48:48:57<40:04:37,  7.96s/it]
 52%|█████▏    | 19843/37963 [48:49:11<49:17:47,  9.79s/it]
 52%|█████▏    | 19844/37963 [48:49:18<46:13:05,  9.18s/it]
 52%|█████▏    | 19845/37963 [48:49:26<44:07:21,  8.77s/it]
 52%|█████▏    | 19846/37963 [48:49:34<42:31:16,  8.45s/it]
 52%|█████▏    | 19847/37963 [48:49:42<41:26:30,  8.24s/it]
 52%|█████▏    | 19848/37963 [48:49:49<40:44:14,  8.10s/it]
 52%|█████▏    | 19849/37963 [48:49:57<40:16:27,  8.00s/it]
 52%|█████▏    | 19850/37963 [48:50:11<49:26:25,  9.83s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '1.118', 'learning_rate': '9.746e-06', 'epoch': '0.5229'}
+
 52%|█████▏    | 19850/37963 [48:50:11<49:26:25,  9.83s/it]
 52%|█████▏    | 19851/37963 [48:50:26<56:52:44, 11.31s/it]
 52%|█████▏    | 19852/37963 [48:50:34<51:35:56, 10.26s/it]
 52%|█████▏    | 19853/37963 [48:50:42<47:59:52,  9.54s/it]
 52%|█████▏    | 19854/37963 [48:50:56<55:14:58, 10.98s/it]
 52%|█████▏    | 19855/37963 [48:51:04<50:42:59, 10.08s/it]
 52%|█████▏    | 19856/37963 [48:51:12<47:03:09,  9.35s/it]
 52%|█████▏    | 19857/37963 [48:51:19<44:42:01,  8.89s/it]
 52%|█████▏    | 19858/37963 [48:51:27<42:48:13,  8.51s/it]
 52%|█████▏    | 19859/37963 [48:51:35<41:33:11,  8.26s/it]
 52%|█████▏    | 19860/37963 [48:51:42<40:32:13,  8.06s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '0.8095', 'learning_rate': '9.737e-06', 'epoch': '0.5231'}
+
 52%|█████▏    | 19860/37963 [48:51:42<40:32:13,  8.06s/it]
 52%|█████▏    | 19861/37963 [48:51:50<40:11:02,  7.99s/it]
 52%|█████▏    | 19862/37963 [48:51:58<39:39:38,  7.89s/it]
 52%|█████▏    | 19863/37963 [48:52:06<39:23:37,  7.84s/it]
 52%|█████▏    | 19864/37963 [48:52:13<39:00:43,  7.76s/it]
 52%|█████▏    | 19865/37963 [48:52:21<39:07:45,  7.78s/it]
 52%|█████▏    | 19866/37963 [48:52:29<38:58:02,  7.75s/it]
 52%|█████▏    | 19867/37963 [48:52:36<38:51:01,  7.73s/it]
 52%|█████▏    | 19868/37963 [48:52:44<39:03:25,  7.77s/it]
 52%|█████▏    | 19869/37963 [48:52:52<39:02:02,  7.77s/it]
 52%|█████▏    | 19870/37963 [48:53:00<38:53:13,  7.74s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '1.15', 'learning_rate': '9.729e-06', 'epoch': '0.5234'}
+
 52%|█████▏    | 19870/37963 [48:53:00<38:53:13,  7.74s/it]
 52%|█████▏    | 19871/37963 [48:53:07<38:49:09,  7.72s/it]
 52%|█████▏    | 19872/37963 [48:53:15<38:38:30,  7.69s/it]
 52%|█████▏    | 19873/37963 [48:53:23<38:34:57,  7.68s/it]
 52%|█████▏    | 19874/37963 [48:53:30<38:54:14,  7.74s/it]
 52%|█████▏    | 19875/37963 [48:53:38<38:43:00,  7.71s/it]
 52%|█████▏    | 19876/37963 [48:53:53<49:13:37,  9.80s/it]
 52%|█████▏    | 19877/37963 [48:54:00<45:56:56,  9.15s/it]
 52%|█████▏    | 19878/37963 [48:54:08<43:49:55,  8.73s/it]
 52%|█████▏    | 19879/37963 [48:54:22<52:17:40, 10.41s/it]
 52%|█████▏    | 19880/37963 [48:54:30<48:17:43,  9.61s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '1.874', 'learning_rate': '9.72e-06', 'epoch': '0.5237'}
+
 52%|█████▏    | 19880/37963 [48:54:30<48:17:43,  9.61s/it]
 52%|█████▏    | 19881/37963 [48:54:38<45:23:59,  9.04s/it]
 52%|█████▏    | 19882/37963 [48:54:46<43:23:52,  8.64s/it]
 52%|█████▏    | 19883/37963 [48:55:01<53:17:55, 10.61s/it]
 52%|█████▏    | 19884/37963 [48:55:09<49:06:38,  9.78s/it]
 52%|█████▏    | 19885/37963 [48:55:17<46:11:33,  9.20s/it]
 52%|█████▏    | 19886/37963 [48:55:24<43:48:07,  8.72s/it]
 52%|█████▏    | 19887/37963 [48:55:32<42:18:28,  8.43s/it]
 52%|█████▏    | 19888/37963 [48:55:40<41:15:05,  8.22s/it]
 52%|█████▏    | 19889/37963 [48:55:47<40:41:32,  8.11s/it]
 52%|█████▏    | 19890/37963 [48:56:02<51:05:53, 10.18s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '1.479', 'learning_rate': '9.712e-06', 'epoch': '0.5239'}
+
 52%|█████▏    | 19890/37963 [48:56:02<51:05:53, 10.18s/it]
 52%|█████▏    | 19891/37963 [48:56:17<57:47:22, 11.51s/it]
 52%|█████▏    | 19892/37963 [48:56:25<52:16:54, 10.42s/it]
 52%|█████▏    | 19893/37963 [48:56:33<48:14:36,  9.61s/it]
 52%|█████▏    | 19894/37963 [48:56:40<45:20:55,  9.04s/it]
 52%|█████▏    | 19895/37963 [48:56:48<43:25:28,  8.65s/it]
 52%|█████▏    | 19896/37963 [48:57:03<53:05:24, 10.58s/it]
 52%|█████▏    | 19897/37963 [48:57:11<48:45:08,  9.71s/it]
 52%|█████▏    | 19898/37963 [48:57:19<45:53:43,  9.15s/it]
 52%|█████▏    | 19899/37963 [48:57:33<53:33:14, 10.67s/it]
 52%|█████▏    | 19900/37963 [48:57:48<60:30:51, 12.06s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '2.044', 'learning_rate': '9.703e-06', 'epoch': '0.5242'}
+
 52%|█████▏    | 19900/37963 [48:57:48<60:30:51, 12.06s/it]
 52%|█████▏    | 19901/37963 [48:57:56<53:59:55, 10.76s/it]
 52%|█████▏    | 19902/37963 [48:58:04<49:28:33,  9.86s/it]
 52%|█████▏    | 19903/37963 [48:58:11<46:10:39,  9.20s/it]
 52%|█████▏    | 19904/37963 [48:58:19<43:49:11,  8.74s/it]
 52%|█████▏    | 19905/37963 [48:58:27<42:16:25,  8.43s/it]
 52%|█████▏    | 19906/37963 [48:58:34<40:44:59,  8.12s/it]
 52%|█████▏    | 19907/37963 [48:58:42<40:06:40,  8.00s/it]
 52%|█████▏    | 19908/37963 [48:58:49<39:27:30,  7.87s/it]
 52%|█████▏    | 19909/37963 [48:58:57<39:03:10,  7.79s/it]
 52%|█████▏    | 19910/37963 [48:59:04<38:26:29,  7.67s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '1.763', 'learning_rate': '9.695e-06', 'epoch': '0.5245'}
+
 52%|█████▏    | 19910/37963 [48:59:04<38:26:29,  7.67s/it]
 52%|█████▏    | 19911/37963 [48:59:12<38:25:26,  7.66s/it]
 52%|█████▏    | 19912/37963 [48:59:20<38:35:23,  7.70s/it]
 52%|█████▏    | 19913/37963 [48:59:27<38:23:53,  7.66s/it]
 52%|█████▏    | 19914/37963 [48:59:35<38:24:25,  7.66s/it]
 52%|█████▏    | 19915/37963 [48:59:43<38:29:56,  7.68s/it]
 52%|█████▏    | 19916/37963 [48:59:51<38:40:21,  7.71s/it]
 52%|█████▏    | 19917/37963 [48:59:58<38:42:13,  7.72s/it]
 52%|█████▏    | 19918/37963 [49:00:06<38:40:47,  7.72s/it]
 52%|█████▏    | 19919/37963 [49:00:14<38:36:29,  7.70s/it]
 52%|█████▏    | 19920/37963 [49:00:22<38:59:23,  7.78s/it]
                                                           
{'loss': '0.1634', 'grad_norm': '1.234', 'learning_rate': '9.686e-06', 'epoch': '0.5247'}
+
 52%|█████▏    | 19920/37963 [49:00:22<38:59:23,  7.78s/it]
 52%|█████▏    | 19921/37963 [49:00:29<38:25:04,  7.67s/it]
 52%|█████▏    | 19922/37963 [49:00:37<38:26:22,  7.67s/it]
 52%|█████▏    | 19923/37963 [49:00:51<48:55:58,  9.76s/it]
 52%|█████▏    | 19924/37963 [49:00:59<45:51:20,  9.15s/it]
 52%|█████▏    | 19925/37963 [49:01:07<43:45:26,  8.73s/it]
 52%|█████▏    | 19926/37963 [49:01:15<42:17:09,  8.44s/it]
 52%|█████▏    | 19927/37963 [49:01:29<50:31:01, 10.08s/it]
 52%|█████▏    | 19928/37963 [49:01:36<46:51:31,  9.35s/it]
 52%|█████▏    | 19929/37963 [49:01:44<44:20:05,  8.85s/it]
 52%|█████▏    | 19930/37963 [49:01:52<42:42:35,  8.53s/it]
                                                           
{'loss': '0.142', 'grad_norm': '2.068', 'learning_rate': '9.678e-06', 'epoch': '0.525'}
+
 52%|█████▏    | 19930/37963 [49:01:52<42:42:35,  8.53s/it]
 53%|█████▎    | 19931/37963 [49:01:59<41:30:04,  8.29s/it]
 53%|█████▎    | 19932/37963 [49:02:14<51:34:41, 10.30s/it]
 53%|█████▎    | 19933/37963 [49:02:22<47:42:19,  9.53s/it]
 53%|█████▎    | 19934/37963 [49:02:37<55:53:46, 11.16s/it]
 53%|█████▎    | 19935/37963 [49:02:45<50:31:58, 10.09s/it]
 53%|█████▎    | 19936/37963 [49:02:52<46:56:11,  9.37s/it]
 53%|█████▎    | 19937/37963 [49:03:00<44:22:32,  8.86s/it]
 53%|█████▎    | 19938/37963 [49:03:08<42:37:59,  8.51s/it]
 53%|█████▎    | 19939/37963 [49:03:15<41:25:21,  8.27s/it]
 53%|█████▎    | 19940/37963 [49:03:37<61:34:37, 12.30s/it]
                                                           
{'loss': '0.1465', 'grad_norm': '1.972', 'learning_rate': '9.669e-06', 'epoch': '0.5252'}
+
 53%|█████▎    | 19940/37963 [49:03:37<61:34:37, 12.30s/it]
 53%|█████▎    | 19941/37963 [49:03:45<55:06:07, 11.01s/it]
 53%|█████▎    | 19942/37963 [49:03:59<60:03:33, 12.00s/it]
 53%|█████▎    | 19943/37963 [49:04:14<63:59:59, 12.79s/it]
 53%|█████▎    | 19944/37963 [49:04:22<56:43:57, 11.33s/it]
 53%|█████▎    | 19945/37963 [49:04:29<50:42:06, 10.13s/it]
 53%|█████▎    | 19946/37963 [49:04:37<47:05:59,  9.41s/it]
 53%|█████▎    | 19947/37963 [49:04:45<44:18:32,  8.85s/it]
 53%|█████▎    | 19948/37963 [49:04:52<42:41:10,  8.53s/it]
 53%|█████▎    | 19949/37963 [49:05:00<41:29:13,  8.29s/it]
 53%|█████▎    | 19950/37963 [49:05:08<40:35:58,  8.11s/it]
                                                           
{'loss': '0.1609', 'grad_norm': '1.287', 'learning_rate': '9.661e-06', 'epoch': '0.5255'}
+
 53%|█████▎    | 19950/37963 [49:05:08<40:35:58,  8.11s/it]
 53%|█████▎    | 19951/37963 [49:05:16<39:58:10,  7.99s/it]
 53%|█████▎    | 19952/37963 [49:05:23<39:39:13,  7.93s/it]
 53%|█████▎    | 19953/37963 [49:05:31<39:16:23,  7.85s/it]
 53%|█████▎    | 19954/37963 [49:05:39<39:05:08,  7.81s/it]
 53%|█████▎    | 19955/37963 [49:05:46<38:57:42,  7.79s/it]
 53%|█████▎    | 19956/37963 [49:05:54<38:33:11,  7.71s/it]
 53%|█████▎    | 19957/37963 [49:06:02<38:46:10,  7.75s/it]
 53%|█████▎    | 19958/37963 [49:06:10<39:05:43,  7.82s/it]
 53%|█████▎    | 19959/37963 [49:06:18<39:10:49,  7.83s/it]
 53%|█████▎    | 19960/37963 [49:06:25<38:59:11,  7.80s/it]
                                                           
{'loss': '0.1387', 'grad_norm': '1.72', 'learning_rate': '9.652e-06', 'epoch': '0.5258'}
+
 53%|█████▎    | 19960/37963 [49:06:25<38:59:11,  7.80s/it]
 53%|█████▎    | 19961/37963 [49:06:33<39:19:06,  7.86s/it]
 53%|█████▎    | 19962/37963 [49:06:41<39:14:35,  7.85s/it]
 53%|█████▎    | 19963/37963 [49:06:49<39:18:52,  7.86s/it]
 53%|█████▎    | 19964/37963 [49:06:57<38:55:25,  7.79s/it]
 53%|█████▎    | 19965/37963 [49:07:04<38:50:43,  7.77s/it]
 53%|█████▎    | 19966/37963 [49:07:12<38:50:25,  7.77s/it]
 53%|█████▎    | 19967/37963 [49:07:20<38:54:09,  7.78s/it]
 53%|█████▎    | 19968/37963 [49:07:28<38:50:02,  7.77s/it]
 53%|█████▎    | 19969/37963 [49:07:36<39:06:31,  7.82s/it]
 53%|█████▎    | 19970/37963 [49:07:43<38:46:29,  7.76s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '3.537', 'learning_rate': '9.643e-06', 'epoch': '0.526'}
+
 53%|█████▎    | 19970/37963 [49:07:43<38:46:29,  7.76s/it]
 53%|█████▎    | 19971/37963 [49:07:51<38:58:28,  7.80s/it]
 53%|█████▎    | 19972/37963 [49:08:06<49:02:27,  9.81s/it]
 53%|█████▎    | 19973/37963 [49:08:14<46:33:50,  9.32s/it]
 53%|█████▎    | 19974/37963 [49:08:28<54:05:20, 10.82s/it]
 53%|█████▎    | 19975/37963 [49:08:36<49:38:17,  9.93s/it]
 53%|█████▎    | 19976/37963 [49:08:44<46:17:56,  9.27s/it]
 53%|█████▎    | 19977/37963 [49:08:52<43:59:22,  8.80s/it]
 53%|█████▎    | 19978/37963 [49:09:06<52:57:30, 10.60s/it]
 53%|█████▎    | 19979/37963 [49:09:21<59:41:25, 11.95s/it]
 53%|█████▎    | 19980/37963 [49:09:29<53:21:39, 10.68s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '2.815', 'learning_rate': '9.635e-06', 'epoch': '0.5263'}
+
 53%|█████▎    | 19980/37963 [49:09:29<53:21:39, 10.68s/it]
 53%|█████▎    | 19981/37963 [49:09:37<48:46:57,  9.77s/it]
 53%|█████▎    | 19982/37963 [49:09:45<45:49:16,  9.17s/it]
 53%|█████▎    | 19983/37963 [49:09:52<43:57:24,  8.80s/it]
 53%|█████▎    | 19984/37963 [49:10:00<42:17:24,  8.47s/it]
 53%|█████▎    | 19985/37963 [49:10:08<41:05:48,  8.23s/it]
 53%|█████▎    | 19986/37963 [49:10:22<50:33:31, 10.12s/it]
 53%|█████▎    | 19987/37963 [49:10:30<47:10:23,  9.45s/it]
 53%|█████▎    | 19988/37963 [49:10:38<44:15:25,  8.86s/it]
 53%|█████▎    | 19989/37963 [49:10:45<42:29:02,  8.51s/it]
 53%|█████▎    | 19990/37963 [49:11:00<51:49:10, 10.38s/it]
                                                           
{'loss': '0.155', 'grad_norm': '1.674', 'learning_rate': '9.626e-06', 'epoch': '0.5266'}
+
 53%|█████▎    | 19990/37963 [49:11:00<51:49:10, 10.38s/it]
 53%|█████▎    | 19991/37963 [49:11:15<58:21:39, 11.69s/it]
 53%|█████▎    | 19992/37963 [49:11:30<63:19:17, 12.68s/it]
 53%|█████▎    | 19993/37963 [49:11:38<55:57:37, 11.21s/it]
 53%|█████▎    | 19994/37963 [49:11:45<50:13:59, 10.06s/it]
 53%|█████▎    | 19995/37963 [49:11:53<46:28:54,  9.31s/it]
 53%|█████▎    | 19996/37963 [49:12:00<43:51:18,  8.79s/it]
 53%|█████▎    | 19997/37963 [49:12:08<42:17:14,  8.47s/it]
 53%|█████▎    | 19998/37963 [49:12:16<40:53:22,  8.19s/it]
 53%|█████▎    | 19999/37963 [49:12:23<40:18:02,  8.08s/it]
 53%|█████▎    | 20000/37963 [49:12:31<39:47:38,  7.98s/it]
                                                           
{'loss': '0.1327', 'grad_norm': '2.866', 'learning_rate': '9.618e-06', 'epoch': '0.5268'}
+
 53%|█████▎    | 20000/37963 [49:12:31<39:47:38,  7.98s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.49s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.49s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 53%|█████▎    | 20001/37963 [49:13:30<116:48:07, 23.41s/it]
 53%|█████▎    | 20002/37963 [49:13:38<93:25:39, 18.73s/it] 
 53%|█████▎    | 20003/37963 [49:13:46<77:01:19, 15.44s/it]
 53%|█████▎    | 20004/37963 [49:13:54<65:26:20, 13.12s/it]
 53%|█████▎    | 20005/37963 [49:14:02<57:34:47, 11.54s/it]
 53%|█████▎    | 20006/37963 [49:14:10<52:08:18, 10.45s/it]
 53%|█████▎    | 20007/37963 [49:14:17<48:16:51,  9.68s/it]
 53%|█████▎    | 20008/37963 [49:14:25<45:02:28,  9.03s/it]
 53%|█████▎    | 20009/37963 [49:14:33<43:10:56,  8.66s/it]
 53%|█████▎    | 20010/37963 [49:14:40<41:27:05,  8.31s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '2.374', 'learning_rate': '9.609e-06', 'epoch': '0.5271'}
+
 53%|█████▎    | 20010/37963 [49:14:40<41:27:05,  8.31s/it]
 53%|█████▎    | 20011/37963 [49:14:48<40:46:30,  8.18s/it]
 53%|█████▎    | 20012/37963 [49:14:56<40:15:14,  8.07s/it]
 53%|█████▎    | 20013/37963 [49:15:04<39:36:02,  7.94s/it]
 53%|█████▎    | 20014/37963 [49:15:11<39:35:15,  7.94s/it]
 53%|█████▎    | 20015/37963 [49:15:19<39:21:18,  7.89s/it]
 53%|█████▎    | 20016/37963 [49:15:27<38:31:52,  7.73s/it]
 53%|█████▎    | 20017/37963 [49:15:34<38:30:06,  7.72s/it]
 53%|█████▎    | 20018/37963 [49:15:42<38:16:13,  7.68s/it]
 53%|█████▎    | 20019/37963 [49:15:50<38:11:57,  7.66s/it]
 53%|█████▎    | 20020/37963 [49:15:57<38:20:40,  7.69s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '2.361', 'learning_rate': '9.601e-06', 'epoch': '0.5274'}
+
 53%|█████▎    | 20020/37963 [49:15:57<38:20:40,  7.69s/it]
 53%|█████▎    | 20021/37963 [49:16:05<38:49:42,  7.79s/it]
 53%|█████▎    | 20022/37963 [49:16:20<49:01:14,  9.84s/it]
 53%|█████▎    | 20023/37963 [49:16:28<46:11:52,  9.27s/it]
 53%|█████▎    | 20024/37963 [49:16:42<53:43:26, 10.78s/it]
 53%|█████▎    | 20025/37963 [49:16:58<60:57:40, 12.23s/it]
 53%|█████▎    | 20026/37963 [49:17:05<53:48:04, 10.80s/it]
 53%|█████▎    | 20027/37963 [49:17:21<60:36:34, 12.17s/it]
 53%|█████▎    | 20028/37963 [49:17:28<54:04:02, 10.85s/it]
 53%|█████▎    | 20029/37963 [49:17:36<49:27:41,  9.93s/it]
 53%|█████▎    | 20030/37963 [49:17:44<45:46:32,  9.19s/it]
                                                           
{'loss': '0.1344', 'grad_norm': '2.524', 'learning_rate': '9.592e-06', 'epoch': '0.5276'}
+
 53%|█████▎    | 20030/37963 [49:17:44<45:46:32,  9.19s/it]
 53%|█████▎    | 20031/37963 [49:17:51<43:39:14,  8.76s/it]
 53%|█████▎    | 20032/37963 [49:18:06<52:18:43, 10.50s/it]
 53%|█████▎    | 20033/37963 [49:18:14<48:05:53,  9.66s/it]
 53%|█████▎    | 20034/37963 [49:18:21<45:15:23,  9.09s/it]
 53%|█████▎    | 20035/37963 [49:18:36<53:42:21, 10.78s/it]
 53%|█████▎    | 20036/37963 [49:18:57<68:59:17, 13.85s/it]
 53%|█████▎    | 20037/37963 [49:19:05<60:07:35, 12.07s/it]
 53%|█████▎    | 20038/37963 [49:19:13<53:34:28, 10.76s/it]
 53%|█████▎    | 20039/37963 [49:19:21<49:11:06,  9.88s/it]
 53%|█████▎    | 20040/37963 [49:19:28<46:04:52,  9.26s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '5.775', 'learning_rate': '9.584e-06', 'epoch': '0.5279'}
+
 53%|█████▎    | 20040/37963 [49:19:28<46:04:52,  9.26s/it]
 53%|█████▎    | 20041/37963 [49:19:36<43:48:28,  8.80s/it]
 53%|█████▎    | 20042/37963 [49:19:44<41:46:30,  8.39s/it]
 53%|█████▎    | 20043/37963 [49:19:51<40:53:13,  8.21s/it]
 53%|█████▎    | 20044/37963 [49:19:59<40:15:43,  8.09s/it]
 53%|█████▎    | 20045/37963 [49:20:07<39:24:35,  7.92s/it]
 53%|█████▎    | 20046/37963 [49:20:14<39:10:32,  7.87s/it]
 53%|█████▎    | 20047/37963 [49:20:22<38:43:35,  7.78s/it]
 53%|█████▎    | 20048/37963 [49:20:30<38:37:04,  7.76s/it]
 53%|█████▎    | 20049/37963 [49:20:38<38:38:07,  7.76s/it]
 53%|█████▎    | 20050/37963 [49:20:45<38:17:20,  7.69s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '1.687', 'learning_rate': '9.575e-06', 'epoch': '0.5281'}
+
 53%|█████▎    | 20050/37963 [49:20:45<38:17:20,  7.69s/it]
 53%|█████▎    | 20051/37963 [49:20:53<38:19:51,  7.70s/it]
 53%|█████▎    | 20052/37963 [49:21:01<38:32:05,  7.75s/it]
 53%|█████▎    | 20053/37963 [49:21:08<38:17:27,  7.70s/it]
 53%|█████▎    | 20054/37963 [49:21:16<38:21:31,  7.71s/it]
 53%|█████▎    | 20055/37963 [49:21:24<38:25:59,  7.73s/it]
 53%|█████▎    | 20056/37963 [49:21:31<38:29:09,  7.74s/it]
 53%|█████▎    | 20057/37963 [49:21:39<38:34:40,  7.76s/it]
 53%|█████▎    | 20058/37963 [49:21:47<38:40:05,  7.77s/it]
 53%|█████▎    | 20059/37963 [49:21:55<38:25:57,  7.73s/it]
 53%|█████▎    | 20060/37963 [49:22:03<38:40:38,  7.78s/it]
                                                           
{'loss': '0.1528', 'grad_norm': '1.41', 'learning_rate': '9.567e-06', 'epoch': '0.5284'}
+
 53%|█████▎    | 20060/37963 [49:22:03<38:40:38,  7.78s/it]
 53%|█████▎    | 20061/37963 [49:22:10<38:50:46,  7.81s/it]
 53%|█████▎    | 20062/37963 [49:22:18<38:55:14,  7.83s/it]
 53%|█████▎    | 20063/37963 [49:22:26<38:48:25,  7.80s/it]
 53%|█████▎    | 20064/37963 [49:22:34<38:57:32,  7.84s/it]
 53%|█████▎    | 20065/37963 [49:22:42<38:39:53,  7.78s/it]
 53%|█████▎    | 20066/37963 [49:22:56<48:55:10,  9.84s/it]
 53%|█████▎    | 20067/37963 [49:23:04<45:53:29,  9.23s/it]
 53%|█████▎    | 20068/37963 [49:23:12<43:53:19,  8.83s/it]
 53%|█████▎    | 20069/37963 [49:23:20<42:19:15,  8.51s/it]
 53%|█████▎    | 20070/37963 [49:23:27<40:55:49,  8.24s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '1.243', 'learning_rate': '9.558e-06', 'epoch': '0.5287'}
+
 53%|█████▎    | 20070/37963 [49:23:27<40:55:49,  8.24s/it]
 53%|█████▎    | 20071/37963 [49:23:35<40:13:40,  8.09s/it]
 53%|█████▎    | 20072/37963 [49:23:50<50:53:39, 10.24s/it]
 53%|█████▎    | 20073/37963 [49:24:05<57:39:09, 11.60s/it]
 53%|█████▎    | 20074/37963 [49:24:13<51:37:07, 10.39s/it]
 53%|█████▎    | 20075/37963 [49:24:28<58:50:57, 11.84s/it]
 53%|█████▎    | 20076/37963 [49:24:36<52:45:34, 10.62s/it]
 53%|█████▎    | 20077/37963 [49:24:44<48:39:19,  9.79s/it]
 53%|█████▎    | 20078/37963 [49:24:51<45:28:13,  9.15s/it]
 53%|█████▎    | 20079/37963 [49:24:59<43:20:13,  8.72s/it]
 53%|█████▎    | 20080/37963 [49:25:07<41:44:59,  8.40s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '4.14', 'learning_rate': '9.55e-06', 'epoch': '0.5289'}
+
 53%|█████▎    | 20080/37963 [49:25:07<41:44:59,  8.40s/it]
 53%|█████▎    | 20081/37963 [49:25:14<40:17:06,  8.11s/it]
 53%|█████▎    | 20082/37963 [49:25:22<39:31:16,  7.96s/it]
 53%|█████▎    | 20083/37963 [49:25:29<39:18:36,  7.91s/it]
 53%|█████▎    | 20084/37963 [49:25:44<49:08:12,  9.89s/it]
 53%|█████▎    | 20085/37963 [49:25:52<45:56:12,  9.25s/it]
 53%|█████▎    | 20086/37963 [49:26:07<54:19:48, 10.94s/it]
 53%|█████▎    | 20087/37963 [49:26:14<49:29:55,  9.97s/it]
 53%|█████▎    | 20088/37963 [49:26:22<46:27:53,  9.36s/it]
 53%|█████▎    | 20089/37963 [49:26:37<54:43:49, 11.02s/it]
 53%|█████▎    | 20090/37963 [49:26:53<61:16:24, 12.34s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '1.978', 'learning_rate': '9.541e-06', 'epoch': '0.5292'}
+
 53%|█████▎    | 20090/37963 [49:26:53<61:16:24, 12.34s/it]
 53%|█████▎    | 20091/37963 [49:27:00<54:34:58, 10.99s/it]
 53%|█████▎    | 20092/37963 [49:27:08<50:00:01, 10.07s/it]
 53%|█████▎    | 20093/37963 [49:27:16<46:28:07,  9.36s/it]
 53%|█████▎    | 20094/37963 [49:27:24<44:04:16,  8.88s/it]
 53%|█████▎    | 20095/37963 [49:27:32<42:20:29,  8.53s/it]
 53%|█████▎    | 20096/37963 [49:27:39<41:13:16,  8.31s/it]
 53%|█████▎    | 20097/37963 [49:27:47<40:27:59,  8.15s/it]
 53%|█████▎    | 20098/37963 [49:27:55<39:35:15,  7.98s/it]
 53%|█████▎    | 20099/37963 [49:28:02<39:18:12,  7.92s/it]
 53%|█████▎    | 20100/37963 [49:28:10<38:57:59,  7.85s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '1.012', 'learning_rate': '9.533e-06', 'epoch': '0.5295'}
+
 53%|█████▎    | 20100/37963 [49:28:10<38:57:59,  7.85s/it]
 53%|█████▎    | 20101/37963 [49:28:18<38:46:38,  7.82s/it]
 53%|█████▎    | 20102/37963 [49:28:25<38:16:55,  7.72s/it]
 53%|█████▎    | 20103/37963 [49:28:33<38:16:27,  7.71s/it]
 53%|█████▎    | 20104/37963 [49:28:41<38:15:26,  7.71s/it]
 53%|█████▎    | 20105/37963 [49:28:49<38:26:55,  7.75s/it]
 53%|█████▎    | 20106/37963 [49:28:56<38:22:48,  7.74s/it]
 53%|█████▎    | 20107/37963 [49:29:04<38:24:57,  7.75s/it]
 53%|█████▎    | 20108/37963 [49:29:12<38:37:51,  7.79s/it]
 53%|█████▎    | 20109/37963 [49:29:20<38:47:27,  7.82s/it]
 53%|█████▎    | 20110/37963 [49:29:28<38:46:29,  7.82s/it]
                                                           
{'loss': '0.1376', 'grad_norm': '0.7986', 'learning_rate': '9.524e-06', 'epoch': '0.5297'}
+
 53%|█████▎    | 20110/37963 [49:29:28<38:46:29,  7.82s/it]
 53%|█████▎    | 20111/37963 [49:29:35<38:40:57,  7.80s/it]
 53%|█████▎    | 20112/37963 [49:29:43<38:40:44,  7.80s/it]
 53%|█████▎    | 20113/37963 [49:29:51<38:43:18,  7.81s/it]
 53%|█████▎    | 20114/37963 [49:30:06<48:39:15,  9.81s/it]
 53%|█████▎    | 20115/37963 [49:30:13<45:41:08,  9.21s/it]
 53%|█████▎    | 20116/37963 [49:30:21<43:29:58,  8.77s/it]
 53%|█████▎    | 20117/37963 [49:30:29<41:55:43,  8.46s/it]
 53%|█████▎    | 20118/37963 [49:30:37<40:46:49,  8.23s/it]
 53%|█████▎    | 20119/37963 [49:30:44<40:01:36,  8.08s/it]
 53%|█████▎    | 20120/37963 [49:30:59<49:28:28,  9.98s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '2.903', 'learning_rate': '9.516e-06', 'epoch': '0.53'}
+
 53%|█████▎    | 20120/37963 [49:30:59<49:28:28,  9.98s/it]
 53%|█████▎    | 20121/37963 [49:31:07<46:26:02,  9.37s/it]
 53%|█████▎    | 20122/37963 [49:31:14<43:46:48,  8.83s/it]
 53%|█████▎    | 20123/37963 [49:31:22<42:17:32,  8.53s/it]
 53%|█████▎    | 20124/37963 [49:31:30<41:04:41,  8.29s/it]
 53%|█████▎    | 20125/37963 [49:31:38<40:16:29,  8.13s/it]
 53%|█████▎    | 20126/37963 [49:31:45<39:40:11,  8.01s/it]
 53%|█████▎    | 20127/37963 [49:32:00<49:03:56,  9.90s/it]
 53%|█████▎    | 20128/37963 [49:32:15<56:40:03, 11.44s/it]
 53%|█████▎    | 20129/37963 [49:32:22<51:17:23, 10.35s/it]
 53%|█████▎    | 20130/37963 [49:32:30<47:24:12,  9.57s/it]
                                                           
{'loss': '0.1739', 'grad_norm': '2.554', 'learning_rate': '9.507e-06', 'epoch': '0.5303'}
+
 53%|█████▎    | 20130/37963 [49:32:30<47:24:12,  9.57s/it]
 53%|█████▎    | 20131/37963 [49:32:38<44:45:34,  9.04s/it]
 53%|█████▎    | 20132/37963 [49:32:52<52:37:35, 10.63s/it]
 53%|█████▎    | 20133/37963 [49:33:00<48:40:08,  9.83s/it]
 53%|█████▎    | 20134/37963 [49:33:08<45:36:43,  9.21s/it]
 53%|█████▎    | 20135/37963 [49:33:16<43:31:37,  8.79s/it]
 53%|█████▎    | 20136/37963 [49:33:23<41:48:33,  8.44s/it]
 53%|█████▎    | 20137/37963 [49:33:31<41:00:01,  8.28s/it]
 53%|█████▎    | 20138/37963 [49:33:47<51:16:21, 10.36s/it]
 53%|█████▎    | 20139/37963 [49:34:02<58:33:53, 11.83s/it]
 53%|█████▎    | 20140/37963 [49:34:09<52:22:48, 10.58s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '1.096', 'learning_rate': '9.499e-06', 'epoch': '0.5305'}
+
 53%|█████▎    | 20140/37963 [49:34:09<52:22:48, 10.58s/it]
 53%|█████▎    | 20141/37963 [49:34:17<48:11:44,  9.74s/it]
 53%|█████▎    | 20142/37963 [49:34:25<45:02:23,  9.10s/it]
 53%|█████▎    | 20143/37963 [49:34:33<43:05:23,  8.71s/it]
 53%|█████▎    | 20144/37963 [49:34:41<42:01:17,  8.49s/it]
 53%|█████▎    | 20145/37963 [49:34:48<40:56:24,  8.27s/it]
 53%|█████▎    | 20146/37963 [49:34:56<40:06:49,  8.11s/it]
 53%|█████▎    | 20147/37963 [49:35:04<39:24:41,  7.96s/it]
 53%|█████▎    | 20148/37963 [49:35:11<38:32:05,  7.79s/it]
 53%|█████▎    | 20149/37963 [49:35:19<38:25:39,  7.77s/it]
 53%|█████▎    | 20150/37963 [49:35:27<38:26:48,  7.77s/it]
                                                           
{'loss': '0.1425', 'grad_norm': '1.075', 'learning_rate': '9.49e-06', 'epoch': '0.5308'}
+
 53%|█████▎    | 20150/37963 [49:35:27<38:26:48,  7.77s/it]
 53%|█████▎    | 20151/37963 [49:35:34<37:53:27,  7.66s/it]
 53%|█████▎    | 20152/37963 [49:35:42<38:00:10,  7.68s/it]
 53%|█████▎    | 20153/37963 [49:35:50<38:11:54,  7.72s/it]
 53%|█████▎    | 20154/37963 [49:35:57<38:15:51,  7.73s/it]
 53%|█████▎    | 20155/37963 [49:36:05<38:08:43,  7.71s/it]
 53%|█████▎    | 20156/37963 [49:36:12<37:46:43,  7.64s/it]
 53%|█████▎    | 20157/37963 [49:36:20<37:49:35,  7.65s/it]
 53%|█████▎    | 20158/37963 [49:36:28<37:39:07,  7.61s/it]
 53%|█████▎    | 20159/37963 [49:36:35<37:32:22,  7.59s/it]
 53%|█████▎    | 20160/37963 [49:36:50<48:09:07,  9.74s/it]
                                                           
{'loss': '0.1483', 'grad_norm': '1.403', 'learning_rate': '9.482e-06', 'epoch': '0.531'}
+
 53%|█████▎    | 20160/37963 [49:36:50<48:09:07,  9.74s/it]
 53%|█████▎    | 20161/37963 [49:36:58<45:35:53,  9.22s/it]
 53%|█████▎    | 20162/37963 [49:37:06<43:24:26,  8.78s/it]
 53%|█████▎    | 20163/37963 [49:37:13<41:43:59,  8.44s/it]
 53%|█████▎    | 20164/37963 [49:37:28<51:09:40, 10.35s/it]
 53%|█████▎    | 20165/37963 [49:37:36<47:25:35,  9.59s/it]
 53%|█████▎    | 20166/37963 [49:37:44<44:37:52,  9.03s/it]
 53%|█████▎    | 20167/37963 [49:37:51<42:41:59,  8.64s/it]
 53%|█████▎    | 20168/37963 [49:37:59<41:17:32,  8.35s/it]
 53%|█████▎    | 20169/37963 [49:38:14<50:57:30, 10.31s/it]
 53%|█████▎    | 20170/37963 [49:38:22<47:25:53,  9.60s/it]
                                                           
{'loss': '0.1444', 'grad_norm': '2.281', 'learning_rate': '9.473e-06', 'epoch': '0.5313'}
+
 53%|█████▎    | 20170/37963 [49:38:22<47:25:53,  9.60s/it]
 53%|█████▎    | 20171/37963 [49:38:30<44:42:09,  9.05s/it]
 53%|█████▎    | 20172/37963 [49:38:38<42:56:19,  8.69s/it]
 53%|█████▎    | 20173/37963 [49:38:52<51:09:07, 10.35s/it]
 53%|█████▎    | 20174/37963 [49:38:59<47:09:09,  9.54s/it]
 53%|█████▎    | 20175/37963 [49:39:07<44:29:12,  9.00s/it]
 53%|█████▎    | 20176/37963 [49:39:15<42:38:36,  8.63s/it]
 53%|█████▎    | 20177/37963 [49:39:30<51:43:11, 10.47s/it]
 53%|█████▎    | 20178/37963 [49:39:37<47:43:24,  9.66s/it]
 53%|█████▎    | 20179/37963 [49:39:45<45:07:42,  9.14s/it]
 53%|█████▎    | 20180/37963 [49:40:00<52:35:07, 10.65s/it]
                                                           
{'loss': '0.1385', 'grad_norm': '1.794', 'learning_rate': '9.464e-06', 'epoch': '0.5316'}
+
 53%|█████▎    | 20180/37963 [49:40:00<52:35:07, 10.65s/it]
 53%|█████▎    | 20181/37963 [49:40:14<58:54:34, 11.93s/it]
 53%|█████▎    | 20182/37963 [49:40:22<52:52:05, 10.70s/it]
 53%|█████▎    | 20183/37963 [49:40:30<48:09:48,  9.75s/it]
 53%|█████▎    | 20184/37963 [49:40:38<45:07:48,  9.14s/it]
 53%|█████▎    | 20185/37963 [49:40:45<43:03:51,  8.72s/it]
 53%|█████▎    | 20186/37963 [49:40:53<41:38:55,  8.43s/it]
 53%|█████▎    | 20187/37963 [49:41:01<40:33:09,  8.21s/it]
 53%|█████▎    | 20188/37963 [49:41:09<39:59:47,  8.10s/it]
 53%|█████▎    | 20189/37963 [49:41:16<39:28:14,  7.99s/it]
 53%|█████▎    | 20190/37963 [49:41:24<39:02:45,  7.91s/it]
                                                           
{'loss': '0.1443', 'grad_norm': '2.44', 'learning_rate': '9.456e-06', 'epoch': '0.5318'}
+
 53%|█████▎    | 20190/37963 [49:41:24<39:02:45,  7.91s/it]
 53%|█████▎    | 20191/37963 [49:41:39<48:53:53,  9.91s/it]
 53%|█████▎    | 20192/37963 [49:41:46<45:48:58,  9.28s/it]
 53%|█████▎    | 20193/37963 [49:41:54<43:11:44,  8.75s/it]
 53%|█████▎    | 20194/37963 [49:42:01<40:59:40,  8.31s/it]
 53%|█████▎    | 20195/37963 [49:42:09<40:01:41,  8.11s/it]
 53%|█████▎    | 20196/37963 [49:42:16<39:12:26,  7.94s/it]
 53%|█████▎    | 20197/37963 [49:42:24<38:30:45,  7.80s/it]
 53%|█████▎    | 20198/37963 [49:42:32<38:26:31,  7.79s/it]
 53%|█████▎    | 20199/37963 [49:42:39<38:06:27,  7.72s/it]
 53%|█████▎    | 20200/37963 [49:42:47<37:58:47,  7.70s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '3.571', 'learning_rate': '9.447e-06', 'epoch': '0.5321'}
+
 53%|█████▎    | 20200/37963 [49:42:47<37:58:47,  7.70s/it]
 53%|█████▎    | 20201/37963 [49:42:55<38:02:00,  7.71s/it]
 53%|█████▎    | 20202/37963 [49:43:02<38:05:47,  7.72s/it]
 53%|█████▎    | 20203/37963 [49:43:10<38:02:39,  7.71s/it]
 53%|█████▎    | 20204/37963 [49:43:18<37:52:01,  7.68s/it]
 53%|█████▎    | 20205/37963 [49:43:25<38:07:34,  7.73s/it]
 53%|█████▎    | 20206/37963 [49:43:33<37:57:35,  7.70s/it]
 53%|█████▎    | 20207/37963 [49:43:41<38:04:42,  7.72s/it]
 53%|█████▎    | 20208/37963 [49:43:55<48:07:01,  9.76s/it]
 53%|█████▎    | 20209/37963 [49:44:03<45:34:07,  9.24s/it]
 53%|█████▎    | 20210/37963 [49:44:11<43:19:54,  8.79s/it]
                                                           
{'loss': '0.1359', 'grad_norm': '1.479', 'learning_rate': '9.439e-06', 'epoch': '0.5324'}
+
 53%|█████▎    | 20210/37963 [49:44:11<43:19:54,  8.79s/it]
 53%|█████▎    | 20211/37963 [49:44:19<41:13:12,  8.36s/it]
 53%|█████▎    | 20212/37963 [49:44:26<40:12:04,  8.15s/it]
 53%|█████▎    | 20213/37963 [49:44:34<39:32:33,  8.02s/it]
 53%|█████▎    | 20214/37963 [49:44:48<48:56:56,  9.93s/it]
 53%|█████▎    | 20215/37963 [49:44:56<45:56:07,  9.32s/it]
 53%|█████▎    | 20216/37963 [49:45:04<43:36:58,  8.85s/it]
 53%|█████▎    | 20217/37963 [49:45:11<41:31:58,  8.43s/it]
 53%|█████▎    | 20218/37963 [49:45:19<40:11:57,  8.16s/it]
 53%|█████▎    | 20219/37963 [49:45:26<39:06:52,  7.94s/it]
 53%|█████▎    | 20220/37963 [49:45:41<48:24:18,  9.82s/it]
                                                           
{'loss': '0.1439', 'grad_norm': '1.774', 'learning_rate': '9.43e-06', 'epoch': '0.5326'}
+
 53%|█████▎    | 20220/37963 [49:45:41<48:24:18,  9.82s/it]
 53%|█████▎    | 20221/37963 [49:45:49<45:44:18,  9.28s/it]
 53%|█████▎    | 20222/37963 [49:45:56<43:09:54,  8.76s/it]
 53%|█████▎    | 20223/37963 [49:46:11<52:46:49, 10.71s/it]
 53%|█████▎    | 20224/37963 [49:46:26<58:27:44, 11.86s/it]
 53%|█████▎    | 20225/37963 [49:46:34<52:32:11, 10.66s/it]
 53%|█████▎    | 20226/37963 [49:46:49<58:57:14, 11.97s/it]
 53%|█████▎    | 20227/37963 [49:46:57<53:07:28, 10.78s/it]
 53%|█████▎    | 20228/37963 [49:47:11<58:53:08, 11.95s/it]
 53%|█████▎    | 20229/37963 [49:47:19<53:03:54, 10.77s/it]
 53%|█████▎    | 20230/37963 [49:47:27<48:40:14,  9.88s/it]
                                                           
{'loss': '0.148', 'grad_norm': '1.711', 'learning_rate': '9.422e-06', 'epoch': '0.5329'}
+
 53%|█████▎    | 20230/37963 [49:47:27<48:40:14,  9.88s/it]
 53%|█████▎    | 20231/37963 [49:47:35<45:24:43,  9.22s/it]
 53%|█████▎    | 20232/37963 [49:47:43<43:03:24,  8.74s/it]
 53%|█████▎    | 20233/37963 [49:47:50<41:40:57,  8.46s/it]
 53%|█████▎    | 20234/37963 [49:47:58<40:13:44,  8.17s/it]
 53%|█████▎    | 20235/37963 [49:48:06<39:33:50,  8.03s/it]
 53%|█████▎    | 20236/37963 [49:48:21<50:04:00, 10.17s/it]
 53%|█████▎    | 20237/37963 [49:48:29<46:43:49,  9.49s/it]
 53%|█████▎    | 20238/37963 [49:48:36<44:11:06,  8.97s/it]
 53%|█████▎    | 20239/37963 [49:48:44<42:26:51,  8.62s/it]
 53%|█████▎    | 20240/37963 [49:48:52<41:16:46,  8.38s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '2.3', 'learning_rate': '9.413e-06', 'epoch': '0.5332'}
+
 53%|█████▎    | 20240/37963 [49:48:52<41:16:46,  8.38s/it]
 53%|█████▎    | 20241/37963 [49:49:00<39:55:01,  8.11s/it]
 53%|█████▎    | 20242/37963 [49:49:07<39:24:48,  8.01s/it]
 53%|█████▎    | 20243/37963 [49:49:15<38:30:54,  7.82s/it]
 53%|█████▎    | 20244/37963 [49:49:22<38:25:02,  7.81s/it]
 53%|█████▎    | 20245/37963 [49:49:30<37:55:33,  7.71s/it]
 53%|█████▎    | 20246/37963 [49:49:38<37:53:55,  7.70s/it]
 53%|█████▎    | 20247/37963 [49:49:46<38:12:33,  7.76s/it]
 53%|█████▎    | 20248/37963 [49:49:53<37:36:22,  7.64s/it]
 53%|█████▎    | 20249/37963 [49:50:01<37:39:27,  7.65s/it]
 53%|█████▎    | 20250/37963 [49:50:08<37:43:43,  7.67s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '1.108', 'learning_rate': '9.405e-06', 'epoch': '0.5334'}
+
 53%|█████▎    | 20250/37963 [49:50:08<37:43:43,  7.67s/it]
 53%|█████▎    | 20251/37963 [49:50:16<37:41:36,  7.66s/it]
 53%|█████▎    | 20252/37963 [49:50:31<47:58:26,  9.75s/it]
 53%|█████▎    | 20253/37963 [49:50:38<44:56:32,  9.14s/it]
 53%|█████▎    | 20254/37963 [49:50:46<42:53:23,  8.72s/it]
 53%|█████▎    | 20255/37963 [49:50:54<41:44:58,  8.49s/it]
 53%|█████▎    | 20256/37963 [49:51:02<40:37:27,  8.26s/it]
 53%|█████▎    | 20257/37963 [49:51:10<39:59:27,  8.13s/it]
 53%|█████▎    | 20258/37963 [49:51:17<39:09:29,  7.96s/it]
 53%|█████▎    | 20259/37963 [49:51:25<38:56:47,  7.92s/it]
 53%|█████▎    | 20260/37963 [49:51:33<38:40:11,  7.86s/it]
                                                           
{'loss': '0.162', 'grad_norm': '2.418', 'learning_rate': '9.396e-06', 'epoch': '0.5337'}
+
 53%|█████▎    | 20260/37963 [49:51:33<38:40:11,  7.86s/it]
 53%|█████▎    | 20261/37963 [49:51:40<38:31:12,  7.83s/it]
 53%|█████▎    | 20262/37963 [49:51:55<48:11:43,  9.80s/it]
 53%|█████▎    | 20263/37963 [49:52:03<45:35:21,  9.27s/it]
 53%|█████▎    | 20264/37963 [49:52:11<43:18:39,  8.81s/it]
 53%|█████▎    | 20265/37963 [49:52:18<41:23:35,  8.42s/it]
 53%|█████▎    | 20266/37963 [49:52:26<40:34:47,  8.25s/it]
 53%|█████▎    | 20267/37963 [49:52:34<39:54:24,  8.12s/it]
 53%|█████▎    | 20268/37963 [49:52:55<59:33:43, 12.12s/it]
 53%|█████▎    | 20269/37963 [49:53:03<53:04:48, 10.80s/it]
 53%|█████▎    | 20270/37963 [49:53:11<48:30:14,  9.87s/it]
                                                           
{'loss': '0.1385', 'grad_norm': '4.314', 'learning_rate': '9.388e-06', 'epoch': '0.5339'}
+
 53%|█████▎    | 20270/37963 [49:53:11<48:30:14,  9.87s/it]
 53%|█████▎    | 20271/37963 [49:53:25<55:42:32, 11.34s/it]
 53%|█████▎    | 20272/37963 [49:53:33<50:18:33, 10.24s/it]
 53%|█████▎    | 20273/37963 [49:53:41<46:25:47,  9.45s/it]
 53%|█████▎    | 20274/37963 [49:53:48<43:40:29,  8.89s/it]
 53%|█████▎    | 20275/37963 [49:54:03<52:32:31, 10.69s/it]
 53%|█████▎    | 20276/37963 [49:54:11<48:20:27,  9.84s/it]
 53%|█████▎    | 20277/37963 [49:54:19<45:05:58,  9.18s/it]
 53%|█████▎    | 20278/37963 [49:54:26<42:56:44,  8.74s/it]
 53%|█████▎    | 20279/37963 [49:54:34<41:03:10,  8.36s/it]
 53%|█████▎    | 20280/37963 [49:54:42<40:09:51,  8.18s/it]
                                                           
{'loss': '0.1425', 'grad_norm': '5.126', 'learning_rate': '9.379e-06', 'epoch': '0.5342'}
+
 53%|█████▎    | 20280/37963 [49:54:42<40:09:51,  8.18s/it]
 53%|█████▎    | 20281/37963 [49:54:49<39:22:14,  8.02s/it]
 53%|█████▎    | 20282/37963 [49:55:04<48:50:24,  9.94s/it]
 53%|█████▎    | 20283/37963 [49:55:12<45:54:34,  9.35s/it]
 53%|█████▎    | 20284/37963 [49:55:19<43:27:43,  8.85s/it]
 53%|█████▎    | 20285/37963 [49:55:27<41:41:23,  8.49s/it]
 53%|█████▎    | 20286/37963 [49:55:35<40:42:32,  8.29s/it]
 53%|█████▎    | 20287/37963 [49:55:42<39:51:12,  8.12s/it]
 53%|█████▎    | 20288/37963 [49:55:50<39:05:27,  7.96s/it]
 53%|█████▎    | 20289/37963 [49:56:05<49:30:31, 10.08s/it]
 53%|█████▎    | 20290/37963 [49:56:13<46:01:28,  9.38s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '1.837', 'learning_rate': '9.371e-06', 'epoch': '0.5345'}
+
 53%|█████▎    | 20290/37963 [49:56:13<46:01:28,  9.38s/it]
 53%|█████▎    | 20291/37963 [49:56:21<43:40:12,  8.90s/it]
 53%|█████▎    | 20292/37963 [49:56:28<41:40:27,  8.49s/it]
 53%|█████▎    | 20293/37963 [49:56:36<40:31:44,  8.26s/it]
 53%|█████▎    | 20294/37963 [49:56:43<39:33:47,  8.06s/it]
 53%|█████▎    | 20295/37963 [49:56:58<48:23:19,  9.86s/it]
 53%|█████▎    | 20296/37963 [49:57:05<45:02:55,  9.18s/it]
 53%|█████▎    | 20297/37963 [49:57:13<42:49:14,  8.73s/it]
 53%|█████▎    | 20298/37963 [49:57:21<41:41:26,  8.50s/it]
 53%|█████▎    | 20299/37963 [49:57:29<40:50:11,  8.32s/it]
 53%|█████▎    | 20300/37963 [49:57:36<39:55:33,  8.14s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '1.065', 'learning_rate': '9.362e-06', 'epoch': '0.5347'}
+
 53%|█████▎    | 20300/37963 [49:57:36<39:55:33,  8.14s/it]
 53%|█████▎    | 20301/37963 [49:57:44<39:24:25,  8.03s/it]
 53%|█████▎    | 20302/37963 [49:57:52<39:14:12,  8.00s/it]
 53%|█████▎    | 20303/37963 [49:58:00<39:02:35,  7.96s/it]
 53%|█████▎    | 20304/37963 [49:58:08<38:55:09,  7.93s/it]
 53%|█████▎    | 20305/37963 [49:58:16<38:37:56,  7.88s/it]
 53%|█████▎    | 20306/37963 [49:58:23<38:20:41,  7.82s/it]
 53%|█████▎    | 20307/37963 [49:58:31<38:03:49,  7.76s/it]
 53%|█████▎    | 20308/37963 [49:58:45<47:42:14,  9.73s/it]
 53%|█████▎    | 20309/37963 [49:58:53<44:50:33,  9.14s/it]
 53%|█████▎    | 20310/37963 [49:59:01<42:28:58,  8.66s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '2.09', 'learning_rate': '9.354e-06', 'epoch': '0.535'}
+
 53%|█████▎    | 20310/37963 [49:59:01<42:28:58,  8.66s/it]
 54%|█████▎    | 20311/37963 [49:59:08<40:50:42,  8.33s/it]
 54%|█████▎    | 20312/37963 [49:59:16<39:39:05,  8.09s/it]
 54%|█████▎    | 20313/37963 [49:59:23<38:51:24,  7.93s/it]
 54%|█████▎    | 20314/37963 [49:59:31<38:33:42,  7.87s/it]
 54%|█████▎    | 20315/37963 [49:59:46<48:46:02,  9.95s/it]
 54%|█████▎    | 20316/37963 [49:59:53<45:20:30,  9.25s/it]
 54%|█████▎    | 20317/37963 [50:00:01<42:34:00,  8.68s/it]
 54%|█████▎    | 20318/37963 [50:00:15<51:13:41, 10.45s/it]
 54%|█████▎    | 20319/37963 [50:00:23<47:12:45,  9.63s/it]
 54%|█████▎    | 20320/37963 [50:00:38<54:34:23, 11.14s/it]
                                                           
{'loss': '0.1412', 'grad_norm': '1.877', 'learning_rate': '9.345e-06', 'epoch': '0.5353'}
+
 54%|█████▎    | 20320/37963 [50:00:38<54:34:23, 11.14s/it]
 54%|█████▎    | 20321/37963 [50:00:46<49:58:04, 10.20s/it]
 54%|█████▎    | 20322/37963 [50:01:01<56:57:37, 11.62s/it]
 54%|█████▎    | 20323/37963 [50:01:08<51:19:21, 10.47s/it]
 54%|█████▎    | 20324/37963 [50:01:16<47:08:54,  9.62s/it]
 54%|█████▎    | 20325/37963 [50:01:24<44:08:51,  9.01s/it]
 54%|█████▎    | 20326/37963 [50:01:38<52:10:56, 10.65s/it]
 54%|█████▎    | 20327/37963 [50:01:46<47:42:40,  9.74s/it]
 54%|█████▎    | 20328/37963 [50:01:53<44:47:40,  9.14s/it]
 54%|█████▎    | 20329/37963 [50:02:01<42:49:24,  8.74s/it]
 54%|█████▎    | 20330/37963 [50:02:09<41:38:18,  8.50s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '1.785', 'learning_rate': '9.337e-06', 'epoch': '0.5355'}
+
 54%|█████▎    | 20330/37963 [50:02:09<41:38:18,  8.50s/it]
 54%|█████▎    | 20331/37963 [50:02:17<40:26:42,  8.26s/it]
 54%|█████▎    | 20332/37963 [50:02:25<39:40:33,  8.10s/it]
 54%|█████▎    | 20333/37963 [50:02:32<38:48:17,  7.92s/it]
 54%|█████▎    | 20334/37963 [50:02:40<38:33:31,  7.87s/it]
 54%|█████▎    | 20335/37963 [50:02:47<37:59:30,  7.76s/it]
 54%|█████▎    | 20336/37963 [50:02:55<37:59:26,  7.76s/it]
 54%|█████▎    | 20337/37963 [50:03:10<48:13:09,  9.85s/it]
 54%|█████▎    | 20338/37963 [50:03:17<44:44:08,  9.14s/it]
 54%|█████▎    | 20339/37963 [50:03:32<52:18:08, 10.68s/it]
 54%|█████▎    | 20340/37963 [50:03:40<48:19:42,  9.87s/it]
                                                           
{'loss': '0.139', 'grad_norm': '0.8245', 'learning_rate': '9.328e-06', 'epoch': '0.5358'}
+
 54%|█████▎    | 20340/37963 [50:03:40<48:19:42,  9.87s/it]
 54%|█████▎    | 20341/37963 [50:03:47<45:03:30,  9.21s/it]
 54%|█████▎    | 20342/37963 [50:03:55<42:43:05,  8.73s/it]
 54%|█████▎    | 20343/37963 [50:04:03<41:14:30,  8.43s/it]
 54%|█████▎    | 20344/37963 [50:04:10<40:02:09,  8.18s/it]
 54%|█████▎    | 20345/37963 [50:04:18<39:30:11,  8.07s/it]
 54%|█████▎    | 20346/37963 [50:04:26<39:17:08,  8.03s/it]
 54%|█████▎    | 20347/37963 [50:04:34<38:48:08,  7.93s/it]
 54%|█████▎    | 20348/37963 [50:04:41<38:39:24,  7.90s/it]
 54%|█████▎    | 20349/37963 [50:04:49<38:35:19,  7.89s/it]
 54%|█████▎    | 20350/37963 [50:04:57<38:13:40,  7.81s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '0.862', 'learning_rate': '9.32e-06', 'epoch': '0.5361'}
+
 54%|█████▎    | 20350/37963 [50:04:57<38:13:40,  7.81s/it]
 54%|█████▎    | 20351/37963 [50:05:05<37:53:11,  7.74s/it]
 54%|█████▎    | 20352/37963 [50:05:12<37:29:40,  7.66s/it]
 54%|█████▎    | 20353/37963 [50:05:20<37:38:57,  7.70s/it]
 54%|█████▎    | 20354/37963 [50:05:28<37:57:09,  7.76s/it]
 54%|█████▎    | 20355/37963 [50:05:35<37:52:23,  7.74s/it]
 54%|█████▎    | 20356/37963 [50:05:43<38:02:57,  7.78s/it]
 54%|█████▎    | 20357/37963 [50:05:51<37:58:44,  7.77s/it]
 54%|█████▎    | 20358/37963 [50:06:06<48:37:56,  9.94s/it]
 54%|█████▎    | 20359/37963 [50:06:14<45:36:05,  9.33s/it]
 54%|█████▎    | 20360/37963 [50:06:28<53:01:06, 10.84s/it]
                                                           
{'loss': '0.1486', 'grad_norm': '5.289', 'learning_rate': '9.311e-06', 'epoch': '0.5363'}
+
 54%|█████▎    | 20360/37963 [50:06:28<53:01:06, 10.84s/it]
 54%|█████▎    | 20361/37963 [50:06:36<48:34:10,  9.93s/it]
 54%|█████▎    | 20362/37963 [50:06:50<54:58:13, 11.24s/it]
 54%|█████▎    | 20363/37963 [50:06:58<49:55:51, 10.21s/it]
 54%|█████▎    | 20364/37963 [50:07:06<46:26:43,  9.50s/it]
 54%|█████▎    | 20365/37963 [50:07:20<53:24:34, 10.93s/it]
 54%|█████▎    | 20366/37963 [50:07:35<58:47:40, 12.03s/it]
 54%|█████▎    | 20367/37963 [50:07:43<53:00:12, 10.84s/it]
 54%|█████▎    | 20368/37963 [50:07:51<48:30:07,  9.92s/it]
 54%|█████▎    | 20369/37963 [50:07:58<45:06:55,  9.23s/it]
 54%|█████▎    | 20370/37963 [50:08:13<53:33:43, 10.96s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '1.82', 'learning_rate': '9.303e-06', 'epoch': '0.5366'}
+
 54%|█████▎    | 20370/37963 [50:08:13<53:33:43, 10.96s/it]
 54%|█████▎    | 20371/37963 [50:08:21<49:26:12, 10.12s/it]
 54%|█████▎    | 20372/37963 [50:08:29<46:12:22,  9.46s/it]
 54%|█████▎    | 20373/37963 [50:08:37<43:54:53,  8.99s/it]
 54%|█████▎    | 20374/37963 [50:08:45<42:00:29,  8.60s/it]
 54%|█████▎    | 20375/37963 [50:08:53<40:55:53,  8.38s/it]
 54%|█████▎    | 20376/37963 [50:09:01<39:56:22,  8.18s/it]
 54%|█████▎    | 20377/37963 [50:09:08<39:26:17,  8.07s/it]
 54%|█████▎    | 20378/37963 [50:09:16<39:02:12,  7.99s/it]
 54%|█████▎    | 20379/37963 [50:09:24<38:43:27,  7.93s/it]
 54%|█████▎    | 20380/37963 [50:09:32<38:31:44,  7.89s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '1.673', 'learning_rate': '9.294e-06', 'epoch': '0.5368'}
+
 54%|█████▎    | 20380/37963 [50:09:32<38:31:44,  7.89s/it]
 54%|█████▎    | 20381/37963 [50:09:39<37:52:40,  7.76s/it]
 54%|█████▎    | 20382/37963 [50:09:47<37:18:54,  7.64s/it]
 54%|█████▎    | 20383/37963 [50:09:54<37:36:54,  7.70s/it]
 54%|█████▎    | 20384/37963 [50:10:02<37:55:47,  7.77s/it]
 54%|█████▎    | 20385/37963 [50:10:10<37:45:47,  7.73s/it]
 54%|█████▎    | 20386/37963 [50:10:18<37:55:00,  7.77s/it]
 54%|█████▎    | 20387/37963 [50:10:26<37:55:38,  7.77s/it]
 54%|█████▎    | 20388/37963 [50:10:41<48:46:03,  9.99s/it]
 54%|█████▎    | 20389/37963 [50:10:49<45:42:51,  9.36s/it]
 54%|█████▎    | 20390/37963 [50:10:56<43:20:32,  8.88s/it]
                                                           
{'loss': '0.1333', 'grad_norm': '1.467', 'learning_rate': '9.286e-06', 'epoch': '0.5371'}
+
 54%|█████▎    | 20390/37963 [50:10:56<43:20:32,  8.88s/it]
 54%|█████▎    | 20391/37963 [50:11:04<41:52:49,  8.58s/it]
 54%|█████▎    | 20392/37963 [50:11:19<50:15:23, 10.30s/it]
 54%|█████▎    | 20393/37963 [50:11:27<46:51:56,  9.60s/it]
 54%|█████▎    | 20394/37963 [50:11:34<44:06:40,  9.04s/it]
 54%|█████▎    | 20395/37963 [50:11:42<42:18:39,  8.67s/it]
 54%|█████▎    | 20396/37963 [50:11:50<40:58:59,  8.40s/it]
 54%|█████▎    | 20397/37963 [50:11:57<39:36:55,  8.12s/it]
 54%|█████▎    | 20398/37963 [50:12:05<39:05:37,  8.01s/it]
 54%|█████▎    | 20399/37963 [50:12:13<38:36:07,  7.91s/it]
 54%|█████▎    | 20400/37963 [50:12:21<38:22:59,  7.87s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '1.722', 'learning_rate': '9.277e-06', 'epoch': '0.5374'}
+
 54%|█████▎    | 20400/37963 [50:12:21<38:22:59,  7.87s/it]
 54%|█████▎    | 20401/37963 [50:12:28<38:08:35,  7.82s/it]
 54%|█████▎    | 20402/37963 [50:12:36<37:47:30,  7.75s/it]
 54%|█████▎    | 20403/37963 [50:12:44<37:47:17,  7.75s/it]
 54%|█████▎    | 20404/37963 [50:12:51<37:48:25,  7.75s/it]
 54%|█████▎    | 20405/37963 [50:13:06<48:10:01,  9.88s/it]
 54%|█████▍    | 20406/37963 [50:13:14<44:58:39,  9.22s/it]
 54%|█████▍    | 20407/37963 [50:13:28<52:23:56, 10.74s/it]
 54%|█████▍    | 20408/37963 [50:13:43<58:22:34, 11.97s/it]
 54%|█████▍    | 20409/37963 [50:13:51<52:27:21, 10.76s/it]
 54%|█████▍    | 20410/37963 [50:13:58<47:39:13,  9.77s/it]
                                                           
{'loss': '0.14', 'grad_norm': '0.7416', 'learning_rate': '9.269e-06', 'epoch': '0.5376'}
+
 54%|█████▍    | 20410/37963 [50:13:58<47:39:13,  9.77s/it]
 54%|█████▍    | 20411/37963 [50:14:06<44:37:07,  9.15s/it]
 54%|█████▍    | 20412/37963 [50:14:14<43:03:39,  8.83s/it]
 54%|█████▍    | 20413/37963 [50:14:22<41:33:07,  8.52s/it]
 54%|█████▍    | 20414/37963 [50:14:37<50:38:22, 10.39s/it]
 54%|█████▍    | 20415/37963 [50:14:44<46:31:39,  9.55s/it]
 54%|█████▍    | 20416/37963 [50:14:59<54:08:59, 11.11s/it]
 54%|█████▍    | 20417/37963 [50:15:07<49:08:36, 10.08s/it]
 54%|█████▍    | 20418/37963 [50:15:15<45:42:43,  9.38s/it]
 54%|█████▍    | 20419/37963 [50:15:29<53:32:00, 10.98s/it]
 54%|█████▍    | 20420/37963 [50:15:37<48:25:11,  9.94s/it]
                                                           
{'loss': '0.145', 'grad_norm': '1.761', 'learning_rate': '9.26e-06', 'epoch': '0.5379'}
+
 54%|█████▍    | 20420/37963 [50:15:37<48:25:11,  9.94s/it]
 54%|█████▍    | 20421/37963 [50:15:45<45:14:25,  9.28s/it]
 54%|█████▍    | 20422/37963 [50:15:52<42:54:59,  8.81s/it]
 54%|█████▍    | 20423/37963 [50:16:00<41:31:38,  8.52s/it]
 54%|█████▍    | 20424/37963 [50:16:08<40:23:54,  8.29s/it]
 54%|█████▍    | 20425/37963 [50:16:16<39:32:24,  8.12s/it]
 54%|█████▍    | 20426/37963 [50:16:23<38:57:39,  8.00s/it]
 54%|█████▍    | 20427/37963 [50:16:31<38:45:34,  7.96s/it]
 54%|█████▍    | 20428/37963 [50:16:39<38:23:25,  7.88s/it]
 54%|█████▍    | 20429/37963 [50:16:46<38:04:52,  7.82s/it]
 54%|█████▍    | 20430/37963 [50:16:54<37:51:19,  7.77s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '2.339', 'learning_rate': '9.252e-06', 'epoch': '0.5382'}
+
 54%|█████▍    | 20430/37963 [50:16:54<37:51:19,  7.77s/it]
 54%|█████▍    | 20431/37963 [50:17:02<38:04:38,  7.82s/it]
 54%|█████▍    | 20432/37963 [50:17:10<38:00:59,  7.81s/it]
 54%|█████▍    | 20433/37963 [50:17:18<38:06:51,  7.83s/it]
 54%|█████▍    | 20434/37963 [50:17:25<37:51:08,  7.77s/it]
 54%|█████▍    | 20435/37963 [50:17:33<37:01:26,  7.60s/it]
 54%|█████▍    | 20436/37963 [50:17:40<37:22:06,  7.68s/it]
 54%|█████▍    | 20437/37963 [50:17:55<48:00:31,  9.86s/it]
 54%|█████▍    | 20438/37963 [50:18:03<44:54:45,  9.23s/it]
 54%|█████▍    | 20439/37963 [50:18:11<42:24:37,  8.71s/it]
 54%|█████▍    | 20440/37963 [50:18:18<41:02:39,  8.43s/it]
                                                           
{'loss': '0.1425', 'grad_norm': '1.944', 'learning_rate': '9.243e-06', 'epoch': '0.5384'}
+
 54%|█████▍    | 20440/37963 [50:18:18<41:02:39,  8.43s/it]
 54%|█████▍    | 20441/37963 [50:18:26<40:03:53,  8.23s/it]
 54%|█████▍    | 20442/37963 [50:18:34<39:18:11,  8.08s/it]
 54%|█████▍    | 20443/37963 [50:18:42<38:45:15,  7.96s/it]
 54%|█████▍    | 20444/37963 [50:18:49<38:29:38,  7.91s/it]
 54%|█████▍    | 20445/37963 [50:19:04<48:30:09,  9.97s/it]
 54%|█████▍    | 20446/37963 [50:19:12<45:57:10,  9.44s/it]
 54%|█████▍    | 20447/37963 [50:19:20<43:44:13,  8.99s/it]
 54%|█████▍    | 20448/37963 [50:19:28<41:53:12,  8.61s/it]
 54%|█████▍    | 20449/37963 [50:19:36<40:38:31,  8.35s/it]
 54%|█████▍    | 20450/37963 [50:19:44<39:42:53,  8.16s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '4.962', 'learning_rate': '9.235e-06', 'epoch': '0.5387'}
+
 54%|█████▍    | 20450/37963 [50:19:44<39:42:53,  8.16s/it]
 54%|█████▍    | 20451/37963 [50:19:58<48:19:37,  9.93s/it]
 54%|█████▍    | 20452/37963 [50:20:06<45:30:09,  9.35s/it]
 54%|█████▍    | 20453/37963 [50:20:13<43:12:37,  8.88s/it]
 54%|█████▍    | 20454/37963 [50:20:21<41:44:33,  8.58s/it]
 54%|█████▍    | 20455/37963 [50:20:36<50:14:37, 10.33s/it]
 54%|█████▍    | 20456/37963 [50:20:44<46:57:15,  9.66s/it]
 54%|█████▍    | 20457/37963 [50:20:59<54:43:27, 11.25s/it]
 54%|█████▍    | 20458/37963 [50:21:13<59:34:27, 12.25s/it]
 54%|█████▍    | 20459/37963 [50:21:21<53:28:28, 11.00s/it]
 54%|█████▍    | 20460/37963 [50:21:29<48:24:55,  9.96s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '2.213', 'learning_rate': '9.226e-06', 'epoch': '0.5389'}
+
 54%|█████▍    | 20460/37963 [50:21:29<48:24:55,  9.96s/it]
 54%|█████▍    | 20461/37963 [50:21:37<45:12:01,  9.30s/it]
 54%|█████▍    | 20462/37963 [50:21:44<42:52:00,  8.82s/it]
 54%|█████▍    | 20463/37963 [50:21:52<41:18:48,  8.50s/it]
 54%|█████▍    | 20464/37963 [50:22:07<50:16:25, 10.34s/it]
 54%|█████▍    | 20465/37963 [50:22:22<57:01:35, 11.73s/it]
 54%|█████▍    | 20466/37963 [50:22:29<51:09:09, 10.52s/it]
 54%|█████▍    | 20467/37963 [50:22:37<46:45:20,  9.62s/it]
 54%|█████▍    | 20468/37963 [50:22:45<44:08:11,  9.08s/it]
 54%|█████▍    | 20469/37963 [50:22:52<42:03:32,  8.66s/it]
 54%|█████▍    | 20470/37963 [50:23:00<40:38:53,  8.37s/it]
                                                           
{'loss': '0.145', 'grad_norm': '0.8694', 'learning_rate': '9.218e-06', 'epoch': '0.5392'}
+
 54%|█████▍    | 20470/37963 [50:23:00<40:38:53,  8.37s/it]
 54%|█████▍    | 20471/37963 [50:23:08<39:11:59,  8.07s/it]
 54%|█████▍    | 20472/37963 [50:23:15<38:44:02,  7.97s/it]
 54%|█████▍    | 20473/37963 [50:23:23<37:56:40,  7.81s/it]
 54%|█████▍    | 20474/37963 [50:23:30<37:55:42,  7.81s/it]
 54%|█████▍    | 20475/37963 [50:23:38<37:39:57,  7.75s/it]
 54%|█████▍    | 20476/37963 [50:23:46<37:33:57,  7.73s/it]
 54%|█████▍    | 20477/37963 [50:23:54<37:34:57,  7.74s/it]
 54%|█████▍    | 20478/37963 [50:24:01<37:18:46,  7.68s/it]
 54%|█████▍    | 20479/37963 [50:24:09<37:39:12,  7.75s/it]
 54%|█████▍    | 20480/37963 [50:24:17<37:16:03,  7.67s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '1.205', 'learning_rate': '9.209e-06', 'epoch': '0.5395'}
+
 54%|█████▍    | 20480/37963 [50:24:17<37:16:03,  7.67s/it]
 54%|█████▍    | 20481/37963 [50:24:24<37:26:47,  7.71s/it]
 54%|█████▍    | 20482/37963 [50:24:32<37:17:46,  7.68s/it]
 54%|█████▍    | 20483/37963 [50:24:40<37:23:11,  7.70s/it]
 54%|█████▍    | 20484/37963 [50:24:47<37:22:27,  7.70s/it]
 54%|█████▍    | 20485/37963 [50:24:55<37:19:27,  7.69s/it]
 54%|█████▍    | 20486/37963 [50:25:03<37:19:29,  7.69s/it]
 54%|█████▍    | 20487/37963 [50:25:10<37:26:34,  7.71s/it]
 54%|█████▍    | 20488/37963 [50:25:19<37:54:24,  7.81s/it]
 54%|█████▍    | 20489/37963 [50:25:33<48:10:13,  9.92s/it]
 54%|█████▍    | 20490/37963 [50:25:41<45:08:47,  9.30s/it]
                                                           
{'loss': '0.1398', 'grad_norm': '0.8323', 'learning_rate': '9.201e-06', 'epoch': '0.5397'}
+
 54%|█████▍    | 20490/37963 [50:25:41<45:08:47,  9.30s/it]
 54%|█████▍    | 20491/37963 [50:25:49<42:56:45,  8.85s/it]
 54%|█████▍    | 20492/37963 [50:25:56<40:51:04,  8.42s/it]
 54%|█████▍    | 20493/37963 [50:26:11<49:36:46, 10.22s/it]
 54%|█████▍    | 20494/37963 [50:26:19<46:19:56,  9.55s/it]
 54%|█████▍    | 20495/37963 [50:26:27<43:40:04,  9.00s/it]
 54%|█████▍    | 20496/37963 [50:26:34<41:52:51,  8.63s/it]
 54%|█████▍    | 20497/37963 [50:26:42<40:37:09,  8.37s/it]
 54%|█████▍    | 20498/37963 [50:26:50<39:47:23,  8.20s/it]
 54%|█████▍    | 20499/37963 [50:26:58<39:15:52,  8.09s/it]
 54%|█████▍    | 20500/37963 [50:27:12<48:22:37,  9.97s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '1.422', 'learning_rate': '9.192e-06', 'epoch': '0.54'}
+
 54%|█████▍    | 20500/37963 [50:27:12<48:22:37,  9.97s/it]
 54%|█████▍    | 20501/37963 [50:27:20<45:05:19,  9.30s/it]
 54%|█████▍    | 20502/37963 [50:27:27<42:19:38,  8.73s/it]
 54%|█████▍    | 20503/37963 [50:27:42<51:16:43, 10.57s/it]
 54%|█████▍    | 20504/37963 [50:27:50<47:14:32,  9.74s/it]
 54%|█████▍    | 20505/37963 [50:28:04<53:44:46, 11.08s/it]
 54%|█████▍    | 20506/37963 [50:28:19<59:02:13, 12.17s/it]
 54%|█████▍    | 20507/37963 [50:28:27<52:46:39, 10.88s/it]
 54%|█████▍    | 20508/37963 [50:28:34<48:13:01,  9.94s/it]
 54%|█████▍    | 20509/37963 [50:28:49<55:08:10, 11.37s/it]
 54%|█████▍    | 20510/37963 [50:28:57<49:19:28, 10.17s/it]
                                                           
{'loss': '0.1582', 'grad_norm': '4.797', 'learning_rate': '9.184e-06', 'epoch': '0.5403'}
+
 54%|█████▍    | 20510/37963 [50:28:57<49:19:28, 10.17s/it]
 54%|█████▍    | 20511/37963 [50:29:04<45:43:34,  9.43s/it]
 54%|█████▍    | 20512/37963 [50:29:12<42:36:03,  8.79s/it]
 54%|█████▍    | 20513/37963 [50:29:19<40:55:38,  8.44s/it]
 54%|█████▍    | 20514/37963 [50:29:27<39:42:29,  8.19s/it]
 54%|█████▍    | 20515/37963 [50:29:42<49:22:05, 10.19s/it]
 54%|█████▍    | 20516/37963 [50:29:49<45:50:38,  9.46s/it]
 54%|█████▍    | 20517/37963 [50:29:57<43:09:31,  8.91s/it]
 54%|█████▍    | 20518/37963 [50:30:05<41:32:29,  8.57s/it]
 54%|█████▍    | 20519/37963 [50:30:12<40:14:02,  8.30s/it]
 54%|█████▍    | 20520/37963 [50:30:20<39:14:15,  8.10s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '1.548', 'learning_rate': '9.175e-06', 'epoch': '0.5405'}
+
 54%|█████▍    | 20520/37963 [50:30:20<39:14:15,  8.10s/it]
 54%|█████▍    | 20521/37963 [50:30:28<38:42:05,  7.99s/it]
 54%|█████▍    | 20522/37963 [50:30:36<38:19:54,  7.91s/it]
 54%|█████▍    | 20523/37963 [50:30:43<37:58:55,  7.84s/it]
 54%|█████▍    | 20524/37963 [50:30:51<37:53:02,  7.82s/it]
 54%|█████▍    | 20525/37963 [50:30:59<37:45:44,  7.80s/it]
 54%|█████▍    | 20526/37963 [50:31:07<37:44:20,  7.79s/it]
 54%|█████▍    | 20527/37963 [50:31:14<37:25:14,  7.73s/it]
 54%|█████▍    | 20528/37963 [50:31:22<37:24:59,  7.73s/it]
 54%|█████▍    | 20529/37963 [50:31:29<37:12:56,  7.68s/it]
 54%|█████▍    | 20530/37963 [50:31:37<37:20:32,  7.71s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '2.521', 'learning_rate': '9.167e-06', 'epoch': '0.5408'}
+
 54%|█████▍    | 20530/37963 [50:31:37<37:20:32,  7.71s/it]
 54%|█████▍    | 20531/37963 [50:31:45<37:00:37,  7.64s/it]
 54%|█████▍    | 20532/37963 [50:31:52<37:11:02,  7.68s/it]
 54%|█████▍    | 20533/37963 [50:32:00<36:55:29,  7.63s/it]
 54%|█████▍    | 20534/37963 [50:32:07<36:45:33,  7.59s/it]
 54%|█████▍    | 20535/37963 [50:32:15<36:54:09,  7.62s/it]
 54%|█████▍    | 20536/37963 [50:32:23<37:08:13,  7.67s/it]
 54%|█████▍    | 20537/37963 [50:32:38<47:44:38,  9.86s/it]
 54%|█████▍    | 20538/37963 [50:32:46<44:50:48,  9.27s/it]
 54%|█████▍    | 20539/37963 [50:32:54<42:46:43,  8.84s/it]
 54%|█████▍    | 20540/37963 [50:33:01<41:16:38,  8.53s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '3.077', 'learning_rate': '9.158e-06', 'epoch': '0.5411'}
+
 54%|█████▍    | 20540/37963 [50:33:01<41:16:38,  8.53s/it]
 54%|█████▍    | 20541/37963 [50:33:09<40:11:15,  8.30s/it]
 54%|█████▍    | 20542/37963 [50:33:17<39:19:16,  8.13s/it]
 54%|█████▍    | 20543/37963 [50:33:25<38:47:31,  8.02s/it]
 54%|█████▍    | 20544/37963 [50:33:32<38:19:49,  7.92s/it]
 54%|█████▍    | 20545/37963 [50:33:40<38:00:14,  7.85s/it]
 54%|█████▍    | 20546/37963 [50:34:01<57:27:13, 11.88s/it]
 54%|█████▍    | 20547/37963 [50:34:09<51:39:33, 10.68s/it]
 54%|█████▍    | 20548/37963 [50:34:17<47:19:17,  9.78s/it]
 54%|█████▍    | 20549/37963 [50:34:25<44:19:51,  9.16s/it]
 54%|█████▍    | 20550/37963 [50:34:32<41:59:41,  8.68s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '2.009', 'learning_rate': '9.15e-06', 'epoch': '0.5413'}
+
 54%|█████▍    | 20550/37963 [50:34:32<41:59:41,  8.68s/it]
 54%|█████▍    | 20551/37963 [50:34:47<50:43:13, 10.49s/it]
 54%|█████▍    | 20552/37963 [50:34:55<47:21:17,  9.79s/it]
 54%|█████▍    | 20553/37963 [50:35:10<54:48:20, 11.33s/it]
 54%|█████▍    | 20554/37963 [50:35:25<59:52:17, 12.38s/it]
 54%|█████▍    | 20555/37963 [50:35:33<53:07:27, 10.99s/it]
 54%|█████▍    | 20556/37963 [50:35:40<48:13:04,  9.97s/it]
 54%|█████▍    | 20557/37963 [50:35:48<44:49:02,  9.27s/it]
 54%|█████▍    | 20558/37963 [50:35:56<42:37:29,  8.82s/it]
 54%|█████▍    | 20559/37963 [50:36:10<50:36:01, 10.47s/it]
 54%|█████▍    | 20560/37963 [50:36:18<46:44:05,  9.67s/it]
                                                           
{'loss': '0.1487', 'grad_norm': '1.11', 'learning_rate': '9.141e-06', 'epoch': '0.5416'}
+
 54%|█████▍    | 20560/37963 [50:36:18<46:44:05,  9.67s/it]
 54%|█████▍    | 20561/37963 [50:36:25<43:51:20,  9.07s/it]
 54%|█████▍    | 20562/37963 [50:36:33<41:43:59,  8.63s/it]
 54%|█████▍    | 20563/37963 [50:36:40<40:04:54,  8.29s/it]
 54%|█████▍    | 20564/37963 [50:36:48<39:17:28,  8.13s/it]
 54%|█████▍    | 20565/37963 [50:36:56<38:39:29,  8.00s/it]
 54%|█████▍    | 20566/37963 [50:37:11<48:17:30,  9.99s/it]
 54%|█████▍    | 20567/37963 [50:37:18<44:33:50,  9.22s/it]
 54%|█████▍    | 20568/37963 [50:37:26<42:20:38,  8.76s/it]
 54%|█████▍    | 20569/37963 [50:37:33<40:36:38,  8.41s/it]
 54%|█████▍    | 20570/37963 [50:37:41<39:44:24,  8.23s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '1.482', 'learning_rate': '9.133e-06', 'epoch': '0.5418'}
+
 54%|█████▍    | 20570/37963 [50:37:41<39:44:24,  8.23s/it]
 54%|█████▍    | 20571/37963 [50:37:49<39:07:40,  8.10s/it]
 54%|█████▍    | 20572/37963 [50:37:57<38:32:51,  7.98s/it]
 54%|█████▍    | 20573/37963 [50:38:04<38:18:39,  7.93s/it]
 54%|█████▍    | 20574/37963 [50:38:12<38:05:46,  7.89s/it]
 54%|█████▍    | 20575/37963 [50:38:20<38:03:29,  7.88s/it]
 54%|█████▍    | 20576/37963 [50:38:28<37:52:43,  7.84s/it]
 54%|█████▍    | 20577/37963 [50:38:35<37:19:11,  7.73s/it]
 54%|█████▍    | 20578/37963 [50:38:43<37:30:30,  7.77s/it]
 54%|█████▍    | 20579/37963 [50:38:51<37:43:59,  7.81s/it]
 54%|█████▍    | 20580/37963 [50:38:59<37:37:42,  7.79s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '2.752', 'learning_rate': '9.124e-06', 'epoch': '0.5421'}
+
 54%|█████▍    | 20580/37963 [50:38:59<37:37:42,  7.79s/it]
 54%|█████▍    | 20581/37963 [50:39:06<37:24:27,  7.75s/it]
 54%|█████▍    | 20582/37963 [50:39:21<47:28:40,  9.83s/it]
 54%|█████▍    | 20583/37963 [50:39:29<44:56:22,  9.31s/it]
 54%|█████▍    | 20584/37963 [50:39:37<42:51:18,  8.88s/it]
 54%|█████▍    | 20585/37963 [50:39:45<40:57:54,  8.49s/it]
 54%|█████▍    | 20586/37963 [50:39:52<39:56:08,  8.27s/it]
 54%|█████▍    | 20587/37963 [50:40:00<39:13:55,  8.13s/it]
 54%|█████▍    | 20588/37963 [50:40:08<38:37:50,  8.00s/it]
 54%|█████▍    | 20589/37963 [50:40:16<38:14:05,  7.92s/it]
 54%|█████▍    | 20590/37963 [50:40:23<37:59:04,  7.87s/it]
                                                           
{'loss': '0.1498', 'grad_norm': '0.9621', 'learning_rate': '9.116e-06', 'epoch': '0.5424'}
+
 54%|█████▍    | 20590/37963 [50:40:23<37:59:04,  7.87s/it]
 54%|█████▍    | 20591/37963 [50:40:31<37:40:25,  7.81s/it]
 54%|█████▍    | 20592/37963 [50:40:45<46:58:29,  9.74s/it]
 54%|█████▍    | 20593/37963 [50:40:53<44:02:26,  9.13s/it]
 54%|█████▍    | 20594/37963 [50:41:01<42:06:31,  8.73s/it]
 54%|█████▍    | 20595/37963 [50:41:09<40:45:55,  8.45s/it]
 54%|█████▍    | 20596/37963 [50:41:16<39:39:40,  8.22s/it]
 54%|█████▍    | 20597/37963 [50:41:31<48:26:34, 10.04s/it]
 54%|█████▍    | 20598/37963 [50:41:39<45:34:40,  9.45s/it]
 54%|█████▍    | 20599/37963 [50:41:53<52:56:47, 10.98s/it]
 54%|█████▍    | 20600/37963 [50:42:08<58:15:01, 12.08s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '1.378', 'learning_rate': '9.107e-06', 'epoch': '0.5426'}
+
 54%|█████▍    | 20600/37963 [50:42:08<58:15:01, 12.08s/it]
 54%|█████▍    | 20601/37963 [50:42:23<62:55:12, 13.05s/it]
 54%|█████▍    | 20602/37963 [50:42:31<55:18:27, 11.47s/it]
 54%|█████▍    | 20603/37963 [50:42:39<49:52:47, 10.34s/it]
 54%|█████▍    | 20604/37963 [50:42:53<55:32:35, 11.52s/it]
 54%|█████▍    | 20605/37963 [50:43:01<50:12:32, 10.41s/it]
 54%|█████▍    | 20606/37963 [50:43:08<46:13:29,  9.59s/it]
 54%|█████▍    | 20607/37963 [50:43:16<43:31:11,  9.03s/it]
 54%|█████▍    | 20608/37963 [50:43:24<41:16:45,  8.56s/it]
 54%|█████▍    | 20609/37963 [50:43:31<40:02:55,  8.31s/it]
 54%|█████▍    | 20610/37963 [50:43:39<39:13:36,  8.14s/it]
                                                           
{'loss': '0.1436', 'grad_norm': '1.229', 'learning_rate': '9.099e-06', 'epoch': '0.5429'}
+
 54%|█████▍    | 20610/37963 [50:43:39<39:13:36,  8.14s/it]
 54%|█████▍    | 20611/37963 [50:43:54<49:09:55, 10.20s/it]
 54%|█████▍    | 20612/37963 [50:44:02<45:33:56,  9.45s/it]
 54%|█████▍    | 20613/37963 [50:44:09<43:02:47,  8.93s/it]
 54%|█████▍    | 20614/37963 [50:44:17<41:04:53,  8.52s/it]
 54%|█████▍    | 20615/37963 [50:44:24<39:29:34,  8.20s/it]
 54%|█████▍    | 20616/37963 [50:44:32<38:48:14,  8.05s/it]
 54%|█████▍    | 20617/37963 [50:44:40<38:18:28,  7.95s/it]
 54%|█████▍    | 20618/37963 [50:44:48<38:00:20,  7.89s/it]
 54%|█████▍    | 20619/37963 [50:44:55<37:45:13,  7.84s/it]
 54%|█████▍    | 20620/37963 [50:45:03<37:34:24,  7.80s/it]
                                                           
{'loss': '0.1412', 'grad_norm': '2.192', 'learning_rate': '9.09e-06', 'epoch': '0.5432'}
+
 54%|█████▍    | 20620/37963 [50:45:03<37:34:24,  7.80s/it]
 54%|█████▍    | 20621/37963 [50:45:11<37:35:51,  7.80s/it]
 54%|█████▍    | 20622/37963 [50:45:18<37:15:55,  7.74s/it]
 54%|█████▍    | 20623/37963 [50:45:26<37:13:58,  7.73s/it]
 54%|█████▍    | 20624/37963 [50:45:34<37:16:39,  7.74s/it]
 54%|█████▍    | 20625/37963 [50:45:42<37:08:09,  7.71s/it]
 54%|█████▍    | 20626/37963 [50:45:57<47:36:31,  9.89s/it]
 54%|█████▍    | 20627/37963 [50:46:04<44:32:41,  9.25s/it]
 54%|█████▍    | 20628/37963 [50:46:12<42:38:02,  8.85s/it]
 54%|█████▍    | 20629/37963 [50:46:20<41:07:29,  8.54s/it]
 54%|█████▍    | 20630/37963 [50:46:28<39:55:10,  8.29s/it]
                                                           
{'loss': '0.145', 'grad_norm': '3.117', 'learning_rate': '9.082e-06', 'epoch': '0.5434'}
+
 54%|█████▍    | 20630/37963 [50:46:28<39:55:10,  8.29s/it]
 54%|█████▍    | 20631/37963 [50:46:35<38:59:10,  8.10s/it]
 54%|█████▍    | 20632/37963 [50:46:43<38:26:47,  7.99s/it]
 54%|█████▍    | 20633/37963 [50:46:51<37:37:36,  7.82s/it]
 54%|█████▍    | 20634/37963 [50:46:58<37:31:19,  7.79s/it]
 54%|█████▍    | 20635/37963 [50:47:06<37:25:42,  7.78s/it]
 54%|█████▍    | 20636/37963 [50:47:14<37:17:25,  7.75s/it]
 54%|█████▍    | 20637/37963 [50:47:21<37:02:16,  7.70s/it]
 54%|█████▍    | 20638/37963 [50:47:29<36:56:33,  7.68s/it]
 54%|█████▍    | 20639/37963 [50:47:43<46:51:05,  9.74s/it]
 54%|█████▍    | 20640/37963 [50:47:51<44:14:55,  9.20s/it]
                                                           
{'loss': '0.1435', 'grad_norm': '1.48', 'learning_rate': '9.073e-06', 'epoch': '0.5437'}
+
 54%|█████▍    | 20640/37963 [50:47:51<44:14:55,  9.20s/it]
 54%|█████▍    | 20641/37963 [50:48:06<51:32:04, 10.71s/it]
 54%|█████▍    | 20642/37963 [50:48:13<47:15:20,  9.82s/it]
 54%|█████▍    | 20643/37963 [50:48:28<54:30:16, 11.33s/it]
 54%|█████▍    | 20644/37963 [50:48:36<49:23:28, 10.27s/it]
 54%|█████▍    | 20645/37963 [50:48:44<45:44:22,  9.51s/it]
 54%|█████▍    | 20646/37963 [50:48:52<43:19:44,  9.01s/it]
 54%|█████▍    | 20647/37963 [50:48:59<41:35:23,  8.65s/it]
 54%|█████▍    | 20648/37963 [50:49:14<49:32:23, 10.30s/it]
 54%|█████▍    | 20649/37963 [50:49:29<56:28:59, 11.74s/it]
 54%|█████▍    | 20650/37963 [50:49:37<51:07:04, 10.63s/it]
                                                           
{'loss': '0.1362', 'grad_norm': '1.45', 'learning_rate': '9.065e-06', 'epoch': '0.544'}
+
 54%|█████▍    | 20650/37963 [50:49:37<51:07:04, 10.63s/it]
 54%|█████▍    | 20651/37963 [50:49:51<56:34:50, 11.77s/it]
 54%|█████▍    | 20652/37963 [50:49:59<51:01:50, 10.61s/it]
 54%|█████▍    | 20653/37963 [50:50:07<46:50:13,  9.74s/it]
 54%|█████▍    | 20654/37963 [50:50:15<44:00:16,  9.15s/it]
 54%|█████▍    | 20655/37963 [50:50:29<52:23:49, 10.90s/it]
 54%|█████▍    | 20656/37963 [50:50:37<48:04:50, 10.00s/it]
 54%|█████▍    | 20657/37963 [50:50:45<44:17:28,  9.21s/it]
 54%|█████▍    | 20658/37963 [50:50:53<42:32:10,  8.85s/it]
 54%|█████▍    | 20659/37963 [50:51:00<40:51:10,  8.50s/it]
 54%|█████▍    | 20660/37963 [50:51:08<39:38:34,  8.25s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '1.833', 'learning_rate': '9.056e-06', 'epoch': '0.5442'}
+
 54%|█████▍    | 20660/37963 [50:51:08<39:38:34,  8.25s/it]
 54%|█████▍    | 20661/37963 [50:51:16<38:38:59,  8.04s/it]
 54%|█████▍    | 20662/37963 [50:51:23<37:47:49,  7.86s/it]
 54%|█████▍    | 20663/37963 [50:51:31<37:40:52,  7.84s/it]
 54%|█████▍    | 20664/37963 [50:51:39<37:29:53,  7.80s/it]
 54%|█████▍    | 20665/37963 [50:51:46<37:33:10,  7.82s/it]
 54%|█████▍    | 20666/37963 [50:51:54<37:23:09,  7.78s/it]
 54%|█████▍    | 20667/37963 [50:52:02<37:16:20,  7.76s/it]
 54%|█████▍    | 20668/37963 [50:52:10<37:12:21,  7.74s/it]
 54%|█████▍    | 20669/37963 [50:52:17<36:49:29,  7.67s/it]
 54%|█████▍    | 20670/37963 [50:52:25<37:05:26,  7.72s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '3.542', 'learning_rate': '9.048e-06', 'epoch': '0.5445'}
+
 54%|█████▍    | 20670/37963 [50:52:25<37:05:26,  7.72s/it]
 54%|█████▍    | 20671/37963 [50:52:33<37:01:39,  7.71s/it]
 54%|█████▍    | 20672/37963 [50:52:40<37:03:13,  7.71s/it]
 54%|█████▍    | 20673/37963 [50:52:48<36:43:23,  7.65s/it]
 54%|█████▍    | 20674/37963 [50:52:56<36:59:10,  7.70s/it]
 54%|█████▍    | 20675/37963 [50:53:03<36:41:18,  7.64s/it]
 54%|█████▍    | 20676/37963 [50:53:11<36:34:45,  7.62s/it]
 54%|█████▍    | 20677/37963 [50:53:19<36:53:10,  7.68s/it]
 54%|█████▍    | 20678/37963 [50:53:26<37:07:52,  7.73s/it]
 54%|█████▍    | 20679/37963 [50:53:34<37:10:58,  7.74s/it]
 54%|█████▍    | 20680/37963 [50:53:49<47:54:08,  9.98s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '1.213', 'learning_rate': '9.039e-06', 'epoch': '0.5447'}
+
 54%|█████▍    | 20680/37963 [50:53:49<47:54:08,  9.98s/it]
 54%|█████▍    | 20681/37963 [50:53:57<44:48:24,  9.33s/it]
 54%|█████▍    | 20682/37963 [50:54:05<42:27:27,  8.84s/it]
 54%|█████▍    | 20683/37963 [50:54:13<40:52:20,  8.52s/it]
 54%|█████▍    | 20684/37963 [50:54:20<39:40:22,  8.27s/it]
 54%|█████▍    | 20685/37963 [50:54:28<38:36:40,  8.04s/it]
 54%|█████▍    | 20686/37963 [50:54:35<37:40:02,  7.85s/it]
 54%|█████▍    | 20687/37963 [50:54:50<47:13:26,  9.84s/it]
 54%|█████▍    | 20688/37963 [50:54:58<44:27:14,  9.26s/it]
 54%|█████▍    | 20689/37963 [50:55:05<42:19:27,  8.82s/it]
 55%|█████▍    | 20690/37963 [50:55:13<40:43:12,  8.49s/it]
                                                           
{'loss': '0.1435', 'grad_norm': '2.314', 'learning_rate': '9.031e-06', 'epoch': '0.545'}
+
 55%|█████▍    | 20690/37963 [50:55:13<40:43:12,  8.49s/it]
 55%|█████▍    | 20691/37963 [50:55:21<39:41:05,  8.27s/it]
 55%|█████▍    | 20692/37963 [50:55:28<38:39:48,  8.06s/it]
 55%|█████▍    | 20693/37963 [50:55:36<38:09:00,  7.95s/it]
 55%|█████▍    | 20694/37963 [50:55:44<38:01:07,  7.93s/it]
 55%|█████▍    | 20695/37963 [50:56:05<56:56:31, 11.87s/it]
 55%|█████▍    | 20696/37963 [50:56:20<61:40:00, 12.86s/it]
 55%|█████▍    | 20697/37963 [50:56:42<74:21:37, 15.50s/it]
 55%|█████▍    | 20698/37963 [50:56:50<63:16:19, 13.19s/it]
 55%|█████▍    | 20699/37963 [50:56:57<55:25:47, 11.56s/it]
 55%|█████▍    | 20700/37963 [50:57:05<49:34:55, 10.34s/it]
                                                           
{'loss': '0.1406', 'grad_norm': '1.647', 'learning_rate': '9.022e-06', 'epoch': '0.5453'}
+
 55%|█████▍    | 20700/37963 [50:57:05<49:34:55, 10.34s/it]
 55%|█████▍    | 20701/37963 [50:57:13<45:47:03,  9.55s/it]
 55%|█████▍    | 20702/37963 [50:57:20<42:46:00,  8.92s/it]
 55%|█████▍    | 20703/37963 [50:57:28<41:13:07,  8.60s/it]
 55%|█████▍    | 20704/37963 [50:57:43<49:50:47, 10.40s/it]
 55%|█████▍    | 20705/37963 [50:57:51<46:33:46,  9.71s/it]
 55%|█████▍    | 20706/37963 [50:57:59<43:50:07,  9.14s/it]
 55%|█████▍    | 20707/37963 [50:58:06<41:43:23,  8.70s/it]
 55%|█████▍    | 20708/37963 [50:58:14<40:17:03,  8.40s/it]
 55%|█████▍    | 20709/37963 [50:58:22<39:29:20,  8.24s/it]
 55%|█████▍    | 20710/37963 [50:58:30<38:48:30,  8.10s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '1.166', 'learning_rate': '9.014e-06', 'epoch': '0.5455'}
+
 55%|█████▍    | 20710/37963 [50:58:30<38:48:30,  8.10s/it]
 55%|█████▍    | 20711/37963 [50:58:37<38:10:55,  7.97s/it]
 55%|█████▍    | 20712/37963 [50:58:45<37:28:49,  7.82s/it]
 55%|█████▍    | 20713/37963 [50:58:52<37:19:27,  7.79s/it]
 55%|█████▍    | 20714/37963 [50:59:00<37:08:12,  7.75s/it]
 55%|█████▍    | 20715/37963 [50:59:08<36:50:26,  7.69s/it]
 55%|█████▍    | 20716/37963 [50:59:15<36:39:03,  7.65s/it]
 55%|█████▍    | 20717/37963 [50:59:23<36:56:04,  7.71s/it]
 55%|█████▍    | 20718/37963 [50:59:31<36:52:51,  7.70s/it]
 55%|█████▍    | 20719/37963 [50:59:38<36:38:52,  7.65s/it]
 55%|█████▍    | 20720/37963 [50:59:46<36:42:50,  7.67s/it]
                                                           
{'loss': '0.145', 'grad_norm': '2.553', 'learning_rate': '9.005e-06', 'epoch': '0.5458'}
+
 55%|█████▍    | 20720/37963 [50:59:46<36:42:50,  7.67s/it]
 55%|█████▍    | 20721/37963 [50:59:53<36:30:38,  7.62s/it]
 55%|█████▍    | 20722/37963 [51:00:01<36:39:24,  7.65s/it]
 55%|█████▍    | 20723/37963 [51:00:09<36:41:19,  7.66s/it]
 55%|█████▍    | 20724/37963 [51:00:17<36:47:38,  7.68s/it]
 55%|█████▍    | 20725/37963 [51:00:24<36:51:31,  7.70s/it]
 55%|█████▍    | 20726/37963 [51:00:32<36:17:57,  7.58s/it]
 55%|█████▍    | 20727/37963 [51:00:39<36:40:36,  7.66s/it]
 55%|█████▍    | 20728/37963 [51:00:47<36:56:15,  7.72s/it]
 55%|█████▍    | 20729/37963 [51:00:55<36:35:56,  7.65s/it]
 55%|█████▍    | 20730/37963 [51:01:02<36:38:13,  7.65s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '1.723', 'learning_rate': '8.997e-06', 'epoch': '0.5461'}
+
 55%|█████▍    | 20730/37963 [51:01:02<36:38:13,  7.65s/it]
 55%|█████▍    | 20731/37963 [51:01:10<36:46:27,  7.68s/it]
 55%|█████▍    | 20732/37963 [51:01:18<37:08:45,  7.76s/it]
 55%|█████▍    | 20733/37963 [51:01:26<37:08:49,  7.76s/it]
 55%|█████▍    | 20734/37963 [51:01:41<47:29:36,  9.92s/it]
 55%|█████▍    | 20735/37963 [51:01:49<44:34:09,  9.31s/it]
 55%|█████▍    | 20736/37963 [51:01:56<42:03:02,  8.79s/it]
 55%|█████▍    | 20737/37963 [51:02:04<40:36:33,  8.49s/it]
 55%|█████▍    | 20738/37963 [51:02:12<39:29:43,  8.25s/it]
 55%|█████▍    | 20739/37963 [51:02:26<48:14:05, 10.08s/it]
 55%|█████▍    | 20740/37963 [51:02:34<44:41:06,  9.34s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '1.967', 'learning_rate': '8.988e-06', 'epoch': '0.5463'}
+
 55%|█████▍    | 20740/37963 [51:02:34<44:41:06,  9.34s/it]
 55%|█████▍    | 20741/37963 [51:02:49<52:28:44, 10.97s/it]
 55%|█████▍    | 20742/37963 [51:02:57<48:22:39, 10.11s/it]
 55%|█████▍    | 20743/37963 [51:03:18<64:55:16, 13.57s/it]
 55%|█████▍    | 20744/37963 [51:03:26<56:43:02, 11.86s/it]
 55%|█████▍    | 20745/37963 [51:03:34<50:42:02, 10.60s/it]
 55%|█████▍    | 20746/37963 [51:03:42<46:32:26,  9.73s/it]
 55%|█████▍    | 20747/37963 [51:03:49<43:11:29,  9.03s/it]
 55%|█████▍    | 20748/37963 [51:03:56<40:57:48,  8.57s/it]
 55%|█████▍    | 20749/37963 [51:04:11<49:53:17, 10.43s/it]
 55%|█████▍    | 20750/37963 [51:04:33<65:59:22, 13.80s/it]
                                                           
{'loss': '0.1577', 'grad_norm': '1.36', 'learning_rate': '8.98e-06', 'epoch': '0.5466'}
+
 55%|█████▍    | 20750/37963 [51:04:33<65:59:22, 13.80s/it]
 55%|█████▍    | 20751/37963 [51:04:41<57:23:43, 12.00s/it]
 55%|█████▍    | 20752/37963 [51:04:48<51:15:56, 10.72s/it]
 55%|█████▍    | 20753/37963 [51:04:56<46:53:15,  9.81s/it]
 55%|█████▍    | 20754/37963 [51:05:04<44:01:13,  9.21s/it]
 55%|█████▍    | 20755/37963 [51:05:11<41:34:18,  8.70s/it]
 55%|█████▍    | 20756/37963 [51:05:19<40:19:24,  8.44s/it]
 55%|█████▍    | 20757/37963 [51:05:27<39:14:13,  8.21s/it]
 55%|█████▍    | 20758/37963 [51:05:35<38:48:40,  8.12s/it]
 55%|█████▍    | 20759/37963 [51:05:43<38:11:15,  7.99s/it]
 55%|█████▍    | 20760/37963 [51:05:50<37:48:52,  7.91s/it]
                                                           
{'loss': '0.1384', 'grad_norm': '3.372', 'learning_rate': '8.971e-06', 'epoch': '0.5469'}
+
 55%|█████▍    | 20760/37963 [51:05:50<37:48:52,  7.91s/it]
 55%|█████▍    | 20761/37963 [51:05:58<37:37:16,  7.87s/it]
 55%|█████▍    | 20762/37963 [51:06:06<37:29:01,  7.84s/it]
 55%|█████▍    | 20763/37963 [51:06:13<37:12:14,  7.79s/it]
 55%|█████▍    | 20764/37963 [51:06:21<37:08:11,  7.77s/it]
 55%|█████▍    | 20765/37963 [51:06:29<37:00:23,  7.75s/it]
 55%|█████▍    | 20766/37963 [51:06:37<36:59:42,  7.74s/it]
 55%|█████▍    | 20767/37963 [51:06:44<36:40:47,  7.68s/it]
 55%|█████▍    | 20768/37963 [51:06:52<36:38:31,  7.67s/it]
 55%|█████▍    | 20769/37963 [51:07:00<36:46:37,  7.70s/it]
 55%|█████▍    | 20770/37963 [51:07:07<36:42:09,  7.69s/it]
                                                           
{'loss': '0.145', 'grad_norm': '1.259', 'learning_rate': '8.963e-06', 'epoch': '0.5471'}
+
 55%|█████▍    | 20770/37963 [51:07:07<36:42:09,  7.69s/it]
 55%|█████▍    | 20771/37963 [51:07:15<36:46:25,  7.70s/it]
 55%|█████▍    | 20772/37963 [51:07:23<36:39:18,  7.68s/it]
 55%|█████▍    | 20773/37963 [51:07:30<36:28:47,  7.64s/it]
 55%|█████▍    | 20774/37963 [51:07:38<36:42:44,  7.69s/it]
 55%|█████▍    | 20775/37963 [51:07:46<36:51:45,  7.72s/it]
 55%|█████▍    | 20776/37963 [51:07:53<36:51:19,  7.72s/it]
 55%|█████▍    | 20777/37963 [51:08:01<36:59:12,  7.75s/it]
 55%|█████▍    | 20778/37963 [51:08:09<36:55:08,  7.73s/it]
 55%|█████▍    | 20779/37963 [51:08:17<37:00:07,  7.75s/it]
 55%|█████▍    | 20780/37963 [51:08:32<47:18:15,  9.91s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '1.077', 'learning_rate': '8.954e-06', 'epoch': '0.5474'}
+
 55%|█████▍    | 20780/37963 [51:08:32<47:18:15,  9.91s/it]
 55%|█████▍    | 20781/37963 [51:08:39<44:12:28,  9.26s/it]
 55%|█████▍    | 20782/37963 [51:08:47<42:03:06,  8.81s/it]
 55%|█████▍    | 20783/37963 [51:08:55<40:21:48,  8.46s/it]
 55%|█████▍    | 20784/37963 [51:09:03<39:19:26,  8.24s/it]
 55%|█████▍    | 20785/37963 [51:09:11<38:56:21,  8.16s/it]
 55%|█████▍    | 20786/37963 [51:09:18<38:17:52,  8.03s/it]
 55%|█████▍    | 20787/37963 [51:09:26<37:54:32,  7.95s/it]
 55%|█████▍    | 20788/37963 [51:09:41<47:55:49, 10.05s/it]
 55%|█████▍    | 20789/37963 [51:09:49<44:51:26,  9.40s/it]
 55%|█████▍    | 20790/37963 [51:10:03<51:54:57, 10.88s/it]
                                                           
{'loss': '0.1493', 'grad_norm': '1.72', 'learning_rate': '8.946e-06', 'epoch': '0.5476'}
+
 55%|█████▍    | 20790/37963 [51:10:03<51:54:57, 10.88s/it]
 55%|█████▍    | 20791/37963 [51:10:19<58:32:53, 12.27s/it]
 55%|█████▍    | 20792/37963 [51:10:27<52:28:30, 11.00s/it]
 55%|█████▍    | 20793/37963 [51:10:35<48:01:46, 10.07s/it]
 55%|█████▍    | 20794/37963 [51:11:04<74:57:34, 15.72s/it]
 55%|█████▍    | 20795/37963 [51:11:12<63:53:14, 13.40s/it]
 55%|█████▍    | 20796/37963 [51:11:19<55:53:13, 11.72s/it]
 55%|█████▍    | 20797/37963 [51:11:34<60:31:37, 12.69s/it]
 55%|█████▍    | 20798/37963 [51:11:42<53:27:45, 11.21s/it]
 55%|█████▍    | 20799/37963 [51:11:49<48:01:28, 10.07s/it]
 55%|█████▍    | 20800/37963 [51:11:57<44:35:51,  9.35s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '3.281', 'learning_rate': '8.937e-06', 'epoch': '0.5479'}
+
 55%|█████▍    | 20800/37963 [51:11:57<44:35:51,  9.35s/it]
 55%|█████▍    | 20801/37963 [51:12:05<42:07:38,  8.84s/it]
 55%|█████▍    | 20802/37963 [51:12:13<40:34:23,  8.51s/it]
 55%|█████▍    | 20803/37963 [51:12:20<39:34:39,  8.30s/it]
 55%|█████▍    | 20804/37963 [51:12:28<38:47:50,  8.14s/it]
 55%|█████▍    | 20805/37963 [51:12:36<38:05:06,  7.99s/it]
 55%|█████▍    | 20806/37963 [51:12:43<37:41:18,  7.91s/it]
 55%|█████▍    | 20807/37963 [51:12:51<37:23:16,  7.85s/it]
 55%|█████▍    | 20808/37963 [51:12:59<37:08:32,  7.79s/it]
 55%|█████▍    | 20809/37963 [51:13:07<36:56:48,  7.75s/it]
 55%|█████▍    | 20810/37963 [51:13:14<36:32:12,  7.67s/it]
                                                           
{'loss': '0.1244', 'grad_norm': '1.021', 'learning_rate': '8.929e-06', 'epoch': '0.5482'}
+
 55%|█████▍    | 20810/37963 [51:13:14<36:32:12,  7.67s/it]
 55%|█████▍    | 20811/37963 [51:13:22<36:34:45,  7.68s/it]
 55%|█████▍    | 20812/37963 [51:13:29<36:38:03,  7.69s/it]
 55%|█████▍    | 20813/37963 [51:13:37<36:44:18,  7.71s/it]
 55%|█████▍    | 20814/37963 [51:13:45<36:46:47,  7.72s/it]
 55%|█████▍    | 20815/37963 [51:13:53<36:45:19,  7.72s/it]
 55%|█████▍    | 20816/37963 [51:14:00<36:39:45,  7.70s/it]
 55%|█████▍    | 20817/37963 [51:14:08<36:54:18,  7.75s/it]
 55%|█████▍    | 20818/37963 [51:14:16<36:26:00,  7.65s/it]
 55%|█████▍    | 20819/37963 [51:14:24<36:53:31,  7.75s/it]
 55%|█████▍    | 20820/37963 [51:14:31<36:25:26,  7.65s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '1.653', 'learning_rate': '8.92e-06', 'epoch': '0.5484'}
+
 55%|█████▍    | 20820/37963 [51:14:31<36:25:26,  7.65s/it]
 55%|█████▍    | 20821/37963 [51:14:38<36:12:40,  7.60s/it]
 55%|█████▍    | 20822/37963 [51:14:46<36:29:13,  7.66s/it]
 55%|█████▍    | 20823/37963 [51:14:54<36:41:57,  7.71s/it]
 55%|█████▍    | 20824/37963 [51:15:02<36:27:24,  7.66s/it]
 55%|█████▍    | 20825/37963 [51:15:09<36:27:17,  7.66s/it]
 55%|█████▍    | 20826/37963 [51:15:17<36:29:21,  7.67s/it]
 55%|█████▍    | 20827/37963 [51:15:25<36:32:01,  7.68s/it]
 55%|█████▍    | 20828/37963 [51:15:32<36:35:55,  7.69s/it]
 55%|█████▍    | 20829/37963 [51:15:40<36:43:30,  7.72s/it]
 55%|█████▍    | 20830/37963 [51:15:48<36:56:33,  7.76s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '2.226', 'learning_rate': '8.912e-06', 'epoch': '0.5487'}
+
 55%|█████▍    | 20830/37963 [51:15:48<36:56:33,  7.76s/it]
 55%|█████▍    | 20831/37963 [51:15:56<36:50:49,  7.74s/it]
 55%|█████▍    | 20832/37963 [51:16:11<46:56:43,  9.87s/it]
 55%|█████▍    | 20833/37963 [51:16:25<53:52:39, 11.32s/it]
 55%|█████▍    | 20834/37963 [51:16:40<58:34:23, 12.31s/it]
 55%|█████▍    | 20835/37963 [51:16:48<52:09:18, 10.96s/it]
 55%|█████▍    | 20836/37963 [51:16:55<47:34:43, 10.00s/it]
 55%|█████▍    | 20837/37963 [51:17:03<43:53:40,  9.23s/it]
 55%|█████▍    | 20838/37963 [51:17:18<52:06:13, 10.95s/it]
 55%|█████▍    | 20839/37963 [51:17:33<58:09:41, 12.23s/it]
 55%|█████▍    | 20840/37963 [51:17:41<51:58:07, 10.93s/it]
                                                           
{'loss': '0.1499', 'grad_norm': '1.048', 'learning_rate': '8.903e-06', 'epoch': '0.549'}
+
 55%|█████▍    | 20840/37963 [51:17:41<51:58:07, 10.93s/it]
 55%|█████▍    | 20841/37963 [51:17:55<56:23:43, 11.86s/it]
 55%|█████▍    | 20842/37963 [51:18:03<50:24:03, 10.60s/it]
 55%|█████▍    | 20843/37963 [51:18:10<46:18:07,  9.74s/it]
 55%|█████▍    | 20844/37963 [51:18:18<43:29:22,  9.15s/it]
 55%|█████▍    | 20845/37963 [51:18:26<41:22:33,  8.70s/it]
 55%|█████▍    | 20846/37963 [51:18:41<50:27:40, 10.61s/it]
 55%|█████▍    | 20847/37963 [51:18:49<46:37:21,  9.81s/it]
 55%|█████▍    | 20848/37963 [51:18:56<43:39:40,  9.18s/it]
 55%|█████▍    | 20849/37963 [51:19:04<41:40:40,  8.77s/it]
 55%|█████▍    | 20850/37963 [51:19:12<40:11:19,  8.45s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '1.538', 'learning_rate': '8.895e-06', 'epoch': '0.5492'}
+
 55%|█████▍    | 20850/37963 [51:19:12<40:11:19,  8.45s/it]
 55%|█████▍    | 20851/37963 [51:19:27<48:57:56, 10.30s/it]
 55%|█████▍    | 20852/37963 [51:19:34<45:26:20,  9.56s/it]
 55%|█████▍    | 20853/37963 [51:19:42<42:52:54,  9.02s/it]
 55%|█████▍    | 20854/37963 [51:19:50<41:04:44,  8.64s/it]
 55%|█████▍    | 20855/37963 [51:19:58<39:40:25,  8.35s/it]
 55%|█████▍    | 20856/37963 [51:20:05<38:52:52,  8.18s/it]
 55%|█████▍    | 20857/37963 [51:20:13<37:49:59,  7.96s/it]
 55%|█████▍    | 20858/37963 [51:20:21<37:43:34,  7.94s/it]
 55%|█████▍    | 20859/37963 [51:20:29<37:38:16,  7.92s/it]
 55%|█████▍    | 20860/37963 [51:20:36<37:30:29,  7.90s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '3.026', 'learning_rate': '8.886e-06', 'epoch': '0.5495'}
+
 55%|█████▍    | 20860/37963 [51:20:36<37:30:29,  7.90s/it]
 55%|█████▍    | 20861/37963 [51:20:44<37:13:20,  7.84s/it]
 55%|█████▍    | 20862/37963 [51:20:52<37:04:57,  7.81s/it]
 55%|█████▍    | 20863/37963 [51:21:00<36:58:20,  7.78s/it]
 55%|█████▍    | 20864/37963 [51:21:07<36:35:11,  7.70s/it]
 55%|█████▍    | 20865/37963 [51:21:15<36:40:28,  7.72s/it]
 55%|█████▍    | 20866/37963 [51:21:23<36:45:39,  7.74s/it]
 55%|█████▍    | 20867/37963 [51:21:30<36:44:36,  7.74s/it]
 55%|█████▍    | 20868/37963 [51:21:38<36:33:47,  7.70s/it]
 55%|█████▍    | 20869/37963 [51:21:46<36:38:52,  7.72s/it]
 55%|█████▍    | 20870/37963 [51:21:53<36:26:37,  7.68s/it]
                                                           
{'loss': '0.13', 'grad_norm': '1.772', 'learning_rate': '8.878e-06', 'epoch': '0.5497'}
+
 55%|█████▍    | 20870/37963 [51:21:53<36:26:37,  7.68s/it]
 55%|█████▍    | 20871/37963 [51:22:01<36:34:08,  7.70s/it]
 55%|█████▍    | 20872/37963 [51:22:09<36:24:15,  7.67s/it]
 55%|█████▍    | 20873/37963 [51:22:16<36:30:19,  7.69s/it]
 55%|█████▍    | 20874/37963 [51:22:24<36:36:30,  7.71s/it]
 55%|█████▍    | 20875/37963 [51:22:32<36:43:20,  7.74s/it]
 55%|█████▍    | 20876/37963 [51:22:40<37:01:28,  7.80s/it]
 55%|█████▍    | 20877/37963 [51:23:01<56:29:18, 11.90s/it]
 55%|█████▍    | 20878/37963 [51:23:09<50:51:11, 10.72s/it]
 55%|█████▍    | 20879/37963 [51:23:17<46:22:12,  9.77s/it]
 55%|█████▌    | 20880/37963 [51:23:25<43:32:48,  9.18s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '2.142', 'learning_rate': '8.869e-06', 'epoch': '0.55'}
+
 55%|█████▌    | 20880/37963 [51:23:25<43:32:48,  9.18s/it]
 55%|█████▌    | 20881/37963 [51:23:33<41:28:41,  8.74s/it]
 55%|█████▌    | 20882/37963 [51:23:40<40:03:42,  8.44s/it]
 55%|█████▌    | 20883/37963 [51:23:48<38:58:45,  8.22s/it]
 55%|█████▌    | 20884/37963 [51:24:03<48:29:41, 10.22s/it]
 55%|█████▌    | 20885/37963 [51:24:18<54:51:52, 11.57s/it]
 55%|█████▌    | 20886/37963 [51:24:25<49:26:51, 10.42s/it]
 55%|█████▌    | 20887/37963 [51:24:40<55:13:46, 11.64s/it]
 55%|█████▌    | 20888/37963 [51:24:55<59:48:45, 12.61s/it]
 55%|█████▌    | 20889/37963 [51:25:02<52:31:05, 11.07s/it]
 55%|█████▌    | 20890/37963 [51:25:10<47:44:57, 10.07s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '2.453', 'learning_rate': '8.861e-06', 'epoch': '0.5503'}
+
 55%|█████▌    | 20890/37963 [51:25:10<47:44:57, 10.07s/it]
 55%|█████▌    | 20891/37963 [51:25:18<44:26:37,  9.37s/it]
 55%|█████▌    | 20892/37963 [51:25:25<42:08:12,  8.89s/it]
 55%|█████▌    | 20893/37963 [51:25:33<40:31:38,  8.55s/it]
 55%|█████▌    | 20894/37963 [51:25:41<39:20:09,  8.30s/it]
 55%|█████▌    | 20895/37963 [51:25:55<48:19:08, 10.19s/it]
 55%|█████▌    | 20896/37963 [51:26:04<45:20:49,  9.57s/it]
 55%|█████▌    | 20897/37963 [51:26:11<42:42:10,  9.01s/it]
 55%|█████▌    | 20898/37963 [51:26:19<40:47:28,  8.61s/it]
 55%|█████▌    | 20899/37963 [51:26:27<39:29:45,  8.33s/it]
 55%|█████▌    | 20900/37963 [51:26:42<49:00:50, 10.34s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '2.029', 'learning_rate': '8.853e-06', 'epoch': '0.5505'}
+
 55%|█████▌    | 20900/37963 [51:26:42<49:00:50, 10.34s/it]
 55%|█████▌    | 20901/37963 [51:26:50<45:40:43,  9.64s/it]
 55%|█████▌    | 20902/37963 [51:26:57<42:56:45,  9.06s/it]
 55%|█████▌    | 20903/37963 [51:27:05<41:04:32,  8.67s/it]
 55%|█████▌    | 20904/37963 [51:27:13<39:29:49,  8.34s/it]
 55%|█████▌    | 20905/37963 [51:27:20<38:25:47,  8.11s/it]
 55%|█████▌    | 20906/37963 [51:27:28<37:53:32,  8.00s/it]
 55%|█████▌    | 20907/37963 [51:27:36<37:22:18,  7.89s/it]
 55%|█████▌    | 20908/37963 [51:27:43<37:15:19,  7.86s/it]
 55%|█████▌    | 20909/37963 [51:27:51<37:00:37,  7.81s/it]
 55%|█████▌    | 20910/37963 [51:27:59<36:37:09,  7.73s/it]
                                                           
{'loss': '0.1369', 'grad_norm': '1.81', 'learning_rate': '8.844e-06', 'epoch': '0.5508'}
+
 55%|█████▌    | 20910/37963 [51:27:59<36:37:09,  7.73s/it]
 55%|█████▌    | 20911/37963 [51:28:06<36:36:11,  7.73s/it]
 55%|█████▌    | 20912/37963 [51:28:14<36:41:06,  7.75s/it]
 55%|█████▌    | 20913/37963 [51:28:22<36:32:12,  7.71s/it]
 55%|█████▌    | 20914/37963 [51:28:29<36:28:30,  7.70s/it]
 55%|█████▌    | 20915/37963 [51:28:37<36:15:58,  7.66s/it]
 55%|█████▌    | 20916/37963 [51:28:45<36:06:21,  7.62s/it]
 55%|█████▌    | 20917/37963 [51:28:52<36:14:34,  7.65s/it]
 55%|█████▌    | 20918/37963 [51:29:00<36:25:16,  7.69s/it]
 55%|█████▌    | 20919/37963 [51:29:08<36:38:31,  7.74s/it]
 55%|█████▌    | 20920/37963 [51:29:22<45:32:54,  9.62s/it]
                                                           
{'loss': '0.1387', 'grad_norm': '2.223', 'learning_rate': '8.836e-06', 'epoch': '0.5511'}
+
 55%|█████▌    | 20920/37963 [51:29:22<45:32:54,  9.62s/it]
 55%|█████▌    | 20921/37963 [51:29:37<53:24:34, 11.28s/it]
 55%|█████▌    | 20922/37963 [51:29:45<48:46:10, 10.30s/it]
 55%|█████▌    | 20923/37963 [51:29:53<45:09:22,  9.54s/it]
 55%|█████▌    | 20924/37963 [51:30:01<42:31:53,  8.99s/it]
 55%|█████▌    | 20925/37963 [51:30:08<40:51:03,  8.63s/it]
 55%|█████▌    | 20926/37963 [51:30:16<39:48:16,  8.41s/it]
 55%|█████▌    | 20927/37963 [51:30:24<38:47:39,  8.20s/it]
 55%|█████▌    | 20928/37963 [51:30:31<37:45:08,  7.98s/it]
 55%|█████▌    | 20929/37963 [51:30:46<47:21:59, 10.01s/it]
 55%|█████▌    | 20930/37963 [51:30:54<43:58:04,  9.29s/it]
                                                           
{'loss': '0.1288', 'grad_norm': '1.632', 'learning_rate': '8.827e-06', 'epoch': '0.5513'}
+
 55%|█████▌    | 20930/37963 [51:30:54<43:58:04,  9.29s/it]
 55%|█████▌    | 20931/37963 [51:31:02<41:55:36,  8.86s/it]
 55%|█████▌    | 20932/37963 [51:31:09<40:21:22,  8.53s/it]
 55%|█████▌    | 20933/37963 [51:31:24<49:24:53, 10.45s/it]
 55%|█████▌    | 20934/37963 [51:31:32<45:36:25,  9.64s/it]
 55%|█████▌    | 20935/37963 [51:31:47<52:22:49, 11.07s/it]
 55%|█████▌    | 20936/37963 [51:31:55<48:20:51, 10.22s/it]
 55%|█████▌    | 20937/37963 [51:32:02<44:36:47,  9.43s/it]
 55%|█████▌    | 20938/37963 [51:32:10<42:18:42,  8.95s/it]
 55%|█████▌    | 20939/37963 [51:32:25<50:42:05, 10.72s/it]
 55%|█████▌    | 20940/37963 [51:32:33<46:42:08,  9.88s/it]
                                                           
{'loss': '0.1351', 'grad_norm': '1.067', 'learning_rate': '8.819e-06', 'epoch': '0.5516'}
+
 55%|█████▌    | 20940/37963 [51:32:33<46:42:08,  9.88s/it]
 55%|█████▌    | 20941/37963 [51:32:41<43:38:36,  9.23s/it]
 55%|█████▌    | 20942/37963 [51:32:55<51:11:36, 10.83s/it]
 55%|█████▌    | 20943/37963 [51:33:03<46:49:50,  9.91s/it]
 55%|█████▌    | 20944/37963 [51:33:11<43:57:36,  9.30s/it]
 55%|█████▌    | 20945/37963 [51:33:18<41:30:20,  8.78s/it]
 55%|█████▌    | 20946/37963 [51:33:26<40:04:41,  8.48s/it]
 55%|█████▌    | 20947/37963 [51:33:34<39:02:13,  8.26s/it]
 55%|█████▌    | 20948/37963 [51:33:42<38:29:58,  8.15s/it]
 55%|█████▌    | 20949/37963 [51:33:50<38:09:19,  8.07s/it]
 55%|█████▌    | 20950/37963 [51:34:05<48:09:11, 10.19s/it]
                                                           
{'loss': '0.135', 'grad_norm': '2.307', 'learning_rate': '8.81e-06', 'epoch': '0.5519'}
+
 55%|█████▌    | 20950/37963 [51:34:05<48:09:11, 10.19s/it]
 55%|█████▌    | 20951/37963 [51:34:13<44:41:10,  9.46s/it]
 55%|█████▌    | 20952/37963 [51:34:21<42:35:38,  9.01s/it]
 55%|█████▌    | 20953/37963 [51:34:28<40:51:16,  8.65s/it]
 55%|█████▌    | 20954/37963 [51:34:36<39:35:56,  8.38s/it]
 55%|█████▌    | 20955/37963 [51:34:44<38:41:41,  8.19s/it]
 55%|█████▌    | 20956/37963 [51:34:52<38:34:01,  8.16s/it]
 55%|█████▌    | 20957/37963 [51:35:00<38:03:10,  8.06s/it]
 55%|█████▌    | 20958/37963 [51:35:08<37:39:50,  7.97s/it]
 55%|█████▌    | 20959/37963 [51:35:15<37:20:48,  7.91s/it]
 55%|█████▌    | 20960/37963 [51:35:23<37:06:21,  7.86s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '2.661', 'learning_rate': '8.802e-06', 'epoch': '0.5521'}
+
 55%|█████▌    | 20960/37963 [51:35:23<37:06:21,  7.86s/it]
 55%|█████▌    | 20961/37963 [51:35:31<36:53:49,  7.81s/it]
 55%|█████▌    | 20962/37963 [51:35:38<36:32:47,  7.74s/it]
 55%|█████▌    | 20963/37963 [51:35:46<36:34:53,  7.75s/it]
 55%|█████▌    | 20964/37963 [51:35:54<36:30:12,  7.73s/it]
 55%|█████▌    | 20965/37963 [51:36:08<46:01:40,  9.75s/it]
 55%|█████▌    | 20966/37963 [51:36:16<43:20:20,  9.18s/it]
 55%|█████▌    | 20967/37963 [51:36:24<41:24:01,  8.77s/it]
 55%|█████▌    | 20968/37963 [51:36:31<39:32:21,  8.38s/it]
 55%|█████▌    | 20969/37963 [51:36:39<38:31:37,  8.16s/it]
 55%|█████▌    | 20970/37963 [51:36:53<47:24:55, 10.05s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '1.132', 'learning_rate': '8.793e-06', 'epoch': '0.5524'}
+
 55%|█████▌    | 20970/37963 [51:36:53<47:24:55, 10.05s/it]
 55%|█████▌    | 20971/37963 [51:37:01<44:19:57,  9.39s/it]
 55%|█████▌    | 20972/37963 [51:37:09<41:52:06,  8.87s/it]
 55%|█████▌    | 20973/37963 [51:37:24<50:23:10, 10.68s/it]
 55%|█████▌    | 20974/37963 [51:37:32<46:16:15,  9.80s/it]
 55%|█████▌    | 20975/37963 [51:37:39<43:21:45,  9.19s/it]
 55%|█████▌    | 20976/37963 [51:37:47<41:20:06,  8.76s/it]
 55%|█████▌    | 20977/37963 [51:38:02<49:52:32, 10.57s/it]
 55%|█████▌    | 20978/37963 [51:38:10<45:49:41,  9.71s/it]
 55%|█████▌    | 20979/37963 [51:38:24<52:48:43, 11.19s/it]
 55%|█████▌    | 20980/37963 [51:38:32<47:46:49, 10.13s/it]
                                                           
{'loss': '0.1387', 'grad_norm': '1.927', 'learning_rate': '8.785e-06', 'epoch': '0.5526'}
+
 55%|█████▌    | 20980/37963 [51:38:32<47:46:49, 10.13s/it]
 55%|█████▌    | 20981/37963 [51:38:40<44:12:56,  9.37s/it]
 55%|█████▌    | 20982/37963 [51:38:47<41:59:01,  8.90s/it]
 55%|█████▌    | 20983/37963 [51:38:55<40:11:11,  8.52s/it]
 55%|█████▌    | 20984/37963 [51:39:02<38:43:22,  8.21s/it]
 55%|█████▌    | 20985/37963 [51:39:10<38:02:24,  8.07s/it]
 55%|█████▌    | 20986/37963 [51:39:18<37:13:51,  7.89s/it]
 55%|█████▌    | 20987/37963 [51:39:25<37:02:39,  7.86s/it]
 55%|█████▌    | 20988/37963 [51:39:33<36:44:27,  7.79s/it]
 55%|█████▌    | 20989/37963 [51:39:41<36:26:32,  7.73s/it]
 55%|█████▌    | 20990/37963 [51:39:55<45:26:02,  9.64s/it]
                                                           
{'loss': '0.126', 'grad_norm': '1.574', 'learning_rate': '8.776e-06', 'epoch': '0.5529'}
+
 55%|█████▌    | 20990/37963 [51:39:55<45:26:02,  9.64s/it]
 55%|█████▌    | 20991/37963 [51:40:02<42:37:35,  9.04s/it]
 55%|█████▌    | 20992/37963 [51:40:10<40:31:29,  8.60s/it]
 55%|█████▌    | 20993/37963 [51:40:25<49:37:41, 10.53s/it]
 55%|█████▌    | 20994/37963 [51:40:33<45:34:26,  9.67s/it]
 55%|█████▌    | 20995/37963 [51:40:40<42:40:12,  9.05s/it]
 55%|█████▌    | 20996/37963 [51:40:48<40:53:44,  8.68s/it]
 55%|█████▌    | 20997/37963 [51:40:56<39:16:56,  8.34s/it]
 55%|█████▌    | 20998/37963 [51:41:03<37:48:10,  8.02s/it]
 55%|█████▌    | 20999/37963 [51:41:10<37:05:15,  7.87s/it]
 55%|█████▌    | 21000/37963 [51:41:18<36:58:58,  7.85s/it]
                                                           
{'loss': '0.1411', 'grad_norm': '1.788', 'learning_rate': '8.768e-06', 'epoch': '0.5532'}
+
 55%|█████▌    | 21000/37963 [51:41:18<36:58:58,  7.85s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:12<00:00, 12.23s/it]
Writing model shards: 100%|██████████| 1/1 [00:12<00:00, 12.23s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 55%|█████▌    | 21001/37963 [51:42:22<115:56:26, 24.61s/it]
 55%|█████▌    | 21002/37963 [51:42:38<103:10:00, 21.90s/it]
 55%|█████▌    | 21003/37963 [51:42:45<83:13:59, 17.67s/it] 
 55%|█████▌    | 21004/37963 [51:42:53<69:03:13, 14.66s/it]
 55%|█████▌    | 21005/37963 [51:43:01<59:16:39, 12.58s/it]
 55%|█████▌    | 21006/37963 [51:43:09<52:32:51, 11.16s/it]
 55%|█████▌    | 21007/37963 [51:43:16<47:57:48, 10.18s/it]
 55%|█████▌    | 21008/37963 [51:43:24<44:35:48,  9.47s/it]
 55%|█████▌    | 21009/37963 [51:43:32<42:13:31,  8.97s/it]
 55%|█████▌    | 21010/37963 [51:43:39<40:03:41,  8.51s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '2.893', 'learning_rate': '8.759e-06', 'epoch': '0.5534'}
+
 55%|█████▌    | 21010/37963 [51:43:40<40:03:41,  8.51s/it]
 55%|█████▌    | 21011/37963 [51:43:47<39:01:45,  8.29s/it]
 55%|█████▌    | 21012/37963 [51:44:02<47:47:21, 10.15s/it]
 55%|█████▌    | 21013/37963 [51:44:10<44:33:26,  9.46s/it]
 55%|█████▌    | 21014/37963 [51:44:17<42:12:50,  8.97s/it]
 55%|█████▌    | 21015/37963 [51:44:25<40:33:28,  8.62s/it]
 55%|█████▌    | 21016/37963 [51:44:33<39:23:32,  8.37s/it]
 55%|█████▌    | 21017/37963 [51:44:41<38:08:18,  8.10s/it]
 55%|█████▌    | 21018/37963 [51:44:48<37:50:04,  8.04s/it]
 55%|█████▌    | 21019/37963 [51:44:56<37:27:03,  7.96s/it]
 55%|█████▌    | 21020/37963 [51:45:11<47:10:45, 10.02s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '1.081', 'learning_rate': '8.751e-06', 'epoch': '0.5537'}
+
 55%|█████▌    | 21020/37963 [51:45:11<47:10:45, 10.02s/it]
 55%|█████▌    | 21021/37963 [51:45:19<44:24:59,  9.44s/it]
 55%|█████▌    | 21022/37963 [51:45:27<42:01:15,  8.93s/it]
 55%|█████▌    | 21023/37963 [51:45:42<50:34:39, 10.75s/it]
 55%|█████▌    | 21024/37963 [51:45:57<57:03:49, 12.13s/it]
 55%|█████▌    | 21025/37963 [51:46:05<50:52:00, 10.81s/it]
 55%|█████▌    | 21026/37963 [51:46:12<46:12:15,  9.82s/it]
 55%|█████▌    | 21027/37963 [51:46:20<43:22:39,  9.22s/it]
 55%|█████▌    | 21028/37963 [51:46:28<41:20:18,  8.79s/it]
 55%|█████▌    | 21029/37963 [51:46:42<49:04:58, 10.43s/it]
 55%|█████▌    | 21030/37963 [51:46:50<45:35:50,  9.69s/it]
                                                           
{'loss': '0.1404', 'grad_norm': '1.767', 'learning_rate': '8.742e-06', 'epoch': '0.554'}
+
 55%|█████▌    | 21030/37963 [51:46:50<45:35:50,  9.69s/it]
 55%|█████▌    | 21031/37963 [51:46:58<42:54:00,  9.12s/it]
 55%|█████▌    | 21032/37963 [51:47:06<41:08:38,  8.75s/it]
 55%|█████▌    | 21033/37963 [51:47:14<39:59:51,  8.51s/it]
 55%|█████▌    | 21034/37963 [51:47:22<39:13:48,  8.34s/it]
 55%|█████▌    | 21035/37963 [51:47:36<47:51:24, 10.18s/it]
 55%|█████▌    | 21036/37963 [51:47:44<44:31:47,  9.47s/it]
 55%|█████▌    | 21037/37963 [51:47:52<41:46:06,  8.88s/it]
 55%|█████▌    | 21038/37963 [51:47:59<40:14:02,  8.56s/it]
 55%|█████▌    | 21039/37963 [51:48:07<38:51:16,  8.26s/it]
 55%|█████▌    | 21040/37963 [51:48:22<47:59:42, 10.21s/it]
                                                           
{'loss': '0.149', 'grad_norm': '2.352', 'learning_rate': '8.734e-06', 'epoch': '0.5542'}
+
 55%|█████▌    | 21040/37963 [51:48:22<47:59:42, 10.21s/it]
 55%|█████▌    | 21041/37963 [51:48:29<44:31:05,  9.47s/it]
 55%|█████▌    | 21042/37963 [51:48:37<42:02:10,  8.94s/it]
 55%|█████▌    | 21043/37963 [51:48:45<40:37:03,  8.64s/it]
 55%|█████▌    | 21044/37963 [51:48:53<39:21:23,  8.37s/it]
 55%|█████▌    | 21045/37963 [51:49:01<38:28:02,  8.19s/it]
 55%|█████▌    | 21046/37963 [51:49:08<37:48:30,  8.05s/it]
 55%|█████▌    | 21047/37963 [51:49:16<37:32:44,  7.99s/it]
 55%|█████▌    | 21048/37963 [51:49:24<36:52:38,  7.85s/it]
 55%|█████▌    | 21049/37963 [51:49:31<36:28:42,  7.76s/it]
 55%|█████▌    | 21050/37963 [51:49:39<36:26:51,  7.76s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '1.697', 'learning_rate': '8.725e-06', 'epoch': '0.5545'}
+
 55%|█████▌    | 21050/37963 [51:49:39<36:26:51,  7.76s/it]
 55%|█████▌    | 21051/37963 [51:49:47<36:30:03,  7.77s/it]
 55%|█████▌    | 21052/37963 [51:49:55<36:37:16,  7.80s/it]
 55%|█████▌    | 21053/37963 [51:50:02<36:21:59,  7.74s/it]
 55%|█████▌    | 21054/37963 [51:50:17<46:42:25,  9.94s/it]
 55%|█████▌    | 21055/37963 [51:50:25<43:41:41,  9.30s/it]
 55%|█████▌    | 21056/37963 [51:50:33<41:23:03,  8.81s/it]
 55%|█████▌    | 21057/37963 [51:50:40<39:32:54,  8.42s/it]
 55%|█████▌    | 21058/37963 [51:50:48<38:33:15,  8.21s/it]
 55%|█████▌    | 21059/37963 [51:50:56<37:47:08,  8.05s/it]
 55%|█████▌    | 21060/37963 [51:51:03<37:20:13,  7.95s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '3.225', 'learning_rate': '8.717e-06', 'epoch': '0.5548'}
+
 55%|█████▌    | 21060/37963 [51:51:03<37:20:13,  7.95s/it]
 55%|█████▌    | 21061/37963 [51:51:18<46:25:06,  9.89s/it]
 55%|█████▌    | 21062/37963 [51:51:26<43:15:29,  9.21s/it]
 55%|█████▌    | 21063/37963 [51:51:33<41:21:04,  8.81s/it]
 55%|█████▌    | 21064/37963 [51:51:41<39:49:38,  8.48s/it]
 55%|█████▌    | 21065/37963 [51:51:49<38:52:44,  8.28s/it]
 55%|█████▌    | 21066/37963 [51:51:57<38:16:31,  8.15s/it]
 55%|█████▌    | 21067/37963 [51:52:04<37:30:14,  7.99s/it]
 55%|█████▌    | 21068/37963 [51:52:19<46:16:03,  9.86s/it]
 55%|█████▌    | 21069/37963 [51:52:27<43:30:04,  9.27s/it]
 56%|█████▌    | 21070/37963 [51:52:34<41:25:35,  8.83s/it]
                                                           
{'loss': '0.1429', 'grad_norm': '1.337', 'learning_rate': '8.709e-06', 'epoch': '0.555'}
+
 56%|█████▌    | 21070/37963 [51:52:34<41:25:35,  8.83s/it]
 56%|█████▌    | 21071/37963 [51:52:50<50:35:25, 10.78s/it]
 56%|█████▌    | 21072/37963 [51:52:58<47:01:17, 10.02s/it]
 56%|█████▌    | 21073/37963 [51:53:06<43:52:49,  9.35s/it]
 56%|█████▌    | 21074/37963 [51:53:13<41:30:33,  8.85s/it]
 56%|█████▌    | 21075/37963 [51:53:21<39:46:16,  8.48s/it]
 56%|█████▌    | 21076/37963 [51:53:29<38:44:19,  8.26s/it]
 56%|█████▌    | 21077/37963 [51:53:44<48:18:48, 10.30s/it]
 56%|█████▌    | 21078/37963 [51:53:58<54:16:31, 11.57s/it]
 56%|█████▌    | 21079/37963 [51:54:06<48:48:15, 10.41s/it]
 56%|█████▌    | 21080/37963 [51:54:14<45:03:27,  9.61s/it]
                                                           
{'loss': '0.1281', 'grad_norm': '1.856', 'learning_rate': '8.7e-06', 'epoch': '0.5553'}
+
 56%|█████▌    | 21080/37963 [51:54:14<45:03:27,  9.61s/it]
 56%|█████▌    | 21081/37963 [51:54:22<42:29:17,  9.06s/it]
 56%|█████▌    | 21082/37963 [51:54:29<40:47:18,  8.70s/it]
 56%|█████▌    | 21083/37963 [51:54:44<49:11:03, 10.49s/it]
 56%|█████▌    | 21084/37963 [51:54:59<55:39:36, 11.87s/it]
 56%|█████▌    | 21085/37963 [51:55:07<50:09:16, 10.70s/it]
 56%|█████▌    | 21086/37963 [51:55:15<45:37:55,  9.73s/it]
 56%|█████▌    | 21087/37963 [51:55:22<42:29:14,  9.06s/it]
 56%|█████▌    | 21088/37963 [51:55:30<40:42:04,  8.68s/it]
 56%|█████▌    | 21089/37963 [51:55:38<39:32:48,  8.44s/it]
 56%|█████▌    | 21090/37963 [51:55:46<38:44:19,  8.27s/it]
                                                           
{'loss': '0.1437', 'grad_norm': '1.16', 'learning_rate': '8.692e-06', 'epoch': '0.5555'}
+
 56%|█████▌    | 21090/37963 [51:55:46<38:44:19,  8.27s/it]
 56%|█████▌    | 21091/37963 [51:55:53<37:40:31,  8.04s/it]
 56%|█████▌    | 21092/37963 [51:56:01<37:15:31,  7.95s/it]
 56%|█████▌    | 21093/37963 [51:56:09<36:59:59,  7.90s/it]
 56%|█████▌    | 21094/37963 [51:56:16<36:44:00,  7.84s/it]
 56%|█████▌    | 21095/37963 [51:56:24<36:46:57,  7.85s/it]
 56%|█████▌    | 21096/37963 [51:56:32<37:04:55,  7.91s/it]
 56%|█████▌    | 21097/37963 [51:56:40<36:54:39,  7.88s/it]
 56%|█████▌    | 21098/37963 [51:56:48<36:32:30,  7.80s/it]
 56%|█████▌    | 21099/37963 [51:56:55<36:23:16,  7.77s/it]
 56%|█████▌    | 21100/37963 [51:57:03<36:28:45,  7.79s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '1.209', 'learning_rate': '8.683e-06', 'epoch': '0.5558'}
+
 56%|█████▌    | 21100/37963 [51:57:03<36:28:45,  7.79s/it]
 56%|█████▌    | 21101/37963 [51:57:11<36:26:05,  7.78s/it]
 56%|█████▌    | 21102/37963 [51:57:26<46:29:43,  9.93s/it]
 56%|█████▌    | 21103/37963 [51:57:34<43:55:58,  9.38s/it]
 56%|█████▌    | 21104/37963 [51:57:42<41:49:26,  8.93s/it]
 56%|█████▌    | 21105/37963 [51:57:50<40:14:58,  8.60s/it]
 56%|█████▌    | 21106/37963 [51:57:57<38:59:54,  8.33s/it]
 56%|█████▌    | 21107/37963 [51:58:05<38:23:18,  8.20s/it]
 56%|█████▌    | 21108/37963 [51:58:20<47:28:28, 10.14s/it]
 56%|█████▌    | 21109/37963 [51:58:28<44:28:15,  9.50s/it]
 56%|█████▌    | 21110/37963 [51:58:36<41:56:28,  8.96s/it]
                                                           
{'loss': '0.1411', 'grad_norm': '1.261', 'learning_rate': '8.675e-06', 'epoch': '0.5561'}
+
 56%|█████▌    | 21110/37963 [51:58:36<41:56:28,  8.96s/it]
 56%|█████▌    | 21111/37963 [51:58:43<40:01:29,  8.55s/it]
 56%|█████▌    | 21112/37963 [51:58:51<39:05:35,  8.35s/it]
 56%|█████▌    | 21113/37963 [51:58:59<38:18:19,  8.18s/it]
 56%|█████▌    | 21114/37963 [51:59:14<47:43:50, 10.20s/it]
 56%|█████▌    | 21115/37963 [51:59:22<44:17:47,  9.47s/it]
 56%|█████▌    | 21116/37963 [51:59:29<41:51:00,  8.94s/it]
 56%|█████▌    | 21117/37963 [51:59:37<40:06:09,  8.57s/it]
 56%|█████▌    | 21118/37963 [51:59:45<39:08:12,  8.36s/it]
 56%|██���██▌    | 21119/37963 [51:59:53<38:04:50,  8.14s/it]
 56%|█████▌    | 21120/37963 [52:00:00<37:32:05,  8.02s/it]
                                                           
{'loss': '0.1503', 'grad_norm': '2.741', 'learning_rate': '8.666e-06', 'epoch': '0.5563'}
+
 56%|█████▌    | 21120/37963 [52:00:00<37:32:05,  8.02s/it]
 56%|█████▌    | 21121/37963 [52:00:15<47:08:46, 10.08s/it]
 56%|█████▌    | 21122/37963 [52:00:30<53:43:16, 11.48s/it]
 56%|█████▌    | 21123/37963 [52:00:45<58:25:11, 12.49s/it]
 56%|█████▌    | 21124/37963 [52:00:53<52:17:35, 11.18s/it]
 56%|█████▌    | 21125/37963 [52:01:01<47:21:50, 10.13s/it]
 56%|█████▌    | 21126/37963 [52:01:08<43:56:03,  9.39s/it]
 56%|█████▌    | 21127/37963 [52:01:16<41:38:20,  8.90s/it]
 56%|█████▌    | 21128/37963 [52:01:24<39:41:40,  8.49s/it]
 56%|█████▌    | 21129/37963 [52:01:38<47:47:57, 10.22s/it]
 56%|█████▌    | 21130/37963 [52:01:45<44:04:14,  9.43s/it]
                                                           
{'loss': '0.1528', 'grad_norm': '2.228', 'learning_rate': '8.658e-06', 'epoch': '0.5566'}
+
 56%|█████▌    | 21130/37963 [52:01:45<44:04:14,  9.43s/it]
 56%|█████▌    | 21131/37963 [52:02:00<51:00:53, 10.91s/it]
 56%|█████▌    | 21132/37963 [52:02:08<46:34:53,  9.96s/it]
 56%|█████▌    | 21133/37963 [52:02:15<43:31:10,  9.31s/it]
 56%|█████▌    | 21134/37963 [52:02:23<41:16:22,  8.83s/it]
 56%|█████▌    | 21135/37963 [52:02:31<39:29:31,  8.45s/it]
 56%|█████▌    | 21136/37963 [52:02:38<38:26:04,  8.22s/it]
 56%|█████▌    | 21137/37963 [52:02:46<37:31:22,  8.03s/it]
 56%|█████▌    | 21138/37963 [52:02:54<37:15:38,  7.97s/it]
 56%|█████▌    | 21139/37963 [52:03:01<37:02:06,  7.92s/it]
 56%|█████▌    | 21140/37963 [52:03:09<36:27:14,  7.80s/it]
                                                           
{'loss': '0.148', 'grad_norm': '2.947', 'learning_rate': '8.649e-06', 'epoch': '0.5569'}
+
 56%|█████▌    | 21140/37963 [52:03:09<36:27:14,  7.80s/it]
 56%|█████▌    | 21141/37963 [52:03:17<36:16:45,  7.76s/it]
 56%|█████▌    | 21142/37963 [52:03:25<36:27:37,  7.80s/it]
 56%|█████▌    | 21143/37963 [52:03:32<36:14:46,  7.76s/it]
 56%|█████▌    | 21144/37963 [52:03:40<36:26:10,  7.80s/it]
 56%|█████▌    | 21145/37963 [52:03:48<35:59:42,  7.71s/it]
 56%|█████▌    | 21146/37963 [52:03:55<36:01:54,  7.71s/it]
 56%|█████▌    | 21147/37963 [52:04:03<36:09:34,  7.74s/it]
 56%|█████▌    | 21148/37963 [52:04:11<36:39:47,  7.85s/it]
 56%|█████▌    | 21149/37963 [52:04:19<36:36:24,  7.84s/it]
 56%|█████▌    | 21150/37963 [52:04:27<36:28:36,  7.81s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '1.34', 'learning_rate': '8.641e-06', 'epoch': '0.5571'}
+
 56%|█████▌    | 21150/37963 [52:04:27<36:28:36,  7.81s/it]
 56%|█████▌    | 21151/37963 [52:04:35<36:39:14,  7.85s/it]
 56%|█████▌    | 21152/37963 [52:04:43<36:45:42,  7.87s/it]
 56%|█████▌    | 21153/37963 [52:04:50<36:19:57,  7.78s/it]
 56%|█████▌    | 21154/37963 [52:04:58<36:28:54,  7.81s/it]
 56%|█████▌    | 21155/37963 [52:05:13<46:05:22,  9.87s/it]
 56%|█████▌    | 21156/37963 [52:05:21<43:31:44,  9.32s/it]
 56%|█████▌    | 21157/37963 [52:05:29<41:15:38,  8.84s/it]
 56%|█████▌    | 21158/37963 [52:05:36<39:22:41,  8.44s/it]
 56%|█████▌    | 21159/37963 [52:05:51<48:13:23, 10.33s/it]
 56%|█████▌    | 21160/37963 [52:05:59<44:37:06,  9.56s/it]
                                                           
{'loss': '0.1423', 'grad_norm': '2.267', 'learning_rate': '8.632e-06', 'epoch': '0.5574'}
+
 56%|█████▌    | 21160/37963 [52:05:59<44:37:06,  9.56s/it]
 56%|█████▌    | 21161/37963 [52:06:13<51:29:44, 11.03s/it]
 56%|█████▌    | 21162/37963 [52:06:21<47:25:27, 10.16s/it]
 56%|█████▌    | 21163/37963 [52:06:29<44:04:20,  9.44s/it]
 56%|█████▌    | 21164/37963 [52:06:37<41:55:53,  8.99s/it]
 56%|█████▌    | 21165/37963 [52:06:52<50:13:20, 10.76s/it]
 56%|█████▌    | 21166/37963 [52:07:00<46:11:23,  9.90s/it]
 56%|█████▌    | 21167/37963 [52:07:07<43:17:22,  9.28s/it]
 56%|█████▌    | 21168/37963 [52:07:15<41:09:46,  8.82s/it]
 56%|█████▌    | 21169/37963 [52:07:23<39:34:42,  8.48s/it]
 56%|█████▌    | 21170/37963 [52:07:30<38:04:36,  8.16s/it]
                                                           
{'loss': '0.1216', 'grad_norm': '2.378', 'learning_rate': '8.624e-06', 'epoch': '0.5577'}
+
 56%|█████▌    | 21170/37963 [52:07:30<38:04:36,  8.16s/it]
 56%|█████▌    | 21171/37963 [52:07:38<37:53:45,  8.12s/it]
 56%|█████▌    | 21172/37963 [52:07:46<37:10:04,  7.97s/it]
 56%|█████▌    | 21173/37963 [52:08:01<46:27:43,  9.96s/it]
 56%|█████▌    | 21174/37963 [52:08:15<53:00:29, 11.37s/it]
 56%|█████▌    | 21175/37963 [52:08:23<48:04:28, 10.31s/it]
 56%|█████▌    | 21176/37963 [52:08:38<54:08:40, 11.61s/it]
 56%|█████▌    | 21177/37963 [52:08:46<49:11:02, 10.55s/it]
 56%|█████▌    | 21178/37963 [52:08:54<45:21:34,  9.73s/it]
 56%|█████▌    | 21179/37963 [52:09:01<42:35:14,  9.13s/it]
 56%|█████▌    | 21180/37963 [52:09:09<40:34:39,  8.70s/it]
                                                           
{'loss': '0.134', 'grad_norm': '3.712', 'learning_rate': '8.616e-06', 'epoch': '0.5579'}
+
 56%|█████▌    | 21180/37963 [52:09:09<40:34:39,  8.70s/it]
 56%|█████▌    | 21181/37963 [52:09:17<38:57:52,  8.36s/it]
 56%|█████▌    | 21182/37963 [52:09:24<38:12:32,  8.20s/it]
 56%|█████▌    | 21183/37963 [52:09:32<37:34:55,  8.06s/it]
 56%|█████▌    | 21184/37963 [52:09:40<37:08:51,  7.97s/it]
 56%|█████▌    | 21185/37963 [52:09:48<36:58:59,  7.94s/it]
 56%|█████▌    | 21186/37963 [52:10:03<46:51:38, 10.06s/it]
 56%|█████▌    | 21187/37963 [52:10:11<43:44:57,  9.39s/it]
 56%|█████▌    | 21188/37963 [52:10:18<41:02:33,  8.81s/it]
 56%|█████▌    | 21189/37963 [52:10:26<39:34:52,  8.49s/it]
 56%|█████▌    | 21190/37963 [52:10:33<38:07:46,  8.18s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '1.838', 'learning_rate': '8.607e-06', 'epoch': '0.5582'}
+
 56%|█████▌    | 21190/37963 [52:10:33<38:07:46,  8.18s/it]
 56%|█████▌    | 21191/37963 [52:10:41<37:46:13,  8.11s/it]
 56%|█████▌    | 21192/37963 [52:10:49<37:13:04,  7.99s/it]
 56%|█████▌    | 21193/37963 [52:10:57<36:59:40,  7.94s/it]
 56%|█████▌    | 21194/37963 [52:11:05<36:59:45,  7.94s/it]
 56%|█████▌    | 21195/37963 [52:11:12<36:44:20,  7.89s/it]
 56%|█████▌    | 21196/37963 [52:11:20<36:33:13,  7.85s/it]
 56%|█████▌    | 21197/37963 [52:11:28<36:23:11,  7.81s/it]
 56%|█████▌    | 21198/37963 [52:11:36<36:22:31,  7.81s/it]
 56%|█████▌    | 21199/37963 [52:11:51<46:12:50,  9.92s/it]
 56%|█████▌    | 21200/37963 [52:11:58<43:12:46,  9.28s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '1.658', 'learning_rate': '8.599e-06', 'epoch': '0.5584'}
+
 56%|█████▌    | 21200/37963 [52:11:58<43:12:46,  9.28s/it]
 56%|█████▌    | 21201/37963 [52:12:06<40:55:26,  8.79s/it]
 56%|█████▌    | 21202/37963 [52:12:14<39:35:13,  8.50s/it]
 56%|█████▌    | 21203/37963 [52:12:21<38:16:50,  8.22s/it]
 56%|█████▌    | 21204/37963 [52:12:29<37:23:41,  8.03s/it]
 56%|█████▌    | 21205/37963 [52:12:37<37:00:56,  7.95s/it]
 56%|█████▌    | 21206/37963 [52:12:44<36:20:23,  7.81s/it]
 56%|█████▌    | 21207/37963 [52:12:52<36:28:02,  7.83s/it]
 56%|█████▌    | 21208/37963 [52:13:00<36:14:24,  7.79s/it]
 56%|█████▌    | 21209/37963 [52:13:14<45:00:26,  9.67s/it]
 56%|█████▌    | 21210/37963 [52:13:22<42:31:00,  9.14s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '1.079', 'learning_rate': '8.59e-06', 'epoch': '0.5587'}
+
 56%|█████▌    | 21210/37963 [52:13:22<42:31:00,  9.14s/it]
 56%|█████▌    | 21211/37963 [52:13:29<40:20:19,  8.67s/it]
 56%|█████▌    | 21212/37963 [52:13:44<49:09:32, 10.56s/it]
 56%|█████▌    | 21213/37963 [52:13:59<54:42:46, 11.76s/it]
 56%|█████▌    | 21214/37963 [52:14:07<48:56:35, 10.52s/it]
 56%|█████▌    | 21215/37963 [52:14:14<45:07:17,  9.70s/it]
 56%|█████▌    | 21216/37963 [52:14:22<42:21:18,  9.10s/it]
 56%|█████▌    | 21217/37963 [52:14:30<40:25:47,  8.69s/it]
 56%|█████▌    | 21218/37963 [52:14:37<38:43:20,  8.32s/it]
 56%|█████▌    | 21219/37963 [52:14:45<37:57:44,  8.16s/it]
 56%|█████▌    | 21220/37963 [52:14:53<37:24:55,  8.04s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '2.354', 'learning_rate': '8.582e-06', 'epoch': '0.559'}
+
 56%|█████▌    | 21220/37963 [52:14:53<37:24:55,  8.04s/it]
 56%|█████▌    | 21221/37963 [52:15:14<55:52:41, 12.02s/it]
 56%|█████▌    | 21222/37963 [52:15:29<59:18:07, 12.75s/it]
 56%|█████▌    | 21223/37963 [52:15:37<52:50:38, 11.36s/it]
 56%|█████▌    | 21224/37963 [52:15:44<47:49:28, 10.29s/it]
 56%|█████▌    | 21225/37963 [52:15:52<44:25:40,  9.56s/it]
 56%|█████▌    | 21226/37963 [52:16:00<41:21:47,  8.90s/it]
 56%|█████▌    | 21227/37963 [52:16:07<39:45:59,  8.55s/it]
 56%|█████▌    | 21228/37963 [52:16:15<38:30:01,  8.28s/it]
 56%|█████▌    | 21229/37963 [52:16:23<37:44:06,  8.12s/it]
 56%|█████▌    | 21230/37963 [52:16:30<37:01:59,  7.97s/it]
                                                           
{'loss': '0.145', 'grad_norm': '1.606', 'learning_rate': '8.573e-06', 'epoch': '0.5592'}
+
 56%|█████▌    | 21230/37963 [52:16:30<37:01:59,  7.97s/it]
 56%|█████▌    | 21231/37963 [52:16:38<36:33:56,  7.87s/it]
 56%|█████▌    | 21232/37963 [52:16:46<36:22:04,  7.83s/it]
 56%|█████▌    | 21233/37963 [52:17:01<46:18:34,  9.97s/it]
 56%|█████▌    | 21234/37963 [52:17:08<43:15:49,  9.31s/it]
 56%|█████▌    | 21235/37963 [52:17:16<41:13:23,  8.87s/it]
 56%|█████▌    | 21236/37963 [52:17:24<39:46:47,  8.56s/it]
 56%|█████▌    | 21237/37963 [52:17:32<38:34:02,  8.30s/it]
 56%|█████▌    | 21238/37963 [52:17:40<37:39:19,  8.11s/it]
 56%|█████▌    | 21239/37963 [52:17:47<37:27:41,  8.06s/it]
 56%|█████▌    | 21240/37963 [52:17:55<37:00:35,  7.97s/it]
                                                           
{'loss': '0.136', 'grad_norm': '1.502', 'learning_rate': '8.565e-06', 'epoch': '0.5595'}
+
 56%|█████▌    | 21240/37963 [52:17:55<37:00:35,  7.97s/it]
 56%|█████▌    | 21241/37963 [52:18:03<36:27:17,  7.85s/it]
 56%|█████▌    | 21242/37963 [52:18:11<36:26:29,  7.85s/it]
 56%|█████▌    | 21243/37963 [52:18:18<36:18:10,  7.82s/it]
 56%|█████▌    | 21244/37963 [52:18:26<36:14:15,  7.80s/it]
 56%|█████▌    | 21245/37963 [52:18:33<35:35:03,  7.66s/it]
 56%|█████▌    | 21246/37963 [52:18:41<35:40:17,  7.68s/it]
 56%|█████▌    | 21247/37963 [52:18:49<35:50:37,  7.72s/it]
 56%|█████▌    | 21248/37963 [52:18:57<35:59:25,  7.75s/it]
 56%|█████▌    | 21249/37963 [52:19:12<46:09:01,  9.94s/it]
 56%|█████▌    | 21250/37963 [52:19:20<43:35:43,  9.39s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '2.806', 'learning_rate': '8.556e-06', 'epoch': '0.5598'}
+
 56%|█████▌    | 21250/37963 [52:19:20<43:35:43,  9.39s/it]
 56%|█████▌    | 21251/37963 [52:19:28<41:12:29,  8.88s/it]
 56%|█████▌    | 21252/37963 [52:19:35<39:38:25,  8.54s/it]
 56%|█████▌    | 21253/37963 [52:19:43<38:43:40,  8.34s/it]
 56%|█████▌    | 21254/37963 [52:19:51<37:47:10,  8.14s/it]
 56%|█████▌    | 21255/37963 [52:19:59<37:15:43,  8.03s/it]
 56%|█████▌    | 21256/37963 [52:20:07<36:53:11,  7.95s/it]
 56%|█████▌    | 21257/37963 [52:20:14<36:38:21,  7.90s/it]
 56%|█████▌    | 21258/37963 [52:20:22<36:28:22,  7.86s/it]
 56%|█████▌    | 21259/37963 [52:20:30<36:36:36,  7.89s/it]
 56%|█████▌    | 21260/37963 [52:20:44<45:29:53,  9.81s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '2.841', 'learning_rate': '8.548e-06', 'epoch': '0.56'}
+
 56%|█████▌    | 21260/37963 [52:20:44<45:29:53,  9.81s/it]
 56%|█████▌    | 21261/37963 [52:20:52<42:48:44,  9.23s/it]
 56%|█████▌    | 21262/37963 [52:21:00<40:40:05,  8.77s/it]
 56%|█████▌    | 21263/37963 [52:21:14<47:56:45, 10.34s/it]
 56%|█████▌    | 21264/37963 [52:21:22<44:20:30,  9.56s/it]
 56%|█████▌    | 21265/37963 [52:21:36<51:11:28, 11.04s/it]
 56%|█████▌    | 21266/37963 [52:21:52<57:15:26, 12.35s/it]
 56%|█████▌    | 21267/37963 [52:21:59<51:11:18, 11.04s/it]
 56%|█████▌    | 21268/37963 [52:22:15<56:51:35, 12.26s/it]
 56%|█████▌    | 21269/37963 [52:22:22<50:45:18, 10.95s/it]
 56%|█████▌    | 21270/37963 [52:22:30<46:10:59,  9.96s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '1.049', 'learning_rate': '8.54e-06', 'epoch': '0.5603'}
+
 56%|█████▌    | 21270/37963 [52:22:30<46:10:59,  9.96s/it]
 56%|█████▌    | 21271/37963 [52:22:38<43:11:59,  9.32s/it]
 56%|█████▌    | 21272/37963 [52:22:46<41:04:47,  8.86s/it]
 56%|█████▌    | 21273/37963 [52:22:54<39:34:26,  8.54s/it]
 56%|█████▌    | 21274/37963 [52:23:01<38:44:57,  8.36s/it]
 56%|█████▌    | 21275/37963 [52:23:16<47:37:36, 10.27s/it]
 56%|█████▌    | 21276/37963 [52:23:24<44:31:13,  9.60s/it]
 56%|█████▌    | 21277/37963 [52:23:32<42:00:53,  9.06s/it]
 56%|█████▌    | 21278/37963 [52:23:40<40:08:35,  8.66s/it]
 56%|█████▌    | 21279/37963 [52:23:54<48:25:49, 10.45s/it]
 56%|█████▌    | 21280/37963 [52:24:02<44:49:57,  9.67s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '1.841', 'learning_rate': '8.531e-06', 'epoch': '0.5605'}
+
 56%|█████▌    | 21280/37963 [52:24:02<44:49:57,  9.67s/it]
 56%|█████▌    | 21281/37963 [52:24:10<41:52:26,  9.04s/it]
 56%|█████▌    | 21282/37963 [52:24:17<39:54:47,  8.61s/it]
 56%|█████▌    | 21283/37963 [52:24:25<38:42:55,  8.36s/it]
 56%|█████▌    | 21284/37963 [52:24:33<37:30:15,  8.09s/it]
 56%|█████▌    | 21285/37963 [52:24:41<37:26:02,  8.08s/it]
 56%|█████▌    | 21286/37963 [52:24:49<37:10:43,  8.03s/it]
 56%|█████▌    | 21287/37963 [52:24:56<36:46:56,  7.94s/it]
 56%|█████▌    | 21288/37963 [52:25:04<36:29:16,  7.88s/it]
 56%|█████▌    | 21289/37963 [52:25:12<35:48:17,  7.73s/it]
 56%|█████▌    | 21290/37963 [52:25:19<36:09:16,  7.81s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '0.9028', 'learning_rate': '8.523e-06', 'epoch': '0.5608'}
+
 56%|█████▌    | 21290/37963 [52:25:19<36:09:16,  7.81s/it]
 56%|█████▌    | 21291/37963 [52:25:27<36:12:00,  7.82s/it]
 56%|█████▌    | 21292/37963 [52:25:35<36:11:24,  7.82s/it]
 56%|█████▌    | 21293/37963 [52:25:43<36:22:21,  7.85s/it]
 56%|█████▌    | 21294/37963 [52:25:51<36:13:15,  7.82s/it]
 56%|█████▌    | 21295/37963 [52:25:58<35:55:45,  7.76s/it]
 56%|█████▌    | 21296/37963 [52:26:06<35:47:44,  7.73s/it]
 56%|█████▌    | 21297/37963 [52:26:21<46:18:00, 10.00s/it]
 56%|█████▌    | 21298/37963 [52:26:29<43:17:57,  9.35s/it]
 56%|█████▌    | 21299/37963 [52:26:37<40:45:20,  8.80s/it]
 56%|█████▌    | 21300/37963 [52:26:45<39:20:06,  8.50s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '1.877', 'learning_rate': '8.514e-06', 'epoch': '0.5611'}
+
 56%|█████▌    | 21300/37963 [52:26:45<39:20:06,  8.50s/it]
 56%|█████▌    | 21301/37963 [52:26:52<38:26:54,  8.31s/it]
 56%|█████▌    | 21302/37963 [52:27:00<37:40:14,  8.14s/it]
 56%|█████▌    | 21303/37963 [52:27:08<37:15:05,  8.05s/it]
 56%|█████▌    | 21304/37963 [52:27:16<36:49:17,  7.96s/it]
 56%|█████▌    | 21305/37963 [52:27:24<36:39:37,  7.92s/it]
 56%|█████▌    | 21306/37963 [52:27:31<36:12:46,  7.83s/it]
 56%|█████▌    | 21307/37963 [52:27:46<45:56:12,  9.93s/it]
 56%|█████▌    | 21308/37963 [52:27:54<43:31:21,  9.41s/it]
 56%|█████▌    | 21309/37963 [52:28:02<41:20:51,  8.94s/it]
 56%|█████▌    | 21310/37963 [52:28:10<39:32:57,  8.55s/it]
                                                           
{'loss': '0.1273', 'grad_norm': '1.244', 'learning_rate': '8.506e-06', 'epoch': '0.5613'}
+
 56%|█████▌    | 21310/37963 [52:28:10<39:32:57,  8.55s/it]
 56%|█████▌    | 21311/37963 [52:28:17<38:02:19,  8.22s/it]
 56%|█████▌    | 21312/37963 [52:28:25<37:29:39,  8.11s/it]
 56%|█████▌    | 21313/37963 [52:28:40<46:57:45, 10.15s/it]
 56%|█████▌    | 21314/37963 [52:28:48<43:45:32,  9.46s/it]
 56%|█████▌    | 21315/37963 [52:28:56<41:33:13,  8.99s/it]
 56%|█████▌    | 21316/37963 [52:29:03<39:53:55,  8.63s/it]
 56%|█████▌    | 21317/37963 [52:29:18<48:08:35, 10.41s/it]
 56%|█████▌    | 21318/37963 [52:29:40<63:54:42, 13.82s/it]
 56%|█████▌    | 21319/37963 [52:29:54<64:43:32, 14.00s/it]
 56%|█████▌    | 21320/37963 [52:30:02<56:12:26, 12.16s/it]
                                                           
{'loss': '0.144', 'grad_norm': '2.825', 'learning_rate': '8.497e-06', 'epoch': '0.5616'}
+
 56%|█████▌    | 21320/37963 [52:30:02<56:12:26, 12.16s/it]
 56%|█████▌    | 21321/37963 [52:30:10<50:23:27, 10.90s/it]
 56%|█████▌    | 21322/37963 [52:30:18<46:04:59,  9.97s/it]
 56%|█████▌    | 21323/37963 [52:30:26<42:59:52,  9.30s/it]
 56%|█████▌    | 21324/37963 [52:30:33<40:47:03,  8.82s/it]
 56%|█████▌    | 21325/37963 [52:30:41<39:14:48,  8.49s/it]
 56%|█████▌    | 21326/37963 [52:30:49<38:18:43,  8.29s/it]
 56%|█████▌    | 21327/37963 [52:31:03<46:36:01, 10.08s/it]
 56%|█████▌    | 21328/37963 [52:31:11<43:40:07,  9.45s/it]
 56%|█████▌    | 21329/37963 [52:31:19<41:24:10,  8.96s/it]
 56%|█████▌    | 21330/37963 [52:31:27<39:46:17,  8.61s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '1.153', 'learning_rate': '8.489e-06', 'epoch': '0.5619'}
+
 56%|█████▌    | 21330/37963 [52:31:27<39:46:17,  8.61s/it]
 56%|█████▌    | 21331/37963 [52:31:34<38:37:27,  8.36s/it]
 56%|█████▌    | 21332/37963 [52:31:42<37:50:15,  8.19s/it]
 56%|█████▌    | 21333/37963 [52:31:50<37:34:10,  8.13s/it]
 56%|█████▌    | 21334/37963 [52:31:58<36:58:04,  8.00s/it]
 56%|█████��    | 21335/37963 [52:32:06<36:59:14,  8.01s/it]
 56%|█████▌    | 21336/37963 [52:32:14<36:35:40,  7.92s/it]
 56%|█████▌    | 21337/37963 [52:32:22<36:28:41,  7.90s/it]
 56%|█████▌    | 21338/37963 [52:32:29<36:16:23,  7.85s/it]
 56%|█████▌    | 21339/37963 [52:32:37<36:07:26,  7.82s/it]
 56%|█████▌    | 21340/37963 [52:32:45<36:12:41,  7.84s/it]
                                                           
{'loss': '0.1368', 'grad_norm': '0.7848', 'learning_rate': '8.48e-06', 'epoch': '0.5621'}
+
 56%|█████▌    | 21340/37963 [52:32:45<36:12:41,  7.84s/it]
 56%|█████▌    | 21341/37963 [52:33:01<46:59:51, 10.18s/it]
 56%|█████▌    | 21342/37963 [52:33:08<43:31:04,  9.43s/it]
 56%|█████▌    | 21343/37963 [52:33:16<40:32:39,  8.78s/it]
 56%|█████▌    | 21344/37963 [52:33:23<38:55:33,  8.43s/it]
 56%|█████▌    | 21345/37963 [52:33:31<37:51:42,  8.20s/it]
 56%|█████▌    | 21346/37963 [52:33:39<37:17:28,  8.08s/it]
 56%|█████▌    | 21347/37963 [52:33:46<36:46:45,  7.97s/it]
 56%|█████▌    | 21348/37963 [52:33:54<36:23:47,  7.89s/it]
 56%|█████▌    | 21349/37963 [52:34:01<35:47:27,  7.76s/it]
 56%|█████▌    | 21350/37963 [52:34:09<35:45:41,  7.75s/it]
                                                           
{'loss': '0.1423', 'grad_norm': '2.298', 'learning_rate': '8.472e-06', 'epoch': '0.5624'}
+
 56%|█████▌    | 21350/37963 [52:34:09<35:45:41,  7.75s/it]
 56%|█████▌    | 21351/37963 [52:34:17<35:43:01,  7.74s/it]
 56%|█████▌    | 21352/37963 [52:34:25<35:45:36,  7.75s/it]
 56%|█████▌    | 21353/37963 [52:34:32<35:46:32,  7.75s/it]
 56%|█████▌    | 21354/37963 [52:34:48<46:05:58,  9.99s/it]
 56%|█████▋    | 21355/37963 [52:34:56<43:20:40,  9.40s/it]
 56%|█████▋    | 21356/37963 [52:35:03<41:06:07,  8.91s/it]
 56%|█████▋    | 21357/37963 [52:35:11<39:28:44,  8.56s/it]
 56%|█████▋    | 21358/37963 [52:35:27<48:53:25, 10.60s/it]
 56%|█████▋    | 21359/37963 [52:35:34<45:04:52,  9.77s/it]
 56%|█████▋    | 21360/37963 [52:35:42<42:18:44,  9.17s/it]
                                                           
{'loss': '0.1439', 'grad_norm': '1.786', 'learning_rate': '8.464e-06', 'epoch': '0.5627'}
+
 56%|█████▋    | 21360/37963 [52:35:42<42:18:44,  9.17s/it]
 56%|█████▋    | 21361/37963 [52:35:57<49:41:18, 10.77s/it]
 56%|█████▋    | 21362/37963 [52:36:04<45:32:26,  9.88s/it]
 56%|█████▋    | 21363/37963 [52:36:12<42:58:08,  9.32s/it]
 56%|█████▋    | 21364/37963 [52:36:20<41:04:02,  8.91s/it]
 56%|█████▋    | 21365/37963 [52:36:28<39:32:12,  8.58s/it]
 56%|█████▋    | 21366/37963 [52:36:36<38:25:59,  8.34s/it]
 56%|█████▋    | 21367/37963 [52:36:44<37:34:28,  8.15s/it]
 56%|█████▋    | 21368/37963 [52:36:51<36:56:12,  8.01s/it]
 56%|█████▋    | 21369/37963 [52:36:59<36:29:32,  7.92s/it]
 56%|█████▋    | 21370/37963 [52:37:07<36:26:35,  7.91s/it]
                                                           
{'loss': '0.1386', 'grad_norm': '1.284', 'learning_rate': '8.455e-06', 'epoch': '0.5629'}
+
 56%|█████▋    | 21370/37963 [52:37:07<36:26:35,  7.91s/it]
 56%|█████▋    | 21371/37963 [52:37:22<45:40:05,  9.91s/it]
 56%|█████▋    | 21372/37963 [52:37:43<61:50:19, 13.42s/it]
 56%|█████▋    | 21373/37963 [52:37:58<63:11:54, 13.71s/it]
 56%|█████▋    | 21374/37963 [52:38:05<55:12:20, 11.98s/it]
 56%|█████▋    | 21375/37963 [52:38:13<49:14:56, 10.69s/it]
 56%|█████▋    | 21376/37963 [52:38:21<45:17:16,  9.83s/it]
 56%|█████▋    | 21377/37963 [52:38:29<42:45:33,  9.28s/it]
 56%|█████▋    | 21378/37963 [52:38:37<40:42:37,  8.84s/it]
 56%|█████▋    | 21379/37963 [52:38:44<38:54:49,  8.45s/it]
 56%|█████▋    | 21380/37963 [52:38:52<37:42:31,  8.19s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '4.232', 'learning_rate': '8.447e-06', 'epoch': '0.5632'}
+
 56%|█████▋    | 21380/37963 [52:38:52<37:42:31,  8.19s/it]
 56%|█████▋    | 21381/37963 [52:39:00<37:21:05,  8.11s/it]
 56%|█████▋    | 21382/37963 [52:39:07<36:33:44,  7.94s/it]
 56%|█████▋    | 21383/37963 [52:39:15<36:15:05,  7.87s/it]
 56%|█████▋    | 21384/37963 [52:39:23<35:39:30,  7.74s/it]
 56%|█████▋    | 21385/37963 [52:39:37<45:36:09,  9.90s/it]
 56%|█████▋    | 21386/37963 [52:39:45<42:53:30,  9.31s/it]
 56%|█████▋    | 21387/37963 [52:39:53<40:54:39,  8.89s/it]
 56%|█████▋    | 21388/37963 [52:40:01<38:51:21,  8.44s/it]
 56%|█████▋    | 21389/37963 [52:40:08<37:50:09,  8.22s/it]
 56%|█████▋    | 21390/37963 [52:40:16<37:22:47,  8.12s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '1.728', 'learning_rate': '8.438e-06', 'epoch': '0.5634'}
+
 56%|█████▋    | 21390/37963 [52:40:16<37:22:47,  8.12s/it]
 56%|█████▋    | 21391/37963 [52:40:24<36:49:39,  8.00s/it]
 56%|█████▋    | 21392/37963 [52:40:32<36:33:33,  7.94s/it]
 56%|█████▋    | 21393/37963 [52:40:40<36:19:37,  7.89s/it]
 56%|█████▋    | 21394/37963 [52:40:47<35:50:16,  7.79s/it]
 56%|█████▋    | 21395/37963 [52:40:55<35:50:21,  7.79s/it]
 56%|█████▋    | 21396/37963 [52:41:03<35:42:54,  7.76s/it]
 56%|█████▋    | 21397/37963 [52:41:10<35:37:48,  7.74s/it]
 56%|█████▋    | 21398/37963 [52:41:18<35:40:32,  7.75s/it]
 56%|█████▋    | 21399/37963 [52:41:26<35:39:57,  7.75s/it]
 56%|█████▋    | 21400/37963 [52:41:34<35:37:32,  7.74s/it]
                                                           
{'loss': '0.1548', 'grad_norm': '1.035', 'learning_rate': '8.43e-06', 'epoch': '0.5637'}
+
 56%|█████▋    | 21400/37963 [52:41:34<35:37:32,  7.74s/it]
 56%|█████▋    | 21401/37963 [52:41:41<35:44:18,  7.77s/it]
 56%|█████▋    | 21402/37963 [52:41:57<45:58:57, 10.00s/it]
 56%|█████▋    | 21403/37963 [52:42:05<43:22:49,  9.43s/it]
 56%|█████▋    | 21404/37963 [52:42:26<60:10:42, 13.08s/it]
 56%|█████▋    | 21405/37963 [52:42:34<52:58:10, 11.52s/it]
 56%|█████▋    | 21406/37963 [52:42:42<47:32:01, 10.34s/it]
 56%|█████▋    | 21407/37963 [52:42:49<43:46:02,  9.52s/it]
 56%|█████▋    | 21408/37963 [52:42:57<41:19:04,  8.98s/it]
 56%|█████▋    | 21409/37963 [52:43:05<39:35:19,  8.61s/it]
 56%|█████▋    | 21410/37963 [52:43:12<38:11:42,  8.31s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '2.954', 'learning_rate': '8.422e-06', 'epoch': '0.564'}
+
 56%|█████▋    | 21410/37963 [52:43:12<38:11:42,  8.31s/it]
 56%|█████▋    | 21411/37963 [52:43:20<37:32:09,  8.16s/it]
 56%|█████▋    | 21412/37963 [52:43:28<36:56:15,  8.03s/it]
 56%|█████▋    | 21413/37963 [52:43:36<36:40:39,  7.98s/it]
 56%|█████▋    | 21414/37963 [52:43:44<36:25:33,  7.92s/it]
 56%|█████▋    | 21415/37963 [52:43:59<46:05:36, 10.03s/it]
 56%|█████▋    | 21416/37963 [52:44:06<42:35:08,  9.27s/it]
 56%|█████▋    | 21417/37963 [52:44:14<40:30:15,  8.81s/it]
 56%|█████▋    | 21418/37963 [52:44:22<39:06:43,  8.51s/it]
 56%|█████▋    | 21419/37963 [52:44:29<38:13:28,  8.32s/it]
 56%|█████▋    | 21420/37963 [52:44:37<37:26:09,  8.15s/it]
                                                           
{'loss': '0.148', 'grad_norm': '1.907', 'learning_rate': '8.413e-06', 'epoch': '0.5642'}
+
 56%|█████▋    | 21420/37963 [52:44:37<37:26:09,  8.15s/it]
 56%|█████▋    | 21421/37963 [52:44:45<36:50:18,  8.02s/it]
 56%|█████▋    | 21422/37963 [52:44:53<36:35:44,  7.96s/it]
 56%|█████▋    | 21423/37963 [52:45:07<45:40:39,  9.94s/it]
 56%|█████▋    | 21424/37963 [52:45:15<43:11:01,  9.40s/it]
 56%|█████▋    | 21425/37963 [52:45:23<40:45:23,  8.87s/it]
 56%|█████▋    | 21426/37963 [52:45:44<57:49:16, 12.59s/it]
 56%|█████▋    | 21427/37963 [52:45:52<51:28:25, 11.21s/it]
 56%|█████▋    | 21428/37963 [52:46:00<46:43:55, 10.17s/it]
 56%|█████▋    | 21429/37963 [52:46:08<43:22:07,  9.44s/it]
 56%|█████▋    | 21430/37963 [52:46:16<40:58:20,  8.92s/it]
                                                           
{'loss': '0.1416', 'grad_norm': '1.248', 'learning_rate': '8.405e-06', 'epoch': '0.5645'}
+
 56%|█████▋    | 21430/37963 [52:46:16<40:58:20,  8.92s/it]
 56%|█████▋    | 21431/37963 [52:46:23<39:25:18,  8.58s/it]
 56%|█████▋    | 21432/37963 [52:46:31<38:26:29,  8.37s/it]
 56%|█████▋    | 21433/37963 [52:46:39<37:33:29,  8.18s/it]
 56%|█████▋    | 21434/37963 [52:46:47<37:05:47,  8.08s/it]
 56%|█████▋    | 21435/37963 [52:46:54<36:20:19,  7.92s/it]
 56%|█████▋    | 21436/37963 [52:47:10<46:40:21, 10.17s/it]
 56%|█████▋    | 21437/37963 [52:47:18<43:48:32,  9.54s/it]
 56%|█████▋    | 21438/37963 [52:47:26<41:42:28,  9.09s/it]
 56%|█████▋    | 21439/37963 [52:47:34<40:05:50,  8.74s/it]
 56%|█████▋    | 21440/37963 [52:47:42<38:50:54,  8.46s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '1.246', 'learning_rate': '8.396e-06', 'epoch': '0.5648'}
+
 56%|█████▋    | 21440/37963 [52:47:42<38:50:54,  8.46s/it]
 56%|█████▋    | 21441/37963 [52:47:49<37:48:06,  8.24s/it]
 56%|█████▋    | 21442/37963 [52:47:57<36:56:00,  8.05s/it]
 56%|█████▋    | 21443/37963 [52:48:05<36:37:11,  7.98s/it]
 56%|█████▋    | 21444/37963 [52:48:13<36:25:42,  7.94s/it]
 56%|█████▋    | 21445/37963 [52:48:20<36:06:16,  7.87s/it]
 56%|█████▋    | 21446/37963 [52:48:28<35:37:20,  7.76s/it]
 56%|█████▋    | 21447/37963 [52:48:43<45:47:37,  9.98s/it]
 56%|█████▋    | 21448/37963 [52:48:57<51:53:11, 11.31s/it]
 56%|█████▋    | 21449/37963 [52:49:05<46:54:07, 10.22s/it]
 57%|█████▋    | 21450/37963 [52:49:13<43:45:41,  9.54s/it]
                                                           
{'loss': '0.1228', 'grad_norm': '0.7713', 'learning_rate': '8.388e-06', 'epoch': '0.565'}
+
 57%|█████▋    | 21450/37963 [52:49:13<43:45:41,  9.54s/it]
 57%|█████▋    | 21451/37963 [52:49:21<41:22:00,  9.02s/it]
 57%|█████▋    | 21452/37963 [52:49:29<39:33:55,  8.63s/it]
 57%|█████▋    | 21453/37963 [52:49:36<38:15:30,  8.34s/it]
 57%|█████▋    | 21454/37963 [52:49:51<47:45:26, 10.41s/it]
 57%|█████▋    | 21455/37963 [52:49:59<44:18:51,  9.66s/it]
 57%|█████▋    | 21456/37963 [52:50:07<41:23:40,  9.03s/it]
 57%|█████▋    | 21457/37963 [52:50:15<39:47:10,  8.68s/it]
 57%|█████▋    | 21458/37963 [52:50:23<38:36:22,  8.42s/it]
 57%|█████▋    | 21459/37963 [52:50:30<37:17:17,  8.13s/it]
 57%|█████▋    | 21460/37963 [52:50:38<36:44:28,  8.01s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '1.461', 'learning_rate': '8.379e-06', 'epoch': '0.5653'}
+
 57%|█████▋    | 21460/37963 [52:50:38<36:44:28,  8.01s/it]
 57%|█████▋    | 21461/37963 [52:50:52<45:26:06,  9.91s/it]
 57%|█████▋    | 21462/37963 [52:51:00<42:36:40,  9.30s/it]
 57%|█████▋    | 21463/37963 [52:51:08<40:31:50,  8.84s/it]
 57%|█████▋    | 21464/37963 [52:51:16<39:11:59,  8.55s/it]
 57%|█████▋    | 21465/37963 [52:51:23<38:10:39,  8.33s/it]
 57%|█████▋    | 21466/37963 [52:51:32<37:51:14,  8.26s/it]
 57%|█████▋    | 21467/37963 [52:51:39<37:03:44,  8.09s/it]
 57%|█████▋    | 21468/37963 [52:51:47<36:39:46,  8.00s/it]
 57%|█████▋    | 21469/37963 [52:52:02<45:45:06,  9.99s/it]
 57%|█████▋    | 21470/37963 [52:52:17<52:33:53, 11.47s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '1.273', 'learning_rate': '8.371e-06', 'epoch': '0.5656'}
+
 57%|█████▋    | 21470/37963 [52:52:17<52:33:53, 11.47s/it]
 57%|█████▋    | 21471/37963 [52:52:32<57:22:26, 12.52s/it]
 57%|█████▋    | 21472/37963 [52:52:40<51:21:32, 11.21s/it]
 57%|█████▋    | 21473/37963 [52:52:48<46:44:03, 10.20s/it]
 57%|█████▋    | 21474/37963 [52:52:55<43:11:13,  9.43s/it]
 57%|█████▋    | 21475/37963 [52:53:03<40:50:41,  8.92s/it]
 57%|█████▋    | 21476/37963 [52:53:11<39:17:04,  8.58s/it]
 57%|█████▋    | 21477/37963 [52:53:19<38:14:30,  8.35s/it]
 57%|█████▋    | 21478/37963 [52:53:26<37:17:43,  8.14s/it]
 57%|█████▋    | 21479/37963 [52:53:34<36:36:40,  8.00s/it]
 57%|█████▋    | 21480/37963 [52:53:42<36:09:57,  7.90s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '3.472', 'learning_rate': '8.363e-06', 'epoch': '0.5658'}
+
 57%|█████▋    | 21480/37963 [52:53:42<36:09:57,  7.90s/it]
 57%|█████▋    | 21481/37963 [52:53:49<35:50:25,  7.83s/it]
 57%|█████▋    | 21482/37963 [52:53:57<35:36:40,  7.78s/it]
 57%|█████▋    | 21483/37963 [52:54:05<35:32:33,  7.76s/it]
 57%|█████▋    | 21484/37963 [52:54:12<35:20:00,  7.72s/it]
 57%|█████▋    | 21485/37963 [52:54:20<35:35:35,  7.78s/it]
 57%|█████▋    | 21486/37963 [52:54:28<35:23:07,  7.73s/it]
 57%|█████▋    | 21487/37963 [52:54:43<46:15:19, 10.11s/it]
 57%|█████▋    | 21488/37963 [52:54:51<42:59:43,  9.40s/it]
 57%|█████▋    | 21489/37963 [52:54:59<40:38:36,  8.88s/it]
 57%|█████▋    | 21490/37963 [52:55:06<38:49:13,  8.48s/it]
                                                           
{'loss': '0.1465', 'grad_norm': '3.562', 'learning_rate': '8.354e-06', 'epoch': '0.5661'}
+
 57%|█████▋    | 21490/37963 [52:55:06<38:49:13,  8.48s/it]
 57%|█████▋    | 21491/37963 [52:55:14<37:46:16,  8.25s/it]
 57%|█████▋    | 21492/37963 [52:55:22<36:45:44,  8.04s/it]
 57%|█████▋    | 21493/37963 [52:55:29<36:26:23,  7.96s/it]
 57%|█████▋    | 21494/37963 [52:55:37<36:09:01,  7.90s/it]
 57%|█████▋    | 21495/37963 [52:55:52<46:00:56, 10.06s/it]
 57%|█████▋    | 21496/37963 [52:56:00<43:10:34,  9.44s/it]
 57%|█████▋    | 21497/37963 [52:56:15<50:10:39, 10.97s/it]
 57%|█████▋    | 21498/37963 [52:56:22<45:40:21,  9.99s/it]
 57%|█████▋    | 21499/37963 [52:56:30<42:38:49,  9.33s/it]
 57%|█████▋    | 21500/37963 [52:56:38<40:33:29,  8.87s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '1.324', 'learning_rate': '8.346e-06', 'epoch': '0.5663'}
+
 57%|█████▋    | 21500/37963 [52:56:38<40:33:29,  8.87s/it]
 57%|█████▋    | 21501/37963 [52:56:46<38:51:41,  8.50s/it]
 57%|█████▋    | 21502/37963 [52:56:54<37:55:26,  8.29s/it]
 57%|█████▋    | 21503/37963 [52:57:01<37:07:38,  8.12s/it]
 57%|█████▋    | 21504/37963 [52:57:16<46:16:06, 10.12s/it]
 57%|█████▋    | 21505/37963 [52:57:24<43:16:43,  9.47s/it]
 57%|█████▋    | 21506/37963 [52:57:32<40:55:52,  8.95s/it]
 57%|█████▋    | 21507/37963 [52:57:39<39:18:01,  8.60s/it]
 57%|█████▋    | 21508/37963 [52:57:47<38:01:49,  8.32s/it]
 57%|█████▋    | 21509/37963 [52:57:55<37:18:35,  8.16s/it]
 57%|█████▋    | 21510/37963 [52:58:10<46:30:23, 10.18s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '2.074', 'learning_rate': '8.337e-06', 'epoch': '0.5666'}
+
 57%|█████▋    | 21510/37963 [52:58:10<46:30:23, 10.18s/it]
 57%|█████▋    | 21511/37963 [52:58:18<43:24:00,  9.50s/it]
 57%|█████▋    | 21512/37963 [52:58:26<41:01:07,  8.98s/it]
 57%|█████▋    | 21513/37963 [52:58:41<49:20:04, 10.80s/it]
 57%|█████▋    | 21514/37963 [52:58:48<45:21:05,  9.93s/it]
 57%|█████▋    | 21515/37963 [52:58:56<42:38:46,  9.33s/it]
 57%|█████▋    | 21516/37963 [52:59:11<49:34:33, 10.85s/it]
 57%|█████▋    | 21517/37963 [52:59:19<45:33:33,  9.97s/it]
 57%|█████▋    | 21518/37963 [52:59:26<41:59:16,  9.19s/it]
 57%|█████▋    | 21519/37963 [52:59:41<49:32:51, 10.85s/it]
 57%|█████▋    | 21520/37963 [52:59:49<45:36:08,  9.98s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '1.925', 'learning_rate': '8.329e-06', 'epoch': '0.5669'}
+
 57%|█████▋    | 21520/37963 [52:59:49<45:36:08,  9.98s/it]
 57%|█████▋    | 21521/37963 [52:59:56<42:22:02,  9.28s/it]
 57%|█████▋    | 21522/37963 [53:00:04<40:15:24,  8.81s/it]
 57%|█████▋    | 21523/37963 [53:00:12<38:51:07,  8.51s/it]
 57%|█████▋    | 21524/37963 [53:00:20<37:48:26,  8.28s/it]
 57%|█████▋    | 21525/37963 [53:00:27<37:01:28,  8.11s/it]
 57%|█████▋    | 21526/37963 [53:00:35<36:36:39,  8.02s/it]
 57%|█████▋    | 21527/37963 [53:00:43<36:21:59,  7.97s/it]
 57%|█████▋    | 21528/37963 [53:00:51<36:26:53,  7.98s/it]
 57%|█████▋    | 21529/37963 [53:00:59<36:06:21,  7.91s/it]
 57%|█████▋    | 21530/37963 [53:01:07<35:59:23,  7.88s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '1.607', 'learning_rate': '8.32e-06', 'epoch': '0.5671'}
+
 57%|█████▋    | 21530/37963 [53:01:07<35:59:23,  7.88s/it]
 57%|█████▋    | 21531/37963 [53:01:14<35:50:55,  7.85s/it]
 57%|█████▋    | 21532/37963 [53:01:22<35:55:53,  7.87s/it]
 57%|█████▋    | 21533/37963 [53:01:30<35:43:05,  7.83s/it]
 57%|█████▋    | 21534/37963 [53:01:38<35:26:51,  7.77s/it]
 57%|█████▋    | 21535/37963 [53:01:45<35:10:24,  7.71s/it]
 57%|█████▋    | 21536/37963 [53:01:53<35:15:05,  7.73s/it]
 57%|█████▋    | 21537/37963 [53:02:01<35:25:48,  7.77s/it]
 57%|█████▋    | 21538/37963 [53:02:09<35:23:09,  7.76s/it]
 57%|█████▋    | 21539/37963 [53:02:16<35:24:13,  7.76s/it]
 57%|█████▋    | 21540/37963 [53:02:24<35:31:24,  7.79s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '3.259', 'learning_rate': '8.312e-06', 'epoch': '0.5674'}
+
 57%|█████▋    | 21540/37963 [53:02:24<35:31:24,  7.79s/it]
 57%|█████▋    | 21541/37963 [53:02:46<54:58:30, 12.05s/it]
 57%|█████▋    | 21542/37963 [53:03:01<58:43:28, 12.87s/it]
 57%|█████▋    | 21543/37963 [53:03:09<51:52:30, 11.37s/it]
 57%|█████▋    | 21544/37963 [53:03:17<47:10:39, 10.34s/it]
 57%|█████▋    | 21545/37963 [53:03:24<43:16:44,  9.49s/it]
 57%|█████▋    | 21546/37963 [53:03:32<41:01:11,  9.00s/it]
 57%|█████▋    | 21547/37963 [53:03:40<39:09:19,  8.59s/it]
 57%|█████▋    | 21548/37963 [53:03:48<38:09:59,  8.37s/it]
 57%|█████▋    | 21549/37963 [53:03:55<37:18:30,  8.18s/it]
 57%|█████▋    | 21550/37963 [53:04:03<36:31:54,  8.01s/it]
                                                           
{'loss': '0.152', 'grad_norm': '1.209', 'learning_rate': '8.304e-06', 'epoch': '0.5677'}
+
 57%|█████▋    | 21550/37963 [53:04:03<36:31:54,  8.01s/it]
 57%|█████▋    | 21551/37963 [53:04:18<46:13:18, 10.14s/it]
 57%|█████▋    | 21552/37963 [53:04:26<42:53:05,  9.41s/it]
 57%|█████▋    | 21553/37963 [53:04:33<40:30:34,  8.89s/it]
 57%|█████▋    | 21554/37963 [53:04:41<38:40:13,  8.48s/it]
 57%|█████▋    | 21555/37963 [53:04:56<46:51:29, 10.28s/it]
 57%|█████▋    | 21556/37963 [53:05:04<43:47:47,  9.61s/it]
 57%|█████▋    | 21557/37963 [53:05:11<41:18:53,  9.07s/it]
 57%|█████▋    | 21558/37963 [53:05:26<49:17:25, 10.82s/it]
 57%|█████▋    | 21559/37963 [53:05:34<45:03:19,  9.89s/it]
 57%|█████▋    | 21560/37963 [53:05:41<41:42:49,  9.15s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '2.554', 'learning_rate': '8.295e-06', 'epoch': '0.5679'}
+
 57%|█████▋    | 21560/37963 [53:05:41<41:42:49,  9.15s/it]
 57%|█████▋    | 21561/37963 [53:05:49<39:34:30,  8.69s/it]
 57%|█████▋    | 21562/37963 [53:05:57<38:30:21,  8.45s/it]
 57%|█████▋    | 21563/37963 [53:06:05<37:22:39,  8.20s/it]
 57%|█████▋    | 21564/37963 [53:06:19<45:27:40,  9.98s/it]
 57%|█████▋    | 21565/37963 [53:06:26<42:10:16,  9.26s/it]
 57%|█████▋    | 21566/37963 [53:06:34<40:03:54,  8.80s/it]
 57%|█████▋    | 21567/37963 [53:06:42<38:34:00,  8.47s/it]
 57%|█████▋    | 21568/37963 [53:06:50<38:10:32,  8.38s/it]
 57%|█████▋    | 21569/37963 [53:06:57<37:03:02,  8.14s/it]
 57%|█████▋    | 21570/37963 [53:07:12<45:40:32, 10.03s/it]
                                                           
{'loss': '0.1368', 'grad_norm': '1.922', 'learning_rate': '8.287e-06', 'epoch': '0.5682'}
+
 57%|█████▋    | 21570/37963 [53:07:12<45:40:32, 10.03s/it]
 57%|█████▋    | 21571/37963 [53:07:20<42:37:06,  9.36s/it]
 57%|█████▋    | 21572/37963 [53:07:27<40:30:15,  8.90s/it]
 57%|█████▋    | 21573/37963 [53:07:35<38:59:30,  8.56s/it]
 57%|█████▋    | 21574/37963 [53:07:43<37:52:12,  8.32s/it]
 57%|█████▋    | 21575/37963 [53:07:51<37:23:48,  8.22s/it]
 57%|█████▋    | 21576/37963 [53:07:59<36:42:28,  8.06s/it]
 57%|█████▋    | 21577/37963 [53:08:06<36:19:26,  7.98s/it]
 57%|█████▋    | 21578/37963 [53:08:14<36:06:55,  7.94s/it]
 57%|█████▋    | 21579/37963 [53:08:22<35:41:18,  7.84s/it]
 57%|█████▋    | 21580/37963 [53:08:30<35:29:33,  7.80s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '1.192', 'learning_rate': '8.278e-06', 'epoch': '0.5685'}
+
 57%|█████▋    | 21580/37963 [53:08:30<35:29:33,  7.80s/it]
 57%|█████▋    | 21581/37963 [53:08:37<35:22:14,  7.77s/it]
 57%|█████▋    | 21582/37963 [53:08:45<35:28:12,  7.80s/it]
 57%|█████▋    | 21583/37963 [53:08:53<35:26:07,  7.79s/it]
 57%|█████▋    | 21584/37963 [53:09:01<35:20:46,  7.77s/it]
 57%|█████▋    | 21585/37963 [53:09:09<35:29:41,  7.80s/it]
 57%|█████▋    | 21586/37963 [53:09:23<44:19:04,  9.74s/it]
 57%|█████▋    | 21587/37963 [53:09:31<42:06:25,  9.26s/it]
 57%|█████▋    | 21588/37963 [53:09:39<40:14:04,  8.85s/it]
 57%|█████▋    | 21589/37963 [53:09:54<49:03:03, 10.78s/it]
 57%|█████▋    | 21590/37963 [53:10:02<44:54:53,  9.88s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '1.443', 'learning_rate': '8.27e-06', 'epoch': '0.5687'}
+
 57%|█████▋    | 21590/37963 [53:10:02<44:54:53,  9.88s/it]
 57%|█████▋    | 21591/37963 [53:10:10<42:07:47,  9.26s/it]
 57%|█████▋    | 21592/37963 [53:10:17<39:50:53,  8.76s/it]
 57%|█████▋    | 21593/37963 [53:10:25<38:31:55,  8.47s/it]
 57%|█████▋    | 21594/37963 [53:10:33<37:30:39,  8.25s/it]
 57%|█████▋    | 21595/37963 [53:10:55<56:38:42, 12.46s/it]
 57%|█████▋    | 21596/37963 [53:11:03<50:14:27, 11.05s/it]
 57%|█████▋    | 21597/37963 [53:11:11<45:49:02, 10.08s/it]
 57%|█████▋    | 21598/37963 [53:11:18<42:39:24,  9.38s/it]
 57%|█████▋    | 21599/37963 [53:11:26<40:27:25,  8.90s/it]
 57%|█████▋    | 21600/37963 [53:11:34<38:43:32,  8.52s/it]
                                                           
{'loss': '0.1371', 'grad_norm': '1.743', 'learning_rate': '8.262e-06', 'epoch': '0.569'}
+
 57%|█████▋    | 21600/37963 [53:11:34<38:43:32,  8.52s/it]
 57%|█████▋    | 21601/37963 [53:11:48<46:40:37, 10.27s/it]
 57%|█████▋    | 21602/37963 [53:12:03<52:29:25, 11.55s/it]
 57%|█████▋    | 21603/37963 [53:12:11<47:33:09, 10.46s/it]
 57%|█████▋    | 21604/37963 [53:12:18<43:41:51,  9.62s/it]
 57%|█████▋    | 21605/37963 [53:12:26<41:06:58,  9.05s/it]
 57%|█████▋    | 21606/37963 [53:12:34<39:16:19,  8.64s/it]
 57%|█████▋    | 21607/37963 [53:12:42<38:09:03,  8.40s/it]
 57%|█████▋    | 21608/37963 [53:12:49<37:25:36,  8.24s/it]
 57%|█████▋    | 21609/37963 [53:12:57<36:54:52,  8.13s/it]
 57%|█████▋    | 21610/37963 [53:13:05<36:29:33,  8.03s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '2.141', 'learning_rate': '8.253e-06', 'epoch': '0.5692'}
+
 57%|█████▋    | 21610/37963 [53:13:05<36:29:33,  8.03s/it]
 57%|█████▋    | 21611/37963 [53:13:13<36:20:31,  8.00s/it]
 57%|█████▋    | 21612/37963 [53:13:28<45:18:23,  9.98s/it]
 57%|█████▋    | 21613/37963 [53:13:35<42:21:48,  9.33s/it]
 57%|█████▋    | 21614/37963 [53:13:43<40:05:54,  8.83s/it]
 57%|█████▋    | 21615/37963 [53:13:51<38:37:32,  8.51s/it]
 57%|█████▋    | 21616/37963 [53:13:58<37:12:19,  8.19s/it]
 57%|█████▋    | 21617/37963 [53:14:06<36:38:18,  8.07s/it]
 57%|█████▋    | 21618/37963 [53:14:21<45:57:32, 10.12s/it]
 57%|█████▋    | 21619/37963 [53:14:29<42:23:00,  9.34s/it]
 57%|█████▋    | 21620/37963 [53:14:36<39:55:37,  8.80s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '1.469', 'learning_rate': '8.245e-06', 'epoch': '0.5695'}
+
 57%|█████▋    | 21620/37963 [53:14:36<39:55:37,  8.80s/it]
 57%|█████▋    | 21621/37963 [53:14:44<38:29:30,  8.48s/it]
 57%|█████▋    | 21622/37963 [53:14:52<37:35:24,  8.28s/it]
 57%|█████▋    | 21623/37963 [53:14:59<36:30:39,  8.04s/it]
 57%|█████▋    | 21624/37963 [53:15:07<36:11:44,  7.98s/it]
 57%|█████▋    | 21625/37963 [53:15:15<35:48:36,  7.89s/it]
 57%|█████▋    | 21626/37963 [53:15:22<35:39:00,  7.86s/it]
 57%|█████▋    | 21627/37963 [53:15:30<35:36:38,  7.85s/it]
 57%|█████▋    | 21628/37963 [53:15:38<35:12:30,  7.76s/it]
 57%|█████▋    | 21629/37963 [53:15:45<34:52:38,  7.69s/it]
 57%|█████▋    | 21630/37963 [53:15:53<35:03:19,  7.73s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '1.764', 'learning_rate': '8.236e-06', 'epoch': '0.5698'}
+
 57%|█████▋    | 21630/37963 [53:15:53<35:03:19,  7.73s/it]
 57%|█████▋    | 21631/37963 [53:16:01<35:03:51,  7.73s/it]
 57%|█████▋    | 21632/37963 [53:16:09<35:12:48,  7.76s/it]
 57%|█████▋    | 21633/37963 [53:16:16<35:13:30,  7.77s/it]
 57%|█████▋    | 21634/37963 [53:16:24<35:14:36,  7.77s/it]
 57%|█████▋    | 21635/37963 [53:16:39<44:28:49,  9.81s/it]
 57%|█████▋    | 21636/37963 [53:16:47<41:43:22,  9.20s/it]
 57%|█████▋    | 21637/37963 [53:17:01<49:29:16, 10.91s/it]
 57%|█████▋    | 21638/37963 [53:17:09<45:08:19,  9.95s/it]
 57%|█████▋    | 21639/37963 [53:17:24<51:49:27, 11.43s/it]
 57%|█████▋    | 21640/37963 [53:17:32<47:37:53, 10.51s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '1.408', 'learning_rate': '8.228e-06', 'epoch': '0.57'}
+
 57%|█████▋    | 21640/37963 [53:17:32<47:37:53, 10.51s/it]
 57%|█████▋    | 21641/37963 [53:17:40<43:50:00,  9.67s/it]
 57%|█████▋    | 21642/37963 [53:17:48<41:14:23,  9.10s/it]
 57%|█████▋    | 21643/37963 [53:17:56<39:26:40,  8.70s/it]
 57%|█████▋    | 21644/37963 [53:18:03<38:10:07,  8.42s/it]
 57%|█████▋    | 21645/37963 [53:18:18<46:42:07, 10.30s/it]
 57%|█████▋    | 21646/37963 [53:18:26<43:19:55,  9.56s/it]
 57%|█████▋    | 21647/37963 [53:18:34<40:54:04,  9.02s/it]
 57%|█████▋    | 21648/37963 [53:18:42<39:10:13,  8.64s/it]
 57%|█████▋    | 21649/37963 [53:18:56<46:50:33, 10.34s/it]
 57%|█████▋    | 21650/37963 [53:19:04<43:40:30,  9.64s/it]
                                                           
{'loss': '0.1328', 'grad_norm': '2.708', 'learning_rate': '8.22e-06', 'epoch': '0.5703'}
+
 57%|█████▋    | 21650/37963 [53:19:04<43:40:30,  9.64s/it]
 57%|█████▋    | 21651/37963 [53:19:19<51:21:08, 11.33s/it]
 57%|█████▋    | 21652/37963 [53:19:27<46:30:43, 10.27s/it]
 57%|█████▋    | 21653/37963 [53:19:35<43:14:50,  9.55s/it]
 57%|█████▋    | 21654/37963 [53:19:42<40:17:59,  8.90s/it]
 57%|█████▋    | 21655/37963 [53:19:50<38:46:47,  8.56s/it]
 57%|█████▋    | 21656/37963 [53:19:58<37:40:19,  8.32s/it]
 57%|█████▋    | 21657/37963 [53:20:05<36:51:44,  8.14s/it]
 57%|█████▋    | 21658/37963 [53:20:13<36:21:10,  8.03s/it]
 57%|█████▋    | 21659/37963 [53:20:21<36:04:42,  7.97s/it]
 57%|█████▋    | 21660/37963 [53:20:29<35:47:19,  7.90s/it]
                                                           
{'loss': '0.14', 'grad_norm': '2.643', 'learning_rate': '8.211e-06', 'epoch': '0.5706'}
+
 57%|█████▋    | 21660/37963 [53:20:29<35:47:19,  7.90s/it]
 57%|█████▋    | 21661/37963 [53:20:36<35:32:20,  7.85s/it]
 57%|█████▋    | 21662/37963 [53:20:44<35:25:19,  7.82s/it]
 57%|█████▋    | 21663/37963 [53:20:52<35:00:41,  7.73s/it]
 57%|█████▋    | 21664/37963 [53:21:06<43:59:45,  9.72s/it]
 57%|█████▋    | 21665/37963 [53:21:14<41:20:25,  9.13s/it]
 57%|█████▋    | 21666/37963 [53:21:22<39:34:55,  8.74s/it]
 57%|█████▋    | 21667/37963 [53:21:29<38:15:27,  8.45s/it]
 57%|█████▋    | 21668/37963 [53:21:37<37:19:53,  8.25s/it]
 57%|█████▋    | 21669/37963 [53:21:52<46:14:23, 10.22s/it]
 57%|█████▋    | 21670/37963 [53:22:00<43:17:21,  9.56s/it]
                                                           
{'loss': '0.1458', 'grad_norm': '2.937', 'learning_rate': '8.203e-06', 'epoch': '0.5708'}
+
 57%|█████▋    | 21670/37963 [53:22:00<43:17:21,  9.56s/it]
 57%|█████▋    | 21671/37963 [53:22:08<40:53:28,  9.04s/it]
 57%|█████▋    | 21672/37963 [53:22:16<39:05:10,  8.64s/it]
 57%|█████▋    | 21673/37963 [53:22:23<38:06:57,  8.42s/it]
 57%|█████▋    | 21674/37963 [53:22:31<37:12:46,  8.22s/it]
 57%|█████▋    | 21675/37963 [53:22:39<36:40:28,  8.11s/it]
 57%|█████▋    | 21676/37963 [53:22:47<36:13:36,  8.01s/it]
 57%|█████▋    | 21677/37963 [53:22:55<35:46:40,  7.91s/it]
 57%|█████▋    | 21678/37963 [53:23:02<35:32:35,  7.86s/it]
 57%|█████▋    | 21679/37963 [53:23:10<35:25:13,  7.83s/it]
 57%|█████▋    | 21680/37963 [53:23:18<35:13:52,  7.79s/it]
                                                           
{'loss': '0.1325', 'grad_norm': '6.02', 'learning_rate': '8.194e-06', 'epoch': '0.5711'}
+
 57%|█████▋    | 21680/37963 [53:23:18<35:13:52,  7.79s/it]
 57%|█████▋    | 21681/37963 [53:23:33<45:05:47,  9.97s/it]
 57%|█████▋    | 21682/37963 [53:23:41<42:06:45,  9.31s/it]
 57%|█████▋    | 21683/37963 [53:23:48<40:02:22,  8.85s/it]
 57%|█████▋    | 21684/37963 [53:23:56<38:28:33,  8.51s/it]
 57%|█████▋    | 21685/37963 [53:24:11<46:48:41, 10.35s/it]
 57%|█████▋    | 21686/37963 [53:24:18<43:16:21,  9.57s/it]
 57%|█████▋    | 21687/37963 [53:24:34<50:55:49, 11.26s/it]
 57%|█████▋    | 21688/37963 [53:24:42<46:35:38, 10.31s/it]
 57%|█████▋    | 21689/37963 [53:24:57<53:08:44, 11.76s/it]
 57%|█████▋    | 21690/37963 [53:25:05<47:53:56, 10.60s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '2.135', 'learning_rate': '8.186e-06', 'epoch': '0.5713'}
+
 57%|█████▋    | 21690/37963 [53:25:05<47:53:56, 10.60s/it]
 57%|█████▋    | 21691/37963 [53:25:12<43:32:19,  9.63s/it]
 57%|█████▋    | 21692/37963 [53:25:20<41:01:47,  9.08s/it]
 57%|█████▋    | 21693/37963 [53:25:28<39:27:44,  8.73s/it]
 57%|█████▋    | 21694/37963 [53:25:36<38:17:02,  8.47s/it]
 57%|█████▋    | 21695/37963 [53:25:44<37:23:06,  8.27s/it]
 57%|█████▋    | 21696/37963 [53:25:51<36:38:11,  8.11s/it]
 57%|█████▋    | 21697/37963 [53:25:59<36:07:23,  7.99s/it]
 57%|█████▋    | 21698/37963 [53:26:07<36:08:18,  8.00s/it]
 57%|█████▋    | 21699/37963 [53:26:14<35:23:03,  7.83s/it]
 57%|█████▋    | 21700/37963 [53:26:22<35:17:20,  7.81s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '4.886', 'learning_rate': '8.178e-06', 'epoch': '0.5716'}
+
 57%|█████▋    | 21700/37963 [53:26:22<35:17:20,  7.81s/it]
 57%|█████▋    | 21701/37963 [53:26:30<34:56:43,  7.74s/it]
 57%|█████▋    | 21702/37963 [53:26:44<44:04:03,  9.76s/it]
 57%|█████▋    | 21703/37963 [53:26:59<50:56:06, 11.28s/it]
 57%|█████▋    | 21704/37963 [53:27:07<45:55:26, 10.17s/it]
 57%|█████▋    | 21705/37963 [53:27:14<42:25:29,  9.39s/it]
 57%|█████▋    | 21706/37963 [53:27:22<40:08:25,  8.89s/it]
 57%|█████▋    | 21707/37963 [53:27:30<38:33:14,  8.54s/it]
 57%|█████▋    | 21708/37963 [53:27:44<47:04:22, 10.43s/it]
 57%|█████▋    | 21709/37963 [53:27:52<43:40:12,  9.67s/it]
 57%|█████▋    | 21710/37963 [53:28:00<40:59:09,  9.08s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '1.209', 'learning_rate': '8.169e-06', 'epoch': '0.5719'}
+
 57%|█████▋    | 21710/37963 [53:28:00<40:59:09,  9.08s/it]
 57%|█████▋    | 21711/37963 [53:28:08<39:07:15,  8.67s/it]
 57%|█████▋    | 21712/37963 [53:28:16<37:57:06,  8.41s/it]
 57%|█████▋    | 21713/37963 [53:28:23<36:51:36,  8.17s/it]
 57%|█████▋    | 21714/37963 [53:28:31<36:09:48,  8.01s/it]
 57%|█████▋    | 21715/37963 [53:28:39<35:56:36,  7.96s/it]
 57%|█████▋    | 21716/37963 [53:28:46<35:41:08,  7.91s/it]
 57%|█████▋    | 21717/37963 [53:28:54<35:14:11,  7.81s/it]
 57%|█████▋    | 21718/37963 [53:29:02<35:05:49,  7.78s/it]
 57%|█████▋    | 21719/37963 [53:29:09<34:57:14,  7.75s/it]
 57%|█████▋    | 21720/37963 [53:29:24<44:12:34,  9.80s/it]
                                                           
{'loss': '0.1402', 'grad_norm': '1.675', 'learning_rate': '8.161e-06', 'epoch': '0.5721'}
+
 57%|█████▋    | 21720/37963 [53:29:24<44:12:34,  9.80s/it]
 57%|█████▋    | 21721/37963 [53:29:32<41:18:50,  9.16s/it]
 57%|█████▋    | 21722/37963 [53:29:39<39:19:22,  8.72s/it]
 57%|█████▋    | 21723/37963 [53:29:47<37:53:02,  8.40s/it]
 57%|█████▋    | 21724/37963 [53:29:55<36:56:02,  8.19s/it]
 57%|█████▋    | 21725/37963 [53:30:02<36:04:10,  8.00s/it]
 57%|█████▋    | 21726/37963 [53:30:10<35:26:27,  7.86s/it]
 57%|█████▋    | 21727/37963 [53:30:17<35:03:16,  7.77s/it]
 57%|█████▋    | 21728/37963 [53:30:32<44:27:33,  9.86s/it]
 57%|█████▋    | 21729/37963 [53:30:40<41:59:02,  9.31s/it]
 57%|█████▋    | 21730/37963 [53:30:48<39:49:07,  8.83s/it]
                                                           
{'loss': '0.1286', 'grad_norm': '2.405', 'learning_rate': '8.153e-06', 'epoch': '0.5724'}
+
 57%|█████▋    | 21730/37963 [53:30:48<39:49:07,  8.83s/it]
 57%|█████▋    | 21731/37963 [53:30:56<38:32:17,  8.55s/it]
 57%|█████▋    | 21732/37963 [53:31:04<37:28:56,  8.31s/it]
 57%|█████▋    | 21733/37963 [53:31:12<37:01:52,  8.21s/it]
 57%|█████▋    | 21734/37963 [53:31:26<45:48:01, 10.16s/it]
 57%|█████▋    | 21735/37963 [53:31:34<42:39:46,  9.46s/it]
 57%|█████▋    | 21736/37963 [53:31:49<50:42:32, 11.25s/it]
 57%|█████▋    | 21737/37963 [53:31:57<46:13:57, 10.26s/it]
 57%|█████▋    | 21738/37963 [53:32:05<43:00:02,  9.54s/it]
 57%|█████▋    | 21739/37963 [53:32:20<50:17:03, 11.16s/it]
 57%|█████▋    | 21740/37963 [53:32:28<45:50:20, 10.17s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '1.799', 'learning_rate': '8.144e-06', 'epoch': '0.5727'}
+
 57%|█████▋    | 21740/37963 [53:32:28<45:50:20, 10.17s/it]
 57%|█████▋    | 21741/37963 [53:32:36<42:21:26,  9.40s/it]
 57%|█████▋    | 21742/37963 [53:32:43<39:57:27,  8.87s/it]
 57%|█████▋    | 21743/37963 [53:32:51<38:36:20,  8.57s/it]
 57%|█████▋    | 21744/37963 [53:32:59<37:32:38,  8.33s/it]
 57%|█████▋    | 21745/37963 [53:33:07<36:36:49,  8.13s/it]
 57%|█████▋    | 21746/37963 [53:33:14<36:07:06,  8.02s/it]
 57%|█████▋    | 21747/37963 [53:33:22<35:54:20,  7.97s/it]
 57%|█████▋    | 21748/37963 [53:33:30<35:53:36,  7.97s/it]
 57%|█████▋    | 21749/37963 [53:33:38<35:34:55,  7.90s/it]
 57%|█████▋    | 21750/37963 [53:33:52<44:30:02,  9.88s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '1.47', 'learning_rate': '8.136e-06', 'epoch': '0.5729'}
+
 57%|█████▋    | 21750/37963 [53:33:52<44:30:02,  9.88s/it]
 57%|█████▋    | 21751/37963 [53:34:07<51:29:55, 11.44s/it]
 57%|█████▋    | 21752/37963 [53:34:15<46:35:39, 10.35s/it]
 57%|█████▋    | 21753/37963 [53:34:23<43:08:33,  9.58s/it]
 57%|█████▋    | 21754/37963 [53:34:31<40:51:43,  9.08s/it]
 57%|█████▋    | 21755/37963 [53:34:39<38:57:29,  8.65s/it]
 57%|█████▋    | 21756/37963 [53:34:47<37:52:21,  8.41s/it]
 57%|█████▋    | 21757/37963 [53:34:54<36:57:10,  8.21s/it]
 57%|█████▋    | 21758/37963 [53:35:02<36:18:43,  8.07s/it]
 57%|█████▋    | 21759/37963 [53:35:10<36:06:55,  8.02s/it]
 57%|█████▋    | 21760/37963 [53:35:18<35:53:51,  7.98s/it]
                                                           
{'loss': '0.1401', 'grad_norm': '1.099', 'learning_rate': '8.127e-06', 'epoch': '0.5732'}
+
 57%|█████▋    | 21760/37963 [53:35:18<35:53:51,  7.98s/it]
 57%|█████▋    | 21761/37963 [53:35:32<44:39:30,  9.92s/it]
 57%|█████▋    | 21762/37963 [53:35:40<42:04:26,  9.35s/it]
 57%|█████▋    | 21763/37963 [53:35:48<39:43:19,  8.83s/it]
 57%|█████▋    | 21764/37963 [53:35:56<38:11:40,  8.49s/it]
 57%|█████▋    | 21765/37963 [53:36:03<36:54:53,  8.20s/it]
 57%|█████▋    | 21766/37963 [53:36:11<36:19:30,  8.07s/it]
 57%|█████▋    | 21767/37963 [53:36:19<36:07:46,  8.03s/it]
 57%|█████▋    | 21768/37963 [53:36:27<35:55:12,  7.98s/it]
 57%|█████▋    | 21769/37963 [53:36:34<35:37:52,  7.92s/it]
 57%|█████▋    | 21770/37963 [53:36:42<35:30:29,  7.89s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '1.29', 'learning_rate': '8.119e-06', 'epoch': '0.5735'}
+
 57%|█████▋    | 21770/37963 [53:36:42<35:30:29,  7.89s/it]
 57%|█████▋    | 21771/37963 [53:36:50<35:25:41,  7.88s/it]
 57%|█████▋    | 21772/37963 [53:37:05<44:16:25,  9.84s/it]
 57%|█████▋    | 21773/37963 [53:37:12<41:32:01,  9.24s/it]
 57%|█████▋    | 21774/37963 [53:37:20<39:37:30,  8.81s/it]
 57%|█████▋    | 21775/37963 [53:37:28<38:21:13,  8.53s/it]
 57%|█████▋    | 21776/37963 [53:37:43<47:18:26, 10.52s/it]
 57%|█████▋    | 21777/37963 [53:37:52<44:25:35,  9.88s/it]
 57%|█████▋    | 21778/37963 [53:37:59<41:33:47,  9.24s/it]
 57%|█████▋    | 21779/37963 [53:38:07<39:38:24,  8.82s/it]
 57%|█████▋    | 21780/37963 [53:38:15<38:15:38,  8.51s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '1.626', 'learning_rate': '8.111e-06', 'epoch': '0.5737'}
+
 57%|█████▋    | 21780/37963 [53:38:15<38:15:38,  8.51s/it]
 57%|█████▋    | 21781/37963 [53:38:23<37:27:48,  8.33s/it]
 57%|█████▋    | 21782/37963 [53:38:31<36:40:14,  8.16s/it]
 57%|█████▋    | 21783/37963 [53:38:54<56:35:07, 12.59s/it]
 57%|█████▋    | 21784/37963 [53:39:02<50:33:31, 11.25s/it]
 57%|█████▋    | 21785/37963 [53:39:09<45:38:28, 10.16s/it]
 57%|█████▋    | 21786/37963 [53:39:17<42:27:30,  9.45s/it]
 57%|█████▋    | 21787/37963 [53:39:25<40:10:45,  8.94s/it]
 57%|█████▋    | 21788/37963 [53:39:33<38:36:00,  8.59s/it]
 57%|█████▋    | 21789/37963 [53:39:40<37:27:23,  8.34s/it]
 57%|█████▋    | 21790/37963 [53:39:48<36:47:16,  8.19s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '1.504', 'learning_rate': '8.102e-06', 'epoch': '0.574'}
+
 57%|█████▋    | 21790/37963 [53:39:48<36:47:16,  8.19s/it]
 57%|█████▋    | 21791/37963 [53:39:56<36:15:27,  8.07s/it]
 57%|█████▋    | 21792/37963 [53:40:04<35:46:26,  7.96s/it]
 57%|█████▋    | 21793/37963 [53:40:19<45:18:54, 10.09s/it]
 57%|█████▋    | 21794/37963 [53:40:26<42:03:42,  9.36s/it]
 57%|█████▋    | 21795/37963 [53:40:34<40:03:14,  8.92s/it]
 57%|█████▋    | 21796/37963 [53:40:42<38:24:04,  8.55s/it]
 57%|█████▋    | 21797/37963 [53:40:57<46:43:24, 10.40s/it]
 57%|█████▋    | 21798/37963 [53:41:05<43:13:17,  9.63s/it]
 57%|█████▋    | 21799/37963 [53:41:19<50:08:34, 11.17s/it]
 57%|█████▋    | 21800/37963 [53:41:27<45:40:51, 10.17s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '1.28', 'learning_rate': '8.094e-06', 'epoch': '0.5742'}
+
 57%|█████▋    | 21800/37963 [53:41:27<45:40:51, 10.17s/it]
 57%|█████▋    | 21801/37963 [53:41:35<42:06:31,  9.38s/it]
 57%|█████▋    | 21802/37963 [53:41:42<39:55:19,  8.89s/it]
 57%|█████▋    | 21803/37963 [53:41:50<38:15:15,  8.52s/it]
 57%|█████▋    | 21804/37963 [53:41:58<37:19:41,  8.32s/it]
 57%|█████▋    | 21805/37963 [53:42:06<36:28:52,  8.13s/it]
 57%|█████▋    | 21806/37963 [53:42:13<36:02:22,  8.03s/it]
 57%|█████▋    | 21807/37963 [53:42:21<35:35:02,  7.93s/it]
 57%|█████▋    | 21808/37963 [53:42:29<35:23:44,  7.89s/it]
 57%|█████▋    | 21809/37963 [53:42:37<35:19:41,  7.87s/it]
 57%|█████▋    | 21810/37963 [53:42:45<35:10:16,  7.84s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '2.775', 'learning_rate': '8.086e-06', 'epoch': '0.5745'}
+
 57%|█████▋    | 21810/37963 [53:42:45<35:10:16,  7.84s/it]
 57%|█████▋    | 21811/37963 [53:42:52<34:54:47,  7.78s/it]
 57%|█████▋    | 21812/37963 [53:43:06<43:33:56,  9.71s/it]
 57%|█████▋    | 21813/37963 [53:43:14<40:54:03,  9.12s/it]
 57%|█████▋    | 21814/37963 [53:43:22<39:07:17,  8.72s/it]
 57%|█████▋    | 21815/37963 [53:43:29<37:34:08,  8.38s/it]
 57%|█████▋    | 21816/37963 [53:43:37<36:21:54,  8.11s/it]
 57%|█████▋    | 21817/37963 [53:43:45<35:40:54,  7.96s/it]
 57%|█████▋    | 21818/37963 [53:43:52<35:16:24,  7.87s/it]
 57%|█████▋    | 21819/37963 [53:44:00<35:10:59,  7.85s/it]
 57%|█████▋    | 21820/37963 [53:44:08<34:56:52,  7.79s/it]
                                                           
{'loss': '0.1351', 'grad_norm': '1.544', 'learning_rate': '8.077e-06', 'epoch': '0.5748'}
+
 57%|█████▋    | 21820/37963 [53:44:08<34:56:52,  7.79s/it]
 57%|█████▋    | 21821/37963 [53:44:15<34:38:05,  7.72s/it]
 57%|█████▋    | 21822/37963 [53:44:30<44:36:00,  9.95s/it]
 57%|��████▋    | 21823/37963 [53:44:38<41:44:56,  9.31s/it]
 57%|█████▋    | 21824/37963 [53:44:46<39:38:21,  8.84s/it]
 57%|█████▋    | 21825/37963 [53:44:54<38:14:40,  8.53s/it]
 57%|█████▋    | 21826/37963 [53:45:01<37:08:33,  8.29s/it]
 57%|█████▋    | 21827/37963 [53:45:09<36:38:55,  8.18s/it]
 57%|█████▋    | 21828/37963 [53:45:31<55:18:04, 12.34s/it]
 58%|█████▊    | 21829/37963 [53:45:39<49:24:46, 11.03s/it]
 58%|█████▊    | 21830/37963 [53:45:47<45:09:01, 10.08s/it]
                                                           
{'loss': '0.1506', 'grad_norm': '2.058', 'learning_rate': '8.069e-06', 'epoch': '0.575'}
+
 58%|█████▊    | 21830/37963 [53:45:47<45:09:01, 10.08s/it]
 58%|█████▊    | 21831/37963 [53:46:02<51:26:22, 11.48s/it]
 58%|█████▊    | 21832/37963 [53:46:10<46:29:06, 10.37s/it]
 58%|█████▊    | 21833/37963 [53:46:18<43:02:46,  9.61s/it]
 58%|█████▊    | 21834/37963 [53:46:25<40:36:06,  9.06s/it]
 58%|█████▊    | 21835/37963 [53:46:33<38:29:29,  8.59s/it]
 58%|█████▊    | 21836/37963 [53:46:41<37:26:02,  8.36s/it]
 58%|█████▊    | 21837/37963 [53:46:48<36:35:32,  8.17s/it]
 58%|█████▊    | 21838/37963 [53:46:56<36:06:24,  8.06s/it]
 58%|█████▊    | 21839/37963 [53:47:04<35:09:56,  7.85s/it]
 58%|█████▊    | 21840/37963 [53:47:11<35:07:37,  7.84s/it]
                                                           
{'loss': '0.1373', 'grad_norm': '1.664', 'learning_rate': '8.06e-06', 'epoch': '0.5753'}
+
 58%|█████▊    | 21840/37963 [53:47:11<35:07:37,  7.84s/it]
 58%|█████▊    | 21841/37963 [53:47:19<35:09:19,  7.85s/it]
 58%|█████▊    | 21842/37963 [53:47:27<35:10:55,  7.86s/it]
 58%|█████▊    | 21843/37963 [53:47:42<44:57:53, 10.04s/it]
 58%|█████▊    | 21844/37963 [53:47:57<51:28:40, 11.50s/it]
 58%|█████▊    | 21845/37963 [53:48:05<46:41:12, 10.43s/it]
 58%|█████▊    | 21846/37963 [53:48:13<43:11:36,  9.65s/it]
 58%|█████▊    | 21847/37963 [53:48:28<49:59:49, 11.17s/it]
 58%|█████▊    | 21848/37963 [53:48:36<45:38:54, 10.20s/it]
 58%|█████▊    | 21849/37963 [53:48:43<42:19:10,  9.45s/it]
 58%|█████▊    | 21850/37963 [53:48:51<40:07:32,  8.96s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '0.8384', 'learning_rate': '8.052e-06', 'epoch': '0.5756'}
+
 58%|█████▊    | 21850/37963 [53:48:51<40:07:32,  8.96s/it]
 58%|█████▊    | 21851/37963 [53:48:59<38:42:32,  8.65s/it]
 58%|█████▊    | 21852/37963 [53:49:07<37:57:12,  8.48s/it]
 58%|█████▊    | 21853/37963 [53:49:15<37:10:50,  8.31s/it]
 58%|█████▊    | 21854/37963 [53:49:23<36:25:30,  8.14s/it]
 58%|█████▊    | 21855/37963 [53:49:31<36:03:33,  8.06s/it]
 58%|█████▊    | 21856/37963 [53:49:45<44:14:04,  9.89s/it]
 58%|█████▊    | 21857/37963 [53:49:53<41:23:06,  9.25s/it]
 58%|█████▊    | 21858/37963 [53:50:00<39:18:38,  8.79s/it]
 58%|█████▊    | 21859/37963 [53:50:08<38:01:35,  8.50s/it]
 58%|█████▊    | 21860/37963 [53:50:16<37:01:14,  8.28s/it]
                                                           
{'loss': '0.149', 'grad_norm': '1.309', 'learning_rate': '8.044e-06', 'epoch': '0.5758'}
+
 58%|█████▊    | 21860/37963 [53:50:16<37:01:14,  8.28s/it]
 58%|█████▊    | 21861/37963 [53:50:24<36:18:41,  8.12s/it]
 58%|█████▊    | 21862/37963 [53:50:31<35:31:46,  7.94s/it]
 58%|█████▊    | 21863/37963 [53:50:39<35:18:51,  7.90s/it]
 58%|█████▊    | 21864/37963 [53:50:47<35:05:31,  7.85s/it]
 58%|█████▊    | 21865/37963 [53:50:55<35:04:54,  7.85s/it]
 58%|█████▊    | 21866/37963 [53:51:09<44:24:33,  9.93s/it]
 58%|█████▊    | 21867/37963 [53:51:17<41:51:50,  9.36s/it]
 58%|█████▊    | 21868/37963 [53:51:25<39:48:51,  8.91s/it]
 58%|█████▊    | 21869/37963 [53:51:33<38:23:17,  8.59s/it]
 58%|█████▊    | 21870/37963 [53:51:41<37:36:54,  8.41s/it]
                                                           
{'loss': '0.1302', 'grad_norm': '0.9823', 'learning_rate': '8.035e-06', 'epoch': '0.5761'}
+
 58%|█████▊    | 21870/37963 [53:51:41<37:36:54,  8.41s/it]
 58%|█████▊    | 21871/37963 [53:51:56<45:45:06, 10.24s/it]
 58%|█████▊    | 21872/37963 [53:52:04<42:48:28,  9.58s/it]
 58%|█████▊    | 21873/37963 [53:52:11<40:25:08,  9.04s/it]
 58%|█████▊    | 21874/37963 [53:52:19<38:19:59,  8.58s/it]
 58%|█████▊    | 21875/37963 [53:52:27<37:17:53,  8.35s/it]
 58%|█████▊    | 21876/37963 [53:52:34<35:57:47,  8.05s/it]
 58%|█████▊    | 21877/37963 [53:52:42<35:30:52,  7.95s/it]
 58%|█████▊    | 21878/37963 [53:52:50<35:31:01,  7.95s/it]
 58%|█████▊    | 21879/37963 [53:52:58<35:19:21,  7.91s/it]
 58%|█████▊    | 21880/37963 [53:53:05<35:03:55,  7.85s/it]
                                                           
{'loss': '0.1312', 'grad_norm': '2.014', 'learning_rate': '8.027e-06', 'epoch': '0.5764'}
+
 58%|█████▊    | 21880/37963 [53:53:05<35:03:55,  7.85s/it]
 58%|█████▊    | 21881/37963 [53:53:20<44:41:24, 10.00s/it]
 58%|█████▊    | 21882/37963 [53:53:36<51:42:18, 11.58s/it]
 58%|█████▊    | 21883/37963 [53:53:43<46:48:35, 10.48s/it]
 58%|█████▊    | 21884/37963 [53:53:51<43:22:39,  9.71s/it]
 58%|█████▊    | 21885/37963 [53:53:59<40:50:33,  9.15s/it]
 58%|█████▊    | 21886/37963 [53:54:07<39:22:49,  8.82s/it]
 58%|█████▊    | 21887/37963 [53:54:15<37:37:06,  8.42s/it]
 58%|█████▊    | 21888/37963 [53:54:29<45:58:12, 10.30s/it]
 58%|█████▊    | 21889/37963 [53:54:37<42:42:38,  9.57s/it]
 58%|█████▊    | 21890/37963 [53:54:45<40:03:47,  8.97s/it]
                                                           
{'loss': '0.156', 'grad_norm': '2.684', 'learning_rate': '8.019e-06', 'epoch': '0.5766'}
+
 58%|█████▊    | 21890/37963 [53:54:45<40:03:47,  8.97s/it]
 58%|█████▊    | 21891/37963 [53:55:00<47:57:48, 10.74s/it]
 58%|█████▊    | 21892/37963 [53:55:08<44:15:02,  9.91s/it]
 58%|█████▊    | 21893/37963 [53:55:15<41:16:03,  9.24s/it]
 58%|█████▊    | 21894/37963 [53:55:23<39:28:42,  8.84s/it]
 58%|█████▊    | 21895/37963 [53:55:31<38:03:59,  8.53s/it]
 58%|█████▊    | 21896/37963 [53:55:39<37:24:10,  8.38s/it]
 58%|█████▊    | 21897/37963 [53:55:54<45:52:43, 10.28s/it]
 58%|█████▊    | 21898/37963 [53:56:02<42:29:52,  9.52s/it]
 58%|█████▊    | 21899/37963 [53:56:10<40:18:07,  9.03s/it]
 58%|█████▊    | 21900/37963 [53:56:17<38:45:52,  8.69s/it]
                                                           
{'loss': '0.1349', 'grad_norm': '1.078', 'learning_rate': '8.01e-06', 'epoch': '0.5769'}
+
 58%|█████▊    | 21900/37963 [53:56:17<38:45:52,  8.69s/it]
 58%|█████▊    | 21901/37963 [53:56:25<37:24:38,  8.38s/it]
 58%|█████▊    | 21902/37963 [53:56:33<36:29:07,  8.18s/it]
 58%|█████▊    | 21903/37963 [53:56:41<35:57:18,  8.06s/it]
 58%|█████▊    | 21904/37963 [53:56:48<35:42:03,  8.00s/it]
 58%|█████▊    | 21905/37963 [53:57:03<44:52:34, 10.06s/it]
 58%|█████▊    | 21906/37963 [53:57:11<41:58:49,  9.41s/it]
 58%|█████▊    | 21907/37963 [53:57:19<39:48:45,  8.93s/it]
 58%|█████▊    | 21908/37963 [53:57:27<38:10:16,  8.56s/it]
 58%|█████▊    | 21909/37963 [53:57:34<36:55:07,  8.28s/it]
 58%|█████▊    | 21910/37963 [53:57:42<36:12:45,  8.12s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '2.605', 'learning_rate': '8.002e-06', 'epoch': '0.5771'}
+
 58%|█████▊    | 21910/37963 [53:57:42<36:12:45,  8.12s/it]
 58%|█████▊    | 21911/37963 [53:57:57<45:11:03, 10.13s/it]
 58%|█████▊    | 21912/37963 [53:58:05<42:31:35,  9.54s/it]
 58%|█████▊    | 21913/37963 [53:58:13<40:11:49,  9.02s/it]
 58%|█████▊    | 21914/37963 [53:58:21<38:35:46,  8.66s/it]
 58%|█████▊    | 21915/37963 [53:58:28<37:24:48,  8.39s/it]
 58%|█████▊    | 21916/37963 [53:58:44<46:25:29, 10.41s/it]
 58%|█████▊    | 21917/37963 [53:58:51<43:05:36,  9.67s/it]
 58%|█████▊    | 21918/37963 [53:58:59<40:46:05,  9.15s/it]
 58%|█████▊    | 21919/37963 [53:59:07<38:43:50,  8.69s/it]
 58%|█████▊    | 21920/37963 [53:59:15<37:36:01,  8.44s/it]
                                                           
{'loss': '0.1436', 'grad_norm': '3.048', 'learning_rate': '7.993e-06', 'epoch': '0.5774'}
+
 58%|█████▊    | 21920/37963 [53:59:15<37:36:01,  8.44s/it]
 58%|█████▊    | 21921/37963 [53:59:23<36:41:21,  8.23s/it]
 58%|█████▊    | 21922/37963 [53:59:30<36:03:56,  8.09s/it]
 58%|█████▊    | 21923/37963 [53:59:38<35:36:24,  7.99s/it]
 58%|█████▊    | 21924/37963 [53:59:46<35:18:42,  7.93s/it]
 58%|█████▊    | 21925/37963 [53:59:54<35:05:18,  7.88s/it]
 58%|█████▊    | 21926/37963 [54:00:01<34:51:07,  7.82s/it]
 58%|█████▊    | 21927/37963 [54:00:09<34:54:06,  7.84s/it]
 58%|█████▊    | 21928/37963 [54:00:17<34:52:31,  7.83s/it]
 58%|█████▊    | 21929/37963 [54:00:32<44:17:57,  9.95s/it]
 58%|█████▊    | 21930/37963 [54:00:47<50:36:42, 11.36s/it]
                                                           
{'loss': '0.1312', 'grad_norm': '1.659', 'learning_rate': '7.985e-06', 'epoch': '0.5777'}
+
 58%|█████▊    | 21930/37963 [54:00:47<50:36:42, 11.36s/it]
 58%|█��███▊    | 21931/37963 [54:01:01<54:32:36, 12.25s/it]
 58%|█████▊    | 21932/37963 [54:01:08<48:07:34, 10.81s/it]
 58%|█████▊    | 21933/37963 [54:01:16<44:23:29,  9.97s/it]
 58%|█████▊    | 21934/37963 [54:01:24<41:48:17,  9.39s/it]
 58%|█████▊    | 21935/37963 [54:01:32<39:36:22,  8.90s/it]
 58%|█████▊    | 21936/37963 [54:01:40<38:06:58,  8.56s/it]
 58%|█████▊    | 21937/37963 [54:01:48<37:06:53,  8.34s/it]
 58%|█████▊    | 21938/37963 [54:01:56<36:20:49,  8.17s/it]
 58%|█████▊    | 21939/37963 [54:02:04<36:08:06,  8.12s/it]
 58%|█████▊    | 21940/37963 [54:02:19<45:21:06, 10.19s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '1.267', 'learning_rate': '7.977e-06', 'epoch': '0.5779'}
+
 58%|█████▊    | 21940/37963 [54:02:19<45:21:06, 10.19s/it]
 58%|█████▊    | 21941/37963 [54:02:33<51:04:20, 11.48s/it]
 58%|█████▊    | 21942/37963 [54:02:41<46:00:17, 10.34s/it]
 58%|█████▊    | 21943/37963 [54:02:49<42:53:25,  9.64s/it]
 58%|█████▊    | 21944/37963 [54:02:56<40:20:22,  9.07s/it]
 58%|█████▊    | 21945/37963 [54:03:04<38:14:06,  8.59s/it]
 58%|█████▊    | 21946/37963 [54:03:12<37:16:20,  8.38s/it]
 58%|█████▊    | 21947/37963 [54:03:20<36:29:04,  8.20s/it]
 58%|█████▊    | 21948/37963 [54:03:28<36:12:46,  8.14s/it]
 58%|█████▊    | 21949/37963 [54:03:35<35:50:10,  8.06s/it]
 58%|█████▊    | 21950/37963 [54:03:50<44:32:40, 10.01s/it]
                                                           
{'loss': '0.1332', 'grad_norm': '1.718', 'learning_rate': '7.968e-06', 'epoch': '0.5782'}
+
 58%|█████▊    | 21950/37963 [54:03:50<44:32:40, 10.01s/it]
 58%|█████▊    | 21951/37963 [54:03:58<41:40:38,  9.37s/it]
 58%|█████▊    | 21952/37963 [54:04:06<39:32:50,  8.89s/it]
 58%|█████▊    | 21953/37963 [54:04:13<38:00:52,  8.55s/it]
 58%|█████▊    | 21954/37963 [54:04:21<36:55:51,  8.30s/it]
 58%|█████▊    | 21955/37963 [54:04:29<36:13:58,  8.15s/it]
 58%|█████▊    | 21956/37963 [54:04:37<35:44:27,  8.04s/it]
 58%|█████▊    | 21957/37963 [54:04:44<35:15:56,  7.93s/it]
 58%|█████▊    | 21958/37963 [54:04:52<35:06:47,  7.90s/it]
 58%|█████▊    | 21959/37963 [54:05:00<35:03:45,  7.89s/it]
 58%|█████▊    | 21960/37963 [54:05:08<34:36:21,  7.78s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '3.022', 'learning_rate': '7.96e-06', 'epoch': '0.5785'}
+
 58%|█████▊    | 21960/37963 [54:05:08<34:36:21,  7.78s/it]
 58%|█████▊    | 21961/37963 [54:05:15<34:38:55,  7.80s/it]
 58%|█████▊    | 21962/37963 [54:05:23<34:39:38,  7.80s/it]
 58%|█████▊    | 21963/37963 [54:05:31<34:34:21,  7.78s/it]
 58%|█████▊    | 21964/37963 [54:05:39<34:26:53,  7.75s/it]
 58%|█████▊    | 21965/37963 [54:06:01<53:32:07, 12.05s/it]
 58%|█████▊    | 21966/37963 [54:06:09<47:52:56, 10.78s/it]
 58%|█████▊    | 21967/37963 [54:06:16<43:25:30,  9.77s/it]
 58%|█████▊    | 21968/37963 [54:06:24<40:48:36,  9.19s/it]
 58%|█████▊    | 21969/37963 [54:06:32<38:57:50,  8.77s/it]
 58%|█████▊    | 21970/37963 [54:06:40<37:44:45,  8.50s/it]
                                                           
{'loss': '0.1429', 'grad_norm': '1.165', 'learning_rate': '7.952e-06', 'epoch': '0.5787'}
+
 58%|█████▊    | 21970/37963 [54:06:40<37:44:45,  8.50s/it]
 58%|█████▊    | 21971/37963 [54:06:47<36:43:45,  8.27s/it]
 58%|█████▊    | 21972/37963 [54:06:55<36:02:29,  8.11s/it]
 58%|█████▊    | 21973/37963 [54:07:03<35:56:07,  8.09s/it]
 58%|█████▊    | 21974/37963 [54:07:18<45:17:28, 10.20s/it]
 58%|█████▊    | 21975/37963 [54:07:33<51:07:35, 11.51s/it]
 58%|█████▊    | 21976/37963 [54:07:41<46:17:07, 10.42s/it]
 58%|█████▊    | 21977/37963 [54:07:56<52:24:46, 11.80s/it]
 58%|█████▊    | 21978/37963 [54:08:03<47:05:27, 10.61s/it]
 58%|█████▊    | 21979/37963 [54:08:11<43:23:58,  9.77s/it]
 58%|█████▊    | 21980/37963 [54:08:19<40:41:50,  9.17s/it]
                                                           
{'loss': '0.1379', 'grad_norm': '2.082', 'learning_rate': '7.943e-06', 'epoch': '0.579'}
+
 58%|█████▊    | 21980/37963 [54:08:19<40:41:50,  9.17s/it]
 58%|█████▊    | 21981/37963 [54:08:27<38:31:13,  8.68s/it]
 58%|█████▊    | 21982/37963 [54:08:34<37:15:10,  8.39s/it]
 58%|█████▊    | 21983/37963 [54:08:42<36:09:06,  8.14s/it]
 58%|█████▊    | 21984/37963 [54:08:49<35:24:11,  7.98s/it]
 58%|█████▊    | 21985/37963 [54:09:04<44:05:17,  9.93s/it]
 58%|█████▊    | 21986/37963 [54:09:12<41:24:24,  9.33s/it]
 58%|█████▊    | 21987/37963 [54:09:20<39:34:56,  8.92s/it]
 58%|█████▊    | 21988/37963 [54:09:35<47:37:44, 10.73s/it]
 58%|█████▊    | 21989/37963 [54:09:43<43:50:06,  9.88s/it]
 58%|█████▊    | 21990/37963 [54:09:50<40:59:56,  9.24s/it]
                                                           
{'loss': '0.1383', 'grad_norm': '1.928', 'learning_rate': '7.935e-06', 'epoch': '0.5793'}
+
 58%|█████▊    | 21990/37963 [54:09:50<40:59:56,  9.24s/it]
 58%|█████▊    | 21991/37963 [54:09:58<39:00:10,  8.79s/it]
 58%|█████▊    | 21992/37963 [54:10:06<37:34:26,  8.47s/it]
 58%|█████▊    | 21993/37963 [54:10:14<36:33:08,  8.24s/it]
 58%|█████▊    | 21994/37963 [54:10:21<35:58:40,  8.11s/it]
 58%|█████▊    | 21995/37963 [54:10:29<35:49:12,  8.08s/it]
 58%|█████▊    | 21996/37963 [54:10:37<35:28:18,  8.00s/it]
 58%|█████▊    | 21997/37963 [54:10:45<35:08:23,  7.92s/it]
 58%|█████▊    | 21998/37963 [54:11:00<44:22:26, 10.01s/it]
 58%|█████▊    | 21999/37963 [54:11:08<41:43:49,  9.41s/it]
 58%|█████▊    | 22000/37963 [54:11:16<39:39:52,  8.95s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '1.401', 'learning_rate': '7.927e-06', 'epoch': '0.5795'}
+
 58%|█████▊    | 22000/37963 [54:11:16<39:39:52,  8.95s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:11<00:00, 11.30s/it]
Writing model shards: 100%|██████████| 1/1 [00:11<00:00, 11.30s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 58%|█████▊    | 22001/37963 [54:12:17<108:44:25, 24.52s/it]
 58%|█████▊    | 22002/37963 [54:12:25<86:47:20, 19.58s/it] 
 58%|█████▊    | 22003/37963 [54:12:32<71:13:02, 16.06s/it]
 58%|█████▊    | 22004/37963 [54:12:40<60:27:20, 13.64s/it]
 58%|█████▊    | 22005/37963 [54:12:48<52:25:36, 11.83s/it]
 58%|█████▊    | 22006/37963 [54:12:56<47:00:24, 10.61s/it]
 58%|█████▊    | 22007/37963 [54:13:04<43:19:27,  9.77s/it]
 58%|█████▊    | 22008/37963 [54:13:12<40:46:27,  9.20s/it]
 58%|█████▊    | 22009/37963 [54:13:19<39:02:11,  8.81s/it]
 58%|█████▊    | 22010/37963 [54:13:27<37:41:48,  8.51s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '1.99', 'learning_rate': '7.918e-06', 'epoch': '0.5798'}
+
 58%|█████▊    | 22010/37963 [54:13:27<37:41:48,  8.51s/it]
 58%|█████▊    | 22011/37963 [54:13:49<55:59:12, 12.63s/it]
 58%|█████▊    | 22012/37963 [54:13:57<49:34:56, 11.19s/it]
 58%|█████▊    | 22013/37963 [54:14:05<44:57:12, 10.15s/it]
 58%|█████▊    | 22014/37963 [54:14:13<41:57:17,  9.47s/it]
 58%|█████▊    | 22015/37963 [54:14:21<39:46:15,  8.98s/it]
 58%|█████▊    | 22016/37963 [54:14:29<38:14:07,  8.63s/it]
 58%|█████▊    | 22017/37963 [54:14:36<37:07:23,  8.38s/it]
 58%|█████▊    | 22018/37963 [54:14:44<36:33:38,  8.25s/it]
 58%|█████▊    | 22019/37963 [54:14:52<35:57:42,  8.12s/it]
 58%|█████▊    | 22020/37963 [54:15:07<44:42:36, 10.10s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '3.571', 'learning_rate': '7.91e-06', 'epoch': '0.58'}
+
 58%|█████▊    | 22020/37963 [54:15:07<44:42:36, 10.10s/it]
 58%|█████▊    | 22021/37963 [54:15:22<51:09:17, 11.55s/it]
 58%|█████▊    | 22022/37963 [54:15:30<46:21:23, 10.47s/it]
 58%|█████▊    | 22023/37963 [54:15:37<42:43:43,  9.65s/it]
 58%|█████▊    | 22024/37963 [54:15:45<40:14:20,  9.09s/it]
 58%|█████▊    | 22025/37963 [54:15:53<38:17:35,  8.65s/it]
 58%|█████▊    | 22026/37963 [54:16:01<37:10:05,  8.40s/it]
 58%|█████▊    | 22027/37963 [54:16:08<36:21:30,  8.21s/it]
 58%|█████▊    | 22028/37963 [54:16:23<45:09:51, 10.20s/it]
 58%|█████▊    | 22029/37963 [54:16:31<42:19:28,  9.56s/it]
 58%|█████▊    | 22030/37963 [54:16:39<39:55:16,  9.02s/it]
                                                           
{'loss': '0.1405', 'grad_norm': '1.592', 'learning_rate': '7.902e-06', 'epoch': '0.5803'}
+
 58%|█████▊    | 22030/37963 [54:16:39<39:55:16,  9.02s/it]
 58%|█████▊    | 22031/37963 [54:16:47<38:26:18,  8.69s/it]
 58%|█████▊    | 22032/37963 [54:16:55<37:25:20,  8.46s/it]
 58%|█████▊    | 22033/37963 [54:17:03<36:50:30,  8.33s/it]
 58%|█████▊    | 22034/37963 [54:17:11<36:04:24,  8.15s/it]
 58%|███��█▊    | 22035/37963 [54:17:25<44:29:58, 10.06s/it]
 58%|█████▊    | 22036/37963 [54:17:33<41:39:56,  9.42s/it]
 58%|█████▊    | 22037/37963 [54:17:41<39:16:29,  8.88s/it]
 58%|█████▊    | 22038/37963 [54:17:48<37:39:48,  8.51s/it]
 58%|█████▊    | 22039/37963 [54:18:03<46:04:57, 10.42s/it]
 58%|█████▊    | 22040/37963 [54:18:11<42:41:10,  9.65s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '1.675', 'learning_rate': '7.893e-06', 'epoch': '0.5806'}
+
 58%|█████▊    | 22040/37963 [54:18:11<42:41:10,  9.65s/it]
 58%|█████▊    | 22041/37963 [54:18:19<40:32:33,  9.17s/it]
 58%|█████▊    | 22042/37963 [54:18:27<38:46:53,  8.77s/it]
 58%|█████▊    | 22043/37963 [54:18:35<37:25:26,  8.46s/it]
 58%|█████▊    | 22044/37963 [54:18:43<36:28:41,  8.25s/it]
 58%|█████▊    | 22045/37963 [54:18:50<35:58:42,  8.14s/it]
 58%|█████▊    | 22046/37963 [54:18:58<35:44:14,  8.08s/it]
 58%|█████▊    | 22047/37963 [54:19:06<35:34:00,  8.04s/it]
 58%|█████▊    | 22048/37963 [54:19:14<35:09:10,  7.95s/it]
 58%|█████▊    | 22049/37963 [54:19:22<34:50:17,  7.88s/it]
 58%|█████▊    | 22050/37963 [54:19:29<34:37:30,  7.83s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '2.127', 'learning_rate': '7.885e-06', 'epoch': '0.5808'}
+
 58%|█████▊    | 22050/37963 [54:19:29<34:37:30,  7.83s/it]
 58%|█████▊    | 22051/37963 [54:19:37<34:07:01,  7.72s/it]
 58%|█████▊    | 22052/37963 [54:19:54<46:09:25, 10.44s/it]
 58%|█████▊    | 22053/37963 [54:20:02<42:51:02,  9.70s/it]
 58%|█████▊    | 22054/37963 [54:20:09<40:20:52,  9.13s/it]
 58%|█████▊    | 22055/37963 [54:20:32<57:45:02, 13.07s/it]
 58%|█████▊    | 22056/37963 [54:20:40<50:48:15, 11.50s/it]
 58%|█████▊    | 22057/37963 [54:20:47<46:01:09, 10.42s/it]
 58%|█████▊    | 22058/37963 [54:20:55<42:27:55,  9.61s/it]
 58%|█████▊    | 22059/37963 [54:21:03<40:03:38,  9.07s/it]
 58%|█████▊    | 22060/37963 [54:21:11<38:17:12,  8.67s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '2.3', 'learning_rate': '7.877e-06', 'epoch': '0.5811'}
+
 58%|█████▊    | 22060/37963 [54:21:11<38:17:12,  8.67s/it]
 58%|█████▊    | 22061/37963 [54:21:18<37:03:01,  8.39s/it]
 58%|█████▊    | 22062/37963 [54:21:26<36:10:01,  8.19s/it]
 58%|█████▊    | 22063/37963 [54:21:34<35:31:47,  8.04s/it]
 58%|█████▊    | 22064/37963 [54:21:49<45:09:21, 10.22s/it]
 58%|█████▊    | 22065/37963 [54:22:04<51:11:43, 11.59s/it]
 58%|█████▊    | 22066/37963 [54:22:12<46:06:58, 10.44s/it]
 58%|█████▊    | 22067/37963 [54:22:20<42:42:28,  9.67s/it]
 58%|█████▊    | 22068/37963 [54:22:27<39:57:24,  9.05s/it]
 58%|█████▊    | 22069/37963 [54:22:35<38:07:16,  8.63s/it]
 58%|█████▊    | 22070/37963 [54:22:43<36:56:39,  8.37s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.134', 'learning_rate': '7.868e-06', 'epoch': '0.5814'}
+
 58%|█████▊    | 22070/37963 [54:22:43<36:56:39,  8.37s/it]
 58%|█████▊    | 22071/37963 [54:22:50<35:56:44,  8.14s/it]
 58%|█████▊    | 22072/37963 [54:22:58<35:21:44,  8.01s/it]
 58%|█████▊    | 22073/37963 [54:23:06<34:49:42,  7.89s/it]
 58%|█████▊    | 22074/37963 [54:23:13<34:26:10,  7.80s/it]
 58%|█████▊    | 22075/37963 [54:23:21<34:32:56,  7.83s/it]
 58%|█████▊    | 22076/37963 [54:23:36<44:05:26,  9.99s/it]
 58%|█████▊    | 22077/37963 [54:23:44<41:04:05,  9.31s/it]
 58%|█████▊    | 22078/37963 [54:23:52<39:07:11,  8.87s/it]
 58%|█████▊    | 22079/37963 [54:23:59<37:38:06,  8.53s/it]
 58%|█████▊    | 22080/37963 [54:24:07<36:43:34,  8.32s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.006', 'learning_rate': '7.86e-06', 'epoch': '0.5816'}
+
 58%|█████▊    | 22080/37963 [54:24:07<36:43:34,  8.32s/it]
 58%|█████▊    | 22081/37963 [54:24:15<36:04:17,  8.18s/it]
 58%|█████▊    | 22082/37963 [54:24:23<35:30:01,  8.05s/it]
 58%|█████▊    | 22083/37963 [54:24:31<35:07:09,  7.96s/it]
 58%|█████▊    | 22084/37963 [54:24:46<44:44:15, 10.14s/it]
 58%|█████▊    | 22085/37963 [54:24:54<41:37:22,  9.44s/it]
 58%|█████▊    | 22086/37963 [54:25:01<39:31:53,  8.96s/it]
 58%|█████▊    | 22087/37963 [54:25:09<37:53:30,  8.59s/it]
 58%|█████▊    | 22088/37963 [54:25:17<36:41:47,  8.32s/it]
 58%|█████▊    | 22089/37963 [54:25:24<35:33:02,  8.06s/it]
 58%|█████▊    | 22090/37963 [54:25:32<35:14:09,  7.99s/it]
                                                           
{'loss': '0.1412', 'grad_norm': '1.049', 'learning_rate': '7.852e-06', 'epoch': '0.5819'}
+
 58%|█████▊    | 22090/37963 [54:25:32<35:14:09,  7.99s/it]
 58%|█████▊    | 22091/37963 [54:25:47<44:24:37, 10.07s/it]
 58%|█████▊    | 22092/37963 [54:25:55<41:49:25,  9.49s/it]
 58%|█████▊    | 22093/37963 [54:26:03<39:31:23,  8.97s/it]
 58%|█████▊    | 22094/37963 [54:26:11<38:06:38,  8.65s/it]
 58%|█████▊    | 22095/37963 [54:26:19<37:07:39,  8.42s/it]
 58%|█████▊    | 22096/37963 [54:26:27<36:16:56,  8.23s/it]
 58%|█████▊    | 22097/37963 [54:26:34<35:32:02,  8.06s/it]
 58%|█████▊    | 22098/37963 [54:26:49<44:11:56, 10.03s/it]
 58%|█████▊    | 22099/37963 [54:26:56<41:02:13,  9.31s/it]
 58%|█████▊    | 22100/37963 [54:27:19<58:01:22, 13.17s/it]
                                                           
{'loss': '0.14', 'grad_norm': '2.217', 'learning_rate': '7.843e-06', 'epoch': '0.5821'}
+
 58%|█████▊    | 22100/37963 [54:27:19<58:01:22, 13.17s/it]
 58%|█████▊    | 22101/37963 [54:27:26<50:55:30, 11.56s/it]
 58%|█████▊    | 22102/37963 [54:27:34<45:50:28, 10.40s/it]
 58%|█████▊    | 22103/37963 [54:27:42<42:29:29,  9.65s/it]
 58%|█████▊    | 22104/37963 [54:27:50<40:07:07,  9.11s/it]
 58%|█████▊    | 22105/37963 [54:27:58<38:12:45,  8.67s/it]
 58%|█████▊    | 22106/37963 [54:28:05<37:03:04,  8.41s/it]
 58%|█████▊    | 22107/37963 [54:28:13<36:08:18,  8.20s/it]
 58%|█████▊    | 22108/37963 [54:28:28<45:22:08, 10.30s/it]
 58%|█████▊    | 22109/37963 [54:28:36<42:06:46,  9.56s/it]
 58%|█████▊    | 22110/37963 [54:28:44<39:37:55,  9.00s/it]
                                                           
{'loss': '0.1354', 'grad_norm': '0.9829', 'learning_rate': '7.835e-06', 'epoch': '0.5824'}
+
 58%|█████▊    | 22110/37963 [54:28:44<39:37:55,  9.00s/it]
 58%|█████▊    | 22111/37963 [54:28:51<37:53:41,  8.61s/it]
 58%|█████▊    | 22112/37963 [54:28:59<36:46:57,  8.35s/it]
 58%|█████▊    | 22113/37963 [54:29:14<44:38:03, 10.14s/it]
 58%|█████▊    | 22114/37963 [54:29:22<41:52:16,  9.51s/it]
 58%|█████▊    | 22115/37963 [54:29:29<39:35:25,  8.99s/it]
 58%|█████▊    | 22116/37963 [54:29:37<37:56:05,  8.62s/it]
 58%|█████▊    | 22117/37963 [54:29:45<36:43:54,  8.35s/it]
 58%|█████▊    | 22118/37963 [54:29:53<36:01:23,  8.18s/it]
 58%|█████▊    | 22119/37963 [54:30:00<35:28:24,  8.06s/it]
 58%|█████▊    | 22120/37963 [54:30:08<35:04:57,  7.97s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '2.198', 'learning_rate': '7.827e-06', 'epoch': '0.5827'}
+
 58%|█████▊    | 22120/37963 [54:30:08<35:04:57,  7.97s/it]
 58%|█████▊    | 22121/37963 [54:30:16<35:11:37,  8.00s/it]
 58%|█████▊    | 22122/37963 [54:30:24<34:43:08,  7.89s/it]
 58%|█████▊    | 22123/37963 [54:30:32<34:41:27,  7.88s/it]
 58%|█████▊    | 22124/37963 [54:30:47<44:11:04, 10.04s/it]
 58%|█████▊    | 22125/37963 [54:30:55<41:06:44,  9.34s/it]
 58%|█████▊    | 22126/37963 [54:31:02<38:58:33,  8.86s/it]
 58%|█████▊    | 22127/37963 [54:31:10<37:27:11,  8.51s/it]
 58%|█████▊    | 22128/37963 [54:31:24<44:58:28, 10.22s/it]
 58%|█████▊    | 22129/37963 [54:31:32<41:32:31,  9.44s/it]
 58%|█████▊    | 22130/37963 [54:31:40<39:16:20,  8.93s/it]
                                                           
{'loss': '0.1365', 'grad_norm': '1.63', 'learning_rate': '7.818e-06', 'epoch': '0.5829'}
+
 58%|█████▊    | 22130/37963 [54:31:40<39:16:20,  8.93s/it]
 58%|█████▊    | 22131/37963 [54:31:48<38:04:36,  8.66s/it]
 58%|█████▊    | 22132/37963 [54:31:55<36:28:48,  8.30s/it]
 58%|█████▊    | 22133/37963 [54:32:03<35:26:22,  8.06s/it]
 58%|█████▊    | 22134/37963 [54:32:10<35:01:51,  7.97s/it]
 58%|█████▊    | 22135/37963 [54:32:18<34:34:12,  7.86s/it]
 58%|█████▊    | 22136/37963 [54:32:26<34:54:01,  7.94s/it]
 58%|█████▊    | 22137/37963 [54:32:34<34:46:19,  7.91s/it]
 58%|█████▊    | 22138/37963 [54:32:42<34:31:53,  7.86s/it]
 58%|█████▊    | 22139/37963 [54:32:56<42:59:35,  9.78s/it]
 58%|█████▊    | 22140/37963 [54:33:04<40:29:45,  9.21s/it]
                                                           
{'loss': '0.1432', 'grad_norm': '2.407', 'learning_rate': '7.81e-06', 'epoch': '0.5832'}
+
 58%|█████▊    | 22140/37963 [54:33:04<40:29:45,  9.21s/it]
 58%|█████▊    | 22141/37963 [54:33:11<38:33:15,  8.77s/it]
 58%|█████▊    | 22142/37963 [54:33:19<37:24:51,  8.51s/it]
 58%|█████��    | 22143/37963 [54:33:27<36:30:53,  8.31s/it]
 58%|█████▊    | 22144/37963 [54:33:35<36:05:46,  8.21s/it]
 58%|█████▊    | 22145/37963 [54:33:51<45:45:09, 10.41s/it]
 58%|█████▊    | 22146/37963 [54:33:59<42:22:59,  9.65s/it]
 58%|█████▊    | 22147/37963 [54:34:06<39:36:04,  9.01s/it]
 58%|█████▊    | 22148/37963 [54:34:14<37:48:13,  8.61s/it]
 58%|█████▊    | 22149/37963 [54:34:22<36:42:44,  8.36s/it]
 58%|█████▊    | 22150/37963 [54:34:29<36:05:53,  8.22s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '2.495', 'learning_rate': '7.802e-06', 'epoch': '0.5835'}
+
 58%|█████▊    | 22150/37963 [54:34:29<36:05:53,  8.22s/it]
 58%|█████▊    | 22151/37963 [54:34:37<35:22:34,  8.05s/it]
 58%|█████▊    | 22152/37963 [54:34:52<44:41:12, 10.17s/it]
 58%|█████▊    | 22153/37963 [54:35:00<41:50:10,  9.53s/it]
 58%|█████▊    | 22154/37963 [54:35:22<57:43:01, 13.14s/it]
 58%|█████▊    | 22155/37963 [54:35:30<50:39:30, 11.54s/it]
 58%|█████▊    | 22156/37963 [54:35:38<46:16:53, 10.54s/it]
 58%|█████▊    | 22157/37963 [54:35:46<42:56:33,  9.78s/it]
 58%|█████▊    | 22158/37963 [54:35:54<40:15:24,  9.17s/it]
 58%|█████▊    | 22159/37963 [54:36:01<38:26:05,  8.76s/it]
 58%|█████▊    | 22160/37963 [54:36:16<46:01:26, 10.48s/it]
                                                           
{'loss': '0.1331', 'grad_norm': '2.071', 'learning_rate': '7.793e-06', 'epoch': '0.5837'}
+
 58%|█████▊    | 22160/37963 [54:36:16<46:01:26, 10.48s/it]
 58%|█████▊    | 22161/37963 [54:36:24<42:56:39,  9.78s/it]
 58%|█████▊    | 22162/37963 [54:36:32<40:18:35,  9.18s/it]
 58%|█████▊    | 22163/37963 [54:36:40<38:33:13,  8.78s/it]
 58%|█████▊    | 22164/37963 [54:36:48<37:16:56,  8.50s/it]
 58%|█████▊    | 22165/37963 [54:36:55<36:14:58,  8.26s/it]
 58%|█████▊    | 22166/37963 [54:37:03<35:37:47,  8.12s/it]
 58%|█████▊    | 22167/37963 [54:37:11<35:03:10,  7.99s/it]
 58%|█████▊    | 22168/37963 [54:37:26<44:33:29, 10.16s/it]
 58%|█████▊    | 22169/37963 [54:37:34<41:29:15,  9.46s/it]
 58%|█████▊    | 22170/37963 [54:37:42<39:14:18,  8.94s/it]
                                                           
{'loss': '0.1416', 'grad_norm': '1.603', 'learning_rate': '7.785e-06', 'epoch': '0.584'}
+
 58%|█████▊    | 22170/37963 [54:37:42<39:14:18,  8.94s/it]
 58%|█████▊    | 22171/37963 [54:37:56<46:33:40, 10.61s/it]
 58%|█████▊    | 22172/37963 [54:38:04<43:13:28,  9.85s/it]
 58%|█████▊    | 22173/37963 [54:38:12<40:13:09,  9.17s/it]
 58%|█████▊    | 22174/37963 [54:38:19<38:10:17,  8.70s/it]
 58%|█████▊    | 22175/37963 [54:38:27<37:04:10,  8.45s/it]
 58%|█████▊    | 22176/37963 [54:38:35<36:13:30,  8.26s/it]
 58%|█████▊    | 22177/37963 [54:38:43<35:51:31,  8.18s/it]
 58%|█████▊    | 22178/37963 [54:38:51<35:16:06,  8.04s/it]
 58%|█████▊    | 22179/37963 [54:38:59<34:59:01,  7.98s/it]
 58%|█████▊    | 22180/37963 [54:39:06<34:43:49,  7.92s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '3.071', 'learning_rate': '7.777e-06', 'epoch': '0.5843'}
+
 58%|█████▊    | 22180/37963 [54:39:06<34:43:49,  7.92s/it]
 58%|█████▊    | 22181/37963 [54:39:14<34:44:49,  7.93s/it]
 58%|█████▊    | 22182/37963 [54:39:22<34:27:11,  7.86s/it]
 58%|█████▊    | 22183/37963 [54:39:30<34:18:12,  7.83s/it]
 58%|█████▊    | 22184/37963 [54:39:37<34:12:35,  7.81s/it]
 58%|█████▊    | 22185/37963 [54:39:45<34:15:07,  7.82s/it]
 58%|█████▊    | 22186/37963 [54:39:53<33:37:17,  7.67s/it]
 58%|█████▊    | 22187/37963 [54:40:00<33:47:33,  7.71s/it]
 58%|█████▊    | 22188/37963 [54:40:08<33:55:57,  7.74s/it]
 58%|█████▊    | 22189/37963 [54:40:16<34:04:48,  7.78s/it]
 58%|█████▊    | 22190/37963 [54:40:24<34:18:34,  7.83s/it]
                                                           
{'loss': '0.1437', 'grad_norm': '1.444', 'learning_rate': '7.768e-06', 'epoch': '0.5845'}
+
 58%|█████▊    | 22190/37963 [54:40:24<34:18:34,  7.83s/it]
 58%|█████▊    | 22191/37963 [54:40:32<33:56:35,  7.75s/it]
 58%|█████▊    | 22192/37963 [54:40:47<43:48:56, 10.00s/it]
 58%|█████▊    | 22193/37963 [54:40:55<40:53:44,  9.34s/it]
 58%|█████▊    | 22194/37963 [54:41:10<48:49:58, 11.15s/it]
 58%|█████▊    | 22195/37963 [54:41:18<44:32:01, 10.17s/it]
 58%|█████▊    | 22196/37963 [54:41:26<41:20:15,  9.44s/it]
 58%|█████▊    | 22197/37963 [54:41:48<58:13:32, 13.30s/it]
 58%|█████▊    | 22198/37963 [54:41:56<51:08:15, 11.68s/it]
 58%|█████▊    | 22199/37963 [54:42:03<45:37:08, 10.42s/it]
 58%|█████▊    | 22200/37963 [54:42:11<42:06:22,  9.62s/it]
                                                           
{'loss': '0.1284', 'grad_norm': '2.411', 'learning_rate': '7.76e-06', 'epoch': '0.5848'}
+
 58%|█████▊    | 22200/37963 [54:42:11<42:06:22,  9.62s/it]
 58%|█████▊    | 22201/37963 [54:42:19<39:41:22,  9.06s/it]
 58%|█████▊    | 22202/37963 [54:42:27<38:15:12,  8.74s/it]
 58%|█████▊    | 22203/37963 [54:42:35<37:02:51,  8.46s/it]
 58%|█████▊    | 22204/37963 [54:42:42<36:09:45,  8.26s/it]
 58%|█████▊    | 22205/37963 [54:42:50<35:03:56,  8.01s/it]
 58%|█████▊    | 22206/37963 [54:42:58<34:52:12,  7.97s/it]
 58%|█████▊    | 22207/37963 [54:43:06<34:37:34,  7.91s/it]
 58%|█████▊    | 22208/37963 [54:43:27<52:13:00, 11.93s/it]
 59%|█████▊    | 22209/37963 [54:43:35<46:59:12, 10.74s/it]
 59%|█████▊    | 22210/37963 [54:43:43<43:20:11,  9.90s/it]
                                                           
{'loss': '0.1411', 'grad_norm': '2.395', 'learning_rate': '7.752e-06', 'epoch': '0.585'}
+
 59%|█████▊    | 22210/37963 [54:43:43<43:20:11,  9.90s/it]
 59%|█████▊    | 22211/37963 [54:43:50<40:21:46,  9.22s/it]
 59%|█████▊    | 22212/37963 [54:43:58<38:27:34,  8.79s/it]
 59%|█████▊    | 22213/37963 [54:44:06<37:12:39,  8.51s/it]
 59%|█████▊    | 22214/37963 [54:44:13<35:43:06,  8.16s/it]
 59%|█████▊    | 22215/37963 [54:44:21<35:23:48,  8.09s/it]
 59%|█████▊    | 22216/37963 [54:44:37<44:49:42, 10.25s/it]
 59%|█████▊    | 22217/37963 [54:44:45<41:50:09,  9.56s/it]
 59%|█████▊    | 22218/37963 [54:44:52<39:28:13,  9.02s/it]
 59%|█████▊    | 22219/37963 [54:45:07<46:49:40, 10.71s/it]
 59%|█████▊    | 22220/37963 [54:45:15<43:20:50,  9.91s/it]
                                                           
{'loss': '0.1362', 'grad_norm': '1.376', 'learning_rate': '7.743e-06', 'epoch': '0.5853'}
+
 59%|█████▊    | 22220/37963 [54:45:15<43:20:50,  9.91s/it]
 59%|█████▊    | 22221/37963 [54:45:23<40:30:51,  9.27s/it]
 59%|█████▊    | 22222/37963 [54:45:31<38:33:34,  8.82s/it]
 59%|█████▊    | 22223/37963 [54:45:38<37:00:28,  8.46s/it]
 59%|█████▊    | 22224/37963 [54:45:46<36:06:27,  8.26s/it]
 59%|█████▊    | 22225/37963 [54:45:54<35:34:01,  8.14s/it]
 59%|█████▊    | 22226/37963 [54:46:02<35:08:45,  8.04s/it]
 59%|█████▊    | 22227/37963 [54:46:09<34:44:59,  7.95s/it]
 59%|█████▊    | 22228/37963 [54:46:17<34:29:08,  7.89s/it]
 59%|█████▊    | 22229/37963 [54:46:25<34:07:22,  7.81s/it]
 59%|█████▊    | 22230/37963 [54:46:32<34:06:16,  7.80s/it]
                                                           
{'loss': '0.1375', 'grad_norm': '3.479', 'learning_rate': '7.735e-06', 'epoch': '0.5856'}
+
 59%|█████▊    | 22230/37963 [54:46:32<34:06:16,  7.80s/it]
 59%|█████▊    | 22231/37963 [54:46:40<34:14:47,  7.84s/it]
 59%|█████▊    | 22232/37963 [54:46:48<34:19:16,  7.85s/it]
 59%|█████▊    | 22233/37963 [54:46:56<34:04:57,  7.80s/it]
 59%|█████▊    | 22234/37963 [54:47:04<34:08:45,  7.82s/it]
 59%|█████▊    | 22235/37963 [54:47:12<34:07:30,  7.81s/it]
 59%|█████▊    | 22236/37963 [54:47:19<33:49:21,  7.74s/it]
 59%|█████▊    | 22237/37963 [54:47:27<33:55:40,  7.77s/it]
 59%|█████▊    | 22238/37963 [54:47:35<34:03:12,  7.80s/it]
 59%|█████▊    | 22239/37963 [54:47:43<34:00:15,  7.79s/it]
 59%|█████▊    | 22240/37963 [54:47:58<43:32:32,  9.97s/it]
                                                           
{'loss': '0.1318', 'grad_norm': '1.256', 'learning_rate': '7.727e-06', 'epoch': '0.5858'}
+
 59%|█████▊    | 22240/37963 [54:47:58<43:32:32,  9.97s/it]
 59%|█████▊    | 22241/37963 [54:48:05<40:35:57,  9.30s/it]
 59%|█████▊    | 22242/37963 [54:48:21<48:11:57, 11.04s/it]
 59%|█████▊    | 22243/37963 [54:48:28<43:56:23, 10.06s/it]
 59%|█████▊    | 22244/37963 [54:48:36<41:00:08,  9.39s/it]
 59%|█████▊    | 22245/37963 [54:48:44<39:01:25,  8.94s/it]
 59%|█████▊    | 22246/37963 [54:48:59<47:21:56, 10.85s/it]
 59%|█████▊    | 22247/37963 [54:49:14<52:31:38, 12.03s/it]
 59%|█████▊    | 22248/37963 [54:49:22<47:12:13, 10.81s/it]
 59%|█████▊    | 22249/37963 [54:49:30<43:19:25,  9.93s/it]
 59%|█████▊    | 22250/37963 [54:49:38<40:35:29,  9.30s/it]
                                                           
{'loss': '0.135', 'grad_norm': '3.892', 'learning_rate': '7.719e-06', 'epoch': '0.5861'}
+
 59%|█████▊    | 22250/37963 [54:49:38<40:35:29,  9.30s/it]
 59%|█████▊    | 22251/37963 [54:49:46<38:32:24,  8.83s/it]
 59%|█████▊    | 22252/37963 [54:49:53<37:07:20,  8.51s/it]
 59%|█████▊    | 22253/37963 [54:50:01<36:23:21,  8.34s/it]
 59%|█████▊    | 22254/37963 [54:50:09<35:35:53,  8.16s/it]
 59%|█████▊    | 22255/37963 [54:50:24<44:09:52, 10.12s/it]
 59%|█████▊    | 22256/37963 [54:50:31<40:48:55,  9.35s/it]
 59%|█████▊    | 22257/37963 [54:50:39<38:32:47,  8.84s/it]
 59%|█████▊    | 22258/37963 [54:50:46<36:46:46,  8.43s/it]
 59%|█████▊    | 22259/37963 [54:50:54<35:43:33,  8.19s/it]
 59%|█████▊    | 22260/37963 [54:51:02<35:08:46,  8.06s/it]
                                                           
{'loss': '0.1302', 'grad_norm': '1.961', 'learning_rate': '7.71e-06', 'epoch': '0.5864'}
+
 59%|█████▊    | 22260/37963 [54:51:02<35:08:46,  8.06s/it]
 59%|█████▊    | 22261/37963 [54:51:16<43:45:47, 10.03s/it]
 59%|█████▊    | 22262/37963 [54:51:24<41:14:43,  9.46s/it]
 59%|█████▊    | 22263/37963 [54:51:32<38:57:56,  8.93s/it]
 59%|█████▊    | 22264/37963 [54:51:47<46:29:10, 10.66s/it]
 59%|█████▊    | 22265/37963 [54:51:55<42:40:00,  9.78s/it]
 59%|█████▊    | 22266/37963 [54:52:02<39:38:00,  9.09s/it]
 59%|█████▊    | 22267/37963 [54:52:10<37:56:47,  8.70s/it]
 59%|█████▊    | 22268/37963 [54:52:17<36:22:48,  8.34s/it]
 59%|█████▊    | 22269/37963 [54:52:25<35:08:51,  8.06s/it]
 59%|█████▊    | 22270/37963 [54:52:33<34:47:40,  7.98s/it]
                                                           
{'loss': '0.134', 'grad_norm': '1.587', 'learning_rate': '7.702e-06', 'epoch': '0.5866'}
+
 59%|█████▊    | 22270/37963 [54:52:33<34:47:40,  7.98s/it]
 59%|█████▊    | 22271/37963 [54:52:40<34:37:27,  7.94s/it]
 59%|█████▊    | 22272/37963 [54:52:48<34:21:15,  7.88s/it]
 59%|█████▊    | 22273/37963 [54:53:03<42:50:42,  9.83s/it]
 59%|█████▊    | 22274/37963 [54:53:10<40:11:00,  9.22s/it]
 59%|█████▊    | 22275/37963 [54:53:18<38:22:54,  8.81s/it]
 59%|█████▊    | 22276/37963 [54:53:26<36:52:39,  8.46s/it]
 59%|█████▊    | 22277/37963 [54:53:34<36:07:00,  8.29s/it]
 59%|█████▊    | 22278/37963 [54:53:41<35:23:05,  8.12s/it]
 59%|█████▊    | 22279/37963 [54:53:49<34:42:56,  7.97s/it]
 59%|█████▊    | 22280/37963 [54:53:57<34:31:18,  7.92s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '1.822', 'learning_rate': '7.694e-06', 'epoch': '0.5869'}
+
 59%|█████▊    | 22280/37963 [54:53:57<34:31:18,  7.92s/it]
 59%|█████▊    | 22281/37963 [54:54:05<34:13:17,  7.86s/it]
 59%|█████▊    | 22282/37963 [54:54:13<34:16:25,  7.87s/it]
 59%|█████▊    | 22283/37963 [54:54:20<34:09:25,  7.84s/it]
 59%|█████▊    | 22284/37963 [54:54:35<43:24:56,  9.97s/it]
 59%|█████▊    | 22285/37963 [54:54:43<41:11:00,  9.46s/it]
 59%|█████▊    | 22286/37963 [54:54:51<38:54:34,  8.94s/it]
 59%|█████▊    | 22287/37963 [54:54:59<37:13:31,  8.55s/it]
 59%|█████▊    | 22288/37963 [54:55:07<36:19:04,  8.34s/it]
 59%|█████▊    | 22289/37963 [54:55:14<35:21:59,  8.12s/it]
 59%|█████▊    | 22290/37963 [54:55:22<35:02:26,  8.05s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '1.09', 'learning_rate': '7.685e-06', 'epoch': '0.5872'}
+
 59%|█████▊    | 22290/37963 [54:55:22<35:02:26,  8.05s/it]
 59%|█████▊    | 22291/37963 [54:55:30<34:27:17,  7.91s/it]
 59%|█████▊    | 22292/37963 [54:55:52<53:20:15, 12.25s/it]
 59%|█████▊    | 22293/37963 [54:56:00<47:56:23, 11.01s/it]
 59%|█████▊    | 22294/37963 [54:56:08<43:43:20, 10.05s/it]
 59%|█████▊    | 22295/37963 [54:56:16<40:28:52,  9.30s/it]
 59%|█████▊    | 22296/37963 [54:56:31<47:50:40, 10.99s/it]
 59%|█████▊    | 22297/37963 [54:56:39<44:16:01, 10.17s/it]
 59%|█████▊    | 22298/37963 [54:56:46<40:53:18,  9.40s/it]
 59%|█████▊    | 22299/37963 [54:56:54<38:43:34,  8.90s/it]
 59%|█████▊    | 22300/37963 [54:57:02<37:00:43,  8.51s/it]
                                                           
{'loss': '0.1356', 'grad_norm': '2.453', 'learning_rate': '7.677e-06', 'epoch': '0.5874'}
+
 59%|█████▊    | 22300/37963 [54:57:02<37:00:43,  8.51s/it]
 59%|█████▊    | 22301/37963 [54:57:10<36:00:17,  8.28s/it]
 59%|█████▊    | 22302/37963 [54:57:17<35:21:56,  8.13s/it]
 59%|█████▊    | 22303/37963 [54:57:25<34:48:07,  8.00s/it]
 59%|█████▉    | 22304/37963 [54:57:39<43:04:30,  9.90s/it]
 59%|█████▉    | 22305/37963 [54:57:47<40:34:32,  9.33s/it]
 59%|█████▉    | 22306/37963 [54:57:55<38:38:25,  8.88s/it]
 59%|█████▉    | 22307/37963 [54:58:03<37:17:46,  8.58s/it]
 59%|█████▉    | 22308/37963 [54:58:17<44:48:43, 10.30s/it]
 59%|█████▉    | 22309/37963 [54:58:32<51:01:43, 11.74s/it]
 59%|█████▉    | 22310/37963 [54:58:40<45:40:52, 10.51s/it]
                                                           
{'loss': '0.1227', 'grad_norm': '1.937', 'learning_rate': '7.669e-06', 'epoch': '0.5877'}
+
 59%|█████▉    | 22310/37963 [54:58:40<45:40:52, 10.51s/it]
 59%|█████▉    | 22311/37963 [54:58:48<42:03:17,  9.67s/it]
 59%|█████▉    | 22312/37963 [54:58:56<39:31:55,  9.09s/it]
 59%|█████▉    | 22313/37963 [54:59:03<37:52:30,  8.71s/it]
 59%|█████▉    | 22314/37963 [54:59:11<36:34:08,  8.41s/it]
 59%|█████▉    | 22315/37963 [54:59:19<35:56:22,  8.27s/it]
 59%|█████▉    | 22316/37963 [54:59:27<35:20:26,  8.13s/it]
 59%|█████▉    | 22317/37963 [54:59:34<34:44:19,  7.99s/it]
 59%|█████▉    | 22318/37963 [54:59:42<34:19:20,  7.90s/it]
 59%|█████▉    | 22319/37963 [54:59:50<33:51:19,  7.79s/it]
 59%|█████▉    | 22320/37963 [54:59:57<33:50:05,  7.79s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '0.987', 'learning_rate': '7.66e-06', 'epoch': '0.5879'}
+
 59%|█████▉    | 22320/37963 [54:59:57<33:50:05,  7.79s/it]
 59%|█████▉    | 22321/37963 [55:00:05<33:56:35,  7.81s/it]
 59%|█████▉    | 22322/37963 [55:00:13<33:58:13,  7.82s/it]
 59%|█████▉    | 22323/37963 [55:00:21<33:38:40,  7.74s/it]
 59%|█████▉    | 22324/37963 [55:00:29<33:43:15,  7.76s/it]
 59%|█████▉    | 22325/37963 [55:00:43<42:42:01,  9.83s/it]
 59%|█████▉    | 22326/37963 [55:00:51<40:14:24,  9.26s/it]
 59%|█████▉    | 22327/37963 [55:00:59<38:14:37,  8.81s/it]
 59%|█████▉    | 22328/37963 [55:01:07<36:54:03,  8.50s/it]
 59%|█████▉    | 22329/37963 [55:01:15<36:17:23,  8.36s/it]
 59%|█████▉    | 22330/37963 [55:01:23<35:42:11,  8.22s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '0.9717', 'learning_rate': '7.652e-06', 'epoch': '0.5882'}
+
 59%|█████▉    | 22330/37963 [55:01:23<35:42:11,  8.22s/it]
 59%|█████▉    | 22331/37963 [55:01:30<35:01:33,  8.07s/it]
 59%|█████▉    | 22332/37963 [55:01:38<34:38:58,  7.98s/it]
 59%|█████▉    | 22333/37963 [55:01:53<43:44:33, 10.08s/it]
 59%|█████▉    | 22334/37963 [55:02:01<41:00:33,  9.45s/it]
 59%|█████▉    | 22335/37963 [55:02:09<38:50:31,  8.95s/it]
 59%|█████▉    | 22336/37963 [55:02:31<56:13:14, 12.95s/it]
 59%|█████▉    | 22337/37963 [55:02:39<49:37:57, 11.43s/it]
 59%|█████▉    | 22338/37963 [55:02:47<44:37:42, 10.28s/it]
 59%|█████▉    | 22339/37963 [55:02:54<41:25:23,  9.54s/it]
 59%|█████▉    | 22340/37963 [55:03:02<38:49:26,  8.95s/it]
                                                           
{'loss': '0.1252', 'grad_norm': '1.006', 'learning_rate': '7.644e-06', 'epoch': '0.5885'}
+
 59%|█████▉    | 22340/37963 [55:03:02<38:49:26,  8.95s/it]
 59%|█████▉    | 22341/37963 [55:03:10<37:08:09,  8.56s/it]
 59%|█████▉    | 22342/37963 [55:03:25<45:35:13, 10.51s/it]
 59%|█████▉    | 22343/37963 [55:03:33<42:25:43,  9.78s/it]
 59%|█████▉    | 22344/37963 [55:03:41<40:00:52,  9.22s/it]
 59%|█████▉    | 22345/37963 [55:03:49<38:27:03,  8.86s/it]
 59%|█████▉    | 22346/37963 [55:03:57<37:22:09,  8.61s/it]
 59%|█████▉    | 22347/37963 [55:04:05<36:21:35,  8.38s/it]
 59%|█████▉    | 22348/37963 [55:04:12<35:38:04,  8.22s/it]
 59%|█████▉    | 22349/37963 [55:04:20<34:55:42,  8.05s/it]
 59%|█████▉    | 22350/37963 [55:04:28<34:35:26,  7.98s/it]
                                                           
{'loss': '0.1309', 'grad_norm': '1.699', 'learning_rate': '7.636e-06', 'epoch': '0.5887'}
+
 59%|█████▉    | 22350/37963 [55:04:28<34:35:26,  7.98s/it]
 59%|█████▉    | 22351/37963 [55:04:36<34:30:49,  7.96s/it]
 59%|█████▉    | 22352/37963 [55:04:44<34:18:08,  7.91s/it]
 59%|█████▉    | 22353/37963 [55:04:59<43:45:08, 10.09s/it]
 59%|█████▉    | 22354/37963 [55:05:07<40:51:18,  9.42s/it]
 59%|█████▉    | 22355/37963 [55:05:14<38:24:07,  8.86s/it]
 59%|█████▉    | 22356/37963 [55:05:28<45:21:59, 10.46s/it]
 59%|█████▉    | 22357/37963 [55:05:36<42:02:15,  9.70s/it]
 59%|█████▉    | 22358/37963 [55:05:44<39:44:35,  9.17s/it]
 59%|█████▉    | 22359/37963 [55:05:52<37:59:25,  8.76s/it]
 59%|█████▉    | 22360/37963 [55:06:00<36:40:08,  8.46s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '1.931', 'learning_rate': '7.627e-06', 'epoch': '0.589'}
+
 59%|█████▉    | 22360/37963 [55:06:00<36:40:08,  8.46s/it]
 59%|█████▉    | 22361/37963 [55:06:08<36:00:09,  8.31s/it]
 59%|█████▉    | 22362/37963 [55:06:16<35:32:15,  8.20s/it]
 59%|█████▉    | 22363/37963 [55:06:24<35:08:17,  8.11s/it]
 59%|█████▉    | 22364/37963 [55:06:32<34:51:25,  8.04s/it]
 59%|█████▉    | 22365/37963 [55:06:39<34:31:26,  7.97s/it]
 59%|█████▉    | 22366/37963 [55:06:47<34:23:35,  7.94s/it]
 59%|█████▉    | 22367/37963 [55:06:55<34:14:50,  7.91s/it]
 59%|█████▉    | 22368/37963 [55:07:03<34:07:13,  7.88s/it]
 59%|█████▉    | 22369/37963 [55:07:11<33:54:29,  7.83s/it]
 59%|█████▉    | 22370/37963 [55:07:18<33:55:00,  7.83s/it]
                                                           
{'loss': '0.1312', 'grad_norm': '1.281', 'learning_rate': '7.619e-06', 'epoch': '0.5893'}
+
 59%|█████▉    | 22370/37963 [55:07:18<33:55:00,  7.83s/it]
 59%|█████▉    | 22371/37963 [55:07:26<33:50:11,  7.81s/it]
 59%|█████▉    | 22372/37963 [55:07:34<33:36:31,  7.76s/it]
 59%|█████▉    | 22373/37963 [55:07:41<33:18:52,  7.69s/it]
 59%|█████▉    | 22374/37963 [55:07:49<33:40:15,  7.78s/it]
 59%|█████▉    | 22375/37963 [55:07:57<33:35:08,  7.76s/it]
 59%|█████▉    | 22376/37963 [55:08:12<42:47:55,  9.88s/it]
 59%|█████▉    | 22377/37963 [55:08:20<40:08:17,  9.27s/it]
 59%|█████▉    | 22378/37963 [55:08:27<38:08:30,  8.81s/it]
 59%|█████▉    | 22379/37963 [55:08:35<36:47:56,  8.50s/it]
 59%|█████▉    | 22380/37963 [55:08:43<36:04:56,  8.34s/it]
                                                           
{'loss': '0.1181', 'grad_norm': '1.368', 'learning_rate': '7.611e-06', 'epoch': '0.5895'}
+
 59%|█████▉    | 22380/37963 [55:08:43<36:04:56,  8.34s/it]
 59%|█████▉    | 22381/37963 [55:08:51<35:28:55,  8.20s/it]
 59%|█████▉    | 22382/37963 [55:09:06<44:00:12, 10.17s/it]
 59%|█████▉    | 22383/37963 [55:09:14<41:00:48,  9.48s/it]
 59%|█████▉    | 22384/37963 [55:09:21<38:50:02,  8.97s/it]
 59%|█████▉    | 22385/37963 [55:09:29<37:10:31,  8.59s/it]
 59%|█████▉    | 22386/37963 [55:09:37<36:16:51,  8.38s/it]
 59%|█████▉    | 22387/37963 [55:09:44<35:01:35,  8.10s/it]
 59%|█████▉    | 22388/37963 [55:09:52<34:34:56,  7.99s/it]
 59%|█████▉    | 22389/37963 [55:10:07<42:48:14,  9.89s/it]
 59%|█████▉    | 22390/37963 [55:10:22<50:23:56, 11.65s/it]
                                                           
{'loss': '0.1315', 'grad_norm': '1.484', 'learning_rate': '7.602e-06', 'epoch': '0.5898'}
+
 59%|█████▉    | 22390/37963 [55:10:22<50:23:56, 11.65s/it]
 59%|█████▉    | 22391/37963 [55:10:30<45:32:46, 10.53s/it]
 59%|█████▉    | 22392/37963 [55:10:38<41:59:21,  9.71s/it]
 59%|█████▉    | 22393/37963 [55:10:46<39:28:11,  9.13s/it]
 59%|█████▉    | 22394/37963 [55:10:54<37:41:17,  8.71s/it]
 59%|█████▉    | 22395/37963 [55:11:02<36:45:22,  8.50s/it]
 59%|█████▉    | 22396/37963 [55:11:09<35:50:43,  8.29s/it]
 59%|█████▉    | 22397/37963 [55:11:17<34:54:33,  8.07s/it]
 59%|█████▉    | 22398/37963 [55:11:24<34:05:26,  7.88s/it]
 59%|█████▉    | 22399/37963 [55:11:32<33:56:33,  7.85s/it]
 59%|█████▉    | 22400/37963 [55:11:47<42:55:42,  9.93s/it]
                                                           
{'loss': '0.1333', 'grad_norm': '4.475', 'learning_rate': '7.594e-06', 'epoch': '0.5901'}
+
 59%|█████▉    | 22400/37963 [55:11:47<42:55:42,  9.93s/it]
 59%|█████▉    | 22401/37963 [55:11:55<40:30:35,  9.37s/it]
 59%|█████▉    | 22402/37963 [55:12:03<38:29:18,  8.90s/it]
 59%|█████▉    | 22403/37963 [55:12:11<37:03:41,  8.57s/it]
 59%|█████▉    | 22404/37963 [55:12:25<45:03:49, 10.43s/it]
 59%|█████▉    | 22405/37963 [55:12:33<41:31:32,  9.61s/it]
 59%|█████▉    | 22406/37963 [55:12:47<47:24:20, 10.97s/it]
 59%|█████▉    | 22407/37963 [55:12:55<43:13:05, 10.00s/it]
 59%|█████▉    | 22408/37963 [55:13:03<40:23:19,  9.35s/it]
 59%|█████▉    | 22409/37963 [55:13:11<38:26:31,  8.90s/it]
 59%|█████▉    | 22410/37963 [55:13:18<37:02:17,  8.57s/it]
                                                           
{'loss': '0.1379', 'grad_norm': '3.583', 'learning_rate': '7.586e-06', 'epoch': '0.5903'}
+
 59%|█████▉    | 22410/37963 [55:13:18<37:02:17,  8.57s/it]
 59%|█████▉    | 22411/37963 [55:13:26<35:54:14,  8.31s/it]
 59%|█████▉    | 22412/37963 [55:13:34<35:07:56,  8.13s/it]
 59%|█████▉    | 22413/37963 [55:13:42<34:44:56,  8.04s/it]
 59%|█████▉    | 22414/37963 [55:13:49<34:12:12,  7.92s/it]
 59%|█████▉    | 22415/37963 [55:13:57<34:01:32,  7.88s/it]
 59%|█████▉    | 22416/37963 [55:14:04<33:21:41,  7.73s/it]
 59%|█████▉    | 22417/37963 [55:14:12<33:22:37,  7.73s/it]
 59%|█████▉    | 22418/37963 [55:14:20<33:30:24,  7.76s/it]
 59%|█████▉    | 22419/37963 [55:14:28<33:28:01,  7.75s/it]
 59%|█████▉    | 22420/37963 [55:14:35<33:06:59,  7.67s/it]
                                                           
{'loss': '0.1332', 'grad_norm': '2.565', 'learning_rate': '7.578e-06', 'epoch': '0.5906'}
+
 59%|█████▉    | 22420/37963 [55:14:35<33:06:59,  7.67s/it]
 59%|█████▉    | 22421/37963 [55:14:43<33:25:05,  7.74s/it]
 59%|█████▉    | 22422/37963 [55:14:51<33:36:41,  7.79s/it]
 59%|█████▉    | 22423/37963 [55:14:59<33:46:28,  7.82s/it]
 59%|█████▉    | 22424/37963 [55:15:13<42:10:03,  9.77s/it]
 59%|█████▉    | 22425/37963 [55:15:28<48:37:40, 11.27s/it]
 59%|█████▉    | 22426/37963 [55:15:36<44:37:34, 10.34s/it]
 59%|█████▉    | 22427/37963 [55:15:44<41:17:20,  9.57s/it]
 59%|█████▉    | 22428/37963 [55:15:52<38:54:54,  9.02s/it]
 59%|█████▉    | 22429/37963 [55:15:59<37:16:32,  8.64s/it]
 59%|█████▉    | 22430/37963 [55:16:07<36:17:50,  8.41s/it]
                                                           
{'loss': '0.1289', 'grad_norm': '4.604', 'learning_rate': '7.569e-06', 'epoch': '0.5908'}
+
 59%|█████▉    | 22430/37963 [55:16:07<36:17:50,  8.41s/it]
 59%|█████▉    | 22431/37963 [55:16:15<35:30:56,  8.23s/it]
 59%|█████▉    | 22432/37963 [55:16:23<35:14:34,  8.17s/it]
 59%|█████▉    | 22433/37963 [55:16:31<35:01:02,  8.12s/it]
 59%|█████▉    | 22434/37963 [55:16:39<34:42:57,  8.05s/it]
 59%|█████▉    | 22435/37963 [55:17:01<52:46:35, 12.24s/it]
 59%|█████▉    | 22436/37963 [55:17:09<47:18:19, 10.97s/it]
 59%|█████▉    | 22437/37963 [55:17:17<43:16:07, 10.03s/it]
 59%|█████▉    | 22438/37963 [55:17:25<40:19:31,  9.35s/it]
 59%|█████▉    | 22439/37963 [55:17:32<38:22:34,  8.90s/it]
 59%|█████▉    | 22440/37963 [55:17:40<36:52:08,  8.55s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '1.417', 'learning_rate': '7.561e-06', 'epoch': '0.5911'}
+
 59%|█████▉    | 22440/37963 [55:17:40<36:52:08,  8.55s/it]
 59%|█████▉    | 22441/37963 [55:17:48<35:56:26,  8.34s/it]
 59%|█████▉    | 22442/37963 [55:17:56<35:25:57,  8.22s/it]
 59%|█████▉    | 22443/37963 [55:18:04<34:49:11,  8.08s/it]
 59%|█████▉    | 22444/37963 [55:18:19<43:45:18, 10.15s/it]
 59%|█████▉    | 22445/37963 [55:18:26<40:17:25,  9.35s/it]
 59%|█████▉    | 22446/37963 [55:18:34<38:16:26,  8.88s/it]
 59%|█████▉    | 22447/37963 [55:18:42<36:52:52,  8.56s/it]
 59%|█████▉    | 22448/37963 [55:18:57<45:05:16, 10.46s/it]
 59%|█████▉    | 22449/37963 [55:19:05<41:40:54,  9.67s/it]
 59%|█████▉    | 22450/37963 [55:19:12<39:12:45,  9.10s/it]
                                                           
{'loss': '0.1416', 'grad_norm': '0.8075', 'learning_rate': '7.553e-06', 'epoch': '0.5914'}
+
 59%|█████▉    | 22450/37963 [55:19:12<39:12:45,  9.10s/it]
 59%|█████▉    | 22451/37963 [55:19:20<37:39:34,  8.74s/it]
 59%|█████▉    | 22452/37963 [55:19:28<36:25:17,  8.45s/it]
 59%|█████▉    | 22453/37963 [55:19:36<35:58:08,  8.35s/it]
 59%|█████▉    | 22454/37963 [55:19:50<43:40:17, 10.14s/it]
 59%|█████▉    | 22455/37963 [55:20:05<49:50:28, 11.57s/it]
 59%|█████▉    | 22456/37963 [55:20:13<44:52:31, 10.42s/it]
 59%|█████▉    | 22457/37963 [55:20:21<41:44:47,  9.69s/it]
 59%|█████▉    | 22458/37963 [55:20:29<39:09:26,  9.09s/it]
 59%|█████▉    | 22459/37963 [55:20:36<37:03:07,  8.60s/it]
 59%|█████▉    | 22460/37963 [55:20:44<36:04:20,  8.38s/it]
                                                           
{'loss': '0.141', 'grad_norm': '1.396', 'learning_rate': '7.544e-06', 'epoch': '0.5916'}
+
 59%|█████▉    | 22460/37963 [55:20:44<36:04:20,  8.38s/it]
 59%|█████▉    | 22461/37963 [55:20:52<35:19:12,  8.20s/it]
 59%|█████▉    | 22462/37963 [55:21:00<34:57:38,  8.12s/it]
 59%|█████▉    | 22463/37963 [55:21:08<34:29:55,  8.01s/it]
 59%|█████▉    | 22464/37963 [55:21:15<34:14:40,  7.95s/it]
 59%|█████▉    | 22465/37963 [55:21:23<33:59:49,  7.90s/it]
 59%|█████▉    | 22466/37963 [55:21:31<33:55:52,  7.88s/it]
 59%|█████▉    | 22467/37963 [55:21:38<33:25:30,  7.77s/it]
 59%|█████▉    | 22468/37963 [55:21:46<33:39:38,  7.82s/it]
 59%|█████▉    | 22469/37963 [55:21:54<33:15:56,  7.73s/it]
 59%|█████▉    | 22470/37963 [55:22:02<33:34:34,  7.80s/it]
                                                           
{'loss': '0.1423', 'grad_norm': '0.9322', 'learning_rate': '7.536e-06', 'epoch': '0.5919'}
+
 59%|█████▉    | 22470/37963 [55:22:02<33:34:34,  7.80s/it]
 59%|█████▉    | 22471/37963 [55:22:10<34:04:45,  7.92s/it]
 59%|█████▉    | 22472/37963 [55:22:18<33:58:25,  7.90s/it]
 59%|█████▉    | 22473/37963 [55:22:25<33:29:47,  7.78s/it]
 59%|█████▉    | 22474/37963 [55:22:33<33:26:47,  7.77s/it]
 59%|█████▉    | 22475/37963 [55:22:41<33:35:05,  7.81s/it]
 59%|█████▉    | 22476/37963 [55:22:49<33:34:08,  7.80s/it]
 59%|█████▉    | 22477/37963 [55:22:57<33:25:52,  7.77s/it]
 59%|█████▉    | 22478/37963 [55:23:11<42:12:13,  9.81s/it]
 59%|█████▉    | 22479/37963 [55:23:26<49:08:39, 11.43s/it]
 59%|█████▉    | 22480/37963 [55:23:43<56:32:05, 13.15s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '2.333', 'learning_rate': '7.528e-06', 'epoch': '0.5922'}
+
 59%|█████▉    | 22480/37963 [55:23:44<56:32:05, 13.15s/it]
 59%|█████▉    | 22481/37963 [55:23:52<50:03:54, 11.64s/it]
 59%|█████▉    | 22482/37963 [55:23:59<44:57:01, 10.45s/it]
 59%|█████▉    | 22483/37963 [55:24:07<41:27:09,  9.64s/it]
 59%|█████▉    | 22484/37963 [55:24:15<38:42:03,  9.00s/it]
 59%|█████▉    | 22485/37963 [55:24:22<36:51:32,  8.57s/it]
 59%|█████▉    | 22486/37963 [55:24:30<35:58:04,  8.37s/it]
 59%|█████▉    | 22487/37963 [55:24:45<44:19:37, 10.31s/it]
 59%|█████▉    | 22488/37963 [55:25:00<50:42:51, 11.80s/it]
 59%|█████▉    | 22489/37963 [55:25:08<45:47:41, 10.65s/it]
 59%|█████▉    | 22490/37963 [55:25:16<42:00:03,  9.77s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '2.519', 'learning_rate': '7.52e-06', 'epoch': '0.5924'}
+
 59%|█████▉    | 22490/37963 [55:25:16<42:00:03,  9.77s/it]
 59%|█████▉    | 22491/37963 [55:25:24<39:31:51,  9.20s/it]
 59%|█████▉    | 22492/37963 [55:25:31<37:41:51,  8.77s/it]
 59%|█████▉    | 22493/37963 [55:25:39<36:26:47,  8.48s/it]
 59%|█████▉    | 22494/37963 [55:25:47<35:36:00,  8.28s/it]
 59%|█████▉    | 22495/37963 [55:25:55<34:57:48,  8.14s/it]
 59%|█████▉    | 22496/37963 [55:26:03<34:29:29,  8.03s/it]
 59%|█████▉    | 22497/37963 [55:26:10<34:08:10,  7.95s/it]
 59%|█████▉    | 22498/37963 [55:26:18<34:01:38,  7.92s/it]
 59%|█████▉    | 22499/37963 [55:26:26<33:49:48,  7.88s/it]
 59%|█████▉    | 22500/37963 [55:26:41<42:55:41,  9.99s/it]
                                                           
{'loss': '0.1331', 'grad_norm': '1.079', 'learning_rate': '7.511e-06', 'epoch': '0.5927'}
+
 59%|█████▉    | 22500/37963 [55:26:41<42:55:41,  9.99s/it]
 59%|█████▉    | 22501/37963 [55:26:49<40:32:18,  9.44s/it]
 59%|█████▉    | 22502/37963 [55:27:10<55:40:53, 12.97s/it]
 59%|█████▉    | 22503/37963 [55:27:19<49:31:58, 11.53s/it]
 59%|█████▉    | 22504/37963 [55:27:26<44:44:42, 10.42s/it]
 59%|█████▉    | 22505/37963 [55:27:34<41:23:22,  9.64s/it]
 59%|█████▉    | 22506/37963 [55:27:42<38:55:47,  9.07s/it]
 59%|█████▉    | 22507/37963 [55:27:50<37:23:44,  8.71s/it]
 59%|█████▉    | 22508/37963 [55:27:57<36:05:28,  8.41s/it]
 59%|█████▉    | 22509/37963 [55:28:05<35:22:23,  8.24s/it]
 59%|█████▉    | 22510/37963 [55:28:13<34:45:41,  8.10s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '1.923', 'learning_rate': '7.503e-06', 'epoch': '0.5929'}
+
 59%|█████▉    | 22510/37963 [55:28:13<34:45:41,  8.10s/it]
 59%|█████▉    | 22511/37963 [55:28:21<34:24:29,  8.02s/it]
 59%|█████▉    | 22512/37963 [55:28:28<33:50:54,  7.89s/it]
 59%|█████▉    | 22513/37963 [55:28:36<33:26:33,  7.79s/it]
 59%|█████▉    | 22514/37963 [55:28:44<33:31:09,  7.81s/it]
 59%|█████▉    | 22515/37963 [55:28:51<33:10:58,  7.73s/it]
 59%|█████▉    | 22516/37963 [55:28:59<33:25:49,  7.79s/it]
 59%|█████▉    | 22517/37963 [55:29:07<33:20:15,  7.77s/it]
 59%|█████▉    | 22518/37963 [55:29:15<33:16:53,  7.76s/it]
 59%|█████▉    | 22519/37963 [55:29:22<33:05:19,  7.71s/it]
 59%|█████▉    | 22520/37963 [55:29:30<33:10:40,  7.73s/it]
                                                           
{'loss': '0.1367', 'grad_norm': '1.41', 'learning_rate': '7.495e-06', 'epoch': '0.5932'}
+
 59%|█████▉    | 22520/37963 [55:29:30<33:10:40,  7.73s/it]
 59%|█████▉    | 22521/37963 [55:29:38<33:18:59,  7.77s/it]
 59%|█████▉    | 22522/37963 [55:29:46<33:12:48,  7.74s/it]
 59%|█████▉    | 22523/37963 [55:30:08<51:45:57, 12.07s/it]
 59%|█████▉    | 22524/37963 [55:30:16<46:25:14, 10.82s/it]
 59%|█████▉    | 22525/37963 [55:30:24<42:26:37,  9.90s/it]
 59%|█████▉    | 22526/37963 [55:30:31<39:37:08,  9.24s/it]
 59%|█████▉    | 22527/37963 [55:30:39<37:47:52,  8.82s/it]
 59%|█████▉    | 22528/37963 [55:30:56<48:05:45, 11.22s/it]
 59%|█████▉    | 22529/37963 [55:31:04<43:49:10, 10.22s/it]
 59%|█████▉    | 22530/37963 [55:31:12<40:42:54,  9.50s/it]
                                                           
{'loss': '0.1401', 'grad_norm': '1.391', 'learning_rate': '7.487e-06', 'epoch': '0.5935'}
+
 59%|█████▉    | 22530/37963 [55:31:12<40:42:54,  9.50s/it]
 59%|█████▉    | 22531/37963 [55:31:26<47:00:37, 10.97s/it]
 59%|█████▉    | 22532/37963 [55:31:34<43:11:20, 10.08s/it]
 59%|█████▉    | 22533/37963 [55:31:42<40:14:49,  9.39s/it]
 59%|█████▉    | 22534/37963 [55:31:50<38:21:45,  8.95s/it]
 59%|█████▉    | 22535/37963 [55:31:57<36:47:12,  8.58s/it]
 59%|█████▉    | 22536/37963 [55:32:05<35:41:55,  8.33s/it]
 59%|█████▉    | 22537/37963 [55:32:13<34:52:20,  8.14s/it]
 59%|█████▉    | 22538/37963 [55:32:21<34:32:46,  8.06s/it]
 59%|█████▉    | 22539/37963 [55:32:29<34:08:47,  7.97s/it]
 59%|█████▉    | 22540/37963 [55:32:43<42:56:57, 10.03s/it]
                                                           
{'loss': '0.1348', 'grad_norm': '2.221', 'learning_rate': '7.478e-06', 'epoch': '0.5937'}
+
 59%|█████▉    | 22540/37963 [55:32:43<42:56:57, 10.03s/it]
 59%|█████▉    | 22541/37963 [55:32:51<40:12:28,  9.39s/it]
 59%|█████▉    | 22542/37963 [55:32:59<38:10:29,  8.91s/it]
 59%|█████▉    | 22543/37963 [55:33:07<36:42:00,  8.57s/it]
 59%|█████▉    | 22544/37963 [55:33:15<35:44:50,  8.35s/it]
 59%|█████▉    | 22545/37963 [55:33:30<44:08:41, 10.31s/it]
 59%|█████▉    | 22546/37963 [55:33:44<49:30:31, 11.56s/it]
 59%|█████▉    | 22547/37963 [55:33:52<44:36:57, 10.42s/it]
 59%|█████▉    | 22548/37963 [55:33:59<41:00:14,  9.58s/it]
 59%|█████▉    | 22549/37963 [55:34:07<38:24:28,  8.97s/it]
 59%|█████▉    | 22550/37963 [55:34:15<36:56:47,  8.63s/it]
                                                           
{'loss': '0.1468', 'grad_norm': '2.688', 'learning_rate': '7.47e-06', 'epoch': '0.594'}
+
 59%|█████▉    | 22550/37963 [55:34:15<36:56:47,  8.63s/it]
 59%|█████▉    | 22551/37963 [55:34:29<44:18:33, 10.35s/it]
 59%|█████▉    | 22552/37963 [55:34:37<40:57:17,  9.57s/it]
 59%|█████▉    | 22553/37963 [55:34:45<38:45:44,  9.06s/it]
 59%|█████▉    | 22554/37963 [55:34:53<37:19:09,  8.72s/it]
 59%|█████▉    | 22555/37963 [55:35:00<36:02:37,  8.42s/it]
 59%|█████▉    | 22556/37963 [55:35:08<35:10:37,  8.22s/it]
 59%|█████▉    | 22557/37963 [55:35:16<34:33:33,  8.08s/it]
 59%|█████▉    | 22558/37963 [55:35:24<34:03:00,  7.96s/it]
 59%|█████▉    | 22559/37963 [55:35:32<34:05:25,  7.97s/it]
 59%|█████▉    | 22560/37963 [55:35:39<33:38:40,  7.86s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '3.39', 'learning_rate': '7.462e-06', 'epoch': '0.5943'}
+
 59%|█████▉    | 22560/37963 [55:35:39<33:38:40,  7.86s/it]
 59%|█████▉    | 22561/37963 [55:35:47<34:01:42,  7.95s/it]
 59%|█████▉    | 22562/37963 [55:35:55<33:51:14,  7.91s/it]
 59%|█████▉    | 22563/37963 [55:36:03<33:20:26,  7.79s/it]
 59%|█████▉    | 22564/37963 [55:36:11<33:31:48,  7.84s/it]
 59%|█████▉    | 22565/37963 [55:36:18<33:28:41,  7.83s/it]
 59%|█████▉    | 22566/37963 [55:36:26<33:23:43,  7.81s/it]
 59%|█████▉    | 22567/37963 [55:36:34<33:32:18,  7.84s/it]
 59%|█████▉    | 22568/37963 [55:36:49<43:01:06, 10.06s/it]
 59%|█████▉    | 22569/37963 [55:36:57<40:16:22,  9.42s/it]
 59%|█████▉    | 22570/37963 [55:37:05<38:05:17,  8.91s/it]
                                                           
{'loss': '0.1303', 'grad_norm': '1.15', 'learning_rate': '7.454e-06', 'epoch': '0.5945'}
+
 59%|█████▉    | 22570/37963 [55:37:05<38:05:17,  8.91s/it]
 59%|█████▉    | 22571/37963 [55:37:13<36:38:09,  8.57s/it]
 59%|█████▉    | 22572/37963 [55:37:29<45:56:30, 10.75s/it]
 59%|█████▉    | 22573/37963 [55:37:36<42:16:25,  9.89s/it]
 59%|█████▉    | 22574/37963 [55:37:44<39:33:36,  9.25s/it]
 59%|█████▉    | 22575/37963 [55:37:59<46:43:21, 10.93s/it]
 59%|█████▉    | 22576/37963 [55:38:07<42:17:58,  9.90s/it]
 59%|█████▉    | 22577/37963 [55:38:14<39:36:28,  9.27s/it]
 59%|█████▉    | 22578/37963 [55:38:22<37:59:54,  8.89s/it]
 59%|█████▉    | 22579/37963 [55:38:30<36:33:54,  8.56s/it]
 59%|█████▉    | 22580/37963 [55:38:46<45:25:42, 10.63s/it]
                                                           
{'loss': '0.1356', 'grad_norm': '2.698', 'learning_rate': '7.445e-06', 'epoch': '0.5948'}
+
 59%|█████▉    | 22580/37963 [55:38:46<45:25:42, 10.63s/it]
 59%|█████▉    | 22581/37963 [55:38:54<42:05:19,  9.85s/it]
 59%|█████▉    | 22582/37963 [55:39:01<39:24:37,  9.22s/it]
 59%|█████▉    | 22583/37963 [55:39:16<46:31:46, 10.89s/it]
 59%|█████▉    | 22584/37963 [55:39:24<42:58:18, 10.06s/it]
 59%|█████▉    | 22585/37963 [55:39:32<40:05:18,  9.38s/it]
 59%|█████▉    | 22586/37963 [55:39:40<37:50:44,  8.86s/it]
 59%|█████▉    | 22587/37963 [55:39:48<36:26:09,  8.53s/it]
 60%|█████▉    | 22588/37963 [55:39:55<35:24:39,  8.29s/it]
 60%|█████▉    | 22589/37963 [55:40:03<34:47:27,  8.15s/it]
 60%|█████▉    | 22590/37963 [55:40:11<34:17:59,  8.03s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '1.297', 'learning_rate': '7.437e-06', 'epoch': '0.5951'}
+
 60%|█████▉    | 22590/37963 [55:40:11<34:17:59,  8.03s/it]
 60%|█████▉    | 22591/37963 [55:40:19<34:12:27,  8.01s/it]
 60%|█████▉    | 22592/37963 [55:40:40<51:37:50, 12.09s/it]
 60%|█████▉    | 22593/37963 [55:40:48<46:15:08, 10.83s/it]
 60%|█████▉    | 22594/37963 [55:40:56<42:26:21,  9.94s/it]
 60%|█████▉    | 22595/37963 [55:41:04<39:43:27,  9.31s/it]
 60%|█████▉    | 22596/37963 [55:41:19<46:47:11, 10.96s/it]
 60%|█████▉    | 22597/37963 [55:41:27<42:47:43, 10.03s/it]
 60%|█████▉    | 22598/37963 [55:41:34<39:43:09,  9.31s/it]
 60%|█████▉    | 22599/37963 [55:41:42<37:50:04,  8.87s/it]
 60%|█████▉    | 22600/37963 [55:41:50<36:33:23,  8.57s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '3.842', 'learning_rate': '7.429e-06', 'epoch': '0.5953'}
+
 60%|█████▉    | 22600/37963 [55:41:50<36:33:23,  8.57s/it]
 60%|█████▉    | 22601/37963 [55:41:58<35:19:15,  8.28s/it]
 60%|█████▉    | 22602/37963 [55:42:05<34:43:07,  8.14s/it]
 60%|█████▉    | 22603/37963 [55:42:13<33:51:35,  7.94s/it]
 60%|█████▉    | 22604/37963 [55:42:21<33:38:58,  7.89s/it]
 60%|█████▉    | 22605/37963 [55:42:28<33:27:48,  7.84s/it]
 60%|█████▉    | 22606/37963 [55:42:36<33:02:01,  7.74s/it]
 60%|█████▉    | 22607/37963 [55:42:44<33:08:05,  7.77s/it]
 60%|█████▉    | 22608/37963 [55:42:52<33:10:31,  7.78s/it]
 60%|█████▉    | 22609/37963 [55:42:59<33:06:10,  7.76s/it]
 60%|█████▉    | 22610/37963 [55:43:07<33:11:12,  7.78s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '1.601', 'learning_rate': '7.421e-06', 'epoch': '0.5956'}
+
 60%|█████▉    | 22610/37963 [55:43:07<33:11:12,  7.78s/it]
 60%|█████▉    | 22611/37963 [55:43:15<33:05:52,  7.76s/it]
 60%|█████▉    | 22612/37963 [55:43:23<33:03:55,  7.75s/it]
 60%|█████▉    | 22613/37963 [55:43:30<33:02:48,  7.75s/it]
 60%|█████▉    | 22614/37963 [55:43:38<33:04:45,  7.76s/it]
 60%|█████▉    | 22615/37963 [55:43:46<33:01:24,  7.75s/it]
 60%|█████▉    | 22616/37963 [55:44:01<42:09:41,  9.89s/it]
 60%|█████▉    | 22617/37963 [55:44:09<39:42:12,  9.31s/it]
 60%|█████▉    | 22618/37963 [55:44:17<37:49:53,  8.88s/it]
 60%|█████▉    | 22619/37963 [55:44:31<45:17:22, 10.63s/it]
 60%|█████▉    | 22620/37963 [55:44:39<41:42:27,  9.79s/it]
                                                           
{'loss': '0.1352', 'grad_norm': '2.119', 'learning_rate': '7.412e-06', 'epoch': '0.5958'}
+
 60%|█████▉    | 22620/37963 [55:44:39<41:42:27,  9.79s/it]
 60%|█████▉    | 22621/37963 [55:44:47<39:03:52,  9.17s/it]
 60%|█████▉    | 22622/37963 [55:44:54<37:13:54,  8.74s/it]
 60%|█████▉    | 22623/37963 [55:45:02<36:12:19,  8.50s/it]
 60%|█████▉    | 22624/37963 [55:45:10<35:15:02,  8.27s/it]
 60%|█████▉    | 22625/37963 [55:45:18<34:38:33,  8.13s/it]
 60%|█████▉    | 22626/37963 [55:45:26<34:18:37,  8.05s/it]
 60%|█████▉    | 22627/37963 [55:45:34<33:56:52,  7.97s/it]
 60%|█████▉    | 22628/37963 [55:45:48<41:57:04,  9.85s/it]
 60%|█████▉    | 22629/37963 [55:46:03<48:58:44, 11.50s/it]
 60%|█████▉    | 22630/37963 [55:46:11<44:31:43, 10.45s/it]
                                                           
{'loss': '0.1346', 'grad_norm': '1.347', 'learning_rate': '7.404e-06', 'epoch': '0.5961'}
+
 60%|█████▉    | 22630/37963 [55:46:11<44:31:43, 10.45s/it]
 60%|█████▉    | 22631/37963 [55:46:19<41:04:14,  9.64s/it]
 60%|█████▉    | 22632/37963 [55:46:27<38:51:34,  9.12s/it]
 60%|█████▉    | 22633/37963 [55:46:35<37:20:38,  8.77s/it]
 60%|█████▉    | 22634/37963 [55:46:43<36:02:59,  8.47s/it]
 60%|█████▉    | 22635/37963 [55:46:50<35:12:10,  8.27s/it]
 60%|█████▉    | 22636/37963 [55:46:58<34:05:24,  8.01s/it]
 60%|█████▉    | 22637/37963 [55:47:20<51:49:24, 12.17s/it]
 60%|█████▉    | 22638/37963 [55:47:28<46:18:45, 10.88s/it]
 60%|█████▉    | 22639/37963 [55:47:35<42:26:19,  9.97s/it]
 60%|█████▉    | 22640/37963 [55:47:43<39:15:12,  9.22s/it]
                                                           
{'loss': '0.141', 'grad_norm': '1.32', 'learning_rate': '7.396e-06', 'epoch': '0.5964'}
+
 60%|█████▉    | 22640/37963 [55:47:43<39:15:12,  9.22s/it]
 60%|█████▉    | 22641/37963 [55:47:51<37:29:36,  8.81s/it]
 60%|█████▉    | 22642/37963 [55:47:58<36:09:20,  8.50s/it]
 60%|█████▉    | 22643/37963 [55:48:06<35:07:45,  8.25s/it]
 60%|█████▉    | 22644/37963 [55:48:21<42:55:35, 10.09s/it]
 60%|█████▉    | 22645/37963 [55:48:28<39:46:21,  9.35s/it]
 60%|█████▉    | 22646/37963 [55:48:36<37:43:37,  8.87s/it]
 60%|█████▉    | 22647/37963 [55:48:51<45:39:08, 10.73s/it]
 60%|█████▉    | 22648/37963 [55:48:59<41:50:46,  9.84s/it]
 60%|█████▉    | 22649/37963 [55:49:06<39:03:44,  9.18s/it]
 60%|█████▉    | 22650/37963 [55:49:14<37:15:41,  8.76s/it]
                                                           
{'loss': '0.1246', 'grad_norm': '1.366', 'learning_rate': '7.388e-06', 'epoch': '0.5966'}
+
 60%|█████▉    | 22650/37963 [55:49:14<37:15:41,  8.76s/it]
 60%|█████▉    | 22651/37963 [55:49:22<36:08:23,  8.50s/it]
 60%|█████▉    | 22652/37963 [55:49:30<35:46:57,  8.41s/it]
 60%|█████▉    | 22653/37963 [55:49:38<35:01:53,  8.24s/it]
 60%|█████▉    | 22654/37963 [55:49:46<34:49:31,  8.19s/it]
 60%|█████▉    | 22655/37963 [55:49:54<34:29:35,  8.11s/it]
 60%|█████▉    | 22656/37963 [55:50:02<34:14:35,  8.05s/it]
 60%|█████▉    | 22657/37963 [55:50:10<33:52:40,  7.97s/it]
 60%|█████▉    | 22658/37963 [55:50:17<33:21:11,  7.85s/it]
 60%|█████▉    | 22659/37963 [55:50:25<33:14:05,  7.82s/it]
 60%|█████▉    | 22660/37963 [55:50:33<33:04:55,  7.78s/it]
                                                           
{'loss': '0.138', 'grad_norm': '2.436', 'learning_rate': '7.379e-06', 'epoch': '0.5969'}
+
 60%|█████▉    | 22660/37963 [55:50:33<33:04:55,  7.78s/it]
 60%|█████▉    | 22661/37963 [55:50:48<42:56:53, 10.10s/it]
 60%|█████▉    | 22662/37963 [55:50:56<40:06:57,  9.44s/it]
 60%|█████▉    | 22663/37963 [55:51:04<37:54:47,  8.92s/it]
 60%|█████▉    | 22664/37963 [55:51:12<36:22:25,  8.56s/it]
 60%|█████▉    | 22665/37963 [55:51:26<43:56:35, 10.34s/it]
 60%|█████▉    | 22666/37963 [55:51:34<40:52:55,  9.62s/it]
 60%|█████▉    | 22667/37963 [55:51:42<38:27:06,  9.05s/it]
 60%|█████▉    | 22668/37963 [55:51:50<36:57:36,  8.70s/it]
 60%|█████▉    | 22669/37963 [55:51:57<35:44:30,  8.41s/it]
 60%|█████▉    | 22670/37963 [55:52:05<35:01:59,  8.25s/it]
                                                           
{'loss': '0.1396', 'grad_norm': '2.198', 'learning_rate': '7.371e-06', 'epoch': '0.5972'}
+
 60%|█████▉    | 22670/37963 [55:52:05<35:01:59,  8.25s/it]
 60%|█████▉    | 22671/37963 [55:52:13<34:26:42,  8.11s/it]
 60%|█████▉    | 22672/37963 [55:52:21<34:12:26,  8.05s/it]
 60%|█████▉    | 22673/37963 [55:52:28<33:29:04,  7.88s/it]
 60%|█████▉    | 22674/37963 [55:52:36<33:19:44,  7.85s/it]
 60%|█████▉    | 22675/37963 [55:52:52<42:54:27, 10.10s/it]
 60%|█████▉    | 22676/37963 [55:53:00<40:11:12,  9.46s/it]
 60%|█████▉    | 22677/37963 [55:53:15<47:14:08, 11.12s/it]
 60%|█████▉    | 22678/37963 [55:53:23<43:16:36, 10.19s/it]
 60%|█████▉    | 22679/37963 [55:53:30<40:19:33,  9.50s/it]
 60%|█████▉    | 22680/37963 [55:53:38<38:04:41,  8.97s/it]
                                                           
{'loss': '0.1253', 'grad_norm': '1.909', 'learning_rate': '7.363e-06', 'epoch': '0.5974'}
+
 60%|█████▉    | 22680/37963 [55:53:38<38:04:41,  8.97s/it]
 60%|█████▉    | 22681/37963 [55:53:46<36:41:57,  8.65s/it]
 60%|█████▉    | 22682/37963 [55:53:54<35:20:35,  8.33s/it]
 60%|█████▉    | 22683/37963 [55:54:02<34:51:12,  8.21s/it]
 60%|█████▉    | 22684/37963 [55:54:09<34:14:25,  8.07s/it]
 60%|█████▉    | 22685/37963 [55:54:24<43:01:10, 10.14s/it]
 60%|█████▉    | 22686/37963 [55:54:39<49:18:56, 11.62s/it]
 60%|█████▉    | 22687/37963 [55:54:47<44:17:39, 10.44s/it]
 60%|█████▉    | 22688/37963 [55:54:54<40:24:42,  9.52s/it]
 60%|█████▉    | 22689/37963 [55:55:02<38:12:01,  9.00s/it]
 60%|█████▉    | 22690/37963 [55:55:10<36:08:54,  8.52s/it]
                                                           
{'loss': '0.1436', 'grad_norm': '1.89', 'learning_rate': '7.355e-06', 'epoch': '0.5977'}
+
 60%|█████▉    | 22690/37963 [55:55:10<36:08:54,  8.52s/it]
 60%|█████▉    | 22691/37963 [55:55:25<44:27:56, 10.48s/it]
 60%|█████▉    | 22692/37963 [55:55:33<41:22:10,  9.75s/it]
 60%|█████▉    | 22693/37963 [55:55:47<47:39:58, 11.24s/it]
 60%|█████▉    | 22694/37963 [55:55:56<44:03:25, 10.39s/it]
 60%|█████▉    | 22695/37963 [55:56:04<40:48:39,  9.62s/it]
 60%|█████▉    | 22696/37963 [55:56:12<38:29:27,  9.08s/it]
 60%|█████▉    | 22697/37963 [55:56:19<36:52:33,  8.70s/it]
 60%|█████▉    | 22698/37963 [55:56:27<35:37:40,  8.40s/it]
 60%|█████▉    | 22699/37963 [55:56:35<34:46:27,  8.20s/it]
 60%|█████▉    | 22700/37963 [55:56:43<34:15:28,  8.08s/it]
                                                           
{'loss': '0.131', 'grad_norm': '4.284', 'learning_rate': '7.346e-06', 'epoch': '0.598'}
+
 60%|█████▉    | 22700/37963 [55:56:43<34:15:28,  8.08s/it]
 60%|█████▉    | 22701/37963 [55:56:50<33:55:42,  8.00s/it]
 60%|█████▉    | 22702/37963 [55:56:58<33:38:01,  7.93s/it]
 60%|█████▉    | 22703/37963 [55:57:06<33:28:41,  7.90s/it]
 60%|█████▉    | 22704/37963 [55:57:14<33:22:37,  7.87s/it]
 60%|█████▉    | 22705/37963 [55:57:21<32:50:56,  7.75s/it]
 60%|█████▉    | 22706/37963 [55:57:29<32:48:51,  7.74s/it]
 60%|█████▉    | 22707/37963 [55:57:37<32:48:57,  7.74s/it]
 60%|█████▉    | 22708/37963 [55:57:44<32:50:02,  7.75s/it]
 60%|█████▉    | 22709/37963 [55:57:59<41:35:39,  9.82s/it]
 60%|█████▉    | 22710/37963 [55:58:14<47:27:50, 11.20s/it]
                                                           
{'loss': '0.1325', 'grad_norm': '2.121', 'learning_rate': '7.338e-06', 'epoch': '0.5982'}
+
 60%|█████▉    | 22710/37963 [55:58:14<47:27:50, 11.20s/it]
 60%|█████▉    | 22711/37963 [55:58:21<43:15:32, 10.21s/it]
 60%|█████▉    | 22712/37963 [55:58:29<40:07:18,  9.47s/it]
 60%|█████▉    | 22713/37963 [55:58:37<37:49:46,  8.93s/it]
 60%|█████▉    | 22714/37963 [55:58:45<36:25:37,  8.60s/it]
 60%|█████▉    | 22715/37963 [55:58:52<35:17:23,  8.33s/it]
 60%|█████▉    | 22716/37963 [55:59:00<34:33:23,  8.16s/it]
 60%|█████▉    | 22717/37963 [55:59:08<33:59:27,  8.03s/it]
 60%|█████▉    | 22718/37963 [55:59:15<33:24:53,  7.89s/it]
 60%|█████▉    | 22719/37963 [55:59:23<33:12:48,  7.84s/it]
 60%|█████▉    | 22720/37963 [55:59:31<33:08:16,  7.83s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '4.145', 'learning_rate': '7.33e-06', 'epoch': '0.5985'}
+
 60%|█████▉    | 22720/37963 [55:59:31<33:08:16,  7.83s/it]
 60%|█████▉    | 22721/37963 [55:59:39<33:16:48,  7.86s/it]
 60%|█████▉    | 22722/37963 [55:59:46<32:50:38,  7.76s/it]
 60%|█████▉    | 22723/37963 [55:59:54<32:48:53,  7.75s/it]
 60%|█████▉    | 22724/37963 [56:00:02<32:50:21,  7.76s/it]
 60%|█████▉    | 22725/37963 [56:00:17<41:55:11,  9.90s/it]
 60%|█████▉    | 22726/37963 [56:00:25<39:21:11,  9.30s/it]
 60%|█████▉    | 22727/37963 [56:00:33<37:39:25,  8.90s/it]
 60%|█████▉    | 22728/37963 [56:00:40<36:12:28,  8.56s/it]
 60%|█████▉    | 22729/37963 [56:00:56<44:43:30, 10.57s/it]
 60%|█████▉    | 22730/37963 [56:01:03<40:52:42,  9.66s/it]
                                                           
{'loss': '0.1254', 'grad_norm': '1.796', 'learning_rate': '7.322e-06', 'epoch': '0.5987'}
+
 60%|█████▉    | 22730/37963 [56:01:03<40:52:42,  9.66s/it]
 60%|█████▉    | 22731/37963 [56:01:11<38:16:42,  9.05s/it]
 60%|█████▉    | 22732/37963 [56:01:19<36:55:22,  8.73s/it]
 60%|█████▉    | 22733/37963 [56:01:33<44:11:54, 10.45s/it]
 60%|█████▉    | 22734/37963 [56:01:41<41:03:55,  9.71s/it]
 60%|█████▉    | 22735/37963 [56:01:49<38:38:51,  9.14s/it]
 60%|█████▉    | 22736/37963 [56:01:57<36:51:35,  8.71s/it]
 60%|█████▉    | 22737/37963 [56:02:05<35:32:13,  8.40s/it]
 60%|█████▉    | 22738/37963 [56:02:20<44:00:49, 10.41s/it]
 60%|█████▉    | 22739/37963 [56:02:28<40:49:30,  9.65s/it]
 60%|█████▉    | 22740/37963 [56:02:42<47:17:01, 11.18s/it]
                                                           
{'loss': '0.1264', 'grad_norm': '1.344', 'learning_rate': '7.314e-06', 'epoch': '0.599'}
+
 60%|█████▉    | 22740/37963 [56:02:42<47:17:01, 11.18s/it]
 60%|█████▉    | 22741/37963 [56:02:50<43:07:47, 10.20s/it]
 60%|█████▉    | 22742/37963 [56:02:58<40:07:13,  9.49s/it]
 60%|█████▉    | 22743/37963 [56:03:06<38:08:02,  9.02s/it]
 60%|█████▉    | 22744/37963 [56:03:14<36:26:35,  8.62s/it]
 60%|█████▉    | 22745/37963 [56:03:28<43:51:48, 10.38s/it]
 60%|█████▉    | 22746/37963 [56:03:36<40:43:59,  9.64s/it]
 60%|█████▉    | 22747/37963 [56:03:44<38:12:40,  9.04s/it]
 60%|█████▉    | 22748/37963 [56:03:51<36:35:01,  8.66s/it]
 60%|█████▉    | 22749/37963 [56:03:59<35:00:57,  8.29s/it]
 60%|█████▉    | 22750/37963 [56:04:07<34:16:11,  8.11s/it]
                                                           
{'loss': '0.1269', 'grad_norm': '1.996', 'learning_rate': '7.305e-06', 'epoch': '0.5993'}
+
 60%|█████▉    | 22750/37963 [56:04:07<34:16:11,  8.11s/it]
 60%|█████▉    | 22751/37963 [56:04:14<33:48:04,  8.00s/it]
 60%|█████▉    | 22752/37963 [56:04:22<33:24:13,  7.91s/it]
 60%|█████▉    | 22753/37963 [56:04:36<41:36:34,  9.85s/it]
 60%|█████▉    | 22754/37963 [56:04:44<38:58:40,  9.23s/it]
 60%|█████▉    | 22755/37963 [56:04:52<37:17:26,  8.83s/it]
 60%|█████▉    | 22756/37963 [56:05:00<35:55:41,  8.51s/it]
 60%|█████▉    | 22757/37963 [56:05:08<35:05:17,  8.31s/it]
 60%|█████▉    | 22758/37963 [56:05:16<34:35:28,  8.19s/it]
 60%|█████▉    | 22759/37963 [56:05:23<33:41:12,  7.98s/it]
 60%|█████▉    | 22760/37963 [56:05:31<33:22:31,  7.90s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '2.838', 'learning_rate': '7.297e-06', 'epoch': '0.5995'}
+
 60%|█████▉    | 22760/37963 [56:05:31<33:22:31,  7.90s/it]
 60%|█████▉    | 22761/37963 [56:05:46<42:36:00, 10.09s/it]
 60%|█████▉    | 22762/37963 [56:05:54<39:45:31,  9.42s/it]
 60%|█████▉    | 22763/37963 [56:06:01<37:03:13,  8.78s/it]
 60%|█████▉    | 22764/37963 [56:06:09<35:42:12,  8.46s/it]
 60%|█████▉    | 22765/37963 [56:06:17<34:50:20,  8.25s/it]
 60%|█████▉    | 22766/37963 [56:06:24<34:09:51,  8.09s/it]
 60%|█████▉    | 22767/37963 [56:06:32<33:37:55,  7.97s/it]
 60%|█████▉    | 22768/37963 [56:06:40<33:25:08,  7.92s/it]
 60%|█████▉    | 22769/37963 [56:06:48<33:20:26,  7.90s/it]
 60%|█████▉    | 22770/37963 [56:06:55<32:52:36,  7.79s/it]
                                                           
{'loss': '0.1312', 'grad_norm': '2.243', 'learning_rate': '7.289e-06', 'epoch': '0.5998'}
+
 60%|█████▉    | 22770/37963 [56:06:55<32:52:36,  7.79s/it]
 60%|█████▉    | 22771/37963 [56:07:03<32:47:10,  7.77s/it]
 60%|█████▉    | 22772/37963 [56:07:11<32:46:49,  7.77s/it]
 60%|█████▉    | 22773/37963 [56:07:19<33:06:31,  7.85s/it]
 60%|█████▉    | 22774/37963 [56:07:33<41:33:04,  9.85s/it]
 60%|█████▉    | 22775/37963 [56:07:41<39:10:58,  9.29s/it]
 60%|█████▉    | 22776/37963 [56:07:49<37:03:15,  8.78s/it]
 60%|█████▉    | 22777/37963 [56:07:57<35:48:56,  8.49s/it]
 60%|██████    | 22778/37963 [56:08:11<43:00:52, 10.20s/it]
 60%|██████    | 22779/37963 [56:08:18<39:38:24,  9.40s/it]
 60%|██████    | 22780/37963 [56:08:26<37:43:59,  8.95s/it]
                                                           
{'loss': '0.134', 'grad_norm': '1.76', 'learning_rate': '7.281e-06', 'epoch': '0.6001'}
+
 60%|██████    | 22780/37963 [56:08:26<37:43:59,  8.95s/it]
 60%|██████    | 22781/37963 [56:08:34<35:51:32,  8.50s/it]
 60%|██████    | 22782/37963 [56:08:41<34:58:55,  8.30s/it]
 60%|██████    | 22783/37963 [56:08:49<34:21:24,  8.15s/it]
 60%|██████    | 22784/37963 [56:09:04<43:05:28, 10.22s/it]
 60%|██████    | 22785/37963 [56:09:19<49:05:15, 11.64s/it]
 60%|██████    | 22786/37963 [56:09:27<44:40:13, 10.60s/it]
 60%|██████    | 22787/37963 [56:09:35<41:13:48,  9.78s/it]
 60%|██████    | 22788/37963 [56:09:50<47:28:14, 11.26s/it]
 60%|██████    | 22789/37963 [56:09:58<42:58:18, 10.19s/it]
 60%|██████    | 22790/37963 [56:10:05<39:40:55,  9.42s/it]
                                                           
{'loss': '0.138', 'grad_norm': '2.625', 'learning_rate': '7.273e-06', 'epoch': '0.6003'}
+
 60%|██████    | 22790/37963 [56:10:05<39:40:55,  9.42s/it]
 60%|██████    | 22791/37963 [56:10:13<37:44:55,  8.96s/it]
 60%|██████    | 22792/37963 [56:10:21<36:11:06,  8.59s/it]
 60%|██████    | 22793/37963 [56:10:28<34:48:37,  8.26s/it]
 60%|██████    | 22794/37963 [56:10:36<34:19:46,  8.15s/it]
 60%|██████    | 22795/37963 [56:10:44<33:57:04,  8.06s/it]
 60%|██████    | 22796/37963 [56:10:52<33:53:54,  8.05s/it]
 60%|██████    | 22797/37963 [56:11:00<33:32:23,  7.96s/it]
 60%|██████    | 22798/37963 [56:11:08<33:13:42,  7.89s/it]
 60%|██████    | 22799/37963 [56:11:15<32:54:25,  7.81s/it]
 60%|██████    | 22800/37963 [56:11:37<50:16:30, 11.94s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '3.506', 'learning_rate': '7.264e-06', 'epoch': '0.6006'}
+
 60%|██████    | 22800/37963 [56:11:37<50:16:30, 11.94s/it]
 60%|██████    | 22801/37963 [56:11:45<45:07:03, 10.71s/it]
 60%|██████    | 22802/37963 [56:11:52<41:13:26,  9.79s/it]
 60%|██████    | 22803/37963 [56:12:00<38:27:55,  9.13s/it]
 60%|██████    | 22804/37963 [56:12:08<36:43:19,  8.72s/it]
 60%|██████    | 22805/37963 [56:12:15<35:32:35,  8.44s/it]
 60%|██████    | 22806/37963 [56:12:23<34:54:37,  8.29s/it]
 60%|██████    | 22807/37963 [56:12:31<33:49:18,  8.03s/it]
 60%|██████    | 22808/37963 [56:12:39<33:20:50,  7.92s/it]
 60%|██████    | 22809/37963 [56:12:54<42:33:56, 10.11s/it]
 60%|██████    | 22810/37963 [56:13:02<39:53:51,  9.48s/it]
                                                           
{'loss': '0.1329', 'grad_norm': '1.603', 'learning_rate': '7.256e-06', 'epoch': '0.6009'}
+
 60%|██████    | 22810/37963 [56:13:02<39:53:51,  9.48s/it]
 60%|██████    | 22811/37963 [56:13:10<38:08:18,  9.06s/it]
 60%|██████    | 22812/37963 [56:13:18<36:32:02,  8.68s/it]
 60%|██████    | 22813/37963 [56:13:25<35:09:26,  8.35s/it]
 60%|██████    | 22814/37963 [56:13:33<34:28:14,  8.19s/it]
 60%|██████    | 22815/37963 [56:13:41<33:55:10,  8.06s/it]
 60%|██████    | 22816/37963 [56:13:49<33:30:25,  7.96s/it]
 60%|██████    | 22817/37963 [56:13:56<33:29:14,  7.96s/it]
 60%|██████    | 22818/37963 [56:14:04<33:24:58,  7.94s/it]
 60%|██████    | 22819/37963 [56:14:12<33:13:04,  7.90s/it]
 60%|██████    | 22820/37963 [56:14:20<33:14:23,  7.90s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '1.058', 'learning_rate': '7.248e-06', 'epoch': '0.6011'}
+
 60%|██████    | 22820/37963 [56:14:20<33:14:23,  7.90s/it]
 60%|██████    | 22821/37963 [56:14:28<32:49:29,  7.80s/it]
 60%|██████    | 22822/37963 [56:14:35<32:48:23,  7.80s/it]
 60%|██████    | 22823/37963 [56:14:50<41:30:12,  9.87s/it]
 60%|██████    | 22824/37963 [56:14:58<38:37:34,  9.19s/it]
 60%|██████    | 22825/37963 [56:15:13<46:11:33, 10.99s/it]
 60%|██████    | 22826/37963 [56:15:21<42:04:53, 10.01s/it]
 60%|██████    | 22827/37963 [56:15:29<39:23:58,  9.37s/it]
 60%|██████    | 22828/37963 [56:15:36<37:18:02,  8.87s/it]
 60%|██████    | 22829/37963 [56:15:44<35:51:09,  8.53s/it]
 60%|██████    | 22830/37963 [56:15:52<34:54:58,  8.31s/it]
                                                           
{'loss': '0.1396', 'grad_norm': '3.545', 'learning_rate': '7.24e-06', 'epoch': '0.6014'}
+
 60%|██████    | 22830/37963 [56:15:52<34:54:58,  8.31s/it]
 60%|██████    | 22831/37963 [56:15:59<34:11:51,  8.14s/it]
 60%|██████    | 22832/37963 [56:16:07<33:36:21,  8.00s/it]
 60%|██████    | 22833/37963 [56:16:15<33:10:18,  7.89s/it]
 60%|██████    | 22834/37963 [56:16:22<32:32:53,  7.74s/it]
 60%|██████    | 22835/37963 [56:16:37<41:17:27,  9.83s/it]
 60%|██████    | 22836/37963 [56:16:45<38:45:00,  9.22s/it]
 60%|██████    | 22837/37963 [56:16:59<45:46:18, 10.89s/it]
 60%|██████    | 22838/37963 [56:17:08<42:17:48, 10.07s/it]
 60%|██████    | 22839/37963 [56:17:23<48:32:33, 11.55s/it]
 60%|██████    | 22840/37963 [56:17:31<43:56:51, 10.46s/it]
                                                           
{'loss': '0.1261', 'grad_norm': '1.107', 'learning_rate': '7.232e-06', 'epoch': '0.6016'}
+
 60%|██████    | 22840/37963 [56:17:31<43:56:51, 10.46s/it]
 60%|██████    | 22841/37963 [56:17:39<41:01:16,  9.77s/it]
 60%|██████    | 22842/37963 [56:17:46<38:27:28,  9.16s/it]
 60%|██████    | 22843/37963 [56:17:54<36:56:37,  8.80s/it]
 60%|██████    | 22844/37963 [56:18:02<35:20:48,  8.42s/it]
 60%|██████    | 22845/37963 [56:18:10<34:24:45,  8.19s/it]
 60%|██████    | 22846/37963 [56:18:18<34:03:32,  8.11s/it]
 60%|██████    | 22847/37963 [56:18:25<33:23:16,  7.95s/it]
 60%|██████    | 22848/37963 [56:18:39<41:25:52,  9.87s/it]
 60%|██████    | 22849/37963 [56:18:47<39:05:12,  9.31s/it]
 60%|██████    | 22850/37963 [56:18:55<36:45:02,  8.75s/it]
                                                           
{'loss': '0.1393', 'grad_norm': '2.182', 'learning_rate': '7.223e-06', 'epoch': '0.6019'}
+
 60%|██████    | 22850/37963 [56:18:55<36:45:02,  8.75s/it]
 60%|██████    | 22851/37963 [56:19:02<35:10:42,  8.38s/it]
 60%|██████    | 22852/37963 [56:19:10<34:14:01,  8.16s/it]
 60%|██████    | 22853/37963 [56:19:18<33:53:48,  8.08s/it]
 60%|██████    | 22854/37963 [56:19:33<42:17:50, 10.08s/it]
 60%|██████    | 22855/37963 [56:19:41<39:47:01,  9.48s/it]
 60%|██████    | 22856/37963 [56:19:49<37:47:15,  9.00s/it]
 60%|██████    | 22857/37963 [56:19:56<36:11:30,  8.63s/it]
 60%|██████    | 22858/37963 [56:20:04<35:08:33,  8.38s/it]
 60%|██████    | 22859/37963 [56:20:12<34:02:03,  8.11s/it]
 60%|██████    | 22860/37963 [56:20:19<33:38:03,  8.02s/it]
                                                           
{'loss': '0.1287', 'grad_norm': '1.927', 'learning_rate': '7.215e-06', 'epoch': '0.6022'}
+
 60%|██████    | 22860/37963 [56:20:20<33:38:03,  8.02s/it]
 60%|██████    | 22861/37963 [56:20:27<33:21:53,  7.95s/it]
 60%|██████    | 22862/37963 [56:20:35<33:09:50,  7.91s/it]
 60%|██████    | 22863/37963 [56:20:50<42:25:44, 10.12s/it]
 60%|██████    | 22864/37963 [56:20:58<39:04:09,  9.32s/it]
 60%|██████    | 22865/37963 [56:21:06<37:02:01,  8.83s/it]
 60%|██████    | 22866/37963 [56:21:13<35:38:21,  8.50s/it]
 60%|██████    | 22867/37963 [56:21:21<34:52:58,  8.32s/it]
 60%|██████    | 22868/37963 [56:21:29<34:13:07,  8.16s/it]
 60%|██████    | 22869/37963 [56:21:37<33:37:30,  8.02s/it]
 60%|██████    | 22870/37963 [56:21:44<33:22:32,  7.96s/it]
                                                           
{'loss': '0.1406', 'grad_norm': '1.834', 'learning_rate': '7.207e-06', 'epoch': '0.6024'}
+
 60%|██████    | 22870/37963 [56:21:44<33:22:32,  7.96s/it]
 60%|██████    | 22871/37963 [56:21:59<41:31:33,  9.91s/it]
 60%|██████    | 22872/37963 [56:22:07<39:28:24,  9.42s/it]
 60%|██████    | 22873/37963 [56:22:15<37:28:23,  8.94s/it]
 60%|██████    | 22874/37963 [56:22:23<35:48:51,  8.54s/it]
 60%|██████    | 22875/37963 [56:22:30<34:52:23,  8.32s/it]
 60%|██████    | 22876/37963 [56:22:38<34:03:07,  8.13s/it]
 60%|██████    | 22877/37963 [56:22:46<33:37:51,  8.03s/it]
 60%|██████    | 22878/37963 [56:22:54<33:19:33,  7.95s/it]
 60%|██████    | 22879/37963 [56:23:09<42:11:33, 10.07s/it]
 60%|██████    | 22880/37963 [56:23:17<39:22:49,  9.40s/it]
                                                           
{'loss': '0.1378', 'grad_norm': '2.424', 'learning_rate': '7.199e-06', 'epoch': '0.6027'}
+
 60%|██████    | 22880/37963 [56:23:17<39:22:49,  9.40s/it]
 60%|██████    | 22881/37963 [56:23:24<37:20:10,  8.91s/it]
 60%|██████    | 22882/37963 [56:23:32<36:04:40,  8.61s/it]
 60%|██████    | 22883/37963 [56:23:40<34:44:14,  8.29s/it]
 60%|██████    | 22884/37963 [56:23:54<42:18:19, 10.10s/it]
 60%|██████    | 22885/37963 [56:24:02<39:34:14,  9.45s/it]
 60%|██████    | 22886/37963 [56:24:09<37:03:47,  8.85s/it]
 60%|██████    | 22887/37963 [56:24:24<44:33:35, 10.64s/it]
 60%|██████    | 22888/37963 [56:24:32<40:54:46,  9.77s/it]
 60%|██████    | 22889/37963 [56:24:40<38:23:08,  9.17s/it]
 60%|██████    | 22890/37963 [56:24:48<36:46:04,  8.78s/it]
                                                           
{'loss': '0.1323', 'grad_norm': '1.171', 'learning_rate': '7.191e-06', 'epoch': '0.603'}
+
 60%|██████    | 22890/37963 [56:24:48<36:46:04,  8.78s/it]
 60%|██████    | 22891/37963 [56:25:03<44:28:20, 10.62s/it]
 60%|██████    | 22892/37963 [56:25:11<41:07:02,  9.82s/it]
 60%|██████    | 22893/37963 [56:25:18<38:18:02,  9.15s/it]
 60%|██████    | 22894/37963 [56:25:26<36:35:12,  8.74s/it]
 60%|██████    | 22895/37963 [56:25:33<35:00:59,  8.37s/it]
 60%|██████    | 22896/37963 [56:25:41<34:24:30,  8.22s/it]
 60%|██████    | 22897/37963 [56:25:49<33:42:50,  8.06s/it]
 60%|██████    | 22898/37963 [56:25:57<33:25:01,  7.99s/it]
 60%|██████    | 22899/37963 [56:26:04<33:04:50,  7.91s/it]
 60%|██████    | 22900/37963 [56:26:19<41:25:24,  9.90s/it]
                                                           
{'loss': '0.1356', 'grad_norm': '2.079', 'learning_rate': '7.182e-06', 'epoch': '0.6032'}
+
 60%|██████    | 22900/37963 [56:26:19<41:25:24,  9.90s/it]
 60%|██████    | 22901/37963 [56:26:27<38:44:27,  9.26s/it]
 60%|██████    | 22902/37963 [56:26:41<45:20:15, 10.84s/it]
 60%|██████    | 22903/37963 [56:26:49<41:59:31, 10.04s/it]
 60%|██████    | 22904/37963 [56:26:57<38:51:44,  9.29s/it]
 60%|██████    | 22905/37963 [56:27:05<36:51:33,  8.81s/it]
 60%|██████    | 22906/37963 [56:27:12<35:26:47,  8.47s/it]
 60%|██████    | 22907/37963 [56:27:20<34:46:44,  8.32s/it]
 60%|██████    | 22908/37963 [56:27:28<34:12:09,  8.18s/it]
 60%|██████    | 22909/37963 [56:27:43<42:26:30, 10.15s/it]
 60%|██████    | 22910/37963 [56:27:51<39:30:15,  9.45s/it]
                                                           
{'loss': '0.1354', 'grad_norm': '1.764', 'learning_rate': '7.174e-06', 'epoch': '0.6035'}
+
 60%|██████    | 22910/37963 [56:27:51<39:30:15,  9.45s/it]
 60%|██████    | 22911/37963 [56:27:59<37:41:33,  9.01s/it]
 60%|██████    | 22912/37963 [56:28:06<36:03:59,  8.63s/it]
 60%|██████    | 22913/37963 [56:28:14<34:54:41,  8.35s/it]
 60%|██████    | 22914/37963 [56:28:22<34:22:10,  8.22s/it]
 60%|██████    | 22915/37963 [56:28:37<42:26:46, 10.15s/it]
 60%|██████    | 22916/37963 [56:28:45<39:33:37,  9.46s/it]
 60%|██████    | 22917/37963 [56:28:53<37:47:37,  9.04s/it]
 60%|██████    | 22918/37963 [56:29:00<36:03:01,  8.63s/it]
 60%|██████    | 22919/37963 [56:29:08<34:59:00,  8.37s/it]
 60%|██████    | 22920/37963 [56:29:16<34:10:34,  8.18s/it]
                                                           
{'loss': '0.1239', 'grad_norm': '1.029', 'learning_rate': '7.166e-06', 'epoch': '0.6037'}
+
 60%|██████    | 22920/37963 [56:29:16<34:10:34,  8.18s/it]
 60%|██████    | 22921/37963 [56:29:23<33:30:08,  8.02s/it]
 60%|██████    | 22922/37963 [56:29:31<33:09:07,  7.93s/it]
 60%|██████    | 22923/37963 [56:29:39<32:51:40,  7.87s/it]
 60%|██████    | 22924/37963 [56:29:47<32:53:02,  7.87s/it]
 60%|██████    | 22925/37963 [56:29:55<33:05:30,  7.92s/it]
 60%|██████    | 22926/37963 [56:30:03<32:54:27,  7.88s/it]
 60%|██████    | 22927/37963 [56:30:10<32:51:24,  7.87s/it]
 60%|██████    | 22928/37963 [56:30:18<32:54:39,  7.88s/it]
 60%|██████    | 22929/37963 [56:30:26<32:43:35,  7.84s/it]
 60%|██████    | 22930/37963 [56:30:34<32:38:36,  7.82s/it]
                                                           
{'loss': '0.1254', 'grad_norm': '1.703', 'learning_rate': '7.158e-06', 'epoch': '0.604'}
+
 60%|██████    | 22930/37963 [56:30:34<32:38:36,  7.82s/it]
 60%|██████    | 22931/37963 [56:30:49<42:00:14, 10.06s/it]
 60%|██████    | 22932/37963 [56:30:57<39:41:12,  9.51s/it]
 60%|██████    | 22933/37963 [56:31:05<37:38:10,  9.01s/it]
 60%|██████    | 22934/37963 [56:31:13<36:02:34,  8.63s/it]
 60%|██████    | 22935/37963 [56:31:21<35:04:16,  8.40s/it]
 60%|██████    | 22936/37963 [56:31:29<34:13:05,  8.20s/it]
 60%|██████    | 22937/37963 [56:31:44<42:39:02, 10.22s/it]
 60%|██████    | 22938/37963 [56:31:51<39:42:37,  9.51s/it]
 60%|██████    | 22939/37963 [56:32:05<45:19:32, 10.86s/it]
 60%|██████    | 22940/37963 [56:32:13<41:44:16, 10.00s/it]
                                                           
{'loss': '0.132', 'grad_norm': '2.531', 'learning_rate': '7.15e-06', 'epoch': '0.6043'}
+
 60%|██████    | 22940/37963 [56:32:13<41:44:16, 10.00s/it]
 60%|██████    | 22941/37963 [56:32:28<47:13:04, 11.32s/it]
 60%|██████    | 22942/37963 [56:32:36<43:20:07, 10.39s/it]
 60%|██████    | 22943/37963 [56:32:44<39:53:59,  9.56s/it]
 60%|██████    | 22944/37963 [56:32:51<37:31:51,  9.00s/it]
 60%|██████    | 22945/37963 [56:32:59<35:59:02,  8.63s/it]
 60%|██████    | 22946/37963 [56:33:13<43:05:56, 10.33s/it]
 60%|██████    | 22947/37963 [56:33:21<40:00:36,  9.59s/it]
 60%|██████    | 22948/37963 [56:33:29<37:54:49,  9.09s/it]
 60%|██████    | 22949/37963 [56:33:37<35:56:20,  8.62s/it]
 60%|██████    | 22950/37963 [56:33:45<34:56:47,  8.38s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '1.315', 'learning_rate': '7.141e-06', 'epoch': '0.6045'}
+
 60%|██████    | 22950/37963 [56:33:45<34:56:47,  8.38s/it]
 60%|██████    | 22951/37963 [56:33:52<34:17:26,  8.22s/it]
 60%|██████    | 22952/37963 [56:34:00<33:42:43,  8.08s/it]
 60%|██████    | 22953/37963 [56:34:14<41:31:32,  9.96s/it]
 60%|██████    | 22954/37963 [56:34:23<39:24:35,  9.45s/it]
 60%|██████    | 22955/37963 [56:34:31<37:30:27,  9.00s/it]
 60%|██████    | 22956/37963 [56:34:38<35:41:07,  8.56s/it]
 60%|██████    | 22957/37963 [56:34:46<34:42:20,  8.33s/it]
 60%|██████    | 22958/37963 [56:34:54<34:08:08,  8.19s/it]
 60%|██████    | 22959/37963 [56:35:08<41:58:34, 10.07s/it]
 60%|██████    | 22960/37963 [56:35:16<39:24:00,  9.45s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '2.149', 'learning_rate': '7.133e-06', 'epoch': '0.6048'}
+
 60%|██████    | 22960/37963 [56:35:16<39:24:00,  9.45s/it]
 60%|██████    | 22961/37963 [56:35:24<37:34:26,  9.02s/it]
 60%|██████    | 22962/37963 [56:35:32<36:00:45,  8.64s/it]
 60%|██████    | 22963/37963 [56:35:47<44:19:12, 10.64s/it]
 60%|██████    | 22964/37963 [56:35:55<40:38:14,  9.75s/it]
 60%|██████    | 22965/37963 [56:36:03<38:13:06,  9.17s/it]
 60%|██████    | 22966/37963 [56:36:11<36:26:38,  8.75s/it]
 60%|██████    | 22967/37963 [56:36:19<35:23:22,  8.50s/it]
 61%|██████    | 22968/37963 [56:36:26<34:31:19,  8.29s/it]
 61%|██████    | 22969/37963 [56:36:34<33:46:05,  8.11s/it]
 61%|██████    | 22970/37963 [56:36:42<33:33:30,  8.06s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '3.996', 'learning_rate': '7.125e-06', 'epoch': '0.6051'}
+
 61%|██████    | 22970/37963 [56:36:42<33:33:30,  8.06s/it]
 61%|██████    | 22971/37963 [56:36:50<33:17:40,  7.99s/it]
 61%|██████    | 22972/37963 [56:36:58<32:54:13,  7.90s/it]
 61%|██████    | 22973/37963 [56:37:06<33:00:33,  7.93s/it]
 61%|██████    | 22974/37963 [56:37:13<32:44:12,  7.86s/it]
 61%|██████    | 22975/37963 [56:37:21<32:37:59,  7.84s/it]
 61%|██████    | 22976/37963 [56:37:29<32:31:08,  7.81s/it]
 61%|██████    | 22977/37963 [56:37:37<32:27:36,  7.80s/it]
 61%|██████    | 22978/37963 [56:37:44<32:32:27,  7.82s/it]
 61%|██████    | 22979/37963 [56:37:52<32:18:17,  7.76s/it]
 61%|██████    | 22980/37963 [56:38:00<31:58:06,  7.68s/it]
                                                           
{'loss': '0.1499', 'grad_norm': '3.058', 'learning_rate': '7.117e-06', 'epoch': '0.6053'}
+
 61%|██████    | 22980/37963 [56:38:00<31:58:06,  7.68s/it]
 61%|██████    | 22981/37963 [56:38:14<41:03:46,  9.87s/it]
 61%|██████    | 22982/37963 [56:38:22<38:30:37,  9.25s/it]
 61%|██████    | 22983/37963 [56:38:37<45:49:18, 11.01s/it]
 61%|██████    | 22984/37963 [56:38:45<41:44:30, 10.03s/it]
 61%|██████    | 22985/37963 [56:38:53<38:58:18,  9.37s/it]
 61%|██████    | 22986/37963 [56:39:01<37:20:38,  8.98s/it]
 61%|██████    | 22987/37963 [56:39:09<35:48:12,  8.61s/it]
 61%|██████    | 22988/37963 [56:39:24<43:29:30, 10.46s/it]
 61%|██████    | 22989/37963 [56:39:38<48:34:08, 11.68s/it]
 61%|██████    | 22990/37963 [56:39:46<43:52:52, 10.55s/it]
                                                           
{'loss': '0.126', 'grad_norm': '1.671', 'learning_rate': '7.109e-06', 'epoch': '0.6056'}
+
 61%|██████    | 22990/37963 [56:39:46<43:52:52, 10.55s/it]
 61%|██████    | 22991/37963 [56:39:54<40:29:24,  9.74s/it]
 61%|██████    | 22992/37963 [56:40:02<37:59:09,  9.13s/it]
 61%|██████    | 22993/37963 [56:40:09<36:23:27,  8.75s/it]
 61%|██████    | 22994/37963 [56:40:17<35:15:02,  8.48s/it]
 61%|██████    | 22995/37963 [56:40:25<33:57:01,  8.17s/it]
 61%|██████    | 22996/37963 [56:40:39<42:09:07, 10.14s/it]
 61%|██████    | 22997/37963 [56:40:48<39:42:04,  9.55s/it]
 61%|██████    | 22998/37963 [56:40:55<37:26:47,  9.01s/it]
 61%|██████    | 22999/37963 [56:41:03<35:58:02,  8.65s/it]
 61%|██████    | 23000/37963 [56:41:11<34:42:38,  8.35s/it]
                                                           
{'loss': '0.1304', 'grad_norm': '1.388', 'learning_rate': '7.101e-06', 'epoch': '0.6059'}
+
 61%|██████    | 23000/37963 [56:41:11<34:42:38,  8.35s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.03s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.03s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 61%|██████    | 23001/37963 [56:42:10<97:51:40, 23.55s/it]
 61%|██████    | 23002/37963 [56:42:18<78:29:12, 18.89s/it]
 61%|██████    | 23003/37963 [56:42:40<82:00:55, 19.74s/it]
 61%|██████    | 23004/37963 [56:42:47<67:13:13, 16.18s/it]
 61%|██████    | 23005/37963 [56:42:55<56:46:50, 13.67s/it]
 61%|██████    | 23006/37963 [56:43:03<49:22:15, 11.88s/it]
 61%|██████    | 23007/37963 [56:43:11<44:06:59, 10.62s/it]
 61%|██████    | 23008/37963 [56:43:18<40:37:03,  9.78s/it]
 61%|██████    | 23009/37963 [56:43:26<37:52:23,  9.12s/it]
 61%|██████    | 23010/37963 [56:43:41<45:28:29, 10.95s/it]
                                                           
{'loss': '0.1368', 'grad_norm': '1.427', 'learning_rate': '7.092e-06', 'epoch': '0.6061'}
+
 61%|██████    | 23010/37963 [56:43:41<45:28:29, 10.95s/it]
 61%|██████    | 23011/37963 [56:43:50<42:08:43, 10.15s/it]
 61%|██████    | 23012/37963 [56:43:58<39:29:07,  9.51s/it]
 61%|██████    | 23013/37963 [56:44:05<37:21:50,  9.00s/it]
 61%|██████    | 23014/37963 [56:44:13<36:00:00,  8.67s/it]
 61%|██████    | 23015/37963 [56:44:21<35:09:51,  8.47s/it]
 61%|██████    | 23016/37963 [56:44:29<34:10:19,  8.23s/it]
 61%|██████    | 23017/37963 [56:44:37<33:38:36,  8.10s/it]
 61%|██████    | 23018/37963 [56:44:45<33:15:38,  8.01s/it]
 61%|██████    | 23019/37963 [56:44:52<33:00:24,  7.95s/it]
 61%|██████    | 23020/37963 [56:45:00<32:41:37,  7.88s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '2.717', 'learning_rate': '7.084e-06', 'epoch': '0.6064'}
+
 61%|██████    | 23020/37963 [56:45:00<32:41:37,  7.88s/it]
 61%|██████    | 23021/37963 [56:45:08<32:14:10,  7.77s/it]
 61%|██████    | 23022/37963 [56:45:15<32:10:37,  7.75s/it]
 61%|██████    | 23023/37963 [56:45:23<32:11:14,  7.76s/it]
 61%|██████    | 23024/37963 [56:45:31<32:10:10,  7.75s/it]
 61%|██████    | 23025/37963 [56:45:38<32:04:35,  7.73s/it]
 61%|██████    | 23026/37963 [56:45:46<32:24:22,  7.81s/it]
 61%|██████    | 23027/37963 [56:45:54<32:21:26,  7.80s/it]
 61%|██████    | 23028/37963 [56:46:02<32:21:23,  7.80s/it]
 61%|██████    | 23029/37963 [56:46:10<32:19:31,  7.79s/it]
 61%|██████    | 23030/37963 [56:46:25<41:44:26, 10.06s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '1.573', 'learning_rate': '7.076e-06', 'epoch': '0.6066'}
+
 61%|██████    | 23030/37963 [56:46:25<41:44:26, 10.06s/it]
 61%|██████    | 23031/37963 [56:46:33<39:03:19,  9.42s/it]
 61%|██████    | 23032/37963 [56:46:41<36:45:55,  8.86s/it]
 61%|██████    | 23033/37963 [56:46:56<44:28:14, 10.72s/it]
 61%|██████    | 23034/37963 [56:47:04<40:52:18,  9.86s/it]
 61%|██████    | 23035/37963 [56:47:18<46:27:52, 11.21s/it]
 61%|██████    | 23036/37963 [56:47:26<42:36:21, 10.28s/it]
 61%|██████    | 23037/37963 [56:47:34<39:25:45,  9.51s/it]
 61%|██████    | 23038/37963 [56:47:48<45:31:22, 10.98s/it]
 61%|██████    | 23039/37963 [56:47:56<42:01:45, 10.14s/it]
 61%|██████    | 23040/37963 [56:48:11<48:16:18, 11.65s/it]
                                                           
{'loss': '0.1356', 'grad_norm': '2.347', 'learning_rate': '7.068e-06', 'epoch': '0.6069'}
+
 61%|██████    | 23040/37963 [56:48:12<48:16:18, 11.65s/it]
 61%|██████    | 23041/37963 [56:48:19<43:44:23, 10.55s/it]
 61%|██████    | 23042/37963 [56:48:27<40:17:04,  9.72s/it]
 61%|██████    | 23043/37963 [56:48:35<37:57:38,  9.16s/it]
 61%|██████    | 23044/37963 [56:48:43<36:26:47,  8.79s/it]
 61%|██████    | 23045/37963 [56:48:51<35:01:06,  8.45s/it]
 61%|██████    | 23046/37963 [56:48:59<34:14:09,  8.26s/it]
 61%|██████    | 23047/37963 [56:49:13<42:05:10, 10.16s/it]
 61%|██████    | 23048/37963 [56:49:21<39:13:06,  9.47s/it]
 61%|██████    | 23049/37963 [56:49:29<37:10:03,  8.97s/it]
 61%|██████    | 23050/37963 [56:49:37<35:39:08,  8.61s/it]
                                                           
{'loss': '0.1458', 'grad_norm': '4.378', 'learning_rate': '7.06e-06', 'epoch': '0.6072'}
+
 61%|██████    | 23050/37963 [56:49:37<35:39:08,  8.61s/it]
 61%|██████    | 23051/37963 [56:49:44<34:25:38,  8.31s/it]
 61%|██████    | 23052/37963 [56:49:52<33:45:16,  8.15s/it]
 61%|██████    | 23053/37963 [56:50:00<33:13:10,  8.02s/it]
 61%|██████    | 23054/37963 [56:50:07<32:39:20,  7.89s/it]
 61%|██████    | 23055/37963 [56:50:22<41:05:52,  9.92s/it]
 61%|██████    | 23056/37963 [56:50:30<38:39:17,  9.34s/it]
 61%|██████    | 23057/37963 [56:50:45<45:35:26, 11.01s/it]
 61%|██████    | 23058/37963 [56:50:52<41:28:03, 10.02s/it]
 61%|██████    | 23059/37963 [56:51:00<38:31:07,  9.30s/it]
 61%|██████    | 23060/37963 [56:51:08<36:39:44,  8.86s/it]
                                                           
{'loss': '0.1364', 'grad_norm': '1.684', 'learning_rate': '7.052e-06', 'epoch': '0.6074'}
+
 61%|██████    | 23060/37963 [56:51:08<36:39:44,  8.86s/it]
 61%|██████    | 23061/37963 [56:51:16<35:18:39,  8.53s/it]
 61%|██████    | 23062/37963 [56:51:24<34:24:20,  8.31s/it]
 61%|██████    | 23063/37963 [56:51:31<33:55:01,  8.19s/it]
 61%|██████    | 23064/37963 [56:51:39<33:23:33,  8.07s/it]
 61%|██████    | 23065/37963 [56:51:47<32:45:12,  7.91s/it]
 61%|██████    | 23066/37963 [56:51:55<32:32:15,  7.86s/it]
 61%|██████    | 23067/37963 [56:52:02<32:32:13,  7.86s/it]
 61%|██████    | 23068/37963 [56:52:10<32:19:50,  7.81s/it]
 61%|██████    | 23069/37963 [56:52:17<31:46:18,  7.68s/it]
 61%|██████    | 23070/37963 [56:52:25<32:00:08,  7.74s/it]
                                                           
{'loss': '0.1272', 'grad_norm': '1.343', 'learning_rate': '7.044e-06', 'epoch': '0.6077'}
+
 61%|██████    | 23070/37963 [56:52:25<32:00:08,  7.74s/it]
 61%|██████    | 23071/37963 [56:52:33<32:06:33,  7.76s/it]
 61%|██████    | 23072/37963 [56:52:41<31:46:42,  7.68s/it]
 61%|██████    | 23073/37963 [56:52:48<31:56:29,  7.72s/it]
 61%|██████    | 23074/37963 [56:52:56<32:08:01,  7.77s/it]
 61%|██████    | 23075/37963 [56:53:04<32:13:05,  7.79s/it]
 61%|██████    | 23076/37963 [56:53:12<32:21:11,  7.82s/it]
 61%|██████    | 23077/37963 [56:53:20<32:29:03,  7.86s/it]
 61%|██████    | 23078/37963 [56:53:28<32:22:40,  7.83s/it]
 61%|██████    | 23079/37963 [56:53:36<32:19:50,  7.82s/it]
 61%|██████    | 23080/37963 [56:53:43<32:13:16,  7.79s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '1.688', 'learning_rate': '7.035e-06', 'epoch': '0.608'}
+
 61%|██████    | 23080/37963 [56:53:43<32:13:16,  7.79s/it]
 61%|██████    | 23081/37963 [56:53:51<32:19:33,  7.82s/it]
 61%|██████    | 23082/37963 [56:53:59<32:03:48,  7.76s/it]
 61%|██████    | 23083/37963 [56:54:13<40:13:29,  9.73s/it]
 61%|██████    | 23084/37963 [56:54:21<38:24:41,  9.29s/it]
 61%|██████    | 23085/37963 [56:54:29<36:36:48,  8.86s/it]
 61%|██████    | 23086/37963 [56:54:37<35:16:29,  8.54s/it]
 61%|██████    | 23087/37963 [56:54:59<51:27:35, 12.45s/it]
 61%|██████    | 23088/37963 [56:55:13<54:13:08, 13.12s/it]
 61%|██████    | 23089/37963 [56:55:21<47:36:54, 11.52s/it]
 61%|██████    | 23090/37963 [56:55:29<42:58:31, 10.40s/it]
                                                           
{'loss': '0.1263', 'grad_norm': '2.594', 'learning_rate': '7.027e-06', 'epoch': '0.6082'}
+
 61%|██████    | 23090/37963 [56:55:29<42:58:31, 10.40s/it]
 61%|██████    | 23091/37963 [56:55:43<48:08:24, 11.65s/it]
 61%|██████    | 23092/37963 [56:55:51<43:33:51, 10.55s/it]
 61%|██████    | 23093/37963 [56:55:59<39:53:57,  9.66s/it]
 61%|██████    | 23094/37963 [56:56:07<37:16:15,  9.02s/it]
 61%|██████    | 23095/37963 [56:56:14<35:32:47,  8.61s/it]
 61%|██████    | 23096/37963 [56:56:22<34:39:28,  8.39s/it]
 61%|██████    | 23097/37963 [56:56:30<33:50:40,  8.20s/it]
 61%|██████    | 23098/37963 [56:56:37<33:03:53,  8.01s/it]
 61%|██████    | 23099/37963 [56:56:45<32:42:40,  7.92s/it]
 61%|██████    | 23100/37963 [56:56:53<32:14:34,  7.81s/it]
                                                           
{'loss': '0.1387', 'grad_norm': '1.898', 'learning_rate': '7.019e-06', 'epoch': '0.6085'}
+
 61%|██████    | 23100/37963 [56:56:53<32:14:34,  7.81s/it]
 61%|██████    | 23101/37963 [56:57:00<32:09:26,  7.79s/it]
 61%|██████    | 23102/37963 [56:57:08<32:11:18,  7.80s/it]
 61%|██████    | 23103/37963 [56:57:16<32:09:27,  7.79s/it]
 61%|██████    | 23104/37963 [56:57:24<32:10:12,  7.79s/it]
 61%|██████    | 23105/37963 [56:57:39<40:50:55,  9.90s/it]
 61%|██████    | 23106/37963 [56:57:46<38:23:22,  9.30s/it]
 61%|██████    | 23107/37963 [56:57:54<36:35:46,  8.87s/it]
 61%|██████    | 23108/37963 [56:58:02<35:17:34,  8.55s/it]
 61%|██████    | 23109/37963 [56:58:18<43:53:30, 10.64s/it]
 61%|██████    | 23110/37963 [56:58:26<40:29:28,  9.81s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '1.248', 'learning_rate': '7.011e-06', 'epoch': '0.6088'}
+
 61%|██████    | 23110/37963 [56:58:26<40:29:28,  9.81s/it]
 61%|██████    | 23111/37963 [56:58:33<37:46:10,  9.16s/it]
 61%|██████    | 23112/37963 [56:58:41<36:06:41,  8.75s/it]
 61%|██████    | 23113/37963 [56:58:49<34:57:55,  8.48s/it]
 61%|██████    | 23114/37963 [56:58:57<34:02:16,  8.25s/it]
 61%|██████    | 23115/37963 [56:59:04<33:34:50,  8.14s/it]
 61%|██████    | 23116/37963 [56:59:12<32:50:22,  7.96s/it]
 61%|██████    | 23117/37963 [56:59:20<32:26:20,  7.87s/it]
 61%|██████    | 23118/37963 [56:59:27<32:12:17,  7.81s/it]
 61%|██████    | 23119/37963 [56:59:35<32:18:08,  7.83s/it]
 61%|██████    | 23120/37963 [56:59:43<32:11:28,  7.81s/it]
                                                           
{'loss': '0.1269', 'grad_norm': '1.191', 'learning_rate': '7.003e-06', 'epoch': '0.609'}
+
 61%|██████    | 23120/37963 [56:59:43<32:11:28,  7.81s/it]
 61%|██████    | 23121/37963 [56:59:51<32:10:32,  7.80s/it]
 61%|██████    | 23122/37963 [56:59:59<32:20:40,  7.85s/it]
 61%|██████    | 23123/37963 [57:00:07<32:23:09,  7.86s/it]
 61%|██████    | 23124/37963 [57:00:15<32:31:53,  7.89s/it]
 61%|██████    | 23125/37963 [57:00:22<32:20:15,  7.85s/it]
 61%|██████    | 23126/37963 [57:00:30<32:14:58,  7.82s/it]
 61%|██████    | 23127/37963 [57:00:38<32:12:32,  7.82s/it]
 61%|██████    | 23128/37963 [57:00:53<41:06:06,  9.97s/it]
 61%|██████    | 23129/37963 [57:01:01<38:15:51,  9.29s/it]
 61%|██████    | 23130/37963 [57:01:08<36:24:22,  8.84s/it]
                                                           
{'loss': '0.1345', 'grad_norm': '1.632', 'learning_rate': '6.995e-06', 'epoch': '0.6093'}
+
 61%|██████    | 23130/37963 [57:01:08<36:24:22,  8.84s/it]
 61%|██████    | 23131/37963 [57:01:23<44:06:35, 10.71s/it]
 61%|██████    | 23132/37963 [57:01:31<40:46:40,  9.90s/it]
 61%|██████    | 23133/37963 [57:01:39<38:04:11,  9.24s/it]
 61%|██████    | 23134/37963 [57:01:47<36:27:09,  8.85s/it]
 61%|██████    | 23135/37963 [57:01:55<35:03:55,  8.51s/it]
 61%|██████    | 23136/37963 [57:02:09<42:36:14, 10.34s/it]
 61%|██████    | 23137/37963 [57:02:17<39:11:13,  9.52s/it]
 61%|██████    | 23138/37963 [57:02:25<37:03:51,  9.00s/it]
 61%|██████    | 23139/37963 [57:02:39<43:46:22, 10.63s/it]
 61%|██████    | 23140/37963 [57:02:47<40:29:09,  9.83s/it]
                                                           
{'loss': '0.1349', 'grad_norm': '2.339', 'learning_rate': '6.987e-06', 'epoch': '0.6095'}
+
 61%|██████    | 23140/37963 [57:02:47<40:29:09,  9.83s/it]
 61%|██████    | 23141/37963 [57:03:02<46:57:13, 11.40s/it]
 61%|██████    | 23142/37963 [57:03:17<51:28:12, 12.50s/it]
 61%|██████    | 23143/37963 [57:03:25<46:04:33, 11.19s/it]
 61%|██████    | 23144/37963 [57:03:33<41:51:42, 10.17s/it]
 61%|██████    | 23145/37963 [57:03:41<38:53:25,  9.45s/it]
 61%|██████    | 23146/37963 [57:03:49<36:46:37,  8.94s/it]
 61%|██████    | 23147/37963 [57:03:57<35:22:43,  8.60s/it]
 61%|██████    | 23148/37963 [57:04:04<34:25:04,  8.36s/it]
 61%|██████    | 23149/37963 [57:04:12<33:59:39,  8.26s/it]
 61%|██████    | 23150/37963 [57:04:20<33:25:13,  8.12s/it]
                                                           
{'loss': '0.153', 'grad_norm': '1.891', 'learning_rate': '6.978e-06', 'epoch': '0.6098'}
+
 61%|██████    | 23150/37963 [57:04:20<33:25:13,  8.12s/it]
 61%|██████    | 23151/37963 [57:04:28<33:04:51,  8.04s/it]
 61%|██████    | 23152/37963 [57:04:36<32:51:19,  7.99s/it]
 61%|██████    | 23153/37963 [57:04:58<49:53:48, 12.13s/it]
 61%|██████    | 23154/37963 [57:05:06<44:42:42, 10.87s/it]
 61%|██████    | 23155/37963 [57:05:13<40:31:01,  9.85s/it]
 61%|██████    | 23156/37963 [57:05:21<37:57:00,  9.23s/it]
 61%|██████    | 23157/37963 [57:05:29<36:11:42,  8.80s/it]
 61%|██████    | 23158/37963 [57:05:36<34:25:05,  8.37s/it]
 61%|██████    | 23159/37963 [57:05:44<33:46:44,  8.21s/it]
 61%|██████    | 23160/37963 [57:05:51<32:56:01,  8.01s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '3.05', 'learning_rate': '6.97e-06', 'epoch': '0.6101'}
+
 61%|██████    | 23160/37963 [57:05:51<32:56:01,  8.01s/it]
 61%|██████    | 23161/37963 [57:05:59<32:35:38,  7.93s/it]
 61%|██████    | 23162/37963 [57:06:07<32:27:18,  7.89s/it]
 61%|██████    | 23163/37963 [57:06:15<32:25:48,  7.89s/it]
 61%|██████    | 23164/37963 [57:06:23<32:39:46,  7.95s/it]
 61%|██████    | 23165/37963 [57:06:31<32:22:53,  7.88s/it]
 61%|██████    | 23166/37963 [57:06:38<32:09:36,  7.82s/it]
 61%|██████    | 23167/37963 [57:06:46<32:08:32,  7.82s/it]
 61%|██████    | 23168/37963 [57:06:54<31:54:41,  7.76s/it]
 61%|██████    | 23169/37963 [57:07:02<31:51:48,  7.75s/it]
 61%|██████    | 23170/37963 [57:07:09<31:26:33,  7.65s/it]
                                                           
{'loss': '0.1269', 'grad_norm': '1.026', 'learning_rate': '6.962e-06', 'epoch': '0.6103'}
+
 61%|██████    | 23170/37963 [57:07:09<31:26:33,  7.65s/it]
 61%|██████    | 23171/37963 [57:07:17<31:34:04,  7.68s/it]
 61%|██████    | 23172/37963 [57:07:31<40:10:07,  9.78s/it]
 61%|██████    | 23173/37963 [57:07:39<37:48:22,  9.20s/it]
 61%|██████    | 23174/37963 [57:07:47<36:06:10,  8.79s/it]
 61%|██████    | 23175/37963 [57:08:02<43:19:27, 10.55s/it]
 61%|██████    | 23176/37963 [57:08:09<39:35:24,  9.64s/it]
 61%|██████    | 23177/37963 [57:08:17<37:17:38,  9.08s/it]
 61%|██████    | 23178/37963 [57:08:25<35:39:57,  8.68s/it]
 61%|██████    | 23179/37963 [57:08:32<34:24:46,  8.38s/it]
 61%|██████    | 23180/37963 [57:08:40<33:34:49,  8.18s/it]
                                                           
{'loss': '0.1363', 'grad_norm': '1.73', 'learning_rate': '6.954e-06', 'epoch': '0.6106'}
+
 61%|██████    | 23180/37963 [57:08:40<33:34:49,  8.18s/it]
 61%|██████    | 23181/37963 [57:08:48<33:26:25,  8.14s/it]
 61%|██████    | 23182/37963 [57:08:56<32:49:55,  8.00s/it]
 61%|██████    | 23183/37963 [57:09:04<32:28:57,  7.91s/it]
 61%|██████    | 23184/37963 [57:09:11<32:19:10,  7.87s/it]
 61%|██████    | 23185/37963 [57:09:19<32:23:59,  7.89s/it]
 61%|██████    | 23186/37963 [57:09:27<32:12:09,  7.85s/it]
 61%|██████    | 23187/37963 [57:09:43<41:43:33, 10.17s/it]
 61%|██████    | 23188/37963 [57:09:50<38:49:27,  9.46s/it]
 61%|██████    | 23189/37963 [57:10:05<45:13:22, 11.02s/it]
 61%|██████    | 23190/37963 [57:10:13<41:38:21, 10.15s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '1.528', 'learning_rate': '6.946e-06', 'epoch': '0.6109'}
+
 61%|██████    | 23190/37963 [57:10:13<41:38:21, 10.15s/it]
 61%|██████    | 23191/37963 [57:10:21<38:52:24,  9.47s/it]
 61%|██████    | 23192/37963 [57:10:36<45:22:57, 11.06s/it]
 61%|██████    | 23193/37963 [57:10:44<41:30:56, 10.12s/it]
 61%|██████    | 23194/37963 [57:10:52<38:41:20,  9.43s/it]
 61%|██████    | 23195/37963 [57:11:07<45:36:34, 11.12s/it]
 61%|██████    | 23196/37963 [57:11:15<42:07:17, 10.27s/it]
 61%|██████    | 23197/37963 [57:11:23<38:53:21,  9.48s/it]
 61%|██████    | 23198/37963 [57:11:30<36:36:26,  8.93s/it]
 61%|██████    | 23199/37963 [57:11:38<35:05:01,  8.55s/it]
 61%|██████    | 23200/37963 [57:11:46<34:04:47,  8.31s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '1.014', 'learning_rate': '6.938e-06', 'epoch': '0.6111'}
+
 61%|██████    | 23200/37963 [57:11:46<34:04:47,  8.31s/it]
 61%|██████    | 23201/37963 [57:12:00<41:28:42, 10.12s/it]
 61%|██████    | 23202/37963 [57:12:08<38:38:11,  9.42s/it]
 61%|██████    | 23203/37963 [57:12:16<36:37:52,  8.93s/it]
 61%|██████    | 23204/37963 [57:12:23<35:15:44,  8.60s/it]
 61%|██████    | 23205/37963 [57:12:31<34:38:19,  8.45s/it]
 61%|██████    | 23206/37963 [57:12:39<33:50:55,  8.26s/it]
 61%|██████    | 23207/37963 [57:12:55<42:40:21, 10.41s/it]
 61%|██████    | 23208/37963 [57:13:02<39:02:41,  9.53s/it]
 61%|██████    | 23209/37963 [57:13:10<36:52:43,  9.00s/it]
 61%|██████    | 23210/37963 [57:13:18<35:20:52,  8.63s/it]
                                                           
{'loss': '0.1348', 'grad_norm': '2.228', 'learning_rate': '6.93e-06', 'epoch': '0.6114'}
+
 61%|██████    | 23210/37963 [57:13:18<35:20:52,  8.63s/it]
 61%|██████    | 23211/37963 [57:13:25<34:16:41,  8.37s/it]
 61%|██████    | 23212/37963 [57:13:33<33:32:53,  8.19s/it]
 61%|██████    | 23213/37963 [57:13:41<32:56:11,  8.04s/it]
 61%|██████    | 23214/37963 [57:13:49<32:25:53,  7.92s/it]
 61%|██████    | 23215/37963 [57:13:56<32:14:43,  7.87s/it]
 61%|██████    | 23216/37963 [57:14:04<31:53:53,  7.79s/it]
 61%|██████    | 23217/37963 [57:14:12<31:57:36,  7.80s/it]
 61%|██████    | 23218/37963 [57:14:20<31:57:45,  7.80s/it]
 61%|██████    | 23219/37963 [57:14:27<31:52:45,  7.78s/it]
 61%|██████    | 23220/37963 [57:14:42<40:38:17,  9.92s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '2.238', 'learning_rate': '6.922e-06', 'epoch': '0.6117'}
+
 61%|██████    | 23220/37963 [57:14:42<40:38:17,  9.92s/it]
 61%|██████    | 23221/37963 [57:14:50<38:16:23,  9.35s/it]
 61%|██████    | 23222/37963 [57:14:58<36:21:39,  8.88s/it]
 61%|██████    | 23223/37963 [57:15:06<35:00:55,  8.55s/it]
 61%|██████    | 23224/37963 [57:15:13<33:54:36,  8.28s/it]
 61%|██████    | 23225/37963 [57:15:21<33:28:40,  8.18s/it]
 61%|██████    | 23226/37963 [57:15:29<33:00:36,  8.06s/it]
 61%|██████    | 23227/37963 [57:15:44<41:07:13, 10.05s/it]
 61%|██████    | 23228/37963 [57:15:52<38:31:43,  9.41s/it]
 61%|██████    | 23229/37963 [57:16:00<36:38:28,  8.95s/it]
 61%|██████    | 23230/37963 [57:16:07<35:03:06,  8.56s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '2.173', 'learning_rate': '6.913e-06', 'epoch': '0.6119'}
+
 61%|██████    | 23230/37963 [57:16:07<35:03:06,  8.56s/it]
 61%|██████    | 23231/37963 [57:16:15<34:09:23,  8.35s/it]
 61%|██████    | 23232/37963 [57:16:23<33:28:37,  8.18s/it]
 61%|██████    | 23233/37963 [57:16:31<33:02:31,  8.08s/it]
 61%|██████    | 23234/37963 [57:16:46<41:18:55, 10.10s/it]
 61%|██████    | 23235/37963 [57:16:53<38:31:02,  9.41s/it]
 61%|██████    | 23236/37963 [57:17:01<36:33:02,  8.93s/it]
 61%|██████    | 23237/37963 [57:17:09<35:06:50,  8.58s/it]
 61%|██████    | 23238/37963 [57:17:24<42:30:24, 10.39s/it]
 61%|██████    | 23239/37963 [57:17:32<39:54:37,  9.76s/it]
 61%|██████    | 23240/37963 [57:17:47<46:05:13, 11.27s/it]
                                                           
{'loss': '0.1415', 'grad_norm': '1.93', 'learning_rate': '6.905e-06', 'epoch': '0.6122'}
+
 61%|██████    | 23240/37963 [57:17:47<46:05:13, 11.27s/it]
 61%|██████    | 23241/37963 [57:18:02<50:40:33, 12.39s/it]
 61%|██████    | 23242/37963 [57:18:10<45:46:46, 11.20s/it]
 61%|██████    | 23243/37963 [57:18:18<41:37:00, 10.18s/it]
 61%|██████    | 23244/37963 [57:18:26<38:56:00,  9.52s/it]
 61%|██████    | 23245/37963 [57:18:34<36:46:38,  9.00s/it]
 61%|██████    | 23246/37963 [57:18:42<35:23:23,  8.66s/it]
 61%|██████    | 23247/37963 [57:18:49<34:19:38,  8.40s/it]
 61%|██████    | 23248/37963 [57:18:57<33:32:52,  8.21s/it]
 61%|██████    | 23249/37963 [57:19:05<33:08:21,  8.11s/it]
 61%|██████    | 23250/37963 [57:19:12<32:21:06,  7.92s/it]
                                                           
{'loss': '0.1296', 'grad_norm': '3.016', 'learning_rate': '6.897e-06', 'epoch': '0.6124'}
+
 61%|██████    | 23250/37963 [57:19:12<32:21:06,  7.92s/it]
 61%|██████    | 23251/37963 [57:19:20<32:08:37,  7.87s/it]
 61%|██████    | 23252/37963 [57:19:28<32:00:15,  7.83s/it]
 61%|██████▏   | 23253/37963 [57:19:50<49:20:08, 12.07s/it]
 61%|██████▏   | 23254/37963 [57:19:58<44:12:33, 10.82s/it]
 61%|██████▏   | 23255/37963 [57:20:06<40:31:31,  9.92s/it]
 61%|██████▏   | 23256/37963 [57:20:13<37:48:54,  9.26s/it]
 61%|██████▏   | 23257/37963 [57:20:21<35:57:17,  8.80s/it]
 61%|██████▏   | 23258/37963 [57:20:29<34:28:14,  8.44s/it]
 61%|██████▏   | 23259/37963 [57:20:36<33:39:10,  8.24s/it]
 61%|██████▏   | 23260/37963 [57:20:44<32:58:04,  8.07s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '1.372', 'learning_rate': '6.889e-06', 'epoch': '0.6127'}
+
 61%|██████▏   | 23260/37963 [57:20:44<32:58:04,  8.07s/it]
 61%|██████▏   | 23261/37963 [57:20:52<32:32:29,  7.97s/it]
 61%|██████▏   | 23262/37963 [57:20:59<32:05:24,  7.86s/it]
 61%|██████▏   | 23263/37963 [57:21:07<31:58:19,  7.83s/it]
 61%|██████▏   | 23264/37963 [57:21:15<31:56:37,  7.82s/it]
 61%|██████▏   | 23265/37963 [57:21:23<31:53:17,  7.81s/it]
 61%|██████▏   | 23266/37963 [57:21:30<31:24:25,  7.69s/it]
 61%|██████▏   | 23267/37963 [57:21:38<31:15:34,  7.66s/it]
 61%|██████▏   | 23268/37963 [57:21:46<31:32:15,  7.73s/it]
 61%|██████▏   | 23269/37963 [57:22:01<40:14:11,  9.86s/it]
 61%|██████▏   | 23270/37963 [57:22:08<37:44:16,  9.25s/it]
                                                           
{'loss': '0.1362', 'grad_norm': '1.144', 'learning_rate': '6.881e-06', 'epoch': '0.613'}
+
 61%|██████▏   | 23270/37963 [57:22:08<37:44:16,  9.25s/it]
 61%|██████▏   | 23271/37963 [57:22:23<44:35:49, 10.93s/it]
 61%|██████▏   | 23272/37963 [57:22:31<40:26:07,  9.91s/it]
 61%|██████▏   | 23273/37963 [57:22:38<37:45:06,  9.25s/it]
 61%|██████▏   | 23274/37963 [57:22:46<35:52:58,  8.79s/it]
 61%|██████▏   | 23275/37963 [57:22:54<34:47:37,  8.53s/it]
 61%|██████▏   | 23276/37963 [57:23:02<33:49:41,  8.29s/it]
 61%|██████▏   | 23277/37963 [57:23:09<33:05:43,  8.11s/it]
 61%|██████▏   | 23278/37963 [57:23:17<32:50:59,  8.05s/it]
 61%|██████▏   | 23279/37963 [57:23:25<32:40:44,  8.01s/it]
 61%|██████▏   | 23280/37963 [57:23:33<32:12:17,  7.90s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '1.932', 'learning_rate': '6.873e-06', 'epoch': '0.6132'}
+
 61%|██████▏   | 23280/37963 [57:23:33<32:12:17,  7.90s/it]
 61%|██████▏   | 23281/37963 [57:23:41<32:01:55,  7.85s/it]
 61%|██████▏   | 23282/37963 [57:23:56<40:38:02,  9.96s/it]
 61%|██████▏   | 23283/37963 [57:24:04<38:11:07,  9.36s/it]
 61%|██████▏   | 23284/37963 [57:24:11<36:09:51,  8.87s/it]
 61%|██████▏   | 23285/37963 [57:24:19<34:50:55,  8.55s/it]
 61%|██████▏   | 23286/37963 [57:24:34<42:23:58, 10.40s/it]
 61%|██████▏   | 23287/37963 [57:24:41<39:02:26,  9.58s/it]
 61%|██████▏   | 23288/37963 [57:24:56<45:36:56, 11.19s/it]
 61%|██████▏   | 23289/37963 [57:25:04<41:20:01, 10.14s/it]
 61%|██████▏   | 23290/37963 [57:25:12<38:20:43,  9.41s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '1.972', 'learning_rate': '6.865e-06', 'epoch': '0.6135'}
+
 61%|██████▏   | 23290/37963 [57:25:12<38:20:43,  9.41s/it]
 61%|██████▏   | 23291/37963 [57:25:20<36:18:08,  8.91s/it]
 61%|██████▏   | 23292/37963 [57:25:27<35:07:38,  8.62s/it]
 61%|██████▏   | 23293/37963 [57:25:35<33:58:47,  8.34s/it]
 61%|██████▏   | 23294/37963 [57:25:50<41:53:03, 10.28s/it]
 61%|██████▏   | 23295/37963 [57:25:58<38:59:01,  9.57s/it]
 61%|██████▏   | 23296/37963 [57:26:06<36:50:46,  9.04s/it]
 61%|██████▏   | 23297/37963 [57:26:13<35:06:32,  8.62s/it]
 61%|██████▏   | 23298/37963 [57:26:21<34:07:37,  8.38s/it]
 61%|██████▏   | 23299/37963 [57:26:29<33:25:51,  8.21s/it]
 61%|██████▏   | 23300/37963 [57:26:37<32:58:31,  8.10s/it]
                                                           
{'loss': '0.1439', 'grad_norm': '1.614', 'learning_rate': '6.857e-06', 'epoch': '0.6138'}
+
 61%|██████▏   | 23300/37963 [57:26:37<32:58:31,  8.10s/it]
 61%|██████▏   | 23301/37963 [57:26:52<41:39:24, 10.23s/it]
 61%|██████▏   | 23302/37963 [57:27:00<38:41:43,  9.50s/it]
 61%|██████▏   | 23303/37963 [57:27:08<36:46:02,  9.03s/it]
 61%|██████▏   | 23304/37963 [57:27:15<35:08:27,  8.63s/it]
 61%|██████▏   | 23305/37963 [57:27:23<34:07:56,  8.38s/it]
 61%|██████▏   | 23306/37963 [57:27:37<41:09:15, 10.11s/it]
 61%|██████▏   | 23307/37963 [57:27:45<38:38:40,  9.49s/it]
 61%|██████▏   | 23308/37963 [57:27:53<36:33:02,  8.98s/it]
 61%|██████▏   | 23309/37963 [57:28:01<35:06:47,  8.63s/it]
 61%|██████▏   | 23310/37963 [57:28:09<34:14:21,  8.41s/it]
                                                           
{'loss': '0.1273', 'grad_norm': '1.602', 'learning_rate': '6.849e-06', 'epoch': '0.614'}
+
 61%|██████▏   | 23310/37963 [57:28:09<34:14:21,  8.41s/it]
 61%|██████▏   | 23311/37963 [57:28:17<33:39:43,  8.27s/it]
 61%|██████▏   | 23312/37963 [57:28:25<33:08:49,  8.14s/it]
 61%|██████▏   | 23313/37963 [57:28:32<32:37:14,  8.02s/it]
 61%|██████▏   | 23314/37963 [57:28:47<40:28:30,  9.95s/it]
 61%|██████▏   | 23315/37963 [57:28:55<38:26:46,  9.45s/it]
 61%|██████▏   | 23316/37963 [57:29:03<36:15:39,  8.91s/it]
 61%|██████▏   | 23317/37963 [57:29:11<34:45:51,  8.55s/it]
 61%|██████▏   | 23318/37963 [57:29:25<42:34:43, 10.47s/it]
 61%|██████▏   | 23319/37963 [57:29:33<39:21:25,  9.68s/it]
 61%|██████▏   | 23320/37963 [57:29:41<37:18:08,  9.17s/it]
                                                           
{'loss': '0.128', 'grad_norm': '1.051', 'learning_rate': '6.84e-06', 'epoch': '0.6143'}
+
 61%|██████▏   | 23320/37963 [57:29:41<37:18:08,  9.17s/it]
 61%|██████▏   | 23321/37963 [57:29:49<35:49:09,  8.81s/it]
 61%|██████▏   | 23322/37963 [57:29:57<34:27:39,  8.47s/it]
 61%|██████▏   | 23323/37963 [57:30:05<33:29:02,  8.23s/it]
 61%|██████▏   | 23324/37963 [57:30:12<32:53:53,  8.09s/it]
 61%|██████▏   | 23325/37963 [57:30:20<32:35:26,  8.02s/it]
 61%|██████▏   | 23326/37963 [57:30:28<32:28:09,  7.99s/it]
 61%|██████▏   | 23327/37963 [57:30:36<32:00:25,  7.87s/it]
 61%|██████▏   | 23328/37963 [57:30:44<32:03:28,  7.89s/it]
 61%|██████▏   | 23329/37963 [57:30:51<31:53:46,  7.85s/it]
 61%|██████▏   | 23330/37963 [57:30:59<31:50:04,  7.83s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '2.24', 'learning_rate': '6.832e-06', 'epoch': '0.6145'}
+
 61%|██████▏   | 23330/37963 [57:30:59<31:50:04,  7.83s/it]
 61%|██████▏   | 23331/37963 [57:31:14<40:28:00,  9.96s/it]
 61%|██████▏   | 23332/37963 [57:31:29<46:37:31, 11.47s/it]
 61%|██████▏   | 23333/37963 [57:31:37<42:20:26, 10.42s/it]
 61%|██████▏   | 23334/37963 [57:31:45<39:14:50,  9.66s/it]
 61%|██████▏   | 23335/37963 [57:31:53<36:45:19,  9.05s/it]
 61%|██████▏   | 23336/37963 [57:32:00<34:52:49,  8.58s/it]
 61%|██████▏   | 23337/37963 [57:32:08<33:50:17,  8.33s/it]
 61%|██████▏   | 23338/37963 [57:32:16<33:08:00,  8.16s/it]
 61%|██████▏   | 23339/37963 [57:32:23<32:37:50,  8.03s/it]
 61%|██████▏   | 23340/37963 [57:32:39<41:22:42, 10.19s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '2.04', 'learning_rate': '6.824e-06', 'epoch': '0.6148'}
+
 61%|██████▏   | 23340/37963 [57:32:39<41:22:42, 10.19s/it]
 61%|██████▏   | 23341/37963 [57:32:47<38:40:59,  9.52s/it]
 61%|██████▏   | 23342/37963 [57:32:54<36:27:20,  8.98s/it]
 61%|██████▏   | 23343/37963 [57:33:02<35:03:30,  8.63s/it]
 61%|██████▏   | 23344/37963 [57:33:10<33:57:21,  8.36s/it]
 61%|██████▏   | 23345/37963 [57:33:18<33:16:23,  8.19s/it]
 61%|██████▏   | 23346/37963 [57:33:25<32:41:23,  8.05s/it]
 61%|██████▏   | 23347/37963 [57:33:40<40:49:10, 10.05s/it]
 62%|██████▏   | 23348/37963 [57:33:48<38:09:37,  9.40s/it]
 62%|██████▏   | 23349/37963 [57:33:56<36:02:33,  8.88s/it]
 62%|██████▏   | 23350/37963 [57:34:03<34:35:44,  8.52s/it]
                                                           
{'loss': '0.143', 'grad_norm': '2.426', 'learning_rate': '6.816e-06', 'epoch': '0.6151'}
+
 62%|██████▏   | 23350/37963 [57:34:03<34:35:44,  8.52s/it]
 62%|██████▏   | 23351/37963 [57:34:11<33:15:52,  8.20s/it]
 62%|██████▏   | 23352/37963 [57:34:18<32:48:12,  8.08s/it]
 62%|██████▏   | 23353/37963 [57:34:26<32:10:24,  7.93s/it]
 62%|██████▏   | 23354/37963 [57:34:41<40:06:12,  9.88s/it]
 62%|██████▏   | 23355/37963 [57:34:56<47:03:24, 11.60s/it]
 62%|██████▏   | 23356/37963 [57:35:04<42:43:18, 10.53s/it]
 62%|██████▏   | 23357/37963 [57:35:12<39:25:06,  9.72s/it]
 62%|██████▏   | 23358/37963 [57:35:20<37:25:20,  9.22s/it]
 62%|██████▏   | 23359/37963 [57:35:28<35:38:10,  8.78s/it]
 62%|██████▏   | 23360/37963 [57:35:36<34:22:53,  8.48s/it]
                                                           
{'loss': '0.1464', 'grad_norm': '4.139', 'learning_rate': '6.808e-06', 'epoch': '0.6153'}
+
 62%|██████▏   | 23360/37963 [57:35:36<34:22:53,  8.48s/it]
 62%|██████▏   | 23361/37963 [57:35:43<33:29:04,  8.26s/it]
 62%|██████▏   | 23362/37963 [57:35:51<32:55:13,  8.12s/it]
 62%|██████▏   | 23363/37963 [57:36:06<40:46:47, 10.06s/it]
 62%|██████▏   | 23364/37963 [57:36:13<37:57:36,  9.36s/it]
 62%|██████▏   | 23365/37963 [57:36:28<44:32:16, 10.98s/it]
 62%|██████▏   | 23366/37963 [57:36:36<41:02:38, 10.12s/it]
 62%|██████▏   | 23367/37963 [57:36:44<37:57:51,  9.36s/it]
 62%|██████▏   | 23368/37963 [57:36:52<35:53:39,  8.85s/it]
 62%|██████▏   | 23369/37963 [57:36:59<34:39:25,  8.55s/it]
 62%|██████▏   | 23370/37963 [57:37:07<33:39:03,  8.30s/it]
                                                           
{'loss': '0.1377', 'grad_norm': '1.409', 'learning_rate': '6.8e-06', 'epoch': '0.6156'}
+
 62%|██████▏   | 23370/37963 [57:37:07<33:39:03,  8.30s/it]
 62%|██████▏   | 23371/37963 [57:37:15<32:53:47,  8.12s/it]
 62%|██████▏   | 23372/37963 [57:37:23<32:40:05,  8.06s/it]
 62%|██████▏   | 23373/37963 [57:37:30<32:17:34,  7.97s/it]
 62%|██████▏   | 23374/37963 [57:37:38<32:11:23,  7.94s/it]
 62%|██████▏   | 23375/37963 [57:37:53<39:50:20,  9.83s/it]
 62%|██████▏   | 23376/37963 [57:38:00<37:18:48,  9.21s/it]
 62%|██████▏   | 23377/37963 [57:38:08<35:17:05,  8.71s/it]
 62%|██████▏   | 23378/37963 [57:38:15<33:55:12,  8.37s/it]
 62%|██████▏   | 23379/37963 [57:38:23<33:20:03,  8.23s/it]
 62%|██████▏   | 23380/37963 [57:38:31<32:50:31,  8.11s/it]
                                                           
{'loss': '0.1357', 'grad_norm': '1.52', 'learning_rate': '6.792e-06', 'epoch': '0.6159'}
+
 62%|██████▏   | 23380/37963 [57:38:31<32:50:31,  8.11s/it]
 62%|██████▏   | 23381/37963 [57:38:39<32:20:36,  7.98s/it]
 62%|██████▏   | 23382/37963 [57:38:47<32:15:11,  7.96s/it]
 62%|██████▏   | 23383/37963 [57:39:02<40:29:59, 10.00s/it]
 62%|██████▏   | 23384/37963 [57:39:10<38:02:08,  9.39s/it]
 62%|██████▏   | 23385/37963 [57:39:17<36:01:33,  8.90s/it]
 62%|██████▏   | 23386/37963 [57:39:25<34:41:08,  8.57s/it]
 62%|██████▏   | 23387/37963 [57:39:33<33:49:36,  8.35s/it]
 62%|██████▏   | 23388/37963 [57:39:41<33:01:15,  8.16s/it]
 62%|██████▏   | 23389/37963 [57:39:48<32:39:47,  8.07s/it]
 62%|██████▏   | 23390/37963 [57:39:56<32:15:01,  7.97s/it]
                                                           
{'loss': '0.1402', 'grad_norm': '3.214', 'learning_rate': '6.784e-06', 'epoch': '0.6161'}
+
 62%|██████▏   | 23390/37963 [57:39:56<32:15:01,  7.97s/it]
 62%|██████▏   | 23391/37963 [57:40:04<32:00:10,  7.91s/it]
 62%|██████▏   | 23392/37963 [57:40:12<31:50:42,  7.87s/it]
 62%|██████▏   | 23393/37963 [57:40:19<31:20:25,  7.74s/it]
 62%|██████▏   | 23394/37963 [57:40:34<40:19:52,  9.97s/it]
 62%|██████▏   | 23395/37963 [57:40:42<37:39:04,  9.30s/it]
 62%|██████▏   | 23396/37963 [57:40:57<43:50:00, 10.83s/it]
 62%|██████▏   | 23397/37963 [57:41:04<40:04:40,  9.91s/it]
 62%|██████▏   | 23398/37963 [57:41:12<37:16:56,  9.21s/it]
 62%|██████▏   | 23399/37963 [57:41:20<35:34:05,  8.79s/it]
 62%|██████▏   | 23400/37963 [57:41:27<34:18:02,  8.48s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '1.746', 'learning_rate': '6.776e-06', 'epoch': '0.6164'}
+
 62%|██████▏   | 23400/37963 [57:41:27<34:18:02,  8.48s/it]
 62%|██████▏   | 23401/37963 [57:41:35<33:18:27,  8.23s/it]
 62%|██████▏   | 23402/37963 [57:41:43<32:45:20,  8.10s/it]
 62%|██████▏   | 23403/37963 [57:41:58<41:16:53, 10.21s/it]
 62%|██████▏   | 23404/37963 [57:42:06<38:40:35,  9.56s/it]
 62%|██████▏   | 23405/37963 [57:42:14<36:33:39,  9.04s/it]
 62%|██████▏   | 23406/37963 [57:42:22<35:07:38,  8.69s/it]
 62%|██████▏   | 23407/37963 [57:42:36<42:16:57, 10.46s/it]
 62%|██████▏   | 23408/37963 [57:42:44<39:08:59,  9.68s/it]
 62%|██████▏   | 23409/37963 [57:42:52<37:01:03,  9.16s/it]
 62%|██████▏   | 23410/37963 [57:43:00<35:06:47,  8.69s/it]
                                                           
{'loss': '0.1318', 'grad_norm': '3.173', 'learning_rate': '6.768e-06', 'epoch': '0.6167'}
+
 62%|██████▏   | 23410/37963 [57:43:00<35:06:47,  8.69s/it]
 62%|██████▏   | 23411/37963 [57:43:07<33:59:07,  8.41s/it]
 62%|██████▏   | 23412/37963 [57:43:22<41:26:01, 10.25s/it]
 62%|██████▏   | 23413/37963 [57:43:37<47:18:13, 11.70s/it]
 62%|██████▏   | 23414/37963 [57:43:45<42:44:30, 10.58s/it]
 62%|██████▏   | 23415/37963 [57:43:53<39:29:06,  9.77s/it]
 62%|██████▏   | 23416/37963 [57:44:01<37:01:19,  9.16s/it]
 62%|██████▏   | 23417/37963 [57:44:08<35:18:46,  8.74s/it]
 62%|██████▏   | 23418/37963 [57:44:16<34:24:23,  8.52s/it]
 62%|██████▏   | 23419/37963 [57:44:24<33:33:38,  8.31s/it]
 62%|██████▏   | 23420/37963 [57:44:32<33:01:37,  8.18s/it]
                                                           
{'loss': '0.1348', 'grad_norm': '3.976', 'learning_rate': '6.76e-06', 'epoch': '0.6169'}
+
 62%|██████▏   | 23420/37963 [57:44:32<33:01:37,  8.18s/it]
 62%|██████▏   | 23421/37963 [57:44:40<32:29:22,  8.04s/it]
 62%|██████▏   | 23422/37963 [57:44:48<32:12:09,  7.97s/it]
 62%|██████▏   | 23423/37963 [57:44:56<32:04:15,  7.94s/it]
 62%|██████▏   | 23424/37963 [57:45:03<31:59:30,  7.92s/it]
 62%|██████▏   | 23425/37963 [57:45:11<31:47:11,  7.87s/it]
 62%|██████▏   | 23426/37963 [57:45:19<31:20:42,  7.76s/it]
 62%|██████▏   | 23427/37963 [57:45:26<31:19:54,  7.76s/it]
 62%|██████▏   | 23428/37963 [57:45:41<39:11:50,  9.71s/it]
 62%|██████▏   | 23429/37963 [57:45:48<36:36:11,  9.07s/it]
 62%|██████▏   | 23430/37963 [57:45:56<35:00:30,  8.67s/it]
                                                           
{'loss': '0.1394', 'grad_norm': '2.568', 'learning_rate': '6.752e-06', 'epoch': '0.6172'}
+
 62%|██████▏   | 23430/37963 [57:45:56<35:00:30,  8.67s/it]
 62%|██████▏   | 23431/37963 [57:46:04<34:02:06,  8.43s/it]
 62%|██████▏   | 23432/37963 [57:46:12<33:13:29,  8.23s/it]
 62%|██████▏   | 23433/37963 [57:46:19<32:43:52,  8.11s/it]
 62%|██████▏   | 23434/37963 [57:46:27<32:18:16,  8.00s/it]
 62%|██████▏   | 23435/37963 [57:46:35<31:59:25,  7.93s/it]
 62%|██████▏   | 23436/37963 [57:46:49<39:58:04,  9.90s/it]
 62%|██████▏   | 23437/37963 [57:46:58<37:47:53,  9.37s/it]
 62%|██████▏   | 23438/37963 [57:47:05<35:41:01,  8.84s/it]
 62%|██████▏   | 23439/37963 [57:47:13<34:23:54,  8.53s/it]
 62%|██████▏   | 23440/37963 [57:47:21<33:44:29,  8.36s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '2.527', 'learning_rate': '6.743e-06', 'epoch': '0.6174'}
+
 62%|██████▏   | 23440/37963 [57:47:21<33:44:29,  8.36s/it]
 62%|██████▏   | 23441/37963 [57:47:29<32:57:41,  8.17s/it]
 62%|██████▏   | 23442/37963 [57:47:36<32:26:45,  8.04s/it]
 62%|██████▏   | 23443/37963 [57:47:52<40:57:22, 10.15s/it]
 62%|██████▏   | 23444/37963 [57:48:00<38:38:55,  9.58s/it]
 62%|██████▏   | 23445/37963 [57:48:08<36:28:04,  9.04s/it]
 62%|██████▏   | 23446/37963 [57:48:22<43:24:50, 10.77s/it]
 62%|██████▏   | 23447/37963 [57:48:30<40:00:02,  9.92s/it]
 62%|██████▏   | 23448/37963 [57:48:38<37:06:24,  9.20s/it]
 62%|██████▏   | 23449/37963 [57:48:46<35:15:58,  8.75s/it]
 62%|██████▏   | 23450/37963 [57:48:53<34:08:11,  8.47s/it]
                                                           
{'loss': '0.1209', 'grad_norm': '2.091', 'learning_rate': '6.735e-06', 'epoch': '0.6177'}
+
 62%|██████▏   | 23450/37963 [57:48:53<34:08:11,  8.47s/it]
 62%|██████▏   | 23451/37963 [57:49:08<41:44:29, 10.35s/it]
 62%|██████▏   | 23452/37963 [57:49:16<38:53:33,  9.65s/it]
 62%|██████▏   | 23453/37963 [57:49:24<36:22:16,  9.02s/it]
 62%|██████▏   | 23454/37963 [57:49:31<34:40:54,  8.61s/it]
 62%|██████▏   | 23455/37963 [57:49:46<41:37:30, 10.33s/it]
 62%|██████▏   | 23456/37963 [57:49:54<39:19:45,  9.76s/it]
 62%|██████▏   | 23457/37963 [57:50:02<36:58:00,  9.17s/it]
 62%|██████▏   | 23458/37963 [57:50:10<35:15:47,  8.75s/it]
 62%|██████▏   | 23459/37963 [57:50:17<34:05:45,  8.46s/it]
 62%|██████▏   | 23460/37963 [57:50:25<33:18:45,  8.27s/it]
                                                           
{'loss': '0.1368', 'grad_norm': '1.383', 'learning_rate': '6.727e-06', 'epoch': '0.618'}
+
 62%|██████▏   | 23460/37963 [57:50:25<33:18:45,  8.27s/it]
 62%|██████▏   | 23461/37963 [57:50:33<32:39:19,  8.11s/it]
 62%|██████▏   | 23462/37963 [57:50:41<32:07:11,  7.97s/it]
 62%|██████▏   | 23463/37963 [57:50:49<32:05:57,  7.97s/it]
 62%|██████▏   | 23464/37963 [57:51:03<40:07:09,  9.96s/it]
 62%|██████▏   | 23465/37963 [57:51:11<37:27:54,  9.30s/it]
 62%|██████▏   | 23466/37963 [57:51:19<35:48:48,  8.89s/it]
 62%|██████▏   | 23467/37963 [57:51:34<43:04:58, 10.70s/it]
 62%|██████▏   | 23468/37963 [57:51:42<39:33:38,  9.83s/it]
 62%|██████▏   | 23469/37963 [57:51:49<37:04:00,  9.21s/it]
 62%|██████▏   | 23470/37963 [57:51:57<35:19:03,  8.77s/it]
                                                           
{'loss': '0.1371', 'grad_norm': '2.407', 'learning_rate': '6.719e-06', 'epoch': '0.6182'}
+
 62%|██████▏   | 23470/37963 [57:51:57<35:19:03,  8.77s/it]
 62%|██████▏   | 23471/37963 [57:52:05<33:43:30,  8.38s/it]
 62%|██████▏   | 23472/37963 [57:52:12<32:45:44,  8.14s/it]
 62%|██████▏   | 23473/37963 [57:52:20<32:16:13,  8.02s/it]
 62%|██████▏   | 23474/37963 [57:52:28<31:59:38,  7.95s/it]
 62%|██████▏   | 23475/37963 [57:52:35<31:38:07,  7.86s/it]
 62%|██████▏   | 23476/37963 [57:52:43<31:33:31,  7.84s/it]
 62%|██████▏   | 23477/37963 [57:52:51<31:18:53,  7.78s/it]
 62%|██████▏   | 23478/37963 [57:52:59<31:25:01,  7.81s/it]
 62%|██████▏   | 23479/37963 [57:53:06<31:16:08,  7.77s/it]
 62%|██████▏   | 23480/37963 [57:53:21<39:38:41,  9.85s/it]
                                                           
{'loss': '0.1376', 'grad_norm': '3.045', 'learning_rate': '6.711e-06', 'epoch': '0.6185'}
+
 62%|██████▏   | 23480/37963 [57:53:21<39:38:41,  9.85s/it]
 62%|██████▏   | 23481/37963 [57:53:29<37:26:55,  9.31s/it]
 62%|██████▏   | 23482/37963 [57:53:37<35:36:58,  8.85s/it]
 62%|██████▏   | 23483/37963 [57:53:45<34:17:15,  8.52s/it]
 62%|██████▏   | 23484/37963 [57:53:52<33:15:50,  8.27s/it]
 62%|██████▏   | 23485/37963 [57:54:00<32:33:20,  8.10s/it]
 62%|██████▏   | 23486/37963 [57:54:08<32:16:23,  8.03s/it]
 62%|██████▏   | 23487/37963 [57:54:15<31:33:43,  7.85s/it]
 62%|██████▏   | 23488/37963 [57:54:23<31:40:53,  7.88s/it]
 62%|██████▏   | 23489/37963 [57:54:38<39:55:02,  9.93s/it]
 62%|██████▏   | 23490/37963 [57:54:46<37:32:30,  9.34s/it]
                                                           
{'loss': '0.1358', 'grad_norm': '2.186', 'learning_rate': '6.703e-06', 'epoch': '0.6188'}
+
 62%|██████▏   | 23490/37963 [57:54:46<37:32:30,  9.34s/it]
 62%|██████▏   | 23491/37963 [57:55:01<44:24:17, 11.05s/it]
 62%|██████▏   | 23492/37963 [57:55:09<40:35:23, 10.10s/it]
 62%|██████▏   | 23493/37963 [57:55:16<37:30:41,  9.33s/it]
 62%|██████▏   | 23494/37963 [57:55:24<35:39:32,  8.87s/it]
 62%|██████▏   | 23495/37963 [57:55:32<34:16:01,  8.53s/it]
 62%|██████▏   | 23496/37963 [57:55:40<33:30:39,  8.34s/it]
 62%|██████▏   | 23497/37963 [57:55:48<32:52:02,  8.18s/it]
 62%|██████▏   | 23498/37963 [57:56:02<39:54:13,  9.93s/it]
 62%|██████▏   | 23499/37963 [57:56:16<45:22:03, 11.29s/it]
 62%|██████▏   | 23500/37963 [57:56:31<50:11:45, 12.49s/it]
                                                           
{'loss': '0.126', 'grad_norm': '1.538', 'learning_rate': '6.695e-06', 'epoch': '0.619'}
+
 62%|██████▏   | 23500/37963 [57:56:31<50:11:45, 12.49s/it]
 62%|██████▏   | 23501/37963 [57:56:40<44:59:42, 11.20s/it]
 62%|██████▏   | 23502/37963 [57:56:47<40:59:12, 10.20s/it]
 62%|██████▏   | 23503/37963 [57:56:55<38:01:11,  9.47s/it]
 62%|██████▏   | 23504/37963 [57:57:03<35:55:03,  8.94s/it]
 62%|██████▏   | 23505/37963 [57:57:11<34:24:48,  8.57s/it]
 62%|██████▏   | 23506/37963 [57:57:19<33:33:40,  8.36s/it]
 62%|██████▏   | 23507/37963 [57:57:26<32:49:09,  8.17s/it]
 62%|██████▏   | 23508/37963 [57:57:34<32:25:59,  8.08s/it]
 62%|██████▏   | 23509/37963 [57:57:49<40:18:45, 10.04s/it]
 62%|██████▏   | 23510/37963 [57:57:57<37:57:39,  9.46s/it]
                                                           
{'loss': '0.1293', 'grad_norm': '1.421', 'learning_rate': '6.687e-06', 'epoch': '0.6193'}
+
 62%|██████▏   | 23510/37963 [57:57:57<37:57:39,  9.46s/it]
 62%|██████▏   | 23511/37963 [57:58:12<44:55:50, 11.19s/it]
 62%|██████▏   | 23512/37963 [57:58:20<41:15:04, 10.28s/it]
 62%|██████▏   | 23513/37963 [57:58:28<38:03:23,  9.48s/it]
 62%|██████▏   | 23514/37963 [57:58:35<35:50:11,  8.93s/it]
 62%|██████▏   | 23515/37963 [57:58:43<34:23:08,  8.57s/it]
 62%|██████▏   | 23516/37963 [57:58:51<33:42:01,  8.40s/it]
 62%|██████▏   | 23517/37963 [57:58:59<32:55:30,  8.21s/it]
 62%|██████▏   | 23518/37963 [57:59:07<32:12:20,  8.03s/it]
 62%|██████▏   | 23519/37963 [57:59:14<31:48:58,  7.93s/it]
 62%|██████▏   | 23520/37963 [57:59:22<31:38:38,  7.89s/it]
                                                           
{'loss': '0.145', 'grad_norm': '2.562', 'learning_rate': '6.679e-06', 'epoch': '0.6196'}
+
 62%|██████▏   | 23520/37963 [57:59:22<31:38:38,  7.89s/it]
 62%|██████▏   | 23521/37963 [57:59:30<31:15:20,  7.79s/it]
 62%|██████▏   | 23522/37963 [57:59:37<31:08:44,  7.76s/it]
 62%|██████▏   | 23523/37963 [57:59:45<31:07:56,  7.76s/it]
 62%|██████▏   | 23524/37963 [57:59:53<30:59:58,  7.73s/it]
 62%|██████▏   | 23525/37963 [58:00:00<30:30:52,  7.61s/it]
 62%|██████▏   | 23526/37963 [58:00:08<30:35:44,  7.63s/it]
 62%|██████▏   | 23527/37963 [58:00:15<30:27:35,  7.60s/it]
 62%|██████▏   | 23528/37963 [58:00:23<30:41:56,  7.66s/it]
 62%|██████▏   | 23529/37963 [58:00:38<39:04:34,  9.75s/it]
 62%|██████▏   | 23530/37963 [58:00:45<36:43:59,  9.16s/it]
                                                           
{'loss': '0.1288', 'grad_norm': '1.38', 'learning_rate': '6.671e-06', 'epoch': '0.6198'}
+
 62%|██████▏   | 23530/37963 [58:00:45<36:43:59,  9.16s/it]
 62%|██████▏   | 23531/37963 [58:00:53<35:15:05,  8.79s/it]
 62%|██████▏   | 23532/37963 [58:01:01<34:04:30,  8.50s/it]
 62%|██████▏   | 23533/37963 [58:01:09<33:04:19,  8.25s/it]
 62%|██████▏   | 23534/37963 [58:01:17<32:24:12,  8.08s/it]
 62%|██████▏   | 23535/37963 [58:01:24<32:02:35,  8.00s/it]
 62%|██████▏   | 23536/37963 [58:01:32<31:44:28,  7.92s/it]
 62%|██████▏   | 23537/37963 [58:01:48<40:51:13, 10.20s/it]
 62%|██████▏   | 23538/37963 [58:01:56<38:15:45,  9.55s/it]
 62%|██████▏   | 23539/37963 [58:02:03<36:05:34,  9.01s/it]
 62%|██████▏   | 23540/37963 [58:02:11<34:22:38,  8.58s/it]
                                                           
{'loss': '0.1234', 'grad_norm': '2.495', 'learning_rate': '6.663e-06', 'epoch': '0.6201'}
+
 62%|██████▏   | 23540/37963 [58:02:11<34:22:38,  8.58s/it]
 62%|██████▏   | 23541/37963 [58:02:19<33:54:33,  8.46s/it]
 62%|██████▏   | 23542/37963 [58:02:34<41:21:10, 10.32s/it]
 62%|██████▏   | 23543/37963 [58:02:42<38:22:23,  9.58s/it]
 62%|██████▏   | 23544/37963 [58:02:49<36:11:17,  9.04s/it]
 62%|██████▏   | 23545/37963 [58:03:04<43:03:26, 10.75s/it]
 62%|██████▏   | 23546/37963 [58:03:12<39:46:44,  9.93s/it]
 62%|██████▏   | 23547/37963 [58:03:20<37:37:13,  9.39s/it]
 62%|██████▏   | 23548/37963 [58:03:28<35:33:31,  8.88s/it]
 62%|██████▏   | 23549/37963 [58:03:36<34:15:35,  8.56s/it]
 62%|██████▏   | 23550/37963 [58:03:44<33:17:05,  8.31s/it]
                                                           
{'loss': '0.1375', 'grad_norm': '1.861', 'learning_rate': '6.655e-06', 'epoch': '0.6203'}
+
 62%|██████▏   | 23550/37963 [58:03:44<33:17:05,  8.31s/it]
 62%|██████▏   | 23551/37963 [58:03:51<32:13:06,  8.05s/it]
 62%|██████▏   | 23552/37963 [58:04:13<48:26:19, 12.10s/it]
 62%|██████▏   | 23553/37963 [58:04:21<44:04:45, 11.01s/it]
 62%|██████▏   | 23554/37963 [58:04:36<48:48:52, 12.20s/it]
 62%|██████▏   | 23555/37963 [58:04:44<43:36:03, 10.89s/it]
 62%|██████▏   | 23556/37963 [58:04:52<39:53:11,  9.97s/it]
 62%|██████▏   | 23557/37963 [58:05:06<45:03:59, 11.26s/it]
 62%|██████▏   | 23558/37963 [58:05:14<41:00:24, 10.25s/it]
 62%|██████▏   | 23559/37963 [58:05:22<37:59:23,  9.49s/it]
 62%|██████▏   | 23560/37963 [58:05:30<36:06:08,  9.02s/it]
                                                           
{'loss': '0.129', 'grad_norm': '2.842', 'learning_rate': '6.647e-06', 'epoch': '0.6206'}
+
 62%|██████▏   | 23560/37963 [58:05:30<36:06:08,  9.02s/it]
 62%|██████▏   | 23561/37963 [58:05:37<34:35:15,  8.65s/it]
 62%|██████▏   | 23562/37963 [58:05:45<33:27:03,  8.36s/it]
 62%|██████▏   | 23563/37963 [58:05:53<32:40:21,  8.17s/it]
 62%|██████▏   | 23564/37963 [58:06:00<32:09:58,  8.04s/it]
 62%|██████▏   | 23565/37963 [58:06:08<31:42:48,  7.93s/it]
 62%|██████▏   | 23566/37963 [58:06:16<31:27:04,  7.86s/it]
 62%|██████▏   | 23567/37963 [58:06:23<31:08:45,  7.79s/it]
 62%|██████▏   | 23568/37963 [58:06:31<31:01:02,  7.76s/it]
 62%|██████▏   | 23569/37963 [58:06:39<31:21:38,  7.84s/it]
 62%|██████▏   | 23570/37963 [58:06:47<31:27:06,  7.87s/it]
                                                           
{'loss': '0.141', 'grad_norm': '1.565', 'learning_rate': '6.639e-06', 'epoch': '0.6209'}
+
 62%|██████▏   | 23570/37963 [58:06:47<31:27:06,  7.87s/it]
 62%|██████▏   | 23571/37963 [58:06:55<31:14:41,  7.82s/it]
 62%|██████▏   | 23572/37963 [58:07:02<31:07:19,  7.79s/it]
 62%|██████▏   | 23573/37963 [58:07:10<30:58:58,  7.75s/it]
 62%|██████▏   | 23574/37963 [58:07:24<38:52:38,  9.73s/it]
 62%|██████▏   | 23575/37963 [58:07:32<36:36:23,  9.16s/it]
 62%|██████▏   | 23576/37963 [58:07:40<34:59:14,  8.75s/it]
 62%|██████▏   | 23577/37963 [58:07:48<33:59:44,  8.51s/it]
 62%|██████▏   | 23578/37963 [58:07:56<32:52:55,  8.23s/it]
 62%|██████▏   | 23579/37963 [58:08:03<32:17:15,  8.08s/it]
 62%|██████▏   | 23580/37963 [58:08:18<40:15:25, 10.08s/it]
                                                           
{'loss': '0.1291', 'grad_norm': '1.815', 'learning_rate': '6.631e-06', 'epoch': '0.6211'}
+
 62%|██████▏   | 23580/37963 [58:08:18<40:15:25, 10.08s/it]
 62%|██████▏   | 23581/37963 [58:08:26<37:59:44,  9.51s/it]
 62%|██████▏   | 23582/37963 [58:08:34<35:38:48,  8.92s/it]
 62%|██████▏   | 23583/37963 [58:08:42<34:13:05,  8.57s/it]
 62%|██████▏   | 23584/37963 [58:08:49<33:12:13,  8.31s/it]
 62%|██████▏   | 23585/37963 [58:08:57<32:33:01,  8.15s/it]
 62%|██████▏   | 23586/37963 [58:09:05<32:11:07,  8.06s/it]
 62%|██████▏   | 23587/37963 [58:09:13<31:51:05,  7.98s/it]
 62%|██████▏   | 23588/37963 [58:09:21<31:40:44,  7.93s/it]
 62%|██████▏   | 23589/37963 [58:09:35<40:03:03, 10.03s/it]
 62%|██████▏   | 23590/37963 [58:09:43<37:33:30,  9.41s/it]
                                                           
{'loss': '0.1207', 'grad_norm': '1.626', 'learning_rate': '6.623e-06', 'epoch': '0.6214'}
+
 62%|██████▏   | 23590/37963 [58:09:43<37:33:30,  9.41s/it]
 62%|██████▏   | 23591/37963 [58:09:51<35:38:39,  8.93s/it]
 62%|██████▏   | 23592/37963 [58:09:59<34:24:56,  8.62s/it]
 62%|██████▏   | 23593/37963 [58:10:07<33:24:31,  8.37s/it]
 62%|██████▏   | 23594/37963 [58:10:22<41:07:52, 10.30s/it]
 62%|██████▏   | 23595/37963 [58:10:30<38:26:22,  9.63s/it]
 62%|██████▏   | 23596/37963 [58:10:45<44:32:35, 11.16s/it]
 62%|██████▏   | 23597/37963 [58:10:52<40:40:00, 10.19s/it]
 62%|██████▏   | 23598/37963 [58:11:00<37:46:15,  9.47s/it]
 62%|██████▏   | 23599/37963 [58:11:08<35:43:36,  8.95s/it]
 62%|██████▏   | 23600/37963 [58:11:16<33:59:30,  8.52s/it]
                                                           
{'loss': '0.137', 'grad_norm': '2.649', 'learning_rate': '6.615e-06', 'epoch': '0.6217'}
+
 62%|██████▏   | 23600/37963 [58:11:16<33:59:30,  8.52s/it]
 62%|██████▏   | 23601/37963 [58:11:23<32:59:16,  8.27s/it]
 62%|██████▏   | 23602/37963 [58:11:31<32:33:17,  8.16s/it]
 62%|██████▏   | 23603/37963 [58:11:46<40:08:13, 10.06s/it]
 62%|██████▏   | 23604/37963 [58:11:54<37:45:13,  9.47s/it]
 62%|██████▏   | 23605/37963 [58:12:02<36:00:23,  9.03s/it]
 62%|██████▏   | 23606/37963 [58:12:16<42:02:13, 10.54s/it]
 62%|██████▏   | 23607/37963 [58:12:24<39:08:11,  9.81s/it]
 62%|██████▏   | 23608/37963 [58:12:39<45:20:22, 11.37s/it]
 62%|██████▏   | 23609/37963 [58:12:47<41:21:13, 10.37s/it]
 62%|██████▏   | 23610/37963 [58:12:55<38:12:01,  9.58s/it]
                                                           
{'loss': '0.1321', 'grad_norm': '4.513', 'learning_rate': '6.607e-06', 'epoch': '0.6219'}
+
 62%|██████▏   | 23610/37963 [58:12:55<38:12:01,  9.58s/it]
 62%|██████▏   | 23611/37963 [58:13:02<36:07:05,  9.06s/it]
 62%|██████▏   | 23612/37963 [58:13:10<34:17:09,  8.60s/it]
 62%|██████▏   | 23613/37963 [58:13:17<32:55:08,  8.26s/it]
 62%|██████▏   | 23614/37963 [58:13:25<32:09:51,  8.07s/it]
 62%|██████▏   | 23615/37963 [58:13:33<31:42:21,  7.96s/it]
 62%|██████▏   | 23616/37963 [58:13:41<31:27:23,  7.89s/it]
 62%|██████▏   | 23617/37963 [58:13:48<31:20:25,  7.86s/it]
 62%|██████▏   | 23618/37963 [58:13:56<31:07:24,  7.81s/it]
 62%|██████▏   | 23619/37963 [58:14:04<31:13:09,  7.84s/it]
 62%|██████▏   | 23620/37963 [58:14:12<31:17:01,  7.85s/it]
                                                           
{'loss': '0.1358', 'grad_norm': '3.155', 'learning_rate': '6.599e-06', 'epoch': '0.6222'}
+
 62%|██████▏   | 23620/37963 [58:14:12<31:17:01,  7.85s/it]
 62%|██████▏   | 23621/37963 [58:14:20<31:15:39,  7.85s/it]
 62%|██████▏   | 23622/37963 [58:14:27<31:07:52,  7.81s/it]
 62%|██████▏   | 23623/37963 [58:14:41<38:24:39,  9.64s/it]
 62%|██████▏   | 23624/37963 [58:14:49<36:11:25,  9.09s/it]
 62%|██████▏   | 23625/37963 [58:14:57<34:33:04,  8.68s/it]
 62%|██████▏   | 23626/37963 [58:15:05<33:25:01,  8.39s/it]
 62%|██████▏   | 23627/37963 [58:15:12<32:38:16,  8.20s/it]
 62%|██████▏   | 23628/37963 [58:15:27<40:03:34, 10.06s/it]
 62%|██████▏   | 23629/37963 [58:15:35<37:43:54,  9.48s/it]
 62%|██████▏   | 23630/37963 [58:15:42<35:24:15,  8.89s/it]
                                                           
{'loss': '0.1336', 'grad_norm': '1.919', 'learning_rate': '6.591e-06', 'epoch': '0.6225'}
+
 62%|██████▏   | 23630/37963 [58:15:42<35:24:15,  8.89s/it]
 62%|██████▏   | 23631/37963 [58:15:50<34:21:19,  8.63s/it]
 62%|██████▏   | 23632/37963 [58:15:58<33:16:37,  8.36s/it]
 62%|██████▏   | 23633/37963 [58:16:06<32:30:47,  8.17s/it]
 62%|██████▏   | 23634/37963 [58:16:21<40:46:30, 10.24s/it]
 62%|██████▏   | 23635/37963 [58:16:29<37:57:14,  9.54s/it]
 62%|██████▏   | 23636/37963 [58:16:36<35:41:53,  8.97s/it]
 62%|██████▏   | 23637/37963 [58:16:44<34:11:37,  8.59s/it]
 62%|██████▏   | 23638/37963 [58:16:52<33:07:07,  8.32s/it]
 62%|██████▏   | 23639/37963 [58:17:00<32:25:11,  8.15s/it]
 62%|██████▏   | 23640/37963 [58:17:14<39:53:40, 10.03s/it]
                                                           
{'loss': '0.1317', 'grad_norm': '1.824', 'learning_rate': '6.583e-06', 'epoch': '0.6227'}
+
 62%|██████▏   | 23640/37963 [58:17:14<39:53:40, 10.03s/it]
 62%|██████▏   | 23641/37963 [58:17:21<36:50:45,  9.26s/it]
 62%|██████▏   | 23642/37963 [58:17:29<34:58:43,  8.79s/it]
 62%|██████▏   | 23643/37963 [58:17:37<33:37:25,  8.45s/it]
 62%|██████▏   | 23644/37963 [58:17:44<32:38:59,  8.21s/it]
 62%|██████▏   | 23645/37963 [58:17:52<32:19:39,  8.13s/it]
 62%|██████▏   | 23646/37963 [58:18:00<31:50:30,  8.01s/it]
 62%|██████▏   | 23647/37963 [58:18:08<31:30:44,  7.92s/it]
 62%|██████▏   | 23648/37963 [58:18:16<31:19:19,  7.88s/it]
 62%|██████▏   | 23649/37963 [58:18:31<40:27:34, 10.18s/it]
 62%|██████▏   | 23650/37963 [58:18:39<37:23:19,  9.40s/it]
                                                           
{'loss': '0.1219', 'grad_norm': '1.193', 'learning_rate': '6.575e-06', 'epoch': '0.623'}
+
 62%|██████▏   | 23650/37963 [58:18:39<37:23:19,  9.40s/it]
 62%|██████▏   | 23651/37963 [58:18:54<43:52:03, 11.03s/it]
 62%|██████▏   | 23652/37963 [58:19:02<40:16:06, 10.13s/it]
 62%|██████▏   | 23653/37963 [58:19:09<37:35:33,  9.46s/it]
 62%|██████▏   | 23654/37963 [58:19:17<35:27:01,  8.92s/it]
 62%|██████▏   | 23655/37963 [58:19:25<34:08:43,  8.59s/it]
 62%|██████▏   | 23656/37963 [58:19:33<33:11:49,  8.35s/it]
 62%|██████▏   | 23657/37963 [58:19:40<32:26:06,  8.16s/it]
 62%|██████▏   | 23658/37963 [58:19:55<40:02:11, 10.08s/it]
 62%|██████▏   | 23659/37963 [58:20:03<37:22:08,  9.40s/it]
 62%|██████▏   | 23660/37963 [58:20:10<35:09:37,  8.85s/it]
                                                           
{'loss': '0.1317', 'grad_norm': '1.626', 'learning_rate': '6.567e-06', 'epoch': '0.6232'}
+
 62%|██████▏   | 23660/37963 [58:20:10<35:09:37,  8.85s/it]
 62%|██████▏   | 23661/37963 [58:20:25<42:08:34, 10.61s/it]
 62%|██████▏   | 23662/37963 [58:20:33<38:37:00,  9.72s/it]
 62%|██████▏   | 23663/37963 [58:20:41<36:14:22,  9.12s/it]
 62%|██████▏   | 23664/37963 [58:20:48<34:47:17,  8.76s/it]
 62%|██████▏   | 23665/37963 [58:20:56<33:34:49,  8.46s/it]
 62%|██████▏   | 23666/37963 [58:21:04<32:31:01,  8.19s/it]
 62%|██████▏   | 23667/37963 [58:21:18<40:03:34, 10.09s/it]
 62%|██████▏   | 23668/37963 [58:21:26<37:22:38,  9.41s/it]
 62%|██████▏   | 23669/37963 [58:21:34<35:22:00,  8.91s/it]
 62%|██████▏   | 23670/37963 [58:21:42<34:03:20,  8.58s/it]
                                                           
{'loss': '0.1298', 'grad_norm': '2.32', 'learning_rate': '6.559e-06', 'epoch': '0.6235'}
+
 62%|██████▏   | 23670/37963 [58:21:42<34:03:20,  8.58s/it]
 62%|██████▏   | 23671/37963 [58:21:49<33:05:55,  8.34s/it]
 62%|██████▏   | 23672/37963 [58:21:57<32:20:45,  8.15s/it]
 62%|██████▏   | 23673/37963 [58:22:05<31:44:40,  8.00s/it]
 62%|██████▏   | 23674/37963 [58:22:12<31:09:27,  7.85s/it]
 62%|██████▏   | 23675/37963 [58:22:27<39:09:40,  9.87s/it]
 62%|██████▏   | 23676/37963 [58:22:35<37:10:27,  9.37s/it]
 62%|██████▏   | 23677/37963 [58:22:43<35:19:02,  8.90s/it]
 62%|██████▏   | 23678/37963 [58:22:51<34:11:51,  8.62s/it]
 62%|██████▏   | 23679/37963 [58:23:06<42:22:21, 10.68s/it]
 62%|██████▏   | 23680/37963 [58:23:14<38:58:10,  9.82s/it]
                                                           
{'loss': '0.1324', 'grad_norm': '2.205', 'learning_rate': '6.551e-06', 'epoch': '0.6238'}
+
 62%|██████▏   | 23680/37963 [58:23:14<38:58:10,  9.82s/it]
 62%|██████▏   | 23681/37963 [58:23:22<36:27:48,  9.19s/it]
 62%|██████▏   | 23682/37963 [58:23:30<34:44:43,  8.76s/it]
 62%|██████▏   | 23683/37963 [58:23:37<33:34:27,  8.46s/it]
 62%|██████▏   | 23684/37963 [58:23:45<32:42:57,  8.25s/it]
 62%|██████▏   | 23685/37963 [58:24:00<40:21:12, 10.17s/it]
 62%|██████▏   | 23686/37963 [58:24:08<37:32:55,  9.47s/it]
 62%|██████▏   | 23687/37963 [58:24:15<35:12:27,  8.88s/it]
 62%|██████▏   | 23688/37963 [58:24:23<33:52:13,  8.54s/it]
 62%|██████▏   | 23689/37963 [58:24:31<32:58:10,  8.32s/it]
 62%|██████▏   | 23690/37963 [58:24:39<32:27:29,  8.19s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '5.243', 'learning_rate': '6.543e-06', 'epoch': '0.624'}
+
 62%|██████▏   | 23690/37963 [58:24:39<32:27:29,  8.19s/it]
 62%|██████▏   | 23691/37963 [58:24:46<31:30:41,  7.95s/it]
 62%|██████▏   | 23692/37963 [58:25:01<39:48:23, 10.04s/it]
 62%|██████▏   | 23693/37963 [58:25:09<37:14:07,  9.39s/it]
 62%|██████▏   | 23694/37963 [58:25:17<35:20:30,  8.92s/it]
 62%|██████▏   | 23695/37963 [58:25:24<33:51:58,  8.54s/it]
 62%|██████▏   | 23696/37963 [58:25:32<32:57:49,  8.32s/it]
 62%|██████▏   | 23697/37963 [58:25:40<32:18:25,  8.15s/it]
 62%|██████▏   | 23698/37963 [58:25:55<40:12:50, 10.15s/it]
 62%|██████▏   | 23699/37963 [58:26:03<37:37:46,  9.50s/it]
 62%|██████▏   | 23700/37963 [58:26:10<35:32:59,  8.97s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '2.105', 'learning_rate': '6.535e-06', 'epoch': '0.6243'}
+
 62%|█████���▏   | 23700/37963 [58:26:10<35:32:59,  8.97s/it]
 62%|██████▏   | 23701/37963 [58:26:18<34:08:23,  8.62s/it]
 62%|██████▏   | 23702/37963 [58:26:26<33:00:10,  8.33s/it]
 62%|██████▏   | 23703/37963 [58:26:34<32:27:39,  8.19s/it]
 62%|██████▏   | 23704/37963 [58:26:41<31:59:52,  8.08s/it]
 62%|██████▏   | 23705/37963 [58:26:49<31:46:55,  8.02s/it]
 62%|██████▏   | 23706/37963 [58:26:57<31:45:26,  8.02s/it]
 62%|██████▏   | 23707/37963 [58:27:05<31:22:18,  7.92s/it]
 62%|██████▏   | 23708/37963 [58:27:13<31:05:47,  7.85s/it]
 62%|██████▏   | 23709/37963 [58:27:27<39:16:30,  9.92s/it]
 62%|██████▏   | 23710/37963 [58:27:35<36:56:11,  9.33s/it]
                                                           
{'loss': '0.1415', 'grad_norm': '1.007', 'learning_rate': '6.527e-06', 'epoch': '0.6246'}
+
 62%|██████▏   | 23710/37963 [58:27:35<36:56:11,  9.33s/it]
 62%|██████▏   | 23711/37963 [58:27:50<43:29:50, 10.99s/it]
 62%|██████▏   | 23712/37963 [58:28:05<48:26:35, 12.24s/it]
 62%|██████▏   | 23713/37963 [58:28:13<43:07:02, 10.89s/it]
 62%|██████▏   | 23714/37963 [58:28:21<39:20:08,  9.94s/it]
 62%|██████▏   | 23715/37963 [58:28:29<36:36:41,  9.25s/it]
 62%|██████▏   | 23716/37963 [58:28:36<34:45:10,  8.78s/it]
 62%|██████▏   | 23717/37963 [58:28:44<33:33:07,  8.48s/it]
 62%|██████▏   | 23718/37963 [58:28:52<32:53:44,  8.31s/it]
 62%|██████▏   | 23719/37963 [58:29:00<32:12:14,  8.14s/it]
 62%|██████▏   | 23720/37963 [58:29:07<31:25:31,  7.94s/it]
                                                           
{'loss': '0.1333', 'grad_norm': '3.152', 'learning_rate': '6.519e-06', 'epoch': '0.6248'}
+
 62%|██████▏   | 23720/37963 [58:29:07<31:25:31,  7.94s/it]
 62%|██████▏   | 23721/37963 [58:29:15<31:08:00,  7.87s/it]
 62%|██████▏   | 23722/37963 [58:29:23<30:58:20,  7.83s/it]
 62%|██████▏   | 23723/37963 [58:29:37<38:35:42,  9.76s/it]
 62%|██████▏   | 23724/37963 [58:29:45<36:52:00,  9.32s/it]
 62%|██████▏   | 23725/37963 [58:29:53<35:08:35,  8.89s/it]
 62%|██████▏   | 23726/37963 [58:30:01<33:45:53,  8.54s/it]
 63%|██████▎   | 23727/37963 [58:30:08<32:45:58,  8.29s/it]
 63%|██████▎   | 23728/37963 [58:30:23<40:38:33, 10.28s/it]
 63%|██████▎   | 23729/37963 [58:30:38<45:38:35, 11.54s/it]
 63%|██████▎   | 23730/37963 [58:30:46<42:00:19, 10.62s/it]
                                                           
{'loss': '0.1216', 'grad_norm': '2.235', 'learning_rate': '6.511e-06', 'epoch': '0.6251'}
+
 63%|██████▎   | 23730/37963 [58:30:46<42:00:19, 10.62s/it]
 63%|██████▎   | 23731/37963 [58:30:54<38:39:13,  9.78s/it]
 63%|██████▎   | 23732/37963 [58:31:02<36:09:38,  9.15s/it]
 63%|██████▎   | 23733/37963 [58:31:10<34:28:19,  8.72s/it]
 63%|██████▎   | 23734/37963 [58:31:17<33:02:53,  8.36s/it]
 63%|██████▎   | 23735/37963 [58:31:25<32:15:28,  8.16s/it]
 63%|██████▎   | 23736/37963 [58:31:32<31:28:21,  7.96s/it]
 63%|██████▎   | 23737/37963 [58:31:40<31:20:36,  7.93s/it]
 63%|██████▎   | 23738/37963 [58:31:48<31:27:32,  7.96s/it]
 63%|██████▎   | 23739/37963 [58:31:56<31:09:49,  7.89s/it]
 63%|██████▎   | 23740/37963 [58:32:04<30:56:27,  7.83s/it]
                                                           
{'loss': '0.1299', 'grad_norm': '1.791', 'learning_rate': '6.503e-06', 'epoch': '0.6253'}
+
 63%|██████▎   | 23740/37963 [58:32:04<30:56:27,  7.83s/it]
 63%|██████▎   | 23741/37963 [58:32:11<30:48:58,  7.80s/it]
 63%|██████▎   | 23742/37963 [58:32:19<30:34:58,  7.74s/it]
 63%|██████▎   | 23743/37963 [58:32:27<30:36:12,  7.75s/it]
 63%|██████▎   | 23744/37963 [58:32:34<30:21:44,  7.69s/it]
 63%|██████▎   | 23745/37963 [58:32:42<30:07:56,  7.63s/it]
 63%|██████▎   | 23746/37963 [58:33:03<46:31:08, 11.78s/it]
 63%|██████▎   | 23747/37963 [58:33:11<41:53:48, 10.61s/it]
 63%|██████▎   | 23748/37963 [58:33:19<38:36:44,  9.78s/it]
 63%|██████▎   | 23749/37963 [58:33:27<36:07:15,  9.15s/it]
 63%|██████▎   | 23750/37963 [58:33:34<34:30:44,  8.74s/it]
                                                           
{'loss': '0.139', 'grad_norm': '2.918', 'learning_rate': '6.495e-06', 'epoch': '0.6256'}
+
 63%|██████▎   | 23750/37963 [58:33:34<34:30:44,  8.74s/it]
 63%|██████▎   | 23751/37963 [58:33:42<33:02:46,  8.37s/it]
 63%|██████▎   | 23752/37963 [58:33:50<32:16:49,  8.18s/it]
 63%|██████▎   | 23753/37963 [58:33:58<32:01:53,  8.11s/it]
 63%|███��██▎   | 23754/37963 [58:34:05<31:27:13,  7.97s/it]
 63%|██████▎   | 23755/37963 [58:34:20<39:05:40,  9.91s/it]
 63%|██████▎   | 23756/37963 [58:34:28<36:51:29,  9.34s/it]
 63%|██████▎   | 23757/37963 [58:34:36<35:35:45,  9.02s/it]
 63%|██████▎   | 23758/37963 [58:34:44<34:17:34,  8.69s/it]
 63%|██████▎   | 23759/37963 [58:34:58<41:20:27, 10.48s/it]
 63%|██████▎   | 23760/37963 [58:35:06<38:07:45,  9.66s/it]
                                                           
{'loss': '0.1321', 'grad_norm': '1.586', 'learning_rate': '6.487e-06', 'epoch': '0.6259'}
+
 63%|██████▎   | 23760/37963 [58:35:06<38:07:45,  9.66s/it]
 63%|██████▎   | 23761/37963 [58:35:14<35:39:08,  9.04s/it]
 63%|██████▎   | 23762/37963 [58:35:29<42:30:54, 10.78s/it]
 63%|██████▎   | 23763/37963 [58:35:37<39:09:05,  9.93s/it]
 63%|██████▎   | 23764/37963 [58:35:44<36:42:08,  9.31s/it]
 63%|██████▎   | 23765/37963 [58:35:52<34:49:13,  8.83s/it]
 63%|██████▎   | 23766/37963 [58:36:00<33:33:11,  8.51s/it]
 63%|██████▎   | 23767/37963 [58:36:08<32:42:00,  8.29s/it]
 63%|██████▎   | 23768/37963 [58:36:15<32:01:31,  8.12s/it]
 63%|██████▎   | 23769/37963 [58:36:30<40:09:40, 10.19s/it]
 63%|██████▎   | 23770/37963 [58:36:38<37:32:17,  9.52s/it]
                                                           
{'loss': '0.1279', 'grad_norm': '1.112', 'learning_rate': '6.479e-06', 'epoch': '0.6261'}
+
 63%|██████▎   | 23770/37963 [58:36:38<37:32:17,  9.52s/it]
 63%|██████▎   | 23771/37963 [58:36:46<35:07:53,  8.91s/it]
 63%|██████▎   | 23772/37963 [58:37:01<42:22:59, 10.75s/it]
 63%|██████▎   | 23773/37963 [58:37:09<38:40:35,  9.81s/it]
 63%|██████▎   | 23774/37963 [58:37:16<35:58:46,  9.13s/it]
 63%|██████▎   | 23775/37963 [58:37:24<34:21:44,  8.72s/it]
 63%|██████▎   | 23776/37963 [58:37:32<33:19:57,  8.46s/it]
 63%|██████▎   | 23777/37963 [58:37:40<32:33:40,  8.26s/it]
 63%|██████▎   | 23778/37963 [58:37:47<31:57:20,  8.11s/it]
 63%|██████▎   | 23779/37963 [58:37:55<31:54:57,  8.10s/it]
 63%|██████▎   | 23780/37963 [58:38:03<31:33:04,  8.01s/it]
                                                           
{'loss': '0.1301', 'grad_norm': '1.841', 'learning_rate': '6.471e-06', 'epoch': '0.6264'}
+
 63%|██████▎   | 23780/37963 [58:38:03<31:33:04,  8.01s/it]
 63%|██████▎   | 23781/37963 [58:38:11<31:21:25,  7.96s/it]
 63%|██████▎   | 23782/37963 [58:38:19<31:05:30,  7.89s/it]
 63%|██████▎   | 23783/37963 [58:38:33<39:01:30,  9.91s/it]
 63%|██████▎   | 23784/37963 [58:38:41<36:36:08,  9.29s/it]
 63%|██████▎   | 23785/37963 [58:38:49<34:41:01,  8.81s/it]
 63%|██████▎   | 23786/37963 [58:38:56<33:17:00,  8.45s/it]
 63%|██████▎   | 23787/37963 [58:39:04<32:26:31,  8.24s/it]
 63%|██████▎   | 23788/37963 [58:39:12<31:52:09,  8.09s/it]
 63%|██████▎   | 23789/37963 [58:39:20<31:28:12,  7.99s/it]
 63%|██████▎   | 23790/37963 [58:39:28<31:16:53,  7.95s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '1.492', 'learning_rate': '6.463e-06', 'epoch': '0.6267'}
+
 63%|██████▎   | 23790/37963 [58:39:28<31:16:53,  7.95s/it]
 63%|██████▎   | 23791/37963 [58:39:43<39:59:06, 10.16s/it]
 63%|██████▎   | 23792/37963 [58:39:51<37:29:15,  9.52s/it]
 63%|██████▎   | 23793/37963 [58:39:59<35:25:40,  9.00s/it]
 63%|██████▎   | 23794/37963 [58:40:13<41:27:51, 10.54s/it]
 63%|██████▎   | 23795/37963 [58:40:21<38:46:29,  9.85s/it]
 63%|██████▎   | 23796/37963 [58:40:29<36:14:10,  9.21s/it]
 63%|██████▎   | 23797/37963 [58:40:36<34:23:57,  8.74s/it]
 63%|██████▎   | 23798/37963 [58:40:44<33:15:51,  8.45s/it]
 63%|██████▎   | 23799/37963 [58:40:52<32:32:02,  8.27s/it]
 63%|██████▎   | 23800/37963 [58:41:07<40:22:18, 10.26s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '2.558', 'learning_rate': '6.455e-06', 'epoch': '0.6269'}
+
 63%|██████▎   | 23800/37963 [58:41:07<40:22:18, 10.26s/it]
 63%|██████▎   | 23801/37963 [58:41:15<37:24:49,  9.51s/it]
 63%|██████▎   | 23802/37963 [58:41:22<35:08:19,  8.93s/it]
 63%|██████▎   | 23803/37963 [58:41:30<33:50:01,  8.60s/it]
 63%|██████▎   | 23804/37963 [58:41:38<32:47:43,  8.34s/it]
 63%|██████▎   | 23805/37963 [58:41:46<32:14:17,  8.20s/it]
 63%|██████▎   | 23806/37963 [58:42:01<40:17:24, 10.25s/it]
 63%|██████▎   | 23807/37963 [58:42:08<37:06:55,  9.44s/it]
 63%|█��████▎   | 23808/37963 [58:42:16<35:08:40,  8.94s/it]
 63%|██████▎   | 23809/37963 [58:42:24<33:47:17,  8.59s/it]
 63%|██████▎   | 23810/37963 [58:42:32<32:47:19,  8.34s/it]
                                                           
{'loss': '0.1213', 'grad_norm': '1.973', 'learning_rate': '6.447e-06', 'epoch': '0.6272'}
+
 63%|██████▎   | 23810/37963 [58:42:32<32:47:19,  8.34s/it]
 63%|██████▎   | 23811/37963 [58:42:39<32:11:48,  8.19s/it]
 63%|██████▎   | 23812/37963 [58:42:54<39:22:43, 10.02s/it]
 63%|██████▎   | 23813/37963 [58:43:02<36:58:08,  9.41s/it]
 63%|██████▎   | 23814/37963 [58:43:09<34:53:42,  8.88s/it]
 63%|██████▎   | 23815/37963 [58:43:17<33:16:31,  8.47s/it]
 63%|██████▎   | 23816/37963 [58:43:25<32:23:23,  8.24s/it]
 63%|██████▎   | 23817/37963 [58:43:39<39:48:04, 10.13s/it]
 63%|██████▎   | 23818/37963 [58:43:47<37:17:00,  9.49s/it]
 63%|██████▎   | 23819/37963 [58:44:02<43:59:18, 11.20s/it]
 63%|██████▎   | 23820/37963 [58:44:10<40:04:24, 10.20s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '1.9', 'learning_rate': '6.439e-06', 'epoch': '0.6275'}
+
 63%|██████▎   | 23820/37963 [58:44:10<40:04:24, 10.20s/it]
 63%|██████▎   | 23821/37963 [58:44:18<37:10:35,  9.46s/it]
 63%|██████▎   | 23822/37963 [58:44:26<35:14:20,  8.97s/it]
 63%|██████▎   | 23823/37963 [58:44:33<33:42:56,  8.58s/it]
 63%|██████▎   | 23824/37963 [58:44:41<32:42:51,  8.33s/it]
 63%|██████▎   | 23825/37963 [58:44:49<32:00:37,  8.15s/it]
 63%|██████▎   | 23826/37963 [58:44:57<31:35:40,  8.05s/it]
 63%|██████▎   | 23827/37963 [58:45:12<39:42:52, 10.11s/it]
 63%|██████▎   | 23828/37963 [58:45:19<37:01:40,  9.43s/it]
 63%|██████▎   | 23829/37963 [58:45:27<34:42:41,  8.84s/it]
 63%|██████▎   | 23830/37963 [58:45:34<33:01:36,  8.41s/it]
                                                           
{'loss': '0.1393', 'grad_norm': '1.374', 'learning_rate': '6.431e-06', 'epoch': '0.6277'}
+
 63%|██████▎   | 23830/37963 [58:45:34<33:01:36,  8.41s/it]
 63%|██████▎   | 23831/37963 [58:45:42<32:13:44,  8.21s/it]
 63%|██████▎   | 23832/37963 [58:45:50<31:25:04,  8.00s/it]
 63%|██████▎   | 23833/37963 [58:45:57<31:01:24,  7.90s/it]
 63%|██████▎   | 23834/37963 [58:46:12<39:09:37,  9.98s/it]
 63%|██████▎   | 23835/37963 [58:46:20<36:48:17,  9.38s/it]
 63%|██████▎   | 23836/37963 [58:46:28<34:53:56,  8.89s/it]
 63%|██████▎   | 23837/37963 [58:46:35<33:15:43,  8.48s/it]
 63%|██████▎   | 23838/37963 [58:46:50<40:18:02, 10.27s/it]
 63%|██████▎   | 23839/37963 [58:46:58<37:24:07,  9.53s/it]
 63%|██████▎   | 23840/37963 [58:47:05<35:15:02,  8.99s/it]
                                                           
{'loss': '0.1286', 'grad_norm': '2.068', 'learning_rate': '6.423e-06', 'epoch': '0.628'}
+
 63%|██████▎   | 23840/37963 [58:47:05<35:15:02,  8.99s/it]
 63%|██████▎   | 23841/37963 [58:47:13<33:47:11,  8.61s/it]
 63%|██████▎   | 23842/37963 [58:47:21<32:44:24,  8.35s/it]
 63%|██████▎   | 23843/37963 [58:47:29<32:02:04,  8.17s/it]
 63%|██████▎   | 23844/37963 [58:47:36<31:25:07,  8.01s/it]
 63%|██████▎   | 23845/37963 [58:47:44<31:08:51,  7.94s/it]
 63%|██████▎   | 23846/37963 [58:47:52<30:54:05,  7.88s/it]
 63%|██████▎   | 23847/37963 [58:48:06<38:41:27,  9.87s/it]
 63%|██████▎   | 23848/37963 [58:48:14<36:25:07,  9.29s/it]
 63%|██████▎   | 23849/37963 [58:48:22<34:42:05,  8.85s/it]
 63%|██████▎   | 23850/37963 [58:48:30<33:24:52,  8.52s/it]
                                                           
{'loss': '0.1268', 'grad_norm': '2.785', 'learning_rate': '6.415e-06', 'epoch': '0.6282'}
+
 63%|██████▎   | 23850/37963 [58:48:30<33:24:52,  8.52s/it]
 63%|██████▎   | 23851/37963 [58:48:37<32:17:35,  8.24s/it]
 63%|██████▎   | 23852/37963 [58:48:45<31:37:52,  8.07s/it]
 63%|██████▎   | 23853/37963 [58:48:53<31:13:54,  7.97s/it]
 63%|██████▎   | 23854/37963 [58:49:08<39:38:39, 10.12s/it]
 63%|██████▎   | 23855/37963 [58:49:16<36:59:31,  9.44s/it]
 63%|██████▎   | 23856/37963 [58:49:23<35:01:02,  8.94s/it]
 63%|██████▎   | 23857/37963 [58:49:31<33:25:14,  8.53s/it]
 63%|██████▎   | 23858/37963 [58:49:39<32:22:35,  8.26s/it]
 63%|██████▎   | 23859/37963 [58:49:47<31:55:45,  8.15s/it]
 63%|██████▎   | 23860/37963 [58:49:54<31:37:23,  8.07s/it]
                                                           
{'loss': '0.1232', 'grad_norm': '1.895', 'learning_rate': '6.407e-06', 'epoch': '0.6285'}
+
 63%|██████▎   | 23860/37963 [58:49:54<31:37:23,  8.07s/it]
 63%|██████▎   | 23861/37963 [58:50:02<31:22:22,  8.01s/it]
 63%|██████▎   | 23862/37963 [58:50:10<31:05:50,  7.94s/it]
 63%|██████▎   | 23863/37963 [58:50:18<30:52:05,  7.88s/it]
 63%|██████▎   | 23864/37963 [58:50:32<38:39:20,  9.87s/it]
 63%|██████▎   | 23865/37963 [58:50:47<44:39:10, 11.40s/it]
 63%|██████▎   | 23866/37963 [58:50:55<40:42:02, 10.39s/it]
 63%|██████▎   | 23867/37963 [58:51:03<37:38:51,  9.61s/it]
 63%|██████▎   | 23868/37963 [58:51:18<43:38:57, 11.15s/it]
 63%|██████▎   | 23869/37963 [58:51:26<39:38:42, 10.13s/it]
 63%|██████▎   | 23870/37963 [58:51:33<36:44:09,  9.38s/it]
                                                           
{'loss': '0.1336', 'grad_norm': '1.699', 'learning_rate': '6.399e-06', 'epoch': '0.6288'}
+
 63%|██████▎   | 23870/37963 [58:51:33<36:44:09,  9.38s/it]
 63%|██████▎   | 23871/37963 [58:51:41<34:47:03,  8.89s/it]
 63%|██████▎   | 23872/37963 [58:51:49<33:41:46,  8.61s/it]
 63%|██████▎   | 23873/37963 [58:51:57<32:44:06,  8.36s/it]
 63%|██████▎   | 23874/37963 [58:52:05<31:59:27,  8.17s/it]
 63%|██████▎   | 23875/37963 [58:52:19<39:36:31, 10.12s/it]
 63%|██████▎   | 23876/37963 [58:52:27<36:57:32,  9.45s/it]
 63%|██████▎   | 23877/37963 [58:52:35<34:57:37,  8.93s/it]
 63%|██████▎   | 23878/37963 [58:52:43<33:36:01,  8.59s/it]
 63%|██████▎   | 23879/37963 [58:52:50<32:37:23,  8.34s/it]
 63%|██████▎   | 23880/37963 [58:52:58<32:05:03,  8.20s/it]
                                                           
{'loss': '0.1193', 'grad_norm': '1.828', 'learning_rate': '6.391e-06', 'epoch': '0.629'}
+
 63%|██████▎   | 23880/37963 [58:52:58<32:05:03,  8.20s/it]
 63%|██████▎   | 23881/37963 [58:53:06<31:33:03,  8.07s/it]
 63%|██████▎   | 23882/37963 [58:53:21<39:51:32, 10.19s/it]
 63%|██████▎   | 23883/37963 [58:53:29<37:01:37,  9.47s/it]
 63%|██████▎   | 23884/37963 [58:53:37<35:08:46,  8.99s/it]
 63%|██████▎   | 23885/37963 [58:53:45<33:58:09,  8.69s/it]
 63%|██████▎   | 23886/37963 [58:53:53<33:02:47,  8.45s/it]
 63%|██████▎   | 23887/37963 [58:54:01<32:30:24,  8.31s/it]
 63%|██████▎   | 23888/37963 [58:54:09<32:06:31,  8.21s/it]
 63%|██████▎   | 23889/37963 [58:54:16<31:25:48,  8.04s/it]
 63%|██████▎   | 23890/37963 [58:54:24<31:08:40,  7.97s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '3.232', 'learning_rate': '6.383e-06', 'epoch': '0.6293'}
+
 63%|██████▎   | 23890/37963 [58:54:24<31:08:40,  7.97s/it]
 63%|██████▎   | 23891/37963 [58:54:31<30:31:13,  7.81s/it]
 63%|██████▎   | 23892/37963 [58:54:46<38:27:49,  9.84s/it]
 63%|██████▎   | 23893/37963 [58:54:54<36:21:14,  9.30s/it]
 63%|██████▎   | 23894/37963 [58:55:02<34:45:11,  8.89s/it]
 63%|██████▎   | 23895/37963 [58:55:10<33:26:38,  8.56s/it]
 63%|██████▎   | 23896/37963 [58:55:18<32:35:39,  8.34s/it]
 63%|██████▎   | 23897/37963 [58:55:25<31:54:11,  8.17s/it]
 63%|██████▎   | 23898/37963 [58:55:33<31:22:38,  8.03s/it]
 63%|██████▎   | 23899/37963 [58:55:41<31:16:33,  8.01s/it]
 63%|██████▎   | 23900/37963 [58:55:49<30:57:00,  7.92s/it]
                                                           
{'loss': '0.1277', 'grad_norm': '1.227', 'learning_rate': '6.375e-06', 'epoch': '0.6296'}
+
 63%|██████▎   | 23900/37963 [58:55:49<30:57:00,  7.92s/it]
 63%|██████▎   | 23901/37963 [58:56:03<38:42:26,  9.91s/it]
 63%|██████▎   | 23902/37963 [58:56:18<44:34:58, 11.41s/it]
 63%|██████▎   | 23903/37963 [58:56:27<40:50:00, 10.46s/it]
 63%|██████▎   | 23904/37963 [58:56:34<37:44:43,  9.67s/it]
 63%|██████▎   | 23905/37963 [58:56:42<35:35:23,  9.11s/it]
 63%|██████▎   | 23906/37963 [58:56:50<34:08:14,  8.74s/it]
 63%|██████▎   | 23907/37963 [58:56:58<33:01:05,  8.46s/it]
 63%|██████▎   | 23908/37963 [58:57:06<32:35:43,  8.35s/it]
 63%|██████▎   | 23909/37963 [58:57:14<31:57:31,  8.19s/it]
 63%|██████▎   | 23910/37963 [58:57:22<31:33:13,  8.08s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '2.485', 'learning_rate': '6.367e-06', 'epoch': '0.6298'}
+
 63%|██████▎   | 23910/37963 [58:57:22<31:33:13,  8.08s/it]
 63%|██████▎   | 23911/37963 [58:57:29<31:09:51,  7.98s/it]
 63%|██████▎   | 23912/37963 [58:57:44<39:03:44, 10.01s/it]
 63%|██████▎   | 23913/37963 [58:57:52<36:42:36,  9.41s/it]
 63%|██████▎   | 23914/37963 [58:58:00<34:50:07,  8.93s/it]
 63%|██████▎   | 23915/37963 [58:58:15<41:40:27, 10.68s/it]
 63%|██████▎   | 23916/37963 [58:58:23<38:32:17,  9.88s/it]
 63%|██████▎   | 23917/37963 [58:58:37<44:06:19, 11.30s/it]
 63%|██████▎   | 23918/37963 [58:58:45<39:58:06, 10.24s/it]
 63%|██████▎   | 23919/37963 [58:58:53<37:20:08,  9.57s/it]
 63%|██████▎   | 23920/37963 [58:59:01<35:06:21,  9.00s/it]
                                                           
{'loss': '0.1152', 'grad_norm': '1.256', 'learning_rate': '6.359e-06', 'epoch': '0.6301'}
+
 63%|██████▎   | 23920/37963 [58:59:01<35:06:21,  9.00s/it]
 63%|██████▎   | 23921/37963 [58:59:08<33:41:16,  8.64s/it]
 63%|██████▎   | 23922/37963 [58:59:17<32:59:02,  8.46s/it]
 63%|██████▎   | 23923/37963 [58:59:24<32:08:18,  8.24s/it]
 63%|██████▎   | 23924/37963 [58:59:33<32:09:59,  8.25s/it]
 63%|██████▎   | 23925/37963 [58:59:40<31:38:47,  8.12s/it]
 63%|██████▎   | 23926/37963 [58:59:55<39:33:17, 10.14s/it]
 63%|██████▎   | 23927/37963 [59:00:03<37:18:06,  9.57s/it]
 63%|██████▎   | 23928/37963 [59:00:12<35:43:53,  9.17s/it]
 63%|██████▎   | 23929/37963 [59:00:20<34:29:45,  8.85s/it]
 63%|██████▎   | 23930/37963 [59:00:28<33:23:42,  8.57s/it]
                                                           
{'loss': '0.1396', 'grad_norm': '3.177', 'learning_rate': '6.351e-06', 'epoch': '0.6304'}
+
 63%|██████▎   | 23930/37963 [59:00:28<33:23:42,  8.57s/it]
 63%|██████▎   | 23931/37963 [59:00:36<32:35:11,  8.36s/it]
 63%|██████▎   | 23932/37963 [59:00:43<31:55:13,  8.19s/it]
 63%|██████▎   | 23933/37963 [59:00:51<31:41:42,  8.13s/it]
 63%|██████▎   | 23934/37963 [59:00:59<31:23:49,  8.06s/it]
 63%|██████▎   | 23935/37963 [59:01:07<31:08:08,  7.99s/it]
 63%|██████▎   | 23936/37963 [59:01:22<39:40:21, 10.18s/it]
 63%|██████▎   | 23937/37963 [59:01:31<37:20:10,  9.58s/it]
 63%|██████▎   | 23938/37963 [59:01:38<35:21:01,  9.07s/it]
 63%|██████▎   | 23939/37963 [59:01:55<43:42:15, 11.22s/it]
 63%|██████▎   | 23940/37963 [59:02:03<39:51:49, 10.23s/it]
                                                           
{'loss': '0.1353', 'grad_norm': '1.293', 'learning_rate': '6.343e-06', 'epoch': '0.6306'}
+
 63%|██████▎   | 23940/37963 [59:02:03<39:51:49, 10.23s/it]
 63%|██████▎   | 23941/37963 [59:02:10<37:02:11,  9.51s/it]
 63%|██████▎   | 23942/37963 [59:02:18<35:07:38,  9.02s/it]
 63%|██████▎   | 23943/37963 [59:02:26<33:35:59,  8.63s/it]
 63%|██████▎   | 23944/37963 [59:02:34<32:32:11,  8.36s/it]
 63%|██████▎   | 23945/37963 [59:02:42<31:59:13,  8.21s/it]
 63%|██████▎   | 23946/37963 [59:02:57<40:09:25, 10.31s/it]
 63%|██████▎   | 23947/37963 [59:03:05<37:15:11,  9.57s/it]
 63%|██████▎   | 23948/37963 [59:03:12<35:06:54,  9.02s/it]
 63%|██████▎   | 23949/37963 [59:03:30<45:25:37, 11.67s/it]
 63%|██████▎   | 23950/37963 [59:03:38<41:03:17, 10.55s/it]
                                                           
{'loss': '0.1419', 'grad_norm': '2.075', 'learning_rate': '6.335e-06', 'epoch': '0.6309'}
+
 63%|██████▎   | 23950/37963 [59:03:38<41:03:17, 10.55s/it]
 63%|██████▎   | 23951/37963 [59:03:46<37:56:09,  9.75s/it]
 63%|██████▎   | 23952/37963 [59:03:54<35:23:34,  9.09s/it]
 63%|██████▎   | 23953/37963 [59:04:01<33:45:41,  8.68s/it]
 63%|██████▎   | 23954/37963 [59:04:09<32:47:40,  8.43s/it]
 63%|██████▎   | 23955/37963 [59:04:17<32:08:29,  8.26s/it]
 63%|██████▎   | 23956/37963 [59:04:39<47:52:39, 12.31s/it]
 63%|██████▎   | 23957/37963 [59:04:47<42:33:07, 10.94s/it]
 63%|██████▎   | 23958/37963 [59:04:55<39:06:52, 10.05s/it]
 63%|██████▎   | 23959/37963 [59:05:10<44:55:10, 11.55s/it]
 63%|██████▎   | 23960/37963 [59:05:18<40:50:34, 10.50s/it]
                                                           
{'loss': '0.14', 'grad_norm': '2.571', 'learning_rate': '6.327e-06', 'epoch': '0.6311'}
+
 63%|██████▎   | 23960/37963 [59:05:18<40:50:34, 10.50s/it]
 63%|██████▎   | 23961/37963 [59:05:25<37:44:34,  9.70s/it]
 63%|██████▎   | 23962/37963 [59:05:33<35:35:29,  9.15s/it]
 63%|██████▎   | 23963/37963 [59:05:41<34:09:33,  8.78s/it]
 63%|██████▎   | 23964/37963 [59:05:49<32:49:09,  8.44s/it]
 63%|██████▎   | 23965/37963 [59:05:57<32:05:12,  8.25s/it]
 63%|██████▎   | 23966/37963 [59:06:04<31:30:22,  8.10s/it]
 63%|██████▎   | 23967/37963 [59:06:12<31:04:00,  7.99s/it]
 63%|██████▎   | 23968/37963 [59:06:20<30:53:07,  7.94s/it]
 63%|██████▎   | 23969/37963 [59:06:28<30:43:14,  7.90s/it]
 63%|██████▎   | 23970/37963 [59:06:36<30:34:55,  7.87s/it]
                                                           
{'loss': '0.1292', 'grad_norm': '3.523', 'learning_rate': '6.319e-06', 'epoch': '0.6314'}
+
 63%|██████▎   | 23970/37963 [59:06:36<30:34:55,  7.87s/it]
 63%|██████▎   | 23971/37963 [59:06:50<38:32:23,  9.92s/it]
 63%|██████▎   | 23972/37963 [59:06:58<36:19:16,  9.35s/it]
 63%|██████▎   | 23973/37963 [59:07:06<34:30:13,  8.88s/it]
 63%|██████▎   | 23974/37963 [59:07:14<33:33:03,  8.63s/it]
 63%|██████▎   | 23975/37963 [59:07:22<32:42:56,  8.42s/it]
 63%|██████▎   | 23976/37963 [59:07:30<31:55:25,  8.22s/it]
 63%|██████▎   | 23977/37963 [59:07:38<31:26:54,  8.09s/it]
 63%|██████▎   | 23978/37963 [59:07:45<31:06:19,  8.01s/it]
 63%|██████▎   | 23979/37963 [59:07:53<30:54:43,  7.96s/it]
 63%|██████▎   | 23980/37963 [59:08:15<47:07:04, 12.13s/it]
                                                           
{'loss': '0.1334', 'grad_norm': '1.835', 'learning_rate': '6.312e-06', 'epoch': '0.6317'}
+
 63%|██████▎   | 23980/37963 [59:08:15<47:07:04, 12.13s/it]
 63%|██████▎   | 23981/37963 [59:08:23<42:18:48, 10.89s/it]
 63%|██████▎   | 23982/37963 [59:08:31<38:42:30,  9.97s/it]
 63%|██████▎   | 23983/37963 [59:08:39<36:16:49,  9.34s/it]
 63%|██████▎   | 23984/37963 [59:08:46<34:09:25,  8.80s/it]
 63%|██████▎   | 23985/37963 [59:08:54<33:08:05,  8.53s/it]
 63%|██████▎   | 23986/37963 [59:09:02<32:12:09,  8.29s/it]
 63%|██████▎   | 23987/37963 [59:09:10<31:38:04,  8.15s/it]
 63%|██████▎   | 23988/37963 [59:09:18<31:16:10,  8.06s/it]
 63%|██████▎   | 23989/37963 [59:09:26<31:02:41,  8.00s/it]
 63%|██████▎   | 23990/37963 [59:09:33<30:20:29,  7.82s/it]
                                                           
{'loss': '0.129', 'grad_norm': '1.33', 'learning_rate': '6.304e-06', 'epoch': '0.6319'}
+
 63%|██████▎   | 23990/37963 [59:09:33<30:20:29,  7.82s/it]
 63%|██████▎   | 23991/37963 [59:09:41<30:24:24,  7.83s/it]
 63%|██████▎   | 23992/37963 [59:09:49<30:19:15,  7.81s/it]
 63%|██████▎   | 23993/37963 [59:09:56<30:04:37,  7.75s/it]
 63%|██████▎   | 23994/37963 [59:10:04<30:13:35,  7.79s/it]
 63%|██████▎   | 23995/37963 [59:10:12<30:18:52,  7.81s/it]
 63%|██████▎   | 23996/37963 [59:10:20<30:12:59,  7.79s/it]
 63%|██████▎   | 23997/37963 [59:10:27<29:54:24,  7.71s/it]
 63%|██████▎   | 23998/37963 [59:10:42<37:49:43,  9.75s/it]
 63%|██████▎   | 23999/37963 [59:10:50<35:55:29,  9.26s/it]
 63%|██████▎   | 24000/37963 [59:11:05<42:15:19, 10.89s/it]
                                                           
{'loss': '0.1298', 'grad_norm': '1.842', 'learning_rate': '6.296e-06', 'epoch': '0.6322'}
+
 63%|██████▎   | 24000/37963 [59:11:05<42:15:19, 10.89s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.76s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.76s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 63%|██████▎   | 24001/37963 [59:12:13<109:29:17, 28.23s/it]
 63%|██████▎   | 24002/37963 [59:12:21<85:59:26, 22.17s/it] 
 63%|██████▎   | 24003/37963 [59:12:29<69:11:33, 17.84s/it]
 63%|██████▎   | 24004/37963 [59:12:37<57:26:17, 14.81s/it]
 63%|██████▎   | 24005/37963 [59:12:52<57:24:55, 14.81s/it]
 63%|██████▎   | 24006/37963 [59:12:59<49:07:08, 12.67s/it]
 63%|██████▎   | 24007/37963 [59:13:15<52:15:17, 13.48s/it]
 63%|██████▎   | 24008/37963 [59:13:22<45:32:41, 11.75s/it]
 63%|██████▎   | 24009/37963 [59:13:30<40:55:21, 10.56s/it]
 63%|██████▎   | 24010/37963 [59:13:38<37:38:24,  9.71s/it]
                                                           
{'loss': '0.1273', 'grad_norm': '3.492', 'learning_rate': '6.288e-06', 'epoch': '0.6325'}
+
 63%|██████▎   | 24010/37963 [59:13:38<37:38:24,  9.71s/it]
 63%|██████▎   | 24011/37963 [59:13:46<35:29:33,  9.16s/it]
 63%|██████▎   | 24012/37963 [59:13:53<33:51:11,  8.74s/it]
 63%|██████▎   | 24013/37963 [59:14:01<32:41:06,  8.43s/it]
 63%|██████▎   | 24014/37963 [59:14:09<31:59:28,  8.26s/it]
 63%|██████▎   | 24015/37963 [59:14:17<31:29:27,  8.13s/it]
 63%|██████▎   | 24016/37963 [59:14:25<31:05:18,  8.02s/it]
 63%|██████▎   | 24017/37963 [59:14:32<30:37:38,  7.91s/it]
 63%|██████▎   | 24018/37963 [59:14:40<30:28:32,  7.87s/it]
 63%|██████▎   | 24019/37963 [59:14:48<30:23:28,  7.85s/it]
 63%|██████▎   | 24020/37963 [59:14:56<30:15:48,  7.81s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '5.413', 'learning_rate': '6.28e-06', 'epoch': '0.6327'}
+
 63%|██████▎   | 24020/37963 [59:14:56<30:15:48,  7.81s/it]
 63%|██████▎   | 24021/37963 [59:15:03<29:55:03,  7.73s/it]
 63%|██████▎   | 24022/37963 [59:15:17<37:42:11,  9.74s/it]
 63%|██████▎   | 24023/37963 [59:15:25<35:36:50,  9.20s/it]
 63%|██████▎   | 24024/37963 [59:15:33<33:47:03,  8.73s/it]
 63%|██████▎   | 24025/37963 [59:15:48<40:50:05, 10.55s/it]
 63%|██████▎   | 24026/37963 [59:15:56<38:08:02,  9.85s/it]
 63%|██████▎   | 24027/37963 [59:16:04<35:48:16,  9.25s/it]
 63%|██████▎   | 24028/37963 [59:16:12<34:12:37,  8.84s/it]
 63%|██████▎   | 24029/37963 [59:16:26<40:50:37, 10.55s/it]
 63%|██████▎   | 24030/37963 [59:16:34<37:57:31,  9.81s/it]
                                                           
{'loss': '0.1379', 'grad_norm': '2.996', 'learning_rate': '6.272e-06', 'epoch': '0.633'}
+
 63%|██████▎   | 24030/37963 [59:16:34<37:57:31,  9.81s/it]
 63%|██████▎   | 24031/37963 [59:16:42<35:49:15,  9.26s/it]
 63%|██████▎   | 24032/37963 [59:16:50<34:10:49,  8.83s/it]
 63%|██████▎   | 24033/37963 [59:16:58<33:01:21,  8.53s/it]
 63%|██████▎   | 24034/37963 [59:17:06<32:06:00,  8.30s/it]
 63%|██████▎   | 24035/37963 [59:17:14<31:36:19,  8.17s/it]
 63%|██████▎   | 24036/37963 [59:17:29<40:27:38, 10.46s/it]
 63%|██████▎   | 24037/37963 [59:17:38<37:41:37,  9.74s/it]
 63%|██████▎   | 24038/37963 [59:17:45<35:27:13,  9.17s/it]
 63%|██████▎   | 24039/37963 [59:17:53<33:52:50,  8.76s/it]
 63%|██████▎   | 24040/37963 [59:18:01<32:24:50,  8.38s/it]
                                                           
{'loss': '0.1363', 'grad_norm': '1.738', 'learning_rate': '6.264e-06', 'epoch': '0.6333'}
+
 63%|██████▎   | 24040/37963 [59:18:01<32:24:50,  8.38s/it]
 63%|██████▎   | 24041/37963 [59:18:08<31:42:26,  8.20s/it]
 63%|██████▎   | 24042/37963 [59:18:16<31:16:16,  8.09s/it]
 63%|██████▎   | 24043/37963 [59:18:24<30:30:48,  7.89s/it]
 63%|██████▎   | 24044/37963 [59:18:31<30:06:04,  7.79s/it]
 63%|██████▎   | 24045/37963 [59:18:46<38:38:09,  9.99s/it]
 63%|██████▎   | 24046/37963 [59:18:54<36:24:21,  9.42s/it]
 63%|██████▎   | 24047/37963 [59:19:09<42:36:52, 11.02s/it]
 63%|██████▎   | 24048/37963 [59:19:17<38:56:42, 10.08s/it]
 63%|██████▎   | 24049/37963 [59:19:25<36:24:42,  9.42s/it]
 63%|██████▎   | 24050/37963 [59:19:33<34:45:17,  8.99s/it]
                                                           
{'loss': '0.14', 'grad_norm': '1.273', 'learning_rate': '6.256e-06', 'epoch': '0.6335'}
+
 63%|██████▎   | 24050/37963 [59:19:33<34:45:17,  8.99s/it]
 63%|██████▎   | 24051/37963 [59:19:48<42:03:07, 10.88s/it]
 63%|██████▎   | 24052/37963 [59:19:56<38:34:46,  9.98s/it]
 63%|██████▎   | 24053/37963 [59:20:04<36:14:36,  9.38s/it]
 63%|██████▎   | 24054/37963 [59:20:19<43:04:22, 11.15s/it]
 63%|██████▎   | 24055/37963 [59:20:27<39:05:47, 10.12s/it]
 63%|██████▎   | 24056/37963 [59:20:35<36:17:34,  9.39s/it]
 63%|██████▎   | 24057/37963 [59:20:43<34:24:53,  8.91s/it]
 63%|██████▎   | 24058/37963 [59:20:51<33:16:09,  8.61s/it]
 63%|██████▎   | 24059/37963 [59:21:05<40:04:59, 10.38s/it]
 63%|██████▎   | 24060/37963 [59:21:13<37:16:59,  9.65s/it]
                                                           
{'loss': '0.1367', 'grad_norm': '1.712', 'learning_rate': '6.248e-06', 'epoch': '0.6338'}
+
 63%|██████▎   | 24060/37963 [59:21:13<37:16:59,  9.65s/it]
 63%|██████▎   | 24061/37963 [59:21:21<35:09:57,  9.11s/it]
 63%|██████▎   | 24062/37963 [59:21:29<33:40:43,  8.72s/it]
 63%|██████▎   | 24063/37963 [59:21:36<32:31:57,  8.43s/it]
 63%|██████▎   | 24064/37963 [59:21:44<31:46:37,  8.23s/it]
 63%|██████▎   | 24065/37963 [59:21:52<30:57:54,  8.02s/it]
 63%|██████▎   | 24066/37963 [59:22:00<30:46:19,  7.97s/it]
 63%|██████▎   | 24067/37963 [59:22:07<30:09:53,  7.81s/it]
 63%|██████▎   | 24068/37963 [59:22:15<29:59:23,  7.77s/it]
 63%|██████▎   | 24069/37963 [59:22:23<30:06:50,  7.80s/it]
 63%|██████▎   | 24070/37963 [59:22:38<38:23:20,  9.95s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '2.073', 'learning_rate': '6.24e-06', 'epoch': '0.634'}
+
 63%|██████▎   | 24070/37963 [59:22:38<38:23:20,  9.95s/it]
 63%|██████▎   | 24071/37963 [59:22:45<36:02:19,  9.34s/it]
 63%|██████▎   | 24072/37963 [59:22:53<34:16:04,  8.88s/it]
 63%|██████▎   | 24073/37963 [59:23:08<41:11:20, 10.68s/it]
 63%|██████▎   | 24074/37963 [59:23:16<38:08:08,  9.88s/it]
 63%|██████▎   | 24075/37963 [59:23:24<35:49:59,  9.29s/it]
 63%|██████▎   | 24076/37963 [59:23:32<34:02:18,  8.82s/it]
 63%|██████▎   | 24077/37963 [59:23:40<32:59:21,  8.55s/it]
 63%|██████▎   | 24078/37963 [59:23:48<32:07:34,  8.33s/it]
 63%|██████▎   | 24079/37963 [59:23:55<30:56:26,  8.02s/it]
 63%|██████▎   | 24080/37963 [59:24:03<30:36:28,  7.94s/it]
                                                           
{'loss': '0.1288', 'grad_norm': '1.766', 'learning_rate': '6.232e-06', 'epoch': '0.6343'}
+
 63%|██████▎   | 24080/37963 [59:24:03<30:36:28,  7.94s/it]
 63%|██████▎   | 24081/37963 [59:24:10<30:21:07,  7.87s/it]
 63%|██████▎   | 24082/37963 [59:24:18<30:14:47,  7.84s/it]
 63%|██████▎   | 24083/37963 [59:24:32<37:32:16,  9.74s/it]
 63%|██████▎   | 24084/37963 [59:24:40<35:24:16,  9.18s/it]
 63%|██████▎   | 24085/37963 [59:24:48<33:47:34,  8.77s/it]
 63%|██████▎   | 24086/37963 [59:24:55<32:23:53,  8.40s/it]
 63%|██████▎   | 24087/37963 [59:25:03<31:40:09,  8.22s/it]
 63%|██████▎   | 24088/37963 [59:25:11<31:16:48,  8.12s/it]
 63%|██████▎   | 24089/37963 [59:25:19<30:47:46,  7.99s/it]
 63%|██████▎   | 24090/37963 [59:25:26<30:23:04,  7.88s/it]
                                                           
{'loss': '0.1241', 'grad_norm': '2.476', 'learning_rate': '6.224e-06', 'epoch': '0.6346'}
+
 63%|██████▎   | 24090/37963 [59:25:26<30:23:04,  7.88s/it]
 63%|██████▎   | 24091/37963 [59:25:34<30:10:29,  7.83s/it]
 63%|██████▎   | 24092/37963 [59:25:42<30:03:50,  7.80s/it]
 63%|██████▎   | 24093/37963 [59:25:49<29:44:47,  7.72s/it]
 63%|██████▎   | 24094/37963 [59:26:04<37:39:48,  9.78s/it]
 63%|██████▎   | 24095/37963 [59:26:19<43:20:05, 11.25s/it]
 63%|██████▎   | 24096/37963 [59:26:27<39:52:03, 10.35s/it]
 63%|██████▎   | 24097/37963 [59:26:35<37:08:14,  9.64s/it]
 63%|██████▎   | 24098/37963 [59:26:43<34:49:03,  9.04s/it]
 63%|██████▎   | 24099/37963 [59:26:58<41:47:46, 10.85s/it]
 63%|██████▎   | 24100/37963 [59:27:13<46:47:15, 12.15s/it]
                                                           
{'loss': '0.1288', 'grad_norm': '1.804', 'learning_rate': '6.217e-06', 'epoch': '0.6348'}
+
 63%|██████▎   | 24100/37963 [59:27:13<46:47:15, 12.15s/it]
 63%|██████▎   | 24101/37963 [59:27:21<42:00:23, 10.91s/it]
 63%|██████▎   | 24102/37963 [59:27:29<38:23:03,  9.97s/it]
 63%|██████▎   | 24103/37963 [59:27:43<43:18:27, 11.25s/it]
 63%|██████▎   | 24104/37963 [59:27:51<39:39:57, 10.30s/it]
 63%|██████▎   | 24105/37963 [59:27:59<36:42:38,  9.54s/it]
 63%|██████▎   | 24106/37963 [59:28:07<34:43:47,  9.02s/it]
 64%|██████▎   | 24107/37963 [59:28:14<33:12:47,  8.63s/it]
 64%|██████▎   | 24108/37963 [59:28:22<31:57:42,  8.30s/it]
 64%|██████▎   | 24109/37963 [59:28:29<31:16:42,  8.13s/it]
 64%|██████▎   | 24110/37963 [59:28:37<30:52:16,  8.02s/it]
                                                           
{'loss': '0.1291', 'grad_norm': '3.254', 'learning_rate': '6.209e-06', 'epoch': '0.6351'}
+
 64%|██████▎   | 24110/37963 [59:28:37<30:52:16,  8.02s/it]
 64%|██████▎   | 24111/37963 [59:28:45<30:24:14,  7.90s/it]
 64%|██████▎   | 24112/37963 [59:28:53<30:18:51,  7.88s/it]
 64%|██████▎   | 24113/37963 [59:29:01<30:21:21,  7.89s/it]
 64%|██████▎   | 24114/37963 [59:29:08<30:12:36,  7.85s/it]
 64%|██████▎   | 24115/37963 [59:29:16<29:59:26,  7.80s/it]
 64%|██████▎   | 24116/37963 [59:29:24<29:54:14,  7.77s/it]
 64%|██████▎   | 24117/37963 [59:29:38<37:28:58,  9.75s/it]
 64%|██████▎   | 24118/37963 [59:29:46<35:23:27,  9.20s/it]
 64%|██████▎   | 24119/37963 [59:29:54<34:01:08,  8.85s/it]
 64%|██████▎   | 24120/37963 [59:30:02<32:51:27,  8.54s/it]
                                                           
{'loss': '0.1356', 'grad_norm': '3.339', 'learning_rate': '6.201e-06', 'epoch': '0.6354'}
+
 64%|██████▎   | 24120/37963 [59:30:02<32:51:27,  8.54s/it]
 64%|██████▎   | 24121/37963 [59:30:10<31:51:39,  8.29s/it]
 64%|██████▎   | 24122/37963 [59:30:25<40:23:55, 10.51s/it]
 64%|██████▎   | 24123/37963 [59:30:33<37:17:38,  9.70s/it]
 64%|██████▎   | 24124/37963 [59:30:41<34:45:32,  9.04s/it]
 64%|██████▎   | 24125/37963 [59:30:48<33:21:47,  8.68s/it]
 64%|██████▎   | 24126/37963 [59:30:56<31:57:08,  8.31s/it]
 64%|██████▎   | 24127/37963 [59:31:04<31:14:52,  8.13s/it]
 64%|██████▎   | 24128/37963 [59:31:11<30:48:45,  8.02s/it]
 64%|██████▎   | 24129/37963 [59:31:19<30:24:07,  7.91s/it]
 64%|██████▎   | 24130/37963 [59:31:27<30:11:09,  7.86s/it]
                                                           
{'loss': '0.1321', 'grad_norm': '1.009', 'learning_rate': '6.193e-06', 'epoch': '0.6356'}
+
 64%|██████▎   | 24130/37963 [59:31:27<30:11:09,  7.86s/it]
 64%|██████▎   | 24131/37963 [59:31:35<30:06:54,  7.84s/it]
 64%|██████▎   | 24132/37963 [59:31:42<30:00:11,  7.81s/it]
 64%|██████▎   | 24133/37963 [59:31:50<29:58:53,  7.80s/it]
 64%|██████▎   | 24134/37963 [59:31:58<30:01:35,  7.82s/it]
 64%|██████▎   | 24135/37963 [59:32:05<29:32:55,  7.69s/it]
 64%|██████▎   | 24136/37963 [59:32:13<29:43:22,  7.74s/it]
 64%|██████▎   | 24137/37963 [59:32:27<37:00:34,  9.64s/it]
 64%|██████▎   | 24138/37963 [59:32:42<43:16:38, 11.27s/it]
 64%|██████▎   | 24139/37963 [59:32:50<39:32:23, 10.30s/it]
 64%|██████▎   | 24140/37963 [59:32:58<36:49:13,  9.59s/it]
                                                           
{'loss': '0.1373', 'grad_norm': '1.344', 'learning_rate': '6.185e-06', 'epoch': '0.6359'}
+
 64%|██████▎   | 24140/37963 [59:32:58<36:49:13,  9.59s/it]
 64%|██████▎   | 24141/37963 [59:33:06<34:41:26,  9.04s/it]
 64%|██████▎   | 24142/37963 [59:33:14<33:13:47,  8.66s/it]
 64%|██████▎   | 24143/37963 [59:33:29<40:27:50, 10.54s/it]
 64%|██████▎   | 24144/37963 [59:33:37<37:17:52,  9.72s/it]
 64%|██████▎   | 24145/37963 [59:33:44<34:57:49,  9.11s/it]
 64%|██████▎   | 24146/37963 [59:33:52<33:27:13,  8.72s/it]
 64%|██████▎   | 24147/37963 [59:34:06<40:00:29, 10.42s/it]
 64%|██████▎   | 24148/37963 [59:34:22<45:41:58, 11.91s/it]
 64%|██████▎   | 24149/37963 [59:34:37<48:58:09, 12.76s/it]
 64%|██████▎   | 24150/37963 [59:34:44<43:15:48, 11.28s/it]
                                                           
{'loss': '0.127', 'grad_norm': '2.297', 'learning_rate': '6.177e-06', 'epoch': '0.6361'}
+
 64%|██████▎   | 24150/37963 [59:34:44<43:15:48, 11.28s/it]
 64%|██████▎   | 24151/37963 [59:34:52<39:08:30, 10.20s/it]
 64%|██████▎   | 24152/37963 [59:35:00<36:14:24,  9.45s/it]
 64%|██████▎   | 24153/37963 [59:35:07<34:11:55,  8.91s/it]
 64%|██████▎   | 24154/37963 [59:35:15<32:32:43,  8.48s/it]
 64%|██████▎   | 24155/37963 [59:35:23<32:05:33,  8.37s/it]
 64%|██████▎   | 24156/37963 [59:35:31<31:32:07,  8.22s/it]
 64%|██████▎   | 24157/37963 [59:35:39<30:58:13,  8.08s/it]
 64%|██████▎   | 24158/37963 [59:35:47<30:47:48,  8.03s/it]
 64%|██████▎   | 24159/37963 [59:35:54<30:31:30,  7.96s/it]
 64%|██████▎   | 24160/37963 [59:36:02<30:15:50,  7.89s/it]
                                                           
{'loss': '0.1408', 'grad_norm': '1.612', 'learning_rate': '6.169e-06', 'epoch': '0.6364'}
+
 64%|██████▎   | 24160/37963 [59:36:02<30:15:50,  7.89s/it]
 64%|██████▎   | 24161/37963 [59:36:10<30:13:57,  7.89s/it]
 64%|██████▎   | 24162/37963 [59:36:18<30:08:41,  7.86s/it]
 64%|██████▎   | 24163/37963 [59:36:32<37:29:09,  9.78s/it]
 64%|██████▎   | 24164/37963 [59:36:40<35:17:50,  9.21s/it]
 64%|██████▎   | 24165/37963 [59:36:48<33:37:40,  8.77s/it]
 64%|██████▎   | 24166/37963 [59:36:55<32:30:08,  8.48s/it]
 64%|██████▎   | 24167/37963 [59:37:03<31:37:22,  8.25s/it]
 64%|██████▎   | 24168/37963 [59:37:11<31:08:05,  8.13s/it]
 64%|██████▎   | 24169/37963 [59:37:19<30:46:58,  8.03s/it]
 64%|██████▎   | 24170/37963 [59:37:34<39:02:55, 10.19s/it]
                                                           
{'loss': '0.1344', 'grad_norm': '3.813', 'learning_rate': '6.161e-06', 'epoch': '0.6367'}
+
 64%|██████▎   | 24170/37963 [59:37:34<39:02:55, 10.19s/it]
 64%|██████▎   | 24171/37963 [59:37:42<36:31:03,  9.53s/it]
 64%|██████▎   | 24172/37963 [59:37:50<34:44:41,  9.07s/it]
 64%|██████▎   | 24173/37963 [59:37:58<33:33:14,  8.76s/it]
 64%|██████▎   | 24174/37963 [59:38:06<32:21:08,  8.45s/it]
 64%|██████▎   | 24175/37963 [59:38:13<31:30:15,  8.23s/it]
 64%|██████▎   | 24176/37963 [59:38:21<31:08:30,  8.13s/it]
 64%|██████▎   | 24177/37963 [59:38:29<30:41:43,  8.02s/it]
 64%|██████▎   | 24178/37963 [59:38:37<30:20:49,  7.93s/it]
 64%|██████▎   | 24179/37963 [59:38:45<30:17:38,  7.91s/it]
 64%|██████▎   | 24180/37963 [59:38:52<30:05:56,  7.86s/it]
                                                           
{'loss': '0.1315', 'grad_norm': '1.422', 'learning_rate': '6.153e-06', 'epoch': '0.6369'}
+
 64%|██████▎   | 24180/37963 [59:38:52<30:05:56,  7.86s/it]
 64%|██████▎   | 24181/37963 [59:39:07<37:54:28,  9.90s/it]
 64%|██████▎   | 24182/37963 [59:39:15<35:36:59,  9.30s/it]
 64%|██████▎   | 24183/37963 [59:39:23<34:05:46,  8.91s/it]
 64%|██████▎   | 24184/37963 [59:39:31<32:51:49,  8.59s/it]
 64%|██████▎   | 24185/37963 [59:39:39<32:01:07,  8.37s/it]
 64%|██████▎   | 24186/37963 [59:39:47<31:21:31,  8.19s/it]
 64%|██████▎   | 24187/37963 [59:39:54<30:50:32,  8.06s/it]
 64%|██████▎   | 24188/37963 [59:40:02<30:34:00,  7.99s/it]
 64%|██████▎   | 24189/37963 [59:40:18<39:23:11, 10.29s/it]
 64%|██████▎   | 24190/37963 [59:40:26<36:35:51,  9.57s/it]
                                                           
{'loss': '0.129', 'grad_norm': '1.899', 'learning_rate': '6.146e-06', 'epoch': '0.6372'}
+
 64%|██████▎   | 24190/37963 [59:40:26<36:35:51,  9.57s/it]
 64%|██████▎   | 24191/37963 [59:40:33<34:20:07,  8.98s/it]
 64%|██████▎   | 24192/37963 [59:40:48<41:33:45, 10.87s/it]
 64%|██████▎   | 24193/37963 [59:40:56<38:12:14,  9.99s/it]
 64%|██████▎   | 24194/37963 [59:41:04<35:32:40,  9.29s/it]
 64%|██████▎   | 24195/37963 [59:41:18<41:06:48, 10.75s/it]
 64%|██████▎   | 24196/37963 [59:41:26<37:42:43,  9.86s/it]
 64%|██████▎   | 24197/37963 [59:41:48<51:02:58, 13.35s/it]
 64%|██████▎   | 24198/37963 [59:41:55<44:29:02, 11.63s/it]
 64%|██████▎   | 24199/37963 [59:42:03<40:19:45, 10.55s/it]
 64%|██████▎   | 24200/37963 [59:42:11<37:01:53,  9.69s/it]
                                                           
{'loss': '0.1235', 'grad_norm': '2.7', 'learning_rate': '6.138e-06', 'epoch': '0.6375'}
+
 64%|██████▎   | 24200/37963 [59:42:11<37:01:53,  9.69s/it]
 64%|██████▎   | 24201/37963 [59:42:19<34:52:43,  9.12s/it]
 64%|██████▍   | 24202/37963 [59:42:27<33:24:39,  8.74s/it]
 64%|██████▍   | 24203/37963 [59:42:34<32:07:29,  8.40s/it]
 64%|██████▍   | 24204/37963 [59:42:42<31:11:00,  8.16s/it]
 64%|██████▍   | 24205/37963 [59:42:49<30:27:38,  7.97s/it]
 64%|██████▍   | 24206/37963 [59:42:57<30:08:15,  7.89s/it]
 64%|██████▍   | 24207/37963 [59:43:05<29:49:52,  7.81s/it]
 64%|██████▍   | 24208/37963 [59:43:12<29:21:11,  7.68s/it]
 64%|██████▍   | 24209/37963 [59:43:20<29:17:29,  7.67s/it]
 64%|██████▍   | 24210/37963 [59:43:34<37:35:53,  9.84s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '2.901', 'learning_rate': '6.13e-06', 'epoch': '0.6377'}
+
 64%|██████▍   | 24210/37963 [59:43:35<37:35:53,  9.84s/it]
 64%|██████▍   | 24211/37963 [59:43:42<35:20:08,  9.25s/it]
 64%|██████▍   | 24212/37963 [59:43:50<33:46:26,  8.84s/it]
 64%|██████▍   | 24213/37963 [59:43:58<32:23:31,  8.48s/it]
 64%|██████▍   | 24214/37963 [59:44:13<40:02:00, 10.48s/it]
 64%|██████▍   | 24215/37963 [59:44:21<36:55:37,  9.67s/it]
 64%|██████▍   | 24216/37963 [59:44:29<34:42:17,  9.09s/it]
 64%|██████▍   | 24217/37963 [59:44:36<33:12:42,  8.70s/it]
 64%|██████▍   | 24218/37963 [59:44:44<31:54:22,  8.36s/it]
 64%|██████▍   | 24219/37963 [59:44:52<31:37:36,  8.28s/it]
 64%|██████▍   | 24220/37963 [59:45:00<31:18:55,  8.20s/it]
                                                           
{'loss': '0.1219', 'grad_norm': '2.068', 'learning_rate': '6.122e-06', 'epoch': '0.638'}
+
 64%|██████▍   | 24220/37963 [59:45:00<31:18:55,  8.20s/it]
 64%|██████▍   | 24221/37963 [59:45:08<30:56:11,  8.10s/it]
 64%|██████▍   | 24222/37963 [59:45:16<30:27:23,  7.98s/it]
 64%|██████▍   | 24223/37963 [59:45:23<30:20:04,  7.95s/it]
 64%|██████▍   | 24224/37963 [59:45:31<30:05:25,  7.88s/it]
 64%|██████▍   | 24225/37963 [59:45:39<30:06:28,  7.89s/it]
 64%|██████▍   | 24226/37963 [59:45:54<37:56:33,  9.94s/it]
 64%|██████▍   | 24227/37963 [59:46:02<35:46:12,  9.37s/it]
 64%|██████▍   | 24228/37963 [59:46:10<33:55:40,  8.89s/it]
 64%|██████▍   | 24229/37963 [59:46:17<32:16:53,  8.46s/it]
 64%|██████▍   | 24230/37963 [59:46:25<31:40:16,  8.30s/it]
                                                           
{'loss': '0.1366', 'grad_norm': '1.715', 'learning_rate': '6.114e-06', 'epoch': '0.6383'}
+
 64%|██████▍   | 24230/37963 [59:46:25<31:40:16,  8.30s/it]
 64%|██████▍   | 24231/37963 [59:46:33<31:04:23,  8.15s/it]
 64%|██████▍   | 24232/37963 [59:46:41<30:37:40,  8.03s/it]
 64%|██████▍   | 24233/37963 [59:46:49<30:30:37,  8.00s/it]
 64%|██████▍   | 24234/37963 [59:46:56<30:08:26,  7.90s/it]
 64%|██████▍   | 24235/37963 [59:47:04<29:57:26,  7.86s/it]
 64%|██████▍   | 24236/37963 [59:47:12<29:37:48,  7.77s/it]
 64%|██████▍   | 24237/37963 [59:47:19<29:30:31,  7.74s/it]
 64%|██████▍   | 24238/37963 [59:47:41<45:50:54, 12.03s/it]
 64%|██████▍   | 24239/37963 [59:47:49<40:57:30, 10.74s/it]
 64%|██████▍   | 24240/37963 [59:47:57<37:40:10,  9.88s/it]
                                                           
{'loss': '0.1242', 'grad_norm': '2.423', 'learning_rate': '6.106e-06', 'epoch': '0.6385'}
+
 64%|██████▍   | 24240/37963 [59:47:57<37:40:10,  9.88s/it]
 64%|██████▍   | 24241/37963 [59:48:04<34:54:24,  9.16s/it]
 64%|██████▍   | 24242/37963 [59:48:19<41:13:27, 10.82s/it]
 64%|██████▍   | 24243/37963 [59:48:26<37:24:43,  9.82s/it]
 64%|██████▍   | 24244/37963 [59:48:34<35:00:53,  9.19s/it]
 64%|██████▍   | 24245/37963 [59:48:49<41:42:14, 10.94s/it]
 64%|██████▍   | 24246/37963 [59:48:57<37:50:46,  9.93s/it]
 64%|██████▍   | 24247/37963 [59:49:04<35:01:21,  9.19s/it]
 64%|██████▍   | 24248/37963 [59:49:12<33:27:29,  8.78s/it]
 64%|██████▍   | 24249/37963 [59:49:20<32:22:19,  8.50s/it]
 64%|██████▍   | 24250/37963 [59:49:34<39:01:22, 10.24s/it]
                                                           
{'loss': '0.1358', 'grad_norm': '2.075', 'learning_rate': '6.098e-06', 'epoch': '0.6388'}
+
 64%|██████▍   | 24250/37963 [59:49:34<39:01:22, 10.24s/it]
 64%|██████▍   | 24251/37963 [59:49:42<36:20:32,  9.54s/it]
 64%|██████▍   | 24252/37963 [59:49:50<34:24:16,  9.03s/it]
 64%|██████▍   | 24253/37963 [59:49:58<32:52:18,  8.63s/it]
 64%|██████▍   | 24254/37963 [59:50:05<31:51:03,  8.36s/it]
 64%|██████▍   | 24255/37963 [59:50:13<31:11:31,  8.19s/it]
 64%|██████▍   | 24256/37963 [59:50:21<30:44:00,  8.07s/it]
 64%|██████▍   | 24257/37963 [59:50:36<38:32:23, 10.12s/it]
 64%|██████▍   | 24258/37963 [59:50:44<36:01:00,  9.46s/it]
 64%|██████▍   | 24259/37963 [59:50:52<34:04:33,  8.95s/it]
 64%|██████▍   | 24260/37963 [59:50:59<32:43:03,  8.60s/it]
                                                           
{'loss': '0.125', 'grad_norm': '1.234', 'learning_rate': '6.091e-06', 'epoch': '0.639'}
+
 64%|██████▍   | 24260/37963 [59:50:59<32:43:03,  8.60s/it]
 64%|██████▍   | 24261/37963 [59:51:07<32:09:50,  8.45s/it]
 64%|██████▍   | 24262/37963 [59:51:15<31:27:09,  8.26s/it]
 64%|██████▍   | 24263/37963 [59:51:23<30:51:17,  8.11s/it]
 64%|██████▍   | 24264/37963 [59:51:38<38:28:09, 10.11s/it]
 64%|██████▍   | 24265/37963 [59:51:45<35:33:09,  9.34s/it]
 64%|██████▍   | 24266/37963 [59:51:53<33:48:21,  8.89s/it]
 64%|██████▍   | 24267/37963 [59:52:01<32:26:02,  8.53s/it]
 64%|██████▍   | 24268/37963 [59:52:09<31:40:48,  8.33s/it]
 64%|██████▍   | 24269/37963 [59:52:17<31:11:37,  8.20s/it]
 64%|██████▍   | 24270/37963 [59:52:24<30:44:05,  8.08s/it]
                                                           
{'loss': '0.1365', 'grad_norm': '2.221', 'learning_rate': '6.083e-06', 'epoch': '0.6393'}
+
 64%|██████▍   | 24270/37963 [59:52:24<30:44:05,  8.08s/it]
 64%|██████▍   | 24271/37963 [59:52:32<30:28:27,  8.01s/it]
 64%|██████▍   | 24272/37963 [59:52:40<29:53:59,  7.86s/it]
 64%|██████▍   | 24273/37963 [59:52:48<29:56:11,  7.87s/it]
 64%|██████▍   | 24274/37963 [59:52:56<29:55:35,  7.87s/it]
 64%|██████▍   | 24275/37963 [59:53:03<29:38:26,  7.80s/it]
 64%|██████▍   | 24276/37963 [59:53:11<29:41:17,  7.81s/it]
 64%|██████▍   | 24277/37963 [59:53:26<37:40:53,  9.91s/it]
 64%|██████▍   | 24278/37963 [59:53:34<35:31:14,  9.34s/it]
 64%|██████▍   | 24279/37963 [59:53:42<33:33:31,  8.83s/it]
 64%|██████▍   | 24280/37963 [59:53:50<32:51:34,  8.65s/it]
                                                           
{'loss': '0.1296', 'grad_norm': '2.238', 'learning_rate': '6.075e-06', 'epoch': '0.6396'}
+
 64%|██████▍   | 24280/37963 [59:53:50<32:51:34,  8.65s/it]
 64%|██████▍   | 24281/37963 [59:53:58<31:53:36,  8.39s/it]
 64%|██████▍   | 24282/37963 [59:54:13<39:33:46, 10.41s/it]
 64%|██████▍   | 24283/37963 [59:54:21<37:00:48,  9.74s/it]
 64%|██████▍   | 24284/37963 [59:54:29<34:42:06,  9.13s/it]
 64%|██████▍   | 24285/37963 [59:54:44<41:27:44, 10.91s/it]
 64%|██████▍   | 24286/37963 [59:54:51<37:59:44, 10.00s/it]
 64%|██████▍   | 24287/37963 [59:54:59<35:09:11,  9.25s/it]
 64%|██████▍   | 24288/37963 [59:55:13<40:41:34, 10.71s/it]
 64%|██████▍   | 24289/37963 [59:55:21<37:38:54,  9.91s/it]
 64%|██████▍   | 24290/37963 [59:55:29<35:10:57,  9.26s/it]
                                                           
{'loss': '0.1265', 'grad_norm': '1.198', 'learning_rate': '6.067e-06', 'epoch': '0.6398'}
+
 64%|██████▍   | 24290/37963 [59:55:29<35:10:57,  9.26s/it]
 64%|██████▍   | 24291/37963 [59:55:37<33:27:47,  8.81s/it]
 64%|██████▍   | 24292/37963 [59:55:44<32:15:20,  8.49s/it]
 64%|██████▍   | 24293/37963 [59:55:59<39:33:17, 10.42s/it]
 64%|██████▍   | 24294/37963 [59:56:07<36:48:42,  9.70s/it]
 64%|██████▍   | 24295/37963 [59:56:15<34:40:27,  9.13s/it]
 64%|██████▍   | 24296/37963 [59:56:23<33:19:59,  8.78s/it]
 64%|██████▍   | 24297/37963 [59:56:31<31:50:36,  8.39s/it]
 64%|██████▍   | 24298/37963 [59:56:39<31:25:29,  8.28s/it]
 64%|██████▍   | 24299/37963 [59:56:46<30:56:58,  8.15s/it]
 64%|██████▍   | 24300/37963 [59:56:54<30:22:24,  8.00s/it]
                                                           
{'loss': '0.1286', 'grad_norm': '1.989', 'learning_rate': '6.059e-06', 'epoch': '0.6401'}
+
 64%|██████▍   | 24300/37963 [59:56:54<30:22:24,  8.00s/it]
 64%|██████▍   | 24301/37963 [59:57:02<29:56:28,  7.89s/it]
 64%|██████▍   | 24302/37963 [59:57:09<29:47:09,  7.85s/it]
 64%|██████▍   | 24303/37963 [59:57:17<29:40:11,  7.82s/it]
 64%|██████▍   | 24304/37963 [59:57:32<37:12:02,  9.80s/it]
 64%|██████▍   | 24305/37963 [59:57:40<35:07:44,  9.26s/it]
 64%|██████▍   | 24306/37963 [59:57:48<33:32:54,  8.84s/it]
 64%|██████▍   | 24307/37963 [59:57:55<32:28:02,  8.56s/it]
 64%|██████▍   | 24308/37963 [59:58:03<31:41:36,  8.36s/it]
 64%|██████▍   | 24309/37963 [59:58:11<30:56:44,  8.16s/it]
 64%|██████▍   | 24310/37963 [59:58:26<38:34:30, 10.17s/it]
                                                           
{'loss': '0.1253', 'grad_norm': '1.276', 'learning_rate': '6.051e-06', 'epoch': '0.6404'}
+
 64%|██████▍   | 24310/37963 [59:58:26<38:34:30, 10.17s/it]
 64%|██████▍   | 24311/37963 [59:58:34<36:18:26,  9.57s/it]
 64%|██████▍   | 24312/37963 [59:58:42<34:05:15,  8.99s/it]
 64%|██████▍   | 24313/37963 [59:58:57<41:32:52, 10.96s/it]
 64%|██████▍   | 24314/37963 [59:59:05<38:08:42, 10.06s/it]
 64%|██████▍   | 24315/37963 [59:59:13<35:52:45,  9.46s/it]
 64%|██████▍   | 24316/37963 [59:59:21<33:58:13,  8.96s/it]
 64%|██████▍   | 24317/37963 [59:59:29<32:21:31,  8.54s/it]
 64%|██████▍   | 24318/37963 [59:59:36<31:35:01,  8.33s/it]
 64%|██████▍   | 24319/37963 [59:59:44<30:41:08,  8.10s/it]
 64%|██████▍   | 24320/37963 [59:59:52<30:14:16,  7.98s/it]
                                                           
{'loss': '0.1392', 'grad_norm': '1.981', 'learning_rate': '6.043e-06', 'epoch': '0.6406'}
+
 64%|██████▍   | 24320/37963 [59:59:52<30:14:16,  7.98s/it]
 64%|██████▍   | 24321/37963 [60:00:00<30:04:32,  7.94s/it]
 64%|██████▍   | 24322/37963 [60:00:14<37:19:50,  9.85s/it]
 64%|██████▍   | 24323/37963 [60:00:22<34:54:14,  9.21s/it]
 64%|██████▍   | 24324/37963 [60:00:29<33:17:32,  8.79s/it]
 64%|██████▍   | 24325/37963 [60:00:37<32:11:23,  8.50s/it]
 64%|██████▍   | 24326/37963 [60:00:52<39:07:54, 10.33s/it]
 64%|██████▍   | 24327/37963 [60:01:00<36:24:17,  9.61s/it]
 64%|██████▍   | 24328/37963 [60:01:08<34:17:33,  9.05s/it]
 64%|██████▍   | 24329/37963 [60:01:15<33:00:10,  8.71s/it]
 64%|██████▍   | 24330/37963 [60:01:23<32:02:10,  8.46s/it]
                                                           
{'loss': '0.1278', 'grad_norm': '1.445', 'learning_rate': '6.036e-06', 'epoch': '0.6409'}
+
 64%|██████▍   | 24330/37963 [60:01:23<32:02:10,  8.46s/it]
 64%|██████▍   | 24331/37963 [60:01:31<31:14:11,  8.25s/it]
 64%|██████▍   | 24332/37963 [60:01:39<30:39:49,  8.10s/it]
 64%|██████▍   | 24333/37963 [60:01:54<38:43:12, 10.23s/it]
 64%|██████▍   | 24334/37963 [60:02:09<43:35:16, 11.51s/it]
 64%|██████▍   | 24335/37963 [60:02:17<39:46:06, 10.51s/it]
 64%|██████▍   | 24336/37963 [60:02:24<36:19:27,  9.60s/it]
 64%|██████▍   | 24337/37963 [60:02:39<42:35:26, 11.25s/it]
 64%|██████▍   | 24338/37963 [60:02:47<38:46:55, 10.25s/it]
 64%|██████▍   | 24339/37963 [60:02:55<35:29:41,  9.38s/it]
 64%|██████▍   | 24340/37963 [60:03:02<33:39:21,  8.89s/it]
                                                           
{'loss': '0.1378', 'grad_norm': '1.967', 'learning_rate': '6.028e-06', 'epoch': '0.6412'}
+
 64%|██████▍   | 24340/37963 [60:03:02<33:39:21,  8.89s/it]
 64%|██████▍   | 24341/37963 [60:03:10<32:21:43,  8.55s/it]
 64%|██████▍   | 24342/37963 [60:03:18<31:18:05,  8.27s/it]
 64%|██████▍   | 24343/37963 [60:03:25<30:34:07,  8.08s/it]
 64%|██████▍   | 24344/37963 [60:03:33<30:07:51,  7.96s/it]
 64%|██████▍   | 24345/37963 [60:03:40<29:29:20,  7.80s/it]
 64%|██████▍   | 24346/37963 [60:03:48<29:04:33,  7.69s/it]
 64%|██████▍   | 24347/37963 [60:03:55<28:48:17,  7.62s/it]
 64%|██████▍   | 24348/37963 [60:04:03<29:02:54,  7.68s/it]
 64%|██████▍   | 24349/37963 [60:04:11<28:53:46,  7.64s/it]
 64%|██████▍   | 24350/37963 [60:04:18<28:56:59,  7.66s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '1.798', 'learning_rate': '6.02e-06', 'epoch': '0.6414'}
+
 64%|██████▍   | 24350/37963 [60:04:18<28:56:59,  7.66s/it]
 64%|██████▍   | 24351/37963 [60:04:26<28:54:08,  7.64s/it]
 64%|██████▍   | 24352/37963 [60:04:34<29:03:39,  7.69s/it]
 64%|██████▍   | 24353/37963 [60:04:49<37:31:56,  9.93s/it]
 64%|██████▍   | 24354/37963 [60:05:04<43:25:06, 11.49s/it]
 64%|██████▍   | 24355/37963 [60:05:12<39:41:30, 10.50s/it]
 64%|██████▍   | 24356/37963 [60:05:20<37:01:29,  9.80s/it]
 64%|██████▍   | 24357/37963 [60:05:28<34:44:04,  9.19s/it]
 64%|██████▍   | 24358/37963 [60:05:36<32:59:04,  8.73s/it]
 64%|██████▍   | 24359/37963 [60:05:43<31:48:39,  8.42s/it]
 64%|██████▍   | 24360/37963 [60:05:51<31:05:08,  8.23s/it]
                                                           
{'loss': '0.1279', 'grad_norm': '1.446', 'learning_rate': '6.012e-06', 'epoch': '0.6417'}
+
 64%|██████▍   | 24360/37963 [60:05:51<31:05:08,  8.23s/it]
 64%|██████▍   | 24361/37963 [60:06:09<41:23:28, 10.95s/it]
 64%|██████▍   | 24362/37963 [60:06:16<37:51:58, 10.02s/it]
 64%|██████▍   | 24363/37963 [60:06:24<35:21:49,  9.36s/it]
 64%|██████▍   | 24364/37963 [60:06:32<33:37:37,  8.90s/it]
 64%|██████▍   | 24365/37963 [60:06:40<31:57:14,  8.46s/it]
 64%|██████▍   | 24366/37963 [60:06:47<31:10:41,  8.25s/it]
 64%|██████▍   | 24367/37963 [60:06:55<30:32:43,  8.09s/it]
 64%|██████▍   | 24368/37963 [60:07:03<30:06:54,  7.97s/it]
 64%|██████▍   | 24369/37963 [60:07:11<29:56:05,  7.93s/it]
 64%|██████▍   | 24370/37963 [60:07:26<38:53:56, 10.30s/it]
                                                           
{'loss': '0.1167', 'grad_norm': '3.158', 'learning_rate': '6.004e-06', 'epoch': '0.6419'}
+
 64%|██████▍   | 24370/37963 [60:07:26<38:53:56, 10.30s/it]
 64%|██████▍   | 24371/37963 [60:07:34<36:10:50,  9.58s/it]
 64%|██████▍   | 24372/37963 [60:07:42<33:59:54,  9.01s/it]
 64%|██████▍   | 24373/37963 [60:07:50<32:39:15,  8.65s/it]
 64%|██████▍   | 24374/37963 [60:07:57<31:28:22,  8.34s/it]
 64%|██████▍   | 24375/37963 [60:08:05<31:01:14,  8.22s/it]
 64%|██████▍   | 24376/37963 [60:08:20<38:36:43, 10.23s/it]
 64%|██████▍   | 24377/37963 [60:08:28<35:56:21,  9.52s/it]
 64%|██████▍   | 24378/37963 [60:08:36<33:55:09,  8.99s/it]
 64%|██████▍   | 24379/37963 [60:08:44<32:29:06,  8.61s/it]
 64%|██████▍   | 24380/37963 [60:08:51<31:35:36,  8.37s/it]
                                                           
{'loss': '0.1257', 'grad_norm': '2.395', 'learning_rate': '5.997e-06', 'epoch': '0.6422'}
+
 64%|██████▍   | 24380/37963 [60:08:51<31:35:36,  8.37s/it]
 64%|██████▍   | 24381/37963 [60:08:59<30:41:37,  8.14s/it]
 64%|██████▍   | 24382/37963 [60:09:07<30:16:16,  8.02s/it]
 64%|██████▍   | 24383/37963 [60:09:22<38:26:47, 10.19s/it]
 64%|██████▍   | 24384/37963 [60:09:37<43:49:31, 11.62s/it]
 64%|██████▍   | 24385/37963 [60:09:44<39:13:13, 10.40s/it]
 64%|██████▍   | 24386/37963 [60:09:59<44:08:42, 11.71s/it]
 64%|██████▍   | 24387/37963 [60:10:07<39:51:06, 10.57s/it]
 64%|██████▍   | 24388/37963 [60:10:15<36:37:59,  9.71s/it]
 64%|██████▍   | 24389/37963 [60:10:22<34:14:11,  9.08s/it]
 64%|██████▍   | 24390/37963 [60:10:30<32:42:54,  8.68s/it]
                                                           
{'loss': '0.1368', 'grad_norm': '1.368', 'learning_rate': '5.989e-06', 'epoch': '0.6425'}
+
 64%|██████▍   | 24390/37963 [60:10:30<32:42:54,  8.68s/it]
 64%|██████▍   | 24391/37963 [60:10:38<31:47:42,  8.43s/it]
 64%|██████▍   | 24392/37963 [60:10:46<31:08:48,  8.26s/it]
 64%|██████▍   | 24393/37963 [60:10:54<30:25:24,  8.07s/it]
 64%|██████▍   | 24394/37963 [60:11:01<29:59:45,  7.96s/it]
 64%|██████▍   | 24395/37963 [60:11:09<29:40:45,  7.87s/it]
 64%|██████▍   | 24396/37963 [60:11:17<29:29:15,  7.82s/it]
 64%|██████▍   | 24397/37963 [60:11:24<29:24:21,  7.80s/it]
 64%|██████▍   | 24398/37963 [60:11:32<29:24:19,  7.80s/it]
 64%|██████▍   | 24399/37963 [60:11:40<29:28:35,  7.82s/it]
 64%|██████▍   | 24400/37963 [60:11:48<29:32:14,  7.84s/it]
                                                           
{'loss': '0.1285', 'grad_norm': '1.28', 'learning_rate': '5.981e-06', 'epoch': '0.6427'}
+
 64%|██████▍   | 24400/37963 [60:11:48<29:32:14,  7.84s/it]
 64%|██████▍   | 24401/37963 [60:12:02<36:49:15,  9.77s/it]
 64%|██████▍   | 24402/37963 [60:12:17<42:09:19, 11.19s/it]
 64%|██████▍   | 24403/37963 [60:12:25<38:50:03, 10.31s/it]
 64%|██████▍   | 24404/37963 [60:12:33<36:03:16,  9.57s/it]
 64%|██████▍   | 24405/37963 [60:12:49<43:37:17, 11.58s/it]
 64%|██████▍   | 24406/37963 [60:12:57<39:39:28, 10.53s/it]
 64%|██████▍   | 24407/37963 [60:13:05<36:32:56,  9.71s/it]
 64%|██████▍   | 24408/37963 [60:13:13<34:11:00,  9.08s/it]
 64%|██████▍   | 24409/37963 [60:13:20<32:40:33,  8.68s/it]
 64%|██████▍   | 24410/37963 [60:13:28<31:45:11,  8.43s/it]
                                                           
{'loss': '0.1297', 'grad_norm': '2.038', 'learning_rate': '5.973e-06', 'epoch': '0.643'}
+
 64%|██████▍   | 24410/37963 [60:13:28<31:45:11,  8.43s/it]
 64%|██████▍   | 24411/37963 [60:13:36<31:03:48,  8.25s/it]
 64%|██████▍   | 24412/37963 [60:13:44<30:36:11,  8.13s/it]
 64%|██████▍   | 24413/37963 [60:13:51<29:59:02,  7.97s/it]
 64%|██████▍   | 24414/37963 [60:13:59<30:01:04,  7.98s/it]
 64%|██████▍   | 24415/37963 [60:14:07<29:41:21,  7.89s/it]
 64%|██████▍   | 24416/37963 [60:14:15<29:48:49,  7.92s/it]
 64%|██████▍   | 24417/37963 [60:14:23<29:37:53,  7.87s/it]
 64%|██████▍   | 24418/37963 [60:14:31<29:35:57,  7.87s/it]
 64%|██████▍   | 24419/37963 [60:14:38<29:11:14,  7.76s/it]
 64%|██████▍   | 24420/37963 [60:14:46<29:12:10,  7.76s/it]
                                                           
{'loss': '0.1202', 'grad_norm': '4.148', 'learning_rate': '5.965e-06', 'epoch': '0.6433'}
+
 64%|██████▍   | 24420/37963 [60:14:46<29:12:10,  7.76s/it]
 64%|██████▍   | 24421/37963 [60:15:01<36:49:45,  9.79s/it]
 64%|██████▍   | 24422/37963 [60:15:09<35:00:43,  9.31s/it]
 64%|██████▍   | 24423/37963 [60:15:17<33:21:11,  8.87s/it]
 64%|██████▍   | 24424/37963 [60:15:24<32:12:21,  8.56s/it]
 64%|██████▍   | 24425/37963 [60:15:32<31:15:44,  8.31s/it]
 64%|██████▍   | 24426/37963 [60:15:40<30:44:28,  8.18s/it]
 64%|██████▍   | 24427/37963 [60:15:48<30:03:29,  7.99s/it]
 64%|██████▍   | 24428/37963 [60:15:55<29:27:23,  7.83s/it]
 64%|██████▍   | 24429/37963 [60:16:03<29:32:46,  7.86s/it]
 64%|██████▍   | 24430/37963 [60:16:17<36:30:55,  9.71s/it]
                                                           
{'loss': '0.14', 'grad_norm': '1.997', 'learning_rate': '5.957e-06', 'epoch': '0.6435'}
+
 64%|██████▍   | 24430/37963 [60:16:17<36:30:55,  9.71s/it]
 64%|██████▍   | 24431/37963 [60:16:32<42:31:28, 11.31s/it]
 64%|██████▍   | 24432/37963 [60:16:40<39:07:51, 10.41s/it]
 64%|██████▍   | 24433/37963 [60:16:48<36:23:20,  9.68s/it]
 64%|██████▍   | 24434/37963 [60:16:56<34:26:19,  9.16s/it]
 64%|██████▍   | 24435/37963 [60:17:11<40:21:26, 10.74s/it]
 64%|██████▍   | 24436/37963 [60:17:19<37:11:02,  9.90s/it]
 64%|██████▍   | 24437/37963 [60:17:26<34:52:59,  9.28s/it]
 64%|██████▍   | 24438/37963 [60:17:34<32:56:20,  8.77s/it]
 64%|██████▍   | 24439/37963 [60:17:42<31:34:21,  8.40s/it]
 64%|██████▍   | 24440/37963 [60:17:57<39:06:50, 10.41s/it]
                                                           
{'loss': '0.131', 'grad_norm': '2.11', 'learning_rate': '5.95e-06', 'epoch': '0.6438'}
+
 64%|██████▍   | 24440/37963 [60:17:57<39:06:50, 10.41s/it]
 64%|██████▍   | 24441/37963 [60:18:05<36:24:05,  9.69s/it]
 64%|██████▍   | 24442/37963 [60:18:13<34:16:01,  9.12s/it]
 64%|██████▍   | 24443/37963 [60:18:20<32:48:32,  8.74s/it]
 64%|██████▍   | 24444/37963 [60:18:28<31:32:13,  8.40s/it]
 64%|██████▍   | 24445/37963 [60:18:36<31:09:32,  8.30s/it]
 64%|██████▍   | 24446/37963 [60:18:44<30:46:57,  8.20s/it]
 64%|██████▍   | 24447/37963 [60:18:58<37:49:57, 10.08s/it]
 64%|██████▍   | 24448/37963 [60:19:13<43:25:32, 11.57s/it]
 64%|██████▍   | 24449/37963 [60:19:21<39:12:42, 10.45s/it]
 64%|██████▍   | 24450/37963 [60:19:29<36:08:09,  9.63s/it]
                                                           
{'loss': '0.1271', 'grad_norm': '2.515', 'learning_rate': '5.942e-06', 'epoch': '0.6441'}
+
 64%|██████▍   | 24450/37963 [60:19:29<36:08:09,  9.63s/it]
 64%|██████▍   | 24451/37963 [60:19:44<42:36:08, 11.35s/it]
 64%|██████▍   | 24452/37963 [60:19:52<38:51:09, 10.35s/it]
 64%|██████▍   | 24453/37963 [60:20:00<36:03:48,  9.61s/it]
 64%|██████▍   | 24454/37963 [60:20:08<34:13:03,  9.12s/it]
 64%|██████▍   | 24455/37963 [60:20:16<32:47:33,  8.74s/it]
 64%|██████▍   | 24456/37963 [60:20:24<31:25:16,  8.37s/it]
 64%|██████▍   | 24457/37963 [60:20:31<30:42:12,  8.18s/it]
 64%|██████▍   | 24458/37963 [60:20:39<30:24:29,  8.11s/it]
 64%|██████▍   | 24459/37963 [60:20:47<29:58:00,  7.99s/it]
 64%|██████▍   | 24460/37963 [60:20:55<29:35:06,  7.89s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '1.638', 'learning_rate': '5.934e-06', 'epoch': '0.6443'}
+
 64%|██████▍   | 24460/37963 [60:20:55<29:35:06,  7.89s/it]
 64%|██████▍   | 24461/37963 [60:21:02<29:23:44,  7.84s/it]
 64%|██████▍   | 24462/37963 [60:21:10<29:05:31,  7.76s/it]
 64%|██████▍   | 24463/37963 [60:21:18<29:10:04,  7.78s/it]
 64%|██████▍   | 24464/37963 [60:21:26<29:17:26,  7.81s/it]
 64%|██████▍   | 24465/37963 [60:21:34<29:19:02,  7.82s/it]
 64%|██████▍   | 24466/37963 [60:21:49<38:08:01, 10.17s/it]
 64%|██████▍   | 24467/37963 [60:21:57<35:47:30,  9.55s/it]
 64%|██████▍   | 24468/37963 [60:22:05<34:09:17,  9.11s/it]
 64%|██████▍   | 24469/37963 [60:22:13<32:31:34,  8.68s/it]
 64%|██████▍   | 24470/37963 [60:22:21<31:33:47,  8.42s/it]
                                                           
{'loss': '0.1351', 'grad_norm': '2.919', 'learning_rate': '5.926e-06', 'epoch': '0.6446'}
+
 64%|██████▍   | 24470/37963 [60:22:21<31:33:47,  8.42s/it]
 64%|██████▍   | 24471/37963 [60:22:29<31:14:32,  8.34s/it]
 64%|██████▍   | 24472/37963 [60:22:37<30:36:55,  8.17s/it]
 64%|██████▍   | 24473/37963 [60:22:45<30:15:41,  8.08s/it]
 64%|██████▍   | 24474/37963 [60:22:53<30:06:54,  8.04s/it]
 64%|██████▍   | 24475/37963 [60:23:00<29:46:19,  7.95s/it]
 64%|██████▍   | 24476/37963 [60:23:15<37:20:43,  9.97s/it]
 64%|██████▍   | 24477/37963 [60:23:23<35:02:52,  9.36s/it]
 64%|██████▍   | 24478/37963 [60:23:31<33:15:41,  8.88s/it]
 64%|██████▍   | 24479/37963 [60:23:38<32:01:30,  8.55s/it]
 64%|██████▍   | 24480/37963 [60:23:46<31:15:06,  8.34s/it]
                                                           
{'loss': '0.1263', 'grad_norm': '2.791', 'learning_rate': '5.919e-06', 'epoch': '0.6448'}
+
 64%|██████▍   | 24480/37963 [60:23:46<31:15:06,  8.34s/it]
 64%|██████▍   | 24481/37963 [60:23:54<30:24:50,  8.12s/it]
 64%|██████▍   | 24482/37963 [60:24:02<30:10:16,  8.06s/it]
 64%|██████▍   | 24483/37963 [60:24:16<37:25:39, 10.00s/it]
 64%|██████▍   | 24484/37963 [60:24:25<35:30:02,  9.48s/it]
 64%|██████▍   | 24485/37963 [60:24:40<42:00:57, 11.22s/it]
 64%|██████▍   | 24486/37963 [60:24:48<38:07:45, 10.19s/it]
 65%|██████▍   | 24487/37963 [60:24:55<35:26:51,  9.47s/it]
 65%|██████▍   | 24488/37963 [60:25:11<41:42:10, 11.14s/it]
 65%|██████▍   | 24489/37963 [60:25:19<38:09:18, 10.19s/it]
 65%|██████▍   | 24490/37963 [60:25:26<35:09:53,  9.40s/it]
                                                           
{'loss': '0.1404', 'grad_norm': '2.883', 'learning_rate': '5.911e-06', 'epoch': '0.6451'}
+
 65%|██████▍   | 24490/37963 [60:25:26<35:09:53,  9.40s/it]
 65%|██████▍   | 24491/37963 [60:25:34<33:08:34,  8.86s/it]
 65%|██████▍   | 24492/37963 [60:25:41<31:58:16,  8.54s/it]
 65%|██████▍   | 24493/37963 [60:25:49<31:07:27,  8.32s/it]
 65%|██████▍   | 24494/37963 [60:25:57<30:27:56,  8.14s/it]
 65%|██████▍   | 24495/37963 [60:26:05<30:02:01,  8.03s/it]
 65%|██████▍   | 24496/37963 [60:26:12<29:37:00,  7.92s/it]
 65%|██████▍   | 24497/37963 [60:26:20<29:37:11,  7.92s/it]
 65%|██████▍   | 24498/37963 [60:26:28<29:32:02,  7.90s/it]
 65%|██████▍   | 24499/37963 [60:26:36<29:29:51,  7.89s/it]
 65%|██████▍   | 24500/37963 [60:26:51<37:05:21,  9.92s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '2.152', 'learning_rate': '5.903e-06', 'epoch': '0.6454'}
+
 65%|██████▍   | 24500/37963 [60:26:51<37:05:21,  9.92s/it]
 65%|██████▍   | 24501/37963 [60:26:58<34:41:54,  9.28s/it]
 65%|██████▍   | 24502/37963 [60:27:13<40:46:51, 10.91s/it]
 65%|██████▍   | 24503/37963 [60:27:21<37:40:54, 10.08s/it]
 65%|██████▍   | 24504/37963 [60:27:29<35:16:56,  9.44s/it]
 65%|██████▍   | 24505/37963 [60:27:45<41:52:00, 11.20s/it]
 65%|██████▍   | 24506/37963 [60:27:52<38:02:49, 10.18s/it]
 65%|██████▍   | 24507/37963 [60:28:00<35:16:12,  9.44s/it]
 65%|██████▍   | 24508/37963 [60:28:08<33:30:09,  8.96s/it]
 65%|██████▍   | 24509/37963 [60:28:16<32:11:54,  8.62s/it]
 65%|██████▍   | 24510/37963 [60:28:23<31:12:40,  8.35s/it]
                                                           
{'loss': '0.1271', 'grad_norm': '1.18', 'learning_rate': '5.895e-06', 'epoch': '0.6456'}
+
 65%|██████▍   | 24510/37963 [60:28:23<31:12:40,  8.35s/it]
 65%|██████▍   | 24511/37963 [60:28:31<30:33:28,  8.18s/it]
 65%|██████▍   | 24512/37963 [60:28:39<29:45:49,  7.97s/it]
 65%|██████▍   | 24513/37963 [60:28:47<29:35:55,  7.92s/it]
 65%|██████▍   | 24514/37963 [60:28:54<29:26:18,  7.88s/it]
 65%|██████▍   | 24515/37963 [60:29:02<29:19:57,  7.85s/it]
 65%|██████▍   | 24516/37963 [60:29:10<29:25:27,  7.88s/it]
 65%|██████▍   | 24517/37963 [60:29:25<37:37:16, 10.07s/it]
 65%|██████▍   | 24518/37963 [60:29:34<35:36:19,  9.53s/it]
 65%|██████▍   | 24519/37963 [60:29:41<33:45:34,  9.04s/it]
 65%|██████▍   | 24520/37963 [60:29:49<32:36:54,  8.73s/it]
                                                           
{'loss': '0.152', 'grad_norm': '2.402', 'learning_rate': '5.887e-06', 'epoch': '0.6459'}
+
 65%|██████▍   | 24520/37963 [60:29:49<32:36:54,  8.73s/it]
 65%|██████▍   | 24521/37963 [60:29:57<31:37:39,  8.47s/it]
 65%|██████▍   | 24522/37963 [60:30:05<31:06:34,  8.33s/it]
 65%|██████▍   | 24523/37963 [60:30:13<30:41:02,  8.22s/it]
 65%|██████▍   | 24524/37963 [60:30:28<38:16:48, 10.25s/it]
 65%|██████▍   | 24525/37963 [60:30:36<35:54:00,  9.62s/it]
 65%|██████▍   | 24526/37963 [60:30:44<34:00:22,  9.11s/it]
 65%|██████▍   | 24527/37963 [60:30:52<32:46:22,  8.78s/it]
 65%|██████▍   | 24528/37963 [60:31:00<31:39:29,  8.48s/it]
 65%|██████▍   | 24529/37963 [60:31:08<30:56:53,  8.29s/it]
 65%|██████▍   | 24530/37963 [60:31:15<30:01:01,  8.04s/it]
                                                           
{'loss': '0.1284', 'grad_norm': '2.402', 'learning_rate': '5.88e-06', 'epoch': '0.6462'}
+
 65%|██████▍   | 24530/37963 [60:31:15<30:01:01,  8.04s/it]
 65%|██████▍   | 24531/37963 [60:31:30<37:18:45, 10.00s/it]
 65%|██████▍   | 24532/37963 [60:31:38<34:54:51,  9.36s/it]
 65%|██████▍   | 24533/37963 [60:31:46<33:10:57,  8.89s/it]
 65%|██████▍   | 24534/37963 [60:31:54<32:07:36,  8.61s/it]
 65%|██████▍   | 24535/37963 [60:32:01<30:42:11,  8.23s/it]
 65%|██████▍   | 24536/37963 [60:32:09<30:11:08,  8.09s/it]
 65%|██████▍   | 24537/37963 [60:32:17<29:56:13,  8.03s/it]
 65%|██████▍   | 24538/37963 [60:32:25<29:47:56,  7.99s/it]
 65%|██████▍   | 24539/37963 [60:32:40<38:03:57, 10.21s/it]
 65%|██████▍   | 24540/37963 [60:32:48<35:21:28,  9.48s/it]
                                                           
{'loss': '0.1357', 'grad_norm': '2.754', 'learning_rate': '5.872e-06', 'epoch': '0.6464'}
+
 65%|██████▍   | 24540/37963 [60:32:48<35:21:28,  9.48s/it]
 65%|██████▍   | 24541/37963 [60:33:03<41:32:24, 11.14s/it]
 65%|██████▍   | 24542/37963 [60:33:11<37:50:41, 10.15s/it]
 65%|██████▍   | 24543/37963 [60:33:18<35:12:19,  9.44s/it]
 65%|██████▍   | 24544/37963 [60:33:33<40:40:42, 10.91s/it]
 65%|██████▍   | 24545/37963 [60:33:41<37:25:25, 10.04s/it]
 65%|██████▍   | 24546/37963 [60:33:49<34:56:50,  9.38s/it]
 65%|██████▍   | 24547/37963 [60:33:56<33:15:35,  8.92s/it]
 65%|██████▍   | 24548/37963 [60:34:05<32:24:23,  8.70s/it]
 65%|██████▍   | 24549/37963 [60:34:12<31:26:51,  8.44s/it]
 65%|██████▍   | 24550/37963 [60:34:20<31:00:17,  8.32s/it]
                                                           
{'loss': '0.1331', 'grad_norm': '2.323', 'learning_rate': '5.864e-06', 'epoch': '0.6467'}
+
 65%|██████▍   | 24550/37963 [60:34:20<31:00:17,  8.32s/it]
 65%|██████▍   | 24551/37963 [60:34:28<30:34:02,  8.20s/it]
 65%|██████▍   | 24552/37963 [60:34:36<30:17:04,  8.13s/it]
 65%|██████▍   | 24553/37963 [60:34:51<38:06:52, 10.23s/it]
 65%|██████▍   | 24554/37963 [60:35:00<35:50:37,  9.62s/it]
 65%|██████▍   | 24555/37963 [60:35:07<33:44:08,  9.06s/it]
 65%|██████▍   | 24556/37963 [60:35:22<40:22:32, 10.84s/it]
 65%|██████▍   | 24557/37963 [60:35:30<37:02:39,  9.95s/it]
 65%|██████▍   | 24558/37963 [60:35:38<34:45:53,  9.34s/it]
 65%|██████▍   | 24559/37963 [60:35:46<33:13:17,  8.92s/it]
 65%|██████▍   | 24560/37963 [60:35:54<31:58:06,  8.59s/it]
                                                           
{'loss': '0.1197', 'grad_norm': '1.027', 'learning_rate': '5.856e-06', 'epoch': '0.6469'}
+
 65%|██████▍   | 24560/37963 [60:35:54<31:58:06,  8.59s/it]
 65%|██████▍   | 24561/37963 [60:36:02<31:16:15,  8.40s/it]
 65%|██████▍   | 24562/37963 [60:36:10<30:39:15,  8.23s/it]
 65%|██████▍   | 24563/37963 [60:36:18<30:09:35,  8.10s/it]
 65%|██████▍   | 24564/37963 [60:36:25<29:39:11,  7.97s/it]
 65%|██████▍   | 24565/37963 [60:36:33<29:40:03,  7.97s/it]
 65%|██████▍   | 24566/37963 [60:36:41<29:43:17,  7.99s/it]
 65%|██████▍   | 24567/37963 [60:36:49<29:38:17,  7.96s/it]
 65%|██████▍   | 24568/37963 [60:36:57<29:30:04,  7.93s/it]
 65%|██████▍   | 24569/37963 [60:37:05<29:21:49,  7.89s/it]
 65%|██████▍   | 24570/37963 [60:37:20<37:47:10, 10.16s/it]
                                                           
{'loss': '0.1284', 'grad_norm': '2.176', 'learning_rate': '5.849e-06', 'epoch': '0.6472'}
+
 65%|██████▍   | 24570/37963 [60:37:20<37:47:10, 10.16s/it]
 65%|██████▍   | 24571/37963 [60:37:28<35:23:32,  9.51s/it]
 65%|██████▍   | 24572/37963 [60:37:43<41:05:24, 11.05s/it]
 65%|██████▍   | 24573/37963 [60:37:51<37:59:04, 10.21s/it]
 65%|██████▍   | 24574/37963 [60:37:59<35:30:32,  9.55s/it]
 65%|██████▍   | 24575/37963 [60:38:07<33:30:59,  9.01s/it]
 65%|██████▍   | 24576/37963 [60:38:15<32:20:23,  8.70s/it]
 65%|██████▍   | 24577/37963 [60:38:23<31:24:17,  8.45s/it]
 65%|██████▍   | 24578/37963 [60:38:31<31:02:05,  8.35s/it]
 65%|██████▍   | 24579/37963 [60:38:45<37:38:16, 10.12s/it]
 65%|██████▍   | 24580/37963 [60:38:53<35:06:23,  9.44s/it]
                                                           
{'loss': '0.1251', 'grad_norm': '1.936', 'learning_rate': '5.841e-06', 'epoch': '0.6475'}
+
 65%|██████▍   | 24580/37963 [60:38:53<35:06:23,  9.44s/it]
 65%|██████▍   | 24581/37963 [60:39:01<33:18:41,  8.96s/it]
 65%|██████▍   | 24582/37963 [60:39:09<32:00:06,  8.61s/it]
 65%|██████▍   | 24583/37963 [60:39:16<31:08:37,  8.38s/it]
 65%|██████▍   | 24584/37963 [60:39:24<30:33:28,  8.22s/it]
 65%|██████▍   | 24585/37963 [60:39:32<29:50:14,  8.03s/it]
 65%|██████▍   | 24586/37963 [60:39:40<29:35:35,  7.96s/it]
 65%|██████▍   | 24587/37963 [60:39:54<37:05:57,  9.98s/it]
 65%|██████▍   | 24588/37963 [60:40:02<35:00:24,  9.42s/it]
 65%|██████▍   | 24589/37963 [60:40:10<33:25:30,  9.00s/it]
 65%|██████▍   | 24590/37963 [60:40:18<32:02:33,  8.63s/it]
                                                           
{'loss': '0.1274', 'grad_norm': '2.889', 'learning_rate': '5.833e-06', 'epoch': '0.6477'}
+
 65%|██████▍   | 24590/37963 [60:40:18<32:02:33,  8.63s/it]
 65%|██████▍   | 24591/37963 [60:40:26<30:54:03,  8.32s/it]
 65%|██████▍   | 24592/37963 [60:40:34<30:34:02,  8.23s/it]
 65%|██████▍   | 24593/37963 [60:40:56<45:54:00, 12.36s/it]
 65%|██████▍   | 24594/37963 [60:41:04<40:57:45, 11.03s/it]
 65%|██████▍   | 24595/37963 [60:41:12<37:32:12, 10.11s/it]
 65%|██████▍   | 24596/37963 [60:41:20<34:56:05,  9.41s/it]
 65%|██████▍   | 24597/37963 [60:41:27<33:09:40,  8.93s/it]
 65%|██████▍   | 24598/37963 [60:41:35<31:53:47,  8.59s/it]
 65%|██████▍   | 24599/37963 [60:41:43<31:05:14,  8.37s/it]
 65%|██████▍   | 24600/37963 [60:41:51<30:42:34,  8.27s/it]
                                                           
{'loss': '0.1246', 'grad_norm': '2.026', 'learning_rate': '5.825e-06', 'epoch': '0.648'}
+
 65%|██████▍   | 24600/37963 [60:41:51<30:42:34,  8.27s/it]
 65%|██████▍   | 24601/37963 [60:41:59<29:53:40,  8.05s/it]
 65%|██████▍   | 24602/37963 [60:42:07<29:55:34,  8.06s/it]
 65%|██████▍   | 24603/37963 [60:42:14<29:35:29,  7.97s/it]
 65%|██████▍   | 24604/37963 [60:42:22<29:34:23,  7.97s/it]
 65%|██████▍   | 24605/37963 [60:42:37<37:05:43, 10.00s/it]
 65%|██████▍   | 24606/37963 [60:42:45<34:47:08,  9.38s/it]
 65%|██████▍   | 24607/37963 [60:42:53<32:43:17,  8.82s/it]
 65%|██████▍   | 24608/37963 [60:43:08<39:57:42, 10.77s/it]
 65%|██████▍   | 24609/37963 [60:43:16<36:29:28,  9.84s/it]
 65%|██████▍   | 24610/37963 [60:43:23<34:01:43,  9.17s/it]
                                                           
{'loss': '0.1294', 'grad_norm': '2.013', 'learning_rate': '5.818e-06', 'epoch': '0.6483'}
+
 65%|██████▍   | 24610/37963 [60:43:23<34:01:43,  9.17s/it]
 65%|██████▍   | 24611/37963 [60:43:31<32:27:19,  8.75s/it]
 65%|██████▍   | 24612/37963 [60:43:39<31:20:38,  8.45s/it]
 65%|██████▍   | 24613/37963 [60:43:46<30:38:10,  8.26s/it]
 65%|██████▍   | 24614/37963 [60:43:54<30:01:21,  8.10s/it]
 65%|██████▍   | 24615/37963 [60:44:02<29:42:57,  8.01s/it]
 65%|██████▍   | 24616/37963 [60:44:10<29:28:54,  7.95s/it]
 65%|██████▍   | 24617/37963 [60:44:18<29:18:17,  7.90s/it]
 65%|██████▍   | 24618/37963 [60:44:25<29:15:35,  7.89s/it]
 65%|██████▍   | 24619/37963 [60:44:40<36:41:45,  9.90s/it]
 65%|██████▍   | 24620/37963 [60:44:48<34:34:49,  9.33s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '2.788', 'learning_rate': '5.81e-06', 'epoch': '0.6485'}
+
 65%|██████▍   | 24620/37963 [60:44:48<34:34:49,  9.33s/it]
 65%|██████▍   | 24621/37963 [60:44:56<32:49:48,  8.86s/it]
 65%|██████▍   | 24622/37963 [60:45:04<31:43:31,  8.56s/it]
 65%|██████▍   | 24623/37963 [60:45:11<30:51:31,  8.33s/it]
 65%|██████▍   | 24624/37963 [60:45:19<29:51:27,  8.06s/it]
 65%|██████▍   | 24625/37963 [60:45:34<37:35:46, 10.15s/it]
 65%|██████▍   | 24626/37963 [60:45:41<34:40:51,  9.36s/it]
 65%|██████▍   | 24627/37963 [60:45:56<40:42:55, 10.99s/it]
 65%|██████▍   | 24628/37963 [60:46:04<37:25:42, 10.10s/it]
 65%|██████▍   | 24629/37963 [60:46:12<34:32:35,  9.33s/it]
 65%|██████▍   | 24630/37963 [60:46:20<33:01:31,  8.92s/it]
                                                           
{'loss': '0.1302', 'grad_norm': '2.694', 'learning_rate': '5.802e-06', 'epoch': '0.6488'}
+
 65%|██████▍   | 24630/37963 [60:46:20<33:01:31,  8.92s/it]
 65%|██████▍   | 24631/37963 [60:46:34<39:00:06, 10.53s/it]
 65%|██████▍   | 24632/37963 [60:46:42<36:14:42,  9.79s/it]
 65%|██████▍   | 24633/37963 [60:46:50<34:07:44,  9.22s/it]
 65%|██████▍   | 24634/37963 [60:46:58<32:16:54,  8.72s/it]
 65%|██████▍   | 24635/37963 [60:47:05<31:08:44,  8.41s/it]
 65%|██████▍   | 24636/37963 [60:47:13<30:27:07,  8.23s/it]
 65%|██████▍   | 24637/37963 [60:47:21<29:59:55,  8.10s/it]
 65%|██████▍   | 24638/37963 [60:47:29<29:39:11,  8.01s/it]
 65%|██████▍   | 24639/37963 [60:47:44<37:31:31, 10.14s/it]
 65%|██████▍   | 24640/37963 [60:47:52<35:08:32,  9.50s/it]
                                                           
{'loss': '0.1313', 'grad_norm': '2.23', 'learning_rate': '5.794e-06', 'epoch': '0.6491'}
+
 65%|██████▍   | 24640/37963 [60:47:52<35:08:32,  9.50s/it]
 65%|██████▍   | 24641/37963 [60:48:00<33:11:39,  8.97s/it]
 65%|██████▍   | 24642/37963 [60:48:07<31:38:54,  8.55s/it]
 65%|██████▍   | 24643/37963 [60:48:15<30:26:14,  8.23s/it]
 65%|██████▍   | 24644/37963 [60:48:22<30:01:12,  8.11s/it]
 65%|██████▍   | 24645/37963 [60:48:30<29:36:08,  8.00s/it]
 65%|██████▍   | 24646/37963 [60:48:38<29:23:41,  7.95s/it]
 65%|██████▍   | 24647/37963 [60:48:53<37:15:43, 10.07s/it]
 65%|██████▍   | 24648/37963 [60:49:01<34:55:26,  9.44s/it]
 65%|██████▍   | 24649/37963 [60:49:16<41:03:40, 11.10s/it]
 65%|██████▍   | 24650/37963 [60:49:24<37:22:34, 10.11s/it]
                                                           
{'loss': '0.1324', 'grad_norm': '2.156', 'learning_rate': '5.787e-06', 'epoch': '0.6493'}
+
 65%|██████▍   | 24650/37963 [60:49:24<37:22:34, 10.11s/it]
 65%|██████▍   | 24651/37963 [60:49:32<34:48:09,  9.41s/it]
 65%|██████▍   | 24652/37963 [60:49:39<33:01:56,  8.93s/it]
 65%|██████▍   | 24653/37963 [60:49:47<31:44:45,  8.59s/it]
 65%|██████▍   | 24654/37963 [60:49:55<30:45:27,  8.32s/it]
 65%|██████▍   | 24655/37963 [60:50:03<30:05:23,  8.14s/it]
 65%|██████▍   | 24656/37963 [60:50:10<29:31:00,  7.99s/it]
 65%|██████▍   | 24657/37963 [60:50:18<29:18:49,  7.93s/it]
 65%|██████▍   | 24658/37963 [60:50:26<28:59:39,  7.85s/it]
 65%|██████▍   | 24659/37963 [60:50:33<28:51:58,  7.81s/it]
 65%|██████▍   | 24660/37963 [60:50:41<28:48:45,  7.80s/it]
                                                           
{'loss': '0.1198', 'grad_norm': '1.729', 'learning_rate': '5.779e-06', 'epoch': '0.6496'}
+
 65%|██████▍   | 24660/37963 [60:50:41<28:48:45,  7.80s/it]
 65%|██████▍   | 24661/37963 [60:50:49<28:47:07,  7.79s/it]
 65%|██████▍   | 24662/37963 [60:51:04<36:29:39,  9.88s/it]
 65%|██████▍   | 24663/37963 [60:51:12<34:20:13,  9.29s/it]
 65%|██████▍   | 24664/37963 [60:51:20<33:04:44,  8.95s/it]
 65%|██████▍   | 24665/37963 [60:51:28<31:55:39,  8.64s/it]
 65%|██████▍   | 24666/37963 [60:51:35<30:59:27,  8.39s/it]
 65%|██████▍   | 24667/37963 [60:51:43<30:19:22,  8.21s/it]
 65%|██████▍   | 24668/37963 [60:51:59<38:24:48, 10.40s/it]
 65%|██████▍   | 24669/37963 [60:52:06<35:25:02,  9.59s/it]
 65%|██████▍   | 24670/37963 [60:52:14<33:16:33,  9.01s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '1.198', 'learning_rate': '5.771e-06', 'epoch': '0.6498'}
+
 65%|██████▍   | 24670/37963 [60:52:14<33:16:33,  9.01s/it]
 65%|██████▍   | 24671/37963 [60:52:22<32:00:26,  8.67s/it]
 65%|██████▍   | 24672/37963 [60:52:30<31:08:10,  8.43s/it]
 65%|██████▍   | 24673/37963 [60:52:38<30:22:21,  8.23s/it]
 65%|██████▍   | 24674/37963 [60:52:52<37:30:03, 10.16s/it]
 65%|██████▍   | 24675/37963 [60:53:00<34:53:51,  9.45s/it]
 65%|██████▌   | 24676/37963 [60:53:08<33:00:37,  8.94s/it]
 65%|██████▌   | 24677/37963 [60:53:16<31:40:53,  8.58s/it]
 65%|██████▌   | 24678/37963 [60:53:23<30:49:30,  8.35s/it]
 65%|██████▌   | 24679/37963 [60:53:31<30:13:22,  8.19s/it]
 65%|██████▌   | 24680/37963 [60:53:46<37:24:25, 10.14s/it]
                                                           
{'loss': '0.13', 'grad_norm': '2.494', 'learning_rate': '5.763e-06', 'epoch': '0.6501'}
+
 65%|██████▌   | 24680/37963 [60:53:46<37:24:25, 10.14s/it]
 65%|██████▌   | 24681/37963 [60:53:54<34:57:25,  9.47s/it]
 65%|██████▌   | 24682/37963 [60:54:02<33:04:58,  8.97s/it]
 65%|██████▌   | 24683/37963 [60:54:10<31:57:32,  8.66s/it]
 65%|██████▌   | 24684/37963 [60:54:17<31:01:42,  8.41s/it]
 65%|██████▌   | 24685/37963 [60:54:32<37:47:20, 10.25s/it]
 65%|██████▌   | 24686/37963 [60:54:40<35:07:47,  9.53s/it]
 65%|██████▌   | 24687/37963 [60:54:47<33:06:42,  8.98s/it]
 65%|██████▌   | 24688/37963 [60:54:55<31:37:12,  8.57s/it]
 65%|██████▌   | 24689/37963 [60:55:03<30:46:11,  8.35s/it]
 65%|██████▌   | 24690/37963 [60:55:11<30:17:00,  8.21s/it]
                                                           
{'loss': '0.1254', 'grad_norm': '1.611', 'learning_rate': '5.756e-06', 'epoch': '0.6504'}
+
 65%|██████▌   | 24690/37963 [60:55:11<30:17:00,  8.21s/it]
 65%|██████▌   | 24691/37963 [60:55:19<29:44:58,  8.07s/it]
 65%|██████▌   | 24692/37963 [60:55:35<38:44:48, 10.51s/it]
 65%|██████▌   | 24693/37963 [60:55:43<36:02:33,  9.78s/it]
 65%|██████▌   | 24694/37963 [60:55:59<42:40:04, 11.58s/it]
 65%|██████▌   | 24695/37963 [60:56:07<39:07:29, 10.62s/it]
 65%|██████▌   | 24696/37963 [60:56:15<36:35:03,  9.93s/it]
 65%|██████▌   | 24697/37963 [60:56:23<34:27:59,  9.35s/it]
 65%|██████▌   | 24698/37963 [60:56:31<33:08:04,  8.99s/it]
 65%|██████▌   | 24699/37963 [60:56:48<41:29:17, 11.26s/it]
 65%|██████▌   | 24700/37963 [60:56:56<38:04:44, 10.34s/it]
                                                           
{'loss': '0.1224', 'grad_norm': '2.758', 'learning_rate': '5.748e-06', 'epoch': '0.6506'}
+
 65%|██████▌   | 24700/37963 [60:56:56<38:04:44, 10.34s/it]
 65%|██████▌   | 24701/37963 [60:57:04<35:42:29,  9.69s/it]
 65%|██████▌   | 24702/37963 [60:57:12<33:54:03,  9.20s/it]
 65%|���█████▌   | 24703/37963 [60:57:21<33:06:33,  8.99s/it]
 65%|██████▌   | 24704/37963 [60:57:29<32:24:32,  8.80s/it]
 65%|██████▌   | 24705/37963 [60:57:38<31:55:37,  8.67s/it]
 65%|██████▌   | 24706/37963 [60:57:46<31:23:47,  8.53s/it]
 65%|██████▌   | 24707/37963 [60:57:54<31:10:48,  8.47s/it]
 65%|██████▌   | 24708/37963 [60:58:02<30:45:02,  8.35s/it]
 65%|██████▌   | 24709/37963 [60:58:10<30:27:08,  8.27s/it]
 65%|██████▌   | 24710/37963 [60:58:19<30:28:04,  8.28s/it]
                                                           
{'loss': '0.1262', 'grad_norm': '2.362', 'learning_rate': '5.74e-06', 'epoch': '0.6509'}
+
 65%|██████▌   | 24710/37963 [60:58:19<30:28:04,  8.28s/it]
 65%|██████▌   | 24711/37963 [60:58:27<30:34:15,  8.30s/it]
 65%|██████▌   | 24712/37963 [60:58:42<38:18:40, 10.41s/it]
 65%|██████▌   | 24713/37963 [60:58:51<36:00:50,  9.78s/it]
 65%|██████▌   | 24714/37963 [60:58:59<34:16:29,  9.31s/it]
 65%|██████▌   | 24715/37963 [60:59:07<32:47:10,  8.91s/it]
 65%|██████▌   | 24716/37963 [60:59:23<41:06:42, 11.17s/it]
 65%|██████▌   | 24717/37963 [60:59:31<37:47:22, 10.27s/it]
 65%|██████▌   | 24718/37963 [60:59:39<35:13:53,  9.58s/it]
 65%|██████▌   | 24719/37963 [60:59:48<33:42:52,  9.16s/it]
 65%|██████▌   | 24720/37963 [60:59:55<32:19:04,  8.79s/it]
                                                           
{'loss': '0.1331', 'grad_norm': '1.392', 'learning_rate': '5.732e-06', 'epoch': '0.6512'}
+
 65%|██████▌   | 24720/37963 [60:59:55<32:19:04,  8.79s/it]
 65%|██████▌   | 24721/37963 [61:00:04<31:42:22,  8.62s/it]
 65%|██████▌   | 24722/37963 [61:00:12<31:20:13,  8.52s/it]
 65%|██████▌   | 24723/37963 [61:00:20<31:12:15,  8.48s/it]
 65%|██████▌   | 24724/37963 [61:00:28<30:41:50,  8.35s/it]
 65%|██████▌   | 24725/37963 [61:00:36<30:22:36,  8.26s/it]
 65%|██████▌   | 24726/37963 [61:00:45<30:20:06,  8.25s/it]
 65%|██████▌   | 24727/37963 [61:00:53<30:10:17,  8.21s/it]
 65%|██████▌   | 24728/37963 [61:01:08<37:35:20, 10.22s/it]
 65%|██████▌   | 24729/37963 [61:01:16<34:55:24,  9.50s/it]
 65%|██████▌   | 24730/37963 [61:01:24<33:46:16,  9.19s/it]
                                                           
{'loss': '0.1251', 'grad_norm': '3.076', 'learning_rate': '5.725e-06', 'epoch': '0.6514'}
+
 65%|██████▌   | 24730/37963 [61:01:24<33:46:16,  9.19s/it]
 65%|██████▌   | 24731/37963 [61:01:32<32:37:12,  8.87s/it]
 65%|██████▌   | 24732/37963 [61:01:40<31:49:40,  8.66s/it]
 65%|██████▌   | 24733/37963 [61:01:55<38:41:43, 10.53s/it]
 65%|██████▌   | 24734/37963 [61:02:10<43:29:31, 11.84s/it]
 65%|██████▌   | 24735/37963 [61:02:18<39:16:35, 10.69s/it]
 65%|██████▌   | 24736/37963 [61:02:34<45:26:59, 12.37s/it]
 65%|██████▌   | 24737/37963 [61:02:43<40:51:01, 11.12s/it]
 65%|██████▌   | 24738/37963 [61:02:59<46:48:58, 12.74s/it]
 65%|██████▌   | 24739/37963 [61:03:07<41:21:28, 11.26s/it]
 65%|██████▌   | 24740/37963 [61:03:15<38:05:49, 10.37s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '1.989', 'learning_rate': '5.717e-06', 'epoch': '0.6517'}
+
 65%|██████▌   | 24740/37963 [61:03:15<38:05:49, 10.37s/it]
 65%|██████▌   | 24741/37963 [61:03:24<36:00:49,  9.81s/it]
 65%|██████▌   | 24742/37963 [61:03:32<34:09:52,  9.30s/it]
 65%|██████▌   | 24743/37963 [61:03:40<32:37:36,  8.88s/it]
 65%|██████▌   | 24744/37963 [61:03:48<31:54:32,  8.69s/it]
 65%|██████▌   | 24745/37963 [61:03:56<31:18:43,  8.53s/it]
 65%|██████▌   | 24746/37963 [61:04:12<39:42:20, 10.81s/it]
 65%|██████▌   | 24747/37963 [61:04:21<37:06:08, 10.11s/it]
 65%|██████▌   | 24748/37963 [61:04:29<34:50:36,  9.49s/it]
 65%|██████▌   | 24749/37963 [61:04:37<32:54:53,  8.97s/it]
 65%|██████▌   | 24750/37963 [61:04:45<31:59:01,  8.71s/it]
                                                           
{'loss': '0.1214', 'grad_norm': '1.16', 'learning_rate': '5.709e-06', 'epoch': '0.652'}
+
 65%|██████▌   | 24750/37963 [61:04:45<31:59:01,  8.71s/it]
 65%|██████▌   | 24751/37963 [61:04:53<31:25:13,  8.56s/it]
 65%|██████▌   | 24752/37963 [61:05:01<30:54:56,  8.42s/it]
 65%|██████▌   | 24753/37963 [61:05:09<30:25:49,  8.29s/it]
 65%|██████▌   | 24754/37963 [61:05:17<30:20:29,  8.27s/it]
 65%|██████▌   | 24755/37963 [61:05:25<29:59:07,  8.17s/it]
 65%|██████▌   | 24756/37963 [61:05:33<29:53:36,  8.15s/it]
 65%|██████▌   | 24757/37963 [61:05:42<30:02:38,  8.19s/it]
 65%|██████▌   | 24758/37963 [61:05:50<30:02:45,  8.19s/it]
 65%|██████▌   | 24759/37963 [61:05:58<30:02:56,  8.19s/it]
 65%|██████▌   | 24760/37963 [61:06:14<38:39:41, 10.54s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '1.847', 'learning_rate': '5.702e-06', 'epoch': '0.6522'}
+
 65%|██████▌   | 24760/37963 [61:06:14<38:39:41, 10.54s/it]
 65%|██████▌   | 24761/37963 [61:06:29<43:46:44, 11.94s/it]
 65%|██████▌   | 24762/37963 [61:06:37<39:44:43, 10.84s/it]
 65%|██████▌   | 24763/37963 [61:06:45<36:37:46,  9.99s/it]
 65%|██████▌   | 24764/37963 [61:06:53<34:19:59,  9.36s/it]
 65%|██████▌   | 24765/37963 [61:07:01<32:54:39,  8.98s/it]
 65%|██████▌   | 24766/37963 [61:07:10<32:01:30,  8.74s/it]
 65%|██████▌   | 24767/37963 [61:07:17<31:09:04,  8.50s/it]
 65%|██████▌   | 24768/37963 [61:07:25<30:32:30,  8.33s/it]
 65%|██████▌   | 24769/37963 [61:07:33<30:07:11,  8.22s/it]
 65%|██████▌   | 24770/37963 [61:07:41<29:55:52,  8.17s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '1.59', 'learning_rate': '5.694e-06', 'epoch': '0.6525'}
+
 65%|██████▌   | 24770/37963 [61:07:41<29:55:52,  8.17s/it]
 65%|██████▌   | 24771/37963 [61:07:49<29:32:59,  8.06s/it]
 65%|██████▌   | 24772/37963 [61:07:57<29:20:53,  8.01s/it]
 65%|██████▌   | 24773/37963 [61:08:05<29:14:16,  7.98s/it]
 65%|██████▌   | 24774/37963 [61:08:13<29:00:47,  7.92s/it]
 65%|██████▌   | 24775/37963 [61:08:21<29:02:19,  7.93s/it]
 65%|██████▌   | 24776/37963 [61:08:29<28:56:13,  7.90s/it]
 65%|██████▌   | 24777/37963 [61:08:36<28:45:40,  7.85s/it]
 65%|██████▌   | 24778/37963 [61:08:44<28:49:33,  7.87s/it]
 65%|██████▌   | 24779/37963 [61:08:52<28:44:18,  7.85s/it]
 65%|██████▌   | 24780/37963 [61:09:00<28:40:58,  7.83s/it]
                                                           
{'loss': '0.1259', 'grad_norm': '1.466', 'learning_rate': '5.686e-06', 'epoch': '0.6527'}
+
 65%|██████▌   | 24780/37963 [61:09:00<28:40:58,  7.83s/it]
 65%|██████▌   | 24781/37963 [61:09:22<44:08:06, 12.05s/it]
 65%|██████▌   | 24782/37963 [61:09:37<47:10:36, 12.88s/it]
 65%|██████▌   | 24783/37963 [61:09:44<41:38:17, 11.37s/it]
 65%|██████▌   | 24784/37963 [61:09:52<37:47:15, 10.32s/it]
 65%|██████▌   | 24785/37963 [61:10:00<35:06:48,  9.59s/it]
 65%|██████▌   | 24786/37963 [61:10:15<40:35:12, 11.09s/it]
 65%|██████▌   | 24787/37963 [61:10:23<37:32:39, 10.26s/it]
 65%|██████▌   | 24788/37963 [61:10:38<42:13:00, 11.54s/it]
 65%|██████▌   | 24789/37963 [61:10:45<38:02:34, 10.40s/it]
 65%|██████▌   | 24790/37963 [61:10:53<35:07:20,  9.60s/it]
                                                           
{'loss': '0.1291', 'grad_norm': '5.772', 'learning_rate': '5.679e-06', 'epoch': '0.653'}
+
 65%|██████▌   | 24790/37963 [61:10:53<35:07:20,  9.60s/it]
 65%|██████▌   | 24791/37963 [61:11:01<32:56:59,  9.01s/it]
 65%|██████▌   | 24792/37963 [61:11:09<31:37:06,  8.64s/it]
 65%|██████▌   | 24793/37963 [61:11:16<30:43:30,  8.40s/it]
 65%|██████▌   | 24794/37963 [61:11:24<30:04:57,  8.22s/it]
 65%|██████▌   | 24795/37963 [61:11:32<29:33:08,  8.08s/it]
 65%|██████▌   | 24796/37963 [61:11:47<37:04:47, 10.14s/it]
 65%|██████▌   | 24797/37963 [61:11:55<34:32:26,  9.44s/it]
 65%|██████▌   | 24798/37963 [61:12:02<32:22:45,  8.85s/it]
 65%|██████▌   | 24799/37963 [61:12:10<31:05:31,  8.50s/it]
 65%|██████▌   | 24800/37963 [61:12:17<30:00:19,  8.21s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '1.943', 'learning_rate': '5.671e-06', 'epoch': '0.6533'}
+
 65%|██████▌   | 24800/37963 [61:12:17<30:00:19,  8.21s/it]
 65%|██████▌   | 24801/37963 [61:12:25<29:20:56,  8.03s/it]
 65%|██████▌   | 24802/37963 [61:12:33<29:08:19,  7.97s/it]
 65%|██████▌   | 24803/37963 [61:12:48<37:09:23, 10.16s/it]
 65%|██████▌   | 24804/37963 [61:12:56<34:59:39,  9.57s/it]
 65%|██████▌   | 24805/37963 [61:13:04<33:12:22,  9.09s/it]
 65%|██████▌   | 24806/37963 [61:13:12<31:35:53,  8.65s/it]
 65%|██████▌   | 24807/37963 [61:13:19<30:30:11,  8.35s/it]
 65%|██████▌   | 24808/37963 [61:13:27<29:47:03,  8.15s/it]
 65%|██████▌   | 24809/37963 [61:13:35<29:21:32,  8.04s/it]
 65%|██████▌   | 24810/37963 [61:13:43<29:14:06,  8.00s/it]
                                                           
{'loss': '0.1354', 'grad_norm': '1.194', 'learning_rate': '5.663e-06', 'epoch': '0.6535'}
+
 65%|██████▌   | 24810/37963 [61:13:43<29:14:06,  8.00s/it]
 65%|██████▌   | 24811/37963 [61:13:51<29:03:42,  7.95s/it]
 65%|██████▌   | 24812/37963 [61:13:58<28:40:29,  7.85s/it]
 65%|██████▌   | 24813/37963 [61:14:06<28:35:11,  7.83s/it]
 65%|██████▌   | 24814/37963 [61:14:14<28:38:58,  7.84s/it]
 65%|██████▌   | 24815/37963 [61:14:29<36:02:06,  9.87s/it]
 65%|██████▌   | 24816/37963 [61:14:36<33:52:15,  9.27s/it]
 65%|██████▌   | 24817/37963 [61:14:44<32:17:58,  8.85s/it]
 65%|██████▌   | 24818/37963 [61:14:52<31:07:11,  8.52s/it]
 65%|██████▌   | 24819/37963 [61:15:00<30:17:43,  8.30s/it]
 65%|██████▌   | 24820/37963 [61:15:08<29:42:21,  8.14s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '1.494', 'learning_rate': '5.655e-06', 'epoch': '0.6538'}
+
 65%|██████▌   | 24820/37963 [61:15:08<29:42:21,  8.14s/it]
 65%|██████▌   | 24821/37963 [61:15:15<29:13:09,  8.00s/it]
 65%|██████▌   | 24822/37963 [61:15:23<28:54:14,  7.92s/it]
 65%|██████▌   | 24823/37963 [61:15:31<28:45:18,  7.88s/it]
 65%|██████▌   | 24824/37963 [61:15:39<28:37:58,  7.85s/it]
 65%|██████▌   | 24825/37963 [61:15:53<35:33:52,  9.75s/it]
 65%|██████▌   | 24826/37963 [61:16:08<41:14:18, 11.30s/it]
 65%|██████▌   | 24827/37963 [61:16:15<37:26:05, 10.26s/it]
 65%|██████▌   | 24828/37963 [61:16:23<34:46:46,  9.53s/it]
 65%|██████▌   | 24829/37963 [61:16:39<41:12:43, 11.30s/it]
 65%|██████▌   | 24830/37963 [61:16:47<37:57:20, 10.40s/it]
                                                           
{'loss': '0.1261', 'grad_norm': '2.453', 'learning_rate': '5.648e-06', 'epoch': '0.6541'}
+
 65%|██████▌   | 24830/37963 [61:16:47<37:57:20, 10.40s/it]
 65%|██████▌   | 24831/37963 [61:16:55<35:02:39,  9.61s/it]
 65%|██████▌   | 24832/37963 [61:17:10<40:47:23, 11.18s/it]
 65%|██████▌   | 24833/37963 [61:17:18<37:32:52, 10.29s/it]
 65%|██████▌   | 24834/37963 [61:17:26<35:35:55,  9.76s/it]
 65%|██████▌   | 24835/37963 [61:17:35<34:06:46,  9.35s/it]
 65%|██████▌   | 24836/37963 [61:17:43<32:56:44,  9.04s/it]
 65%|██████▌   | 24837/37963 [61:17:51<31:57:54,  8.77s/it]
 65%|██████▌   | 24838/37963 [61:18:00<31:24:51,  8.62s/it]
 65%|██████▌   | 24839/37963 [61:18:16<40:26:05, 11.09s/it]
 65%|██████▌   | 24840/37963 [61:18:25<37:23:28, 10.26s/it]
                                                           
{'loss': '0.1325', 'grad_norm': '2.356', 'learning_rate': '5.64e-06', 'epoch': '0.6543'}
+
 65%|██████▌   | 24840/37963 [61:18:25<37:23:28, 10.26s/it]
 65%|██████▌   | 24841/37963 [61:18:33<35:16:08,  9.68s/it]
 65%|██████▌   | 24842/37963 [61:18:41<33:45:54,  9.26s/it]
 65%|██████▌   | 24843/37963 [61:18:50<32:55:49,  9.04s/it]
 65%|██████▌   | 24844/37963 [61:19:09<43:29:26, 11.93s/it]
 65%|██████▌   | 24845/37963 [61:19:17<39:47:19, 10.92s/it]
 65%|██████▌   | 24846/37963 [61:19:25<36:53:42, 10.13s/it]
 65%|██████▌   | 24847/37963 [61:19:34<34:47:26,  9.55s/it]
 65%|██████▌   | 24848/37963 [61:19:42<33:21:30,  9.16s/it]
 65%|██████▌   | 24849/37963 [61:19:50<32:12:13,  8.84s/it]
 65%|██████▌   | 24850/37963 [61:20:07<41:30:34, 11.40s/it]
                                                           
{'loss': '0.1283', 'grad_norm': '1.186', 'learning_rate': '5.632e-06', 'epoch': '0.6546'}
+
 65%|██████▌   | 24850/37963 [61:20:07<41:30:34, 11.40s/it]
 65%|██████▌   | 24851/37963 [61:20:16<38:15:42, 10.51s/it]
 65%|██████▌   | 24852/37963 [61:20:24<35:46:18,  9.82s/it]
 65%|██████▌   | 24853/37963 [61:20:32<34:09:29,  9.38s/it]
 65%|██████▌   | 24854/37963 [61:20:40<32:45:55,  9.00s/it]
 65%|██████▌   | 24855/37963 [61:20:48<31:36:12,  8.68s/it]
 65%|██████▌   | 24856/37963 [61:20:56<30:39:59,  8.42s/it]
 65%|██████▌   | 24857/37963 [61:21:04<30:21:51,  8.34s/it]
 65%|██████▌   | 24858/37963 [61:21:13<30:25:29,  8.36s/it]
 65%|██████▌   | 24859/37963 [61:21:21<29:59:04,  8.24s/it]
 65%|██████▌   | 24860/37963 [61:21:29<30:05:33,  8.27s/it]
                                                           
{'loss': '0.1252', 'grad_norm': '2.196', 'learning_rate': '5.625e-06', 'epoch': '0.6549'}
+
 65%|██████▌   | 24860/37963 [61:21:29<30:05:33,  8.27s/it]
 65%|██████▌   | 24861/37963 [61:21:37<29:57:09,  8.23s/it]
 65%|██████▌   | 24862/37963 [61:21:45<29:57:48,  8.23s/it]
 65%|██████▌   | 24863/37963 [61:21:54<30:05:32,  8.27s/it]
 65%|██████▌   | 24864/37963 [61:22:02<29:59:49,  8.24s/it]
 65%|██████▌   | 24865/37963 [61:22:10<29:51:36,  8.21s/it]
 66%|██████▌   | 24866/37963 [61:22:18<29:55:19,  8.22s/it]
 66%|██████▌   | 24867/37963 [61:22:33<37:18:01, 10.25s/it]
 66%|██████▌   | 24868/37963 [61:22:41<34:57:16,  9.61s/it]
 66%|██████▌   | 24869/37963 [61:22:50<33:42:09,  9.27s/it]
 66%|██████▌   | 24870/37963 [61:22:58<32:20:05,  8.89s/it]
                                                           
{'loss': '0.1303', 'grad_norm': '1.784', 'learning_rate': '5.617e-06', 'epoch': '0.6551'}
+
 66%|██████▌   | 24870/37963 [61:22:58<32:20:05,  8.89s/it]
 66%|██████▌   | 24871/37963 [61:23:06<31:45:01,  8.73s/it]
 66%|██████▌   | 24872/37963 [61:23:15<31:19:07,  8.61s/it]
 66%|██████▌   | 24873/37963 [61:23:23<31:08:04,  8.56s/it]
 66%|██████▌   | 24874/37963 [61:23:38<38:22:43, 10.56s/it]
 66%|██████▌   | 24875/37963 [61:23:46<35:35:50,  9.79s/it]
 66%|██████▌   | 24876/37963 [61:23:54<33:48:47,  9.30s/it]
 66%|██████▌   | 24877/37963 [61:24:12<42:41:53, 11.75s/it]
 66%|██████▌   | 24878/37963 [61:24:20<38:55:25, 10.71s/it]
 66%|██████▌   | 24879/37963 [61:24:28<36:07:26,  9.94s/it]
 66%|██████▌   | 24880/37963 [61:24:50<48:40:18, 13.39s/it]
                                                           
{'loss': '0.1247', 'grad_norm': '1.931', 'learning_rate': '5.609e-06', 'epoch': '0.6554'}
+
 66%|██████▌   | 24880/37963 [61:24:50<48:40:18, 13.39s/it]
 66%|██████▌   | 24881/37963 [61:24:58<43:31:58, 11.98s/it]
 66%|██████▌   | 24882/37963 [61:25:16<49:15:50, 13.56s/it]
 66%|██████▌   | 24883/37963 [61:25:24<43:28:49, 11.97s/it]
 66%|██████▌   | 24884/37963 [61:25:32<39:19:48, 10.83s/it]
 66%|██████▌   | 24885/37963 [61:25:40<36:20:30, 10.00s/it]
 66%|██████▌   | 24886/37963 [61:25:48<34:05:03,  9.38s/it]
 66%|██████▌   | 24887/37963 [61:25:56<32:50:27,  9.04s/it]
 66%|██████▌   | 24888/37963 [61:26:04<31:26:02,  8.65s/it]
 66%|██████▌   | 24889/37963 [61:26:12<30:49:30,  8.49s/it]
 66%|██████▌   | 24890/37963 [61:26:20<30:33:23,  8.41s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '1.303', 'learning_rate': '5.602e-06', 'epoch': '0.6556'}
+
 66%|██████▌   | 24890/37963 [61:26:20<30:33:23,  8.41s/it]
 66%|██████▌   | 24891/37963 [61:26:28<30:06:35,  8.29s/it]
 66%|██████▌   | 24892/37963 [61:26:44<38:36:10, 10.63s/it]
 66%|██████▌   | 24893/37963 [61:27:01<45:15:57, 12.47s/it]
 66%|██████▌   | 24894/37963 [61:27:10<40:59:43, 11.29s/it]
 66%|██████▌   | 24895/37963 [61:27:18<37:47:41, 10.41s/it]
 66%|██████▌   | 24896/37963 [61:27:26<35:30:54,  9.78s/it]
 66%|██████▌   | 24897/37963 [61:27:35<33:44:48,  9.30s/it]
 66%|██████▌   | 24898/37963 [61:27:43<32:36:44,  8.99s/it]
 66%|██████▌   | 24899/37963 [61:27:51<31:52:19,  8.78s/it]
 66%|██████▌   | 24900/37963 [61:27:59<31:03:33,  8.56s/it]
                                                           
{'loss': '0.1301', 'grad_norm': '2.764', 'learning_rate': '5.594e-06', 'epoch': '0.6559'}
+
 66%|██████▌   | 24900/37963 [61:27:59<31:03:33,  8.56s/it]
 66%|██████▌   | 24901/37963 [61:28:07<30:41:10,  8.46s/it]
 66%|██████▌   | 24902/37963 [61:28:15<30:03:46,  8.29s/it]
 66%|██████▌   | 24903/37963 [61:28:24<29:55:17,  8.25s/it]
 66%|██████▌   | 24904/37963 [61:28:32<29:54:28,  8.24s/it]
 66%|██████▌   | 24905/37963 [61:28:39<29:20:27,  8.09s/it]
 66%|██████▌   | 24906/37963 [61:28:48<29:35:03,  8.16s/it]
 66%|██████▌   | 24907/37963 [61:28:56<29:56:51,  8.26s/it]
 66%|██████▌   | 24908/37963 [61:29:04<29:54:06,  8.25s/it]
 66%|██████▌   | 24909/37963 [61:29:13<30:02:11,  8.28s/it]
 66%|██████▌   | 24910/37963 [61:29:21<29:54:10,  8.25s/it]
                                                           
{'loss': '0.1231', 'grad_norm': '2.341', 'learning_rate': '5.586e-06', 'epoch': '0.6562'}
+
 66%|██████▌   | 24910/37963 [61:29:21<29:54:10,  8.25s/it]
 66%|██████▌   | 24911/37963 [61:29:29<29:35:55,  8.16s/it]
 66%|██████▌   | 24912/37963 [61:29:37<29:18:27,  8.08s/it]
 66%|██████▌   | 24913/37963 [61:29:45<29:18:03,  8.08s/it]
 66%|██████▌   | 24914/37963 [61:29:53<29:32:12,  8.15s/it]
 66%|██████▌   | 24915/37963 [61:30:09<37:26:09, 10.33s/it]
 66%|██████▌   | 24916/37963 [61:30:17<35:08:37,  9.70s/it]
 66%|██████▌   | 24917/37963 [61:30:32<41:02:55, 11.33s/it]
 66%|██████▌   | 24918/37963 [61:30:40<37:44:41, 10.42s/it]
 66%|██████▌   | 24919/37963 [61:30:49<35:33:32,  9.81s/it]
 66%|██████▌   | 24920/37963 [61:30:57<33:46:00,  9.32s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '1.752', 'learning_rate': '5.579e-06', 'epoch': '0.6564'}
+
 66%|██████▌   | 24920/37963 [61:30:57<33:46:00,  9.32s/it]
 66%|██████▌   | 24921/37963 [61:31:05<32:48:20,  9.06s/it]
 66%|██████▌   | 24922/37963 [61:31:14<32:03:23,  8.85s/it]
 66%|██████▌   | 24923/37963 [61:31:22<31:30:09,  8.70s/it]
 66%|██████▌   | 24924/37963 [61:31:37<38:26:06, 10.61s/it]
 66%|██████▌   | 24925/37963 [61:31:46<36:01:03,  9.95s/it]
 66%|██████▌   | 24926/37963 [61:31:54<34:11:19,  9.44s/it]
 66%|██████▌   | 24927/37963 [61:32:02<32:41:52,  9.03s/it]
 66%|██████▌   | 24928/37963 [61:32:10<31:41:43,  8.75s/it]
 66%|██████▌   | 24929/37963 [61:32:25<38:47:25, 10.71s/it]
 66%|██████▌   | 24930/37963 [61:32:42<45:27:16, 12.56s/it]
                                                           
{'loss': '0.1344', 'grad_norm': '1.494', 'learning_rate': '5.571e-06', 'epoch': '0.6567'}
+
 66%|██████▌   | 24930/37963 [61:32:42<45:27:16, 12.56s/it]
 66%|██████▌   | 24931/37963 [61:33:00<50:43:08, 14.01s/it]
 66%|██████▌   | 24932/37963 [61:33:08<44:40:17, 12.34s/it]
 66%|██████▌   | 24933/37963 [61:33:16<40:07:56, 11.09s/it]
 66%|██████▌   | 24934/37963 [61:33:24<37:07:14, 10.26s/it]
 66%|██████▌   | 24935/37963 [61:33:33<34:56:15,  9.65s/it]
 66%|██████▌   | 24936/37963 [61:33:48<41:05:51, 11.36s/it]
 66%|██████▌   | 24937/37963 [61:33:56<37:24:20, 10.34s/it]
 66%|██████▌   | 24938/37963 [61:34:04<34:37:54,  9.57s/it]
 66%|██████▌   | 24939/37963 [61:34:12<33:00:32,  9.12s/it]
 66%|██████▌   | 24940/37963 [61:34:20<31:57:06,  8.83s/it]
                                                           
{'loss': '0.1262', 'grad_norm': '4.34', 'learning_rate': '5.563e-06', 'epoch': '0.657'}
+
 66%|██████▌   | 24940/37963 [61:34:20<31:57:06,  8.83s/it]
 66%|██████▌   | 24941/37963 [61:34:28<31:12:44,  8.63s/it]
 66%|██████▌   | 24942/37963 [61:34:37<30:59:38,  8.57s/it]
 66%|██████▌   | 24943/37963 [61:34:45<30:22:30,  8.40s/it]
 66%|██████▌   | 24944/37963 [61:34:53<30:16:23,  8.37s/it]
 66%|██████▌   | 24945/37963 [61:35:01<30:22:26,  8.40s/it]
 66%|██████▌   | 24946/37963 [61:35:10<30:29:41,  8.43s/it]
 66%|██████▌   | 24947/37963 [61:35:27<40:20:49, 11.16s/it]
 66%|██████▌   | 24948/37963 [61:35:36<37:12:24, 10.29s/it]
 66%|██████▌   | 24949/37963 [61:35:44<35:06:13,  9.71s/it]
 66%|██████▌   | 24950/37963 [61:35:52<33:34:54,  9.29s/it]
                                                           
{'loss': '0.1286', 'grad_norm': '1.893', 'learning_rate': '5.556e-06', 'epoch': '0.6572'}
+
 66%|██████▌   | 24950/37963 [61:35:52<33:34:54,  9.29s/it]
 66%|██████▌   | 24951/37963 [61:36:01<32:31:22,  9.00s/it]
 66%|██████▌   | 24952/37963 [61:36:09<31:39:39,  8.76s/it]
 66%|██████▌   | 24953/37963 [61:36:17<31:21:25,  8.68s/it]
 66%|██████▌   | 24954/37963 [61:36:26<31:04:26,  8.60s/it]
 66%|██████▌   | 24955/37963 [61:36:34<31:06:44,  8.61s/it]
 66%|██████▌   | 24956/37963 [61:36:43<31:03:17,  8.60s/it]
 66%|██████▌   | 24957/37963 [61:36:52<31:37:16,  8.75s/it]
 66%|██████▌   | 24958/37963 [61:37:02<32:36:04,  9.02s/it]
 66%|██████▌   | 24959/37963 [61:37:11<32:38:08,  9.03s/it]
 66%|██████▌   | 24960/37963 [61:37:20<32:33:04,  9.01s/it]
                                                           
{'loss': '0.1368', 'grad_norm': '1.411', 'learning_rate': '5.548e-06', 'epoch': '0.6575'}
+
 66%|██████▌   | 24960/37963 [61:37:20<32:33:04,  9.01s/it]
 66%|██████▌   | 24961/37963 [61:37:34<38:29:09, 10.66s/it]
 66%|██████▌   | 24962/37963 [61:37:42<35:41:54,  9.88s/it]
 66%|██████▌   | 24963/37963 [61:37:50<33:24:31,  9.25s/it]
 66%|██████▌   | 24964/37963 [61:38:05<39:49:46, 11.03s/it]
 66%|██████▌   | 24965/37963 [61:38:13<36:13:49, 10.03s/it]
 66%|██████▌   | 24966/37963 [61:38:21<34:05:43,  9.44s/it]
 66%|██████▌   | 24967/37963 [61:38:29<32:19:11,  8.95s/it]
 66%|██████▌   | 24968/37963 [61:38:37<31:12:49,  8.65s/it]
 66%|██████▌   | 24969/37963 [61:38:45<30:40:44,  8.50s/it]
 66%|██████▌   | 24970/37963 [61:38:53<30:34:04,  8.47s/it]
                                                           
{'loss': '0.1331', 'grad_norm': '1.269', 'learning_rate': '5.541e-06', 'epoch': '0.6577'}
+
 66%|██████▌   | 24970/37963 [61:38:53<30:34:04,  8.47s/it]
 66%|██████▌   | 24971/37963 [61:39:01<29:55:00,  8.29s/it]
 66%|██████▌   | 24972/37963 [61:39:09<29:47:43,  8.26s/it]
 66%|██████▌   | 24973/37963 [61:39:17<29:33:55,  8.19s/it]
 66%|██████▌   | 24974/37963 [61:39:26<29:39:54,  8.22s/it]
 66%|██████▌   | 24975/37963 [61:39:42<38:30:00, 10.67s/it]
 66%|██████▌   | 24976/37963 [61:39:50<35:38:41,  9.88s/it]
 66%|██████▌   | 24977/37963 [61:40:11<47:48:22, 13.25s/it]
 66%|██████▌   | 24978/37963 [61:40:20<42:39:58, 11.83s/it]
 66%|██████▌   | 24979/37963 [61:40:36<47:10:15, 13.08s/it]
 66%|██████▌   | 24980/37963 [61:40:44<42:02:00, 11.66s/it]
                                                           
{'loss': '0.1258', 'grad_norm': '2.047', 'learning_rate': '5.533e-06', 'epoch': '0.658'}
+
 66%|██████▌   | 24980/37963 [61:40:44<42:02:00, 11.66s/it]
 66%|██████▌   | 24981/37963 [61:40:52<38:15:07, 10.61s/it]
 66%|██████▌   | 24982/37963 [61:41:01<35:44:17,  9.91s/it]
 66%|██████▌   | 24983/37963 [61:41:09<33:56:26,  9.41s/it]
 66%|██████▌   | 24984/37963 [61:41:24<39:55:35, 11.07s/it]
 66%|██████▌   | 24985/37963 [61:41:31<36:14:42, 10.05s/it]
 66%|██████▌   | 24986/37963 [61:41:39<33:41:10,  9.35s/it]
 66%|██████▌   | 24987/37963 [61:41:47<32:21:54,  8.98s/it]
 66%|██████▌   | 24988/37963 [61:41:55<30:48:55,  8.55s/it]
 66%|██████▌   | 24989/37963 [61:42:03<30:17:39,  8.41s/it]
 66%|██████▌   | 24990/37963 [61:42:19<38:27:44, 10.67s/it]
                                                           
{'loss': '0.117', 'grad_norm': '1.685', 'learning_rate': '5.525e-06', 'epoch': '0.6583'}
+
 66%|██████▌   | 24990/37963 [61:42:19<38:27:44, 10.67s/it]
 66%|██████▌   | 24991/37963 [61:42:27<35:44:25,  9.92s/it]
 66%|██████▌   | 24992/37963 [61:42:35<33:51:55,  9.40s/it]
 66%|██████▌   | 24993/37963 [61:42:43<32:19:03,  8.97s/it]
 66%|██████▌   | 24994/37963 [61:42:51<31:19:20,  8.69s/it]
 66%|██████▌   | 24995/37963 [61:42:59<30:36:00,  8.49s/it]
 66%|██████▌   | 24996/37963 [61:43:07<29:56:16,  8.31s/it]
 66%|██████▌   | 24997/37963 [61:43:15<29:58:38,  8.32s/it]
 66%|██████▌   | 24998/37963 [61:43:24<29:46:52,  8.27s/it]
 66%|██████▌   | 24999/37963 [61:43:32<29:35:52,  8.22s/it]
 66%|██████▌   | 25000/37963 [61:43:40<29:27:50,  8.18s/it]
                                                           
{'loss': '0.1298', 'grad_norm': '2.119', 'learning_rate': '5.518e-06', 'epoch': '0.6585'}
+
 66%|██████▌   | 25000/37963 [61:43:40<29:27:50,  8.18s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.81s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.81s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 66%|██████▌   | 25001/37963 [61:44:38<83:02:19, 23.06s/it]
 66%|██████▌   | 25002/37963 [61:44:46<67:20:22, 18.70s/it]
 66%|██████▌   | 25003/37963 [61:44:55<56:13:59, 15.62s/it]
 66%|██████▌   | 25004/37963 [61:45:03<48:32:30, 13.48s/it]
 66%|██████▌   | 25005/37963 [61:45:11<42:23:16, 11.78s/it]
 66%|██████▌   | 25006/37963 [61:45:19<38:33:00, 10.71s/it]
 66%|██████▌   | 25007/37963 [61:45:27<35:41:35,  9.92s/it]
 66%|██████▌   | 25008/37963 [61:45:35<33:54:02,  9.42s/it]
 66%|██████▌   | 25009/37963 [61:45:43<32:19:21,  8.98s/it]
 66%|██████▌   | 25010/37963 [61:45:51<31:25:29,  8.73s/it]
                                                           
{'loss': '0.1219', 'grad_norm': '2.397', 'learning_rate': '5.51e-06', 'epoch': '0.6588'}
+
 66%|██████▌   | 25010/37963 [61:45:52<31:25:29,  8.73s/it]
 66%|██████▌   | 25011/37963 [61:46:00<30:51:41,  8.58s/it]
 66%|██████▌   | 25012/37963 [61:46:08<30:38:42,  8.52s/it]
 66%|██████▌   | 25013/37963 [61:46:16<30:18:03,  8.42s/it]
 66%|██████▌   | 25014/37963 [61:46:31<37:32:55, 10.44s/it]
 66%|██████▌   | 25015/37963 [61:46:46<42:24:34, 11.79s/it]
 66%|██████▌   | 25016/37963 [61:46:55<38:56:28, 10.83s/it]
 66%|██████▌   | 25017/37963 [61:47:03<36:07:17, 10.04s/it]
 66%|██████▌   | 25018/37963 [61:47:11<34:00:21,  9.46s/it]
 66%|██████▌   | 25019/37963 [61:47:19<32:20:18,  8.99s/it]
 66%|██████▌   | 25020/37963 [61:47:27<31:32:50,  8.77s/it]
                                                           
{'loss': '0.129', 'grad_norm': '1.752', 'learning_rate': '5.502e-06', 'epoch': '0.6591'}
+
 66%|██████▌   | 25020/37963 [61:47:27<31:32:50,  8.77s/it]
 66%|██████▌   | 25021/37963 [61:47:35<30:40:53,  8.53s/it]
 66%|██████▌   | 25022/37963 [61:47:52<39:52:13, 11.09s/it]
 66%|██████▌   | 25023/37963 [61:48:16<53:13:10, 14.81s/it]
 66%|██████▌   | 25024/37963 [61:48:24<46:23:08, 12.91s/it]
 66%|██████▌   | 25025/37963 [61:48:39<48:20:57, 13.45s/it]
 66%|██████▌   | 25026/37963 [61:48:47<42:50:29, 11.92s/it]
 66%|██████▌   | 25027/37963 [61:48:56<38:38:31, 10.75s/it]
 66%|██████▌   | 25028/37963 [61:49:04<35:50:09,  9.97s/it]
 66%|██████▌   | 25029/37963 [61:49:12<33:56:54,  9.45s/it]
 66%|██████▌   | 25030/37963 [61:49:20<32:17:19,  8.99s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '2.217', 'learning_rate': '5.495e-06', 'epoch': '0.6593'}
+
 66%|██████▌   | 25030/37963 [61:49:20<32:17:19,  8.99s/it]
 66%|██████▌   | 25031/37963 [61:49:28<31:16:53,  8.71s/it]
 66%|██████▌   | 25032/37963 [61:49:36<30:37:52,  8.53s/it]
 66%|██████▌   | 25033/37963 [61:49:44<30:21:54,  8.45s/it]
 66%|██████▌   | 25034/37963 [61:49:59<37:14:56, 10.37s/it]
 66%|██████▌   | 25035/37963 [61:50:07<34:53:55,  9.72s/it]
 66%|██████▌   | 25036/37963 [61:50:15<33:06:18,  9.22s/it]
 66%|██████▌   | 25037/37963 [61:50:23<31:29:58,  8.77s/it]
 66%|██████▌   | 25038/37963 [61:50:31<30:49:47,  8.59s/it]
 66%|██████▌   | 25039/37963 [61:50:40<30:31:34,  8.50s/it]
 66%|██████▌   | 25040/37963 [61:50:47<29:55:42,  8.34s/it]
                                                           
{'loss': '0.1238', 'grad_norm': '1.105', 'learning_rate': '5.487e-06', 'epoch': '0.6596'}
+
 66%|██████▌   | 25040/37963 [61:50:48<29:55:42,  8.34s/it]
 66%|██████▌   | 25041/37963 [61:51:04<38:15:05, 10.66s/it]
 66%|██████▌   | 25042/37963 [61:51:12<35:35:31,  9.92s/it]
 66%|██████▌   | 25043/37963 [61:51:20<33:50:56,  9.43s/it]
 66%|██████▌   | 25044/37963 [61:51:28<32:27:52,  9.05s/it]
 66%|██████▌   | 25045/37963 [61:51:36<31:29:37,  8.78s/it]
 66%|██████▌   | 25046/37963 [61:51:44<30:41:34,  8.55s/it]
 66%|██████▌   | 25047/37963 [61:51:52<29:47:55,  8.31s/it]
 66%|██████▌   | 25048/37963 [61:52:00<29:20:37,  8.18s/it]
 66%|██████▌   | 25049/37963 [61:52:08<28:52:38,  8.05s/it]
 66%|██████▌   | 25050/37963 [61:52:16<28:35:31,  7.97s/it]
                                                           
{'loss': '0.1256', 'grad_norm': '1.673', 'learning_rate': '5.48e-06', 'epoch': '0.6599'}
+
 66%|██████▌   | 25050/37963 [61:52:16<28:35:31,  7.97s/it]
 66%|██████▌   | 25051/37963 [61:52:23<28:24:34,  7.92s/it]
 66%|██████▌   | 25052/37963 [61:52:31<28:25:01,  7.92s/it]
 66%|██████▌   | 25053/37963 [61:52:39<28:16:01,  7.88s/it]
 66%|██████▌   | 25054/37963 [61:52:47<28:09:33,  7.85s/it]
 66%|██████▌   | 25055/37963 [61:52:55<28:05:58,  7.84s/it]
 66%|██████▌   | 25056/37963 [61:53:02<27:44:31,  7.74s/it]
 66%|██████▌   | 25057/37963 [61:53:16<34:42:52,  9.68s/it]
 66%|██████▌   | 25058/37963 [61:53:24<32:41:56,  9.12s/it]
 66%|██████▌   | 25059/37963 [61:53:32<31:11:32,  8.70s/it]
 66%|██████▌   | 25060/37963 [61:53:40<30:06:18,  8.40s/it]
                                                           
{'loss': '0.1184', 'grad_norm': '1.135', 'learning_rate': '5.472e-06', 'epoch': '0.6601'}
+
 66%|██████▌   | 25060/37963 [61:53:40<30:06:18,  8.40s/it]
 66%|██████▌   | 25061/37963 [61:53:47<29:23:27,  8.20s/it]
 66%|██████▌   | 25062/37963 [61:53:55<28:54:11,  8.07s/it]
 66%|██████▌   | 25063/37963 [61:54:03<28:39:46,  8.00s/it]
 66%|██████▌   | 25064/37963 [61:54:11<28:29:09,  7.95s/it]
 66%|██████▌   | 25065/37963 [61:54:19<28:18:11,  7.90s/it]
 66%|██████▌   | 25066/37963 [61:54:26<28:15:18,  7.89s/it]
 66%|██████▌   | 25067/37963 [61:54:41<35:24:19,  9.88s/it]
 66%|██████▌   | 25068/37963 [61:54:49<33:15:53,  9.29s/it]
 66%|██████▌   | 25069/37963 [61:55:04<39:13:27, 10.95s/it]
 66%|██████▌   | 25070/37963 [61:55:12<35:55:56, 10.03s/it]
                                                           
{'loss': '0.1316', 'grad_norm': '1.209', 'learning_rate': '5.464e-06', 'epoch': '0.6604'}
+
 66%|██████▌   | 25070/37963 [61:55:12<35:55:56, 10.03s/it]
 66%|██████▌   | 25071/37963 [61:55:19<33:25:00,  9.33s/it]
 66%|██████▌   | 25072/37963 [61:55:34<39:41:49, 11.09s/it]
 66%|██████▌   | 25073/37963 [61:55:42<36:19:47, 10.15s/it]
 66%|██████▌   | 25074/37963 [61:55:50<33:58:37,  9.49s/it]
 66%|██████▌   | 25075/37963 [61:55:58<31:54:55,  8.91s/it]
 66%|██████▌   | 25076/37963 [61:56:06<30:44:21,  8.59s/it]
 66%|██████▌   | 25077/37963 [61:56:20<36:49:49, 10.29s/it]
 66%|██████▌   | 25078/37963 [61:56:28<33:53:00,  9.47s/it]
 66%|██████▌   | 25079/37963 [61:56:42<39:21:15, 11.00s/it]
 66%|██████▌   | 25080/37963 [61:56:50<35:59:19, 10.06s/it]
                                                           
{'loss': '0.1368', 'grad_norm': '1.412', 'learning_rate': '5.457e-06', 'epoch': '0.6606'}
+
 66%|██████▌   | 25080/37963 [61:56:50<35:59:19, 10.06s/it]
 66%|██████▌   | 25081/37963 [61:56:58<33:22:08,  9.33s/it]
 66%|██████▌   | 25082/37963 [61:57:12<39:00:58, 10.90s/it]
 66%|██████▌   | 25083/37963 [61:57:21<36:15:17, 10.13s/it]
 66%|██████▌   | 25084/37963 [61:57:29<34:19:41,  9.60s/it]
 66%|██████▌   | 25085/37963 [61:57:37<32:22:57,  9.05s/it]
 66%|██████▌   | 25086/37963 [61:57:44<30:58:44,  8.66s/it]
 66%|██████▌   | 25087/37963 [61:57:52<30:05:15,  8.41s/it]
 66%|██████▌   | 25088/37963 [61:58:00<29:35:43,  8.28s/it]
 66%|██████▌   | 25089/37963 [61:58:08<29:00:18,  8.11s/it]
 66%|██████▌   | 25090/37963 [61:58:16<28:40:12,  8.02s/it]
                                                           
{'loss': '0.1298', 'grad_norm': '1.508', 'learning_rate': '5.449e-06', 'epoch': '0.6609'}
+
 66%|██████▌   | 25090/37963 [61:58:16<28:40:12,  8.02s/it]
 66%|██████▌   | 25091/37963 [61:58:24<28:28:21,  7.96s/it]
 66%|██████▌   | 25092/37963 [61:58:31<28:12:26,  7.89s/it]
 66%|██████▌   | 25093/37963 [61:58:39<28:01:04,  7.84s/it]
 66%|██████▌   | 25094/37963 [61:58:54<35:37:00,  9.96s/it]
 66%|██████▌   | 25095/37963 [61:59:02<33:19:44,  9.32s/it]
 66%|██████▌   | 25096/37963 [61:59:10<31:46:15,  8.89s/it]
 66%|██████▌   | 25097/37963 [61:59:17<30:38:36,  8.57s/it]
 66%|██████▌   | 25098/37963 [61:59:25<29:46:01,  8.33s/it]
 66%|██████▌   | 25099/37963 [61:59:33<29:13:56,  8.18s/it]
 66%|██████▌   | 25100/37963 [61:59:41<28:35:57,  8.00s/it]
                                                           
{'loss': '0.1313', 'grad_norm': '3.507', 'learning_rate': '5.442e-06', 'epoch': '0.6612'}
+
 66%|██████▌   | 25100/37963 [61:59:41<28:35:57,  8.00s/it]
 66%|██████▌   | 25101/37963 [61:59:49<28:34:21,  8.00s/it]
 66%|██████▌   | 25102/37963 [61:59:56<28:16:00,  7.91s/it]
 66%|██████▌   | 25103/37963 [62:00:04<28:03:52,  7.86s/it]
 66%|██████▌   | 25104/37963 [62:00:12<27:37:32,  7.73s/it]
 66%|██████▌   | 25105/37963 [62:00:19<27:39:03,  7.74s/it]
 66%|██████▌   | 25106/37963 [62:00:34<34:52:57,  9.77s/it]
 66%|██████▌   | 25107/37963 [62:00:42<32:45:47,  9.17s/it]
 66%|██████▌   | 25108/37963 [62:00:49<30:58:28,  8.67s/it]
 66%|██████▌   | 25109/37963 [62:00:57<29:40:07,  8.31s/it]
 66%|██████▌   | 25110/37963 [62:01:04<29:04:51,  8.15s/it]
                                                           
{'loss': '0.1221', 'grad_norm': '2.14', 'learning_rate': '5.434e-06', 'epoch': '0.6614'}
+
 66%|██████▌   | 25110/37963 [62:01:04<29:04:51,  8.15s/it]
 66%|██████▌   | 25111/37963 [62:01:12<28:35:23,  8.01s/it]
 66%|██████▌   | 25112/37963 [62:01:20<28:23:15,  7.95s/it]
 66%|██████▌   | 25113/37963 [62:01:28<28:12:07,  7.90s/it]
 66%|██████▌   | 25114/37963 [62:01:35<28:00:58,  7.85s/it]
 66%|██████▌   | 25115/37963 [62:01:44<28:24:34,  7.96s/it]
 66%|██████▌   | 25116/37963 [62:01:51<27:58:47,  7.84s/it]
 66%|██████▌   | 25117/37963 [62:02:06<35:23:41,  9.92s/it]
 66%|██████▌   | 25118/37963 [62:02:14<33:11:50,  9.30s/it]
 66%|██████▌   | 25119/37963 [62:02:28<38:43:44, 10.86s/it]
 66%|██████▌   | 25120/37963 [62:02:36<35:11:41,  9.87s/it]
                                                           
{'loss': '0.1254', 'grad_norm': '1.4', 'learning_rate': '5.426e-06', 'epoch': '0.6617'}
+
 66%|██████▌   | 25120/37963 [62:02:36<35:11:41,  9.87s/it]
 66%|██████▌   | 25121/37963 [62:02:51<40:53:59, 11.47s/it]
 66%|██████▌   | 25122/37963 [62:02:59<37:14:02, 10.44s/it]
 66%|██████▌   | 25123/37963 [62:03:07<34:17:59,  9.62s/it]
 66%|██████▌   | 25124/37963 [62:03:14<31:53:11,  8.94s/it]
 66%|██████▌   | 25125/37963 [62:03:28<37:33:32, 10.53s/it]
 66%|██████▌   | 25126/37963 [62:03:49<48:56:04, 13.72s/it]
 66%|██████▌   | 25127/37963 [62:03:57<42:39:36, 11.96s/it]
 66%|██████▌   | 25128/37963 [62:04:05<37:58:18, 10.65s/it]
 66%|██████▌   | 25129/37963 [62:04:13<34:46:56,  9.76s/it]
 66%|██████▌   | 25130/37963 [62:04:20<32:40:03,  9.16s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '2.014', 'learning_rate': '5.419e-06', 'epoch': '0.662'}
+
 66%|██████▌   | 25130/37963 [62:04:20<32:40:03,  9.16s/it]
 66%|██████▌   | 25131/37963 [62:04:28<31:11:05,  8.75s/it]
 66%|██████▌   | 25132/37963 [62:04:36<30:20:17,  8.51s/it]
 66%|██████▌   | 25133/37963 [62:04:44<29:37:39,  8.31s/it]
 66%|██████▌   | 25134/37963 [62:04:52<29:07:06,  8.17s/it]
 66%|██████▌   | 25135/37963 [62:04:59<28:34:54,  8.02s/it]
 66%|██████▌   | 25136/37963 [62:05:07<28:18:26,  7.94s/it]
 66%|██████▌   | 25137/37963 [62:05:15<28:08:39,  7.90s/it]
 66%|██████▌   | 25138/37963 [62:05:23<27:58:45,  7.85s/it]
 66%|██████▌   | 25139/37963 [62:05:30<27:45:29,  7.79s/it]
 66%|██████▌   | 25140/37963 [62:05:38<27:41:02,  7.77s/it]
                                                           
{'loss': '0.1218', 'grad_norm': '1.071', 'learning_rate': '5.411e-06', 'epoch': '0.6622'}
+
 66%|██████▌   | 25140/37963 [62:05:38<27:41:02,  7.77s/it]
 66%|██████▌   | 25141/37963 [62:05:46<27:22:26,  7.69s/it]
 66%|██████▌   | 25142/37963 [62:05:54<27:42:10,  7.78s/it]
 66%|██████▌   | 25143/37963 [62:06:02<27:57:23,  7.85s/it]
 66%|██████▌   | 25144/37963 [62:06:17<35:30:42,  9.97s/it]
 66%|██████▌   | 25145/37963 [62:06:24<33:10:33,  9.32s/it]
 66%|██████▌   | 25146/37963 [62:06:32<31:26:10,  8.83s/it]
 66%|██████▌   | 25147/37963 [62:06:40<30:21:19,  8.53s/it]
 66%|██████▌   | 25148/37963 [62:06:48<29:42:11,  8.34s/it]
 66%|██████▌   | 25149/37963 [62:06:56<29:17:19,  8.23s/it]
 66%|██████▌   | 25150/37963 [62:07:04<28:52:58,  8.12s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '2.213', 'learning_rate': '5.404e-06', 'epoch': '0.6625'}
+
 66%|██████▌   | 25150/37963 [62:07:04<28:52:58,  8.12s/it]
 66%|██████▋   | 25151/37963 [62:07:11<28:29:57,  8.01s/it]
 66%|██████▋   | 25152/37963 [62:07:19<27:55:22,  7.85s/it]
 66%|██████▋   | 25153/37963 [62:07:27<27:48:35,  7.82s/it]
 66%|██████▋   | 25154/37963 [62:07:41<35:02:53,  9.85s/it]
 66%|██████▋   | 25155/37963 [62:07:49<32:56:10,  9.26s/it]
 66%|██████▋   | 25156/37963 [62:07:56<30:58:47,  8.71s/it]
 66%|██████▋   | 25157/37963 [62:08:04<29:57:01,  8.42s/it]
 66%|██████▋   | 25158/37963 [62:08:12<28:52:31,  8.12s/it]
 66%|██████▋   | 25159/37963 [62:08:19<28:34:47,  8.04s/it]
 66%|██████▋   | 25160/37963 [62:08:27<28:22:59,  7.98s/it]
                                                           
{'loss': '0.1287', 'grad_norm': '1.772', 'learning_rate': '5.396e-06', 'epoch': '0.6628'}
+
 66%|██████▋   | 25160/37963 [62:08:27<28:22:59,  7.98s/it]
 66%|██████▋   | 25161/37963 [62:08:35<28:14:54,  7.94s/it]
 66%|██████▋   | 25162/37963 [62:08:43<28:08:02,  7.91s/it]
 66%|██████▋   | 25163/37963 [62:08:58<35:16:16,  9.92s/it]
 66%|██████▋   | 25164/37963 [62:09:13<40:42:22, 11.45s/it]
 66%|██████▋   | 25165/37963 [62:09:21<37:08:23, 10.45s/it]
 66%|██████▋   | 25166/37963 [62:09:29<34:15:53,  9.64s/it]
 66%|██████▋   | 25167/37963 [62:09:36<32:14:04,  9.07s/it]
 66%|██████▋   | 25168/37963 [62:09:44<30:49:36,  8.67s/it]
 66%|██████▋   | 25169/37963 [62:09:58<36:54:14, 10.38s/it]
 66%|██████▋   | 25170/37963 [62:10:13<41:17:49, 11.62s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '2.239', 'learning_rate': '5.388e-06', 'epoch': '0.663'}
+
 66%|██████▋   | 25170/37963 [62:10:13<41:17:49, 11.62s/it]
 66%|██████▋   | 25171/37963 [62:10:21<37:29:50, 10.55s/it]
 66%|██████▋   | 25172/37963 [62:10:29<34:39:47,  9.76s/it]
 66%|██████▋   | 25173/37963 [62:10:37<32:37:29,  9.18s/it]
 66%|██████▋   | 25174/37963 [62:10:44<31:05:27,  8.75s/it]
 66%|██████▋   | 25175/37963 [62:10:52<30:02:47,  8.46s/it]
 66%|██████▋   | 25176/37963 [62:11:08<37:36:32, 10.59s/it]
 66%|██████▋   | 25177/37963 [62:11:23<42:19:29, 11.92s/it]
 66%|██████▋   | 25178/37963 [62:11:31<38:02:58, 10.71s/it]
 66%|██████▋   | 25179/37963 [62:11:38<34:52:41,  9.82s/it]
 66%|██████▋   | 25180/37963 [62:11:46<32:48:35,  9.24s/it]
                                                           
{'loss': '0.1348', 'grad_norm': '3.065', 'learning_rate': '5.381e-06', 'epoch': '0.6633'}
+
 66%|██████▋   | 25180/37963 [62:11:46<32:48:35,  9.24s/it]
 66%|██████▋   | 25181/37963 [62:11:54<31:12:05,  8.79s/it]
 66%|██████▋   | 25182/37963 [62:12:02<30:09:42,  8.50s/it]
 66%|██████▋   | 25183/37963 [62:12:10<29:26:35,  8.29s/it]
 66%|██████▋   | 25184/37963 [62:12:18<29:10:10,  8.22s/it]
 66%|██████▋   | 25185/37963 [62:12:25<28:42:19,  8.09s/it]
 66%|██████▋   | 25186/37963 [62:12:33<28:19:37,  7.98s/it]
 66%|██████▋   | 25187/37963 [62:12:41<28:08:34,  7.93s/it]
 66%|██████▋   | 25188/37963 [62:12:49<27:42:07,  7.81s/it]
 66%|██████▋   | 25189/37963 [62:12:56<27:33:38,  7.77s/it]
 66%|██████▋   | 25190/37963 [62:13:04<27:31:25,  7.76s/it]
                                                           
{'loss': '0.1097', 'grad_norm': '1.238', 'learning_rate': '5.373e-06', 'epoch': '0.6635'}
+
 66%|██████▋   | 25190/37963 [62:13:04<27:31:25,  7.76s/it]
 66%|██████▋   | 25191/37963 [62:13:12<27:41:31,  7.81s/it]
 66%|██████▋   | 25192/37963 [62:13:20<27:44:38,  7.82s/it]
 66%|██████▋   | 25193/37963 [62:13:27<27:37:24,  7.79s/it]
 66%|██████▋   | 25194/37963 [62:13:35<27:34:00,  7.77s/it]
 66%|██████▋   | 25195/37963 [62:13:43<27:14:38,  7.68s/it]
 66%|██████▋   | 25196/37963 [62:13:51<27:27:08,  7.74s/it]
 66%|██████▋   | 25197/37963 [62:13:58<27:27:33,  7.74s/it]
 66%|██████▋   | 25198/37963 [62:14:13<35:06:44,  9.90s/it]
 66%|██████▋   | 25199/37963 [62:14:22<33:37:23,  9.48s/it]
 66%|██████▋   | 25200/37963 [62:14:30<31:48:50,  8.97s/it]
                                                           
{'loss': '0.1365', 'grad_norm': '2.659', 'learning_rate': '5.366e-06', 'epoch': '0.6638'}
+
 66%|██████▋   | 25200/37963 [62:14:30<31:48:50,  8.97s/it]
 66%|██████▋   | 25201/37963 [62:14:44<37:39:29, 10.62s/it]
 66%|██████▋   | 25202/37963 [62:14:52<34:40:30,  9.78s/it]
 66%|██████▋   | 25203/37963 [62:14:59<32:21:51,  9.13s/it]
 66%|██████▋   | 25204/37963 [62:15:07<30:41:19,  8.66s/it]
 66%|██████▋   | 25205/37963 [62:15:15<29:43:48,  8.39s/it]
 66%|██████▋   | 25206/37963 [62:15:22<28:49:37,  8.13s/it]
 66%|██████▋   | 25207/37963 [62:15:37<35:49:37, 10.11s/it]
 66%|██████▋   | 25208/37963 [62:15:45<33:17:07,  9.39s/it]
 66%|██████▋   | 25209/37963 [62:15:53<31:39:36,  8.94s/it]
 66%|██████▋   | 25210/37963 [62:16:00<30:25:06,  8.59s/it]
                                                           
{'loss': '0.1179', 'grad_norm': '2.699', 'learning_rate': '5.358e-06', 'epoch': '0.6641'}
+
 66%|██████▋   | 25210/37963 [62:16:00<30:25:06,  8.59s/it]
 66%|██████▋   | 25211/37963 [62:16:08<29:33:20,  8.34s/it]
 66%|██████▋   | 25212/37963 [62:16:16<28:56:25,  8.17s/it]
 66%|██████▋   | 25213/37963 [62:16:38<43:16:05, 12.22s/it]
 66%|██████▋   | 25214/37963 [62:16:46<38:59:50, 11.01s/it]
 66%|██████▋   | 25215/37963 [62:16:54<35:40:44, 10.08s/it]
 66%|██████▋   | 25216/37963 [62:17:02<33:38:02,  9.50s/it]
 66%|██████▋   | 25217/37963 [62:17:09<31:36:38,  8.93s/it]
 66%|██████▋   | 25218/37963 [62:17:17<30:25:40,  8.59s/it]
 66%|██████▋   | 25219/37963 [62:17:25<29:32:15,  8.34s/it]
 66%|██████▋   | 25220/37963 [62:17:33<29:00:43,  8.20s/it]
                                                           
{'loss': '0.1261', 'grad_norm': '2.317', 'learning_rate': '5.351e-06', 'epoch': '0.6643'}
+
 66%|██████▋   | 25220/37963 [62:17:33<29:00:43,  8.20s/it]
 66%|██████▋   | 25221/37963 [62:17:41<28:29:54,  8.05s/it]
 66%|██████▋   | 25222/37963 [62:17:49<28:24:25,  8.03s/it]
 66%|██████▋   | 25223/37963 [62:17:56<28:08:20,  7.95s/it]
 66%|██████▋   | 25224/37963 [62:18:11<35:33:36, 10.05s/it]
 66%|██████▋   | 25225/37963 [62:18:26<40:22:27, 11.41s/it]
 66%|██████▋   | 25226/37963 [62:18:34<36:46:46, 10.40s/it]
 66%|██████▋   | 25227/37963 [62:18:42<34:02:37,  9.62s/it]
 66%|██████▋   | 25228/37963 [62:18:49<31:57:37,  9.03s/it]
 66%|██████▋   | 25229/37963 [62:18:57<30:35:44,  8.65s/it]
 66%|██████▋   | 25230/37963 [62:19:12<37:37:14, 10.64s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '1.673', 'learning_rate': '5.343e-06', 'epoch': '0.6646'}
+
 66%|██████▋   | 25230/37963 [62:19:12<37:37:14, 10.64s/it]
 66%|██████▋   | 25231/37963 [62:19:20<34:22:37,  9.72s/it]
 66%|██████▋   | 25232/37963 [62:19:28<32:14:24,  9.12s/it]
 66%|██████▋   | 25233/37963 [62:19:35<30:48:35,  8.71s/it]
 66%|██████▋   | 25234/37963 [62:19:43<29:44:51,  8.41s/it]
 66%|██████▋   | 25235/37963 [62:19:51<28:55:11,  8.18s/it]
 66%|██████▋   | 25236/37963 [62:19:59<28:36:19,  8.09s/it]
 66%|██████▋   | 25237/37963 [62:20:06<28:16:23,  8.00s/it]
 66%|██████▋   | 25238/37963 [62:20:14<27:55:58,  7.90s/it]
 66%|██████▋   | 25239/37963 [62:20:22<27:59:06,  7.92s/it]
 66%|██████▋   | 25240/37963 [62:20:30<27:51:58,  7.88s/it]
                                                           
{'loss': '0.1286', 'grad_norm': '2.013', 'learning_rate': '5.336e-06', 'epoch': '0.6649'}
+
 66%|██████▋   | 25240/37963 [62:20:30<27:51:58,  7.88s/it]
 66%|██████▋   | 25241/37963 [62:20:38<27:44:20,  7.85s/it]
 66%|██████▋   | 25242/37963 [62:20:45<27:35:51,  7.81s/it]
 66%|██████▋   | 25243/37963 [62:20:53<27:35:06,  7.81s/it]
 66%|██████▋   | 25244/37963 [62:21:01<27:30:00,  7.78s/it]
 66%|██████▋   | 25245/37963 [62:21:16<34:48:01,  9.85s/it]
 67%|██████▋   | 25246/37963 [62:21:24<32:57:04,  9.33s/it]
 67%|██████▋   | 25247/37963 [62:21:39<39:10:42, 11.09s/it]
 67%|██████▋   | 25248/37963 [62:21:47<35:45:43, 10.13s/it]
 67%|██████▋   | 25249/37963 [62:21:55<33:16:18,  9.42s/it]
 67%|██████▋   | 25250/37963 [62:22:02<31:33:28,  8.94s/it]
                                                           
{'loss': '0.119', 'grad_norm': '2.574', 'learning_rate': '5.328e-06', 'epoch': '0.6651'}
+
 67%|██████▋   | 25250/37963 [62:22:02<31:33:28,  8.94s/it]
 67%|██████▋   | 25251/37963 [62:22:10<30:19:30,  8.59s/it]
 67%|██████▋   | 25252/37963 [62:22:18<29:28:18,  8.35s/it]
 67%|██████▋   | 25253/37963 [62:22:26<28:50:32,  8.17s/it]
 67%|██████▋   | 25254/37963 [62:22:33<28:23:01,  8.04s/it]
 67%|██████▋   | 25255/37963 [62:22:48<34:49:14,  9.86s/it]
 67%|██████▋   | 25256/37963 [62:22:56<33:05:25,  9.37s/it]
 67%|██████▋   | 25257/37963 [62:23:04<31:28:00,  8.92s/it]
 67%|██████▋   | 25258/37963 [62:23:11<29:56:50,  8.49s/it]
 67%|██████▋   | 25259/37963 [62:23:19<29:11:15,  8.27s/it]
 67%|██████▋   | 25260/37963 [62:23:27<28:42:11,  8.13s/it]
                                                           
{'loss': '0.1143', 'grad_norm': '2.593', 'learning_rate': '5.32e-06', 'epoch': '0.6654'}
+
 67%|██████▋   | 25260/37963 [62:23:27<28:42:11,  8.13s/it]
 67%|██████▋   | 25261/37963 [62:23:34<28:17:15,  8.02s/it]
 67%|██████▋   | 25262/37963 [62:23:42<28:00:27,  7.94s/it]
 67%|██████▋   | 25263/37963 [62:23:50<27:49:37,  7.89s/it]
 67%|██████▋   | 25264/37963 [62:24:05<35:15:05,  9.99s/it]
 67%|██████▋   | 25265/37963 [62:24:13<33:08:29,  9.40s/it]
 67%|██████▋   | 25266/37963 [62:24:21<31:36:43,  8.96s/it]
 67%|██████▋   | 25267/37963 [62:24:35<37:20:08, 10.59s/it]
 67%|██████▋   | 25268/37963 [62:24:43<34:24:33,  9.76s/it]
 67%|██████▋   | 25269/37963 [62:24:50<32:00:51,  9.08s/it]
 67%|██████▋   | 25270/37963 [62:24:58<30:37:26,  8.69s/it]
                                                           
{'loss': '0.126', 'grad_norm': '2.344', 'learning_rate': '5.313e-06', 'epoch': '0.6657'}
+
 67%|██████▋   | 25270/37963 [62:24:58<30:37:26,  8.69s/it]
 67%|██████▋   | 25271/37963 [62:25:06<29:45:54,  8.44s/it]
 67%|██████▋   | 25272/37963 [62:25:20<35:57:51, 10.20s/it]
 67%|██████▋   | 25273/37963 [62:25:28<33:21:03,  9.46s/it]
 67%|██████▋   | 25274/37963 [62:25:36<31:28:44,  8.93s/it]
 67%|██████▋   | 25275/37963 [62:25:43<30:04:56,  8.54s/it]
 67%|██████▋   | 25276/37963 [62:25:51<29:14:27,  8.30s/it]
 67%|██████▋   | 25277/37963 [62:25:59<28:32:41,  8.10s/it]
 67%|██████▋   | 25278/37963 [62:26:14<35:30:13, 10.08s/it]
 67%|██████▋   | 25279/37963 [62:26:21<33:13:04,  9.43s/it]
 67%|██████▋   | 25280/37963 [62:26:36<39:02:08, 11.08s/it]
                                                           
{'loss': '0.1277', 'grad_norm': '2.151', 'learning_rate': '5.305e-06', 'epoch': '0.6659'}
+
 67%|██████▋   | 25280/37963 [62:26:36<39:02:08, 11.08s/it]
 67%|██████▋   | 25281/37963 [62:26:44<35:51:28, 10.18s/it]
 67%|██████▋   | 25282/37963 [62:26:52<33:18:05,  9.45s/it]
 67%|██████▋   | 25283/37963 [62:27:00<31:26:47,  8.93s/it]
 67%|██████▋   | 25284/37963 [62:27:08<30:16:10,  8.59s/it]
 67%|██████▋   | 25285/37963 [62:27:15<29:12:57,  8.30s/it]
 67%|██████▋   | 25286/37963 [62:27:23<28:45:41,  8.17s/it]
 67%|██████▋   | 25287/37963 [62:27:31<28:24:16,  8.07s/it]
 67%|██████▋   | 25288/37963 [62:27:39<28:02:22,  7.96s/it]
 67%|██████▋   | 25289/37963 [62:27:46<27:43:24,  7.87s/it]
 67%|██████▋   | 25290/37963 [62:27:54<27:30:26,  7.81s/it]
                                                           
{'loss': '0.1251', 'grad_norm': '2.014', 'learning_rate': '5.298e-06', 'epoch': '0.6662'}
+
 67%|██████▋   | 25290/37963 [62:27:54<27:30:26,  7.81s/it]
 67%|██████▋   | 25291/37963 [62:28:01<26:54:51,  7.65s/it]
 67%|██████▋   | 25292/37963 [62:28:09<27:03:22,  7.69s/it]
 67%|██████▋   | 25293/37963 [62:28:17<27:00:23,  7.67s/it]
 67%|██████▋   | 25294/37963 [62:28:25<27:04:05,  7.69s/it]
 67%|██████▋   | 25295/37963 [62:28:32<27:08:08,  7.71s/it]
 67%|██████▋   | 25296/37963 [62:28:40<27:08:41,  7.71s/it]
 67%|██████▋   | 25297/37963 [62:28:48<27:07:33,  7.71s/it]
 67%|██████▋   | 25298/37963 [62:28:55<27:09:57,  7.72s/it]
 67%|██████▋   | 25299/37963 [62:29:17<41:55:32, 11.92s/it]
 67%|██████▋   | 25300/37963 [62:29:25<37:49:17, 10.75s/it]
                                                           
{'loss': '0.1197', 'grad_norm': '1.991', 'learning_rate': '5.29e-06', 'epoch': '0.6664'}
+
 67%|██████▋   | 25300/37963 [62:29:25<37:49:17, 10.75s/it]
 67%|██████▋   | 25301/37963 [62:29:33<34:36:55,  9.84s/it]
 67%|██████▋   | 25302/37963 [62:29:48<39:57:31, 11.36s/it]
 67%|██████▋   | 25303/37963 [62:29:56<36:43:13, 10.44s/it]
 67%|██████▋   | 25304/37963 [62:30:04<34:03:25,  9.69s/it]
 67%|██████▋   | 25305/37963 [62:30:12<31:47:08,  9.04s/it]
 67%|██████▋   | 25306/37963 [62:30:19<30:27:33,  8.66s/it]
 67%|██████▋   | 25307/37963 [62:30:27<29:45:47,  8.47s/it]
 67%|██████▋   | 25308/37963 [62:30:35<28:52:14,  8.21s/it]
 67%|██████▋   | 25309/37963 [62:30:43<28:16:17,  8.04s/it]
 67%|██████▋   | 25310/37963 [62:30:50<27:58:57,  7.96s/it]
                                                           
{'loss': '0.1276', 'grad_norm': '2.438', 'learning_rate': '5.283e-06', 'epoch': '0.6667'}
+
 67%|██████▋   | 25310/37963 [62:30:50<27:58:57,  7.96s/it]
 67%|██████▋   | 25311/37963 [62:30:58<27:48:54,  7.91s/it]
 67%|██████▋   | 25312/37963 [62:31:06<27:40:07,  7.87s/it]
 67%|██████▋   | 25313/37963 [62:31:13<27:15:13,  7.76s/it]
 67%|██████▋   | 25314/37963 [62:31:21<26:54:43,  7.66s/it]
 67%|██████▋   | 25315/37963 [62:31:28<26:45:37,  7.62s/it]
 67%|██████▋   | 25316/37963 [62:31:50<41:12:46, 11.73s/it]
 67%|██████▋   | 25317/37963 [62:31:57<36:49:13, 10.48s/it]
 67%|██████▋   | 25318/37963 [62:32:12<41:19:34, 11.77s/it]
 67%|██████▋   | 25319/37963 [62:32:20<37:17:11, 10.62s/it]
 67%|██████▋   | 25320/37963 [62:32:28<34:23:25,  9.79s/it]
                                                           
{'loss': '0.1161', 'grad_norm': '2.163', 'learning_rate': '5.275e-06', 'epoch': '0.667'}
+
 67%|██████▋   | 25320/37963 [62:32:28<34:23:25,  9.79s/it]
 67%|██████▋   | 25321/37963 [62:32:36<32:07:53,  9.15s/it]
 67%|██████▋   | 25322/37963 [62:32:43<30:27:23,  8.67s/it]
 67%|██████▋   | 25323/37963 [62:32:51<29:36:49,  8.43s/it]
 67%|██████▋   | 25324/37963 [62:32:59<28:56:06,  8.24s/it]
 67%|██████▋   | 25325/37963 [62:33:06<28:20:41,  8.07s/it]
 67%|██████▋   | 25326/37963 [62:33:21<35:35:32, 10.14s/it]
 67%|██████▋   | 25327/37963 [62:33:29<33:12:09,  9.46s/it]
 67%|██████▋   | 25328/37963 [62:33:37<31:26:16,  8.96s/it]
 67%|██████▋   | 25329/37963 [62:33:45<30:08:34,  8.59s/it]
 67%|██████▋   | 25330/37963 [62:33:53<29:16:59,  8.34s/it]
                                                           
{'loss': '0.1217', 'grad_norm': '2.217', 'learning_rate': '5.268e-06', 'epoch': '0.6672'}
+
 67%|██████▋   | 25330/37963 [62:33:53<29:16:59,  8.34s/it]
 67%|██████▋   | 25331/37963 [62:34:00<28:35:40,  8.15s/it]
 67%|██████▋   | 25332/37963 [62:34:14<34:58:46,  9.97s/it]
 67%|██████▋   | 25333/37963 [62:34:22<32:18:30,  9.21s/it]
 67%|██████▋   | 25334/37963 [62:34:30<30:48:55,  8.78s/it]
 67%|██████▋   | 25335/37963 [62:34:37<29:25:13,  8.39s/it]
 67%|██████▋   | 25336/37963 [62:34:45<28:41:09,  8.18s/it]
 67%|██████▋   | 25337/37963 [62:34:53<28:32:23,  8.14s/it]
 67%|██████▋   | 25338/37963 [62:35:01<28:04:37,  8.01s/it]
 67%|██████▋   | 25339/37963 [62:35:08<27:44:26,  7.91s/it]
 67%|██████▋   | 25340/37963 [62:35:16<27:33:32,  7.86s/it]
                                                           
{'loss': '0.1312', 'grad_norm': '1.462', 'learning_rate': '5.26e-06', 'epoch': '0.6675'}
+
 67%|██████▋   | 25340/37963 [62:35:16<27:33:32,  7.86s/it]
 67%|██████▋   | 25341/37963 [62:35:24<27:32:42,  7.86s/it]
 67%|██████▋   | 25342/37963 [62:35:32<27:31:46,  7.85s/it]
 67%|██████▋   | 25343/37963 [62:35:40<27:30:22,  7.85s/it]
 67%|██████▋   | 25344/37963 [62:35:47<27:36:58,  7.88s/it]
 67%|██████▋   | 25345/37963 [62:35:55<27:33:00,  7.86s/it]
 67%|██████▋   | 25346/37963 [62:36:10<34:43:24,  9.91s/it]
 67%|██████▋   | 25347/37963 [62:36:18<32:37:30,  9.31s/it]
 67%|██████▋   | 25348/37963 [62:36:26<30:49:32,  8.80s/it]
 67%|██████▋   | 25349/37963 [62:36:33<29:40:46,  8.47s/it]
 67%|██████▋   | 25350/37963 [62:36:41<28:51:41,  8.24s/it]
                                                           
{'loss': '0.1233', 'grad_norm': '2.536', 'learning_rate': '5.253e-06', 'epoch': '0.6678'}
+
 67%|██████▋   | 25350/37963 [62:36:41<28:51:41,  8.24s/it]
 67%|██████▋   | 25351/37963 [62:36:49<28:30:07,  8.14s/it]
 67%|██████▋   | 25352/37963 [62:36:57<28:11:56,  8.05s/it]
 67%|██████▋   | 25353/37963 [62:37:12<35:44:32, 10.20s/it]
 67%|██████▋   | 25354/37963 [62:37:20<33:43:28,  9.63s/it]
 67%|██████▋   | 25355/37963 [62:37:28<31:43:35,  9.06s/it]
 67%|██████▋   | 25356/37963 [62:37:36<30:41:06,  8.76s/it]
 67%|██████▋   | 25357/37963 [62:37:44<29:43:13,  8.49s/it]
 67%|██████▋   | 25358/37963 [62:37:52<28:56:08,  8.26s/it]
 67%|██████▋   | 25359/37963 [62:37:59<28:31:20,  8.15s/it]
 67%|██████▋   | 25360/37963 [62:38:07<28:13:02,  8.06s/it]
                                                           
{'loss': '0.1193', 'grad_norm': '1.973', 'learning_rate': '5.245e-06', 'epoch': '0.668'}
+
 67%|██████▋   | 25360/37963 [62:38:07<28:13:02,  8.06s/it]
 67%|██████▋   | 25361/37963 [62:38:15<28:07:14,  8.03s/it]
 67%|██████▋   | 25362/37963 [62:38:23<28:18:18,  8.09s/it]
 67%|██████▋   | 25363/37963 [62:38:38<35:12:46, 10.06s/it]
 67%|██████▋   | 25364/37963 [62:38:46<33:06:54,  9.46s/it]
 67%|██████▋   | 25365/37963 [62:38:54<31:35:16,  9.03s/it]
 67%|██████▋   | 25366/37963 [62:39:02<30:32:33,  8.73s/it]
 67%|██████▋   | 25367/37963 [62:39:10<29:49:15,  8.52s/it]
 67%|██████▋   | 25368/37963 [62:39:18<29:24:42,  8.41s/it]
 67%|██████▋   | 25369/37963 [62:39:27<29:09:22,  8.33s/it]
 67%|██████▋   | 25370/37963 [62:39:42<36:24:23, 10.41s/it]
                                                           
{'loss': '0.1317', 'grad_norm': '2.083', 'learning_rate': '5.238e-06', 'epoch': '0.6683'}
+
 67%|██████▋   | 25370/37963 [62:39:42<36:24:23, 10.41s/it]
 67%|██████▋   | 25371/37963 [62:39:50<34:02:27,  9.73s/it]
 67%|██████▋   | 25372/37963 [62:40:05<40:01:59, 11.45s/it]
 67%|██████▋   | 25373/37963 [62:40:14<36:43:47, 10.50s/it]
 67%|██████▋   | 25374/37963 [62:40:22<34:05:19,  9.75s/it]
 67%|██████▋   | 25375/37963 [62:40:30<32:22:13,  9.26s/it]
 67%|██████▋   | 25376/37963 [62:40:38<31:24:28,  8.98s/it]
 67%|██████▋   | 25377/37963 [62:40:46<30:30:11,  8.72s/it]
 67%|██████▋   | 25378/37963 [62:40:54<29:49:34,  8.53s/it]
 67%|██████▋   | 25379/37963 [62:41:02<29:22:18,  8.40s/it]
 67%|██████▋   | 25380/37963 [62:41:17<35:54:43, 10.27s/it]
                                                           
{'loss': '0.1341', 'grad_norm': '1.587', 'learning_rate': '5.23e-06', 'epoch': '0.6685'}
+
 67%|██████▋   | 25380/37963 [62:41:17<35:54:43, 10.27s/it]
 67%|██████▋   | 25381/37963 [62:41:34<42:24:25, 12.13s/it]
 67%|██████▋   | 25382/37963 [62:41:41<37:54:18, 10.85s/it]
 67%|██████▋   | 25383/37963 [62:41:49<34:54:57,  9.99s/it]
 67%|██████▋   | 25384/37963 [62:41:57<32:47:29,  9.38s/it]
 67%|██████▋   | 25385/37963 [62:42:06<31:32:28,  9.03s/it]
 67%|██████▋   | 25386/37963 [62:42:14<30:32:20,  8.74s/it]
 67%|██████▋   | 25387/37963 [62:42:22<29:43:04,  8.51s/it]
 67%|██████���   | 25388/37963 [62:42:30<29:26:28,  8.43s/it]
 67%|██████▋   | 25389/37963 [62:42:45<36:23:06, 10.42s/it]
 67%|██████▋   | 25390/37963 [62:42:53<34:23:42,  9.85s/it]
                                                           
{'loss': '0.124', 'grad_norm': '2.181', 'learning_rate': '5.223e-06', 'epoch': '0.6688'}
+
 67%|██████▋   | 25390/37963 [62:42:53<34:23:42,  9.85s/it]
 67%|██████▋   | 25391/37963 [62:43:02<32:44:51,  9.38s/it]
 67%|██████▋   | 25392/37963 [62:43:10<31:45:28,  9.09s/it]
 67%|██████▋   | 25393/37963 [62:43:18<30:41:56,  8.79s/it]
 67%|██████▋   | 25394/37963 [62:43:26<30:06:30,  8.62s/it]
 67%|██████▋   | 25395/37963 [62:43:34<29:21:38,  8.41s/it]
 67%|██████▋   | 25396/37963 [62:43:43<29:11:52,  8.36s/it]
 67%|██████▋   | 25397/37963 [62:43:51<29:23:54,  8.42s/it]
 67%|██████▋   | 25398/37963 [62:43:59<29:14:11,  8.38s/it]
 67%|██████▋   | 25399/37963 [62:44:08<29:04:13,  8.33s/it]
 67%|██████▋   | 25400/37963 [62:44:16<28:47:34,  8.25s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '2.698', 'learning_rate': '5.215e-06', 'epoch': '0.6691'}
+
 67%|██████▋   | 25400/37963 [62:44:16<28:47:34,  8.25s/it]
 67%|██████▋   | 25401/37963 [62:44:31<36:04:12, 10.34s/it]
 67%|██████▋   | 25402/37963 [62:44:39<34:08:01,  9.78s/it]
 67%|██████▋   | 25403/37963 [62:44:47<32:16:00,  9.25s/it]
 67%|██████▋   | 25404/37963 [62:44:56<31:13:18,  8.95s/it]
 67%|██████▋   | 25405/37963 [62:45:04<30:33:18,  8.76s/it]
 67%|██████▋   | 25406/37963 [62:45:21<39:24:51, 11.30s/it]
 67%|██████▋   | 25407/37963 [62:45:30<36:17:15, 10.40s/it]
 67%|██████▋   | 25408/37963 [62:45:38<33:45:38,  9.68s/it]
 67%|██████▋   | 25409/37963 [62:45:46<32:18:56,  9.27s/it]
 67%|██████▋   | 25410/37963 [62:45:54<31:07:10,  8.92s/it]
                                                           
{'loss': '0.1249', 'grad_norm': '1.614', 'learning_rate': '5.208e-06', 'epoch': '0.6693'}
+
 67%|██████▋   | 25410/37963 [62:45:54<31:07:10,  8.92s/it]
 67%|██████▋   | 25411/37963 [62:46:02<30:17:40,  8.69s/it]
 67%|██████▋   | 25412/37963 [62:46:10<29:51:49,  8.57s/it]
 67%|██████▋   | 25413/37963 [62:46:19<29:24:08,  8.43s/it]
 67%|██████▋   | 25414/37963 [62:46:27<29:02:17,  8.33s/it]
 67%|██████▋   | 25415/37963 [62:46:35<28:53:46,  8.29s/it]
 67%|██████▋   | 25416/37963 [62:46:43<28:44:22,  8.25s/it]
 67%|██████▋   | 25417/37963 [62:47:05<42:51:16, 12.30s/it]
 67%|██████▋   | 25418/37963 [62:47:13<38:50:03, 11.14s/it]
 67%|██████▋   | 25419/37963 [62:47:30<44:31:22, 12.78s/it]
 67%|██████▋   | 25420/37963 [62:47:38<39:45:56, 11.41s/it]
                                                           
{'loss': '0.1255', 'grad_norm': '2.193', 'learning_rate': '5.2e-06', 'epoch': '0.6696'}
+
 67%|██████▋   | 25420/37963 [62:47:38<39:45:56, 11.41s/it]
 67%|██████▋   | 25421/37963 [62:47:46<36:27:22, 10.46s/it]
 67%|██████▋   | 25422/37963 [62:47:54<33:40:18,  9.67s/it]
 67%|██████▋   | 25423/37963 [62:48:02<32:10:14,  9.24s/it]
 67%|██████▋   | 25424/37963 [62:48:11<31:09:29,  8.95s/it]
 67%|██████▋   | 25425/37963 [62:48:19<30:33:37,  8.77s/it]
 67%|██████▋   | 25426/37963 [62:48:27<29:54:29,  8.59s/it]
 67%|██████▋   | 25427/37963 [62:48:35<29:40:21,  8.52s/it]
 67%|██████▋   | 25428/37963 [62:48:43<29:07:45,  8.37s/it]
 67%|██████▋   | 25429/37963 [62:49:00<38:02:52, 10.93s/it]
 67%|██████▋   | 25430/37963 [62:49:09<35:13:21, 10.12s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '1.835', 'learning_rate': '5.193e-06', 'epoch': '0.6699'}
+
 67%|██████▋   | 25430/37963 [62:49:09<35:13:21, 10.12s/it]
 67%|██████▋   | 25431/37963 [62:49:17<33:26:34,  9.61s/it]
 67%|██████▋   | 25432/37963 [62:49:25<31:53:58,  9.16s/it]
 67%|██████▋   | 25433/37963 [62:49:33<30:39:26,  8.81s/it]
 67%|██████▋   | 25434/37963 [62:49:41<29:26:29,  8.46s/it]
 67%|██████▋   | 25435/37963 [62:49:49<28:50:56,  8.29s/it]
 67%|██████▋   | 25436/37963 [62:49:57<28:24:37,  8.16s/it]
 67%|██████▋   | 25437/37963 [62:50:11<35:26:51, 10.19s/it]
 67%|██████▋   | 25438/37963 [62:50:20<33:34:49,  9.65s/it]
 67%|██████▋   | 25439/37963 [62:50:28<31:55:50,  9.18s/it]
 67%|██████▋   | 25440/37963 [62:50:36<30:34:12,  8.79s/it]
                                                           
{'loss': '0.1209', 'grad_norm': '1.278', 'learning_rate': '5.185e-06', 'epoch': '0.6701'}
+
 67%|██████▋   | 25440/37963 [62:50:36<30:34:12,  8.79s/it]
 67%|██████▋   | 25441/37963 [62:50:44<30:02:46,  8.64s/it]
 67%|██████▋   | 25442/37963 [62:50:52<29:26:19,  8.46s/it]
 67%|██████▋   | 25443/37963 [62:51:00<29:07:53,  8.38s/it]
 67%|██████▋   | 25444/37963 [62:51:08<28:45:06,  8.27s/it]
 67%|██████▋   | 25445/37963 [62:51:23<35:16:53, 10.15s/it]
 67%|██████▋   | 25446/37963 [62:51:31<33:18:46,  9.58s/it]
 67%|██████▋   | 25447/37963 [62:51:39<31:42:26,  9.12s/it]
 67%|██████▋   | 25448/37963 [62:51:47<30:34:49,  8.80s/it]
 67%|██████▋   | 25449/37963 [62:51:55<29:50:26,  8.58s/it]
 67%|██████▋   | 25450/37963 [62:52:03<29:16:37,  8.42s/it]
                                                           
{'loss': '0.1274', 'grad_norm': '2.116', 'learning_rate': '5.178e-06', 'epoch': '0.6704'}
+
 67%|██████▋   | 25450/37963 [62:52:03<29:16:37,  8.42s/it]
 67%|██████▋   | 25451/37963 [62:52:12<29:06:24,  8.37s/it]
 67%|██████▋   | 25452/37963 [62:52:20<28:39:10,  8.24s/it]
 67%|██████▋   | 25453/37963 [62:52:27<28:10:56,  8.11s/it]
 67%|██████▋   | 25454/37963 [62:52:44<37:16:22, 10.73s/it]
 67%|██████▋   | 25455/37963 [62:52:52<34:34:48,  9.95s/it]
 67%|██████▋   | 25456/37963 [62:53:00<32:36:01,  9.38s/it]
 67%|██████▋   | 25457/37963 [62:53:08<31:16:06,  9.00s/it]
 67%|██████▋   | 25458/37963 [62:53:16<29:59:40,  8.63s/it]
 67%|██████▋   | 25459/37963 [62:53:24<29:10:29,  8.40s/it]
 67%|██████▋   | 25460/37963 [62:53:32<28:35:12,  8.23s/it]
                                                           
{'loss': '0.12', 'grad_norm': '1.956', 'learning_rate': '5.17e-06', 'epoch': '0.6707'}
+
 67%|██████▋   | 25460/37963 [62:53:32<28:35:12,  8.23s/it]
 67%|██████▋   | 25461/37963 [62:53:47<35:23:00, 10.19s/it]
 67%|██████▋   | 25462/37963 [62:53:55<33:02:50,  9.52s/it]
 67%|██████▋   | 25463/37963 [62:54:03<31:27:05,  9.06s/it]
 67%|██████▋   | 25464/37963 [62:54:11<30:14:37,  8.71s/it]
 67%|██████▋   | 25465/37963 [62:54:18<29:27:28,  8.49s/it]
 67%|██████▋   | 25466/37963 [62:54:40<43:28:54, 12.53s/it]
 67%|██████▋   | 25467/37963 [62:54:49<39:12:32, 11.30s/it]
 67%|██████▋   | 25468/37963 [62:54:57<35:54:18, 10.34s/it]
 67%|██████▋   | 25469/37963 [62:55:05<33:36:05,  9.68s/it]
 67%|██████▋   | 25470/37963 [62:55:13<31:46:09,  9.15s/it]
                                                           
{'loss': '0.1208', 'grad_norm': '1.622', 'learning_rate': '5.163e-06', 'epoch': '0.6709'}
+
 67%|██████▋   | 25470/37963 [62:55:13<31:46:09,  9.15s/it]
 67%|██████▋   | 25471/37963 [62:55:21<30:24:32,  8.76s/it]
 67%|██████▋   | 25472/37963 [62:55:29<29:16:22,  8.44s/it]
 67%|██████▋   | 25473/37963 [62:55:37<28:53:35,  8.33s/it]
 67%|██████▋   | 25474/37963 [62:55:45<29:02:34,  8.37s/it]
 67%|██████▋   | 25475/37963 [62:55:53<28:34:25,  8.24s/it]
 67%|██████▋   | 25476/37963 [62:56:01<28:14:13,  8.14s/it]
 67%|██████▋   | 25477/37963 [62:56:17<36:20:58, 10.48s/it]
 67%|██████▋   | 25478/37963 [62:56:25<34:08:12,  9.84s/it]
 67%|██████▋   | 25479/37963 [62:56:33<32:14:54,  9.30s/it]
 67%|██████▋   | 25480/37963 [62:56:42<31:12:30,  9.00s/it]
                                                           
{'loss': '0.1328', 'grad_norm': '2.509', 'learning_rate': '5.155e-06', 'epoch': '0.6712'}
+
 67%|██████▋   | 25480/37963 [62:56:42<31:12:30,  9.00s/it]
 67%|██████▋   | 25481/37963 [62:56:57<37:29:33, 10.81s/it]
 67%|██████▋   | 25482/37963 [62:57:05<35:05:54, 10.12s/it]
 67%|██████▋   | 25483/37963 [62:57:20<40:02:28, 11.55s/it]
 67%|██████▋   | 25484/37963 [62:57:28<36:42:06, 10.59s/it]
 67%|██████▋   | 25485/37963 [62:57:36<33:48:24,  9.75s/it]
 67%|██████▋   | 25486/37963 [62:57:44<31:58:01,  9.22s/it]
 67%|██████▋   | 25487/37963 [62:57:52<30:46:36,  8.88s/it]
 67%|██████▋   | 25488/37963 [62:58:00<29:52:04,  8.62s/it]
 67%|██████▋   | 25489/37963 [62:58:08<29:20:34,  8.47s/it]
 67%|██████▋   | 25490/37963 [62:58:16<28:47:38,  8.31s/it]
                                                           
{'loss': '0.1147', 'grad_norm': '1.734', 'learning_rate': '5.148e-06', 'epoch': '0.6714'}
+
 67%|██████▋   | 25490/37963 [62:58:16<28:47:38,  8.31s/it]
 67%|██████▋   | 25491/37963 [62:58:24<28:21:17,  8.18s/it]
 67%|██████▋   | 25492/37963 [62:58:32<28:04:04,  8.10s/it]
 67%|██████▋   | 25493/37963 [62:58:40<27:44:21,  8.01s/it]
 67%|██████▋   | 25494/37963 [62:58:48<27:33:45,  7.96s/it]
 67%|██████▋   | 25495/37963 [62:58:56<27:53:49,  8.05s/it]
 67%|██████▋   | 25496/37963 [62:59:04<27:48:39,  8.03s/it]
 67%|██████▋   | 25497/37963 [62:59:12<28:01:34,  8.09s/it]
 67%|██████▋   | 25498/37963 [62:59:21<28:23:00,  8.20s/it]
 67%|██████▋   | 25499/37963 [62:59:35<35:05:54, 10.14s/it]
 67%|██████▋   | 25500/37963 [62:59:44<33:02:03,  9.54s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '1.76', 'learning_rate': '5.141e-06', 'epoch': '0.6717'}
+
 67%|██████▋   | 25500/37963 [62:59:44<33:02:03,  9.54s/it]
 67%|██████▋   | 25501/37963 [62:59:52<31:56:09,  9.23s/it]
 67%|██████▋   | 25502/37963 [63:00:00<30:29:41,  8.81s/it]
 67%|██████▋   | 25503/37963 [63:00:17<38:56:58, 11.25s/it]
 67%|██████▋   | 25504/37963 [63:00:32<42:42:44, 12.34s/it]
 67%|██████▋   | 25505/37963 [63:00:40<38:23:29, 11.09s/it]
 67%|██████▋   | 25506/37963 [63:00:48<35:14:20, 10.18s/it]
 67%|██████▋   | 25507/37963 [63:00:56<32:56:10,  9.52s/it]
 67%|██████▋   | 25508/37963 [63:01:04<31:26:23,  9.09s/it]
 67%|██████▋   | 25509/37963 [63:01:12<30:28:58,  8.81s/it]
 67%|██████▋   | 25510/37963 [63:01:20<29:49:07,  8.62s/it]
                                                           
{'loss': '0.1354', 'grad_norm': '1.618', 'learning_rate': '5.133e-06', 'epoch': '0.672'}
+
 67%|██████▋   | 25510/37963 [63:01:20<29:49:07,  8.62s/it]
 67%|██████▋   | 25511/37963 [63:01:28<29:10:00,  8.43s/it]
 67%|██████▋   | 25512/37963 [63:01:36<28:35:02,  8.26s/it]
 67%|██████▋   | 25513/37963 [63:01:52<36:49:56, 10.65s/it]
 67%|██████▋   | 25514/37963 [63:02:01<34:15:35,  9.91s/it]
 67%|██████▋   | 25515/37963 [63:02:09<32:21:34,  9.36s/it]
 67%|██████▋   | 25516/37963 [63:02:17<30:53:02,  8.93s/it]
 67%|██████▋   | 25517/37963 [63:02:24<29:38:25,  8.57s/it]
 67%|██████▋   | 25518/37963 [63:02:32<29:05:23,  8.41s/it]
 67%|██████▋   | 25519/37963 [63:02:40<28:45:06,  8.32s/it]
 67%|██████▋   | 25520/37963 [63:02:49<28:41:14,  8.30s/it]
                                                           
{'loss': '0.1216', 'grad_norm': '1.725', 'learning_rate': '5.126e-06', 'epoch': '0.6722'}
+
 67%|██████▋   | 25520/37963 [63:02:49<28:41:14,  8.30s/it]
 67%|██████▋   | 25521/37963 [63:03:12<44:28:02, 12.87s/it]
 67%|██████▋   | 25522/37963 [63:03:20<39:35:52, 11.46s/it]
 67%|██████▋   | 25523/37963 [63:03:29<36:10:39, 10.47s/it]
 67%|██████▋   | 25524/37963 [63:03:43<40:16:49, 11.66s/it]
 67%|██████▋   | 25525/37963 [63:03:51<36:55:10, 10.69s/it]
 67%|██████▋   | 25526/37963 [63:04:00<34:15:42,  9.92s/it]
 67%|██████▋   | 25527/37963 [63:04:08<32:21:06,  9.37s/it]
 67%|██████▋   | 25528/37963 [63:04:16<31:02:06,  8.98s/it]
 67%|██████▋   | 25529/37963 [63:04:24<30:16:34,  8.77s/it]
 67%|██████▋   | 25530/37963 [63:04:32<29:44:20,  8.61s/it]
                                                           
{'loss': '0.1319', 'grad_norm': '3.247', 'learning_rate': '5.118e-06', 'epoch': '0.6725'}
+
 67%|██████▋   | 25530/37963 [63:04:32<29:44:20,  8.61s/it]
 67%|██████▋   | 25531/37963 [63:04:41<29:29:11,  8.54s/it]
 67%|██████▋   | 25532/37963 [63:04:49<28:55:09,  8.37s/it]
 67%|██████▋   | 25533/37963 [63:05:04<35:49:44, 10.38s/it]
 67%|██████▋   | 25534/37963 [63:05:12<33:31:03,  9.71s/it]
 67%|██████▋   | 25535/37963 [63:05:20<31:54:16,  9.24s/it]
 67%|██████▋   | 25536/37963 [63:05:28<30:35:28,  8.86s/it]
 67%|██████▋   | 25537/37963 [63:05:36<29:43:23,  8.61s/it]
 67%|██████▋   | 25538/37963 [63:05:44<29:09:40,  8.45s/it]
 67%|██████▋   | 25539/37963 [63:05:52<28:34:23,  8.28s/it]
 67%|██████▋   | 25540/37963 [63:06:00<28:35:29,  8.29s/it]
                                                           
{'loss': '0.1295', 'grad_norm': '2.41', 'learning_rate': '5.111e-06', 'epoch': '0.6728'}
+
 67%|██████▋   | 25540/37963 [63:06:00<28:35:29,  8.29s/it]
 67%|██████▋   | 25541/37963 [63:06:08<28:13:35,  8.18s/it]
 67%|██████▋   | 25542/37963 [63:06:16<28:23:14,  8.23s/it]
 67%|██████▋   | 25543/37963 [63:06:25<28:29:42,  8.26s/it]
 67%|██████▋   | 25544/37963 [63:06:33<28:24:09,  8.23s/it]
 67%|██████▋   | 25545/37963 [63:06:41<28:10:11,  8.17s/it]
 67%|██████▋   | 25546/37963 [63:06:49<28:07:33,  8.15s/it]
 67%|██████▋   | 25547/37963 [63:07:04<35:06:53, 10.18s/it]
 67%|██████▋   | 25548/37963 [63:07:12<32:43:45,  9.49s/it]
 67%|██████▋   | 25549/37963 [63:07:28<40:00:39, 11.60s/it]
 67%|██████▋   | 25550/37963 [63:07:36<35:55:28, 10.42s/it]
                                                           
{'loss': '0.1252', 'grad_norm': '2.001', 'learning_rate': '5.103e-06', 'epoch': '0.673'}
+
 67%|██████▋   | 25550/37963 [63:07:36<35:55:28, 10.42s/it]
 67%|██████▋   | 25551/37963 [63:07:44<33:23:38,  9.69s/it]
 67%|██████▋   | 25552/37963 [63:07:58<38:15:18, 11.10s/it]
 67%|██████▋   | 25553/37963 [63:08:07<35:17:38, 10.24s/it]
 67%|██████▋   | 25554/37963 [63:08:15<33:27:24,  9.71s/it]
 67%|██████▋   | 25555/37963 [63:08:23<31:54:40,  9.26s/it]
 67%|██████▋   | 25556/37963 [63:08:31<30:29:39,  8.85s/it]
 67%|██████▋   | 25557/37963 [63:08:40<29:55:29,  8.68s/it]
 67%|██████▋   | 25558/37963 [63:08:48<29:14:23,  8.49s/it]
 67%|██████▋   | 25559/37963 [63:09:04<37:21:11, 10.84s/it]
 67%|██████▋   | 25560/37963 [63:09:12<34:40:24, 10.06s/it]
                                                           
{'loss': '0.1172', 'grad_norm': '4.085', 'learning_rate': '5.096e-06', 'epoch': '0.6733'}
+
 67%|██████▋   | 25560/37963 [63:09:12<34:40:24, 10.06s/it]
 67%|██████▋   | 25561/37963 [63:09:20<32:39:08,  9.48s/it]
 67%|██████▋   | 25562/37963 [63:09:29<31:32:28,  9.16s/it]
 67%|██████▋   | 25563/37963 [63:09:37<30:26:57,  8.84s/it]
 67%|██████▋   | 25564/37963 [63:09:45<29:31:15,  8.57s/it]
 67%|██████▋   | 25565/37963 [63:09:53<29:22:48,  8.53s/it]
 67%|██████▋   | 25566/37963 [63:10:01<28:55:35,  8.40s/it]
 67%|██████▋   | 25567/37963 [63:10:18<37:18:22, 10.83s/it]
 67%|██████▋   | 25568/37963 [63:10:26<34:44:58, 10.09s/it]
 67%|██████▋   | 25569/37963 [63:10:34<32:38:16,  9.48s/it]
 67%|██████▋   | 25570/37963 [63:10:42<31:03:25,  9.02s/it]
                                                           
{'loss': '0.1282', 'grad_norm': '1.554', 'learning_rate': '5.088e-06', 'epoch': '0.6736'}
+
 67%|██████▋   | 25570/37963 [63:10:42<31:03:25,  9.02s/it]
 67%|██████▋   | 25571/37963 [63:10:50<30:16:07,  8.79s/it]
 67%|██████▋   | 25572/37963 [63:10:58<29:21:54,  8.53s/it]
 67%|██████▋   | 25573/37963 [63:11:13<36:01:25, 10.47s/it]
 67%|██████▋   | 25574/37963 [63:11:21<33:35:52,  9.76s/it]
 67%|██████▋   | 25575/37963 [63:11:37<39:17:46, 11.42s/it]
 67%|██████▋   | 25576/37963 [63:11:45<36:01:59, 10.47s/it]
 67%|██████▋   | 25577/37963 [63:11:53<33:11:59,  9.65s/it]
 67%|██████▋   | 25578/37963 [63:12:01<31:18:49,  9.10s/it]
 67%|██████▋   | 25579/37963 [63:12:09<30:13:30,  8.79s/it]
 67%|██████▋   | 25580/37963 [63:12:17<29:49:48,  8.67s/it]
                                                           
{'loss': '0.1174', 'grad_norm': '1.88', 'learning_rate': '5.081e-06', 'epoch': '0.6738'}
+
 67%|██████▋   | 25580/37963 [63:12:17<29:49:48,  8.67s/it]
 67%|██████▋   | 25581/37963 [63:12:25<29:16:51,  8.51s/it]
 67%|██████▋   | 25582/37963 [63:12:33<28:53:24,  8.40s/it]
 67%|██████▋   | 25583/37963 [63:12:42<28:46:09,  8.37s/it]
 67%|██████▋   | 25584/37963 [63:12:50<28:48:18,  8.38s/it]
 67%|██████▋   | 25585/37963 [63:12:58<28:24:31,  8.26s/it]
 67%|██████▋   | 25586/37963 [63:13:06<28:17:36,  8.23s/it]
 67%|██████▋   | 25587/37963 [63:13:21<35:02:02, 10.19s/it]
 67%|██████▋   | 25588/37963 [63:13:29<32:52:39,  9.56s/it]
 67%|██████▋   | 25589/37963 [63:13:37<31:13:25,  9.08s/it]
 67%|██████▋   | 25590/37963 [63:13:45<30:22:37,  8.84s/it]
                                                           
{'loss': '0.1328', 'grad_norm': '3.274', 'learning_rate': '5.074e-06', 'epoch': '0.6741'}
+
 67%|██████▋   | 25590/37963 [63:13:45<30:22:37,  8.84s/it]
 67%|██████▋   | 25591/37963 [63:13:53<29:33:03,  8.60s/it]
 67%|██████▋   | 25592/37963 [63:14:01<29:02:46,  8.45s/it]
 67%|██████▋   | 25593/37963 [63:14:09<28:41:15,  8.35s/it]
 67%|██████▋   | 25594/37963 [63:14:26<37:07:02, 10.80s/it]
 67%|██████▋   | 25595/37963 [63:14:34<34:29:13, 10.04s/it]
 67%|██████▋   | 25596/37963 [63:14:42<32:13:55,  9.38s/it]
 67%|██████▋   | 25597/37963 [63:14:50<31:04:58,  9.05s/it]
 67%|██████▋   | 25598/37963 [63:14:58<30:06:01,  8.76s/it]
 67%|██████▋   | 25599/37963 [63:15:07<29:34:42,  8.61s/it]
 67%|██████▋   | 25600/37963 [63:15:14<28:38:04,  8.34s/it]
                                                           
{'loss': '0.1165', 'grad_norm': '1.852', 'learning_rate': '5.066e-06', 'epoch': '0.6743'}
+
 67%|██████▋   | 25600/37963 [63:15:14<28:38:04,  8.34s/it]
 67%|██████▋   | 25601/37963 [63:15:36<41:51:48, 12.19s/it]
 67%|██████▋   | 25602/37963 [63:15:44<37:29:47, 10.92s/it]
 67%|██████▋   | 25603/37963 [63:15:59<42:17:22, 12.32s/it]
 67%|██████▋   | 25604/37963 [63:16:08<38:16:15, 11.15s/it]
 67%|██████▋   | 25605/37963 [63:16:15<34:46:22, 10.13s/it]
 67%|██████▋   | 25606/37963 [63:16:23<32:41:02,  9.52s/it]
 67%|██████▋   | 25607/37963 [63:16:31<31:10:45,  9.08s/it]
 67%|██████▋   | 25608/37963 [63:16:39<29:43:47,  8.66s/it]
 67%|██████▋   | 25609/37963 [63:16:47<29:07:57,  8.49s/it]
 67%|██████▋   | 25610/37963 [63:16:55<28:33:22,  8.32s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '1.956', 'learning_rate': '5.059e-06', 'epoch': '0.6746'}
+
 67%|██████▋   | 25610/37963 [63:16:55<28:33:22,  8.32s/it]
 67%|██████▋   | 25611/37963 [63:17:03<28:11:45,  8.22s/it]
 67%|██████▋   | 25612/37963 [63:17:11<27:57:08,  8.15s/it]
 67%|██████▋   | 25613/37963 [63:17:19<27:51:46,  8.12s/it]
 67%|██████▋   | 25614/37963 [63:17:28<28:07:16,  8.20s/it]
 67%|██████▋   | 25615/37963 [63:17:36<28:19:12,  8.26s/it]
 67%|██████▋   | 25616/37963 [63:17:52<36:26:08, 10.62s/it]
 67%|██████▋   | 25617/37963 [63:18:00<34:01:28,  9.92s/it]
 67%|██████▋   | 25618/37963 [63:18:08<31:51:27,  9.29s/it]
 67%|██████▋   | 25619/37963 [63:18:16<30:28:01,  8.89s/it]
 67%|██████▋   | 25620/37963 [63:18:24<29:39:58,  8.65s/it]
                                                           
{'loss': '0.1133', 'grad_norm': '1.981', 'learning_rate': '5.051e-06', 'epoch': '0.6749'}
+
 67%|██████▋   | 25620/37963 [63:18:25<29:39:58,  8.65s/it]
 67%|██████▋   | 25621/37963 [63:18:39<35:51:16, 10.46s/it]
 67%|██████▋   | 25622/37963 [63:18:47<33:24:03,  9.74s/it]
 67%|██████▋   | 25623/37963 [63:18:55<31:36:55,  9.22s/it]
 67%|██████▋   | 25624/37963 [63:19:03<30:27:49,  8.89s/it]
 67%|██████▋   | 25625/37963 [63:19:11<29:32:56,  8.62s/it]
 68%|██████▊   | 25626/37963 [63:19:26<35:54:36, 10.48s/it]
 68%|██████▊   | 25627/37963 [63:19:34<33:27:16,  9.76s/it]
 68%|██████▊   | 25628/37963 [63:19:42<31:39:51,  9.24s/it]
 68%|██████▊   | 25629/37963 [63:19:50<30:33:17,  8.92s/it]
 68%|██████▊   | 25630/37963 [63:19:58<29:42:28,  8.67s/it]
                                                           
{'loss': '0.1292', 'grad_norm': '1.723', 'learning_rate': '5.044e-06', 'epoch': '0.6751'}
+
 68%|██████▊   | 25630/37963 [63:19:58<29:42:28,  8.67s/it]
 68%|██████▊   | 25631/37963 [63:20:06<29:05:20,  8.49s/it]
 68%|██████▊   | 25632/37963 [63:20:14<28:36:34,  8.35s/it]
 68%|██████▊   | 25633/37963 [63:20:22<28:19:01,  8.27s/it]
 68%|██████▊   | 25634/37963 [63:20:30<28:01:34,  8.18s/it]
 68%|██████▊   | 25635/37963 [63:20:39<27:54:56,  8.15s/it]
 68%|██████▊   | 25636/37963 [63:20:47<28:12:18,  8.24s/it]
 68%|██████▊   | 25637/37963 [63:21:03<36:12:27, 10.57s/it]
 68%|██████▊   | 25638/37963 [63:21:11<33:57:06,  9.92s/it]
 68%|██████▊   | 25639/37963 [63:21:20<32:13:45,  9.41s/it]
 68%|██████▊   | 25640/37963 [63:21:27<30:36:04,  8.94s/it]
                                                           
{'loss': '0.1201', 'grad_norm': '2.965', 'learning_rate': '5.036e-06', 'epoch': '0.6754'}
+
 68%|██████▊   | 25640/37963 [63:21:27<30:36:04,  8.94s/it]
 68%|██████▊   | 25641/37963 [63:21:42<36:33:03, 10.68s/it]
 68%|██████▊   | 25642/37963 [63:21:50<33:40:46,  9.84s/it]
 68%|██████▊   | 25643/37963 [63:21:58<31:18:10,  9.15s/it]
 68%|██████▊   | 25644/37963 [63:22:05<29:52:58,  8.73s/it]
 68%|██████▊   | 25645/37963 [63:22:20<36:12:37, 10.58s/it]
 68%|██████▊   | 25646/37963 [63:22:28<33:35:21,  9.82s/it]
 68%|██████▊   | 25647/37963 [63:22:36<31:36:33,  9.24s/it]
 68%|██████▊   | 25648/37963 [63:22:44<29:48:23,  8.71s/it]
 68%|██████▊   | 25649/37963 [63:22:58<35:43:14, 10.44s/it]
 68%|██████▊   | 25650/37963 [63:23:06<33:23:17,  9.76s/it]
                                                           
{'loss': '0.1195', 'grad_norm': '1.738', 'learning_rate': '5.029e-06', 'epoch': '0.6757'}
+
 68%|██████▊   | 25650/37963 [63:23:06<33:23:17,  9.76s/it]
 68%|██████▊   | 25651/37963 [63:23:14<31:25:41,  9.19s/it]
 68%|██████▊   | 25652/37963 [63:23:22<29:53:26,  8.74s/it]
 68%|██████▊   | 25653/37963 [63:23:36<35:37:27, 10.42s/it]
 68%|██████▊   | 25654/37963 [63:23:44<33:13:06,  9.72s/it]
 68%|██████▊   | 25655/37963 [63:23:52<31:25:40,  9.19s/it]
 68%|██████▊   | 25656/37963 [63:24:00<29:40:09,  8.68s/it]
 68%|██████▊   | 25657/37963 [63:24:07<28:40:29,  8.39s/it]
 68%|██████▊   | 25658/37963 [63:24:15<28:00:50,  8.20s/it]
 68%|██████▊   | 25659/37963 [63:24:23<27:26:26,  8.03s/it]
 68%|██████▊   | 25660/37963 [63:24:30<26:59:55,  7.90s/it]
                                                           
{'loss': '0.1135', 'grad_norm': '1.716', 'learning_rate': '5.022e-06', 'epoch': '0.6759'}
+
 68%|██████▊   | 25660/37963 [63:24:30<26:59:55,  7.90s/it]
 68%|██████▊   | 25661/37963 [63:24:38<26:55:11,  7.88s/it]
 68%|██████▊   | 25662/37963 [63:24:46<26:50:19,  7.85s/it]
 68%|██████▊   | 25663/37963 [63:24:54<26:53:19,  7.87s/it]
 68%|██████▊   | 25664/37963 [63:25:09<34:19:51, 10.05s/it]
 68%|██████▊   | 25665/37963 [63:25:24<39:00:52, 11.42s/it]
 68%|██████▊   | 25666/37963 [63:25:32<35:18:57, 10.34s/it]
 68%|██████▊   | 25667/37963 [63:25:39<32:38:39,  9.56s/it]
 68%|██████▊   | 25668/37963 [63:25:47<30:48:42,  9.02s/it]
 68%|██████▊   | 25669/37963 [63:25:55<29:13:37,  8.56s/it]
 68%|██████▊   | 25670/37963 [63:26:02<28:11:41,  8.26s/it]
                                                           
{'loss': '0.1221', 'grad_norm': '1.278', 'learning_rate': '5.014e-06', 'epoch': '0.6762'}
+
 68%|██████▊   | 25670/37963 [63:26:02<28:11:41,  8.26s/it]
 68%|██████▊   | 25671/37963 [63:26:09<27:21:11,  8.01s/it]
 68%|██████▊   | 25672/37963 [63:26:17<27:09:05,  7.95s/it]
 68%|██████▊   | 25673/37963 [63:26:25<26:51:17,  7.87s/it]
 68%|██████▊   | 25674/37963 [63:26:32<26:20:39,  7.72s/it]
 68%|██████▊   | 25675/37963 [63:26:40<26:30:44,  7.77s/it]
 68%|██████▊   | 25676/37963 [63:26:48<26:30:20,  7.77s/it]
 68%|██████▊   | 25677/37963 [63:26:55<26:11:13,  7.67s/it]
 68%|██████▊   | 25678/37963 [63:27:03<26:14:21,  7.69s/it]
 68%|██████▊   | 25679/37963 [63:27:11<26:35:30,  7.79s/it]
 68%|██████▊   | 25680/37963 [63:27:26<33:37:43,  9.86s/it]
                                                           
{'loss': '0.1275', 'grad_norm': '1.209', 'learning_rate': '5.007e-06', 'epoch': '0.6765'}
+
 68%|██████▊   | 25680/37963 [63:27:26<33:37:43,  9.86s/it]
 68%|██████▊   | 25681/37963 [63:27:34<31:34:51,  9.26s/it]
 68%|██████▊   | 25682/37963 [63:27:42<30:09:58,  8.84s/it]
 68%|██████▊   | 25683/37963 [63:27:49<29:04:25,  8.52s/it]
 68%|██████▊   | 25684/37963 [63:27:57<28:10:43,  8.26s/it]
 68%|██████▊   | 25685/37963 [63:28:05<27:41:08,  8.12s/it]
 68%|██████▊   | 25686/37963 [63:28:13<27:19:31,  8.01s/it]
 68%|██████▊   | 25687/37963 [63:28:28<34:39:02, 10.16s/it]
 68%|██████▊   | 25688/37963 [63:28:36<32:17:12,  9.47s/it]
 68%|██████▊   | 25689/37963 [63:28:43<30:36:00,  8.98s/it]
 68%|██████▊   | 25690/37963 [63:28:51<29:27:57,  8.64s/it]
                                                           
{'loss': '0.117', 'grad_norm': '1.538', 'learning_rate': '5e-06', 'epoch': '0.6767'}
+
 68%|██████▊   | 25690/37963 [63:28:51<29:27:57,  8.64s/it]
 68%|██████▊   | 25691/37963 [63:28:59<28:32:52,  8.37s/it]
 68%|██████▊   | 25692/37963 [63:29:07<27:51:11,  8.17s/it]
 68%|██████▊   | 25693/37963 [63:29:21<34:15:23, 10.05s/it]
 68%|██████▊   | 25694/37963 [63:29:29<32:05:02,  9.41s/it]
 68%|██████▊   | 25695/37963 [63:29:44<37:33:44, 11.02s/it]
 68%|██████▊   | 25696/37963 [63:29:52<34:29:24, 10.12s/it]
 68%|██████▊   | 25697/37963 [63:30:00<32:12:18,  9.45s/it]
 68%|██████▊   | 25698/37963 [63:30:14<37:24:29, 10.98s/it]
 68%|██████▊   | 25699/37963 [63:30:22<34:16:12, 10.06s/it]
 68%|██████▊   | 25700/37963 [63:30:30<32:03:12,  9.41s/it]
                                                           
{'loss': '0.1278', 'grad_norm': '1.566', 'learning_rate': '4.992e-06', 'epoch': '0.677'}
+
 68%|██████▊   | 25700/37963 [63:30:30<32:03:12,  9.41s/it]
 68%|██████▊   | 25701/37963 [63:30:38<30:16:44,  8.89s/it]
 68%|██████▊   | 25702/37963 [63:30:45<28:50:56,  8.47s/it]
 68%|██████▊   | 25703/37963 [63:30:53<28:03:54,  8.24s/it]
 68%|██████▊   | 25704/37963 [63:31:01<27:24:52,  8.05s/it]
 68%|██████▊   | 25705/37963 [63:31:09<27:22:42,  8.04s/it]
 68%|██████▊   | 25706/37963 [63:31:17<27:13:56,  8.00s/it]
 68%|██████▊   | 25707/37963 [63:31:31<33:34:24,  9.86s/it]
 68%|██████▊   | 25708/37963 [63:31:39<31:26:30,  9.24s/it]
 68%|██████▊   | 25709/37963 [63:31:47<30:09:07,  8.86s/it]
 68%|██████▊   | 25710/37963 [63:31:54<28:48:29,  8.46s/it]
                                                           
{'loss': '0.1268', 'grad_norm': '1.691', 'learning_rate': '4.985e-06', 'epoch': '0.6772'}
+
 68%|██████▊   | 25710/37963 [63:31:54<28:48:29,  8.46s/it]
 68%|██████▊   | 25711/37963 [63:32:02<27:45:15,  8.16s/it]
 68%|██████▊   | 25712/37963 [63:32:16<34:40:44, 10.19s/it]
 68%|██████▊   | 25713/37963 [63:32:24<32:11:52,  9.46s/it]
 68%|██████▊   | 25714/37963 [63:32:32<30:43:49,  9.03s/it]
 68%|██████▊   | 25715/37963 [63:32:40<29:31:28,  8.68s/it]
 68%|██████▊   | 25716/37963 [63:32:48<28:49:04,  8.47s/it]
 68%|██████▊   | 25717/37963 [63:33:03<34:59:01, 10.28s/it]
 68%|██████▊   | 25718/37963 [63:33:11<32:34:40,  9.58s/it]
 68%|██████▊   | 25719/37963 [63:33:18<30:46:43,  9.05s/it]
 68%|██████▊   | 25720/37963 [63:33:26<29:06:05,  8.56s/it]
                                                           
{'loss': '0.1244', 'grad_norm': '2.372', 'learning_rate': '4.977e-06', 'epoch': '0.6775'}
+
 68%|██████▊   | 25720/37963 [63:33:26<29:06:05,  8.56s/it]
 68%|██████▊   | 25721/37963 [63:33:34<28:17:25,  8.32s/it]
 68%|██████▊   | 25722/37963 [63:33:41<27:43:41,  8.15s/it]
 68%|██████▊   | 25723/37963 [63:33:49<27:37:35,  8.13s/it]
 68%|██████▊   | 25724/37963 [63:33:57<27:00:10,  7.94s/it]
 68%|██████▊   | 25725/37963 [63:34:05<26:49:02,  7.89s/it]
 68%|██████▊   | 25726/37963 [63:34:12<26:19:51,  7.75s/it]
 68%|██████▊   | 25727/37963 [63:34:20<26:23:41,  7.77s/it]
 68%|██████▊   | 25728/37963 [63:34:34<33:08:05,  9.75s/it]
 68%|██████▊   | 25729/37963 [63:34:42<30:48:51,  9.07s/it]
 68%|██████▊   | 25730/37963 [63:34:49<29:13:44,  8.60s/it]
                                                           
{'loss': '0.1304', 'grad_norm': '1.473', 'learning_rate': '4.97e-06', 'epoch': '0.6778'}
+
 68%|██████▊   | 25730/37963 [63:34:49<29:13:44,  8.60s/it]
 68%|██████▊   | 25731/37963 [63:34:57<28:15:30,  8.32s/it]
 68%|██████▊   | 25732/37963 [63:35:04<27:32:30,  8.11s/it]
 68%|██████▊   | 25733/37963 [63:35:12<27:18:07,  8.04s/it]
 68%|██████▊   | 25734/37963 [63:35:20<27:05:40,  7.98s/it]
 68%|██████▊   | 25735/37963 [63:35:35<34:08:50, 10.05s/it]
 68%|██████▊   | 25736/37963 [63:35:43<32:08:59,  9.47s/it]
 68%|██████▊   | 25737/37963 [63:35:51<30:28:45,  8.97s/it]
 68%|██████▊   | 25738/37963 [63:35:59<29:05:52,  8.57s/it]
 68%|██████▊   | 25739/37963 [63:36:06<28:14:10,  8.32s/it]
 68%|██████▊   | 25740/37963 [63:36:21<34:20:09, 10.11s/it]
                                                           
{'loss': '0.1093', 'grad_norm': '2.044', 'learning_rate': '4.963e-06', 'epoch': '0.678'}
+
 68%|██████▊   | 25740/37963 [63:36:21<34:20:09, 10.11s/it]
 68%|██████▊   | 25741/37963 [63:36:35<38:18:05, 11.28s/it]
 68%|██████▊   | 25742/37963 [63:36:42<34:46:32, 10.24s/it]
 68%|██████▊   | 25743/37963 [63:36:50<32:06:36,  9.46s/it]
 68%|██████▊   | 25744/37963 [63:36:58<30:24:50,  8.96s/it]
 68%|██████▊   | 25745/37963 [63:37:05<28:56:22,  8.53s/it]
 68%|██████▊   | 25746/37963 [63:37:13<28:08:58,  8.29s/it]
 68%|██████▊   | 25747/37963 [63:37:21<27:41:30,  8.16s/it]
 68%|██████▊   | 25748/37963 [63:37:29<27:16:05,  8.04s/it]
 68%|██████▊   | 25749/37963 [63:37:44<34:05:53, 10.05s/it]
 68%|██████▊   | 25750/37963 [63:37:51<31:33:21,  9.30s/it]
                                                           
{'loss': '0.1182', 'grad_norm': '1.964', 'learning_rate': '4.955e-06', 'epoch': '0.6783'}
+
 68%|██████▊   | 25750/37963 [63:37:51<31:33:21,  9.30s/it]
 68%|██████▊   | 25751/37963 [63:37:59<29:57:33,  8.83s/it]
 68%|██████▊   | 25752/37963 [63:38:07<28:59:17,  8.55s/it]
 68%|██████▊   | 25753/37963 [63:38:14<28:11:56,  8.31s/it]
 68%|██████▊   | 25754/37963 [63:38:22<27:39:49,  8.16s/it]
 68%|██████▊   | 25755/37963 [63:38:30<27:17:27,  8.05s/it]
 68%|██████▊   | 25756/37963 [63:38:45<34:21:32, 10.13s/it]
 68%|██████▊   | 25757/37963 [63:38:53<31:56:39,  9.42s/it]
 68%|██████▊   | 25758/37963 [63:39:01<30:17:34,  8.94s/it]
 68%|██████▊   | 25759/37963 [63:39:08<28:59:00,  8.55s/it]
 68%|██████▊   | 25760/37963 [63:39:16<28:32:56,  8.42s/it]
                                                           
{'loss': '0.1327', 'grad_norm': '1.817', 'learning_rate': '4.948e-06', 'epoch': '0.6786'}
+
 68%|██████▊   | 25760/37963 [63:39:16<28:32:56,  8.42s/it]
 68%|██████▊   | 25761/37963 [63:39:24<27:48:00,  8.20s/it]
 68%|██████▊   | 25762/37963 [63:39:39<34:33:23, 10.20s/it]
 68%|██████▊   | 25763/37963 [63:39:47<32:21:11,  9.55s/it]
 68%|██████▊   | 25764/37963 [63:39:55<30:34:04,  9.02s/it]
 68%|██████▊   | 25765/37963 [63:40:02<29:15:46,  8.64s/it]
 68%|██████▊   | 25766/37963 [63:40:10<28:26:37,  8.40s/it]
 68%|██████▊   | 25767/37963 [63:40:18<27:52:48,  8.23s/it]
 68%|██████▊   | 25768/37963 [63:40:33<34:38:32, 10.23s/it]
 68%|██████▊   | 25769/37963 [63:40:41<32:03:30,  9.46s/it]
 68%|██████▊   | 25770/37963 [63:40:49<30:28:41,  9.00s/it]
                                                           
{'loss': '0.126', 'grad_norm': '3.002', 'learning_rate': '4.941e-06', 'epoch': '0.6788'}
+
 68%|██████▊   | 25770/37963 [63:40:49<30:28:41,  9.00s/it]
 68%|██████▊   | 25771/37963 [63:40:56<29:16:47,  8.65s/it]
 68%|██████▊   | 25772/37963 [63:41:04<28:24:14,  8.39s/it]
 68%|██████▊   | 25773/37963 [63:41:12<27:42:37,  8.18s/it]
 68%|██████▊   | 25774/37963 [63:41:20<27:21:36,  8.08s/it]
 68%|██████▊   | 25775/37963 [63:41:27<26:47:28,  7.91s/it]
 68%|██████▊   | 25776/37963 [63:41:42<33:16:52,  9.83s/it]
 68%|██████▊   | 25777/37963 [63:41:49<31:02:50,  9.17s/it]
 68%|██████▊   | 25778/37963 [63:41:57<29:34:56,  8.74s/it]
 68%|██████▊   | 25779/37963 [63:42:05<28:33:17,  8.44s/it]
 68%|██████▊   | 25780/37963 [63:42:12<27:49:15,  8.22s/it]
                                                           
{'loss': '0.1193', 'grad_norm': '1.472', 'learning_rate': '4.933e-06', 'epoch': '0.6791'}
+
 68%|██████▊   | 25780/37963 [63:42:12<27:49:15,  8.22s/it]
 68%|██████▊   | 25781/37963 [63:42:20<27:15:18,  8.05s/it]
 68%|██████▊   | 25782/37963 [63:42:28<26:56:11,  7.96s/it]
 68%|██████▊   | 25783/37963 [63:42:36<27:02:20,  7.99s/it]
 68%|██████▊   | 25784/37963 [63:42:52<34:44:21, 10.27s/it]
 68%|██████▊   | 25785/37963 [63:43:06<39:29:00, 11.67s/it]
 68%|██████▊   | 25786/37963 [63:43:15<36:11:21, 10.70s/it]
 68%|██████▊   | 25787/37963 [63:43:23<33:40:53,  9.96s/it]
 68%|██████▊   | 25788/37963 [63:43:31<31:43:08,  9.38s/it]
 68%|██████▊   | 25789/37963 [63:43:39<30:35:24,  9.05s/it]
 68%|██████▊   | 25790/37963 [63:43:47<29:29:37,  8.72s/it]
                                                           
{'loss': '0.1222', 'grad_norm': '1.569', 'learning_rate': '4.926e-06', 'epoch': '0.6793'}
+
 68%|██████▊   | 25790/37963 [63:43:47<29:29:37,  8.72s/it]
 68%|██████▊   | 25791/37963 [63:43:55<28:43:57,  8.50s/it]
 68%|██████▊   | 25792/37963 [63:44:03<28:19:01,  8.38s/it]
 68%|██████▊   | 25793/37963 [63:44:11<27:56:22,  8.26s/it]
 68%|██████▊   | 25794/37963 [63:44:27<35:27:28, 10.49s/it]
 68%|██████▊   | 25795/37963 [63:44:35<33:06:57,  9.80s/it]
 68%|██████▊   | 25796/37963 [63:44:43<31:25:13,  9.30s/it]
 68%|██████▊   | 25797/37963 [63:44:51<30:02:50,  8.89s/it]
 68%|██████▊   | 25798/37963 [63:45:00<29:21:09,  8.69s/it]
 68%|██████▊   | 25799/37963 [63:45:08<28:36:22,  8.47s/it]
 68%|██████▊   | 25800/37963 [63:45:16<28:21:45,  8.39s/it]
                                                           
{'loss': '0.1241', 'grad_norm': '1.354', 'learning_rate': '4.918e-06', 'epoch': '0.6796'}
+
 68%|██████▊   | 25800/37963 [63:45:16<28:21:45,  8.39s/it]
 68%|██████▊   | 25801/37963 [63:45:24<28:13:00,  8.35s/it]
 68%|██████▊   | 25802/37963 [63:45:32<27:34:29,  8.16s/it]
 68%|██████▊   | 25803/37963 [63:45:47<34:44:06, 10.28s/it]
 68%|██████▊   | 25804/37963 [63:46:05<42:21:58, 12.54s/it]
 68%|██████▊   | 25805/37963 [63:46:13<38:02:13, 11.26s/it]
 68%|██████▊   | 25806/37963 [63:46:21<34:48:03, 10.31s/it]
 68%|██████▊   | 25807/37963 [63:46:29<32:21:51,  9.58s/it]
 68%|██████▊   | 25808/37963 [63:46:46<39:57:41, 11.84s/it]
 68%|██████▊   | 25809/37963 [63:46:55<36:38:07, 10.85s/it]
 68%|██████▊   | 25810/37963 [63:47:03<34:07:17, 10.11s/it]
                                                           
{'loss': '0.1096', 'grad_norm': '1.789', 'learning_rate': '4.911e-06', 'epoch': '0.6799'}
+
 68%|██████▊   | 25810/37963 [63:47:03<34:07:17, 10.11s/it]
 68%|██████▊   | 25811/37963 [63:47:11<32:17:41,  9.57s/it]
 68%|██████▊   | 25812/37963 [63:47:20<30:54:47,  9.16s/it]
 68%|██████▊   | 25813/37963 [63:47:35<37:10:01, 11.01s/it]
 68%|██████▊   | 25814/37963 [63:47:43<34:32:28, 10.24s/it]
 68%|██████▊   | 25815/37963 [63:47:51<32:14:56,  9.56s/it]
 68%|██████▊   | 25816/37963 [63:48:00<30:52:55,  9.15s/it]
 68%|██████▊   | 25817/37963 [63:48:07<29:39:07,  8.79s/it]
 68%|██████▊   | 25818/37963 [63:48:15<28:35:46,  8.48s/it]
 68%|██████▊   | 25819/37963 [63:48:23<28:05:27,  8.33s/it]
 68%|██████▊   | 25820/37963 [63:48:31<28:01:48,  8.31s/it]
                                                           
{'loss': '0.1279', 'grad_norm': '4.474', 'learning_rate': '4.904e-06', 'epoch': '0.6801'}
+
 68%|██████▊   | 25820/37963 [63:48:31<28:01:48,  8.31s/it]
 68%|██████▊   | 25821/37963 [63:48:40<27:50:56,  8.26s/it]
 68%|██████▊   | 25822/37963 [63:48:48<27:58:55,  8.30s/it]
 68%|██████▊   | 25823/37963 [63:48:56<27:45:57,  8.23s/it]
 68%|██████▊   | 25824/37963 [63:49:04<27:37:56,  8.19s/it]
 68%|██████▊   | 25825/37963 [63:49:19<34:22:26, 10.19s/it]
 68%|██████▊   | 25826/37963 [63:49:27<32:31:46,  9.65s/it]
 68%|██████▊   | 25827/37963 [63:49:36<30:59:33,  9.19s/it]
 68%|██████▊   | 25828/37963 [63:49:44<29:49:36,  8.85s/it]
 68%|██████▊   | 25829/37963 [63:49:59<36:23:23, 10.80s/it]
 68%|██████▊   | 25830/37963 [63:50:07<33:46:28, 10.02s/it]
                                                           
{'loss': '0.1246', 'grad_norm': '1.498', 'learning_rate': '4.896e-06', 'epoch': '0.6804'}
+
 68%|██████▊   | 25830/37963 [63:50:07<33:46:28, 10.02s/it]
 68%|██████▊   | 25831/37963 [63:50:15<31:55:05,  9.47s/it]
 68%|██████▊   | 25832/37963 [63:50:23<30:32:10,  9.06s/it]
 68%|██████▊   | 25833/37963 [63:50:31<29:26:42,  8.74s/it]
 68%|██████▊   | 25834/37963 [63:50:39<28:23:27,  8.43s/it]
 68%|██████▊   | 25835/37963 [63:50:47<28:18:13,  8.40s/it]
 68%|██████▊   | 25836/37963 [63:50:56<27:58:21,  8.30s/it]
 68%|██████▊   | 25837/37963 [63:51:10<34:11:06, 10.15s/it]
 68%|██████▊   | 25838/37963 [63:51:27<41:20:25, 12.27s/it]
 68%|██████▊   | 25839/37963 [63:51:35<37:17:29, 11.07s/it]
 68%|██████▊   | 25840/37963 [63:51:43<33:58:28, 10.09s/it]
                                                           
{'loss': '0.1235', 'grad_norm': '1.89', 'learning_rate': '4.889e-06', 'epoch': '0.6807'}
+
 68%|██████▊   | 25840/37963 [63:51:43<33:58:28, 10.09s/it]
 68%|██████▊   | 25841/37963 [63:51:51<31:50:50,  9.46s/it]
 68%|██████▊   | 25842/37963 [63:52:00<30:52:41,  9.17s/it]
 68%|██████▊   | 25843/37963 [63:52:08<29:38:44,  8.81s/it]
 68%|██████▊   | 25844/37963 [63:52:16<28:49:29,  8.56s/it]
 68%|██████▊   | 25845/37963 [63:52:24<28:22:19,  8.43s/it]
 68%|██████▊   | 25846/37963 [63:52:32<27:54:29,  8.29s/it]
 68%|██████▊   | 25847/37963 [63:52:40<27:44:28,  8.24s/it]
 68%|██████▊   | 25848/37963 [63:52:57<36:14:57, 10.77s/it]
 68%|██████▊   | 25849/37963 [63:53:05<33:50:52, 10.06s/it]
 68%|██████▊   | 25850/37963 [63:53:13<31:50:34,  9.46s/it]
                                                           
{'loss': '0.1324', 'grad_norm': '2.216', 'learning_rate': '4.882e-06', 'epoch': '0.6809'}
+
 68%|██████▊   | 25850/37963 [63:53:13<31:50:34,  9.46s/it]
 68%|██████▊   | 25851/37963 [63:53:21<30:27:45,  9.05s/it]
 68%|██████▊   | 25852/37963 [63:53:29<29:23:34,  8.74s/it]
 68%|██████▊   | 25853/37963 [63:53:37<28:49:31,  8.57s/it]
 68%|██████▊   | 25854/37963 [63:53:46<28:27:18,  8.46s/it]
 68%|██████▊   | 25855/37963 [63:53:54<28:00:07,  8.33s/it]
 68%|██████▊   | 25856/37963 [63:54:02<27:47:02,  8.26s/it]
 68%|██████▊   | 25857/37963 [63:54:17<34:59:27, 10.41s/it]
 68%|██████▊   | 25858/37963 [63:54:25<32:36:10,  9.70s/it]
 68%|██████▊   | 25859/37963 [63:54:33<31:00:33,  9.22s/it]
 68%|██████▊   | 25860/37963 [63:54:41<29:52:43,  8.89s/it]
                                                           
{'loss': '0.1191', 'grad_norm': '1.676', 'learning_rate': '4.874e-06', 'epoch': '0.6812'}
+
 68%|██████▊   | 25860/37963 [63:54:41<29:52:43,  8.89s/it]
 68%|██████▊   | 25861/37963 [63:54:49<28:52:08,  8.59s/it]
 68%|██████▊   | 25862/37963 [63:55:06<36:43:20, 10.92s/it]
 68%|██████▊   | 25863/37963 [63:55:14<33:49:56, 10.07s/it]
 68%|██████▊   | 25864/37963 [63:55:22<31:51:35,  9.48s/it]
 68%|██████▊   | 25865/37963 [63:55:30<30:48:20,  9.17s/it]
 68%|██████▊   | 25866/37963 [63:55:38<29:38:02,  8.82s/it]
 68%|██████▊   | 25867/37963 [63:55:55<37:25:19, 11.14s/it]
 68%|██████▊   | 25868/37963 [63:56:09<41:01:11, 12.21s/it]
 68%|██████▊   | 25869/37963 [63:56:18<37:13:13, 11.08s/it]
 68%|██████▊   | 25870/37963 [63:56:26<34:19:49, 10.22s/it]
                                                           
{'loss': '0.1276', 'grad_norm': '1.383', 'learning_rate': '4.867e-06', 'epoch': '0.6815'}
+
 68%|██████▊   | 25870/37963 [63:56:26<34:19:49, 10.22s/it]
 68%|██████▊   | 25871/37963 [63:56:34<32:14:03,  9.60s/it]
 68%|██████▊   | 25872/37963 [63:56:43<30:54:06,  9.20s/it]
 68%|██████▊   | 25873/37963 [63:56:51<29:53:12,  8.90s/it]
 68%|██████▊   | 25874/37963 [63:56:59<28:59:42,  8.63s/it]
 68%|██████▊   | 25875/37963 [63:57:07<28:29:08,  8.48s/it]
 68%|██████▊   | 25876/37963 [63:57:15<28:09:35,  8.39s/it]
 68%|██████▊   | 25877/37963 [63:57:30<34:57:17, 10.41s/it]
 68%|██████▊   | 25878/37963 [63:57:38<32:37:21,  9.72s/it]
 68%|██████▊   | 25879/37963 [63:57:47<31:10:33,  9.29s/it]
 68%|██████▊   | 25880/37963 [63:57:55<30:06:14,  8.97s/it]
                                                           
{'loss': '0.1305', 'grad_norm': '2.18', 'learning_rate': '4.86e-06', 'epoch': '0.6817'}
+
 68%|██████▊   | 25880/37963 [63:57:55<30:06:14,  8.97s/it]
 68%|██████▊   | 25881/37963 [63:58:03<29:10:53,  8.70s/it]
 68%|██████▊   | 25882/37963 [63:58:11<28:36:07,  8.52s/it]
 68%|██████▊   | 25883/37963 [63:58:19<28:10:35,  8.40s/it]
 68%|██████▊   | 25884/37963 [63:58:27<27:47:33,  8.28s/it]
 68%|██████▊   | 25885/37963 [63:58:35<27:38:52,  8.24s/it]
 68%|██████▊   | 25886/37963 [63:58:53<36:45:26, 10.96s/it]
 68%|██████▊   | 25887/37963 [63:59:01<34:10:17, 10.19s/it]
 68%|██████▊   | 25888/37963 [63:59:10<32:37:03,  9.72s/it]
 68%|██████▊   | 25889/37963 [63:59:18<30:58:26,  9.24s/it]
 68%|██████▊   | 25890/37963 [63:59:33<36:53:56, 11.00s/it]
                                                           
{'loss': '0.1202', 'grad_norm': '1.773', 'learning_rate': '4.852e-06', 'epoch': '0.682'}
+
 68%|██████▊   | 25890/37963 [63:59:33<36:53:56, 11.00s/it]
 68%|██████▊   | 25891/37963 [63:59:41<34:03:59, 10.16s/it]
 68%|██████▊   | 25892/37963 [63:59:49<32:01:59,  9.55s/it]
 68%|██████▊   | 25893/37963 [63:59:57<30:50:01,  9.20s/it]
 68%|██████▊   | 25894/37963 [64:00:06<29:41:18,  8.86s/it]
 68%|██████▊   | 25895/37963 [64:00:14<28:52:34,  8.61s/it]
 68%|██████▊   | 25896/37963 [64:00:31<37:34:46, 11.21s/it]
 68%|██████▊   | 25897/37963 [64:00:39<34:13:15, 10.21s/it]
 68%|██████▊   | 25898/37963 [64:00:47<32:22:11,  9.66s/it]
 68%|██████▊   | 25899/37963 [64:00:55<30:29:30,  9.10s/it]
 68%|██████▊   | 25900/37963 [64:01:03<29:43:24,  8.87s/it]
                                                           
{'loss': '0.1124', 'grad_norm': '2.158', 'learning_rate': '4.845e-06', 'epoch': '0.6822'}
+
 68%|██████▊   | 25900/37963 [64:01:03<29:43:24,  8.87s/it]
 68%|██████▊   | 25901/37963 [64:01:11<28:51:02,  8.61s/it]
 68%|██████▊   | 25902/37963 [64:01:19<28:15:54,  8.44s/it]
 68%|██████▊   | 25903/37963 [64:01:28<28:02:08,  8.37s/it]
 68%|██████▊   | 25904/37963 [64:01:36<27:58:09,  8.35s/it]
 68%|██████▊   | 25905/37963 [64:01:44<27:47:31,  8.30s/it]
 68%|██████▊   | 25906/37963 [64:01:52<27:39:27,  8.26s/it]
 68%|██████▊   | 25907/37963 [64:02:10<36:51:39, 11.01s/it]
 68%|██████▊   | 25908/37963 [64:02:18<34:12:01, 10.21s/it]
 68%|██████▊   | 25909/37963 [64:02:26<32:25:54,  9.69s/it]
 68%|██████▊   | 25910/37963 [64:02:35<31:07:58,  9.30s/it]
                                                           
{'loss': '0.1187', 'grad_norm': '2.208', 'learning_rate': '4.838e-06', 'epoch': '0.6825'}
+
 68%|██████▊   | 25910/37963 [64:02:35<31:07:58,  9.30s/it]
 68%|██████▊   | 25911/37963 [64:02:50<37:12:45, 11.12s/it]
 68%|██████▊   | 25912/37963 [64:02:58<34:21:03, 10.26s/it]
 68%|██████▊   | 25913/37963 [64:03:07<32:12:12,  9.62s/it]
 68%|██████▊   | 25914/37963 [64:03:21<37:00:21, 11.06s/it]
 68%|██████▊   | 25915/37963 [64:03:30<34:31:06, 10.31s/it]
 68%|██████▊   | 25916/37963 [64:03:38<32:11:59,  9.62s/it]
 68%|██████▊   | 25917/37963 [64:03:46<30:34:42,  9.14s/it]
 68%|██████▊   | 25918/37963 [64:03:54<29:54:33,  8.94s/it]
 68%|██████▊   | 25919/37963 [64:04:03<29:28:10,  8.81s/it]
 68%|██████▊   | 25920/37963 [64:04:11<28:53:25,  8.64s/it]
                                                           
{'loss': '0.123', 'grad_norm': '2.393', 'learning_rate': '4.831e-06', 'epoch': '0.6828'}
+
 68%|██████▊   | 25920/37963 [64:04:11<28:53:25,  8.64s/it]
 68%|██████▊   | 25921/37963 [64:04:19<28:23:09,  8.49s/it]
 68%|██████▊   | 25922/37963 [64:04:27<28:08:15,  8.41s/it]
 68%|██████▊   | 25923/37963 [64:04:43<35:22:51, 10.58s/it]
 68%|██████▊   | 25924/37963 [64:04:51<33:15:25,  9.94s/it]
 68%|██████▊   | 25925/37963 [64:05:06<38:31:45, 11.52s/it]
 68%|██████▊   | 25926/37963 [64:05:15<35:28:46, 10.61s/it]
 68%|██████▊   | 25927/37963 [64:05:23<32:53:36,  9.84s/it]
 68%|██████▊   | 25928/37963 [64:05:31<31:11:03,  9.33s/it]
 68%|██████▊   | 25929/37963 [64:05:39<30:08:07,  9.02s/it]
 68%|██████▊   | 25930/37963 [64:05:48<29:29:04,  8.82s/it]
                                                           
{'loss': '0.1302', 'grad_norm': '1.911', 'learning_rate': '4.823e-06', 'epoch': '0.683'}
+
 68%|██████▊   | 25930/37963 [64:05:48<29:29:04,  8.82s/it]
 68%|██████▊   | 25931/37963 [64:05:56<28:50:57,  8.63s/it]
 68%|██████▊   | 25932/37963 [64:06:04<28:27:13,  8.51s/it]
 68%|██████▊   | 25933/37963 [64:06:13<28:26:11,  8.51s/it]
 68%|██████▊   | 25934/37963 [64:06:21<28:08:10,  8.42s/it]
 68%|██████▊   | 25935/37963 [64:06:29<28:11:54,  8.44s/it]
 68%|██████▊   | 25936/37963 [64:06:37<27:39:00,  8.28s/it]
 68%|██████▊   | 25937/37963 [64:06:54<35:53:38, 10.74s/it]
 68%|██████▊   | 25938/37963 [64:07:02<33:46:06, 10.11s/it]
 68%|██████▊   | 25939/37963 [64:07:11<32:14:05,  9.65s/it]
 68%|██████▊   | 25940/37963 [64:07:19<30:55:13,  9.26s/it]
                                                           
{'loss': '0.1213', 'grad_norm': '1.234', 'learning_rate': '4.816e-06', 'epoch': '0.6833'}
+
 68%|██████▊   | 25940/37963 [64:07:19<30:55:13,  9.26s/it]
 68%|██████▊   | 25941/37963 [64:07:28<30:04:45,  9.01s/it]
 68%|██████▊   | 25942/37963 [64:07:36<29:09:22,  8.73s/it]
 68%|██████▊   | 25943/37963 [64:07:51<35:25:33, 10.61s/it]
 68%|██████▊   | 25944/37963 [64:07:59<32:56:13,  9.87s/it]
 68%|██████▊   | 25945/37963 [64:08:07<31:08:59,  9.33s/it]
 68%|██████▊   | 25946/37963 [64:08:25<39:55:17, 11.96s/it]
 68%|██████▊   | 25947/37963 [64:08:33<36:05:26, 10.81s/it]
 68%|██████▊   | 25948/37963 [64:08:42<33:31:01, 10.04s/it]
 68%|██████▊   | 25949/37963 [64:08:50<32:03:16,  9.61s/it]
 68%|██████▊   | 25950/37963 [64:08:58<30:39:47,  9.19s/it]
                                                           
{'loss': '0.1252', 'grad_norm': '3.531', 'learning_rate': '4.809e-06', 'epoch': '0.6836'}
+
 68%|██████▊   | 25950/37963 [64:08:58<30:39:47,  9.19s/it]
 68%|██████▊   | 25951/37963 [64:09:07<29:45:35,  8.92s/it]
 68%|██████▊   | 25952/37963 [64:09:15<28:54:28,  8.66s/it]
 68%|██████▊   | 25953/37963 [64:09:23<28:10:41,  8.45s/it]
 68%|██████▊   | 25954/37963 [64:09:31<27:47:32,  8.33s/it]
 68%|██████▊   | 25955/37963 [64:09:39<27:49:28,  8.34s/it]
 68%|██████▊   | 25956/37963 [64:09:56<36:27:55, 10.93s/it]
 68%|██████▊   | 25957/37963 [64:10:04<33:52:59, 10.16s/it]
 68%|██████▊   | 25958/37963 [64:10:13<31:52:02,  9.56s/it]
 68%|██████▊   | 25959/37963 [64:10:21<30:33:26,  9.16s/it]
 68%|██████▊   | 25960/37963 [64:10:29<29:38:59,  8.89s/it]
                                                           
{'loss': '0.1214', 'grad_norm': '1.13', 'learning_rate': '4.801e-06', 'epoch': '0.6838'}
+
 68%|██████▊   | 25960/37963 [64:10:29<29:38:59,  8.89s/it]
 68%|██████▊   | 25961/37963 [64:10:37<28:56:05,  8.68s/it]
 68%|██████▊   | 25962/37963 [64:10:52<35:16:51, 10.58s/it]
 68%|██████▊   | 25963/37963 [64:11:01<33:04:42,  9.92s/it]
 68%|██████▊   | 25964/37963 [64:11:09<31:22:42,  9.41s/it]
 68%|██████▊   | 25965/37963 [64:11:24<37:00:53, 11.11s/it]
 68%|██████▊   | 25966/37963 [64:11:32<34:08:23, 10.24s/it]
 68%|██████▊   | 25967/37963 [64:11:40<32:06:14,  9.63s/it]
 68%|██████▊   | 25968/37963 [64:11:49<30:40:26,  9.21s/it]
 68%|██████▊   | 25969/37963 [64:11:57<29:46:51,  8.94s/it]
 68%|██████▊   | 25970/37963 [64:12:12<35:30:52, 10.66s/it]
                                                           
{'loss': '0.1045', 'grad_norm': '2.032', 'learning_rate': '4.794e-06', 'epoch': '0.6841'}
+
 68%|██████▊   | 25970/37963 [64:12:12<35:30:52, 10.66s/it]
 68%|██████▊   | 25971/37963 [64:12:20<33:38:50, 10.10s/it]
 68%|██████▊   | 25972/37963 [64:12:29<32:00:30,  9.61s/it]
 68%|██████▊   | 25973/37963 [64:12:37<30:29:31,  9.16s/it]
 68%|██████▊   | 25974/37963 [64:12:45<29:13:36,  8.78s/it]
 68%|██████▊   | 25975/37963 [64:12:53<28:47:53,  8.65s/it]
 68%|██████▊   | 25976/37963 [64:13:08<34:48:37, 10.45s/it]
 68%|██████▊   | 25977/37963 [64:13:17<33:03:42,  9.93s/it]
 68%|██████▊   | 25978/37963 [64:13:25<31:35:58,  9.49s/it]
 68%|██████▊   | 25979/37963 [64:13:33<29:59:28,  9.01s/it]
 68%|██████▊   | 25980/37963 [64:13:41<29:12:43,  8.78s/it]
                                                           
{'loss': '0.1329', 'grad_norm': '1.882', 'learning_rate': '4.787e-06', 'epoch': '0.6844'}
+
 68%|██████▊   | 25980/37963 [64:13:41<29:12:43,  8.78s/it]
 68%|██████▊   | 25981/37963 [64:13:49<28:47:44,  8.65s/it]
 68%|██████▊   | 25982/37963 [64:13:58<28:31:58,  8.57s/it]
 68%|██████▊   | 25983/37963 [64:14:06<28:06:55,  8.45s/it]
 68%|██████▊   | 25984/37963 [64:14:14<27:31:15,  8.27s/it]
 68%|██████▊   | 25985/37963 [64:14:22<27:40:46,  8.32s/it]
 68%|██████▊   | 25986/37963 [64:14:30<27:21:38,  8.22s/it]
 68%|██████▊   | 25987/37963 [64:14:38<27:08:21,  8.16s/it]
 68%|██████▊   | 25988/37963 [64:14:47<27:28:06,  8.26s/it]
 68%|██████▊   | 25989/37963 [64:14:55<27:29:57,  8.27s/it]
 68%|██████▊   | 25990/37963 [64:15:03<27:21:45,  8.23s/it]
                                                           
{'loss': '0.128', 'grad_norm': '3.436', 'learning_rate': '4.78e-06', 'epoch': '0.6846'}
+
 68%|██████▊   | 25990/37963 [64:15:03<27:21:45,  8.23s/it]
 68%|██████▊   | 25991/37963 [64:15:21<36:54:35, 11.10s/it]
 68%|██████▊   | 25992/37963 [64:15:30<34:27:50, 10.36s/it]
 68%|██████▊   | 25993/37963 [64:15:38<32:11:07,  9.68s/it]
 68%|██████▊   | 25994/37963 [64:15:55<39:17:31, 11.82s/it]
 68%|██████▊   | 25995/37963 [64:16:03<35:52:29, 10.79s/it]
 68%|██████▊   | 25996/37963 [64:16:11<33:17:09, 10.01s/it]
 68%|██████▊   | 25997/37963 [64:16:26<38:27:44, 11.57s/it]
 68%|██████▊   | 25998/37963 [64:16:35<35:52:49, 10.80s/it]
 68%|██████▊   | 25999/37963 [64:16:44<33:47:19, 10.17s/it]
 68%|██████▊   | 26000/37963 [64:16:52<31:46:09,  9.56s/it]
                                                           
{'loss': '0.1238', 'grad_norm': '2.504', 'learning_rate': '4.772e-06', 'epoch': '0.6849'}
+
 68%|██████▊   | 26000/37963 [64:16:52<31:46:09,  9.56s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.45s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.46s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 68%|██████▊   | 26001/37963 [64:17:53<82:43:43, 24.90s/it]
 68%|██████▊   | 26002/37963 [64:18:01<66:22:22, 19.98s/it]
 68%|██████▊   | 26003/37963 [64:18:10<54:38:04, 16.45s/it]
 68%|██████▊   | 26004/37963 [64:18:18<46:29:33, 14.00s/it]
 69%|██████▊   | 26005/37963 [64:18:26<41:03:03, 12.36s/it]
 69%|██████▊   | 26006/37963 [64:18:43<45:17:55, 13.64s/it]
 69%|██████▊   | 26007/37963 [64:18:51<39:55:50, 12.02s/it]
 69%|██████▊   | 26008/37963 [64:19:00<36:14:43, 10.91s/it]
 69%|██████▊   | 26009/37963 [64:19:16<41:34:32, 12.52s/it]
 69%|██████▊   | 26010/37963 [64:19:24<37:24:48, 11.27s/it]
                                                           
{'loss': '0.1145', 'grad_norm': '1.62', 'learning_rate': '4.765e-06', 'epoch': '0.6851'}
+
 69%|██████▊   | 26010/37963 [64:19:24<37:24:48, 11.27s/it]
 69%|██████▊   | 26011/37963 [64:19:39<40:44:06, 12.27s/it]
 69%|██████▊   | 26012/37963 [64:19:47<36:49:35, 11.09s/it]
 69%|██████▊   | 26013/37963 [64:19:56<34:12:06, 10.30s/it]
 69%|██████▊   | 26014/37963 [64:20:04<32:10:51,  9.70s/it]
 69%|██████▊   | 26015/37963 [64:20:12<30:18:46,  9.13s/it]
 69%|██████▊   | 26016/37963 [64:20:20<29:18:08,  8.83s/it]
 69%|██████▊   | 26017/37963 [64:20:28<28:24:08,  8.56s/it]
 69%|██████▊   | 26018/37963 [64:20:36<28:09:18,  8.49s/it]
 69%|██████▊   | 26019/37963 [64:20:44<27:37:07,  8.32s/it]
 69%|██████▊   | 26020/37963 [64:20:52<27:35:58,  8.32s/it]
                                                           
{'loss': '0.1217', 'grad_norm': '1.805', 'learning_rate': '4.758e-06', 'epoch': '0.6854'}
+
 69%|██████▊   | 26020/37963 [64:20:52<27:35:58,  8.32s/it]
 69%|██████▊   | 26021/37963 [64:21:01<28:06:13,  8.47s/it]
 69%|██████▊   | 26022/37963 [64:21:17<35:09:41, 10.60s/it]
 69%|██████▊   | 26023/37963 [64:21:25<33:13:07, 10.02s/it]
 69%|██████▊   | 26024/37963 [64:21:34<31:57:21,  9.64s/it]
 69%|██████▊   | 26025/37963 [64:21:42<30:31:53,  9.21s/it]
 69%|██████▊   | 26026/37963 [64:21:51<29:37:54,  8.94s/it]
 69%|██████▊   | 26027/37963 [64:22:06<36:26:34, 10.99s/it]
 69%|██████▊   | 26028/37963 [64:22:15<33:33:40, 10.12s/it]
 69%|██████▊   | 26029/37963 [64:22:23<31:45:15,  9.58s/it]
 69%|██████▊   | 26030/37963 [64:22:31<30:39:54,  9.25s/it]
                                                           
{'loss': '0.1238', 'grad_norm': '2.737', 'learning_rate': '4.75e-06', 'epoch': '0.6857'}
+
 69%|██████▊   | 26030/37963 [64:22:31<30:39:54,  9.25s/it]
 69%|██████▊   | 26031/37963 [64:22:39<29:33:59,  8.92s/it]
 69%|██████▊   | 26032/37963 [64:22:48<29:04:29,  8.77s/it]
 69%|██████▊   | 26033/37963 [64:22:56<28:47:18,  8.69s/it]
 69%|██████▊   | 26034/37963 [64:23:05<28:28:45,  8.59s/it]
 69%|██████▊   | 26035/37963 [64:23:23<37:57:18, 11.46s/it]
 69%|██████▊   | 26036/37963 [64:23:31<35:01:05, 10.57s/it]
 69%|██████▊   | 26037/37963 [64:23:40<32:34:20,  9.83s/it]
 69%|██████▊   | 26038/37963 [64:23:48<31:05:13,  9.38s/it]
 69%|██████▊   | 26039/37963 [64:23:56<29:49:15,  9.00s/it]
 69%|██████▊   | 26040/37963 [64:24:04<28:54:39,  8.73s/it]
                                                           
{'loss': '0.146', 'grad_norm': '4.542', 'learning_rate': '4.743e-06', 'epoch': '0.6859'}
+
 69%|██████▊   | 26040/37963 [64:24:04<28:54:39,  8.73s/it]
 69%|██████▊   | 26041/37963 [64:24:19<35:02:00, 10.58s/it]
 69%|██████▊   | 26042/37963 [64:24:27<32:47:51,  9.90s/it]
 69%|██████▊   | 26043/37963 [64:24:36<31:09:38,  9.41s/it]
 69%|██████▊   | 26044/37963 [64:24:44<29:56:45,  9.04s/it]
 69%|██████▊   | 26045/37963 [64:24:52<29:15:42,  8.84s/it]
 69%|██████▊   | 26046/37963 [64:25:00<28:42:37,  8.67s/it]
 69%|██████▊   | 26047/37963 [64:25:18<37:37:36, 11.37s/it]
 69%|██████▊   | 26048/37963 [64:25:27<34:53:32, 10.54s/it]
 69%|██████▊   | 26049/37963 [64:25:35<32:38:42,  9.86s/it]
 69%|██████▊   | 26050/37963 [64:25:43<30:46:41,  9.30s/it]
                                                           
{'loss': '0.1203', 'grad_norm': '2.085', 'learning_rate': '4.736e-06', 'epoch': '0.6862'}
+
 69%|██████▊   | 26050/37963 [64:25:43<30:46:41,  9.30s/it]
 69%|██████▊   | 26051/37963 [64:25:52<30:05:52,  9.10s/it]
 69%|██████▊   | 26052/37963 [64:26:06<35:30:57, 10.73s/it]
 69%|██████▊   | 26053/37963 [64:26:15<33:56:19, 10.26s/it]
 69%|██████▊   | 26054/37963 [64:26:24<32:29:31,  9.82s/it]
 69%|██████▊   | 26055/37963 [64:26:32<31:01:43,  9.38s/it]
 69%|██████▊   | 26056/37963 [64:26:41<30:08:52,  9.12s/it]
 69%|██████▊   | 26057/37963 [64:26:49<29:04:53,  8.79s/it]
 69%|██████▊   | 26058/37963 [64:26:57<28:36:12,  8.65s/it]
 69%|██████▊   | 26059/37963 [64:27:12<35:02:54, 10.60s/it]
 69%|██████▊   | 26060/37963 [64:27:29<41:15:13, 12.48s/it]
                                                           
{'loss': '0.1236', 'grad_norm': '2.119', 'learning_rate': '4.729e-06', 'epoch': '0.6865'}
+
 69%|██████▊   | 26060/37963 [64:27:29<41:15:13, 12.48s/it]
 69%|██████▊   | 26061/37963 [64:27:37<36:42:24, 11.10s/it]
 69%|██████▊   | 26062/37963 [64:27:45<33:28:58, 10.13s/it]
 69%|██████▊   | 26063/37963 [64:27:53<31:33:49,  9.55s/it]
 69%|██████▊   | 26064/37963 [64:28:02<30:32:12,  9.24s/it]
 69%|██████▊   | 26065/37963 [64:28:10<29:33:55,  8.95s/it]
 69%|██████▊   | 26066/37963 [64:28:18<28:50:59,  8.73s/it]
 69%|██████▊   | 26067/37963 [64:28:26<28:04:27,  8.50s/it]
 69%|██████▊   | 26068/37963 [64:28:34<27:47:23,  8.41s/it]
 69%|██████▊   | 26069/37963 [64:28:43<28:22:05,  8.59s/it]
 69%|██████▊   | 26070/37963 [64:28:52<28:20:22,  8.58s/it]
                                                           
{'loss': '0.1297', 'grad_norm': '1.836', 'learning_rate': '4.721e-06', 'epoch': '0.6867'}
+
 69%|██████▊   | 26070/37963 [64:28:52<28:20:22,  8.58s/it]
 69%|██████▊   | 26071/37963 [64:29:08<35:33:56, 10.77s/it]
 69%|██████▊   | 26072/37963 [64:29:16<33:11:32, 10.05s/it]
 69%|██████▊   | 26073/37963 [64:29:32<38:44:56, 11.73s/it]
 69%|██████▊   | 26074/37963 [64:29:41<35:45:37, 10.83s/it]
 69%|██████▊   | 26075/37963 [64:29:49<33:14:17, 10.07s/it]
 69%|██████▊   | 26076/37963 [64:29:58<31:51:02,  9.65s/it]
 69%|██████▊   | 26077/37963 [64:30:06<30:35:45,  9.27s/it]
 69%|██████▊   | 26078/37963 [64:30:14<29:50:39,  9.04s/it]
 69%|██████▊   | 26079/37963 [64:30:23<29:08:47,  8.83s/it]
 69%|██████▊   | 26080/37963 [64:30:31<28:46:00,  8.72s/it]
                                                           
{'loss': '0.1246', 'grad_norm': '1.122', 'learning_rate': '4.714e-06', 'epoch': '0.687'}
+
 69%|██████▊   | 26080/37963 [64:30:31<28:46:00,  8.72s/it]
 69%|██████▊   | 26081/37963 [64:30:39<28:06:50,  8.52s/it]
 69%|██████▊   | 26082/37963 [64:30:48<27:56:42,  8.47s/it]
 69%|██████▊   | 26083/37963 [64:31:06<37:53:02, 11.48s/it]
 69%|██████▊   | 26084/37963 [64:31:14<34:48:12, 10.55s/it]
 69%|██████▊   | 26085/37963 [64:31:30<39:33:55, 11.99s/it]
 69%|██████▊   | 26086/37963 [64:31:38<35:53:45, 10.88s/it]
 69%|██████▊   | 26087/37963 [64:31:47<33:28:10, 10.15s/it]
 69%|██████▊   | 26088/37963 [64:31:55<32:00:06,  9.70s/it]
 69%|██████▊   | 26089/37963 [64:32:04<30:38:53,  9.29s/it]
 69%|██████▊   | 26090/37963 [64:32:12<29:29:09,  8.94s/it]
                                                           
{'loss': '0.1194', 'grad_norm': '1.669', 'learning_rate': '4.707e-06', 'epoch': '0.6873'}
+
 69%|██████▊   | 26090/37963 [64:32:12<29:29:09,  8.94s/it]
 69%|██████▊   | 26091/37963 [64:32:20<29:16:48,  8.88s/it]
 69%|██████▊   | 26092/37963 [64:32:29<28:41:09,  8.70s/it]
 69%|██████▊   | 26093/37963 [64:32:37<28:20:14,  8.59s/it]
 69%|██████▊   | 26094/37963 [64:32:45<27:55:59,  8.47s/it]
 69%|██████▊   | 26095/37963 [64:32:53<27:40:16,  8.39s/it]
 69%|██████▊   | 26096/37963 [64:33:02<27:30:42,  8.35s/it]
 69%|██████▊   | 26097/37963 [64:33:10<27:27:19,  8.33s/it]
 69%|██████▊   | 26098/37963 [64:33:18<27:34:44,  8.37s/it]
 69%|██████▊   | 26099/37963 [64:33:27<27:20:38,  8.30s/it]
 69%|██████▉   | 26100/37963 [64:33:35<27:06:59,  8.23s/it]
                                                           
{'loss': '0.1168', 'grad_norm': '2.285', 'learning_rate': '4.7e-06', 'epoch': '0.6875'}
+
 69%|██████▉   | 26100/37963 [64:33:35<27:06:59,  8.23s/it]
 69%|██████▉   | 26101/37963 [64:33:52<35:57:50, 10.91s/it]
 69%|██████▉   | 26102/37963 [64:34:00<33:22:19, 10.13s/it]
 69%|██████▉   | 26103/37963 [64:34:16<38:38:56, 11.73s/it]
 69%|██████▉   | 26104/37963 [64:34:33<44:19:25, 13.46s/it]
 69%|██████▉   | 26105/37963 [64:34:48<46:00:35, 13.97s/it]
 69%|██████▉   | 26106/37963 [64:34:56<40:13:27, 12.21s/it]
 69%|██████▉   | 26107/37963 [64:35:05<36:38:31, 11.13s/it]
 69%|██████▉   | 26108/37963 [64:35:13<33:43:49, 10.24s/it]
 69%|██████▉   | 26109/37963 [64:35:21<31:54:04,  9.69s/it]
 69%|██████▉   | 26110/37963 [64:35:30<30:29:32,  9.26s/it]
                                                           
{'loss': '0.1274', 'grad_norm': '1.937', 'learning_rate': '4.692e-06', 'epoch': '0.6878'}
+
 69%|██████▉   | 26110/37963 [64:35:30<30:29:32,  9.26s/it]
 69%|██████▉   | 26111/37963 [64:35:38<29:26:28,  8.94s/it]
 69%|██████▉   | 26112/37963 [64:35:47<29:10:44,  8.86s/it]
 69%|██████▉   | 26113/37963 [64:35:55<28:46:40,  8.74s/it]
 69%|██████▉   | 26114/37963 [64:36:03<28:17:14,  8.59s/it]
 69%|██████▉   | 26115/37963 [64:36:12<27:52:25,  8.47s/it]
 69%|██████▉   | 26116/37963 [64:36:20<28:21:02,  8.62s/it]
 69%|██████▉   | 26117/37963 [64:36:29<28:25:14,  8.64s/it]
 69%|██████▉   | 26118/37963 [64:36:37<27:55:18,  8.49s/it]
 69%|██████▉   | 26119/37963 [64:36:52<34:17:03, 10.42s/it]
 69%|██████▉   | 26120/37963 [64:37:01<32:35:31,  9.91s/it]
                                                           
{'loss': '0.1332', 'grad_norm': '2.702', 'learning_rate': '4.685e-06', 'epoch': '0.688'}
+
 69%|██████▉   | 26120/37963 [64:37:01<32:35:31,  9.91s/it]
 69%|██████▉   | 26121/37963 [64:37:16<38:02:42, 11.57s/it]
 69%|██████▉   | 26122/37963 [64:37:25<34:55:23, 10.62s/it]
 69%|██████▉   | 26123/37963 [64:37:33<32:54:34, 10.01s/it]
 69%|██████▉   | 26124/37963 [64:37:42<31:03:30,  9.44s/it]
 69%|██████▉   | 26125/37963 [64:37:50<29:59:07,  9.12s/it]
 69%|██████▉   | 26126/37963 [64:37:58<29:19:43,  8.92s/it]
 69%|██████▉   | 26127/37963 [64:38:17<38:45:04, 11.79s/it]
 69%|██████▉   | 26128/37963 [64:38:32<42:04:48, 12.80s/it]
 69%|██████▉   | 26129/37963 [64:38:41<38:11:02, 11.62s/it]
 69%|██████▉   | 26130/37963 [64:38:50<35:45:19, 10.88s/it]
                                                           
{'loss': '0.1246', 'grad_norm': '1.537', 'learning_rate': '4.678e-06', 'epoch': '0.6883'}
+
 69%|██████▉   | 26130/37963 [64:38:50<35:45:19, 10.88s/it]
 69%|██████▉   | 26131/37963 [64:38:58<33:16:19, 10.12s/it]
 69%|██████▉   | 26132/37963 [64:39:07<32:11:12,  9.79s/it]
 69%|██████▉   | 26133/37963 [64:39:16<30:50:29,  9.39s/it]
 69%|██████▉   | 26134/37963 [64:39:24<29:54:45,  9.10s/it]
 69%|██████▉   | 26135/37963 [64:39:32<28:59:00,  8.82s/it]
 69%|██████▉   | 26136/37963 [64:39:40<28:15:00,  8.60s/it]
 69%|██████▉   | 26137/37963 [64:39:49<28:03:15,  8.54s/it]
 69%|██████▉   | 26138/37963 [64:39:57<27:56:30,  8.51s/it]
 69%|██████▉   | 26139/37963 [64:40:06<27:47:04,  8.46s/it]
 69%|██████▉   | 26140/37963 [64:40:14<27:44:38,  8.45s/it]
                                                           
{'loss': '0.1217', 'grad_norm': '1.429', 'learning_rate': '4.671e-06', 'epoch': '0.6886'}
+
 69%|██████▉   | 26140/37963 [64:40:14<27:44:38,  8.45s/it]
 69%|██████▉   | 26141/37963 [64:40:22<27:28:20,  8.37s/it]
 69%|██████▉   | 26142/37963 [64:40:31<27:34:53,  8.40s/it]
 69%|██████▉   | 26143/37963 [64:40:39<27:19:02,  8.32s/it]
 69%|██████▉   | 26144/37963 [64:40:47<27:36:25,  8.41s/it]
 69%|██████▉   | 26145/37963 [64:40:56<27:20:27,  8.33s/it]
 69%|██████▉   | 26146/37963 [64:41:04<27:21:00,  8.33s/it]
 69%|██████▉   | 26147/37963 [64:41:19<33:53:19, 10.32s/it]
 69%|██████▉   | 26148/37963 [64:41:37<41:20:28, 12.60s/it]
 69%|██████▉   | 26149/37963 [64:41:45<37:21:56, 11.39s/it]
 69%|██████▉   | 26150/37963 [64:41:54<34:35:11, 10.54s/it]
                                                           
{'loss': '0.127', 'grad_norm': '2.482', 'learning_rate': '4.664e-06', 'epoch': '0.6888'}
+
 69%|██████▉   | 26150/37963 [64:41:54<34:35:11, 10.54s/it]
 69%|██████▉   | 26151/37963 [64:42:02<32:25:23,  9.88s/it]
 69%|██████▉   | 26152/37963 [64:42:10<30:18:23,  9.24s/it]
 69%|██████▉   | 26153/37963 [64:42:18<29:24:52,  8.97s/it]
 69%|██████▉   | 26154/37963 [64:42:26<28:34:25,  8.71s/it]
 69%|██████▉   | 26155/37963 [64:42:44<37:27:46, 11.42s/it]
 69%|██████▉   | 26156/37963 [64:42:53<34:52:01, 10.63s/it]
 69%|██████▉   | 26157/37963 [64:43:02<32:57:55, 10.05s/it]
 69%|██████▉   | 26158/37963 [64:43:10<31:25:13,  9.58s/it]
 69%|██████▉   | 26159/37963 [64:43:26<37:21:19, 11.39s/it]
 69%|██████▉   | 26160/37963 [64:43:34<34:37:55, 10.56s/it]
                                                           
{'loss': '0.1119', 'grad_norm': '3.374', 'learning_rate': '4.656e-06', 'epoch': '0.6891'}
+
 69%|██████▉   | 26160/37963 [64:43:34<34:37:55, 10.56s/it]
 69%|██████▉   | 26161/37963 [64:43:43<32:22:51,  9.88s/it]
 69%|██████▉   | 26162/37963 [64:43:51<30:49:59,  9.41s/it]
 69%|██████▉   | 26163/37963 [64:44:00<30:26:25,  9.29s/it]
 69%|██████▉   | 26164/37963 [64:44:08<29:30:50,  9.01s/it]
 69%|██████▉   | 26165/37963 [64:44:17<29:19:20,  8.95s/it]
 69%|██████▉   | 26166/37963 [64:44:26<28:42:29,  8.76s/it]
 69%|██████▉   | 26167/37963 [64:44:34<28:12:34,  8.61s/it]
 69%|██████▉   | 26168/37963 [64:44:42<28:06:56,  8.58s/it]
 69%|██████▉   | 26169/37963 [64:44:51<27:54:51,  8.52s/it]
 69%|██████▉   | 26170/37963 [64:44:59<28:05:04,  8.57s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '1.466', 'learning_rate': '4.649e-06', 'epoch': '0.6894'}
+
 69%|██████▉   | 26170/37963 [64:44:59<28:05:04,  8.57s/it]
 69%|██████▉   | 26171/37963 [64:45:18<37:40:42, 11.50s/it]
 69%|██████▉   | 26172/37963 [64:45:26<34:26:38, 10.52s/it]
 69%|██████▉   | 26173/37963 [64:45:41<38:58:26, 11.90s/it]
 69%|██████▉   | 26174/37963 [64:45:58<43:36:01, 13.31s/it]
 69%|██████▉   | 26175/37963 [64:46:06<38:33:08, 11.77s/it]
 69%|██████▉   | 26176/37963 [64:46:14<34:52:42, 10.65s/it]
 69%|██████▉   | 26177/37963 [64:46:22<32:23:33,  9.89s/it]
 69%|██████▉   | 26178/37963 [64:46:30<30:54:56,  9.44s/it]
 69%|██████▉   | 26179/37963 [64:46:39<29:58:29,  9.16s/it]
 69%|██████▉   | 26180/37963 [64:46:47<29:16:09,  8.94s/it]
                                                           
{'loss': '0.1144', 'grad_norm': '2.815', 'learning_rate': '4.642e-06', 'epoch': '0.6896'}
+
 69%|██████▉   | 26180/37963 [64:46:47<29:16:09,  8.94s/it]
 69%|██████▉   | 26181/37963 [64:46:55<28:28:39,  8.70s/it]
 69%|██████▉   | 26182/37963 [64:47:11<34:47:41, 10.63s/it]
 69%|██████▉   | 26183/37963 [64:47:19<32:46:36, 10.02s/it]
 69%|██████▉   | 26184/37963 [64:47:28<31:29:19,  9.62s/it]
 69%|██████▉   | 26185/37963 [64:47:36<30:19:27,  9.27s/it]
 69%|██████▉   | 26186/37963 [64:47:45<29:41:08,  9.07s/it]
 69%|██████▉   | 26187/37963 [64:47:54<29:12:12,  8.93s/it]
 69%|██████▉   | 26188/37963 [64:48:02<28:19:23,  8.66s/it]
 69%|██████▉   | 26189/37963 [64:48:10<28:00:36,  8.56s/it]
 69%|██████▉   | 26190/37963 [64:48:25<34:20:26, 10.50s/it]
                                                           
{'loss': '0.1159', 'grad_norm': '2.904', 'learning_rate': '4.635e-06', 'epoch': '0.6899'}
+
 69%|██████▉   | 26190/37963 [64:48:25<34:20:26, 10.50s/it]
 69%|██████▉   | 26191/37963 [64:48:34<32:32:59,  9.95s/it]
 69%|██████▉   | 26192/37963 [64:48:51<40:07:02, 12.27s/it]
 69%|██████▉   | 26193/37963 [64:49:00<37:00:58, 11.32s/it]
 69%|██████▉   | 26194/37963 [64:49:09<34:17:51, 10.49s/it]
 69%|██████▉   | 26195/37963 [64:49:17<32:16:28,  9.87s/it]
 69%|██████▉   | 26196/37963 [64:49:26<30:33:36,  9.35s/it]
 69%|██████▉   | 26197/37963 [64:49:34<29:43:42,  9.10s/it]
 69%|██████▉   | 26198/37963 [64:49:42<28:55:45,  8.85s/it]
 69%|██████▉   | 26199/37963 [64:49:51<28:28:23,  8.71s/it]
 69%|██████▉   | 26200/37963 [64:49:59<28:09:25,  8.62s/it]
                                                           
{'loss': '0.1159', 'grad_norm': '2.452', 'learning_rate': '4.628e-06', 'epoch': '0.6901'}
+
 69%|██████▉   | 26200/37963 [64:49:59<28:09:25,  8.62s/it]
 69%|██████▉   | 26201/37963 [64:50:07<27:50:08,  8.52s/it]
 69%|██████▉   | 26202/37963 [64:50:16<27:38:33,  8.46s/it]
 69%|██████▉   | 26203/37963 [64:50:24<27:35:22,  8.45s/it]
 69%|██████▉   | 26204/37963 [64:50:32<27:17:37,  8.36s/it]
 69%|██████▉   | 26205/37963 [64:50:40<27:05:59,  8.30s/it]
 69%|██████▉   | 26206/37963 [64:50:49<27:39:36,  8.47s/it]
 69%|██████▉   | 26207/37963 [64:50:58<27:52:30,  8.54s/it]
 69%|██████▉   | 26208/37963 [64:51:06<27:40:04,  8.47s/it]
 69%|██████▉   | 26209/37963 [64:51:24<36:47:57, 11.27s/it]
 69%|██████▉   | 26210/37963 [64:51:32<33:45:17, 10.34s/it]
                                                           
{'loss': '0.1224', 'grad_norm': '1.717', 'learning_rate': '4.62e-06', 'epoch': '0.6904'}
+
 69%|██████▉   | 26210/37963 [64:51:32<33:45:17, 10.34s/it]
 69%|██████▉   | 26211/37963 [64:51:41<31:44:34,  9.72s/it]
 69%|██████▉   | 26212/37963 [64:51:49<30:13:42,  9.26s/it]
 69%|██████▉   | 26213/37963 [64:52:04<35:54:37, 11.00s/it]
 69%|██████▉   | 26214/37963 [64:52:13<33:50:42, 10.37s/it]
 69%|██████▉   | 26215/37963 [64:52:21<32:00:02,  9.81s/it]
 69%|██████▉   | 26216/37963 [64:52:30<30:55:13,  9.48s/it]
 69%|██████▉   | 26217/37963 [64:52:38<29:55:58,  9.17s/it]
 69%|██████▉   | 26218/37963 [64:52:56<38:37:23, 11.84s/it]
 69%|██████▉   | 26219/37963 [64:53:05<35:21:09, 10.84s/it]
 69%|██████▉   | 26220/37963 [64:53:13<32:50:54, 10.07s/it]
                                                           
{'loss': '0.1088', 'grad_norm': '1.892', 'learning_rate': '4.613e-06', 'epoch': '0.6907'}
+
 69%|██████▉   | 26220/37963 [64:53:13<32:50:54, 10.07s/it]
 69%|██████▉   | 26221/37963 [64:53:22<31:06:34,  9.54s/it]
 69%|██████▉   | 26222/37963 [64:53:30<30:04:59,  9.22s/it]
 69%|██████▉   | 26223/37963 [64:53:38<29:20:45,  9.00s/it]
 69%|██████▉   | 26224/37963 [64:53:47<28:52:49,  8.86s/it]
 69%|██████▉   | 26225/37963 [64:53:56<28:38:19,  8.78s/it]
 69%|██████▉   | 26226/37963 [64:54:04<28:34:14,  8.76s/it]
 69%|██████▉   | 26227/37963 [64:54:20<35:08:00, 10.78s/it]
 69%|██████▉   | 26228/37963 [64:54:35<39:28:43, 12.11s/it]
 69%|██████▉   | 26229/37963 [64:54:44<36:08:58, 11.09s/it]
 69%|██████▉   | 26230/37963 [64:54:52<33:39:26, 10.33s/it]
                                                           
{'loss': '0.1205', 'grad_norm': '1.3', 'learning_rate': '4.606e-06', 'epoch': '0.6909'}
+
 69%|██████▉   | 26230/37963 [64:54:52<33:39:26, 10.33s/it]
 69%|██████▉   | 26231/37963 [64:55:01<31:53:51,  9.79s/it]
 69%|██████▉   | 26232/37963 [64:55:09<30:39:44,  9.41s/it]
 69%|██████▉   | 26233/37963 [64:55:18<29:38:45,  9.10s/it]
 69%|██████▉   | 26234/37963 [64:55:40<42:58:24, 13.19s/it]
 69%|██████▉   | 26235/37963 [64:55:49<38:24:32, 11.79s/it]
 69%|██████▉   | 26236/37963 [64:55:57<35:03:22, 10.76s/it]
 69%|██████▉   | 26237/37963 [64:56:06<32:31:58,  9.99s/it]
 69%|██████▉   | 26238/37963 [64:56:14<31:07:50,  9.56s/it]
 69%|██████▉   | 26239/37963 [64:56:32<39:20:24, 12.08s/it]
 69%|██████▉   | 26240/37963 [64:56:41<35:52:16, 11.02s/it]
                                                           
{'loss': '0.1155', 'grad_norm': '2.286', 'learning_rate': '4.599e-06', 'epoch': '0.6912'}
+
 69%|██████▉   | 26240/37963 [64:56:41<35:52:16, 11.02s/it]
 69%|██████▉   | 26241/37963 [64:56:49<33:43:12, 10.36s/it]
 69%|██████▉   | 26242/37963 [64:56:58<31:45:58,  9.76s/it]
 69%|██████▉   | 26243/37963 [64:57:06<30:42:26,  9.43s/it]
 69%|██████▉   | 26244/37963 [64:57:15<29:28:43,  9.06s/it]
 69%|██████▉   | 26245/37963 [64:57:23<28:54:23,  8.88s/it]
 69%|██████▉   | 26246/37963 [64:57:32<28:37:00,  8.79s/it]
 69%|██████▉   | 26247/37963 [64:57:40<28:02:06,  8.61s/it]
 69%|██████▉   | 26248/37963 [64:57:48<27:49:38,  8.55s/it]
 69%|██████▉   | 26249/37963 [64:57:57<27:39:00,  8.50s/it]
 69%|██████▉   | 26250/37963 [64:58:05<27:33:06,  8.47s/it]
                                                           
{'loss': '0.1103', 'grad_norm': '1.706', 'learning_rate': '4.592e-06', 'epoch': '0.6915'}
+
 69%|██████▉   | 26250/37963 [64:58:05<27:33:06,  8.47s/it]
 69%|██████▉   | 26251/37963 [64:58:14<27:40:34,  8.51s/it]
 69%|██████▉   | 26252/37963 [64:58:22<27:29:11,  8.45s/it]
 69%|██████▉   | 26253/37963 [64:58:30<27:35:10,  8.48s/it]
 69%|██████▉   | 26254/37963 [64:58:39<27:43:38,  8.52s/it]
 69%|██████▉   | 26255/37963 [64:58:48<27:39:12,  8.50s/it]
 69%|██████▉   | 26256/37963 [64:58:56<27:39:35,  8.51s/it]
 69%|██████▉   | 26257/37963 [64:59:04<27:30:40,  8.46s/it]
 69%|██████▉   | 26258/37963 [64:59:13<27:37:04,  8.49s/it]
 69%|██████▉   | 26259/37963 [64:59:21<27:31:25,  8.47s/it]
 69%|██████▉   | 26260/37963 [64:59:30<27:29:42,  8.46s/it]
                                                           
{'loss': '0.1325', 'grad_norm': '2.269', 'learning_rate': '4.584e-06', 'epoch': '0.6917'}
+
 69%|██████▉   | 26260/37963 [64:59:30<27:29:42,  8.46s/it]
 69%|██████▉   | 26261/37963 [64:59:38<27:26:13,  8.44s/it]
 69%|██████▉   | 26262/37963 [64:59:57<37:31:17, 11.54s/it]
 69%|██████▉   | 26263/37963 [65:00:15<43:56:10, 13.52s/it]
 69%|██████▉   | 26264/37963 [65:00:24<38:52:53, 11.96s/it]
 69%|██████▉   | 26265/37963 [65:00:32<35:42:21, 10.99s/it]
 69%|██████▉   | 26266/37963 [65:00:41<33:35:40, 10.34s/it]
 69%|██████▉   | 26267/37963 [65:00:57<39:00:22, 12.01s/it]
 69%|██████▉   | 26268/37963 [65:01:05<35:31:57, 10.94s/it]
 69%|██████▉   | 26269/37963 [65:01:14<33:19:55, 10.26s/it]
 69%|██████▉   | 26270/37963 [65:01:22<31:29:22,  9.69s/it]
                                                           
{'loss': '0.1257', 'grad_norm': '1.834', 'learning_rate': '4.577e-06', 'epoch': '0.692'}
+
 69%|██████▉   | 26270/37963 [65:01:22<31:29:22,  9.69s/it]
 69%|██████▉   | 26271/37963 [65:01:38<37:36:20, 11.58s/it]
 69%|██████▉   | 26272/37963 [65:01:47<34:22:08, 10.58s/it]
 69%|██████▉   | 26273/37963 [65:01:55<32:06:50,  9.89s/it]
 69%|██████▉   | 26274/37963 [65:02:03<30:30:57,  9.40s/it]
 69%|██████▉   | 26275/37963 [65:02:11<29:24:36,  9.06s/it]
 69%|██████▉   | 26276/37963 [65:02:20<28:39:30,  8.83s/it]
 69%|██████▉   | 26277/37963 [65:02:28<28:03:34,  8.64s/it]
 69%|██████▉   | 26278/37963 [65:02:43<34:09:57, 10.53s/it]
 69%|██████▉   | 26279/37963 [65:02:51<32:14:25,  9.93s/it]
 69%|██████▉   | 26280/37963 [65:03:00<30:45:22,  9.48s/it]
                                                           
{'loss': '0.1258', 'grad_norm': '1.762', 'learning_rate': '4.57e-06', 'epoch': '0.6923'}
+
 69%|██████▉   | 26280/37963 [65:03:00<30:45:22,  9.48s/it]
 69%|██████▉   | 26281/37963 [65:03:08<29:29:28,  9.09s/it]
 69%|██████▉   | 26282/37963 [65:03:31<42:32:16, 13.11s/it]
 69%|██████▉   | 26283/37963 [65:03:40<38:33:38, 11.89s/it]
 69%|██████▉   | 26284/37963 [65:03:48<35:13:58, 10.86s/it]
 69%|██████▉   | 26285/37963 [65:03:56<32:47:26, 10.11s/it]
 69%|██████▉   | 26286/37963 [65:04:05<31:13:33,  9.63s/it]
 69%|██████▉   | 26287/37963 [65:04:22<38:26:28, 11.85s/it]
 69%|██████▉   | 26288/37963 [65:04:31<35:46:26, 11.03s/it]
 69%|██████▉   | 26289/37963 [65:04:40<33:25:01, 10.31s/it]
 69%|██████▉   | 26290/37963 [65:04:48<31:45:34,  9.79s/it]
                                                           
{'loss': '0.1281', 'grad_norm': '1.895', 'learning_rate': '4.563e-06', 'epoch': '0.6925'}
+
 69%|██████▉   | 26290/37963 [65:04:48<31:45:34,  9.79s/it]
 69%|██████▉   | 26291/37963 [65:04:56<30:14:47,  9.33s/it]
 69%|██████▉   | 26292/37963 [65:05:05<29:19:56,  9.05s/it]
 69%|██████▉   | 26293/37963 [65:05:13<28:43:21,  8.86s/it]
 69%|██████▉   | 26294/37963 [65:05:22<28:10:03,  8.69s/it]
 69%|██████▉   | 26295/37963 [65:05:30<27:56:12,  8.62s/it]
 69%|██████▉   | 26296/37963 [65:05:38<27:32:29,  8.50s/it]
 69%|██████▉   | 26297/37963 [65:05:47<27:33:18,  8.50s/it]
 69%|██████▉   | 26298/37963 [65:05:55<27:26:21,  8.47s/it]
 69%|██████▉   | 26299/37963 [65:06:03<27:15:54,  8.42s/it]
 69%|██████▉   | 26300/37963 [65:06:12<27:15:46,  8.42s/it]
                                                           
{'loss': '0.1212', 'grad_norm': '2.875', 'learning_rate': '4.556e-06', 'epoch': '0.6928'}
+
 69%|██████▉   | 26300/37963 [65:06:12<27:15:46,  8.42s/it]
 69%|██████▉   | 26301/37963 [65:06:20<27:14:47,  8.41s/it]
 69%|██████▉   | 26302/37963 [65:06:28<27:03:18,  8.35s/it]
 69%|██████▉   | 26303/37963 [65:06:37<26:51:26,  8.29s/it]
 69%|██████▉   | 26304/37963 [65:06:45<27:07:23,  8.37s/it]
 69%|██████▉   | 26305/37963 [65:06:54<27:05:08,  8.36s/it]
 69%|██████▉   | 26306/37963 [65:07:02<27:12:56,  8.40s/it]
 69%|██████▉   | 26307/37963 [65:07:11<27:15:34,  8.42s/it]
 69%|██████▉   | 26308/37963 [65:07:28<35:48:21, 11.06s/it]
 69%|██████▉   | 26309/37963 [65:07:37<33:46:16, 10.43s/it]
 69%|██████▉   | 26310/37963 [65:07:45<32:01:12,  9.89s/it]
                                                           
{'loss': '0.1196', 'grad_norm': '5.255', 'learning_rate': '4.549e-06', 'epoch': '0.693'}
+
 69%|██████▉   | 26310/37963 [65:07:45<32:01:12,  9.89s/it]
 69%|██████▉   | 26311/37963 [65:08:04<40:09:01, 12.40s/it]
 69%|██████▉   | 26312/37963 [65:08:12<36:21:24, 11.23s/it]
 69%|██████▉   | 26313/37963 [65:08:20<33:30:58, 10.36s/it]
 69%|██████▉   | 26314/37963 [65:08:29<31:34:52,  9.76s/it]
 69%|██████▉   | 26315/37963 [65:08:37<30:00:44,  9.28s/it]
 69%|██████▉   | 26316/37963 [65:08:45<29:12:35,  9.03s/it]
 69%|██████▉   | 26317/37963 [65:08:53<28:13:27,  8.72s/it]
 69%|██████▉   | 26318/37963 [65:09:02<27:49:12,  8.60s/it]
 69%|██████▉   | 26319/37963 [65:09:17<34:16:08, 10.60s/it]
 69%|██████▉   | 26320/37963 [65:09:25<31:52:14,  9.85s/it]
                                                           
{'loss': '0.118', 'grad_norm': '1.691', 'learning_rate': '4.541e-06', 'epoch': '0.6933'}
+
 69%|██████▉   | 26320/37963 [65:09:25<31:52:14,  9.85s/it]
 69%|██████▉   | 26321/37963 [65:09:41<37:23:23, 11.56s/it]
 69%|██████▉   | 26322/37963 [65:09:49<34:22:19, 10.63s/it]
 69%|██████▉   | 26323/37963 [65:09:58<32:21:40, 10.01s/it]
 69%|██████▉   | 26324/37963 [65:10:06<30:59:52,  9.59s/it]
 69%|██████▉   | 26325/37963 [65:10:15<29:51:23,  9.24s/it]
 69%|██████▉   | 26326/37963 [65:10:30<35:38:52, 11.03s/it]
 69%|██████▉   | 26327/37963 [65:10:38<33:05:26, 10.24s/it]
 69%|██████▉   | 26328/37963 [65:10:47<31:17:50,  9.68s/it]
 69%|██████▉   | 26329/37963 [65:10:55<30:01:25,  9.29s/it]
 69%|██████▉   | 26330/37963 [65:11:10<35:46:03, 11.07s/it]
                                                           
{'loss': '0.1241', 'grad_norm': '3.794', 'learning_rate': '4.534e-06', 'epoch': '0.6936'}
+
 69%|██████▉   | 26330/37963 [65:11:10<35:46:03, 11.07s/it]
 69%|██████▉   | 26331/37963 [65:11:26<40:12:20, 12.44s/it]
 69%|██████▉   | 26332/37963 [65:11:34<36:15:09, 11.22s/it]
 69%|██████▉   | 26333/37963 [65:11:43<33:45:42, 10.45s/it]
 69%|██████▉   | 26334/37963 [65:11:51<31:32:40,  9.77s/it]
 69%|██████▉   | 26335/37963 [65:12:00<30:18:07,  9.38s/it]
 69%|██████▉   | 26336/37963 [65:12:08<29:16:06,  9.06s/it]
 69%|█████��▉   | 26337/37963 [65:12:16<28:42:29,  8.89s/it]
 69%|██████▉   | 26338/37963 [65:12:25<28:01:15,  8.68s/it]
 69%|██████▉   | 26339/37963 [65:12:33<27:39:09,  8.56s/it]
 69%|██████▉   | 26340/37963 [65:12:41<27:24:37,  8.49s/it]
                                                           
{'loss': '0.1285', 'grad_norm': '1.853', 'learning_rate': '4.527e-06', 'epoch': '0.6938'}
+
 69%|██████▉   | 26340/37963 [65:12:41<27:24:37,  8.49s/it]
 69%|██████▉   | 26341/37963 [65:12:49<27:11:13,  8.42s/it]
 69%|██████▉   | 26342/37963 [65:13:07<35:46:28, 11.08s/it]
 69%|██████▉   | 26343/37963 [65:13:15<33:11:23, 10.28s/it]
 69%|██████▉   | 26344/37963 [65:13:24<31:27:34,  9.75s/it]
 69%|██████▉   | 26345/37963 [65:13:32<30:18:23,  9.39s/it]
 69%|██████▉   | 26346/37963 [65:13:40<29:15:13,  9.07s/it]
 69%|██████▉   | 26347/37963 [65:13:49<28:35:31,  8.86s/it]
 69%|██████▉   | 26348/37963 [65:13:57<28:12:07,  8.74s/it]
 69%|██████▉   | 26349/37963 [65:14:06<27:49:56,  8.63s/it]
 69%|██████▉   | 26350/37963 [65:14:14<27:32:24,  8.54s/it]
                                                           
{'loss': '0.132', 'grad_norm': '3.872', 'learning_rate': '4.52e-06', 'epoch': '0.6941'}
+
 69%|██████▉   | 26350/37963 [65:14:14<27:32:24,  8.54s/it]
 69%|██████▉   | 26351/37963 [65:14:23<27:35:11,  8.55s/it]
 69%|██████▉   | 26352/37963 [65:14:31<27:22:08,  8.49s/it]
 69%|██████▉   | 26353/37963 [65:14:39<27:09:25,  8.42s/it]
 69%|██████▉   | 26354/37963 [65:14:48<27:08:17,  8.42s/it]
 69%|██████▉   | 26355/37963 [65:14:56<27:04:32,  8.40s/it]
 69%|██████▉   | 26356/37963 [65:15:04<26:54:20,  8.34s/it]
 69%|██████▉   | 26357/37963 [65:15:13<26:53:25,  8.34s/it]
 69%|██████▉   | 26358/37963 [65:15:30<36:11:19, 11.23s/it]
 69%|██████▉   | 26359/37963 [65:15:39<33:35:22, 10.42s/it]
 69%|██████▉   | 26360/37963 [65:15:47<31:24:23,  9.74s/it]
                                                           
{'loss': '0.1156', 'grad_norm': '2.04', 'learning_rate': '4.513e-06', 'epoch': '0.6944'}
+
 69%|██████▉   | 26360/37963 [65:15:47<31:24:23,  9.74s/it]
 69%|██████▉   | 26361/37963 [65:16:05<38:54:58, 12.08s/it]
 69%|██████▉   | 26362/37963 [65:16:13<35:36:49, 11.05s/it]
 69%|██████▉   | 26363/37963 [65:16:22<32:50:36, 10.19s/it]
 69%|██████▉   | 26364/37963 [65:16:30<31:00:00,  9.62s/it]
 69%|██████▉   | 26365/37963 [65:16:38<29:41:34,  9.22s/it]
 69%|██████▉   | 26366/37963 [65:16:46<28:51:02,  8.96s/it]
 69%|██████▉   | 26367/37963 [65:17:02<35:33:10, 11.04s/it]
 69%|██████▉   | 26368/37963 [65:17:11<33:03:29, 10.26s/it]
 69%|██████▉   | 26369/37963 [65:17:19<31:16:33,  9.71s/it]
 69%|██████▉   | 26370/37963 [65:17:35<37:08:43, 11.53s/it]
                                                           
{'loss': '0.1235', 'grad_norm': '1.407', 'learning_rate': '4.506e-06', 'epoch': '0.6946'}
+
 69%|██████▉   | 26370/37963 [65:17:35<37:08:43, 11.53s/it]
 69%|██████▉   | 26371/37963 [65:17:44<34:36:03, 10.75s/it]
 69%|██████▉   | 26372/37963 [65:17:52<32:10:31,  9.99s/it]
 69%|██████▉   | 26373/37963 [65:18:01<30:40:26,  9.53s/it]
 69%|██████▉   | 26374/37963 [65:18:16<36:13:30, 11.25s/it]
 69%|██████▉   | 26375/37963 [65:18:32<41:05:04, 12.76s/it]
 69%|██████▉   | 26376/37963 [65:18:41<36:49:02, 11.44s/it]
 69%|██████▉   | 26377/37963 [65:18:49<33:42:10, 10.47s/it]
 69%|██████▉   | 26378/37963 [65:18:57<31:41:25,  9.85s/it]
 69%|██████▉   | 26379/37963 [65:19:05<29:49:08,  9.27s/it]
 69%|██████▉   | 26380/37963 [65:19:13<28:58:34,  9.01s/it]
                                                           
{'loss': '0.1163', 'grad_norm': '2.136', 'learning_rate': '4.499e-06', 'epoch': '0.6949'}
+
 69%|██████▉   | 26380/37963 [65:19:13<28:58:34,  9.01s/it]
 69%|██████▉   | 26381/37963 [65:19:22<28:19:36,  8.80s/it]
 69%|██████▉   | 26382/37963 [65:19:30<27:52:12,  8.66s/it]
 69%|██████▉   | 26383/37963 [65:19:38<27:20:57,  8.50s/it]
 69%|██████▉   | 26384/37963 [65:19:46<27:00:37,  8.40s/it]
 70%|██████▉   | 26385/37963 [65:20:02<33:34:45, 10.44s/it]
 70%|██████▉   | 26386/37963 [65:20:10<31:33:14,  9.81s/it]
 70%|██████▉   | 26387/37963 [65:20:18<29:44:26,  9.25s/it]
 70%|██████▉   | 26388/37963 [65:20:26<28:57:11,  9.00s/it]
 70%|██████▉   | 26389/37963 [65:20:34<28:08:25,  8.75s/it]
 70%|██████▉   | 26390/37963 [65:20:52<36:50:23, 11.46s/it]
                                                           
{'loss': '0.1207', 'grad_norm': '2.056', 'learning_rate': '4.492e-06', 'epoch': '0.6952'}
+
 70%|██████▉   | 26390/37963 [65:20:52<36:50:23, 11.46s/it]
 70%|██████▉   | 26391/37963 [65:21:01<34:07:00, 10.61s/it]
 70%|██████▉   | 26392/37963 [65:21:09<32:08:20, 10.00s/it]
 70%|██████▉   | 26393/37963 [65:21:18<30:36:39,  9.52s/it]
 70%|██████▉   | 26394/37963 [65:21:26<29:37:04,  9.22s/it]
 70%|██████▉   | 26395/37963 [65:21:34<28:32:50,  8.88s/it]
 70%|██████▉   | 26396/37963 [65:21:43<27:57:34,  8.70s/it]
 70%|██████▉   | 26397/37963 [65:21:51<27:44:39,  8.64s/it]
 70%|██████▉   | 26398/37963 [65:22:00<27:39:15,  8.61s/it]
 70%|██████▉   | 26399/37963 [65:22:08<27:34:36,  8.58s/it]
 70%|██████▉   | 26400/37963 [65:22:17<27:19:26,  8.51s/it]
                                                           
{'loss': '0.1295', 'grad_norm': '2.143', 'learning_rate': '4.484e-06', 'epoch': '0.6954'}
+
 70%|██████▉   | 26400/37963 [65:22:17<27:19:26,  8.51s/it]
 70%|██████▉   | 26401/37963 [65:22:25<27:09:38,  8.46s/it]
 70%|██████▉   | 26402/37963 [65:22:33<27:04:01,  8.43s/it]
 70%|██████▉   | 26403/37963 [65:22:42<26:59:49,  8.41s/it]
 70%|██████▉   | 26404/37963 [65:22:50<27:01:43,  8.42s/it]
 70%|██████▉   | 26405/37963 [65:22:59<27:01:32,  8.42s/it]
 70%|██████▉   | 26406/37963 [65:23:07<27:02:05,  8.42s/it]
 70%|██████▉   | 26407/37963 [65:23:15<26:53:02,  8.38s/it]
 70%|██████▉   | 26408/37963 [65:23:23<26:30:34,  8.26s/it]
 70%|██████▉   | 26409/37963 [65:23:41<35:52:02, 11.18s/it]
 70%|██████▉   | 26410/37963 [65:23:50<33:17:19, 10.37s/it]
                                                           
{'loss': '0.1185', 'grad_norm': '1.355', 'learning_rate': '4.477e-06', 'epoch': '0.6957'}
+
 70%|██████▉   | 26410/37963 [65:23:50<33:17:19, 10.37s/it]
 70%|██████▉   | 26411/37963 [65:24:07<40:18:23, 12.56s/it]
 70%|██████▉   | 26412/37963 [65:24:16<36:15:22, 11.30s/it]
 70%|██████▉   | 26413/37963 [65:24:24<33:25:11, 10.42s/it]
 70%|██████▉   | 26414/37963 [65:24:33<31:31:35,  9.83s/it]
 70%|██████▉   | 26415/37963 [65:24:48<36:46:41, 11.47s/it]
 70%|██████▉   | 26416/37963 [65:24:56<33:33:21, 10.46s/it]
 70%|██████▉   | 26417/37963 [65:25:11<37:41:05, 11.75s/it]
 70%|██████▉   | 26418/37963 [65:25:19<34:07:07, 10.64s/it]
 70%|██████▉   | 26419/37963 [65:25:27<32:00:36,  9.98s/it]
 70%|██████▉   | 26420/37963 [65:25:35<30:10:04,  9.41s/it]
                                                           
{'loss': '0.1203', 'grad_norm': '1.038', 'learning_rate': '4.47e-06', 'epoch': '0.6959'}
+
 70%|██████▉   | 26420/37963 [65:25:35<30:10:04,  9.41s/it]
 70%|██████▉   | 26421/37963 [65:25:50<35:27:01, 11.06s/it]
 70%|██████▉   | 26422/37963 [65:25:59<32:57:56, 10.28s/it]
 70%|██████▉   | 26423/37963 [65:26:07<30:52:51,  9.63s/it]
 70%|██████▉   | 26424/37963 [65:26:15<29:25:47,  9.18s/it]
 70%|██████▉   | 26425/37963 [65:26:23<28:37:39,  8.93s/it]
 70%|██████▉   | 26426/37963 [65:26:31<27:54:20,  8.71s/it]
 70%|██████▉   | 26427/37963 [65:26:40<27:21:40,  8.54s/it]
 70%|██████▉   | 26428/37963 [65:26:48<26:53:35,  8.39s/it]
 70%|██████▉   | 26429/37963 [65:27:03<33:14:53, 10.38s/it]
 70%|██████▉   | 26430/37963 [65:27:11<31:10:27,  9.73s/it]
                                                           
{'loss': '0.1195', 'grad_norm': '1.758', 'learning_rate': '4.463e-06', 'epoch': '0.6962'}
+
 70%|██████▉   | 26430/37963 [65:27:11<31:10:27,  9.73s/it]
 70%|██████▉   | 26431/37963 [65:27:19<29:46:33,  9.30s/it]
 70%|██████▉   | 26432/37963 [65:27:27<28:32:10,  8.91s/it]
 70%|██████▉   | 26433/37963 [65:27:35<27:49:20,  8.69s/it]
 70%|██████▉   | 26434/37963 [65:27:44<27:30:37,  8.59s/it]
 70%|██████▉   | 26435/37963 [65:27:52<27:16:00,  8.51s/it]
 70%|██████▉   | 26436/37963 [65:28:00<27:00:59,  8.44s/it]
 70%|██████▉   | 26437/37963 [65:28:08<26:39:22,  8.33s/it]
 70%|██████▉   | 26438/37963 [65:28:25<34:44:52, 10.85s/it]
 70%|██████▉   | 26439/37963 [65:28:40<38:44:17, 12.10s/it]
 70%|██████▉   | 26440/37963 [65:28:49<35:10:38, 10.99s/it]
                                                           
{'loss': '0.1229', 'grad_norm': '2.313', 'learning_rate': '4.456e-06', 'epoch': '0.6965'}
+
 70%|██████▉   | 26440/37963 [65:28:49<35:10:38, 10.99s/it]
 70%|██████▉   | 26441/37963 [65:28:57<32:32:18, 10.17s/it]
 70%|█��████▉   | 26442/37963 [65:29:05<30:36:54,  9.57s/it]
 70%|██████▉   | 26443/37963 [65:29:13<29:11:45,  9.12s/it]
 70%|██████▉   | 26444/37963 [65:29:21<28:24:27,  8.88s/it]
 70%|██████▉   | 26445/37963 [65:29:30<27:45:08,  8.67s/it]
 70%|██████▉   | 26446/37963 [65:29:38<27:20:37,  8.55s/it]
 70%|██████▉   | 26447/37963 [65:29:46<27:01:26,  8.45s/it]
 70%|██████▉   | 26448/37963 [65:29:54<26:35:18,  8.31s/it]
 70%|██████▉   | 26449/37963 [65:30:02<26:25:34,  8.26s/it]
 70%|██████▉   | 26450/37963 [65:30:10<26:19:35,  8.23s/it]
                                                           
{'loss': '0.1211', 'grad_norm': '3.302', 'learning_rate': '4.449e-06', 'epoch': '0.6967'}
+
 70%|██████▉   | 26450/37963 [65:30:10<26:19:35,  8.23s/it]
 70%|██████▉   | 26451/37963 [65:30:18<25:55:55,  8.11s/it]
 70%|██████▉   | 26452/37963 [65:30:26<25:51:40,  8.09s/it]
 70%|██████▉   | 26453/37963 [65:30:34<26:03:16,  8.15s/it]
 70%|██████▉   | 26454/37963 [65:30:52<34:41:01, 10.85s/it]
 70%|██████▉   | 26455/37963 [65:31:00<32:12:21, 10.07s/it]
 70%|██████▉   | 26456/37963 [65:31:08<30:14:01,  9.46s/it]
 70%|██████▉   | 26457/37963 [65:31:16<29:01:14,  9.08s/it]
 70%|██████▉   | 26458/37963 [65:31:24<28:04:26,  8.78s/it]
 70%|██████▉   | 26459/37963 [65:31:32<27:09:58,  8.50s/it]
 70%|██████▉   | 26460/37963 [65:31:40<26:39:25,  8.34s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '2.049', 'learning_rate': '4.442e-06', 'epoch': '0.697'}
+
 70%|██████▉   | 26460/37963 [65:31:40<26:39:25,  8.34s/it]
 70%|██████▉   | 26461/37963 [65:31:55<32:51:45, 10.29s/it]
 70%|██████▉   | 26462/37963 [65:32:03<30:59:27,  9.70s/it]
 70%|██████▉   | 26463/37963 [65:32:26<43:43:55, 13.69s/it]
 70%|██████▉   | 26464/37963 [65:32:34<38:20:47, 12.01s/it]
 70%|██████▉   | 26465/37963 [65:32:42<34:30:17, 10.80s/it]
 70%|██████▉   | 26466/37963 [65:32:50<31:49:25,  9.96s/it]
 70%|██████▉   | 26467/37963 [65:32:58<29:52:29,  9.36s/it]
 70%|██████▉   | 26468/37963 [65:33:06<28:33:23,  8.94s/it]
 70%|██████▉   | 26469/37963 [65:33:20<33:41:47, 10.55s/it]
 70%|██████▉   | 26470/37963 [65:33:28<31:16:36,  9.80s/it]
                                                           
{'loss': '0.1162', 'grad_norm': '2.048', 'learning_rate': '4.435e-06', 'epoch': '0.6973'}
+
 70%|██████▉   | 26470/37963 [65:33:28<31:16:36,  9.80s/it]
 70%|██████▉   | 26471/37963 [65:33:37<29:35:25,  9.27s/it]
 70%|██████▉   | 26472/37963 [65:33:44<28:12:49,  8.84s/it]
 70%|██████▉   | 26473/37963 [65:33:59<34:03:11, 10.67s/it]
 70%|██████▉   | 26474/37963 [65:34:07<31:17:53,  9.81s/it]
 70%|██████▉   | 26475/37963 [65:34:15<29:22:59,  9.21s/it]
 70%|██████▉   | 26476/37963 [65:34:23<28:36:17,  8.96s/it]
 70%|██████▉   | 26477/37963 [65:34:31<27:34:02,  8.64s/it]
 70%|██████▉   | 26478/37963 [65:34:39<26:55:18,  8.44s/it]
 70%|██████▉   | 26479/37963 [65:34:47<26:28:13,  8.30s/it]
 70%|██████▉   | 26480/37963 [65:34:55<26:08:32,  8.20s/it]
                                                           
{'loss': '0.1139', 'grad_norm': '2.258', 'learning_rate': '4.428e-06', 'epoch': '0.6975'}
+
 70%|██████▉   | 26480/37963 [65:34:55<26:08:32,  8.20s/it]
 70%|██████▉   | 26481/37963 [65:35:03<26:01:49,  8.16s/it]
 70%|██████▉   | 26482/37963 [65:35:11<25:40:15,  8.05s/it]
 70%|██████▉   | 26483/37963 [65:35:19<25:51:59,  8.11s/it]
 70%|██████▉   | 26484/37963 [65:35:27<26:00:57,  8.16s/it]
 70%|██████▉   | 26485/37963 [65:35:35<25:46:35,  8.08s/it]
 70%|██████▉   | 26486/37963 [65:35:43<25:30:24,  8.00s/it]
 70%|██████▉   | 26487/37963 [65:36:06<39:12:18, 12.30s/it]
 70%|██████▉   | 26488/37963 [65:36:14<35:13:30, 11.05s/it]
 70%|██████▉   | 26489/37963 [65:36:22<32:18:22, 10.14s/it]
 70%|██████▉   | 26490/37963 [65:36:30<30:24:23,  9.54s/it]
                                                           
{'loss': '0.1188', 'grad_norm': '1.628', 'learning_rate': '4.421e-06', 'epoch': '0.6978'}
+
 70%|██████▉   | 26490/37963 [65:36:30<30:24:23,  9.54s/it]
 70%|██████▉   | 26491/37963 [65:36:38<28:56:43,  9.08s/it]
 70%|██████▉   | 26492/37963 [65:36:46<27:52:56,  8.75s/it]
 70%|██████▉   | 26493/37963 [65:36:54<27:37:53,  8.67s/it]
 70%|██████▉   | 26494/37963 [65:37:03<27:12:48,  8.54s/it]
 70%|██████▉   | 26495/37963 [65:37:10<26:34:07,  8.34s/it]
 70%|██████▉   | 26496/37963 [65:37:18<26:16:56,  8.25s/it]
 70%|██████▉   | 26497/37963 [65:37:27<26:15:50,  8.25s/it]
 70%|██████▉   | 26498/37963 [65:37:34<25:42:24,  8.07s/it]
 70%|██████▉   | 26499/37963 [65:37:42<25:37:45,  8.05s/it]
 70%|██████▉   | 26500/37963 [65:37:50<25:35:23,  8.04s/it]
                                                           
{'loss': '0.1304', 'grad_norm': '4.093', 'learning_rate': '4.413e-06', 'epoch': '0.6981'}
+
 70%|██████▉   | 26500/37963 [65:37:50<25:35:23,  8.04s/it]
 70%|██████▉   | 26501/37963 [65:37:58<25:19:43,  7.96s/it]
 70%|██████▉   | 26502/37963 [65:38:14<33:20:11, 10.47s/it]
 70%|██████▉   | 26503/37963 [65:38:23<31:22:02,  9.85s/it]
 70%|██████▉   | 26504/37963 [65:38:37<35:41:02, 11.21s/it]
 70%|██████▉   | 26505/37963 [65:38:45<32:41:45, 10.27s/it]
 70%|██████▉   | 26506/37963 [65:38:53<30:31:44,  9.59s/it]
 70%|██████▉   | 26507/37963 [65:39:01<29:08:27,  9.16s/it]
 70%|██████▉   | 26508/37963 [65:39:10<28:15:34,  8.88s/it]
 70%|██████▉   | 26509/37963 [65:39:18<27:17:23,  8.58s/it]
 70%|██████▉   | 26510/37963 [65:39:26<26:44:14,  8.40s/it]
                                                           
{'loss': '0.111', 'grad_norm': '3.636', 'learning_rate': '4.406e-06', 'epoch': '0.6983'}
+
 70%|██████▉   | 26510/37963 [65:39:26<26:44:14,  8.40s/it]
 70%|██████▉   | 26511/37963 [65:39:34<26:22:05,  8.29s/it]
 70%|██████▉   | 26512/37963 [65:39:42<26:07:22,  8.21s/it]
 70%|██████▉   | 26513/37963 [65:39:56<32:23:30, 10.18s/it]
 70%|██████▉   | 26514/37963 [65:40:05<30:38:10,  9.63s/it]
 70%|██████▉   | 26515/37963 [65:40:13<28:52:33,  9.08s/it]
 70%|██████▉   | 26516/37963 [65:40:21<27:58:42,  8.80s/it]
 70%|██████▉   | 26517/37963 [65:40:43<41:04:52, 12.92s/it]
 70%|██████▉   | 26518/37963 [65:40:58<43:12:01, 13.59s/it]
 70%|██████▉   | 26519/37963 [65:41:07<38:03:10, 11.97s/it]
 70%|██████▉   | 26520/37963 [65:41:15<34:21:41, 10.81s/it]
                                                           
{'loss': '0.1084', 'grad_norm': '1.717', 'learning_rate': '4.399e-06', 'epoch': '0.6986'}
+
 70%|██████▉   | 26520/37963 [65:41:15<34:21:41, 10.81s/it]
 70%|██████▉   | 26521/37963 [65:41:23<31:41:37,  9.97s/it]
 70%|██████▉   | 26522/37963 [65:41:31<29:43:23,  9.35s/it]
 70%|██████▉   | 26523/37963 [65:41:38<28:18:28,  8.91s/it]
 70%|██████▉   | 26524/37963 [65:41:46<27:18:44,  8.60s/it]
 70%|██████▉   | 26525/37963 [65:41:54<26:37:35,  8.38s/it]
 70%|██████▉   | 26526/37963 [65:42:02<25:58:55,  8.18s/it]
 70%|██████▉   | 26527/37963 [65:42:10<25:23:56,  8.00s/it]
 70%|██████▉   | 26528/37963 [65:42:17<25:13:22,  7.94s/it]
 70%|██████▉   | 26529/37963 [65:42:25<25:06:38,  7.91s/it]
 70%|██████▉   | 26530/37963 [65:42:33<24:54:31,  7.84s/it]
                                                           
{'loss': '0.1177', 'grad_norm': '2.912', 'learning_rate': '4.392e-06', 'epoch': '0.6988'}
+
 70%|██████▉   | 26530/37963 [65:42:33<24:54:31,  7.84s/it]
 70%|██████▉   | 26531/37963 [65:42:41<24:58:06,  7.86s/it]
 70%|██████▉   | 26532/37963 [65:42:48<24:51:13,  7.83s/it]
 70%|██████▉   | 26533/37963 [65:42:56<24:52:50,  7.84s/it]
 70%|██████▉   | 26534/37963 [65:43:04<24:46:54,  7.81s/it]
 70%|██████▉   | 26535/37963 [65:43:12<24:39:43,  7.77s/it]
 70%|██████▉   | 26536/37963 [65:43:26<31:12:54,  9.83s/it]
 70%|██████▉   | 26537/37963 [65:43:34<29:26:36,  9.28s/it]
 70%|██████▉   | 26538/37963 [65:43:50<35:19:00, 11.13s/it]
 70%|██████▉   | 26539/37963 [65:43:58<32:17:12, 10.17s/it]
 70%|██████▉   | 26540/37963 [65:44:05<29:53:56,  9.42s/it]
                                                           
{'loss': '0.1182', 'grad_norm': '2.316', 'learning_rate': '4.385e-06', 'epoch': '0.6991'}
+
 70%|██████▉   | 26540/37963 [65:44:05<29:53:56,  9.42s/it]
 70%|██████▉   | 26541/37963 [65:44:13<28:18:34,  8.92s/it]
 70%|██████▉   | 26542/37963 [65:44:21<27:14:18,  8.59s/it]
 70%|██████▉   | 26543/37963 [65:44:29<26:12:35,  8.26s/it]
 70%|██████▉   | 26544/37963 [65:44:36<25:32:43,  8.05s/it]
 70%|██████▉   | 26545/37963 [65:44:44<25:03:27,  7.90s/it]
 70%|██████▉   | 26546/37963 [65:44:51<24:49:28,  7.83s/it]
 70%|██████▉   | 26547/37963 [65:44:59<24:45:14,  7.81s/it]
 70%|██████▉   | 26548/37963 [65:45:14<31:17:50,  9.87s/it]
 70%|██████▉   | 26549/37963 [65:45:22<29:32:13,  9.32s/it]
 70%|██████▉   | 26550/37963 [65:45:29<28:00:29,  8.83s/it]
                                                           
{'loss': '0.1227', 'grad_norm': '3.698', 'learning_rate': '4.378e-06', 'epoch': '0.6994'}
+
 70%|██████▉   | 26550/37963 [65:45:29<28:00:29,  8.83s/it]
 70%|██████▉   | 26551/37963 [65:45:37<26:59:12,  8.51s/it]
 70%|██████▉   | 26552/37963 [65:45:45<26:21:09,  8.31s/it]
 70%|██████▉   | 26553/37963 [65:45:53<25:52:25,  8.16s/it]
 70%|██████▉   | 26554/37963 [65:46:01<25:29:55,  8.05s/it]
 70%|██████▉   | 26555/37963 [65:46:08<25:06:31,  7.92s/it]
 70%|██████▉   | 26556/37963 [65:46:23<32:00:55, 10.10s/it]
 70%|██████▉   | 26557/37963 [65:46:31<29:52:33,  9.43s/it]
 70%|██████▉   | 26558/37963 [65:46:39<28:15:28,  8.92s/it]
 70%|██████▉   | 26559/37963 [65:46:47<27:08:48,  8.57s/it]
 70%|██████▉   | 26560/37963 [65:46:54<25:56:11,  8.19s/it]
                                                           
{'loss': '0.1273', 'grad_norm': '2.089', 'learning_rate': '4.371e-06', 'epoch': '0.6996'}
+
 70%|██████▉   | 26560/37963 [65:46:54<25:56:11,  8.19s/it]
 70%|██████▉   | 26561/37963 [65:47:15<37:54:57, 11.97s/it]
 70%|██████▉   | 26562/37963 [65:47:30<40:26:51, 12.77s/it]
 70%|██████▉   | 26563/37963 [65:47:37<35:31:12, 11.22s/it]
 70%|██████▉   | 26564/37963 [65:47:45<32:13:58, 10.18s/it]
 70%|██████▉   | 26565/37963 [65:48:00<36:41:08, 11.59s/it]
 70%|██████▉   | 26566/37963 [65:48:07<32:50:34, 10.37s/it]
 70%|██████▉   | 26567/37963 [65:48:15<30:18:57,  9.58s/it]
 70%|██████▉   | 26568/37963 [65:48:23<28:28:58,  9.00s/it]
 70%|██████▉   | 26569/37963 [65:48:30<27:12:21,  8.60s/it]
 70%|██████▉   | 26570/37963 [65:48:38<26:08:31,  8.26s/it]
                                                           
{'loss': '0.1034', 'grad_norm': '2.218', 'learning_rate': '4.364e-06', 'epoch': '0.6999'}
+
 70%|██████▉   | 26570/37963 [65:48:38<26:08:31,  8.26s/it]
 70%|██████▉   | 26571/37963 [65:48:45<25:22:56,  8.02s/it]
 70%|██████▉   | 26572/37963 [65:48:53<24:45:09,  7.82s/it]
 70%|██████▉   | 26573/37963 [65:49:00<24:23:48,  7.71s/it]
 70%|██████▉   | 26574/37963 [65:49:08<24:22:35,  7.71s/it]
 70%|███████   | 26575/37963 [65:49:15<24:10:34,  7.64s/it]
 70%|███████   | 26576/37963 [65:49:23<24:15:28,  7.67s/it]
 70%|███████   | 26577/37963 [65:49:31<24:12:49,  7.66s/it]
 70%|███████   | 26578/37963 [65:49:38<24:00:32,  7.59s/it]
 70%|███████   | 26579/37963 [65:49:52<30:15:58,  9.57s/it]
 70%|███████   | 26580/37963 [65:50:00<28:32:06,  9.02s/it]
                                                           
{'loss': '0.1092', 'grad_norm': '1.832', 'learning_rate': '4.357e-06', 'epoch': '0.7002'}
+
 70%|███████   | 26580/37963 [65:50:00<28:32:06,  9.02s/it]
 70%|███████   | 26581/37963 [65:50:08<27:17:52,  8.63s/it]
 70%|███████   | 26582/37963 [65:50:15<26:10:15,  8.28s/it]
 70%|███████   | 26583/37963 [65:50:23<25:38:42,  8.11s/it]
 70%|███████   | 26584/37963 [65:50:39<32:48:26, 10.38s/it]
 70%|███████   | 26585/37963 [65:50:46<30:24:00,  9.62s/it]
 70%|███████   | 26586/37963 [65:50:54<28:44:32,  9.09s/it]
 70%|███████   | 26587/37963 [65:51:02<27:24:25,  8.67s/it]
 70%|███████   | 26588/37963 [65:51:10<26:22:09,  8.35s/it]
 70%|███████   | 26589/37963 [65:51:17<25:48:49,  8.17s/it]
 70%|███████   | 26590/37963 [65:51:25<25:16:59,  8.00s/it]
                                                           
{'loss': '0.1226', 'grad_norm': '3.394', 'learning_rate': '4.35e-06', 'epoch': '0.7004'}
+
 70%|███████   | 26590/37963 [65:51:25<25:16:59,  8.00s/it]
 70%|███████   | 26591/37963 [65:51:32<24:31:58,  7.77s/it]
 70%|███████   | 26592/37963 [65:51:40<24:28:30,  7.75s/it]
 70%|███████   | 26593/37963 [65:51:47<24:19:16,  7.70s/it]
 70%|███████   | 26594/37963 [65:51:55<24:04:12,  7.62s/it]
 70%|███████   | 26595/37963 [65:52:03<24:15:19,  7.68s/it]
 70%|███████   | 26596/37963 [65:52:10<24:14:52,  7.68s/it]
 70%|███████   | 26597/37963 [65:52:18<24:18:55,  7.70s/it]
 70%|███████   | 26598/37963 [65:52:26<24:22:45,  7.72s/it]
 70%|███████   | 26599/37963 [65:52:34<24:23:07,  7.73s/it]
 70%|███████   | 26600/37963 [65:52:41<24:17:12,  7.69s/it]
                                                           
{'loss': '0.1146', 'grad_norm': '1.955', 'learning_rate': '4.343e-06', 'epoch': '0.7007'}
+
 70%|███████   | 26600/37963 [65:52:41<24:17:12,  7.69s/it]
 70%|███████   | 26601/37963 [65:52:56<31:20:21,  9.93s/it]
 70%|███████   | 26602/37963 [65:53:11<35:51:02, 11.36s/it]
 70%|███████   | 26603/37963 [65:53:19<32:23:12, 10.26s/it]
 70%|███████   | 26604/37963 [65:53:27<30:18:02,  9.60s/it]
 70%|███████   | 26605/37963 [65:53:35<28:33:39,  9.05s/it]
 70%|███████   | 26606/37963 [65:53:42<27:17:49,  8.65s/it]
 70%|███████   | 26607/37963 [65:53:50<26:28:51,  8.39s/it]
 70%|███████   | 26608/37963 [65:53:58<25:40:11,  8.14s/it]
 70%|███████   | 26609/37963 [65:54:12<31:14:48,  9.91s/it]
 70%|███████   | 26610/37963 [65:54:26<35:34:42, 11.28s/it]
                                                           
{'loss': '0.1132', 'grad_norm': '2.042', 'learning_rate': '4.336e-06', 'epoch': '0.7009'}
+
 70%|███████   | 26610/37963 [65:54:26<35:34:42, 11.28s/it]
 70%|███████   | 26611/37963 [65:54:34<32:10:12, 10.20s/it]
 70%|███████   | 26612/37963 [65:54:42<29:54:09,  9.48s/it]
 70%|███████   | 26613/37963 [65:54:49<28:08:48,  8.93s/it]
 70%|███████   | 26614/37963 [65:54:57<27:02:13,  8.58s/it]
 70%|███████   | 26615/37963 [65:55:05<26:15:16,  8.33s/it]
 70%|███████   | 26616/37963 [65:55:19<32:03:38, 10.17s/it]
 70%|███████   | 26617/37963 [65:55:34<36:42:28, 11.65s/it]
 70%|███████   | 26618/37963 [65:55:42<33:08:43, 10.52s/it]
 70%|███████   | 26619/37963 [65:55:50<30:38:14,  9.72s/it]
 70%|███████   | 26620/37963 [65:55:58<28:39:42,  9.10s/it]
                                                           
{'loss': '0.1134', 'grad_norm': '2.667', 'learning_rate': '4.329e-06', 'epoch': '0.7012'}
+
 70%|███████   | 26620/37963 [65:55:58<28:39:42,  9.10s/it]
 70%|███████   | 26621/37963 [65:56:06<27:36:09,  8.76s/it]
 70%|███████   | 26622/37963 [65:56:13<26:32:35,  8.43s/it]
 70%|███████   | 26623/37963 [65:56:28<32:02:32, 10.17s/it]
 70%|███████   | 26624/37963 [65:56:35<29:44:31,  9.44s/it]
 70%|███████   | 26625/37963 [65:56:43<28:05:23,  8.92s/it]
 70%|███████   | 26626/37963 [65:56:51<26:59:16,  8.57s/it]
 70%|███████   | 26627/37963 [65:56:58<25:48:39,  8.20s/it]
 70%|███████   | 26628/37963 [65:57:06<25:15:13,  8.02s/it]
 70%|███████   | 26629/37963 [65:57:13<24:43:00,  7.85s/it]
 70%|███████   | 26630/37963 [65:57:28<31:26:39,  9.99s/it]
                                                           
{'loss': '0.115', 'grad_norm': '3.695', 'learning_rate': '4.322e-06', 'epoch': '0.7015'}
+
 70%|███████   | 26630/37963 [65:57:28<31:26:39,  9.99s/it]
 70%|███████   | 26631/37963 [65:57:36<29:14:33,  9.29s/it]
 70%|███████   | 26632/37963 [65:57:44<27:42:14,  8.80s/it]
 70%|███████   | 26633/37963 [65:57:51<26:43:20,  8.49s/it]
 70%|███████   | 26634/37963 [65:57:59<25:58:43,  8.26s/it]
 70%|███████   | 26635/37963 [65:58:07<25:25:12,  8.08s/it]
 70%|███████   | 26636/37963 [65:58:14<24:53:13,  7.91s/it]
 70%|███████   | 26637/37963 [65:58:22<24:38:50,  7.83s/it]
 70%|███████   | 26638/37963 [65:58:30<24:38:20,  7.83s/it]
 70%|███████   | 26639/37963 [65:58:38<24:38:19,  7.83s/it]
 70%|███████   | 26640/37963 [65:58:45<24:19:52,  7.74s/it]
                                                           
{'loss': '0.1163', 'grad_norm': '1.819', 'learning_rate': '4.315e-06', 'epoch': '0.7017'}
+
 70%|███████   | 26640/37963 [65:58:45<24:19:52,  7.74s/it]
 70%|███████   | 26641/37963 [65:58:52<23:59:52,  7.63s/it]
 70%|███████   | 26642/37963 [65:59:00<24:00:30,  7.63s/it]
 70%|███████   | 26643/37963 [65:59:08<24:02:04,  7.64s/it]
 70%|███████   | 26644/37963 [65:59:16<24:10:23,  7.69s/it]
 70%|███████   | 26645/37963 [65:59:23<24:07:33,  7.67s/it]
 70%|███████   | 26646/37963 [65:59:38<30:29:11,  9.70s/it]
 70%|███████   | 26647/37963 [65:59:45<28:32:09,  9.08s/it]
 70%|███████   | 26648/37963 [65:59:53<27:13:35,  8.66s/it]
 70%|███████   | 26649/37963 [66:00:01<26:17:34,  8.37s/it]
 70%|███████   | 26650/37963 [66:00:08<25:19:07,  8.06s/it]
                                                           
{'loss': '0.1067', 'grad_norm': '2.089', 'learning_rate': '4.308e-06', 'epoch': '0.702'}
+
 70%|███████   | 26650/37963 [66:00:08<25:19:07,  8.06s/it]
 70%|███████   | 26651/37963 [66:00:16<25:03:47,  7.98s/it]
 70%|███████   | 26652/37963 [66:00:30<31:21:59,  9.98s/it]
 70%|███████   | 26653/37963 [66:00:45<35:25:34, 11.28s/it]
 70%|███████   | 26654/37963 [66:00:52<31:45:37, 10.11s/it]
 70%|███████   | 26655/37963 [66:01:00<29:21:09,  9.34s/it]
 70%|███████   | 26656/37963 [66:01:07<27:45:48,  8.84s/it]
 70%|███████   | 26657/37963 [66:01:15<26:44:09,  8.51s/it]
 70%|███████   | 26658/37963 [66:01:30<32:21:23, 10.30s/it]
 70%|███████   | 26659/37963 [66:01:37<29:56:20,  9.53s/it]
 70%|███████   | 26660/37963 [66:01:45<28:00:39,  8.92s/it]
                                                           
{'loss': '0.1112', 'grad_norm': '2.209', 'learning_rate': '4.301e-06', 'epoch': '0.7023'}
+
 70%|███████   | 26660/37963 [66:01:45<28:00:39,  8.92s/it]
 70%|███████   | 26661/37963 [66:01:52<26:43:53,  8.51s/it]
 70%|███████   | 26662/37963 [66:02:00<25:40:06,  8.18s/it]
 70%|███████   | 26663/37963 [66:02:14<31:15:01,  9.96s/it]
 70%|███████   | 26664/37963 [66:02:21<29:04:30,  9.26s/it]
 70%|███████   | 26665/37963 [66:02:29<27:36:41,  8.80s/it]
 70%|███████   | 26666/37963 [66:02:37<26:31:12,  8.45s/it]
 70%|███████   | 26667/37963 [66:02:44<25:46:53,  8.22s/it]
 70%|███████   | 26668/37963 [66:02:59<32:02:23, 10.21s/it]
 70%|███████   | 26669/37963 [66:03:07<29:35:42,  9.43s/it]
 70%|███████   | 26670/37963 [66:03:15<28:04:32,  8.95s/it]
                                                           
{'loss': '0.1211', 'grad_norm': '3.493', 'learning_rate': '4.294e-06', 'epoch': '0.7025'}
+
 70%|███████   | 26670/37963 [66:03:15<28:04:32,  8.95s/it]
 70%|███████   | 26671/37963 [66:03:22<26:52:39,  8.57s/it]
 70%|███████   | 26672/37963 [66:03:30<25:52:47,  8.25s/it]
 70%|███████   | 26673/37963 [66:03:38<25:26:14,  8.11s/it]
 70%|███████   | 26674/37963 [66:03:45<25:00:37,  7.98s/it]
 70%|███████   | 26675/37963 [66:03:53<24:47:32,  7.91s/it]
 70%|███████   | 26676/37963 [66:04:07<30:34:01,  9.75s/it]
 70%|███████   | 26677/37963 [66:04:15<28:40:18,  9.15s/it]
 70%|███████   | 26678/37963 [66:04:23<27:21:29,  8.73s/it]
 70%|███████   | 26679/37963 [66:04:30<26:07:30,  8.33s/it]
 70%|███████   | 26680/37963 [66:04:38<25:32:17,  8.15s/it]
                                                           
{'loss': '0.1244', 'grad_norm': '3.444', 'learning_rate': '4.287e-06', 'epoch': '0.7028'}
+
 70%|███████   | 26680/37963 [66:04:38<25:32:17,  8.15s/it]
 70%|███████   | 26681/37963 [66:04:46<25:05:55,  8.01s/it]
 70%|███████   | 26682/37963 [66:04:53<24:43:14,  7.89s/it]
 70%|███████   | 26683/37963 [66:05:01<24:26:52,  7.80s/it]
 70%|███████   | 26684/37963 [66:05:16<31:00:21,  9.90s/it]
 70%|███████   | 26685/37963 [66:05:24<29:17:18,  9.35s/it]
 70%|███████   | 26686/37963 [66:05:31<27:41:00,  8.84s/it]
 70%|███████   | 26687/37963 [66:05:39<26:38:54,  8.51s/it]
 70%|███████   | 26688/37963 [66:05:47<26:29:54,  8.46s/it]
 70%|███████   | 26689/37963 [66:05:55<25:53:23,  8.27s/it]
 70%|███████   | 26690/37963 [66:06:03<25:10:40,  8.04s/it]
                                                           
{'loss': '0.1201', 'grad_norm': '2.664', 'learning_rate': '4.28e-06', 'epoch': '0.7031'}
+
 70%|███████   | 26690/37963 [66:06:03<25:10:40,  8.04s/it]
 70%|███████   | 26691/37963 [66:06:10<24:49:08,  7.93s/it]
 70%|███████   | 26692/37963 [66:06:18<24:39:03,  7.87s/it]
 70%|███████   | 26693/37963 [66:06:26<24:28:57,  7.82s/it]
 70%|███████   | 26694/37963 [66:06:33<24:17:46,  7.76s/it]
 70%|███████   | 26695/37963 [66:06:41<24:04:17,  7.69s/it]
 70%|███████   | 26696/37963 [66:06:48<23:48:13,  7.61s/it]
 70%|███████   | 26697/37963 [66:06:56<23:50:34,  7.62s/it]
 70%|███████   | 26698/37963 [66:07:04<23:54:22,  7.64s/it]
 70%|███████   | 26699/37963 [66:07:11<23:48:38,  7.61s/it]
 70%|███████   | 26700/37963 [66:07:25<30:05:53,  9.62s/it]
                                                           
{'loss': '0.1068', 'grad_norm': '1.866', 'learning_rate': '4.273e-06', 'epoch': '0.7033'}
+
 70%|███████   | 26700/37963 [66:07:25<30:05:53,  9.62s/it]
 70%|███████   | 26701/37963 [66:07:33<28:18:34,  9.05s/it]
 70%|███████   | 26702/37963 [66:07:48<33:46:47, 10.80s/it]
 70%|███████   | 26703/37963 [66:08:02<37:03:52, 11.85s/it]
 70%|███████   | 26704/37963 [66:08:10<33:27:03, 10.70s/it]
 70%|███████   | 26705/37963 [66:08:18<30:49:21,  9.86s/it]
 70%|███████   | 26706/37963 [66:08:32<34:26:29, 11.01s/it]
 70%|███████   | 26707/37963 [66:08:40<31:33:41, 10.09s/it]
 70%|███████   | 26708/37963 [66:08:47<29:04:56,  9.30s/it]
 70%|███████   | 26709/37963 [66:08:55<27:21:39,  8.75s/it]
 70%|███████   | 26710/37963 [66:09:09<32:40:47, 10.45s/it]
                                                           
{'loss': '0.1099', 'grad_norm': '1.65', 'learning_rate': '4.266e-06', 'epoch': '0.7036'}
+
 70%|███████   | 26710/37963 [66:09:09<32:40:47, 10.45s/it]
 70%|███████   | 26711/37963 [66:09:17<30:11:12,  9.66s/it]
 70%|███████   | 26712/37963 [66:09:25<28:18:22,  9.06s/it]
 70%|███████   | 26713/37963 [66:09:32<27:03:33,  8.66s/it]
 70%|███████   | 26714/37963 [66:09:40<25:58:16,  8.31s/it]
 70%|███████   | 26715/37963 [66:09:48<25:13:23,  8.07s/it]
 70%|███████   | 26716/37963 [66:09:55<24:53:03,  7.97s/it]
 70%|███████   | 26717/37963 [66:10:03<24:41:00,  7.90s/it]
 70%|███████   | 26718/37963 [66:10:11<24:27:37,  7.83s/it]
 70%|███████   | 26719/37963 [66:10:25<30:59:12,  9.92s/it]
 70%|███████   | 26720/37963 [66:10:40<34:52:44, 11.17s/it]
                                                           
{'loss': '0.1209', 'grad_norm': '1.45', 'learning_rate': '4.259e-06', 'epoch': '0.7038'}
+
 70%|███████   | 26720/37963 [66:10:40<34:52:44, 11.17s/it]
 70%|███████   | 26721/37963 [66:10:47<31:39:43, 10.14s/it]
 70%|███████   | 26722/37963 [66:10:55<29:26:10,  9.43s/it]
 70%|███████   | 26723/37963 [66:11:03<27:49:51,  8.91s/it]
 70%|███████   | 26724/37963 [66:11:10<26:36:49,  8.52s/it]
 70%|███████   | 26725/37963 [66:11:18<25:56:50,  8.31s/it]
 70%|███████   | 26726/37963 [66:11:26<25:22:03,  8.13s/it]
 70%|███████   | 26727/37963 [66:11:34<24:55:44,  7.99s/it]
 70%|███████   | 26728/37963 [66:11:41<24:21:59,  7.81s/it]
 70%|███████   | 26729/37963 [66:11:49<24:18:50,  7.79s/it]
 70%|███████   | 26730/37963 [66:11:56<24:13:37,  7.76s/it]
                                                           
{'loss': '0.1195', 'grad_norm': '3.866', 'learning_rate': '4.252e-06', 'epoch': '0.7041'}
+
 70%|███████   | 26730/37963 [66:11:56<24:13:37,  7.76s/it]
 70%|███████   | 26731/37963 [66:12:04<24:14:50,  7.77s/it]
 70%|███████   | 26732/37963 [66:12:12<24:14:29,  7.77s/it]
 70%|███████   | 26733/37963 [66:12:27<31:20:43, 10.05s/it]
 70%|███████   | 26734/37963 [66:12:35<29:09:15,  9.35s/it]
 70%|███████   | 26735/37963 [66:12:43<27:36:28,  8.85s/it]
 70%|███████   | 26736/37963 [66:12:50<26:33:28,  8.52s/it]
 70%|███████   | 26737/37963 [66:12:58<25:48:21,  8.28s/it]
 70%|███████   | 26738/37963 [66:13:06<25:09:07,  8.07s/it]
 70%|███████   | 26739/37963 [66:13:14<24:55:02,  7.99s/it]
 70%|███████   | 26740/37963 [66:13:21<24:41:54,  7.92s/it]
                                                           
{'loss': '0.1257', 'grad_norm': '1.863', 'learning_rate': '4.245e-06', 'epoch': '0.7044'}
+
 70%|███████   | 26740/37963 [66:13:21<24:41:54,  7.92s/it]
 70%|███████   | 26741/37963 [66:13:29<24:27:57,  7.85s/it]
 70%|███████   | 26742/37963 [66:13:37<24:20:48,  7.81s/it]
 70%|███████   | 26743/37963 [66:13:44<24:10:05,  7.75s/it]
 70%|███████   | 26744/37963 [66:13:59<30:28:02,  9.78s/it]
 70%|███████   | 26745/37963 [66:14:06<28:27:30,  9.13s/it]
 70%|███████   | 26746/37963 [66:14:22<34:05:32, 10.94s/it]
 70%|███████   | 26747/37963 [66:14:29<31:10:28, 10.01s/it]
 70%|███████   | 26748/37963 [66:14:37<28:58:47,  9.30s/it]
 70%|███████   | 26749/37963 [66:14:45<27:32:39,  8.84s/it]
 70%|███████   | 26750/37963 [66:15:00<33:04:39, 10.62s/it]
                                                           
{'loss': '0.1266', 'grad_norm': '2.269', 'learning_rate': '4.238e-06', 'epoch': '0.7046'}
+
 70%|███████   | 26750/37963 [66:15:00<33:04:39, 10.62s/it]
 70%|███████   | 26751/37963 [66:15:14<36:43:13, 11.79s/it]
 70%|███████   | 26752/37963 [66:15:22<32:57:23, 10.58s/it]
 70%|███████   | 26753/37963 [66:15:30<30:23:29,  9.76s/it]
 70%|███████   | 26754/37963 [66:15:38<28:30:28,  9.16s/it]
 70%|███████   | 26755/37963 [66:15:45<27:02:35,  8.69s/it]
 70%|███████   | 26756/37963 [66:15:53<25:56:06,  8.33s/it]
 70%|███████   | 26757/37963 [66:16:00<25:19:57,  8.14s/it]
 70%|███████   | 26758/37963 [66:16:08<24:42:22,  7.94s/it]
 70%|███████   | 26759/37963 [66:16:15<24:22:21,  7.83s/it]
 70%|███████   | 26760/37963 [66:16:23<23:58:47,  7.71s/it]
                                                           
{'loss': '0.1234', 'grad_norm': '1.973', 'learning_rate': '4.231e-06', 'epoch': '0.7049'}
+
 70%|███████   | 26760/37963 [66:16:23<23:58:47,  7.71s/it]
 70%|███████   | 26761/37963 [66:16:30<24:00:34,  7.72s/it]
 70%|███████   | 26762/37963 [66:16:45<30:15:44,  9.73s/it]
 70%|███████   | 26763/37963 [66:16:53<28:26:47,  9.14s/it]
 71%|███████   | 26764/37963 [66:17:00<26:59:30,  8.68s/it]
 71%|███████   | 26765/37963 [66:17:08<25:56:01,  8.34s/it]
 71%|███████   | 26766/37963 [66:17:15<25:17:05,  8.13s/it]
 71%|███████   | 26767/37963 [66:17:30<31:39:50, 10.18s/it]
 71%|███████   | 26768/37963 [66:17:38<29:25:28,  9.46s/it]
 71%|███████   | 26769/37963 [66:17:46<27:43:21,  8.92s/it]
 71%|███████   | 26770/37963 [66:18:00<32:46:02, 10.54s/it]
                                                           
{'loss': '0.1087', 'grad_norm': '1.824', 'learning_rate': '4.224e-06', 'epoch': '0.7052'}
+
 71%|███████   | 26770/37963 [66:18:00<32:46:02, 10.54s/it]
 71%|███████   | 26771/37963 [66:18:08<30:10:30,  9.71s/it]
 71%|███████   | 26772/37963 [66:18:16<28:14:33,  9.09s/it]
 71%|███████   | 26773/37963 [66:18:23<26:41:55,  8.59s/it]
 71%|███████   | 26774/37963 [66:18:30<25:33:23,  8.22s/it]
 71%|███████   | 26775/37963 [66:18:38<24:52:03,  8.00s/it]
 71%|███████   | 26776/37963 [66:18:46<24:37:05,  7.92s/it]
 71%|███████   | 26777/37963 [66:18:53<24:25:03,  7.86s/it]
 71%|███████   | 26778/37963 [66:19:01<24:09:35,  7.78s/it]
 71%|███████   | 26779/37963 [66:19:09<24:12:49,  7.79s/it]
 71%|███████   | 26780/37963 [66:19:17<24:14:16,  7.80s/it]
                                                           
{'loss': '0.1301', 'grad_norm': '2.028', 'learning_rate': '4.217e-06', 'epoch': '0.7054'}
+
 71%|███████   | 26780/37963 [66:19:17<24:14:16,  7.80s/it]
 71%|███████   | 26781/37963 [66:19:24<24:01:26,  7.73s/it]
 71%|███████   | 26782/37963 [66:19:32<23:52:22,  7.69s/it]
 71%|███████   | 26783/37963 [66:19:39<23:49:40,  7.67s/it]
 71%|███████   | 26784/37963 [66:19:47<23:55:55,  7.71s/it]
 71%|███████   | 26785/37963 [66:19:55<23:50:23,  7.68s/it]
 71%|███████   | 26786/37963 [66:20:09<30:01:16,  9.67s/it]
 71%|███████   | 26787/37963 [66:20:17<28:13:55,  9.09s/it]
 71%|███████   | 26788/37963 [66:20:25<26:58:19,  8.69s/it]
 71%|███████   | 26789/37963 [66:20:32<25:55:15,  8.35s/it]
 71%|███████   | 26790/37963 [66:20:40<25:08:42,  8.10s/it]
                                                           
{'loss': '0.1234', 'grad_norm': '1.953', 'learning_rate': '4.21e-06', 'epoch': '0.7057'}
+
 71%|███████   | 26790/37963 [66:20:40<25:08:42,  8.10s/it]
 71%|███████   | 26791/37963 [66:20:47<24:51:16,  8.01s/it]
 71%|███████   | 26792/37963 [66:21:09<37:19:59, 12.03s/it]
 71%|███████   | 26793/37963 [66:21:17<33:20:47, 10.75s/it]
 71%|███████   | 26794/37963 [66:21:24<30:28:56,  9.83s/it]
 71%|███████   | 26795/37963 [66:21:39<34:50:10, 11.23s/it]
 71%|███████   | 26796/37963 [66:21:47<31:33:50, 10.18s/it]
 71%|███████   | 26797/37963 [66:21:54<29:10:26,  9.41s/it]
 71%|███████   | 26798/37963 [66:22:02<27:27:27,  8.85s/it]
 71%|███████   | 26799/37963 [66:22:09<26:27:53,  8.53s/it]
 71%|███████   | 26800/37963 [66:22:17<25:36:14,  8.26s/it]
                                                           
{'loss': '0.1197', 'grad_norm': '2.452', 'learning_rate': '4.203e-06', 'epoch': '0.706'}
+
 71%|███████   | 26800/37963 [66:22:17<25:36:14,  8.26s/it]
 71%|███████   | 26801/37963 [66:22:25<25:10:03,  8.12s/it]
 71%|███████   | 26802/37963 [66:22:33<24:50:46,  8.01s/it]
 71%|███████   | 26803/37963 [66:22:40<24:37:37,  7.94s/it]
 71%|███████   | 26804/37963 [66:22:55<30:23:01,  9.80s/it]
 71%|███████   | 26805/37963 [66:23:02<28:35:44,  9.23s/it]
 71%|███████   | 26806/37963 [66:23:10<27:09:40,  8.76s/it]
 71%|███████   | 26807/37963 [66:23:18<26:10:40,  8.45s/it]
 71%|███████   | 26808/37963 [66:23:26<25:31:57,  8.24s/it]
 71%|███████   | 26809/37963 [66:23:33<25:04:39,  8.09s/it]
 71%|███████   | 26810/37963 [66:23:41<24:46:55,  8.00s/it]
                                                           
{'loss': '0.1258', 'grad_norm': '1.847', 'learning_rate': '4.196e-06', 'epoch': '0.7062'}
+
 71%|███████   | 26810/37963 [66:23:41<24:46:55,  8.00s/it]
 71%|███████   | 26811/37963 [66:23:56<30:52:36,  9.97s/it]
 71%|███████   | 26812/37963 [66:24:03<28:50:52,  9.31s/it]
 71%|███████   | 26813/37963 [66:24:11<27:21:54,  8.84s/it]
 71%|███████   | 26814/37963 [66:24:19<26:20:34,  8.51s/it]
 71%|███████   | 26815/37963 [66:24:27<25:36:39,  8.27s/it]
 71%|███████   | 26816/37963 [66:24:34<25:00:48,  8.08s/it]
 71%|███████   | 26817/37963 [66:24:42<24:40:25,  7.97s/it]
 71%|███████   | 26818/37963 [66:24:50<24:21:31,  7.87s/it]
 71%|███████   | 26819/37963 [66:25:04<30:31:55,  9.86s/it]
 71%|███████   | 26820/37963 [66:25:18<34:37:48, 11.19s/it]
                                                           
{'loss': '0.1276', 'grad_norm': '1.861', 'learning_rate': '4.189e-06', 'epoch': '0.7065'}
+
 71%|███████   | 26820/37963 [66:25:18<34:37:48, 11.19s/it]
 71%|███████   | 26821/37963 [66:25:26<31:22:41, 10.14s/it]
 71%|███████   | 26822/37963 [66:25:34<28:59:15,  9.37s/it]
 71%|███████   | 26823/37963 [66:25:41<27:22:16,  8.85s/it]
 71%|███████   | 26824/37963 [66:25:49<26:20:52,  8.52s/it]
 71%|███████   | 26825/37963 [66:25:57<25:24:53,  8.21s/it]
 71%|███████   | 26826/37963 [66:26:04<24:52:21,  8.04s/it]
 71%|███████   | 26827/37963 [66:26:12<24:20:33,  7.87s/it]
 71%|███████   | 26828/37963 [66:26:19<24:14:50,  7.84s/it]
 71%|███████   | 26829/37963 [66:26:27<24:01:12,  7.77s/it]
 71%|███████   | 26830/37963 [66:26:35<24:03:00,  7.78s/it]
                                                           
{'loss': '0.1211', 'grad_norm': '2.014', 'learning_rate': '4.182e-06', 'epoch': '0.7067'}
+
 71%|███████   | 26830/37963 [66:26:35<24:03:00,  7.78s/it]
 71%|███████   | 26831/37963 [66:26:42<23:49:51,  7.71s/it]
 71%|███████   | 26832/37963 [66:26:50<23:56:22,  7.74s/it]
 71%|███████   | 26833/37963 [66:26:58<23:47:50,  7.70s/it]
 71%|███████   | 26834/37963 [66:27:05<23:45:03,  7.68s/it]
 71%|███████   | 26835/37963 [66:27:13<23:32:03,  7.61s/it]
 71%|███████   | 26836/37963 [66:27:21<23:39:39,  7.66s/it]
 71%|███████   | 26837/37963 [66:27:28<23:47:49,  7.70s/it]
 71%|███████   | 26838/37963 [66:27:43<30:19:29,  9.81s/it]
 71%|███████   | 26839/37963 [66:27:51<28:23:34,  9.19s/it]
 71%|███████   | 26840/37963 [66:28:13<39:53:42, 12.91s/it]
                                                           
{'loss': '0.1218', 'grad_norm': '2.537', 'learning_rate': '4.175e-06', 'epoch': '0.707'}
+
 71%|███████   | 26840/37963 [66:28:13<39:53:42, 12.91s/it]
 71%|███████   | 26841/37963 [66:28:20<35:13:22, 11.40s/it]
 71%|███████   | 26842/37963 [66:28:28<31:46:09, 10.28s/it]
 71%|███████   | 26843/37963 [66:28:43<35:36:53, 11.53s/it]
 71%|███████   | 26844/37963 [66:28:50<32:10:40, 10.42s/it]
 71%|███████   | 26845/37963 [66:28:58<29:48:06,  9.65s/it]
 71%|███████   | 26846/37963 [66:29:06<27:58:10,  9.06s/it]
 71%|███████   | 26847/37963 [66:29:13<26:36:03,  8.61s/it]
 71%|███████   | 26848/37963 [66:29:21<25:38:14,  8.30s/it]
 71%|███████   | 26849/37963 [66:29:29<25:05:11,  8.13s/it]
 71%|███████   | 26850/37963 [66:29:36<24:33:34,  7.96s/it]
                                                           
{'loss': '0.1021', 'grad_norm': '2.354', 'learning_rate': '4.168e-06', 'epoch': '0.7073'}
+
 71%|███████   | 26850/37963 [66:29:36<24:33:34,  7.96s/it]
 71%|███████   | 26851/37963 [66:29:44<24:20:28,  7.89s/it]
 71%|███████   | 26852/37963 [66:29:52<24:10:05,  7.83s/it]
 71%|███████   | 26853/37963 [66:29:59<23:59:03,  7.77s/it]
 71%|███████   | 26854/37963 [66:30:07<23:49:46,  7.72s/it]
 71%|███████   | 26855/37963 [66:30:21<30:00:01,  9.72s/it]
 71%|███████   | 26856/37963 [66:30:36<34:14:26, 11.10s/it]
 71%|███████   | 26857/37963 [66:30:43<31:09:50, 10.10s/it]
 71%|███████   | 26858/37963 [66:30:51<28:58:59,  9.40s/it]
 71%|███████   | 26859/37963 [66:30:59<27:18:26,  8.85s/it]
 71%|███████   | 26860/37963 [66:31:06<26:03:24,  8.45s/it]
                                                           
{'loss': '0.1201', 'grad_norm': '2.496', 'learning_rate': '4.161e-06', 'epoch': '0.7075'}
+
 71%|███████   | 26860/37963 [66:31:06<26:03:24,  8.45s/it]
 71%|███████   | 26861/37963 [66:31:14<25:17:49,  8.20s/it]
 71%|███████   | 26862/37963 [66:31:22<24:58:59,  8.10s/it]
 71%|███████   | 26863/37963 [66:31:36<30:40:47,  9.95s/it]
 71%|███████   | 26864/37963 [66:31:44<28:35:21,  9.27s/it]
 71%|███████   | 26865/37963 [66:31:51<27:06:51,  8.80s/it]
 71%|███████   | 26866/37963 [66:31:59<26:06:20,  8.47s/it]
 71%|███████   | 26867/37963 [66:32:07<25:07:36,  8.15s/it]
 71%|███████   | 26868/37963 [66:32:14<24:44:21,  8.03s/it]
 71%|███████   | 26869/37963 [66:32:22<24:28:07,  7.94s/it]
 71%|███████   | 26870/37963 [66:32:30<24:12:05,  7.85s/it]
                                                           
{'loss': '0.126', 'grad_norm': '3.363', 'learning_rate': '4.154e-06', 'epoch': '0.7078'}
+
 71%|███████   | 26870/37963 [66:32:30<24:12:05,  7.85s/it]
 71%|███████   | 26871/37963 [66:32:37<23:57:33,  7.78s/it]
 71%|███████   | 26872/37963 [66:32:45<24:11:24,  7.85s/it]
 71%|███████   | 26873/37963 [66:32:53<23:50:51,  7.74s/it]
 71%|███████   | 26874/37963 [66:33:00<23:46:16,  7.72s/it]
 71%|███████   | 26875/37963 [66:33:15<30:03:57,  9.76s/it]
 71%|███████   | 26876/37963 [66:33:23<28:15:59,  9.18s/it]
 71%|███████   | 26877/37963 [66:33:30<26:49:45,  8.71s/it]
 71%|███████   | 26878/37963 [66:33:38<25:53:28,  8.41s/it]
 71%|███████   | 26879/37963 [66:33:46<25:11:17,  8.18s/it]
 71%|███████   | 26880/37963 [66:33:53<24:23:52,  7.92s/it]
                                                           
{'loss': '0.1188', 'grad_norm': '2.895', 'learning_rate': '4.148e-06', 'epoch': '0.7081'}
+
 71%|███████   | 26880/37963 [66:33:53<24:23:52,  7.92s/it]
 71%|███████   | 26881/37963 [66:34:01<24:08:05,  7.84s/it]
 71%|███████   | 26882/37963 [66:34:08<24:03:29,  7.82s/it]
 71%|███████   | 26883/37963 [66:34:16<23:41:45,  7.70s/it]
 71%|███████   | 26884/37963 [66:34:24<23:38:18,  7.68s/it]
 71%|███████   | 26885/37963 [66:34:38<29:48:51,  9.69s/it]
 71%|███████   | 26886/37963 [66:34:53<34:53:54, 11.34s/it]
 71%|███████   | 26887/37963 [66:35:08<38:05:48, 12.38s/it]
 71%|███████   | 26888/37963 [66:35:16<33:42:06, 10.95s/it]
 71%|███████   | 26889/37963 [66:35:23<30:39:10,  9.96s/it]
 71%|███████   | 26890/37963 [66:35:31<28:19:06,  9.21s/it]
                                                           
{'loss': '0.1063', 'grad_norm': '1.65', 'learning_rate': '4.141e-06', 'epoch': '0.7083'}
+
 71%|███████   | 26890/37963 [66:35:31<28:19:06,  9.21s/it]
 71%|███████   | 26891/37963 [66:35:38<26:57:11,  8.76s/it]
 71%|███████   | 26892/37963 [66:35:46<26:03:59,  8.48s/it]
 71%|███████   | 26893/37963 [66:35:54<25:20:59,  8.24s/it]
 71%|███████   | 26894/37963 [66:36:02<24:52:13,  8.09s/it]
 71%|███████   | 26895/37963 [66:36:16<30:22:55,  9.88s/it]
 71%|███████   | 26896/37963 [66:36:23<28:16:12,  9.20s/it]
 71%|███████   | 26897/37963 [66:36:31<26:56:45,  8.77s/it]
 71%|███████   | 26898/37963 [66:36:39<25:54:39,  8.43s/it]
 71%|███████   | 26899/37963 [66:36:46<25:06:42,  8.17s/it]
 71%|███████   | 26900/37963 [66:37:00<30:29:38,  9.92s/it]
                                                           
{'loss': '0.1139', 'grad_norm': '2.621', 'learning_rate': '4.134e-06', 'epoch': '0.7086'}
+
 71%|███████   | 26900/37963 [66:37:00<30:29:38,  9.92s/it]
 71%|███████   | 26901/37963 [66:37:08<28:11:28,  9.17s/it]
 71%|███████   | 26902/37963 [66:37:15<26:51:18,  8.74s/it]
 71%|███████   | 26903/37963 [66:37:23<25:54:47,  8.43s/it]
 71%|███████   | 26904/37963 [66:37:37<30:56:26, 10.07s/it]
 71%|███████   | 26905/37963 [66:37:45<28:40:30,  9.34s/it]
 71%|███████   | 26906/37963 [66:37:52<27:13:32,  8.86s/it]
 71%|███████   | 26907/37963 [66:38:00<26:10:41,  8.52s/it]
 71%|███████   | 26908/37963 [66:38:07<24:58:35,  8.13s/it]
 71%|███████   | 26909/37963 [66:38:15<24:34:43,  8.00s/it]
 71%|███████   | 26910/37963 [66:38:23<24:20:01,  7.93s/it]
                                                           
{'loss': '0.109', 'grad_norm': '1.643', 'learning_rate': '4.127e-06', 'epoch': '0.7089'}
+
 71%|███████   | 26910/37963 [66:38:23<24:20:01,  7.93s/it]
 71%|███████   | 26911/37963 [66:38:37<30:05:31,  9.80s/it]
 71%|███████   | 26912/37963 [66:38:45<28:10:41,  9.18s/it]
 71%|███████   | 26913/37963 [66:38:52<26:32:49,  8.65s/it]
 71%|███████   | 26914/37963 [66:39:00<25:34:57,  8.34s/it]
 71%|███████   | 26915/37963 [66:39:07<24:48:36,  8.08s/it]
 71%|███████   | 26916/37963 [66:39:15<24:21:21,  7.94s/it]
 71%|███████   | 26917/37963 [66:39:23<24:08:27,  7.87s/it]
 71%|███████   | 26918/37963 [66:39:30<23:52:25,  7.78s/it]
 71%|███████   | 26919/37963 [66:39:44<29:44:20,  9.69s/it]
 71%|███████   | 26920/37963 [66:39:52<27:58:51,  9.12s/it]
                                                           
{'loss': '0.1192', 'grad_norm': '2.764', 'learning_rate': '4.12e-06', 'epoch': '0.7091'}
+
 71%|███████   | 26920/37963 [66:39:52<27:58:51,  9.12s/it]
 71%|███████   | 26921/37963 [66:40:00<26:41:44,  8.70s/it]
 71%|███████   | 26922/37963 [66:40:07<25:29:00,  8.31s/it]
 71%|███████   | 26923/37963 [66:40:15<24:41:51,  8.05s/it]
 71%|███████   | 26924/37963 [66:40:22<24:27:30,  7.98s/it]
 71%|███████   | 26925/37963 [66:40:30<24:14:05,  7.90s/it]
 71%|███████   | 26926/37963 [66:40:38<23:52:57,  7.79s/it]
 71%|███████   | 26927/37963 [66:40:45<23:48:09,  7.76s/it]
 71%|███████   | 26928/37963 [66:41:00<29:46:51,  9.72s/it]
 71%|███████   | 26929/37963 [66:41:14<34:24:45, 11.23s/it]
 71%|███████   | 26930/37963 [66:41:22<31:07:40, 10.16s/it]
                                                           
{'loss': '0.1157', 'grad_norm': '2.37', 'learning_rate': '4.113e-06', 'epoch': '0.7094'}
+
 71%|███████   | 26930/37963 [66:41:22<31:07:40, 10.16s/it]
 71%|███████   | 26931/37963 [66:41:30<28:50:52,  9.41s/it]
 71%|███████   | 26932/37963 [66:41:37<27:09:05,  8.86s/it]
 71%|███████   | 26933/37963 [66:41:45<26:19:53,  8.59s/it]
 71%|███████   | 26934/37963 [66:41:53<25:28:56,  8.32s/it]
 71%|███████   | 26935/37963 [66:42:01<24:54:16,  8.13s/it]
 71%|███████   | 26936/37963 [66:42:08<24:24:17,  7.97s/it]
 71%|███████   | 26937/37963 [66:42:16<24:09:40,  7.89s/it]
 71%|███████   | 26938/37963 [66:42:23<23:42:26,  7.74s/it]
 71%|███████   | 26939/37963 [66:42:38<30:28:25,  9.95s/it]
 71%|███████   | 26940/37963 [66:42:46<28:28:30,  9.30s/it]
                                                           
{'loss': '0.1233', 'grad_norm': '2.035', 'learning_rate': '4.106e-06', 'epoch': '0.7096'}
+
 71%|███████   | 26940/37963 [66:42:46<28:28:30,  9.30s/it]
 71%|███████   | 26941/37963 [66:42:54<27:09:09,  8.87s/it]
 71%|███████   | 26942/37963 [66:43:01<25:46:46,  8.42s/it]
 71%|███████   | 26943/37963 [66:43:16<31:06:01, 10.16s/it]
 71%|███████   | 26944/37963 [66:43:24<29:03:16,  9.49s/it]
 71%|███████   | 26945/37963 [66:43:31<27:23:43,  8.95s/it]
 71%|███████   | 26946/37963 [66:43:39<26:17:09,  8.59s/it]
 71%|███████   | 26947/37963 [66:43:47<25:25:05,  8.31s/it]
 71%|███████   | 26948/37963 [66:43:54<24:35:52,  8.04s/it]
 71%|███████   | 26949/37963 [66:44:02<24:22:10,  7.97s/it]
 71%|███████   | 26950/37963 [66:44:17<30:34:31,  9.99s/it]
                                                           
{'loss': '0.1135', 'grad_norm': '1.405', 'learning_rate': '4.099e-06', 'epoch': '0.7099'}
+
 71%|███████   | 26950/37963 [66:44:17<30:34:31,  9.99s/it]
 71%|███████   | 26951/37963 [66:44:31<34:43:11, 11.35s/it]
 71%|███████   | 26952/37963 [66:44:39<31:09:41, 10.19s/it]
 71%|███████   | 26953/37963 [66:44:46<28:52:57,  9.44s/it]
 71%|███████   | 26954/37963 [66:45:00<33:03:42, 10.81s/it]
 71%|███████   | 26955/37963 [66:45:08<29:52:24,  9.77s/it]
 71%|███████   | 26956/37963 [66:45:15<27:55:23,  9.13s/it]
 71%|███████   | 26957/37963 [66:45:23<26:35:31,  8.70s/it]
 71%|███████   | 26958/37963 [66:45:31<25:34:42,  8.37s/it]
 71%|███████   | 26959/37963 [66:45:38<24:54:40,  8.15s/it]
 71%|███████   | 26960/37963 [66:45:46<24:35:28,  8.05s/it]
                                                           
{'loss': '0.1131', 'grad_norm': '2.306', 'learning_rate': '4.092e-06', 'epoch': '0.7102'}
+
 71%|███████   | 26960/37963 [66:45:46<24:35:28,  8.05s/it]
 71%|███████   | 26961/37963 [66:45:54<24:20:30,  7.96s/it]
 71%|███████   | 26962/37963 [66:46:02<24:08:25,  7.90s/it]
 71%|███████   | 26963/37963 [66:46:09<23:56:18,  7.83s/it]
 71%|███████   | 26964/37963 [66:46:17<23:45:21,  7.78s/it]
 71%|███████   | 26965/37963 [66:46:25<23:43:31,  7.77s/it]
 71%|███████   | 26966/37963 [66:46:32<23:40:27,  7.75s/it]
 71%|███████   | 26967/37963 [66:46:47<30:11:58,  9.89s/it]
 71%|███████   | 26968/37963 [66:46:55<28:11:19,  9.23s/it]
 71%|███████   | 26969/37963 [66:47:03<26:52:52,  8.80s/it]
 71%|███████   | 26970/37963 [66:47:11<25:58:20,  8.51s/it]
                                                           
{'loss': '0.126', 'grad_norm': '2.768', 'learning_rate': '4.085e-06', 'epoch': '0.7104'}
+
 71%|███████   | 26970/37963 [66:47:11<25:58:20,  8.51s/it]
 71%|███████   | 26971/37963 [66:47:18<25:24:20,  8.32s/it]
 71%|███████   | 26972/37963 [66:47:26<24:32:25,  8.04s/it]
 71%|███████   | 26973/37963 [66:47:33<24:10:48,  7.92s/it]
 71%|███████   | 26974/37963 [66:47:41<24:01:39,  7.87s/it]
 71%|███████   | 26975/37963 [66:47:49<24:02:37,  7.88s/it]
 71%|███████   | 26976/37963 [66:48:10<36:24:49, 11.93s/it]
 71%|███████   | 26977/37963 [66:48:18<32:21:18, 10.60s/it]
 71%|███████   | 26978/37963 [66:48:26<29:34:51,  9.69s/it]
 71%|███████   | 26979/37963 [66:48:33<27:44:17,  9.09s/it]
 71%|███████   | 26980/37963 [66:48:41<26:27:23,  8.67s/it]
                                                           
{'loss': '0.119', 'grad_norm': '1.847', 'learning_rate': '4.079e-06', 'epoch': '0.7107'}
+
 71%|███████   | 26980/37963 [66:48:41<26:27:23,  8.67s/it]
 71%|███████   | 26981/37963 [66:48:49<25:40:57,  8.42s/it]
 71%|███████   | 26982/37963 [66:48:56<25:00:29,  8.20s/it]
 71%|███████   | 26983/37963 [66:49:04<24:10:39,  7.93s/it]
 71%|███████   | 26984/37963 [66:49:11<23:57:42,  7.86s/it]
 71%|███████   | 26985/37963 [66:49:19<23:52:36,  7.83s/it]
 71%|███████   | 26986/37963 [66:49:27<23:38:25,  7.75s/it]
 71%|███████   | 26987/37963 [66:49:41<29:44:16,  9.75s/it]
 71%|███████   | 26988/37963 [66:49:56<34:19:01, 11.26s/it]
 71%|███████   | 26989/37963 [66:50:04<31:23:10, 10.30s/it]
 71%|███████   | 26990/37963 [66:50:12<29:14:41,  9.59s/it]
                                                           
{'loss': '0.1209', 'grad_norm': '3.838', 'learning_rate': '4.072e-06', 'epoch': '0.711'}
+
 71%|███████   | 26990/37963 [66:50:12<29:14:41,  9.59s/it]
 71%|███████   | 26991/37963 [66:50:20<27:37:04,  9.06s/it]
 71%|███████   | 26992/37963 [66:50:27<26:20:49,  8.65s/it]
 71%|███████   | 26993/37963 [66:50:35<25:26:42,  8.35s/it]
 71%|███████   | 26994/37963 [66:50:43<24:46:33,  8.13s/it]
 71%|███████   | 26995/37963 [66:50:51<24:30:01,  8.04s/it]
 71%|███████   | 26996/37963 [66:50:58<24:06:17,  7.91s/it]
 71%|███████   | 26997/37963 [66:51:06<23:52:07,  7.84s/it]
 71%|███████   | 26998/37963 [66:51:27<35:36:13, 11.69s/it]
 71%|███████   | 26999/37963 [66:51:41<38:03:53, 12.50s/it]
 71%|███████   | 27000/37963 [66:51:49<33:38:58, 11.05s/it]
                                                           
{'loss': '0.1209', 'grad_norm': '3.643', 'learning_rate': '4.065e-06', 'epoch': '0.7112'}
+
 71%|███████   | 27000/37963 [66:51:49<33:38:58, 11.05s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.12s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.13s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 71%|███████   | 27001/37963 [66:52:47<77:17:20, 25.38s/it]
 71%|███████   | 27002/37963 [66:52:55<61:14:36, 20.11s/it]
 71%|███████   | 27003/37963 [66:53:03<49:53:23, 16.39s/it]
 71%|███████   | 27004/37963 [66:53:11<41:55:37, 13.77s/it]
 71%|███████   | 27005/37963 [66:53:18<36:20:14, 11.94s/it]
 71%|███████   | 27006/37963 [66:53:26<32:04:27, 10.54s/it]
 71%|███████   | 27007/37963 [66:53:33<29:32:57,  9.71s/it]
 71%|███████   | 27008/37963 [66:53:41<27:39:53,  9.09s/it]
 71%|███████   | 27009/37963 [66:53:49<26:23:43,  8.67s/it]
 71%|███████   | 27010/37963 [66:53:56<25:23:04,  8.34s/it]
                                                           
{'loss': '0.1188', 'grad_norm': '2.285', 'learning_rate': '4.058e-06', 'epoch': '0.7115'}
+
 71%|███████   | 27010/37963 [66:53:56<25:23:04,  8.34s/it]
 71%|███████   | 27011/37963 [66:54:04<24:50:31,  8.17s/it]
 71%|███████   | 27012/37963 [66:54:12<24:16:47,  7.98s/it]
 71%|███████   | 27013/37963 [66:54:19<23:57:27,  7.88s/it]
 71%|███████   | 27014/37963 [66:54:34<30:22:26,  9.99s/it]
 71%|███████   | 27015/37963 [66:54:42<28:15:34,  9.29s/it]
 71%|███████   | 27016/37963 [66:54:50<26:51:04,  8.83s/it]
 71%|███████   | 27017/37963 [66:54:57<25:49:02,  8.49s/it]
 71%|███████   | 27018/37963 [66:55:05<25:00:24,  8.23s/it]
 71%|███████   | 27019/37963 [66:55:12<24:29:52,  8.06s/it]
 71%|███████   | 27020/37963 [66:55:20<24:15:14,  7.98s/it]
                                                           
{'loss': '0.1133', 'grad_norm': '1.64', 'learning_rate': '4.051e-06', 'epoch': '0.7117'}
+
 71%|███████   | 27020/37963 [66:55:20<24:15:14,  7.98s/it]
 71%|███████   | 27021/37963 [66:55:28<24:03:10,  7.91s/it]
 71%|███████   | 27022/37963 [66:55:36<23:51:53,  7.85s/it]
 71%|███████   | 27023/37963 [66:55:44<23:46:52,  7.83s/it]
 71%|███████   | 27024/37963 [66:55:51<23:50:37,  7.85s/it]
 71%|███████   | 27025/37963 [66:55:59<23:34:44,  7.76s/it]
 71%|███████   | 27026/37963 [66:56:07<23:32:59,  7.75s/it]
 71%|███████   | 27027/37963 [66:56:21<29:42:09,  9.78s/it]
 71%|███████   | 27028/37963 [66:56:29<27:34:20,  9.08s/it]
 71%|███████   | 27029/37963 [66:56:43<32:44:31, 10.78s/it]
 71%|███████   | 27030/37963 [66:56:51<30:06:47,  9.92s/it]
                                                           
{'loss': '0.1074', 'grad_norm': '1.553', 'learning_rate': '4.044e-06', 'epoch': '0.712'}
+
 71%|███████   | 27030/37963 [66:56:51<30:06:47,  9.92s/it]
 71%|███████   | 27031/37963 [66:56:59<28:01:45,  9.23s/it]
 71%|███████   | 27032/37963 [66:57:06<26:27:27,  8.71s/it]
 71%|███████   | 27033/37963 [66:57:14<25:32:36,  8.41s/it]
 71%|███████   | 27034/37963 [66:57:28<30:47:10, 10.14s/it]
 71%|███████   | 27035/37963 [66:57:36<28:42:55,  9.46s/it]
 71%|███████   | 27036/37963 [66:57:44<27:04:59,  8.92s/it]
 71%|███████   | 27037/37963 [66:57:51<25:53:06,  8.53s/it]
 71%|███████   | 27038/37963 [66:58:06<31:39:43, 10.43s/it]
 71%|███████   | 27039/37963 [66:58:14<29:19:28,  9.66s/it]
 71%|███████   | 27040/37963 [66:58:22<27:37:38,  9.11s/it]
                                                           
{'loss': '0.119', 'grad_norm': '2.247', 'learning_rate': '4.037e-06', 'epoch': '0.7123'}
+
 71%|███████   | 27040/37963 [66:58:22<27:37:38,  9.11s/it]
 71%|███████   | 27041/37963 [66:58:30<26:21:58,  8.69s/it]
 71%|███████   | 27042/37963 [66:58:38<25:33:11,  8.42s/it]
 71%|███████   | 27043/37963 [66:58:45<24:54:42,  8.21s/it]
 71%|███████   | 27044/37963 [66:59:00<30:43:59, 10.13s/it]
 71%|███████   | 27045/37963 [66:59:14<34:28:52, 11.37s/it]
 71%|███████   | 27046/37963 [66:59:28<37:02:48, 12.22s/it]
 71%|███████   | 27047/37963 [66:59:36<32:58:36, 10.88s/it]
 71%|███████   | 27048/37963 [66:59:44<29:59:07,  9.89s/it]
 71%|███████▏  | 27049/37963 [66:59:51<27:59:01,  9.23s/it]
 71%|███████▏  | 27050/37963 [66:59:59<26:11:16,  8.64s/it]
                                                           
{'loss': '0.1369', 'grad_norm': '2.5', 'learning_rate': '4.031e-06', 'epoch': '0.7125'}
+
 71%|███████▏  | 27050/37963 [66:59:59<26:11:16,  8.64s/it]
 71%|███████▏  | 27051/37963 [67:00:06<25:21:17,  8.36s/it]
 71%|███████▏  | 27052/37963 [67:00:14<24:45:34,  8.17s/it]
 71%|███████▏  | 27053/37963 [67:00:22<24:16:20,  8.01s/it]
 71%|███████▏  | 27054/37963 [67:00:29<24:03:00,  7.94s/it]
 71%|███████▏  | 27055/37963 [67:00:37<23:58:51,  7.91s/it]
 71%|███████▏  | 27056/37963 [67:00:45<23:30:58,  7.76s/it]
 71%|███████▏  | 27057/37963 [67:00:52<23:30:55,  7.76s/it]
 71%|███████▏  | 27058/37963 [67:01:00<23:05:35,  7.62s/it]
 71%|███████▏  | 27059/37963 [67:01:07<23:09:51,  7.65s/it]
 71%|███████▏  | 27060/37963 [67:01:15<23:17:13,  7.69s/it]
                                                           
{'loss': '0.1166', 'grad_norm': '2.293', 'learning_rate': '4.024e-06', 'epoch': '0.7128'}
+
 71%|███████▏  | 27060/37963 [67:01:15<23:17:13,  7.69s/it]
 71%|███████▏  | 27061/37963 [67:01:23<23:20:16,  7.71s/it]
 71%|███████▏  | 27062/37963 [67:01:38<29:41:50,  9.81s/it]
 71%|███████▏  | 27063/37963 [67:01:45<27:40:58,  9.14s/it]
 71%|███████▏  | 27064/37963 [67:01:53<26:27:52,  8.74s/it]
 71%|███████▏  | 27065/37963 [67:02:00<25:12:27,  8.33s/it]
 71%|███████▏  | 27066/37963 [67:02:08<24:37:11,  8.13s/it]
 71%|███████▏  | 27067/37963 [67:02:16<24:20:16,  8.04s/it]
 71%|███████▏  | 27068/37963 [67:02:24<24:04:27,  7.95s/it]
 71%|███████▏  | 27069/37963 [67:02:31<23:47:36,  7.86s/it]
 71%|███████▏  | 27070/37963 [67:02:39<23:16:23,  7.69s/it]
                                                           
{'loss': '0.1068', 'grad_norm': '1.33', 'learning_rate': '4.017e-06', 'epoch': '0.7131'}
+
 71%|███████▏  | 27070/37963 [67:02:39<23:16:23,  7.69s/it]
 71%|███████▏  | 27071/37963 [67:02:46<22:54:07,  7.57s/it]
 71%|███████▏  | 27072/37963 [67:02:53<22:46:55,  7.53s/it]
 71%|███████▏  | 27073/37963 [67:03:01<22:37:42,  7.48s/it]
 71%|███████▏  | 27074/37963 [67:03:08<22:48:48,  7.54s/it]
 71%|███████▏  | 27075/37963 [67:03:23<29:17:40,  9.69s/it]
 71%|███████▏  | 27076/37963 [67:03:31<27:40:00,  9.15s/it]
 71%|███████▏  | 27077/37963 [67:03:39<26:20:10,  8.71s/it]
 71%|███████▏  | 27078/37963 [67:03:47<25:39:53,  8.49s/it]
 71%|███████▏  | 27079/37963 [67:03:55<25:07:55,  8.31s/it]
 71%|███████▏  | 27080/37963 [67:04:10<31:09:48, 10.31s/it]
                                                           
{'loss': '0.1191', 'grad_norm': '2.299', 'learning_rate': '4.01e-06', 'epoch': '0.7133'}
+
 71%|███████▏  | 27080/37963 [67:04:10<31:09:48, 10.31s/it]
 71%|███████▏  | 27081/37963 [67:04:24<34:40:46, 11.47s/it]
 71%|███████▏  | 27082/37963 [67:04:31<31:13:47, 10.33s/it]
 71%|███████▏  | 27083/37963 [67:04:39<28:49:46,  9.54s/it]
 71%|███████▏  | 27084/37963 [67:04:47<27:13:17,  9.01s/it]
 71%|███████▏  | 27085/37963 [67:04:55<26:03:18,  8.62s/it]
 71%|███████▏  | 27086/37963 [67:05:02<24:52:20,  8.23s/it]
 71%|███████▏  | 27087/37963 [67:05:10<24:20:35,  8.06s/it]
 71%|███████▏  | 27088/37963 [67:05:17<24:04:54,  7.97s/it]
 71%|███████▏  | 27089/37963 [67:05:32<30:31:26, 10.11s/it]
 71%|███████▏  | 27090/37963 [67:05:40<28:13:02,  9.34s/it]
                                                           
{'loss': '0.1343', 'grad_norm': '1.609', 'learning_rate': '4.003e-06', 'epoch': '0.7136'}
+
 71%|███████▏  | 27090/37963 [67:05:40<28:13:02,  9.34s/it]
 71%|███████▏  | 27091/37963 [67:05:48<26:45:06,  8.86s/it]
 71%|███████▏  | 27092/37963 [67:06:02<31:37:28, 10.47s/it]
 71%|███████▏  | 27093/37963 [67:06:17<35:19:23, 11.70s/it]
 71%|███████▏  | 27094/37963 [67:06:31<37:44:51, 12.50s/it]
 71%|███████▏  | 27095/37963 [67:06:39<33:37:13, 11.14s/it]
 71%|███████▏  | 27096/37963 [67:06:47<30:31:32, 10.11s/it]
 71%|███████▏  | 27097/37963 [67:06:54<28:26:09,  9.42s/it]
 71%|███████▏  | 27098/37963 [67:07:02<26:57:02,  8.93s/it]
 71%|███████▏  | 27099/37963 [67:07:10<25:59:01,  8.61s/it]
 71%|███████▏  | 27100/37963 [67:07:18<25:16:25,  8.38s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '2.756', 'learning_rate': '3.996e-06', 'epoch': '0.7139'}
+
 71%|███████▏  | 27100/37963 [67:07:18<25:16:25,  8.38s/it]
 71%|███████▏  | 27101/37963 [67:07:25<24:32:27,  8.13s/it]
 71%|███████▏  | 27102/37963 [67:07:33<23:56:30,  7.94s/it]
 71%|███████▏  | 27103/37963 [67:07:40<23:34:34,  7.82s/it]
 71%|███████▏  | 27104/37963 [67:07:48<23:28:48,  7.78s/it]
 71%|███████▏  | 27105/37963 [67:07:56<23:21:15,  7.74s/it]
 71%|███████▏  | 27106/37963 [67:08:03<23:17:30,  7.72s/it]
 71%|███████▏  | 27107/37963 [67:08:11<23:23:37,  7.76s/it]
 71%|███████▏  | 27108/37963 [67:08:19<23:22:42,  7.75s/it]
 71%|███████▏  | 27109/37963 [67:08:27<23:19:38,  7.74s/it]
 71%|███████▏  | 27110/37963 [67:08:34<23:03:40,  7.65s/it]
                                                           
{'loss': '0.1233', 'grad_norm': '2.815', 'learning_rate': '3.99e-06', 'epoch': '0.7141'}
+
 71%|███████▏  | 27110/37963 [67:08:34<23:03:40,  7.65s/it]
 71%|███████▏  | 27111/37963 [67:08:42<22:51:18,  7.58s/it]
 71%|███████▏  | 27112/37963 [67:08:56<28:35:07,  9.48s/it]
 71%|███████▏  | 27113/37963 [67:09:03<27:05:49,  8.99s/it]
 71%|███████▏  | 27114/37963 [67:09:11<25:45:27,  8.55s/it]
 71%|███████▏  | 27115/37963 [67:09:19<24:57:14,  8.28s/it]
 71%|███████▏  | 27116/37963 [67:09:26<24:17:00,  8.06s/it]
 71%|███████▏  | 27117/37963 [67:09:34<24:02:45,  7.98s/it]
 71%|███████▏  | 27118/37963 [67:09:41<23:41:05,  7.86s/it]
 71%|███████▏  | 27119/37963 [67:09:56<29:33:54,  9.82s/it]
 71%|███████▏  | 27120/37963 [67:10:04<27:49:02,  9.24s/it]
                                                           
{'loss': '0.1177', 'grad_norm': '1.778', 'learning_rate': '3.983e-06', 'epoch': '0.7144'}
+
 71%|███████▏  | 27120/37963 [67:10:04<27:49:02,  9.24s/it]
 71%|███████▏  | 27121/37963 [67:10:11<26:25:43,  8.78s/it]
 71%|███████▏  | 27122/37963 [67:10:19<25:35:54,  8.50s/it]
 71%|███████▏  | 27123/37963 [67:10:27<24:54:18,  8.27s/it]
 71%|███████▏  | 27124/37963 [67:10:35<24:24:43,  8.11s/it]
 71%|█���█████▏  | 27125/37963 [67:10:42<23:59:43,  7.97s/it]
 71%|███████▏  | 27126/37963 [67:10:50<23:47:33,  7.90s/it]
 71%|███████▏  | 27127/37963 [67:10:58<23:36:47,  7.84s/it]
 71%|███████▏  | 27128/37963 [67:11:13<29:48:11,  9.90s/it]
 71%|███████▏  | 27129/37963 [67:11:20<27:59:23,  9.30s/it]
 71%|███████▏  | 27130/37963 [67:11:28<26:28:34,  8.80s/it]
                                                           
{'loss': '0.1253', 'grad_norm': '2.648', 'learning_rate': '3.976e-06', 'epoch': '0.7146'}
+
 71%|███████▏  | 27130/37963 [67:11:28<26:28:34,  8.80s/it]
 71%|███████▏  | 27131/37963 [67:11:36<25:25:11,  8.45s/it]
 71%|███████▏  | 27132/37963 [67:11:43<24:45:04,  8.23s/it]
 71%|███████▏  | 27133/37963 [67:11:51<24:28:59,  8.14s/it]
 71%|███████▏  | 27134/37963 [67:11:59<24:05:09,  8.01s/it]
 71%|███████▏  | 27135/37963 [67:12:13<29:44:59,  9.89s/it]
 71%|███████▏  | 27136/37963 [67:12:27<33:27:09, 11.12s/it]
 71%|███████▏  | 27137/37963 [67:12:35<30:29:04, 10.14s/it]
 71%|███████▏  | 27138/37963 [67:12:43<28:19:39,  9.42s/it]
 71%|███████▏  | 27139/37963 [67:12:51<26:49:58,  8.92s/it]
 71%|███████▏  | 27140/37963 [67:12:58<25:33:46,  8.50s/it]
                                                           
{'loss': '0.1301', 'grad_norm': '1.708', 'learning_rate': '3.969e-06', 'epoch': '0.7149'}
+
 71%|███████▏  | 27140/37963 [67:12:58<25:33:46,  8.50s/it]
 71%|███████▏  | 27141/37963 [67:13:13<31:15:09, 10.40s/it]
 71%|███████▏  | 27142/37963 [67:13:34<41:04:27, 13.66s/it]
 71%|███████▏  | 27143/37963 [67:13:42<35:47:58, 11.91s/it]
 72%|███████▏  | 27144/37963 [67:13:50<32:01:19, 10.66s/it]
 72%|███████▏  | 27145/37963 [67:13:57<28:59:32,  9.65s/it]
 72%|███████▏  | 27146/37963 [67:14:05<27:20:11,  9.10s/it]
 72%|███████▏  | 27147/37963 [67:14:13<26:03:27,  8.67s/it]
 72%|███████▏  | 27148/37963 [67:14:20<25:12:33,  8.39s/it]
 72%|███████▏  | 27149/37963 [67:14:28<24:13:42,  8.07s/it]
 72%|███████▏  | 27150/37963 [67:14:35<23:48:31,  7.93s/it]
                                                           
{'loss': '0.116', 'grad_norm': '1.703', 'learning_rate': '3.962e-06', 'epoch': '0.7152'}
+
 72%|███████▏  | 27150/37963 [67:14:35<23:48:31,  7.93s/it]
 72%|███████▏  | 27151/37963 [67:14:43<23:34:07,  7.85s/it]
 72%|███████▏  | 27152/37963 [67:14:50<23:09:32,  7.71s/it]
 72%|███████▏  | 27153/37963 [67:14:58<23:11:40,  7.72s/it]
 72%|███████▏  | 27154/37963 [67:15:06<23:06:44,  7.70s/it]
 72%|███████▏  | 27155/37963 [67:15:13<23:03:29,  7.68s/it]
 72%|███████▏  | 27156/37963 [67:15:22<23:27:34,  7.81s/it]
 72%|███████▏  | 27157/37963 [67:15:29<23:25:46,  7.81s/it]
 72%|███████▏  | 27158/37963 [67:15:37<23:16:52,  7.76s/it]
 72%|███████▏  | 27159/37963 [67:15:52<29:40:40,  9.89s/it]
 72%|███████▏  | 27160/37963 [67:16:00<27:55:20,  9.30s/it]
                                                           
{'loss': '0.1204', 'grad_norm': '2.306', 'learning_rate': '3.956e-06', 'epoch': '0.7154'}
+
 72%|███████▏  | 27160/37963 [67:16:00<27:55:20,  9.30s/it]
 72%|███████▏  | 27161/37963 [67:16:07<26:18:17,  8.77s/it]
 72%|███████▏  | 27162/37963 [67:16:15<25:23:53,  8.47s/it]
 72%|███████▏  | 27163/37963 [67:16:23<24:34:15,  8.19s/it]
 72%|███████▏  | 27164/37963 [67:16:30<24:05:56,  8.03s/it]
 72%|███████▏  | 27165/37963 [67:16:44<29:40:49,  9.90s/it]
 72%|███████▏  | 27166/37963 [67:16:52<27:32:15,  9.18s/it]
 72%|███████▏  | 27167/37963 [67:17:00<26:17:30,  8.77s/it]
 72%|███████▏  | 27168/37963 [67:17:08<25:19:48,  8.45s/it]
 72%|███████▏  | 27169/37963 [67:17:15<24:37:03,  8.21s/it]
 72%|███████▏  | 27170/37963 [67:17:23<24:08:06,  8.05s/it]
                                                           
{'loss': '0.115', 'grad_norm': '2.215', 'learning_rate': '3.949e-06', 'epoch': '0.7157'}
+
 72%|███████▏  | 27170/37963 [67:17:23<24:08:06,  8.05s/it]
 72%|███████▏  | 27171/37963 [67:17:31<23:48:06,  7.94s/it]
 72%|███████▏  | 27172/37963 [67:17:38<23:32:48,  7.86s/it]
 72%|███████▏  | 27173/37963 [67:17:46<23:25:53,  7.82s/it]
 72%|███████▏  | 27174/37963 [67:17:54<23:26:47,  7.82s/it]
 72%|███████▏  | 27175/37963 [67:18:01<23:20:03,  7.79s/it]
 72%|███████▏  | 27176/37963 [67:18:09<23:18:17,  7.78s/it]
 72%|███████▏  | 27177/37963 [67:18:17<23:11:28,  7.74s/it]
 72%|███████▏  | 27178/37963 [67:18:25<23:11:39,  7.74s/it]
 72%|███████▏  | 27179/37963 [67:18:39<29:02:18,  9.69s/it]
 72%|███████▏  | 27180/37963 [67:18:46<27:04:53,  9.04s/it]
                                                           
{'loss': '0.1241', 'grad_norm': '3.129', 'learning_rate': '3.942e-06', 'epoch': '0.716'}
+
 72%|███████▏  | 27180/37963 [67:18:46<27:04:53,  9.04s/it]
 72%|███████▏  | 27181/37963 [67:19:02<32:33:16, 10.87s/it]
 72%|███████▏  | 27182/37963 [67:19:09<29:50:51,  9.97s/it]
 72%|███████▏  | 27183/37963 [67:19:17<27:49:33,  9.29s/it]
 72%|███████▏  | 27184/37963 [67:19:25<26:26:32,  8.83s/it]
 72%|███████▏  | 27185/37963 [67:19:32<25:20:25,  8.46s/it]
 72%|███████▏  | 27186/37963 [67:19:40<24:44:16,  8.26s/it]
 72%|███████▏  | 27187/37963 [67:19:55<30:54:27, 10.33s/it]
 72%|███████▏  | 27188/37963 [67:20:03<28:33:38,  9.54s/it]
 72%|███████▏  | 27189/37963 [67:20:11<26:52:31,  8.98s/it]
 72%|███████▏  | 27190/37963 [67:20:32<37:41:22, 12.59s/it]
                                                           
{'loss': '0.1177', 'grad_norm': '3.062', 'learning_rate': '3.935e-06', 'epoch': '0.7162'}
+
 72%|███████▏  | 27190/37963 [67:20:32<37:41:22, 12.59s/it]
 72%|███████▏  | 27191/37963 [67:20:46<39:19:11, 13.14s/it]
 72%|███████▏  | 27192/37963 [67:20:54<34:29:45, 11.53s/it]
 72%|███████▏  | 27193/37963 [67:21:02<31:02:30, 10.38s/it]
 72%|███████▏  | 27194/37963 [67:21:09<28:41:08,  9.59s/it]
 72%|███████▏  | 27195/37963 [67:21:17<27:06:16,  9.06s/it]
 72%|███████▏  | 27196/37963 [67:21:25<25:53:24,  8.66s/it]
 72%|███████▏  | 27197/37963 [67:21:33<24:59:12,  8.36s/it]
 72%|███████▏  | 27198/37963 [67:21:40<24:22:52,  8.15s/it]
 72%|███████▏  | 27199/37963 [67:21:48<24:02:11,  8.04s/it]
 72%|███████▏  | 27200/37963 [67:21:56<23:35:54,  7.89s/it]
                                                           
{'loss': '0.1084', 'grad_norm': '1.497', 'learning_rate': '3.928e-06', 'epoch': '0.7165'}
+
 72%|███████▏  | 27200/37963 [67:21:56<23:35:54,  7.89s/it]
 72%|███████▏  | 27201/37963 [67:22:03<23:17:30,  7.79s/it]
 72%|███████▏  | 27202/37963 [67:22:11<23:17:55,  7.79s/it]
 72%|███████▏  | 27203/37963 [67:22:19<23:16:45,  7.79s/it]
 72%|███████▏  | 27204/37963 [67:22:27<23:20:52,  7.81s/it]
 72%|███████▏  | 27205/37963 [67:22:34<23:08:25,  7.74s/it]
 72%|███████▏  | 27206/37963 [67:22:42<23:07:15,  7.74s/it]
 72%|███████▏  | 27207/37963 [67:22:50<23:07:24,  7.74s/it]
 72%|███████▏  | 27208/37963 [67:22:57<23:00:12,  7.70s/it]
 72%|███████▏  | 27209/37963 [67:23:05<23:05:16,  7.73s/it]
 72%|███████▏  | 27210/37963 [67:23:13<23:03:35,  7.72s/it]
                                                           
{'loss': '0.126', 'grad_norm': '2.283', 'learning_rate': '3.922e-06', 'epoch': '0.7168'}
+
 72%|███████▏  | 27210/37963 [67:23:13<23:03:35,  7.72s/it]
 72%|███████▏  | 27211/37963 [67:23:28<29:33:51,  9.90s/it]
 72%|███████▏  | 27212/37963 [67:23:35<27:21:29,  9.16s/it]
 72%|███████▏  | 27213/37963 [67:23:49<31:48:49, 10.65s/it]
 72%|███████▏  | 27214/37963 [67:23:57<29:19:58,  9.82s/it]
 72%|███████▏  | 27215/37963 [67:24:05<27:18:41,  9.15s/it]
 72%|███████▏  | 27216/37963 [67:24:13<26:05:19,  8.74s/it]
 72%|███████▏  | 27217/37963 [67:24:20<25:12:49,  8.45s/it]
 72%|███████▏  | 27218/37963 [67:24:28<24:22:10,  8.16s/it]
 72%|███████▏  | 27219/37963 [67:24:35<23:53:00,  8.00s/it]
 72%|███████▏  | 27220/37963 [67:24:43<23:43:22,  7.95s/it]
                                                           
{'loss': '0.1221', 'grad_norm': '1.97', 'learning_rate': '3.915e-06', 'epoch': '0.717'}
+
 72%|███████▏  | 27220/37963 [67:24:43<23:43:22,  7.95s/it]
 72%|███████▏  | 27221/37963 [67:24:51<23:30:22,  7.88s/it]
 72%|███████▏  | 27222/37963 [67:24:59<23:23:12,  7.84s/it]
 72%|███████▏  | 27223/37963 [67:25:06<23:13:04,  7.78s/it]
 72%|███████▏  | 27224/37963 [67:25:14<23:04:17,  7.73s/it]
 72%|███████▏  | 27225/37963 [67:25:22<23:06:04,  7.74s/it]
 72%|███████▏  | 27226/37963 [67:25:29<23:00:18,  7.71s/it]
 72%|███████▏  | 27227/37963 [67:25:37<22:53:54,  7.68s/it]
 72%|███████▏  | 27228/37963 [67:25:45<22:53:02,  7.67s/it]
 72%|███████▏  | 27229/37963 [67:25:53<23:01:47,  7.72s/it]
 72%|███████▏  | 27230/37963 [67:26:00<23:00:48,  7.72s/it]
                                                           
{'loss': '0.1187', 'grad_norm': '2.915', 'learning_rate': '3.908e-06', 'epoch': '0.7173'}
+
 72%|███████▏  | 27230/37963 [67:26:00<23:00:48,  7.72s/it]
 72%|███████▏  | 27231/37963 [67:26:22<35:46:28, 12.00s/it]
 72%|███████▏  | 27232/37963 [67:26:36<37:38:42, 12.63s/it]
 72%|███████▏  | 27233/37963 [67:26:44<33:19:38, 11.18s/it]
 72%|███████▏  | 27234/37963 [67:26:58<36:01:27, 12.09s/it]
 72%|███████▏  | 27235/37963 [67:27:06<32:19:37, 10.85s/it]
 72%|███████▏  | 27236/37963 [67:27:14<29:28:28,  9.89s/it]
 72%|███████▏  | 27237/37963 [67:27:22<27:36:02,  9.26s/it]
 72%|███████▏  | 27238/37963 [67:27:36<32:14:32, 10.82s/it]
 72%|███████▏  | 27239/37963 [67:27:44<29:24:11,  9.87s/it]
 72%|███████▏  | 27240/37963 [67:27:51<27:16:50,  9.16s/it]
                                                           
{'loss': '0.1118', 'grad_norm': '2.173', 'learning_rate': '3.901e-06', 'epoch': '0.7175'}
+
 72%|███████▏  | 27240/37963 [67:27:51<27:16:50,  9.16s/it]
 72%|███████▏  | 27241/37963 [67:27:59<26:06:11,  8.76s/it]
 72%|███████▏  | 27242/37963 [67:28:07<25:05:24,  8.42s/it]
 72%|███████▏  | 27243/37963 [67:28:15<24:26:09,  8.21s/it]
 72%|███████▏  | 27244/37963 [67:28:29<29:48:33, 10.01s/it]
 72%|███████▏  | 27245/37963 [67:28:36<27:45:36,  9.32s/it]
 72%|███████▏  | 27246/37963 [67:28:44<26:20:37,  8.85s/it]
 72%|███████▏  | 27247/37963 [67:28:52<25:22:47,  8.53s/it]
 72%|███████▏  | 27248/37963 [67:29:00<24:36:15,  8.27s/it]
 72%|███████▏  | 27249/37963 [67:29:08<24:14:57,  8.15s/it]
 72%|███████▏  | 27250/37963 [67:29:15<23:46:54,  7.99s/it]
                                                           
{'loss': '0.123', 'grad_norm': '2.806', 'learning_rate': '3.895e-06', 'epoch': '0.7178'}
+
 72%|███████▏  | 27250/37963 [67:29:15<23:46:54,  7.99s/it]
 72%|███████▏  | 27251/37963 [67:29:23<23:30:54,  7.90s/it]
 72%|███████▏  | 27252/37963 [67:29:31<23:21:05,  7.85s/it]
 72%|███████▏  | 27253/37963 [67:29:38<22:49:37,  7.67s/it]
 72%|███████▏  | 27254/37963 [67:29:46<22:49:30,  7.67s/it]
 72%|███████▏  | 27255/37963 [67:29:53<22:47:30,  7.66s/it]
 72%|███████▏  | 27256/37963 [67:30:01<22:42:05,  7.63s/it]
 72%|███████▏  | 27257/37963 [67:30:15<28:25:55,  9.56s/it]
 72%|███████▏  | 27258/37963 [67:30:23<26:55:59,  9.06s/it]
 72%|███████▏  | 27259/37963 [67:30:30<25:41:14,  8.64s/it]
 72%|███████▏  | 27260/37963 [67:30:38<24:53:47,  8.37s/it]
                                                           
{'loss': '0.1171', 'grad_norm': '1.832', 'learning_rate': '3.888e-06', 'epoch': '0.7181'}
+
 72%|███████▏  | 27260/37963 [67:30:38<24:53:47,  8.37s/it]
 72%|███████▏  | 27261/37963 [67:30:46<24:18:41,  8.18s/it]
 72%|███████▏  | 27262/37963 [67:30:53<23:50:22,  8.02s/it]
 72%|███████▏  | 27263/37963 [67:31:01<23:33:36,  7.93s/it]
 72%|███████▏  | 27264/37963 [67:31:16<29:38:49,  9.98s/it]
 72%|███████▏  | 27265/37963 [67:31:24<27:54:55,  9.39s/it]
 72%|███████▏  | 27266/37963 [67:31:32<26:17:20,  8.85s/it]
 72%|███████▏  | 27267/37963 [67:31:39<25:12:40,  8.49s/it]
 72%|███████▏  | 27268/37963 [67:31:47<24:40:59,  8.31s/it]
 72%|███████▏  | 27269/37963 [67:31:55<24:00:49,  8.08s/it]
 72%|███████▏  | 27270/37963 [67:32:02<23:20:40,  7.86s/it]
                                                           
{'loss': '0.1153', 'grad_norm': '1.286', 'learning_rate': '3.881e-06', 'epoch': '0.7183'}
+
 72%|███████▏  | 27270/37963 [67:32:02<23:20:40,  7.86s/it]
 72%|███████▏  | 27271/37963 [67:32:09<23:00:40,  7.75s/it]
 72%|███████▏  | 27272/37963 [67:32:17<23:02:03,  7.76s/it]
 72%|███████▏  | 27273/37963 [67:32:25<22:59:11,  7.74s/it]
 72%|███████▏  | 27274/37963 [67:32:32<22:49:30,  7.69s/it]
 72%|███████▏  | 27275/37963 [67:32:40<22:51:26,  7.70s/it]
 72%|███████▏  | 27276/37963 [67:32:48<22:46:05,  7.67s/it]
 72%|███████▏  | 27277/37963 [67:32:55<22:33:29,  7.60s/it]
 72%|███████▏  | 27278/37963 [67:33:10<29:03:14,  9.79s/it]
 72%|███████▏  | 27279/37963 [67:33:24<32:51:49, 11.07s/it]
 72%|███████▏  | 27280/37963 [67:33:39<36:09:22, 12.18s/it]
                                                           
{'loss': '0.1144', 'grad_norm': '1.96', 'learning_rate': '3.874e-06', 'epoch': '0.7186'}
+
 72%|███████▏  | 27280/37963 [67:33:39<36:09:22, 12.18s/it]
 72%|███████▏  | 27281/37963 [67:33:47<32:13:40, 10.86s/it]
 72%|███████▏  | 27282/37963 [67:33:54<29:23:06,  9.90s/it]
 72%|███████▏  | 27283/37963 [67:34:02<27:04:30,  9.13s/it]
 72%|███████▏  | 27284/37963 [67:34:09<25:50:23,  8.71s/it]
 72%|███████▏  | 27285/37963 [67:34:17<25:04:27,  8.45s/it]
 72%|███████▏  | 27286/37963 [67:34:32<30:19:16, 10.22s/it]
 72%|███████▏  | 27287/37963 [67:34:46<33:39:32, 11.35s/it]
 72%|███████▏  | 27288/37963 [67:34:54<30:38:11, 10.33s/it]
 72%|███████▏  | 27289/37963 [67:35:01<27:57:51,  9.43s/it]
 72%|███████▏  | 27290/37963 [67:35:09<26:23:46,  8.90s/it]
                                                           
{'loss': '0.1207', 'grad_norm': '2.028', 'learning_rate': '3.868e-06', 'epoch': '0.7189'}
+
 72%|███████▏  | 27290/37963 [67:35:09<26:23:46,  8.90s/it]
 72%|███████▏  | 27291/37963 [67:35:16<25:24:17,  8.57s/it]
 72%|███████▏  | 27292/37963 [67:35:24<24:43:03,  8.34s/it]
 72%|███████▏  | 27293/37963 [67:35:32<24:20:04,  8.21s/it]
 72%|███████▏  | 27294/37963 [67:35:40<23:52:24,  8.06s/it]
 72%|███████▏  | 27295/37963 [67:35:48<23:37:54,  7.97s/it]
 72%|███████▏  | 27296/37963 [67:35:55<23:28:03,  7.92s/it]
 72%|███████▏  | 27297/37963 [67:36:03<23:14:17,  7.84s/it]
 72%|███████▏  | 27298/37963 [67:36:17<28:46:59,  9.72s/it]
 72%|███████▏  | 27299/37963 [67:36:25<27:14:28,  9.20s/it]
 72%|███████▏  | 27300/37963 [67:36:33<26:02:52,  8.79s/it]
                                                           
{'loss': '0.1114', 'grad_norm': '1.589', 'learning_rate': '3.861e-06', 'epoch': '0.7191'}
+
 72%|███████▏  | 27300/37963 [67:36:33<26:02:52,  8.79s/it]
 72%|███████▏  | 27301/37963 [67:36:41<25:02:26,  8.45s/it]
 72%|███████▏  | 27302/37963 [67:36:48<24:22:23,  8.23s/it]
 72%|███████▏  | 27303/37963 [67:36:56<23:45:12,  8.02s/it]
 72%|███████▏  | 27304/37963 [67:37:04<23:24:39,  7.91s/it]
 72%|███████▏  | 27305/37963 [67:37:11<23:08:50,  7.82s/it]
 72%|███████▏  | 27306/37963 [67:37:18<22:43:09,  7.67s/it]
 72%|███████▏  | 27307/37963 [67:37:26<22:45:13,  7.69s/it]
 72%|███████▏  | 27308/37963 [67:37:34<22:49:02,  7.71s/it]
 72%|███████▏  | 27309/37963 [67:37:41<22:35:42,  7.63s/it]
 72%|███████▏  | 27310/37963 [67:37:49<22:41:24,  7.67s/it]
                                                           
{'loss': '0.1196', 'grad_norm': '2.612', 'learning_rate': '3.854e-06', 'epoch': '0.7194'}
+
 72%|███████▏  | 27310/37963 [67:37:49<22:41:24,  7.67s/it]
 72%|███████▏  | 27311/37963 [67:38:04<28:37:03,  9.67s/it]
 72%|███████▏  | 27312/37963 [67:38:11<26:55:03,  9.10s/it]
 72%|███████▏  | 27313/37963 [67:38:19<25:22:15,  8.58s/it]
 72%|███████▏  | 27314/37963 [67:38:26<24:16:56,  8.21s/it]
 72%|███████▏  | 27315/37963 [67:38:34<23:45:08,  8.03s/it]
 72%|███████▏  | 27316/37963 [67:38:41<23:27:44,  7.93s/it]
 72%|███████▏  | 27317/37963 [67:38:56<29:03:53,  9.83s/it]
 72%|███████▏  | 27318/37963 [67:39:03<27:17:08,  9.23s/it]
 72%|███████▏  | 27319/37963 [67:39:11<25:37:18,  8.67s/it]
 72%|███████▏  | 27320/37963 [67:39:19<24:56:59,  8.44s/it]
                                                           
{'loss': '0.1164', 'grad_norm': '1.609', 'learning_rate': '3.847e-06', 'epoch': '0.7197'}
+
 72%|███████▏  | 27320/37963 [67:39:19<24:56:59,  8.44s/it]
 72%|███████▏  | 27321/37963 [67:39:26<24:18:31,  8.22s/it]
 72%|███████▏  | 27322/37963 [67:39:34<23:54:31,  8.09s/it]
 72%|███████▏  | 27323/37963 [67:39:42<23:28:56,  7.95s/it]
 72%|███████▏  | 27324/37963 [67:39:57<29:47:39, 10.08s/it]
 72%|███████▏  | 27325/37963 [67:40:04<27:37:30,  9.35s/it]
 72%|███████▏  | 27326/37963 [67:40:12<26:11:15,  8.86s/it]
 72%|███████▏  | 27327/37963 [67:40:34<37:31:36, 12.70s/it]
 72%|███████▏  | 27328/37963 [67:40:42<33:12:42, 11.24s/it]
 72%|███████▏  | 27329/37963 [67:40:50<30:13:19, 10.23s/it]
 72%|███████▏  | 27330/37963 [67:41:04<33:38:55, 11.39s/it]
                                                           
{'loss': '0.1089', 'grad_norm': '2.132', 'learning_rate': '3.841e-06', 'epoch': '0.7199'}
+
 72%|███████▏  | 27330/37963 [67:41:04<33:38:55, 11.39s/it]
 72%|███████▏  | 27331/37963 [67:41:11<30:21:53, 10.28s/it]
 72%|███████▏  | 27332/37963 [67:41:19<27:58:43,  9.47s/it]
 72%|███████▏  | 27333/37963 [67:41:27<26:24:51,  8.95s/it]
 72%|███████▏  | 27334/37963 [67:41:41<31:29:09, 10.66s/it]
 72%|███████▏  | 27335/37963 [67:41:49<29:10:04,  9.88s/it]
 72%|███████▏  | 27336/37963 [67:41:57<27:12:42,  9.22s/it]
 72%|███████▏  | 27337/37963 [67:42:05<25:55:20,  8.78s/it]
 72%|███████▏  | 27338/37963 [67:42:12<24:46:06,  8.39s/it]
 72%|███████▏  | 27339/37963 [67:42:20<24:07:23,  8.17s/it]
 72%|███████▏  | 27340/37963 [67:42:28<24:06:41,  8.17s/it]
                                                           
{'loss': '0.1161', 'grad_norm': '2.274', 'learning_rate': '3.834e-06', 'epoch': '0.7202'}
+
 72%|███████▏  | 27340/37963 [67:42:28<24:06:41,  8.17s/it]
 72%|███████▏  | 27341/37963 [67:42:36<23:34:57,  7.99s/it]
 72%|███████▏  | 27342/37963 [67:42:43<23:17:52,  7.90s/it]
 72%|███████▏  | 27343/37963 [67:42:51<22:54:59,  7.77s/it]
 72%|███████▏  | 27344/37963 [67:42:58<22:45:01,  7.71s/it]
 72%|███████▏  | 27345/37963 [67:43:06<22:50:55,  7.75s/it]
 72%|███████▏  | 27346/37963 [67:43:14<23:04:51,  7.83s/it]
 72%|███████▏  | 27347/37963 [67:43:22<22:52:07,  7.76s/it]
 72%|███████▏  | 27348/37963 [67:43:30<22:48:32,  7.74s/it]
 72%|███████▏  | 27349/37963 [67:43:37<22:39:07,  7.68s/it]
 72%|███████▏  | 27350/37963 [67:43:45<22:30:00,  7.63s/it]
                                                           
{'loss': '0.1266', 'grad_norm': '3.422', 'learning_rate': '3.827e-06', 'epoch': '0.7204'}
+
 72%|███████▏  | 27350/37963 [67:43:45<22:30:00,  7.63s/it]
 72%|███████▏  | 27351/37963 [67:43:52<22:18:16,  7.57s/it]
 72%|███████▏  | 27352/37963 [67:44:06<28:07:18,  9.54s/it]
 72%|███████▏  | 27353/37963 [67:44:14<26:26:21,  8.97s/it]
 72%|███████▏  | 27354/37963 [67:44:22<25:20:05,  8.60s/it]
 72%|███████▏  | 27355/37963 [67:44:29<24:26:19,  8.29s/it]
 72%|███████▏  | 27356/37963 [67:44:43<29:39:39, 10.07s/it]
 72%|███████▏  | 27357/37963 [67:44:51<27:43:13,  9.41s/it]
 72%|███████▏  | 27358/37963 [67:44:59<26:13:00,  8.90s/it]
 72%|███████▏  | 27359/37963 [67:45:07<25:04:30,  8.51s/it]
 72%|███████▏  | 27360/37963 [67:45:14<24:01:51,  8.16s/it]
                                                           
{'loss': '0.126', 'grad_norm': '3.415', 'learning_rate': '3.821e-06', 'epoch': '0.7207'}
+
 72%|███████▏  | 27360/37963 [67:45:14<24:01:51,  8.16s/it]
 72%|███████▏  | 27361/37963 [67:45:21<23:33:42,  8.00s/it]
 72%|███████▏  | 27362/37963 [67:45:29<23:09:46,  7.87s/it]
 72%|███████▏  | 27363/37963 [67:45:37<23:09:20,  7.86s/it]
 72%|███████▏  | 27364/37963 [67:45:45<23:02:38,  7.83s/it]
 72%|███████▏  | 27365/37963 [67:45:52<22:47:13,  7.74s/it]
 72%|███████▏  | 27366/37963 [67:46:00<22:50:02,  7.76s/it]
 72%|███████▏  | 27367/37963 [67:46:08<22:49:45,  7.76s/it]
 72%|███████▏  | 27368/37963 [67:46:15<22:46:57,  7.74s/it]
 72%|███████▏  | 27369/37963 [67:46:23<22:46:28,  7.74s/it]
 72%|███████▏  | 27370/37963 [67:46:31<22:45:30,  7.73s/it]
                                                           
{'loss': '0.1111', 'grad_norm': '2.606', 'learning_rate': '3.814e-06', 'epoch': '0.721'}
+
 72%|███████▏  | 27370/37963 [67:46:31<22:45:30,  7.73s/it]
 72%|███████▏  | 27371/37963 [67:46:54<36:42:26, 12.48s/it]
 72%|███████▏  | 27372/37963 [67:47:09<38:56:11, 13.24s/it]
 72%|███████▏  | 27373/37963 [67:47:24<40:30:19, 13.77s/it]
 72%|███████▏  | 27374/37963 [67:47:32<35:12:48, 11.97s/it]
 72%|███████▏  | 27375/37963 [67:47:40<31:28:59, 10.70s/it]
 72%|███████▏  | 27376/37963 [67:47:48<28:59:36,  9.86s/it]
 72%|███████▏  | 27377/37963 [67:48:02<33:05:31, 11.25s/it]
 72%|███████▏  | 27378/37963 [67:48:10<29:58:40, 10.20s/it]
 72%|███████▏  | 27379/37963 [67:48:18<27:52:06,  9.48s/it]
 72%|███████▏  | 27380/37963 [67:48:26<26:12:13,  8.91s/it]
                                                           
{'loss': '0.1264', 'grad_norm': '3.037', 'learning_rate': '3.807e-06', 'epoch': '0.7212'}
+
 72%|███████▏  | 27380/37963 [67:48:26<26:12:13,  8.91s/it]
 72%|███████▏  | 27381/37963 [67:48:40<31:04:37, 10.57s/it]
 72%|███████▏  | 27382/37963 [67:48:48<28:25:45,  9.67s/it]
 72%|███████▏  | 27383/37963 [67:48:55<26:46:53,  9.11s/it]
 72%|��██████▏  | 27384/37963 [67:49:03<25:32:00,  8.69s/it]
 72%|███████▏  | 27385/37963 [67:49:10<24:18:39,  8.27s/it]
 72%|███████▏  | 27386/37963 [67:49:18<23:58:01,  8.16s/it]
 72%|███████▏  | 27387/37963 [67:49:26<23:35:04,  8.03s/it]
 72%|███████▏  | 27388/37963 [67:49:34<23:16:25,  7.92s/it]
 72%|███████▏  | 27389/37963 [67:49:41<23:05:27,  7.86s/it]
 72%|███████▏  | 27390/37963 [67:49:49<22:59:31,  7.83s/it]
                                                           
{'loss': '0.1173', 'grad_norm': '2.451', 'learning_rate': '3.8e-06', 'epoch': '0.7215'}
+
 72%|███████▏  | 27390/37963 [67:49:49<22:59:31,  7.83s/it]
 72%|███████▏  | 27391/37963 [67:49:57<22:55:51,  7.81s/it]
 72%|███████▏  | 27392/37963 [67:50:04<22:37:39,  7.71s/it]
 72%|███████▏  | 27393/37963 [67:50:12<22:45:06,  7.75s/it]
 72%|███████▏  | 27394/37963 [67:50:20<22:38:42,  7.71s/it]
 72%|███████▏  | 27395/37963 [67:50:27<22:14:51,  7.58s/it]
 72%|███████▏  | 27396/37963 [67:50:35<22:20:48,  7.61s/it]
 72%|███████▏  | 27397/37963 [67:50:42<22:26:25,  7.65s/it]
 72%|███████▏  | 27398/37963 [67:50:50<22:27:54,  7.65s/it]
 72%|███████▏  | 27399/37963 [67:51:04<27:45:18,  9.46s/it]
 72%|███████▏  | 27400/37963 [67:51:12<26:16:06,  8.95s/it]
                                                           
{'loss': '0.1077', 'grad_norm': '2.289', 'learning_rate': '3.794e-06', 'epoch': '0.7218'}
+
 72%|███████▏  | 27400/37963 [67:51:12<26:16:06,  8.95s/it]
 72%|███████▏  | 27401/37963 [67:51:26<31:00:48, 10.57s/it]
 72%|███████▏  | 27402/37963 [67:51:34<28:23:54,  9.68s/it]
 72%|███████▏  | 27403/37963 [67:51:41<26:42:33,  9.11s/it]
 72%|███████▏  | 27404/37963 [67:51:49<25:12:28,  8.59s/it]
 72%|███████▏  | 27405/37963 [67:51:56<24:24:55,  8.33s/it]
 72%|███████▏  | 27406/37963 [67:52:04<23:56:57,  8.17s/it]
 72%|███████▏  | 27407/37963 [67:52:12<23:31:38,  8.02s/it]
 72%|███████▏  | 27408/37963 [67:52:20<23:22:05,  7.97s/it]
 72%|███████▏  | 27409/37963 [67:52:27<23:07:19,  7.89s/it]
 72%|███████▏  | 27410/37963 [67:52:35<22:39:00,  7.73s/it]
                                                           
{'loss': '0.1095', 'grad_norm': '2.094', 'learning_rate': '3.787e-06', 'epoch': '0.722'}
+
 72%|███████▏  | 27410/37963 [67:52:35<22:39:00,  7.73s/it]
 72%|███████▏  | 27411/37963 [67:52:42<22:31:38,  7.69s/it]
 72%|███████▏  | 27412/37963 [67:52:50<22:32:26,  7.69s/it]
 72%|███████▏  | 27413/37963 [67:52:57<22:17:18,  7.61s/it]
 72%|███████▏  | 27414/37963 [67:53:05<22:28:15,  7.67s/it]
 72%|███████▏  | 27415/37963 [67:53:13<22:19:14,  7.62s/it]
 72%|███████▏  | 27416/37963 [67:53:21<22:27:56,  7.67s/it]
 72%|███████▏  | 27417/37963 [67:53:28<22:27:16,  7.67s/it]
 72%|███████▏  | 27418/37963 [67:53:36<22:18:39,  7.62s/it]
 72%|███████▏  | 27419/37963 [67:53:43<22:18:59,  7.62s/it]
 72%|███████▏  | 27420/37963 [67:53:58<28:32:18,  9.74s/it]
                                                           
{'loss': '0.1272', 'grad_norm': '1.528', 'learning_rate': '3.78e-06', 'epoch': '0.7223'}
+
 72%|███████▏  | 27420/37963 [67:53:58<28:32:18,  9.74s/it]
 72%|███████▏  | 27421/37963 [67:54:06<26:39:27,  9.10s/it]
 72%|███████▏  | 27422/37963 [67:54:13<25:26:24,  8.69s/it]
 72%|███████▏  | 27423/37963 [67:54:21<24:38:21,  8.42s/it]
 72%|███████▏  | 27424/37963 [67:54:28<23:33:40,  8.05s/it]
 72%|███████▏  | 27425/37963 [67:54:50<35:35:48, 12.16s/it]
 72%|███████▏  | 27426/37963 [67:55:04<37:19:41, 12.75s/it]
 72%|███████▏  | 27427/37963 [67:55:26<45:08:31, 15.42s/it]
 72%|███████▏  | 27428/37963 [67:55:34<38:22:40, 13.11s/it]
 72%|███████▏  | 27429/37963 [67:55:42<33:53:34, 11.58s/it]
 72%|███████▏  | 27430/37963 [67:55:49<30:29:46, 10.42s/it]
                                                           
{'loss': '0.1209', 'grad_norm': '2.117', 'learning_rate': '3.774e-06', 'epoch': '0.7225'}
+
 72%|███████▏  | 27430/37963 [67:55:49<30:29:46, 10.42s/it]
 72%|███████▏  | 27431/37963 [67:55:57<28:07:08,  9.61s/it]
 72%|███████▏  | 27432/37963 [67:56:05<26:27:54,  9.05s/it]
 72%|███████▏  | 27433/37963 [67:56:12<25:14:25,  8.63s/it]
 72%|███████▏  | 27434/37963 [67:56:20<24:23:44,  8.34s/it]
 72%|███████▏  | 27435/37963 [67:56:28<23:32:40,  8.05s/it]
 72%|███████▏  | 27436/37963 [67:56:35<23:00:39,  7.87s/it]
 72%|███████▏  | 27437/37963 [67:56:43<22:53:53,  7.83s/it]
 72%|███████▏  | 27438/37963 [67:56:50<22:50:41,  7.81s/it]
 72%|███████▏  | 27439/37963 [67:56:58<22:42:32,  7.77s/it]
 72%|███████▏  | 27440/37963 [67:57:06<22:41:27,  7.76s/it]
                                                           
{'loss': '0.1133', 'grad_norm': '1.578', 'learning_rate': '3.767e-06', 'epoch': '0.7228'}
+
 72%|███████▏  | 27440/37963 [67:57:06<22:41:27,  7.76s/it]
 72%|███████▏  | 27441/37963 [67:57:14<22:40:05,  7.76s/it]
 72%|███████▏  | 27442/37963 [67:57:21<22:36:51,  7.74s/it]
 72%|███████▏  | 27443/37963 [67:57:29<22:25:11,  7.67s/it]
 72%|███████▏  | 27444/37963 [67:57:36<22:13:35,  7.61s/it]
 72%|███████▏  | 27445/37963 [67:57:51<28:13:21,  9.66s/it]
 72%|███████▏  | 27446/37963 [67:57:59<26:39:24,  9.12s/it]
 72%|███████▏  | 27447/37963 [67:58:06<25:30:12,  8.73s/it]
 72%|███████▏  | 27448/37963 [67:58:14<24:30:50,  8.39s/it]
 72%|███████▏  | 27449/37963 [67:58:22<23:58:29,  8.21s/it]
 72%|███████▏  | 27450/37963 [67:58:29<23:24:26,  8.02s/it]
                                                           
{'loss': '0.113', 'grad_norm': '3.127', 'learning_rate': '3.76e-06', 'epoch': '0.7231'}
+
 72%|███████▏  | 27450/37963 [67:58:29<23:24:26,  8.02s/it]
 72%|███████▏  | 27451/37963 [67:58:37<23:07:04,  7.92s/it]
 72%|███████▏  | 27452/37963 [67:58:51<28:44:04,  9.84s/it]
 72%|███████▏  | 27453/37963 [67:58:59<27:02:27,  9.26s/it]
 72%|███████▏  | 27454/37963 [67:59:07<25:38:58,  8.79s/it]
 72%|███████▏  | 27455/37963 [67:59:15<24:46:01,  8.49s/it]
 72%|███████▏  | 27456/37963 [67:59:23<24:05:51,  8.26s/it]
 72%|███████▏  | 27457/37963 [67:59:30<23:32:12,  8.07s/it]
 72%|███████▏  | 27458/37963 [67:59:38<23:16:55,  7.98s/it]
 72%|███████▏  | 27459/37963 [67:59:46<22:59:03,  7.88s/it]
 72%|███████▏  | 27460/37963 [67:59:53<22:37:13,  7.75s/it]
                                                           
{'loss': '0.1089', 'grad_norm': '2.59', 'learning_rate': '3.754e-06', 'epoch': '0.7233'}
+
 72%|███████▏  | 27460/37963 [67:59:53<22:37:13,  7.75s/it]
 72%|███████▏  | 27461/37963 [68:00:00<22:14:58,  7.63s/it]
 72%|███████▏  | 27462/37963 [68:00:08<22:21:55,  7.67s/it]
 72%|███████▏  | 27463/37963 [68:00:16<22:23:36,  7.68s/it]
 72%|███████▏  | 27464/37963 [68:00:23<22:21:07,  7.66s/it]
 72%|███████▏  | 27465/37963 [68:00:38<28:29:18,  9.77s/it]
 72%|███████▏  | 27466/37963 [68:00:46<26:34:43,  9.12s/it]
 72%|███████▏  | 27467/37963 [68:00:53<25:18:53,  8.68s/it]
 72%|███████▏  | 27468/37963 [68:01:01<24:33:00,  8.42s/it]
 72%|███████▏  | 27469/37963 [68:01:09<23:52:30,  8.19s/it]
 72%|███████▏  | 27470/37963 [68:01:16<23:24:26,  8.03s/it]
                                                           
{'loss': '0.1105', 'grad_norm': '3.158', 'learning_rate': '3.747e-06', 'epoch': '0.7236'}
+
 72%|███████▏  | 27470/37963 [68:01:17<23:24:26,  8.03s/it]
 72%|███████▏  | 27471/37963 [68:01:31<29:21:14, 10.07s/it]
 72%|███████▏  | 27472/37963 [68:01:52<38:47:21, 13.31s/it]
 72%|███████▏  | 27473/37963 [68:02:07<39:57:01, 13.71s/it]
 72%|███████▏  | 27474/37963 [68:02:21<40:14:02, 13.81s/it]
 72%|███████▏  | 27475/37963 [68:02:29<34:53:39, 11.98s/it]
 72%|███████▏  | 27476/37963 [68:02:36<31:03:27, 10.66s/it]
 72%|███████▏  | 27477/37963 [68:02:44<28:29:10,  9.78s/it]
 72%|███████▏  | 27478/37963 [68:02:52<26:41:42,  9.17s/it]
 72%|███████▏  | 27479/37963 [68:02:59<25:22:07,  8.71s/it]
 72%|███████▏  | 27480/37963 [68:03:07<24:32:19,  8.43s/it]
                                                           
{'loss': '0.1159', 'grad_norm': '2.051', 'learning_rate': '3.74e-06', 'epoch': '0.7239'}
+
 72%|███████▏  | 27480/37963 [68:03:07<24:32:19,  8.43s/it]
 72%|███████▏  | 27481/37963 [68:03:15<23:53:41,  8.21s/it]
 72%|███████▏  | 27482/37963 [68:03:22<23:23:51,  8.04s/it]
 72%|███████▏  | 27483/37963 [68:03:30<22:57:39,  7.89s/it]
 72%|███████▏  | 27484/37963 [68:03:38<22:48:32,  7.84s/it]
 72%|███████▏  | 27485/37963 [68:03:45<22:34:34,  7.76s/it]
 72%|███████▏  | 27486/37963 [68:03:53<22:35:31,  7.76s/it]
 72%|███████▏  | 27487/37963 [68:04:01<22:27:57,  7.72s/it]
 72%|███████▏  | 27488/37963 [68:04:15<28:17:21,  9.72s/it]
 72%|███████▏  | 27489/37963 [68:04:23<26:46:31,  9.20s/it]
 72%|███████▏  | 27490/37963 [68:04:31<25:22:29,  8.72s/it]
                                                           
{'loss': '0.1118', 'grad_norm': '1.702', 'learning_rate': '3.734e-06', 'epoch': '0.7241'}
+
 72%|███████▏  | 27490/37963 [68:04:31<25:22:29,  8.72s/it]
 72%|███████▏  | 27491/37963 [68:04:38<24:32:28,  8.44s/it]
 72%|███████▏  | 27492/37963 [68:04:46<23:42:15,  8.15s/it]
 72%|███████▏  | 27493/37963 [68:04:54<23:25:58,  8.06s/it]
 72%|███████▏  | 27494/37963 [68:05:01<23:07:14,  7.95s/it]
 72%|███████▏  | 27495/37963 [68:05:09<22:58:50,  7.90s/it]
 72%|███████▏  | 27496/37963 [68:05:17<22:44:07,  7.82s/it]
 72%|███████▏  | 27497/37963 [68:05:24<22:37:17,  7.78s/it]
 72%|███████▏  | 27498/37963 [68:05:32<22:30:48,  7.74s/it]
 72%|███████▏  | 27499/37963 [68:05:40<22:22:48,  7.70s/it]
 72%|███████▏  | 27500/37963 [68:05:48<22:29:31,  7.74s/it]
                                                           
{'loss': '0.1057', 'grad_norm': '2.114', 'learning_rate': '3.727e-06', 'epoch': '0.7244'}
+
 72%|███████▏  | 27500/37963 [68:05:48<22:29:31,  7.74s/it]
 72%|███████▏  | 27501/37963 [68:06:02<28:18:24,  9.74s/it]
 72%|███████▏  | 27502/37963 [68:06:10<26:23:42,  9.08s/it]
 72%|███████▏  | 27503/37963 [68:06:17<25:11:10,  8.67s/it]
 72%|███████▏  | 27504/37963 [68:06:25<24:18:37,  8.37s/it]
 72%|███████▏  | 27505/37963 [68:06:32<23:29:11,  8.08s/it]
 72%|███████▏  | 27506/37963 [68:06:40<23:15:09,  8.01s/it]
 72%|███████▏  | 27507/37963 [68:06:48<22:57:32,  7.90s/it]
 72%|███████▏  | 27508/37963 [68:06:55<22:40:03,  7.81s/it]
 72%|███████▏  | 27509/37963 [68:07:03<22:28:17,  7.74s/it]
 72%|███████▏  | 27510/37963 [68:07:11<22:24:39,  7.72s/it]
                                                           
{'loss': '0.1069', 'grad_norm': '1.909', 'learning_rate': '3.72e-06', 'epoch': '0.7247'}
+
 72%|███████▏  | 27510/37963 [68:07:11<22:24:39,  7.72s/it]
 72%|███████▏  | 27511/37963 [68:07:18<22:31:06,  7.76s/it]
 72%|███████▏  | 27512/37963 [68:07:33<28:27:44,  9.80s/it]
 72%|███████▏  | 27513/37963 [68:07:41<26:34:57,  9.16s/it]
 72%|███████▏  | 27514/37963 [68:07:48<25:21:08,  8.73s/it]
 72%|███████▏  | 27515/37963 [68:07:56<24:23:11,  8.40s/it]
 72%|███████▏  | 27516/37963 [68:08:04<23:36:02,  8.13s/it]
 72%|███████▏  | 27517/37963 [68:08:25<35:00:35, 12.07s/it]
 72%|███████▏  | 27518/37963 [68:08:33<31:13:00, 10.76s/it]
 72%|███████▏  | 27519/37963 [68:08:40<28:40:12,  9.88s/it]
 72%|███████▏  | 27520/37963 [68:08:54<32:14:07, 11.11s/it]
                                                           
{'loss': '0.1215', 'grad_norm': '2.244', 'learning_rate': '3.714e-06', 'epoch': '0.7249'}
+
 72%|███████▏  | 27520/37963 [68:08:54<32:14:07, 11.11s/it]
 72%|███████▏  | 27521/37963 [68:09:02<29:15:41, 10.09s/it]
 72%|███████▏  | 27522/37963 [68:09:10<27:10:00,  9.37s/it]
 72%|███████▏  | 27523/37963 [68:09:32<38:28:25, 13.27s/it]
 73%|███████▎  | 27524/37963 [68:09:40<33:41:23, 11.62s/it]
 73%|███████▎  | 27525/37963 [68:09:48<30:18:07, 10.45s/it]
 73%|███████▎  | 27526/37963 [68:09:55<27:57:13,  9.64s/it]
 73%|███████▎  | 27527/37963 [68:10:03<26:06:02,  9.00s/it]
 73%|███████▎  | 27528/37963 [68:10:11<24:55:39,  8.60s/it]
 73%|███████▎  | 27529/37963 [68:10:18<24:06:02,  8.32s/it]
 73%|███████▎  | 27530/37963 [68:10:26<23:32:39,  8.12s/it]
                                                           
{'loss': '0.1228', 'grad_norm': '2.228', 'learning_rate': '3.707e-06', 'epoch': '0.7252'}
+
 73%|███████▎  | 27530/37963 [68:10:26<23:32:39,  8.12s/it]
 73%|███████▎  | 27531/37963 [68:10:34<23:11:22,  8.00s/it]
 73%|███████▎  | 27532/37963 [68:10:41<22:54:34,  7.91s/it]
 73%|███████▎  | 27533/37963 [68:10:49<22:36:47,  7.81s/it]
 73%|███████▎  | 27534/37963 [68:11:03<28:32:08,  9.85s/it]
 73%|███████▎  | 27535/37963 [68:11:11<26:29:20,  9.14s/it]
 73%|███████▎  | 27536/37963 [68:11:19<25:19:09,  8.74s/it]
 73%|███████▎  | 27537/37963 [68:11:26<24:15:03,  8.37s/it]
 73%|███████▎  | 27538/37963 [68:11:34<23:37:51,  8.16s/it]
 73%|███████▎  | 27539/37963 [68:11:42<23:12:15,  8.01s/it]
 73%|███████▎  | 27540/37963 [68:11:49<22:58:32,  7.94s/it]
                                                           
{'loss': '0.09906', 'grad_norm': '2.034', 'learning_rate': '3.701e-06', 'epoch': '0.7254'}
+
 73%|███████▎  | 27540/37963 [68:11:49<22:58:32,  7.94s/it]
 73%|███████▎  | 27541/37963 [68:11:57<22:42:47,  7.85s/it]
 73%|███████▎  | 27542/37963 [68:12:05<22:28:34,  7.76s/it]
 73%|███████▎  | 27543/37963 [68:12:12<22:25:22,  7.75s/it]
 73%|███████▎  | 27544/37963 [68:12:26<27:52:15,  9.63s/it]
 73%|███████▎  | 27545/37963 [68:12:34<26:09:41,  9.04s/it]
 73%|███████▎  | 27546/37963 [68:12:41<24:44:44,  8.55s/it]
 73%|███████▎  | 27547/37963 [68:12:49<24:06:15,  8.33s/it]
 73%|███████▎  | 27548/37963 [68:12:57<23:41:12,  8.19s/it]
 73%|███████▎  | 27549/37963 [68:13:05<23:13:49,  8.03s/it]
 73%|███████▎  | 27550/37963 [68:13:12<22:54:42,  7.92s/it]
                                                           
{'loss': '0.1118', 'grad_norm': '3.115', 'learning_rate': '3.694e-06', 'epoch': '0.7257'}
+
 73%|███████▎  | 27550/37963 [68:13:12<22:54:42,  7.92s/it]
 73%|███████▎  | 27551/37963 [68:13:20<22:43:14,  7.86s/it]
 73%|███████▎  | 27552/37963 [68:13:28<22:29:19,  7.78s/it]
 73%|███████▎  | 27553/37963 [68:13:35<22:20:43,  7.73s/it]
 73%|███████▎  | 27554/37963 [68:13:43<22:17:17,  7.71s/it]
 73%|███████▎  | 27555/37963 [68:13:51<22:11:00,  7.67s/it]
 73%|███████▎  | 27556/37963 [68:14:05<28:08:23,  9.73s/it]
 73%|███████▎  | 27557/37963 [68:14:13<26:31:23,  9.18s/it]
 73%|███████▎  | 27558/37963 [68:14:21<25:29:36,  8.82s/it]
 73%|███████▎  | 27559/37963 [68:14:29<24:31:33,  8.49s/it]
 73%|███████▎  | 27560/37963 [68:14:36<23:46:35,  8.23s/it]
                                                           
{'loss': '0.1214', 'grad_norm': '2.62', 'learning_rate': '3.687e-06', 'epoch': '0.726'}
+
 73%|███████▎  | 27560/37963 [68:14:36<23:46:35,  8.23s/it]
 73%|███████▎  | 27561/37963 [68:14:44<23:22:38,  8.09s/it]
 73%|███████▎  | 27562/37963 [68:14:52<23:04:06,  7.98s/it]
 73%|███████▎  | 27563/37963 [68:14:59<22:47:34,  7.89s/it]
 73%|███████▎  | 27564/37963 [68:15:07<22:41:15,  7.85s/it]
 73%|███████▎  | 27565/37963 [68:15:15<22:40:08,  7.85s/it]
 73%|███████▎  | 27566/37963 [68:15:30<28:34:14,  9.89s/it]
 73%|███████▎  | 27567/37963 [68:15:37<26:29:52,  9.18s/it]
 73%|███████▎  | 27568/37963 [68:15:51<30:54:01, 10.70s/it]
 73%|███████▎  | 27569/37963 [68:15:59<28:16:39,  9.79s/it]
 73%|███████▎  | 27570/37963 [68:16:14<32:25:38, 11.23s/it]
                                                           
{'loss': '0.1188', 'grad_norm': '1.683', 'learning_rate': '3.681e-06', 'epoch': '0.7262'}
+
 73%|███████▎  | 27570/37963 [68:16:14<32:25:38, 11.23s/it]
 73%|███████▎  | 27571/37963 [68:16:35<41:15:44, 14.29s/it]
 73%|███████▎  | 27572/37963 [68:16:43<35:34:00, 12.32s/it]
 73%|███████▎  | 27573/37963 [68:16:51<31:36:48, 10.95s/it]
 73%|███████▎  | 27574/37963 [68:16:58<28:36:16,  9.91s/it]
 73%|███████▎  | 27575/37963 [68:17:06<26:38:15,  9.23s/it]
 73%|███████▎  | 27576/37963 [68:17:13<25:11:23,  8.73s/it]
 73%|███████▎  | 27577/37963 [68:17:21<24:20:25,  8.44s/it]
 73%|███████▎  | 27578/37963 [68:17:29<23:30:37,  8.15s/it]
 73%|███████▎  | 27579/37963 [68:17:36<23:06:07,  8.01s/it]
 73%|███████▎  | 27580/37963 [68:17:44<22:49:46,  7.92s/it]
                                                           
{'loss': '0.1217', 'grad_norm': '1.738', 'learning_rate': '3.674e-06', 'epoch': '0.7265'}
+
 73%|███████▎  | 27580/37963 [68:17:44<22:49:46,  7.92s/it]
 73%|███████▎  | 27581/37963 [68:17:52<22:39:36,  7.86s/it]
 73%|███████▎  | 27582/37963 [68:18:00<22:37:27,  7.85s/it]
 73%|███████▎  | 27583/37963 [68:18:07<22:19:41,  7.74s/it]
 73%|███████▎  | 27584/37963 [68:18:15<22:19:11,  7.74s/it]
 73%|███████▎  | 27585/37963 [68:18:23<22:25:22,  7.78s/it]
 73%|███████▎  | 27586/37963 [68:18:37<28:01:17,  9.72s/it]
 73%|███████▎  | 27587/37963 [68:18:45<26:18:40,  9.13s/it]
 73%|███████▎  | 27588/37963 [68:18:52<25:10:09,  8.73s/it]
 73%|███████▎  | 27589/37963 [68:19:00<24:18:47,  8.44s/it]
 73%|███████▎  | 27590/37963 [68:19:08<23:39:33,  8.21s/it]
                                                           
{'loss': '0.1142', 'grad_norm': '1.504', 'learning_rate': '3.667e-06', 'epoch': '0.7268'}
+
 73%|███████▎  | 27590/37963 [68:19:08<23:39:33,  8.21s/it]
 73%|███████▎  | 27591/37963 [68:19:16<23:14:21,  8.07s/it]
 73%|███████▎  | 27592/37963 [68:19:30<28:34:10,  9.92s/it]
 73%|███████▎  | 27593/37963 [68:19:38<26:39:38,  9.26s/it]
 73%|███████▎  | 27594/37963 [68:19:45<25:16:59,  8.78s/it]
 73%|███████▎  | 27595/37963 [68:19:53<24:20:50,  8.45s/it]
 73%|███████▎  | 27596/37963 [68:20:01<23:51:36,  8.29s/it]
 73%|███████▎  | 27597/37963 [68:20:08<23:14:24,  8.07s/it]
 73%|███████▎  | 27598/37963 [68:20:16<22:58:25,  7.98s/it]
 73%|███████▎  | 27599/37963 [68:20:24<22:32:33,  7.83s/it]
 73%|███████▎  | 27600/37963 [68:20:31<22:25:31,  7.79s/it]
                                                           
{'loss': '0.1141', 'grad_norm': '1.554', 'learning_rate': '3.661e-06', 'epoch': '0.727'}
+
 73%|███████▎  | 27600/37963 [68:20:31<22:25:31,  7.79s/it]
 73%|███████▎  | 27601/37963 [68:20:46<28:26:43,  9.88s/it]
 73%|███████▎  | 27602/37963 [68:20:54<26:44:30,  9.29s/it]
 73%|███████▎  | 27603/37963 [68:21:01<25:10:30,  8.75s/it]
 73%|███████▎  | 27604/37963 [68:21:09<24:13:28,  8.42s/it]
 73%|███████▎  | 27605/37963 [68:21:17<23:35:56,  8.20s/it]
 73%|███████▎  | 27606/37963 [68:21:24<22:57:13,  7.98s/it]
 73%|███████▎  | 27607/37963 [68:21:32<22:41:34,  7.89s/it]
 73%|███████▎  | 27608/37963 [68:21:39<22:18:47,  7.76s/it]
 73%|███████▎  | 27609/37963 [68:21:47<22:20:13,  7.77s/it]
 73%|███████▎  | 27610/37963 [68:21:55<22:14:56,  7.74s/it]
                                                           
{'loss': '0.09615', 'grad_norm': '2.412', 'learning_rate': '3.654e-06', 'epoch': '0.7273'}
+
 73%|███████▎  | 27610/37963 [68:21:55<22:14:56,  7.74s/it]
 73%|███████▎  | 27611/37963 [68:22:03<22:16:35,  7.75s/it]
 73%|███████▎  | 27612/37963 [68:22:17<27:44:20,  9.65s/it]
 73%|███████▎  | 27613/37963 [68:22:24<25:57:58,  9.03s/it]
 73%|███████▎  | 27614/37963 [68:22:32<24:48:48,  8.63s/it]
 73%|███████▎  | 27615/37963 [68:22:39<23:42:10,  8.25s/it]
 73%|███████▎  | 27616/37963 [68:22:54<29:09:21, 10.14s/it]
 73%|███████▎  | 27617/37963 [68:23:02<27:07:29,  9.44s/it]
 73%|███████▎  | 27618/37963 [68:23:16<31:41:13, 11.03s/it]
 73%|███████▎  | 27619/37963 [68:23:24<28:49:47, 10.03s/it]
 73%|███████▎  | 27620/37963 [68:23:32<26:44:46,  9.31s/it]
                                                           
{'loss': '0.1199', 'grad_norm': '2.308', 'learning_rate': '3.648e-06', 'epoch': '0.7276'}
+
 73%|███████▎  | 27620/37963 [68:23:32<26:44:46,  9.31s/it]
 73%|███████▎  | 27621/37963 [68:23:39<25:15:48,  8.79s/it]
 73%|███████▎  | 27622/37963 [68:23:47<24:19:30,  8.47s/it]
 73%|███████▎  | 27623/37963 [68:23:54<23:19:26,  8.12s/it]
 73%|███████▎  | 27624/37963 [68:24:09<29:08:07, 10.14s/it]
 73%|███████▎  | 27625/37963 [68:24:24<32:42:19, 11.39s/it]
 73%|███████▎  | 27626/37963 [68:24:31<29:28:01, 10.26s/it]
 73%|███████▎  | 27627/37963 [68:24:39<27:12:15,  9.48s/it]
 73%|███████▎  | 27628/37963 [68:24:46<25:37:57,  8.93s/it]
 73%|███████▎  | 27629/37963 [68:24:54<24:43:15,  8.61s/it]
 73%|███████▎  | 27630/37963 [68:25:02<24:00:32,  8.36s/it]
                                                           
{'loss': '0.1294', 'grad_norm': '2.043', 'learning_rate': '3.641e-06', 'epoch': '0.7278'}
+
 73%|███████▎  | 27630/37963 [68:25:02<24:00:32,  8.36s/it]
 73%|███████▎  | 27631/37963 [68:25:10<23:24:21,  8.16s/it]
 73%|███████▎  | 27632/37963 [68:25:18<23:03:01,  8.03s/it]
 73%|███████▎  | 27633/37963 [68:25:25<22:45:19,  7.93s/it]
 73%|███████▎  | 27634/37963 [68:25:33<22:33:18,  7.86s/it]
 73%|███████▎  | 27635/37963 [68:25:47<28:03:47,  9.78s/it]
 73%|███████▎  | 27636/37963 [68:25:55<26:18:56,  9.17s/it]
 73%|███████▎  | 27637/37963 [68:26:03<25:03:00,  8.73s/it]
 73%|███████▎  | 27638/37963 [68:26:10<24:09:18,  8.42s/it]
 73%|███████▎  | 27639/37963 [68:26:18<23:33:58,  8.22s/it]
 73%|███████▎  | 27640/37963 [68:26:26<23:10:04,  8.08s/it]
                                                           
{'loss': '0.1256', 'grad_norm': '1.76', 'learning_rate': '3.634e-06', 'epoch': '0.7281'}
+
 73%|███████▎  | 27640/37963 [68:26:26<23:10:04,  8.08s/it]
 73%|███████▎  | 27641/37963 [68:26:33<22:45:32,  7.94s/it]
 73%|███████▎  | 27642/37963 [68:26:41<22:34:07,  7.87s/it]
 73%|���██████▎  | 27643/37963 [68:26:49<22:29:08,  7.84s/it]
 73%|███████▎  | 27644/37963 [68:26:57<22:26:33,  7.83s/it]
 73%|███████▎  | 27645/37963 [68:27:11<28:18:19,  9.88s/it]
 73%|███████▎  | 27646/37963 [68:27:26<32:27:48, 11.33s/it]
 73%|███████▎  | 27647/37963 [68:27:34<29:20:09, 10.24s/it]
 73%|███████▎  | 27648/37963 [68:27:41<27:02:28,  9.44s/it]
 73%|███████▎  | 27649/37963 [68:27:49<25:33:10,  8.92s/it]
 73%|███████▎  | 27650/37963 [68:27:57<24:33:04,  8.57s/it]
                                                           
{'loss': '0.1264', 'grad_norm': '1.862', 'learning_rate': '3.628e-06', 'epoch': '0.7283'}
+
 73%|███████▎  | 27650/37963 [68:27:57<24:33:04,  8.57s/it]
 73%|███████▎  | 27651/37963 [68:28:04<23:44:44,  8.29s/it]
 73%|███████▎  | 27652/37963 [68:28:12<23:01:10,  8.04s/it]
 73%|███████▎  | 27653/37963 [68:28:19<22:29:25,  7.85s/it]
 73%|███████▎  | 27654/37963 [68:28:27<22:13:08,  7.76s/it]
 73%|███████▎  | 27655/37963 [68:28:35<22:11:20,  7.75s/it]
 73%|███████▎  | 27656/37963 [68:28:42<22:09:26,  7.74s/it]
 73%|███████▎  | 27657/37963 [68:28:50<22:07:17,  7.73s/it]
 73%|███████▎  | 27658/37963 [68:28:58<22:06:21,  7.72s/it]
 73%|███████▎  | 27659/37963 [68:29:05<22:05:38,  7.72s/it]
 73%|███████▎  | 27660/37963 [68:29:20<27:46:19,  9.70s/it]
                                                           
{'loss': '0.1198', 'grad_norm': '3.37', 'learning_rate': '3.621e-06', 'epoch': '0.7286'}
+
 73%|███████▎  | 27660/37963 [68:29:20<27:46:19,  9.70s/it]
 73%|███████▎  | 27661/37963 [68:29:27<26:02:52,  9.10s/it]
 73%|███████▎  | 27662/37963 [68:29:35<24:50:23,  8.68s/it]
 73%|███████▎  | 27663/37963 [68:29:43<23:39:36,  8.27s/it]
 73%|███████▎  | 27664/37963 [68:29:57<29:14:04, 10.22s/it]
 73%|███████▎  | 27665/37963 [68:30:05<27:06:35,  9.48s/it]
 73%|███████▎  | 27666/37963 [68:30:13<25:34:08,  8.94s/it]
 73%|███████▎  | 27667/37963 [68:30:21<24:36:13,  8.60s/it]
 73%|███████▎  | 27668/37963 [68:30:28<23:47:06,  8.32s/it]
 73%|███████▎  | 27669/37963 [68:30:36<23:11:46,  8.11s/it]
 73%|███████▎  | 27670/37963 [68:30:50<28:41:25, 10.03s/it]
                                                           
{'loss': '0.1226', 'grad_norm': '1.803', 'learning_rate': '3.615e-06', 'epoch': '0.7289'}
+
 73%|███████▎  | 27670/37963 [68:30:50<28:41:25, 10.03s/it]
 73%|███████▎  | 27671/37963 [68:30:58<26:52:19,  9.40s/it]
 73%|███████▎  | 27672/37963 [68:31:06<25:28:10,  8.91s/it]
 73%|███████▎  | 27673/37963 [68:31:14<24:27:26,  8.56s/it]
 73%|███████▎  | 27674/37963 [68:31:22<23:51:33,  8.35s/it]
 73%|███████▎  | 27675/37963 [68:31:29<23:16:46,  8.15s/it]
 73%|███████▎  | 27676/37963 [68:31:44<29:11:06, 10.21s/it]
 73%|███████▎  | 27677/37963 [68:31:52<27:09:12,  9.50s/it]
 73%|███████▎  | 27678/37963 [68:32:00<25:20:59,  8.87s/it]
 73%|███████▎  | 27679/37963 [68:32:14<30:06:48, 10.54s/it]
 73%|███████▎  | 27680/37963 [68:32:22<27:36:10,  9.66s/it]
                                                           
{'loss': '0.1092', 'grad_norm': '1.947', 'learning_rate': '3.608e-06', 'epoch': '0.7291'}
+
 73%|███████▎  | 27680/37963 [68:32:22<27:36:10,  9.66s/it]
 73%|███████▎  | 27681/37963 [68:32:29<25:35:48,  8.96s/it]
 73%|███████▎  | 27682/37963 [68:32:36<24:23:22,  8.54s/it]
 73%|███████▎  | 27683/37963 [68:32:44<23:30:27,  8.23s/it]
 73%|███████▎  | 27684/37963 [68:32:52<23:08:10,  8.10s/it]
 73%|███████▎  | 27685/37963 [68:33:00<22:50:07,  8.00s/it]
 73%|███████▎  | 27686/37963 [68:33:07<22:33:52,  7.90s/it]
 73%|███████▎  | 27687/37963 [68:33:21<27:39:16,  9.69s/it]
 73%|███████▎  | 27688/37963 [68:33:29<25:56:38,  9.09s/it]
 73%|███████▎  | 27689/37963 [68:33:37<24:47:04,  8.68s/it]
 73%|███████▎  | 27690/37963 [68:33:44<24:03:22,  8.43s/it]
                                                           
{'loss': '0.1109', 'grad_norm': '1.612', 'learning_rate': '3.602e-06', 'epoch': '0.7294'}
+
 73%|███████▎  | 27690/37963 [68:33:44<24:03:22,  8.43s/it]
 73%|███████▎  | 27691/37963 [68:33:52<23:35:04,  8.27s/it]
 73%|███████▎  | 27692/37963 [68:34:00<23:08:21,  8.11s/it]
 73%|███████▎  | 27693/37963 [68:34:08<22:52:49,  8.02s/it]
 73%|███████▎  | 27694/37963 [68:34:15<22:35:22,  7.92s/it]
 73%|███████▎  | 27695/37963 [68:34:30<28:33:00, 10.01s/it]
 73%|███████▎  | 27696/37963 [68:34:38<26:36:54,  9.33s/it]
 73%|███████▎  | 27697/37963 [68:34:53<30:58:02, 10.86s/it]
 73%|███████▎  | 27698/37963 [68:35:01<28:35:16, 10.03s/it]
 73%|███████▎  | 27699/37963 [68:35:08<26:25:21,  9.27s/it]
 73%|███████▎  | 27700/37963 [68:35:16<25:02:12,  8.78s/it]
                                                           
{'loss': '0.1222', 'grad_norm': '1.858', 'learning_rate': '3.595e-06', 'epoch': '0.7297'}
+
 73%|███████▎  | 27700/37963 [68:35:16<25:02:12,  8.78s/it]
 73%|███████▎  | 27701/37963 [68:35:24<24:13:08,  8.50s/it]
 73%|███████▎  | 27702/37963 [68:35:31<23:34:15,  8.27s/it]
 73%|███████▎  | 27703/37963 [68:35:39<22:54:34,  8.04s/it]
 73%|███████▎  | 27704/37963 [68:35:47<22:43:31,  7.97s/it]
 73%|███████▎  | 27705/37963 [68:36:01<28:19:29,  9.94s/it]
 73%|███████▎  | 27706/37963 [68:36:09<26:27:56,  9.29s/it]
 73%|███████▎  | 27707/37963 [68:36:17<25:09:54,  8.83s/it]
 73%|███████▎  | 27708/37963 [68:36:24<24:11:18,  8.49s/it]
 73%|███████▎  | 27709/37963 [68:36:32<23:29:53,  8.25s/it]
 73%|███████▎  | 27710/37963 [68:36:40<22:58:21,  8.07s/it]
                                                           
{'loss': '0.09826', 'grad_norm': '1.681', 'learning_rate': '3.589e-06', 'epoch': '0.7299'}
+
 73%|███████▎  | 27710/37963 [68:36:40<22:58:21,  8.07s/it]
 73%|███████▎  | 27711/37963 [68:36:47<22:31:49,  7.91s/it]
 73%|███████▎  | 27712/37963 [68:36:55<22:20:41,  7.85s/it]
 73%|███████▎  | 27713/37963 [68:37:03<22:11:41,  7.80s/it]
 73%|███████▎  | 27714/37963 [68:37:10<22:02:47,  7.74s/it]
 73%|███████▎  | 27715/37963 [68:37:25<28:06:21,  9.87s/it]
 73%|███████▎  | 27716/37963 [68:37:33<26:02:07,  9.15s/it]
 73%|███████▎  | 27717/37963 [68:37:40<24:47:47,  8.71s/it]
 73%|███████▎  | 27718/37963 [68:37:48<24:04:17,  8.46s/it]
 73%|███████▎  | 27719/37963 [68:37:55<23:05:15,  8.11s/it]
 73%|███████▎  | 27720/37963 [68:38:10<28:32:41, 10.03s/it]
                                                           
{'loss': '0.1148', 'grad_norm': '2.82', 'learning_rate': '3.582e-06', 'epoch': '0.7302'}
+
 73%|███████▎  | 27720/37963 [68:38:10<28:32:41, 10.03s/it]
 73%|███████▎  | 27721/37963 [68:38:18<26:35:09,  9.34s/it]
 73%|███████▎  | 27722/37963 [68:38:25<25:13:27,  8.87s/it]
 73%|███████▎  | 27723/37963 [68:38:40<29:58:28, 10.54s/it]
 73%|███████▎  | 27724/37963 [68:38:48<27:36:26,  9.71s/it]
 73%|███████▎  | 27725/37963 [68:38:55<25:54:14,  9.11s/it]
 73%|███████▎  | 27726/37963 [68:39:10<30:58:36, 10.89s/it]
 73%|███████▎  | 27727/37963 [68:39:18<28:15:59,  9.94s/it]
 73%|███████▎  | 27728/37963 [68:39:26<26:14:47,  9.23s/it]
 73%|███████▎  | 27729/37963 [68:39:33<24:56:47,  8.78s/it]
 73%|███████▎  | 27730/37963 [68:39:41<24:08:13,  8.49s/it]
                                                           
{'loss': '0.1209', 'grad_norm': '3.289', 'learning_rate': '3.575e-06', 'epoch': '0.7305'}
+
 73%|███████▎  | 27730/37963 [68:39:41<24:08:13,  8.49s/it]
 73%|███████▎  | 27731/37963 [68:39:49<23:38:20,  8.32s/it]
 73%|███████▎  | 27732/37963 [68:39:57<23:07:15,  8.14s/it]
 73%|███████▎  | 27733/37963 [68:40:05<22:39:55,  7.98s/it]
 73%|███████▎  | 27734/37963 [68:40:12<22:27:06,  7.90s/it]
 73%|███████▎  | 27735/37963 [68:40:20<22:28:18,  7.91s/it]
 73%|███████▎  | 27736/37963 [68:40:28<22:18:26,  7.85s/it]
 73%|███████▎  | 27737/37963 [68:40:35<21:58:22,  7.74s/it]
 73%|███████▎  | 27738/37963 [68:40:50<27:33:34,  9.70s/it]
 73%|███████▎  | 27739/37963 [68:40:57<25:57:44,  9.14s/it]
 73%|███████▎  | 27740/37963 [68:41:05<24:43:54,  8.71s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '3.935', 'learning_rate': '3.569e-06', 'epoch': '0.7307'}
+
 73%|███████▎  | 27740/37963 [68:41:05<24:43:54,  8.71s/it]
 73%|███████▎  | 27741/37963 [68:41:13<23:43:10,  8.35s/it]
 73%|███████▎  | 27742/37963 [68:41:20<23:08:25,  8.15s/it]
 73%|███████▎  | 27743/37963 [68:41:28<22:51:43,  8.05s/it]
 73%|███████▎  | 27744/37963 [68:41:43<28:25:25, 10.01s/it]
 73%|███████▎  | 27745/37963 [68:41:57<32:15:17, 11.36s/it]
 73%|███████▎  | 27746/37963 [68:42:05<29:06:35, 10.26s/it]
 73%|███████▎  | 27747/37963 [68:42:13<26:55:32,  9.49s/it]
 73%|███████▎  | 27748/37963 [68:42:20<25:25:48,  8.96s/it]
 73%|███████▎  | 27749/37963 [68:42:28<24:24:49,  8.60s/it]
 73%|███████▎  | 27750/37963 [68:42:36<23:38:17,  8.33s/it]
                                                           
{'loss': '0.1164', 'grad_norm': '4.158', 'learning_rate': '3.562e-06', 'epoch': '0.731'}
+
 73%|███████▎  | 27750/37963 [68:42:36<23:38:17,  8.33s/it]
 73%|███████▎  | 27751/37963 [68:42:44<23:09:55,  8.17s/it]
 73%|███████▎  | 27752/37963 [68:42:51<22:43:43,  8.01s/it]
 73%|███████▎  | 27753/37963 [68:42:59<22:20:12,  7.88s/it]
 73%|███████▎  | 27754/37963 [68:43:07<22:09:56,  7.82s/it]
 73%|███████▎  | 27755/37963 [68:43:14<22:02:47,  7.78s/it]
 73%|███████▎  | 27756/37963 [68:43:22<21:55:04,  7.73s/it]
 73%|███████▎  | 27757/37963 [68:43:30<21:52:31,  7.72s/it]
 73%|███████▎  | 27758/37963 [68:43:37<21:48:22,  7.69s/it]
 73%|███████▎  | 27759/37963 [68:43:52<27:45:02,  9.79s/it]
 73%|███████▎  | 27760/37963 [68:44:00<25:58:27,  9.16s/it]
                                                           
{'loss': '0.1101', 'grad_norm': '1.572', 'learning_rate': '3.556e-06', 'epoch': '0.7312'}
+
 73%|███████▎  | 27760/37963 [68:44:00<25:58:27,  9.16s/it]
 73%|███████▎  | 27761/37963 [68:44:07<24:24:27,  8.61s/it]
 73%|███████▎  | 27762/37963 [68:44:15<23:41:35,  8.36s/it]
 73%|███████▎  | 27763/37963 [68:44:22<23:13:37,  8.20s/it]
 73%|███████▎  | 27764/37963 [68:44:37<28:38:32, 10.11s/it]
 73%|███████▎  | 27765/37963 [68:44:45<26:49:37,  9.47s/it]
 73%|███████▎  | 27766/37963 [68:44:53<25:20:04,  8.94s/it]
 73%|███████▎  | 27767/37963 [68:45:07<29:56:27, 10.57s/it]
 73%|███████▎  | 27768/37963 [68:45:15<27:21:39,  9.66s/it]
 73%|███████▎  | 27769/37963 [68:45:30<31:55:32, 11.27s/it]
 73%|███████▎  | 27770/37963 [68:45:38<28:58:50, 10.24s/it]
                                                           
{'loss': '0.1046', 'grad_norm': '1.463', 'learning_rate': '3.549e-06', 'epoch': '0.7315'}
+
 73%|███████▎  | 27770/37963 [68:45:38<28:58:50, 10.24s/it]
 73%|███████▎  | 27771/37963 [68:45:45<26:42:52,  9.44s/it]
 73%|███████▎  | 27772/37963 [68:45:53<25:19:40,  8.95s/it]
 73%|███████▎  | 27773/37963 [68:46:01<24:16:38,  8.58s/it]
 73%|███████▎  | 27774/37963 [68:46:08<23:41:40,  8.37s/it]
 73%|███████▎  | 27775/37963 [68:46:23<29:13:21, 10.33s/it]
 73%|███████▎  | 27776/37963 [68:46:31<26:59:10,  9.54s/it]
 73%|███████▎  | 27777/37963 [68:46:39<25:22:26,  8.97s/it]
 73%|███████▎  | 27778/37963 [68:46:46<24:19:19,  8.60s/it]
 73%|███████▎  | 27779/37963 [68:46:54<23:36:09,  8.34s/it]
 73%|███████▎  | 27780/37963 [68:47:02<23:04:39,  8.16s/it]
                                                           
{'loss': '0.1157', 'grad_norm': '2.622', 'learning_rate': '3.543e-06', 'epoch': '0.7318'}
+
 73%|███████▎  | 27780/37963 [68:47:02<23:04:39,  8.16s/it]
 73%|███████▎  | 27781/37963 [68:47:10<22:40:07,  8.01s/it]
 73%|███████▎  | 27782/37963 [68:47:17<22:25:07,  7.93s/it]
 73%|███████▎  | 27783/37963 [68:47:31<27:42:17,  9.80s/it]
 73%|███████▎  | 27784/37963 [68:47:39<25:55:25,  9.17s/it]
 73%|███████▎  | 27785/37963 [68:47:47<24:39:13,  8.72s/it]
 73%|███████▎  | 27786/37963 [68:47:54<23:43:14,  8.39s/it]
 73%|███████▎  | 27787/37963 [68:48:02<23:06:45,  8.18s/it]
 73%|███████▎  | 27788/37963 [68:48:10<22:43:09,  8.04s/it]
 73%|███████▎  | 27789/37963 [68:48:24<28:00:40,  9.91s/it]
 73%|███████▎  | 27790/37963 [68:48:32<26:15:40,  9.29s/it]
                                                           
{'loss': '0.1131', 'grad_norm': '1.803', 'learning_rate': '3.536e-06', 'epoch': '0.732'}
+
 73%|███████▎  | 27790/37963 [68:48:32<26:15:40,  9.29s/it]
 73%|███████▎  | 27791/37963 [68:48:40<24:50:18,  8.79s/it]
 73%|███████▎  | 27792/37963 [68:48:47<23:55:52,  8.47s/it]
 73%|███████▎  | 27793/37963 [68:49:02<28:48:50, 10.20s/it]
 73%|███████▎  | 27794/37963 [68:49:10<26:55:35,  9.53s/it]
 73%|███████▎  | 27795/37963 [68:49:17<25:26:31,  9.01s/it]
 73%|███████▎  | 27796/37963 [68:49:25<24:23:07,  8.63s/it]
 73%|███████▎  | 27797/37963 [68:49:33<23:32:10,  8.33s/it]
 73%|███████▎  | 27798/37963 [68:49:40<22:58:16,  8.14s/it]
 73%|███████▎  | 27799/37963 [68:49:48<22:38:28,  8.02s/it]
 73%|███████▎  | 27800/37963 [68:49:56<22:19:35,  7.91s/it]
                                                           
{'loss': '0.1173', 'grad_norm': '2.54', 'learning_rate': '3.53e-06', 'epoch': '0.7323'}
+
 73%|███████▎  | 27800/37963 [68:49:56<22:19:35,  7.91s/it]
 73%|███████▎  | 27801/37963 [68:50:04<22:11:10,  7.86s/it]
 73%|███████▎  | 27802/37963 [68:50:11<22:00:16,  7.80s/it]
 73%|███████▎  | 27803/37963 [68:50:19<21:52:04,  7.75s/it]
 73%|███████▎  | 27804/37963 [68:50:26<21:46:41,  7.72s/it]
 73%|███████▎  | 27805/37963 [68:50:34<21:44:19,  7.70s/it]
 73%|███████▎  | 27806/37963 [68:50:42<21:46:07,  7.72s/it]
 73%|███████▎  | 27807/37963 [68:50:56<27:17:24,  9.67s/it]
 73%|███████▎  | 27808/37963 [68:51:04<25:29:27,  9.04s/it]
 73%|███████▎  | 27809/37963 [68:51:18<29:38:20, 10.51s/it]
 73%|███████▎  | 27810/37963 [68:51:25<27:14:23,  9.66s/it]
                                                           
{'loss': '0.1313', 'grad_norm': '2.687', 'learning_rate': '3.523e-06', 'epoch': '0.7326'}
+
 73%|███████▎  | 27810/37963 [68:51:25<27:14:23,  9.66s/it]
 73%|███████▎  | 27811/37963 [68:51:33<25:32:52,  9.06s/it]
 73%|███████▎  | 27812/37963 [68:51:41<24:28:20,  8.68s/it]
 73%|███████▎  | 27813/37963 [68:51:49<23:41:15,  8.40s/it]
 73%|███████▎  | 27814/37963 [68:51:56<23:08:57,  8.21s/it]
 73%|███████▎  | 27815/37963 [68:52:04<22:26:43,  7.96s/it]
 73%|███████▎  | 27816/37963 [68:52:11<22:14:36,  7.89s/it]
 73%|███████▎  | 27817/37963 [68:52:26<28:13:38, 10.02s/it]
 73%|███████▎  | 27818/37963 [68:52:34<26:21:44,  9.35s/it]
 73%|███████▎  | 27819/37963 [68:52:42<24:44:43,  8.78s/it]
 73%|███████▎  | 27820/37963 [68:52:56<29:15:41, 10.39s/it]
                                                           
{'loss': '0.119', 'grad_norm': '1.925', 'learning_rate': '3.517e-06', 'epoch': '0.7328'}
+
 73%|███████▎  | 27820/37963 [68:52:56<29:15:41, 10.39s/it]
 73%|███████▎  | 27821/37963 [68:53:03<26:47:46,  9.51s/it]
 73%|███████▎  | 27822/37963 [68:53:18<31:19:31, 11.12s/it]
 73%|███████▎  | 27823/37963 [68:53:26<28:22:30, 10.07s/it]
 73%|███████▎  | 27824/37963 [68:53:33<26:23:31,  9.37s/it]
 73%|███████▎  | 27825/37963 [68:53:41<24:55:02,  8.85s/it]
 73%|███████▎  | 27826/37963 [68:53:49<23:49:23,  8.46s/it]
 73%|███████▎  | 27827/37963 [68:54:03<28:44:29, 10.21s/it]
 73%|███████▎  | 27828/37963 [68:54:11<26:33:26,  9.43s/it]
 73%|███████▎  | 27829/37963 [68:54:18<25:08:43,  8.93s/it]
 73%|███████▎  | 27830/37963 [68:54:26<24:09:20,  8.58s/it]
                                                           
{'loss': '0.116', 'grad_norm': '2.689', 'learning_rate': '3.51e-06', 'epoch': '0.7331'}
+
 73%|███████▎  | 27830/37963 [68:54:26<24:09:20,  8.58s/it]
 73%|███████▎  | 27831/37963 [68:54:34<23:15:07,  8.26s/it]
 73%|███████▎  | 27832/37963 [68:54:41<22:41:55,  8.07s/it]
 73%|███████▎  | 27833/37963 [68:54:49<22:25:52,  7.97s/it]
 73%|███████▎  | 27834/37963 [68:54:57<22:13:56,  7.90s/it]
 73%|███████▎  | 27835/37963 [68:55:04<22:02:05,  7.83s/it]
 73%|███████▎  | 27836/37963 [68:55:12<21:59:38,  7.82s/it]
 73%|███████▎  | 27837/37963 [68:55:26<27:18:59,  9.71s/it]
 73%|███████▎  | 27838/37963 [68:55:34<25:41:37,  9.14s/it]
 73%|███████▎  | 27839/37963 [68:55:42<24:26:29,  8.69s/it]
 73%|███████▎  | 27840/37963 [68:55:49<23:33:00,  8.38s/it]
                                                           
{'loss': '0.1204', 'grad_norm': '1.779', 'learning_rate': '3.504e-06', 'epoch': '0.7333'}
+
 73%|███████▎  | 27840/37963 [68:55:49<23:33:00,  8.38s/it]
 73%|███████▎  | 27841/37963 [68:55:57<22:59:36,  8.18s/it]
 73%|███████▎  | 27842/37963 [68:56:05<22:26:55,  7.98s/it]
 73%|███████▎  | 27843/37963 [68:56:19<28:13:38, 10.04s/it]
 73%|███████▎  | 27844/37963 [68:56:28<26:32:58,  9.45s/it]
 73%|███████▎  | 27845/37963 [68:56:35<25:08:40,  8.95s/it]
 73%|███████▎  | 27846/37963 [68:56:43<24:11:02,  8.61s/it]
 73%|███████▎  | 27847/37963 [68:56:51<23:20:47,  8.31s/it]
 73%|███████▎  | 27848/37963 [68:56:58<22:48:37,  8.12s/it]
 73%|███████▎  | 27849/37963 [68:57:06<22:22:30,  7.96s/it]
 73%|███████▎  | 27850/37963 [68:57:14<22:18:47,  7.94s/it]
                                                           
{'loss': '0.1094', 'grad_norm': '1.929', 'learning_rate': '3.497e-06', 'epoch': '0.7336'}
+
 73%|███████▎  | 27850/37963 [68:57:14<22:18:47,  7.94s/it]
 73%|███████▎  | 27851/37963 [68:57:21<21:50:18,  7.77s/it]
 73%|███████▎  | 27852/37963 [68:57:29<21:36:18,  7.69s/it]
 73%|███████▎  | 27853/37963 [68:57:37<21:38:00,  7.70s/it]
 73%|███████▎  | 27854/37963 [68:57:51<27:02:22,  9.63s/it]
 73%|███████▎  | 27855/37963 [68:57:58<25:28:48,  9.07s/it]
 73%|███████▎  | 27856/37963 [68:58:06<24:11:33,  8.62s/it]
 73%|███████▎  | 27857/37963 [68:58:21<29:20:49, 10.45s/it]
 73%|███████▎  | 27858/37963 [68:58:29<27:11:06,  9.68s/it]
 73%|███████▎  | 27859/37963 [68:58:36<25:28:00,  9.07s/it]
 73%|███████▎  | 27860/37963 [68:58:44<24:15:16,  8.64s/it]
                                                           
{'loss': '0.1079', 'grad_norm': '2.159', 'learning_rate': '3.491e-06', 'epoch': '0.7339'}
+
 73%|███████▎  | 27860/37963 [68:58:44<24:15:16,  8.64s/it]
 73%|███████▎  | 27861/37963 [68:58:52<23:31:48,  8.39s/it]
 73%|███████▎  | 27862/37963 [68:58:59<23:00:44,  8.20s/it]
 73%|███████▎  | 27863/37963 [68:59:07<22:20:05,  7.96s/it]
 73%|███████▎  | 27864/37963 [68:59:14<22:04:35,  7.87s/it]
 73%|███████▎  | 27865/37963 [68:59:22<21:39:27,  7.72s/it]
 73%|███████▎  | 27866/37963 [68:59:37<27:38:11,  9.85s/it]
 73%|███████▎  | 27867/37963 [68:59:45<25:59:39,  9.27s/it]
 73%|███████▎  | 27868/37963 [68:59:52<24:38:24,  8.79s/it]
 73%|███████▎  | 27869/37963 [69:00:07<29:52:57, 10.66s/it]
 73%|███████▎  | 27870/37963 [69:00:15<27:39:13,  9.86s/it]
                                                           
{'loss': '0.119', 'grad_norm': '2.271', 'learning_rate': '3.484e-06', 'epoch': '0.7341'}
+
 73%|███████▎  | 27870/37963 [69:00:15<27:39:13,  9.86s/it]
 73%|███████▎  | 27871/37963 [69:00:23<25:48:46,  9.21s/it]
 73%|███████▎  | 27872/37963 [69:00:31<24:28:10,  8.73s/it]
 73%|███████▎  | 27873/37963 [69:00:38<23:30:33,  8.39s/it]
 73%|███████▎  | 27874/37963 [69:00:53<28:42:33, 10.24s/it]
 73%|███████▎  | 27875/37963 [69:01:07<32:04:37, 11.45s/it]
 73%|███████▎  | 27876/37963 [69:01:15<29:04:39, 10.38s/it]
 73%|███████▎  | 27877/37963 [69:01:23<26:47:23,  9.56s/it]
 73%|███████▎  | 27878/37963 [69:01:30<25:10:07,  8.98s/it]
 73%|███████▎  | 27879/37963 [69:01:38<23:54:52,  8.54s/it]
 73%|███████▎  | 27880/37963 [69:01:45<23:14:59,  8.30s/it]
                                                           
{'loss': '0.1181', 'grad_norm': '2.266', 'learning_rate': '3.478e-06', 'epoch': '0.7344'}
+
 73%|███████▎  | 27880/37963 [69:01:45<23:14:59,  8.30s/it]
 73%|███████▎  | 27881/37963 [69:02:00<28:21:55, 10.13s/it]
 73%|███████▎  | 27882/37963 [69:02:07<26:17:37,  9.39s/it]
 73%|███████▎  | 27883/37963 [69:02:15<24:55:28,  8.90s/it]
 73%|███████▎  | 27884/37963 [69:02:23<23:51:28,  8.52s/it]
 73%|███████▎  | 27885/37963 [69:02:30<23:04:43,  8.24s/it]
 73%|███████▎  | 27886/37963 [69:02:38<22:34:15,  8.06s/it]
 73%|███████▎  | 27887/37963 [69:02:46<22:19:42,  7.98s/it]
 73%|███████▎  | 27888/37963 [69:02:53<21:54:52,  7.83s/it]
 73%|███████▎  | 27889/37963 [69:03:01<21:46:56,  7.78s/it]
 73%|███████▎  | 27890/37963 [69:03:09<21:40:02,  7.74s/it]
                                                           
{'loss': '0.1179', 'grad_norm': '3.651', 'learning_rate': '3.471e-06', 'epoch': '0.7347'}
+
 73%|███████▎  | 27890/37963 [69:03:09<21:40:02,  7.74s/it]
 73%|███████▎  | 27891/37963 [69:03:24<27:35:33,  9.86s/it]
 73%|███████▎  | 27892/37963 [69:03:31<25:59:52,  9.29s/it]
 73%|███████▎  | 27893/37963 [69:03:39<24:38:51,  8.81s/it]
 73%|███████▎  | 27894/37963 [69:03:47<23:41:21,  8.47s/it]
 73%|███████▎  | 27895/37963 [69:03:55<23:03:02,  8.24s/it]
 73%|███████▎  | 27896/37963 [69:04:02<22:36:52,  8.09s/it]
 73%|███████▎  | 27897/37963 [69:04:10<22:14:49,  7.96s/it]
 73%|███████▎  | 27898/37963 [69:04:18<22:01:16,  7.88s/it]
 73%|███████▎  | 27899/37963 [69:04:25<21:52:47,  7.83s/it]
 73%|███████▎  | 27900/37963 [69:04:39<27:10:22,  9.72s/it]
                                                           
{'loss': '0.1196', 'grad_norm': '3.131', 'learning_rate': '3.465e-06', 'epoch': '0.7349'}
+
 73%|███████▎  | 27900/37963 [69:04:39<27:10:22,  9.72s/it]
 73%|███████▎  | 27901/37963 [69:04:54<31:15:09, 11.18s/it]
 73%|███████▎  | 27902/37963 [69:05:02<28:21:24, 10.15s/it]
 74%|███████▎  | 27903/37963 [69:05:09<26:16:06,  9.40s/it]
 74%|███████▎  | 27904/37963 [69:05:17<24:35:47,  8.80s/it]
 74%|███████▎  | 27905/37963 [69:05:25<23:39:19,  8.47s/it]
 74%|███████▎  | 27906/37963 [69:05:32<22:58:26,  8.22s/it]
 74%|███████▎  | 27907/37963 [69:05:40<22:26:49,  8.04s/it]
 74%|███████▎  | 27908/37963 [69:05:48<22:10:18,  7.94s/it]
 74%|███████▎  | 27909/37963 [69:05:55<21:54:42,  7.85s/it]
 74%|███████▎  | 27910/37963 [69:06:03<21:41:00,  7.76s/it]
                                                           
{'loss': '0.1066', 'grad_norm': '2.244', 'learning_rate': '3.459e-06', 'epoch': '0.7352'}
+
 74%|███████▎  | 27910/37963 [69:06:03<21:41:00,  7.76s/it]
 74%|███████▎  | 27911/37963 [69:06:10<21:38:32,  7.75s/it]
 74%|███████▎  | 27912/37963 [69:06:18<21:41:37,  7.77s/it]
 74%|███████▎  | 27913/37963 [69:06:26<21:37:00,  7.74s/it]
 74%|███████▎  | 27914/37963 [69:06:41<27:26:38,  9.83s/it]
 74%|███████▎  | 27915/37963 [69:06:56<32:08:02, 11.51s/it]
 74%|███████▎  | 27916/37963 [69:07:04<29:01:18, 10.40s/it]
 74%|███████▎  | 27917/37963 [69:07:11<26:36:22,  9.53s/it]
 74%|███████▎  | 27918/37963 [69:07:19<25:02:45,  8.98s/it]
 74%|███████▎  | 27919/37963 [69:07:33<29:25:39, 10.55s/it]
 74%|███████▎  | 27920/37963 [69:07:41<27:00:43,  9.68s/it]
                                                           
{'loss': '0.1162', 'grad_norm': '3.244', 'learning_rate': '3.452e-06', 'epoch': '0.7355'}
+
 74%|███████▎  | 27920/37963 [69:07:41<27:00:43,  9.68s/it]
 74%|███████▎  | 27921/37963 [69:07:55<31:00:19, 11.12s/it]
 74%|███████▎  | 27922/37963 [69:08:03<28:12:52, 10.12s/it]
 74%|███████▎  | 27923/37963 [69:08:11<26:18:35,  9.43s/it]
 74%|███████▎  | 27924/37963 [69:08:25<30:19:50, 10.88s/it]
 74%|███████▎  | 27925/37963 [69:08:33<27:29:16,  9.86s/it]
 74%|███████▎  | 27926/37963 [69:08:41<25:48:56,  9.26s/it]
 74%|███████▎  | 27927/37963 [69:08:48<24:16:34,  8.71s/it]
 74%|███████▎  | 27928/37963 [69:08:56<23:23:45,  8.39s/it]
 74%|███████▎  | 27929/37963 [69:09:03<22:46:52,  8.17s/it]
 74%|███████▎  | 27930/37963 [69:09:11<22:20:51,  8.02s/it]
                                                           
{'loss': '0.1135', 'grad_norm': '2.361', 'learning_rate': '3.446e-06', 'epoch': '0.7357'}
+
 74%|███████▎  | 27930/37963 [69:09:11<22:20:51,  8.02s/it]
 74%|███████▎  | 27931/37963 [69:09:19<22:12:45,  7.97s/it]
 74%|███████▎  | 27932/37963 [69:09:27<22:05:44,  7.93s/it]
 74%|███████▎  | 27933/37963 [69:09:34<21:48:40,  7.83s/it]
 74%|███████▎  | 27934/37963 [69:09:42<21:38:34,  7.77s/it]
 74%|███████▎  | 27935/37963 [69:09:50<21:36:53,  7.76s/it]
 74%|███████▎  | 27936/37963 [69:09:57<21:29:29,  7.72s/it]
 74%|███████▎  | 27937/37963 [69:10:05<21:32:35,  7.74s/it]
 74%|███████▎  | 27938/37963 [69:10:13<21:38:15,  7.77s/it]
 74%|███████▎  | 27939/37963 [69:10:21<21:45:14,  7.81s/it]
 74%|███████▎  | 27940/37963 [69:10:28<21:37:47,  7.77s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '1.955', 'learning_rate': '3.439e-06', 'epoch': '0.736'}
+
 74%|███████▎  | 27940/37963 [69:10:28<21:37:47,  7.77s/it]
 74%|███████▎  | 27941/37963 [69:10:36<21:21:51,  7.67s/it]
 74%|███████▎  | 27942/37963 [69:10:43<21:11:16,  7.61s/it]
 74%|███████▎  | 27943/37963 [69:10:51<21:18:53,  7.66s/it]
 74%|███████▎  | 27944/37963 [69:10:59<21:16:18,  7.64s/it]
 74%|███████▎  | 27945/37963 [69:11:13<27:09:47,  9.76s/it]
 74%|███████▎  | 27946/37963 [69:11:28<31:25:55, 11.30s/it]
 74%|███████▎  | 27947/37963 [69:11:36<28:30:09, 10.24s/it]
 74%|███████▎  | 27948/37963 [69:11:44<26:19:45,  9.46s/it]
 74%|███████▎  | 27949/37963 [69:11:52<25:03:23,  9.01s/it]
 74%|███████▎  | 27950/37963 [69:12:00<24:04:34,  8.66s/it]
                                                           
{'loss': '0.1213', 'grad_norm': '1.854', 'learning_rate': '3.433e-06', 'epoch': '0.7362'}
+
 74%|███████▎  | 27950/37963 [69:12:00<24:04:34,  8.66s/it]
 74%|███████▎  | 27951/37963 [69:12:07<23:06:07,  8.31s/it]
 74%|███████▎  | 27952/37963 [69:12:15<22:34:33,  8.12s/it]
 74%|███████▎  | 27953/37963 [69:12:22<22:14:07,  8.00s/it]
 74%|███████▎  | 27954/37963 [69:12:30<21:59:52,  7.91s/it]
 74%|███████▎  | 27955/37963 [69:12:45<27:42:31,  9.97s/it]
 74%|███████▎  | 27956/37963 [69:12:53<25:45:54,  9.27s/it]
 74%|███████▎  | 27957/37963 [69:13:00<24:28:25,  8.81s/it]
 74%|███████▎  | 27958/37963 [69:13:15<29:22:25, 10.57s/it]
 74%|███████▎  | 27959/37963 [69:13:23<27:09:56,  9.78s/it]
 74%|███████▎  | 27960/37963 [69:13:31<25:21:41,  9.13s/it]
                                                           
{'loss': '0.1186', 'grad_norm': '2.151', 'learning_rate': '3.426e-06', 'epoch': '0.7365'}
+
 74%|███████▎  | 27960/37963 [69:13:31<25:21:41,  9.13s/it]
 74%|███████▎  | 27961/37963 [69:13:38<23:55:41,  8.61s/it]
 74%|███████▎  | 27962/37963 [69:13:52<28:40:06, 10.32s/it]
 74%|███████▎  | 27963/37963 [69:14:07<32:37:05, 11.74s/it]
 74%|███████▎  | 27964/37963 [69:14:15<29:11:56, 10.51s/it]
 74%|███████▎  | 27965/37963 [69:14:23<26:51:28,  9.67s/it]
 74%|███████▎  | 27966/37963 [69:14:30<25:10:45,  9.07s/it]
 74%|███████▎  | 27967/37963 [69:14:38<23:52:54,  8.60s/it]
 74%|███████▎  | 27968/37963 [69:14:45<23:06:35,  8.32s/it]
 74%|███████▎  | 27969/37963 [69:15:00<27:54:19, 10.05s/it]
 74%|███████▎  | 27970/37963 [69:15:07<26:05:33,  9.40s/it]
                                                           
{'loss': '0.1116', 'grad_norm': '2.14', 'learning_rate': '3.42e-06', 'epoch': '0.7368'}
+
 74%|███████▎  | 27970/37963 [69:15:07<26:05:33,  9.40s/it]
 74%|███████▎  | 27971/37963 [69:15:15<24:49:43,  8.95s/it]
 74%|███████▎  | 27972/37963 [69:15:23<23:36:08,  8.50s/it]
 74%|███████▎  | 27973/37963 [69:15:37<28:35:17, 10.30s/it]
 74%|███████▎  | 27974/37963 [69:15:45<26:25:39,  9.52s/it]
 74%|███████▎  | 27975/37963 [69:15:53<24:53:56,  8.97s/it]
 74%|███████▎  | 27976/37963 [69:16:00<23:50:35,  8.59s/it]
 74%|███████▎  | 27977/37963 [69:16:08<23:06:48,  8.33s/it]
 74%|███████▎  | 27978/37963 [69:16:16<22:42:53,  8.19s/it]
 74%|███████▎  | 27979/37963 [69:16:24<22:24:12,  8.08s/it]
 74%|███████▎  | 27980/37963 [69:16:31<22:02:01,  7.95s/it]
                                                           
{'loss': '0.1206', 'grad_norm': '2.116', 'learning_rate': '3.413e-06', 'epoch': '0.737'}
+
 74%|███████▎  | 27980/37963 [69:16:31<22:02:01,  7.95s/it]
 74%|███████▎  | 27981/37963 [69:16:39<21:53:07,  7.89s/it]
 74%|███████▎  | 27982/37963 [69:16:47<21:47:13,  7.86s/it]
 74%|███████▎  | 27983/37963 [69:16:55<21:31:02,  7.76s/it]
 74%|███████▎  | 27984/37963 [69:17:02<21:13:37,  7.66s/it]
 74%|███████▎  | 27985/37963 [69:17:10<21:21:17,  7.70s/it]
 74%|███████▎  | 27986/37963 [69:17:17<21:21:44,  7.71s/it]
 74%|███████▎  | 27987/37963 [69:17:25<21:18:11,  7.69s/it]
 74%|███████▎  | 27988/37963 [69:17:33<21:15:39,  7.67s/it]
 74%|███████▎  | 27989/37963 [69:17:40<21:02:17,  7.59s/it]
 74%|███████▎  | 27990/37963 [69:17:54<26:38:00,  9.61s/it]
                                                           
{'loss': '0.1114', 'grad_norm': '1.985', 'learning_rate': '3.407e-06', 'epoch': '0.7373'}
+
 74%|███████▎  | 27990/37963 [69:17:55<26:38:00,  9.61s/it]
 74%|███████▎  | 27991/37963 [69:18:02<24:58:26,  9.02s/it]
 74%|███████▎  | 27992/37963 [69:18:10<23:49:23,  8.60s/it]
 74%|███████▎  | 27993/37963 [69:18:25<29:00:03, 10.47s/it]
 74%|███████▎  | 27994/37963 [69:18:32<26:41:22,  9.64s/it]
 74%|███████▎  | 27995/37963 [69:18:40<25:02:13,  9.04s/it]
 74%|███████▎  | 27996/37963 [69:18:47<23:45:23,  8.58s/it]
 74%|███████▎  | 27997/37963 [69:18:55<23:00:28,  8.31s/it]
 74%|███████▍  | 27998/37963 [69:19:03<22:15:48,  8.04s/it]
 74%|███████▍  | 27999/37963 [69:19:10<21:57:31,  7.93s/it]
 74%|███████▍  | 28000/37963 [69:19:18<21:46:32,  7.87s/it]
                                                           
{'loss': '0.09678', 'grad_norm': '1.625', 'learning_rate': '3.401e-06', 'epoch': '0.7376'}
+
 74%|███████▍  | 28000/37963 [69:19:18<21:46:32,  7.87s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.67s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.67s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 74%|███████▍  | 28001/37963 [69:20:21<67:51:15, 24.52s/it]
 74%|███████▍  | 28002/37963 [69:20:29<54:00:04, 19.52s/it]
 74%|███████▍  | 28003/37963 [69:20:43<49:37:11, 17.93s/it]
 74%|███████▍  | 28004/37963 [69:20:51<41:24:57, 14.97s/it]
 74%|███████▍  | 28005/37963 [69:20:59<35:16:26, 12.75s/it]
 74%|███████▍  | 28006/37963 [69:21:07<31:08:38, 11.26s/it]
 74%|███████▍  | 28007/37963 [69:21:15<28:16:01, 10.22s/it]
 74%|███████▍  | 28008/37963 [69:21:22<26:10:53,  9.47s/it]
 74%|███████▍  | 28009/37963 [69:21:36<29:44:16, 10.76s/it]
 74%|███████▍  | 28010/37963 [69:21:51<33:31:53, 12.13s/it]
                                                           
{'loss': '0.1191', 'grad_norm': '2.878', 'learning_rate': '3.394e-06', 'epoch': '0.7378'}
+
 74%|███████▍  | 28010/37963 [69:21:51<33:31:53, 12.13s/it]
 74%|███████▍  | 28011/37963 [69:21:59<29:58:49, 10.84s/it]
 74%|███████▍  | 28012/37963 [69:22:07<27:10:47,  9.83s/it]
 74%|███████▍  | 28013/37963 [69:22:14<25:22:45,  9.18s/it]
 74%|███████▍  | 28014/37963 [69:22:22<24:11:03,  8.75s/it]
 74%|███████▍  | 28015/37963 [69:22:36<28:45:38, 10.41s/it]
 74%|███████▍  | 28016/37963 [69:22:44<26:44:39,  9.68s/it]
 74%|███████▍  | 28017/37963 [69:22:52<25:08:43,  9.10s/it]
 74%|███████▍  | 28018/37963 [69:23:06<29:21:40, 10.63s/it]
 74%|███████▍  | 28019/37963 [69:23:14<26:54:20,  9.74s/it]
 74%|███████▍  | 28020/37963 [69:23:22<25:21:30,  9.18s/it]
                                                           
{'loss': '0.09696', 'grad_norm': '2.175', 'learning_rate': '3.388e-06', 'epoch': '0.7381'}
+
 74%|███████▍  | 28020/37963 [69:23:22<25:21:30,  9.18s/it]
 74%|███████▍  | 28021/37963 [69:23:30<24:06:04,  8.73s/it]
 74%|███████▍  | 28022/37963 [69:23:37<23:11:08,  8.40s/it]
 74%|███████▍  | 28023/37963 [69:23:45<22:40:32,  8.21s/it]
 74%|███████▍  | 28024/37963 [69:23:53<22:14:23,  8.06s/it]
 74%|███████▍  | 28025/37963 [69:24:00<21:56:24,  7.95s/it]
 74%|███████▍  | 28026/37963 [69:24:08<21:40:13,  7.85s/it]
 74%|███████▍  | 28027/37963 [69:24:16<21:26:49,  7.77s/it]
 74%|███████▍  | 28028/37963 [69:24:23<21:30:58,  7.80s/it]
 74%|███████▍  | 28029/37963 [69:24:31<21:26:59,  7.77s/it]
 74%|███████▍  | 28030/37963 [69:24:39<21:16:32,  7.71s/it]
                                                           
{'loss': '0.1075', 'grad_norm': '2.208', 'learning_rate': '3.381e-06', 'epoch': '0.7384'}
+
 74%|███████▍  | 28030/37963 [69:24:39<21:16:32,  7.71s/it]
 74%|███████▍  | 28031/37963 [69:24:46<21:11:38,  7.68s/it]
 74%|███████▍  | 28032/37963 [69:24:54<21:14:29,  7.70s/it]
 74%|███████▍  | 28033/37963 [69:25:02<21:15:24,  7.71s/it]
 74%|███████▍  | 28034/37963 [69:25:09<21:13:25,  7.70s/it]
 74%|███████▍  | 28035/37963 [69:25:24<26:36:04,  9.65s/it]
 74%|███████▍  | 28036/37963 [69:25:31<25:01:44,  9.08s/it]
 74%|███████▍  | 28037/37963 [69:25:39<23:52:11,  8.66s/it]
 74%|███████▍  | 28038/37963 [69:25:47<22:58:46,  8.34s/it]
 74%|███████▍  | 28039/37963 [69:25:54<22:24:52,  8.13s/it]
 74%|███████▍  | 28040/37963 [69:26:02<22:00:00,  7.98s/it]
                                                           
{'loss': '0.1126', 'grad_norm': '2.168', 'learning_rate': '3.375e-06', 'epoch': '0.7386'}
+
 74%|███████▍  | 28040/37963 [69:26:02<22:00:00,  7.98s/it]
 74%|███████▍  | 28041/37963 [69:26:16<27:10:17,  9.86s/it]
 74%|███████▍  | 28042/37963 [69:26:24<25:24:17,  9.22s/it]
 74%|███████▍  | 28043/37963 [69:26:32<24:11:24,  8.78s/it]
 74%|███████▍  | 28044/37963 [69:26:39<23:01:39,  8.36s/it]
 74%|███████▍  | 28045/37963 [69:26:47<22:31:33,  8.18s/it]
 74%|███████▍  | 28046/37963 [69:26:54<22:07:50,  8.03s/it]
 74%|███████▍  | 28047/37963 [69:27:02<21:49:59,  7.93s/it]
 74%|███████▍  | 28048/37963 [69:27:17<27:40:57, 10.05s/it]
 74%|███████▍  | 28049/37963 [69:27:25<25:51:04,  9.39s/it]
 74%|███████▍  | 28050/37963 [69:27:39<29:25:32, 10.69s/it]
                                                           
{'loss': '0.116', 'grad_norm': '1.716', 'learning_rate': '3.369e-06', 'epoch': '0.7389'}
+
 74%|███████▍  | 28050/37963 [69:27:39<29:25:32, 10.69s/it]
 74%|███████▍  | 28051/37963 [69:27:46<26:49:30,  9.74s/it]
 74%|███████▍  | 28052/37963 [69:27:54<25:12:26,  9.16s/it]
 74%|███████▍  | 28053/37963 [69:28:02<24:05:12,  8.75s/it]
 74%|███████▍  | 28054/37963 [69:28:10<23:13:33,  8.44s/it]
 74%|███████▍  | 28055/37963 [69:28:17<22:32:14,  8.19s/it]
 74%|███████▍  | 28056/37963 [69:28:25<21:59:51,  7.99s/it]
 74%|███████▍  | 28057/37963 [69:28:40<27:43:02, 10.07s/it]
 74%|███████▍  | 28058/37963 [69:28:47<25:49:39,  9.39s/it]
 74%|███████▍  | 28059/37963 [69:28:55<24:15:53,  8.82s/it]
 74%|███████▍  | 28060/37963 [69:29:03<23:20:31,  8.49s/it]
                                                           
{'loss': '0.1132', 'grad_norm': '2.897', 'learning_rate': '3.362e-06', 'epoch': '0.7391'}
+
 74%|███████▍  | 28060/37963 [69:29:03<23:20:31,  8.49s/it]
 74%|███████▍  | 28061/37963 [69:29:10<22:46:10,  8.28s/it]
 74%|███████▍  | 28062/37963 [69:29:18<22:21:49,  8.13s/it]
 74%|███████▍  | 28063/37963 [69:29:26<22:05:25,  8.03s/it]
 74%|███████▍  | 28064/37963 [69:29:40<27:07:37,  9.87s/it]
 74%|███████▍  | 28065/37963 [69:29:48<25:27:20,  9.26s/it]
 74%|███████▍  | 28066/37963 [69:30:03<29:48:12, 10.84s/it]
 74%|███████▍  | 28067/37963 [69:30:10<27:15:21,  9.92s/it]
 74%|███████▍  | 28068/37963 [69:30:18<25:30:34,  9.28s/it]
 74%|███████▍  | 28069/37963 [69:30:32<29:36:05, 10.77s/it]
 74%|███████▍  | 28070/37963 [69:30:40<27:04:01,  9.85s/it]
                                                           
{'loss': '0.1203', 'grad_norm': '2.185', 'learning_rate': '3.356e-06', 'epoch': '0.7394'}
+
 74%|███████▍  | 28070/37963 [69:30:40<27:04:01,  9.85s/it]
 74%|███████▍  | 28071/37963 [69:30:47<25:05:30,  9.13s/it]
 74%|███████▍  | 28072/37963 [69:30:55<23:50:39,  8.68s/it]
 74%|███████▍  | 28073/37963 [69:31:03<23:01:09,  8.38s/it]
 74%|███████▍  | 28074/37963 [69:31:11<22:29:21,  8.19s/it]
 74%|███████▍  | 28075/37963 [69:31:18<22:08:34,  8.06s/it]
 74%|███████▍  | 28076/37963 [69:31:26<21:35:38,  7.86s/it]
 74%|███████▍  | 28077/37963 [69:31:34<21:36:13,  7.87s/it]
 74%|███████▍  | 28078/37963 [69:31:41<21:27:31,  7.82s/it]
 74%|███████▍  | 28079/37963 [69:31:49<21:16:37,  7.75s/it]
 74%|███████▍  | 28080/37963 [69:31:56<21:09:13,  7.71s/it]
                                                           
{'loss': '0.111', 'grad_norm': '2.015', 'learning_rate': '3.35e-06', 'epoch': '0.7397'}
+
 74%|███████▍  | 28080/37963 [69:31:56<21:09:13,  7.71s/it]
 74%|███████▍  | 28081/37963 [69:32:04<21:11:57,  7.72s/it]
 74%|███████▍  | 28082/37963 [69:32:12<21:11:37,  7.72s/it]
 74%|███████▍  | 28083/37963 [69:32:20<21:19:10,  7.77s/it]
 74%|███████▍  | 28084/37963 [69:32:27<21:11:09,  7.72s/it]
 74%|███████▍  | 28085/37963 [69:32:42<26:52:04,  9.79s/it]
 74%|███████▍  | 28086/37963 [69:32:50<25:10:22,  9.18s/it]
 74%|███████▍  | 28087/37963 [69:33:04<29:01:32, 10.58s/it]
 74%|███████▍  | 28088/37963 [69:33:11<26:28:07,  9.65s/it]
 74%|███████▍  | 28089/37963 [69:33:19<25:11:08,  9.18s/it]
 74%|███████▍  | 28090/37963 [69:33:27<23:56:10,  8.73s/it]
                                                           
{'loss': '0.1141', 'grad_norm': '2.395', 'learning_rate': '3.343e-06', 'epoch': '0.7399'}
+
 74%|███████▍  | 28090/37963 [69:33:27<23:56:10,  8.73s/it]
 74%|███████▍  | 28091/37963 [69:33:34<22:57:46,  8.37s/it]
 74%|███████▍  | 28092/37963 [69:33:42<22:31:31,  8.22s/it]
 74%|███████▍  | 28093/37963 [69:33:50<21:52:27,  7.98s/it]
 74%|███████▍  | 28094/37963 [69:34:04<27:00:14,  9.85s/it]
 74%|███████▍  | 28095/37963 [69:34:19<31:33:06, 11.51s/it]
 74%|███████▍  | 28096/37963 [69:34:27<28:15:17, 10.31s/it]
 74%|███████▍  | 28097/37963 [69:34:34<26:04:21,  9.51s/it]
 74%|███████▍  | 28098/37963 [69:34:42<24:28:48,  8.93s/it]
 74%|███████▍  | 28099/37963 [69:34:50<23:28:40,  8.57s/it]
 74%|███████▍  | 28100/37963 [69:34:57<22:46:54,  8.32s/it]
                                                           
{'loss': '0.1049', 'grad_norm': '2.741', 'learning_rate': '3.337e-06', 'epoch': '0.7402'}
+
 74%|███████▍  | 28100/37963 [69:34:57<22:46:54,  8.32s/it]
 74%|███████▍  | 28101/37963 [69:35:05<22:16:20,  8.13s/it]
 74%|███████▍  | 28102/37963 [69:35:13<21:54:53,  8.00s/it]
 74%|███████▍  | 28103/37963 [69:35:21<21:39:39,  7.91s/it]
 74%|███████▍  | 28104/37963 [69:35:28<21:17:59,  7.78s/it]
 74%|███████▍  | 28105/37963 [69:35:36<21:22:46,  7.81s/it]
 74%|███████▍  | 28106/37963 [69:35:50<26:45:33,  9.77s/it]
 74%|███████▍  | 28107/37963 [69:35:58<25:07:01,  9.17s/it]
 74%|███████▍  | 28108/37963 [69:36:06<23:54:50,  8.74s/it]
 74%|███████▍  | 28109/37963 [69:36:13<22:59:20,  8.40s/it]
 74%|███████▍  | 28110/37963 [69:36:21<22:24:14,  8.19s/it]
                                                           
{'loss': '0.1199', 'grad_norm': '2.947', 'learning_rate': '3.33e-06', 'epoch': '0.7405'}
+
 74%|███████▍  | 28110/37963 [69:36:21<22:24:14,  8.19s/it]
 74%|███████▍  | 28111/37963 [69:36:35<27:26:26, 10.03s/it]
 74%|███████▍  | 28112/37963 [69:36:43<25:32:04,  9.33s/it]
 74%|███████▍  | 28113/37963 [69:36:51<23:57:54,  8.76s/it]
 74%|███████▍  | 28114/37963 [69:36:58<23:10:11,  8.47s/it]
 74%|███████▍  | 28115/37963 [69:37:13<27:58:58, 10.23s/it]
 74%|███████▍  | 28116/37963 [69:37:20<25:46:21,  9.42s/it]
 74%|███████▍  | 28117/37963 [69:37:28<24:28:30,  8.95s/it]
 74%|███████▍  | 28118/37963 [69:37:36<23:20:42,  8.54s/it]
 74%|███████▍  | 28119/37963 [69:37:50<28:04:33, 10.27s/it]
 74%|███████▍  | 28120/37963 [69:37:58<25:53:44,  9.47s/it]
                                                           
{'loss': '0.117', 'grad_norm': '2.493', 'learning_rate': '3.324e-06', 'epoch': '0.7407'}
+
 74%|███████▍  | 28120/37963 [69:37:58<25:53:44,  9.47s/it]
 74%|███████▍  | 28121/37963 [69:38:05<24:26:21,  8.94s/it]
 74%|███████▍  | 28122/37963 [69:38:13<23:31:43,  8.61s/it]
 74%|███████▍  | 28123/37963 [69:38:21<22:50:06,  8.35s/it]
 74%|███████▍  | 28124/37963 [69:38:28<22:14:22,  8.14s/it]
 74%|███████▍  | 28125/37963 [69:38:36<21:52:36,  8.01s/it]
 74%|███████▍  | 28126/37963 [69:38:44<21:36:50,  7.91s/it]
 74%|███████▍  | 28127/37963 [69:38:52<21:31:08,  7.88s/it]
 74%|███████▍  | 28128/37963 [69:38:59<21:20:24,  7.81s/it]
 74%|███████▍  | 28129/37963 [69:39:07<21:09:22,  7.74s/it]
 74%|███████▍  | 28130/37963 [69:39:15<21:07:34,  7.73s/it]
                                                           
{'loss': '0.1157', 'grad_norm': '1.477', 'learning_rate': '3.318e-06', 'epoch': '0.741'}
+
 74%|███████▍  | 28130/37963 [69:39:15<21:07:34,  7.73s/it]
 74%|███████▍  | 28131/37963 [69:39:22<20:52:51,  7.65s/it]
 74%|███████▍  | 28132/37963 [69:39:30<20:53:20,  7.65s/it]
 74%|███████▍  | 28133/37963 [69:39:37<21:00:13,  7.69s/it]
 74%|███████▍  | 28134/37963 [69:39:45<20:55:20,  7.66s/it]
 74%|███████▍  | 28135/37963 [69:39:53<21:07:11,  7.74s/it]
 74%|███████▍  | 28136/37963 [69:40:07<26:25:50,  9.68s/it]
 74%|███████▍  | 28137/37963 [69:40:22<30:29:09, 11.17s/it]
 74%|███████▍  | 28138/37963 [69:40:30<27:50:40, 10.20s/it]
 74%|███████▍  | 28139/37963 [69:40:37<25:44:51,  9.44s/it]
 74%|███████▍  | 28140/37963 [69:40:45<24:17:41,  8.90s/it]
                                                           
{'loss': '0.1074', 'grad_norm': '1.81', 'learning_rate': '3.311e-06', 'epoch': '0.7413'}
+
 74%|███████▍  | 28140/37963 [69:40:45<24:17:41,  8.90s/it]
 74%|███████▍  | 28141/37963 [69:40:52<23:02:49,  8.45s/it]
 74%|███████▍  | 28142/37963 [69:41:00<22:25:14,  8.22s/it]
 74%|███████▍  | 28143/37963 [69:41:21<33:05:53, 12.13s/it]
 74%|███████▍  | 28144/37963 [69:41:29<29:22:38, 10.77s/it]
 74%|███████▍  | 28145/37963 [69:41:37<26:54:27,  9.87s/it]
 74%|███████▍  | 28146/37963 [69:41:45<25:09:15,  9.22s/it]
 74%|███████▍  | 28147/37963 [69:41:52<23:55:26,  8.77s/it]
 74%|███████▍  | 28148/37963 [69:42:00<23:02:37,  8.45s/it]
 74%|███████▍  | 28149/37963 [69:42:08<22:26:47,  8.23s/it]
 74%|███████▍  | 28150/37963 [69:42:15<21:59:42,  8.07s/it]
                                                           
{'loss': '0.1017', 'grad_norm': '3.303', 'learning_rate': '3.305e-06', 'epoch': '0.7415'}
+
 74%|███████▍  | 28150/37963 [69:42:15<21:59:42,  8.07s/it]
 74%|███████▍  | 28151/37963 [69:42:23<21:43:12,  7.97s/it]
 74%|███████▍  | 28152/37963 [69:42:31<21:21:56,  7.84s/it]
 74%|███████▍  | 28153/37963 [69:42:38<21:16:44,  7.81s/it]
 74%|███████▍  | 28154/37963 [69:42:46<21:13:05,  7.79s/it]
 74%|███████▍  | 28155/37963 [69:43:01<27:01:44,  9.92s/it]
 74%|███████▍  | 28156/37963 [69:43:09<25:11:16,  9.25s/it]
 74%|█████��█▍  | 28157/37963 [69:43:16<23:37:27,  8.67s/it]
 74%|███████▍  | 28158/37963 [69:43:24<22:52:52,  8.40s/it]
 74%|███████▍  | 28159/37963 [69:43:38<27:34:45, 10.13s/it]
 74%|███████▍  | 28160/37963 [69:43:46<25:33:52,  9.39s/it]
                                                           
{'loss': '0.1046', 'grad_norm': '2.773', 'learning_rate': '3.299e-06', 'epoch': '0.7418'}
+
 74%|███████▍  | 28160/37963 [69:43:46<25:33:52,  9.39s/it]
 74%|███████▍  | 28161/37963 [69:43:53<24:08:40,  8.87s/it]
 74%|███████▍  | 28162/37963 [69:44:01<23:06:51,  8.49s/it]
 74%|███████▍  | 28163/37963 [69:44:09<22:31:15,  8.27s/it]
 74%|███████▍  | 28164/37963 [69:44:23<27:14:59, 10.01s/it]
 74%|███████▍  | 28165/37963 [69:44:30<25:20:03,  9.31s/it]
 74%|███████▍  | 28166/37963 [69:44:38<24:07:22,  8.86s/it]
 74%|███████▍  | 28167/37963 [69:44:46<23:18:21,  8.56s/it]
 74%|███████▍  | 28168/37963 [69:44:54<22:43:08,  8.35s/it]
 74%|███████▍  | 28169/37963 [69:45:02<22:12:10,  8.16s/it]
 74%|███████▍  | 28170/37963 [69:45:09<21:49:05,  8.02s/it]
                                                           
{'loss': '0.118', 'grad_norm': '3.514', 'learning_rate': '3.292e-06', 'epoch': '0.742'}
+
 74%|███████▍  | 28170/37963 [69:45:09<21:49:05,  8.02s/it]
 74%|███████▍  | 28171/37963 [69:45:17<21:28:38,  7.90s/it]
 74%|███████▍  | 28172/37963 [69:45:24<21:11:29,  7.79s/it]
 74%|███████▍  | 28173/37963 [69:45:39<26:20:55,  9.69s/it]
 74%|███████▍  | 28174/37963 [69:45:46<24:43:42,  9.09s/it]
 74%|███████▍  | 28175/37963 [69:45:54<23:34:09,  8.67s/it]
 74%|███████▍  | 28176/37963 [69:46:02<22:41:37,  8.35s/it]
 74%|███████▍  | 28177/37963 [69:46:09<22:10:21,  8.16s/it]
 74%|███████▍  | 28178/37963 [69:46:17<21:46:24,  8.01s/it]
 74%|███████▍  | 28179/37963 [69:46:25<21:37:04,  7.95s/it]
 74%|███████▍  | 28180/37963 [69:46:32<21:23:24,  7.87s/it]
                                                           
{'loss': '0.1107', 'grad_norm': '2.006', 'learning_rate': '3.286e-06', 'epoch': '0.7423'}
+
 74%|███████▍  | 28180/37963 [69:46:32<21:23:24,  7.87s/it]
 74%|███████▍  | 28181/37963 [69:46:40<21:06:31,  7.77s/it]
 74%|███████▍  | 28182/37963 [69:46:48<21:06:53,  7.77s/it]
 74%|███████▍  | 28183/37963 [69:46:56<21:06:00,  7.77s/it]
 74%|███████▍  | 28184/37963 [69:47:03<21:00:22,  7.73s/it]
 74%|███████▍  | 28185/37963 [69:47:11<20:54:24,  7.70s/it]
 74%|███████▍  | 28186/37963 [69:47:18<20:50:27,  7.67s/it]
 74%|███████▍  | 28187/37963 [69:47:26<20:45:07,  7.64s/it]
 74%|███████▍  | 28188/37963 [69:47:47<32:00:24, 11.79s/it]
 74%|███████▍  | 28189/37963 [69:47:55<28:45:16, 10.59s/it]
 74%|███████▍  | 28190/37963 [69:48:03<26:24:26,  9.73s/it]
                                                           
{'loss': '0.1084', 'grad_norm': '2.888', 'learning_rate': '3.28e-06', 'epoch': '0.7426'}
+
 74%|███████▍  | 28190/37963 [69:48:03<26:24:26,  9.73s/it]
 74%|███████▍  | 28191/37963 [69:48:10<24:35:21,  9.06s/it]
 74%|███████▍  | 28192/37963 [69:48:18<23:25:10,  8.63s/it]
 74%|███████▍  | 28193/37963 [69:48:39<33:25:18, 12.32s/it]
 74%|███████▍  | 28194/37963 [69:48:46<29:26:56, 10.85s/it]
 74%|███████▍  | 28195/37963 [69:48:54<26:53:00,  9.91s/it]
 74%|███████▍  | 28196/37963 [69:49:02<25:12:40,  9.29s/it]
 74%|███████▍  | 28197/37963 [69:49:10<24:02:03,  8.86s/it]
 74%|███████▍  | 28198/37963 [69:49:18<23:11:14,  8.55s/it]
 74%|███████▍  | 28199/37963 [69:49:25<22:25:46,  8.27s/it]
 74%|███████▍  | 28200/37963 [69:49:33<21:49:24,  8.05s/it]
                                                           
{'loss': '0.1063', 'grad_norm': '2.943', 'learning_rate': '3.273e-06', 'epoch': '0.7428'}
+
 74%|███████▍  | 28200/37963 [69:49:33<21:49:24,  8.05s/it]
 74%|███████▍  | 28201/37963 [69:49:40<21:22:56,  7.89s/it]
 74%|███████▍  | 28202/37963 [69:49:48<21:12:29,  7.82s/it]
 74%|███████▍  | 28203/37963 [69:50:09<32:18:53, 11.92s/it]
 74%|███████▍  | 28204/37963 [69:50:17<28:45:43, 10.61s/it]
 74%|███████▍  | 28205/37963 [69:50:24<26:10:22,  9.66s/it]
 74%|███████▍  | 28206/37963 [69:50:32<24:35:18,  9.07s/it]
 74%|███████▍  | 28207/37963 [69:50:40<23:33:34,  8.69s/it]
 74%|███████▍  | 28208/37963 [69:50:48<22:49:04,  8.42s/it]
 74%|███████▍  | 28209/37963 [69:50:55<22:11:37,  8.19s/it]
 74%|███████▍  | 28210/37963 [69:51:03<21:39:29,  7.99s/it]
                                                           
{'loss': '0.1146', 'grad_norm': '2.178', 'learning_rate': '3.267e-06', 'epoch': '0.7431'}
+
 74%|███████▍  | 28210/37963 [69:51:03<21:39:29,  7.99s/it]
 74%|███████▍  | 28211/37963 [69:51:11<21:19:51,  7.87s/it]
 74%|███████▍  | 28212/37963 [69:51:18<21:16:06,  7.85s/it]
 74%|███████▍  | 28213/37963 [69:51:26<21:03:27,  7.78s/it]
 74%|███████▍  | 28214/37963 [69:51:34<20:56:14,  7.73s/it]
 74%|███████▍  | 28215/37963 [69:51:41<20:56:01,  7.73s/it]
 74%|███████▍  | 28216/37963 [69:51:49<20:55:27,  7.73s/it]
 74%|███████▍  | 28217/37963 [69:51:57<20:50:59,  7.70s/it]
 74%|███████▍  | 28218/37963 [69:52:11<25:54:56,  9.57s/it]
 74%|███████▍  | 28219/37963 [69:52:19<24:35:08,  9.08s/it]
 74%|███████▍  | 28220/37963 [69:52:26<23:19:13,  8.62s/it]
                                                           
{'loss': '0.1051', 'grad_norm': '1.996', 'learning_rate': '3.261e-06', 'epoch': '0.7434'}
+
 74%|███████▍  | 28220/37963 [69:52:26<23:19:13,  8.62s/it]
 74%|███████▍  | 28221/37963 [69:52:40<27:51:44, 10.30s/it]
 74%|███████▍  | 28222/37963 [69:52:48<25:43:59,  9.51s/it]
 74%|███████▍  | 28223/37963 [69:52:56<24:13:26,  8.95s/it]
 74%|███████▍  | 28224/37963 [69:53:03<23:07:13,  8.55s/it]
 74%|███████▍  | 28225/37963 [69:53:11<22:20:07,  8.26s/it]
 74%|███████▍  | 28226/37963 [69:53:19<21:59:15,  8.13s/it]
 74%|███████▍  | 28227/37963 [69:53:26<21:37:39,  8.00s/it]
 74%|███████▍  | 28228/37963 [69:53:34<21:24:36,  7.92s/it]
 74%|███████▍  | 28229/37963 [69:53:42<21:18:16,  7.88s/it]
 74%|███████▍  | 28230/37963 [69:53:50<21:11:43,  7.84s/it]
                                                           
{'loss': '0.1177', 'grad_norm': '2.729', 'learning_rate': '3.255e-06', 'epoch': '0.7436'}
+
 74%|███████▍  | 28230/37963 [69:53:50<21:11:43,  7.84s/it]
 74%|███████▍  | 28231/37963 [69:53:57<20:56:55,  7.75s/it]
 74%|███████▍  | 28232/37963 [69:54:05<21:00:46,  7.77s/it]
 74%|███████▍  | 28233/37963 [69:54:13<20:50:24,  7.71s/it]
 74%|███████▍  | 28234/37963 [69:54:20<20:44:00,  7.67s/it]
 74%|███████▍  | 28235/37963 [69:54:28<20:45:27,  7.68s/it]
 74%|███████▍  | 28236/37963 [69:54:43<26:31:58,  9.82s/it]
 74%|███████▍  | 28237/37963 [69:54:50<24:49:35,  9.19s/it]
 74%|███████▍  | 28238/37963 [69:54:58<23:35:39,  8.73s/it]
 74%|███████▍  | 28239/37963 [69:55:06<22:37:56,  8.38s/it]
 74%|███████▍  | 28240/37963 [69:55:20<27:41:07, 10.25s/it]
                                                           
{'loss': '0.09773', 'grad_norm': '2.363', 'learning_rate': '3.248e-06', 'epoch': '0.7439'}
+
 74%|███████▍  | 28240/37963 [69:55:20<27:41:07, 10.25s/it]
 74%|███████▍  | 28241/37963 [69:55:28<25:37:22,  9.49s/it]
 74%|███████▍  | 28242/37963 [69:55:36<24:09:00,  8.94s/it]
 74%|███████▍  | 28243/37963 [69:55:43<22:55:17,  8.49s/it]
 74%|███████▍  | 28244/37963 [69:55:58<27:49:15, 10.31s/it]
 74%|███████▍  | 28245/37963 [69:56:05<25:45:30,  9.54s/it]
 74%|███████▍  | 28246/37963 [69:56:13<24:12:15,  8.97s/it]
 74%|███████▍  | 28247/37963 [69:56:27<28:10:47, 10.44s/it]
 74%|███████▍  | 28248/37963 [69:56:34<25:54:17,  9.60s/it]
 74%|███████▍  | 28249/37963 [69:56:42<24:11:05,  8.96s/it]
 74%|███████▍  | 28250/37963 [69:56:50<23:09:44,  8.58s/it]
                                                           
{'loss': '0.1054', 'grad_norm': '2.123', 'learning_rate': '3.242e-06', 'epoch': '0.7441'}
+
 74%|███████▍  | 28250/37963 [69:56:50<23:09:44,  8.58s/it]
 74%|███████▍  | 28251/37963 [69:56:57<22:25:50,  8.31s/it]
 74%|███████▍  | 28252/37963 [69:57:05<21:48:17,  8.08s/it]
 74%|███████▍  | 28253/37963 [69:57:12<21:25:22,  7.94s/it]
 74%|███████▍  | 28254/37963 [69:57:20<21:15:29,  7.88s/it]
 74%|███████▍  | 28255/37963 [69:57:28<21:04:12,  7.81s/it]
 74%|███████▍  | 28256/37963 [69:57:42<26:20:59,  9.77s/it]
 74%|███████▍  | 28257/37963 [69:57:50<24:45:24,  9.18s/it]
 74%|███████▍  | 28258/37963 [69:57:58<23:33:44,  8.74s/it]
 74%|███████▍  | 28259/37963 [69:58:06<22:54:38,  8.50s/it]
 74%|███████▍  | 28260/37963 [69:58:13<22:05:17,  8.20s/it]
                                                           
{'loss': '0.1148', 'grad_norm': '2.6', 'learning_rate': '3.236e-06', 'epoch': '0.7444'}
+
 74%|███████▍  | 28260/37963 [69:58:13<22:05:17,  8.20s/it]
 74%|███████▍  | 28261/37963 [69:58:21<21:53:07,  8.12s/it]
 74%|███████▍  | 28262/37963 [69:58:29<21:34:38,  8.01s/it]
 74%|███████▍  | 28263/37963 [69:58:36<21:09:51,  7.85s/it]
 74%|███████▍  | 28264/37963 [69:58:44<20:57:20,  7.78s/it]
 74%|███████▍  | 28265/37963 [69:58:52<20:53:33,  7.76s/it]
 74%|███████▍  | 28266/37963 [69:58:59<20:42:20,  7.69s/it]
 74%|███████▍  | 28267/37963 [69:59:07<20:47:24,  7.72s/it]
 74%|███████▍  | 28268/37963 [69:59:21<26:00:49,  9.66s/it]
 74%|███████▍  | 28269/37963 [69:59:29<24:24:23,  9.06s/it]
 74%|███████▍  | 28270/37963 [69:59:36<23:05:43,  8.58s/it]
                                                           
{'loss': '0.11', 'grad_norm': '1.864', 'learning_rate': '3.229e-06', 'epoch': '0.7447'}
+
 74%|███████▍  | 28270/37963 [69:59:36<23:05:43,  8.58s/it]
 74%|███████▍  | 28271/37963 [69:59:44<22:14:41,  8.26s/it]
 74%|███████▍  | 28272/37963 [69:59:52<21:51:53,  8.12s/it]
 74%|███████▍  | 28273/37963 [70:00:06<26:39:17,  9.90s/it]
 74%|███████▍  | 28274/37963 [70:00:13<24:52:25,  9.24s/it]
 74%|███████▍  | 28275/37963 [70:00:21<23:39:14,  8.79s/it]
 74%|███████▍  | 28276/37963 [70:00:29<22:42:18,  8.44s/it]
 74%|███████▍  | 28277/37963 [70:00:36<22:03:00,  8.20s/it]
 74%|███████▍  | 28278/37963 [70:00:44<21:40:26,  8.06s/it]
 74%|███████▍  | 28279/37963 [70:00:52<21:29:29,  7.99s/it]
 74%|███████▍  | 28280/37963 [70:01:00<21:13:55,  7.89s/it]
                                                           
{'loss': '0.09976', 'grad_norm': '1.397', 'learning_rate': '3.223e-06', 'epoch': '0.7449'}
+
 74%|███████▍  | 28280/37963 [70:01:00<21:13:55,  7.89s/it]
 74%|███████▍  | 28281/37963 [70:01:07<20:41:34,  7.69s/it]
 74%|███████▍  | 28282/37963 [70:01:21<26:15:26,  9.76s/it]
 75%|███████▍  | 28283/37963 [70:01:29<24:40:08,  9.17s/it]
 75%|███████▍  | 28284/37963 [70:01:37<23:27:36,  8.73s/it]
 75%|███████▍  | 28285/37963 [70:01:45<22:38:40,  8.42s/it]
 75%|███████▍  | 28286/37963 [70:01:52<22:02:57,  8.20s/it]
 75%|███████▍  | 28287/37963 [70:02:07<27:04:27, 10.07s/it]
 75%|███████▍  | 28288/37963 [70:02:15<25:21:37,  9.44s/it]
 75%|███████▍  | 28289/37963 [70:02:22<23:39:30,  8.80s/it]
 75%|███████▍  | 28290/37963 [70:02:29<22:27:34,  8.36s/it]
                                                           
{'loss': '0.1115', 'grad_norm': '2.89', 'learning_rate': '3.217e-06', 'epoch': '0.7452'}
+
 75%|███████▍  | 28290/37963 [70:02:29<22:27:34,  8.36s/it]
 75%|███████▍  | 28291/37963 [70:02:37<21:54:55,  8.16s/it]
 75%|███████▍  | 28292/37963 [70:02:52<27:30:25, 10.24s/it]
 75%|███████▍  | 28293/37963 [70:03:00<25:35:39,  9.53s/it]
 75%|███████▍  | 28294/37963 [70:03:07<24:00:44,  8.94s/it]
 75%|███████▍  | 28295/37963 [70:03:15<23:03:31,  8.59s/it]
 75%|███████▍  | 28296/37963 [70:03:23<22:18:51,  8.31s/it]
 75%|███████▍  | 28297/37963 [70:03:30<21:43:23,  8.09s/it]
 75%|███████▍  | 28298/37963 [70:03:38<21:21:59,  7.96s/it]
 75%|███████▍  | 28299/37963 [70:03:46<21:06:42,  7.86s/it]
 75%|███████▍  | 28300/37963 [70:03:53<20:41:15,  7.71s/it]
                                                           
{'loss': '0.09861', 'grad_norm': '3.422', 'learning_rate': '3.211e-06', 'epoch': '0.7455'}
+
 75%|███████▍  | 28300/37963 [70:03:53<20:41:15,  7.71s/it]
 75%|███████▍  | 28301/37963 [70:04:14<31:16:13, 11.65s/it]
 75%|███████▍  | 28302/37963 [70:04:22<28:09:29, 10.49s/it]
 75%|███████▍  | 28303/37963 [70:04:29<25:37:51,  9.55s/it]
 75%|███████▍  | 28304/37963 [70:04:37<23:57:46,  8.93s/it]
 75%|███████▍  | 28305/37963 [70:04:44<22:56:59,  8.55s/it]
 75%|███████▍  | 28306/37963 [70:04:52<22:16:39,  8.30s/it]
 75%|███████▍  | 28307/37963 [70:05:00<21:44:46,  8.11s/it]
 75%|███████▍  | 28308/37963 [70:05:07<21:23:14,  7.97s/it]
 75%|███████▍  | 28309/37963 [70:05:15<21:09:01,  7.89s/it]
 75%|███████▍  | 28310/37963 [70:05:30<26:33:12,  9.90s/it]
                                                           
{'loss': '0.1146', 'grad_norm': '2.739', 'learning_rate': '3.204e-06', 'epoch': '0.7457'}
+
 75%|███████▍  | 28310/37963 [70:05:30<26:33:12,  9.90s/it]
 75%|███████▍  | 28311/37963 [70:05:37<24:46:10,  9.24s/it]
 75%|███████▍  | 28312/37963 [70:05:45<23:34:59,  8.80s/it]
 75%|███████▍  | 28313/37963 [70:05:53<22:36:33,  8.43s/it]
 75%|███████▍  | 28314/37963 [70:06:00<21:57:01,  8.19s/it]
 75%|███████▍  | 28315/37963 [70:06:08<21:31:15,  8.03s/it]
 75%|███████▍  | 28316/37963 [70:06:16<21:14:54,  7.93s/it]
 75%|███████▍  | 28317/37963 [70:06:23<21:03:34,  7.86s/it]
 75%|███████▍  | 28318/37963 [70:06:31<20:55:56,  7.81s/it]
 75%|███████▍  | 28319/37963 [70:06:39<20:49:27,  7.77s/it]
 75%|███████▍  | 28320/37963 [70:06:53<26:10:58,  9.77s/it]
                                                           
{'loss': '0.1093', 'grad_norm': '2.716', 'learning_rate': '3.198e-06', 'epoch': '0.746'}
+
 75%|███████▍  | 28320/37963 [70:06:53<26:10:58,  9.77s/it]
 75%|███████▍  | 28321/37963 [70:07:01<24:31:39,  9.16s/it]
 75%|███████▍  | 28322/37963 [70:07:09<23:26:38,  8.75s/it]
 75%|███████▍  | 28323/37963 [70:07:16<22:30:31,  8.41s/it]
 75%|███████▍  | 28324/37963 [70:07:31<27:24:25, 10.24s/it]
 75%|███████▍  | 28325/37963 [70:07:38<25:06:48,  9.38s/it]
 75%|███████▍  | 28326/37963 [70:07:46<23:51:40,  8.91s/it]
 75%|███████▍  | 28327/37963 [70:07:54<22:48:57,  8.52s/it]
 75%|███████▍  | 28328/37963 [70:08:01<21:59:58,  8.22s/it]
 75%|███████▍  | 28329/37963 [70:08:09<21:39:03,  8.09s/it]
 75%|███████▍  | 28330/37963 [70:08:17<21:15:27,  7.94s/it]
                                                           
{'loss': '0.1153', 'grad_norm': '2.299', 'learning_rate': '3.192e-06', 'epoch': '0.7463'}
+
 75%|███████▍  | 28330/37963 [70:08:17<21:15:27,  7.94s/it]
 75%|███████▍  | 28331/37963 [70:08:24<21:00:42,  7.85s/it]
 75%|███████▍  | 28332/37963 [70:08:32<20:47:49,  7.77s/it]
 75%|███████▍  | 28333/37963 [70:08:39<20:45:13,  7.76s/it]
 75%|███████▍  | 28334/37963 [70:08:47<20:44:24,  7.75s/it]
 75%|███████▍  | 28335/37963 [70:08:55<20:44:29,  7.76s/it]
 75%|███████▍  | 28336/37963 [70:09:16<31:38:24, 11.83s/it]
 75%|███████▍  | 28337/37963 [70:09:24<28:20:29, 10.60s/it]
 75%|███████▍  | 28338/37963 [70:09:39<32:01:18, 11.98s/it]
 75%|███████▍  | 28339/37963 [70:09:47<28:40:14, 10.72s/it]
 75%|███████▍  | 28340/37963 [70:09:55<26:06:21,  9.77s/it]
                                                           
{'loss': '0.1199', 'grad_norm': '2.369', 'learning_rate': '3.186e-06', 'epoch': '0.7465'}
+
 75%|███████▍  | 28340/37963 [70:09:55<26:06:21,  9.77s/it]
 75%|███████▍  | 28341/37963 [70:10:02<24:27:15,  9.15s/it]
 75%|███████▍  | 28342/37963 [70:10:10<23:16:09,  8.71s/it]
 75%|███████▍  | 28343/37963 [70:10:18<22:28:17,  8.41s/it]
 75%|███████▍  | 28344/37963 [70:10:25<21:42:54,  8.13s/it]
 75%|███████▍  | 28345/37963 [70:10:40<26:44:05, 10.01s/it]
 75%|███████▍  | 28346/37963 [70:10:47<25:02:00,  9.37s/it]
 75%|███████▍  | 28347/37963 [70:10:55<23:57:25,  8.97s/it]
 75%|███████▍  | 28348/37963 [70:11:03<22:54:38,  8.58s/it]
 75%|███████▍  | 28349/37963 [70:11:11<22:10:18,  8.30s/it]
 75%|███████▍  | 28350/37963 [70:11:19<21:51:08,  8.18s/it]
                                                           
{'loss': '0.1239', 'grad_norm': '2.705', 'learning_rate': '3.179e-06', 'epoch': '0.7468'}
+
 75%|███████▍  | 28350/37963 [70:11:19<21:51:08,  8.18s/it]
 75%|███████▍  | 28351/37963 [70:11:26<21:28:31,  8.04s/it]
 75%|███████▍  | 28352/37963 [70:11:34<21:10:18,  7.93s/it]
 75%|███████▍  | 28353/37963 [70:11:42<20:59:57,  7.87s/it]
 75%|███████▍  | 28354/37963 [70:11:50<20:55:33,  7.84s/it]
 75%|███████▍  | 28355/37963 [70:12:04<26:11:45,  9.82s/it]
 75%|███████▍  | 28356/37963 [70:12:12<24:31:21,  9.19s/it]
 75%|███████▍  | 28357/37963 [70:12:19<23:07:25,  8.67s/it]
 75%|███████▍  | 28358/37963 [70:12:27<22:19:49,  8.37s/it]
 75%|███████▍  | 28359/37963 [70:12:42<27:37:50, 10.36s/it]
 75%|███████▍  | 28360/37963 [70:12:50<25:32:00,  9.57s/it]
                                                           
{'loss': '0.1058', 'grad_norm': '2.255', 'learning_rate': '3.173e-06', 'epoch': '0.747'}
+
 75%|███████▍  | 28360/37963 [70:12:50<25:32:00,  9.57s/it]
 75%|███████▍  | 28361/37963 [70:12:57<23:51:20,  8.94s/it]
 75%|███████▍  | 28362/37963 [70:13:05<23:01:26,  8.63s/it]
 75%|███████▍  | 28363/37963 [70:13:12<21:57:47,  8.24s/it]
 75%|███████▍  | 28364/37963 [70:13:26<26:40:44, 10.01s/it]
 75%|███████▍  | 28365/37963 [70:13:34<24:57:14,  9.36s/it]
 75%|███████▍  | 28366/37963 [70:13:42<23:41:42,  8.89s/it]
 75%|███████▍  | 28367/37963 [70:13:56<28:04:32, 10.53s/it]
 75%|███████▍  | 28368/37963 [70:14:04<25:50:31,  9.70s/it]
 75%|███████▍  | 28369/37963 [70:14:12<24:00:30,  9.01s/it]
 75%|███████▍  | 28370/37963 [70:14:19<23:01:13,  8.64s/it]
                                                           
{'loss': '0.107', 'grad_norm': '2.006', 'learning_rate': '3.167e-06', 'epoch': '0.7473'}
+
 75%|███████▍  | 28370/37963 [70:14:19<23:01:13,  8.64s/it]
 75%|███████▍  | 28371/37963 [70:14:27<22:16:38,  8.36s/it]
 75%|███████▍  | 28372/37963 [70:14:35<21:37:01,  8.11s/it]
 75%|███████▍  | 28373/37963 [70:14:42<21:07:04,  7.93s/it]
 75%|███████▍  | 28374/37963 [70:14:50<20:47:02,  7.80s/it]
 75%|███████▍  | 28375/37963 [70:14:57<20:42:35,  7.78s/it]
 75%|███████▍  | 28376/37963 [70:15:05<20:34:39,  7.73s/it]
 75%|███████▍  | 28377/37963 [70:15:13<20:31:50,  7.71s/it]
 75%|███████▍  | 28378/37963 [70:15:20<20:31:03,  7.71s/it]
 75%|███████▍  | 28379/37963 [70:15:28<20:25:57,  7.68s/it]
 75%|███████▍  | 28380/37963 [70:15:35<20:22:38,  7.66s/it]
                                                           
{'loss': '0.1156', 'grad_norm': '1.707', 'learning_rate': '3.161e-06', 'epoch': '0.7476'}
+
 75%|███████▍  | 28380/37963 [70:15:35<20:22:38,  7.66s/it]
 75%|███████▍  | 28381/37963 [70:15:43<20:23:15,  7.66s/it]
 75%|███████▍  | 28382/37963 [70:15:51<20:35:06,  7.73s/it]
 75%|███████▍  | 28383/37963 [70:16:06<26:00:11,  9.77s/it]
 75%|███████▍  | 28384/37963 [70:16:13<24:14:29,  9.11s/it]
 75%|███████▍  | 28385/37963 [70:16:28<28:48:24, 10.83s/it]
 75%|███████▍  | 28386/37963 [70:16:36<26:14:01,  9.86s/it]
 75%|███████▍  | 28387/37963 [70:16:43<24:38:43,  9.27s/it]
 75%|███████▍  | 28388/37963 [70:16:51<23:25:08,  8.81s/it]
 75%|███████▍  | 28389/37963 [70:16:59<22:30:14,  8.46s/it]
 75%|███████▍  | 28390/37963 [70:17:07<21:57:11,  8.26s/it]
                                                           
{'loss': '0.09963', 'grad_norm': '2.223', 'learning_rate': '3.154e-06', 'epoch': '0.7478'}
+
 75%|███████▍  | 28390/37963 [70:17:07<21:57:11,  8.26s/it]
 75%|███████▍  | 28391/37963 [70:17:22<27:21:51, 10.29s/it]
 75%|███████▍  | 28392/37963 [70:17:29<25:13:54,  9.49s/it]
 75%|███████▍  | 28393/37963 [70:17:44<29:05:58, 10.95s/it]
 75%|███████▍  | 28394/37963 [70:17:52<26:39:41, 10.03s/it]
 75%|███████▍  | 28395/37963 [70:17:59<24:44:32,  9.31s/it]
 75%|███████▍  | 28396/37963 [70:18:07<23:23:42,  8.80s/it]
 75%|███████▍  | 28397/37963 [70:18:15<22:35:56,  8.50s/it]
 75%|███████▍  | 28398/37963 [70:18:22<21:53:34,  8.24s/it]
 75%|███████▍  | 28399/37963 [70:18:30<21:24:36,  8.06s/it]
 75%|███████▍  | 28400/37963 [70:18:37<20:59:46,  7.90s/it]
                                                           
{'loss': '0.1053', 'grad_norm': '2.259', 'learning_rate': '3.148e-06', 'epoch': '0.7481'}
+
 75%|███████▍  | 28400/37963 [70:18:37<20:59:46,  7.90s/it]
 75%|███████▍  | 28401/37963 [70:18:45<20:37:15,  7.76s/it]
 75%|███████▍  | 28402/37963 [70:18:53<20:37:38,  7.77s/it]
 75%|███████▍  | 28403/37963 [70:19:00<20:36:28,  7.76s/it]
 75%|███████▍  | 28404/37963 [70:19:08<20:31:05,  7.73s/it]
 75%|███████▍  | 28405/37963 [70:19:16<20:38:33,  7.77s/it]
 75%|███████▍  | 28406/37963 [70:19:24<20:34:26,  7.75s/it]
 75%|███████▍  | 28407/37963 [70:19:44<30:55:22, 11.65s/it]
 75%|███████▍  | 28408/37963 [70:19:59<33:08:07, 12.48s/it]
 75%|███████▍  | 28409/37963 [70:20:06<29:20:09, 11.05s/it]
 75%|███████▍  | 28410/37963 [70:20:14<26:39:40, 10.05s/it]
                                                           
{'loss': '0.1123', 'grad_norm': '3.821', 'learning_rate': '3.142e-06', 'epoch': '0.7484'}
+
 75%|███████▍  | 28410/37963 [70:20:14<26:39:40, 10.05s/it]
 75%|███████▍  | 28411/37963 [70:20:22<24:40:01,  9.30s/it]
 75%|███████▍  | 28412/37963 [70:20:29<23:22:23,  8.81s/it]
 75%|███████▍  | 28413/37963 [70:20:37<22:32:14,  8.50s/it]
 75%|███████▍  | 28414/37963 [70:20:45<21:48:50,  8.22s/it]
 75%|███████▍  | 28415/37963 [70:20:53<21:31:43,  8.12s/it]
 75%|███████▍  | 28416/37963 [70:21:00<21:09:06,  7.98s/it]
 75%|███████▍  | 28417/37963 [70:21:08<20:55:00,  7.89s/it]
 75%|███████▍  | 28418/37963 [70:21:16<20:41:19,  7.80s/it]
 75%|███████▍  | 28419/37963 [70:21:23<20:34:11,  7.76s/it]
 75%|███████▍  | 28420/37963 [70:21:31<20:19:09,  7.67s/it]
                                                           
{'loss': '0.1144', 'grad_norm': '1.715', 'learning_rate': '3.136e-06', 'epoch': '0.7486'}
+
 75%|███████▍  | 28420/37963 [70:21:31<20:19:09,  7.67s/it]
 75%|███████▍  | 28421/37963 [70:21:45<25:20:00,  9.56s/it]
 75%|███████▍  | 28422/37963 [70:21:53<24:02:12,  9.07s/it]
 75%|███████▍  | 28423/37963 [70:22:00<22:55:00,  8.65s/it]
 75%|███████▍  | 28424/37963 [70:22:08<21:56:07,  8.28s/it]
 75%|███████▍  | 28425/37963 [70:22:15<21:30:07,  8.12s/it]
 75%|███████▍  | 28426/37963 [70:22:23<21:00:11,  7.93s/it]
 75%|███████▍  | 28427/37963 [70:22:31<20:47:28,  7.85s/it]
 75%|███████▍  | 28428/37963 [70:22:45<26:07:15,  9.86s/it]
 75%|███████▍  | 28429/37963 [70:22:53<24:26:38,  9.23s/it]
 75%|███████▍  | 28430/37963 [70:23:00<22:57:17,  8.67s/it]
                                                           
{'loss': '0.1244', 'grad_norm': '2.352', 'learning_rate': '3.13e-06', 'epoch': '0.7489'}
+
 75%|███████▍  | 28430/37963 [70:23:00<22:57:17,  8.67s/it]
 75%|███████▍  | 28431/37963 [70:23:08<21:58:29,  8.30s/it]
 75%|███████▍  | 28432/37963 [70:23:15<21:12:48,  8.01s/it]
 75%|███████▍  | 28433/37963 [70:23:23<20:53:51,  7.89s/it]
 75%|███████▍  | 28434/37963 [70:23:31<20:56:52,  7.91s/it]
 75%|███████▍  | 28435/37963 [70:23:46<26:32:20, 10.03s/it]
 75%|███████▍  | 28436/37963 [70:23:53<24:51:50,  9.40s/it]
 75%|███████▍  | 28437/37963 [70:24:08<28:37:05, 10.82s/it]
 75%|███████▍  | 28438/37963 [70:24:15<26:13:59,  9.91s/it]
 75%|███████▍  | 28439/37963 [70:24:30<30:18:14, 11.45s/it]
 75%|███████▍  | 28440/37963 [70:24:38<27:14:34, 10.30s/it]
                                                           
{'loss': '0.1197', 'grad_norm': '5.74', 'learning_rate': '3.123e-06', 'epoch': '0.7492'}
+
 75%|███████▍  | 28440/37963 [70:24:38<27:14:34, 10.30s/it]
 75%|███████▍  | 28441/37963 [70:24:46<25:07:23,  9.50s/it]
 75%|███████▍  | 28442/37963 [70:24:53<23:40:15,  8.95s/it]
 75%|███████▍  | 28443/37963 [70:25:01<22:43:43,  8.59s/it]
 75%|███████▍  | 28444/37963 [70:25:09<22:00:49,  8.33s/it]
 75%|███████▍  | 28445/37963 [70:25:17<21:34:53,  8.16s/it]
 75%|███████▍  | 28446/37963 [70:25:24<21:10:06,  8.01s/it]
 75%|███████▍  | 28447/37963 [70:25:32<20:53:43,  7.90s/it]
 75%|███████▍  | 28448/37963 [70:25:40<20:45:08,  7.85s/it]
 75%|███████▍  | 28449/37963 [70:25:47<20:35:58,  7.79s/it]
 75%|███████▍  | 28450/37963 [70:25:55<20:29:51,  7.76s/it]
                                                           
{'loss': '0.1026', 'grad_norm': '2.545', 'learning_rate': '3.117e-06', 'epoch': '0.7494'}
+
 75%|███████▍  | 28450/37963 [70:25:55<20:29:51,  7.76s/it]
 75%|███████▍  | 28451/37963 [70:26:03<20:24:53,  7.73s/it]
 75%|███████▍  | 28452/37963 [70:26:10<20:30:01,  7.76s/it]
 75%|███████▍  | 28453/37963 [70:26:25<26:17:11,  9.95s/it]
 75%|███████▍  | 28454/37963 [70:26:33<24:34:08,  9.30s/it]
 75%|███████▍  | 28455/37963 [70:26:41<23:17:48,  8.82s/it]
 75%|███████▍  | 28456/37963 [70:26:49<22:23:12,  8.48s/it]
 75%|███████▍  | 28457/37963 [70:26:57<21:55:17,  8.30s/it]
 75%|███████▍  | 28458/37963 [70:27:04<21:22:30,  8.10s/it]
 75%|███████▍  | 28459/37963 [70:27:12<21:05:43,  7.99s/it]
 75%|███████▍  | 28460/37963 [70:27:20<20:57:34,  7.94s/it]
                                                           
{'loss': '0.1029', 'grad_norm': '2.433', 'learning_rate': '3.111e-06', 'epoch': '0.7497'}
+
 75%|███████▍  | 28460/37963 [70:27:20<20:57:34,  7.94s/it]
 75%|███████▍  | 28461/37963 [70:27:34<26:08:07,  9.90s/it]
 75%|███████▍  | 28462/37963 [70:27:49<29:51:28, 11.31s/it]
 75%|███████▍  | 28463/37963 [70:27:57<27:02:51, 10.25s/it]
 75%|███████▍  | 28464/37963 [70:28:04<24:55:38,  9.45s/it]
 75%|███████▍  | 28465/37963 [70:28:12<23:30:07,  8.91s/it]
 75%|███████▍  | 28466/37963 [70:28:19<22:22:32,  8.48s/it]
 75%|███████▍  | 28467/37963 [70:28:27<21:43:15,  8.23s/it]
 75%|███████▍  | 28468/37963 [70:28:34<21:05:42,  8.00s/it]
 75%|███████▍  | 28469/37963 [70:28:42<20:42:09,  7.85s/it]
 75%|███████▍  | 28470/37963 [70:28:56<25:48:30,  9.79s/it]
                                                           
{'loss': '0.1182', 'grad_norm': '2.044', 'learning_rate': '3.105e-06', 'epoch': '0.7499'}
+
 75%|███████▍  | 28470/37963 [70:28:56<25:48:30,  9.79s/it]
 75%|███████▍  | 28471/37963 [70:29:04<24:01:03,  9.11s/it]
 75%|███████▍  | 28472/37963 [70:29:11<22:55:22,  8.69s/it]
 75%|███████▌  | 28473/37963 [70:29:19<22:08:54,  8.40s/it]
 75%|███████▌  | 28474/37963 [70:29:27<21:35:51,  8.19s/it]
 75%|███████▌  | 28475/37963 [70:29:35<21:11:07,  8.04s/it]
 75%|███████▌  | 28476/37963 [70:29:49<25:54:09,  9.83s/it]
 75%|███████▌  | 28477/37963 [70:29:56<24:05:04,  9.14s/it]
 75%|███████▌  | 28478/37963 [70:30:04<22:48:04,  8.65s/it]
 75%|███████▌  | 28479/37963 [70:30:11<21:59:55,  8.35s/it]
 75%|███████▌  | 28480/37963 [70:30:19<21:28:34,  8.15s/it]
                                                           
{'loss': '0.1174', 'grad_norm': '2.797', 'learning_rate': '3.099e-06', 'epoch': '0.7502'}
+
 75%|███████▌  | 28480/37963 [70:30:19<21:28:34,  8.15s/it]
 75%|███████▌  | 28481/37963 [70:30:26<20:54:25,  7.94s/it]
 75%|███████▌  | 28482/37963 [70:30:34<20:44:53,  7.88s/it]
 75%|███████▌  | 28483/37963 [70:30:49<26:27:57, 10.05s/it]
 75%|███████▌  | 28484/37963 [70:30:57<24:33:52,  9.33s/it]
 75%|███████▌  | 28485/37963 [70:31:05<23:15:33,  8.83s/it]
 75%|███████▌  | 28486/37963 [70:31:12<22:19:30,  8.48s/it]
 75%|███████▌  | 28487/37963 [70:31:27<27:10:52, 10.33s/it]
 75%|███████▌  | 28488/37963 [70:31:35<25:07:48,  9.55s/it]
 75%|███████▌  | 28489/37963 [70:31:42<23:43:28,  9.02s/it]
 75%|███████▌  | 28490/37963 [70:31:50<22:39:15,  8.61s/it]
                                                           
{'loss': '0.1206', 'grad_norm': '2.57', 'learning_rate': '3.092e-06', 'epoch': '0.7505'}
+
 75%|███████▌  | 28490/37963 [70:31:50<22:39:15,  8.61s/it]
 75%|███████▌  | 28491/37963 [70:31:58<21:55:47,  8.33s/it]
 75%|███████▌  | 28492/37963 [70:32:12<26:20:12, 10.01s/it]
 75%|███████▌  | 28493/37963 [70:32:19<24:28:21,  9.30s/it]
 75%|███████▌  | 28494/37963 [70:32:27<23:18:09,  8.86s/it]
 75%|███████▌  | 28495/37963 [70:32:35<22:22:46,  8.51s/it]
 75%|███████▌  | 28496/37963 [70:32:42<21:35:39,  8.21s/it]
 75%|███████▌  | 28497/37963 [70:32:50<21:13:04,  8.07s/it]
 75%|███████▌  | 28498/37963 [70:32:58<20:42:36,  7.88s/it]
 75%|███████▌  | 28499/37963 [70:33:05<20:28:31,  7.79s/it]
 75%|███████▌  | 28500/37963 [70:33:13<20:18:38,  7.73s/it]
                                                           
{'loss': '0.1031', 'grad_norm': '2.178', 'learning_rate': '3.086e-06', 'epoch': '0.7507'}
+
 75%|███████▌  | 28500/37963 [70:33:13<20:18:38,  7.73s/it]
 75%|███████▌  | 28501/37963 [70:33:20<20:20:20,  7.74s/it]
 75%|███████▌  | 28502/37963 [70:33:28<20:17:12,  7.72s/it]
 75%|███████▌  | 28503/37963 [70:33:36<20:10:04,  7.67s/it]
 75%|███████▌  | 28504/37963 [70:33:43<20:03:53,  7.64s/it]
 75%|███████▌  | 28505/37963 [70:33:51<20:13:59,  7.70s/it]
 75%|███████▌  | 28506/37963 [70:33:59<20:03:15,  7.63s/it]
 75%|███████▌  | 28507/37963 [70:34:20<30:37:26, 11.66s/it]
 75%|███████▌  | 28508/37963 [70:34:27<27:22:38, 10.42s/it]
 75%|███████▌  | 28509/37963 [70:34:35<25:10:51,  9.59s/it]
 75%|███████▌  | 28510/37963 [70:34:49<29:11:02, 11.11s/it]
                                                           
{'loss': '0.1194', 'grad_norm': '2.704', 'learning_rate': '3.08e-06', 'epoch': '0.751'}
+
 75%|███████▌  | 28510/37963 [70:34:49<29:11:02, 11.11s/it]
 75%|███████▌  | 28511/37963 [70:34:57<26:41:04, 10.16s/it]
 75%|███████▌  | 28512/37963 [70:35:05<24:41:33,  9.41s/it]
 75%|███████▌  | 28513/37963 [70:35:19<28:25:02, 10.83s/it]
 75%|███████▌  | 28514/37963 [70:35:27<25:56:47,  9.89s/it]
 75%|███████▌  | 28515/37963 [70:35:34<24:09:25,  9.20s/it]
 75%|███████▌  | 28516/37963 [70:35:42<22:54:40,  8.73s/it]
 75%|███████▌  | 28517/37963 [70:35:50<22:10:15,  8.45s/it]
 75%|███████▌  | 28518/37963 [70:35:58<21:36:59,  8.24s/it]
 75%|███████▌  | 28519/37963 [70:36:05<21:12:37,  8.09s/it]
 75%|███████▌  | 28520/37963 [70:36:13<20:50:51,  7.95s/it]
                                                           
{'loss': '0.09812', 'grad_norm': '2.764', 'learning_rate': '3.074e-06', 'epoch': '0.7513'}
+
 75%|███████▌  | 28520/37963 [70:36:13<20:50:51,  7.95s/it]
 75%|███████▌  | 28521/37963 [70:36:20<20:28:32,  7.81s/it]
 75%|███████▌  | 28522/37963 [70:36:28<20:25:31,  7.79s/it]
 75%|███████▌  | 28523/37963 [70:36:36<20:21:38,  7.76s/it]
 75%|███████▌  | 28524/37963 [70:36:44<20:18:49,  7.75s/it]
 75%|███████▌  | 28525/37963 [70:36:51<20:04:07,  7.65s/it]
 75%|███████▌  | 28526/37963 [70:36:59<19:57:58,  7.62s/it]
 75%|███████▌  | 28527/37963 [70:37:06<19:55:49,  7.60s/it]
 75%|███████▌  | 28528/37963 [70:37:14<19:59:31,  7.63s/it]
 75%|███████▌  | 28529/37963 [70:37:28<25:18:54,  9.66s/it]
 75%|███████▌  | 28530/37963 [70:37:36<23:30:23,  8.97s/it]
                                                           
{'loss': '0.1193', 'grad_norm': '2.357', 'learning_rate': '3.068e-06', 'epoch': '0.7515'}
+
 75%|███████▌  | 28530/37963 [70:37:36<23:30:23,  8.97s/it]
 75%|███████▌  | 28531/37963 [70:37:50<28:00:30, 10.69s/it]
 75%|███████▌  | 28532/37963 [70:37:58<25:26:09,  9.71s/it]
 75%|███████▌  | 28533/37963 [70:38:05<23:47:44,  9.08s/it]
 75%|███████▌  | 28534/37963 [70:38:13<22:41:20,  8.66s/it]
 75%|███████▌  | 28535/37963 [70:38:21<21:59:01,  8.39s/it]
 75%|███████▌  | 28536/37963 [70:38:35<26:50:12, 10.25s/it]
 75%|███████▌  | 28537/37963 [70:38:43<25:00:17,  9.55s/it]
 75%|███████▌  | 28538/37963 [70:38:51<23:38:01,  9.03s/it]
 75%|███████▌  | 28539/37963 [70:38:59<22:20:48,  8.54s/it]
 75%|███████▌  | 28540/37963 [70:39:13<26:44:53, 10.22s/it]
                                                           
{'loss': '0.1116', 'grad_norm': '2.687', 'learning_rate': '3.062e-06', 'epoch': '0.7518'}
+
 75%|███████▌  | 28540/37963 [70:39:13<26:44:53, 10.22s/it]
 75%|███████▌  | 28541/37963 [70:39:20<24:37:28,  9.41s/it]
 75%|███████▌  | 28542/37963 [70:39:28<23:23:55,  8.94s/it]
 75%|███████▌  | 28543/37963 [70:39:36<22:14:56,  8.50s/it]
 75%|███████▌  | 28544/37963 [70:39:43<21:24:36,  8.18s/it]
 75%|███████▌  | 28545/37963 [70:39:51<21:04:26,  8.06s/it]
 75%|███████▌  | 28546/37963 [70:39:58<20:34:30,  7.87s/it]
 75%|███████▌  | 28547/37963 [70:40:06<20:19:19,  7.77s/it]
 75%|███████▌  | 28548/37963 [70:40:13<20:12:53,  7.73s/it]
 75%|███████▌  | 28549/37963 [70:40:21<19:57:12,  7.63s/it]
 75%|███████▌  | 28550/37963 [70:40:29<20:04:00,  7.67s/it]
                                                           
{'loss': '0.1128', 'grad_norm': '1.638', 'learning_rate': '3.056e-06', 'epoch': '0.7521'}
+
 75%|███████▌  | 28550/37963 [70:40:29<20:04:00,  7.67s/it]
 75%|███████▌  | 28551/37963 [70:40:36<20:12:29,  7.73s/it]
 75%|███████▌  | 28552/37963 [70:40:44<20:13:57,  7.74s/it]
 75%|███████▌  | 28553/37963 [70:40:52<20:15:28,  7.75s/it]
 75%|███████▌  | 28554/37963 [70:41:06<25:12:22,  9.64s/it]
 75%|███████▌  | 28555/37963 [70:41:14<23:36:43,  9.04s/it]
 75%|███████▌  | 28556/37963 [70:41:21<22:23:07,  8.57s/it]
 75%|███████▌  | 28557/37963 [70:41:35<26:49:44, 10.27s/it]
 75%|███████▌  | 28558/37963 [70:41:43<24:48:18,  9.49s/it]
 75%|███████▌  | 28559/37963 [70:41:51<23:21:02,  8.94s/it]
 75%|███████▌  | 28560/37963 [70:41:58<22:20:27,  8.55s/it]
                                                           
{'loss': '0.108', 'grad_norm': '3.668', 'learning_rate': '3.049e-06', 'epoch': '0.7523'}
+
 75%|███████▌  | 28560/37963 [70:41:58<22:20:27,  8.55s/it]
 75%|███████▌  | 28561/37963 [70:42:13<26:49:44, 10.27s/it]
 75%|███████▌  | 28562/37963 [70:42:20<24:59:41,  9.57s/it]
 75%|███████▌  | 28563/37963 [70:42:28<23:29:12,  8.99s/it]
 75%|███████▌  | 28564/37963 [70:42:36<22:26:52,  8.60s/it]
 75%|███████▌  | 28565/37963 [70:42:50<26:44:48, 10.25s/it]
 75%|███████▌  | 28566/37963 [70:42:58<24:40:27,  9.45s/it]
 75%|███████▌  | 28567/37963 [70:43:05<23:15:24,  8.91s/it]
 75%|███████▌  | 28568/37963 [70:43:13<22:15:44,  8.53s/it]
 75%|███████▌  | 28569/37963 [70:43:21<21:42:31,  8.32s/it]
 75%|███████▌  | 28570/37963 [70:43:28<21:11:00,  8.12s/it]
                                                           
{'loss': '0.1114', 'grad_norm': '2.36', 'learning_rate': '3.043e-06', 'epoch': '0.7526'}
+
 75%|███████▌  | 28570/37963 [70:43:28<21:11:00,  8.12s/it]
 75%|███████▌  | 28571/37963 [70:43:36<20:44:10,  7.95s/it]
 75%|███████▌  | 28572/37963 [70:43:43<20:30:24,  7.86s/it]
 75%|███████▌  | 28573/37963 [70:43:58<25:37:41,  9.83s/it]
 75%|███████▌  | 28574/37963 [70:44:05<23:48:07,  9.13s/it]
 75%|███████▌  | 28575/37963 [70:44:20<28:07:32, 10.79s/it]
 75%|███████▌  | 28576/37963 [70:44:28<25:49:14,  9.90s/it]
 75%|███████▌  | 28577/37963 [70:44:35<24:00:36,  9.21s/it]
 75%|███████▌  | 28578/37963 [70:44:43<22:46:42,  8.74s/it]
 75%|███████▌  | 28579/37963 [70:44:51<21:59:26,  8.44s/it]
 75%|███████▌  | 28580/37963 [70:44:59<21:29:39,  8.25s/it]
                                                           
{'loss': '0.1038', 'grad_norm': '2.177', 'learning_rate': '3.037e-06', 'epoch': '0.7528'}
+
 75%|███████▌  | 28580/37963 [70:44:59<21:29:39,  8.25s/it]
 75%|███████▌  | 28581/37963 [70:45:06<21:05:07,  8.09s/it]
 75%|███████▌  | 28582/37963 [70:45:14<20:37:18,  7.91s/it]
 75%|███████▌  | 28583/37963 [70:45:22<20:25:15,  7.84s/it]
 75%|███████▌  | 28584/37963 [70:45:29<20:16:44,  7.78s/it]
 75%|███████▌  | 28585/37963 [70:45:44<25:36:47,  9.83s/it]
 75%|███████▌  | 28586/37963 [70:45:51<23:52:58,  9.17s/it]
 75%|███████▌  | 28587/37963 [70:45:59<22:43:37,  8.73s/it]
 75%|███████▌  | 28588/37963 [70:46:14<27:10:24, 10.43s/it]
 75%|███████▌  | 28589/37963 [70:46:21<25:00:43,  9.61s/it]
 75%|███████▌  | 28590/37963 [70:46:29<23:29:03,  9.02s/it]
                                                           
{'loss': '0.1155', 'grad_norm': '3.584', 'learning_rate': '3.031e-06', 'epoch': '0.7531'}
+
 75%|███████▌  | 28590/37963 [70:46:29<23:29:03,  9.02s/it]
 75%|███████▌  | 28591/37963 [70:46:36<22:20:08,  8.58s/it]
 75%|███████▌  | 28592/37963 [70:46:44<21:35:02,  8.29s/it]
 75%|███████▌  | 28593/37963 [70:46:52<21:12:10,  8.15s/it]
 75%|███████▌  | 28594/37963 [70:46:59<20:45:37,  7.98s/it]
 75%|███████▌  | 28595/37963 [70:47:07<20:32:01,  7.89s/it]
 75%|███████▌  | 28596/37963 [70:47:15<20:23:32,  7.84s/it]
 75%|███████▌  | 28597/37963 [70:47:29<25:03:46,  9.63s/it]
 75%|███████▌  | 28598/37963 [70:47:36<23:12:08,  8.92s/it]
 75%|███████▌  | 28599/37963 [70:47:44<22:14:28,  8.55s/it]
 75%|███████▌  | 28600/37963 [70:47:51<21:29:25,  8.26s/it]
                                                           
{'loss': '0.1179', 'grad_norm': '2.185', 'learning_rate': '3.025e-06', 'epoch': '0.7534'}
+
 75%|███████▌  | 28600/37963 [70:47:51<21:29:25,  8.26s/it]
 75%|███████▌  | 28601/37963 [70:48:05<26:06:37, 10.04s/it]
 75%|███████▌  | 28602/37963 [70:48:13<24:06:54,  9.27s/it]
 75%|███████▌  | 28603/37963 [70:48:21<22:59:37,  8.84s/it]
 75%|███████▌  | 28604/37963 [70:48:28<22:06:38,  8.51s/it]
 75%|███████▌  | 28605/37963 [70:48:36<21:28:26,  8.26s/it]
 75%|███████▌  | 28606/37963 [70:48:44<20:57:06,  8.06s/it]
 75%|███████▌  | 28607/37963 [70:48:51<20:38:00,  7.94s/it]
 75%|███████▌  | 28608/37963 [70:48:59<20:32:35,  7.91s/it]
 75%|███████▌  | 28609/37963 [70:49:14<25:43:50,  9.90s/it]
 75%|███████▌  | 28610/37963 [70:49:21<23:52:11,  9.19s/it]
                                                           
{'loss': '0.09516', 'grad_norm': '2.237', 'learning_rate': '3.019e-06', 'epoch': '0.7536'}
+
 75%|███████▌  | 28610/37963 [70:49:21<23:52:11,  9.19s/it]
 75%|███████▌  | 28611/37963 [70:49:29<22:44:30,  8.75s/it]
 75%|███████▌  | 28612/37963 [70:49:43<26:54:26, 10.36s/it]
 75%|███████▌  | 28613/37963 [70:49:51<24:51:50,  9.57s/it]
 75%|███████▌  | 28614/37963 [70:49:59<23:21:31,  8.99s/it]
 75%|███████▌  | 28615/37963 [70:50:06<22:19:20,  8.60s/it]
 75%|███████▌  | 28616/37963 [70:50:14<21:35:05,  8.31s/it]
 75%|███████▌  | 28617/37963 [70:50:22<21:11:34,  8.16s/it]
 75%|███████▌  | 28618/37963 [70:50:29<20:51:27,  8.04s/it]
 75%|███████▌  | 28619/37963 [70:50:37<20:32:59,  7.92s/it]
 75%|███████▌  | 28620/37963 [70:50:52<26:01:31, 10.03s/it]
                                                           
{'loss': '0.1116', 'grad_norm': '2.744', 'learning_rate': '3.013e-06', 'epoch': '0.7539'}
+
 75%|███████▌  | 28620/37963 [70:50:52<26:01:31, 10.03s/it]
 75%|███████▌  | 28621/37963 [70:51:07<29:35:45, 11.40s/it]
 75%|███████▌  | 28622/37963 [70:51:14<26:39:49, 10.28s/it]
 75%|███████▌  | 28623/37963 [70:51:22<24:44:27,  9.54s/it]
 75%|███████▌  | 28624/37963 [70:51:30<23:15:59,  8.97s/it]
 75%|███████▌  | 28625/37963 [70:51:37<22:08:52,  8.54s/it]
 75%|███████▌  | 28626/37963 [70:51:45<21:15:01,  8.19s/it]
 75%|███████▌  | 28627/37963 [70:51:53<21:02:30,  8.11s/it]
 75%|███████▌  | 28628/37963 [70:52:00<20:46:29,  8.01s/it]
 75%|███████▌  | 28629/37963 [70:52:08<20:36:11,  7.95s/it]
 75%|███████▌  | 28630/37963 [70:52:16<20:29:14,  7.90s/it]
                                                           
{'loss': '0.1042', 'grad_norm': '2.966', 'learning_rate': '3.007e-06', 'epoch': '0.7542'}
+
 75%|███████▌  | 28630/37963 [70:52:16<20:29:14,  7.90s/it]
 75%|███████▌  | 28631/37963 [70:52:23<20:11:09,  7.79s/it]
 75%|███████▌  | 28632/37963 [70:52:38<25:15:41,  9.75s/it]
 75%|███████▌  | 28633/37963 [70:52:45<23:36:06,  9.11s/it]
 75%|███████▌  | 28634/37963 [70:52:53<22:26:46,  8.66s/it]
 75%|███████▌  | 28635/37963 [70:53:01<21:44:07,  8.39s/it]
 75%|███████▌  | 28636/37963 [70:53:16<26:42:47, 10.31s/it]
 75%|███████▌  | 28637/37963 [70:53:23<24:44:48,  9.55s/it]
 75%|███████▌  | 28638/37963 [70:53:31<23:18:35,  9.00s/it]
 75%|███████▌  | 28639/37963 [70:53:38<22:07:45,  8.54s/it]
 75%|███████▌  | 28640/37963 [70:53:46<21:30:51,  8.31s/it]
                                                           
{'loss': '0.1071', 'grad_norm': '2.635', 'learning_rate': '3e-06', 'epoch': '0.7544'}
+
 75%|███████▌  | 28640/37963 [70:53:46<21:30:51,  8.31s/it]
 75%|███████▌  | 28641/37963 [70:53:54<21:01:01,  8.12s/it]
 75%|███████▌  | 28642/37963 [70:54:02<20:42:05,  8.00s/it]
 75%|███████▌  | 28643/37963 [70:54:09<20:32:52,  7.94s/it]
 75%|███████▌  | 28644/37963 [70:54:23<25:11:31,  9.73s/it]
 75%|███████▌  | 28645/37963 [70:54:31<23:32:05,  9.09s/it]
 75%|███████▌  | 28646/37963 [70:54:39<22:25:46,  8.67s/it]
 75%|███████▌  | 28647/37963 [70:54:46<21:41:22,  8.38s/it]
 75%|███████▌  | 28648/37963 [70:54:54<21:07:19,  8.16s/it]
 75%|███████▌  | 28649/37963 [70:55:01<20:31:11,  7.93s/it]
 75%|███████▌  | 28650/37963 [70:55:09<20:15:32,  7.83s/it]
                                                           
{'loss': '0.1177', 'grad_norm': '2.046', 'learning_rate': '2.994e-06', 'epoch': '0.7547'}
+
 75%|███████▌  | 28650/37963 [70:55:09<20:15:32,  7.83s/it]
 75%|███████▌  | 28651/37963 [70:55:17<20:12:07,  7.81s/it]
 75%|███████▌  | 28652/37963 [70:55:31<25:19:16,  9.79s/it]
 75%|███████▌  | 28653/37963 [70:55:39<23:47:40,  9.20s/it]
 75%|███████▌  | 28654/37963 [70:55:47<22:39:51,  8.76s/it]
 75%|███████▌  | 28655/37963 [70:56:01<26:53:41, 10.40s/it]
 75%|███████▌  | 28656/37963 [70:56:09<24:42:30,  9.56s/it]
 75%|███████▌  | 28657/37963 [70:56:24<28:55:23, 11.19s/it]
 75%|███████▌  | 28658/37963 [70:56:31<26:19:50, 10.19s/it]
 75%|███████▌  | 28659/37963 [70:56:39<24:25:07,  9.45s/it]
 75%|███████▌  | 28660/37963 [70:56:47<23:09:45,  8.96s/it]
                                                           
{'loss': '0.09577', 'grad_norm': '2.076', 'learning_rate': '2.988e-06', 'epoch': '0.7549'}
+
 75%|███████▌  | 28660/37963 [70:56:47<23:09:45,  8.96s/it]
 75%|███████▌  | 28661/37963 [70:56:55<22:14:09,  8.61s/it]
 75%|███████▌  | 28662/37963 [70:57:02<21:25:39,  8.29s/it]
 76%|███████▌  | 28663/37963 [70:57:17<26:05:57, 10.10s/it]
 76%|███████▌  | 28664/37963 [70:57:24<24:11:08,  9.36s/it]
 76%|███████▌  | 28665/37963 [70:57:32<22:55:54,  8.88s/it]
 76%|███████▌  | 28666/37963 [70:57:40<21:58:30,  8.51s/it]
 76%|███████▌  | 28667/37963 [70:57:47<21:19:01,  8.26s/it]
 76%|███████▌  | 28668/37963 [70:57:55<20:48:08,  8.06s/it]
 76%|███████▌  | 28669/37963 [70:58:03<20:28:21,  7.93s/it]
 76%|███████▌  | 28670/37963 [70:58:10<20:20:50,  7.88s/it]
                                                           
{'loss': '0.108', 'grad_norm': '2.383', 'learning_rate': '2.982e-06', 'epoch': '0.7552'}
+
 76%|███████▌  | 28670/37963 [70:58:10<20:20:50,  7.88s/it]
 76%|███████▌  | 28671/37963 [70:58:25<25:36:37,  9.92s/it]
 76%|███████▌  | 28672/37963 [70:58:32<23:35:07,  9.14s/it]
 76%|███████▌  | 28673/37963 [70:58:40<22:31:01,  8.73s/it]
 76%|███████▌  | 28674/37963 [70:58:47<21:26:39,  8.31s/it]
 76%|███████▌  | 28675/37963 [70:58:55<20:57:01,  8.12s/it]
 76%|███████▌  | 28676/37963 [70:59:09<25:37:11,  9.93s/it]
 76%|███████▌  | 28677/37963 [70:59:17<23:45:06,  9.21s/it]
 76%|███████▌  | 28678/37963 [70:59:24<22:33:31,  8.75s/it]
 76%|███████▌  | 28679/37963 [70:59:32<21:38:15,  8.39s/it]
 76%|███████▌  | 28680/37963 [70:59:40<21:12:34,  8.23s/it]
                                                           
{'loss': '0.1035', 'grad_norm': '2.654', 'learning_rate': '2.976e-06', 'epoch': '0.7555'}
+
 76%|███████▌  | 28680/37963 [70:59:40<21:12:34,  8.23s/it]
 76%|███████▌  | 28681/37963 [70:59:48<20:56:20,  8.12s/it]
 76%|███████▌  | 28682/37963 [70:59:55<20:30:50,  7.96s/it]
 76%|███████▌  | 28683/37963 [71:00:10<26:01:32, 10.10s/it]
 76%|███████▌  | 28684/37963 [71:00:18<24:18:16,  9.43s/it]
 76%|███████▌  | 28685/37963 [71:00:26<22:40:50,  8.80s/it]
 76%|███████▌  | 28686/37963 [71:00:33<21:47:02,  8.45s/it]
 76%|███████▌  | 28687/37963 [71:00:41<21:11:16,  8.22s/it]
 76%|███████▌  | 28688/37963 [71:00:48<20:42:37,  8.04s/it]
 76%|███████▌  | 28689/37963 [71:00:56<20:30:49,  7.96s/it]
 76%|███████▌  | 28690/37963 [71:01:04<20:16:33,  7.87s/it]
                                                           
{'loss': '0.1007', 'grad_norm': '2.233', 'learning_rate': '2.97e-06', 'epoch': '0.7557'}
+
 76%|███████▌  | 28690/37963 [71:01:04<20:16:33,  7.87s/it]
 76%|███████▌  | 28691/37963 [71:01:18<24:55:04,  9.67s/it]
 76%|███████▌  | 28692/37963 [71:01:26<23:27:28,  9.11s/it]
 76%|███████▌  | 28693/37963 [71:01:33<22:18:18,  8.66s/it]
 76%|███████▌  | 28694/37963 [71:01:41<21:31:25,  8.36s/it]
 76%|███████▌  | 28695/37963 [71:01:49<20:58:59,  8.15s/it]
 76%|███████▌  | 28696/37963 [71:01:56<20:31:29,  7.97s/it]
 76%|███████▌  | 28697/37963 [71:02:04<20:19:03,  7.89s/it]
 76%|███████▌  | 28698/37963 [71:02:12<20:15:45,  7.87s/it]
 76%|███████▌  | 28699/37963 [71:02:19<20:12:00,  7.85s/it]
 76%|███████▌  | 28700/37963 [71:02:34<25:07:11,  9.76s/it]
                                                           
{'loss': '0.1129', 'grad_norm': '3.568', 'learning_rate': '2.964e-06', 'epoch': '0.756'}
+
 76%|███████▌  | 28700/37963 [71:02:34<25:07:11,  9.76s/it]
 76%|███████▌  | 28701/37963 [71:02:49<29:02:20, 11.29s/it]
 76%|███████▌  | 28702/37963 [71:02:56<26:14:09, 10.20s/it]
 76%|███████▌  | 28703/37963 [71:03:04<24:30:26,  9.53s/it]
 76%|███████▌  | 28704/37963 [71:03:12<23:07:19,  8.99s/it]
 76%|███████▌  | 28705/37963 [71:03:20<22:06:33,  8.60s/it]
 76%|███████▌  | 28706/37963 [71:03:34<26:55:23, 10.47s/it]
 76%|███████▌  | 28707/37963 [71:03:42<24:45:20,  9.63s/it]
 76%|███████▌  | 28708/37963 [71:03:50<23:12:34,  9.03s/it]
 76%|███████▌  | 28709/37963 [71:03:57<22:10:08,  8.62s/it]
 76%|███████▌  | 28710/37963 [71:04:05<21:30:54,  8.37s/it]
                                                           
{'loss': '0.1047', 'grad_norm': '3.042', 'learning_rate': '2.958e-06', 'epoch': '0.7563'}
+
 76%|███████▌  | 28710/37963 [71:04:05<21:30:54,  8.37s/it]
 76%|███████▌  | 28711/37963 [71:04:13<20:54:14,  8.13s/it]
 76%|███████▌  | 28712/37963 [71:04:21<20:42:48,  8.06s/it]
 76%|███████▌  | 28713/37963 [71:04:28<20:14:44,  7.88s/it]
 76%|███████▌  | 28714/37963 [71:04:36<20:01:06,  7.79s/it]
 76%|███████▌  | 28715/37963 [71:04:43<19:53:45,  7.74s/it]
 76%|███████▌  | 28716/37963 [71:04:51<19:56:22,  7.76s/it]
 76%|███████▌  | 28717/37963 [71:04:59<19:53:55,  7.75s/it]
 76%|███████▌  | 28718/37963 [71:05:13<25:13:32,  9.82s/it]
 76%|███████▌  | 28719/37963 [71:05:21<23:29:17,  9.15s/it]
 76%|███████▌  | 28720/37963 [71:05:29<22:23:25,  8.72s/it]
                                                           
{'loss': '0.1112', 'grad_norm': '2.652', 'learning_rate': '2.952e-06', 'epoch': '0.7565'}
+
 76%|███████▌  | 28720/37963 [71:05:29<22:23:25,  8.72s/it]
 76%|███████▌  | 28721/37963 [71:05:36<21:30:20,  8.38s/it]
 76%|███████▌  | 28722/37963 [71:05:44<21:04:23,  8.21s/it]
 76%|███████▌  | 28723/37963 [71:05:58<25:45:18, 10.03s/it]
 76%|███████▌  | 28724/37963 [71:06:06<23:56:51,  9.33s/it]
 76%|███████▌  | 28725/37963 [71:06:21<27:52:27, 10.86s/it]
 76%|███████▌  | 28726/37963 [71:06:28<25:27:09,  9.92s/it]
 76%|███████▌  | 28727/37963 [71:06:43<29:20:39, 11.44s/it]
 76%|███████▌  | 28728/37963 [71:06:51<26:31:30, 10.34s/it]
 76%|███████▌  | 28729/37963 [71:06:59<24:24:08,  9.51s/it]
 76%|███████▌  | 28730/37963 [71:07:06<22:49:09,  8.90s/it]
                                                           
{'loss': '0.1146', 'grad_norm': '1.931', 'learning_rate': '2.946e-06', 'epoch': '0.7568'}
+
 76%|███████▌  | 28730/37963 [71:07:06<22:49:09,  8.90s/it]
 76%|███████▌  | 28731/37963 [71:07:14<22:01:29,  8.59s/it]
 76%|███████▌  | 28732/37963 [71:07:21<21:05:29,  8.23s/it]
 76%|███████▌  | 28733/37963 [71:07:29<20:39:37,  8.06s/it]
 76%|███████▌  | 28734/37963 [71:07:37<20:17:02,  7.91s/it]
 76%|███████▌  | 28735/37963 [71:07:51<25:04:46,  9.78s/it]
 76%|███████▌  | 28736/37963 [71:07:59<23:38:18,  9.22s/it]
 76%|███████▌  | 28737/37963 [71:08:06<22:12:43,  8.67s/it]
 76%|███████▌  | 28738/37963 [71:08:14<21:28:55,  8.38s/it]
 76%|███████▌  | 28739/37963 [71:08:22<21:00:39,  8.20s/it]
 76%|███████▌  | 28740/37963 [71:08:29<20:33:05,  8.02s/it]
                                                           
{'loss': '0.1201', 'grad_norm': '2.347', 'learning_rate': '2.94e-06', 'epoch': '0.7571'}
+
 76%|███████▌  | 28740/37963 [71:08:29<20:33:05,  8.02s/it]
 76%|███████▌  | 28741/37963 [71:08:37<20:14:03,  7.90s/it]
 76%|███████▌  | 28742/37963 [71:08:44<20:03:04,  7.83s/it]
 76%|███████▌  | 28743/37963 [71:08:52<19:56:39,  7.79s/it]
 76%|███████▌  | 28744/37963 [71:09:06<24:38:49,  9.62s/it]
 76%|███████▌  | 28745/37963 [71:09:21<28:28:24, 11.12s/it]
 76%|███████▌  | 28746/37963 [71:09:29<26:01:28, 10.16s/it]
 76%|███████▌  | 28747/37963 [71:09:36<24:02:18,  9.39s/it]
 76%|███████▌  | 28748/37963 [71:09:44<22:36:37,  8.83s/it]
 76%|███████▌  | 28749/37963 [71:09:51<21:49:08,  8.52s/it]
 76%|███████▌  | 28750/37963 [71:09:59<21:11:07,  8.28s/it]
                                                           
{'loss': '0.1111', 'grad_norm': '2.115', 'learning_rate': '2.934e-06', 'epoch': '0.7573'}
+
 76%|███████▌  | 28750/37963 [71:09:59<21:11:07,  8.28s/it]
 76%|███████▌  | 28751/37963 [71:10:06<20:23:36,  7.97s/it]
 76%|███████▌  | 28752/37963 [71:10:21<25:30:27,  9.97s/it]
 76%|███████▌  | 28753/37963 [71:10:29<23:42:44,  9.27s/it]
 76%|███████▌  | 28754/37963 [71:10:36<22:34:12,  8.82s/it]
 76%|███████▌  | 28755/37963 [71:10:44<21:38:08,  8.46s/it]
 76%|███████▌  | 28756/37963 [71:10:52<20:58:56,  8.20s/it]
 76%|███████▌  | 28757/37963 [71:11:00<20:40:58,  8.09s/it]
 76%|███████▌  | 28758/37963 [71:11:07<20:19:12,  7.95s/it]
 76%|███████▌  | 28759/37963 [71:11:15<19:57:37,  7.81s/it]
 76%|███████▌  | 28760/37963 [71:11:22<19:48:36,  7.75s/it]
                                                           
{'loss': '0.1119', 'grad_norm': '1.915', 'learning_rate': '2.928e-06', 'epoch': '0.7576'}
+
 76%|███████▌  | 28760/37963 [71:11:22<19:48:36,  7.75s/it]
 76%|███████▌  | 28761/37963 [71:11:30<19:31:58,  7.64s/it]
 76%|███████▌  | 28762/37963 [71:11:37<19:28:00,  7.62s/it]
 76%|███████▌  | 28763/37963 [71:11:45<19:31:17,  7.64s/it]
 76%|███████▌  | 28764/37963 [71:11:52<19:20:01,  7.57s/it]
 76%|███████▌  | 28765/37963 [71:12:00<19:25:52,  7.61s/it]
 76%|███████▌  | 28766/37963 [71:12:08<19:30:10,  7.63s/it]
 76%|███████▌  | 28767/37963 [71:12:15<19:34:36,  7.66s/it]
 76%|███████▌  | 28768/37963 [71:12:23<19:35:27,  7.67s/it]
 76%|███████▌  | 28769/37963 [71:12:31<19:35:40,  7.67s/it]
 76%|███████▌  | 28770/37963 [71:12:46<25:16:42,  9.90s/it]
                                                           
{'loss': '0.1018', 'grad_norm': '1.409', 'learning_rate': '2.922e-06', 'epoch': '0.7578'}
+
 76%|███████▌  | 28770/37963 [71:12:46<25:16:42,  9.90s/it]
 76%|███████▌  | 28771/37963 [71:12:54<23:49:51,  9.33s/it]
 76%|███████▌  | 28772/37963 [71:13:08<27:12:18, 10.66s/it]
 76%|███████▌  | 28773/37963 [71:13:15<24:58:59,  9.79s/it]
 76%|███████▌  | 28774/37963 [71:13:23<23:19:53,  9.14s/it]
 76%|███████▌  | 28775/37963 [71:13:31<22:12:09,  8.70s/it]
 76%|███████▌  | 28776/37963 [71:13:38<21:14:58,  8.33s/it]
 76%|███████▌  | 28777/37963 [71:13:46<20:40:11,  8.10s/it]
 76%|███████▌  | 28778/37963 [71:14:01<25:53:31, 10.15s/it]
 76%|███████▌  | 28779/37963 [71:14:15<29:07:48, 11.42s/it]
 76%|███████▌  | 28780/37963 [71:14:23<26:15:44, 10.30s/it]
                                                           
{'loss': '0.1059', 'grad_norm': '2.887', 'learning_rate': '2.916e-06', 'epoch': '0.7581'}
+
 76%|███████▌  | 28780/37963 [71:14:23<26:15:44, 10.30s/it]
 76%|███████▌  | 28781/37963 [71:14:30<24:16:20,  9.52s/it]
 76%|███████▌  | 28782/37963 [71:14:38<22:51:38,  8.96s/it]
 76%|███████▌  | 28783/37963 [71:14:46<21:54:05,  8.59s/it]
 76%|███████▌  | 28784/37963 [71:14:53<21:14:39,  8.33s/it]
 76%|███████▌  | 28785/37963 [71:15:01<20:32:02,  8.05s/it]
 76%|███████▌  | 28786/37963 [71:15:09<20:15:29,  7.95s/it]
 76%|███████▌  | 28787/37963 [71:15:16<20:10:49,  7.92s/it]
 76%|███████▌  | 28788/37963 [71:15:24<19:55:26,  7.82s/it]
 76%|███████▌  | 28789/37963 [71:15:45<29:48:40, 11.70s/it]
 76%|███████▌  | 28790/37963 [71:15:52<26:44:21, 10.49s/it]
                                                           
{'loss': '0.1026', 'grad_norm': '2.016', 'learning_rate': '2.91e-06', 'epoch': '0.7584'}
+
 76%|███████▌  | 28790/37963 [71:15:52<26:44:21, 10.49s/it]
 76%|███████▌  | 28791/37963 [71:16:00<24:26:08,  9.59s/it]
 76%|███████▌  | 28792/37963 [71:16:14<28:08:19, 11.05s/it]
 76%|███████▌  | 28793/37963 [71:16:22<25:37:11, 10.06s/it]
 76%|███████▌  | 28794/37963 [71:16:30<23:46:18,  9.33s/it]
 76%|███████▌  | 28795/37963 [71:16:37<22:29:48,  8.83s/it]
 76%|███████▌  | 28796/37963 [71:16:53<27:24:28, 10.76s/it]
 76%|███████▌  | 28797/37963 [71:17:00<24:58:47,  9.81s/it]
 76%|███████▌  | 28798/37963 [71:17:08<23:22:12,  9.18s/it]
 76%|███████▌  | 28799/37963 [71:17:16<22:15:48,  8.75s/it]
 76%|███████▌  | 28800/37963 [71:17:23<21:26:10,  8.42s/it]
                                                           
{'loss': '0.1083', 'grad_norm': '2.335', 'learning_rate': '2.904e-06', 'epoch': '0.7586'}
+
 76%|███████▌  | 28800/37963 [71:17:23<21:26:10,  8.42s/it]
 76%|███████▌  | 28801/37963 [71:17:31<20:40:54,  8.13s/it]
 76%|███████▌  | 28802/37963 [71:17:38<20:17:37,  7.97s/it]
 76%|███████▌  | 28803/37963 [71:17:46<19:51:56,  7.81s/it]
 76%|███████▌  | 28804/37963 [71:17:54<19:48:12,  7.78s/it]
 76%|███████▌  | 28805/37963 [71:18:01<19:47:40,  7.78s/it]
 76%|███████▌  | 28806/37963 [71:18:09<19:39:33,  7.73s/it]
 76%|███████▌  | 28807/37963 [71:18:17<19:29:20,  7.66s/it]
 76%|███████▌  | 28808/37963 [71:18:24<19:30:09,  7.67s/it]
 76%|███████▌  | 28809/37963 [71:18:32<19:27:46,  7.65s/it]
 76%|███████▌  | 28810/37963 [71:18:40<19:29:57,  7.67s/it]
                                                           
{'loss': '0.1081', 'grad_norm': '1.875', 'learning_rate': '2.898e-06', 'epoch': '0.7589'}
+
 76%|███████▌  | 28810/37963 [71:18:40<19:29:57,  7.67s/it]
 76%|███████▌  | 28811/37963 [71:18:47<19:26:51,  7.65s/it]
 76%|███████▌  | 28812/37963 [71:18:55<19:28:30,  7.66s/it]
 76%|███████▌  | 28813/37963 [71:19:02<19:22:49,  7.63s/it]
 76%|███████▌  | 28814/37963 [71:19:10<19:22:41,  7.63s/it]
 76%|███████▌  | 28815/37963 [71:19:18<19:25:49,  7.65s/it]
 76%|███████▌  | 28816/37963 [71:19:25<19:28:09,  7.66s/it]
 76%|███████▌  | 28817/37963 [71:19:33<19:23:37,  7.63s/it]
 76%|███████▌  | 28818/37963 [71:19:41<19:23:35,  7.63s/it]
 76%|███████▌  | 28819/37963 [71:19:48<19:22:09,  7.63s/it]
 76%|███████▌  | 28820/37963 [71:20:02<24:23:48,  9.61s/it]
                                                           
{'loss': '0.1225', 'grad_norm': '3.152', 'learning_rate': '2.892e-06', 'epoch': '0.7592'}
+
 76%|███████▌  | 28820/37963 [71:20:02<24:23:48,  9.61s/it]
 76%|███████▌  | 28821/37963 [71:20:17<28:12:31, 11.11s/it]
 76%|███████▌  | 28822/37963 [71:20:25<25:38:34, 10.10s/it]
 76%|███████▌  | 28823/37963 [71:20:33<23:58:39,  9.44s/it]
 76%|███████▌  | 28824/37963 [71:20:40<22:41:40,  8.94s/it]
 76%|███████▌  | 28825/37963 [71:20:55<27:20:39, 10.77s/it]
 76%|███████▌  | 28826/37963 [71:21:03<24:58:59,  9.84s/it]
 76%|███████▌  | 28827/37963 [71:21:11<23:13:57,  9.15s/it]
 76%|███████▌  | 28828/37963 [71:21:19<22:18:13,  8.79s/it]
 76%|███████▌  | 28829/37963 [71:21:26<21:28:07,  8.46s/it]
 76%|███████▌  | 28830/37963 [71:21:34<20:49:59,  8.21s/it]
                                                           
{'loss': '0.1223', 'grad_norm': '1.77', 'learning_rate': '2.886e-06', 'epoch': '0.7594'}
+
 76%|███████▌  | 28830/37963 [71:21:34<20:49:59,  8.21s/it]
 76%|███████▌  | 28831/37963 [71:21:42<20:27:24,  8.06s/it]
 76%|███████▌  | 28832/37963 [71:21:50<20:15:18,  7.99s/it]
 76%|███████▌  | 28833/37963 [71:22:04<25:02:59,  9.88s/it]
 76%|███████▌  | 28834/37963 [71:22:11<23:23:26,  9.22s/it]
 76%|███████▌  | 28835/37963 [71:22:19<22:10:46,  8.75s/it]
 76%|███████▌  | 28836/37963 [71:22:27<21:17:21,  8.40s/it]
 76%|███████▌  | 28837/37963 [71:22:41<25:26:14, 10.03s/it]
 76%|███████▌  | 28838/37963 [71:22:49<24:03:49,  9.49s/it]
 76%|███████▌  | 28839/37963 [71:22:56<22:38:56,  8.94s/it]
 76%|███████▌  | 28840/37963 [71:23:10<26:27:25, 10.44s/it]
                                                           
{'loss': '0.1119', 'grad_norm': '2.57', 'learning_rate': '2.88e-06', 'epoch': '0.7597'}
+
 76%|███████▌  | 28840/37963 [71:23:10<26:27:25, 10.44s/it]
 76%|███████▌  | 28841/37963 [71:23:25<29:59:03, 11.83s/it]
 76%|███████▌  | 28842/37963 [71:23:40<31:41:23, 12.51s/it]
 76%|███████▌  | 28843/37963 [71:23:47<28:03:35, 11.08s/it]
 76%|███████▌  | 28844/37963 [71:23:55<25:30:59, 10.07s/it]
 76%|███████▌  | 28845/37963 [71:24:03<23:38:42,  9.34s/it]
 76%|███████▌  | 28846/37963 [71:24:10<22:26:45,  8.86s/it]
 76%|███████▌  | 28847/37963 [71:24:18<21:40:01,  8.56s/it]
 76%|███████▌  | 28848/37963 [71:24:26<21:09:48,  8.36s/it]
 76%|███████▌  | 28849/37963 [71:24:34<20:37:30,  8.15s/it]
 76%|███████▌  | 28850/37963 [71:24:41<20:17:11,  8.01s/it]
                                                           
{'loss': '0.09928', 'grad_norm': '1.961', 'learning_rate': '2.874e-06', 'epoch': '0.76'}
+
 76%|███████▌  | 28850/37963 [71:24:41<20:17:11,  8.01s/it]
 76%|███████▌  | 28851/37963 [71:24:49<19:58:32,  7.89s/it]
 76%|███████▌  | 28852/37963 [71:24:57<19:48:32,  7.83s/it]
 76%|███████▌  | 28853/37963 [71:25:04<19:37:37,  7.76s/it]
 76%|███████▌  | 28854/37963 [71:25:12<19:31:55,  7.72s/it]
 76%|███████▌  | 28855/37963 [71:25:20<19:33:15,  7.73s/it]
 76%|███████▌  | 28856/37963 [71:25:28<19:37:10,  7.76s/it]
 76%|███████▌  | 28857/37963 [71:25:35<19:33:35,  7.73s/it]
 76%|███████▌  | 28858/37963 [71:25:43<19:30:57,  7.72s/it]
 76%|███████▌  | 28859/37963 [71:25:51<19:24:33,  7.68s/it]
 76%|███████▌  | 28860/37963 [71:25:58<19:27:38,  7.70s/it]
                                                           
{'loss': '0.111', 'grad_norm': '3.299', 'learning_rate': '2.868e-06', 'epoch': '0.7602'}
+
 76%|███████▌  | 28860/37963 [71:25:58<19:27:38,  7.70s/it]
 76%|███████▌  | 28861/37963 [71:26:06<19:15:48,  7.62s/it]
 76%|███████▌  | 28862/37963 [71:26:13<19:12:29,  7.60s/it]
 76%|███████▌  | 28863/37963 [71:26:21<19:06:59,  7.56s/it]
 76%|███████▌  | 28864/37963 [71:26:28<19:04:18,  7.55s/it]
 76%|███████▌  | 28865/37963 [71:26:36<19:07:57,  7.57s/it]
 76%|███████▌  | 28866/37963 [71:26:44<19:12:24,  7.60s/it]
 76%|███████▌  | 28867/37963 [71:26:51<19:16:43,  7.63s/it]
 76%|███████▌  | 28868/37963 [71:26:59<19:06:44,  7.57s/it]
 76%|███████▌  | 28869/37963 [71:27:20<29:45:57, 11.78s/it]
 76%|███████▌  | 28870/37963 [71:27:28<26:49:55, 10.62s/it]
                                                           
{'loss': '0.1098', 'grad_norm': '1.901', 'learning_rate': '2.862e-06', 'epoch': '0.7605'}
+
 76%|███████▌  | 28870/37963 [71:27:28<26:49:55, 10.62s/it]
 76%|███████▌  | 28871/37963 [71:27:43<29:43:46, 11.77s/it]
 76%|███████▌  | 28872/37963 [71:27:50<26:43:52, 10.59s/it]
 76%|███████▌  | 28873/37963 [71:27:58<24:23:51,  9.66s/it]
 76%|███████▌  | 28874/37963 [71:28:06<22:50:22,  9.05s/it]
 76%|███████▌  | 28875/37963 [71:28:13<21:43:19,  8.60s/it]
 76%|███████▌  | 28876/37963 [71:28:21<20:58:36,  8.31s/it]
 76%|███████▌  | 28877/37963 [71:28:28<20:32:06,  8.14s/it]
 76%|███████▌  | 28878/37963 [71:28:36<20:11:16,  8.00s/it]
 76%|███████▌  | 28879/37963 [71:28:44<19:53:26,  7.88s/it]
 76%|███████▌  | 28880/37963 [71:28:52<19:48:24,  7.85s/it]
                                                           
{'loss': '0.09662', 'grad_norm': '1.526', 'learning_rate': '2.856e-06', 'epoch': '0.7607'}
+
 76%|███████▌  | 28880/37963 [71:28:52<19:48:24,  7.85s/it]
 76%|███████▌  | 28881/37963 [71:28:59<19:43:38,  7.82s/it]
 76%|███████▌  | 28882/37963 [71:29:07<19:23:42,  7.69s/it]
 76%|███████▌  | 28883/37963 [71:29:14<19:21:01,  7.67s/it]
 76%|███████▌  | 28884/37963 [71:29:22<19:31:16,  7.74s/it]
 76%|███████▌  | 28885/37963 [71:29:37<24:30:40,  9.72s/it]
 76%|███████▌  | 28886/37963 [71:29:51<27:55:46, 11.08s/it]
 76%|███████▌  | 28887/37963 [71:30:05<30:30:24, 12.10s/it]
 76%|███████▌  | 28888/37963 [71:30:13<27:03:54, 10.74s/it]
 76%|███████▌  | 28889/37963 [71:30:27<29:58:32, 11.89s/it]
 76%|███████▌  | 28890/37963 [71:30:35<26:50:45, 10.65s/it]
                                                           
{'loss': '0.09295', 'grad_norm': '1.888', 'learning_rate': '2.85e-06', 'epoch': '0.761'}
+
 76%|███████▌  | 28890/37963 [71:30:35<26:50:45, 10.65s/it]
 76%|███████▌  | 28891/37963 [71:30:43<24:36:22,  9.76s/it]
 76%|███████▌  | 28892/37963 [71:30:50<22:57:18,  9.11s/it]
 76%|███████▌  | 28893/37963 [71:30:58<21:35:14,  8.57s/it]
 76%|███████▌  | 28894/37963 [71:31:05<20:49:36,  8.27s/it]
 76%|███████▌  | 28895/37963 [71:31:13<20:22:46,  8.09s/it]
 76%|███████▌  | 28896/37963 [71:31:27<25:07:59,  9.98s/it]
 76%|███████▌  | 28897/37963 [71:31:35<23:17:48,  9.25s/it]
 76%|███████▌  | 28898/37963 [71:31:43<22:02:26,  8.75s/it]
 76%|███████▌  | 28899/37963 [71:31:50<21:13:16,  8.43s/it]
 76%|███████▌  | 28900/37963 [71:31:58<20:42:48,  8.23s/it]
                                                           
{'loss': '0.1043', 'grad_norm': '2.308', 'learning_rate': '2.844e-06', 'epoch': '0.7613'}
+
 76%|███████▌  | 28900/37963 [71:31:58<20:42:48,  8.23s/it]
 76%|███████▌  | 28901/37963 [71:32:06<20:23:31,  8.10s/it]
 76%|███████▌  | 28902/37963 [71:32:13<20:05:14,  7.98s/it]
 76%|███████▌  | 28903/37963 [71:32:21<19:51:55,  7.89s/it]
 76%|███████▌  | 28904/37963 [71:32:29<19:36:19,  7.79s/it]
 76%|███████▌  | 28905/37963 [71:32:36<19:31:57,  7.76s/it]
 76%|███████▌  | 28906/37963 [71:32:44<19:24:57,  7.72s/it]
 76%|███████▌  | 28907/37963 [71:32:52<19:25:01,  7.72s/it]
 76%|███████▌  | 28908/37963 [71:32:59<19:14:21,  7.65s/it]
 76%|███████▌  | 28909/37963 [71:33:07<19:21:31,  7.70s/it]
 76%|███████▌  | 28910/37963 [71:33:14<19:07:24,  7.60s/it]
                                                           
{'loss': '0.09963', 'grad_norm': '1.712', 'learning_rate': '2.838e-06', 'epoch': '0.7615'}
+
 76%|███████▌  | 28910/37963 [71:33:14<19:07:24,  7.60s/it]
 76%|███████▌  | 28911/37963 [71:33:22<19:19:44,  7.69s/it]
 76%|███████▌  | 28912/37963 [71:33:30<18:59:37,  7.55s/it]
 76%|███████▌  | 28913/37963 [71:33:37<19:02:45,  7.58s/it]
 76%|███████▌  | 28914/37963 [71:33:45<18:51:53,  7.51s/it]
 76%|███████▌  | 28915/37963 [71:33:52<18:44:13,  7.46s/it]
 76%|███████▌  | 28916/37963 [71:34:14<29:28:11, 11.73s/it]
 76%|███████▌  | 28917/37963 [71:34:21<26:30:11, 10.55s/it]
 76%|███████▌  | 28918/37963 [71:34:29<24:20:21,  9.69s/it]
 76%|███████▌  | 28919/37963 [71:34:43<27:42:20, 11.03s/it]
 76%|███████▌  | 28920/37963 [71:34:51<25:06:49, 10.00s/it]
                                                           
{'loss': '0.1012', 'grad_norm': '2.253', 'learning_rate': '2.832e-06', 'epoch': '0.7618'}
+
 76%|███████▌  | 28920/37963 [71:34:51<25:06:49, 10.00s/it]
 76%|███████▌  | 28921/37963 [71:34:59<23:24:18,  9.32s/it]
 76%|███████▌  | 28922/37963 [71:35:06<22:02:30,  8.78s/it]
 76%|███████▌  | 28923/37963 [71:35:14<21:16:06,  8.47s/it]
 76%|███████▌  | 28924/37963 [71:35:21<20:28:23,  8.15s/it]
 76%|███████▌  | 28925/37963 [71:35:29<20:08:24,  8.02s/it]
 76%|███████▌  | 28926/37963 [71:35:37<19:51:58,  7.91s/it]
 76%|███████▌  | 28927/37963 [71:35:44<19:26:24,  7.75s/it]
 76%|███████▌  | 28928/37963 [71:35:51<19:11:41,  7.65s/it]
 76%|███████▌  | 28929/37963 [71:36:06<24:05:44,  9.60s/it]
 76%|███████▌  | 28930/37963 [71:36:19<27:22:38, 10.91s/it]
                                                           
{'loss': '0.09962', 'grad_norm': '2.754', 'learning_rate': '2.826e-06', 'epoch': '0.7621'}
+
 76%|███████▌  | 28930/37963 [71:36:19<27:22:38, 10.91s/it]
 76%|███████▌  | 28931/37963 [71:36:27<24:53:55,  9.92s/it]
 76%|███████▌  | 28932/37963 [71:36:35<23:15:37,  9.27s/it]
 76%|███████▌  | 28933/37963 [71:36:43<22:03:13,  8.79s/it]
 76%|█���█████▌  | 28934/37963 [71:36:50<21:13:34,  8.46s/it]
 76%|███████▌  | 28935/37963 [71:36:58<20:40:34,  8.24s/it]
 76%|███████▌  | 28936/37963 [71:37:13<25:32:13, 10.18s/it]
 76%|███████▌  | 28937/37963 [71:37:20<23:43:35,  9.46s/it]
 76%|███████▌  | 28938/37963 [71:37:28<22:22:33,  8.93s/it]
 76%|███████▌  | 28939/37963 [71:37:36<21:18:23,  8.50s/it]
 76%|███████▌  | 28940/37963 [71:37:50<25:43:06, 10.26s/it]
                                                           
{'loss': '0.1179', 'grad_norm': '2.154', 'learning_rate': '2.82e-06', 'epoch': '0.7623'}
+
 76%|███████▌  | 28940/37963 [71:37:50<25:43:06, 10.26s/it]
 76%|███████▌  | 28941/37963 [71:37:57<23:38:16,  9.43s/it]
 76%|███████▌  | 28942/37963 [71:38:05<22:14:56,  8.88s/it]
 76%|███████▌  | 28943/37963 [71:38:13<21:19:47,  8.51s/it]
 76%|███████▌  | 28944/37963 [71:38:21<20:47:37,  8.30s/it]
 76%|███████▌  | 28945/37963 [71:38:28<20:22:46,  8.14s/it]
 76%|███████▌  | 28946/37963 [71:38:36<20:08:03,  8.04s/it]
 76%|███████▋  | 28947/37963 [71:38:43<19:38:13,  7.84s/it]
 76%|███████▋  | 28948/37963 [71:38:51<19:33:25,  7.81s/it]
 76%|███████▋  | 28949/37963 [71:38:59<19:26:55,  7.77s/it]
 76%|███████▋  | 28950/37963 [71:39:13<24:27:58,  9.77s/it]
                                                           
{'loss': '0.106', 'grad_norm': '3.663', 'learning_rate': '2.814e-06', 'epoch': '0.7626'}
+
 76%|███████▋  | 28950/37963 [71:39:13<24:27:58,  9.77s/it]
 76%|███████▋  | 28951/37963 [71:39:21<22:58:35,  9.18s/it]
 76%|███████▋  | 28952/37963 [71:39:29<21:50:30,  8.73s/it]
 76%|███████▋  | 28953/37963 [71:39:37<21:04:21,  8.42s/it]
 76%|███████▋  | 28954/37963 [71:39:44<20:37:31,  8.24s/it]
 76%|███████▋  | 28955/37963 [71:39:52<20:01:37,  8.00s/it]
 76%|███████▋  | 28956/37963 [71:40:00<19:51:16,  7.94s/it]
 76%|███████▋  | 28957/37963 [71:40:07<19:24:20,  7.76s/it]
 76%|███████▋  | 28958/37963 [71:40:14<19:09:22,  7.66s/it]
 76%|███████▋  | 28959/37963 [71:40:22<18:51:57,  7.54s/it]
 76%|███████▋  | 28960/37963 [71:40:29<18:48:02,  7.52s/it]
                                                           
{'loss': '0.1032', 'grad_norm': '2.299', 'learning_rate': '2.808e-06', 'epoch': '0.7629'}
+
 76%|███████▋  | 28960/37963 [71:40:29<18:48:02,  7.52s/it]
 76%|███████▋  | 28961/37963 [71:40:37<18:45:24,  7.50s/it]
 76%|███████▋  | 28962/37963 [71:40:44<18:52:32,  7.55s/it]
 76%|███████▋  | 28963/37963 [71:40:58<23:52:10,  9.55s/it]
 76%|███████▋  | 28964/37963 [71:41:13<27:48:46, 11.13s/it]
 76%|███████▋  | 28965/37963 [71:41:21<25:15:08, 10.10s/it]
 76%|███████▋  | 28966/37963 [71:41:29<23:27:24,  9.39s/it]
 76%|███████▋  | 28967/37963 [71:41:36<22:09:51,  8.87s/it]
 76%|███████▋  | 28968/37963 [71:41:44<21:04:55,  8.44s/it]
 76%|███████▋  | 28969/37963 [71:41:51<20:25:30,  8.18s/it]
 76%|███████▋  | 28970/37963 [71:42:06<25:25:07, 10.18s/it]
                                                           
{'loss': '0.08858', 'grad_norm': '1.748', 'learning_rate': '2.802e-06', 'epoch': '0.7631'}
+
 76%|███████▋  | 28970/37963 [71:42:06<25:25:07, 10.18s/it]
 76%|███████▋  | 28971/37963 [71:42:14<23:31:18,  9.42s/it]
 76%|███████▋  | 28972/37963 [71:42:21<22:11:05,  8.88s/it]
 76%|███████▋  | 28973/37963 [71:42:29<21:02:09,  8.42s/it]
 76%|███████▋  | 28974/37963 [71:42:36<20:27:13,  8.19s/it]
 76%|███████▋  | 28975/37963 [71:42:44<20:03:26,  8.03s/it]
 76%|███████▋  | 28976/37963 [71:42:59<24:54:14,  9.98s/it]
 76%|███████▋  | 28977/37963 [71:43:06<23:18:22,  9.34s/it]
 76%|███████▋  | 28978/37963 [71:43:14<21:59:38,  8.81s/it]
 76%|███████▋  | 28979/37963 [71:43:29<26:16:25, 10.53s/it]
 76%|███████▋  | 28980/37963 [71:43:36<24:05:24,  9.65s/it]
                                                           
{'loss': '0.1147', 'grad_norm': '3', 'learning_rate': '2.796e-06', 'epoch': '0.7634'}
+
 76%|███████▋  | 28980/37963 [71:43:36<24:05:24,  9.65s/it]
 76%|███████▋  | 28981/37963 [71:43:44<22:33:39,  9.04s/it]
 76%|███████▋  | 28982/37963 [71:43:51<21:30:56,  8.62s/it]
 76%|███████▋  | 28983/37963 [71:43:59<20:53:56,  8.38s/it]
 76%|███████▋  | 28984/37963 [71:44:07<20:18:59,  8.15s/it]
 76%|███████▋  | 28985/37963 [71:44:15<19:59:24,  8.02s/it]
 76%|███████▋  | 28986/37963 [71:44:22<19:38:20,  7.88s/it]
 76%|███████▋  | 28987/37963 [71:44:30<19:34:25,  7.85s/it]
 76%|███████▋  | 28988/37963 [71:44:38<19:25:22,  7.79s/it]
 76%|███████▋  | 28989/37963 [71:44:53<24:51:51,  9.97s/it]
 76%|███████▋  | 28990/37963 [71:45:00<23:15:56,  9.33s/it]
                                                           
{'loss': '0.1054', 'grad_norm': '2.76', 'learning_rate': '2.79e-06', 'epoch': '0.7636'}
+
 76%|███████▋  | 28990/37963 [71:45:00<23:15:56,  9.33s/it]
 76%|███████▋  | 28991/37963 [71:45:08<21:55:02,  8.79s/it]
 76%|███████▋  | 28992/37963 [71:45:16<21:13:27,  8.52s/it]
 76%|███████▋  | 28993/37963 [71:45:24<20:36:42,  8.27s/it]
 76%|███████▋  | 28994/37963 [71:45:31<20:12:38,  8.11s/it]
 76%|███████▋  | 28995/37963 [71:45:39<19:48:09,  7.95s/it]
 76%|███████▋  | 28996/37963 [71:45:47<19:40:28,  7.90s/it]
 76%|███████▋  | 28997/37963 [71:45:54<19:31:33,  7.84s/it]
 76%|███████▋  | 28998/37963 [71:46:02<19:18:07,  7.75s/it]
 76%|███████▋  | 28999/37963 [71:46:10<19:11:07,  7.70s/it]
 76%|███████▋  | 29000/37963 [71:46:17<19:09:54,  7.70s/it]
                                                           
{'loss': '0.09983', 'grad_norm': '4.194', 'learning_rate': '2.784e-06', 'epoch': '0.7639'}
+
 76%|███████▋  | 29000/37963 [71:46:17<19:09:54,  7.70s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.69s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.69s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 76%|███████▋  | 29001/37963 [71:47:14<56:09:49, 22.56s/it]
 76%|███████▋  | 29002/37963 [71:47:22<45:13:48, 18.17s/it]
 76%|███████▋  | 29003/37963 [71:47:37<42:24:20, 17.04s/it]
 76%|███████▋  | 29004/37963 [71:47:44<35:27:38, 14.25s/it]
 76%|███████▋  | 29005/37963 [71:47:52<30:38:43, 12.32s/it]
 76%|███████▋  | 29006/37963 [71:48:00<27:08:12, 10.91s/it]
 76%|███████▋  | 29007/37963 [71:48:08<24:46:39,  9.96s/it]
 76%|███████▋  | 29008/37963 [71:48:22<27:48:09, 11.18s/it]
 76%|███████▋  | 29009/37963 [71:48:29<25:08:46, 10.11s/it]
 76%|███████▋  | 29010/37963 [71:48:37<23:12:04,  9.33s/it]
                                                           
{'loss': '0.116', 'grad_norm': '2.25', 'learning_rate': '2.779e-06', 'epoch': '0.7642'}
+
 76%|███████▋  | 29010/37963 [71:48:37<23:12:04,  9.33s/it]
 76%|███████▋  | 29011/37963 [71:48:52<27:23:21, 11.01s/it]
 76%|███████▋  | 29012/37963 [71:48:59<24:51:26, 10.00s/it]
 76%|███████▋  | 29013/37963 [71:49:07<23:04:22,  9.28s/it]
 76%|███████▋  | 29014/37963 [71:49:15<21:51:19,  8.79s/it]
 76%|███████▋  | 29015/37963 [71:49:22<21:06:11,  8.49s/it]
 76%|███████▋  | 29016/37963 [71:49:30<20:31:44,  8.26s/it]
 76%|███████▋  | 29017/37963 [71:49:38<20:10:54,  8.12s/it]
 76%|███████▋  | 29018/37963 [71:49:46<19:52:06,  8.00s/it]
 76%|███████▋  | 29019/37963 [71:49:53<19:41:20,  7.92s/it]
 76%|███████▋  | 29020/37963 [71:50:08<24:57:52, 10.05s/it]
                                                           
{'loss': '0.1124', 'grad_norm': '2.763', 'learning_rate': '2.773e-06', 'epoch': '0.7644'}
+
 76%|███████▋  | 29020/37963 [71:50:08<24:57:52, 10.05s/it]
 76%|███████▋  | 29021/37963 [71:50:16<23:10:22,  9.33s/it]
 76%|███████▋  | 29022/37963 [71:50:24<21:57:01,  8.84s/it]
 76%|███████▋  | 29023/37963 [71:50:31<21:01:13,  8.46s/it]
 76%|███████▋  | 29024/37963 [71:50:39<20:30:41,  8.26s/it]
 76%|███████▋  | 29025/37963 [71:50:47<20:11:32,  8.13s/it]
 76%|███████▋  | 29026/37963 [71:50:54<19:41:39,  7.93s/it]
 76%|███████▋  | 29027/37963 [71:51:09<24:33:06,  9.89s/it]
 76%|███████▋  | 29028/37963 [71:51:16<22:46:12,  9.17s/it]
 76%|███████▋  | 29029/37963 [71:51:31<26:47:34, 10.80s/it]
 76%|███████▋  | 29030/37963 [71:51:39<24:33:05,  9.89s/it]
                                                           
{'loss': '0.1138', 'grad_norm': '2.884', 'learning_rate': '2.767e-06', 'epoch': '0.7647'}
+
 76%|███████▋  | 29030/37963 [71:51:39<24:33:05,  9.89s/it]
 76%|███████▋  | 29031/37963 [71:51:46<22:50:56,  9.21s/it]
 76%|████��██▋  | 29032/37963 [71:51:54<21:24:43,  8.63s/it]
 76%|███████▋  | 29033/37963 [71:52:01<20:44:54,  8.36s/it]
 76%|███████▋  | 29034/37963 [71:52:09<20:09:54,  8.13s/it]
 76%|███████▋  | 29035/37963 [71:52:17<19:48:57,  7.99s/it]
 76%|███████▋  | 29036/37963 [71:52:31<24:46:05,  9.99s/it]
 76%|███████▋  | 29037/37963 [71:52:39<23:05:45,  9.31s/it]
 76%|███████▋  | 29038/37963 [71:52:47<21:52:36,  8.82s/it]
 76%|███████▋  | 29039/37963 [71:52:54<21:04:47,  8.50s/it]
 76%|███████▋  | 29040/37963 [71:53:02<20:25:00,  8.24s/it]
                                                           
{'loss': '0.1087', 'grad_norm': '2.024', 'learning_rate': '2.761e-06', 'epoch': '0.765'}
+
 76%|███████▋  | 29040/37963 [71:53:02<20:25:00,  8.24s/it]
 76%|███████▋  | 29041/37963 [71:53:17<25:09:46, 10.15s/it]
 77%|███████▋  | 29042/37963 [71:53:25<23:24:43,  9.45s/it]
 77%|███████▋  | 29043/37963 [71:53:32<22:05:05,  8.91s/it]
 77%|███████▋  | 29044/37963 [71:53:40<21:04:26,  8.51s/it]
 77%|███████▋  | 29045/37963 [71:53:47<20:30:27,  8.28s/it]
 77%|███████▋  | 29046/37963 [71:53:55<20:08:40,  8.13s/it]
 77%|███████▋  | 29047/37963 [71:54:03<19:42:22,  7.96s/it]
 77%|███████▋  | 29048/37963 [71:54:11<19:31:23,  7.88s/it]
 77%|███████▋  | 29049/37963 [71:54:18<19:19:45,  7.81s/it]
 77%|███████▋  | 29050/37963 [71:54:26<19:16:17,  7.78s/it]
                                                           
{'loss': '0.1004', 'grad_norm': '2.06', 'learning_rate': '2.755e-06', 'epoch': '0.7652'}
+
 77%|███████▋  | 29050/37963 [71:54:26<19:16:17,  7.78s/it]
 77%|███████▋  | 29051/37963 [71:54:40<24:10:16,  9.76s/it]
 77%|███████▋  | 29052/37963 [71:54:48<22:33:26,  9.11s/it]
 77%|███████▋  | 29053/37963 [71:54:55<21:25:28,  8.66s/it]
 77%|███████▋  | 29054/37963 [71:55:03<20:39:27,  8.35s/it]
 77%|███████▋  | 29055/37963 [71:55:11<20:07:32,  8.13s/it]
 77%|███████▋  | 29056/37963 [71:55:18<19:48:27,  8.01s/it]
 77%|███████▋  | 29057/37963 [71:55:26<19:36:23,  7.93s/it]
 77%|███████▋  | 29058/37963 [71:55:41<24:43:52, 10.00s/it]
 77%|███████▋  | 29059/37963 [71:55:49<23:05:31,  9.34s/it]
 77%|███████▋  | 29060/37963 [71:55:56<21:49:00,  8.82s/it]
                                                           
{'loss': '0.1073', 'grad_norm': '2.445', 'learning_rate': '2.749e-06', 'epoch': '0.7655'}
+
 77%|███████▋  | 29060/37963 [71:55:56<21:49:00,  8.82s/it]
 77%|███████▋  | 29061/37963 [71:56:11<26:02:34, 10.53s/it]
 77%|███████▋  | 29062/37963 [71:56:19<23:56:11,  9.68s/it]
 77%|███████▋  | 29063/37963 [71:56:26<22:26:02,  9.07s/it]
 77%|███████▋  | 29064/37963 [71:56:34<21:11:51,  8.58s/it]
 77%|███████▋  | 29065/37963 [71:56:41<20:22:10,  8.24s/it]
 77%|███████▋  | 29066/37963 [71:56:49<19:53:15,  8.05s/it]
 77%|███████▋  | 29067/37963 [71:56:56<19:35:58,  7.93s/it]
 77%|███████▋  | 29068/37963 [71:57:11<24:48:33, 10.04s/it]
 77%|███████▋  | 29069/37963 [71:57:19<23:08:10,  9.36s/it]
 77%|███████▋  | 29070/37963 [71:57:27<21:52:28,  8.86s/it]
                                                           
{'loss': '0.09562', 'grad_norm': '1.968', 'learning_rate': '2.743e-06', 'epoch': '0.7657'}
+
 77%|███████▋  | 29070/37963 [71:57:27<21:52:28,  8.86s/it]
 77%|███████▋  | 29071/37963 [71:57:41<26:04:03, 10.55s/it]
 77%|███████▋  | 29072/37963 [71:57:49<23:59:26,  9.71s/it]
 77%|███████▋  | 29073/37963 [71:58:04<27:36:34, 11.18s/it]
 77%|███████▋  | 29074/37963 [71:58:11<25:00:45, 10.13s/it]
 77%|███████▋  | 29075/37963 [71:58:19<23:12:04,  9.40s/it]
 77%|███████▋  | 29076/37963 [71:58:27<21:57:55,  8.90s/it]
 77%|███████▋  | 29077/37963 [71:58:34<21:03:21,  8.53s/it]
 77%|███████▋  | 29078/37963 [71:58:42<20:23:35,  8.26s/it]
 77%|███████▋  | 29079/37963 [71:58:50<20:00:55,  8.11s/it]
 77%|███████▋  | 29080/37963 [71:58:58<19:46:51,  8.02s/it]
                                                           
{'loss': '0.1086', 'grad_norm': '2.637', 'learning_rate': '2.737e-06', 'epoch': '0.766'}
+
 77%|███████▋  | 29080/37963 [71:58:58<19:46:51,  8.02s/it]
 77%|███████▋  | 29081/37963 [71:59:05<19:23:47,  7.86s/it]
 77%|███████▋  | 29082/37963 [71:59:13<19:15:48,  7.81s/it]
 77%|███████▋  | 29083/37963 [71:59:21<19:15:12,  7.81s/it]
 77%|███████▋  | 29084/37963 [71:59:35<24:25:59,  9.91s/it]
 77%|███████▋  | 29085/37963 [71:59:43<22:45:53,  9.23s/it]
 77%|███████▋  | 29086/37963 [71:59:51<21:41:08,  8.79s/it]
 77%|███████▋  | 29087/37963 [71:59:58<20:46:21,  8.43s/it]
 77%|███████▋  | 29088/37963 [72:00:06<20:13:25,  8.20s/it]
 77%|███████▋  | 29089/37963 [72:00:20<24:30:30,  9.94s/it]
 77%|███████▋  | 29090/37963 [72:00:28<22:52:52,  9.28s/it]
                                                           
{'loss': '0.1052', 'grad_norm': '2.162', 'learning_rate': '2.732e-06', 'epoch': '0.7663'}
+
 77%|███████▋  | 29090/37963 [72:00:28<22:52:52,  9.28s/it]
 77%|███████▋  | 29091/37963 [72:00:36<21:44:42,  8.82s/it]
 77%|███████▋  | 29092/37963 [72:00:43<20:45:30,  8.42s/it]
 77%|███████▋  | 29093/37963 [72:00:51<20:15:35,  8.22s/it]
 77%|███████▋  | 29094/37963 [72:00:58<19:42:54,  8.00s/it]
 77%|███████▋  | 29095/37963 [72:01:06<19:24:00,  7.88s/it]
 77%|███████▋  | 29096/37963 [72:01:14<19:14:43,  7.81s/it]
 77%|███████▋  | 29097/37963 [72:01:21<19:03:09,  7.74s/it]
 77%|███████▋  | 29098/37963 [72:01:29<19:10:31,  7.79s/it]
 77%|███████▋  | 29099/37963 [72:01:43<23:59:27,  9.74s/it]
 77%|███████▋  | 29100/37963 [72:01:51<22:18:16,  9.06s/it]
                                                           
{'loss': '0.1053', 'grad_norm': '1.66', 'learning_rate': '2.726e-06', 'epoch': '0.7665'}
+
 77%|███████▋  | 29100/37963 [72:01:51<22:18:16,  9.06s/it]
 77%|███████▋  | 29101/37963 [72:01:58<21:07:01,  8.58s/it]
 77%|███████▋  | 29102/37963 [72:02:06<20:29:01,  8.32s/it]
 77%|███████▋  | 29103/37963 [72:02:14<20:00:22,  8.13s/it]
 77%|███████▋  | 29104/37963 [72:02:22<19:46:43,  8.04s/it]
 77%|███████▋  | 29105/37963 [72:02:29<19:30:56,  7.93s/it]
 77%|███████▋  | 29106/37963 [72:02:37<19:17:39,  7.84s/it]
 77%|███████▋  | 29107/37963 [72:02:45<19:13:36,  7.82s/it]
 77%|███████▋  | 29108/37963 [72:02:59<24:06:25,  9.80s/it]
 77%|███████▋  | 29109/37963 [72:03:13<27:21:20, 11.12s/it]
 77%|███████▋  | 29110/37963 [72:03:21<24:55:11, 10.13s/it]
                                                           
{'loss': '0.1135', 'grad_norm': '3.235', 'learning_rate': '2.72e-06', 'epoch': '0.7668'}
+
 77%|███████▋  | 29110/37963 [72:03:21<24:55:11, 10.13s/it]
 77%|███████▋  | 29111/37963 [72:03:29<23:04:17,  9.38s/it]
 77%|███████▋  | 29112/37963 [72:03:36<21:49:32,  8.88s/it]
 77%|███████▋  | 29113/37963 [72:03:44<20:56:32,  8.52s/it]
 77%|███████▋  | 29114/37963 [72:03:52<20:20:44,  8.28s/it]
 77%|███████▋  | 29115/37963 [72:04:00<19:55:06,  8.10s/it]
 77%|███████▋  | 29116/37963 [72:04:14<24:50:42, 10.11s/it]
 77%|███████▋  | 29117/37963 [72:04:22<23:08:02,  9.41s/it]
 77%|███████▋  | 29118/37963 [72:04:30<21:52:37,  8.90s/it]
 77%|███████▋  | 29119/37963 [72:04:37<20:42:14,  8.43s/it]
 77%|███████▋  | 29120/37963 [72:04:44<19:54:01,  8.10s/it]
                                                           
{'loss': '0.09951', 'grad_norm': '2.108', 'learning_rate': '2.714e-06', 'epoch': '0.7671'}
+
 77%|███████▋  | 29120/37963 [72:04:44<19:54:01,  8.10s/it]
 77%|███████▋  | 29121/37963 [72:04:59<24:44:50, 10.08s/it]
 77%|███████▋  | 29122/37963 [72:05:07<23:00:49,  9.37s/it]
 77%|███████▋  | 29123/37963 [72:05:15<21:44:29,  8.85s/it]
 77%|███████▋  | 29124/37963 [72:05:29<25:36:46, 10.43s/it]
 77%|███████▋  | 29125/37963 [72:05:36<23:28:33,  9.56s/it]
 77%|███████▋  | 29126/37963 [72:05:44<22:03:02,  8.98s/it]
 77%|███████▋  | 29127/37963 [72:05:52<21:06:28,  8.60s/it]
 77%|███████▋  | 29128/37963 [72:05:59<20:25:55,  8.33s/it]
 77%|███████▋  | 29129/37963 [72:06:07<20:03:09,  8.17s/it]
 77%|███████▋  | 29130/37963 [72:06:15<19:38:55,  8.01s/it]
                                                           
{'loss': '0.1037', 'grad_norm': '2.324', 'learning_rate': '2.708e-06', 'epoch': '0.7673'}
+
 77%|███████▋  | 29130/37963 [72:06:15<19:38:55,  8.01s/it]
 77%|███████▋  | 29131/37963 [72:06:22<19:30:56,  7.95s/it]
 77%|███████▋  | 29132/37963 [72:06:37<24:28:55,  9.98s/it]
 77%|███████▋  | 29133/37963 [72:06:45<22:38:08,  9.23s/it]
 77%|███████▋  | 29134/37963 [72:06:52<21:27:20,  8.75s/it]
 77%|███████▋  | 29135/37963 [72:07:00<20:28:24,  8.35s/it]
 77%|███████▋  | 29136/37963 [72:07:07<19:59:22,  8.15s/it]
 77%|███████▋  | 29137/37963 [72:07:15<19:33:57,  7.98s/it]
 77%|███████▋  | 29138/37963 [72:07:23<19:20:54,  7.89s/it]
 77%|███████▋  | 29139/37963 [72:07:30<19:11:06,  7.83s/it]
 77%|███████▋  | 29140/37963 [72:07:38<19:02:46,  7.77s/it]
                                                           
{'loss': '0.1158', 'grad_norm': '2.255', 'learning_rate': '2.702e-06', 'epoch': '0.7676'}
+
 77%|███████▋  | 29140/37963 [72:07:38<19:02:46,  7.77s/it]
 77%|███████▋  | 29141/37963 [72:07:52<23:57:40,  9.78s/it]
 77%|███████▋  | 29142/37963 [72:08:06<27:04:57, 11.05s/it]
 77%|███████▋  | 29143/37963 [72:08:14<24:43:28, 10.09s/it]
 77%|███████▋  | 29144/37963 [72:08:22<22:59:43,  9.39s/it]
 77%|███████▋  | 29145/37963 [72:08:30<21:46:51,  8.89s/it]
 77%|███████▋  | 29146/37963 [72:08:37<20:44:08,  8.47s/it]
 77%|███████▋  | 29147/37963 [72:08:45<20:16:14,  8.28s/it]
 77%|███████▋  | 29148/37963 [72:08:53<19:50:27,  8.10s/it]
 77%|███████▋  | 29149/37963 [72:09:00<19:29:48,  7.96s/it]
 77%|███████▋  | 29150/37963 [72:09:08<19:15:38,  7.87s/it]
                                                           
{'loss': '0.1041', 'grad_norm': '1.655', 'learning_rate': '2.696e-06', 'epoch': '0.7679'}
+
 77%|███████▋  | 29150/37963 [72:09:08<19:15:38,  7.87s/it]
 77%|███████▋  | 29151/37963 [72:09:16<19:07:16,  7.81s/it]
 77%|███████▋  | 29152/37963 [72:09:23<18:58:44,  7.75s/it]
 77%|███████▋  | 29153/37963 [72:09:31<18:44:53,  7.66s/it]
 77%|███████▋  | 29154/37963 [72:09:38<18:43:42,  7.65s/it]
 77%|███████▋  | 29155/37963 [72:09:46<18:42:00,  7.64s/it]
 77%|███████▋  | 29156/37963 [72:09:54<18:43:55,  7.66s/it]
 77%|███████▋  | 29157/37963 [72:10:01<18:44:46,  7.66s/it]
 77%|███████▋  | 29158/37963 [72:10:09<18:44:29,  7.66s/it]
 77%|███████▋  | 29159/37963 [72:10:17<18:45:27,  7.67s/it]
 77%|███████▋  | 29160/37963 [72:10:31<23:44:03,  9.71s/it]
                                                           
{'loss': '0.09213', 'grad_norm': '1.997', 'learning_rate': '2.691e-06', 'epoch': '0.7681'}
+
 77%|███████▋  | 29160/37963 [72:10:31<23:44:03,  9.71s/it]
 77%|███████▋  | 29161/37963 [72:10:39<22:22:21,  9.15s/it]
 77%|███████▋  | 29162/37963 [72:10:47<21:19:42,  8.72s/it]
 77%|███████▋  | 29163/37963 [72:11:02<25:50:40, 10.57s/it]
 77%|███████▋  | 29164/37963 [72:11:16<28:34:14, 11.69s/it]
 77%|███████▋  | 29165/37963 [72:11:24<25:52:29, 10.59s/it]
 77%|███████▋  | 29166/37963 [72:11:32<23:54:28,  9.78s/it]
 77%|███████▋  | 29167/37963 [72:11:40<22:25:59,  9.18s/it]
 77%|███████▋  | 29168/37963 [72:11:54<26:12:09, 10.73s/it]
 77%|███████▋  | 29169/37963 [72:12:02<23:53:56,  9.78s/it]
 77%|███████▋  | 29170/37963 [72:12:09<22:09:57,  9.08s/it]
                                                           
{'loss': '0.09154', 'grad_norm': '2.784', 'learning_rate': '2.685e-06', 'epoch': '0.7684'}
+
 77%|███████▋  | 29170/37963 [72:12:09<22:09:57,  9.08s/it]
 77%|███████▋  | 29171/37963 [72:12:17<21:03:53,  8.63s/it]
 77%|███████▋  | 29172/37963 [72:12:24<20:10:22,  8.26s/it]
 77%|███████▋  | 29173/37963 [72:12:31<19:31:06,  7.99s/it]
 77%|███████▋  | 29174/37963 [72:12:39<19:14:09,  7.88s/it]
 77%|███████▋  | 29175/37963 [72:12:47<19:03:31,  7.81s/it]
 77%|███████▋  | 29176/37963 [72:12:54<18:56:34,  7.76s/it]
 77%|███████▋  | 29177/37963 [72:13:02<18:50:20,  7.72s/it]
 77%|███████▋  | 29178/37963 [72:13:10<18:51:20,  7.73s/it]
 77%|███████▋  | 29179/37963 [72:13:24<23:41:43,  9.71s/it]
 77%|███████▋  | 29180/37963 [72:13:32<22:09:37,  9.08s/it]
                                                           
{'loss': '0.1103', 'grad_norm': '2.284', 'learning_rate': '2.679e-06', 'epoch': '0.7686'}
+
 77%|███████▋  | 29180/37963 [72:13:32<22:09:37,  9.08s/it]
 77%|███████▋  | 29181/37963 [72:13:39<21:14:09,  8.71s/it]
 77%|███████▋  | 29182/37963 [72:13:47<20:27:05,  8.38s/it]
 77%|███████▋  | 29183/37963 [72:14:02<25:11:24, 10.33s/it]
 77%|███████▋  | 29184/37963 [72:14:10<23:11:50,  9.51s/it]
 77%|███████▋  | 29185/37963 [72:14:24<26:49:20, 11.00s/it]
 77%|███████▋  | 29186/37963 [72:14:32<24:26:06, 10.02s/it]
 77%|███████▋  | 29187/37963 [72:14:39<22:41:46,  9.31s/it]
 77%|███████▋  | 29188/37963 [72:14:47<21:26:57,  8.80s/it]
 77%|███████��  | 29189/37963 [72:14:55<20:39:48,  8.48s/it]
 77%|███████▋  | 29190/37963 [72:15:03<20:08:57,  8.27s/it]
                                                           
{'loss': '0.09825', 'grad_norm': '2.207', 'learning_rate': '2.673e-06', 'epoch': '0.7689'}
+
 77%|███████▋  | 29190/37963 [72:15:03<20:08:57,  8.27s/it]
 77%|███████▋  | 29191/37963 [72:15:10<19:40:03,  8.07s/it]
 77%|███████▋  | 29192/37963 [72:15:18<19:18:30,  7.93s/it]
 77%|███████▋  | 29193/37963 [72:15:26<19:11:31,  7.88s/it]
 77%|███████▋  | 29194/37963 [72:15:33<19:05:28,  7.84s/it]
 77%|███████▋  | 29195/37963 [72:15:48<23:55:14,  9.82s/it]
 77%|███████▋  | 29196/37963 [72:15:55<22:18:49,  9.16s/it]
 77%|███████▋  | 29197/37963 [72:16:03<21:10:51,  8.70s/it]
 77%|███████▋  | 29198/37963 [72:16:11<20:29:01,  8.41s/it]
 77%|███████▋  | 29199/37963 [72:16:18<19:52:09,  8.16s/it]
 77%|███████▋  | 29200/37963 [72:16:26<19:36:56,  8.06s/it]
                                                           
{'loss': '0.09856', 'grad_norm': '3.67', 'learning_rate': '2.667e-06', 'epoch': '0.7692'}
+
 77%|███████▋  | 29200/37963 [72:16:26<19:36:56,  8.06s/it]
 77%|███████▋  | 29201/37963 [72:16:33<19:07:44,  7.86s/it]
 77%|███████▋  | 29202/37963 [72:16:41<18:56:23,  7.78s/it]
 77%|███████▋  | 29203/37963 [72:16:49<18:56:37,  7.79s/it]
 77%|███████▋  | 29204/37963 [72:16:56<18:41:25,  7.68s/it]
 77%|███████▋  | 29205/37963 [72:17:04<18:46:53,  7.72s/it]
 77%|███████▋  | 29206/37963 [72:17:12<18:49:18,  7.74s/it]
 77%|███████▋  | 29207/37963 [72:17:20<18:47:29,  7.73s/it]
 77%|███████▋  | 29208/37963 [72:17:34<23:55:13,  9.84s/it]
 77%|███████▋  | 29209/37963 [72:17:42<22:20:44,  9.19s/it]
 77%|███████▋  | 29210/37963 [72:17:57<26:51:10, 11.04s/it]
                                                           
{'loss': '0.1028', 'grad_norm': '3.056', 'learning_rate': '2.662e-06', 'epoch': '0.7694'}
+
 77%|███████▋  | 29210/37963 [72:17:57<26:51:10, 11.04s/it]
 77%|███████▋  | 29211/37963 [72:18:05<24:25:14, 10.05s/it]
 77%|███████▋  | 29212/37963 [72:18:19<27:20:28, 11.25s/it]
 77%|███████▋  | 29213/37963 [72:18:27<24:37:36, 10.13s/it]
 77%|███████▋  | 29214/37963 [72:18:34<22:51:08,  9.40s/it]
 77%|███████▋  | 29215/37963 [72:18:42<21:31:31,  8.86s/it]
 77%|███████▋  | 29216/37963 [72:18:56<25:36:30, 10.54s/it]
 77%|███████▋  | 29217/37963 [72:19:04<23:29:16,  9.67s/it]
 77%|███████▋  | 29218/37963 [72:19:12<22:06:27,  9.10s/it]
 77%|███████▋  | 29219/37963 [72:19:20<21:02:36,  8.66s/it]
 77%|███████▋  | 29220/37963 [72:19:27<20:16:23,  8.35s/it]
                                                           
{'loss': '0.1099', 'grad_norm': '2.57', 'learning_rate': '2.656e-06', 'epoch': '0.7697'}
+
 77%|███████▋  | 29220/37963 [72:19:27<20:16:23,  8.35s/it]
 77%|███████▋  | 29221/37963 [72:19:35<19:45:35,  8.14s/it]
 77%|███████▋  | 29222/37963 [72:19:42<19:16:27,  7.94s/it]
 77%|███████▋  | 29223/37963 [72:19:50<19:14:57,  7.93s/it]
 77%|███████▋  | 29224/37963 [72:19:58<19:04:53,  7.86s/it]
 77%|███████▋  | 29225/37963 [72:20:05<18:52:14,  7.77s/it]
 77%|███████▋  | 29226/37963 [72:20:13<18:45:39,  7.73s/it]
 77%|███████▋  | 29227/37963 [72:20:21<18:46:25,  7.74s/it]
 77%|███████▋  | 29228/37963 [72:20:28<18:39:37,  7.69s/it]
 77%|███████▋  | 29229/37963 [72:20:36<18:34:56,  7.66s/it]
 77%|███████▋  | 29230/37963 [72:20:43<18:18:49,  7.55s/it]
                                                           
{'loss': '0.1083', 'grad_norm': '1.77', 'learning_rate': '2.65e-06', 'epoch': '0.77'}
+
 77%|███████▋  | 29230/37963 [72:20:43<18:18:49,  7.55s/it]
 77%|███████▋  | 29231/37963 [72:20:51<18:23:58,  7.59s/it]
 77%|███████▋  | 29232/37963 [72:21:05<23:07:24,  9.53s/it]
 77%|███████▋  | 29233/37963 [72:21:26<31:24:13, 12.95s/it]
 77%|███████▋  | 29234/37963 [72:21:34<27:36:25, 11.39s/it]
 77%|███████▋  | 29235/37963 [72:21:41<24:57:49, 10.30s/it]
 77%|███████▋  | 29236/37963 [72:21:49<23:05:35,  9.53s/it]
 77%|███████▋  | 29237/37963 [72:21:57<21:43:24,  8.96s/it]
 77%|███████▋  | 29238/37963 [72:22:04<20:45:30,  8.57s/it]
 77%|███████▋  | 29239/37963 [72:22:12<20:00:31,  8.26s/it]
 77%|███████▋  | 29240/37963 [72:22:20<19:40:01,  8.12s/it]
                                                           
{'loss': '0.09921', 'grad_norm': '2.035', 'learning_rate': '2.644e-06', 'epoch': '0.7702'}
+
 77%|███████▋  | 29240/37963 [72:22:20<19:40:01,  8.12s/it]
 77%|███████▋  | 29241/37963 [72:22:27<19:20:35,  7.98s/it]
 77%|███████▋  | 29242/37963 [72:22:35<19:03:03,  7.86s/it]
 77%|███████▋  | 29243/37963 [72:22:43<18:59:41,  7.84s/it]
 77%|███████▋  | 29244/37963 [72:22:51<18:53:07,  7.80s/it]
 77%|███████▋  | 29245/37963 [72:22:58<18:49:43,  7.78s/it]
 77%|███████▋  | 29246/37963 [72:23:06<18:44:49,  7.74s/it]
 77%|███████▋  | 29247/37963 [72:23:14<18:42:01,  7.72s/it]
 77%|███████▋  | 29248/37963 [72:23:21<18:44:32,  7.74s/it]
 77%|███████▋  | 29249/37963 [72:23:36<23:32:25,  9.73s/it]
 77%|███████▋  | 29250/37963 [72:23:43<22:02:41,  9.11s/it]
                                                           
{'loss': '0.09582', 'grad_norm': '2.182', 'learning_rate': '2.638e-06', 'epoch': '0.7705'}
+
 77%|███████▋  | 29250/37963 [72:23:43<22:02:41,  9.11s/it]
 77%|███████▋  | 29251/37963 [72:23:51<21:04:05,  8.71s/it]
 77%|███████▋  | 29252/37963 [72:23:59<20:17:22,  8.39s/it]
 77%|███████▋  | 29253/37963 [72:24:14<25:01:01, 10.34s/it]
 77%|███████▋  | 29254/37963 [72:24:21<23:07:38,  9.56s/it]
 77%|███████▋  | 29255/37963 [72:24:29<21:40:34,  8.96s/it]
 77%|███████▋  | 29256/37963 [72:24:36<20:25:06,  8.44s/it]
 77%|███████▋  | 29257/37963 [72:24:51<24:51:14, 10.28s/it]
 77%|███████▋  | 29258/37963 [72:24:58<22:43:56,  9.40s/it]
 77%|███████▋  | 29259/37963 [72:25:06<21:22:45,  8.84s/it]
 77%|███████▋  | 29260/37963 [72:25:27<30:25:25, 12.58s/it]
                                                           
{'loss': '0.09172', 'grad_norm': '2.181', 'learning_rate': '2.633e-06', 'epoch': '0.7708'}
+
 77%|███████▋  | 29260/37963 [72:25:27<30:25:25, 12.58s/it]
 77%|███████▋  | 29261/37963 [72:25:35<26:44:52, 11.07s/it]
 77%|███████▋  | 29262/37963 [72:25:42<24:18:34, 10.06s/it]
 77%|███████▋  | 29263/37963 [72:25:50<22:32:19,  9.33s/it]
 77%|███████▋  | 29264/37963 [72:25:58<21:21:13,  8.84s/it]
 77%|███████▋  | 29265/37963 [72:26:05<20:27:42,  8.47s/it]
 77%|███████▋  | 29266/37963 [72:26:13<19:51:48,  8.22s/it]
 77%|███████▋  | 29267/37963 [72:26:21<19:40:21,  8.14s/it]
 77%|███████▋  | 29268/37963 [72:26:28<19:19:32,  8.00s/it]
 77%|███████▋  | 29269/37963 [72:26:36<19:09:55,  7.94s/it]
 77%|███████▋  | 29270/37963 [72:26:44<19:07:25,  7.92s/it]
                                                           
{'loss': '0.1001', 'grad_norm': '2.051', 'learning_rate': '2.627e-06', 'epoch': '0.771'}
+
 77%|███████▋  | 29270/37963 [72:26:44<19:07:25,  7.92s/it]
 77%|███████▋  | 29271/37963 [72:26:52<18:54:18,  7.83s/it]
 77%|███████▋  | 29272/37963 [72:26:59<18:50:16,  7.80s/it]
 77%|███████▋  | 29273/37963 [72:27:07<18:30:23,  7.67s/it]
 77%|███████▋  | 29274/37963 [72:27:14<18:29:30,  7.66s/it]
 77%|███████▋  | 29275/37963 [72:27:22<18:20:50,  7.60s/it]
 77%|███████▋  | 29276/37963 [72:27:30<18:24:26,  7.63s/it]
 77%|███████▋  | 29277/37963 [72:27:51<28:27:27, 11.79s/it]
 77%|███████▋  | 29278/37963 [72:27:59<25:37:16, 10.62s/it]
 77%|███████▋  | 29279/37963 [72:28:07<23:29:13,  9.74s/it]
 77%|███████▋  | 29280/37963 [72:28:14<22:03:07,  9.14s/it]
                                                           
{'loss': '0.1093', 'grad_norm': '1.798', 'learning_rate': '2.621e-06', 'epoch': '0.7713'}
+
 77%|███████▋  | 29280/37963 [72:28:14<22:03:07,  9.14s/it]
 77%|███████▋  | 29281/37963 [72:28:28<25:26:19, 10.55s/it]
 77%|███████▋  | 29282/37963 [72:28:36<23:36:56,  9.79s/it]
 77%|███████▋  | 29283/37963 [72:28:44<22:00:11,  9.13s/it]
 77%|███████▋  | 29284/37963 [72:28:52<20:56:47,  8.69s/it]
 77%|███████▋  | 29285/37963 [72:28:59<20:11:08,  8.37s/it]
 77%|███████▋  | 29286/37963 [72:29:07<19:39:44,  8.16s/it]
 77%|███████▋  | 29287/37963 [72:29:14<19:17:39,  8.01s/it]
 77%|███████▋  | 29288/37963 [72:29:22<19:07:58,  7.94s/it]
 77%|███████▋  | 29289/37963 [72:29:30<18:54:39,  7.85s/it]
 77%|███████▋  | 29290/37963 [72:29:37<18:43:36,  7.77s/it]
                                                           
{'loss': '0.09916', 'grad_norm': '1.891', 'learning_rate': '2.615e-06', 'epoch': '0.7715'}
+
 77%|███████▋  | 29290/37963 [72:29:37<18:43:36,  7.77s/it]
 77%|█���█████▋  | 29291/37963 [72:29:45<18:18:10,  7.60s/it]
 77%|███████▋  | 29292/37963 [72:29:52<18:23:21,  7.63s/it]
 77%|███████▋  | 29293/37963 [72:30:00<18:21:22,  7.62s/it]
 77%|███████▋  | 29294/37963 [72:30:08<18:26:47,  7.66s/it]
 77%|███████▋  | 29295/37963 [72:30:15<18:26:28,  7.66s/it]
 77%|███████▋  | 29296/37963 [72:30:23<18:30:14,  7.69s/it]
 77%|███████▋  | 29297/37963 [72:30:31<18:34:04,  7.71s/it]
 77%|███████▋  | 29298/37963 [72:30:38<18:27:33,  7.67s/it]
 77%|███████▋  | 29299/37963 [72:30:52<22:58:15,  9.54s/it]
 77%|███████▋  | 29300/37963 [72:31:07<26:36:19, 11.06s/it]
                                                           
{'loss': '0.09285', 'grad_norm': '2.417', 'learning_rate': '2.61e-06', 'epoch': '0.7718'}
+
 77%|███████▋  | 29300/37963 [72:31:07<26:36:19, 11.06s/it]
 77%|███████▋  | 29301/37963 [72:31:15<24:11:50, 10.06s/it]
 77%|███████▋  | 29302/37963 [72:31:22<22:28:13,  9.34s/it]
 77%|███████▋  | 29303/37963 [72:31:30<21:06:29,  8.77s/it]
 77%|███████▋  | 29304/37963 [72:31:38<20:26:30,  8.50s/it]
 77%|███████▋  | 29305/37963 [72:31:45<19:48:06,  8.23s/it]
 77%|███████▋  | 29306/37963 [72:31:53<19:23:06,  8.06s/it]
 77%|███████▋  | 29307/37963 [72:32:01<19:10:16,  7.97s/it]
 77%|███████▋  | 29308/37963 [72:32:22<28:45:24, 11.96s/it]
 77%|███████▋  | 29309/37963 [72:32:29<25:28:49, 10.60s/it]
 77%|███████▋  | 29310/37963 [72:32:37<23:21:22,  9.72s/it]
                                                           
{'loss': '0.1169', 'grad_norm': '3.552', 'learning_rate': '2.604e-06', 'epoch': '0.7721'}
+
 77%|███████▋  | 29310/37963 [72:32:37<23:21:22,  9.72s/it]
 77%|███████▋  | 29311/37963 [72:32:45<21:52:16,  9.10s/it]
 77%|███████▋  | 29312/37963 [72:32:52<20:46:44,  8.65s/it]
 77%|███████▋  | 29313/37963 [72:33:00<20:05:22,  8.36s/it]
 77%|███████▋  | 29314/37963 [72:33:14<24:11:22, 10.07s/it]
 77%|███████▋  | 29315/37963 [72:33:22<22:28:00,  9.35s/it]
 77%|███████▋  | 29316/37963 [72:33:30<21:22:39,  8.90s/it]
 77%|███████▋  | 29317/37963 [72:33:37<20:28:45,  8.53s/it]
 77%|███████▋  | 29318/37963 [72:33:45<19:49:31,  8.26s/it]
 77%|███████▋  | 29319/37963 [72:33:53<19:24:29,  8.08s/it]
 77%|███████▋  | 29320/37963 [72:34:00<19:03:48,  7.94s/it]
                                                           
{'loss': '0.1039', 'grad_norm': '1.655', 'learning_rate': '2.598e-06', 'epoch': '0.7723'}
+
 77%|███████▋  | 29320/37963 [72:34:00<19:03:48,  7.94s/it]
 77%|███████▋  | 29321/37963 [72:34:08<18:54:15,  7.88s/it]
 77%|███████▋  | 29322/37963 [72:34:16<18:51:58,  7.86s/it]
 77%|███████▋  | 29323/37963 [72:34:23<18:46:10,  7.82s/it]
 77%|███████▋  | 29324/37963 [72:34:31<18:43:05,  7.80s/it]
 77%|███████▋  | 29325/37963 [72:34:39<18:41:30,  7.79s/it]
 77%|███████▋  | 29326/37963 [72:34:54<24:05:36, 10.04s/it]
 77%|███████▋  | 29327/37963 [72:35:02<22:13:21,  9.26s/it]
 77%|███████▋  | 29328/37963 [72:35:15<25:22:21, 10.58s/it]
 77%|███████▋  | 29329/37963 [72:35:23<23:10:07,  9.66s/it]
 77%|███████▋  | 29330/37963 [72:35:31<21:42:02,  9.05s/it]
                                                           
{'loss': '0.101', 'grad_norm': '3.358', 'learning_rate': '2.592e-06', 'epoch': '0.7726'}
+
 77%|███████▋  | 29330/37963 [72:35:31<21:42:02,  9.05s/it]
 77%|███████▋  | 29331/37963 [72:35:45<25:29:07, 10.63s/it]
 77%|███████▋  | 29332/37963 [72:35:53<23:25:06,  9.77s/it]
 77%|███████▋  | 29333/37963 [72:36:00<22:03:05,  9.20s/it]
 77%|███████▋  | 29334/37963 [72:36:08<20:54:46,  8.72s/it]
 77%|███████▋  | 29335/37963 [72:36:16<20:13:51,  8.44s/it]
 77%|███████▋  | 29336/37963 [72:36:23<19:37:31,  8.19s/it]
 77%|███████▋  | 29337/37963 [72:36:31<19:15:03,  8.03s/it]
 77%|███████▋  | 29338/37963 [72:36:39<18:57:15,  7.91s/it]
 77%|███████▋  | 29339/37963 [72:36:47<18:51:22,  7.87s/it]
 77%|███████▋  | 29340/37963 [72:36:54<18:41:54,  7.81s/it]
                                                           
{'loss': '0.1161', 'grad_norm': '2.82', 'learning_rate': '2.587e-06', 'epoch': '0.7729'}
+
 77%|███████▋  | 29340/37963 [72:36:54<18:41:54,  7.81s/it]
 77%|███████▋  | 29341/37963 [72:37:02<18:34:34,  7.76s/it]
 77%|███████▋  | 29342/37963 [72:37:09<18:21:51,  7.67s/it]
 77%|███████▋  | 29343/37963 [72:37:17<18:20:15,  7.66s/it]
 77%|███████▋  | 29344/37963 [72:37:25<18:26:09,  7.70s/it]
 77%|███████▋  | 29345/37963 [72:37:39<23:19:43,  9.75s/it]
 77%|███████▋  | 29346/37963 [72:37:47<21:59:43,  9.19s/it]
 77%|███████▋  | 29347/37963 [72:37:55<20:54:23,  8.74s/it]
 77%|███████▋  | 29348/37963 [72:38:03<20:13:14,  8.45s/it]
 77%|███████▋  | 29349/37963 [72:38:10<19:41:53,  8.23s/it]
 77%|███████▋  | 29350/37963 [72:38:18<19:27:34,  8.13s/it]
                                                           
{'loss': '0.09522', 'grad_norm': '2.476', 'learning_rate': '2.581e-06', 'epoch': '0.7731'}
+
 77%|███████▋  | 29350/37963 [72:38:18<19:27:34,  8.13s/it]
 77%|███████▋  | 29351/37963 [72:38:26<19:16:37,  8.06s/it]
 77%|███████▋  | 29352/37963 [72:38:34<19:01:46,  7.96s/it]
 77%|███████▋  | 29353/37963 [72:38:41<18:44:42,  7.84s/it]
 77%|███████▋  | 29354/37963 [72:38:56<23:44:09,  9.93s/it]
 77%|███████▋  | 29355/37963 [72:39:04<22:10:07,  9.27s/it]
 77%|███████▋  | 29356/37963 [72:39:12<21:02:27,  8.80s/it]
 77%|███████▋  | 29357/37963 [72:39:26<24:48:29, 10.38s/it]
 77%|███████▋  | 29358/37963 [72:39:34<23:10:31,  9.70s/it]
 77%|███████▋  | 29359/37963 [72:39:41<21:42:11,  9.08s/it]
 77%|███████▋  | 29360/37963 [72:39:49<20:42:26,  8.67s/it]
                                                           
{'loss': '0.09781', 'grad_norm': '3.062', 'learning_rate': '2.575e-06', 'epoch': '0.7734'}
+
 77%|███████▋  | 29360/37963 [72:39:49<20:42:26,  8.67s/it]
 77%|███████▋  | 29361/37963 [72:39:57<20:02:47,  8.39s/it]
 77%|███████▋  | 29362/37963 [72:40:12<24:50:23, 10.40s/it]
 77%|███████▋  | 29363/37963 [72:40:19<22:47:35,  9.54s/it]
 77%|███████▋  | 29364/37963 [72:40:34<26:12:25, 10.97s/it]
 77%|███████▋  | 29365/37963 [72:40:42<24:06:21, 10.09s/it]
 77%|███████▋  | 29366/37963 [72:40:50<22:25:13,  9.39s/it]
 77%|███████▋  | 29367/37963 [72:40:57<21:15:36,  8.90s/it]
 77%|███████▋  | 29368/37963 [72:41:05<20:20:00,  8.52s/it]
 77%|███████▋  | 29369/37963 [72:41:13<19:40:43,  8.24s/it]
 77%|███████▋  | 29370/37963 [72:41:20<19:19:32,  8.10s/it]
                                                           
{'loss': '0.09139', 'grad_norm': '2.316', 'learning_rate': '2.57e-06', 'epoch': '0.7737'}
+
 77%|███████▋  | 29370/37963 [72:41:20<19:19:32,  8.10s/it]
 77%|███████▋  | 29371/37963 [72:41:28<19:02:28,  7.98s/it]
 77%|███████▋  | 29372/37963 [72:41:36<18:44:26,  7.85s/it]
 77%|███████▋  | 29373/37963 [72:41:43<18:33:12,  7.78s/it]
 77%|███████▋  | 29374/37963 [72:41:58<23:21:14,  9.79s/it]
 77%|███████▋  | 29375/37963 [72:42:05<21:52:49,  9.17s/it]
 77%|███████▋  | 29376/37963 [72:42:13<20:48:34,  8.72s/it]
 77%|███████▋  | 29377/37963 [72:42:27<24:46:32, 10.39s/it]
 77%|███████▋  | 29378/37963 [72:42:35<22:49:44,  9.57s/it]
 77%|███████▋  | 29379/37963 [72:42:43<21:27:29,  9.00s/it]
 77%|███████▋  | 29380/37963 [72:42:51<20:38:32,  8.66s/it]
                                                           
{'loss': '0.1085', 'grad_norm': '3.603', 'learning_rate': '2.564e-06', 'epoch': '0.7739'}
+
 77%|███████▋  | 29380/37963 [72:42:51<20:38:32,  8.66s/it]
 77%|███████▋  | 29381/37963 [72:42:58<19:54:51,  8.35s/it]
 77%|███████▋  | 29382/37963 [72:43:06<19:17:55,  8.10s/it]
 77%|███████▋  | 29383/37963 [72:43:13<18:56:49,  7.95s/it]
 77%|███████▋  | 29384/37963 [72:43:21<18:44:46,  7.87s/it]
 77%|███████▋  | 29385/37963 [72:43:35<23:20:15,  9.79s/it]
 77%|███████▋  | 29386/37963 [72:43:43<21:44:58,  9.13s/it]
 77%|███████▋  | 29387/37963 [72:43:50<20:41:30,  8.69s/it]
 77%|███████▋  | 29388/37963 [72:43:58<19:56:12,  8.37s/it]
 77%|███████▋  | 29389/37963 [72:44:06<19:25:10,  8.15s/it]
 77%|███████▋  | 29390/37963 [72:44:13<18:52:20,  7.92s/it]
                                                           
{'loss': '0.1089', 'grad_norm': '2.34', 'learning_rate': '2.558e-06', 'epoch': '0.7742'}
+
 77%|███████▋  | 29390/37963 [72:44:13<18:52:20,  7.92s/it]
 77%|███████▋  | 29391/37963 [72:44:21<18:46:44,  7.89s/it]
 77%|███████▋  | 29392/37963 [72:44:28<18:24:58,  7.74s/it]
 77%|███████▋  | 29393/37963 [72:44:36<18:24:13,  7.73s/it]
 77%|███████▋  | 29394/37963 [72:44:44<18:24:39,  7.73s/it]
 77%|███████▋  | 29395/37963 [72:44:52<18:24:28,  7.73s/it]
 77%|███████▋  | 29396/37963 [72:44:59<18:20:39,  7.71s/it]
 77%|███████▋  | 29397/37963 [72:45:07<18:21:12,  7.71s/it]
 77%|███████▋  | 29398/37963 [72:45:21<23:09:44,  9.74s/it]
 77%|███████▋  | 29399/37963 [72:45:29<21:43:40,  9.13s/it]
 77%|███████▋  | 29400/37963 [72:45:37<20:40:17,  8.69s/it]
                                                           
{'loss': '0.09881', 'grad_norm': '2.769', 'learning_rate': '2.552e-06', 'epoch': '0.7744'}
+
 77%|███████▋  | 29400/37963 [72:45:37<20:40:17,  8.69s/it]
 77%|███████▋  | 29401/37963 [72:45:45<20:02:05,  8.42s/it]
 77%|███████▋  | 29402/37963 [72:45:52<19:18:23,  8.12s/it]
 77%|███████▋  | 29403/37963 [72:46:00<18:59:50,  7.99s/it]
 77%|███████▋  | 29404/37963 [72:46:14<23:50:03, 10.02s/it]
 77%|███████▋  | 29405/37963 [72:46:29<26:55:26, 11.33s/it]
 77%|███████▋  | 29406/37963 [72:46:36<24:18:30, 10.23s/it]
 77%|███████▋  | 29407/37963 [72:46:44<22:26:01,  9.44s/it]
 77%|███████▋  | 29408/37963 [72:46:52<21:15:00,  8.94s/it]
 77%|███████▋  | 29409/37963 [72:47:00<20:20:52,  8.56s/it]
 77%|███████▋  | 29410/37963 [72:47:07<19:26:13,  8.18s/it]
                                                           
{'loss': '0.1043', 'grad_norm': '2.141', 'learning_rate': '2.547e-06', 'epoch': '0.7747'}
+
 77%|███████▋  | 29410/37963 [72:47:07<19:26:13,  8.18s/it]
 77%|███████▋  | 29411/37963 [72:47:14<18:58:31,  7.99s/it]
 77%|███████▋  | 29412/37963 [72:47:29<23:27:24,  9.88s/it]
 77%|███████▋  | 29413/37963 [72:47:36<21:46:44,  9.17s/it]
 77%|███████▋  | 29414/37963 [72:47:44<20:44:33,  8.73s/it]
 77%|███████▋  | 29415/37963 [72:47:51<19:50:52,  8.36s/it]
 77%|███████▋  | 29416/37963 [72:48:06<24:26:44, 10.30s/it]
 77%|███████▋  | 29417/37963 [72:48:14<22:32:44,  9.50s/it]
 77%|███████▋  | 29418/37963 [72:48:21<21:13:43,  8.94s/it]
 77%|███████▋  | 29419/37963 [72:48:29<20:26:33,  8.61s/it]
 77%|███████▋  | 29420/37963 [72:48:43<24:13:51, 10.21s/it]
                                                           
{'loss': '0.1107', 'grad_norm': '3.839', 'learning_rate': '2.541e-06', 'epoch': '0.775'}
+
 77%|███████▋  | 29420/37963 [72:48:43<24:13:51, 10.21s/it]
 77%|███████▋  | 29421/37963 [72:48:51<22:20:09,  9.41s/it]
 78%|███████▊  | 29422/37963 [72:49:06<26:14:51, 11.06s/it]
 78%|███████▊  | 29423/37963 [72:49:13<23:52:33, 10.06s/it]
 78%|███████▊  | 29424/37963 [72:49:21<22:04:18,  9.31s/it]
 78%|███████▊  | 29425/37963 [72:49:29<20:49:51,  8.78s/it]
 78%|███████▊  | 29426/37963 [72:49:36<20:02:37,  8.45s/it]
 78%|███████▊  | 29427/37963 [72:49:44<19:26:49,  8.20s/it]
 78%|███████▊  | 29428/37963 [72:49:52<19:06:28,  8.06s/it]
 78%|███████▊  | 29429/37963 [72:50:06<23:38:57,  9.98s/it]
 78%|███████▊  | 29430/37963 [72:50:14<22:15:06,  9.39s/it]
                                                           
{'loss': '0.1002', 'grad_norm': '2.401', 'learning_rate': '2.535e-06', 'epoch': '0.7752'}
+
 78%|███████▊  | 29430/37963 [72:50:14<22:15:06,  9.39s/it]
 78%|███████▊  | 29431/37963 [72:50:22<21:05:15,  8.90s/it]
 78%|███████▊  | 29432/37963 [72:50:29<20:13:36,  8.54s/it]
 78%|███████▊  | 29433/37963 [72:50:37<19:22:47,  8.18s/it]
 78%|███████▊  | 29434/37963 [72:50:44<19:01:18,  8.03s/it]
 78%|███████▊  | 29435/37963 [72:50:52<18:43:51,  7.91s/it]
 78%|███████▊  | 29436/37963 [72:51:00<18:34:37,  7.84s/it]
 78%|███████▊  | 29437/37963 [72:51:08<18:28:45,  7.80s/it]
 78%|███████▊  | 29438/37963 [72:51:15<18:18:52,  7.73s/it]
 78%|███████▊  | 29439/37963 [72:51:23<18:06:27,  7.65s/it]
 78%|███████▊  | 29440/37963 [72:51:30<18:07:38,  7.66s/it]
                                                           
{'loss': '0.1075', 'grad_norm': '3.1', 'learning_rate': '2.53e-06', 'epoch': '0.7755'}
+
 78%|███████▊  | 29440/37963 [72:51:30<18:07:38,  7.66s/it]
 78%|███████▊  | 29441/37963 [72:51:38<18:12:24,  7.69s/it]
 78%|███████▊  | 29442/37963 [72:51:46<18:11:16,  7.68s/it]
 78%|███████▊  | 29443/37963 [72:51:53<18:14:23,  7.71s/it]
 78%|███████▊  | 29444/37963 [72:52:01<18:15:03,  7.71s/it]
 78%|███████▊  | 29445/37963 [72:52:09<18:10:43,  7.68s/it]
 78%|███████▊  | 29446/37963 [72:52:16<18:07:27,  7.66s/it]
 78%|███████▊  | 29447/37963 [72:52:24<18:08:31,  7.67s/it]
 78%|█████���█▊  | 29448/37963 [72:52:32<18:04:52,  7.64s/it]
 78%|███████▊  | 29449/37963 [72:52:39<18:03:46,  7.64s/it]
 78%|███████▊  | 29450/37963 [72:52:47<18:03:05,  7.63s/it]
                                                           
{'loss': '0.1097', 'grad_norm': '3.603', 'learning_rate': '2.524e-06', 'epoch': '0.7758'}
+
 78%|███████▊  | 29450/37963 [72:52:47<18:03:05,  7.63s/it]
 78%|███████▊  | 29451/37963 [72:53:01<22:57:55,  9.71s/it]
 78%|███████▊  | 29452/37963 [72:53:22<30:43:24, 13.00s/it]
 78%|███████▊  | 29453/37963 [72:53:30<26:52:51, 11.37s/it]
 78%|███████▊  | 29454/37963 [72:53:37<24:15:07, 10.26s/it]
 78%|███████▊  | 29455/37963 [72:53:45<22:32:39,  9.54s/it]
 78%|███████▊  | 29456/37963 [72:53:53<21:17:38,  9.01s/it]
 78%|███████▊  | 29457/37963 [72:54:01<20:22:55,  8.63s/it]
 78%|███████▊  | 29458/37963 [72:54:08<19:42:59,  8.35s/it]
 78%|███████▊  | 29459/37963 [72:54:16<19:04:26,  8.07s/it]
 78%|███████▊  | 29460/37963 [72:54:23<18:40:01,  7.90s/it]
                                                           
{'loss': '0.102', 'grad_norm': '2.981', 'learning_rate': '2.518e-06', 'epoch': '0.776'}
+
 78%|███████▊  | 29460/37963 [72:54:23<18:40:01,  7.90s/it]
 78%|███████▊  | 29461/37963 [72:54:39<23:48:11, 10.08s/it]
 78%|███████▊  | 29462/37963 [72:54:46<22:08:12,  9.37s/it]
 78%|███████▊  | 29463/37963 [72:54:54<20:57:32,  8.88s/it]
 78%|███████▊  | 29464/37963 [72:55:02<20:04:30,  8.50s/it]
 78%|███████▊  | 29465/37963 [72:55:09<19:26:29,  8.24s/it]
 78%|███████▊  | 29466/37963 [72:55:24<24:04:47, 10.20s/it]
 78%|███████▊  | 29467/37963 [72:55:38<27:02:29, 11.46s/it]
 78%|███████▊  | 29468/37963 [72:55:46<24:27:10, 10.36s/it]
 78%|███████▊  | 29469/37963 [72:55:54<22:18:54,  9.46s/it]
 78%|███████▊  | 29470/37963 [72:56:01<21:04:03,  8.93s/it]
                                                           
{'loss': '0.1022', 'grad_norm': '2.248', 'learning_rate': '2.513e-06', 'epoch': '0.7763'}
+
 78%|███████▊  | 29470/37963 [72:56:01<21:04:03,  8.93s/it]
 78%|███████▊  | 29471/37963 [72:56:09<20:11:51,  8.56s/it]
 78%|███████▊  | 29472/37963 [72:56:17<19:36:15,  8.31s/it]
 78%|███████▊  | 29473/37963 [72:56:31<23:53:04, 10.13s/it]
 78%|███████▊  | 29474/37963 [72:56:39<22:07:51,  9.39s/it]
 78%|███████▊  | 29475/37963 [72:56:53<25:26:36, 10.79s/it]
 78%|███████▊  | 29476/37963 [72:57:00<23:16:36,  9.87s/it]
 78%|███████▊  | 29477/37963 [72:57:08<21:28:28,  9.11s/it]
 78%|███████▊  | 29478/37963 [72:57:15<20:26:43,  8.67s/it]
 78%|███████▊  | 29479/37963 [72:57:23<19:45:10,  8.38s/it]
 78%|███████▊  | 29480/37963 [72:57:31<19:11:57,  8.15s/it]
                                                           
{'loss': '0.09039', 'grad_norm': '2.649', 'learning_rate': '2.507e-06', 'epoch': '0.7765'}
+
 78%|███████▊  | 29480/37963 [72:57:31<19:11:57,  8.15s/it]
 78%|███████▊  | 29481/37963 [72:57:38<18:49:00,  7.99s/it]
 78%|███████▊  | 29482/37963 [72:57:46<18:35:13,  7.89s/it]
 78%|███████▊  | 29483/37963 [72:57:54<18:30:48,  7.86s/it]
 78%|███████▊  | 29484/37963 [72:58:02<18:24:17,  7.81s/it]
 78%|███████▊  | 29485/37963 [72:58:09<18:18:13,  7.77s/it]
 78%|███████▊  | 29486/37963 [72:58:17<18:14:32,  7.75s/it]
 78%|███████▊  | 29487/37963 [72:58:25<18:10:56,  7.72s/it]
 78%|███████▊  | 29488/37963 [72:58:32<17:58:14,  7.63s/it]
 78%|███████▊  | 29489/37963 [72:58:40<17:59:44,  7.65s/it]
 78%|███████▊  | 29490/37963 [72:58:47<18:03:21,  7.67s/it]
                                                           
{'loss': '0.1058', 'grad_norm': '2.644', 'learning_rate': '2.501e-06', 'epoch': '0.7768'}
+
 78%|███████▊  | 29490/37963 [72:58:47<18:03:21,  7.67s/it]
 78%|███████▊  | 29491/37963 [72:58:55<17:52:21,  7.59s/it]
 78%|███████▊  | 29492/37963 [72:59:03<17:56:11,  7.62s/it]
 78%|███████▊  | 29493/37963 [72:59:10<17:44:20,  7.54s/it]
 78%|███████▊  | 29494/37963 [72:59:18<17:49:49,  7.58s/it]
 78%|███████▊  | 29495/37963 [72:59:32<22:25:56,  9.54s/it]
 78%|███████▊  | 29496/37963 [72:59:39<21:03:57,  8.96s/it]
 78%|███████▊  | 29497/37963 [72:59:47<20:10:43,  8.58s/it]
 78%|███████▊  | 29498/37963 [72:59:55<19:30:18,  8.30s/it]
 78%|███████▊  | 29499/37963 [73:00:02<19:07:17,  8.13s/it]
 78%|███████▊  | 29500/37963 [73:00:17<23:57:26, 10.19s/it]
                                                           
{'loss': '0.1037', 'grad_norm': '2.605', 'learning_rate': '2.496e-06', 'epoch': '0.7771'}
+
 78%|███████▊  | 29500/37963 [73:00:17<23:57:26, 10.19s/it]
 78%|███████▊  | 29501/37963 [73:00:25<22:14:45,  9.46s/it]
 78%|███████▊  | 29502/37963 [73:00:33<21:06:01,  8.98s/it]
 78%|███████▊  | 29503/37963 [73:00:41<20:14:50,  8.62s/it]
 78%|███████▊  | 29504/37963 [73:00:48<19:34:54,  8.33s/it]
 78%|███████▊  | 29505/37963 [73:00:56<19:13:37,  8.18s/it]
 78%|███████▊  | 29506/37963 [73:01:10<23:27:57,  9.99s/it]
 78%|███████▊  | 29507/37963 [73:01:18<21:53:26,  9.32s/it]
 78%|███████▊  | 29508/37963 [73:01:26<20:41:08,  8.81s/it]
 78%|███████▊  | 29509/37963 [73:01:41<24:59:45, 10.64s/it]
 78%|███████▊  | 29510/37963 [73:01:48<22:59:21,  9.79s/it]
                                                           
{'loss': '0.1092', 'grad_norm': '2.427', 'learning_rate': '2.49e-06', 'epoch': '0.7773'}
+
 78%|███████▊  | 29510/37963 [73:01:49<22:59:21,  9.79s/it]
 78%|███████▊  | 29511/37963 [73:01:56<21:20:49,  9.09s/it]
 78%|███████▊  | 29512/37963 [73:02:04<20:34:15,  8.76s/it]
 78%|███████▊  | 29513/37963 [73:02:11<19:42:30,  8.40s/it]
 78%|███████▊  | 29514/37963 [73:02:19<19:17:32,  8.22s/it]
 78%|███████▊  | 29515/37963 [73:02:27<18:58:27,  8.09s/it]
 78%|███████▊  | 29516/37963 [73:02:41<23:20:42,  9.95s/it]
 78%|███████▊  | 29517/37963 [73:02:49<21:43:56,  9.26s/it]
 78%|███████▊  | 29518/37963 [73:03:10<29:45:41, 12.69s/it]
 78%|███████▊  | 29519/37963 [73:03:18<26:21:41, 11.24s/it]
 78%|███████▊  | 29520/37963 [73:03:25<23:38:44, 10.08s/it]
                                                           
{'loss': '0.1047', 'grad_norm': '1.91', 'learning_rate': '2.485e-06', 'epoch': '0.7776'}
+
 78%|███████▊  | 29520/37963 [73:03:25<23:38:44, 10.08s/it]
 78%|███████▊  | 29521/37963 [73:03:32<21:50:59,  9.32s/it]
 78%|███████▊  | 29522/37963 [73:03:40<20:39:27,  8.81s/it]
 78%|███████▊  | 29523/37963 [73:03:48<20:02:51,  8.55s/it]
 78%|███████▊  | 29524/37963 [73:03:56<19:18:15,  8.24s/it]
 78%|███████▊  | 29525/37963 [73:04:03<18:48:34,  8.02s/it]
 78%|███████▊  | 29526/37963 [73:04:11<18:40:52,  7.97s/it]
 78%|███████▊  | 29527/37963 [73:04:19<18:36:03,  7.94s/it]
 78%|███████▊  | 29528/37963 [73:04:27<18:28:23,  7.88s/it]
 78%|███████▊  | 29529/37963 [73:04:35<18:36:45,  7.94s/it]
 78%|███████▊  | 29530/37963 [73:04:42<18:24:24,  7.86s/it]
                                                           
{'loss': '0.1025', 'grad_norm': '2.283', 'learning_rate': '2.479e-06', 'epoch': '0.7779'}
+
 78%|███████▊  | 29530/37963 [73:04:42<18:24:24,  7.86s/it]
 78%|███████▊  | 29531/37963 [73:04:50<18:17:49,  7.81s/it]
 78%|███████▊  | 29532/37963 [73:04:58<18:14:07,  7.79s/it]
 78%|███████▊  | 29533/37963 [73:05:05<18:11:20,  7.77s/it]
 78%|███████▊  | 29534/37963 [73:05:13<18:05:29,  7.73s/it]
 78%|███████▊  | 29535/37963 [73:05:21<18:04:05,  7.72s/it]
 78%|███████▊  | 29536/37963 [73:05:28<18:00:10,  7.69s/it]
 78%|███████▊  | 29537/37963 [73:05:36<18:00:29,  7.69s/it]
 78%|███████▊  | 29538/37963 [73:05:44<17:47:40,  7.60s/it]
 78%|███████▊  | 29539/37963 [73:05:51<17:54:25,  7.65s/it]
 78%|███████▊  | 29540/37963 [73:06:05<22:22:58,  9.57s/it]
                                                           
{'loss': '0.1101', 'grad_norm': '2.976', 'learning_rate': '2.473e-06', 'epoch': '0.7781'}
+
 78%|███████▊  | 29540/37963 [73:06:05<22:22:58,  9.57s/it]
 78%|███████▊  | 29541/37963 [73:06:13<20:58:04,  8.96s/it]
 78%|███████▊  | 29542/37963 [73:06:21<20:17:37,  8.68s/it]
 78%|███████▊  | 29543/37963 [73:06:29<19:38:40,  8.40s/it]
 78%|███████▊  | 29544/37963 [73:06:36<18:55:35,  8.09s/it]
 78%|███████▊  | 29545/37963 [73:06:44<18:38:32,  7.97s/it]
 78%|███████▊  | 29546/37963 [73:06:51<18:27:35,  7.90s/it]
 78%|███████▊  | 29547/37963 [73:06:59<18:21:07,  7.85s/it]
 78%|███████▊  | 29548/37963 [73:07:07<18:21:14,  7.85s/it]
 78%|███████▊  | 29549/37963 [73:07:15<18:17:39,  7.83s/it]
 78%|███████▊  | 29550/37963 [73:07:23<18:17:28,  7.83s/it]
                                                           
{'loss': '0.1087', 'grad_norm': '2.505', 'learning_rate': '2.468e-06', 'epoch': '0.7784'}
+
 78%|███████▊  | 29550/37963 [73:07:23<18:17:28,  7.83s/it]
 78%|███████▊  | 29551/37963 [73:07:30<18:16:17,  7.82s/it]
 78%|███████▊  | 29552/37963 [73:07:38<18:14:48,  7.81s/it]
 78%|███████▊  | 29553/37963 [73:07:46<18:07:33,  7.76s/it]
 78%|███████▊  | 29554/37963 [73:08:07<27:28:13, 11.76s/it]
 78%|███████▊  | 29555/37963 [73:08:15<24:42:00, 10.58s/it]
 78%|███████▊  | 29556/37963 [73:08:22<22:42:55,  9.73s/it]
 78%|███████▊  | 29557/37963 [73:08:38<26:27:51, 11.33s/it]
 78%|███████▊  | 29558/37963 [73:08:45<23:55:39, 10.25s/it]
 78%|███████▊  | 29559/37963 [73:08:53<22:08:58,  9.49s/it]
 78%|███████▊  | 29560/37963 [73:09:01<20:52:30,  8.94s/it]
                                                           
{'loss': '0.1071', 'grad_norm': '2.244', 'learning_rate': '2.462e-06', 'epoch': '0.7787'}
+
 78%|███████▊  | 29560/37963 [73:09:01<20:52:30,  8.94s/it]
 78%|███████▊  | 29561/37963 [73:09:08<19:48:13,  8.49s/it]
 78%|███████▊  | 29562/37963 [73:09:16<19:16:02,  8.26s/it]
 78%|███████▊  | 29563/37963 [73:09:24<18:53:41,  8.10s/it]
 78%|███████▊  | 29564/37963 [73:09:38<23:23:39, 10.03s/it]
 78%|███████▊  | 29565/37963 [73:09:52<26:21:46, 11.30s/it]
 78%|███████▊  | 29566/37963 [73:10:07<28:31:26, 12.23s/it]
 78%|███████▊  | 29567/37963 [73:10:15<25:24:07, 10.89s/it]
 78%|███████▊  | 29568/37963 [73:10:22<23:06:47,  9.91s/it]
 78%|███████▊  | 29569/37963 [73:10:30<21:33:33,  9.25s/it]
 78%|███████▊  | 29570/37963 [73:10:37<20:24:05,  8.75s/it]
                                                           
{'loss': '0.1116', 'grad_norm': '2.225', 'learning_rate': '2.456e-06', 'epoch': '0.7789'}
+
 78%|███████▊  | 29570/37963 [73:10:37<20:24:05,  8.75s/it]
 78%|███████▊  | 29571/37963 [73:10:52<24:17:19, 10.42s/it]
 78%|███████▊  | 29572/37963 [73:10:59<22:18:44,  9.57s/it]
 78%|███████▊  | 29573/37963 [73:11:07<20:59:37,  9.01s/it]
 78%|███████▊  | 29574/37963 [73:11:15<20:03:03,  8.60s/it]
 78%|███████▊  | 29575/37963 [73:11:22<19:24:20,  8.33s/it]
 78%|███████▊  | 29576/37963 [73:11:30<18:51:47,  8.10s/it]
 78%|███████▊  | 29577/37963 [73:11:38<18:32:52,  7.96s/it]
 78%|███████▊  | 29578/37963 [73:11:45<18:20:59,  7.88s/it]
 78%|███████▊  | 29579/37963 [73:11:53<18:06:18,  7.77s/it]
 78%|███████▊  | 29580/37963 [73:12:00<18:01:07,  7.74s/it]
                                                           
{'loss': '0.09257', 'grad_norm': '1.56', 'learning_rate': '2.451e-06', 'epoch': '0.7792'}
+
 78%|███████▊  | 29580/37963 [73:12:00<18:01:07,  7.74s/it]
 78%|███████▊  | 29581/37963 [73:12:08<17:58:52,  7.72s/it]
 78%|███████▊  | 29582/37963 [73:12:16<17:56:57,  7.71s/it]
 78%|███████▊  | 29583/37963 [73:12:24<17:58:39,  7.72s/it]
 78%|███████▊  | 29584/37963 [73:12:38<22:30:37,  9.67s/it]
 78%|███████▊  | 29585/37963 [73:12:46<21:10:19,  9.10s/it]
 78%|███████▊  | 29586/37963 [73:12:53<20:10:01,  8.67s/it]
 78%|███████▊  | 29587/37963 [73:13:01<19:26:29,  8.36s/it]
 78%|███████▊  | 29588/37963 [73:13:09<18:59:06,  8.16s/it]
 78%|███████▊  | 29589/37963 [73:13:16<18:39:23,  8.02s/it]
 78%|███████▊  | 29590/37963 [73:13:24<18:30:34,  7.96s/it]
                                                           
{'loss': '0.09439', 'grad_norm': '3.033', 'learning_rate': '2.445e-06', 'epoch': '0.7794'}
+
 78%|███████▊  | 29590/37963 [73:13:24<18:30:34,  7.96s/it]
 78%|███████▊  | 29591/37963 [73:13:32<18:18:58,  7.88s/it]
 78%|███████▊  | 29592/37963 [73:13:39<18:11:54,  7.83s/it]
 78%|███████▊  | 29593/37963 [73:13:47<17:58:31,  7.73s/it]
 78%|███████▊  | 29594/37963 [73:13:55<17:54:46,  7.71s/it]
 78%|███████▊  | 29595/37963 [73:14:02<17:56:07,  7.72s/it]
 78%|███████▊  | 29596/37963 [73:14:10<17:46:43,  7.65s/it]
 78%|███████▊  | 29597/37963 [73:14:17<17:38:03,  7.59s/it]
 78%|███████▊  | 29598/37963 [73:14:32<22:23:13,  9.63s/it]
 78%|███████▊  | 29599/37963 [73:14:39<21:05:11,  9.08s/it]
 78%|███████▊  | 29600/37963 [73:14:47<20:00:30,  8.61s/it]
                                                           
{'loss': '0.1015', 'grad_norm': '1.956', 'learning_rate': '2.44e-06', 'epoch': '0.7797'}
+
 78%|███████▊  | 29600/37963 [73:14:47<20:00:30,  8.61s/it]
 78%|███████▊  | 29601/37963 [73:14:54<19:11:08,  8.26s/it]
 78%|███████▊  | 29602/37963 [73:15:02<18:39:34,  8.03s/it]
 78%|███████▊  | 29603/37963 [73:15:09<18:15:19,  7.86s/it]
 78%|███████▊  | 29604/37963 [73:15:17<17:54:55,  7.72s/it]
 78%|███████▊  | 29605/37963 [73:15:24<17:41:06,  7.62s/it]
 78%|███████▊  | 29606/37963 [73:15:46<27:35:43, 11.89s/it]
 78%|███████▊  | 29607/37963 [73:15:54<24:59:33, 10.77s/it]
 78%|███████▊  | 29608/37963 [73:16:02<22:53:07,  9.86s/it]
 78%|███████▊  | 29609/37963 [73:16:17<26:18:47, 11.34s/it]
 78%|███████▊  | 29610/37963 [73:16:31<28:20:35, 12.22s/it]
                                                           
{'loss': '0.1118', 'grad_norm': '2.135', 'learning_rate': '2.434e-06', 'epoch': '0.78'}
+
 78%|███████▊  | 29610/37963 [73:16:31<28:20:35, 12.22s/it]
 78%|███████▊  | 29611/37963 [73:16:39<25:18:13, 10.91s/it]
 78%|███████▊  | 29612/37963 [73:16:47<23:05:46,  9.96s/it]
 78%|███████▊  | 29613/37963 [73:16:54<21:16:49,  9.17s/it]
 78%|███████▊  | 29614/37963 [73:17:08<24:51:38, 10.72s/it]
 78%|███████▊  | 29615/37963 [73:17:16<22:37:51,  9.76s/it]
 78%|███████▊  | 29616/37963 [73:17:23<21:06:34,  9.10s/it]
 78%|███████▊  | 29617/37963 [73:17:31<20:06:38,  8.67s/it]
 78%|███████▊  | 29618/37963 [73:17:39<19:22:28,  8.36s/it]
 78%|███████▊  | 29619/37963 [73:17:46<18:55:47,  8.17s/it]
 78%|███████▊  | 29620/37963 [73:17:54<18:30:28,  7.99s/it]
                                                           
{'loss': '0.09818', 'grad_norm': '2.472', 'learning_rate': '2.429e-06', 'epoch': '0.7802'}
+
 78%|███████▊  | 29620/37963 [73:17:54<18:30:28,  7.99s/it]
 78%|███████▊  | 29621/37963 [73:18:01<18:14:33,  7.87s/it]
 78%|███████▊  | 29622/37963 [73:18:16<22:47:56,  9.84s/it]
 78%|███████▊  | 29623/37963 [73:18:24<21:24:11,  9.24s/it]
 78%|███████▊  | 29624/37963 [73:18:31<20:19:57,  8.78s/it]
 78%|███████▊  | 29625/37963 [73:18:39<19:31:21,  8.43s/it]
 78%|███████▊  | 29626/37963 [73:18:47<18:54:21,  8.16s/it]
 78%|███████▊  | 29627/37963 [73:18:54<18:28:40,  7.98s/it]
 78%|███████▊  | 29628/37963 [73:19:02<18:19:34,  7.92s/it]
 78%|███████▊  | 29629/37963 [73:19:10<18:09:05,  7.84s/it]
 78%|███████▊  | 29630/37963 [73:19:24<22:38:39,  9.78s/it]
                                                           
{'loss': '0.1029', 'grad_norm': '1.998', 'learning_rate': '2.423e-06', 'epoch': '0.7805'}
+
 78%|███████▊  | 29630/37963 [73:19:24<22:38:39,  9.78s/it]
 78%|███████▊  | 29631/37963 [73:19:32<21:09:47,  9.14s/it]
 78%|███████▊  | 29632/37963 [73:19:39<20:03:13,  8.67s/it]
 78%|███████▊  | 29633/37963 [73:19:47<19:11:36,  8.29s/it]
 78%|███████▊  | 29634/37963 [73:19:54<18:42:53,  8.09s/it]
 78%|███████▊  | 29635/37963 [73:20:02<18:25:31,  7.96s/it]
 78%|███████▊  | 29636/37963 [73:20:10<18:17:12,  7.91s/it]
 78%|███████▊  | 29637/37963 [73:20:17<18:05:10,  7.82s/it]
 78%|███████▊  | 29638/37963 [73:20:25<18:00:06,  7.78s/it]
 78%|███████▊  | 29639/37963 [73:20:33<17:57:29,  7.77s/it]
 78%|███████▊  | 29640/37963 [73:20:40<17:50:45,  7.72s/it]
                                                           
{'loss': '0.09915', 'grad_norm': '3.1', 'learning_rate': '2.417e-06', 'epoch': '0.7808'}
+
 78%|███████▊  | 29640/37963 [73:20:40<17:50:45,  7.72s/it]
 78%|███████▊  | 29641/37963 [73:20:48<17:53:22,  7.74s/it]
 78%|███████▊  | 29642/37963 [73:20:56<17:47:09,  7.69s/it]
 78%|███████▊  | 29643/37963 [73:21:03<17:48:33,  7.71s/it]
 78%|███████▊  | 29644/37963 [73:21:11<17:44:53,  7.68s/it]
 78%|███████▊  | 29645/37963 [73:21:19<17:47:58,  7.70s/it]
 78%|███████▊  | 29646/37963 [73:21:26<17:49:15,  7.71s/it]
 78%|███████▊  | 29647/37963 [73:21:34<17:43:02,  7.67s/it]
 78%|███████▊  | 29648/37963 [73:21:42<17:44:40,  7.68s/it]
 78%|███████▊  | 29649/37963 [73:21:49<17:36:18,  7.62s/it]
 78%|███████▊  | 29650/37963 [73:21:57<17:35:35,  7.62s/it]
                                                           
{'loss': '0.09842', 'grad_norm': '2.744', 'learning_rate': '2.412e-06', 'epoch': '0.781'}
+
 78%|███████▊  | 29650/37963 [73:21:57<17:35:35,  7.62s/it]
 78%|███████▊  | 29651/37963 [73:22:04<17:23:29,  7.53s/it]
 78%|███████▊  | 29652/37963 [73:22:19<22:12:00,  9.62s/it]
 78%|███████▊  | 29653/37963 [73:22:34<25:49:04, 11.18s/it]
 78%|███████▊  | 29654/37963 [73:22:41<23:28:31, 10.17s/it]
 78%|███████▊  | 29655/37963 [73:22:49<21:49:20,  9.46s/it]
 78%|███████▊  | 29656/37963 [73:22:57<20:41:08,  8.96s/it]
 78%|███████▊  | 29657/37963 [73:23:05<19:49:43,  8.59s/it]
 78%|███████▊  | 29658/37963 [73:23:20<24:12:57, 10.50s/it]
 78%|███████▊  | 29659/37963 [73:23:27<22:20:02,  9.68s/it]
 78%|███████▊  | 29660/37963 [73:23:42<25:36:51, 11.11s/it]
                                                           
{'loss': '0.09745', 'grad_norm': '2.252', 'learning_rate': '2.406e-06', 'epoch': '0.7813'}
+
 78%|███████▊  | 29660/37963 [73:23:42<25:36:51, 11.11s/it]
 78%|███████▊  | 29661/37963 [73:23:50<23:19:04, 10.11s/it]
 78%|███████▊  | 29662/37963 [73:23:57<21:29:42,  9.32s/it]
 78%|███████▊  | 29663/37963 [73:24:05<20:23:01,  8.84s/it]
 78%|███████▊  | 29664/37963 [73:24:12<19:33:37,  8.49s/it]
 78%|███████▊  | 29665/37963 [73:24:20<19:01:06,  8.25s/it]
 78%|███████▊  | 29666/37963 [73:24:28<18:38:54,  8.09s/it]
 78%|███████▊  | 29667/37963 [73:24:36<18:27:00,  8.01s/it]
 78%|███████▊  | 29668/37963 [73:24:50<22:46:44,  9.89s/it]
 78%|███████▊  | 29669/37963 [73:24:58<21:16:59,  9.24s/it]
 78%|███████▊  | 29670/37963 [73:25:12<24:34:06, 10.67s/it]
                                                           
{'loss': '0.09923', 'grad_norm': '2.097', 'learning_rate': '2.401e-06', 'epoch': '0.7816'}
+
 78%|███████▊  | 29670/37963 [73:25:12<24:34:06, 10.67s/it]
 78%|███████▊  | 29671/37963 [73:25:19<22:28:42,  9.76s/it]
 78%|███████▊  | 29672/37963 [73:25:27<21:01:03,  9.13s/it]
 78%|███████▊  | 29673/37963 [73:25:35<20:01:18,  8.69s/it]
 78%|███████▊  | 29674/37963 [73:25:49<23:50:38, 10.36s/it]
 78%|███████▊  | 29675/37963 [73:25:57<22:18:43,  9.69s/it]
 78%|███████▊  | 29676/37963 [73:26:05<20:58:39,  9.11s/it]
 78%|███████▊  | 29677/37963 [73:26:12<19:59:02,  8.68s/it]
 78%|███████▊  | 29678/37963 [73:26:20<19:21:48,  8.41s/it]
 78%|███████▊  | 29679/37963 [73:26:28<18:55:39,  8.23s/it]
 78%|███████▊  | 29680/37963 [73:26:36<18:36:32,  8.09s/it]
                                                           
{'loss': '0.1021', 'grad_norm': '2.214', 'learning_rate': '2.395e-06', 'epoch': '0.7818'}
+
 78%|███████▊  | 29680/37963 [73:26:36<18:36:32,  8.09s/it]
 78%|███████▊  | 29681/37963 [73:26:43<18:17:43,  7.95s/it]
 78%|███████▊  | 29682/37963 [73:26:51<18:05:30,  7.87s/it]
 78%|███████▊  | 29683/37963 [73:26:59<17:59:05,  7.82s/it]
 78%|███████▊  | 29684/37963 [73:27:07<17:56:32,  7.80s/it]
 78%|███████▊  | 29685/37963 [73:27:14<17:51:08,  7.76s/it]
 78%|███████▊  | 29686/37963 [73:27:22<17:48:50,  7.75s/it]
 78%|███████▊  | 29687/37963 [73:27:30<17:46:40,  7.73s/it]
 78%|███████▊  | 29688/37963 [73:27:37<17:40:08,  7.69s/it]
 78%|███████▊  | 29689/37963 [73:27:45<17:42:02,  7.70s/it]
 78%|███████▊  | 29690/37963 [73:27:53<17:45:02,  7.72s/it]
                                                           
{'loss': '0.1074', 'grad_norm': '4.089', 'learning_rate': '2.39e-06', 'epoch': '0.7821'}
+
 78%|███████▊  | 29690/37963 [73:27:53<17:45:02,  7.72s/it]
 78%|███████▊  | 29691/37963 [73:28:00<17:44:36,  7.72s/it]
 78%|███████▊  | 29692/37963 [73:28:08<17:42:20,  7.71s/it]
 78%|███████▊  | 29693/37963 [73:28:16<17:39:42,  7.69s/it]
 78%|███████▊  | 29694/37963 [73:28:23<17:37:45,  7.68s/it]
 78%|███████▊  | 29695/37963 [73:28:31<17:37:42,  7.68s/it]
 78%|███████▊  | 29696/37963 [73:28:39<17:33:17,  7.64s/it]
 78%|███████▊  | 29697/37963 [73:28:54<22:31:42,  9.81s/it]
 78%|███████▊  | 29698/37963 [73:29:01<21:03:04,  9.17s/it]
 78%|███████▊  | 29699/37963 [73:29:15<24:27:16, 10.65s/it]
 78%|███████▊  | 29700/37963 [73:29:23<22:25:57,  9.77s/it]
                                                           
{'loss': '0.1065', 'grad_norm': '2.575', 'learning_rate': '2.384e-06', 'epoch': '0.7823'}
+
 78%|███████▊  | 29700/37963 [73:29:23<22:25:57,  9.77s/it]
 78%|███████▊  | 29701/37963 [73:29:31<20:59:33,  9.15s/it]
 78%|███████▊  | 29702/37963 [73:29:38<19:42:27,  8.59s/it]
 78%|███████▊  | 29703/37963 [73:29:46<19:05:38,  8.32s/it]
 78%|███████▊  | 29704/37963 [73:30:00<23:17:30, 10.15s/it]
 78%|███████▊  | 29705/37963 [73:30:15<26:35:21, 11.59s/it]
 78%|███████▊  | 29706/37963 [73:30:23<23:56:41, 10.44s/it]
 78%|██��████▊  | 29707/37963 [73:30:30<21:59:26,  9.59s/it]
 78%|███████▊  | 29708/37963 [73:30:38<20:42:04,  9.03s/it]
 78%|███████▊  | 29709/37963 [73:30:46<19:50:15,  8.65s/it]
 78%|███████▊  | 29710/37963 [73:31:01<23:59:31, 10.47s/it]
                                                           
{'loss': '0.109', 'grad_norm': '2.222', 'learning_rate': '2.379e-06', 'epoch': '0.7826'}
+
 78%|███████▊  | 29710/37963 [73:31:01<23:59:31, 10.47s/it]
 78%|███████▊  | 29711/37963 [73:31:09<22:17:41,  9.73s/it]
 78%|███████▊  | 29712/37963 [73:31:17<21:02:03,  9.18s/it]
 78%|███████▊  | 29713/37963 [73:31:24<19:52:39,  8.67s/it]
 78%|███████▊  | 29714/37963 [73:31:32<19:13:21,  8.39s/it]
 78%|███████▊  | 29715/37963 [73:31:39<18:43:59,  8.18s/it]
 78%|███████▊  | 29716/37963 [73:31:47<18:26:22,  8.05s/it]
 78%|███████▊  | 29717/37963 [73:32:01<22:41:02,  9.90s/it]
 78%|███████▊  | 29718/37963 [73:32:16<25:42:06, 11.22s/it]
 78%|███████▊  | 29719/37963 [73:32:23<23:13:38, 10.14s/it]
 78%|███████▊  | 29720/37963 [73:32:31<21:33:47,  9.42s/it]
                                                           
{'loss': '0.1139', 'grad_norm': '3.741', 'learning_rate': '2.373e-06', 'epoch': '0.7829'}
+
 78%|███████▊  | 29720/37963 [73:32:31<21:33:47,  9.42s/it]
 78%|███████▊  | 29721/37963 [73:32:39<20:23:16,  8.91s/it]
 78%|███████▊  | 29722/37963 [73:32:46<19:32:35,  8.54s/it]
 78%|███████▊  | 29723/37963 [73:33:00<23:16:19, 10.17s/it]
 78%|███████▊  | 29724/37963 [73:33:08<21:41:30,  9.48s/it]
 78%|███████▊  | 29725/37963 [73:33:16<20:16:57,  8.86s/it]
 78%|███████▊  | 29726/37963 [73:33:23<19:31:13,  8.53s/it]
 78%|███████▊  | 29727/37963 [73:33:31<18:58:59,  8.30s/it]
 78%|███████▊  | 29728/37963 [73:33:39<18:33:25,  8.11s/it]
 78%|███████▊  | 29729/37963 [73:33:47<18:19:45,  8.01s/it]
 78%|███████▊  | 29730/37963 [73:33:55<18:13:56,  7.97s/it]
                                                           
{'loss': '0.1005', 'grad_norm': '2.291', 'learning_rate': '2.368e-06', 'epoch': '0.7831'}
+
 78%|███████▊  | 29730/37963 [73:33:55<18:13:56,  7.97s/it]
 78%|███████▊  | 29731/37963 [73:34:02<17:56:53,  7.85s/it]
 78%|███████▊  | 29732/37963 [73:34:10<17:57:00,  7.85s/it]
 78%|███████▊  | 29733/37963 [73:34:18<17:46:15,  7.77s/it]
 78%|███████▊  | 29734/37963 [73:34:25<17:38:39,  7.72s/it]
 78%|███████▊  | 29735/37963 [73:34:33<17:33:09,  7.68s/it]
 78%|███████▊  | 29736/37963 [73:34:41<17:37:46,  7.71s/it]
 78%|███████▊  | 29737/37963 [73:34:48<17:28:47,  7.65s/it]
 78%|███████▊  | 29738/37963 [73:34:56<17:32:33,  7.68s/it]
 78%|███████▊  | 29739/37963 [73:35:03<17:31:33,  7.67s/it]
 78%|███████▊  | 29740/37963 [73:35:11<17:17:36,  7.57s/it]
                                                           
{'loss': '0.1064', 'grad_norm': '2.787', 'learning_rate': '2.362e-06', 'epoch': '0.7834'}
+
 78%|███████▊  | 29740/37963 [73:35:11<17:17:36,  7.57s/it]
 78%|███████▊  | 29741/37963 [73:35:19<17:22:34,  7.61s/it]
 78%|███████▊  | 29742/37963 [73:35:26<17:18:15,  7.58s/it]
 78%|███████▊  | 29743/37963 [73:35:34<17:27:27,  7.65s/it]
 78%|███████▊  | 29744/37963 [73:35:41<17:27:13,  7.64s/it]
 78%|███████▊  | 29745/37963 [73:35:49<17:36:47,  7.72s/it]
 78%|███████▊  | 29746/37963 [73:35:57<17:36:51,  7.72s/it]
 78%|███████▊  | 29747/37963 [73:36:11<21:53:42,  9.59s/it]
 78%|███████▊  | 29748/37963 [73:36:26<25:34:15, 11.21s/it]
 78%|███████▊  | 29749/37963 [73:36:34<23:21:16, 10.24s/it]
 78%|███████▊  | 29750/37963 [73:36:42<21:42:49,  9.52s/it]
                                                           
{'loss': '0.102', 'grad_norm': '2.147', 'learning_rate': '2.357e-06', 'epoch': '0.7837'}
+
 78%|███████▊  | 29750/37963 [73:36:42<21:42:49,  9.52s/it]
 78%|███████▊  | 29751/37963 [73:36:50<20:36:45,  9.04s/it]
 78%|███████▊  | 29752/37963 [73:36:57<19:41:10,  8.63s/it]
 78%|███████▊  | 29753/37963 [73:37:05<18:55:40,  8.30s/it]
 78%|███████▊  | 29754/37963 [73:37:13<18:30:10,  8.11s/it]
 78%|███████▊  | 29755/37963 [73:37:20<18:12:04,  7.98s/it]
 78%|███████▊  | 29756/37963 [73:37:28<17:59:05,  7.89s/it]
 78%|███████▊  | 29757/37963 [73:37:36<17:48:53,  7.82s/it]
 78%|███████▊  | 29758/37963 [73:37:51<22:55:42, 10.06s/it]
 78%|███████▊  | 29759/37963 [73:37:59<21:19:53,  9.36s/it]
 78%|███████▊  | 29760/37963 [73:38:06<20:09:20,  8.85s/it]
                                                           
{'loss': '0.09555', 'grad_norm': '1.946', 'learning_rate': '2.351e-06', 'epoch': '0.7839'}
+
 78%|███████▊  | 29760/37963 [73:38:06<20:09:20,  8.85s/it]
 78%|███████▊  | 29761/37963 [73:38:14<19:20:12,  8.49s/it]
 78%|███████▊  | 29762/37963 [73:38:22<18:47:50,  8.25s/it]
 78%|███████▊  | 29763/37963 [73:38:36<22:53:40, 10.05s/it]
 78%|███████▊  | 29764/37963 [73:38:51<26:13:06, 11.51s/it]
 78%|███████▊  | 29765/37963 [73:38:58<23:29:14, 10.31s/it]
 78%|███████▊  | 29766/37963 [73:39:06<21:40:45,  9.52s/it]
 78%|███████▊  | 29767/37963 [73:39:20<24:56:35, 10.96s/it]
 78%|███████▊  | 29768/37963 [73:39:28<22:41:44,  9.97s/it]
 78%|███████▊  | 29769/37963 [73:39:36<21:12:23,  9.32s/it]
 78%|███████▊  | 29770/37963 [73:39:43<19:52:11,  8.73s/it]
                                                           
{'loss': '0.1057', 'grad_norm': '3.65', 'learning_rate': '2.346e-06', 'epoch': '0.7842'}
+
 78%|███████▊  | 29770/37963 [73:39:43<19:52:11,  8.73s/it]
 78%|███████▊  | 29771/37963 [73:39:51<19:10:30,  8.43s/it]
 78%|███████▊  | 29772/37963 [73:39:59<18:41:49,  8.22s/it]
 78%|███████▊  | 29773/37963 [73:40:06<18:17:08,  8.04s/it]
 78%|███████▊  | 29774/37963 [73:40:14<17:56:07,  7.88s/it]
 78%|███████▊  | 29775/37963 [73:40:21<17:44:01,  7.80s/it]
 78%|███████▊  | 29776/37963 [73:40:29<17:40:35,  7.77s/it]
 78%|███████▊  | 29777/37963 [73:40:43<21:50:26,  9.61s/it]
 78%|███████▊  | 29778/37963 [73:40:50<20:22:30,  8.96s/it]
 78%|███████▊  | 29779/37963 [73:40:58<19:29:02,  8.57s/it]
 78%|███████▊  | 29780/37963 [73:41:06<18:54:08,  8.32s/it]
                                                           
{'loss': '0.103', 'grad_norm': '1.905', 'learning_rate': '2.34e-06', 'epoch': '0.7845'}
+
 78%|███████▊  | 29780/37963 [73:41:06<18:54:08,  8.32s/it]
 78%|███████▊  | 29781/37963 [73:41:13<18:18:16,  8.05s/it]
 78%|███████▊  | 29782/37963 [73:41:21<18:07:12,  7.97s/it]
 78%|███████▊  | 29783/37963 [73:41:29<17:56:44,  7.90s/it]
 78%|███████▊  | 29784/37963 [73:41:36<17:46:04,  7.82s/it]
 78%|███████▊  | 29785/37963 [73:41:44<17:40:59,  7.78s/it]
 78%|███████▊  | 29786/37963 [73:41:52<17:28:56,  7.70s/it]
 78%|███████▊  | 29787/37963 [73:41:59<17:23:14,  7.66s/it]
 78%|███████▊  | 29788/37963 [73:42:07<17:21:55,  7.65s/it]
 78%|███████▊  | 29789/37963 [73:42:14<17:22:14,  7.65s/it]
 78%|███████▊  | 29790/37963 [73:42:22<17:22:53,  7.66s/it]
                                                           
{'loss': '0.09055', 'grad_norm': '3.721', 'learning_rate': '2.335e-06', 'epoch': '0.7847'}
+
 78%|███████▊  | 29790/37963 [73:42:22<17:22:53,  7.66s/it]
 78%|███████▊  | 29791/37963 [73:42:30<17:20:12,  7.64s/it]
 78%|███████▊  | 29792/37963 [73:42:37<17:19:58,  7.64s/it]
 78%|███████▊  | 29793/37963 [73:42:45<17:20:35,  7.64s/it]
 78%|███████▊  | 29794/37963 [73:42:53<17:22:13,  7.65s/it]
 78%|███████▊  | 29795/37963 [73:43:07<22:04:38,  9.73s/it]
 78%|███████▊  | 29796/37963 [73:43:22<25:14:25, 11.13s/it]
 78%|███████▊  | 29797/37963 [73:43:29<22:59:25, 10.14s/it]
 78%|███████▊  | 29798/37963 [73:43:37<21:21:22,  9.42s/it]
 78%|███████▊  | 29799/37963 [73:43:44<19:57:24,  8.80s/it]
 78%|███████▊  | 29800/37963 [73:43:52<19:16:36,  8.50s/it]
                                                           
{'loss': '0.0947', 'grad_norm': '2.475', 'learning_rate': '2.329e-06', 'epoch': '0.785'}
+
 78%|███████▊  | 29800/37963 [73:43:52<19:16:36,  8.50s/it]
 79%|███████▊  | 29801/37963 [73:44:00<18:46:10,  8.28s/it]
 79%|███████▊  | 29802/37963 [73:44:22<28:10:18, 12.43s/it]
 79%|███████▊  | 29803/37963 [73:44:30<24:58:51, 11.02s/it]
 79%|███████▊  | 29804/37963 [73:44:38<22:44:52, 10.04s/it]
 79%|███████▊  | 29805/37963 [73:44:45<21:09:35,  9.34s/it]
 79%|███████▊  | 29806/37963 [73:44:53<19:57:10,  8.81s/it]
 79%|███████▊  | 29807/37963 [73:45:00<19:07:06,  8.44s/it]
 79%|███████▊  | 29808/37963 [73:45:08<18:30:17,  8.17s/it]
 79%|███████▊  | 29809/37963 [73:45:15<17:59:10,  7.94s/it]
 79%|███████▊  | 29810/37963 [73:45:30<22:28:41,  9.93s/it]
                                                           
{'loss': '0.09823', 'grad_norm': '2.494', 'learning_rate': '2.324e-06', 'epoch': '0.7852'}
+
 79%|███████▊  | 29810/37963 [73:45:30<22:28:41,  9.93s/it]
 79%|███████▊  | 29811/37963 [73:45:37<20:42:01,  9.14s/it]
 79%|███████▊  | 29812/37963 [73:45:45<19:36:55,  8.66s/it]
 79%|███████▊  | 29813/37963 [73:45:53<18:56:28,  8.37s/it]
 79%|███████▊  | 29814/37963 [73:46:00<18:25:23,  8.14s/it]
 79%|███████▊  | 29815/37963 [73:46:15<22:46:13, 10.06s/it]
 79%|███████▊  | 29816/37963 [73:46:22<21:14:26,  9.39s/it]
 79%|███████▊  | 29817/37963 [73:46:30<20:11:27,  8.92s/it]
 79%|███████▊  | 29818/37963 [73:46:45<24:03:32, 10.63s/it]
 79%|███████▊  | 29819/37963 [73:46:53<22:11:38,  9.81s/it]
 79%|███████▊  | 29820/37963 [73:47:01<20:43:59,  9.17s/it]
                                                           
{'loss': '0.1042', 'grad_norm': '3.664', 'learning_rate': '2.318e-06', 'epoch': '0.7855'}
+
 79%|███████▊  | 29820/37963 [73:47:01<20:43:59,  9.17s/it]
 79%|███████▊  | 29821/37963 [73:47:08<19:41:54,  8.71s/it]
 79%|███████▊  | 29822/37963 [73:47:16<18:51:34,  8.34s/it]
 79%|███████▊  | 29823/37963 [73:47:23<18:27:53,  8.17s/it]
 79%|███████▊  | 29824/37963 [73:47:31<18:09:20,  8.03s/it]
 79%|███████▊  | 29825/37963 [73:47:39<17:45:28,  7.86s/it]
 79%|███████▊  | 29826/37963 [73:47:46<17:38:14,  7.80s/it]
 79%|███████▊  | 29827/37963 [73:47:54<17:34:45,  7.78s/it]
 79%|███████▊  | 29828/37963 [73:48:02<17:30:01,  7.74s/it]
 79%|███████▊  | 29829/37963 [73:48:10<17:39:49,  7.82s/it]
 79%|███████▊  | 29830/37963 [73:48:24<22:12:10,  9.83s/it]
                                                           
{'loss': '0.0942', 'grad_norm': '2.561', 'learning_rate': '2.313e-06', 'epoch': '0.7858'}
+
 79%|███████▊  | 29830/37963 [73:48:24<22:12:10,  9.83s/it]
 79%|███████▊  | 29831/37963 [73:48:32<20:54:01,  9.25s/it]
 79%|███████▊  | 29832/37963 [73:48:40<19:53:55,  8.81s/it]
 79%|███████▊  | 29833/37963 [73:48:48<19:11:37,  8.50s/it]
 79%|███████▊  | 29834/37963 [73:48:55<18:35:25,  8.23s/it]
 79%|███████▊  | 29835/37963 [73:49:03<18:15:17,  8.09s/it]
 79%|███████▊  | 29836/37963 [73:49:11<17:55:39,  7.94s/it]
 79%|███████▊  | 29837/37963 [73:49:18<17:41:25,  7.84s/it]
 79%|███████▊  | 29838/37963 [73:49:26<17:34:32,  7.79s/it]
 79%|███████▊  | 29839/37963 [73:49:40<21:47:11,  9.65s/it]
 79%|███████▊  | 29840/37963 [73:49:48<20:26:38,  9.06s/it]
                                                           
{'loss': '0.1163', 'grad_norm': '2.857', 'learning_rate': '2.307e-06', 'epoch': '0.786'}
+
 79%|███████▊  | 29840/37963 [73:49:48<20:26:38,  9.06s/it]
 79%|███████▊  | 29841/37963 [73:49:55<19:29:02,  8.64s/it]
 79%|███████▊  | 29842/37963 [73:50:03<18:54:02,  8.38s/it]
 79%|███████▊  | 29843/37963 [73:50:11<18:24:23,  8.16s/it]
 79%|███████▊  | 29844/37963 [73:50:25<22:38:46, 10.04s/it]
 79%|███████▊  | 29845/37963 [73:50:40<25:42:10, 11.40s/it]
 79%|███████▊  | 29846/37963 [73:50:47<23:14:16, 10.31s/it]
 79%|███████▊  | 29847/37963 [73:50:55<21:25:25,  9.50s/it]
 79%|███████▊  | 29848/37963 [73:51:02<20:03:44,  8.90s/it]
 79%|███████▊  | 29849/37963 [73:51:10<19:13:41,  8.53s/it]
 79%|███████▊  | 29850/37963 [73:51:18<18:38:34,  8.27s/it]
                                                           
{'loss': '0.09907', 'grad_norm': '2.229', 'learning_rate': '2.302e-06', 'epoch': '0.7863'}
+
 79%|███████▊  | 29850/37963 [73:51:18<18:38:34,  8.27s/it]
 79%|███████▊  | 29851/37963 [73:51:26<18:16:21,  8.11s/it]
 79%|███████▊  | 29852/37963 [73:51:41<23:10:54, 10.29s/it]
 79%|███████▊  | 29853/37963 [73:51:49<21:23:36,  9.50s/it]
 79%|███████▊  | 29854/37963 [73:51:56<19:58:55,  8.87s/it]
 79%|███████▊  | 29855/37963 [73:52:04<19:06:24,  8.48s/it]
 79%|███████▊  | 29856/37963 [73:52:11<18:31:07,  8.22s/it]
 79%|███████▊  | 29857/37963 [73:52:25<22:24:04,  9.95s/it]
 79%|███████▊  | 29858/37963 [73:52:33<20:53:57,  9.28s/it]
 79%|███████▊  | 29859/37963 [73:52:41<19:50:27,  8.81s/it]
 79%|███████▊  | 29860/37963 [73:52:56<24:14:40, 10.77s/it]
                                                           
{'loss': '0.09928', 'grad_norm': '2.29', 'learning_rate': '2.296e-06', 'epoch': '0.7866'}
+
 79%|███████▊  | 29860/37963 [73:52:56<24:14:40, 10.77s/it]
 79%|██████���▊  | 29861/37963 [73:53:04<22:08:02,  9.83s/it]
 79%|███████▊  | 29862/37963 [73:53:18<25:31:41, 11.34s/it]
 79%|███████▊  | 29863/37963 [73:53:26<23:04:12, 10.25s/it]
 79%|███████▊  | 29864/37963 [73:53:34<21:17:47,  9.47s/it]
 79%|███████▊  | 29865/37963 [73:53:42<20:10:15,  8.97s/it]
 79%|███████▊  | 29866/37963 [73:53:50<19:29:00,  8.66s/it]
 79%|███████▊  | 29867/37963 [73:53:57<18:58:50,  8.44s/it]
 79%|███████▊  | 29868/37963 [73:54:05<18:27:38,  8.21s/it]
 79%|███████▊  | 29869/37963 [73:54:13<18:09:16,  8.07s/it]
 79%|███████▊  | 29870/37963 [73:54:21<17:59:58,  8.01s/it]
                                                           
{'loss': '0.1076', 'grad_norm': '3.536', 'learning_rate': '2.291e-06', 'epoch': '0.7868'}
+
 79%|███████▊  | 29870/37963 [73:54:21<17:59:58,  8.01s/it]
 79%|███████▊  | 29871/37963 [73:54:28<17:45:36,  7.90s/it]
 79%|███████▊  | 29872/37963 [73:54:36<17:36:10,  7.83s/it]
 79%|███████▊  | 29873/37963 [73:54:44<17:29:05,  7.78s/it]
 79%|███████▊  | 29874/37963 [73:54:51<17:24:44,  7.75s/it]
 79%|███████▊  | 29875/37963 [73:54:59<17:16:50,  7.69s/it]
 79%|███████▊  | 29876/37963 [73:55:13<21:54:07,  9.75s/it]
 79%|███████▊  | 29877/37963 [73:55:21<20:36:00,  9.17s/it]
 79%|███████▊  | 29878/37963 [73:55:29<19:33:43,  8.71s/it]
 79%|███████▊  | 29879/37963 [73:55:37<18:53:09,  8.41s/it]
 79%|███████▊  | 29880/37963 [73:55:44<18:26:02,  8.21s/it]
                                                           
{'loss': '0.09275', 'grad_norm': '2.536', 'learning_rate': '2.285e-06', 'epoch': '0.7871'}
+
 79%|███████▊  | 29880/37963 [73:55:44<18:26:02,  8.21s/it]
 79%|███████▊  | 29881/37963 [73:55:52<18:03:26,  8.04s/it]
 79%|███████▊  | 29882/37963 [73:56:00<17:40:18,  7.87s/it]
 79%|███████▊  | 29883/37963 [73:56:07<17:29:23,  7.79s/it]
 79%|███████▊  | 29884/37963 [73:56:21<21:43:01,  9.68s/it]
 79%|███████▊  | 29885/37963 [73:56:29<20:22:19,  9.08s/it]
 79%|███████▊  | 29886/37963 [73:56:36<19:19:38,  8.61s/it]
 79%|███████▊  | 29887/37963 [73:56:44<18:39:54,  8.32s/it]
 79%|███████▊  | 29888/37963 [73:56:52<18:18:50,  8.16s/it]
 79%|███████▊  | 29889/37963 [73:57:06<22:37:01, 10.08s/it]
 79%|███████▊  | 29890/37963 [73:57:14<20:59:26,  9.36s/it]
                                                           
{'loss': '0.1159', 'grad_norm': '3.144', 'learning_rate': '2.28e-06', 'epoch': '0.7873'}
+
 79%|███████▊  | 29890/37963 [73:57:14<20:59:26,  9.36s/it]
 79%|███████▊  | 29891/37963 [73:57:21<19:34:08,  8.73s/it]
 79%|███████▊  | 29892/37963 [73:57:36<23:17:14, 10.39s/it]
 79%|███████▊  | 29893/37963 [73:57:43<21:31:40,  9.60s/it]
 79%|███████▊  | 29894/37963 [73:57:51<20:15:37,  9.04s/it]
 79%|███████▊  | 29895/37963 [73:57:59<19:25:10,  8.67s/it]
 79%|███████▉  | 29896/37963 [73:58:07<18:45:56,  8.37s/it]
 79%|███████▉  | 29897/37963 [73:58:14<18:15:46,  8.15s/it]
 79%|███████▉  | 29898/37963 [73:58:22<17:53:58,  7.99s/it]
 79%|███████▉  | 29899/37963 [73:58:29<17:39:39,  7.88s/it]
 79%|███████▉  | 29900/37963 [73:58:37<17:31:41,  7.83s/it]
                                                           
{'loss': '0.1026', 'grad_norm': '2.718', 'learning_rate': '2.275e-06', 'epoch': '0.7876'}
+
 79%|███████▉  | 29900/37963 [73:58:37<17:31:41,  7.83s/it]
 79%|███████▉  | 29901/37963 [73:58:45<17:22:41,  7.76s/it]
 79%|███████▉  | 29902/37963 [73:58:53<17:21:16,  7.75s/it]
 79%|███████▉  | 29903/37963 [73:59:07<21:47:15,  9.73s/it]
 79%|███████▉  | 29904/37963 [73:59:15<20:28:31,  9.15s/it]
 79%|███████▉  | 29905/37963 [73:59:22<19:32:27,  8.73s/it]
 79%|███████▉  | 29906/37963 [73:59:37<23:19:13, 10.42s/it]
 79%|███████▉  | 29907/37963 [73:59:44<21:20:05,  9.53s/it]
 79%|███████▉  | 29908/37963 [73:59:52<20:07:11,  8.99s/it]
 79%|███████▉  | 29909/37963 [74:00:00<19:14:34,  8.60s/it]
 79%|███████▉  | 29910/37963 [74:00:14<23:09:47, 10.35s/it]
                                                           
{'loss': '0.09588', 'grad_norm': '2.318', 'learning_rate': '2.269e-06', 'epoch': '0.7879'}
+
 79%|███████▉  | 29910/37963 [74:00:14<23:09:47, 10.35s/it]
 79%|███████▉  | 29911/37963 [74:00:22<21:19:46,  9.54s/it]
 79%|███████▉  | 29912/37963 [74:00:29<20:03:19,  8.97s/it]
 79%|███████▉  | 29913/37963 [74:00:37<19:03:50,  8.53s/it]
 79%|███████▉  | 29914/37963 [74:00:45<18:30:39,  8.28s/it]
 79%|███████▉  | 29915/37963 [74:00:52<18:10:43,  8.13s/it]
 79%|███████▉  | 29916/37963 [74:01:06<22:10:32,  9.92s/it]
 79%|███████▉  | 29917/37963 [74:01:14<20:36:28,  9.22s/it]
 79%|███████▉  | 29918/37963 [74:01:22<19:41:27,  8.81s/it]
 79%|███████▉  | 29919/37963 [74:01:30<18:53:39,  8.46s/it]
 79%|███████▉  | 29920/37963 [74:01:44<23:09:16, 10.36s/it]
                                                           
{'loss': '0.107', 'grad_norm': '2.17', 'learning_rate': '2.264e-06', 'epoch': '0.7881'}
+
 79%|███████▉  | 29920/37963 [74:01:44<23:09:16, 10.36s/it]
 79%|███████▉  | 29921/37963 [74:01:52<21:16:36,  9.52s/it]
 79%|███████▉  | 29922/37963 [74:01:59<19:57:22,  8.93s/it]
 79%|███████▉  | 29923/37963 [74:02:07<19:01:37,  8.52s/it]
 79%|███████▉  | 29924/37963 [74:02:15<18:32:11,  8.30s/it]
 79%|███████▉  | 29925/37963 [74:02:22<18:06:34,  8.11s/it]
 79%|███████▉  | 29926/37963 [74:02:30<17:52:51,  8.01s/it]
 79%|███████▉  | 29927/37963 [74:02:38<17:39:00,  7.91s/it]
 79%|███████▉  | 29928/37963 [74:02:52<22:02:43,  9.88s/it]
 79%|███████▉  | 29929/37963 [74:03:00<20:37:51,  9.24s/it]
 79%|███████▉  | 29930/37963 [74:03:08<19:35:51,  8.78s/it]
                                                           
{'loss': '0.09458', 'grad_norm': '3.187', 'learning_rate': '2.258e-06', 'epoch': '0.7884'}
+
 79%|███████▉  | 29930/37963 [74:03:08<19:35:51,  8.78s/it]
 79%|███████▉  | 29931/37963 [74:03:15<18:40:17,  8.37s/it]
 79%|███████▉  | 29932/37963 [74:03:23<18:12:56,  8.17s/it]
 79%|███████▉  | 29933/37963 [74:03:38<22:30:14, 10.09s/it]
 79%|███████▉  | 29934/37963 [74:03:45<20:44:56,  9.30s/it]
 79%|███████▉  | 29935/37963 [74:03:53<19:34:14,  8.78s/it]
 79%|███████▉  | 29936/37963 [74:04:00<18:51:26,  8.46s/it]
 79%|███████▉  | 29937/37963 [74:04:08<18:20:30,  8.23s/it]
 79%|███████▉  | 29938/37963 [74:04:16<17:56:36,  8.05s/it]
 79%|███████▉  | 29939/37963 [74:04:23<17:44:02,  7.96s/it]
 79%|███████▉  | 29940/37963 [74:04:37<21:48:59,  9.79s/it]
                                                           
{'loss': '0.1143', 'grad_norm': '3.113', 'learning_rate': '2.253e-06', 'epoch': '0.7887'}
+
 79%|███████▉  | 29940/37963 [74:04:37<21:48:59,  9.79s/it]
 79%|███████▉  | 29941/37963 [74:04:45<20:30:54,  9.21s/it]
 79%|███████▉  | 29942/37963 [74:04:53<19:30:47,  8.76s/it]
 79%|███████▉  | 29943/37963 [74:05:01<18:46:03,  8.42s/it]
 79%|███████▉  | 29944/37963 [74:05:08<18:14:11,  8.19s/it]
 79%|███████▉  | 29945/37963 [74:05:16<17:57:20,  8.06s/it]
 79%|███████▉  | 29946/37963 [74:05:24<17:41:49,  7.95s/it]
 79%|███████▉  | 29947/37963 [74:05:31<17:28:35,  7.85s/it]
 79%|███████▉  | 29948/37963 [74:05:39<17:14:18,  7.74s/it]
 79%|███████▉  | 29949/37963 [74:05:54<22:10:14,  9.96s/it]
 79%|███████▉  | 29950/37963 [74:06:02<20:37:06,  9.26s/it]
                                                           
{'loss': '0.09619', 'grad_norm': '2.502', 'learning_rate': '2.248e-06', 'epoch': '0.7889'}
+
 79%|███████▉  | 29950/37963 [74:06:02<20:37:06,  9.26s/it]
 79%|███████▉  | 29951/37963 [74:06:09<19:27:35,  8.74s/it]
 79%|███████▉  | 29952/37963 [74:06:17<18:45:13,  8.43s/it]
 79%|███████▉  | 29953/37963 [74:06:24<18:09:00,  8.16s/it]
 79%|███████▉  | 29954/37963 [74:06:32<17:52:37,  8.04s/it]
 79%|███████▉  | 29955/37963 [74:06:40<17:31:32,  7.88s/it]
 79%|███████▉  | 29956/37963 [74:06:47<17:26:07,  7.84s/it]
 79%|███████▉  | 29957/37963 [74:06:55<17:20:47,  7.80s/it]
 79%|███████▉  | 29958/37963 [74:07:03<17:13:36,  7.75s/it]
 79%|███████▉  | 29959/37963 [74:07:10<17:13:25,  7.75s/it]
 79%|███████▉  | 29960/37963 [74:07:32<26:21:46, 11.86s/it]
                                                           
{'loss': '0.1027', 'grad_norm': '2.424', 'learning_rate': '2.242e-06', 'epoch': '0.7892'}
+
 79%|███████▉  | 29960/37963 [74:07:32<26:21:46, 11.86s/it]
 79%|███████▉  | 29961/37963 [74:07:39<23:31:01, 10.58s/it]
 79%|███████▉  | 29962/37963 [74:07:47<21:37:30,  9.73s/it]
 79%|███████▉  | 29963/37963 [74:08:01<24:20:25, 10.95s/it]
 79%|███████▉  | 29964/37963 [74:08:09<22:07:43,  9.96s/it]
 79%|███████▉  | 29965/37963 [74:08:16<20:41:05,  9.31s/it]
 79%|███████▉  | 29966/37963 [74:08:24<19:32:19,  8.80s/it]
 79%|███████▉  | 29967/37963 [74:08:32<18:52:30,  8.50s/it]
 79%|███████▉  | 29968/37963 [74:08:40<18:22:16,  8.27s/it]
 79%|███████▉  | 29969/37963 [74:08:47<18:01:01,  8.11s/it]
 79%|███████▉  | 29970/37963 [74:09:01<22:00:52,  9.92s/it]
                                                           
{'loss': '0.1075', 'grad_norm': '2.884', 'learning_rate': '2.237e-06', 'epoch': '0.7895'}
+
 79%|███████▉  | 29970/37963 [74:09:01<22:00:52,  9.92s/it]
 79%|███████▉  | 29971/37963 [74:09:09<20:32:32,  9.25s/it]
 79%|███████▉  | 29972/37963 [74:09:17<19:21:07,  8.72s/it]
 79%|███████▉  | 29973/37963 [74:09:24<18:41:17,  8.42s/it]
 79%|███████▉  | 29974/37963 [74:09:32<18:09:32,  8.18s/it]
 79%|███████▉  | 29975/37963 [74:09:39<17:38:27,  7.95s/it]
 79%|███████▉  | 29976/37963 [74:09:53<21:39:20,  9.76s/it]
 79%|███████▉  | 29977/37963 [74:10:08<25:04:44, 11.31s/it]
 79%|███████▉  | 29978/37963 [74:10:16<22:42:05, 10.23s/it]
 79%|███████▉  | 29979/37963 [74:10:24<20:57:04,  9.45s/it]
 79%|███████▉  | 29980/37963 [74:10:31<19:41:56,  8.88s/it]
                                                           
{'loss': '0.09632', 'grad_norm': '2.099', 'learning_rate': '2.231e-06', 'epoch': '0.7897'}
+
 79%|███████▉  | 29980/37963 [74:10:31<19:41:56,  8.88s/it]
 79%|███████▉  | 29981/37963 [74:10:39<18:50:12,  8.50s/it]
 79%|███████▉  | 29982/37963 [74:10:46<18:18:40,  8.26s/it]
 79%|███████▉  | 29983/37963 [74:10:54<17:55:27,  8.09s/it]
 79%|███████▉  | 29984/37963 [74:11:02<17:36:13,  7.94s/it]
 79%|███████▉  | 29985/37963 [74:11:09<17:23:30,  7.85s/it]
 79%|███████▉  | 29986/37963 [74:11:17<17:16:27,  7.80s/it]
 79%|███████▉  | 29987/37963 [74:11:25<17:02:30,  7.69s/it]
 79%|███████▉  | 29988/37963 [74:11:32<17:01:55,  7.69s/it]
 79%|███████▉  | 29989/37963 [74:11:47<21:38:18,  9.77s/it]
 79%|███████▉  | 29990/37963 [74:11:54<20:10:12,  9.11s/it]
                                                           
{'loss': '0.1046', 'grad_norm': '2.152', 'learning_rate': '2.226e-06', 'epoch': '0.79'}
+
 79%|███████▉  | 29990/37963 [74:11:54<20:10:12,  9.11s/it]
 79%|███████▉  | 29991/37963 [74:12:02<19:13:30,  8.68s/it]
 79%|███████▉  | 29992/37963 [74:12:10<18:28:57,  8.35s/it]
 79%|███████▉  | 29993/37963 [74:12:17<18:04:22,  8.16s/it]
 79%|███████▉  | 29994/37963 [74:12:25<17:41:30,  7.99s/it]
 79%|███████▉  | 29995/37963 [74:12:33<17:28:37,  7.90s/it]
 79%|███████▉  | 29996/37963 [74:12:40<17:18:53,  7.82s/it]
 79%|███████▉  | 29997/37963 [74:12:54<21:32:07,  9.73s/it]
 79%|███████▉  | 29998/37963 [74:13:02<20:17:12,  9.17s/it]
 79%|███████▉  | 29999/37963 [74:13:10<19:17:56,  8.72s/it]
 79%|███████▉  | 30000/37963 [74:13:18<18:29:29,  8.36s/it]
                                                           
{'loss': '0.1071', 'grad_norm': '2.95', 'learning_rate': '2.221e-06', 'epoch': '0.7902'}
+
 79%|███████▉  | 30000/37963 [74:13:18<18:29:29,  8.36s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.98s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.98s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 79%|███████▉  | 30001/37963 [74:14:15<50:55:13, 23.02s/it]
 79%|███████▉  | 30002/37963 [74:14:23<40:53:08, 18.49s/it]
 79%|███████▉  | 30003/37963 [74:14:31<33:49:40, 15.30s/it]
 79%|███████▉  | 30004/37963 [74:14:45<33:05:50, 14.97s/it]
 79%|███████▉  | 30005/37963 [74:14:53<28:19:44, 12.82s/it]
 79%|███████▉  | 30006/37963 [74:15:00<24:54:50, 11.27s/it]
 79%|███████▉  | 30007/37963 [74:15:08<22:32:05, 10.20s/it]
 79%|███████▉  | 30008/37963 [74:15:22<25:25:03, 11.50s/it]
 79%|███████▉  | 30009/37963 [74:15:30<23:01:48, 10.42s/it]
 79%|███████▉  | 30010/37963 [74:15:38<21:23:26,  9.68s/it]
                                                           
{'loss': '0.1172', 'grad_norm': '2.65', 'learning_rate': '2.215e-06', 'epoch': '0.7905'}
+
 79%|███████▉  | 30010/37963 [74:15:38<21:23:26,  9.68s/it]
 79%|███████▉  | 30011/37963 [74:15:53<24:39:05, 11.16s/it]
 79%|███████▉  | 30012/37963 [74:16:01<22:19:18, 10.11s/it]
 79%|███████▉  | 30013/37963 [74:16:08<20:38:51,  9.35s/it]
 79%|███████▉  | 30014/37963 [74:16:16<19:29:52,  8.83s/it]
 79%|███████▉  | 30015/37963 [74:16:23<18:43:13,  8.48s/it]
 79%|███████▉  | 30016/37963 [74:16:31<18:16:30,  8.28s/it]
 79%|███████▉  | 30017/37963 [74:16:39<17:52:21,  8.10s/it]
 79%|███████▉  | 30018/37963 [74:16:46<17:32:28,  7.95s/it]
 79%|███████▉  | 30019/37963 [74:17:01<22:12:02, 10.06s/it]
 79%|███████▉  | 30020/37963 [74:17:09<20:30:30,  9.30s/it]
                                                           
{'loss': '0.09684', 'grad_norm': '1.595', 'learning_rate': '2.21e-06', 'epoch': '0.7908'}
+
 79%|███████▉  | 30020/37963 [74:17:09<20:30:30,  9.30s/it]
 79%|███████▉  | 30021/37963 [74:17:23<23:41:40, 10.74s/it]
 79%|███████▉  | 30022/37963 [74:17:31<21:42:34,  9.84s/it]
 79%|███████▉  | 30023/37963 [74:17:38<20:14:38,  9.18s/it]
 79%|███████▉  | 30024/37963 [74:17:46<19:22:57,  8.79s/it]
 79%|███████▉  | 30025/37963 [74:17:54<18:47:06,  8.52s/it]
 79%|███████▉  | 30026/37963 [74:18:08<22:32:36, 10.23s/it]
 79%|███████▉  | 30027/37963 [74:18:16<20:52:08,  9.47s/it]
 79%|███████▉  | 30028/37963 [74:18:24<19:39:02,  8.92s/it]
 79%|███████▉  | 30029/37963 [74:18:31<18:42:06,  8.49s/it]
 79%|███████▉  | 30030/37963 [74:18:39<18:09:49,  8.24s/it]
                                                           
{'loss': '0.1015', 'grad_norm': '2.546', 'learning_rate': '2.205e-06', 'epoch': '0.791'}
+
 79%|███████▉  | 30030/37963 [74:18:39<18:09:49,  8.24s/it]
 79%|███████▉  | 30031/37963 [74:18:47<17:47:28,  8.07s/it]
 79%|███████▉  | 30032/37963 [74:18:54<17:36:57,  8.00s/it]
 79%|███████▉  | 30033/37963 [74:19:09<21:42:24,  9.85s/it]
 79%|███████▉  | 30034/37963 [74:19:16<20:12:56,  9.18s/it]
 79%|███████▉  | 30035/37963 [74:19:24<19:14:33,  8.74s/it]
 79%|███████▉  | 30036/37963 [74:19:32<18:34:06,  8.43s/it]
 79%|███████▉  | 30037/37963 [74:19:39<18:06:59,  8.23s/it]
 79%|███████▉  | 30038/37963 [74:19:47<17:48:00,  8.09s/it]
 79%|███████▉  | 30039/37963 [74:19:55<17:32:09,  7.97s/it]
 79%|███████▉  | 30040/37963 [74:20:03<17:21:18,  7.89s/it]
                                                           
{'loss': '0.1', 'grad_norm': '2.64', 'learning_rate': '2.199e-06', 'epoch': '0.7913'}
+
 79%|███████▉  | 30040/37963 [74:20:03<17:21:18,  7.89s/it]
 79%|███████▉  | 30041/37963 [74:20:10<17:17:22,  7.86s/it]
 79%|███████▉  | 30042/37963 [74:20:18<17:13:25,  7.83s/it]
 79%|███████▉  | 30043/37963 [74:20:26<17:12:55,  7.83s/it]
 79%|███████▉  | 30044/37963 [74:20:34<17:10:21,  7.81s/it]
 79%|███████▉  | 30045/37963 [74:20:41<17:05:02,  7.77s/it]
 79%|███████▉  | 30046/37963 [74:20:49<16:56:39,  7.70s/it]
 79%|███████▉  | 30047/37963 [74:20:57<16:57:22,  7.71s/it]
 79%|███████▉  | 30048/37963 [74:21:04<16:56:05,  7.70s/it]
 79%|███████▉  | 30049/37963 [74:21:19<21:32:21,  9.80s/it]
 79%|███████▉  | 30050/37963 [74:21:26<19:51:32,  9.03s/it]
                                                           
{'loss': '0.1051', 'grad_norm': '2.583', 'learning_rate': '2.194e-06', 'epoch': '0.7916'}
+
 79%|███████▉  | 30050/37963 [74:21:26<19:51:32,  9.03s/it]
 79%|███████▉  | 30051/37963 [74:21:34<18:55:46,  8.61s/it]
 79%|███████▉  | 30052/37963 [74:21:42<18:16:44,  8.32s/it]
 79%|███████▉  | 30053/37963 [74:21:49<17:55:41,  8.16s/it]
 79%|███████▉  | 30054/37963 [74:21:57<17:41:05,  8.05s/it]
 79%|███████▉  | 30055/37963 [74:22:11<21:48:05,  9.92s/it]
 79%|███████▉  | 30056/37963 [74:22:19<20:20:26,  9.26s/it]
 79%|███████▉  | 30057/37963 [74:22:27<19:18:23,  8.79s/it]
 79%|███████▉  | 30058/37963 [74:22:35<18:36:04,  8.47s/it]
 79%|███████▉  | 30059/37963 [74:22:49<22:43:57, 10.35s/it]
 79%|███████▉  | 30060/37963 [74:22:57<20:58:43,  9.56s/it]
                                                           
{'loss': '0.09788', 'grad_norm': '1.597', 'learning_rate': '2.189e-06', 'epoch': '0.7918'}
+
 79%|███████▉  | 30060/37963 [74:22:57<20:58:43,  9.56s/it]
 79%|███████▉  | 30061/37963 [74:23:05<19:48:41,  9.03s/it]
 79%|███████▉  | 30062/37963 [74:23:19<23:20:58, 10.64s/it]
 79%|███████▉  | 30063/37963 [74:23:27<21:28:27,  9.79s/it]
 79%|██���████▉  | 30064/37963 [74:23:34<19:55:26,  9.08s/it]
 79%|███████▉  | 30065/37963 [74:23:42<18:55:35,  8.63s/it]
 79%|███████▉  | 30066/37963 [74:23:50<18:23:17,  8.38s/it]
 79%|███████▉  | 30067/37963 [74:24:05<22:42:20, 10.35s/it]
 79%|███████▉  | 30068/37963 [74:24:12<20:59:43,  9.57s/it]
 79%|███████▉  | 30069/37963 [74:24:20<19:50:40,  9.05s/it]
 79%|███████▉  | 30070/37963 [74:24:28<18:59:11,  8.66s/it]
                                                           
{'loss': '0.1068', 'grad_norm': '3.831', 'learning_rate': '2.183e-06', 'epoch': '0.7921'}
+
 79%|███████▉  | 30070/37963 [74:24:28<18:59:11,  8.66s/it]
 79%|███████▉  | 30071/37963 [74:24:42<22:36:58, 10.32s/it]
 79%|███████▉  | 30072/37963 [74:24:50<20:58:20,  9.57s/it]
 79%|███████▉  | 30073/37963 [74:24:58<19:46:02,  9.02s/it]
 79%|███████▉  | 30074/37963 [74:25:12<23:12:54, 10.59s/it]
 79%|███████▉  | 30075/37963 [74:25:20<21:21:11,  9.75s/it]
 79%|███████▉  | 30076/37963 [74:25:27<19:45:36,  9.02s/it]
 79%|███████▉  | 30077/37963 [74:25:35<18:53:11,  8.62s/it]
 79%|███████▉  | 30078/37963 [74:25:42<18:14:00,  8.32s/it]
 79%|███████▉  | 30079/37963 [74:25:50<17:52:02,  8.16s/it]
 79%|███████▉  | 30080/37963 [74:25:58<17:33:14,  8.02s/it]
                                                           
{'loss': '0.09115', 'grad_norm': '2.931', 'learning_rate': '2.178e-06', 'epoch': '0.7924'}
+
 79%|███████▉  | 30080/37963 [74:25:58<17:33:14,  8.02s/it]
 79%|███████▉  | 30081/37963 [74:26:05<17:10:10,  7.84s/it]
 79%|███████▉  | 30082/37963 [74:26:13<17:07:04,  7.82s/it]
 79%|███████▉  | 30083/37963 [74:26:28<21:32:57,  9.84s/it]
 79%|███████▉  | 30084/37963 [74:26:36<20:12:35,  9.23s/it]
 79%|███████▉  | 30085/37963 [74:26:43<19:15:06,  8.80s/it]
 79%|███████▉  | 30086/37963 [74:26:51<18:29:06,  8.45s/it]
 79%|███████▉  | 30087/37963 [74:26:58<17:52:30,  8.17s/it]
 79%|███████▉  | 30088/37963 [74:27:06<17:27:13,  7.98s/it]
 79%|███████▉  | 30089/37963 [74:27:14<17:15:56,  7.89s/it]
 79%|███████▉  | 30090/37963 [74:27:22<17:16:51,  7.90s/it]
                                                           
{'loss': '0.1023', 'grad_norm': '2.489', 'learning_rate': '2.173e-06', 'epoch': '0.7926'}
+
 79%|███████▉  | 30090/37963 [74:27:22<17:16:51,  7.90s/it]
 79%|███████▉  | 30091/37963 [74:27:29<16:57:13,  7.75s/it]
 79%|███████▉  | 30092/37963 [74:27:37<16:51:50,  7.71s/it]
 79%|███████▉  | 30093/37963 [74:27:44<16:54:12,  7.73s/it]
 79%|███████▉  | 30094/37963 [74:27:52<16:51:21,  7.71s/it]
 79%|███████▉  | 30095/37963 [74:28:07<21:20:04,  9.76s/it]
 79%|███████▉  | 30096/37963 [74:28:14<19:59:08,  9.15s/it]
 79%|███████▉  | 30097/37963 [74:28:22<18:59:12,  8.69s/it]
 79%|███████▉  | 30098/37963 [74:28:30<18:19:27,  8.39s/it]
 79%|███████▉  | 30099/37963 [74:28:37<17:48:25,  8.15s/it]
 79%|███████▉  | 30100/37963 [74:28:45<17:18:41,  7.93s/it]
                                                           
{'loss': '0.0965', 'grad_norm': '2.307', 'learning_rate': '2.167e-06', 'epoch': '0.7929'}
+
 79%|███████▉  | 30100/37963 [74:28:45<17:18:41,  7.93s/it]
 79%|███████▉  | 30101/37963 [74:28:52<17:00:25,  7.79s/it]
 79%|███████▉  | 30102/37963 [74:29:00<16:53:05,  7.73s/it]
 79%|███████▉  | 30103/37963 [74:29:14<21:00:52,  9.63s/it]
 79%|███████▉  | 30104/37963 [74:29:22<19:50:53,  9.09s/it]
 79%|███████▉  | 30105/37963 [74:29:36<23:18:35, 10.68s/it]
 79%|███████▉  | 30106/37963 [74:29:43<21:08:41,  9.69s/it]
 79%|███████▉  | 30107/37963 [74:29:51<19:48:58,  9.08s/it]
 79%|███████▉  | 30108/37963 [74:29:59<18:51:56,  8.65s/it]
 79%|███████▉  | 30109/37963 [74:30:06<18:09:07,  8.32s/it]
 79%|███████▉  | 30110/37963 [74:30:14<17:43:31,  8.13s/it]
                                                           
{'loss': '0.1076', 'grad_norm': '2.351', 'learning_rate': '2.162e-06', 'epoch': '0.7931'}
+
 79%|███████▉  | 30110/37963 [74:30:14<17:43:31,  8.13s/it]
 79%|███████▉  | 30111/37963 [74:30:28<21:51:09, 10.02s/it]
 79%|███████▉  | 30112/37963 [74:30:36<20:15:20,  9.29s/it]
 79%|███████▉  | 30113/37963 [74:30:44<19:11:47,  8.80s/it]
 79%|███████▉  | 30114/37963 [74:30:51<18:27:10,  8.46s/it]
 79%|███████▉  | 30115/37963 [74:30:59<17:54:08,  8.21s/it]
 79%|███████▉  | 30116/37963 [74:31:14<22:34:12, 10.35s/it]
 79%|███████▉  | 30117/37963 [74:31:22<20:56:06,  9.61s/it]
 79%|███████▉  | 30118/37963 [74:31:30<19:34:39,  8.98s/it]
 79%|███████▉  | 30119/37963 [74:31:37<18:32:17,  8.51s/it]
 79%|███████▉  | 30120/37963 [74:31:51<22:08:27, 10.16s/it]
                                                           
{'loss': '0.09282', 'grad_norm': '3.04', 'learning_rate': '2.157e-06', 'epoch': '0.7934'}
+
 79%|███████▉  | 30120/37963 [74:31:51<22:08:27, 10.16s/it]
 79%|███████▉  | 30121/37963 [74:31:59<20:35:35,  9.45s/it]
 79%|███████▉  | 30122/37963 [74:32:06<19:24:28,  8.91s/it]
 79%|███████▉  | 30123/37963 [74:32:14<18:47:05,  8.63s/it]
 79%|███████▉  | 30124/37963 [74:32:29<22:25:50, 10.30s/it]
 79%|███████▉  | 30125/37963 [74:32:36<20:43:38,  9.52s/it]
 79%|███████▉  | 30126/37963 [74:32:44<19:33:53,  8.99s/it]
 79%|███████▉  | 30127/37963 [74:32:58<23:05:33, 10.61s/it]
 79%|███████▉  | 30128/37963 [74:33:06<20:58:22,  9.64s/it]
 79%|███████▉  | 30129/37963 [74:33:14<19:40:18,  9.04s/it]
 79%|███████▉  | 30130/37963 [74:33:21<18:49:31,  8.65s/it]
                                                           
{'loss': '0.1014', 'grad_norm': '2.78', 'learning_rate': '2.152e-06', 'epoch': '0.7937'}
+
 79%|███████▉  | 30130/37963 [74:33:21<18:49:31,  8.65s/it]
 79%|███████▉  | 30131/37963 [74:33:29<18:11:44,  8.36s/it]
 79%|███████▉  | 30132/37963 [74:33:36<17:28:58,  8.04s/it]
 79%|███████▉  | 30133/37963 [74:33:44<17:15:24,  7.93s/it]
 79%|███████▉  | 30134/37963 [74:33:52<17:06:20,  7.87s/it]
 79%|███████▉  | 30135/37963 [74:33:59<17:06:12,  7.87s/it]
 79%|███████▉  | 30136/37963 [74:34:07<16:47:22,  7.72s/it]
 79%|███████▉  | 30137/37963 [74:34:15<16:45:51,  7.71s/it]
 79%|███████▉  | 30138/37963 [74:34:22<16:43:29,  7.69s/it]
 79%|███████▉  | 30139/37963 [74:34:30<16:37:29,  7.65s/it]
 79%|███████▉  | 30140/37963 [74:34:37<16:37:26,  7.65s/it]
                                                           
{'loss': '0.1017', 'grad_norm': '3.212', 'learning_rate': '2.146e-06', 'epoch': '0.7939'}
+
 79%|███████▉  | 30140/37963 [74:34:37<16:37:26,  7.65s/it]
 79%|███████▉  | 30141/37963 [74:34:45<16:41:12,  7.68s/it]
 79%|███████▉  | 30142/37963 [74:34:53<16:40:27,  7.68s/it]
 79%|███████▉  | 30143/37963 [74:35:08<21:27:24,  9.88s/it]
 79%|███████▉  | 30144/37963 [74:35:16<20:08:11,  9.27s/it]
 79%|███████▉  | 30145/37963 [74:35:23<19:10:08,  8.83s/it]
 79%|███████▉  | 30146/37963 [74:35:31<18:24:09,  8.48s/it]
 79%|███████▉  | 30147/37963 [74:35:39<17:47:26,  8.19s/it]
 79%|███████▉  | 30148/37963 [74:35:46<17:25:20,  8.03s/it]
 79%|███████▉  | 30149/37963 [74:35:54<17:14:38,  7.94s/it]
 79%|███████▉  | 30150/37963 [74:36:02<16:56:45,  7.81s/it]
                                                           
{'loss': '0.0953', 'grad_norm': '2.499', 'learning_rate': '2.141e-06', 'epoch': '0.7942'}
+
 79%|███████▉  | 30150/37963 [74:36:02<16:56:45,  7.81s/it]
 79%|███████▉  | 30151/37963 [74:36:09<16:45:48,  7.73s/it]
 79%|███████▉  | 30152/37963 [74:36:17<16:46:23,  7.73s/it]
 79%|███████▉  | 30153/37963 [74:36:32<21:19:04,  9.83s/it]
 79%|███████▉  | 30154/37963 [74:36:39<19:56:21,  9.19s/it]
 79%|███████▉  | 30155/37963 [74:36:54<23:31:23, 10.85s/it]
 79%|███████▉  | 30156/37963 [74:37:02<21:37:16,  9.97s/it]
 79%|███████▉  | 30157/37963 [74:37:10<20:06:57,  9.28s/it]
 79%|███████▉  | 30158/37963 [74:37:24<23:45:34, 10.96s/it]
 79%|███████▉  | 30159/37963 [74:37:32<21:44:40, 10.03s/it]
 79%|███████▉  | 30160/37963 [74:37:40<20:07:02,  9.28s/it]
                                                           
{'loss': '0.111', 'grad_norm': '2.791', 'learning_rate': '2.136e-06', 'epoch': '0.7945'}
+
 79%|███████▉  | 30160/37963 [74:37:40<20:07:02,  9.28s/it]
 79%|███████▉  | 30161/37963 [74:37:48<19:06:41,  8.82s/it]
 79%|███████▉  | 30162/37963 [74:37:55<18:21:30,  8.47s/it]
 79%|███████▉  | 30163/37963 [74:38:03<17:44:42,  8.19s/it]
 79%|███████▉  | 30164/37963 [74:38:18<22:16:59, 10.29s/it]
 79%|███████▉  | 30165/37963 [74:38:26<20:44:45,  9.58s/it]
 79%|███████▉  | 30166/37963 [74:38:34<19:33:12,  9.03s/it]
 79%|███████▉  | 30167/37963 [74:38:41<18:30:50,  8.55s/it]
 79%|███████▉  | 30168/37963 [74:38:56<22:35:07, 10.43s/it]
 79%|███████▉  | 30169/37963 [74:39:03<20:31:25,  9.48s/it]
 79%|███████▉  | 30170/37963 [74:39:11<19:26:06,  8.98s/it]
                                                           
{'loss': '0.0978', 'grad_norm': '3.128', 'learning_rate': '2.13e-06', 'epoch': '0.7947'}
+
 79%|███████▉  | 30170/37963 [74:39:11<19:26:06,  8.98s/it]
 79%|███████▉  | 30171/37963 [74:39:19<18:41:27,  8.64s/it]
 79%|███████▉  | 30172/37963 [74:39:33<22:20:40, 10.32s/it]
 79%|███████▉  | 30173/37963 [74:39:41<20:41:07,  9.56s/it]
 79%|███████▉  | 30174/37963 [74:39:48<19:25:02,  8.97s/it]
 79%|███████▉  | 30175/37963 [74:39:56<18:34:14,  8.58s/it]
 79%|███████▉  | 30176/37963 [74:40:10<22:14:15, 10.28s/it]
 79%|███████▉  | 30177/37963 [74:40:18<20:19:20,  9.40s/it]
 79%|███████▉  | 30178/37963 [74:40:25<19:12:41,  8.88s/it]
 79%|███████▉  | 30179/37963 [74:40:33<18:24:47,  8.52s/it]
 79%|███████▉  | 30180/37963 [74:40:40<17:42:54,  8.19s/it]
                                                           
{'loss': '0.1057', 'grad_norm': '2.074', 'learning_rate': '2.125e-06', 'epoch': '0.795'}
+
 79%|███████▉  | 30180/37963 [74:40:40<17:42:54,  8.19s/it]
 80%|███████▉  | 30181/37963 [74:40:48<17:25:50,  8.06s/it]
 80%|███████▉  | 30182/37963 [74:40:56<17:14:20,  7.98s/it]
 80%|███████▉  | 30183/37963 [74:41:04<17:06:00,  7.91s/it]
 80%|███████▉  | 30184/37963 [74:41:11<16:58:01,  7.85s/it]
 80%|███████▉  | 30185/37963 [74:41:19<16:52:26,  7.81s/it]
 80%|███████▉  | 30186/37963 [74:41:33<20:59:22,  9.72s/it]
 80%|███████▉  | 30187/37963 [74:41:41<19:33:49,  9.06s/it]
 80%|███████▉  | 30188/37963 [74:41:49<18:41:40,  8.66s/it]
 80%|███████▉  | 30189/37963 [74:41:56<18:03:07,  8.36s/it]
 80%|███████▉  | 30190/37963 [74:42:04<17:37:53,  8.17s/it]
                                                           
{'loss': '0.1022', 'grad_norm': '3.466', 'learning_rate': '2.12e-06', 'epoch': '0.7953'}
+
 80%|███████▉  | 30190/37963 [74:42:04<17:37:53,  8.17s/it]
 80%|███████▉  | 30191/37963 [74:42:12<17:18:53,  8.02s/it]
 80%|███████▉  | 30192/37963 [74:42:19<16:58:52,  7.87s/it]
 80%|███████▉  | 30193/37963 [74:42:27<16:56:54,  7.85s/it]
 80%|███████▉  | 30194/37963 [74:42:35<16:47:56,  7.78s/it]
 80%|███████▉  | 30195/37963 [74:42:42<16:46:57,  7.78s/it]
 80%|███████▉  | 30196/37963 [74:42:50<16:48:59,  7.79s/it]
 80%|███████▉  | 30197/37963 [74:42:58<16:43:04,  7.75s/it]
 80%|███████▉  | 30198/37963 [74:43:06<16:40:38,  7.73s/it]
 80%|███████▉  | 30199/37963 [74:43:13<16:41:25,  7.74s/it]
 80%|███████▉  | 30200/37963 [74:43:21<16:31:13,  7.66s/it]
                                                           
{'loss': '0.1009', 'grad_norm': '2.587', 'learning_rate': '2.115e-06', 'epoch': '0.7955'}
+
 80%|███████▉  | 30200/37963 [74:43:21<16:31:13,  7.66s/it]
 80%|███████▉  | 30201/37963 [74:43:35<20:52:09,  9.68s/it]
 80%|███████▉  | 30202/37963 [74:43:50<23:54:52, 11.09s/it]
 80%|███████▉  | 30203/37963 [74:43:57<21:41:45, 10.07s/it]
 80%|███████▉  | 30204/37963 [74:44:05<20:01:24,  9.29s/it]
 80%|███████▉  | 30205/37963 [74:44:12<18:56:31,  8.79s/it]
 80%|███████▉  | 30206/37963 [74:44:27<22:42:35, 10.54s/it]
 80%|███████▉  | 30207/37963 [74:44:35<20:55:22,  9.71s/it]
 80%|███████▉  | 30208/37963 [74:44:42<19:36:19,  9.10s/it]
 80%|███████▉  | 30209/37963 [74:44:50<18:39:48,  8.67s/it]
 80%|███████▉  | 30210/37963 [74:44:58<18:06:57,  8.41s/it]
                                                           
{'loss': '0.09838', 'grad_norm': '3.665', 'learning_rate': '2.109e-06', 'epoch': '0.7958'}
+
 80%|███████▉  | 30210/37963 [74:44:58<18:06:57,  8.41s/it]
 80%|███████▉  | 30211/37963 [74:45:06<17:38:46,  8.19s/it]
 80%|███████▉  | 30212/37963 [74:45:13<17:18:40,  8.04s/it]
 80%|███████▉  | 30213/37963 [74:45:21<17:12:34,  7.99s/it]
 80%|███████▉  | 30214/37963 [74:45:29<16:50:24,  7.82s/it]
 80%|███████▉  | 30215/37963 [74:45:36<16:40:59,  7.75s/it]
 80%|███████▉  | 30216/37963 [74:45:50<20:46:44,  9.66s/it]
 80%|███████▉  | 30217/37963 [74:46:05<24:04:06, 11.19s/it]
 80%|███████▉  | 30218/37963 [74:46:13<21:53:55, 10.18s/it]
 80%|███████▉  | 30219/37963 [74:46:20<20:16:09,  9.42s/it]
 80%|███████▉  | 30220/37963 [74:46:28<19:08:49,  8.90s/it]
                                                           
{'loss': '0.1023', 'grad_norm': '2.872', 'learning_rate': '2.104e-06', 'epoch': '0.796'}
+
 80%|███████▉  | 30220/37963 [74:46:28<19:08:49,  8.90s/it]
 80%|███████▉  | 30221/37963 [74:46:36<18:21:24,  8.54s/it]
 80%|███████▉  | 30222/37963 [74:46:50<22:01:21, 10.24s/it]
 80%|███████▉  | 30223/37963 [74:46:58<20:23:21,  9.48s/it]
 80%|███████▉  | 30224/37963 [74:47:05<19:14:11,  8.95s/it]
 80%|███████▉  | 30225/37963 [74:47:13<18:21:54,  8.54s/it]
 80%|███████▉  | 30226/37963 [74:47:20<17:35:35,  8.19s/it]
 80%|███████▉  | 30227/37963 [74:47:28<17:13:51,  8.02s/it]
 80%|███████▉  | 30228/37963 [74:47:36<17:03:10,  7.94s/it]
 80%|███████▉  | 30229/37963 [74:47:43<16:50:46,  7.84s/it]
 80%|███████▉  | 30230/37963 [74:47:58<21:20:42,  9.94s/it]
                                                           
{'loss': '0.1042', 'grad_norm': '2.161', 'learning_rate': '2.099e-06', 'epoch': '0.7963'}
+
 80%|███████▉  | 30230/37963 [74:47:58<21:20:42,  9.94s/it]
 80%|███████▉  | 30231/37963 [74:48:06<19:41:42,  9.17s/it]
 80%|███████▉  | 30232/37963 [74:48:14<18:51:48,  8.78s/it]
 80%|███████▉  | 30233/37963 [74:48:21<18:04:30,  8.42s/it]
 80%|███████▉  | 30234/37963 [74:48:29<17:36:58,  8.21s/it]
 80%|███████▉  | 30235/37963 [74:48:36<17:09:48,  8.00s/it]
 80%|███████▉  | 30236/37963 [74:48:44<17:00:14,  7.92s/it]
 80%|███████▉  | 30237/37963 [74:48:52<16:56:32,  7.89s/it]
 80%|███████▉  | 30238/37963 [74:49:00<16:48:24,  7.83s/it]
 80%|███████▉  | 30239/37963 [74:49:07<16:36:37,  7.74s/it]
 80%|███████▉  | 30240/37963 [74:49:15<16:26:39,  7.67s/it]
                                                           
{'loss': '0.102', 'grad_norm': '2.257', 'learning_rate': '2.094e-06', 'epoch': '0.7966'}
+
 80%|███████▉  | 30240/37963 [74:49:15<16:26:39,  7.67s/it]
 80%|███████▉  | 30241/37963 [74:49:22<16:32:24,  7.71s/it]
 80%|███████▉  | 30242/37963 [74:49:30<16:30:34,  7.70s/it]
 80%|███████▉  | 30243/37963 [74:49:38<16:26:08,  7.66s/it]
 80%|███████▉  | 30244/37963 [74:49:46<16:34:55,  7.73s/it]
 80%|███████▉  | 30245/37963 [74:50:00<20:51:55,  9.73s/it]
 80%|███████▉  | 30246/37963 [74:50:08<19:40:17,  9.18s/it]
 80%|███████▉  | 30247/37963 [74:50:15<18:41:41,  8.72s/it]
 80%|███████▉  | 30248/37963 [74:50:23<17:57:21,  8.38s/it]
 80%|███████▉  | 30249/37963 [74:50:31<17:25:01,  8.13s/it]
 80%|███████▉  | 30250/37963 [74:50:38<16:59:23,  7.93s/it]
                                                           
{'loss': '0.1125', 'grad_norm': '3.46', 'learning_rate': '2.089e-06', 'epoch': '0.7968'}
+
 80%|███████▉  | 30250/37963 [74:50:38<16:59:23,  7.93s/it]
 80%|███████▉  | 30251/37963 [74:50:53<21:30:39, 10.04s/it]
 80%|███████▉  | 30252/37963 [74:51:01<19:52:42,  9.28s/it]
 80%|███████▉  | 30253/37963 [74:51:08<18:52:06,  8.81s/it]
 80%|███████▉  | 30254/37963 [74:51:23<22:40:11, 10.59s/it]
 80%|███████▉  | 30255/37963 [74:51:31<20:52:13,  9.75s/it]
 80%|███████▉  | 30256/37963 [74:51:38<19:34:09,  9.14s/it]
 80%|███████▉  | 30257/37963 [74:51:46<18:38:17,  8.71s/it]
 80%|███████▉  | 30258/37963 [74:51:54<17:57:41,  8.39s/it]
 80%|███████▉  | 30259/37963 [74:52:01<17:28:56,  8.17s/it]
 80%|███████▉  | 30260/37963 [74:52:09<17:11:26,  8.03s/it]
                                                           
{'loss': '0.09968', 'grad_norm': '3.235', 'learning_rate': '2.083e-06', 'epoch': '0.7971'}
+
 80%|███████▉  | 30260/37963 [74:52:09<17:11:26,  8.03s/it]
 80%|███████▉  | 30261/37963 [74:52:17<16:59:23,  7.94s/it]
 80%|███████▉  | 30262/37963 [74:52:24<16:43:52,  7.82s/it]
 80%|███████▉  | 30263/37963 [74:52:32<16:30:32,  7.72s/it]
 80%|███████▉  | 30264/37963 [74:52:47<20:54:05,  9.77s/it]
 80%|███████▉  | 30265/37963 [74:53:01<24:05:13, 11.26s/it]
 80%|███████▉  | 30266/37963 [74:53:16<25:59:45, 12.16s/it]
 80%|███████▉  | 30267/37963 [74:53:23<23:07:11, 10.81s/it]
 80%|███████▉  | 30268/37963 [74:53:31<21:02:10,  9.84s/it]
 80%|███████▉  | 30269/37963 [74:53:38<19:32:02,  9.14s/it]
 80%|███████▉  | 30270/37963 [74:53:52<22:39:48, 10.61s/it]
                                                           
{'loss': '0.09354', 'grad_norm': '2.709', 'learning_rate': '2.078e-06', 'epoch': '0.7974'}
+
 80%|███████▉  | 30270/37963 [74:53:52<22:39:48, 10.61s/it]
 80%|███████▉  | 30271/37963 [74:54:00<20:45:08,  9.71s/it]
 80%|███████▉  | 30272/37963 [74:54:08<19:30:29,  9.13s/it]
 80%|███████▉  | 30273/37963 [74:54:15<18:31:21,  8.67s/it]
 80%|███████▉  | 30274/37963 [74:54:30<22:41:27, 10.62s/it]
 80%|███████▉  | 30275/37963 [74:54:38<20:58:01,  9.82s/it]
 80%|███████▉  | 30276/37963 [74:54:46<19:39:02,  9.20s/it]
 80%|███████▉  | 30277/37963 [74:54:54<18:35:05,  8.70s/it]
 80%|███████▉  | 30278/37963 [74:55:01<17:52:09,  8.37s/it]
 80%|███████▉  | 30279/37963 [74:55:09<17:24:50,  8.16s/it]
 80%|███████▉  | 30280/37963 [74:55:16<17:00:01,  7.97s/it]
                                                           
{'loss': '0.1002', 'grad_norm': '3.35', 'learning_rate': '2.073e-06', 'epoch': '0.7976'}
+
 80%|███████▉  | 30280/37963 [74:55:16<17:00:01,  7.97s/it]
 80%|███████▉  | 30281/37963 [74:55:24<16:36:27,  7.78s/it]
 80%|███████▉  | 30282/37963 [74:55:31<16:27:07,  7.71s/it]
 80%|███████▉  | 30283/37963 [74:55:39<16:24:16,  7.69s/it]
 80%|███████▉  | 30284/37963 [74:55:46<16:12:56,  7.60s/it]
 80%|███████▉  | 30285/37963 [74:55:54<16:11:11,  7.59s/it]
 80%|███████▉  | 30286/37963 [74:56:02<16:16:23,  7.63s/it]
 80%|███████▉  | 30287/37963 [74:56:09<16:08:58,  7.57s/it]
 80%|███████▉  | 30288/37963 [74:56:17<16:07:16,  7.56s/it]
 80%|███████▉  | 30289/37963 [74:56:24<16:12:37,  7.60s/it]
 80%|███████▉  | 30290/37963 [74:56:32<16:06:12,  7.56s/it]
                                                           
{'loss': '0.09327', 'grad_norm': '2.753', 'learning_rate': '2.068e-06', 'epoch': '0.7979'}
+
 80%|███████▉  | 30290/37963 [74:56:32<16:06:12,  7.56s/it]
 80%|███████▉  | 30291/37963 [74:56:40<16:12:11,  7.60s/it]
 80%|███████▉  | 30292/37963 [74:56:47<16:18:05,  7.65s/it]
 80%|███████▉  | 30293/37963 [74:57:01<20:26:49,  9.60s/it]
 80%|███████▉  | 30294/37963 [74:57:09<19:18:31,  9.06s/it]
 80%|███████▉  | 30295/37963 [74:57:17<18:32:40,  8.71s/it]
 80%|███████▉  | 30296/37963 [74:57:25<17:49:38,  8.37s/it]
 80%|███████▉  | 30297/37963 [74:57:32<17:22:39,  8.16s/it]
 80%|███████▉  | 30298/37963 [74:57:40<17:04:29,  8.02s/it]
 80%|███████▉  | 30299/37963 [74:57:55<21:22:51, 10.04s/it]
 80%|███████▉  | 30300/37963 [74:58:03<19:52:33,  9.34s/it]
                                                           
{'loss': '0.1048', 'grad_norm': '2.12', 'learning_rate': '2.062e-06', 'epoch': '0.7981'}
+
 80%|███████▉  | 30300/37963 [74:58:03<19:52:33,  9.34s/it]
 80%|███████▉  | 30301/37963 [74:58:17<22:52:28, 10.75s/it]
 80%|███████▉  | 30302/37963 [74:58:24<20:53:25,  9.82s/it]
 80%|███████▉  | 30303/37963 [74:58:32<19:31:54,  9.18s/it]
 80%|███████▉  | 30304/37963 [74:58:40<18:36:21,  8.75s/it]
 80%|███████▉  | 30305/37963 [74:58:47<17:58:40,  8.45s/it]
 80%|███████▉  | 30306/37963 [74:58:55<17:33:11,  8.25s/it]
 80%|███████▉  | 30307/37963 [74:59:03<17:16:34,  8.12s/it]
 80%|███████▉  | 30308/37963 [74:59:10<16:49:10,  7.91s/it]
 80%|███████▉  | 30309/37963 [74:59:18<16:47:56,  7.90s/it]
 80%|███████▉  | 30310/37963 [74:59:33<21:19:25, 10.03s/it]
                                                           
{'loss': '0.1038', 'grad_norm': '2.536', 'learning_rate': '2.057e-06', 'epoch': '0.7984'}
+
 80%|███████▉  | 30310/37963 [74:59:33<21:19:25, 10.03s/it]
 80%|███████▉  | 30311/37963 [74:59:41<19:51:39,  9.34s/it]
 80%|███████▉  | 30312/37963 [74:59:49<18:41:29,  8.79s/it]
 80%|███████▉  | 30313/37963 [74:59:56<18:00:29,  8.47s/it]
 80%|███████▉  | 30314/37963 [75:00:04<17:24:42,  8.19s/it]
 80%|███████▉  | 30315/37963 [75:00:18<21:02:35,  9.91s/it]
 80%|███████▉  | 30316/37963 [75:00:32<23:39:16, 11.14s/it]
 80%|███████▉  | 30317/37963 [75:00:40<21:33:57, 10.15s/it]
 80%|███████▉  | 30318/37963 [75:00:54<24:07:30, 11.36s/it]
 80%|███████▉  | 30319/37963 [75:01:01<21:41:06, 10.21s/it]
 80%|███████▉  | 30320/37963 [75:01:09<20:02:19,  9.44s/it]
                                                           
{'loss': '0.1005', 'grad_norm': '2.572', 'learning_rate': '2.052e-06', 'epoch': '0.7987'}
+
 80%|███████▉  | 30320/37963 [75:01:09<20:02:19,  9.44s/it]
 80%|███████▉  | 30321/37963 [75:01:17<18:57:51,  8.93s/it]
 80%|███████▉  | 30322/37963 [75:01:31<22:28:56, 10.59s/it]
 80%|███████▉  | 30323/37963 [75:01:39<20:35:08,  9.70s/it]
 80%|███████▉  | 30324/37963 [75:01:47<19:19:13,  9.11s/it]
 80%|███████▉  | 30325/37963 [75:01:54<18:23:10,  8.67s/it]
 80%|███████▉  | 30326/37963 [75:02:02<17:45:22,  8.37s/it]
 80%|███████▉  | 30327/37963 [75:02:10<17:19:00,  8.16s/it]
 80%|███████▉  | 30328/37963 [75:02:17<16:59:13,  8.01s/it]
 80%|███████▉  | 30329/37963 [75:02:25<16:49:37,  7.94s/it]
 80%|███████▉  | 30330/37963 [75:02:32<16:33:28,  7.81s/it]
                                                           
{'loss': '0.1064', 'grad_norm': '2.492', 'learning_rate': '2.047e-06', 'epoch': '0.7989'}
+
 80%|███████▉  | 30330/37963 [75:02:32<16:33:28,  7.81s/it]
 80%|███████▉  | 30331/37963 [75:02:40<16:26:43,  7.76s/it]
 80%|███████▉  | 30332/37963 [75:02:48<16:22:24,  7.72s/it]
 80%|███████▉  | 30333/37963 [75:02:55<16:06:19,  7.60s/it]
 80%|███████▉  | 30334/37963 [75:03:03<16:04:43,  7.59s/it]
 80%|███████▉  | 30335/37963 [75:03:10<16:11:45,  7.64s/it]
 80%|███████▉  | 30336/37963 [75:03:18<16:02:43,  7.57s/it]
 80%|███████▉  | 30337/37963 [75:03:25<16:02:04,  7.57s/it]
 80%|███████▉  | 30338/37963 [75:03:33<16:03:30,  7.58s/it]
 80%|███████▉  | 30339/37963 [75:03:41<16:10:59,  7.64s/it]
 80%|███████▉  | 30340/37963 [75:03:48<16:13:59,  7.67s/it]
                                                           
{'loss': '0.1169', 'grad_norm': '3.313', 'learning_rate': '2.042e-06', 'epoch': '0.7992'}
+
 80%|███████▉  | 30340/37963 [75:03:48<16:13:59,  7.67s/it]
 80%|███████▉  | 30341/37963 [75:03:56<16:10:50,  7.64s/it]
 80%|███████▉  | 30342/37963 [75:04:04<16:13:59,  7.67s/it]
 80%|███████▉  | 30343/37963 [75:04:11<16:14:48,  7.68s/it]
 80%|███████▉  | 30344/37963 [75:04:19<16:10:42,  7.64s/it]
 80%|███████▉  | 30345/37963 [75:04:27<16:09:40,  7.64s/it]
 80%|███████▉  | 30346/37963 [75:04:34<16:09:26,  7.64s/it]
 80%|███████▉  | 30347/37963 [75:04:55<24:34:11, 11.61s/it]
 80%|███████▉  | 30348/37963 [75:05:09<26:14:23, 12.40s/it]
 80%|███████▉  | 30349/37963 [75:05:17<23:08:31, 10.94s/it]
 80%|███████▉  | 30350/37963 [75:05:24<20:58:22,  9.92s/it]
                                                           
{'loss': '0.0938', 'grad_norm': '2.276', 'learning_rate': '2.037e-06', 'epoch': '0.7995'}
+
 80%|███████▉  | 30350/37963 [75:05:24<20:58:22,  9.92s/it]
 80%|███████▉  | 30351/37963 [75:05:32<19:30:53,  9.23s/it]
 80%|███████▉  | 30352/37963 [75:05:40<18:34:18,  8.78s/it]
 80%|███████▉  | 30353/37963 [75:05:47<17:48:58,  8.43s/it]
 80%|███████▉  | 30354/37963 [75:05:55<17:20:22,  8.20s/it]
 80%|███████▉  | 30355/37963 [75:06:03<17:01:32,  8.06s/it]
 80%|███████▉  | 30356/37963 [75:06:10<16:45:19,  7.93s/it]
 80%|███████▉  | 30357/37963 [75:06:26<21:30:13, 10.18s/it]
 80%|███████▉  | 30358/37963 [75:06:34<19:58:32,  9.46s/it]
 80%|███████▉  | 30359/37963 [75:06:41<18:53:06,  8.94s/it]
 80%|███████▉  | 30360/37963 [75:06:49<18:08:44,  8.59s/it]
                                                           
{'loss': '0.0977', 'grad_norm': '2.47', 'learning_rate': '2.031e-06', 'epoch': '0.7997'}
+
 80%|███████▉  | 30360/37963 [75:06:49<18:08:44,  8.59s/it]
 80%|███████▉  | 30361/37963 [75:06:57<17:26:38,  8.26s/it]
 80%|███████▉  | 30362/37963 [75:07:04<17:01:52,  8.07s/it]
 80%|███████▉  | 30363/37963 [75:07:18<20:54:19,  9.90s/it]
 80%|███████▉  | 30364/37963 [75:07:33<23:43:19, 11.24s/it]
 80%|███████▉  | 30365/37963 [75:07:47<25:34:25, 12.12s/it]
 80%|███████▉  | 30366/37963 [75:07:55<22:50:18, 10.82s/it]
 80%|███████▉  | 30367/37963 [75:08:02<20:48:00,  9.86s/it]
 80%|███████▉  | 30368/37963 [75:08:17<23:57:21, 11.35s/it]
 80%|███████▉  | 30369/37963 [75:08:25<21:38:40, 10.26s/it]
 80%|███████▉  | 30370/37963 [75:08:33<20:02:28,  9.50s/it]
                                                           
{'loss': '0.1109', 'grad_norm': '3.181', 'learning_rate': '2.026e-06', 'epoch': '0.8'}
+
 80%|███████▉  | 30370/37963 [75:08:33<20:02:28,  9.50s/it]
 80%|████████  | 30371/37963 [75:08:40<18:52:33,  8.95s/it]
 80%|████████  | 30372/37963 [75:08:48<18:04:24,  8.57s/it]
 80%|████████  | 30373/37963 [75:08:56<17:31:24,  8.31s/it]
 80%|████████  | 30374/37963 [75:09:04<17:13:11,  8.17s/it]
 80%|████████  | 30375/37963 [75:09:11<16:47:09,  7.96s/it]
 80%|████████  | 30376/37963 [75:09:19<16:34:52,  7.87s/it]
 80%|████████  | 30377/37963 [75:09:26<16:30:21,  7.83s/it]
 80%|████████  | 30378/37963 [75:09:34<16:15:47,  7.72s/it]
 80%|████████  | 30379/37963 [75:09:42<16:13:59,  7.71s/it]
 80%|████████  | 30380/37963 [75:09:49<16:12:20,  7.69s/it]
                                                           
{'loss': '0.1029', 'grad_norm': '2.753', 'learning_rate': '2.021e-06', 'epoch': '0.8003'}
+
 80%|████████  | 30380/37963 [75:09:49<16:12:20,  7.69s/it]
 80%|████████  | 30381/37963 [75:09:57<16:16:14,  7.73s/it]
 80%|████████  | 30382/37963 [75:10:05<16:10:38,  7.68s/it]
 80%|████████  | 30383/37963 [75:10:12<16:09:41,  7.68s/it]
 80%|████████  | 30384/37963 [75:10:20<16:12:10,  7.70s/it]
 80%|████████  | 30385/37963 [75:10:28<16:09:56,  7.68s/it]
 80%|████████  | 30386/37963 [75:10:35<16:07:48,  7.66s/it]
 80%|████████  | 30387/37963 [75:10:43<16:04:29,  7.64s/it]
 80%|████████  | 30388/37963 [75:10:51<16:11:05,  7.69s/it]
 80%|████████  | 30389/37963 [75:10:59<16:22:06,  7.78s/it]
 80%|████████  | 30390/37963 [75:11:06<16:15:52,  7.73s/it]
                                                           
{'loss': '0.09928', 'grad_norm': '2.224', 'learning_rate': '2.016e-06', 'epoch': '0.8005'}
+
 80%|████████  | 30390/37963 [75:11:06<16:15:52,  7.73s/it]
 80%|████████  | 30391/37963 [75:11:14<16:16:12,  7.74s/it]
 80%|████████  | 30392/37963 [75:11:29<20:43:05,  9.85s/it]
 80%|████████  | 30393/37963 [75:11:37<19:25:03,  9.23s/it]
 80%|████████  | 30394/37963 [75:11:44<18:16:29,  8.69s/it]
 80%|████████  | 30395/37963 [75:11:58<21:37:36, 10.29s/it]
 80%|████████  | 30396/37963 [75:12:13<24:16:47, 11.55s/it]
 80%|████████  | 30397/37963 [75:12:20<21:46:46, 10.36s/it]
 80%|████████  | 30398/37963 [75:12:28<20:08:14,  9.58s/it]
 80%|████████  | 30399/37963 [75:12:36<19:00:22,  9.05s/it]
 80%|████████  | 30400/37963 [75:12:43<18:10:44,  8.65s/it]
                                                           
{'loss': '0.1056', 'grad_norm': '2.631', 'learning_rate': '2.011e-06', 'epoch': '0.8008'}
+
 80%|████████  | 30400/37963 [75:12:43<18:10:44,  8.65s/it]
 80%|████████  | 30401/37963 [75:12:51<17:36:04,  8.38s/it]
 80%|████████  | 30402/37963 [75:12:59<17:14:38,  8.21s/it]
 80%|████████  | 30403/37963 [75:13:07<16:54:05,  8.05s/it]
 80%|████████  | 30404/37963 [75:13:14<16:41:47,  7.95s/it]
 80%|████████  | 30405/37963 [75:13:22<16:33:29,  7.89s/it]
 80%|████████  | 30406/37963 [75:13:30<16:24:02,  7.81s/it]
 80%|████████  | 30407/37963 [75:13:44<20:19:17,  9.68s/it]
 80%|████████  | 30408/37963 [75:13:59<23:33:08, 11.22s/it]
 80%|████████  | 30409/37963 [75:14:06<21:23:27, 10.19s/it]
 80%|████████  | 30410/37963 [75:14:14<19:49:31,  9.45s/it]
                                                           
{'loss': '0.1058', 'grad_norm': '2.476', 'learning_rate': '2.006e-06', 'epoch': '0.801'}
+
 80%|████████  | 30410/37963 [75:14:14<19:49:31,  9.45s/it]
 80%|████████  | 30411/37963 [75:14:22<18:43:23,  8.93s/it]
 80%|████████  | 30412/37963 [75:14:30<17:58:25,  8.57s/it]
 80%|████████  | 30413/37963 [75:14:44<21:33:38, 10.28s/it]
 80%|████████  | 30414/37963 [75:14:52<19:55:54,  9.51s/it]
 80%|████████  | 30415/37963 [75:14:59<18:50:27,  8.99s/it]
 80%|████████  | 30416/37963 [75:15:07<18:00:24,  8.59s/it]
 80%|████████  | 30417/37963 [75:15:22<21:55:07, 10.46s/it]
 80%|████████  | 30418/37963 [75:15:36<24:14:33, 11.57s/it]
 80%|████████  | 30419/37963 [75:15:44<21:41:55, 10.35s/it]
 80%|████████  | 30420/37963 [75:15:51<19:58:38,  9.53s/it]
                                                           
{'loss': '0.09489', 'grad_norm': '2.137', 'learning_rate': '2.001e-06', 'epoch': '0.8013'}
+
 80%|████████  | 30420/37963 [75:15:51<19:58:38,  9.53s/it]
 80%|████████  | 30421/37963 [75:15:59<18:56:08,  9.04s/it]
 80%|████████  | 30422/37963 [75:16:07<17:57:54,  8.58s/it]
 80%|████████  | 30423/37963 [75:16:14<17:24:04,  8.31s/it]
 80%|████████  | 30424/37963 [75:16:22<16:54:09,  8.07s/it]
 80%|████████  | 30425/37963 [75:16:29<16:33:29,  7.91s/it]
 80%|████████  | 30426/37963 [75:16:37<16:19:54,  7.80s/it]
 80%|████████  | 30427/37963 [75:16:44<16:15:38,  7.77s/it]
 80%|████████  | 30428/37963 [75:16:52<16:13:39,  7.75s/it]
 80%|████████  | 30429/37963 [75:17:00<16:03:41,  7.67s/it]
 80%|████████  | 30430/37963 [75:17:07<16:04:29,  7.68s/it]
                                                           
{'loss': '0.09239', 'grad_norm': '2.492', 'learning_rate': '1.996e-06', 'epoch': '0.8016'}
+
 80%|████████  | 30430/37963 [75:17:07<16:04:29,  7.68s/it]
 80%|████████  | 30431/37963 [75:17:15<16:05:55,  7.69s/it]
 80%|████████  | 30432/37963 [75:17:23<16:03:29,  7.68s/it]
 80%|████████  | 30433/37963 [75:17:31<16:08:20,  7.72s/it]
 80%|████████  | 30434/37963 [75:17:38<16:06:02,  7.70s/it]
 80%|████████  | 30435/37963 [75:17:46<16:02:11,  7.67s/it]
 80%|████████  | 30436/37963 [75:17:54<16:04:19,  7.69s/it]
 80%|████████  | 30437/37963 [75:18:01<16:03:50,  7.68s/it]
 80%|████████  | 30438/37963 [75:18:09<16:00:46,  7.66s/it]
 80%|████████  | 30439/37963 [75:18:23<20:16:00,  9.70s/it]
 80%|████████  | 30440/37963 [75:18:38<23:15:03, 11.13s/it]
                                                           
{'loss': '0.08815', 'grad_norm': '2.808', 'learning_rate': '1.99e-06', 'epoch': '0.8018'}
+
 80%|████████  | 30440/37963 [75:18:38<23:15:03, 11.13s/it]
 80%|████████  | 30441/37963 [75:18:45<21:03:42, 10.08s/it]
 80%|████████  | 30442/37963 [75:18:53<19:32:13,  9.35s/it]
 80%|████████  | 30443/37963 [75:19:01<18:32:51,  8.88s/it]
 80%|████████  | 30444/37963 [75:19:08<17:31:20,  8.39s/it]
 80%|████████  | 30445/37963 [75:19:23<21:27:26, 10.27s/it]
 80%|████████  | 30446/37963 [75:19:30<19:51:33,  9.51s/it]
 80%|████████  | 30447/37963 [75:19:38<18:42:55,  8.96s/it]
 80%|████████  | 30448/37963 [75:19:46<17:57:14,  8.60s/it]
 80%|████████  | 30449/37963 [75:19:54<17:31:37,  8.40s/it]
 80%|████████  | 30450/37963 [75:20:01<17:04:30,  8.18s/it]
                                                           
{'loss': '0.09458', 'grad_norm': '1.962', 'learning_rate': '1.985e-06', 'epoch': '0.8021'}
+
 80%|████████  | 30450/37963 [75:20:01<17:04:30,  8.18s/it]
 80%|████████  | 30451/37963 [75:20:09<16:29:15,  7.90s/it]
 80%|████████  | 30452/37963 [75:20:16<16:16:42,  7.80s/it]
 80%|████████  | 30453/37963 [75:20:24<16:18:33,  7.82s/it]
 80%|████████  | 30454/37963 [75:20:38<20:14:43,  9.71s/it]
 80%|████████  | 30455/37963 [75:20:46<19:00:57,  9.12s/it]
 80%|████████  | 30456/37963 [75:20:54<18:12:07,  8.73s/it]
 80%|████████  | 30457/37963 [75:21:02<17:33:53,  8.42s/it]
 80%|████████  | 30458/37963 [75:21:09<17:11:48,  8.25s/it]
 80%|████████  | 30459/37963 [75:21:24<21:06:28, 10.13s/it]
 80%|████████  | 30460/37963 [75:21:32<19:39:01,  9.43s/it]
                                                           
{'loss': '0.09827', 'grad_norm': '2.725', 'learning_rate': '1.98e-06', 'epoch': '0.8024'}
+
 80%|████████  | 30460/37963 [75:21:32<19:39:01,  9.43s/it]
 80%|████████  | 30461/37963 [75:21:46<22:34:59, 10.84s/it]
 80%|████████  | 30462/37963 [75:22:00<24:45:52, 11.89s/it]
 80%|████████  | 30463/37963 [75:22:14<26:15:41, 12.61s/it]
 80%|████████  | 30464/37963 [75:22:22<23:16:50, 11.18s/it]
 80%|████████  | 30465/37963 [75:22:30<21:06:01, 10.13s/it]
 80%|████████  | 30466/37963 [75:22:37<19:25:11,  9.33s/it]
 80%|████████  | 30467/37963 [75:22:45<18:27:42,  8.87s/it]
 80%|████████  | 30468/37963 [75:22:53<17:46:56,  8.54s/it]
 80%|████████  | 30469/37963 [75:23:01<17:14:58,  8.29s/it]
 80%|████████  | 30470/37963 [75:23:08<16:49:35,  8.08s/it]
                                                           
{'loss': '0.1121', 'grad_norm': '3.013', 'learning_rate': '1.975e-06', 'epoch': '0.8026'}
+
 80%|████████  | 30470/37963 [75:23:08<16:49:35,  8.08s/it]
 80%|████████  | 30471/37963 [75:23:16<16:32:53,  7.95s/it]
 80%|████████  | 30472/37963 [75:23:24<16:25:53,  7.90s/it]
 80%|████████  | 30473/37963 [75:23:32<16:29:18,  7.93s/it]
 80%|████████  | 30474/37963 [75:23:40<16:26:05,  7.90s/it]
 80%|████████  | 30475/37963 [75:23:47<16:20:04,  7.85s/it]
 80%|████████  | 30476/37963 [75:23:55<16:10:05,  7.77s/it]
 80%|████████  | 30477/37963 [75:24:03<16:05:02,  7.73s/it]
 80%|████████  | 30478/37963 [75:24:10<15:56:13,  7.67s/it]
 80%|████████  | 30479/37963 [75:24:18<15:55:42,  7.66s/it]
 80%|████████  | 30480/37963 [75:24:25<15:50:55,  7.62s/it]
                                                           
{'loss': '0.07936', 'grad_norm': '2.701', 'learning_rate': '1.97e-06', 'epoch': '0.8029'}
+
 80%|████████  | 30480/37963 [75:24:25<15:50:55,  7.62s/it]
 80%|████████  | 30481/37963 [75:24:33<15:53:38,  7.65s/it]
 80%|████████  | 30482/37963 [75:24:40<15:44:37,  7.58s/it]
 80%|████████  | 30483/37963 [75:24:54<19:42:32,  9.49s/it]
 80%|████████  | 30484/37963 [75:25:02<18:32:44,  8.93s/it]
 80%|████████  | 30485/37963 [75:25:10<17:43:23,  8.53s/it]
 80%|████████  | 30486/37963 [75:25:17<17:03:57,  8.22s/it]
 80%|████████  | 30487/37963 [75:25:24<16:34:30,  7.98s/it]
 80%|████████  | 30488/37963 [75:25:32<16:24:20,  7.90s/it]
 80%|████████  | 30489/37963 [75:25:47<20:55:09, 10.08s/it]
 80%|████████  | 30490/37963 [75:25:55<19:25:54,  9.36s/it]
                                                           
{'loss': '0.09823', 'grad_norm': '4.325', 'learning_rate': '1.965e-06', 'epoch': '0.8032'}
+
 80%|████████  | 30490/37963 [75:25:55<19:25:54,  9.36s/it]
 80%|████████  | 30491/37963 [75:26:03<18:18:01,  8.82s/it]
 80%|████████  | 30492/37963 [75:26:10<17:26:50,  8.41s/it]
 80%|████████  | 30493/37963 [75:26:25<21:16:00, 10.25s/it]
 80%|████████  | 30494/37963 [75:26:32<19:45:17,  9.52s/it]
 80%|████████  | 30495/37963 [75:26:40<18:39:03,  8.99s/it]
 80%|████████  | 30496/37963 [75:26:48<17:54:05,  8.63s/it]
 80%|████████  | 30497/37963 [75:26:56<17:20:39,  8.36s/it]
 80%|████████  | 30498/37963 [75:27:10<21:08:58, 10.20s/it]
 80%|████████  | 30499/37963 [75:27:18<19:37:01,  9.46s/it]
 80%|████████  | 30500/37963 [75:27:25<18:25:26,  8.89s/it]
                                                           
{'loss': '0.09237', 'grad_norm': '2.803', 'learning_rate': '1.96e-06', 'epoch': '0.8034'}
+
 80%|████████  | 30500/37963 [75:27:25<18:25:26,  8.89s/it]
 80%|████████  | 30501/37963 [75:27:33<17:33:13,  8.47s/it]
 80%|████████  | 30502/37963 [75:27:41<17:06:14,  8.25s/it]
 80%|████████  | 30503/37963 [75:27:48<16:41:55,  8.06s/it]
 80%|████████  | 30504/37963 [75:27:56<16:25:24,  7.93s/it]
 80%|████████  | 30505/37963 [75:28:04<16:17:09,  7.86s/it]
 80%|████████  | 30506/37963 [75:28:25<24:49:42, 11.99s/it]
 80%|████████  | 30507/37963 [75:28:33<22:06:30, 10.67s/it]
 80%|████████  | 30508/37963 [75:28:41<20:17:53,  9.80s/it]
 80%|████████  | 30509/37963 [75:28:48<18:59:58,  9.18s/it]
 80%|████████  | 30510/37963 [75:28:56<18:01:26,  8.71s/it]
                                                           
{'loss': '0.1082', 'grad_norm': '1.924', 'learning_rate': '1.955e-06', 'epoch': '0.8037'}
+
 80%|████████  | 30510/37963 [75:28:56<18:01:26,  8.71s/it]
 80%|████████  | 30511/37963 [75:29:04<17:21:15,  8.38s/it]
 80%|████████  | 30512/37963 [75:29:11<16:55:45,  8.18s/it]
 80%|████████  | 30513/37963 [75:29:19<16:36:11,  8.02s/it]
 80%|████████  | 30514/37963 [75:29:26<16:10:17,  7.82s/it]
 80%|████████  | 30515/37963 [75:29:48<24:44:19, 11.96s/it]
 80%|████████  | 30516/37963 [75:29:56<22:09:20, 10.71s/it]
 80%|████████  | 30517/37963 [75:30:03<20:05:59,  9.72s/it]
 80%|████████  | 30518/37963 [75:30:11<18:51:21,  9.12s/it]
 80%|████████  | 30519/37963 [75:30:18<17:58:36,  8.69s/it]
 80%|████████  | 30520/37963 [75:30:26<17:13:50,  8.33s/it]
                                                           
{'loss': '0.0923', 'grad_norm': '2.4', 'learning_rate': '1.95e-06', 'epoch': '0.8039'}
+
 80%|████████  | 30520/37963 [75:30:26<17:13:50,  8.33s/it]
 80%|████████  | 30521/37963 [75:30:34<16:48:05,  8.13s/it]
 80%|████████  | 30522/37963 [75:30:41<16:33:34,  8.01s/it]
 80%|████████  | 30523/37963 [75:30:49<16:24:14,  7.94s/it]
 80%|████████  | 30524/37963 [75:30:57<16:08:10,  7.81s/it]
 80%|████████  | 30525/37963 [75:31:04<16:03:35,  7.77s/it]
 80%|████████  | 30526/37963 [75:31:12<15:57:56,  7.73s/it]
 80%|████████  | 30527/37963 [75:31:27<20:13:47,  9.79s/it]
 80%|████████  | 30528/37963 [75:31:34<18:55:40,  9.16s/it]
 80%|████████  | 30529/37963 [75:31:42<18:00:49,  8.72s/it]
 80%|████████  | 30530/37963 [75:31:50<17:23:16,  8.42s/it]
                                                           
{'loss': '0.09459', 'grad_norm': '2.988', 'learning_rate': '1.945e-06', 'epoch': '0.8042'}
+
 80%|████████  | 30530/37963 [75:31:50<17:23:16,  8.42s/it]
 80%|████████  | 30531/37963 [75:31:57<16:57:02,  8.21s/it]
 80%|████████  | 30532/37963 [75:32:05<16:19:19,  7.91s/it]
 80%|████████  | 30533/37963 [75:32:12<16:03:45,  7.78s/it]
 80%|████████  | 30534/37963 [75:32:20<16:02:14,  7.77s/it]
 80%|████████  | 30535/37963 [75:32:27<15:51:16,  7.68s/it]
 80%|████████  | 30536/37963 [75:32:35<15:40:18,  7.60s/it]
 80%|████████  | 30537/37963 [75:32:49<20:06:42,  9.75s/it]
 80%|████████  | 30538/37963 [75:32:57<18:59:19,  9.21s/it]
 80%|████████  | 30539/37963 [75:33:12<22:05:57, 10.72s/it]
 80%|████████  | 30540/37963 [75:33:20<20:21:49,  9.88s/it]
                                                           
{'loss': '0.1024', 'grad_norm': '3.721', 'learning_rate': '1.94e-06', 'epoch': '0.8045'}
+
 80%|████████  | 30540/37963 [75:33:20<20:21:49,  9.88s/it]
 80%|████████  | 30541/37963 [75:33:27<18:53:27,  9.16s/it]
 80%|████████  | 30542/37963 [75:33:41<21:50:41, 10.60s/it]
 80%|████████  | 30543/37963 [75:33:49<20:00:42,  9.71s/it]
 80%|████████  | 30544/37963 [75:33:56<18:37:25,  9.04s/it]
 80%|████████  | 30545/37963 [75:34:04<17:45:52,  8.62s/it]
 80%|████████  | 30546/37963 [75:34:11<17:07:56,  8.32s/it]
 80%|████████  | 30547/37963 [75:34:19<16:45:46,  8.14s/it]
 80%|████████  | 30548/37963 [75:34:27<16:25:34,  7.97s/it]
 80%|████████  | 30549/37963 [75:34:34<16:15:02,  7.89s/it]
 80%|████████  | 30550/37963 [75:34:42<16:04:05,  7.80s/it]
                                                           
{'loss': '0.09325', 'grad_norm': '2.505', 'learning_rate': '1.935e-06', 'epoch': '0.8047'}
+
 80%|████████  | 30550/37963 [75:34:42<16:04:05,  7.80s/it]
 80%|████████  | 30551/37963 [75:34:50<16:07:14,  7.83s/it]
 80%|████████  | 30552/37963 [75:34:57<15:59:26,  7.77s/it]
 80%|████████  | 30553/37963 [75:35:12<20:01:52,  9.73s/it]
 80%|████████  | 30554/37963 [75:35:19<18:45:42,  9.12s/it]
 80%|████████  | 30555/37963 [75:35:27<17:45:26,  8.63s/it]
 80%|████████  | 30556/37963 [75:35:42<21:51:10, 10.62s/it]
 80%|████████  | 30557/37963 [75:35:50<20:07:19,  9.78s/it]
 80%|████████  | 30558/37963 [75:35:58<18:51:56,  9.17s/it]
 80%|████████  | 30559/37963 [75:36:06<17:59:32,  8.75s/it]
 80%|████████  | 30560/37963 [75:36:20<21:14:25, 10.33s/it]
                                                           
{'loss': '0.101', 'grad_norm': '2.686', 'learning_rate': '1.93e-06', 'epoch': '0.805'}
+
 80%|████████  | 30560/37963 [75:36:20<21:14:25, 10.33s/it]
 81%|████████  | 30561/37963 [75:36:27<19:33:04,  9.51s/it]
 81%|████████  | 30562/37963 [75:36:35<18:27:10,  8.98s/it]
 81%|████████  | 30563/37963 [75:36:43<17:43:59,  8.63s/it]
 81%|████████  | 30564/37963 [75:36:58<21:33:20, 10.49s/it]
 81%|████████  | 30565/37963 [75:37:05<19:48:58,  9.64s/it]
 81%|████████  | 30566/37963 [75:37:13<18:27:34,  8.98s/it]
 81%|████████  | 30567/37963 [75:37:20<17:34:37,  8.56s/it]
 81%|████████  | 30568/37963 [75:37:28<16:50:53,  8.20s/it]
 81%|████████  | 30569/37963 [75:37:35<16:17:51,  7.94s/it]
 81%|████████  | 30570/37963 [75:37:43<16:08:13,  7.86s/it]
                                                           
{'loss': '0.08058', 'grad_norm': '3.035', 'learning_rate': '1.924e-06', 'epoch': '0.8053'}
+
 81%|████████  | 30570/37963 [75:37:43<16:08:13,  7.86s/it]
 81%|████████  | 30571/37963 [75:37:50<16:00:14,  7.79s/it]
 81%|████████  | 30572/37963 [75:37:58<15:49:34,  7.71s/it]
 81%|████████  | 30573/37963 [75:38:05<15:42:35,  7.65s/it]
 81%|████████  | 30574/37963 [75:38:13<15:35:39,  7.60s/it]
 81%|████████  | 30575/37963 [75:38:20<15:41:07,  7.64s/it]
 81%|████████  | 30576/37963 [75:38:28<15:42:16,  7.65s/it]
 81%|████████  | 30577/37963 [75:38:42<19:36:52,  9.56s/it]
 81%|████████  | 30578/37963 [75:38:50<18:41:28,  9.11s/it]
 81%|████████  | 30579/37963 [75:38:58<17:46:36,  8.67s/it]
 81%|████████  | 30580/37963 [75:39:06<17:08:44,  8.36s/it]
                                                           
{'loss': '0.09107', 'grad_norm': '1.957', 'learning_rate': '1.919e-06', 'epoch': '0.8055'}
+
 81%|████████  | 30580/37963 [75:39:06<17:08:44,  8.36s/it]
 81%|████████  | 30581/37963 [75:39:20<21:07:49, 10.30s/it]
 81%|████████  | 30582/37963 [75:39:28<19:29:35,  9.51s/it]
 81%|████████  | 30583/37963 [75:39:36<18:18:25,  8.93s/it]
 81%|████████  | 30584/37963 [75:39:43<17:36:51,  8.59s/it]
 81%|████████  | 30585/37963 [75:39:57<20:49:55, 10.16s/it]
 81%|████████  | 30586/37963 [75:40:05<19:18:48,  9.43s/it]
 81%|████████  | 30587/37963 [75:40:19<22:17:25, 10.88s/it]
 81%|████████  | 30588/37963 [75:40:27<20:09:53,  9.84s/it]
 81%|████████  | 30589/37963 [75:40:34<18:48:47,  9.18s/it]
 81%|████████  | 30590/37963 [75:40:42<17:51:40,  8.72s/it]
                                                           
{'loss': '0.1037', 'grad_norm': '2.468', 'learning_rate': '1.914e-06', 'epoch': '0.8058'}
+
 81%|████████  | 30590/37963 [75:40:42<17:51:40,  8.72s/it]
 81%|████████  | 30591/37963 [75:40:50<17:15:03,  8.42s/it]
 81%|████████  | 30592/37963 [75:40:57<16:49:17,  8.22s/it]
 81%|████████  | 30593/37963 [75:41:05<16:34:34,  8.10s/it]
 81%|████████  | 30594/37963 [75:41:13<16:17:01,  7.96s/it]
 81%|████████  | 30595/37963 [75:41:21<16:07:19,  7.88s/it]
 81%|████████  | 30596/37963 [75:41:28<16:01:49,  7.83s/it]
 81%|████████  | 30597/37963 [75:41:36<15:56:57,  7.79s/it]
 81%|████████  | 30598/37963 [75:41:43<15:46:06,  7.71s/it]
 81%|████████  | 30599/37963 [75:41:51<15:38:00,  7.64s/it]
 81%|████████  | 30600/37963 [75:41:59<15:40:45,  7.67s/it]
                                                           
{'loss': '0.09153', 'grad_norm': '2.387', 'learning_rate': '1.909e-06', 'epoch': '0.8061'}
+
 81%|████████  | 30600/37963 [75:41:59<15:40:45,  7.67s/it]
 81%|████████  | 30601/37963 [75:42:20<24:06:37, 11.79s/it]
 81%|████████  | 30602/37963 [75:42:28<21:36:11, 10.57s/it]
 81%|████████  | 30603/37963 [75:42:42<23:44:46, 11.61s/it]
 81%|████████  | 30604/37963 [75:42:49<21:12:45, 10.38s/it]
 81%|████████  | 30605/37963 [75:42:57<19:36:31,  9.59s/it]
 81%|████████  | 30606/37963 [75:43:05<18:25:37,  9.02s/it]
 81%|████████  | 30607/37963 [75:43:12<17:34:59,  8.61s/it]
 81%|████████  | 30608/37963 [75:43:20<17:01:11,  8.33s/it]
 81%|████████  | 30609/37963 [75:43:28<16:38:55,  8.15s/it]
 81%|████████  | 30610/37963 [75:43:43<20:42:49, 10.14s/it]
                                                           
{'loss': '0.09043', 'grad_norm': '2.455', 'learning_rate': '1.904e-06', 'epoch': '0.8063'}
+
 81%|████████  | 30610/37963 [75:43:43<20:42:49, 10.14s/it]
 81%|████████  | 30611/37963 [75:43:50<19:12:42,  9.41s/it]
 81%|████████  | 30612/37963 [75:43:58<18:05:18,  8.86s/it]
 81%|████████  | 30613/37963 [75:44:06<17:21:51,  8.50s/it]
 81%|████████  | 30614/37963 [75:44:13<16:46:22,  8.22s/it]
 81%|████████  | 30615/37963 [75:44:21<16:31:25,  8.10s/it]
 81%|████████  | 30616/37963 [75:44:29<16:12:30,  7.94s/it]
 81%|████████  | 30617/37963 [75:44:36<16:01:55,  7.86s/it]
 81%|████████  | 30618/37963 [75:44:44<15:43:44,  7.71s/it]
 81%|████████  | 30619/37963 [75:44:51<15:43:25,  7.71s/it]
 81%|████████  | 30620/37963 [75:44:59<15:42:42,  7.70s/it]
                                                           
{'loss': '0.1012', 'grad_norm': '2.74', 'learning_rate': '1.899e-06', 'epoch': '0.8066'}
+
 81%|████████  | 30620/37963 [75:44:59<15:42:42,  7.70s/it]
 81%|████████  | 30621/37963 [75:45:06<15:33:15,  7.63s/it]
 81%|████████  | 30622/37963 [75:45:14<15:32:18,  7.62s/it]
 81%|████████  | 30623/37963 [75:45:29<19:53:09,  9.75s/it]
 81%|████████  | 30624/37963 [75:45:37<18:43:16,  9.18s/it]
 81%|████████  | 30625/37963 [75:45:44<17:47:38,  8.73s/it]
 81%|████████  | 30626/37963 [75:45:52<17:11:54,  8.44s/it]
 81%|████████  | 30627/37963 [75:46:00<16:40:18,  8.18s/it]
 81%|████████  | 30628/37963 [75:46:07<16:24:07,  8.05s/it]
 81%|████████  | 30629/37963 [75:46:22<20:33:01, 10.09s/it]
 81%|████████  | 30630/37963 [75:46:30<19:01:57,  9.34s/it]
                                                           
{'loss': '0.1036', 'grad_norm': '2.342', 'learning_rate': '1.894e-06', 'epoch': '0.8068'}
+
 81%|████████  | 30630/37963 [75:46:30<19:01:57,  9.34s/it]
 81%|████████  | 30631/37963 [75:46:37<18:01:28,  8.85s/it]
 81%|████████  | 30632/37963 [75:46:45<17:06:52,  8.40s/it]
 81%|████████  | 30633/37963 [75:46:59<20:36:55, 10.12s/it]
 81%|████████  | 30634/37963 [75:47:13<23:00:58, 11.31s/it]
 81%|████████  | 30635/37963 [75:47:21<20:52:41, 10.26s/it]
 81%|████████  | 30636/37963 [75:47:29<19:20:01,  9.50s/it]
 81%|████████  | 30637/37963 [75:47:36<18:14:31,  8.96s/it]
 81%|████████  | 30638/37963 [75:47:44<17:31:56,  8.62s/it]
 81%|████████  | 30639/37963 [75:47:52<17:02:26,  8.38s/it]
 81%|████████  | 30640/37963 [75:48:00<16:35:35,  8.16s/it]
                                                           
{'loss': '0.09899', 'grad_norm': '2.622', 'learning_rate': '1.889e-06', 'epoch': '0.8071'}
+
 81%|████████  | 30640/37963 [75:48:00<16:35:35,  8.16s/it]
 81%|████████  | 30641/37963 [75:48:07<16:19:55,  8.03s/it]
 81%|████████  | 30642/37963 [75:48:15<16:10:43,  7.96s/it]
 81%|████████  | 30643/37963 [75:48:23<16:01:50,  7.88s/it]
 81%|████████  | 30644/37963 [75:48:30<15:47:08,  7.76s/it]
 81%|████████  | 30645/37963 [75:48:45<19:52:05,  9.77s/it]
 81%|████████  | 30646/37963 [75:48:53<18:45:14,  9.23s/it]
 81%|████████  | 30647/37963 [75:49:00<17:46:03,  8.74s/it]
 81%|████████  | 30648/37963 [75:49:08<17:14:40,  8.49s/it]
 81%|████████  | 30649/37963 [75:49:16<16:48:40,  8.27s/it]
 81%|████████  | 30650/37963 [75:49:30<20:33:50, 10.12s/it]
                                                           
{'loss': '0.1072', 'grad_norm': '3.068', 'learning_rate': '1.884e-06', 'epoch': '0.8074'}
+
 81%|████████  | 30650/37963 [75:49:30<20:33:50, 10.12s/it]
 81%|████████  | 30651/37963 [75:49:38<19:03:11,  9.38s/it]
 81%|████████  | 30652/37963 [75:49:53<22:34:15, 11.11s/it]
 81%|████████  | 30653/37963 [75:50:01<20:29:11, 10.09s/it]
 81%|████████  | 30654/37963 [75:50:09<18:58:45,  9.35s/it]
 81%|████████  | 30655/37963 [75:50:16<17:57:29,  8.85s/it]
 81%|████████  | 30656/37963 [75:50:31<21:25:25, 10.56s/it]
 81%|████████  | 30657/37963 [75:50:39<19:43:18,  9.72s/it]
 81%|████████  | 30658/37963 [75:50:46<18:16:42,  9.01s/it]
 81%|████████  | 30659/37963 [75:50:53<17:13:41,  8.49s/it]
 81%|████████  | 30660/37963 [75:51:01<16:46:45,  8.27s/it]
                                                           
{'loss': '0.1043', 'grad_norm': '2.764', 'learning_rate': '1.879e-06', 'epoch': '0.8076'}
+
 81%|████████  | 30660/37963 [75:51:01<16:46:45,  8.27s/it]
 81%|████████  | 30661/37963 [75:51:09<16:28:15,  8.12s/it]
 81%|████████  | 30662/37963 [75:51:16<16:14:18,  8.01s/it]
 81%|████████  | 30663/37963 [75:51:24<15:55:52,  7.86s/it]
 81%|████████  | 30664/37963 [75:51:32<15:49:37,  7.81s/it]
 81%|████████  | 30665/37963 [75:51:39<15:46:13,  7.78s/it]
 81%|████████  | 30666/37963 [75:51:47<15:46:00,  7.78s/it]
 81%|████████  | 30667/37963 [75:51:55<15:40:37,  7.74s/it]
 81%|████████  | 30668/37963 [75:52:02<15:40:09,  7.73s/it]
 81%|████████  | 30669/37963 [75:52:10<15:38:45,  7.72s/it]
 81%|████████  | 30670/37963 [75:52:18<15:29:28,  7.65s/it]
                                                           
{'loss': '0.1064', 'grad_norm': '1.928', 'learning_rate': '1.874e-06', 'epoch': '0.8079'}
+
 81%|████████  | 30670/37963 [75:52:18<15:29:28,  7.65s/it]
 81%|████████  | 30671/37963 [75:52:25<15:30:13,  7.65s/it]
 81%|████████  | 30672/37963 [75:52:33<15:30:35,  7.66s/it]
 81%|████████  | 30673/37963 [75:52:41<15:32:36,  7.68s/it]
 81%|████████  | 30674/37963 [75:52:49<15:40:53,  7.75s/it]
 81%|████████  | 30675/37963 [75:52:56<15:27:30,  7.64s/it]
 81%|████████  | 30676/37963 [75:53:10<19:14:39,  9.51s/it]
 81%|████████  | 30677/37963 [75:53:18<18:11:16,  8.99s/it]
 81%|████████  | 30678/37963 [75:53:25<17:19:15,  8.56s/it]
 81%|████████  | 30679/37963 [75:53:40<21:03:08, 10.40s/it]
 81%|████████  | 30680/37963 [75:53:48<19:23:46,  9.59s/it]
                                                           
{'loss': '0.08916', 'grad_norm': '4.072', 'learning_rate': '1.87e-06', 'epoch': '0.8082'}
+
 81%|████████  | 30680/37963 [75:53:48<19:23:46,  9.59s/it]
 81%|████████  | 30681/37963 [75:53:55<18:12:11,  9.00s/it]
 81%|████████  | 30682/37963 [75:54:10<21:26:54, 10.60s/it]
 81%|████████  | 30683/37963 [75:54:17<19:39:06,  9.72s/it]
 81%|████████  | 30684/37963 [75:54:25<18:15:53,  9.03s/it]
 81%|████████  | 30685/37963 [75:54:32<17:26:16,  8.63s/it]
 81%|████████  | 30686/37963 [75:54:40<16:48:47,  8.32s/it]
 81%|████████  | 30687/37963 [75:54:54<20:24:41, 10.10s/it]
 81%|████████  | 30688/37963 [75:55:02<19:04:41,  9.44s/it]
 81%|████████  | 30689/37963 [75:55:10<18:04:58,  8.95s/it]
 81%|████████  | 30690/37963 [75:55:17<17:13:54,  8.53s/it]
                                                           
{'loss': '0.08933', 'grad_norm': '2.246', 'learning_rate': '1.865e-06', 'epoch': '0.8084'}
+
 81%|████████  | 30690/37963 [75:55:17<17:13:54,  8.53s/it]
 81%|████████  | 30691/37963 [75:55:25<16:45:41,  8.30s/it]
 81%|████████  | 30692/37963 [75:55:33<16:25:11,  8.13s/it]
 81%|████████  | 30693/37963 [75:55:41<16:10:19,  8.01s/it]
 81%|████████  | 30694/37963 [75:55:48<15:58:54,  7.92s/it]
 81%|████████  | 30695/37963 [75:55:56<15:44:51,  7.80s/it]
 81%|████████  | 30696/37963 [75:56:11<20:00:11,  9.91s/it]
 81%|████████  | 30697/37963 [75:56:25<22:38:42, 11.22s/it]
 81%|████████  | 30698/37963 [75:56:33<20:31:10, 10.17s/it]
 81%|████████  | 30699/37963 [75:56:40<19:01:23,  9.43s/it]
 81%|████████  | 30700/37963 [75:56:48<17:51:36,  8.85s/it]
                                                           
{'loss': '0.1016', 'grad_norm': '3.95', 'learning_rate': '1.86e-06', 'epoch': '0.8087'}
+
 81%|████████  | 30700/37963 [75:56:48<17:51:36,  8.85s/it]
 81%|████████  | 30701/37963 [75:56:55<16:59:07,  8.42s/it]
 81%|████████  | 30702/37963 [75:57:10<20:28:55, 10.15s/it]
 81%|████████  | 30703/37963 [75:57:17<19:02:59,  9.45s/it]
 81%|████████  | 30704/37963 [75:57:25<18:04:13,  8.96s/it]
 81%|████████  | 30705/37963 [75:57:33<17:15:10,  8.56s/it]
 81%|████████  | 30706/37963 [75:57:40<16:32:41,  8.21s/it]
 81%|████████  | 30707/37963 [75:57:47<15:55:18,  7.90s/it]
 81%|████████  | 30708/37963 [75:58:02<20:08:37, 10.00s/it]
 81%|████████  | 30709/37963 [75:58:10<18:33:01,  9.21s/it]
 81%|████████  | 30710/37963 [75:58:17<17:25:15,  8.65s/it]
                                                           
{'loss': '0.09995', 'grad_norm': '2.687', 'learning_rate': '1.855e-06', 'epoch': '0.8089'}
+
 81%|████████  | 30710/37963 [75:58:17<17:25:15,  8.65s/it]
 81%|████████  | 30711/37963 [75:58:25<16:46:41,  8.33s/it]
 81%|████████  | 30712/37963 [75:58:32<16:20:53,  8.12s/it]
 81%|████████  | 30713/37963 [75:58:39<15:53:02,  7.89s/it]
 81%|████████  | 30714/37963 [75:58:47<15:46:30,  7.83s/it]
 81%|████████  | 30715/37963 [75:58:55<15:35:04,  7.74s/it]
 81%|████████  | 30716/37963 [75:59:02<15:22:13,  7.64s/it]
 81%|████████  | 30717/37963 [75:59:10<15:19:08,  7.61s/it]
 81%|████████  | 30718/37963 [75:59:17<15:22:39,  7.64s/it]
 81%|████████  | 30719/37963 [75:59:25<15:26:23,  7.67s/it]
 81%|████████  | 30720/37963 [75:59:33<15:23:55,  7.65s/it]
                                                           
{'loss': '0.09777', 'grad_norm': '2.958', 'learning_rate': '1.85e-06', 'epoch': '0.8092'}
+
 81%|████████  | 30720/37963 [75:59:33<15:23:55,  7.65s/it]
 81%|████████  | 30721/37963 [75:59:40<15:24:28,  7.66s/it]
 81%|████████  | 30722/37963 [75:59:48<15:30:23,  7.71s/it]
 81%|████████  | 30723/37963 [75:59:56<15:27:33,  7.69s/it]
 81%|████████  | 30724/37963 [76:00:04<15:27:47,  7.69s/it]
 81%|████████  | 30725/37963 [76:00:11<15:33:46,  7.74s/it]
 81%|████████  | 30726/37963 [76:00:19<15:35:40,  7.76s/it]
 81%|████████  | 30727/37963 [76:00:34<19:45:20,  9.83s/it]
 81%|████████  | 30728/37963 [76:00:48<22:25:15, 11.16s/it]
 81%|████████  | 30729/37963 [76:01:03<24:28:17, 12.18s/it]
 81%|████████  | 30730/37963 [76:01:10<21:42:47, 10.81s/it]
                                                           
{'loss': '0.1059', 'grad_norm': '3.39', 'learning_rate': '1.845e-06', 'epoch': '0.8095'}
+
 81%|████████  | 30730/37963 [76:01:10<21:42:47, 10.81s/it]
 81%|████████  | 30731/37963 [76:01:18<19:51:05,  9.88s/it]
 81%|████████  | 30732/37963 [76:01:26<18:30:08,  9.21s/it]
 81%|████████  | 30733/37963 [76:01:33<17:34:43,  8.75s/it]
 81%|████████  | 30734/37963 [76:01:41<16:42:10,  8.32s/it]
 81%|████████  | 30735/37963 [76:01:55<20:20:19, 10.13s/it]
 81%|████████  | 30736/37963 [76:02:03<18:54:34,  9.42s/it]
 81%|████████  | 30737/37963 [76:02:10<17:46:57,  8.86s/it]
 81%|████████  | 30738/37963 [76:02:18<17:06:21,  8.52s/it]
 81%|████████  | 30739/37963 [76:02:26<16:32:08,  8.24s/it]
 81%|████████  | 30740/37963 [76:02:33<16:09:53,  8.06s/it]
                                                           
{'loss': '0.09324', 'grad_norm': '2.627', 'learning_rate': '1.84e-06', 'epoch': '0.8097'}
+
 81%|████████  | 30740/37963 [76:02:33<16:09:53,  8.06s/it]
 81%|████████  | 30741/37963 [76:02:41<15:56:05,  7.94s/it]
 81%|████████  | 30742/37963 [76:02:49<15:43:47,  7.84s/it]
 81%|████████  | 30743/37963 [76:02:56<15:33:54,  7.76s/it]
 81%|████████  | 30744/37963 [76:03:04<15:20:52,  7.65s/it]
 81%|████████  | 30745/37963 [76:03:11<15:21:58,  7.66s/it]
 81%|████████  | 30746/37963 [76:03:19<15:23:30,  7.68s/it]
 81%|████████  | 30747/37963 [76:03:33<19:29:33,  9.72s/it]
 81%|████████  | 30748/37963 [76:03:41<18:16:39,  9.12s/it]
 81%|████████  | 30749/37963 [76:03:55<21:22:31, 10.67s/it]
 81%|████████  | 30750/37963 [76:04:10<23:51:17, 11.91s/it]
                                                           
{'loss': '0.1097', 'grad_norm': '2.015', 'learning_rate': '1.835e-06', 'epoch': '0.81'}
+
 81%|████████  | 30750/37963 [76:04:10<23:51:17, 11.91s/it]
 81%|████████  | 30751/37963 [76:04:18<21:19:44, 10.65s/it]
 81%|████████  | 30752/37963 [76:04:25<19:18:17,  9.64s/it]
 81%|████████  | 30753/37963 [76:04:33<18:06:21,  9.04s/it]
 81%|████████  | 30754/37963 [76:04:40<17:13:42,  8.60s/it]
 81%|████████  | 30755/37963 [76:04:48<16:41:55,  8.34s/it]
 81%|████████  | 30756/37963 [76:04:56<16:21:52,  8.17s/it]
 81%|████████  | 30757/37963 [76:05:11<20:18:47, 10.15s/it]
 81%|████████  | 30758/37963 [76:05:18<18:49:07,  9.40s/it]
 81%|████████  | 30759/37963 [76:05:26<17:47:01,  8.89s/it]
 81%|████████  | 30760/37963 [76:05:34<17:14:05,  8.61s/it]
                                                           
{'loss': '0.09075', 'grad_norm': '2.04', 'learning_rate': '1.83e-06', 'epoch': '0.8103'}
+
 81%|████████  | 30760/37963 [76:05:34<17:14:05,  8.61s/it]
 81%|████████  | 30761/37963 [76:05:42<16:39:17,  8.33s/it]
 81%|████████  | 30762/37963 [76:05:49<16:16:47,  8.14s/it]
 81%|████████  | 30763/37963 [76:05:57<16:01:41,  8.01s/it]
 81%|████████  | 30764/37963 [76:06:05<15:48:35,  7.91s/it]
 81%|████████  | 30765/37963 [76:06:12<15:37:42,  7.82s/it]
 81%|████████  | 30766/37963 [76:06:20<15:33:34,  7.78s/it]
 81%|████████  | 30767/37963 [76:06:28<15:28:44,  7.74s/it]
 81%|████████  | 30768/37963 [76:06:36<15:30:54,  7.76s/it]
 81%|████████  | 30769/37963 [76:06:43<15:28:04,  7.74s/it]
 81%|████████  | 30770/37963 [76:06:51<15:26:54,  7.73s/it]
                                                           
{'loss': '0.1014', 'grad_norm': '2.419', 'learning_rate': '1.825e-06', 'epoch': '0.8105'}
+
 81%|████████  | 30770/37963 [76:06:51<15:26:54,  7.73s/it]
 81%|████████  | 30771/37963 [76:06:59<15:22:18,  7.69s/it]
 81%|████████  | 30772/37963 [76:07:20<23:34:14, 11.80s/it]
 81%|████████  | 30773/37963 [76:07:28<21:07:25, 10.58s/it]
 81%|████████  | 30774/37963 [76:07:36<19:31:39,  9.78s/it]
 81%|████████  | 30775/37963 [76:07:43<18:21:23,  9.19s/it]
 81%|████████  | 30776/37963 [76:07:51<17:27:18,  8.74s/it]
 81%|████████  | 30777/37963 [76:08:06<20:54:58, 10.48s/it]
 81%|████████  | 30778/37963 [76:08:13<19:17:16,  9.66s/it]
 81%|████████  | 30779/37963 [76:08:28<22:07:35, 11.09s/it]
 81%|████████  | 30780/37963 [76:08:35<20:04:42, 10.06s/it]
                                                           
{'loss': '0.1026', 'grad_norm': '2.58', 'learning_rate': '1.82e-06', 'epoch': '0.8108'}
+
 81%|████████  | 30780/37963 [76:08:35<20:04:42, 10.06s/it]
 81%|████████  | 30781/37963 [76:08:43<18:37:55,  9.34s/it]
 81%|████████  | 30782/37963 [76:08:51<17:42:43,  8.88s/it]
 81%|████████  | 30783/37963 [76:08:59<17:02:28,  8.54s/it]
 81%|████████  | 30784/37963 [76:09:06<16:26:48,  8.25s/it]
 81%|████████  | 30785/37963 [76:09:14<16:04:25,  8.06s/it]
 81%|████████  | 30786/37963 [76:09:22<15:53:50,  7.97s/it]
 81%|████████  | 30787/37963 [76:09:29<15:44:04,  7.89s/it]
 81%|████████  | 30788/37963 [76:09:37<15:30:07,  7.78s/it]
 81%|████████  | 30789/37963 [76:09:45<15:26:45,  7.75s/it]
 81%|████████  | 30790/37963 [76:09:59<19:16:45,  9.68s/it]
                                                           
{'loss': '0.1117', 'grad_norm': '2.558', 'learning_rate': '1.815e-06', 'epoch': '0.8111'}
+
 81%|████████  | 30790/37963 [76:09:59<19:16:45,  9.68s/it]
 81%|████████  | 30791/37963 [76:10:06<18:03:52,  9.07s/it]
 81%|████████  | 30792/37963 [76:10:14<17:04:28,  8.57s/it]
 81%|████████  | 30793/37963 [76:10:21<16:32:17,  8.30s/it]
 81%|████████  | 30794/37963 [76:10:29<16:12:55,  8.14s/it]
 81%|████████  | 30795/37963 [76:10:37<15:42:09,  7.89s/it]
 81%|████████  | 30796/37963 [76:10:44<15:35:43,  7.83s/it]
 81%|████████  | 30797/37963 [76:10:52<15:33:13,  7.81s/it]
 81%|████████  | 30798/37963 [76:11:07<19:49:59,  9.96s/it]
 81%|████████  | 30799/37963 [76:11:15<18:31:16,  9.31s/it]
 81%|████████  | 30800/37963 [76:11:22<17:33:14,  8.82s/it]
                                                           
{'loss': '0.1003', 'grad_norm': '2.714', 'learning_rate': '1.81e-06', 'epoch': '0.8113'}
+
 81%|████████  | 30800/37963 [76:11:22<17:33:14,  8.82s/it]
 81%|████████  | 30801/37963 [76:11:30<16:46:32,  8.43s/it]
 81%|████████  | 30802/37963 [76:11:37<16:14:33,  8.17s/it]
 81%|████████  | 30803/37963 [76:11:45<15:55:14,  8.00s/it]
 81%|████████  | 30804/37963 [76:11:53<15:45:08,  7.92s/it]
 81%|████████  | 30805/37963 [76:12:01<15:36:53,  7.85s/it]
 81%|████████  | 30806/37963 [76:12:15<19:22:23,  9.74s/it]
 81%|████████  | 30807/37963 [76:12:22<18:10:05,  9.14s/it]
 81%|████████  | 30808/37963 [76:12:30<17:14:13,  8.67s/it]
 81%|████████  | 30809/37963 [76:12:37<16:26:14,  8.27s/it]
 81%|████████  | 30810/37963 [76:12:45<16:04:08,  8.09s/it]
                                                           
{'loss': '0.09292', 'grad_norm': '2.577', 'learning_rate': '1.805e-06', 'epoch': '0.8116'}
+
 81%|████████  | 30810/37963 [76:12:45<16:04:08,  8.09s/it]
 81%|████████  | 30811/37963 [76:12:53<15:52:12,  7.99s/it]
 81%|████████  | 30812/37963 [76:13:00<15:40:46,  7.89s/it]
 81%|████████  | 30813/37963 [76:13:08<15:32:49,  7.83s/it]
 81%|████████  | 30814/37963 [76:13:16<15:31:07,  7.81s/it]
 81%|████████  | 30815/37963 [76:13:24<15:25:51,  7.77s/it]
 81%|████████  | 30816/37963 [76:13:31<15:17:21,  7.70s/it]
 81%|████████  | 30817/37963 [76:13:39<15:16:01,  7.69s/it]
 81%|████████  | 30818/37963 [76:13:47<15:23:48,  7.76s/it]
 81%|████████  | 30819/37963 [76:13:54<15:24:16,  7.76s/it]
 81%|████████  | 30820/37963 [76:14:02<15:20:51,  7.74s/it]
                                                           
{'loss': '0.1023', 'grad_norm': '2.434', 'learning_rate': '1.801e-06', 'epoch': '0.8118'}
+
 81%|████████  | 30820/37963 [76:14:02<15:20:51,  7.74s/it]
 81%|████████  | 30821/37963 [76:14:17<19:26:49,  9.80s/it]
 81%|████████  | 30822/37963 [76:14:25<18:14:32,  9.20s/it]
 81%|████████  | 30823/37963 [76:14:32<17:19:29,  8.74s/it]
 81%|████████  | 30824/37963 [76:14:47<20:51:30, 10.52s/it]
 81%|████████  | 30825/37963 [76:14:55<19:15:37,  9.71s/it]
 81%|████████  | 30826/37963 [76:15:02<18:05:44,  9.13s/it]
 81%|████████  | 30827/37963 [76:15:17<21:00:57, 10.60s/it]
 81%|████████  | 30828/37963 [76:15:24<19:23:48,  9.79s/it]
 81%|████████  | 30829/37963 [76:15:32<18:10:36,  9.17s/it]
 81%|████████  | 30830/37963 [76:15:40<17:17:14,  8.72s/it]
                                                           
{'loss': '0.08606', 'grad_norm': '1.887', 'learning_rate': '1.796e-06', 'epoch': '0.8121'}
+
 81%|████████  | 30830/37963 [76:15:40<17:17:14,  8.72s/it]
 81%|████████  | 30831/37963 [76:15:48<16:42:53,  8.44s/it]
 81%|████████  | 30832/37963 [76:15:55<16:14:15,  8.20s/it]
 81%|████████  | 30833/37963 [76:16:03<15:57:31,  8.06s/it]
 81%|████████  | 30834/37963 [76:16:11<15:45:16,  7.96s/it]
 81%|████████  | 30835/37963 [76:16:18<15:38:29,  7.90s/it]
 81%|████████  | 30836/37963 [76:16:26<15:23:16,  7.77s/it]
 81%|████████  | 30837/37963 [76:16:34<15:20:03,  7.75s/it]
 81%|████████  | 30838/37963 [76:16:41<15:17:53,  7.73s/it]
 81%|████████  | 30839/37963 [76:16:49<15:13:23,  7.69s/it]
 81%|████████  | 30840/37963 [76:16:57<15:10:47,  7.67s/it]
                                                           
{'loss': '0.09132', 'grad_norm': '2.798', 'learning_rate': '1.791e-06', 'epoch': '0.8124'}
+
 81%|████████  | 30840/37963 [76:16:57<15:10:47,  7.67s/it]
 81%|████████  | 30841/37963 [76:17:04<15:14:05,  7.70s/it]
 81%|████████  | 30842/37963 [76:17:12<15:08:51,  7.66s/it]
 81%|████████  | 30843/37963 [76:17:20<15:13:01,  7.69s/it]
 81%|████████  | 30844/37963 [76:17:34<19:04:44,  9.65s/it]
 81%|████████▏ | 30845/37963 [76:17:42<17:55:52,  9.07s/it]
 81%|████████▏ | 30846/37963 [76:17:56<21:12:48, 10.73s/it]
 81%|████████▏ | 30847/37963 [76:18:04<19:20:28,  9.78s/it]
 81%|████████▏ | 30848/37963 [76:18:19<22:24:56, 11.34s/it]
 81%|████████▏ | 30849/37963 [76:18:26<20:12:23, 10.23s/it]
 81%|████████▏ | 30850/37963 [76:18:34<18:42:14,  9.47s/it]
                                                           
{'loss': '0.108', 'grad_norm': '3.325', 'learning_rate': '1.786e-06', 'epoch': '0.8126'}
+
 81%|████████▏ | 30850/37963 [76:18:34<18:42:14,  9.47s/it]
 81%|████████▏ | 30851/37963 [76:18:42<17:37:52,  8.92s/it]
 81%|████████▏ | 30852/37963 [76:18:49<16:55:14,  8.57s/it]
 81%|████████▏ | 30853/37963 [76:18:57<16:11:29,  8.20s/it]
 81%|████████▏ | 30854/37963 [76:19:12<20:19:45, 10.29s/it]
 81%|████████▏ | 30855/37963 [76:19:20<18:50:33,  9.54s/it]
 81%|████████▏ | 30856/37963 [76:19:27<17:43:56,  8.98s/it]
 81%|████████▏ | 30857/37963 [76:19:35<16:53:19,  8.56s/it]
 81%|████████▏ | 30858/37963 [76:19:43<16:26:06,  8.33s/it]
 81%|████████▏ | 30859/37963 [76:19:50<16:03:54,  8.14s/it]
 81%|████████▏ | 30860/37963 [76:19:58<15:47:10,  8.00s/it]
                                                           
{'loss': '0.09735', 'grad_norm': '3.205', 'learning_rate': '1.781e-06', 'epoch': '0.8129'}
+
 81%|████████▏ | 30860/37963 [76:19:58<15:47:10,  8.00s/it]
 81%|████████▏ | 30861/37963 [76:20:06<15:24:23,  7.81s/it]
 81%|████████▏ | 30862/37963 [76:20:13<15:15:44,  7.74s/it]
 81%|████████▏ | 30863/37963 [76:20:21<15:16:20,  7.74s/it]
 81%|████████▏ | 30864/37963 [76:20:29<15:21:11,  7.79s/it]
 81%|████████▏ | 30865/37963 [76:20:36<15:18:50,  7.77s/it]
 81%|████████▏ | 30866/37963 [76:20:44<15:11:08,  7.70s/it]
 81%|████████▏ | 30867/37963 [76:20:52<15:11:17,  7.71s/it]
 81%|████████▏ | 30868/37963 [76:21:06<19:00:26,  9.64s/it]
 81%|████████▏ | 30869/37963 [76:21:20<21:52:29, 11.10s/it]
 81%|████████▏ | 30870/37963 [76:21:28<19:49:00, 10.06s/it]
                                                           
{'loss': '0.09154', 'grad_norm': '2.541', 'learning_rate': '1.776e-06', 'epoch': '0.8132'}
+
 81%|████████▏ | 30870/37963 [76:21:28<19:49:00, 10.06s/it]
 81%|████████▏ | 30871/37963 [76:21:36<18:24:35,  9.35s/it]
 81%|████████▏ | 30872/37963 [76:21:50<21:21:07, 10.84s/it]
 81%|████████▏ | 30873/37963 [76:21:58<19:32:55,  9.93s/it]
 81%|████████▏ | 30874/37963 [76:22:05<18:04:30,  9.18s/it]
 81%|████████▏ | 30875/37963 [76:22:13<17:22:57,  8.83s/it]
 81%|████████▏ | 30876/37963 [76:22:21<16:35:06,  8.42s/it]
 81%|████████▏ | 30877/37963 [76:22:28<16:08:12,  8.20s/it]
 81%|████████▏ | 30878/37963 [76:22:36<15:49:18,  8.04s/it]
 81%|████████▏ | 30879/37963 [76:22:44<15:31:27,  7.89s/it]
 81%|████████▏ | 30880/37963 [76:22:51<15:28:09,  7.86s/it]
                                                           
{'loss': '0.08948', 'grad_norm': '2.902', 'learning_rate': '1.771e-06', 'epoch': '0.8134'}
+
 81%|████████▏ | 30880/37963 [76:22:51<15:28:09,  7.86s/it]
 81%|████████▏ | 30881/37963 [76:23:06<19:14:50,  9.78s/it]
 81%|████████▏ | 30882/37963 [76:23:13<17:58:00,  9.13s/it]
 81%|████████▏ | 30883/37963 [76:23:21<17:03:12,  8.67s/it]
 81%|████████▏ | 30884/37963 [76:23:28<16:23:47,  8.34s/it]
 81%|████████▏ | 30885/37963 [76:23:36<15:51:08,  8.06s/it]
 81%|████████▏ | 30886/37963 [76:23:43<15:32:25,  7.91s/it]
 81%|████████▏ | 30887/37963 [76:23:51<15:28:25,  7.87s/it]
 81%|████████▏ | 30888/37963 [76:23:59<15:20:12,  7.80s/it]
 81%|████████▏ | 30889/37963 [76:24:07<15:17:21,  7.78s/it]
 81%|████████▏ | 30890/37963 [76:24:14<15:15:38,  7.77s/it]
                                                           
{'loss': '0.0919', 'grad_norm': '2.905', 'learning_rate': '1.767e-06', 'epoch': '0.8137'}
+
 81%|████████▏ | 30890/37963 [76:24:14<15:15:38,  7.77s/it]
 81%|████████▏ | 30891/37963 [76:24:22<15:09:33,  7.72s/it]
 81%|████████▏ | 30892/37963 [76:24:29<15:04:51,  7.68s/it]
 81%|████████▏ | 30893/37963 [76:24:44<19:00:30,  9.68s/it]
 81%|████████▏ | 30894/37963 [76:24:52<17:53:58,  9.12s/it]
 81%|████████▏ | 30895/37963 [76:24:59<17:04:06,  8.69s/it]
 81%|████████▏ | 30896/37963 [76:25:07<16:26:49,  8.38s/it]
 81%|████████▏ | 30897/37963 [76:25:22<20:22:41, 10.38s/it]
 81%|████████▏ | 30898/37963 [76:25:30<18:51:10,  9.61s/it]
 81%|████████▏ | 30899/37963 [76:25:44<21:36:40, 11.01s/it]
 81%|████████▏ | 30900/37963 [76:25:52<19:43:26, 10.05s/it]
                                                           
{'loss': '0.09854', 'grad_norm': '3.028', 'learning_rate': '1.762e-06', 'epoch': '0.814'}
+
 81%|████████▏ | 30900/37963 [76:25:52<19:43:26, 10.05s/it]
 81%|████████▏ | 30901/37963 [76:26:00<18:26:18,  9.40s/it]
 81%|████████▏ | 30902/37963 [76:26:07<17:11:21,  8.76s/it]
 81%|████████▏ | 30903/37963 [76:26:15<16:30:19,  8.42s/it]
 81%|████████▏ | 30904/37963 [76:26:23<16:08:33,  8.23s/it]
 81%|████████▏ | 30905/37963 [76:26:30<15:44:58,  8.03s/it]
 81%|████████▏ | 30906/37963 [76:26:38<15:23:58,  7.86s/it]
 81%|████████▏ | 30907/37963 [76:26:53<19:42:41, 10.06s/it]
 81%|████████▏ | 30908/37963 [76:27:00<18:21:38,  9.37s/it]
 81%|████████▏ | 30909/37963 [76:27:08<17:11:43,  8.78s/it]
 81%|████████▏ | 30910/37963 [76:27:16<16:36:05,  8.47s/it]
                                                           
{'loss': '0.1037', 'grad_norm': '3.053', 'learning_rate': '1.757e-06', 'epoch': '0.8142'}
+
 81%|████████▏ | 30910/37963 [76:27:16<16:36:05,  8.47s/it]
 81%|████████▏ | 30911/37963 [76:27:23<16:06:03,  8.22s/it]
 81%|████████▏ | 30912/37963 [76:27:31<15:44:22,  8.04s/it]
 81%|████████▏ | 30913/37963 [76:27:39<15:29:31,  7.91s/it]
 81%|████████▏ | 30914/37963 [76:27:46<15:17:10,  7.81s/it]
 81%|████████▏ | 30915/37963 [76:27:54<15:08:21,  7.73s/it]
 81%|████████▏ | 30916/37963 [76:28:08<19:11:09,  9.80s/it]
 81%|████████▏ | 30917/37963 [76:28:15<17:40:03,  9.03s/it]
 81%|████████▏ | 30918/37963 [76:28:23<16:47:51,  8.58s/it]
 81%|████████▏ | 30919/37963 [76:28:31<16:14:08,  8.30s/it]
 81%|████████▏ | 30920/37963 [76:28:38<15:48:49,  8.08s/it]
                                                           
{'loss': '0.09155', 'grad_norm': '2.875', 'learning_rate': '1.752e-06', 'epoch': '0.8145'}
+
 81%|████████▏ | 30920/37963 [76:28:38<15:48:49,  8.08s/it]
 81%|████████▏ | 30921/37963 [76:28:46<15:32:38,  7.95s/it]
 81%|████████▏ | 30922/37963 [76:29:00<19:18:40,  9.87s/it]
 81%|████████▏ | 30923/37963 [76:29:07<17:45:54,  9.08s/it]
 81%|████████▏ | 30924/37963 [76:29:22<21:04:00, 10.77s/it]
 81%|████████▏ | 30925/37963 [76:29:30<19:16:23,  9.86s/it]
 81%|████████▏ | 30926/37963 [76:29:38<17:58:42,  9.20s/it]
 81%|████████▏ | 30927/37963 [76:29:45<17:03:08,  8.72s/it]
 81%|████████▏ | 30928/37963 [76:29:53<16:26:38,  8.41s/it]
 81%|████████▏ | 30929/37963 [76:30:00<15:52:45,  8.13s/it]
 81%|████████▏ | 30930/37963 [76:30:08<15:36:38,  7.99s/it]
                                                           
{'loss': '0.09269', 'grad_norm': '3.792', 'learning_rate': '1.747e-06', 'epoch': '0.8147'}
+
 81%|████████▏ | 30930/37963 [76:30:08<15:36:38,  7.99s/it]
 81%|████████▏ | 30931/37963 [76:30:16<15:24:22,  7.89s/it]
 81%|████████▏ | 30932/37963 [76:30:23<15:17:22,  7.83s/it]
 81%|████████▏ | 30933/37963 [76:30:31<15:07:02,  7.74s/it]
 81%|████████▏ | 30934/37963 [76:30:39<15:04:26,  7.72s/it]
 81%|████████▏ | 30935/37963 [76:30:53<18:48:10,  9.63s/it]
 81%|████████▏ | 30936/37963 [76:31:00<17:39:41,  9.05s/it]
 81%|████████▏ | 30937/37963 [76:31:08<16:50:27,  8.63s/it]
 81%|████████▏ | 30938/37963 [76:31:15<16:06:33,  8.26s/it]
 81%|████████▏ | 30939/37963 [76:31:23<15:45:05,  8.07s/it]
 82%|████████▏ | 30940/37963 [76:31:37<19:29:06,  9.99s/it]
                                                           
{'loss': '0.1028', 'grad_norm': '2.911', 'learning_rate': '1.742e-06', 'epoch': '0.815'}
+
 82%|████████▏ | 30940/37963 [76:31:37<19:29:06,  9.99s/it]
 82%|████████▏ | 30941/37963 [76:31:52<22:16:08, 11.42s/it]
 82%|████████▏ | 30942/37963 [76:32:00<20:11:35, 10.35s/it]
 82%|████████▏ | 30943/37963 [76:32:08<18:34:28,  9.53s/it]
 82%|████████▏ | 30944/37963 [76:32:22<21:19:20, 10.94s/it]
 82%|████████▏ | 30945/37963 [76:32:30<19:31:13, 10.01s/it]
 82%|████████▏ | 30946/37963 [76:32:37<18:08:05,  9.30s/it]
 82%|████████▏ | 30947/37963 [76:32:45<17:10:46,  8.82s/it]
 82%|████████▏ | 30948/37963 [76:32:53<16:32:09,  8.49s/it]
 82%|████████▏ | 30949/37963 [76:33:00<16:03:10,  8.24s/it]
 82%|████████▏ | 30950/37963 [76:33:08<15:45:09,  8.09s/it]
                                                           
{'loss': '0.09305', 'grad_norm': '2.922', 'learning_rate': '1.738e-06', 'epoch': '0.8153'}
+
 82%|████████▏ | 30950/37963 [76:33:08<15:45:09,  8.09s/it]
 82%|████████▏ | 30951/37963 [76:33:16<15:29:00,  7.95s/it]
 82%|████████▏ | 30952/37963 [76:33:24<15:20:17,  7.88s/it]
 82%|████████▏ | 30953/37963 [76:33:38<19:18:18,  9.91s/it]
 82%|████████▏ | 30954/37963 [76:33:46<18:02:03,  9.26s/it]
 82%|████████▏ | 30955/37963 [76:33:54<17:07:18,  8.80s/it]
 82%|████████▏ | 30956/37963 [76:34:01<16:31:50,  8.49s/it]
 82%|████████▏ | 30957/37963 [76:34:09<16:01:35,  8.24s/it]
 82%|████████▏ | 30958/37963 [76:34:17<15:43:41,  8.08s/it]
 82%|████████▏ | 30959/37963 [76:34:24<15:20:21,  7.88s/it]
 82%|████████▏ | 30960/37963 [76:34:39<19:07:11,  9.83s/it]
                                                           
{'loss': '0.09874', 'grad_norm': '1.929', 'learning_rate': '1.733e-06', 'epoch': '0.8155'}
+
 82%|████████▏ | 30960/37963 [76:34:39<19:07:11,  9.83s/it]
 82%|████████▏ | 30961/37963 [76:34:46<17:55:11,  9.21s/it]
 82%|████████▏ | 30962/37963 [76:34:54<16:53:19,  8.68s/it]
 82%|████████▏ | 30963/37963 [76:35:02<16:18:19,  8.39s/it]
 82%|████████▏ | 30964/37963 [76:35:09<15:47:41,  8.12s/it]
 82%|████████▏ | 30965/37963 [76:35:17<15:28:15,  7.96s/it]
 82%|████████▏ | 30966/37963 [76:35:24<15:04:31,  7.76s/it]
 82%|████████▏ | 30967/37963 [76:35:32<15:07:42,  7.78s/it]
 82%|████████▏ | 30968/37963 [76:35:39<14:49:27,  7.63s/it]
 82%|████████▏ | 30969/37963 [76:35:47<14:51:01,  7.64s/it]
 82%|████████▏ | 30970/37963 [76:35:54<14:51:05,  7.65s/it]
                                                           
{'loss': '0.09595', 'grad_norm': '3.185', 'learning_rate': '1.728e-06', 'epoch': '0.8158'}
+
 82%|████████▏ | 30970/37963 [76:35:54<14:51:05,  7.65s/it]
 82%|████████▏ | 30971/37963 [76:36:02<14:50:07,  7.64s/it]
 82%|████████▏ | 30972/37963 [76:36:09<14:44:53,  7.59s/it]
 82%|████████▏ | 30973/37963 [76:36:17<14:36:35,  7.52s/it]
 82%|████████▏ | 30974/37963 [76:36:24<14:38:42,  7.54s/it]
 82%|████████▏ | 30975/37963 [76:36:32<14:44:24,  7.59s/it]
 82%|████████▏ | 30976/37963 [76:36:47<18:43:55,  9.65s/it]
 82%|████████▏ | 30977/37963 [76:36:54<17:37:29,  9.08s/it]
 82%|████████▏ | 30978/37963 [76:37:09<20:56:51, 10.80s/it]
 82%|████████▏ | 30979/37963 [76:37:17<19:10:33,  9.88s/it]
 82%|████████▏ | 30980/37963 [76:37:25<17:52:14,  9.21s/it]
                                                           
{'loss': '0.09482', 'grad_norm': '2.499', 'learning_rate': '1.723e-06', 'epoch': '0.8161'}
+
 82%|████████▏ | 30980/37963 [76:37:25<17:52:14,  9.21s/it]
 82%|████████▏ | 30981/37963 [76:37:32<17:02:38,  8.79s/it]
 82%|████████▏ | 30982/37963 [76:37:40<16:26:06,  8.48s/it]
 82%|████████▏ | 30983/37963 [76:37:48<16:07:26,  8.32s/it]
 82%|████████▏ | 30984/37963 [76:37:56<15:39:51,  8.08s/it]
 82%|████████▏ | 30985/37963 [76:38:03<15:27:10,  7.97s/it]
 82%|████████▏ | 30986/37963 [76:38:11<15:19:35,  7.91s/it]
 82%|████████▏ | 30987/37963 [76:38:19<15:10:47,  7.83s/it]
 82%|████████▏ | 30988/37963 [76:38:33<18:48:18,  9.71s/it]
 82%|████████▏ | 30989/37963 [76:38:47<21:30:12, 11.10s/it]
 82%|████████▏ | 30990/37963 [76:39:08<27:18:43, 14.10s/it]
                                                           
{'loss': '0.09091', 'grad_norm': '2.611', 'learning_rate': '1.718e-06', 'epoch': '0.8163'}
+
 82%|████████▏ | 30990/37963 [76:39:08<27:18:43, 14.10s/it]
 82%|████████▏ | 30991/37963 [76:39:16<23:35:03, 12.18s/it]
 82%|████████▏ | 30992/37963 [76:39:23<20:51:46, 10.77s/it]
 82%|████████▏ | 30993/37963 [76:39:31<19:04:15,  9.85s/it]
 82%|████████▏ | 30994/37963 [76:39:39<17:48:43,  9.20s/it]
 82%|████████▏ | 30995/37963 [76:39:46<16:53:33,  8.73s/it]
 82%|████████▏ | 30996/37963 [76:39:54<16:12:51,  8.38s/it]
 82%|████████▏ | 30997/37963 [76:40:01<15:39:45,  8.09s/it]
 82%|████████▏ | 30998/37963 [76:40:09<15:24:45,  7.97s/it]
 82%|████████▏ | 30999/37963 [76:40:17<15:15:57,  7.89s/it]
 82%|████████▏ | 31000/37963 [76:40:24<15:03:46,  7.79s/it]
                                                           
{'loss': '0.08941', 'grad_norm': '2.539', 'learning_rate': '1.714e-06', 'epoch': '0.8166'}
+
 82%|████████▏ | 31000/37963 [76:40:24<15:03:46,  7.79s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.07s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.07s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 82%|████████▏ | 31001/37963 [76:41:21<43:21:17, 22.42s/it]
 82%|████████▏ | 31002/37963 [76:41:28<34:39:13, 17.92s/it]
 82%|████████▏ | 31003/37963 [76:41:36<28:41:56, 14.84s/it]
 82%|████████▏ | 31004/37963 [76:41:51<28:53:08, 14.94s/it]
 82%|████████▏ | 31005/37963 [76:42:06<28:48:07, 14.90s/it]
 82%|████████▏ | 31006/37963 [76:42:14<24:43:15, 12.79s/it]
 82%|████████▏ | 31007/37963 [76:42:22<21:49:05, 11.29s/it]
 82%|████████▏ | 31008/37963 [76:42:29<19:37:52, 10.16s/it]
 82%|████████▏ | 31009/37963 [76:42:37<18:08:37,  9.39s/it]
 82%|████████▏ | 31010/37963 [76:42:44<16:56:53,  8.78s/it]
                                                           
{'loss': '0.1036', 'grad_norm': '2.527', 'learning_rate': '1.709e-06', 'epoch': '0.8169'}
+
 82%|████████▏ | 31010/37963 [76:42:44<16:56:53,  8.78s/it]
 82%|████████▏ | 31011/37963 [76:42:52<16:20:53,  8.47s/it]
 82%|████████▏ | 31012/37963 [76:42:59<15:53:04,  8.23s/it]
 82%|████████▏ | 31013/37963 [76:43:07<15:34:12,  8.07s/it]
 82%|████████▏ | 31014/37963 [76:43:15<15:23:25,  7.97s/it]
 82%|████████▏ | 31015/37963 [76:43:23<15:15:20,  7.90s/it]
 82%|████████▏ | 31016/37963 [76:43:30<15:05:52,  7.82s/it]
 82%|████████▏ | 31017/37963 [76:43:38<14:54:05,  7.72s/it]
 82%|████████▏ | 31018/37963 [76:43:45<14:38:15,  7.59s/it]
 82%|████████▏ | 31019/37963 [76:43:53<14:38:38,  7.59s/it]
 82%|████████▏ | 31020/37963 [76:44:00<14:34:40,  7.56s/it]
                                                           
{'loss': '0.09202', 'grad_norm': '2.24', 'learning_rate': '1.704e-06', 'epoch': '0.8171'}
+
 82%|████████▏ | 31020/37963 [76:44:00<14:34:40,  7.56s/it]
 82%|████████▏ | 31021/37963 [76:44:08<14:41:24,  7.62s/it]
 82%|████████▏ | 31022/37963 [76:44:16<14:45:35,  7.66s/it]
 82%|████████▏ | 31023/37963 [76:44:23<14:51:32,  7.71s/it]
 82%|████████▏ | 31024/37963 [76:44:38<18:57:28,  9.84s/it]
 82%|████████▏ | 31025/37963 [76:44:53<21:45:28, 11.29s/it]
 82%|████████▏ | 31026/37963 [76:45:01<19:44:43, 10.25s/it]
 82%|████████▏ | 31027/37963 [76:45:08<18:16:04,  9.48s/it]
 82%|████████▏ | 31028/37963 [76:45:16<17:07:27,  8.89s/it]
 82%|████████▏ | 31029/37963 [76:45:24<16:28:58,  8.56s/it]
 82%|████████▏ | 31030/37963 [76:45:31<15:58:28,  8.29s/it]
                                                           
{'loss': '0.0963', 'grad_norm': '3.108', 'learning_rate': '1.699e-06', 'epoch': '0.8174'}
+
 82%|████████▏ | 31030/37963 [76:45:31<15:58:28,  8.29s/it]
 82%|████████▏ | 31031/37963 [76:45:39<15:35:08,  8.09s/it]
 82%|████████▏ | 31032/37963 [76:45:47<15:25:10,  8.01s/it]
 82%|████████▏ | 31033/37963 [76:46:08<23:10:16, 12.04s/it]
 82%|████████▏ | 31034/37963 [76:46:16<20:37:57, 10.72s/it]
 82%|████████▏ | 31035/37963 [76:46:31<22:53:37, 11.90s/it]
 82%|████████▏ | 31036/37963 [76:46:38<20:17:45, 10.55s/it]
 82%|████████▏ | 31037/37963 [76:46:46<18:40:25,  9.71s/it]
 82%|████████▏ | 31038/37963 [76:47:00<21:04:40, 10.96s/it]
 82%|████████▏ | 31039/37963 [76:47:07<19:06:02,  9.93s/it]
 82%|████████▏ | 31040/37963 [76:47:14<17:32:13,  9.12s/it]
                                                           
{'loss': '0.09447', 'grad_norm': '2.418', 'learning_rate': '1.695e-06', 'epoch': '0.8176'}
+
 82%|████████▏ | 31040/37963 [76:47:14<17:32:13,  9.12s/it]
 82%|████████▏ | 31041/37963 [76:47:22<16:41:43,  8.68s/it]
 82%|████████▏ | 31042/37963 [76:47:29<15:55:24,  8.28s/it]
 82%|████████▏ | 31043/37963 [76:47:37<15:26:14,  8.03s/it]
 82%|████████▏ | 31044/37963 [76:47:44<15:01:37,  7.82s/it]
 82%|████████▏ | 31045/37963 [76:47:52<15:00:25,  7.81s/it]
 82%|████████▏ | 31046/37963 [76:48:00<14:56:56,  7.78s/it]
 82%|████████▏ | 31047/37963 [76:48:07<14:53:57,  7.76s/it]
 82%|████████▏ | 31048/37963 [76:48:15<14:52:59,  7.75s/it]
 82%|████████▏ | 31049/37963 [76:48:29<18:37:53,  9.70s/it]
 82%|████████▏ | 31050/37963 [76:48:37<17:29:10,  9.11s/it]
                                                           
{'loss': '0.08634', 'grad_norm': '1.836', 'learning_rate': '1.69e-06', 'epoch': '0.8179'}
+
 82%|████████▏ | 31050/37963 [76:48:37<17:29:10,  9.11s/it]
 82%|████████▏ | 31051/37963 [76:48:45<16:38:03,  8.66s/it]
 82%|████████▏ | 31052/37963 [76:48:59<19:48:49, 10.32s/it]
 82%|████████▏ | 31053/37963 [76:49:07<18:16:35,  9.52s/it]
 82%|████████▏ | 31054/37963 [76:49:14<17:13:04,  8.97s/it]
 82%|████████▏ | 31055/37963 [76:49:22<16:25:18,  8.56s/it]
 82%|████████▏ | 31056/37963 [76:49:29<15:48:57,  8.24s/it]
 82%|████████▏ | 31057/37963 [76:49:37<15:26:20,  8.05s/it]
 82%|████████▏ | 31058/37963 [76:49:45<15:14:20,  7.95s/it]
 82%|████████▏ | 31059/37963 [76:49:52<15:05:04,  7.87s/it]
 82%|████████▏ | 31060/37963 [76:50:00<15:00:43,  7.83s/it]
                                                           
{'loss': '0.1064', 'grad_norm': '4.253', 'learning_rate': '1.685e-06', 'epoch': '0.8182'}
+
 82%|████████▏ | 31060/37963 [76:50:00<15:00:43,  7.83s/it]
 82%|████████▏ | 31061/37963 [76:50:08<14:56:21,  7.79s/it]
 82%|████████▏ | 31062/37963 [76:50:15<14:48:21,  7.72s/it]
 82%|████████▏ | 31063/37963 [76:50:23<14:42:13,  7.67s/it]
 82%|████████▏ | 31064/37963 [76:50:31<14:47:51,  7.72s/it]
 82%|████████▏ | 31065/37963 [76:50:38<14:48:00,  7.72s/it]
 82%|████████▏ | 31066/37963 [76:50:46<14:46:47,  7.71s/it]
 82%|████████▏ | 31067/37963 [76:50:54<14:51:21,  7.76s/it]
 82%|████████▏ | 31068/37963 [76:51:01<14:41:41,  7.67s/it]
 82%|████████▏ | 31069/37963 [76:51:09<14:40:23,  7.66s/it]
 82%|████████▏ | 31070/37963 [76:51:17<14:34:13,  7.61s/it]
                                                           
{'loss': '0.09691', 'grad_norm': '2.925', 'learning_rate': '1.68e-06', 'epoch': '0.8184'}
+
 82%|████████▏ | 31070/37963 [76:51:17<14:34:13,  7.61s/it]
 82%|████████▏ | 31071/37963 [76:51:24<14:35:53,  7.63s/it]
 82%|████████▏ | 31072/37963 [76:51:39<18:49:19,  9.83s/it]
 82%|████████▏ | 31073/37963 [76:51:53<21:16:42, 11.12s/it]
 82%|████████▏ | 31074/37963 [76:52:01<19:14:03, 10.05s/it]
 82%|████████▏ | 31075/37963 [76:52:08<17:48:04,  9.30s/it]
 82%|████████▏ | 31076/37963 [76:52:16<16:51:07,  8.81s/it]
 82%|████████▏ | 31077/37963 [76:52:24<16:11:57,  8.47s/it]
 82%|████████▏ | 31078/37963 [76:52:38<19:42:13, 10.30s/it]
 82%|████████▏ | 31079/37963 [76:52:46<18:10:33,  9.51s/it]
 82%|████████▏ | 31080/37963 [76:53:01<21:21:08, 11.17s/it]
                                                           
{'loss': '0.0886', 'grad_norm': '2.779', 'learning_rate': '1.676e-06', 'epoch': '0.8187'}
+
 82%|████████▏ | 31080/37963 [76:53:01<21:21:08, 11.17s/it]
 82%|████████▏ | 31081/37963 [76:53:09<19:17:31, 10.09s/it]
 82%|████████▏ | 31082/37963 [76:53:17<18:01:58,  9.43s/it]
 82%|████████▏ | 31083/37963 [76:53:31<20:41:03, 10.82s/it]
 82%|████████▏ | 31084/37963 [76:53:38<18:43:33,  9.80s/it]
 82%|████████▏ | 31085/37963 [76:53:46<17:23:25,  9.10s/it]
 82%|████████▏ | 31086/37963 [76:53:53<16:33:26,  8.67s/it]
 82%|████████▏ | 31087/37963 [76:54:07<19:47:52, 10.37s/it]
 82%|████████▏ | 31088/37963 [76:54:15<18:10:12,  9.51s/it]
 82%|████████▏ | 31089/37963 [76:54:23<17:04:35,  8.94s/it]
 82%|████████▏ | 31090/37963 [76:54:30<16:14:55,  8.51s/it]
                                                           
{'loss': '0.09721', 'grad_norm': '2.327', 'learning_rate': '1.671e-06', 'epoch': '0.819'}
+
 82%|████████▏ | 31090/37963 [76:54:30<16:14:55,  8.51s/it]
 82%|████████▏ | 31091/37963 [76:54:38<15:43:35,  8.24s/it]
 82%|████████▏ | 31092/37963 [76:54:45<15:24:25,  8.07s/it]
 82%|████████▏ | 31093/37963 [76:54:53<15:11:07,  7.96s/it]
 82%|████████▏ | 31094/37963 [76:55:01<14:59:31,  7.86s/it]
 82%|████████▏ | 31095/37963 [76:55:08<14:52:53,  7.80s/it]
 82%|████████▏ | 31096/37963 [76:55:16<14:47:07,  7.75s/it]
 82%|████████▏ | 31097/37963 [76:55:24<14:46:24,  7.75s/it]
 82%|████████▏ | 31098/37963 [76:55:32<14:45:50,  7.74s/it]
 82%|████████▏ | 31099/37963 [76:55:39<14:37:57,  7.67s/it]
 82%|████████▏ | 31100/37963 [76:55:47<14:38:19,  7.68s/it]
                                                           
{'loss': '0.08606', 'grad_norm': '2.166', 'learning_rate': '1.666e-06', 'epoch': '0.8192'}
+
 82%|████████▏ | 31100/37963 [76:55:47<14:38:19,  7.68s/it]
 82%|████████▏ | 31101/37963 [76:56:02<18:42:54,  9.82s/it]
 82%|████████▏ | 31102/37963 [76:56:09<17:21:23,  9.11s/it]
 82%|████████▏ | 31103/37963 [76:56:17<16:38:24,  8.73s/it]
 82%|████████▏ | 31104/37963 [76:56:24<16:00:36,  8.40s/it]
 82%|████████▏ | 31105/37963 [76:56:32<15:28:09,  8.12s/it]
 82%|████████▏ | 31106/37963 [76:56:47<19:14:35, 10.10s/it]
 82%|████████▏ | 31107/37963 [76:56:55<17:57:30,  9.43s/it]
 82%|████████▏ | 31108/37963 [76:57:02<17:01:19,  8.94s/it]
 82%|████████▏ | 31109/37963 [76:57:10<16:09:56,  8.49s/it]
 82%|████████▏ | 31110/37963 [76:57:17<15:43:08,  8.26s/it]
                                                           
{'loss': '0.0899', 'grad_norm': '2.882', 'learning_rate': '1.661e-06', 'epoch': '0.8195'}
+
 82%|████████▏ | 31110/37963 [76:57:17<15:43:08,  8.26s/it]
 82%|████████▏ | 31111/37963 [76:57:25<15:22:36,  8.08s/it]
 82%|████████▏ | 31112/37963 [76:57:33<15:05:36,  7.93s/it]
 82%|████████▏ | 31113/37963 [76:57:40<14:57:39,  7.86s/it]
 82%|████████▏ | 31114/37963 [76:57:48<14:49:40,  7.79s/it]
 82%|████████▏ | 31115/37963 [76:57:56<14:43:53,  7.74s/it]
 82%|████████▏ | 31116/37963 [76:58:03<14:43:38,  7.74s/it]
 82%|████████▏ | 31117/37963 [76:58:11<14:42:05,  7.73s/it]
 82%|████████▏ | 31118/37963 [76:58:19<14:42:37,  7.74s/it]
 82%|████████▏ | 31119/37963 [76:58:34<18:52:09,  9.93s/it]
 82%|████████▏ | 31120/37963 [76:58:41<17:22:53,  9.14s/it]
                                                           
{'loss': '0.09299', 'grad_norm': '2.944', 'learning_rate': '1.657e-06', 'epoch': '0.8197'}
+
 82%|████████▏ | 31120/37963 [76:58:41<17:22:53,  9.14s/it]
 82%|████████▏ | 31121/37963 [76:58:55<20:15:25, 10.66s/it]
 82%|████████▏ | 31122/37963 [76:59:03<18:33:41,  9.77s/it]
 82%|████████▏ | 31123/37963 [76:59:11<17:21:53,  9.14s/it]
 82%|████████▏ | 31124/37963 [76:59:18<16:30:47,  8.69s/it]
 82%|████████▏ | 31125/37963 [76:59:26<15:55:10,  8.38s/it]
 82%|████████▏ | 31126/37963 [76:59:41<19:25:07, 10.22s/it]
 82%|████████▏ | 31127/37963 [76:59:48<18:01:49,  9.50s/it]
 82%|████████▏ | 31128/37963 [76:59:56<16:57:44,  8.93s/it]
 82%|████████▏ | 31129/37963 [77:00:04<16:10:39,  8.52s/it]
 82%|████████▏ | 31130/37963 [77:00:18<19:24:24, 10.22s/it]
                                                           
{'loss': '0.09312', 'grad_norm': '3.049', 'learning_rate': '1.652e-06', 'epoch': '0.82'}
+
 82%|████████▏ | 31130/37963 [77:00:18<19:24:24, 10.22s/it]
 82%|████████▏ | 31131/37963 [77:00:25<17:48:43,  9.39s/it]
 82%|████████▏ | 31132/37963 [77:00:40<21:00:18, 11.07s/it]
 82%|████████▏ | 31133/37963 [77:00:54<22:47:27, 12.01s/it]
 82%|████████▏ | 31134/37963 [77:01:02<20:06:37, 10.60s/it]
 82%|████████▏ | 31135/37963 [77:01:09<18:25:26,  9.71s/it]
 82%|████████▏ | 31136/37963 [77:01:17<17:14:05,  9.09s/it]
 82%|████████▏ | 31137/37963 [77:01:25<16:27:34,  8.68s/it]
 82%|████████▏ | 31138/37963 [77:01:32<15:46:18,  8.32s/it]
 82%|████████▏ | 31139/37963 [77:01:40<15:26:29,  8.15s/it]
 82%|████████▏ | 31140/37963 [77:01:48<15:12:10,  8.02s/it]
                                                           
{'loss': '0.08998', 'grad_norm': '2.194', 'learning_rate': '1.647e-06', 'epoch': '0.8203'}
+
 82%|████████▏ | 31140/37963 [77:01:48<15:12:10,  8.02s/it]
 82%|████████▏ | 31141/37963 [77:01:55<15:01:42,  7.93s/it]
 82%|████████▏ | 31142/37963 [77:02:03<14:57:13,  7.89s/it]
 82%|████████▏ | 31143/37963 [77:02:11<14:48:36,  7.82s/it]
 82%|████████▏ | 31144/37963 [77:02:18<14:31:26,  7.67s/it]
 82%|████████▏ | 31145/37963 [77:02:26<14:34:38,  7.70s/it]
 82%|████████▏ | 31146/37963 [77:02:34<14:35:10,  7.70s/it]
 82%|████████▏ | 31147/37963 [77:02:41<14:36:23,  7.71s/it]
 82%|████████▏ | 31148/37963 [77:02:49<14:35:18,  7.71s/it]
 82%|████████▏ | 31149/37963 [77:03:03<18:15:46,  9.65s/it]
 82%|████████▏ | 31150/37963 [77:03:11<17:15:28,  9.12s/it]
                                                           
{'loss': '0.09551', 'grad_norm': '2.783', 'learning_rate': '1.643e-06', 'epoch': '0.8205'}
+
 82%|████████▏ | 31150/37963 [77:03:11<17:15:28,  9.12s/it]
 82%|████████▏ | 31151/37963 [77:03:19<16:28:20,  8.71s/it]
 82%|████████▏ | 31152/37963 [77:03:27<15:52:24,  8.39s/it]
 82%|████████▏ | 31153/37963 [77:03:34<15:24:52,  8.15s/it]
 82%|████████▏ | 31154/37963 [77:03:42<15:05:29,  7.98s/it]
 82%|████████▏ | 31155/37963 [77:03:50<15:01:56,  7.95s/it]
 82%|████████▏ | 31156/37963 [77:04:04<18:30:18,  9.79s/it]
 82%|████████▏ | 31157/37963 [77:04:11<17:13:09,  9.11s/it]
 82%|████████▏ | 31158/37963 [77:04:19<16:19:41,  8.64s/it]
 82%|████████▏ | 31159/37963 [77:04:26<15:50:00,  8.38s/it]
 82%|████████▏ | 31160/37963 [77:04:34<15:25:29,  8.16s/it]
                                                           
{'loss': '0.0909', 'grad_norm': '3.014', 'learning_rate': '1.638e-06', 'epoch': '0.8208'}
+
 82%|████████▏ | 31160/37963 [77:04:34<15:25:29,  8.16s/it]
 82%|████████▏ | 31161/37963 [77:04:42<15:07:23,  8.00s/it]
 82%|████████▏ | 31162/37963 [77:04:50<15:01:29,  7.95s/it]
 82%|████████▏ | 31163/37963 [77:04:57<14:55:38,  7.90s/it]
 82%|████████▏ | 31164/37963 [77:05:05<14:51:53,  7.87s/it]
 82%|████████▏ | 31165/37963 [77:05:13<14:46:17,  7.82s/it]
 82%|████████▏ | 31166/37963 [77:05:20<14:37:29,  7.75s/it]
 82%|████████▏ | 31167/37963 [77:05:28<14:33:17,  7.71s/it]
 82%|████████▏ | 31168/37963 [77:05:42<18:12:45,  9.65s/it]
 82%|████████▏ | 31169/37963 [77:05:50<17:14:59,  9.14s/it]
 82%|████████▏ | 31170/37963 [77:06:11<24:03:51, 12.75s/it]
                                                           
{'loss': '0.08248', 'grad_norm': '2.572', 'learning_rate': '1.633e-06', 'epoch': '0.8211'}
+
 82%|████████▏ | 31170/37963 [77:06:11<24:03:51, 12.75s/it]
 82%|████████▏ | 31171/37963 [77:06:19<21:18:31, 11.29s/it]
 82%|████████▏ | 31172/37963 [77:06:27<19:14:47, 10.20s/it]
 82%|████████▏ | 31173/37963 [77:06:35<17:51:28,  9.47s/it]
 82%|████████▏ | 31174/37963 [77:06:42<16:49:29,  8.92s/it]
 82%|████████▏ | 31175/37963 [77:06:57<20:14:59, 10.74s/it]
 82%|████████▏ | 31176/37963 [77:07:05<18:34:38,  9.85s/it]
 82%|████████▏ | 31177/37963 [77:07:13<17:16:25,  9.16s/it]
 82%|████████▏ | 31178/37963 [77:07:20<16:27:01,  8.73s/it]
 82%|████████▏ | 31179/37963 [77:07:34<19:21:17, 10.27s/it]
 82%|████████▏ | 31180/37963 [77:07:42<17:54:34,  9.51s/it]
                                                           
{'loss': '0.09464', 'grad_norm': '3.048', 'learning_rate': '1.629e-06', 'epoch': '0.8213'}
+
 82%|████████▏ | 31180/37963 [77:07:42<17:54:34,  9.51s/it]
 82%|████████▏ | 31181/37963 [77:07:50<16:49:53,  8.93s/it]
 82%|████████▏ | 31182/37963 [77:08:04<19:48:05, 10.51s/it]
 82%|████████▏ | 31183/37963 [77:08:11<18:02:56,  9.58s/it]
 82%|████████▏ | 31184/37963 [77:08:19<16:59:09,  9.02s/it]
 82%|████████▏ | 31185/37963 [77:08:27<16:11:19,  8.60s/it]
 82%|████████▏ | 31186/37963 [77:08:34<15:43:56,  8.36s/it]
 82%|████████▏ | 31187/37963 [77:08:42<15:24:48,  8.19s/it]
 82%|████████▏ | 31188/37963 [77:08:50<15:13:55,  8.09s/it]
 82%|████████▏ | 31189/37963 [77:08:58<15:04:25,  8.01s/it]
 82%|████████▏ | 31190/37963 [77:09:06<14:54:10,  7.92s/it]
                                                           
{'loss': '0.1001', 'grad_norm': '3.178', 'learning_rate': '1.624e-06', 'epoch': '0.8216'}
+
 82%|████████▏ | 31190/37963 [77:09:06<14:54:10,  7.92s/it]
 82%|████████▏ | 31191/37963 [77:09:13<14:42:47,  7.82s/it]
 82%|████████▏ | 31192/37963 [77:09:21<14:43:24,  7.83s/it]
 82%|████████▏ | 31193/37963 [77:09:29<14:37:18,  7.78s/it]
 82%|████████▏ | 31194/37963 [77:09:36<14:32:42,  7.74s/it]
 82%|████████▏ | 31195/37963 [77:09:44<14:33:08,  7.74s/it]
 82%|████████▏ | 31196/37963 [77:09:52<14:28:36,  7.70s/it]
 82%|████████▏ | 31197/37963 [77:10:06<18:24:23,  9.79s/it]
 82%|████████▏ | 31198/37963 [77:10:14<17:14:02,  9.17s/it]
 82%|████████▏ | 31199/37963 [77:10:21<16:16:37,  8.66s/it]
 82%|████████▏ | 31200/37963 [77:10:29<15:41:54,  8.36s/it]
                                                           
{'loss': '0.09708', 'grad_norm': '2.858', 'learning_rate': '1.619e-06', 'epoch': '0.8219'}
+
 82%|████████▏ | 31200/37963 [77:10:29<15:41:54,  8.36s/it]
 82%|████████▏ | 31201/37963 [77:10:37<15:11:12,  8.09s/it]
 82%|████████▏ | 31202/37963 [77:10:44<14:58:45,  7.98s/it]
 82%|████████▏ | 31203/37963 [77:10:59<18:37:26,  9.92s/it]
 82%|████████▏ | 31204/37963 [77:11:06<17:16:36,  9.20s/it]
 82%|████████▏ | 31205/37963 [77:11:14<16:22:58,  8.73s/it]
 82%|████████▏ | 31206/37963 [77:11:22<15:46:28,  8.40s/it]
 82%|████████▏ | 31207/37963 [77:11:29<15:20:23,  8.17s/it]
 82%|████████▏ | 31208/37963 [77:11:37<15:01:15,  8.01s/it]
 82%|████████▏ | 31209/37963 [77:11:44<14:49:14,  7.90s/it]
 82%|████████▏ | 31210/37963 [77:11:52<14:24:28,  7.68s/it]
                                                           
{'loss': '0.09991', 'grad_norm': '2.13', 'learning_rate': '1.615e-06', 'epoch': '0.8221'}
+
 82%|████████▏ | 31210/37963 [77:11:52<14:24:28,  7.68s/it]
 82%|████████▏ | 31211/37963 [77:11:59<14:24:53,  7.69s/it]
 82%|████████▏ | 31212/37963 [77:12:07<14:17:54,  7.62s/it]
 82%|████████▏ | 31213/37963 [77:12:15<14:26:49,  7.71s/it]
 82%|████████▏ | 31214/37963 [77:12:22<14:22:35,  7.67s/it]
 82%|████████▏ | 31215/37963 [77:12:30<14:29:51,  7.73s/it]
 82%|████████▏ | 31216/37963 [77:12:44<18:12:12,  9.71s/it]
 82%|████████▏ | 31217/37963 [77:12:52<17:06:30,  9.13s/it]
 82%|████████▏ | 31218/37963 [77:13:00<16:16:43,  8.69s/it]
 82%|████████▏ | 31219/37963 [77:13:14<19:20:21, 10.32s/it]
 82%|████████▏ | 31220/37963 [77:13:36<25:51:56, 13.81s/it]
                                                           
{'loss': '0.08626', 'grad_norm': '2.434', 'learning_rate': '1.61e-06', 'epoch': '0.8224'}
+
 82%|████████▏ | 31220/37963 [77:13:36<25:51:56, 13.81s/it]
 82%|████████▏ | 31221/37963 [77:13:44<22:23:26, 11.96s/it]
 82%|████████▏ | 31222/37963 [77:13:51<19:58:14, 10.67s/it]
 82%|████████▏ | 31223/37963 [77:13:59<18:18:53,  9.78s/it]
 82%|████████▏ | 31224/37963 [77:14:07<17:06:59,  9.14s/it]
 82%|████████▏ | 31225/37963 [77:14:14<16:14:38,  8.68s/it]
 82%|████████▏ | 31226/37963 [77:14:22<15:39:20,  8.37s/it]
 82%|████████▏ | 31227/37963 [77:14:29<15:11:56,  8.12s/it]
 82%|████████▏ | 31228/37963 [77:14:37<14:57:20,  7.99s/it]
 82%|████████▏ | 31229/37963 [77:14:45<14:44:39,  7.88s/it]
 82%|████████▏ | 31230/37963 [77:14:59<18:19:08,  9.79s/it]
                                                           
{'loss': '0.1016', 'grad_norm': '2.646', 'learning_rate': '1.605e-06', 'epoch': '0.8226'}
+
 82%|████████▏ | 31230/37963 [77:14:59<18:19:08,  9.79s/it]
 82%|████████▏ | 31231/37963 [77:15:07<17:10:17,  9.18s/it]
 82%|████████▏ | 31232/37963 [77:15:21<19:58:29, 10.68s/it]
 82%|████████▏ | 31233/37963 [77:15:29<18:16:25,  9.77s/it]
 82%|████████▏ | 31234/37963 [77:15:36<16:56:10,  9.06s/it]
 82%|████████▏ | 31235/37963 [77:15:44<16:10:47,  8.66s/it]
 82%|████████▏ | 31236/37963 [77:15:51<15:38:12,  8.37s/it]
 82%|████████▏ | 31237/37963 [77:15:59<15:09:21,  8.11s/it]
 82%|████████▏ | 31238/37963 [77:16:06<14:47:19,  7.92s/it]
 82%|████████▏ | 31239/37963 [77:16:14<14:39:40,  7.85s/it]
 82%|████████▏ | 31240/37963 [77:16:22<14:32:51,  7.79s/it]
                                                           
{'loss': '0.09772', 'grad_norm': '2.786', 'learning_rate': '1.601e-06', 'epoch': '0.8229'}
+
 82%|████████▏ | 31240/37963 [77:16:22<14:32:51,  7.79s/it]
 82%|███████���▏ | 31241/37963 [77:16:29<14:27:15,  7.74s/it]
 82%|████████▏ | 31242/37963 [77:16:37<14:25:17,  7.72s/it]
 82%|████████▏ | 31243/37963 [77:16:45<14:24:00,  7.71s/it]
 82%|████████▏ | 31244/37963 [77:16:52<14:24:23,  7.72s/it]
 82%|████████▏ | 31245/37963 [77:17:00<14:22:27,  7.70s/it]
 82%|████████▏ | 31246/37963 [77:17:08<14:24:09,  7.72s/it]
 82%|████████▏ | 31247/37963 [77:17:23<18:16:36,  9.80s/it]
 82%|████████▏ | 31248/37963 [77:17:30<17:05:02,  9.16s/it]
 82%|████████▏ | 31249/37963 [77:17:38<16:14:21,  8.71s/it]
 82%|████████▏ | 31250/37963 [77:17:46<15:45:02,  8.45s/it]
                                                           
{'loss': '0.09063', 'grad_norm': '2.274', 'learning_rate': '1.596e-06', 'epoch': '0.8232'}
+
 82%|████████▏ | 31250/37963 [77:17:46<15:45:02,  8.45s/it]
 82%|████████▏ | 31251/37963 [77:18:00<19:16:37, 10.34s/it]
 82%|████████▏ | 31252/37963 [77:18:08<17:31:42,  9.40s/it]
 82%|████████▏ | 31253/37963 [77:18:15<16:32:36,  8.88s/it]
 82%|████████▏ | 31254/37963 [77:18:23<15:51:13,  8.51s/it]
 82%|████████▏ | 31255/37963 [77:18:31<15:26:22,  8.29s/it]
 82%|████████▏ | 31256/37963 [77:18:38<15:08:40,  8.13s/it]
 82%|████████▏ | 31257/37963 [77:18:46<14:51:36,  7.98s/it]
 82%|████████▏ | 31258/37963 [77:18:54<14:41:11,  7.89s/it]
 82%|████████▏ | 31259/37963 [77:19:01<14:33:27,  7.82s/it]
 82%|████████▏ | 31260/37963 [77:19:09<14:25:01,  7.74s/it]
                                                           
{'loss': '0.09899', 'grad_norm': '3.054', 'learning_rate': '1.591e-06', 'epoch': '0.8234'}
+
 82%|████████▏ | 31260/37963 [77:19:09<14:25:01,  7.74s/it]
 82%|████████▏ | 31261/37963 [77:19:17<14:19:46,  7.70s/it]
 82%|████████▏ | 31262/37963 [77:19:24<14:09:05,  7.60s/it]
 82%|████████▏ | 31263/37963 [77:19:32<14:15:43,  7.66s/it]
 82%|████████▏ | 31264/37963 [77:19:39<14:12:50,  7.64s/it]
 82%|████████▏ | 31265/37963 [77:19:47<14:19:19,  7.70s/it]
 82%|████████▏ | 31266/37963 [77:20:02<18:22:58,  9.88s/it]
 82%|████████▏ | 31267/37963 [77:20:17<20:52:36, 11.22s/it]
 82%|████████▏ | 31268/37963 [77:20:24<18:43:16, 10.07s/it]
 82%|████████▏ | 31269/37963 [77:20:32<17:23:43,  9.36s/it]
 82%|████████▏ | 31270/37963 [77:20:46<20:06:31, 10.82s/it]
                                                           
{'loss': '0.0863', 'grad_norm': '2.993', 'learning_rate': '1.587e-06', 'epoch': '0.8237'}
+
 82%|████████▏ | 31270/37963 [77:20:46<20:06:31, 10.82s/it]
 82%|████████▏ | 31271/37963 [77:21:00<22:12:12, 11.94s/it]
 82%|████████▏ | 31272/37963 [77:21:08<19:49:28, 10.67s/it]
 82%|████████▏ | 31273/37963 [77:21:16<18:11:13,  9.79s/it]
 82%|████████▏ | 31274/37963 [77:21:24<17:02:35,  9.17s/it]
 82%|████████▏ | 31275/37963 [77:21:31<16:18:13,  8.78s/it]
 82%|████████▏ | 31276/37963 [77:21:39<15:36:52,  8.41s/it]
 82%|████████▏ | 31277/37963 [77:21:47<15:15:39,  8.22s/it]
 82%|████████▏ | 31278/37963 [77:22:01<18:42:38, 10.08s/it]
 82%|████████▏ | 31279/37963 [77:22:09<17:22:20,  9.36s/it]
 82%|████████▏ | 31280/37963 [77:22:17<16:28:40,  8.88s/it]
                                                           
{'loss': '0.1061', 'grad_norm': '3.941', 'learning_rate': '1.582e-06', 'epoch': '0.824'}
+
 82%|████████▏ | 31280/37963 [77:22:17<16:28:40,  8.88s/it]
 82%|████████▏ | 31281/37963 [77:22:24<15:52:53,  8.56s/it]
 82%|████████▏ | 31282/37963 [77:22:32<15:26:15,  8.32s/it]
 82%|████████▏ | 31283/37963 [77:22:40<14:56:50,  8.06s/it]
 82%|████████▏ | 31284/37963 [77:22:47<14:46:15,  7.96s/it]
 82%|████████▏ | 31285/37963 [77:22:55<14:35:38,  7.87s/it]
 82%|████████▏ | 31286/37963 [77:23:09<18:08:22,  9.78s/it]
 82%|████████▏ | 31287/37963 [77:23:17<16:57:22,  9.14s/it]
 82%|████████▏ | 31288/37963 [77:23:25<16:12:12,  8.74s/it]
 82%|████████▏ | 31289/37963 [77:23:33<15:43:33,  8.48s/it]
 82%|████████▏ | 31290/37963 [77:23:40<15:15:21,  8.23s/it]
                                                           
{'loss': '0.0877', 'grad_norm': '2.345', 'learning_rate': '1.578e-06', 'epoch': '0.8242'}
+
 82%|████████▏ | 31290/37963 [77:23:40<15:15:21,  8.23s/it]
 82%|████████▏ | 31291/37963 [77:23:48<14:56:59,  8.07s/it]
 82%|████���███▏ | 31292/37963 [77:23:56<14:42:24,  7.94s/it]
 82%|████████▏ | 31293/37963 [77:24:10<18:22:17,  9.92s/it]
 82%|████████▏ | 31294/37963 [77:24:18<17:11:06,  9.28s/it]
 82%|████████▏ | 31295/37963 [77:24:26<16:22:19,  8.84s/it]
 82%|████████▏ | 31296/37963 [77:24:33<15:44:07,  8.50s/it]
 82%|████████▏ | 31297/37963 [77:24:41<15:18:04,  8.26s/it]
 82%|████████▏ | 31298/37963 [77:24:49<14:59:15,  8.10s/it]
 82%|████████▏ | 31299/37963 [77:24:56<14:45:18,  7.97s/it]
 82%|████████▏ | 31300/37963 [77:25:04<14:36:26,  7.89s/it]
                                                           
{'loss': '0.09014', 'grad_norm': '2.584', 'learning_rate': '1.573e-06', 'epoch': '0.8245'}
+
 82%|████████▏ | 31300/37963 [77:25:04<14:36:26,  7.89s/it]
 82%|████████▏ | 31301/37963 [77:25:20<18:50:44, 10.18s/it]
 82%|████████▏ | 31302/37963 [77:25:27<17:25:02,  9.41s/it]
 82%|████████▏ | 31303/37963 [77:25:35<16:25:36,  8.88s/it]
 82%|████████▏ | 31304/37963 [77:25:43<15:44:32,  8.51s/it]
 82%|████████▏ | 31305/37963 [77:25:50<15:16:45,  8.26s/it]
 82%|████████▏ | 31306/37963 [77:25:58<14:53:13,  8.05s/it]
 82%|████████▏ | 31307/37963 [77:26:05<14:38:03,  7.92s/it]
 82%|████████▏ | 31308/37963 [77:26:13<14:22:24,  7.78s/it]
 82%|████████▏ | 31309/37963 [77:26:21<14:23:41,  7.79s/it]
 82%|████████▏ | 31310/37963 [77:26:28<14:21:50,  7.77s/it]
                                                           
{'loss': '0.09578', 'grad_norm': '2.205', 'learning_rate': '1.568e-06', 'epoch': '0.8248'}
+
 82%|████████▏ | 31310/37963 [77:26:28<14:21:50,  7.77s/it]
 82%|████████▏ | 31311/37963 [77:26:43<18:13:01,  9.86s/it]
 82%|████████▏ | 31312/37963 [77:26:51<17:00:58,  9.21s/it]
 82%|████████▏ | 31313/37963 [77:26:59<16:08:30,  8.74s/it]
 82%|████████▏ | 31314/37963 [77:27:06<15:35:01,  8.44s/it]
 82%|████████▏ | 31315/37963 [77:27:14<15:05:19,  8.17s/it]
 82%|████████▏ | 31316/37963 [77:27:22<14:54:51,  8.08s/it]
 82%|████████▏ | 31317/37963 [77:27:29<14:43:27,  7.98s/it]
 82%|████████▏ | 31318/37963 [77:27:44<18:19:56,  9.93s/it]
 82%|████████▏ | 31319/37963 [77:27:59<20:56:15, 11.34s/it]
 83%|████████▎ | 31320/37963 [77:28:06<18:53:36, 10.24s/it]
                                                           
{'loss': '0.1031', 'grad_norm': '2.518', 'learning_rate': '1.564e-06', 'epoch': '0.825'}
+
 83%|████████▎ | 31320/37963 [77:28:06<18:53:36, 10.24s/it]
 83%|████████▎ | 31321/37963 [77:28:14<17:24:16,  9.43s/it]
 83%|████████▎ | 31322/37963 [77:28:21<16:26:19,  8.91s/it]
 83%|████████▎ | 31323/37963 [77:28:29<15:44:24,  8.53s/it]
 83%|████████▎ | 31324/37963 [77:28:43<18:47:20, 10.19s/it]
 83%|████████▎ | 31325/37963 [77:28:51<17:27:50,  9.47s/it]
 83%|████████▎ | 31326/37963 [77:28:59<16:32:05,  8.97s/it]
 83%|████████▎ | 31327/37963 [77:29:06<15:50:40,  8.60s/it]
 83%|████████▎ | 31328/37963 [77:29:14<15:23:25,  8.35s/it]
 83%|████████▎ | 31329/37963 [77:29:22<15:01:22,  8.15s/it]
 83%|████████▎ | 31330/37963 [77:29:36<18:29:15, 10.03s/it]
                                                           
{'loss': '0.1002', 'grad_norm': '3.35', 'learning_rate': '1.559e-06', 'epoch': '0.8253'}
+
 83%|████████▎ | 31330/37963 [77:29:36<18:29:15, 10.03s/it]
 83%|████████▎ | 31331/37963 [77:29:51<20:54:46, 11.35s/it]
 83%|████████▎ | 31332/37963 [77:29:58<18:50:05, 10.23s/it]
 83%|████████▎ | 31333/37963 [77:30:06<17:28:48,  9.49s/it]
 83%|████████▎ | 31334/37963 [77:30:14<16:24:47,  8.91s/it]
 83%|████████▎ | 31335/37963 [77:30:21<15:45:47,  8.56s/it]
 83%|████████▎ | 31336/37963 [77:30:29<15:16:17,  8.30s/it]
 83%|████████▎ | 31337/37963 [77:30:37<14:54:21,  8.10s/it]
 83%|████████▎ | 31338/37963 [77:30:51<18:33:29, 10.08s/it]
 83%|████████▎ | 31339/37963 [77:30:59<17:13:25,  9.36s/it]
 83%|████████▎ | 31340/37963 [77:31:07<16:12:31,  8.81s/it]
                                                           
{'loss': '0.09794', 'grad_norm': '3.042', 'learning_rate': '1.555e-06', 'epoch': '0.8255'}
+
 83%|████████▎ | 31340/37963 [77:31:07<16:12:31,  8.81s/it]
 83%|████████▎ | 31341/37963 [77:31:15<15:39:49,  8.52s/it]
 83%|████████▎ | 31342/37963 [77:31:22<15:14:08,  8.28s/it]
 83%|█���██████▎ | 31343/37963 [77:31:30<14:54:55,  8.11s/it]
 83%|████████▎ | 31344/37963 [77:31:38<14:39:18,  7.97s/it]
 83%|████████▎ | 31345/37963 [77:31:45<14:35:19,  7.94s/it]
 83%|████████▎ | 31346/37963 [77:31:53<14:32:07,  7.91s/it]
 83%|████████▎ | 31347/37963 [77:32:08<18:02:17,  9.82s/it]
 83%|████████▎ | 31348/37963 [77:32:15<16:55:24,  9.21s/it]
 83%|████████▎ | 31349/37963 [77:32:23<16:05:49,  8.76s/it]
 83%|████████▎ | 31350/37963 [77:32:31<15:28:15,  8.42s/it]
                                                           
{'loss': '0.08379', 'grad_norm': '1.814', 'learning_rate': '1.55e-06', 'epoch': '0.8258'}
+
 83%|████████▎ | 31350/37963 [77:32:31<15:28:15,  8.42s/it]
 83%|████████▎ | 31351/37963 [77:32:38<15:06:43,  8.23s/it]
 83%|████████▎ | 31352/37963 [77:32:46<14:52:06,  8.10s/it]
 83%|████████▎ | 31353/37963 [77:32:54<14:38:33,  7.97s/it]
 83%|████████▎ | 31354/37963 [77:33:02<14:30:11,  7.90s/it]
 83%|████████▎ | 31355/37963 [77:33:09<14:24:53,  7.85s/it]
 83%|████████▎ | 31356/37963 [77:33:17<14:19:03,  7.80s/it]
 83%|████████▎ | 31357/37963 [77:33:25<14:14:10,  7.76s/it]
 83%|████████▎ | 31358/37963 [77:33:32<14:12:38,  7.75s/it]
 83%|████████▎ | 31359/37963 [77:33:40<14:07:24,  7.70s/it]
 83%|████████▎ | 31360/37963 [77:33:48<14:08:35,  7.71s/it]
                                                           
{'loss': '0.09169', 'grad_norm': '3.118', 'learning_rate': '1.546e-06', 'epoch': '0.8261'}
+
 83%|████████▎ | 31360/37963 [77:33:48<14:08:35,  7.71s/it]
 83%|████████▎ | 31361/37963 [77:34:03<18:00:30,  9.82s/it]
 83%|████████▎ | 31362/37963 [77:34:10<16:52:49,  9.21s/it]
 83%|████████▎ | 31363/37963 [77:34:25<19:44:51, 10.77s/it]
 83%|████████▎ | 31364/37963 [77:34:32<18:03:27,  9.85s/it]
 83%|████████▎ | 31365/37963 [77:34:40<16:51:09,  9.20s/it]
 83%|████████▎ | 31366/37963 [77:34:48<16:04:07,  8.77s/it]
 83%|████████▎ | 31367/37963 [77:35:02<19:13:38, 10.49s/it]
 83%|████████▎ | 31368/37963 [77:35:10<17:40:19,  9.65s/it]
 83%|████████▎ | 31369/37963 [77:35:18<16:30:17,  9.01s/it]
 83%|████████▎ | 31370/37963 [77:35:25<15:46:46,  8.62s/it]
                                                           
{'loss': '0.08745', 'grad_norm': '2.08', 'learning_rate': '1.541e-06', 'epoch': '0.8263'}
+
 83%|████████▎ | 31370/37963 [77:35:25<15:46:46,  8.62s/it]
 83%|████████▎ | 31371/37963 [77:35:33<15:11:47,  8.30s/it]
 83%|████████▎ | 31372/37963 [77:35:41<14:52:17,  8.12s/it]
 83%|████████▎ | 31373/37963 [77:35:48<14:39:59,  8.01s/it]
 83%|████████▎ | 31374/37963 [77:35:56<14:20:30,  7.84s/it]
 83%|████████▎ | 31375/37963 [77:36:10<17:59:16,  9.83s/it]
 83%|████████▎ | 31376/37963 [77:36:18<16:47:10,  9.17s/it]
 83%|████████▎ | 31377/37963 [77:36:26<15:58:34,  8.73s/it]
 83%|████████▎ | 31378/37963 [77:36:46<22:38:26, 12.38s/it]
 83%|████████▎ | 31379/37963 [77:36:54<20:08:57, 11.02s/it]
 83%|████████▎ | 31380/37963 [77:37:02<18:18:34, 10.01s/it]
                                                           
{'loss': '0.089', 'grad_norm': '2.667', 'learning_rate': '1.537e-06', 'epoch': '0.8266'}
+
 83%|████████▎ | 31380/37963 [77:37:02<18:18:34, 10.01s/it]
 83%|████████▎ | 31381/37963 [77:37:09<16:54:16,  9.25s/it]
 83%|████████▎ | 31382/37963 [77:37:17<16:03:19,  8.78s/it]
 83%|████████▎ | 31383/37963 [77:37:25<15:19:21,  8.38s/it]
 83%|████████▎ | 31384/37963 [77:37:32<14:56:21,  8.17s/it]
 83%|████████▎ | 31385/37963 [77:37:40<14:42:46,  8.05s/it]
 83%|████████▎ | 31386/37963 [77:37:54<18:10:25,  9.95s/it]
 83%|████████▎ | 31387/37963 [77:38:02<16:55:50,  9.27s/it]
 83%|████████▎ | 31388/37963 [77:38:10<16:01:16,  8.77s/it]
 83%|████████▎ | 31389/37963 [77:38:17<15:26:31,  8.46s/it]
 83%|████████▎ | 31390/37963 [77:38:25<14:55:09,  8.17s/it]
                                                           
{'loss': '0.08772', 'grad_norm': '2.172', 'learning_rate': '1.532e-06', 'epoch': '0.8269'}
+
 83%|████████▎ | 31390/37963 [77:38:25<14:55:09,  8.17s/it]
 83%|████████▎ | 31391/37963 [77:38:33<14:39:37,  8.03s/it]
 83%|████████▎ | 31392/37963 [77:38:40<14:24:14,  7.89s/it]
 83%|████████▎ | 31393/37963 [77:38:48<14:18:50,  7.84s/it]
 83%|████████▎ | 31394/37963 [77:38:56<14:13:49,  7.80s/it]
 83%|████████▎ | 31395/37963 [77:39:03<14:06:59,  7.74s/it]
 83%|████████▎ | 31396/37963 [77:39:11<14:03:48,  7.71s/it]
 83%|████████▎ | 31397/37963 [77:39:19<14:00:58,  7.68s/it]
 83%|████████▎ | 31398/37963 [77:39:26<13:57:44,  7.66s/it]
 83%|████████▎ | 31399/37963 [77:39:34<13:55:37,  7.64s/it]
 83%|████████▎ | 31400/37963 [77:39:42<14:01:59,  7.70s/it]
                                                           
{'loss': '0.1072', 'grad_norm': '2.956', 'learning_rate': '1.527e-06', 'epoch': '0.8271'}
+
 83%|████████▎ | 31400/37963 [77:39:42<14:01:59,  7.70s/it]
 83%|████████▎ | 31401/37963 [77:39:49<14:03:56,  7.72s/it]
 83%|████████▎ | 31402/37963 [77:40:04<17:52:18,  9.81s/it]
 83%|████████▎ | 31403/37963 [77:40:12<16:46:18,  9.20s/it]
 83%|████████▎ | 31404/37963 [77:40:19<15:55:15,  8.74s/it]
 83%|████████▎ | 31405/37963 [77:40:27<15:22:16,  8.44s/it]
 83%|████████▎ | 31406/37963 [77:40:35<15:02:02,  8.25s/it]
 83%|████████▎ | 31407/37963 [77:40:43<14:41:56,  8.07s/it]
 83%|████████▎ | 31408/37963 [77:40:50<14:30:13,  7.97s/it]
 83%|████████▎ | 31409/37963 [77:41:05<18:17:44, 10.05s/it]
 83%|████████▎ | 31410/37963 [77:41:13<17:00:33,  9.34s/it]
                                                           
{'loss': '0.09533', 'grad_norm': '2.822', 'learning_rate': '1.523e-06', 'epoch': '0.8274'}
+
 83%|████████▎ | 31410/37963 [77:41:13<17:00:33,  9.34s/it]
 83%|████████▎ | 31411/37963 [77:41:21<16:06:41,  8.85s/it]
 83%|████████▎ | 31412/37963 [77:41:28<15:31:56,  8.54s/it]
 83%|████████▎ | 31413/37963 [77:41:36<15:02:39,  8.27s/it]
 83%|████████▎ | 31414/37963 [77:41:50<18:20:41, 10.08s/it]
 83%|████████▎ | 31415/37963 [77:41:58<17:07:49,  9.42s/it]
 83%|████████▎ | 31416/37963 [77:42:13<19:53:19, 10.94s/it]
 83%|████████▎ | 31417/37963 [77:42:20<17:59:34,  9.90s/it]
 83%|████████▎ | 31418/37963 [77:42:28<16:43:02,  9.20s/it]
 83%|████████▎ | 31419/37963 [77:42:35<15:52:11,  8.73s/it]
 83%|████████▎ | 31420/37963 [77:42:43<15:17:42,  8.42s/it]
                                                           
{'loss': '0.08373', 'grad_norm': '2.102', 'learning_rate': '1.518e-06', 'epoch': '0.8277'}
+
 83%|████████▎ | 31420/37963 [77:42:43<15:17:42,  8.42s/it]
 83%|████████▎ | 31421/37963 [77:42:51<14:56:13,  8.22s/it]
 83%|████████▎ | 31422/37963 [77:43:05<18:01:10,  9.92s/it]
 83%|████████▎ | 31423/37963 [77:43:12<16:49:09,  9.26s/it]
 83%|████████▎ | 31424/37963 [77:43:20<15:53:09,  8.75s/it]
 83%|████████▎ | 31425/37963 [77:43:28<15:24:09,  8.48s/it]
 83%|████████▎ | 31426/37963 [77:43:42<18:29:32, 10.18s/it]
 83%|████████▎ | 31427/37963 [77:43:50<17:01:33,  9.38s/it]
 83%|████████▎ | 31428/37963 [77:43:57<15:59:00,  8.81s/it]
 83%|████████▎ | 31429/37963 [77:44:11<18:55:09, 10.42s/it]
 83%|████████▎ | 31430/37963 [77:44:19<17:24:12,  9.59s/it]
                                                           
{'loss': '0.09754', 'grad_norm': '2.833', 'learning_rate': '1.514e-06', 'epoch': '0.8279'}
+
 83%|████████▎ | 31430/37963 [77:44:19<17:24:12,  9.59s/it]
 83%|████████▎ | 31431/37963 [77:44:27<16:21:13,  9.01s/it]
 83%|████████▎ | 31432/37963 [77:44:34<15:37:49,  8.62s/it]
 83%|████████▎ | 31433/37963 [77:44:42<15:09:08,  8.35s/it]
 83%|████████▎ | 31434/37963 [77:44:57<18:37:00, 10.27s/it]
 83%|████████▎ | 31435/37963 [77:45:05<17:17:39,  9.54s/it]
 83%|████████▎ | 31436/37963 [77:45:12<16:10:51,  8.92s/it]
 83%|████████▎ | 31437/37963 [77:45:20<15:29:47,  8.55s/it]
 83%|████████▎ | 31438/37963 [77:45:28<15:06:26,  8.34s/it]
 83%|████████▎ | 31439/37963 [77:45:35<14:48:39,  8.17s/it]
 83%|████████▎ | 31440/37963 [77:45:43<14:33:09,  8.03s/it]
                                                           
{'loss': '0.08812', 'grad_norm': '2.703', 'learning_rate': '1.509e-06', 'epoch': '0.8282'}
+
 83%|████████▎ | 31440/37963 [77:45:43<14:33:09,  8.03s/it]
 83%|████████▎ | 31441/37963 [77:45:51<14:28:23,  7.99s/it]
 83%|████████▎ | 31442/37963 [77:45:59<14:19:26,  7.91s/it]
 83%|████████▎ | 31443/37963 [77:46:06<14:09:14,  7.82s/it]
 83%|████████▎ | 31444/37963 [77:46:14<14:09:11,  7.82s/it]
 83%|████████▎ | 31445/37963 [77:46:21<13:55:22,  7.69s/it]
 83%|████████▎ | 31446/37963 [77:46:29<13:53:06,  7.67s/it]
 83%|████████▎ | 31447/37963 [77:46:43<17:25:37,  9.63s/it]
 83%|████████▎ | 31448/37963 [77:46:51<16:23:03,  9.05s/it]
 83%|████████▎ | 31449/37963 [77:46:59<15:36:57,  8.63s/it]
 83%|████████▎ | 31450/37963 [77:47:06<15:05:43,  8.34s/it]
                                                           
{'loss': '0.09812', 'grad_norm': '2.936', 'learning_rate': '1.505e-06', 'epoch': '0.8284'}
+
 83%|████████▎ | 31450/37963 [77:47:06<15:05:43,  8.34s/it]
 83%|████████▎ | 31451/37963 [77:47:14<14:33:14,  8.05s/it]
 83%|████████▎ | 31452/37963 [77:47:21<14:23:57,  7.96s/it]
 83%|████████▎ | 31453/37963 [77:47:29<14:13:16,  7.86s/it]
 83%|████████▎ | 31454/37963 [77:47:36<13:59:02,  7.73s/it]
 83%|████████▎ | 31455/37963 [77:47:44<13:56:43,  7.71s/it]
 83%|████████▎ | 31456/37963 [77:47:52<13:57:24,  7.72s/it]
 83%|████████▎ | 31457/37963 [77:48:00<13:55:37,  7.71s/it]
 83%|████████▎ | 31458/37963 [77:48:07<13:55:51,  7.71s/it]
 83%|████████▎ | 31459/37963 [77:48:15<13:53:37,  7.69s/it]
 83%|████████▎ | 31460/37963 [77:48:23<13:52:38,  7.68s/it]
                                                           
{'loss': '0.09379', 'grad_norm': '2.485', 'learning_rate': '1.5e-06', 'epoch': '0.8287'}
+
 83%|████████▎ | 31460/37963 [77:48:23<13:52:38,  7.68s/it]
 83%|████████▎ | 31461/37963 [77:48:30<13:54:21,  7.70s/it]
 83%|████████▎ | 31462/37963 [77:48:45<17:47:34,  9.85s/it]
 83%|████████▎ | 31463/37963 [77:48:53<16:38:35,  9.22s/it]
 83%|████████▎ | 31464/37963 [77:49:14<23:15:45, 12.89s/it]
 83%|████████▎ | 31465/37963 [77:49:29<23:56:04, 13.26s/it]
 83%|████████▎ | 31466/37963 [77:49:36<20:56:44, 11.61s/it]
 83%|████████▎ | 31467/37963 [77:49:44<18:46:51, 10.41s/it]
 83%|████████▎ | 31468/37963 [77:49:52<17:18:42,  9.60s/it]
 83%|████████▎ | 31469/37963 [77:49:59<16:16:54,  9.03s/it]
 83%|████████▎ | 31470/37963 [77:50:07<15:34:59,  8.64s/it]
                                                           
{'loss': '0.09382', 'grad_norm': '2.664', 'learning_rate': '1.496e-06', 'epoch': '0.829'}
+
 83%|████████▎ | 31470/37963 [77:50:07<15:34:59,  8.64s/it]
 83%|████████▎ | 31471/37963 [77:50:15<14:57:52,  8.30s/it]
 83%|████████▎ | 31472/37963 [77:50:22<14:42:06,  8.15s/it]
 83%|████████▎ | 31473/37963 [77:50:37<18:02:04, 10.00s/it]
 83%|████████▎ | 31474/37963 [77:50:44<16:49:38,  9.34s/it]
 83%|████████▎ | 31475/37963 [77:50:52<15:48:38,  8.77s/it]
 83%|████████▎ | 31476/37963 [77:50:59<15:09:21,  8.41s/it]
 83%|████████▎ | 31477/37963 [77:51:07<14:43:28,  8.17s/it]
 83%|████████▎ | 31478/37963 [77:51:21<17:51:39,  9.92s/it]
 83%|████████▎ | 31479/37963 [77:51:29<16:40:22,  9.26s/it]
 83%|████████▎ | 31480/37963 [77:51:43<19:18:58, 10.73s/it]
                                                           
{'loss': '0.09246', 'grad_norm': '2.406', 'learning_rate': '1.491e-06', 'epoch': '0.8292'}
+
 83%|████████▎ | 31480/37963 [77:51:43<19:18:58, 10.73s/it]
 83%|████████▎ | 31481/37963 [77:51:51<17:45:10,  9.86s/it]
 83%|████████▎ | 31482/37963 [77:51:59<16:36:52,  9.23s/it]
 83%|████████▎ | 31483/37963 [77:52:06<15:43:20,  8.73s/it]
 83%|████████▎ | 31484/37963 [77:52:14<15:05:33,  8.39s/it]
 83%|████████▎ | 31485/37963 [77:52:21<14:34:44,  8.10s/it]
 83%|████████▎ | 31486/37963 [77:52:29<14:18:50,  7.96s/it]
 83%|████████▎ | 31487/37963 [77:52:37<14:13:41,  7.91s/it]
 83%|████████▎ | 31488/37963 [77:52:44<14:06:48,  7.85s/it]
 83%|████████▎ | 31489/37963 [77:52:52<14:00:24,  7.79s/it]
 83%|████████▎ | 31490/37963 [77:52:59<13:53:16,  7.72s/it]
                                                           
{'loss': '0.09063', 'grad_norm': '3.019', 'learning_rate': '1.487e-06', 'epoch': '0.8295'}
+
 83%|████████▎ | 31490/37963 [77:52:59<13:53:16,  7.72s/it]
 83%|████████▎ | 31491/37963 [77:53:07<13:51:01,  7.70s/it]
 83%|████████▎ | 31492/37963 [77:53:15<13:40:33,  7.61s/it]
 83%|████████▎ | 31493/37963 [77:53:22<13:49:24,  7.69s/it]
 83%|████████▎ | 31494/37963 [77:53:30<13:42:50,  7.63s/it]
 83%|████████▎ | 31495/37963 [77:53:45<17:44:34,  9.88s/it]
 83%|████████▎ | 31496/37963 [77:53:53<16:32:40,  9.21s/it]
 83%|████████▎ | 31497/37963 [77:54:00<15:42:43,  8.75s/it]
 83%|████████▎ | 31498/37963 [77:54:08<15:01:26,  8.37s/it]
 83%|████████▎ | 31499/37963 [77:54:15<14:39:04,  8.16s/it]
 83%|████████▎ | 31500/37963 [77:54:23<14:22:58,  8.01s/it]
                                                           
{'loss': '0.09309', 'grad_norm': '2.374', 'learning_rate': '1.482e-06', 'epoch': '0.8298'}
+
 83%|████████▎ | 31500/37963 [77:54:23<14:22:58,  8.01s/it]
 83%|████████▎ | 31501/37963 [77:54:31<14:07:42,  7.87s/it]
 83%|████████▎ | 31502/37963 [77:54:38<14:02:48,  7.83s/it]
 83%|████████▎ | 31503/37963 [77:54:46<13:58:20,  7.79s/it]
 83%|████████▎ | 31504/37963 [77:54:54<13:56:38,  7.77s/it]
 83%|████████▎ | 31505/37963 [77:55:02<13:53:38,  7.75s/it]
 83%|████████▎ | 31506/37963 [77:55:09<13:53:45,  7.75s/it]
 83%|████████▎ | 31507/37963 [77:55:17<13:52:12,  7.73s/it]
 83%|████████▎ | 31508/37963 [77:55:25<13:50:39,  7.72s/it]
 83%|████████▎ | 31509/37963 [77:55:39<17:31:42,  9.78s/it]
 83%|████████▎ | 31510/37963 [77:55:47<16:13:42,  9.05s/it]
                                                           
{'loss': '0.0924', 'grad_norm': '2.331', 'learning_rate': '1.478e-06', 'epoch': '0.83'}
+
 83%|████████▎ | 31510/37963 [77:55:47<16:13:42,  9.05s/it]
 83%|████████▎ | 31511/37963 [77:56:01<19:15:32, 10.75s/it]
 83%|████████▎ | 31512/37963 [77:56:16<21:09:20, 11.81s/it]
 83%|████████▎ | 31513/37963 [77:56:23<18:57:58, 10.59s/it]
 83%|████████▎ | 31514/37963 [77:56:31<17:26:56,  9.74s/it]
 83%|████████▎ | 31515/37963 [77:56:38<16:10:25,  9.03s/it]
 83%|████████▎ | 31516/37963 [77:56:46<15:19:48,  8.56s/it]
 83%|████████▎ | 31517/37963 [77:57:00<18:19:40, 10.24s/it]
 83%|████████▎ | 31518/37963 [77:57:08<16:59:20,  9.49s/it]
 83%|████████▎ | 31519/37963 [77:57:15<16:00:09,  8.94s/it]
 83%|████████▎ | 31520/37963 [77:57:23<15:19:14,  8.56s/it]
                                                           
{'loss': '0.09631', 'grad_norm': '3.021', 'learning_rate': '1.474e-06', 'epoch': '0.8303'}
+
 83%|████████▎ | 31520/37963 [77:57:23<15:19:14,  8.56s/it]
 83%|████████▎ | 31521/37963 [77:57:31<14:48:02,  8.27s/it]
 83%|████████▎ | 31522/37963 [77:57:38<14:28:52,  8.09s/it]
 83%|████████▎ | 31523/37963 [77:57:46<14:16:30,  7.98s/it]
 83%|████████▎ | 31524/37963 [77:58:01<17:44:46,  9.92s/it]
 83%|████████▎ | 31525/37963 [77:58:08<16:34:41,  9.27s/it]
 83%|████████▎ | 31526/37963 [77:58:16<15:43:07,  8.79s/it]
 83%|████████▎ | 31527/37963 [77:58:31<18:58:45, 10.62s/it]
 83%|████████▎ | 31528/37963 [77:58:38<17:13:52,  9.64s/it]
 83%|████████▎ | 31529/37963 [77:58:46<16:10:38,  9.05s/it]
 83%|████████▎ | 31530/37963 [77:58:54<15:26:42,  8.64s/it]
                                                           
{'loss': '0.09782', 'grad_norm': '2.758', 'learning_rate': '1.469e-06', 'epoch': '0.8305'}
+
 83%|████████▎ | 31530/37963 [77:58:54<15:26:42,  8.64s/it]
 83%|████████▎ | 31531/37963 [77:59:01<14:48:55,  8.29s/it]
 83%|████████▎ | 31532/37963 [77:59:09<14:26:11,  8.08s/it]
 83%|████████▎ | 31533/37963 [77:59:16<14:09:16,  7.92s/it]
 83%|████████▎ | 31534/37963 [77:59:24<14:02:47,  7.87s/it]
 83%|████████▎ | 31535/37963 [77:59:32<13:56:12,  7.81s/it]
 83%|████████▎ | 31536/37963 [77:59:39<13:54:22,  7.79s/it]
 83%|████████▎ | 31537/37963 [77:59:47<13:52:40,  7.77s/it]
 83%|████████▎ | 31538/37963 [77:59:55<13:56:53,  7.82s/it]
 83%|████████▎ | 31539/37963 [78:00:02<13:44:09,  7.70s/it]
 83%|████████▎ | 31540/37963 [78:00:10<13:45:10,  7.71s/it]
                                                           
{'loss': '0.1027', 'grad_norm': '3.668', 'learning_rate': '1.465e-06', 'epoch': '0.8308'}
+
 83%|████████▎ | 31540/37963 [78:00:10<13:45:10,  7.71s/it]
 83%|████████▎ | 31541/37963 [78:00:18<13:45:29,  7.71s/it]
 83%|████████▎ | 31542/37963 [78:00:26<13:42:39,  7.69s/it]
 83%|████████▎ | 31543/37963 [78:00:40<17:26:21,  9.78s/it]
 83%|████████▎ | 31544/37963 [78:00:48<16:19:43,  9.16s/it]
 83%|████████▎ | 31545/37963 [78:00:56<15:34:05,  8.73s/it]
 83%|████████▎ | 31546/37963 [78:01:03<15:00:37,  8.42s/it]
 83%|████████▎ | 31547/37963 [78:01:11<14:31:24,  8.15s/it]
 83%|████████▎ | 31548/37963 [78:01:19<14:17:22,  8.02s/it]
 83%|████████▎ | 31549/37963 [78:01:26<14:05:14,  7.91s/it]
 83%|████████▎ | 31550/37963 [78:01:34<14:01:55,  7.88s/it]
                                                           
{'loss': '0.09289', 'grad_norm': '2.384', 'learning_rate': '1.46e-06', 'epoch': '0.8311'}
+
 83%|████████▎ | 31550/37963 [78:01:34<14:01:55,  7.88s/it]
 83%|████████▎ | 31551/37963 [78:01:42<13:58:58,  7.85s/it]
 83%|████████▎ | 31552/37963 [78:01:49<13:47:19,  7.74s/it]
 83%|████████▎ | 31553/37963 [78:01:57<13:49:38,  7.77s/it]
 83%|████████▎ | 31554/37963 [78:02:05<13:47:26,  7.75s/it]
 83%|████████▎ | 31555/37963 [78:02:19<17:15:08,  9.69s/it]
 83%|████████▎ | 31556/37963 [78:02:27<16:18:24,  9.16s/it]
 83%|████████▎ | 31557/37963 [78:02:34<15:24:52,  8.66s/it]
 83%|████████▎ | 31558/37963 [78:02:42<14:57:00,  8.40s/it]
 83%|████████▎ | 31559/37963 [78:02:58<18:38:32, 10.48s/it]
 83%|████████▎ | 31560/37963 [78:03:05<17:12:14,  9.67s/it]
                                                           
{'loss': '0.08063', 'grad_norm': '2.869', 'learning_rate': '1.456e-06', 'epoch': '0.8313'}
+
 83%|████████▎ | 31560/37963 [78:03:05<17:12:14,  9.67s/it]
 83%|████████▎ | 31561/37963 [78:03:20<19:55:37, 11.21s/it]
 83%|████████▎ | 31562/37963 [78:03:28<18:07:18, 10.19s/it]
 83%|████████▎ | 31563/37963 [78:03:42<20:21:11, 11.45s/it]
 83%|████████▎ | 31564/37963 [78:03:50<18:23:12, 10.34s/it]
 83%|████████▎ | 31565/37963 [78:03:58<16:55:04,  9.52s/it]
 83%|████████▎ | 31566/37963 [78:04:05<15:55:41,  8.96s/it]
 83%|████████▎ | 31567/37963 [78:04:13<15:09:01,  8.53s/it]
 83%|████████▎ | 31568/37963 [78:04:27<18:19:32, 10.32s/it]
 83%|████████▎ | 31569/37963 [78:04:35<16:53:38,  9.51s/it]
 83%|████████▎ | 31570/37963 [78:04:43<15:48:07,  8.90s/it]
                                                           
{'loss': '0.08635', 'grad_norm': '2.759', 'learning_rate': '1.451e-06', 'epoch': '0.8316'}
+
 83%|████████▎ | 31570/37963 [78:04:43<15:48:07,  8.90s/it]
 83%|████████▎ | 31571/37963 [78:04:50<15:13:46,  8.58s/it]
 83%|████████▎ | 31572/37963 [78:04:58<14:45:32,  8.31s/it]
 83%|████████▎ | 31573/37963 [78:05:06<14:26:50,  8.14s/it]
 83%|████████▎ | 31574/37963 [78:05:14<14:14:07,  8.02s/it]
 83%|████████▎ | 31575/37963 [78:05:28<17:32:19,  9.88s/it]
 83%|████████▎ | 31576/37963 [78:05:35<16:21:05,  9.22s/it]
 83%|████████▎ | 31577/37963 [78:05:50<19:06:25, 10.77s/it]
 83%|████████▎ | 31578/37963 [78:05:57<17:26:27,  9.83s/it]
 83%|████████▎ | 31579/37963 [78:06:05<16:20:06,  9.21s/it]
 83%|████████▎ | 31580/37963 [78:06:13<15:39:19,  8.83s/it]
                                                           
{'loss': '0.08257', 'grad_norm': '2.899', 'learning_rate': '1.447e-06', 'epoch': '0.8319'}
+
 83%|████████▎ | 31580/37963 [78:06:13<15:39:19,  8.83s/it]
 83%|████████▎ | 31581/37963 [78:06:21<15:05:08,  8.51s/it]
 83%|████████▎ | 31582/37963 [78:06:28<14:30:07,  8.18s/it]
 83%|████████▎ | 31583/37963 [78:06:36<14:09:40,  7.99s/it]
 83%|████████▎ | 31584/37963 [78:06:43<13:51:37,  7.82s/it]
 83%|████████▎ | 31585/37963 [78:06:51<13:46:17,  7.77s/it]
 83%|████████▎ | 31586/37963 [78:06:59<13:44:42,  7.76s/it]
 83%|████████▎ | 31587/37963 [78:07:06<13:41:05,  7.73s/it]
 83%|████████▎ | 31588/37963 [78:07:14<13:29:57,  7.62s/it]
 83%|████████▎ | 31589/37963 [78:07:21<13:20:45,  7.54s/it]
 83%|████████▎ | 31590/37963 [78:07:29<13:25:46,  7.59s/it]
                                                           
{'loss': '0.0891', 'grad_norm': '2.696', 'learning_rate': '1.442e-06', 'epoch': '0.8321'}
+
 83%|████████▎ | 31590/37963 [78:07:29<13:25:46,  7.59s/it]
 83%|████████▎ | 31591/37963 [78:07:36<13:25:06,  7.58s/it]
 83%|████████▎ | 31592/37963 [78:07:51<17:14:27,  9.74s/it]
 83%|████████▎ | 31593/37963 [78:07:59<16:05:41,  9.10s/it]
 83%|████████▎ | 31594/37963 [78:08:06<15:20:29,  8.67s/it]
 83%|████████▎ | 31595/37963 [78:08:14<14:48:20,  8.37s/it]
 83%|████████▎ | 31596/37963 [78:08:22<14:24:50,  8.15s/it]
 83%|████████▎ | 31597/37963 [78:08:29<14:07:49,  7.99s/it]
 83%|████████▎ | 31598/37963 [78:08:37<13:57:57,  7.90s/it]
 83%|████████▎ | 31599/37963 [78:08:44<13:42:00,  7.75s/it]
 83%|████████▎ | 31600/37963 [78:08:52<13:38:46,  7.72s/it]
                                                           
{'loss': '0.1079', 'grad_norm': '2.288', 'learning_rate': '1.438e-06', 'epoch': '0.8324'}
+
 83%|████████▎ | 31600/37963 [78:08:52<13:38:46,  7.72s/it]
 83%|████████▎ | 31601/37963 [78:09:00<13:37:21,  7.71s/it]
 83%|████████▎ | 31602/37963 [78:09:07<13:33:07,  7.67s/it]
 83%|████████▎ | 31603/37963 [78:09:15<13:34:27,  7.68s/it]
 83%|████████▎ | 31604/37963 [78:09:23<13:27:55,  7.62s/it]
 83%|████████▎ | 31605/37963 [78:09:30<13:31:20,  7.66s/it]
 83%|████████▎ | 31606/37963 [78:09:38<13:32:32,  7.67s/it]
 83%|████████▎ | 31607/37963 [78:09:52<17:01:24,  9.64s/it]
 83%|████████▎ | 31608/37963 [78:10:06<19:26:32, 11.01s/it]
 83%|████████▎ | 31609/37963 [78:10:20<21:00:25, 11.90s/it]
 83%|████████▎ | 31610/37963 [78:10:28<18:52:26, 10.70s/it]
                                                           
{'loss': '0.09034', 'grad_norm': '3.165', 'learning_rate': '1.434e-06', 'epoch': '0.8327'}
+
 83%|████████▎ | 31610/37963 [78:10:28<18:52:26, 10.70s/it]
 83%|████████▎ | 31611/37963 [78:10:36<17:17:26,  9.80s/it]
 83%|████████▎ | 31612/37963 [78:10:51<19:56:17, 11.30s/it]
 83%|████████▎ | 31613/37963 [78:10:59<18:07:55, 10.28s/it]
 83%|████████▎ | 31614/37963 [78:11:06<16:43:14,  9.48s/it]
 83%|████████▎ | 31615/37963 [78:11:14<15:36:44,  8.85s/it]
 83%|████████▎ | 31616/37963 [78:11:28<18:29:07, 10.48s/it]
 83%|████████▎ | 31617/37963 [78:11:36<17:05:49,  9.70s/it]
 83%|████████▎ | 31618/37963 [78:11:43<15:50:33,  8.99s/it]
 83%|████████▎ | 31619/37963 [78:11:51<15:08:58,  8.60s/it]
 83%|████████▎ | 31620/37963 [78:11:59<14:40:41,  8.33s/it]
                                                           
{'loss': '0.09237', 'grad_norm': '3.287', 'learning_rate': '1.429e-06', 'epoch': '0.8329'}
+
 83%|████████▎ | 31620/37963 [78:11:59<14:40:41,  8.33s/it]
 83%|████████▎ | 31621/37963 [78:12:06<14:19:33,  8.13s/it]
 83%|████████▎ | 31622/37963 [78:12:14<13:55:32,  7.91s/it]
 83%|████████▎ | 31623/37963 [78:12:21<13:38:20,  7.74s/it]
 83%|████████▎ | 31624/37963 [78:12:29<13:35:33,  7.72s/it]
 83%|████████▎ | 31625/37963 [78:12:36<13:32:52,  7.70s/it]
 83%|████████▎ | 31626/37963 [78:12:44<13:29:32,  7.66s/it]
 83%|████████▎ | 31627/37963 [78:12:52<13:34:19,  7.71s/it]
 83%|████████▎ | 31628/37963 [78:13:06<16:59:36,  9.66s/it]
 83%|████████▎ | 31629/37963 [78:13:20<19:28:34, 11.07s/it]
 83%|████████▎ | 31630/37963 [78:13:28<17:41:05, 10.05s/it]
                                                           
{'loss': '0.086', 'grad_norm': '2.604', 'learning_rate': '1.425e-06', 'epoch': '0.8332'}
+
 83%|████████▎ | 31630/37963 [78:13:28<17:41:05, 10.05s/it]
 83%|████████▎ | 31631/37963 [78:13:36<16:28:53,  9.37s/it]
 83%|████████▎ | 31632/37963 [78:13:43<15:32:28,  8.84s/it]
 83%|████████▎ | 31633/37963 [78:13:51<14:59:17,  8.52s/it]
 83%|████████▎ | 31634/37963 [78:13:59<14:31:54,  8.27s/it]
 83%|████████▎ | 31635/37963 [78:14:06<14:10:46,  8.07s/it]
 83%|████████▎ | 31636/37963 [78:14:14<13:47:49,  7.85s/it]
 83%|████████▎ | 31637/37963 [78:14:21<13:44:25,  7.82s/it]
 83%|████████▎ | 31638/37963 [78:14:36<17:22:39,  9.89s/it]
 83%|████████▎ | 31639/37963 [78:14:44<16:15:55,  9.26s/it]
 83%|████████▎ | 31640/37963 [78:14:52<15:28:41,  8.81s/it]
                                                           
{'loss': '0.08864', 'grad_norm': '4.465', 'learning_rate': '1.42e-06', 'epoch': '0.8334'}
+
 83%|████████▎ | 31640/37963 [78:14:52<15:28:41,  8.81s/it]
 83%|████████▎ | 31641/37963 [78:15:00<15:01:50,  8.56s/it]
 83%|████████▎ | 31642/37963 [78:15:07<14:35:22,  8.31s/it]
 83%|████████▎ | 31643/37963 [78:15:15<14:07:12,  8.04s/it]
 83%|████████▎ | 31644/37963 [78:15:23<13:55:29,  7.93s/it]
 83%|████████▎ | 31645/37963 [78:15:30<13:49:38,  7.88s/it]
 83%|████████▎ | 31646/37963 [78:15:38<13:49:13,  7.88s/it]
 83%|████████▎ | 31647/37963 [78:15:46<13:43:49,  7.83s/it]
 83%|███████���▎ | 31648/37963 [78:15:54<13:40:13,  7.79s/it]
 83%|████████▎ | 31649/37963 [78:16:01<13:36:56,  7.76s/it]
 83%|████████▎ | 31650/37963 [78:16:09<13:34:59,  7.75s/it]
                                                           
{'loss': '0.09463', 'grad_norm': '3.12', 'learning_rate': '1.416e-06', 'epoch': '0.8337'}
+
 83%|████████▎ | 31650/37963 [78:16:09<13:34:59,  7.75s/it]
 83%|████████▎ | 31651/37963 [78:16:23<17:05:26,  9.75s/it]
 83%|████████▎ | 31652/37963 [78:16:31<15:54:54,  9.08s/it]
 83%|████████▎ | 31653/37963 [78:16:38<15:07:56,  8.63s/it]
 83%|████████▎ | 31654/37963 [78:16:53<18:06:14, 10.33s/it]
 83%|████████▎ | 31655/37963 [78:17:01<16:43:31,  9.55s/it]
 83%|████████▎ | 31656/37963 [78:17:08<15:46:17,  9.00s/it]
 83%|████████▎ | 31657/37963 [78:17:16<15:02:11,  8.58s/it]
 83%|████████▎ | 31658/37963 [78:17:24<14:41:08,  8.39s/it]
 83%|████████▎ | 31659/37963 [78:17:31<14:09:35,  8.09s/it]
 83%|████████▎ | 31660/37963 [78:17:46<17:38:58, 10.08s/it]
                                                           
{'loss': '0.09267', 'grad_norm': '2.457', 'learning_rate': '1.412e-06', 'epoch': '0.834'}
+
 83%|████████▎ | 31660/37963 [78:17:46<17:38:58, 10.08s/it]
 83%|████████▎ | 31661/37963 [78:17:54<16:33:24,  9.46s/it]
 83%|████████▎ | 31662/37963 [78:18:01<15:31:49,  8.87s/it]
 83%|████████▎ | 31663/37963 [78:18:23<22:18:57, 12.75s/it]
 83%|████████▎ | 31664/37963 [78:18:31<19:40:43, 11.25s/it]
 83%|████████▎ | 31665/37963 [78:18:39<17:48:48, 10.18s/it]
 83%|████████▎ | 31666/37963 [78:18:46<16:26:59,  9.40s/it]
 83%|████████▎ | 31667/37963 [78:18:54<15:31:29,  8.88s/it]
 83%|████████▎ | 31668/37963 [78:19:02<14:53:02,  8.51s/it]
 83%|████████▎ | 31669/37963 [78:19:09<14:19:44,  8.20s/it]
 83%|████████▎ | 31670/37963 [78:19:17<14:03:25,  8.04s/it]
                                                           
{'loss': '0.09213', 'grad_norm': '2.17', 'learning_rate': '1.407e-06', 'epoch': '0.8342'}
+
 83%|████████▎ | 31670/37963 [78:19:17<14:03:25,  8.04s/it]
 83%|████████▎ | 31671/37963 [78:19:24<13:43:22,  7.85s/it]
 83%|████████▎ | 31672/37963 [78:19:39<17:16:25,  9.88s/it]
 83%|████████▎ | 31673/37963 [78:19:47<16:13:45,  9.29s/it]
 83%|████████▎ | 31674/37963 [78:19:54<15:19:14,  8.77s/it]
 83%|████████▎ | 31675/37963 [78:20:02<14:47:02,  8.46s/it]
 83%|████████▎ | 31676/37963 [78:20:10<14:21:03,  8.22s/it]
 83%|████████▎ | 31677/37963 [78:20:17<14:07:47,  8.09s/it]
 83%|████████▎ | 31678/37963 [78:20:25<13:58:02,  8.00s/it]
 83%|████████▎ | 31679/37963 [78:20:33<13:39:57,  7.83s/it]
 83%|████████▎ | 31680/37963 [78:20:40<13:35:09,  7.78s/it]
                                                           
{'loss': '0.08906', 'grad_norm': '2.855', 'learning_rate': '1.403e-06', 'epoch': '0.8345'}
+
 83%|████████▎ | 31680/37963 [78:20:40<13:35:09,  7.78s/it]
 83%|████████▎ | 31681/37963 [78:20:48<13:33:11,  7.77s/it]
 83%|████████▎ | 31682/37963 [78:20:56<13:30:48,  7.75s/it]
 83%|████████▎ | 31683/37963 [78:21:10<16:53:06,  9.68s/it]
 83%|████████▎ | 31684/37963 [78:21:18<15:50:24,  9.08s/it]
 83%|████████▎ | 31685/37963 [78:21:25<15:07:40,  8.67s/it]
 83%|████████▎ | 31686/37963 [78:21:33<14:40:51,  8.42s/it]
 83%|████████▎ | 31687/37963 [78:21:41<14:13:27,  8.16s/it]
 83%|████████▎ | 31688/37963 [78:21:56<17:48:52, 10.22s/it]
 83%|████████▎ | 31689/37963 [78:22:03<16:28:53,  9.46s/it]
 83%|████████▎ | 31690/37963 [78:22:11<15:32:58,  8.92s/it]
                                                           
{'loss': '0.1003', 'grad_norm': '2.778', 'learning_rate': '1.399e-06', 'epoch': '0.8348'}
+
 83%|████████▎ | 31690/37963 [78:22:11<15:32:58,  8.92s/it]
 83%|████████▎ | 31691/37963 [78:22:18<14:46:42,  8.48s/it]
 83%|████████▎ | 31692/37963 [78:22:26<14:19:44,  8.23s/it]
 83%|████████▎ | 31693/37963 [78:22:34<14:06:21,  8.10s/it]
 83%|████████▎ | 31694/37963 [78:22:41<13:49:43,  7.94s/it]
 83%|████████▎ | 31695/37963 [78:22:56<17:16:05,  9.92s/it]
 83%|████████▎ | 31696/37963 [78:23:04<16:03:53,  9.23s/it]
 83%|████████▎ | 31697/37963 [78:23:11<15:13:50,  8.75s/it]
 83%|████████▎ | 31698/37963 [78:23:19<14:53:05,  8.55s/it]
 83%|████���███▎ | 31699/37963 [78:23:27<14:26:06,  8.30s/it]
 84%|████████▎ | 31700/37963 [78:23:35<14:08:02,  8.12s/it]
                                                           
{'loss': '0.09479', 'grad_norm': '2.91', 'learning_rate': '1.394e-06', 'epoch': '0.835'}
+
 84%|████████▎ | 31700/37963 [78:23:35<14:08:02,  8.12s/it]
 84%|████████▎ | 31701/37963 [78:23:43<13:55:01,  8.00s/it]
 84%|████████▎ | 31702/37963 [78:23:50<13:50:17,  7.96s/it]
 84%|████████▎ | 31703/37963 [78:23:58<13:45:14,  7.91s/it]
 84%|████████▎ | 31704/37963 [78:24:06<13:38:38,  7.85s/it]
 84%|████████▎ | 31705/37963 [78:24:20<17:02:32,  9.80s/it]
 84%|████████▎ | 31706/37963 [78:24:28<15:49:25,  9.10s/it]
 84%|████████▎ | 31707/37963 [78:24:35<15:07:00,  8.70s/it]
 84%|████████▎ | 31708/37963 [78:24:57<21:52:38, 12.59s/it]
 84%|████████▎ | 31709/37963 [78:25:05<19:32:42, 11.25s/it]
 84%|████████▎ | 31710/37963 [78:25:13<17:39:59, 10.17s/it]
                                                           
{'loss': '0.08822', 'grad_norm': '2.812', 'learning_rate': '1.39e-06', 'epoch': '0.8353'}
+
 84%|████████▎ | 31710/37963 [78:25:13<17:39:59, 10.17s/it]
 84%|████████▎ | 31711/37963 [78:25:27<19:46:42, 11.39s/it]
 84%|████████▎ | 31712/37963 [78:25:35<17:53:39, 10.31s/it]
 84%|████████▎ | 31713/37963 [78:25:43<16:33:05,  9.53s/it]
 84%|████████▎ | 31714/37963 [78:25:50<15:34:19,  8.97s/it]
 84%|████████▎ | 31715/37963 [78:25:58<14:53:48,  8.58s/it]
 84%|████████▎ | 31716/37963 [78:26:06<14:31:07,  8.37s/it]
 84%|████████▎ | 31717/37963 [78:26:13<14:05:25,  8.12s/it]
 84%|████████▎ | 31718/37963 [78:26:21<13:45:00,  7.93s/it]
 84%|████████▎ | 31719/37963 [78:26:29<13:38:04,  7.86s/it]
 84%|████████▎ | 31720/37963 [78:26:43<16:56:39,  9.77s/it]
                                                           
{'loss': '0.08032', 'grad_norm': '2.54', 'learning_rate': '1.386e-06', 'epoch': '0.8356'}
+
 84%|████████▎ | 31720/37963 [78:26:43<16:56:39,  9.77s/it]
 84%|████████▎ | 31721/37963 [78:26:51<15:57:21,  9.20s/it]
 84%|████████▎ | 31722/37963 [78:26:58<15:09:15,  8.74s/it]
 84%|████████▎ | 31723/37963 [78:27:06<14:36:01,  8.42s/it]
 84%|████████▎ | 31724/37963 [78:27:14<14:13:37,  8.21s/it]
 84%|████████▎ | 31725/37963 [78:27:22<14:00:58,  8.09s/it]
 84%|████████▎ | 31726/37963 [78:27:29<13:51:24,  8.00s/it]
 84%|████████▎ | 31727/37963 [78:27:43<17:02:22,  9.84s/it]
 84%|████████▎ | 31728/37963 [78:27:51<16:05:26,  9.29s/it]
 84%|████████▎ | 31729/37963 [78:27:59<15:12:33,  8.78s/it]
 84%|████████▎ | 31730/37963 [78:28:07<14:37:55,  8.45s/it]
                                                           
{'loss': '0.1033', 'grad_norm': '2.508', 'learning_rate': '1.381e-06', 'epoch': '0.8358'}
+
 84%|████████▎ | 31730/37963 [78:28:07<14:37:55,  8.45s/it]
 84%|████████▎ | 31731/37963 [78:28:14<14:15:53,  8.24s/it]
 84%|████████▎ | 31732/37963 [78:28:29<17:44:58, 10.26s/it]
 84%|████████▎ | 31733/37963 [78:28:37<16:24:06,  9.48s/it]
 84%|████████▎ | 31734/37963 [78:28:45<15:28:11,  8.94s/it]
 84%|████████▎ | 31735/37963 [78:28:53<14:50:34,  8.58s/it]
 84%|████████▎ | 31736/37963 [78:29:00<14:24:09,  8.33s/it]
 84%|████████▎ | 31737/37963 [78:29:08<13:56:44,  8.06s/it]
 84%|████████▎ | 31738/37963 [78:29:15<13:44:46,  7.95s/it]
 84%|████████▎ | 31739/37963 [78:29:23<13:27:17,  7.78s/it]
 84%|████████▎ | 31740/37963 [78:29:30<13:22:10,  7.73s/it]
                                                           
{'loss': '0.09036', 'grad_norm': '2.508', 'learning_rate': '1.377e-06', 'epoch': '0.8361'}
+
 84%|████████▎ | 31740/37963 [78:29:30<13:22:10,  7.73s/it]
 84%|████████▎ | 31741/37963 [78:29:38<13:12:42,  7.64s/it]
 84%|████████▎ | 31742/37963 [78:29:46<13:14:45,  7.67s/it]
 84%|████████▎ | 31743/37963 [78:29:53<13:07:54,  7.60s/it]
 84%|████████▎ | 31744/37963 [78:30:01<13:10:39,  7.63s/it]
 84%|████████▎ | 31745/37963 [78:30:08<13:10:14,  7.63s/it]
 84%|████████▎ | 31746/37963 [78:30:16<13:13:08,  7.65s/it]
 84%|████████▎ | 31747/37963 [78:30:24<13:16:03,  7.68s/it]
 84%|████████▎ | 31748/37963 [78:30:38<16:35:31,  9.61s/it]
 84%|████████▎ | 31749/37963 [78:30:46<15:32:53,  9.01s/it]
 84%|█��██████▎ | 31750/37963 [78:30:53<14:54:12,  8.64s/it]
                                                           
{'loss': '0.09504', 'grad_norm': '1.986', 'learning_rate': '1.373e-06', 'epoch': '0.8363'}
+
 84%|████████▎ | 31750/37963 [78:30:53<14:54:12,  8.64s/it]
 84%|████████▎ | 31751/37963 [78:31:01<14:24:06,  8.35s/it]
 84%|████████▎ | 31752/37963 [78:31:08<13:53:24,  8.05s/it]
 84%|████████▎ | 31753/37963 [78:31:16<13:44:51,  7.97s/it]
 84%|████████▎ | 31754/37963 [78:31:31<17:08:37,  9.94s/it]
 84%|████████▎ | 31755/37963 [78:31:45<19:29:59, 11.31s/it]
 84%|████████▎ | 31756/37963 [78:31:53<17:30:30, 10.15s/it]
 84%|████████▎ | 31757/37963 [78:32:00<16:06:32,  9.34s/it]
 84%|████████▎ | 31758/37963 [78:32:07<15:06:00,  8.76s/it]
 84%|████████▎ | 31759/37963 [78:32:29<21:43:37, 12.61s/it]
 84%|████████▎ | 31760/37963 [78:32:36<19:00:08, 11.03s/it]
                                                           
{'loss': '0.09194', 'grad_norm': '2.114', 'learning_rate': '1.368e-06', 'epoch': '0.8366'}
+
 84%|████████▎ | 31760/37963 [78:32:36<19:00:08, 11.03s/it]
 84%|████████▎ | 31761/37963 [78:32:44<17:19:11, 10.05s/it]
 84%|████████▎ | 31762/37963 [78:32:52<16:01:31,  9.30s/it]
 84%|████████▎ | 31763/37963 [78:32:59<15:11:24,  8.82s/it]
 84%|████████▎ | 31764/37963 [78:33:07<14:36:57,  8.49s/it]
 84%|████████▎ | 31765/37963 [78:33:15<14:11:20,  8.24s/it]
 84%|████████▎ | 31766/37963 [78:33:22<13:48:52,  8.03s/it]
 84%|████████▎ | 31767/37963 [78:33:30<13:36:31,  7.91s/it]
 84%|████████▎ | 31768/37963 [78:33:38<13:30:30,  7.85s/it]
 84%|████████▎ | 31769/37963 [78:33:45<13:23:24,  7.78s/it]
 84%|████████▎ | 31770/37963 [78:33:53<13:17:48,  7.73s/it]
                                                           
{'loss': '0.09337', 'grad_norm': '2.884', 'learning_rate': '1.364e-06', 'epoch': '0.8369'}
+
 84%|████████▎ | 31770/37963 [78:33:53<13:17:48,  7.73s/it]
 84%|████████▎ | 31771/37963 [78:34:01<13:15:18,  7.71s/it]
 84%|████████▎ | 31772/37963 [78:34:08<13:16:31,  7.72s/it]
 84%|████████▎ | 31773/37963 [78:34:16<13:14:43,  7.70s/it]
 84%|████████▎ | 31774/37963 [78:34:30<16:41:28,  9.71s/it]
 84%|████████▎ | 31775/37963 [78:34:38<15:38:41,  9.10s/it]
 84%|████████▎ | 31776/37963 [78:34:46<14:54:15,  8.67s/it]
 84%|████████▎ | 31777/37963 [78:34:53<14:21:37,  8.36s/it]
 84%|████████▎ | 31778/37963 [78:35:01<13:59:12,  8.14s/it]
 84%|████████▎ | 31779/37963 [78:35:15<17:10:23, 10.00s/it]
 84%|████████▎ | 31780/37963 [78:35:23<16:01:58,  9.34s/it]
                                                           
{'loss': '0.09938', 'grad_norm': '2.61', 'learning_rate': '1.36e-06', 'epoch': '0.8371'}
+
 84%|████████▎ | 31780/37963 [78:35:23<16:01:58,  9.34s/it]
 84%|████████▎ | 31781/37963 [78:35:37<18:31:43, 10.79s/it]
 84%|████████▎ | 31782/37963 [78:35:45<16:55:48,  9.86s/it]
 84%|████████▎ | 31783/37963 [78:35:53<15:46:59,  9.19s/it]
 84%|████████▎ | 31784/37963 [78:36:00<14:59:26,  8.73s/it]
 84%|████████▎ | 31785/37963 [78:36:08<14:26:23,  8.41s/it]
 84%|████████▎ | 31786/37963 [78:36:16<14:01:56,  8.18s/it]
 84%|████████▎ | 31787/37963 [78:36:23<13:44:41,  8.01s/it]
 84%|████████▎ | 31788/37963 [78:36:31<13:35:05,  7.92s/it]
 84%|████████▎ | 31789/37963 [78:36:39<13:31:04,  7.88s/it]
 84%|████████▎ | 31790/37963 [78:36:46<13:15:27,  7.73s/it]
                                                           
{'loss': '0.08592', 'grad_norm': '2.399', 'learning_rate': '1.355e-06', 'epoch': '0.8374'}
+
 84%|████████▎ | 31790/37963 [78:36:46<13:15:27,  7.73s/it]
 84%|████████▎ | 31791/37963 [78:36:54<13:15:55,  7.74s/it]
 84%|████████▎ | 31792/37963 [78:37:01<13:13:48,  7.72s/it]
 84%|████████▎ | 31793/37963 [78:37:09<13:03:51,  7.62s/it]
 84%|████████▎ | 31794/37963 [78:37:23<16:35:34,  9.68s/it]
 84%|████████▍ | 31795/37963 [78:37:31<15:32:18,  9.07s/it]
 84%|████████▍ | 31796/37963 [78:37:39<14:49:53,  8.66s/it]
 84%|████████▍ | 31797/37963 [78:37:47<14:24:00,  8.41s/it]
 84%|████████▍ | 31798/37963 [78:38:02<17:51:31, 10.43s/it]
 84%|████████▍ | 31799/37963 [78:38:09<16:26:21,  9.60s/it]
 84%|████████▍ | 31800/37963 [78:38:17<15:18:47,  8.94s/it]
                                                           
{'loss': '0.101', 'grad_norm': '2.614', 'learning_rate': '1.351e-06', 'epoch': '0.8377'}
+
 84%|████████▍ | 31800/37963 [78:38:17<15:18:47,  8.94s/it]
 84%|████████▍ | 31801/37963 [78:38:24<14:29:21,  8.47s/it]
 84%|████████▍ | 31802/37963 [78:38:32<14:04:04,  8.22s/it]
 84%|████████▍ | 31803/37963 [78:38:46<17:17:38, 10.11s/it]
 84%|████████▍ | 31804/37963 [78:38:54<16:01:14,  9.36s/it]
 84%|████████▍ | 31805/37963 [78:39:01<14:55:03,  8.72s/it]
 84%|████████▍ | 31806/37963 [78:39:09<14:21:00,  8.39s/it]
 84%|████████▍ | 31807/37963 [78:39:16<13:58:11,  8.17s/it]
 84%|████████▍ | 31808/37963 [78:39:31<17:24:21, 10.18s/it]
 84%|████████▍ | 31809/37963 [78:39:39<16:09:28,  9.45s/it]
 84%|████████▍ | 31810/37963 [78:39:47<15:14:59,  8.92s/it]
                                                           
{'loss': '0.09778', 'grad_norm': '3.872', 'learning_rate': '1.347e-06', 'epoch': '0.8379'}
+
 84%|████████▍ | 31810/37963 [78:39:47<15:14:59,  8.92s/it]
 84%|████████▍ | 31811/37963 [78:39:54<14:31:10,  8.50s/it]
 84%|████████▍ | 31812/37963 [78:40:02<14:06:16,  8.25s/it]
 84%|████████▍ | 31813/37963 [78:40:16<17:14:25, 10.09s/it]
 84%|████████▍ | 31814/37963 [78:40:24<16:06:33,  9.43s/it]
 84%|████████▍ | 31815/37963 [78:40:32<15:10:49,  8.89s/it]
 84%|████████▍ | 31816/37963 [78:40:39<14:32:29,  8.52s/it]
 84%|████████▍ | 31817/37963 [78:40:47<14:07:55,  8.28s/it]
 84%|████████▍ | 31818/37963 [78:40:55<13:52:30,  8.13s/it]
 84%|████████▍ | 31819/37963 [78:41:03<13:37:58,  7.99s/it]
 84%|████████▍ | 31820/37963 [78:41:10<13:30:30,  7.92s/it]
                                                           
{'loss': '0.0876', 'grad_norm': '3.202', 'learning_rate': '1.343e-06', 'epoch': '0.8382'}
+
 84%|████████▍ | 31820/37963 [78:41:10<13:30:30,  7.92s/it]
 84%|████████▍ | 31821/37963 [78:41:18<13:24:23,  7.86s/it]
 84%|████████▍ | 31822/37963 [78:41:26<13:19:11,  7.81s/it]
 84%|████████▍ | 31823/37963 [78:41:33<13:17:20,  7.79s/it]
 84%|████████▍ | 31824/37963 [78:41:41<13:07:26,  7.70s/it]
 84%|████████▍ | 31825/37963 [78:41:55<16:21:41,  9.60s/it]
 84%|████████▍ | 31826/37963 [78:42:03<15:19:32,  8.99s/it]
 84%|████████▍ | 31827/37963 [78:42:10<14:37:17,  8.58s/it]
 84%|████████▍ | 31828/37963 [78:42:32<21:24:07, 12.56s/it]
 84%|████████▍ | 31829/37963 [78:42:40<18:56:18, 11.11s/it]
 84%|████████▍ | 31830/37963 [78:42:48<17:14:24, 10.12s/it]
                                                           
{'loss': '0.08119', 'grad_norm': '2.264', 'learning_rate': '1.338e-06', 'epoch': '0.8385'}
+
 84%|████████▍ | 31830/37963 [78:42:48<17:14:24, 10.12s/it]
 84%|████████▍ | 31831/37963 [78:42:55<16:03:59,  9.43s/it]
 84%|████████▍ | 31832/37963 [78:43:03<15:10:50,  8.91s/it]
 84%|████████▍ | 31833/37963 [78:43:11<14:31:16,  8.53s/it]
 84%|████████▍ | 31834/37963 [78:43:19<14:08:20,  8.30s/it]
 84%|████████▍ | 31835/37963 [78:43:26<13:47:56,  8.11s/it]
 84%|████████▍ | 31836/37963 [78:43:34<13:32:39,  7.96s/it]
 84%|████████▍ | 31837/37963 [78:43:42<13:27:54,  7.91s/it]
 84%|████████▍ | 31838/37963 [78:43:49<13:20:56,  7.85s/it]
 84%|████████▍ | 31839/37963 [78:43:57<13:19:41,  7.83s/it]
 84%|████████▍ | 31840/37963 [78:44:05<13:18:09,  7.82s/it]
                                                           
{'loss': '0.09924', 'grad_norm': '3.231', 'learning_rate': '1.334e-06', 'epoch': '0.8387'}
+
 84%|████████▍ | 31840/37963 [78:44:05<13:18:09,  7.82s/it]
 84%|████████▍ | 31841/37963 [78:44:19<16:40:23,  9.80s/it]
 84%|████████▍ | 31842/37963 [78:44:27<15:40:03,  9.21s/it]
 84%|████████▍ | 31843/37963 [78:44:35<14:50:10,  8.73s/it]
 84%|████████▍ | 31844/37963 [78:44:42<14:14:30,  8.38s/it]
 84%|████████▍ | 31845/37963 [78:44:57<17:31:31, 10.31s/it]
 84%|████████▍ | 31846/37963 [78:45:05<16:15:31,  9.57s/it]
 84%|████████▍ | 31847/37963 [78:45:19<18:31:32, 10.90s/it]
 84%|████████▍ | 31848/37963 [78:45:27<16:49:18,  9.90s/it]
 84%|████████▍ | 31849/37963 [78:45:34<15:41:16,  9.24s/it]
 84%|████████▍ | 31850/37963 [78:45:42<14:51:36,  8.75s/it]
                                                           
{'loss': '0.1002', 'grad_norm': '4.052', 'learning_rate': '1.33e-06', 'epoch': '0.839'}
+
 84%|████████▍ | 31850/37963 [78:45:42<14:51:36,  8.75s/it]
 84%|████████▍ | 31851/37963 [78:45:50<14:22:28,  8.47s/it]
 84%|████████▍ | 31852/37963 [78:45:57<14:00:15,  8.25s/it]
 84%|████████▍ | 31853/37963 [78:46:05<13:44:16,  8.09s/it]
 84%|████████▍ | 31854/37963 [78:46:13<13:24:03,  7.90s/it]
 84%|████████▍ | 31855/37963 [78:46:20<13:16:33,  7.82s/it]
 84%|████████▍ | 31856/37963 [78:46:36<17:06:21, 10.08s/it]
 84%|████████▍ | 31857/37963 [78:46:43<15:40:24,  9.24s/it]
 84%|████████▍ | 31858/37963 [78:46:51<14:51:45,  8.76s/it]
 84%|████████▍ | 31859/37963 [78:46:58<14:19:10,  8.45s/it]
 84%|████████▍ | 31860/37963 [78:47:06<13:50:41,  8.17s/it]
                                                           
{'loss': '0.1049', 'grad_norm': '3.175', 'learning_rate': '1.326e-06', 'epoch': '0.8392'}
+
 84%|████████▍ | 31860/37963 [78:47:06<13:50:41,  8.17s/it]
 84%|████████▍ | 31861/37963 [78:47:13<13:35:12,  8.02s/it]
 84%|████████▍ | 31862/37963 [78:47:21<13:22:20,  7.89s/it]
 84%|████████▍ | 31863/37963 [78:47:29<13:14:59,  7.82s/it]
 84%|████████▍ | 31864/37963 [78:47:36<13:10:34,  7.78s/it]
 84%|████████▍ | 31865/37963 [78:47:44<13:02:32,  7.70s/it]
 84%|████████▍ | 31866/37963 [78:47:51<13:00:04,  7.68s/it]
 84%|████████▍ | 31867/37963 [78:48:06<16:22:38,  9.67s/it]
 84%|████████▍ | 31868/37963 [78:48:14<15:27:22,  9.13s/it]
 84%|████████▍ | 31869/37963 [78:48:21<14:36:47,  8.63s/it]
 84%|████████▍ | 31870/37963 [78:48:29<14:16:16,  8.43s/it]
                                                           
{'loss': '0.0904', 'grad_norm': '3.331', 'learning_rate': '1.321e-06', 'epoch': '0.8395'}
+
 84%|████████▍ | 31870/37963 [78:48:29<14:16:16,  8.43s/it]
 84%|████████▍ | 31871/37963 [78:48:37<13:52:35,  8.20s/it]
 84%|████████▍ | 31872/37963 [78:48:45<13:39:04,  8.07s/it]
 84%|████████▍ | 31873/37963 [78:48:52<13:20:17,  7.88s/it]
 84%|████████▍ | 31874/37963 [78:49:06<16:35:33,  9.81s/it]
 84%|████████▍ | 31875/37963 [78:49:14<15:36:37,  9.23s/it]
 84%|████████▍ | 31876/37963 [78:49:22<14:45:50,  8.73s/it]
 84%|████████▍ | 31877/37963 [78:49:30<14:17:23,  8.45s/it]
 84%|████████▍ | 31878/37963 [78:49:37<13:54:30,  8.23s/it]
 84%|████████▍ | 31879/37963 [78:49:45<13:38:23,  8.07s/it]
 84%|████████▍ | 31880/37963 [78:49:53<13:29:42,  7.99s/it]
                                                           
{'loss': '0.09082', 'grad_norm': '2.649', 'learning_rate': '1.317e-06', 'epoch': '0.8398'}
+
 84%|████████▍ | 31880/37963 [78:49:53<13:29:42,  7.99s/it]
 84%|████████▍ | 31881/37963 [78:50:08<17:04:17, 10.10s/it]
 84%|████████▍ | 31882/37963 [78:50:23<19:31:12, 11.56s/it]
 84%|████████▍ | 31883/37963 [78:50:30<17:30:32, 10.37s/it]
 84%|████████▍ | 31884/37963 [78:50:38<16:02:51,  9.50s/it]
 84%|████████▍ | 31885/37963 [78:50:52<18:20:03, 10.86s/it]
 84%|████████▍ | 31886/37963 [78:50:59<16:41:02,  9.88s/it]
 84%|████████▍ | 31887/37963 [78:51:07<15:38:07,  9.26s/it]
 84%|████████▍ | 31888/37963 [78:51:15<14:48:03,  8.77s/it]
 84%|████████▍ | 31889/37963 [78:51:23<14:14:58,  8.45s/it]
 84%|████████▍ | 31890/37963 [78:51:37<17:11:27, 10.19s/it]
                                                           
{'loss': '0.09705', 'grad_norm': '2.996', 'learning_rate': '1.313e-06', 'epoch': '0.84'}
+
 84%|████████▍ | 31890/37963 [78:51:37<17:11:27, 10.19s/it]
 84%|████████▍ | 31891/37963 [78:51:45<15:56:23,  9.45s/it]
 84%|████████▍ | 31892/37963 [78:51:52<15:01:32,  8.91s/it]
 84%|████████▍ | 31893/37963 [78:52:07<18:03:44, 10.71s/it]
 84%|████████▍ | 31894/37963 [78:52:15<16:30:10,  9.79s/it]
 84%|████████▍ | 31895/37963 [78:52:22<15:19:28,  9.09s/it]
 84%|████████▍ | 31896/37963 [78:52:30<14:36:00,  8.66s/it]
 84%|████████▍ | 31897/37963 [78:52:37<14:04:49,  8.36s/it]
 84%|████████▍ | 31898/37963 [78:52:45<13:44:33,  8.16s/it]
 84%|████████▍ | 31899/37963 [78:52:53<13:27:02,  7.99s/it]
 84%|████████▍ | 31900/37963 [78:53:00<13:18:35,  7.90s/it]
                                                           
{'loss': '0.0978', 'grad_norm': '3.935', 'learning_rate': '1.309e-06', 'epoch': '0.8403'}
+
 84%|████████▍ | 31900/37963 [78:53:00<13:18:35,  7.90s/it]
 84%|████████▍ | 31901/37963 [78:53:08<13:01:29,  7.74s/it]
 84%|████████▍ | 31902/37963 [78:53:16<13:03:53,  7.76s/it]
 84%|████████▍ | 31903/37963 [78:53:24<13:09:54,  7.82s/it]
 84%|████████▍ | 31904/37963 [78:53:31<13:05:26,  7.78s/it]
 84%|████████▍ | 31905/37963 [78:53:39<13:03:30,  7.76s/it]
 84%|████████▍ | 31906/37963 [78:53:47<13:04:23,  7.77s/it]
 84%|████████▍ | 31907/37963 [78:54:02<16:42:16,  9.93s/it]
 84%|████████▍ | 31908/37963 [78:54:09<15:33:41,  9.25s/it]
 84%|████████▍ | 31909/37963 [78:54:17<14:47:50,  8.80s/it]
 84%|████████▍ | 31910/37963 [78:54:25<14:15:37,  8.48s/it]
                                                           
{'loss': '0.08606', 'grad_norm': '3.076', 'learning_rate': '1.304e-06', 'epoch': '0.8406'}
+
 84%|████████▍ | 31910/37963 [78:54:25<14:15:37,  8.48s/it]
 84%|████████▍ | 31911/37963 [78:54:39<16:59:39, 10.11s/it]
 84%|████████▍ | 31912/37963 [78:54:47<15:53:15,  9.45s/it]
 84%|████████▍ | 31913/37963 [78:54:54<14:53:38,  8.86s/it]
 84%|████████▍ | 31914/37963 [78:55:02<14:17:24,  8.50s/it]
 84%|████████▍ | 31915/37963 [78:55:10<13:51:15,  8.25s/it]
 84%|████████▍ | 31916/37963 [78:55:17<13:36:54,  8.11s/it]
 84%|████████▍ | 31917/37963 [78:55:25<13:22:57,  7.97s/it]
 84%|████████▍ | 31918/37963 [78:55:33<13:14:44,  7.89s/it]
 84%|████████▍ | 31919/37963 [78:55:40<13:06:54,  7.81s/it]
 84%|████████▍ | 31920/37963 [78:55:48<13:04:06,  7.79s/it]
                                                           
{'loss': '0.1032', 'grad_norm': '2.355', 'learning_rate': '1.3e-06', 'epoch': '0.8408'}
+
 84%|████████▍ | 31920/37963 [78:55:48<13:04:06,  7.79s/it]
 84%|████████▍ | 31921/37963 [78:55:56<13:04:36,  7.79s/it]
 84%|████████▍ | 31922/37963 [78:56:04<13:01:35,  7.76s/it]
 84%|████████▍ | 31923/37963 [78:56:11<12:59:31,  7.74s/it]
 84%|████████▍ | 31924/37963 [78:56:19<12:59:52,  7.75s/it]
 84%|████████▍ | 31925/37963 [78:56:34<16:37:51,  9.92s/it]
 84%|████████▍ | 31926/37963 [78:56:41<15:22:32,  9.17s/it]
 84%|████████▍ | 31927/37963 [78:56:49<14:40:29,  8.75s/it]
 84%|████████▍ | 31928/37963 [78:57:04<17:30:14, 10.44s/it]
 84%|████████▍ | 31929/37963 [78:57:18<19:30:59, 11.64s/it]
 84%|████████▍ | 31930/37963 [78:57:26<17:31:05, 10.45s/it]
                                                           
{'loss': '0.09107', 'grad_norm': '2.74', 'learning_rate': '1.296e-06', 'epoch': '0.8411'}
+
 84%|████████▍ | 31930/37963 [78:57:26<17:31:05, 10.45s/it]
 84%|████████▍ | 31931/37963 [78:57:33<16:04:59,  9.60s/it]
 84%|████████▍ | 31932/37963 [78:57:41<15:11:08,  9.06s/it]
 84%|████████▍ | 31933/37963 [78:57:49<14:33:59,  8.70s/it]
 84%|████████▍ | 31934/37963 [78:57:57<14:03:31,  8.39s/it]
 84%|████████▍ | 31935/37963 [78:58:04<13:41:16,  8.17s/it]
 84%|████████▍ | 31936/37963 [78:58:19<16:44:21, 10.00s/it]
 84%|████████▍ | 31937/37963 [78:58:26<15:37:19,  9.33s/it]
 84%|████████▍ | 31938/37963 [78:58:34<14:48:53,  8.85s/it]
 84%|████████▍ | 31939/37963 [78:58:42<14:18:54,  8.55s/it]
 84%|████████▍ | 31940/37963 [78:58:50<13:54:33,  8.31s/it]
                                                           
{'loss': '0.07297', 'grad_norm': '2.868', 'learning_rate': '1.292e-06', 'epoch': '0.8413'}
+
 84%|████████▍ | 31940/37963 [78:58:50<13:54:33,  8.31s/it]
 84%|████████▍ | 31941/37963 [78:58:57<13:37:40,  8.15s/it]
 84%|████████▍ | 31942/37963 [78:59:05<13:26:07,  8.03s/it]
 84%|████████▍ | 31943/37963 [78:59:20<16:37:47,  9.94s/it]
 84%|████████▍ | 31944/37963 [78:59:27<15:30:19,  9.27s/it]
 84%|████████▍ | 31945/37963 [78:59:35<14:39:18,  8.77s/it]
 84%|████████▍ | 31946/37963 [78:59:50<17:42:07, 10.59s/it]
 84%|████████▍ | 31947/37963 [78:59:57<16:09:45,  9.67s/it]
 84%|████████▍ | 31948/37963 [79:00:05<15:08:33,  9.06s/it]
 84%|████████▍ | 31949/37963 [79:00:13<14:26:28,  8.64s/it]
 84%|████████▍ | 31950/37963 [79:00:20<13:58:14,  8.36s/it]
                                                           
{'loss': '0.09801', 'grad_norm': '2.442', 'learning_rate': '1.288e-06', 'epoch': '0.8416'}
+
 84%|████████▍ | 31950/37963 [79:00:20<13:58:14,  8.36s/it]
 84%|████████▍ | 31951/37963 [79:00:28<13:32:54,  8.11s/it]
 84%|████████▍ | 31952/37963 [79:00:35<13:19:01,  7.98s/it]
 84%|████████▍ | 31953/37963 [79:00:50<16:48:34, 10.07s/it]
 84%|████████▍ | 31954/37963 [79:00:58<15:34:26,  9.33s/it]
 84%|████████▍ | 31955/37963 [79:01:06<14:44:17,  8.83s/it]
 84%|████████▍ | 31956/37963 [79:01:13<14:10:42,  8.50s/it]
 84%|████████▍ | 31957/37963 [79:01:21<13:46:42,  8.26s/it]
 84%|████████▍ | 31958/37963 [79:01:29<13:29:10,  8.08s/it]
 84%|████████▍ | 31959/37963 [79:01:36<13:16:49,  7.96s/it]
 84%|████████▍ | 31960/37963 [79:01:51<16:34:11,  9.94s/it]
                                                           
{'loss': '0.09286', 'grad_norm': '2.826', 'learning_rate': '1.283e-06', 'epoch': '0.8419'}
+
 84%|████████▍ | 31960/37963 [79:01:51<16:34:11,  9.94s/it]
 84%|████████▍ | 31961/37963 [79:01:59<15:23:15,  9.23s/it]
 84%|████████▍ | 31962/37963 [79:02:06<14:37:30,  8.77s/it]
 84%|████████▍ | 31963/37963 [79:02:14<14:03:42,  8.44s/it]
 84%|████████▍ | 31964/37963 [79:02:22<13:42:34,  8.23s/it]
 84%|████████▍ | 31965/37963 [79:02:29<13:20:16,  8.01s/it]
 84%|████████▍ | 31966/37963 [79:02:37<13:06:21,  7.87s/it]
 84%|████████▍ | 31967/37963 [79:02:44<13:00:10,  7.81s/it]
 84%|████████▍ | 31968/37963 [79:02:52<13:00:52,  7.82s/it]
 84%|████████▍ | 31969/37963 [79:03:00<12:54:33,  7.75s/it]
 84%|████████▍ | 31970/37963 [79:03:08<12:54:13,  7.75s/it]
                                                           
{'loss': '0.09214', 'grad_norm': '2.848', 'learning_rate': '1.279e-06', 'epoch': '0.8421'}
+
 84%|████████▍ | 31970/37963 [79:03:08<12:54:13,  7.75s/it]
 84%|████████▍ | 31971/37963 [79:03:15<12:51:40,  7.73s/it]
 84%|████████▍ | 31972/37963 [79:03:23<12:51:10,  7.72s/it]
 84%|████████▍ | 31973/37963 [79:03:31<12:50:09,  7.71s/it]
 84%|████████▍ | 31974/37963 [79:03:38<12:41:34,  7.63s/it]
 84%|████████▍ | 31975/37963 [79:03:46<12:41:07,  7.63s/it]
 84%|████████▍ | 31976/37963 [79:03:53<12:40:47,  7.62s/it]
 84%|████████▍ | 31977/37963 [79:04:14<19:12:40, 11.55s/it]
 84%|████████▍ | 31978/37963 [79:04:29<20:50:20, 12.53s/it]
 84%|████████▍ | 31979/37963 [79:04:37<18:23:35, 11.07s/it]
 84%|████████▍ | 31980/37963 [79:04:44<16:41:23, 10.04s/it]
                                                           
{'loss': '0.08949', 'grad_norm': '3.093', 'learning_rate': '1.275e-06', 'epoch': '0.8424'}
+
 84%|████████▍ | 31980/37963 [79:04:44<16:41:23, 10.04s/it]
 84%|████████▍ | 31981/37963 [79:04:52<15:32:34,  9.35s/it]
 84%|████████▍ | 31982/37963 [79:04:59<14:36:43,  8.80s/it]
 84%|████████▍ | 31983/37963 [79:05:07<14:00:42,  8.44s/it]
 84%|████████▍ | 31984/37963 [79:05:21<17:00:49, 10.24s/it]
 84%|████████▍ | 31985/37963 [79:05:29<15:44:58,  9.48s/it]
 84%|████████▍ | 31986/37963 [79:05:37<14:50:27,  8.94s/it]
 84%|████████▍ | 31987/37963 [79:05:44<14:11:32,  8.55s/it]
 84%|████████▍ | 31988/37963 [79:05:52<13:42:42,  8.26s/it]
 84%|████████▍ | 31989/37963 [79:06:00<13:26:49,  8.10s/it]
 84%|████████▍ | 31990/37963 [79:06:14<16:25:45,  9.90s/it]
                                                           
{'loss': '0.08488', 'grad_norm': '2.554', 'learning_rate': '1.271e-06', 'epoch': '0.8427'}
+
 84%|████████▍ | 31990/37963 [79:06:14<16:25:45,  9.90s/it]
 84%|████████▍ | 31991/37963 [79:06:22<15:19:46,  9.24s/it]
 84%|████████▍ | 31992/37963 [79:06:29<14:28:37,  8.73s/it]
 84%|████████▍ | 31993/37963 [79:06:37<13:55:38,  8.40s/it]
 84%|████████▍ | 31994/37963 [79:06:44<13:29:34,  8.14s/it]
 84%|████████▍ | 31995/37963 [79:06:52<13:10:40,  7.95s/it]
 84%|████████▍ | 31996/37963 [79:07:00<13:04:07,  7.88s/it]
 84%|████████▍ | 31997/37963 [79:07:07<12:58:13,  7.83s/it]
 84%|████████▍ | 31998/37963 [79:07:22<16:26:11,  9.92s/it]
 84%|████████▍ | 31999/37963 [79:07:37<18:47:49, 11.35s/it]
 84%|████████▍ | 32000/37963 [79:07:44<17:00:39, 10.27s/it]
                                                           
{'loss': '0.09721', 'grad_norm': '2.965', 'learning_rate': '1.267e-06', 'epoch': '0.8429'}
+
 84%|████████▍ | 32000/37963 [79:07:44<17:00:39, 10.27s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.82s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.82s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 84%|████████▍ | 32001/37963 [79:08:42<40:27:52, 24.43s/it]
 84%|████████▍ | 32002/37963 [79:08:50<32:07:57, 19.41s/it]
 84%|████████▍ | 32003/37963 [79:08:57<26:16:48, 15.87s/it]
 84%|████████▍ | 32004/37963 [79:09:05<22:15:02, 13.44s/it]
 84%|████████▍ | 32005/37963 [79:09:13<19:30:36, 11.79s/it]
 84%|████████▍ | 32006/37963 [79:09:21<17:28:25, 10.56s/it]
 84%|████████▍ | 32007/37963 [79:09:28<16:03:37,  9.71s/it]
 84%|████████▍ | 32008/37963 [79:09:43<18:18:03, 11.06s/it]
 84%|████████▍ | 32009/37963 [79:09:50<16:41:38, 10.09s/it]
 84%|████████▍ | 32010/37963 [79:09:58<15:25:13,  9.33s/it]
                                                           
{'loss': '0.09223', 'grad_norm': '2.672', 'learning_rate': '1.263e-06', 'epoch': '0.8432'}
+
 84%|████████▍ | 32010/37963 [79:09:58<15:25:13,  9.33s/it]
 84%|████████▍ | 32011/37963 [79:10:05<14:30:50,  8.78s/it]
 84%|████████▍ | 32012/37963 [79:10:13<13:57:43,  8.45s/it]
 84%|████████▍ | 32013/37963 [79:10:21<13:47:27,  8.34s/it]
 84%|████████▍ | 32014/37963 [79:10:29<13:26:49,  8.14s/it]
 84%|████████▍ | 32015/37963 [79:10:37<13:11:08,  7.98s/it]
 84%|████████▍ | 32016/37963 [79:10:44<12:59:56,  7.87s/it]
 84%|████████▍ | 32017/37963 [79:10:52<12:48:01,  7.75s/it]
 84%|████████▍ | 32018/37963 [79:10:59<12:46:56,  7.74s/it]
 84%|████████▍ | 32019/37963 [79:11:07<12:43:35,  7.71s/it]
 84%|████████▍ | 32020/37963 [79:11:15<12:43:16,  7.71s/it]
                                                           
{'loss': '0.08764', 'grad_norm': '3.058', 'learning_rate': '1.258e-06', 'epoch': '0.8435'}
+
 84%|████████▍ | 32020/37963 [79:11:15<12:43:16,  7.71s/it]
 84%|████████▍ | 32021/37963 [79:11:22<12:44:12,  7.72s/it]
 84%|████████▍ | 32022/37963 [79:11:30<12:38:50,  7.66s/it]
 84%|████████▍ | 32023/37963 [79:11:38<12:37:53,  7.66s/it]
 84%|████████▍ | 32024/37963 [79:11:45<12:40:27,  7.68s/it]
 84%|████████▍ | 32025/37963 [79:11:59<15:44:15,  9.54s/it]
 84%|████████▍ | 32026/37963 [79:12:07<14:46:35,  8.96s/it]
 84%|████████▍ | 32027/37963 [79:12:15<14:12:22,  8.62s/it]
 84%|████████▍ | 32028/37963 [79:12:29<17:07:55, 10.39s/it]
 84%|████████▍ | 32029/37963 [79:12:51<22:42:00, 13.77s/it]
 84%|████████▍ | 32030/37963 [79:12:58<19:38:20, 11.92s/it]
                                                           
{'loss': '0.1058', 'grad_norm': '3.193', 'learning_rate': '1.254e-06', 'epoch': '0.8437'}
+
 84%|████████▍ | 32030/37963 [79:12:58<19:38:20, 11.92s/it]
 84%|████████▍ | 32031/37963 [79:13:06<17:27:25, 10.59s/it]
 84%|████████▍ | 32032/37963 [79:13:13<15:52:11,  9.63s/it]
 84%|████████▍ | 32033/37963 [79:13:21<14:49:32,  9.00s/it]
 84%|████████▍ | 32034/37963 [79:13:28<14:09:24,  8.60s/it]
 84%|████████▍ | 32035/37963 [79:13:36<13:40:53,  8.31s/it]
 84%|████████▍ | 32036/37963 [79:13:44<13:21:37,  8.11s/it]
 84%|████████▍ | 32037/37963 [79:13:51<13:09:09,  7.99s/it]
 84%|████████▍ | 32038/37963 [79:13:59<13:03:31,  7.93s/it]
 84%|████████▍ | 32039/37963 [79:14:07<12:54:32,  7.84s/it]
 84%|████████▍ | 32040/37963 [79:14:15<12:48:42,  7.79s/it]
                                                           
{'loss': '0.08595', 'grad_norm': '3.296', 'learning_rate': '1.25e-06', 'epoch': '0.844'}
+
 84%|████████▍ | 32040/37963 [79:14:15<12:48:42,  7.79s/it]
 84%|████████▍ | 32041/37963 [79:14:22<12:41:45,  7.72s/it]
 84%|████████▍ | 32042/37963 [79:14:36<15:48:17,  9.61s/it]
 84%|████████▍ | 32043/37963 [79:14:44<14:50:59,  9.03s/it]
 84%|████████▍ | 32044/37963 [79:14:51<14:06:04,  8.58s/it]
 84%|████████▍ | 32045/37963 [79:14:59<13:37:30,  8.29s/it]
 84%|████████▍ | 32046/37963 [79:15:14<16:48:24, 10.23s/it]
 84%|████████▍ | 32047/37963 [79:15:22<15:44:34,  9.58s/it]
 84%|████████▍ | 32048/37963 [79:15:29<14:48:47,  9.02s/it]
 84%|████████▍ | 32049/37963 [79:15:37<14:01:53,  8.54s/it]
 84%|████████▍ | 32050/37963 [79:15:52<17:06:09, 10.41s/it]
                                                           
{'loss': '0.09893', 'grad_norm': '2.946', 'learning_rate': '1.246e-06', 'epoch': '0.8442'}
+
 84%|████████▍ | 32050/37963 [79:15:52<17:06:09, 10.41s/it]
 84%|████████▍ | 32051/37963 [79:15:59<15:46:19,  9.60s/it]
 84%|████████▍ | 32052/37963 [79:16:07<14:45:37,  8.99s/it]
 84%|████████▍ | 32053/37963 [79:16:15<14:07:06,  8.60s/it]
 84%|████████▍ | 32054/37963 [79:16:22<13:40:06,  8.33s/it]
 84%|████████▍ | 32055/37963 [79:16:30<13:14:00,  8.06s/it]
 84%|████████▍ | 32056/37963 [79:16:44<16:10:36,  9.86s/it]
 84%|████████▍ | 32057/37963 [79:16:52<15:14:16,  9.29s/it]
 84%|████████▍ | 32058/37963 [79:17:00<14:28:23,  8.82s/it]
 84%|████████▍ | 32059/37963 [79:17:07<13:53:17,  8.47s/it]
 84%|████████▍ | 32060/37963 [79:17:15<13:29:16,  8.23s/it]
                                                           
{'loss': '0.09488', 'grad_norm': '3.233', 'learning_rate': '1.242e-06', 'epoch': '0.8445'}
+
 84%|████████▍ | 32060/37963 [79:17:15<13:29:16,  8.23s/it]
 84%|████████▍ | 32061/37963 [79:17:22<13:13:02,  8.06s/it]
 84%|████████▍ | 32062/37963 [79:17:30<12:55:36,  7.89s/it]
 84%|████████▍ | 32063/37963 [79:17:38<12:45:24,  7.78s/it]
 84%|████████▍ | 32064/37963 [79:17:45<12:42:42,  7.76s/it]
 84%|████████▍ | 32065/37963 [79:17:53<12:35:13,  7.68s/it]
 84%|████████▍ | 32066/37963 [79:18:01<12:38:46,  7.72s/it]
 84%|████████▍ | 32067/37963 [79:18:08<12:36:53,  7.70s/it]
 84%|████████▍ | 32068/37963 [79:18:16<12:43:19,  7.77s/it]
 84%|████████▍ | 32069/37963 [79:18:30<15:47:13,  9.64s/it]
 84%|████████▍ | 32070/37963 [79:18:38<14:49:51,  9.06s/it]
                                                           
{'loss': '0.09012', 'grad_norm': '2.867', 'learning_rate': '1.238e-06', 'epoch': '0.8448'}
+
 84%|████████▍ | 32070/37963 [79:18:38<14:49:51,  9.06s/it]
 84%|████████▍ | 32071/37963 [79:18:46<14:10:34,  8.66s/it]
 84%|████████▍ | 32072/37963 [79:18:53<13:38:41,  8.34s/it]
 84%|████████▍ | 32073/37963 [79:19:07<16:33:53, 10.12s/it]
 84%|████████▍ | 32074/37963 [79:19:15<15:24:57,  9.42s/it]
 84%|████████▍ | 32075/37963 [79:19:23<14:35:40,  8.92s/it]
 84%|████████▍ | 32076/37963 [79:19:45<20:50:53, 12.75s/it]
 84%|████████▍ | 32077/37963 [79:19:52<18:20:35, 11.22s/it]
 84%|████████▍ | 32078/37963 [79:20:00<16:36:16, 10.16s/it]
 85%|████████▍ | 32079/37963 [79:20:08<15:20:35,  9.39s/it]
 85%|████████▍ | 32080/37963 [79:20:15<14:28:48,  8.86s/it]
                                                           
{'loss': '0.08625', 'grad_norm': '3.165', 'learning_rate': '1.234e-06', 'epoch': '0.845'}
+
 85%|████████▍ | 32080/37963 [79:20:15<14:28:48,  8.86s/it]
 85%|████████▍ | 32081/37963 [79:20:23<13:50:18,  8.47s/it]
 85%|████████▍ | 32082/37963 [79:20:30<13:22:51,  8.19s/it]
 85%|████████▍ | 32083/37963 [79:20:38<13:09:24,  8.06s/it]
 85%|████████▍ | 32084/37963 [79:20:46<12:52:52,  7.89s/it]
 85%|████████▍ | 32085/37963 [79:20:53<12:53:36,  7.90s/it]
 85%|████████▍ | 32086/37963 [79:21:01<12:47:28,  7.84s/it]
 85%|████████▍ | 32087/37963 [79:21:09<12:46:26,  7.83s/it]
 85%|████████▍ | 32088/37963 [79:21:17<12:42:05,  7.78s/it]
 85%|████████▍ | 32089/37963 [79:21:24<12:32:54,  7.69s/it]
 85%|████████▍ | 32090/37963 [79:21:32<12:33:34,  7.70s/it]
                                                           
{'loss': '0.08558', 'grad_norm': '2.379', 'learning_rate': '1.23e-06', 'epoch': '0.8453'}
+
 85%|████████▍ | 32090/37963 [79:21:32<12:33:34,  7.70s/it]
 85%|████████▍ | 32091/37963 [79:21:39<12:28:07,  7.64s/it]
 85%|████████▍ | 32092/37963 [79:21:47<12:31:07,  7.68s/it]
 85%|████████▍ | 32093/37963 [79:21:55<12:33:50,  7.71s/it]
 85%|████████▍ | 32094/37963 [79:22:10<16:01:52,  9.83s/it]
 85%|████████▍ | 32095/37963 [79:22:18<15:02:47,  9.23s/it]
 85%|████████▍ | 32096/37963 [79:22:32<17:44:23, 10.89s/it]
 85%|████████▍ | 32097/37963 [79:22:40<16:05:32,  9.88s/it]
 85%|████████▍ | 32098/37963 [79:22:54<18:22:02, 11.27s/it]
 85%|████████▍ | 32099/37963 [79:23:02<16:41:43, 10.25s/it]
 85%|████████▍ | 32100/37963 [79:23:10<15:24:50,  9.46s/it]
                                                           
{'loss': '0.08437', 'grad_norm': '2.904', 'learning_rate': '1.226e-06', 'epoch': '0.8456'}
+
 85%|████████▍ | 32100/37963 [79:23:10<15:24:50,  9.46s/it]
 85%|████████▍ | 32101/37963 [79:23:18<14:40:20,  9.01s/it]
 85%|████████▍ | 32102/37963 [79:23:25<13:57:27,  8.57s/it]
 85%|████████▍ | 32103/37963 [79:23:33<13:31:01,  8.30s/it]
 85%|████████▍ | 32104/37963 [79:23:41<13:12:51,  8.12s/it]
 85%|████████▍ | 32105/37963 [79:23:55<16:19:57, 10.04s/it]
 85%|████████▍ | 32106/37963 [79:24:03<15:11:05,  9.33s/it]
 85%|████████▍ | 32107/37963 [79:24:11<14:21:36,  8.83s/it]
 85%|████████▍ | 32108/37963 [79:24:18<13:45:05,  8.46s/it]
 85%|████████▍ | 32109/37963 [79:24:26<13:21:18,  8.21s/it]
 85%|████████▍ | 32110/37963 [79:24:33<13:06:04,  8.06s/it]
                                                           
{'loss': '0.09175', 'grad_norm': '2.482', 'learning_rate': '1.221e-06', 'epoch': '0.8458'}
+
 85%|████████▍ | 32110/37963 [79:24:33<13:06:04,  8.06s/it]
 85%|████████▍ | 32111/37963 [79:24:41<12:59:18,  7.99s/it]
 85%|████████▍ | 32112/37963 [79:24:49<12:52:55,  7.93s/it]
 85%|████████▍ | 32113/37963 [79:25:03<15:50:10,  9.75s/it]
 85%|████████▍ | 32114/37963 [79:25:11<14:54:07,  9.17s/it]
 85%|████████▍ | 32115/37963 [79:25:18<14:02:26,  8.64s/it]
 85%|████████▍ | 32116/37963 [79:25:26<13:33:59,  8.35s/it]
 85%|████████▍ | 32117/37963 [79:25:41<16:34:48, 10.21s/it]
 85%|████████▍ | 32118/37963 [79:25:48<15:23:52,  9.48s/it]
 85%|████████▍ | 32119/37963 [79:25:56<14:28:53,  8.92s/it]
 85%|████████▍ | 32120/37963 [79:26:04<13:53:35,  8.56s/it]
                                                           
{'loss': '0.08922', 'grad_norm': '3.061', 'learning_rate': '1.217e-06', 'epoch': '0.8461'}
+
 85%|████████▍ | 32120/37963 [79:26:04<13:53:35,  8.56s/it]
 85%|████████▍ | 32121/37963 [79:26:12<13:34:01,  8.36s/it]
 85%|████████▍ | 32122/37963 [79:26:26<16:42:26, 10.30s/it]
 85%|████████▍ | 32123/37963 [79:26:41<18:38:15, 11.49s/it]
 85%|████████▍ | 32124/37963 [79:26:48<16:34:20, 10.22s/it]
 85%|████████▍ | 32125/37963 [79:26:55<15:12:38,  9.38s/it]
 85%|████████▍ | 32126/37963 [79:27:03<14:21:51,  8.86s/it]
 85%|████████▍ | 32127/37963 [79:27:11<13:49:37,  8.53s/it]
 85%|████████▍ | 32128/37963 [79:27:18<13:16:45,  8.19s/it]
 85%|████████▍ | 32129/37963 [79:27:26<12:57:00,  7.99s/it]
 85%|████████▍ | 32130/37963 [79:27:33<12:44:21,  7.86s/it]
                                                           
{'loss': '0.08573', 'grad_norm': '3.476', 'learning_rate': '1.213e-06', 'epoch': '0.8464'}
+
 85%|████████▍ | 32130/37963 [79:27:33<12:44:21,  7.86s/it]
 85%|████████▍ | 32131/37963 [79:27:41<12:37:18,  7.79s/it]
 85%|████████▍ | 32132/37963 [79:27:49<12:35:32,  7.77s/it]
 85%|████████▍ | 32133/37963 [79:27:56<12:34:06,  7.76s/it]
 85%|████████▍ | 32134/37963 [79:28:04<12:32:33,  7.75s/it]
 85%|████████▍ | 32135/37963 [79:28:12<12:30:35,  7.73s/it]
 85%|████████▍ | 32136/37963 [79:28:19<12:31:50,  7.74s/it]
 85%|████████▍ | 32137/37963 [79:28:27<12:32:24,  7.75s/it]
 85%|████████▍ | 32138/37963 [79:28:35<12:26:45,  7.69s/it]
 85%|████████▍ | 32139/37963 [79:28:43<12:30:23,  7.73s/it]
 85%|████████▍ | 32140/37963 [79:28:50<12:31:48,  7.75s/it]
                                                           
{'loss': '0.0869', 'grad_norm': '3.287', 'learning_rate': '1.209e-06', 'epoch': '0.8466'}
+
 85%|████████▍ | 32140/37963 [79:28:50<12:31:48,  7.75s/it]
 85%|████████▍ | 32141/37963 [79:28:58<12:30:02,  7.73s/it]
 85%|████████▍ | 32142/37963 [79:29:06<12:27:06,  7.70s/it]
 85%|████████▍ | 32143/37963 [79:29:13<12:23:01,  7.66s/it]
 85%|████████▍ | 32144/37963 [79:29:28<15:34:41,  9.64s/it]
 85%|████████▍ | 32145/37963 [79:29:35<14:38:26,  9.06s/it]
 85%|████████▍ | 32146/37963 [79:29:50<17:26:10, 10.79s/it]
 85%|████████▍ | 32147/37963 [79:29:58<15:57:50,  9.88s/it]
 85%|████████▍ | 32148/37963 [79:30:06<14:56:28,  9.25s/it]
 85%|████████▍ | 32149/37963 [79:30:21<17:45:36, 11.00s/it]
 85%|████████▍ | 32150/37963 [79:30:28<16:10:24, 10.02s/it]
                                                           
{'loss': '0.09235', 'grad_norm': '2.202', 'learning_rate': '1.205e-06', 'epoch': '0.8469'}
+
 85%|████████▍ | 32150/37963 [79:30:28<16:10:24, 10.02s/it]
 85%|████████▍ | 32151/37963 [79:30:36<15:01:35,  9.31s/it]
 85%|████████▍ | 32152/37963 [79:30:44<14:15:19,  8.83s/it]
 85%|████████▍ | 32153/37963 [79:30:58<16:58:19, 10.52s/it]
 85%|████████▍ | 32154/37963 [79:31:06<15:41:38,  9.73s/it]
 85%|████████▍ | 32155/37963 [79:31:14<14:37:18,  9.06s/it]
 85%|████████▍ | 32156/37963 [79:31:21<13:56:53,  8.65s/it]
 85%|████████▍ | 32157/37963 [79:31:35<16:29:48, 10.23s/it]
 85%|████████▍ | 32158/37963 [79:31:43<15:18:31,  9.49s/it]
 85%|████████▍ | 32159/37963 [79:31:51<14:28:21,  8.98s/it]
 85%|████████▍ | 32160/37963 [79:31:58<13:52:34,  8.61s/it]
                                                           
{'loss': '0.08928', 'grad_norm': '3.275', 'learning_rate': '1.201e-06', 'epoch': '0.8471'}
+
 85%|████████▍ | 32160/37963 [79:31:59<13:52:34,  8.61s/it]
 85%|████████▍ | 32161/37963 [79:32:06<13:23:37,  8.31s/it]
 85%|████████▍ | 32162/37963 [79:32:14<13:05:13,  8.12s/it]
 85%|████████▍ | 32163/37963 [79:32:22<12:55:46,  8.03s/it]
 85%|████████▍ | 32164/37963 [79:32:29<12:44:22,  7.91s/it]
 85%|████████▍ | 32165/37963 [79:32:37<12:33:47,  7.80s/it]
 85%|████████▍ | 32166/37963 [79:32:51<15:52:37,  9.86s/it]
 85%|████████▍ | 32167/37963 [79:32:59<14:52:01,  9.23s/it]
 85%|████████▍ | 32168/37963 [79:33:07<14:11:40,  8.82s/it]
 85%|████████▍ | 32169/37963 [79:33:15<13:39:25,  8.49s/it]
 85%|████████▍ | 32170/37963 [79:33:29<16:28:44, 10.24s/it]
                                                           
{'loss': '0.09632', 'grad_norm': '2.7', 'learning_rate': '1.197e-06', 'epoch': '0.8474'}
+
 85%|████████▍ | 32170/37963 [79:33:29<16:28:44, 10.24s/it]
 85%|████████▍ | 32171/37963 [79:33:44<18:34:39, 11.55s/it]
 85%|████████▍ | 32172/37963 [79:33:51<16:43:23, 10.40s/it]
 85%|████████▍ | 32173/37963 [79:33:59<15:23:49,  9.57s/it]
 85%|████████▍ | 32174/37963 [79:34:07<14:28:58,  9.01s/it]
 85%|████████▍ | 32175/37963 [79:34:15<13:53:49,  8.64s/it]
 85%|████████▍ | 32176/37963 [79:34:22<13:23:07,  8.33s/it]
 85%|████████▍ | 32177/37963 [79:34:30<12:57:57,  8.07s/it]
 85%|████████▍ | 32178/37963 [79:34:37<12:47:27,  7.96s/it]
 85%|████████▍ | 32179/37963 [79:34:45<12:38:35,  7.87s/it]
 85%|████████▍ | 32180/37963 [79:34:53<12:34:11,  7.82s/it]
                                                           
{'loss': '0.09521', 'grad_norm': '2.531', 'learning_rate': '1.193e-06', 'epoch': '0.8477'}
+
 85%|████████▍ | 32180/37963 [79:34:53<12:34:11,  7.82s/it]
 85%|████████▍ | 32181/37963 [79:35:00<12:28:02,  7.76s/it]
 85%|████████▍ | 32182/37963 [79:35:08<12:24:37,  7.73s/it]
 85%|████████▍ | 32183/37963 [79:35:15<12:18:06,  7.66s/it]
 85%|████████▍ | 32184/37963 [79:35:23<12:18:42,  7.67s/it]
 85%|████████▍ | 32185/37963 [79:35:31<12:22:23,  7.71s/it]
 85%|████████▍ | 32186/37963 [79:35:39<12:20:20,  7.69s/it]
 85%|████████▍ | 32187/37963 [79:35:46<12:20:22,  7.69s/it]
 85%|████████▍ | 32188/37963 [79:35:54<12:25:40,  7.75s/it]
 85%|████████▍ | 32189/37963 [79:36:02<12:22:34,  7.72s/it]
 85%|████████▍ | 32190/37963 [79:36:09<12:20:45,  7.70s/it]
                                                           
{'loss': '0.09669', 'grad_norm': '2.735', 'learning_rate': '1.189e-06', 'epoch': '0.8479'}
+
 85%|████████▍ | 32190/37963 [79:36:09<12:20:45,  7.70s/it]
 85%|████████▍ | 32191/37963 [79:36:24<15:37:09,  9.74s/it]
 85%|████████▍ | 32192/37963 [79:36:32<14:35:49,  9.11s/it]
 85%|████████▍ | 32193/37963 [79:36:39<13:53:22,  8.67s/it]
 85%|████████▍ | 32194/37963 [79:36:47<13:26:05,  8.38s/it]
 85%|████████▍ | 32195/37963 [79:36:55<13:07:46,  8.19s/it]
 85%|████████▍ | 32196/37963 [79:37:02<12:50:18,  8.01s/it]
 85%|████████▍ | 32197/37963 [79:37:24<19:25:47, 12.13s/it]
 85%|████████▍ | 32198/37963 [79:37:32<17:17:35, 10.80s/it]
 85%|████████▍ | 32199/37963 [79:37:39<15:37:44,  9.76s/it]
 85%|████████▍ | 32200/37963 [79:37:47<14:38:22,  9.14s/it]
                                                           
{'loss': '0.08062', 'grad_norm': '2.301', 'learning_rate': '1.185e-06', 'epoch': '0.8482'}
+
 85%|████████▍ | 32200/37963 [79:37:47<14:38:22,  9.14s/it]
 85%|████████▍ | 32201/37963 [79:37:54<13:52:51,  8.67s/it]
 85%|████████▍ | 32202/37963 [79:38:02<13:17:46,  8.31s/it]
 85%|████████▍ | 32203/37963 [79:38:10<13:01:35,  8.14s/it]
 85%|████████▍ | 32204/37963 [79:38:17<12:47:59,  8.00s/it]
 85%|████████▍ | 32205/37963 [79:38:32<15:54:32,  9.95s/it]
 85%|████████▍ | 32206/37963 [79:38:39<14:47:54,  9.25s/it]
 85%|████████▍ | 32207/37963 [79:38:47<13:59:33,  8.75s/it]
 85%|████████▍ | 32208/37963 [79:38:55<13:31:02,  8.46s/it]
 85%|████████▍ | 32209/37963 [79:39:02<13:10:20,  8.24s/it]
 85%|████████▍ | 32210/37963 [79:39:10<12:54:35,  8.08s/it]
                                                           
{'loss': '0.08237', 'grad_norm': '2.806', 'learning_rate': '1.181e-06', 'epoch': '0.8485'}
+
 85%|████████▍ | 32210/37963 [79:39:10<12:54:35,  8.08s/it]
 85%|████████▍ | 32211/37963 [79:39:24<15:49:37,  9.91s/it]
 85%|████████▍ | 32212/37963 [79:39:32<14:52:18,  9.31s/it]
 85%|████████▍ | 32213/37963 [79:39:40<13:58:05,  8.75s/it]
 85%|████████▍ | 32214/37963 [79:39:47<13:27:07,  8.42s/it]
 85%|████████▍ | 32215/37963 [79:40:01<16:08:43, 10.11s/it]
 85%|████████▍ | 32216/37963 [79:40:16<18:05:17, 11.33s/it]
 85%|████████▍ | 32217/37963 [79:40:23<16:21:21, 10.25s/it]
 85%|████████▍ | 32218/37963 [79:40:31<15:05:48,  9.46s/it]
 85%|████████▍ | 32219/37963 [79:40:39<14:14:40,  8.93s/it]
 85%|████████▍ | 32220/37963 [79:40:46<13:40:22,  8.57s/it]
                                                           
{'loss': '0.09998', 'grad_norm': '3.406', 'learning_rate': '1.177e-06', 'epoch': '0.8487'}
+
 85%|████████▍ | 32220/37963 [79:40:46<13:40:22,  8.57s/it]
 85%|████████▍ | 32221/37963 [79:40:54<13:13:45,  8.29s/it]
 85%|████████▍ | 32222/37963 [79:41:02<12:57:15,  8.12s/it]
 85%|████████▍ | 32223/37963 [79:41:09<12:45:01,  8.00s/it]
 85%|████████▍ | 32224/37963 [79:41:17<12:34:10,  7.88s/it]
 85%|████████▍ | 32225/37963 [79:41:25<12:31:01,  7.85s/it]
 85%|████████▍ | 32226/37963 [79:41:32<12:14:04,  7.68s/it]
 85%|████████▍ | 32227/37963 [79:41:40<12:11:27,  7.65s/it]
 85%|████████▍ | 32228/37963 [79:41:47<12:14:46,  7.69s/it]
 85%|████████▍ | 32229/37963 [79:41:55<12:13:39,  7.68s/it]
 85%|████████▍ | 32230/37963 [79:42:03<12:14:54,  7.69s/it]
                                                           
{'loss': '0.09346', 'grad_norm': '2.78', 'learning_rate': '1.173e-06', 'epoch': '0.849'}
+
 85%|████████▍ | 32230/37963 [79:42:03<12:14:54,  7.69s/it]
 85%|████████▍ | 32231/37963 [79:42:11<12:16:30,  7.71s/it]
 85%|████████▍ | 32232/37963 [79:42:18<12:16:44,  7.71s/it]
 85%|████████▍ | 32233/37963 [79:42:26<12:16:49,  7.72s/it]
 85%|████████▍ | 32234/37963 [79:42:34<12:22:19,  7.77s/it]
 85%|████████▍ | 32235/37963 [79:42:41<12:15:53,  7.71s/it]
 85%|████████▍ | 32236/37963 [79:42:49<12:10:54,  7.66s/it]
 85%|████████▍ | 32237/37963 [79:42:57<12:12:05,  7.67s/it]
 85%|████████▍ | 32238/37963 [79:43:04<12:11:57,  7.67s/it]
 85%|████████▍ | 32239/37963 [79:43:19<15:20:07,  9.64s/it]
 85%|████████▍ | 32240/37963 [79:43:26<14:23:53,  9.06s/it]
                                                           
{'loss': '0.09691', 'grad_norm': '2.782', 'learning_rate': '1.169e-06', 'epoch': '0.8493'}
+
 85%|████████▍ | 32240/37963 [79:43:26<14:23:53,  9.06s/it]
 85%|████████▍ | 32241/37963 [79:43:41<17:13:05, 10.83s/it]
 85%|████████▍ | 32242/37963 [79:43:49<15:49:45,  9.96s/it]
 85%|████████▍ | 32243/37963 [79:43:57<14:46:42,  9.30s/it]
 85%|████████▍ | 32244/37963 [79:44:05<14:03:25,  8.85s/it]
 85%|████████▍ | 32245/37963 [79:44:26<19:52:17, 12.51s/it]
 85%|████████▍ | 32246/37963 [79:44:33<17:29:40, 11.02s/it]
 85%|████████▍ | 32247/37963 [79:44:41<15:52:16, 10.00s/it]
 85%|████████▍ | 32248/37963 [79:44:48<14:38:08,  9.22s/it]
 85%|████████▍ | 32249/37963 [79:44:56<13:47:36,  8.69s/it]
 85%|████████▍ | 32250/37963 [79:45:03<13:14:58,  8.35s/it]
                                                           
{'loss': '0.08232', 'grad_norm': '2.171', 'learning_rate': '1.165e-06', 'epoch': '0.8495'}
+
 85%|████████▍ | 32250/37963 [79:45:03<13:14:58,  8.35s/it]
 85%|████████▍ | 32251/37963 [79:45:11<12:58:16,  8.18s/it]
 85%|████████▍ | 32252/37963 [79:45:19<12:38:19,  7.97s/it]
 85%|████████▍ | 32253/37963 [79:45:33<15:31:07,  9.78s/it]
 85%|████████▍ | 32254/37963 [79:45:40<14:32:14,  9.17s/it]
 85%|████████▍ | 32255/37963 [79:45:48<13:50:40,  8.73s/it]
 85%|████████▍ | 32256/37963 [79:45:56<13:12:11,  8.33s/it]
 85%|████████▍ | 32257/37963 [79:46:03<12:50:44,  8.10s/it]
 85%|████████▍ | 32258/37963 [79:46:17<15:42:49,  9.92s/it]
 85%|████████▍ | 32259/37963 [79:46:25<14:43:44,  9.30s/it]
 85%|████████▍ | 32260/37963 [79:46:40<17:30:14, 11.05s/it]
                                                           
{'loss': '0.08189', 'grad_norm': '3.781', 'learning_rate': '1.161e-06', 'epoch': '0.8498'}
+
 85%|████████▍ | 32260/37963 [79:46:40<17:30:14, 11.05s/it]
 85%|████████▍ | 32261/37963 [79:46:48<15:59:40, 10.10s/it]
 85%|████████▍ | 32262/37963 [79:47:03<18:06:12, 11.43s/it]
 85%|████████▍ | 32263/37963 [79:47:10<16:21:25, 10.33s/it]
 85%|████████▍ | 32264/37963 [79:47:18<15:05:21,  9.53s/it]
 85%|████████▍ | 32265/37963 [79:47:26<14:09:40,  8.95s/it]
 85%|████████▍ | 32266/37963 [79:47:33<13:33:24,  8.57s/it]
 85%|████████▍ | 32267/37963 [79:47:41<13:06:01,  8.28s/it]
 85%|████████▍ | 32268/37963 [79:47:49<12:48:57,  8.10s/it]
 85%|████████▌ | 32269/37963 [79:47:56<12:34:36,  7.95s/it]
 85%|████████▌ | 32270/37963 [79:48:04<12:29:28,  7.90s/it]
                                                           
{'loss': '0.09124', 'grad_norm': '3.52', 'learning_rate': '1.157e-06', 'epoch': '0.85'}
+
 85%|████████▌ | 32270/37963 [79:48:04<12:29:28,  7.90s/it]
 85%|████████▌ | 32271/37963 [79:48:12<12:23:42,  7.84s/it]
 85%|████████▌ | 32272/37963 [79:48:20<12:23:27,  7.84s/it]
 85%|████████▌ | 32273/37963 [79:48:27<12:10:24,  7.70s/it]
 85%|████████▌ | 32274/37963 [79:48:35<12:14:25,  7.75s/it]
 85%|████████▌ | 32275/37963 [79:48:43<12:14:48,  7.75s/it]
 85%|████████▌ | 32276/37963 [79:48:50<12:08:52,  7.69s/it]
 85%|████████▌ | 32277/37963 [79:48:58<12:12:49,  7.73s/it]
 85%|████████▌ | 32278/37963 [79:49:06<12:12:07,  7.73s/it]
 85%|████████▌ | 32279/37963 [79:49:13<12:10:40,  7.71s/it]
 85%|████████▌ | 32280/37963 [79:49:21<12:10:51,  7.72s/it]
                                                           
{'loss': '0.08859', 'grad_norm': '2.949', 'learning_rate': '1.153e-06', 'epoch': '0.8503'}
+
 85%|████████▌ | 32280/37963 [79:49:21<12:10:51,  7.72s/it]
 85%|████████▌ | 32281/37963 [79:49:28<12:03:11,  7.64s/it]
 85%|████████▌ | 32282/37963 [79:49:36<12:08:19,  7.69s/it]
 85%|████████▌ | 32283/37963 [79:49:44<12:03:02,  7.64s/it]
 85%|████████▌ | 32284/37963 [79:49:52<12:11:09,  7.72s/it]
 85%|████████▌ | 32285/37963 [79:49:59<12:10:59,  7.72s/it]
 85%|████████▌ | 32286/37963 [79:50:07<12:13:41,  7.75s/it]
 85%|████████▌ | 32287/37963 [79:50:21<15:14:47,  9.67s/it]
 85%|████████▌ | 32288/37963 [79:50:36<17:39:58, 11.21s/it]
 85%|████████▌ | 32289/37963 [79:50:44<16:07:35, 10.23s/it]
 85%|████████▌ | 32290/37963 [79:50:52<14:56:44,  9.48s/it]
                                                           
{'loss': '0.08817', 'grad_norm': '2.226', 'learning_rate': '1.149e-06', 'epoch': '0.8506'}
+
 85%|████████▌ | 32290/37963 [79:50:52<14:56:44,  9.48s/it]
 85%|████████▌ | 32291/37963 [79:50:59<14:00:46,  8.89s/it]
 85%|████████▌ | 32292/37963 [79:51:07<13:28:27,  8.55s/it]
 85%|████████▌ | 32293/37963 [79:51:22<16:20:03, 10.37s/it]
 85%|████████▌ | 32294/37963 [79:51:30<15:05:42,  9.59s/it]
 85%|████████▌ | 32295/37963 [79:51:37<14:11:35,  9.01s/it]
 85%|████████▌ | 32296/37963 [79:51:45<13:28:35,  8.56s/it]
 85%|████████▌ | 32297/37963 [79:51:53<13:05:38,  8.32s/it]
 85%|████████▌ | 32298/37963 [79:52:07<15:53:01, 10.09s/it]
 85%|████████▌ | 32299/37963 [79:52:14<14:46:09,  9.39s/it]
 85%|████████▌ | 32300/37963 [79:52:22<13:58:37,  8.89s/it]
                                                           
{'loss': '0.08228', 'grad_norm': '3.235', 'learning_rate': '1.145e-06', 'epoch': '0.8508'}
+
 85%|████████▌ | 32300/37963 [79:52:22<13:58:37,  8.89s/it]
 85%|████████▌ | 32301/37963 [79:52:36<16:13:41, 10.32s/it]
 85%|████████▌ | 32302/37963 [79:52:44<15:03:33,  9.58s/it]
 85%|████████▌ | 32303/37963 [79:52:51<14:03:36,  8.94s/it]
 85%|████████▌ | 32304/37963 [79:53:06<16:48:48, 10.70s/it]
 85%|████████▌ | 32305/37963 [79:53:14<15:28:10,  9.84s/it]
 85%|████████▌ | 32306/37963 [79:53:22<14:30:28,  9.23s/it]
 85%|████████▌ | 32307/37963 [79:53:29<13:46:51,  8.77s/it]
 85%|████████▌ | 32308/37963 [79:53:37<13:16:13,  8.45s/it]
 85%|████████▌ | 32309/37963 [79:53:45<12:54:58,  8.22s/it]
 85%|████████▌ | 32310/37963 [79:54:06<18:55:32, 12.05s/it]
                                                           
{'loss': '0.088', 'grad_norm': '2.952', 'learning_rate': '1.141e-06', 'epoch': '0.8511'}
+
 85%|████████▌ | 32310/37963 [79:54:06<18:55:32, 12.05s/it]
 85%|████████▌ | 32311/37963 [79:54:13<16:53:25, 10.76s/it]
 85%|████████▌ | 32312/37963 [79:54:21<15:28:44,  9.86s/it]
 85%|████████▌ | 32313/37963 [79:54:29<14:27:24,  9.21s/it]
 85%|████████▌ | 32314/37963 [79:54:37<13:44:58,  8.76s/it]
 85%|████████▌ | 32315/37963 [79:54:44<13:14:37,  8.44s/it]
 85%|████████▌ | 32316/37963 [79:54:52<12:49:58,  8.18s/it]
 85%|████████▌ | 32317/37963 [79:55:00<12:37:09,  8.05s/it]
 85%|████████▌ | 32318/37963 [79:55:07<12:29:09,  7.96s/it]
 85%|████████▌ | 32319/37963 [79:55:15<12:24:02,  7.91s/it]
 85%|████████▌ | 32320/37963 [79:55:23<12:15:44,  7.82s/it]
                                                           
{'loss': '0.08754', 'grad_norm': '3.042', 'learning_rate': '1.137e-06', 'epoch': '0.8514'}
+
 85%|████████▌ | 32320/37963 [79:55:23<12:15:44,  7.82s/it]
 85%|████████▌ | 32321/37963 [79:55:30<12:10:51,  7.77s/it]
 85%|████████▌ | 32322/37963 [79:55:38<12:07:43,  7.74s/it]
 85%|████████▌ | 32323/37963 [79:55:46<12:07:30,  7.74s/it]
 85%|████████▌ | 32324/37963 [79:55:54<12:07:08,  7.74s/it]
 85%|████████▌ | 32325/37963 [79:56:01<12:04:46,  7.71s/it]
 85%|████████▌ | 32326/37963 [79:56:09<12:02:27,  7.69s/it]
 85%|████████▌ | 32327/37963 [79:56:17<12:01:13,  7.68s/it]
 85%|████████▌ | 32328/37963 [79:56:24<11:56:03,  7.62s/it]
 85%|████████▌ | 32329/37963 [79:56:32<11:57:26,  7.64s/it]
 85%|████████▌ | 32330/37963 [79:56:39<12:00:59,  7.68s/it]
                                                           
{'loss': '0.08284', 'grad_norm': '2.709', 'learning_rate': '1.133e-06', 'epoch': '0.8516'}
+
 85%|████████▌ | 32330/37963 [79:56:39<12:00:59,  7.68s/it]
 85%|████████▌ | 32331/37963 [79:56:47<12:02:36,  7.70s/it]
 85%|████████▌ | 32332/37963 [79:56:55<12:03:20,  7.71s/it]
 85%|████████▌ | 32333/37963 [79:57:03<12:01:45,  7.69s/it]
 85%|████████▌ | 32334/37963 [79:57:10<11:55:17,  7.62s/it]
 85%|████████▌ | 32335/37963 [79:57:24<14:52:01,  9.51s/it]
 85%|████████▌ | 32336/37963 [79:57:32<14:05:04,  9.01s/it]
 85%|████████▌ | 32337/37963 [79:57:39<13:23:10,  8.57s/it]
 85%|████████▌ | 32338/37963 [79:57:54<16:25:48, 10.52s/it]
 85%|████████▌ | 32339/37963 [79:58:02<15:05:41,  9.66s/it]
 85%|████████▌ | 32340/37963 [79:58:10<14:08:44,  9.06s/it]
                                                           
{'loss': '0.09575', 'grad_norm': '4.789', 'learning_rate': '1.129e-06', 'epoch': '0.8519'}
+
 85%|████████▌ | 32340/37963 [79:58:10<14:08:44,  9.06s/it]
 85%|████████▌ | 32341/37963 [79:58:24<16:33:52, 10.61s/it]
 85%|████████▌ | 32342/37963 [79:58:32<15:15:08,  9.77s/it]
 85%|████████▌ | 32343/37963 [79:58:39<14:17:03,  9.15s/it]
 85%|████████▌ | 32344/37963 [79:58:47<13:29:13,  8.64s/it]
 85%|████████▌ | 32345/37963 [79:59:01<15:58:45, 10.24s/it]
 85%|████████▌ | 32346/37963 [79:59:08<14:45:05,  9.45s/it]
 85%|████████▌ | 32347/37963 [79:59:16<14:01:22,  8.99s/it]
 85%|████████▌ | 32348/37963 [79:59:24<13:22:29,  8.58s/it]
 85%|████████▌ | 32349/37963 [79:59:32<12:58:59,  8.33s/it]
 85%|████████▌ | 32350/37963 [79:59:39<12:33:26,  8.05s/it]
                                                           
{'loss': '0.09033', 'grad_norm': '2.887', 'learning_rate': '1.125e-06', 'epoch': '0.8521'}
+
 85%|████████▌ | 32350/37963 [79:59:39<12:33:26,  8.05s/it]
 85%|████████▌ | 32351/37963 [79:59:47<12:27:05,  7.99s/it]
 85%|████████▌ | 32352/37963 [79:59:55<12:16:47,  7.88s/it]
 85%|████████▌ | 32353/37963 [80:00:09<15:22:01,  9.86s/it]
 85%|████████▌ | 32354/37963 [80:00:17<14:19:13,  9.19s/it]
 85%|████████▌ | 32355/37963 [80:00:24<13:38:15,  8.75s/it]
 85%|████████▌ | 32356/37963 [80:00:39<16:12:51, 10.41s/it]
 85%|████████▌ | 32357/37963 [80:00:53<18:12:43, 11.70s/it]
 85%|████████▌ | 32358/37963 [80:01:01<16:18:33, 10.48s/it]
 85%|████████▌ | 32359/37963 [80:01:09<14:56:57,  9.60s/it]
 85%|████████▌ | 32360/37963 [80:01:16<14:05:15,  9.05s/it]
                                                           
{'loss': '0.09569', 'grad_norm': '2.693', 'learning_rate': '1.121e-06', 'epoch': '0.8524'}
+
 85%|████████▌ | 32360/37963 [80:01:16<14:05:15,  9.05s/it]
 85%|████████▌ | 32361/37963 [80:01:24<13:24:12,  8.61s/it]
 85%|████████▌ | 32362/37963 [80:01:32<12:59:38,  8.35s/it]
 85%|████████▌ | 32363/37963 [80:01:46<15:40:54, 10.08s/it]
 85%|████████▌ | 32364/37963 [80:01:54<14:40:53,  9.44s/it]
 85%|████████▌ | 32365/37963 [80:02:01<13:51:32,  8.91s/it]
 85%|████████▌ | 32366/37963 [80:02:09<13:16:16,  8.54s/it]
 85%|████████▌ | 32367/37963 [80:02:17<12:58:47,  8.35s/it]
 85%|████████▌ | 32368/37963 [80:02:25<12:40:31,  8.16s/it]
 85%|████████▌ | 32369/37963 [80:02:32<12:25:44,  8.00s/it]
 85%|████████▌ | 32370/37963 [80:02:40<12:15:16,  7.89s/it]
                                                           
{'loss': '0.08621', 'grad_norm': '3.397', 'learning_rate': '1.117e-06', 'epoch': '0.8527'}
+
 85%|████████▌ | 32370/37963 [80:02:40<12:15:16,  7.89s/it]
 85%|████████▌ | 32371/37963 [80:02:47<12:02:02,  7.75s/it]
 85%|████████▌ | 32372/37963 [80:02:55<11:52:32,  7.65s/it]
 85%|████████▌ | 32373/37963 [80:03:02<11:49:21,  7.61s/it]
 85%|████████▌ | 32374/37963 [80:03:10<11:50:41,  7.63s/it]
 85%|████████▌ | 32375/37963 [80:03:18<11:55:51,  7.69s/it]
 85%|████████▌ | 32376/37963 [80:03:25<11:53:37,  7.66s/it]
 85%|████████▌ | 32377/37963 [80:03:33<11:53:56,  7.67s/it]
 85%|████████▌ | 32378/37963 [80:03:41<11:48:54,  7.62s/it]
 85%|████████▌ | 32379/37963 [80:03:48<11:53:12,  7.66s/it]
 85%|████████▌ | 32380/37963 [80:03:56<11:52:30,  7.66s/it]
                                                           
{'loss': '0.0883', 'grad_norm': '2.542', 'learning_rate': '1.113e-06', 'epoch': '0.8529'}
+
 85%|████████▌ | 32380/37963 [80:03:56<11:52:30,  7.66s/it]
 85%|████████▌ | 32381/37963 [80:04:04<11:51:47,  7.65s/it]
 85%|████████▌ | 32382/37963 [80:04:11<11:47:44,  7.61s/it]
 85%|████████▌ | 32383/37963 [80:04:19<12:04:24,  7.79s/it]
 85%|████████▌ | 32384/37963 [80:04:27<12:03:03,  7.78s/it]
 85%|████████▌ | 32385/37963 [80:04:35<11:58:44,  7.73s/it]
 85%|████████▌ | 32386/37963 [80:04:50<15:21:34,  9.91s/it]
 85%|████████▌ | 32387/37963 [80:04:57<14:18:05,  9.23s/it]
 85%|████████▌ | 32388/37963 [80:05:05<13:34:03,  8.76s/it]
 85%|████████▌ | 32389/37963 [80:05:13<13:01:37,  8.41s/it]
 85%|████████▌ | 32390/37963 [80:05:21<12:46:17,  8.25s/it]
                                                           
{'loss': '0.07581', 'grad_norm': '2.655', 'learning_rate': '1.11e-06', 'epoch': '0.8532'}
+
 85%|████████▌ | 32390/37963 [80:05:21<12:46:17,  8.25s/it]
 85%|████████▌ | 32391/37963 [80:05:28<12:32:26,  8.10s/it]
 85%|████████▌ | 32392/37963 [80:05:36<12:21:11,  7.98s/it]
 85%|████████▌ | 32393/37963 [80:05:50<15:17:36,  9.88s/it]
 85%|████████▌ | 32394/37963 [80:05:58<14:16:30,  9.23s/it]
 85%|████████▌ | 32395/37963 [80:06:05<13:26:11,  8.69s/it]
 85%|████████▌ | 32396/37963 [80:06:13<13:01:01,  8.42s/it]
 85%|████████▌ | 32397/37963 [80:06:21<12:33:28,  8.12s/it]
 85%|████████▌ | 32398/37963 [80:06:28<12:12:51,  7.90s/it]
 85%|████████▌ | 32399/37963 [80:06:35<11:58:16,  7.75s/it]
 85%|████████▌ | 32400/37963 [80:06:43<11:54:15,  7.70s/it]
                                                           
{'loss': '0.08617', 'grad_norm': '2.215', 'learning_rate': '1.106e-06', 'epoch': '0.8535'}
+
 85%|████████▌ | 32400/37963 [80:06:43<11:54:15,  7.70s/it]
 85%|████████▌ | 32401/37963 [80:06:58<15:01:13,  9.72s/it]
 85%|████████▌ | 32402/37963 [80:07:05<14:06:34,  9.13s/it]
 85%|████████▌ | 32403/37963 [80:07:13<13:27:15,  8.71s/it]
 85%|████████▌ | 32404/37963 [80:07:28<16:29:08, 10.68s/it]
 85%|████████▌ | 32405/37963 [80:07:43<18:09:00, 11.76s/it]
 85%|████████▌ | 32406/37963 [80:07:51<16:24:40, 10.63s/it]
 85%|████████▌ | 32407/37963 [80:08:05<18:03:52, 11.70s/it]
 85%|████████▌ | 32408/37963 [80:08:12<16:04:23, 10.42s/it]
 85%|████████▌ | 32409/37963 [80:08:20<14:50:24,  9.62s/it]
 85%|████████▌ | 32410/37963 [80:08:28<13:56:12,  9.04s/it]
                                                           
{'loss': '0.08893', 'grad_norm': '3.804', 'learning_rate': '1.102e-06', 'epoch': '0.8537'}
+
 85%|████████▌ | 32410/37963 [80:08:28<13:56:12,  9.04s/it]
 85%|████████▌ | 32411/37963 [80:08:35<13:17:17,  8.62s/it]
 85%|████████▌ | 32412/37963 [80:08:43<12:52:03,  8.35s/it]
 85%|████████▌ | 32413/37963 [80:08:51<12:35:41,  8.17s/it]
 85%|████████▌ | 32414/37963 [80:08:58<12:20:29,  8.01s/it]
 85%|████████▌ | 32415/37963 [80:09:06<12:12:08,  7.92s/it]
 85%|████████▌ | 32416/37963 [80:09:14<12:01:16,  7.80s/it]
 85%|████████▌ | 32417/37963 [80:09:21<12:02:05,  7.81s/it]
 85%|████████▌ | 32418/37963 [80:09:30<12:10:40,  7.91s/it]
 85%|████████▌ | 32419/37963 [80:09:37<12:01:14,  7.81s/it]
 85%|████████▌ | 32420/37963 [80:09:45<12:00:19,  7.80s/it]
                                                           
{'loss': '0.09577', 'grad_norm': '3.197', 'learning_rate': '1.098e-06', 'epoch': '0.854'}
+
 85%|████████▌ | 32420/37963 [80:09:45<12:00:19,  7.80s/it]
 85%|████████▌ | 32421/37963 [80:09:52<11:53:56,  7.73s/it]
 85%|████████▌ | 32422/37963 [80:10:00<11:51:52,  7.71s/it]
 85%|████████▌ | 32423/37963 [80:10:08<11:48:45,  7.68s/it]
 85%|████████▌ | 32424/37963 [80:10:16<11:53:40,  7.73s/it]
 85%|████████▌ | 32425/37963 [80:10:23<11:55:18,  7.75s/it]
 85%|████████▌ | 32426/37963 [80:10:31<11:55:01,  7.75s/it]
 85%|████████▌ | 32427/37963 [80:10:39<11:53:05,  7.73s/it]
 85%|████████▌ | 32428/37963 [80:10:47<11:52:03,  7.72s/it]
 85%|████████▌ | 32429/37963 [80:10:54<11:49:37,  7.69s/it]
 85%|████████▌ | 32430/37963 [80:11:02<11:44:47,  7.64s/it]
                                                           
{'loss': '0.08151', 'grad_norm': '2.375', 'learning_rate': '1.094e-06', 'epoch': '0.8543'}
+
 85%|████████▌ | 32430/37963 [80:11:02<11:44:47,  7.64s/it]
 85%|████████▌ | 32431/37963 [80:11:09<11:46:54,  7.67s/it]
 85%|████████▌ | 32432/37963 [80:11:17<11:48:57,  7.69s/it]
 85%|████████▌ | 32433/37963 [80:11:25<11:44:39,  7.65s/it]
 85%|████████▌ | 32434/37963 [80:11:32<11:43:54,  7.64s/it]
 85%|████████▌ | 32435/37963 [80:11:47<15:02:11,  9.79s/it]
 85%|████████▌ | 32436/37963 [80:11:55<14:09:12,  9.22s/it]
 85%|████████▌ | 32437/37963 [80:12:09<16:31:55, 10.77s/it]
 85%|████████▌ | 32438/37963 [80:12:17<15:08:53,  9.87s/it]
 85%|████████▌ | 32439/37963 [80:12:25<14:10:37,  9.24s/it]
 85%|████████▌ | 32440/37963 [80:12:46<19:31:06, 12.72s/it]
                                                           
{'loss': '0.09869', 'grad_norm': '2.785', 'learning_rate': '1.09e-06', 'epoch': '0.8545'}
+
 85%|████████▌ | 32440/37963 [80:12:46<19:31:06, 12.72s/it]
 85%|████████▌ | 32441/37963 [80:12:54<17:14:22, 11.24s/it]
 85%|████████▌ | 32442/37963 [80:13:01<15:34:33, 10.16s/it]
 85%|████████▌ | 32443/37963 [80:13:09<14:21:14,  9.36s/it]
 85%|████████▌ | 32444/37963 [80:13:16<13:35:36,  8.87s/it]
 85%|████████▌ | 32445/37963 [80:13:31<16:13:05, 10.58s/it]
 85%|████████▌ | 32446/37963 [80:13:39<15:00:28,  9.79s/it]
 85%|████████▌ | 32447/37963 [80:13:47<14:05:12,  9.19s/it]
 85%|████████▌ | 32448/37963 [80:13:55<13:26:47,  8.78s/it]
 85%|████████▌ | 32449/37963 [80:14:09<15:59:28, 10.44s/it]
 85%|████████▌ | 32450/37963 [80:14:17<14:44:43,  9.63s/it]
                                                           
{'loss': '0.08875', 'grad_norm': '3.699', 'learning_rate': '1.086e-06', 'epoch': '0.8548'}
+
 85%|████████▌ | 32450/37963 [80:14:17<14:44:43,  9.63s/it]
 85%|████████▌ | 32451/37963 [80:14:31<16:47:48, 10.97s/it]
 85%|████████▌ | 32452/37963 [80:14:45<18:31:27, 12.10s/it]
 85%|████████▌ | 32453/37963 [80:14:53<16:29:18, 10.77s/it]
 85%|████████▌ | 32454/37963 [80:15:01<15:01:22,  9.82s/it]
 85%|████████▌ | 32455/37963 [80:15:08<13:56:20,  9.11s/it]
 85%|████████▌ | 32456/37963 [80:15:15<13:05:39,  8.56s/it]
 85%|████████▌ | 32457/37963 [80:15:23<12:32:36,  8.20s/it]
 85%|████████▌ | 32458/37963 [80:15:31<12:19:16,  8.06s/it]
 86%|████████▌ | 32459/37963 [80:15:38<12:08:46,  7.94s/it]
 86%|████████▌ | 32460/37963 [80:15:46<12:02:00,  7.87s/it]
                                                           
{'loss': '0.07582', 'grad_norm': '1.829', 'learning_rate': '1.082e-06', 'epoch': '0.855'}
+
 86%|████████▌ | 32460/37963 [80:15:46<12:02:00,  7.87s/it]
 86%|████████▌ | 32461/37963 [80:15:53<11:39:15,  7.63s/it]
 86%|████████▌ | 32462/37963 [80:16:01<11:41:50,  7.66s/it]
 86%|████████▌ | 32463/37963 [80:16:08<11:40:31,  7.64s/it]
 86%|████████▌ | 32464/37963 [80:16:16<11:47:39,  7.72s/it]
 86%|████████▌ | 32465/37963 [80:16:24<11:47:49,  7.72s/it]
 86%|████████▌ | 32466/37963 [80:16:32<11:46:54,  7.72s/it]
 86%|████████▌ | 32467/37963 [80:16:39<11:46:59,  7.72s/it]
 86%|████████▌ | 32468/37963 [80:16:47<11:47:51,  7.73s/it]
 86%|████████▌ | 32469/37963 [80:16:55<11:50:05,  7.75s/it]
 86%|████████▌ | 32470/37963 [80:17:02<11:45:14,  7.70s/it]
                                                           
{'loss': '0.08925', 'grad_norm': '4.162', 'learning_rate': '1.078e-06', 'epoch': '0.8553'}
+
 86%|████████▌ | 32470/37963 [80:17:02<11:45:14,  7.70s/it]
 86%|████████▌ | 32471/37963 [80:17:10<11:45:17,  7.71s/it]
 86%|████████▌ | 32472/37963 [80:17:18<11:49:29,  7.75s/it]
 86%|████████▌ | 32473/37963 [80:17:26<11:47:54,  7.74s/it]
 86%|████████▌ | 32474/37963 [80:17:33<11:47:30,  7.73s/it]
 86%|████████▌ | 32475/37963 [80:17:41<11:45:24,  7.71s/it]
 86%|████████▌ | 32476/37963 [80:17:49<11:44:36,  7.70s/it]
 86%|████████▌ | 32477/37963 [80:17:57<11:45:43,  7.72s/it]
 86%|████████▌ | 32478/37963 [80:18:04<11:43:10,  7.69s/it]
 86%|████████▌ | 32479/37963 [80:18:12<11:40:16,  7.66s/it]
 86%|████████▌ | 32480/37963 [80:18:20<11:45:13,  7.72s/it]
                                                           
{'loss': '0.09578', 'grad_norm': '4.389', 'learning_rate': '1.075e-06', 'epoch': '0.8556'}
+
 86%|████████▌ | 32480/37963 [80:18:20<11:45:13,  7.72s/it]
 86%|████████▌ | 32481/37963 [80:18:27<11:45:04,  7.72s/it]
 86%|████████▌ | 32482/37963 [80:18:35<11:45:45,  7.73s/it]
 86%|████████▌ | 32483/37963 [80:18:50<15:02:43,  9.88s/it]
 86%|████████▌ | 32484/37963 [80:18:58<14:03:38,  9.24s/it]
 86%|████████▌ | 32485/37963 [80:19:05<13:20:10,  8.76s/it]
 86%|████████▌ | 32486/37963 [80:19:20<16:09:00, 10.62s/it]
 86%|████████▌ | 32487/37963 [80:19:28<14:53:08,  9.79s/it]
 86%|████████▌ | 32488/37963 [80:19:36<13:55:06,  9.15s/it]
 86%|████████▌ | 32489/37963 [80:19:44<13:17:45,  8.74s/it]
 86%|████████▌ | 32490/37963 [80:19:51<12:48:16,  8.42s/it]
                                                           
{'loss': '0.1009', 'grad_norm': '3.182', 'learning_rate': '1.071e-06', 'epoch': '0.8558'}
+
 86%|████████▌ | 32490/37963 [80:19:51<12:48:16,  8.42s/it]
 86%|████████▌ | 32491/37963 [80:20:06<15:33:39, 10.24s/it]
 86%|████████▌ | 32492/37963 [80:20:14<14:25:27,  9.49s/it]
 86%|████████▌ | 32493/37963 [80:20:21<13:39:29,  8.99s/it]
 86%|████████▌ | 32494/37963 [80:20:36<16:04:47, 10.58s/it]
 86%|████████▌ | 32495/37963 [80:20:50<17:46:58, 11.71s/it]
 86%|████████▌ | 32496/37963 [80:20:58<15:56:56, 10.50s/it]
 86%|████████▌ | 32497/37963 [80:21:12<17:37:40, 11.61s/it]
 86%|████████▌ | 32498/37963 [80:21:20<15:53:55, 10.47s/it]
 86%|████████▌ | 32499/37963 [80:21:27<14:38:54,  9.65s/it]
 86%|████████▌ | 32500/37963 [80:21:35<13:46:11,  9.07s/it]
                                                           
{'loss': '0.07821', 'grad_norm': '3.138', 'learning_rate': '1.067e-06', 'epoch': '0.8561'}
+
 86%|████████▌ | 32500/37963 [80:21:35<13:46:11,  9.07s/it]
 86%|████████▌ | 32501/37963 [80:21:43<13:02:17,  8.59s/it]
 86%|████████▌ | 32502/37963 [80:21:58<15:54:04, 10.48s/it]
 86%|████████▌ | 32503/37963 [80:22:05<14:37:37,  9.64s/it]
 86%|████████▌ | 32504/37963 [80:22:13<13:43:51,  9.06s/it]
 86%|████████▌ | 32505/37963 [80:22:27<16:06:37, 10.63s/it]
 86%|████████▌ | 32506/37963 [80:22:35<14:41:42,  9.69s/it]
 86%|████████▌ | 32507/37963 [80:22:42<13:48:01,  9.11s/it]
 86%|████████▌ | 32508/37963 [80:22:50<13:11:44,  8.71s/it]
 86%|████████▌ | 32509/37963 [80:22:58<12:45:44,  8.42s/it]
 86%|████████▌ | 32510/37963 [80:23:06<12:25:56,  8.21s/it]
                                                           
{'loss': '0.08291', 'grad_norm': '2.832', 'learning_rate': '1.063e-06', 'epoch': '0.8564'}
+
 86%|████████▌ | 32510/37963 [80:23:06<12:25:56,  8.21s/it]
 86%|████████▌ | 32511/37963 [80:23:13<12:11:14,  8.05s/it]
 86%|████████▌ | 32512/37963 [80:23:21<12:03:09,  7.96s/it]
 86%|████████▌ | 32513/37963 [80:23:29<11:56:08,  7.88s/it]
 86%|████████▌ | 32514/37963 [80:23:36<11:47:06,  7.79s/it]
 86%|████████▌ | 32515/37963 [80:23:44<11:44:57,  7.76s/it]
 86%|████████▌ | 32516/37963 [80:23:52<11:43:07,  7.75s/it]
 86%|████████▌ | 32517/37963 [80:23:59<11:37:08,  7.68s/it]
 86%|████████▌ | 32518/37963 [80:24:07<11:37:33,  7.69s/it]
 86%|████████▌ | 32519/37963 [80:24:15<11:34:13,  7.65s/it]
 86%|████████▌ | 32520/37963 [80:24:22<11:36:49,  7.68s/it]
                                                           
{'loss': '0.08575', 'grad_norm': '3.481', 'learning_rate': '1.059e-06', 'epoch': '0.8566'}
+
 86%|████████▌ | 32520/37963 [80:24:22<11:36:49,  7.68s/it]
 86%|████████▌ | 32521/37963 [80:24:30<11:39:31,  7.71s/it]
 86%|████████▌ | 32522/37963 [80:24:38<11:38:38,  7.70s/it]
 86%|████████▌ | 32523/37963 [80:24:46<11:41:22,  7.74s/it]
 86%|████████▌ | 32524/37963 [80:24:53<11:42:48,  7.75s/it]
 86%|████████▌ | 32525/37963 [80:25:01<11:36:22,  7.68s/it]
 86%|████████▌ | 32526/37963 [80:25:09<11:36:22,  7.68s/it]
 86%|████████▌ | 32527/37963 [80:25:16<11:37:17,  7.70s/it]
 86%|████████▌ | 32528/37963 [80:25:24<11:23:23,  7.54s/it]
 86%|████████▌ | 32529/37963 [80:25:31<11:22:29,  7.54s/it]
 86%|████████▌ | 32530/37963 [80:25:46<14:37:50,  9.69s/it]
                                                           
{'loss': '0.1022', 'grad_norm': '4.004', 'learning_rate': '1.055e-06', 'epoch': '0.8569'}
+
 86%|████████▌ | 32530/37963 [80:25:46<14:37:50,  9.69s/it]
 86%|████████▌ | 32531/37963 [80:25:54<13:49:11,  9.16s/it]
 86%|████████▌ | 32532/37963 [80:26:01<13:06:21,  8.69s/it]
 86%|████████▌ | 32533/37963 [80:26:09<12:31:46,  8.31s/it]
 86%|████████▌ | 32534/37963 [80:26:16<12:06:23,  8.03s/it]
 86%|████████▌ | 32535/37963 [80:26:31<14:59:29,  9.94s/it]
 86%|████████▌ | 32536/37963 [80:26:38<13:54:19,  9.22s/it]
 86%|████████▌ | 32537/37963 [80:26:46<13:10:53,  8.75s/it]
 86%|████████▌ | 32538/37963 [80:26:54<12:45:48,  8.47s/it]
 86%|████████▌ | 32539/37963 [80:27:08<15:21:37, 10.19s/it]
 86%|████████▌ | 32540/37963 [80:27:15<14:04:28,  9.34s/it]
                                                           
{'loss': '0.09002', 'grad_norm': '3.122', 'learning_rate': '1.052e-06', 'epoch': '0.8572'}
+
 86%|████████▌ | 32540/37963 [80:27:15<14:04:28,  9.34s/it]
 86%|████████▌ | 32541/37963 [80:27:23<13:19:36,  8.85s/it]
 86%|████████▌ | 32542/37963 [80:27:37<15:50:47, 10.52s/it]
 86%|████████▌ | 32543/37963 [80:27:45<14:32:32,  9.66s/it]
 86%|████████▌ | 32544/37963 [80:27:53<13:40:24,  9.08s/it]
 86%|████████▌ | 32545/37963 [80:28:07<16:03:12, 10.67s/it]
 86%|████████▌ | 32546/37963 [80:28:15<14:49:15,  9.85s/it]
 86%|████████▌ | 32547/37963 [80:28:23<13:48:04,  9.17s/it]
 86%|████████▌ | 32548/37963 [80:28:36<15:57:12, 10.61s/it]
 86%|████████▌ | 32549/37963 [80:28:50<17:29:06, 11.63s/it]
 86%|████████▌ | 32550/37963 [80:29:05<19:00:38, 12.64s/it]
                                                           
{'loss': '0.08575', 'grad_norm': '3.056', 'learning_rate': '1.048e-06', 'epoch': '0.8574'}
+
 86%|████████▌ | 32550/37963 [80:29:05<19:00:38, 12.64s/it]
 86%|████████▌ | 32551/37963 [80:29:13<16:49:06, 11.19s/it]
 86%|████████▌ | 32552/37963 [80:29:21<15:15:00, 10.15s/it]
 86%|████████▌ | 32553/37963 [80:29:29<14:10:48,  9.44s/it]
 86%|████████▌ | 32554/37963 [80:29:36<13:23:48,  8.92s/it]
 86%|████████▌ | 32555/37963 [80:29:44<12:46:04,  8.50s/it]
 86%|████████▌ | 32556/37963 [80:29:52<12:23:57,  8.26s/it]
 86%|████████▌ | 32557/37963 [80:29:59<12:00:58,  8.00s/it]
 86%|████████▌ | 32558/37963 [80:30:07<11:51:32,  7.90s/it]
 86%|████████▌ | 32559/37963 [80:30:14<11:46:26,  7.84s/it]
 86%|████████▌ | 32560/37963 [80:30:22<11:43:37,  7.81s/it]
                                                           
{'loss': '0.08063', 'grad_norm': '3.054', 'learning_rate': '1.044e-06', 'epoch': '0.8577'}
+
 86%|████████▌ | 32560/37963 [80:30:22<11:43:37,  7.81s/it]
 86%|████████▌ | 32561/37963 [80:30:30<11:39:55,  7.77s/it]
 86%|████████▌ | 32562/37963 [80:30:38<11:40:23,  7.78s/it]
 86%|████████▌ | 32563/37963 [80:30:45<11:36:33,  7.74s/it]
 86%|████████▌ | 32564/37963 [80:30:53<11:32:39,  7.70s/it]
 86%|████████▌ | 32565/37963 [80:31:01<11:31:47,  7.69s/it]
 86%|████████▌ | 32566/37963 [80:31:08<11:31:14,  7.68s/it]
 86%|████████▌ | 32567/37963 [80:31:16<11:31:23,  7.69s/it]
 86%|████████▌ | 32568/37963 [80:31:24<11:29:42,  7.67s/it]
 86%|████████▌ | 32569/37963 [80:31:31<11:24:48,  7.62s/it]
 86%|████████▌ | 32570/37963 [80:31:39<11:23:45,  7.61s/it]
                                                           
{'loss': '0.1067', 'grad_norm': '3.044', 'learning_rate': '1.04e-06', 'epoch': '0.8579'}
+
 86%|████████▌ | 32570/37963 [80:31:39<11:23:45,  7.61s/it]
 86%|████████▌ | 32571/37963 [80:31:46<11:27:16,  7.65s/it]
 86%|████████▌ | 32572/37963 [80:31:54<11:29:16,  7.67s/it]
 86%|████████▌ | 32573/37963 [80:32:02<11:34:45,  7.73s/it]
 86%|████████▌ | 32574/37963 [80:32:10<11:32:56,  7.72s/it]
 86%|████████▌ | 32575/37963 [80:32:17<11:31:51,  7.70s/it]
 86%|████████▌ | 32576/37963 [80:32:25<11:31:56,  7.71s/it]
 86%|████████▌ | 32577/37963 [80:32:33<11:32:01,  7.71s/it]
 86%|████████▌ | 32578/37963 [80:32:41<11:32:54,  7.72s/it]
 86%|████████▌ | 32579/37963 [80:32:48<11:26:43,  7.65s/it]
 86%|████████▌ | 32580/37963 [80:32:56<11:27:26,  7.66s/it]
                                                           
{'loss': '0.09235', 'grad_norm': '4.585', 'learning_rate': '1.036e-06', 'epoch': '0.8582'}
+
 86%|████████▌ | 32580/37963 [80:32:56<11:27:26,  7.66s/it]
 86%|████████▌ | 32581/37963 [80:33:03<11:26:28,  7.65s/it]
 86%|████████▌ | 32582/37963 [80:33:11<11:21:58,  7.60s/it]
 86%|████████▌ | 32583/37963 [80:33:25<14:25:19,  9.65s/it]
 86%|████████▌ | 32584/37963 [80:33:40<16:44:15, 11.20s/it]
 86%|████████▌ | 32585/37963 [80:33:48<15:11:10, 10.17s/it]
 86%|████████▌ | 32586/37963 [80:33:56<14:05:07,  9.43s/it]
 86%|████████▌ | 32587/37963 [80:34:10<16:28:27, 11.03s/it]
 86%|████████▌ | 32588/37963 [80:34:18<14:59:19, 10.04s/it]
 86%|████████▌ | 32589/37963 [80:34:26<14:00:30,  9.38s/it]
 86%|████████▌ | 32590/37963 [80:34:34<13:13:34,  8.86s/it]
                                                           
{'loss': '0.09338', 'grad_norm': '3.021', 'learning_rate': '1.033e-06', 'epoch': '0.8585'}
+
 86%|████████▌ | 32590/37963 [80:34:34<13:13:34,  8.86s/it]
 86%|████████▌ | 32591/37963 [80:34:41<12:39:42,  8.49s/it]
 86%|████████▌ | 32592/37963 [80:34:49<12:16:46,  8.23s/it]
 86%|████████▌ | 32593/37963 [80:34:56<11:56:57,  8.01s/it]
 86%|████████▌ | 32594/37963 [80:35:04<11:46:23,  7.89s/it]
 86%|████████▌ | 32595/37963 [80:35:18<14:31:00,  9.74s/it]
 86%|████████▌ | 32596/37963 [80:35:32<16:34:35, 11.12s/it]
 86%|████████▌ | 32597/37963 [80:35:40<14:59:20, 10.06s/it]
 86%|████████▌ | 32598/37963 [80:35:55<17:04:34, 11.46s/it]
 86%|████████▌ | 32599/37963 [80:36:02<15:19:57, 10.29s/it]
 86%|████████▌ | 32600/37963 [80:36:10<14:07:26,  9.48s/it]
                                                           
{'loss': '0.1004', 'grad_norm': '2.464', 'learning_rate': '1.029e-06', 'epoch': '0.8587'}
+
 86%|████████▌ | 32600/37963 [80:36:10<14:07:26,  9.48s/it]
 86%|████████▌ | 32601/37963 [80:36:18<13:23:48,  8.99s/it]
 86%|████████▌ | 32602/37963 [80:36:32<15:50:17, 10.64s/it]
 86%|████████▌ | 32603/37963 [80:36:40<14:29:18,  9.73s/it]
 86%|████████▌ | 32604/37963 [80:36:55<16:48:59, 11.30s/it]
 86%|████████▌ | 32605/37963 [80:37:02<15:09:10, 10.18s/it]
 86%|████████▌ | 32606/37963 [80:37:10<14:03:31,  9.45s/it]
 86%|████████▌ | 32607/37963 [80:37:18<13:17:52,  8.94s/it]
 86%|████████▌ | 32608/37963 [80:37:25<12:44:02,  8.56s/it]
 86%|████████▌ | 32609/37963 [80:37:33<12:22:33,  8.32s/it]
 86%|████████▌ | 32610/37963 [80:37:41<12:03:04,  8.10s/it]
                                                           
{'loss': '0.0892', 'grad_norm': '3.204', 'learning_rate': '1.025e-06', 'epoch': '0.859'}
+
 86%|████████▌ | 32610/37963 [80:37:41<12:03:04,  8.10s/it]
 86%|████████▌ | 32611/37963 [80:37:49<11:54:24,  8.01s/it]
 86%|████████▌ | 32612/37963 [80:37:56<11:41:52,  7.87s/it]
 86%|████████▌ | 32613/37963 [80:38:04<11:33:40,  7.78s/it]
 86%|████████▌ | 32614/37963 [80:38:11<11:33:22,  7.78s/it]
 86%|████████▌ | 32615/37963 [80:38:19<11:34:01,  7.79s/it]
 86%|████████▌ | 32616/37963 [80:38:27<11:28:58,  7.73s/it]
 86%|████████▌ | 32617/37963 [80:38:34<11:17:40,  7.61s/it]
 86%|████████▌ | 32618/37963 [80:38:42<11:20:07,  7.63s/it]
 86%|████████▌ | 32619/37963 [80:38:49<11:18:18,  7.62s/it]
 86%|████████▌ | 32620/37963 [80:38:57<11:12:00,  7.55s/it]
                                                           
{'loss': '0.07883', 'grad_norm': '2.199', 'learning_rate': '1.021e-06', 'epoch': '0.8593'}
+
 86%|████████▌ | 32620/37963 [80:38:57<11:12:00,  7.55s/it]
 86%|████████▌ | 32621/37963 [80:39:04<11:15:34,  7.59s/it]
 86%|████████▌ | 32622/37963 [80:39:12<11:12:34,  7.56s/it]
 86%|████████▌ | 32623/37963 [80:39:20<11:17:38,  7.61s/it]
 86%|████████▌ | 32624/37963 [80:39:27<11:15:54,  7.60s/it]
 86%|████████▌ | 32625/37963 [80:39:35<11:22:04,  7.67s/it]
 86%|████████▌ | 32626/37963 [80:39:43<11:23:06,  7.68s/it]
 86%|████████▌ | 32627/37963 [80:39:57<14:21:11,  9.68s/it]
 86%|████████▌ | 32628/37963 [80:40:05<13:22:43,  9.03s/it]
 86%|████████▌ | 32629/37963 [80:40:12<12:46:01,  8.62s/it]
 86%|████████▌ | 32630/37963 [80:40:20<12:22:47,  8.36s/it]
                                                           
{'loss': '0.09104', 'grad_norm': '2.997', 'learning_rate': '1.018e-06', 'epoch': '0.8595'}
+
 86%|████████▌ | 32630/37963 [80:40:20<12:22:47,  8.36s/it]
 86%|████████▌ | 32631/37963 [80:40:28<12:04:28,  8.15s/it]
 86%|████████▌ | 32632/37963 [80:40:43<15:06:33, 10.20s/it]
 86%|████████▌ | 32633/37963 [80:40:57<17:06:04, 11.55s/it]
 86%|████████▌ | 32634/37963 [80:41:05<15:25:39, 10.42s/it]
 86%|████████▌ | 32635/37963 [80:41:13<14:15:43,  9.64s/it]
 86%|████████▌ | 32636/37963 [80:41:21<13:28:07,  9.10s/it]
 86%|████████▌ | 32637/37963 [80:41:29<12:50:54,  8.68s/it]
 86%|████████▌ | 32638/37963 [80:41:36<12:25:40,  8.40s/it]
 86%|████████▌ | 32639/37963 [80:41:44<11:57:54,  8.09s/it]
 86%|████████▌ | 32640/37963 [80:41:51<11:46:21,  7.96s/it]
                                                           
{'loss': '0.08842', 'grad_norm': '2.983', 'learning_rate': '1.014e-06', 'epoch': '0.8598'}
+
 86%|████████▌ | 32640/37963 [80:41:51<11:46:21,  7.96s/it]
 86%|████████▌ | 32641/37963 [80:41:59<11:36:11,  7.85s/it]
 86%|████████▌ | 32642/37963 [80:42:07<11:29:38,  7.78s/it]
 86%|████████▌ | 32643/37963 [80:42:14<11:16:51,  7.63s/it]
 86%|████████▌ | 32644/37963 [80:42:22<11:19:06,  7.66s/it]
 86%|████████▌ | 32645/37963 [80:42:29<11:23:29,  7.71s/it]
 86%|████████▌ | 32646/37963 [80:42:37<11:20:02,  7.67s/it]
 86%|████████▌ | 32647/37963 [80:42:45<11:20:01,  7.68s/it]
 86%|████████▌ | 32648/37963 [80:42:52<11:20:07,  7.68s/it]
 86%|████████▌ | 32649/37963 [80:43:07<14:22:03,  9.73s/it]
 86%|████████▌ | 32650/37963 [80:43:21<16:22:03, 11.09s/it]
                                                           
{'loss': '0.09557', 'grad_norm': '2.71', 'learning_rate': '1.01e-06', 'epoch': '0.8601'}
+
 86%|████████▌ | 32650/37963 [80:43:21<16:22:03, 11.09s/it]
 86%|████████▌ | 32651/37963 [80:43:29<14:51:20, 10.07s/it]
 86%|████████▌ | 32652/37963 [80:43:43<16:52:58, 11.44s/it]
 86%|████████▌ | 32653/37963 [80:43:52<15:22:26, 10.42s/it]
 86%|████████▌ | 32654/37963 [80:44:13<20:18:35, 13.77s/it]
 86%|████████▌ | 32655/37963 [80:44:21<17:35:23, 11.93s/it]
 86%|████████▌ | 32656/37963 [80:44:28<15:43:44, 10.67s/it]
 86%|████████▌ | 32657/37963 [80:44:36<14:18:22,  9.71s/it]
 86%|████████▌ | 32658/37963 [80:44:43<13:18:45,  9.03s/it]
 86%|████████▌ | 32659/37963 [80:44:51<12:43:25,  8.64s/it]
 86%|████████▌ | 32660/37963 [80:44:59<12:16:27,  8.33s/it]
                                                           
{'loss': '0.08669', 'grad_norm': '3.386', 'learning_rate': '1.006e-06', 'epoch': '0.8603'}
+
 86%|████████▌ | 32660/37963 [80:44:59<12:16:27,  8.33s/it]
 86%|████████▌ | 32661/37963 [80:45:06<11:59:03,  8.14s/it]
 86%|████████▌ | 32662/37963 [80:45:14<11:44:13,  7.97s/it]
 86%|████████▌ | 32663/37963 [80:45:22<11:34:53,  7.87s/it]
 86%|████████▌ | 32664/37963 [80:45:29<11:28:37,  7.80s/it]
 86%|████████▌ | 32665/37963 [80:45:37<11:26:41,  7.78s/it]
 86%|████████▌ | 32666/37963 [80:45:45<11:23:36,  7.74s/it]
 86%|████████▌ | 32667/37963 [80:45:52<11:13:18,  7.63s/it]
 86%|████████▌ | 32668/37963 [80:46:00<11:14:31,  7.64s/it]
 86%|████████▌ | 32669/37963 [80:46:07<11:14:57,  7.65s/it]
 86%|████████▌ | 32670/37963 [80:46:15<11:13:20,  7.63s/it]
                                                           
{'loss': '0.08895', 'grad_norm': '2.511', 'learning_rate': '1.003e-06', 'epoch': '0.8606'}
+
 86%|████████▌ | 32670/37963 [80:46:15<11:13:20,  7.63s/it]
 86%|████████▌ | 32671/37963 [80:46:22<11:10:21,  7.60s/it]
 86%|████████▌ | 32672/37963 [80:46:30<11:08:48,  7.58s/it]
 86%|████████▌ | 32673/37963 [80:46:38<11:11:02,  7.61s/it]
 86%|████████▌ | 32674/37963 [80:46:45<11:13:21,  7.64s/it]
 86%|████████▌ | 32675/37963 [80:46:53<11:13:02,  7.64s/it]
 86%|████████▌ | 32676/37963 [80:47:01<11:14:43,  7.66s/it]
 86%|████████▌ | 32677/37963 [80:47:08<11:09:28,  7.60s/it]
 86%|████████▌ | 32678/37963 [80:47:16<11:13:49,  7.65s/it]
 86%|████████▌ | 32679/37963 [80:47:31<14:21:17,  9.78s/it]
 86%|████████▌ | 32680/37963 [80:47:39<13:33:00,  9.23s/it]
                                                           
{'loss': '0.09224', 'grad_norm': '2.723', 'learning_rate': '9.99e-07', 'epoch': '0.8608'}
+
 86%|████████▌ | 32680/37963 [80:47:39<13:33:00,  9.23s/it]
 86%|████████▌ | 32681/37963 [80:48:00<18:47:00, 12.80s/it]
 86%|████████▌ | 32682/37963 [80:48:07<16:25:28, 11.20s/it]
 86%|████████▌ | 32683/37963 [80:48:15<14:55:13, 10.17s/it]
 86%|████████▌ | 32684/37963 [80:48:23<13:49:15,  9.43s/it]
 86%|████████▌ | 32685/37963 [80:48:30<13:03:32,  8.91s/it]
 86%|████████▌ | 32686/37963 [80:48:38<12:29:29,  8.52s/it]
 86%|████████▌ | 32687/37963 [80:48:46<12:07:53,  8.28s/it]
 86%|████████▌ | 32688/37963 [80:48:54<11:55:09,  8.13s/it]
 86%|████████▌ | 32689/37963 [80:49:01<11:42:29,  7.99s/it]
 86%|████████▌ | 32690/37963 [80:49:09<11:35:15,  7.91s/it]
                                                           
{'loss': '0.08801', 'grad_norm': '2.934', 'learning_rate': '9.953e-07', 'epoch': '0.8611'}
+
 86%|████████▌ | 32690/37963 [80:49:09<11:35:15,  7.91s/it]
 86%|████████▌ | 32691/37963 [80:49:17<11:33:18,  7.89s/it]
 86%|████████▌ | 32692/37963 [80:49:24<11:27:25,  7.83s/it]
 86%|████████▌ | 32693/37963 [80:49:32<11:18:53,  7.73s/it]
 86%|████████▌ | 32694/37963 [80:49:40<11:17:44,  7.72s/it]
 86%|████████▌ | 32695/37963 [80:49:47<11:14:38,  7.68s/it]
 86%|████████▌ | 32696/37963 [80:49:55<11:13:02,  7.67s/it]
 86%|████████▌ | 32697/37963 [80:50:03<11:17:09,  7.72s/it]
 86%|████████▌ | 32698/37963 [80:50:10<11:16:29,  7.71s/it]
 86%|████████▌ | 32699/37963 [80:50:25<14:11:22,  9.70s/it]
 86%|████████▌ | 32700/37963 [80:50:32<13:18:15,  9.10s/it]
                                                           
{'loss': '0.08389', 'grad_norm': '4.776', 'learning_rate': '9.916e-07', 'epoch': '0.8614'}
+
 86%|████████▌ | 32700/37963 [80:50:32<13:18:15,  9.10s/it]
 86%|████████▌ | 32701/37963 [80:50:47<15:38:29, 10.70s/it]
 86%|████████▌ | 32702/37963 [80:51:01<17:13:43, 11.79s/it]
 86%|████████▌ | 32703/37963 [80:51:17<18:47:59, 12.87s/it]
 86%|████████▌ | 32704/37963 [80:51:31<19:16:31, 13.19s/it]
 86%|████████▌ | 32705/37963 [80:51:38<16:50:45, 11.53s/it]
 86%|████████▌ | 32706/37963 [80:51:46<15:11:04, 10.40s/it]
 86%|████████▌ | 32707/37963 [80:51:54<14:04:18,  9.64s/it]
 86%|████████▌ | 32708/37963 [80:52:02<13:13:55,  9.06s/it]
 86%|████████▌ | 32709/37963 [80:52:09<12:35:49,  8.63s/it]
 86%|████████▌ | 32710/37963 [80:52:17<12:10:12,  8.34s/it]
                                                           
{'loss': '0.08894', 'grad_norm': '3.691', 'learning_rate': '9.879e-07', 'epoch': '0.8616'}
+
 86%|████████▌ | 32710/37963 [80:52:17<12:10:12,  8.34s/it]
 86%|████████▌ | 32711/37963 [80:52:24<11:49:42,  8.11s/it]
 86%|████████▌ | 32712/37963 [80:52:32<11:42:34,  8.03s/it]
 86%|████████▌ | 32713/37963 [80:52:40<11:32:09,  7.91s/it]
 86%|████████▌ | 32714/37963 [80:52:48<11:26:29,  7.85s/it]
 86%|████████▌ | 32715/37963 [80:52:55<11:20:08,  7.78s/it]
 86%|████████▌ | 32716/37963 [80:53:03<11:12:01,  7.68s/it]
 86%|████████▌ | 32717/37963 [80:53:10<11:10:04,  7.66s/it]
 86%|████████▌ | 32718/37963 [80:53:18<11:13:14,  7.70s/it]
 86%|████████▌ | 32719/37963 [80:53:26<11:06:21,  7.62s/it]
 86%|████████▌ | 32720/37963 [80:53:33<11:05:18,  7.61s/it]
                                                           
{'loss': '0.08153', 'grad_norm': '3.825', 'learning_rate': '9.842e-07', 'epoch': '0.8619'}
+
 86%|████████▌ | 32720/37963 [80:53:33<11:05:18,  7.61s/it]
 86%|████████▌ | 32721/37963 [80:53:41<11:03:08,  7.59s/it]
 86%|████████▌ | 32722/37963 [80:53:48<11:10:12,  7.67s/it]
 86%|████████▌ | 32723/37963 [80:53:56<11:07:03,  7.64s/it]
 86%|████████▌ | 32724/37963 [80:54:11<14:23:14,  9.89s/it]
 86%|████████▌ | 32725/37963 [80:54:19<13:28:57,  9.27s/it]
 86%|████████▌ | 32726/37963 [80:54:26<12:40:30,  8.71s/it]
 86%|████████▌ | 32727/37963 [80:54:34<12:12:48,  8.40s/it]
 86%|████████▌ | 32728/37963 [80:54:42<11:49:07,  8.13s/it]
 86%|████████▌ | 32729/37963 [80:54:56<14:37:57, 10.06s/it]
 86%|████████▌ | 32730/37963 [80:55:04<13:32:59,  9.32s/it]
                                                           
{'loss': '0.08219', 'grad_norm': '1.794', 'learning_rate': '9.805e-07', 'epoch': '0.8622'}
+
 86%|████████▌ | 32730/37963 [80:55:04<13:32:59,  9.32s/it]
 86%|████████▌ | 32731/37963 [80:55:11<12:49:34,  8.83s/it]
 86%|████████▌ | 32732/37963 [80:55:19<12:21:45,  8.51s/it]
 86%|████████▌ | 32733/37963 [80:55:27<12:03:53,  8.30s/it]
 86%|████████▌ | 32734/37963 [80:55:41<14:40:52, 10.11s/it]
 86%|████████▌ | 32735/37963 [80:55:49<13:39:50,  9.41s/it]
 86%|████████▌ | 32736/37963 [80:55:57<12:52:56,  8.87s/it]
 86%|████████▌ | 32737/37963 [80:56:04<12:16:40,  8.46s/it]
 86%|████████▌ | 32738/37963 [80:56:12<11:56:25,  8.23s/it]
 86%|████████▌ | 32739/37963 [80:56:20<11:42:16,  8.07s/it]
 86%|████████▌ | 32740/37963 [80:56:27<11:31:30,  7.94s/it]
                                                           
{'loss': '0.09905', 'grad_norm': '3.095', 'learning_rate': '9.768e-07', 'epoch': '0.8624'}
+
 86%|████████▌ | 32740/37963 [80:56:27<11:31:30,  7.94s/it]
 86%|████████▌ | 32741/37963 [80:56:35<11:22:47,  7.85s/it]
 86%|████████▌ | 32742/37963 [80:56:43<11:16:54,  7.78s/it]
 86%|████████▌ | 32743/37963 [80:56:57<14:14:06,  9.82s/it]
 86%|████████▋ | 32744/37963 [80:57:05<13:16:17,  9.15s/it]
 86%|████████▋ | 32745/37963 [80:57:19<15:31:44, 10.71s/it]
 86%|████████▋ | 32746/37963 [80:57:33<17:04:51, 11.79s/it]
 86%|████████▋ | 32747/37963 [80:57:41<15:14:12, 10.52s/it]
 86%|████████▋ | 32748/37963 [80:57:49<14:01:18,  9.68s/it]
 86%|████████▋ | 32749/37963 [80:57:56<13:10:47,  9.10s/it]
 86%|████████▋ | 32750/37963 [80:58:04<12:32:59,  8.67s/it]
                                                           
{'loss': '0.0923', 'grad_norm': '2.914', 'learning_rate': '9.731e-07', 'epoch': '0.8627'}
+
 86%|████████▋ | 32750/37963 [80:58:04<12:32:59,  8.67s/it]
 86%|████████▋ | 32751/37963 [80:58:26<18:08:07, 12.53s/it]
 86%|████████▋ | 32752/37963 [80:58:33<16:03:14, 11.09s/it]
 86%|████████▋ | 32753/37963 [80:58:41<14:30:14, 10.02s/it]
 86%|████████▋ | 32754/37963 [80:58:48<13:28:06,  9.31s/it]
 86%|████████▋ | 32755/37963 [80:58:56<12:38:32,  8.74s/it]
 86%|████████▋ | 32756/37963 [80:59:04<12:13:36,  8.45s/it]
 86%|████████▋ | 32757/37963 [80:59:11<11:54:29,  8.23s/it]
 86%|████████▋ | 32758/37963 [80:59:19<11:41:30,  8.09s/it]
 86%|████████▋ | 32759/37963 [80:59:27<11:31:13,  7.97s/it]
 86%|████████▋ | 32760/37963 [80:59:34<11:23:21,  7.88s/it]
                                                           
{'loss': '0.09624', 'grad_norm': '2.796', 'learning_rate': '9.695e-07', 'epoch': '0.8629'}
+
 86%|████████▋ | 32760/37963 [80:59:34<11:23:21,  7.88s/it]
 86%|████████▋ | 32761/37963 [80:59:42<11:19:45,  7.84s/it]
 86%|████████▋ | 32762/37963 [80:59:50<11:18:56,  7.83s/it]
 86%|████████▋ | 32763/37963 [80:59:58<11:16:25,  7.80s/it]
 86%|████████▋ | 32764/37963 [81:00:05<11:13:12,  7.77s/it]
 86%|████████▋ | 32765/37963 [81:00:13<11:07:47,  7.71s/it]
 86%|████████▋ | 32766/37963 [81:00:21<11:07:32,  7.71s/it]
 86%|████████▋ | 32767/37963 [81:00:28<10:57:43,  7.59s/it]
 86%|████████▋ | 32768/37963 [81:00:36<10:57:50,  7.60s/it]
 86%|████████▋ | 32769/37963 [81:00:43<11:02:27,  7.65s/it]
 86%|████████▋ | 32770/37963 [81:00:51<10:56:52,  7.59s/it]
                                                           
{'loss': '0.09681', 'grad_norm': '3.036', 'learning_rate': '9.658e-07', 'epoch': '0.8632'}
+
 86%|████████▋ | 32770/37963 [81:00:51<10:56:52,  7.59s/it]
 86%|████████▋ | 32771/37963 [81:00:59<11:00:11,  7.63s/it]
 86%|████████▋ | 32772/37963 [81:01:06<11:04:30,  7.68s/it]
 86%|████████▋ | 32773/37963 [81:01:14<11:05:31,  7.69s/it]
 86%|████████▋ | 32774/37963 [81:01:29<14:07:49,  9.80s/it]
 86%|████████▋ | 32775/37963 [81:01:37<13:16:40,  9.21s/it]
 86%|████████▋ | 32776/37963 [81:01:44<12:33:47,  8.72s/it]
 86%|████████▋ | 32777/37963 [81:01:52<12:07:29,  8.42s/it]
 86%|████████▋ | 32778/37963 [81:01:59<11:40:31,  8.11s/it]
 86%|████████▋ | 32779/37963 [81:02:07<11:30:10,  7.99s/it]
 86%|████████▋ | 32780/37963 [81:02:15<11:22:43,  7.90s/it]
                                                           
{'loss': '0.09177', 'grad_norm': '4.103', 'learning_rate': '9.622e-07', 'epoch': '0.8635'}
+
 86%|████████▋ | 32780/37963 [81:02:15<11:22:43,  7.90s/it]
 86%|████████▋ | 32781/37963 [81:02:23<11:20:10,  7.88s/it]
 86%|████████▋ | 32782/37963 [81:02:37<14:10:36,  9.85s/it]
 86%|████████▋ | 32783/37963 [81:02:45<13:12:06,  9.17s/it]
 86%|████████▋ | 32784/37963 [81:02:52<12:34:50,  8.75s/it]
 86%|████████▋ | 32785/37963 [81:03:00<12:02:02,  8.37s/it]
 86%|████████▋ | 32786/37963 [81:03:08<11:45:22,  8.18s/it]
 86%|████████▋ | 32787/37963 [81:03:15<11:33:55,  8.04s/it]
 86%|████████▋ | 32788/37963 [81:03:30<14:13:40,  9.90s/it]
 86%|████████▋ | 32789/37963 [81:03:37<13:12:47,  9.19s/it]
 86%|████████▋ | 32790/37963 [81:03:51<15:21:54, 10.69s/it]
                                                           
{'loss': '0.1018', 'grad_norm': '2.847', 'learning_rate': '9.585e-07', 'epoch': '0.8637'}
+
 86%|████████▋ | 32790/37963 [81:03:51<15:21:54, 10.69s/it]
 86%|████████▋ | 32791/37963 [81:03:59<14:09:50,  9.86s/it]
 86%|████████▋ | 32792/37963 [81:04:07<13:12:04,  9.19s/it]
 86%|████████▋ | 32793/37963 [81:04:15<12:33:20,  8.74s/it]
 86%|████████▋ | 32794/37963 [81:04:22<12:08:09,  8.45s/it]
 86%|████████▋ | 32795/37963 [81:04:37<14:47:23, 10.30s/it]
 86%|████████▋ | 32796/37963 [81:04:45<13:43:20,  9.56s/it]
 86%|████████▋ | 32797/37963 [81:04:53<12:56:25,  9.02s/it]
 86%|████████▋ | 32798/37963 [81:05:00<12:17:46,  8.57s/it]
 86%|████████▋ | 32799/37963 [81:05:14<14:45:44, 10.29s/it]
 86%|████████▋ | 32800/37963 [81:05:22<13:45:31,  9.59s/it]
                                                           
{'loss': '0.08817', 'grad_norm': '3.125', 'learning_rate': '9.549e-07', 'epoch': '0.864'}
+
 86%|████████▋ | 32800/37963 [81:05:22<13:45:31,  9.59s/it]
 86%|████████▋ | 32801/37963 [81:05:30<12:51:55,  8.97s/it]
 86%|████████▋ | 32802/37963 [81:05:38<12:18:39,  8.59s/it]
 86%|████████▋ | 32803/37963 [81:05:45<11:58:45,  8.36s/it]
 86%|████████▋ | 32804/37963 [81:05:53<11:40:41,  8.15s/it]
 86%|████████▋ | 32805/37963 [81:06:07<14:21:22, 10.02s/it]
 86%|████████▋ | 32806/37963 [81:06:15<13:21:25,  9.32s/it]
 86%|████████▋ | 32807/37963 [81:06:23<12:43:08,  8.88s/it]
 86%|████████▋ | 32808/37963 [81:06:31<12:19:35,  8.61s/it]
 86%|████████▋ | 32809/37963 [81:06:39<11:57:20,  8.35s/it]
 86%|████████▋ | 32810/37963 [81:06:46<11:36:48,  8.11s/it]
                                                           
{'loss': '0.09189', 'grad_norm': '3.931', 'learning_rate': '9.512e-07', 'epoch': '0.8643'}
+
 86%|████████▋ | 32810/37963 [81:06:46<11:36:48,  8.11s/it]
 86%|████████▋ | 32811/37963 [81:06:54<11:28:55,  8.02s/it]
 86%|████████▋ | 32812/37963 [81:07:02<11:14:09,  7.85s/it]
 86%|████████▋ | 32813/37963 [81:07:09<11:09:30,  7.80s/it]
 86%|████████▋ | 32814/37963 [81:07:17<11:06:16,  7.76s/it]
 86%|████████▋ | 32815/37963 [81:07:25<11:03:27,  7.73s/it]
 86%|████████▋ | 32816/37963 [81:07:32<10:58:14,  7.67s/it]
 86%|████████▋ | 32817/37963 [81:07:40<10:58:47,  7.68s/it]
 86%|████████▋ | 32818/37963 [81:07:48<11:02:51,  7.73s/it]
 86%|████████▋ | 32819/37963 [81:07:55<11:01:01,  7.71s/it]
 86%|████████▋ | 32820/37963 [81:08:03<10:59:58,  7.70s/it]
                                                           
{'loss': '0.08796', 'grad_norm': '2.475', 'learning_rate': '9.476e-07', 'epoch': '0.8645'}
+
 86%|████████▋ | 32820/37963 [81:08:03<10:59:58,  7.70s/it]
 86%|████████▋ | 32821/37963 [81:08:11<10:59:19,  7.69s/it]
 86%|████████▋ | 32822/37963 [81:08:18<11:00:30,  7.71s/it]
 86%|████████▋ | 32823/37963 [81:08:26<10:57:32,  7.68s/it]
 86%|████████▋ | 32824/37963 [81:08:34<10:59:58,  7.71s/it]
 86%|████████▋ | 32825/37963 [81:08:42<11:02:06,  7.73s/it]
 86%|████████▋ | 32826/37963 [81:08:56<14:05:05,  9.87s/it]
 86%|████████▋ | 32827/37963 [81:09:04<13:04:49,  9.17s/it]
 86%|████████▋ | 32828/37963 [81:09:19<15:31:38, 10.89s/it]
 86%|████████▋ | 32829/37963 [81:09:27<14:13:21,  9.97s/it]
 86%|████████▋ | 32830/37963 [81:09:34<13:12:26,  9.26s/it]
                                                           
{'loss': '0.09438', 'grad_norm': '4.152', 'learning_rate': '9.44e-07', 'epoch': '0.8648'}
+
 86%|████████▋ | 32830/37963 [81:09:34<13:12:26,  9.26s/it]
 86%|████████▋ | 32831/37963 [81:09:42<12:34:29,  8.82s/it]
 86%|████████▋ | 32832/37963 [81:09:56<14:50:59, 10.42s/it]
 86%|████████▋ | 32833/37963 [81:10:04<13:41:58,  9.61s/it]
 86%|████████▋ | 32834/37963 [81:10:19<15:48:46, 11.10s/it]
 86%|████████▋ | 32835/37963 [81:10:26<14:25:37, 10.13s/it]
 86%|████████▋ | 32836/37963 [81:10:34<13:22:54,  9.40s/it]
 86%|████████▋ | 32837/37963 [81:10:48<15:17:06, 10.73s/it]
 87%|████████▋ | 32838/37963 [81:10:56<13:59:01,  9.82s/it]
 87%|████████▋ | 32839/37963 [81:11:03<13:03:01,  9.17s/it]
 87%|████████▋ | 32840/37963 [81:11:11<12:22:50,  8.70s/it]
                                                           
{'loss': '0.0846', 'grad_norm': '2.584', 'learning_rate': '9.404e-07', 'epoch': '0.8651'}
+
 87%|████████▋ | 32840/37963 [81:11:11<12:22:50,  8.70s/it]
 87%|████████▋ | 32841/37963 [81:11:19<11:57:34,  8.41s/it]
 87%|████████▋ | 32842/37963 [81:11:26<11:40:32,  8.21s/it]
 87%|████████▋ | 32843/37963 [81:11:34<11:21:22,  7.98s/it]
 87%|████████▋ | 32844/37963 [81:11:56<17:13:13, 12.11s/it]
 87%|████████▋ | 32845/37963 [81:12:03<15:20:10, 10.79s/it]
 87%|████████▋ | 32846/37963 [81:12:11<14:01:38,  9.87s/it]
 87%|████████▋ | 32847/37963 [81:12:19<13:08:47,  9.25s/it]
 87%|████████▋ | 32848/37963 [81:12:26<12:27:52,  8.77s/it]
 87%|████████▋ | 32849/37963 [81:12:34<12:00:32,  8.45s/it]
 87%|████████▋ | 32850/37963 [81:12:42<11:41:08,  8.23s/it]
                                                           
{'loss': '0.09142', 'grad_norm': '3.456', 'learning_rate': '9.368e-07', 'epoch': '0.8653'}
+
 87%|████████▋ | 32850/37963 [81:12:42<11:41:08,  8.23s/it]
 87%|████████▋ | 32851/37963 [81:12:49<11:25:32,  8.05s/it]
 87%|████████▋ | 32852/37963 [81:12:57<11:15:55,  7.93s/it]
 87%|████████▋ | 32853/37963 [81:13:05<11:10:34,  7.87s/it]
 87%|████████▋ | 32854/37963 [81:13:12<11:00:03,  7.75s/it]
 87%|████████▋ | 32855/37963 [81:13:20<10:59:09,  7.74s/it]
 87%|████████▋ | 32856/37963 [81:13:28<10:57:14,  7.72s/it]
 87%|████████▋ | 32857/37963 [81:13:35<10:56:13,  7.71s/it]
 87%|████████▋ | 32858/37963 [81:13:43<10:56:42,  7.72s/it]
 87%|████████▋ | 32859/37963 [81:13:57<13:42:21,  9.67s/it]
 87%|████████▋ | 32860/37963 [81:14:05<12:52:29,  9.08s/it]
                                                           
{'loss': '0.09926', 'grad_norm': '3.364', 'learning_rate': '9.332e-07', 'epoch': '0.8656'}
+
 87%|████████▋ | 32860/37963 [81:14:05<12:52:29,  9.08s/it]
 87%|████████▋ | 32861/37963 [81:14:13<12:13:52,  8.63s/it]
 87%|████████▋ | 32862/37963 [81:14:20<11:50:31,  8.36s/it]
 87%|████████▋ | 32863/37963 [81:14:28<11:34:55,  8.18s/it]
 87%|████████▋ | 32864/37963 [81:14:36<11:15:09,  7.94s/it]
 87%|████████▋ | 32865/37963 [81:14:43<11:10:56,  7.90s/it]
 87%|████████▋ | 32866/37963 [81:14:51<11:05:35,  7.84s/it]
 87%|████████▋ | 32867/37963 [81:14:59<11:05:51,  7.84s/it]
 87%|████████▋ | 32868/37963 [81:15:07<11:00:57,  7.78s/it]
 87%|████████▋ | 32869/37963 [81:15:14<11:00:01,  7.77s/it]
 87%|████████▋ | 32870/37963 [81:15:22<10:57:16,  7.74s/it]
                                                           
{'loss': '0.07868', 'grad_norm': '2.681', 'learning_rate': '9.296e-07', 'epoch': '0.8658'}
+
 87%|████████▋ | 32870/37963 [81:15:22<10:57:16,  7.74s/it]
 87%|████████▋ | 32871/37963 [81:15:30<10:58:46,  7.76s/it]
 87%|████████▋ | 32872/37963 [81:15:37<10:53:58,  7.71s/it]
 87%|████████▋ | 32873/37963 [81:15:45<10:52:37,  7.69s/it]
 87%|████████▋ | 32874/37963 [81:15:53<10:54:02,  7.71s/it]
 87%|████████▋ | 32875/37963 [81:16:00<10:51:30,  7.68s/it]
 87%|████████▋ | 32876/37963 [81:16:22<16:46:45, 11.87s/it]
 87%|████████▋ | 32877/37963 [81:16:30<15:03:29, 10.66s/it]
 87%|████████▋ | 32878/37963 [81:16:44<16:37:54, 11.77s/it]
 87%|████████▋ | 32879/37963 [81:16:52<14:56:02, 10.57s/it]
 87%|████████▋ | 32880/37963 [81:17:00<13:44:15,  9.73s/it]
                                                           
{'loss': '0.084', 'grad_norm': '3.442', 'learning_rate': '9.26e-07', 'epoch': '0.8661'}
+
 87%|████████▋ | 32880/37963 [81:17:00<13:44:15,  9.73s/it]
 87%|████████▋ | 32881/37963 [81:17:15<15:56:01, 11.29s/it]
 87%|████████▋ | 32882/37963 [81:17:22<14:22:43, 10.19s/it]
 87%|████████▋ | 32883/37963 [81:17:30<13:20:08,  9.45s/it]
 87%|████████▋ | 32884/37963 [81:17:37<12:29:25,  8.85s/it]
 87%|████████▋ | 32885/37963 [81:17:45<12:00:02,  8.51s/it]
 87%|████████▋ | 32886/37963 [81:17:53<11:38:24,  8.25s/it]
 87%|████████▋ | 32887/37963 [81:18:00<11:18:20,  8.02s/it]
 87%|████████▋ | 32888/37963 [81:18:08<11:06:20,  7.88s/it]
 87%|████████▋ | 32889/37963 [81:18:15<10:56:49,  7.77s/it]
 87%|████████▋ | 32890/37963 [81:18:30<13:38:52,  9.69s/it]
                                                           
{'loss': '0.08773', 'grad_norm': '3.208', 'learning_rate': '9.224e-07', 'epoch': '0.8664'}
+
 87%|████████▋ | 32890/37963 [81:18:30<13:38:52,  9.69s/it]
 87%|████████▋ | 32891/37963 [81:18:44<15:46:24, 11.20s/it]
 87%|████████▋ | 32892/37963 [81:18:52<14:18:04, 10.15s/it]
 87%|████████▋ | 32893/37963 [81:19:00<13:11:55,  9.37s/it]
 87%|████████▋ | 32894/37963 [81:19:07<12:26:02,  8.83s/it]
 87%|████████▋ | 32895/37963 [81:19:15<11:55:34,  8.47s/it]
 87%|████████▋ | 32896/37963 [81:19:22<11:33:50,  8.22s/it]
 87%|████████▋ | 32897/37963 [81:19:30<11:19:28,  8.05s/it]
 87%|████████▋ | 32898/37963 [81:19:45<14:16:33, 10.15s/it]
 87%|████████▋ | 32899/37963 [81:19:53<13:13:20,  9.40s/it]
 87%|████████▋ | 32900/37963 [81:20:00<12:27:13,  8.86s/it]
                                                           
{'loss': '0.08204', 'grad_norm': '2.455', 'learning_rate': '9.188e-07', 'epoch': '0.8666'}
+
 87%|████████▋ | 32900/37963 [81:20:00<12:27:13,  8.86s/it]
 87%|████████▋ | 32901/37963 [81:20:08<11:57:28,  8.50s/it]
 87%|████████▋ | 32902/37963 [81:20:16<11:36:23,  8.26s/it]
 87%|████████▋ | 32903/37963 [81:20:23<11:20:04,  8.06s/it]
 87%|████████▋ | 32904/37963 [81:20:31<11:11:59,  7.97s/it]
 87%|████████▋ | 32905/37963 [81:20:39<11:05:48,  7.90s/it]
 87%|████████▋ | 32906/37963 [81:20:46<10:57:24,  7.80s/it]
 87%|████████▋ | 32907/37963 [81:20:54<10:57:27,  7.80s/it]
 87%|████████▋ | 32908/37963 [81:21:02<10:50:09,  7.72s/it]
 87%|████████▋ | 32909/37963 [81:21:09<10:50:33,  7.72s/it]
 87%|████████▋ | 32910/37963 [81:21:17<10:53:26,  7.76s/it]
                                                           
{'loss': '0.08874', 'grad_norm': '3.29', 'learning_rate': '9.152e-07', 'epoch': '0.8669'}
+
 87%|████████▋ | 32910/37963 [81:21:17<10:53:26,  7.76s/it]
 87%|████████▋ | 32911/37963 [81:21:25<10:48:46,  7.71s/it]
 87%|████████▋ | 32912/37963 [81:21:32<10:45:35,  7.67s/it]
 87%|████████▋ | 32913/37963 [81:21:47<13:38:31,  9.73s/it]
 87%|████████▋ | 32914/37963 [81:21:55<12:48:11,  9.13s/it]
 87%|████████▋ | 32915/37963 [81:22:02<11:59:59,  8.56s/it]
 87%|████████▋ | 32916/37963 [81:22:09<11:27:47,  8.18s/it]
 87%|████████▋ | 32917/37963 [81:22:17<11:15:42,  8.03s/it]
 87%|████████▋ | 32918/37963 [81:22:24<11:05:51,  7.92s/it]
 87%|████████▋ | 32919/37963 [81:22:38<13:34:51,  9.69s/it]
 87%|████████▋ | 32920/37963 [81:22:46<12:49:33,  9.16s/it]
                                                           
{'loss': '0.08698', 'grad_norm': '3.373', 'learning_rate': '9.117e-07', 'epoch': '0.8672'}
+
 87%|████████▋ | 32920/37963 [81:22:46<12:49:33,  9.16s/it]
 87%|████████▋ | 32921/37963 [81:23:00<14:57:20, 10.68s/it]
 87%|████████▋ | 32922/37963 [81:23:08<13:41:08,  9.77s/it]
 87%|████████▋ | 32923/37963 [81:23:16<12:47:29,  9.14s/it]
 87%|████████▋ | 32924/37963 [81:23:24<12:12:00,  8.72s/it]
 87%|████████▋ | 32925/37963 [81:23:31<11:47:25,  8.43s/it]
 87%|████████▋ | 32926/37963 [81:23:39<11:26:54,  8.18s/it]
 87%|████████▋ | 32927/37963 [81:23:47<11:16:00,  8.05s/it]
 87%|████████▋ | 32928/37963 [81:23:54<11:09:23,  7.98s/it]
 87%|████████▋ | 32929/37963 [81:24:02<11:00:56,  7.88s/it]
 87%|████████▋ | 32930/37963 [81:24:17<14:08:39, 10.12s/it]
                                                           
{'loss': '0.08274', 'grad_norm': '2.858', 'learning_rate': '9.081e-07', 'epoch': '0.8674'}
+
 87%|████████▋ | 32930/37963 [81:24:17<14:08:39, 10.12s/it]
 87%|████████▋ | 32931/37963 [81:24:25<13:08:08,  9.40s/it]
 87%|████████▋ | 32932/37963 [81:24:40<15:30:19, 11.10s/it]
 87%|████████▋ | 32933/37963 [81:24:48<14:07:26, 10.11s/it]
 87%|████████▋ | 32934/37963 [81:25:02<15:46:22, 11.29s/it]
 87%|████████▋ | 32935/37963 [81:25:16<16:57:46, 12.15s/it]
 87%|████████▋ | 32936/37963 [81:25:24<15:02:59, 10.78s/it]
 87%|████████▋ | 32937/37963 [81:25:31<13:44:39,  9.84s/it]
 87%|████████▋ | 32938/37963 [81:25:39<12:47:00,  9.16s/it]
 87%|████████▋ | 32939/37963 [81:25:46<12:05:05,  8.66s/it]
 87%|████████▋ | 32940/37963 [81:25:54<11:36:42,  8.32s/it]
                                                           
{'loss': '0.0932', 'grad_norm': '3.09', 'learning_rate': '9.046e-07', 'epoch': '0.8677'}
+
 87%|████████▋ | 32940/37963 [81:25:54<11:36:42,  8.32s/it]
 87%|████████▋ | 32941/37963 [81:26:01<11:10:36,  8.01s/it]
 87%|████████▋ | 32942/37963 [81:26:09<10:58:59,  7.87s/it]
 87%|████████▋ | 32943/37963 [81:26:17<10:55:20,  7.83s/it]
 87%|████████▋ | 32944/37963 [81:26:24<10:53:58,  7.82s/it]
 87%|████████▋ | 32945/37963 [81:26:32<10:53:39,  7.82s/it]
 87%|████████▋ | 32946/37963 [81:26:40<10:45:42,  7.72s/it]
 87%|████████▋ | 32947/37963 [81:26:48<10:52:49,  7.81s/it]
 87%|████████▋ | 32948/37963 [81:26:55<10:50:51,  7.79s/it]
 87%|████████▋ | 32949/37963 [81:27:03<10:46:02,  7.73s/it]
 87%|████████▋ | 32950/37963 [81:27:11<10:46:58,  7.74s/it]
                                                           
{'loss': '0.08981', 'grad_norm': '2.693', 'learning_rate': '9.01e-07', 'epoch': '0.868'}
+
 87%|████████▋ | 32950/37963 [81:27:11<10:46:58,  7.74s/it]
 87%|████████▋ | 32951/37963 [81:27:18<10:41:33,  7.68s/it]
 87%|████████▋ | 32952/37963 [81:27:33<13:42:53,  9.85s/it]
 87%|████████▋ | 32953/37963 [81:27:41<12:44:56,  9.16s/it]
 87%|████████▋ | 32954/37963 [81:27:48<12:07:43,  8.72s/it]
 87%|████████▋ | 32955/37963 [81:27:56<11:43:22,  8.43s/it]
 87%|████████▋ | 32956/37963 [81:28:10<14:05:05, 10.13s/it]
 87%|████████▋ | 32957/37963 [81:28:18<13:05:20,  9.41s/it]
 87%|████████▋ | 32958/37963 [81:28:26<12:20:57,  8.88s/it]
 87%|████████▋ | 32959/37963 [81:28:33<11:48:15,  8.49s/it]
 87%|████████▋ | 32960/37963 [81:28:41<11:26:51,  8.24s/it]
                                                           
{'loss': '0.1031', 'grad_norm': '3.466', 'learning_rate': '8.975e-07', 'epoch': '0.8682'}
+
 87%|████████▋ | 32960/37963 [81:28:41<11:26:51,  8.24s/it]
 87%|████████▋ | 32961/37963 [81:28:49<11:17:00,  8.12s/it]
 87%|████████▋ | 32962/37963 [81:28:56<11:05:57,  7.99s/it]
 87%|████████▋ | 32963/37963 [81:29:11<13:46:31,  9.92s/it]
 87%|████████▋ | 32964/37963 [81:29:19<12:50:48,  9.25s/it]
 87%|████████▋ | 32965/37963 [81:29:26<12:06:47,  8.72s/it]
 87%|████████▋ | 32966/37963 [81:29:34<11:41:45,  8.43s/it]
 87%|████████▋ | 32967/37963 [81:29:41<11:22:30,  8.20s/it]
 87%|████████▋ | 32968/37963 [81:29:49<11:13:39,  8.09s/it]
 87%|████████▋ | 32969/37963 [81:29:57<10:59:52,  7.93s/it]
 87%|████████▋ | 32970/37963 [81:30:05<10:52:35,  7.84s/it]
                                                           
{'loss': '0.09243', 'grad_norm': '2.728', 'learning_rate': '8.94e-07', 'epoch': '0.8685'}
+
 87%|████████▋ | 32970/37963 [81:30:05<10:52:35,  7.84s/it]
 87%|████████▋ | 32971/37963 [81:30:12<10:46:56,  7.78s/it]
 87%|████████▋ | 32972/37963 [81:30:20<10:46:52,  7.78s/it]
 87%|████████▋ | 32973/37963 [81:30:28<10:43:16,  7.73s/it]
 87%|████████▋ | 32974/37963 [81:30:35<10:44:05,  7.75s/it]
 87%|████████▋ | 32975/37963 [81:30:56<16:17:22, 11.76s/it]
 87%|████████▋ | 32976/37963 [81:31:04<14:41:33, 10.61s/it]
 87%|████████▋ | 32977/37963 [81:31:12<13:28:44,  9.73s/it]
 87%|████████▋ | 32978/37963 [81:31:20<12:37:00,  9.11s/it]
 87%|████████▋ | 32979/37963 [81:31:28<12:04:10,  8.72s/it]
 87%|████████▋ | 32980/37963 [81:31:42<14:34:07, 10.53s/it]
                                                           
{'loss': '0.07709', 'grad_norm': '2.875', 'learning_rate': '8.905e-07', 'epoch': '0.8687'}
+
 87%|████████▋ | 32980/37963 [81:31:42<14:34:07, 10.53s/it]
 87%|████████▋ | 32981/37963 [81:31:50<13:23:35,  9.68s/it]
 87%|████████▋ | 32982/37963 [81:31:57<12:29:34,  9.03s/it]
 87%|████████▋ | 32983/37963 [81:32:12<14:44:39, 10.66s/it]
 87%|████████▋ | 32984/37963 [81:32:26<16:12:28, 11.72s/it]
 87%|████████▋ | 32985/37963 [81:32:34<14:28:44, 10.47s/it]
 87%|████████▋ | 32986/37963 [81:32:41<13:19:08,  9.63s/it]
 87%|████████▋ | 32987/37963 [81:32:49<12:31:07,  9.06s/it]
 87%|████████▋ | 32988/37963 [81:32:57<11:55:47,  8.63s/it]
 87%|████████▋ | 32989/37963 [81:33:04<11:31:30,  8.34s/it]
 87%|████████▋ | 32990/37963 [81:33:12<11:14:52,  8.14s/it]
                                                           
{'loss': '0.08395', 'grad_norm': '2.721', 'learning_rate': '8.869e-07', 'epoch': '0.869'}
+
 87%|████████▋ | 32990/37963 [81:33:12<11:14:52,  8.14s/it]
 87%|████████▋ | 32991/37963 [81:33:20<11:03:25,  8.01s/it]
 87%|████████▋ | 32992/37963 [81:33:27<10:55:16,  7.91s/it]
 87%|████████▋ | 32993/37963 [81:33:35<10:52:15,  7.87s/it]
 87%|████████▋ | 32994/37963 [81:33:43<10:42:13,  7.75s/it]
 87%|████████▋ | 32995/37963 [81:33:50<10:41:56,  7.75s/it]
 87%|████████▋ | 32996/37963 [81:33:58<10:35:37,  7.68s/it]
 87%|████████▋ | 32997/37963 [81:34:13<13:34:27,  9.84s/it]
 87%|████████▋ | 32998/37963 [81:34:21<12:41:42,  9.20s/it]
 87%|████████▋ | 32999/37963 [81:34:28<12:04:48,  8.76s/it]
 87%|████████▋ | 33000/37963 [81:34:43<14:25:21, 10.46s/it]
                                                           
{'loss': '0.08888', 'grad_norm': '2.259', 'learning_rate': '8.834e-07', 'epoch': '0.8693'}
+
 87%|████████▋ | 33000/37963 [81:34:43<14:25:21, 10.46s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.55s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.55s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 87%|████████▋ | 33001/37963 [81:35:41<34:07:25, 24.76s/it]
 87%|████████▋ | 33002/37963 [81:35:49<27:10:17, 19.72s/it]
 87%|████████▋ | 33003/37963 [81:35:56<22:05:35, 16.04s/it]
 87%|████████▋ | 33004/37963 [81:36:04<18:37:26, 13.52s/it]
 87%|████████▋ | 33005/37963 [81:36:12<16:14:27, 11.79s/it]
 87%|████████▋ | 33006/37963 [81:36:19<14:33:52, 10.58s/it]
 87%|████████▋ | 33007/37963 [81:36:27<13:18:30,  9.67s/it]
 87%|████████▋ | 33008/37963 [81:36:41<15:18:32, 11.12s/it]
 87%|████████▋ | 33009/37963 [81:36:49<14:00:00, 10.17s/it]
 87%|████████▋ | 33010/37963 [81:36:57<12:56:50,  9.41s/it]
                                                           
{'loss': '0.08902', 'grad_norm': '2.208', 'learning_rate': '8.799e-07', 'epoch': '0.8695'}
+
 87%|████████▋ | 33010/37963 [81:36:57<12:56:50,  9.41s/it]
 87%|████████▋ | 33011/37963 [81:37:05<12:14:48,  8.90s/it]
 87%|████████▋ | 33012/37963 [81:37:12<11:45:31,  8.55s/it]
 87%|████████▋ | 33013/37963 [81:37:20<11:20:38,  8.25s/it]
 87%|████████▋ | 33014/37963 [81:37:28<11:07:07,  8.09s/it]
 87%|████████▋ | 33015/37963 [81:37:35<10:57:50,  7.98s/it]
 87%|████████▋ | 33016/37963 [81:37:43<10:49:31,  7.88s/it]
 87%|████████▋ | 33017/37963 [81:37:51<10:47:18,  7.85s/it]
 87%|████████▋ | 33018/37963 [81:37:59<10:43:55,  7.81s/it]
 87%|████████▋ | 33019/37963 [81:38:06<10:32:11,  7.67s/it]
 87%|████████▋ | 33020/37963 [81:38:13<10:22:04,  7.55s/it]
                                                           
{'loss': '0.08657', 'grad_norm': '2.638', 'learning_rate': '8.764e-07', 'epoch': '0.8698'}
+
 87%|████████▋ | 33020/37963 [81:38:13<10:22:04,  7.55s/it]
 87%|████████▋ | 33021/37963 [81:38:21<10:27:13,  7.62s/it]
 87%|████████▋ | 33022/37963 [81:38:35<13:05:52,  9.54s/it]
 87%|████████▋ | 33023/37963 [81:38:50<15:14:09, 11.10s/it]
 87%|████████▋ | 33024/37963 [81:38:58<13:52:37, 10.11s/it]
 87%|████████▋ | 33025/37963 [81:39:05<12:53:07,  9.39s/it]
 87%|████████▋ | 33026/37963 [81:39:13<12:10:20,  8.88s/it]
 87%|████████▋ | 33027/37963 [81:39:21<11:40:20,  8.51s/it]
 87%|████████▋ | 33028/37963 [81:39:28<11:14:50,  8.20s/it]
 87%|████████▋ | 33029/37963 [81:39:36<11:02:21,  8.05s/it]
 87%|████████▋ | 33030/37963 [81:39:44<10:55:08,  7.97s/it]
                                                           
{'loss': '0.09634', 'grad_norm': '3.446', 'learning_rate': '8.729e-07', 'epoch': '0.8701'}
+
 87%|████████▋ | 33030/37963 [81:39:44<10:55:08,  7.97s/it]
 87%|████████▋ | 33031/37963 [81:39:51<10:47:42,  7.88s/it]
 87%|████████▋ | 33032/37963 [81:40:06<13:35:32,  9.92s/it]
 87%|████████▋ | 33033/37963 [81:40:21<15:39:05, 11.43s/it]
 87%|████████▋ | 33034/37963 [81:40:35<16:46:43, 12.25s/it]
 87%|████████▋ | 33035/37963 [81:40:43<14:55:28, 10.90s/it]
 87%|████████▋ | 33036/37963 [81:40:51<13:39:22,  9.98s/it]
 87%|████████▋ | 33037/37963 [81:40:58<12:43:10,  9.30s/it]
 87%|████████▋ | 33038/37963 [81:41:06<12:02:25,  8.80s/it]
 87%|████████▋ | 33039/37963 [81:41:14<11:37:14,  8.50s/it]
 87%|████████▋ | 33040/37963 [81:41:22<11:18:51,  8.27s/it]
                                                           
{'loss': '0.09387', 'grad_norm': '2.948', 'learning_rate': '8.695e-07', 'epoch': '0.8703'}
+
 87%|████████▋ | 33040/37963 [81:41:22<11:18:51,  8.27s/it]
 87%|████████▋ | 33041/37963 [81:41:29<11:04:52,  8.10s/it]
 87%|████████▋ | 33042/37963 [81:41:44<13:36:16,  9.95s/it]
 87%|████████▋ | 33043/37963 [81:41:51<12:43:44,  9.31s/it]
 87%|████████▋ | 33044/37963 [81:41:59<12:04:44,  8.84s/it]
 87%|████████▋ | 33045/37963 [81:42:07<11:32:28,  8.45s/it]
 87%|████████▋ | 33046/37963 [81:42:14<11:08:57,  8.16s/it]
 87%|████████▋ | 33047/37963 [81:42:21<10:46:44,  7.89s/it]
 87%|████████▋ | 33048/37963 [81:42:29<10:42:28,  7.84s/it]
 87%|████████▋ | 33049/37963 [81:42:37<10:39:38,  7.81s/it]
 87%|████████▋ | 33050/37963 [81:42:45<10:35:59,  7.77s/it]
                                                           
{'loss': '0.09107', 'grad_norm': '3.329', 'learning_rate': '8.66e-07', 'epoch': '0.8706'}
+
 87%|████████▋ | 33050/37963 [81:42:45<10:35:59,  7.77s/it]
 87%|████████▋ | 33051/37963 [81:42:52<10:31:50,  7.72s/it]
 87%|████████▋ | 33052/37963 [81:43:00<10:30:53,  7.71s/it]
 87%|████████▋ | 33053/37963 [81:43:07<10:29:02,  7.69s/it]
 87%|████████▋ | 33054/37963 [81:43:22<13:10:07,  9.66s/it]
 87%|████████▋ | 33055/37963 [81:43:29<12:16:29,  9.00s/it]
 87%|████████▋ | 33056/37963 [81:43:37<11:43:33,  8.60s/it]
 87%|████████▋ | 33057/37963 [81:43:45<11:20:59,  8.33s/it]
 87%|████████▋ | 33058/37963 [81:43:52<11:06:31,  8.15s/it]
 87%|████████▋ | 33059/37963 [81:44:00<10:56:54,  8.04s/it]
 87%|████████▋ | 33060/37963 [81:44:08<10:50:38,  7.96s/it]
                                                           
{'loss': '0.08322', 'grad_norm': '2.366', 'learning_rate': '8.625e-07', 'epoch': '0.8709'}
+
 87%|████████▋ | 33060/37963 [81:44:08<10:50:38,  7.96s/it]
 87%|████████▋ | 33061/37963 [81:44:16<10:44:37,  7.89s/it]
 87%|████████▋ | 33062/37963 [81:44:30<13:18:15,  9.77s/it]
 87%|████████▋ | 33063/37963 [81:44:37<12:28:28,  9.16s/it]
 87%|████████▋ | 33064/37963 [81:44:45<11:46:17,  8.65s/it]
 87%|████████▋ | 33065/37963 [81:44:53<11:22:27,  8.36s/it]
 87%|████████▋ | 33066/37963 [81:45:00<11:04:16,  8.14s/it]
 87%|████████▋ | 33067/37963 [81:45:08<10:54:38,  8.02s/it]
 87%|████████▋ | 33068/37963 [81:45:16<10:49:10,  7.96s/it]
 87%|████████▋ | 33069/37963 [81:45:24<10:49:15,  7.96s/it]
 87%|████████▋ | 33070/37963 [81:45:31<10:42:32,  7.88s/it]
                                                           
{'loss': '0.09011', 'grad_norm': '3.762', 'learning_rate': '8.59e-07', 'epoch': '0.8711'}
+
 87%|████████▋ | 33070/37963 [81:45:31<10:42:32,  7.88s/it]
 87%|████████▋ | 33071/37963 [81:45:39<10:38:42,  7.83s/it]
 87%|████████▋ | 33072/37963 [81:45:47<10:38:59,  7.84s/it]
 87%|████████▋ | 33073/37963 [81:45:55<10:33:45,  7.78s/it]
 87%|████████▋ | 33074/37963 [81:46:09<13:24:45,  9.88s/it]
 87%|████████▋ | 33075/37963 [81:46:17<12:30:05,  9.21s/it]
 87%|████████▋ | 33076/37963 [81:46:31<14:27:54, 10.66s/it]
 87%|████████▋ | 33077/37963 [81:46:39<13:20:20,  9.83s/it]
 87%|████████▋ | 33078/37963 [81:46:47<12:30:14,  9.21s/it]
 87%|████████▋ | 33079/37963 [81:46:55<11:54:12,  8.77s/it]
 87%|████████▋ | 33080/37963 [81:47:02<11:25:01,  8.42s/it]
                                                           
{'loss': '0.09081', 'grad_norm': '3.808', 'learning_rate': '8.556e-07', 'epoch': '0.8714'}
+
 87%|████████▋ | 33080/37963 [81:47:02<11:25:01,  8.42s/it]
 87%|████████▋ | 33081/37963 [81:47:10<11:06:01,  8.19s/it]
 87%|████████▋ | 33082/37963 [81:47:24<13:45:53, 10.15s/it]
 87%|████████▋ | 33083/37963 [81:47:32<12:49:15,  9.46s/it]
 87%|████████▋ | 33084/37963 [81:47:47<14:44:19, 10.88s/it]
 87%|████████▋ | 33085/37963 [81:48:01<16:13:24, 11.97s/it]
 87%|████████▋ | 33086/37963 [81:48:09<14:29:20, 10.70s/it]
 87%|████████▋ | 33087/37963 [81:48:17<13:17:35,  9.81s/it]
 87%|████████▋ | 33088/37963 [81:48:24<12:20:17,  9.11s/it]
 87%|████████▋ | 33089/37963 [81:48:39<14:45:00, 10.89s/it]
 87%|████████▋ | 33090/37963 [81:48:47<13:25:09,  9.91s/it]
                                                           
{'loss': '0.09265', 'grad_norm': '3.099', 'learning_rate': '8.521e-07', 'epoch': '0.8716'}
+
 87%|████████▋ | 33090/37963 [81:48:47<13:25:09,  9.91s/it]
 87%|████████▋ | 33091/37963 [81:48:54<12:30:07,  9.24s/it]
 87%|████████▋ | 33092/37963 [81:49:02<11:52:58,  8.78s/it]
 87%|████████▋ | 33093/37963 [81:49:10<11:20:59,  8.39s/it]
 87%|████████▋ | 33094/37963 [81:49:17<11:04:13,  8.19s/it]
 87%|████████▋ | 33095/37963 [81:49:25<10:50:22,  8.02s/it]
 87%|████████▋ | 33096/37963 [81:49:32<10:31:46,  7.79s/it]
 87%|████████▋ | 33097/37963 [81:49:40<10:26:07,  7.72s/it]
 87%|████████▋ | 33098/37963 [81:49:47<10:28:06,  7.75s/it]
 87%|████████▋ | 33099/37963 [81:49:55<10:24:24,  7.70s/it]
 87%|████████▋ | 33100/37963 [81:50:03<10:27:16,  7.74s/it]
                                                           
{'loss': '0.09583', 'grad_norm': '3.83', 'learning_rate': '8.487e-07', 'epoch': '0.8719'}
+
 87%|████████▋ | 33100/37963 [81:50:03<10:27:16,  7.74s/it]
 87%|████████▋ | 33101/37963 [81:50:10<10:22:55,  7.69s/it]
 87%|████████▋ | 33102/37963 [81:50:18<10:27:04,  7.74s/it]
 87%|████████▋ | 33103/37963 [81:50:26<10:28:31,  7.76s/it]
 87%|████████▋ | 33104/37963 [81:50:34<10:27:42,  7.75s/it]
 87%|████████▋ | 33105/37963 [81:50:41<10:24:01,  7.71s/it]
 87%|████████▋ | 33106/37963 [81:50:49<10:27:05,  7.75s/it]
 87%|████████▋ | 33107/37963 [81:50:57<10:20:55,  7.67s/it]
 87%|████████▋ | 33108/37963 [81:51:11<13:06:12,  9.72s/it]
 87%|████████▋ | 33109/37963 [81:51:19<12:17:02,  9.11s/it]
 87%|████████▋ | 33110/37963 [81:51:27<11:42:39,  8.69s/it]
                                                           
{'loss': '0.0783', 'grad_norm': '2.663', 'learning_rate': '8.453e-07', 'epoch': '0.8722'}
+
 87%|████████▋ | 33110/37963 [81:51:27<11:42:39,  8.69s/it]
 87%|████████▋ | 33111/37963 [81:51:34<11:17:27,  8.38s/it]
 87%|████████▋ | 33112/37963 [81:51:42<11:05:37,  8.23s/it]
 87%|████████▋ | 33113/37963 [81:51:50<10:52:02,  8.07s/it]
 87%|████████▋ | 33114/37963 [81:51:58<10:44:25,  7.97s/it]
 87%|████████▋ | 33115/37963 [81:52:05<10:39:05,  7.91s/it]
 87%|████████▋ | 33116/37963 [81:52:20<13:08:54,  9.77s/it]
 87%|████████▋ | 33117/37963 [81:52:27<12:17:07,  9.13s/it]
 87%|████████▋ | 33118/37963 [81:52:35<11:47:31,  8.76s/it]
 87%|████████▋ | 33119/37963 [81:52:43<11:21:45,  8.44s/it]
 87%|████████▋ | 33120/37963 [81:52:51<11:05:03,  8.24s/it]
                                                           
{'loss': '0.08813', 'grad_norm': '3.199', 'learning_rate': '8.418e-07', 'epoch': '0.8724'}
+
 87%|████████▋ | 33120/37963 [81:52:51<11:05:03,  8.24s/it]
 87%|████████▋ | 33121/37963 [81:52:58<10:46:02,  8.01s/it]
 87%|████████▋ | 33122/37963 [81:53:06<10:40:04,  7.93s/it]
 87%|████████▋ | 33123/37963 [81:53:21<13:26:44, 10.00s/it]
 87%|████████▋ | 33124/37963 [81:53:28<12:28:52,  9.29s/it]
 87%|████████▋ | 33125/37963 [81:53:42<14:22:33, 10.70s/it]
 87%|████████▋ | 33126/37963 [81:53:50<13:11:17,  9.82s/it]
 87%|████████▋ | 33127/37963 [81:53:58<12:21:37,  9.20s/it]
 87%|████████▋ | 33128/37963 [81:54:05<11:35:14,  8.63s/it]
 87%|████████▋ | 33129/37963 [81:54:13<11:13:16,  8.36s/it]
 87%|████████▋ | 33130/37963 [81:54:28<13:56:47, 10.39s/it]
                                                           
{'loss': '0.09104', 'grad_norm': '3.132', 'learning_rate': '8.384e-07', 'epoch': '0.8727'}
+
 87%|████████▋ | 33130/37963 [81:54:28<13:56:47, 10.39s/it]
 87%|████████▋ | 33131/37963 [81:54:35<12:47:20,  9.53s/it]
 87%|████████▋ | 33132/37963 [81:54:50<14:57:48, 11.15s/it]
 87%|████████▋ | 33133/37963 [81:55:05<16:17:23, 12.14s/it]
 87%|████████▋ | 33134/37963 [81:55:13<14:30:40, 10.82s/it]
 87%|████████▋ | 33135/37963 [81:55:20<13:12:45,  9.85s/it]
 87%|████████▋ | 33136/37963 [81:55:28<12:22:20,  9.23s/it]
 87%|████████▋ | 33137/37963 [81:55:36<11:45:32,  8.77s/it]
 87%|████████▋ | 33138/37963 [81:55:43<11:19:02,  8.44s/it]
 87%|████████▋ | 33139/37963 [81:55:51<10:59:51,  8.21s/it]
 87%|████████▋ | 33140/37963 [81:55:58<10:38:39,  7.95s/it]
                                                           
{'loss': '0.08208', 'grad_norm': '2.899', 'learning_rate': '8.35e-07', 'epoch': '0.873'}
+
 87%|████████▋ | 33140/37963 [81:55:58<10:38:39,  7.95s/it]
 87%|████████▋ | 33141/37963 [81:56:06<10:32:43,  7.87s/it]
 87%|████████▋ | 33142/37963 [81:56:14<10:24:38,  7.77s/it]
 87%|████████▋ | 33143/37963 [81:56:21<10:16:21,  7.67s/it]
 87%|████████▋ | 33144/37963 [81:56:29<10:15:55,  7.67s/it]
 87%|████████▋ | 33145/37963 [81:56:36<10:12:55,  7.63s/it]
 87%|████████▋ | 33146/37963 [81:56:44<10:09:02,  7.59s/it]
 87%|████████▋ | 33147/37963 [81:56:51<10:11:17,  7.62s/it]
 87%|████████▋ | 33148/37963 [81:56:59<10:11:40,  7.62s/it]
 87%|████████▋ | 33149/37963 [81:57:07<10:13:28,  7.65s/it]
 87%|████████▋ | 33150/37963 [81:57:14<10:04:44,  7.54s/it]
                                                           
{'loss': '0.09289', 'grad_norm': '3.053', 'learning_rate': '8.316e-07', 'epoch': '0.8732'}
+
 87%|████████▋ | 33150/37963 [81:57:14<10:04:44,  7.54s/it]
 87%|████████▋ | 33151/37963 [81:57:21<10:04:21,  7.54s/it]
 87%|████████▋ | 33152/37963 [81:57:29<10:06:15,  7.56s/it]
 87%|████████▋ | 33153/37963 [81:57:37<10:09:33,  7.60s/it]
 87%|████████▋ | 33154/37963 [81:57:44<10:10:00,  7.61s/it]
 87%|████████▋ | 33155/37963 [81:57:52<10:10:36,  7.62s/it]
 87%|████████▋ | 33156/37963 [81:58:06<12:51:39,  9.63s/it]
 87%|████████▋ | 33157/37963 [81:58:14<12:00:31,  9.00s/it]
 87%|██████���█▋ | 33158/37963 [81:58:22<11:29:54,  8.61s/it]
 87%|████████▋ | 33159/37963 [81:58:29<11:06:39,  8.33s/it]
 87%|████████▋ | 33160/37963 [81:58:37<10:51:15,  8.14s/it]
                                                           
{'loss': '0.09376', 'grad_norm': '2.5', 'learning_rate': '8.282e-07', 'epoch': '0.8735'}
+
 87%|████████▋ | 33160/37963 [81:58:37<10:51:15,  8.14s/it]
 87%|████████▋ | 33161/37963 [81:58:45<10:38:40,  7.98s/it]
 87%|████████▋ | 33162/37963 [81:58:52<10:33:36,  7.92s/it]
 87%|████████▋ | 33163/37963 [81:59:00<10:25:42,  7.82s/it]
 87%|████████▋ | 33164/37963 [81:59:08<10:20:39,  7.76s/it]
 87%|████████▋ | 33165/37963 [81:59:22<12:52:04,  9.65s/it]
 87%|████████▋ | 33166/37963 [81:59:29<12:03:36,  9.05s/it]
 87%|████████▋ | 33167/37963 [81:59:37<11:31:20,  8.65s/it]
 87%|████████▋ | 33168/37963 [81:59:45<11:08:33,  8.37s/it]
 87%|████████▋ | 33169/37963 [81:59:52<10:54:01,  8.19s/it]
 87%|████████▋ | 33170/37963 [82:00:00<10:36:02,  7.96s/it]
                                                           
{'loss': '0.08989', 'grad_norm': '2.748', 'learning_rate': '8.248e-07', 'epoch': '0.8737'}
+
 87%|████████▋ | 33170/37963 [82:00:00<10:36:02,  7.96s/it]
 87%|████████▋ | 33171/37963 [82:00:07<10:24:12,  7.82s/it]
 87%|████████▋ | 33172/37963 [82:00:15<10:20:31,  7.77s/it]
 87%|████████▋ | 33173/37963 [82:00:23<10:18:02,  7.74s/it]
 87%|████████▋ | 33174/37963 [82:00:30<10:12:10,  7.67s/it]
 87%|████████▋ | 33175/37963 [82:00:38<10:13:11,  7.68s/it]
 87%|████████▋ | 33176/37963 [82:01:00<15:55:02, 11.97s/it]
 87%|████████▋ | 33177/37963 [82:01:15<16:57:43, 12.76s/it]
 87%|████████▋ | 33178/37963 [82:01:22<14:49:35, 11.15s/it]
 87%|████████▋ | 33179/37963 [82:01:36<15:59:08, 12.03s/it]
 87%|████████▋ | 33180/37963 [82:01:51<17:04:11, 12.85s/it]
                                                           
{'loss': '0.07652', 'grad_norm': '2.471', 'learning_rate': '8.214e-07', 'epoch': '0.874'}
+
 87%|████████▋ | 33180/37963 [82:01:51<17:04:11, 12.85s/it]
 87%|████████▋ | 33181/37963 [82:01:58<14:57:20, 11.26s/it]
 87%|████████▋ | 33182/37963 [82:02:06<13:30:52, 10.18s/it]
 87%|████████▋ | 33183/37963 [82:02:14<12:30:02,  9.41s/it]
 87%|████████▋ | 33184/37963 [82:02:21<11:49:28,  8.91s/it]
 87%|████████▋ | 33185/37963 [82:02:29<11:22:43,  8.57s/it]
 87%|████████▋ | 33186/37963 [82:02:37<11:00:17,  8.29s/it]
 87%|████████▋ | 33187/37963 [82:02:51<13:28:12, 10.15s/it]
 87%|████████▋ | 33188/37963 [82:02:59<12:33:12,  9.46s/it]
 87%|████████▋ | 33189/37963 [82:03:07<11:50:09,  8.93s/it]
 87%|████████▋ | 33190/37963 [82:03:15<11:25:28,  8.62s/it]
                                                           
{'loss': '0.08601', 'grad_norm': '2.876', 'learning_rate': '8.18e-07', 'epoch': '0.8743'}
+
 87%|████████▋ | 33190/37963 [82:03:15<11:25:28,  8.62s/it]
 87%|████████▋ | 33191/37963 [82:03:23<11:07:32,  8.39s/it]
 87%|████████▋ | 33192/37963 [82:03:30<10:44:57,  8.11s/it]
 87%|████████▋ | 33193/37963 [82:03:38<10:37:32,  8.02s/it]
 87%|████████▋ | 33194/37963 [82:03:46<10:30:36,  7.93s/it]
 87%|████████▋ | 33195/37963 [82:03:53<10:27:06,  7.89s/it]
 87%|████████▋ | 33196/37963 [82:04:01<10:23:30,  7.85s/it]
 87%|████████▋ | 33197/37963 [82:04:09<10:24:55,  7.87s/it]
 87%|████████▋ | 33198/37963 [82:04:17<10:25:50,  7.88s/it]
 87%|████████▋ | 33199/37963 [82:04:25<10:22:52,  7.84s/it]
 87%|████████▋ | 33200/37963 [82:04:39<12:56:37,  9.78s/it]
                                                           
{'loss': '0.08775', 'grad_norm': '3.339', 'learning_rate': '8.146e-07', 'epoch': '0.8745'}
+
 87%|████████▋ | 33200/37963 [82:04:39<12:56:37,  9.78s/it]
 87%|████████▋ | 33201/37963 [82:04:47<12:09:14,  9.19s/it]
 87%|████████▋ | 33202/37963 [82:04:54<11:31:11,  8.71s/it]
 87%|████████▋ | 33203/37963 [82:05:02<11:08:07,  8.42s/it]
 87%|████████▋ | 33204/37963 [82:05:10<10:47:38,  8.17s/it]
 87%|████████▋ | 33205/37963 [82:05:17<10:36:51,  8.03s/it]
 87%|████████▋ | 33206/37963 [82:05:25<10:29:33,  7.94s/it]
 87%|████████▋ | 33207/37963 [82:05:33<10:25:17,  7.89s/it]
 87%|████████▋ | 33208/37963 [82:05:40<10:16:47,  7.78s/it]
 87%|███���████▋ | 33209/37963 [82:05:48<10:10:15,  7.70s/it]
 87%|████████▋ | 33210/37963 [82:05:56<10:11:50,  7.72s/it]
                                                           
{'loss': '0.08983', 'grad_norm': '4.429', 'learning_rate': '8.113e-07', 'epoch': '0.8748'}
+
 87%|████████▋ | 33210/37963 [82:05:56<10:11:50,  7.72s/it]
 87%|████████▋ | 33211/37963 [82:06:03<10:01:36,  7.60s/it]
 87%|████████▋ | 33212/37963 [82:06:11<9:59:24,  7.57s/it] 
 87%|████████▋ | 33213/37963 [82:06:25<12:37:44,  9.57s/it]
 87%|████████▋ | 33214/37963 [82:06:32<11:52:37,  9.00s/it]
 87%|████████▋ | 33215/37963 [82:06:40<11:23:34,  8.64s/it]
 87%|████████▋ | 33216/37963 [82:06:48<11:04:00,  8.39s/it]
 87%|████████▋ | 33217/37963 [82:06:56<10:47:21,  8.18s/it]
 88%|████████▊ | 33218/37963 [82:07:04<10:37:37,  8.06s/it]
 88%|████████▊ | 33219/37963 [82:07:11<10:31:02,  7.98s/it]
 88%|████████▊ | 33220/37963 [82:07:19<10:26:58,  7.93s/it]
                                                           
{'loss': '0.09865', 'grad_norm': '3.198', 'learning_rate': '8.079e-07', 'epoch': '0.8751'}
+
 88%|████████▊ | 33220/37963 [82:07:19<10:26:58,  7.93s/it]
 88%|████████▊ | 33221/37963 [82:07:27<10:19:24,  7.84s/it]
 88%|████████▊ | 33222/37963 [82:07:34<10:15:49,  7.79s/it]
 88%|████████▊ | 33223/37963 [82:07:50<13:11:11, 10.02s/it]
 88%|████████▊ | 33224/37963 [82:07:58<12:20:45,  9.38s/it]
 88%|████████▊ | 33225/37963 [82:08:05<11:40:18,  8.87s/it]
 88%|████████▊ | 33226/37963 [82:08:20<14:03:34, 10.68s/it]
 88%|████████▊ | 33227/37963 [82:08:35<15:41:25, 11.93s/it]
 88%|████████▊ | 33228/37963 [82:08:43<14:03:02, 10.68s/it]
 88%|████████▊ | 33229/37963 [82:08:51<12:55:14,  9.83s/it]
 88%|████████▊ | 33230/37963 [82:09:05<14:45:36, 11.23s/it]
                                                           
{'loss': '0.08837', 'grad_norm': '2.776', 'learning_rate': '8.045e-07', 'epoch': '0.8753'}
+
 88%|████████▊ | 33230/37963 [82:09:05<14:45:36, 11.23s/it]
 88%|████████▊ | 33231/37963 [82:09:13<13:25:00, 10.21s/it]
 88%|████████▊ | 33232/37963 [82:09:27<14:59:19, 11.41s/it]
 88%|████████▊ | 33233/37963 [82:09:35<13:25:26, 10.22s/it]
 88%|████████▊ | 33234/37963 [82:09:49<15:10:05, 11.55s/it]
 88%|████████▊ | 33235/37963 [82:09:57<13:36:19, 10.36s/it]
 88%|████████▊ | 33236/37963 [82:10:05<12:34:59,  9.58s/it]
 88%|████████▊ | 33237/37963 [82:10:12<11:52:54,  9.05s/it]
 88%|████████▊ | 33238/37963 [82:10:20<11:18:27,  8.62s/it]
 88%|████████▊ | 33239/37963 [82:10:27<10:49:59,  8.26s/it]
 88%|████████▊ | 33240/37963 [82:10:35<10:34:14,  8.06s/it]
                                                           
{'loss': '0.1025', 'grad_norm': '4.255', 'learning_rate': '8.012e-07', 'epoch': '0.8756'}
+
 88%|████████▊ | 33240/37963 [82:10:35<10:34:14,  8.06s/it]
 88%|████████▊ | 33241/37963 [82:10:42<10:21:52,  7.90s/it]
 88%|████████▊ | 33242/37963 [82:10:50<10:18:24,  7.86s/it]
 88%|████████▊ | 33243/37963 [82:10:58<10:06:34,  7.71s/it]
 88%|████████▊ | 33244/37963 [82:11:05<10:04:16,  7.68s/it]
 88%|████████▊ | 33245/37963 [82:11:13<10:07:01,  7.72s/it]
 88%|████████▊ | 33246/37963 [82:11:21<10:10:13,  7.76s/it]
 88%|████████▊ | 33247/37963 [82:11:28<10:05:05,  7.70s/it]
 88%|████████▊ | 33248/37963 [82:11:36<10:02:39,  7.67s/it]
 88%|████████▊ | 33249/37963 [82:11:44<10:02:42,  7.67s/it]
 88%|████████▊ | 33250/37963 [82:11:51<9:57:32,  7.61s/it] 
                                                          
{'loss': '0.09347', 'grad_norm': '3.142', 'learning_rate': '7.979e-07', 'epoch': '0.8759'}
+
 88%|████████▊ | 33250/37963 [82:11:51<9:57:32,  7.61s/it]
 88%|████████▊ | 33251/37963 [82:11:59<10:00:58,  7.65s/it]
 88%|████████▊ | 33252/37963 [82:12:07<10:01:00,  7.65s/it]
 88%|████████▊ | 33253/37963 [82:12:14<10:00:20,  7.65s/it]
 88%|████████▊ | 33254/37963 [82:12:29<12:37:12,  9.65s/it]
 88%|████████▊ | 33255/37963 [82:12:36<11:43:37,  8.97s/it]
 88%|████████▊ | 33256/37963 [82:12:44<11:11:13,  8.56s/it]
 88%|████████▊ | 33257/37963 [82:12:51<10:43:38,  8.21s/it]
 88%|████████▊ | 33258/37963 [82:12:59<10:31:07,  8.05s/it]
 88%|████████▊ | 33259/37963 [82:13:13<12:54:02,  9.87s/it]
 88%|████████▊ | 33260/37963 [82:13:20<12:04:20,  9.24s/it]
                                                           
{'loss': '0.08767', 'grad_norm': '2.42', 'learning_rate': '7.945e-07', 'epoch': '0.8761'}
+
 88%|████████▊ | 33260/37963 [82:13:20<12:04:20,  9.24s/it]
 88%|████████▊ | 33261/37963 [82:13:28<11:23:38,  8.72s/it]
 88%|████████▊ | 33262/37963 [82:13:36<11:02:27,  8.46s/it]
 88%|████████▊ | 33263/37963 [82:13:44<10:46:35,  8.25s/it]
 88%|████████▊ | 33264/37963 [82:13:52<10:39:47,  8.17s/it]
 88%|████████▊ | 33265/37963 [82:13:59<10:31:24,  8.06s/it]
 88%|████████▊ | 33266/37963 [82:14:07<10:20:31,  7.93s/it]
 88%|████████▊ | 33267/37963 [82:14:15<10:15:52,  7.87s/it]
 88%|████████▊ | 33268/37963 [82:14:22<10:11:46,  7.82s/it]
 88%|████████▊ | 33269/37963 [82:14:30<10:10:31,  7.80s/it]
 88%|████████▊ | 33270/37963 [82:14:45<12:55:11,  9.91s/it]
                                                           
{'loss': '0.07844', 'grad_norm': '2.681', 'learning_rate': '7.912e-07', 'epoch': '0.8764'}
+
 88%|████████▊ | 33270/37963 [82:14:45<12:55:11,  9.91s/it]
 88%|████████▊ | 33271/37963 [82:15:00<14:50:17, 11.38s/it]
 88%|████████▊ | 33272/37963 [82:15:07<13:21:32, 10.25s/it]
 88%|████████▊ | 33273/37963 [82:15:23<15:17:17, 11.74s/it]
 88%|████████▊ | 33274/37963 [82:15:30<13:39:15, 10.48s/it]
 88%|████████▊ | 33275/37963 [82:15:38<12:33:15,  9.64s/it]
 88%|████████▊ | 33276/37963 [82:15:46<11:46:17,  9.04s/it]
 88%|████████▊ | 33277/37963 [82:15:53<11:14:22,  8.63s/it]
 88%|████████▊ | 33278/37963 [82:16:01<10:51:46,  8.35s/it]
 88%|████████▊ | 33279/37963 [82:16:08<10:32:21,  8.10s/it]
 88%|████████▊ | 33280/37963 [82:16:23<13:02:30, 10.03s/it]
                                                           
{'loss': '0.0904', 'grad_norm': '4.084', 'learning_rate': '7.879e-07', 'epoch': '0.8766'}
+
 88%|████████▊ | 33280/37963 [82:16:23<13:02:30, 10.03s/it]
 88%|████████▊ | 33281/37963 [82:16:31<12:08:25,  9.33s/it]
 88%|████████▊ | 33282/37963 [82:16:45<14:12:05, 10.92s/it]
 88%|████████▊ | 33283/37963 [82:16:53<13:01:26, 10.02s/it]
 88%|████████▊ | 33284/37963 [82:17:01<12:05:35,  9.30s/it]
 88%|████████▊ | 33285/37963 [82:17:08<11:26:27,  8.80s/it]
 88%|████████▊ | 33286/37963 [82:17:16<10:52:51,  8.38s/it]
 88%|████████▊ | 33287/37963 [82:17:23<10:30:46,  8.09s/it]
 88%|████████▊ | 33288/37963 [82:17:38<12:55:00,  9.95s/it]
 88%|████████▊ | 33289/37963 [82:17:45<12:03:34,  9.29s/it]
 88%|████████▊ | 33290/37963 [82:17:53<11:24:35,  8.79s/it]
                                                           
{'loss': '0.07571', 'grad_norm': '3.206', 'learning_rate': '7.846e-07', 'epoch': '0.8769'}
+
 88%|████████▊ | 33290/37963 [82:17:53<11:24:35,  8.79s/it]
 88%|████████▊ | 33291/37963 [82:18:00<10:46:50,  8.31s/it]
 88%|████████▊ | 33292/37963 [82:18:08<10:32:59,  8.13s/it]
 88%|████████▊ | 33293/37963 [82:18:16<10:25:03,  8.03s/it]
 88%|████████▊ | 33294/37963 [82:18:23<10:08:59,  7.83s/it]
 88%|████████▊ | 33295/37963 [82:18:31<10:04:57,  7.78s/it]
 88%|████████▊ | 33296/37963 [82:18:38<10:02:47,  7.75s/it]
 88%|████████▊ | 33297/37963 [82:18:46<10:01:28,  7.73s/it]
 88%|████████▊ | 33298/37963 [82:18:54<9:59:55,  7.72s/it] 
 88%|████████▊ | 33299/37963 [82:19:01<9:54:32,  7.65s/it]
 88%|████████▊ | 33300/37963 [82:19:08<9:45:49,  7.54s/it]
                                                          
{'loss': '0.08067', 'grad_norm': '3.025', 'learning_rate': '7.812e-07', 'epoch': '0.8772'}
+
 88%|████████▊ | 33300/37963 [82:19:08<9:45:49,  7.54s/it]
 88%|████████▊ | 33301/37963 [82:19:16<9:51:28,  7.61s/it]
 88%|████████▊ | 33302/37963 [82:19:30<12:16:49,  9.49s/it]
 88%|████████▊ | 33303/37963 [82:19:38<11:35:52,  8.96s/it]
 88%|████████▊ | 33304/37963 [82:19:46<11:10:27,  8.63s/it]
 88%|████████▊ | 33305/37963 [82:19:54<10:53:20,  8.42s/it]
 88%|████████▊ | 33306/37963 [82:20:01<10:37:49,  8.22s/it]
 88%|████████▊ | 33307/37963 [82:20:09<10:30:44,  8.13s/it]
 88%|████████▊ | 33308/37963 [82:20:17<10:24:00,  8.04s/it]
 88%|████████▊ | 33309/37963 [82:20:31<12:49:57,  9.93s/it]
 88%|████████▊ | 33310/37963 [82:20:40<12:09:36,  9.41s/it]
                                                           
{'loss': '0.07912', 'grad_norm': '3.77', 'learning_rate': '7.779e-07', 'epoch': '0.8774'}
+
 88%|████████▊ | 33310/37963 [82:20:40<12:09:36,  9.41s/it]
 88%|████████▊ | 33311/37963 [82:20:48<11:35:05,  8.97s/it]
 88%|████████▊ | 33312/37963 [82:20:55<11:04:30,  8.57s/it]
 88%|████████▊ | 33313/37963 [82:21:03<10:42:48,  8.29s/it]
 88%|████████▊ | 33314/37963 [82:21:10<10:24:37,  8.06s/it]
 88%|████████▊ | 33315/37963 [82:21:18<10:19:31,  8.00s/it]
 88%|████████▊ | 33316/37963 [82:21:26<10:09:54,  7.87s/it]
 88%|████████▊ | 33317/37963 [82:21:34<10:06:41,  7.83s/it]
 88%|████████▊ | 33318/37963 [82:21:49<12:53:17,  9.99s/it]
 88%|████████▊ | 33319/37963 [82:22:03<14:35:23, 11.31s/it]
 88%|████████▊ | 33320/37963 [82:22:11<13:10:30, 10.22s/it]
                                                           
{'loss': '0.081', 'grad_norm': '2.352', 'learning_rate': '7.746e-07', 'epoch': '0.8777'}
+
 88%|████████▊ | 33320/37963 [82:22:11<13:10:30, 10.22s/it]
 88%|████████▊ | 33321/37963 [82:22:18<12:11:10,  9.45s/it]
 88%|████████▊ | 33322/37963 [82:22:26<11:31:31,  8.94s/it]
 88%|████████▊ | 33323/37963 [82:22:34<10:59:35,  8.53s/it]
 88%|████████▊ | 33324/37963 [82:22:48<13:08:14, 10.20s/it]
 88%|████████▊ | 33325/37963 [82:23:03<14:55:36, 11.59s/it]
 88%|████████▊ | 33326/37963 [82:23:10<13:21:07, 10.37s/it]
 88%|████████▊ | 33327/37963 [82:23:18<12:16:25,  9.53s/it]
 88%|████████▊ | 33328/37963 [82:23:25<11:34:01,  8.98s/it]
 88%|████████▊ | 33329/37963 [82:23:33<11:06:31,  8.63s/it]
 88%|████████▊ | 33330/37963 [82:23:41<10:49:39,  8.41s/it]
                                                           
{'loss': '0.09471', 'grad_norm': '2.337', 'learning_rate': '7.714e-07', 'epoch': '0.878'}
+
 88%|████████▊ | 33330/37963 [82:23:41<10:49:39,  8.41s/it]
 88%|████████▊ | 33331/37963 [82:23:49<10:38:04,  8.27s/it]
 88%|████████▊ | 33332/37963 [82:23:57<10:24:14,  8.09s/it]
 88%|████████▊ | 33333/37963 [82:24:04<10:16:22,  7.99s/it]
 88%|████████▊ | 33334/37963 [82:24:12<10:07:29,  7.87s/it]
 88%|████████▊ | 33335/37963 [82:24:20<10:07:26,  7.88s/it]
 88%|████████▊ | 33336/37963 [82:24:34<12:33:25,  9.77s/it]
 88%|████████▊ | 33337/37963 [82:24:42<11:46:11,  9.16s/it]
 88%|████████▊ | 33338/37963 [82:24:50<11:10:52,  8.70s/it]
 88%|████████▊ | 33339/37963 [82:24:57<10:51:53,  8.46s/it]
 88%|████████▊ | 33340/37963 [82:25:05<10:34:11,  8.23s/it]
                                                           
{'loss': '0.08651', 'grad_norm': '2.474', 'learning_rate': '7.681e-07', 'epoch': '0.8782'}
+
 88%|████████▊ | 33340/37963 [82:25:05<10:34:11,  8.23s/it]
 88%|████████▊ | 33341/37963 [82:25:13<10:19:39,  8.04s/it]
 88%|████████▊ | 33342/37963 [82:25:27<12:43:45,  9.92s/it]
 88%|████████▊ | 33343/37963 [82:25:35<11:50:55,  9.23s/it]
 88%|████████▊ | 33344/37963 [82:25:42<11:13:04,  8.74s/it]
 88%|████████▊ | 33345/37963 [82:25:50<10:48:13,  8.42s/it]
 88%|████████▊ | 33346/37963 [82:26:04<12:58:27, 10.12s/it]
 88%|████████▊ | 33347/37963 [82:26:12<12:01:49,  9.38s/it]
 88%|████████▊ | 33348/37963 [82:26:19<11:25:31,  8.91s/it]
 88%|████████▊ | 33349/37963 [82:26:27<10:56:43,  8.54s/it]
 88%|████████▊ | 33350/37963 [82:26:35<10:37:33,  8.29s/it]
                                                           
{'loss': '0.09087', 'grad_norm': '3.623', 'learning_rate': '7.648e-07', 'epoch': '0.8785'}
+
 88%|████████▊ | 33350/37963 [82:26:35<10:37:33,  8.29s/it]
 88%|████████▊ | 33351/37963 [82:26:43<10:24:29,  8.12s/it]
 88%|████████▊ | 33352/37963 [82:26:50<10:15:18,  8.01s/it]
 88%|████████▊ | 33353/37963 [82:26:58<10:08:03,  7.91s/it]
 88%|████████▊ | 33354/37963 [82:27:06<10:00:17,  7.81s/it]
 88%|████████▊ | 33355/37963 [82:27:13<9:58:04,  7.79s/it] 
 88%|████████▊ | 33356/37963 [82:27:21<10:00:18,  7.82s/it]
 88%|████████▊ | 33357/37963 [82:27:29<9:56:56,  7.78s/it] 
 88%|████████▊ | 33358/37963 [82:27:37<9:55:07,  7.75s/it]
 88%|████████▊ | 33359/37963 [82:27:44<9:52:09,  7.72s/it]
 88%|████████▊ | 33360/37963 [82:27:52<9:51:27,  7.71s/it]
                                                          
{'loss': '0.07275', 'grad_norm': '3.01', 'learning_rate': '7.615e-07', 'epoch': '0.8788'}
+
 88%|████████▊ | 33360/37963 [82:27:52<9:51:27,  7.71s/it]
 88%|████████▊ | 33361/37963 [82:28:00<9:55:21,  7.76s/it]
 88%|████████▊ | 33362/37963 [82:28:07<9:52:16,  7.72s/it]
 88%|████████▊ | 33363/37963 [82:28:22<12:27:50,  9.75s/it]
 88%|████████▊ | 33364/37963 [82:28:37<14:23:00, 11.26s/it]
 88%|████████▊ | 33365/37963 [82:28:44<12:59:33, 10.17s/it]
 88%|████████▊ | 33366/37963 [82:28:52<12:01:07,  9.41s/it]
 88%|████████▊ | 33367/37963 [82:29:00<11:22:30,  8.91s/it]
 88%|████████▊ | 33368/37963 [82:29:08<10:59:29,  8.61s/it]
 88%|████████▊ | 33369/37963 [82:29:15<10:37:46,  8.33s/it]
 88%|████████▊ | 33370/37963 [82:29:23<10:23:02,  8.14s/it]
                                                           
{'loss': '0.08659', 'grad_norm': '3.93', 'learning_rate': '7.583e-07', 'epoch': '0.879'}
+
 88%|████████▊ | 33370/37963 [82:29:23<10:23:02,  8.14s/it]
 88%|████████▊ | 33371/37963 [82:29:44<15:17:13, 11.98s/it]
 88%|████████▊ | 33372/37963 [82:29:59<16:27:06, 12.90s/it]
 88%|████████▊ | 33373/37963 [82:30:07<14:32:16, 11.40s/it]
 88%|████████▊ | 33374/37963 [82:30:14<12:58:02, 10.17s/it]
 88%|████████▊ | 33375/37963 [82:30:22<11:56:08,  9.37s/it]
 88%|████████▊ | 33376/37963 [82:30:29<11:15:19,  8.83s/it]
 88%|████████▊ | 33377/37963 [82:30:37<10:51:25,  8.52s/it]
 88%|████████▊ | 33378/37963 [82:30:45<10:33:24,  8.29s/it]
 88%|████████▊ | 33379/37963 [82:30:53<10:21:06,  8.13s/it]
 88%|████████▊ | 33380/37963 [82:31:00<10:06:18,  7.94s/it]
                                                           
{'loss': '0.08408', 'grad_norm': '2.537', 'learning_rate': '7.55e-07', 'epoch': '0.8793'}
+
 88%|████████▊ | 33380/37963 [82:31:00<10:06:18,  7.94s/it]
 88%|████████▊ | 33381/37963 [82:31:08<10:01:05,  7.87s/it]
 88%|████████▊ | 33382/37963 [82:31:16<9:58:30,  7.84s/it] 
 88%|████████▊ | 33383/37963 [82:31:23<9:53:34,  7.78s/it]
 88%|████████▊ | 33384/37963 [82:31:31<9:49:43,  7.73s/it]
 88%|████████▊ | 33385/37963 [82:31:38<9:47:21,  7.70s/it]
 88%|████████▊ | 33386/37963 [82:31:46<9:45:36,  7.68s/it]
 88%|████████▊ | 33387/37963 [82:31:54<9:48:13,  7.71s/it]
 88%|████████▊ | 33388/37963 [82:32:02<9:47:46,  7.71s/it]
 88%|████████▊ | 33389/37963 [82:32:09<9:50:48,  7.75s/it]
 88%|████████▊ | 33390/37963 [82:32:30<14:53:53, 11.73s/it]
                                                           
{'loss': '0.07774', 'grad_norm': '2.62', 'learning_rate': '7.518e-07', 'epoch': '0.8795'}
+
 88%|████████▊ | 33390/37963 [82:32:30<14:53:53, 11.73s/it]
 88%|████████▊ | 33391/37963 [82:32:38<13:22:04, 10.53s/it]
 88%|████████▊ | 33392/37963 [82:32:46<12:18:31,  9.69s/it]
 88%|████████▊ | 33393/37963 [82:32:54<11:32:13,  9.09s/it]
 88%|████████▊ | 33394/37963 [82:33:01<10:58:23,  8.65s/it]
 88%|████████▊ | 33395/37963 [82:33:09<10:37:19,  8.37s/it]
 88%|████████▊ | 33396/37963 [82:33:23<12:46:09, 10.07s/it]
 88%|████████▊ | 33397/37963 [82:33:30<11:47:54,  9.30s/it]
 88%|████████▊ | 33398/37963 [82:33:38<11:08:09,  8.78s/it]
 88%|████████▊ | 33399/37963 [82:33:46<10:42:59,  8.45s/it]
 88%|████████▊ | 33400/37963 [82:33:53<10:26:07,  8.23s/it]
                                                           
{'loss': '0.07659', 'grad_norm': '2.063', 'learning_rate': '7.485e-07', 'epoch': '0.8798'}
+
 88%|████████▊ | 33400/37963 [82:33:53<10:26:07,  8.23s/it]
 88%|████████▊ | 33401/37963 [82:34:01<10:16:05,  8.10s/it]
 88%|████████▊ | 33402/37963 [82:34:09<10:03:26,  7.94s/it]
 88%|████████▊ | 33403/37963 [82:34:16<9:58:00,  7.87s/it] 
 88%|████████▊ | 33404/37963 [82:34:24<9:52:53,  7.80s/it]
 88%|████████▊ | 33405/37963 [82:34:32<9:54:35,  7.83s/it]
 88%|████████▊ | 33406/37963 [82:34:40<9:49:23,  7.76s/it]
 88%|████████▊ | 33407/37963 [82:34:47<9:50:24,  7.78s/it]
 88%|████████▊ | 33408/37963 [82:34:55<9:47:06,  7.73s/it]
 88%|████████▊ | 33409/37963 [82:35:03<9:45:42,  7.72s/it]
 88%|████████▊ | 33410/37963 [82:35:10<9:44:44,  7.71s/it]
                                                          
{'loss': '0.08277', 'grad_norm': '3.396', 'learning_rate': '7.453e-07', 'epoch': '0.8801'}
+
 88%|��███████▊ | 33410/37963 [82:35:10<9:44:44,  7.71s/it]
 88%|████████▊ | 33411/37963 [82:35:18<9:45:15,  7.71s/it]
 88%|████████▊ | 33412/37963 [82:35:33<12:22:25,  9.79s/it]
 88%|████████▊ | 33413/37963 [82:35:40<11:34:11,  9.15s/it]
 88%|████████▊ | 33414/37963 [82:35:48<11:02:01,  8.73s/it]
 88%|████████▊ | 33415/37963 [82:35:56<10:37:17,  8.41s/it]
 88%|████████▊ | 33416/37963 [82:36:10<12:56:17, 10.24s/it]
 88%|████████▊ | 33417/37963 [82:36:25<14:34:27, 11.54s/it]
 88%|████████▊ | 33418/37963 [82:36:33<13:07:57, 10.40s/it]
 88%|████████▊ | 33419/37963 [82:36:40<12:06:13,  9.59s/it]
 88%|████████▊ | 33420/37963 [82:36:55<14:06:39, 11.18s/it]
                                                           
{'loss': '0.08509', 'grad_norm': '3.258', 'learning_rate': '7.421e-07', 'epoch': '0.8803'}
+
 88%|████████▊ | 33420/37963 [82:36:55<14:06:39, 11.18s/it]
 88%|████████▊ | 33421/37963 [82:37:03<12:47:25, 10.14s/it]
 88%|████████▊ | 33422/37963 [82:37:11<11:53:31,  9.43s/it]
 88%|████████▊ | 33423/37963 [82:37:19<11:21:01,  9.00s/it]
 88%|████████▊ | 33424/37963 [82:37:26<10:52:26,  8.62s/it]
 88%|████████▊ | 33425/37963 [82:37:41<13:09:51, 10.44s/it]
 88%|████████▊ | 33426/37963 [82:37:49<12:07:51,  9.63s/it]
 88%|████████▊ | 33427/37963 [82:37:57<11:26:19,  9.08s/it]
 88%|████████▊ | 33428/37963 [82:38:04<10:47:53,  8.57s/it]
 88%|████████▊ | 33429/37963 [82:38:12<10:26:28,  8.29s/it]
 88%|████████▊ | 33430/37963 [82:38:19<10:14:57,  8.14s/it]
                                                           
{'loss': '0.09301', 'grad_norm': '3.188', 'learning_rate': '7.388e-07', 'epoch': '0.8806'}
+
 88%|████████▊ | 33430/37963 [82:38:19<10:14:57,  8.14s/it]
 88%|████████▊ | 33431/37963 [82:38:27<10:08:32,  8.06s/it]
 88%|████████▊ | 33432/37963 [82:38:35<9:57:43,  7.92s/it] 
 88%|████████▊ | 33433/37963 [82:38:43<9:51:19,  7.83s/it]
 88%|████████▊ | 33434/37963 [82:38:57<12:12:12,  9.70s/it]
 88%|████████▊ | 33435/37963 [82:39:04<11:26:30,  9.10s/it]
 88%|████████▊ | 33436/37963 [82:39:12<10:55:23,  8.69s/it]
 88%|████████▊ | 33437/37963 [82:39:20<10:28:46,  8.34s/it]
 88%|████████▊ | 33438/37963 [82:39:27<10:11:21,  8.11s/it]
 88%|████████▊ | 33439/37963 [82:39:35<9:59:31,  7.95s/it] 
 88%|████████▊ | 33440/37963 [82:39:49<12:24:09,  9.87s/it]
                                                           
{'loss': '0.09433', 'grad_norm': '3.606', 'learning_rate': '7.356e-07', 'epoch': '0.8809'}
+
 88%|████████▊ | 33440/37963 [82:39:49<12:24:09,  9.87s/it]
 88%|████████▊ | 33441/37963 [82:39:57<11:32:38,  9.19s/it]
 88%|████████▊ | 33442/37963 [82:40:04<10:58:50,  8.74s/it]
 88%|████████▊ | 33443/37963 [82:40:12<10:35:18,  8.43s/it]
 88%|████████▊ | 33444/37963 [82:40:26<12:42:15, 10.12s/it]
 88%|████████▊ | 33445/37963 [82:40:34<11:39:54,  9.30s/it]
 88%|████████▊ | 33446/37963 [82:40:41<10:57:47,  8.74s/it]
 88%|████████▊ | 33447/37963 [82:40:49<10:31:40,  8.39s/it]
 88%|████████▊ | 33448/37963 [82:40:56<10:08:00,  8.08s/it]
 88%|████████▊ | 33449/37963 [82:41:04<9:58:57,  7.96s/it] 
 88%|████████▊ | 33450/37963 [82:41:11<9:52:24,  7.88s/it]
                                                          
{'loss': '0.07948', 'grad_norm': '2.131', 'learning_rate': '7.324e-07', 'epoch': '0.8811'}
+
 88%|████████▊ | 33450/37963 [82:41:11<9:52:24,  7.88s/it]
 88%|████████▊ | 33451/37963 [82:41:19<9:49:49,  7.84s/it]
 88%|████████▊ | 33452/37963 [82:41:27<9:46:13,  7.80s/it]
 88%|████████▊ | 33453/37963 [82:41:34<9:42:33,  7.75s/it]
 88%|████████▊ | 33454/37963 [82:41:42<9:37:29,  7.68s/it]
 88%|████████▊ | 33455/37963 [82:41:50<9:39:44,  7.72s/it]
 88%|████████▊ | 33456/37963 [82:42:04<12:19:07,  9.84s/it]
 88%|████████▊ | 33457/37963 [82:42:12<11:29:48,  9.19s/it]
 88%|████████▊ | 33458/37963 [82:42:20<10:56:05,  8.74s/it]
 88%|████████▊ | 33459/37963 [82:42:28<10:33:46,  8.44s/it]
 88%|████████▊ | 33460/37963 [82:42:35<10:20:38,  8.27s/it]
                                                           
{'loss': '0.08237', 'grad_norm': '4.079', 'learning_rate': '7.292e-07', 'epoch': '0.8814'}
+
 88%|████████▊ | 33460/37963 [82:42:35<10:20:38,  8.27s/it]
 88%|████████▊ | 33461/37963 [82:42:43<10:06:12,  8.08s/it]
 88%|████████▊ | 33462/37963 [82:42:51<9:56:13,  7.95s/it] 
 88%|████████▊ | 33463/37963 [82:43:05<12:20:37,  9.87s/it]
 88%|████████▊ | 33464/37963 [82:43:20<14:10:15, 11.34s/it]
 88%|████████▊ | 33465/37963 [82:43:28<12:50:19, 10.28s/it]
 88%|████████▊ | 33466/37963 [82:43:42<14:29:58, 11.61s/it]
 88%|████████▊ | 33467/37963 [82:43:50<13:01:06, 10.42s/it]
 88%|████████▊ | 33468/37963 [82:43:58<11:58:04,  9.59s/it]
 88%|████████▊ | 33469/37963 [82:44:12<13:51:26, 11.10s/it]
 88%|████████▊ | 33470/37963 [82:44:20<12:36:47, 10.11s/it]
                                                           
{'loss': '0.08929', 'grad_norm': '2.574', 'learning_rate': '7.26e-07', 'epoch': '0.8817'}
+
 88%|████████▊ | 33470/37963 [82:44:20<12:36:47, 10.11s/it]
 88%|████████▊ | 33471/37963 [82:44:28<11:44:42,  9.41s/it]
 88%|████████▊ | 33472/37963 [82:44:36<11:06:41,  8.91s/it]
 88%|████████▊ | 33473/37963 [82:44:43<10:36:15,  8.50s/it]
 88%|████████▊ | 33474/37963 [82:44:51<10:17:15,  8.25s/it]
 88%|████████▊ | 33475/37963 [82:44:58<10:00:23,  8.03s/it]
 88%|████████▊ | 33476/37963 [82:45:06<9:52:02,  7.92s/it] 
 88%|████████▊ | 33477/37963 [82:45:14<9:46:12,  7.84s/it]
 88%|████████▊ | 33478/37963 [82:45:21<9:43:28,  7.81s/it]
 88%|████████▊ | 33479/37963 [82:45:29<9:38:13,  7.74s/it]
 88%|████████▊ | 33480/37963 [82:45:36<9:31:31,  7.65s/it]
                                                          
{'loss': '0.09689', 'grad_norm': '3.18', 'learning_rate': '7.228e-07', 'epoch': '0.8819'}
+
 88%|████████▊ | 33480/37963 [82:45:36<9:31:31,  7.65s/it]
 88%|████████▊ | 33481/37963 [82:45:44<9:28:02,  7.60s/it]
 88%|████████▊ | 33482/37963 [82:45:51<9:26:31,  7.59s/it]
 88%|████████▊ | 33483/37963 [82:45:59<9:27:23,  7.60s/it]
 88%|████████▊ | 33484/37963 [82:46:07<9:28:02,  7.61s/it]
 88%|████████▊ | 33485/37963 [82:46:14<9:28:43,  7.62s/it]
 88%|████████▊ | 33486/37963 [82:46:22<9:31:03,  7.65s/it]
 88%|████████▊ | 33487/37963 [82:46:30<9:32:14,  7.67s/it]
 88%|████████▊ | 33488/37963 [82:46:44<12:06:09,  9.74s/it]
 88%|████████▊ | 33489/37963 [82:46:52<11:18:21,  9.10s/it]
 88%|████████▊ | 33490/37963 [82:47:00<10:46:30,  8.67s/it]
                                                           
{'loss': '0.09565', 'grad_norm': '2.979', 'learning_rate': '7.196e-07', 'epoch': '0.8822'}
+
 88%|████████▊ | 33490/37963 [82:47:00<10:46:30,  8.67s/it]
 88%|████████▊ | 33491/37963 [82:47:07<10:24:30,  8.38s/it]
 88%|████████▊ | 33492/37963 [82:47:22<12:37:16, 10.16s/it]
 88%|████████▊ | 33493/37963 [82:47:29<11:44:44,  9.46s/it]
 88%|████████▊ | 33494/37963 [82:47:44<13:32:01, 10.90s/it]
 88%|████████▊ | 33495/37963 [82:47:52<12:22:41,  9.97s/it]
 88%|████████▊ | 33496/37963 [82:47:59<11:29:45,  9.26s/it]
 88%|████████▊ | 33497/37963 [82:48:07<10:54:15,  8.79s/it]
 88%|████████▊ | 33498/37963 [82:48:14<10:28:10,  8.44s/it]
 88%|████████▊ | 33499/37963 [82:48:22<10:10:27,  8.21s/it]
 88%|████████▊ | 33500/37963 [82:48:30<10:00:31,  8.07s/it]
                                                           
{'loss': '0.07235', 'grad_norm': '3.59', 'learning_rate': '7.165e-07', 'epoch': '0.8824'}
+
 88%|████████▊ | 33500/37963 [82:48:30<10:00:31,  8.07s/it]
 88%|████████▊ | 33501/37963 [82:48:37<9:48:55,  7.92s/it] 
 88%|████████▊ | 33502/37963 [82:48:45<9:44:05,  7.86s/it]
 88%|████████▊ | 33503/37963 [82:48:53<9:39:20,  7.79s/it]
 88%|████████▊ | 33504/37963 [82:49:08<12:20:11,  9.96s/it]
 88%|████████▊ | 33505/37963 [82:49:15<11:26:43,  9.24s/it]
 88%|████████▊ | 33506/37963 [82:49:23<10:54:26,  8.81s/it]
 88%|████████▊ | 33507/37963 [82:49:31<10:30:29,  8.49s/it]
 88%|████████▊ | 33508/37963 [82:49:45<12:44:59, 10.30s/it]
 88%|████████▊ | 33509/37963 [82:50:00<14:12:46, 11.49s/it]
 88%|████████▊ | 33510/37963 [82:50:07<12:49:17, 10.37s/it]
                                                           
{'loss': '0.09258', 'grad_norm': '3.534', 'learning_rate': '7.133e-07', 'epoch': '0.8827'}
+
 88%|████████▊ | 33510/37963 [82:50:07<12:49:17, 10.37s/it]
 88%|████████▊ | 33511/37963 [82:50:15<11:48:57,  9.55s/it]
 88%|█��██████▊ | 33512/37963 [82:50:22<10:58:28,  8.88s/it]
 88%|████████▊ | 33513/37963 [82:50:30<10:30:48,  8.51s/it]
 88%|████████▊ | 33514/37963 [82:50:38<10:07:20,  8.19s/it]
 88%|████████▊ | 33515/37963 [82:50:52<12:24:52, 10.05s/it]
 88%|████████▊ | 33516/37963 [82:51:07<14:08:49, 11.45s/it]
 88%|████████▊ | 33517/37963 [82:51:14<12:44:35, 10.32s/it]
 88%|████████▊ | 33518/37963 [82:51:22<11:45:28,  9.52s/it]
 88%|████████▊ | 33519/37963 [82:51:30<11:04:37,  8.97s/it]
 88%|████████▊ | 33520/37963 [82:51:37<10:34:43,  8.57s/it]
                                                           
{'loss': '0.09026', 'grad_norm': '3.127', 'learning_rate': '7.101e-07', 'epoch': '0.883'}
+
 88%|████████▊ | 33520/37963 [82:51:37<10:34:43,  8.57s/it]
 88%|████████▊ | 33521/37963 [82:51:45<10:21:30,  8.39s/it]
 88%|████████▊ | 33522/37963 [82:51:54<10:39:41,  8.64s/it]
 88%|████████▊ | 33523/37963 [82:52:09<12:39:28, 10.26s/it]
 88%|████████▊ | 33524/37963 [82:52:24<14:36:05, 11.84s/it]
 88%|████████▊ | 33525/37963 [82:52:40<15:57:23, 12.94s/it]
 88%|████████▊ | 33526/37963 [82:52:55<16:51:28, 13.68s/it]
 88%|████████▊ | 33527/37963 [82:53:06<16:03:42, 13.03s/it]
 88%|████████▊ | 33528/37963 [82:53:16<14:53:50, 12.09s/it]
 88%|████████▊ | 33529/37963 [82:53:26<14:04:31, 11.43s/it]
 88%|████████▊ | 33530/37963 [82:53:36<13:30:15, 10.97s/it]
                                                           
{'loss': '0.08576', 'grad_norm': '2.953', 'learning_rate': '7.07e-07', 'epoch': '0.8832'}
+
 88%|████████▊ | 33530/37963 [82:53:36<13:30:15, 10.97s/it]
 88%|████████▊ | 33531/37963 [82:53:46<13:02:37, 10.59s/it]
 88%|████████▊ | 33532/37963 [82:53:55<12:23:34, 10.07s/it]
 88%|████████▊ | 33533/37963 [82:54:04<12:01:02,  9.77s/it]
 88%|████████▊ | 33534/37963 [82:54:13<11:40:01,  9.48s/it]
 88%|████████▊ | 33535/37963 [82:54:22<11:29:58,  9.35s/it]
 88%|████████▊ | 33536/37963 [82:54:30<11:01:36,  8.97s/it]
 88%|████████▊ | 33537/37963 [82:54:38<10:42:09,  8.71s/it]
 88%|████████▊ | 33538/37963 [82:54:53<12:55:49, 10.52s/it]
 88%|████████▊ | 33539/37963 [82:55:01<12:04:56,  9.83s/it]
 88%|████████▊ | 33540/37963 [82:55:15<13:36:51, 11.08s/it]
                                                           
{'loss': '0.08315', 'grad_norm': '3.312', 'learning_rate': '7.038e-07', 'epoch': '0.8835'}
+
 88%|████████▊ | 33540/37963 [82:55:15<13:36:51, 11.08s/it]
 88%|████████▊ | 33541/37963 [82:55:29<14:49:13, 12.07s/it]
 88%|████████▊ | 33542/37963 [82:55:37<13:11:24, 10.74s/it]
 88%|████████▊ | 33543/37963 [82:55:44<12:02:26,  9.81s/it]
 88%|████████▊ | 33544/37963 [82:55:52<11:12:42,  9.13s/it]
 88%|████████▊ | 33545/37963 [82:56:00<10:42:24,  8.72s/it]
 88%|████████▊ | 33546/37963 [82:56:07<10:17:59,  8.39s/it]
 88%|████████▊ | 33547/37963 [82:56:15<9:58:10,  8.13s/it] 
 88%|████████▊ | 33548/37963 [82:56:23<10:02:37,  8.19s/it]
 88%|████████▊ | 33549/37963 [82:56:31<9:59:43,  8.15s/it] 
 88%|████████▊ | 33550/37963 [82:56:39<9:58:09,  8.13s/it]
                                                          
{'loss': '0.08874', 'grad_norm': '2.858', 'learning_rate': '7.007e-07', 'epoch': '0.8838'}
+
 88%|████████▊ | 33550/37963 [82:56:39<9:58:09,  8.13s/it]
 88%|████████▊ | 33551/37963 [82:56:55<12:49:07, 10.46s/it]
 88%|████████▊ | 33552/37963 [82:57:03<11:49:00,  9.64s/it]
 88%|████████▊ | 33553/37963 [82:57:11<11:04:36,  9.04s/it]
 88%|████████▊ | 33554/37963 [82:57:18<10:32:44,  8.61s/it]
 88%|████████▊ | 33555/37963 [82:57:26<10:07:47,  8.27s/it]
 88%|████████▊ | 33556/37963 [82:57:47<14:55:24, 12.19s/it]
 88%|████████▊ | 33557/37963 [82:57:55<13:14:53, 10.82s/it]
 88%|████████▊ | 33558/37963 [82:58:02<12:05:31,  9.88s/it]
 88%|████████▊ | 33559/37963 [82:58:10<11:15:49,  9.21s/it]
 88%|████████▊ | 33560/37963 [82:58:18<10:43:39,  8.77s/it]
                                                           
{'loss': '0.08815', 'grad_norm': '2.209', 'learning_rate': '6.976e-07', 'epoch': '0.884'}
+
 88%|████████▊ | 33560/37963 [82:58:18<10:43:39,  8.77s/it]
 88%|████████▊ | 33561/37963 [82:58:32<12:54:26, 10.56s/it]
 88%|████████▊ | 33562/37963 [82:58:40<11:51:58,  9.71s/it]
 88%|████████▊ | 33563/37963 [82:58:48<11:06:21,  9.09s/it]
 88%|████████▊ | 33564/37963 [82:58:55<10:29:05,  8.58s/it]
 88%|████████▊ | 33565/37963 [82:59:10<12:46:31, 10.46s/it]
 88%|████████▊ | 33566/37963 [82:59:18<11:48:17,  9.67s/it]
 88%|████████▊ | 33567/37963 [82:59:26<11:05:18,  9.08s/it]
 88%|████████▊ | 33568/37963 [82:59:33<10:34:39,  8.66s/it]
 88%|████████▊ | 33569/37963 [82:59:41<10:17:01,  8.43s/it]
 88%|████████▊ | 33570/37963 [82:59:49<10:00:52,  8.21s/it]
                                                           
{'loss': '0.07574', 'grad_norm': '3.328', 'learning_rate': '6.944e-07', 'epoch': '0.8843'}
+
 88%|████████▊ | 33570/37963 [82:59:49<10:00:52,  8.21s/it]
 88%|████████▊ | 33571/37963 [82:59:57<9:50:52,  8.07s/it] 
 88%|████████▊ | 33572/37963 [83:00:04<9:42:40,  7.96s/it]
 88%|████████▊ | 33573/37963 [83:00:12<9:37:38,  7.89s/it]
 88%|████████▊ | 33574/37963 [83:00:20<9:36:36,  7.88s/it]
 88%|████████▊ | 33575/37963 [83:00:28<9:34:02,  7.85s/it]
 88%|████████▊ | 33576/37963 [83:00:35<9:29:40,  7.79s/it]
 88%|████████▊ | 33577/37963 [83:00:43<9:22:05,  7.69s/it]
 88%|████████▊ | 33578/37963 [83:00:50<9:17:55,  7.63s/it]
 88%|████████▊ | 33579/37963 [83:00:58<9:19:07,  7.65s/it]
 88%|████████▊ | 33580/37963 [83:01:06<9:20:32,  7.67s/it]
                                                          
{'loss': '0.09424', 'grad_norm': '3.075', 'learning_rate': '6.913e-07', 'epoch': '0.8845'}
+
 88%|████████▊ | 33580/37963 [83:01:06<9:20:32,  7.67s/it]
 88%|████████▊ | 33581/37963 [83:01:13<9:20:44,  7.68s/it]
 88%|████████▊ | 33582/37963 [83:01:21<9:24:05,  7.73s/it]
 88%|████████▊ | 33583/37963 [83:01:29<9:22:08,  7.70s/it]
 88%|████████▊ | 33584/37963 [83:01:37<9:23:08,  7.72s/it]
 88%|████████▊ | 33585/37963 [83:01:44<9:20:43,  7.68s/it]
 88%|████████▊ | 33586/37963 [83:01:52<9:21:46,  7.70s/it]
 88%|████████▊ | 33587/37963 [83:02:07<11:50:56,  9.75s/it]
 88%|████████▊ | 33588/37963 [83:02:14<11:05:46,  9.13s/it]
 88%|████████▊ | 33589/37963 [83:02:36<15:35:13, 12.83s/it]
 88%|████████▊ | 33590/37963 [83:02:44<13:46:30, 11.34s/it]
                                                           
{'loss': '0.08886', 'grad_norm': '3.342', 'learning_rate': '6.882e-07', 'epoch': '0.8848'}
+
 88%|████████▊ | 33590/37963 [83:02:44<13:46:30, 11.34s/it]
 88%|████████▊ | 33591/37963 [83:02:51<12:24:25, 10.22s/it]
 88%|████████▊ | 33592/37963 [83:02:59<11:31:58,  9.50s/it]
 88%|████████▊ | 33593/37963 [83:03:06<10:45:12,  8.86s/it]
 88%|████████▊ | 33594/37963 [83:03:14<10:19:24,  8.51s/it]
 88%|████████▊ | 33595/37963 [83:03:22<10:03:12,  8.29s/it]
 88%|████████▊ | 33596/37963 [83:03:29<9:50:17,  8.11s/it] 
 88%|████████▊ | 33597/37963 [83:03:37<9:39:53,  7.97s/it]
 89%|████████▊ | 33598/37963 [83:03:45<9:32:32,  7.87s/it]
 89%|████████▊ | 33599/37963 [83:03:52<9:26:52,  7.79s/it]
 89%|████████▊ | 33600/37963 [83:04:07<11:44:50,  9.69s/it]
                                                           
{'loss': '0.07778', 'grad_norm': '3.094', 'learning_rate': '6.851e-07', 'epoch': '0.8851'}
+
 89%|████████▊ | 33600/37963 [83:04:07<11:44:50,  9.69s/it]
 89%|████████▊ | 33601/37963 [83:04:21<13:33:42, 11.19s/it]
 89%|████████▊ | 33602/37963 [83:04:36<14:59:49, 12.38s/it]
 89%|████████▊ | 33603/37963 [83:04:44<13:06:08, 10.82s/it]
 89%|████████▊ | 33604/37963 [83:04:51<11:56:56,  9.87s/it]
 89%|████████▊ | 33605/37963 [83:04:59<11:04:43,  9.15s/it]
 89%|████████▊ | 33606/37963 [83:05:06<10:32:47,  8.71s/it]
 89%|████████▊ | 33607/37963 [83:05:14<10:10:34,  8.41s/it]
 89%|████████▊ | 33608/37963 [83:05:22<9:53:57,  8.18s/it] 
 89%|████████▊ | 33609/37963 [83:05:36<12:08:46, 10.04s/it]
 89%|████████▊ | 33610/37963 [83:05:51<14:01:05, 11.59s/it]
                                                           
{'loss': '0.08347', 'grad_norm': '2.899', 'learning_rate': '6.82e-07', 'epoch': '0.8853'}
+
 89%|████████▊ | 33610/37963 [83:05:51<14:01:05, 11.59s/it]
 89%|████████▊ | 33611/37963 [83:05:59<12:30:14, 10.34s/it]
 89%|████████▊ | 33612/37963 [83:06:06<11:31:51,  9.54s/it]
 89%|████████▊ | 33613/37963 [83:06:14<10:51:56,  8.99s/it]
 89%|████████▊ | 33614/37963 [83:06:22<10:25:36,  8.63s/it]
 89%|████████▊ | 33615/37963 [83:06:30<10:05:00,  8.35s/it]
 89%|████████▊ | 33616/37963 [83:06:37<9:49:33,  8.14s/it] 
 89%|████████▊ | 33617/37963 [83:06:45<9:39:51,  8.01s/it]
 89%|████████▊ | 33618/37963 [83:06:53<9:34:04,  7.93s/it]
 89%|████████▊ | 33619/37963 [83:07:00<9:28:14,  7.85s/it]
 89%|████████▊ | 33620/37963 [83:07:08<9:23:06,  7.78s/it]
                                                          
{'loss': '0.09111', 'grad_norm': '3.838', 'learning_rate': '6.789e-07', 'epoch': '0.8856'}
+
 89%|████████▊ | 33620/37963 [83:07:08<9:23:06,  7.78s/it]
 89%|████████▊ | 33621/37963 [83:07:16<9:18:21,  7.72s/it]
 89%|████████▊ | 33622/37963 [83:07:23<9:13:48,  7.65s/it]
 89%|████████▊ | 33623/37963 [83:07:31<9:10:49,  7.62s/it]
 89%|████████▊ | 33624/37963 [83:07:38<9:13:37,  7.66s/it]
 89%|████████▊ | 33625/37963 [83:07:46<9:14:10,  7.66s/it]
 89%|████████▊ | 33626/37963 [83:07:54<9:16:06,  7.69s/it]
 89%|████████▊ | 33627/37963 [83:08:01<9:16:11,  7.70s/it]
 89%|████████▊ | 33628/37963 [83:08:09<9:16:45,  7.71s/it]
 89%|████████▊ | 33629/37963 [83:08:17<9:18:03,  7.73s/it]
 89%|████████▊ | 33630/37963 [83:08:31<11:34:49,  9.62s/it]
                                                           
{'loss': '0.09222', 'grad_norm': '2.577', 'learning_rate': '6.758e-07', 'epoch': '0.8859'}
+
 89%|████████▊ | 33630/37963 [83:08:31<11:34:49,  9.62s/it]
 89%|████████▊ | 33631/37963 [83:08:39<10:54:30,  9.07s/it]
 89%|████████▊ | 33632/37963 [83:08:53<12:45:00, 10.60s/it]
 89%|████████▊ | 33633/37963 [83:09:01<11:46:28,  9.79s/it]
 89%|████████▊ | 33634/37963 [83:09:09<11:03:07,  9.19s/it]
 89%|████████▊ | 33635/37963 [83:09:17<10:34:45,  8.80s/it]
 89%|████████▊ | 33636/37963 [83:09:24<10:07:15,  8.42s/it]
 89%|████████▊ | 33637/37963 [83:09:32<9:52:31,  8.22s/it] 
 89%|████████▊ | 33638/37963 [83:09:40<9:42:15,  8.08s/it]
 89%|████████▊ | 33639/37963 [83:09:47<9:31:36,  7.93s/it]
 89%|████████▊ | 33640/37963 [83:09:55<9:29:25,  7.90s/it]
                                                          
{'loss': '0.09386', 'grad_norm': '3.653', 'learning_rate': '6.727e-07', 'epoch': '0.8861'}
+
 89%|████████▊ | 33640/37963 [83:09:55<9:29:25,  7.90s/it]
 89%|████████▊ | 33641/37963 [83:10:03<9:24:55,  7.84s/it]
 89%|████████▊ | 33642/37963 [83:10:10<9:21:47,  7.80s/it]
 89%|████████▊ | 33643/37963 [83:10:25<11:46:26,  9.81s/it]
 89%|████████▊ | 33644/37963 [83:10:33<11:05:07,  9.24s/it]
 89%|████████▊ | 33645/37963 [83:10:47<13:01:03, 10.85s/it]
 89%|████████▊ | 33646/37963 [83:11:03<14:39:51, 12.23s/it]
 89%|████████▊ | 33647/37963 [83:11:11<13:00:41, 10.85s/it]
 89%|████████▊ | 33648/37963 [83:11:18<11:49:34,  9.87s/it]
 89%|████████▊ | 33649/37963 [83:11:33<13:48:55, 11.53s/it]
 89%|████████▊ | 33650/37963 [83:11:41<12:21:42, 10.32s/it]
                                                           
{'loss': '0.0898', 'grad_norm': '3.467', 'learning_rate': '6.697e-07', 'epoch': '0.8864'}
+
 89%|████████▊ | 33650/37963 [83:11:41<12:21:42, 10.32s/it]
 89%|████████▊ | 33651/37963 [83:11:49<11:26:22,  9.55s/it]
 89%|████████▊ | 33652/37963 [83:11:56<10:44:59,  8.98s/it]
 89%|████████▊ | 33653/37963 [83:12:04<10:17:31,  8.60s/it]
 89%|████████▊ | 33654/37963 [83:12:12<9:57:23,  8.32s/it] 
 89%|████████▊ | 33655/37963 [83:12:19<9:44:59,  8.15s/it]
 89%|████████▊ | 33656/37963 [83:12:34<11:54:09,  9.95s/it]
 89%|████████▊ | 33657/37963 [83:12:41<11:05:02,  9.27s/it]
 89%|████████▊ | 33658/37963 [83:12:49<10:31:52,  8.81s/it]
 89%|████████▊ | 33659/37963 [83:13:04<12:36:29, 10.55s/it]
 89%|████████▊ | 33660/37963 [83:13:11<11:32:29,  9.66s/it]
                                                           
{'loss': '0.09375', 'grad_norm': '2.982', 'learning_rate': '6.666e-07', 'epoch': '0.8867'}
+
 89%|████████▊ | 33660/37963 [83:13:11<11:32:29,  9.66s/it]
 89%|████████▊ | 33661/37963 [83:13:19<10:45:14,  9.00s/it]
 89%|████████▊ | 33662/37963 [83:13:26<10:17:00,  8.61s/it]
 89%|████████▊ | 33663/37963 [83:13:34<9:57:04,  8.33s/it] 
 89%|████████▊ | 33664/37963 [83:13:42<9:41:17,  8.11s/it]
 89%|████████▊ | 33665/37963 [83:13:49<9:34:18,  8.02s/it]
 89%|████████▊ | 33666/37963 [83:13:57<9:27:50,  7.93s/it]
 89%|████████▊ | 33667/37963 [83:14:05<9:24:18,  7.88s/it]
 89%|████████▊ | 33668/37963 [83:14:13<9:22:19,  7.86s/it]
 89%|████████▊ | 33669/37963 [83:14:21<9:20:29,  7.83s/it]
 89%|████████▊ | 33670/37963 [83:14:28<9:16:35,  7.78s/it]
                                                          
{'loss': '0.08515', 'grad_norm': '2.01', 'learning_rate': '6.635e-07', 'epoch': '0.8869'}
+
 89%|████████▊ | 33670/37963 [83:14:28<9:16:35,  7.78s/it]
 89%|████████▊ | 33671/37963 [83:14:36<9:14:01,  7.75s/it]
 89%|████████▊ | 33672/37963 [83:14:44<9:13:51,  7.74s/it]
 89%|████████▊ | 33673/37963 [83:14:51<9:13:41,  7.74s/it]
 89%|████████▊ | 33674/37963 [83:14:59<9:11:17,  7.71s/it]
 89%|████████▊ | 33675/37963 [83:15:07<9:09:43,  7.69s/it]
 89%|████████▊ | 33676/37963 [83:15:14<9:03:17,  7.60s/it]
 89%|████████▊ | 33677/37963 [83:15:22<9:06:00,  7.64s/it]
 89%|████████▊ | 33678/37963 [83:15:30<9:08:34,  7.68s/it]
 89%|████████▊ | 33679/37963 [83:15:44<11:31:28,  9.68s/it]
 89%|████████▊ | 33680/37963 [83:15:58<13:10:55, 11.08s/it]
                                                           
{'loss': '0.08533', 'grad_norm': '3.741', 'learning_rate': '6.605e-07', 'epoch': '0.8872'}
+
 89%|████████▊ | 33680/37963 [83:15:58<13:10:55, 11.08s/it]
 89%|████████▊ | 33681/37963 [83:16:06<11:57:09, 10.05s/it]
 89%|████████▊ | 33682/37963 [83:16:14<11:05:51,  9.33s/it]
 89%|████████▊ | 33683/37963 [83:16:21<10:36:11,  8.92s/it]
 89%|████████▊ | 33684/37963 [83:16:29<10:07:43,  8.52s/it]
 89%|████████▊ | 33685/37963 [83:16:37<9:50:47,  8.29s/it] 
 89%|████████▊ | 33686/37963 [83:16:45<9:40:40,  8.15s/it]
 89%|████████▊ | 33687/37963 [83:16:52<9:32:05,  8.03s/it]
 89%|████████▊ | 33688/37963 [83:17:00<9:25:04,  7.93s/it]
 89%|████████▊ | 33689/37963 [83:17:14<11:42:52,  9.87s/it]
 89%|████████▊ | 33690/37963 [83:17:22<10:57:00,  9.23s/it]
                                                           
{'loss': '0.07905', 'grad_norm': '2.662', 'learning_rate': '6.574e-07', 'epoch': '0.8874'}
+
 89%|████████▊ | 33690/37963 [83:17:22<10:57:00,  9.23s/it]
 89%|████████▊ | 33691/37963 [83:17:36<12:36:25, 10.62s/it]
 89%|████████▊ | 33692/37963 [83:17:51<14:05:27, 11.88s/it]
 89%|████████▉ | 33693/37963 [83:17:59<12:42:20, 10.71s/it]
 89%|████████▉ | 33694/37963 [83:18:07<11:39:26,  9.83s/it]
 89%|████████▉ | 33695/37963 [83:18:21<13:19:26, 11.24s/it]
 89%|████████▉ | 33696/37963 [83:18:29<12:01:44, 10.15s/it]
 89%|████████▉ | 33697/37963 [83:18:36<11:08:56,  9.41s/it]
 89%|████████▉ | 33698/37963 [83:18:44<10:33:50,  8.92s/it]
 89%|████████▉ | 33699/37963 [83:18:52<10:09:09,  8.57s/it]
 89%|████████▉ | 33700/37963 [83:19:00<9:52:38,  8.34s/it] 
                                                          
{'loss': '0.08581', 'grad_norm': '3.413', 'learning_rate': '6.544e-07', 'epoch': '0.8877'}
+
 89%|████████▉ | 33700/37963 [83:19:00<9:52:38,  8.34s/it]
 89%|████████▉ | 33701/37963 [83:19:08<9:38:50,  8.15s/it]
 89%|████████▉ | 33702/37963 [83:19:15<9:29:27,  8.02s/it]
 89%|████████▉ | 33703/37963 [83:19:23<9:22:13,  7.92s/it]
 89%|████████▉ | 33704/37963 [83:19:37<11:28:46,  9.70s/it]
 89%|████████▉ | 33705/37963 [83:19:44<10:45:14,  9.09s/it]
 89%|████████▉ | 33706/37963 [83:19:52<10:19:02,  8.73s/it]
 89%|████████▉ | 33707/37963 [83:20:00<9:52:41,  8.36s/it] 
 89%|████████▉ | 33708/37963 [83:20:08<9:41:40,  8.20s/it]
 89%|████████▉ | 33709/37963 [83:20:15<9:29:23,  8.03s/it]
 89%|████████▉ | 33710/37963 [83:20:30<11:55:28, 10.09s/it]
                                                           
{'loss': '0.07474', 'grad_norm': '2.167', 'learning_rate': '6.514e-07', 'epoch': '0.888'}
+
 89%|████████▉ | 33710/37963 [83:20:30<11:55:28, 10.09s/it]
 89%|████████▉ | 33711/37963 [83:20:38<11:03:07,  9.36s/it]
 89%|████████▉ | 33712/37963 [83:20:45<10:25:38,  8.83s/it]
 89%|████████▉ | 33713/37963 [83:20:53<9:56:28,  8.42s/it] 
 89%|████████▉ | 33714/37963 [83:21:01<9:40:28,  8.20s/it]
 89%|████████▉ | 33715/37963 [83:21:08<9:29:21,  8.04s/it]
 89%|████████▉ | 33716/37963 [83:21:16<9:19:55,  7.91s/it]
 89%|████████▉ | 33717/37963 [83:21:24<9:14:53,  7.84s/it]
 89%|████████▉ | 33718/37963 [83:21:31<9:14:05,  7.83s/it]
 89%|████████▉ | 33719/37963 [83:21:39<9:10:17,  7.78s/it]
 89%|████████▉ | 33720/37963 [83:21:47<9:11:32,  7.80s/it]
                                                          
{'loss': '0.08496', 'grad_norm': '3.149', 'learning_rate': '6.483e-07', 'epoch': '0.8882'}
+
 89%|████████▉ | 33720/37963 [83:21:47<9:11:32,  7.80s/it]
 89%|████████▉ | 33721/37963 [83:21:55<9:08:53,  7.76s/it]
 89%|████████▉ | 33722/37963 [83:22:09<11:22:26,  9.66s/it]
 89%|████████▉ | 33723/37963 [83:22:16<10:39:33,  9.05s/it]
 89%|████████▉ | 33724/37963 [83:22:24<10:10:16,  8.64s/it]
 89%|████████▉ | 33725/37963 [83:22:31<9:44:54,  8.28s/it] 
 89%|████████▉ | 33726/37963 [83:22:39<9:33:27,  8.12s/it]
 89%|████████▉ | 33727/37963 [83:22:47<9:25:30,  8.01s/it]
 89%|████████▉ | 33728/37963 [83:23:01<11:35:21,  9.85s/it]
 89%|████████▉ | 33729/37963 [83:23:09<10:50:25,  9.22s/it]
 89%|████████▉ | 33730/37963 [83:23:16<10:16:29,  8.74s/it]
                                                           
{'loss': '0.07213', 'grad_norm': '2.533', 'learning_rate': '6.453e-07', 'epoch': '0.8885'}
+
 89%|████████▉ | 33730/37963 [83:23:16<10:16:29,  8.74s/it]
 89%|████████▉ | 33731/37963 [83:23:24<9:54:25,  8.43s/it] 
 89%|████████▉ | 33732/37963 [83:23:32<9:38:19,  8.20s/it]
 89%|████████▉ | 33733/37963 [83:23:47<12:01:41, 10.24s/it]
 89%|████████▉ | 33734/37963 [83:23:54<11:08:25,  9.48s/it]
 89%|████████▉ | 33735/37963 [83:24:09<12:48:41, 10.91s/it]
 89%|████████▉ | 33736/37963 [83:24:24<14:14:48, 12.13s/it]
 89%|████████▉ | 33737/37963 [83:24:31<12:42:43, 10.83s/it]
 89%|████████▉ | 33738/37963 [83:24:39<11:37:30,  9.91s/it]
 89%|████████▉ | 33739/37963 [83:24:47<10:49:56,  9.23s/it]
 89%|████████▉ | 33740/37963 [83:24:55<10:18:29,  8.79s/it]
                                                           
{'loss': '0.08448', 'grad_norm': '3.404', 'learning_rate': '6.423e-07', 'epoch': '0.8888'}
+
 89%|████████▉ | 33740/37963 [83:24:55<10:18:29,  8.79s/it]
 89%|████████▉ | 33741/37963 [83:25:02<9:56:50,  8.48s/it] 
 89%|████████▉ | 33742/37963 [83:25:10<9:40:54,  8.26s/it]
 89%|████████▉ | 33743/37963 [83:25:25<11:58:25, 10.21s/it]
 89%|████████▉ | 33744/37963 [83:25:33<11:04:54,  9.46s/it]
 89%|████████▉ | 33745/37963 [83:25:40<10:30:02,  8.96s/it]
 89%|████████▉ | 33746/37963 [83:25:48<10:04:53,  8.61s/it]
 89%|████████▉ | 33747/37963 [83:25:56<9:43:53,  8.31s/it] 
 89%|████████▉ | 33748/37963 [83:26:03<9:24:05,  8.03s/it]
 89%|████████▉ | 33749/37963 [83:26:11<9:16:23,  7.92s/it]
 89%|████████▉ | 33750/37963 [83:26:18<9:10:26,  7.84s/it]
                                                          
{'loss': '0.0864', 'grad_norm': '3.617', 'learning_rate': '6.393e-07', 'epoch': '0.889'}
+
 89%|████████▉ | 33750/37963 [83:26:18<9:10:26,  7.84s/it]
 89%|████████▉ | 33751/37963 [83:26:26<9:09:19,  7.83s/it]
 89%|████████▉ | 33752/37963 [83:26:34<8:58:59,  7.68s/it]
 89%|████████▉ | 33753/37963 [83:26:48<11:14:52,  9.62s/it]
 89%|████████▉ | 33754/37963 [83:27:02<12:56:12, 11.06s/it]
 89%|████████▉ | 33755/37963 [83:27:10<11:45:26, 10.06s/it]
 89%|████████▉ | 33756/37963 [83:27:18<10:53:56,  9.33s/it]
 89%|████████▉ | 33757/37963 [83:27:25<10:21:00,  8.86s/it]
 89%|████████▉ | 33758/37963 [83:27:33<9:56:14,  8.51s/it] 
 89%|████████▉ | 33759/37963 [83:27:41<9:35:58,  8.22s/it]
 89%|████████▉ | 33760/37963 [83:27:48<9:25:59,  8.08s/it]
                                                          
{'loss': '0.08866', 'grad_norm': '3.261', 'learning_rate': '6.363e-07', 'epoch': '0.8893'}
+
 89%|████████▉ | 33760/37963 [83:27:48<9:25:59,  8.08s/it]
 89%|████████▉ | 33761/37963 [83:27:56<9:17:37,  7.96s/it]
 89%|████████▉ | 33762/37963 [83:28:04<9:11:40,  7.88s/it]
 89%|████████▉ | 33763/37963 [83:28:11<9:08:42,  7.84s/it]
 89%|████████▉ | 33764/37963 [83:28:19<9:06:21,  7.81s/it]
 89%|████████▉ | 33765/37963 [83:28:27<9:06:17,  7.81s/it]
 89%|████████▉ | 33766/37963 [83:28:35<9:06:01,  7.81s/it]
 89%|████████▉ | 33767/37963 [83:28:42<9:00:03,  7.72s/it]
 89%|████████▉ | 33768/37963 [83:28:50<8:58:14,  7.70s/it]
 89%|████████▉ | 33769/37963 [83:28:58<8:57:52,  7.69s/it]
 89%|████████▉ | 33770/37963 [83:29:05<8:54:40,  7.65s/it]
                                                          
{'loss': '0.08772', 'grad_norm': '4.342', 'learning_rate': '6.333e-07', 'epoch': '0.8896'}
+
 89%|████████▉ | 33770/37963 [83:29:05<8:54:40,  7.65s/it]
 89%|████████▉ | 33771/37963 [83:29:13<8:50:07,  7.59s/it]
 89%|████████▉ | 33772/37963 [83:29:21<8:57:39,  7.70s/it]
 89%|████████▉ | 33773/37963 [83:29:28<8:55:10,  7.66s/it]
 89%|████████▉ | 33774/37963 [83:29:42<11:14:35,  9.66s/it]
 89%|████████▉ | 33775/37963 [83:29:50<10:33:56,  9.08s/it]
 89%|████████▉ | 33776/37963 [83:29:58<10:03:53,  8.65s/it]
 89%|████████▉ | 33777/37963 [83:30:13<12:14:32, 10.53s/it]
 89%|████████▉ | 33778/37963 [83:30:21<11:19:37,  9.74s/it]
 89%|████████▉ | 33779/37963 [83:30:35<12:47:38, 11.01s/it]
 89%|████████▉ | 33780/37963 [83:30:42<11:39:09, 10.03s/it]
                                                           
{'loss': '0.08513', 'grad_norm': '2.956', 'learning_rate': '6.303e-07', 'epoch': '0.8898'}
+
 89%|████████▉ | 33780/37963 [83:30:42<11:39:09, 10.03s/it]
 89%|████████▉ | 33781/37963 [83:30:50<10:49:52,  9.32s/it]
 89%|████████▉ | 33782/37963 [83:31:04<12:28:34, 10.74s/it]
 89%|████████▉ | 33783/37963 [83:31:12<11:24:56,  9.83s/it]
 89%|████████▉ | 33784/37963 [83:31:27<13:07:08, 11.30s/it]
 89%|████████▉ | 33785/37963 [83:31:34<11:52:04, 10.23s/it]
 89%|████████▉ | 33786/37963 [83:31:42<11:00:04,  9.48s/it]
 89%|████████▉ | 33787/37963 [83:31:50<10:22:32,  8.94s/it]
 89%|████████▉ | 33788/37963 [83:31:57<9:56:03,  8.57s/it] 
 89%|████████▉ | 33789/37963 [83:32:05<9:36:31,  8.29s/it]
 89%|████████▉ | 33790/37963 [83:32:13<9:21:21,  8.07s/it]
                                                          
{'loss': '0.08832', 'grad_norm': '3.383', 'learning_rate': '6.274e-07', 'epoch': '0.8901'}
+
 89%|████████▉ | 33790/37963 [83:32:13<9:21:21,  8.07s/it]
 89%|████████▉ | 33791/37963 [83:32:20<9:14:24,  7.97s/it]
 89%|████████▉ | 33792/37963 [83:32:28<9:08:44,  7.89s/it]
 89%|████████▉ | 33793/37963 [83:32:35<8:59:02,  7.76s/it]
 89%|████████▉ | 33794/37963 [83:32:50<11:19:30,  9.78s/it]
 89%|████████▉ | 33795/37963 [83:32:58<10:37:07,  9.17s/it]
 89%|████████▉ | 33796/37963 [83:33:05<10:06:29,  8.73s/it]
 89%|████████▉ | 33797/37963 [83:33:13<9:40:21,  8.36s/it] 
 89%|████████▉ | 33798/37963 [83:33:20<9:21:36,  8.09s/it]
 89%|████████▉ | 33799/37963 [83:33:28<9:14:11,  7.99s/it]
 89%|████████▉ | 33800/37963 [83:33:36<9:07:46,  7.89s/it]
                                                          
{'loss': '0.08226', 'grad_norm': '2.484', 'learning_rate': '6.244e-07', 'epoch': '0.8903'}
+
 89%|████████▉ | 33800/37963 [83:33:36<9:07:46,  7.89s/it]
 89%|████████▉ | 33801/37963 [83:33:58<14:04:04, 12.17s/it]
 89%|████████▉ | 33802/37963 [83:34:06<12:29:00, 10.80s/it]
 89%|████████▉ | 33803/37963 [83:34:13<11:20:34,  9.82s/it]
 89%|████████▉ | 33804/37963 [83:34:21<10:34:41,  9.16s/it]
 89%|████████▉ | 33805/37963 [83:34:28<9:59:53,  8.66s/it] 
 89%|████████▉ | 33806/37963 [83:34:36<9:39:19,  8.36s/it]
 89%|████████▉ | 33807/37963 [83:34:43<9:24:18,  8.15s/it]
 89%|████████▉ | 33808/37963 [83:34:51<9:14:53,  8.01s/it]
 89%|████████▉ | 33809/37963 [83:34:59<9:08:35,  7.92s/it]
 89%|████████▉ | 33810/37963 [83:35:06<9:00:46,  7.81s/it]
                                                          
{'loss': '0.08586', 'grad_norm': '3.546', 'learning_rate': '6.214e-07', 'epoch': '0.8906'}
+
 89%|████████▉ | 33810/37963 [83:35:06<9:00:46,  7.81s/it]
 89%|████████▉ | 33811/37963 [83:35:14<8:52:12,  7.69s/it]
 89%|████████▉ | 33812/37963 [83:35:22<8:50:52,  7.67s/it]
 89%|████████▉ | 33813/37963 [83:35:29<8:51:15,  7.68s/it]
 89%|████████▉ | 33814/37963 [83:35:37<8:51:21,  7.68s/it]
 89%|████████▉ | 33815/37963 [83:35:45<8:54:07,  7.73s/it]
 89%|████████▉ | 33816/37963 [83:35:52<8:53:00,  7.71s/it]
 89%|████████▉ | 33817/37963 [83:36:00<8:51:28,  7.69s/it]
 89%|████████▉ | 33818/37963 [83:36:08<8:48:43,  7.65s/it]
 89%|████████▉ | 33819/37963 [83:36:15<8:43:00,  7.57s/it]
 89%|████████▉ | 33820/37963 [83:36:23<8:45:35,  7.61s/it]
                                                          
{'loss': '0.08505', 'grad_norm': '2.868', 'learning_rate': '6.185e-07', 'epoch': '0.8909'}
+
 89%|████████▉ | 33820/37963 [83:36:23<8:45:35,  7.61s/it]
 89%|████████▉ | 33821/37963 [83:36:30<8:42:51,  7.57s/it]
 89%|████████▉ | 33822/37963 [83:36:38<8:45:27,  7.61s/it]
 89%|████████▉ | 33823/37963 [83:36:52<11:02:23,  9.60s/it]
 89%|████████▉ | 33824/37963 [83:37:07<12:52:27, 11.20s/it]
 89%|████████▉ | 33825/37963 [83:37:15<11:40:39, 10.16s/it]
 89%|████████▉ | 33826/37963 [83:37:22<10:43:12,  9.33s/it]
 89%|████████▉ | 33827/37963 [83:37:30<10:09:42,  8.84s/it]
 89%|████████▉ | 33828/37963 [83:37:51<14:27:12, 12.58s/it]
 89%|████████▉ | 33829/37963 [83:37:59<12:40:38, 11.04s/it]
 89%|████████▉ | 33830/37963 [83:38:06<11:29:24, 10.01s/it]
                                                           
{'loss': '0.08707', 'grad_norm': '3.273', 'learning_rate': '6.155e-07', 'epoch': '0.8911'}
+
 89%|████████▉ | 33830/37963 [83:38:06<11:29:24, 10.01s/it]
 89%|████████▉ | 33831/37963 [83:38:14<10:40:24,  9.30s/it]
 89%|████████▉ | 33832/37963 [83:38:22<10:08:08,  8.83s/it]
 89%|████████▉ | 33833/37963 [83:38:29<9:45:09,  8.50s/it] 
 89%|████████▉ | 33834/37963 [83:38:37<9:23:30,  8.19s/it]
 89%|████████▉ | 33835/37963 [83:38:45<9:14:22,  8.06s/it]
 89%|████████▉ | 33836/37963 [83:38:59<11:19:01,  9.87s/it]
 89%|████████▉ | 33837/37963 [83:39:06<10:34:29,  9.23s/it]
 89%|████████▉ | 33838/37963 [83:39:14<10:02:21,  8.76s/it]
 89%|████████▉ | 33839/37963 [83:39:22<9:44:24,  8.50s/it] 
 89%|████████▉ | 33840/37963 [83:39:30<9:27:01,  8.25s/it]
                                                          
{'loss': '0.0857', 'grad_norm': '2.702', 'learning_rate': '6.126e-07', 'epoch': '0.8914'}
+
 89%|████████▉ | 33840/37963 [83:39:30<9:27:01,  8.25s/it]
 89%|████████▉ | 33841/37963 [83:39:37<9:14:28,  8.07s/it]
 89%|████████▉ | 33842/37963 [83:39:45<9:05:08,  7.94s/it]
 89%|████████▉ | 33843/37963 [83:39:59<11:13:57,  9.82s/it]
 89%|████████▉ | 33844/37963 [83:40:07<10:29:30,  9.17s/it]
 89%|████████▉ | 33845/37963 [83:40:15<10:01:25,  8.76s/it]
 89%|████████▉ | 33846/37963 [83:40:36<14:31:40, 12.70s/it]
 89%|████████▉ | 33847/37963 [83:40:44<12:53:13, 11.27s/it]
 89%|████████▉ | 33848/37963 [83:40:52<11:40:39, 10.22s/it]
 89%|████████▉ | 33849/37963 [83:41:00<10:48:41,  9.46s/it]
 89%|████████▉ | 33850/37963 [83:41:08<10:12:03,  8.93s/it]
                                                           
{'loss': '0.08642', 'grad_norm': '3.727', 'learning_rate': '6.096e-07', 'epoch': '0.8917'}
+
 89%|████████▉ | 33850/37963 [83:41:08<10:12:03,  8.93s/it]
 89%|████████▉ | 33851/37963 [83:41:15<9:46:16,  8.55s/it] 
 89%|████████▉ | 33852/37963 [83:41:23<9:28:12,  8.29s/it]
 89%|████████▉ | 33853/37963 [83:41:30<9:09:18,  8.02s/it]
 89%|████████▉ | 33854/37963 [83:41:38<8:58:02,  7.86s/it]
 89%|████████▉ | 33855/37963 [83:41:45<8:53:22,  7.79s/it]
 89%|████████▉ | 33856/37963 [83:41:53<8:47:42,  7.71s/it]
 89%|████████▉ | 33857/37963 [83:42:01<8:48:22,  7.72s/it]
 89%|████████▉ | 33858/37963 [83:42:08<8:46:20,  7.69s/it]
 89%|████████▉ | 33859/37963 [83:42:16<8:42:48,  7.64s/it]
 89%|████████▉ | 33860/37963 [83:42:23<8:41:12,  7.62s/it]
                                                          
{'loss': '0.08244', 'grad_norm': '3.681', 'learning_rate': '6.067e-07', 'epoch': '0.8919'}
+
 89%|████████▉ | 33860/37963 [83:42:23<8:41:12,  7.62s/it]
 89%|████████▉ | 33861/37963 [83:42:31<8:41:55,  7.63s/it]
 89%|████████▉ | 33862/37963 [83:42:39<8:45:03,  7.68s/it]
 89%|████████▉ | 33863/37963 [83:42:46<8:40:06,  7.61s/it]
 89%|████████▉ | 33864/37963 [83:42:54<8:40:44,  7.62s/it]
 89%|████████▉ | 33865/37963 [83:43:02<8:42:41,  7.65s/it]
 89%|████████▉ | 33866/37963 [83:43:09<8:40:15,  7.62s/it]
 89%|████████▉ | 33867/37963 [83:43:17<8:42:41,  7.66s/it]
 89%|████████▉ | 33868/37963 [83:43:32<11:13:52,  9.87s/it]
 89%|████████▉ | 33869/37963 [83:43:40<10:29:47,  9.23s/it]
 89%|█████��██▉ | 33870/37963 [83:43:48<10:00:52,  8.81s/it]
                                                           
{'loss': '0.08663', 'grad_norm': '3.413', 'learning_rate': '6.038e-07', 'epoch': '0.8922'}
+
 89%|████████▉ | 33870/37963 [83:43:48<10:00:52,  8.81s/it]
 89%|████████▉ | 33871/37963 [83:43:55<9:37:05,  8.46s/it] 
 89%|████████▉ | 33872/37963 [83:44:03<9:17:12,  8.17s/it]
 89%|████████▉ | 33873/37963 [83:44:10<9:05:38,  8.00s/it]
 89%|████████▉ | 33874/37963 [83:44:18<8:54:10,  7.84s/it]
 89%|████████▉ | 33875/37963 [83:44:26<8:52:50,  7.82s/it]
 89%|████████▉ | 33876/37963 [83:44:47<13:27:22, 11.85s/it]
 89%|████████▉ | 33877/37963 [83:45:01<14:12:26, 12.52s/it]
 89%|████████▉ | 33878/37963 [83:45:09<12:34:34, 11.08s/it]
 89%|████████▉ | 33879/37963 [83:45:16<11:24:46, 10.06s/it]
 89%|████████▉ | 33880/37963 [83:45:24<10:37:39,  9.37s/it]
                                                           
{'loss': '0.08862', 'grad_norm': '3.376', 'learning_rate': '6.009e-07', 'epoch': '0.8925'}
+
 89%|████████▉ | 33880/37963 [83:45:24<10:37:39,  9.37s/it]
 89%|████████▉ | 33881/37963 [83:45:32<10:05:51,  8.91s/it]
 89%|████████▉ | 33882/37963 [83:45:46<11:50:19, 10.44s/it]
 89%|████████▉ | 33883/37963 [83:45:54<11:00:15,  9.71s/it]
 89%|████████▉ | 33884/37963 [83:46:01<10:16:07,  9.06s/it]
 89%|████████▉ | 33885/37963 [83:46:09<9:49:23,  8.67s/it] 
 89%|████████▉ | 33886/37963 [83:46:17<9:30:48,  8.40s/it]
 89%|████████▉ | 33887/37963 [83:46:25<9:13:10,  8.14s/it]
 89%|████████▉ | 33888/37963 [83:46:39<11:16:47,  9.97s/it]
 89%|████████▉ | 33889/37963 [83:46:47<10:32:30,  9.32s/it]
 89%|████████▉ | 33890/37963 [83:47:01<12:08:47, 10.74s/it]
                                                           
{'loss': '0.08229', 'grad_norm': '3.859', 'learning_rate': '5.98e-07', 'epoch': '0.8927'}
+
 89%|████████▉ | 33890/37963 [83:47:01<12:08:47, 10.74s/it]
 89%|████████▉ | 33891/37963 [83:47:15<13:28:30, 11.91s/it]
 89%|████████▉ | 33892/37963 [83:47:23<12:00:56, 10.63s/it]
 89%|████████▉ | 33893/37963 [83:47:30<10:59:37,  9.72s/it]
 89%|████████▉ | 33894/37963 [83:47:38<10:17:19,  9.10s/it]
 89%|████████▉ | 33895/37963 [83:47:46<9:48:53,  8.69s/it] 
 89%|████████▉ | 33896/37963 [83:47:54<9:30:21,  8.41s/it]
 89%|████████▉ | 33897/37963 [83:48:01<9:15:46,  8.20s/it]
 89%|████████▉ | 33898/37963 [83:48:09<9:05:35,  8.05s/it]
 89%|████████▉ | 33899/37963 [83:48:17<8:59:26,  7.96s/it]
 89%|████████▉ | 33900/37963 [83:48:24<8:47:55,  7.80s/it]
                                                          
{'loss': '0.07754', 'grad_norm': '2.592', 'learning_rate': '5.951e-07', 'epoch': '0.893'}
+
 89%|████████▉ | 33900/37963 [83:48:24<8:47:55,  7.80s/it]
 89%|████████▉ | 33901/37963 [83:48:32<8:44:46,  7.75s/it]
 89%|████████▉ | 33902/37963 [83:48:39<8:35:06,  7.61s/it]
 89%|████████▉ | 33903/37963 [83:48:47<8:36:16,  7.63s/it]
 89%|████████▉ | 33904/37963 [83:48:55<8:37:58,  7.66s/it]
 89%|████████▉ | 33905/37963 [83:49:02<8:41:52,  7.72s/it]
 89%|████████▉ | 33906/37963 [83:49:10<8:37:48,  7.66s/it]
 89%|████████▉ | 33907/37963 [83:49:17<8:35:06,  7.62s/it]
 89%|████████▉ | 33908/37963 [83:49:25<8:38:19,  7.67s/it]
 89%|████████▉ | 33909/37963 [83:49:33<8:35:51,  7.63s/it]
 89%|████████▉ | 33910/37963 [83:49:41<8:38:22,  7.67s/it]
                                                          
{'loss': '0.08434', 'grad_norm': '3.192', 'learning_rate': '5.922e-07', 'epoch': '0.8932'}
+
 89%|████████▉ | 33910/37963 [83:49:41<8:38:22,  7.67s/it]
 89%|████████▉ | 33911/37963 [83:49:48<8:41:30,  7.72s/it]
 89%|████████▉ | 33912/37963 [83:49:56<8:42:02,  7.73s/it]
 89%|████████▉ | 33913/37963 [83:50:04<8:40:14,  7.71s/it]
 89%|████████▉ | 33914/37963 [83:50:12<8:41:57,  7.73s/it]
 89%|████████▉ | 33915/37963 [83:50:19<8:42:09,  7.74s/it]
 89%|████████▉ | 33916/37963 [83:50:27<8:41:14,  7.73s/it]
 89%|████████▉ | 33917/37963 [83:50:35<8:42:13,  7.74s/it]
 89%|████████▉ | 33918/37963 [83:50:43<8:41:12,  7.73s/it]
 89%|████████▉ | 33919/37963 [83:50:50<8:33:58,  7.63s/it]
 89%|████████▉ | 33920/37963 [83:51:04<10:44:48,  9.57s/it]
                                                           
{'loss': '0.08247', 'grad_norm': '3.007', 'learning_rate': '5.893e-07', 'epoch': '0.8935'}
+
 89%|████████▉ | 33920/37963 [83:51:04<10:44:48,  9.57s/it]
 89%|████████▉ | 33921/37963 [83:51:19<12:35:08, 11.21s/it]
 89%|████████▉ | 33922/37963 [83:51:27<11:22:30, 10.13s/it]
 89%|████████▉ | 33923/37963 [83:51:41<12:56:57, 11.54s/it]
 89%|████████▉ | 33924/37963 [83:51:49<11:41:17, 10.42s/it]
 89%|████████▉ | 33925/37963 [83:52:03<12:55:25, 11.52s/it]
 89%|████████▉ | 33926/37963 [83:52:11<11:42:18, 10.44s/it]
 89%|████████▉ | 33927/37963 [83:52:19<10:45:14,  9.59s/it]
 89%|████████▉ | 33928/37963 [83:52:27<10:05:06,  9.00s/it]
 89%|████████▉ | 33929/37963 [83:52:34<9:38:22,  8.60s/it] 
 89%|████████▉ | 33930/37963 [83:52:42<9:20:05,  8.33s/it]
                                                          
{'loss': '0.07925', 'grad_norm': '3.201', 'learning_rate': '5.864e-07', 'epoch': '0.8938'}
+
 89%|████████▉ | 33930/37963 [83:52:42<9:20:05,  8.33s/it]
 89%|████████▉ | 33931/37963 [83:52:50<9:10:58,  8.20s/it]
 89%|████████▉ | 33932/37963 [83:53:04<11:19:39, 10.12s/it]
 89%|████████▉ | 33933/37963 [83:53:12<10:29:09,  9.37s/it]
 89%|████████▉ | 33934/37963 [83:53:19<9:50:17,  8.79s/it] 
 89%|████████▉ | 33935/37963 [83:53:33<11:35:06, 10.35s/it]
 89%|████████▉ | 33936/37963 [83:53:41<10:42:44,  9.58s/it]
 89%|████████▉ | 33937/37963 [83:53:49<10:05:47,  9.03s/it]
 89%|████████▉ | 33938/37963 [83:54:03<11:41:04, 10.45s/it]
 89%|████████▉ | 33939/37963 [83:54:11<10:49:28,  9.68s/it]
 89%|████████▉ | 33940/37963 [83:54:26<12:35:10, 11.26s/it]
                                                           
{'loss': '0.0889', 'grad_norm': '3.248', 'learning_rate': '5.835e-07', 'epoch': '0.894'}
+
 89%|████████▉ | 33940/37963 [83:54:26<12:35:10, 11.26s/it]
 89%|████████▉ | 33941/37963 [83:54:33<11:26:50, 10.25s/it]
 89%|████████▉ | 33942/37963 [83:54:41<10:40:43,  9.56s/it]
 89%|████████▉ | 33943/37963 [83:54:49<10:04:08,  9.02s/it]
 89%|████████▉ | 33944/37963 [83:54:57<9:36:11,  8.60s/it] 
 89%|████████▉ | 33945/37963 [83:55:05<9:18:48,  8.34s/it]
 89%|████████▉ | 33946/37963 [83:55:13<9:11:37,  8.24s/it]
 89%|████████▉ | 33947/37963 [83:55:20<9:02:17,  8.10s/it]
 89%|████████▉ | 33948/37963 [83:55:28<8:55:33,  8.00s/it]
 89%|████████▉ | 33949/37963 [83:55:36<8:47:49,  7.89s/it]
 89%|████████▉ | 33950/37963 [83:55:43<8:43:59,  7.83s/it]
                                                          
{'loss': '0.08446', 'grad_norm': '3.108', 'learning_rate': '5.806e-07', 'epoch': '0.8943'}
+
 89%|████████▉ | 33950/37963 [83:55:43<8:43:59,  7.83s/it]
 89%|████████▉ | 33951/37963 [83:55:51<8:43:10,  7.82s/it]
 89%|████████▉ | 33952/37963 [83:55:59<8:37:56,  7.75s/it]
 89%|████████▉ | 33953/37963 [83:56:06<8:36:20,  7.73s/it]
 89%|████████▉ | 33954/37963 [83:56:14<8:40:09,  7.78s/it]
 89%|████████▉ | 33955/37963 [83:56:22<8:39:04,  7.77s/it]
 89%|████████▉ | 33956/37963 [83:56:30<8:38:20,  7.76s/it]
 89%|████████▉ | 33957/37963 [83:56:37<8:32:25,  7.67s/it]
 89%|████████▉ | 33958/37963 [83:56:45<8:29:44,  7.64s/it]
 89%|████████▉ | 33959/37963 [83:56:53<8:33:37,  7.70s/it]
 89%|████████▉ | 33960/37963 [83:57:00<8:30:40,  7.65s/it]
                                                          
{'loss': '0.07739', 'grad_norm': '3.555', 'learning_rate': '5.778e-07', 'epoch': '0.8946'}
+
 89%|████████▉ | 33960/37963 [83:57:00<8:30:40,  7.65s/it]
 89%|████████▉ | 33961/37963 [83:57:08<8:23:01,  7.54s/it]
 89%|████████▉ | 33962/37963 [83:57:15<8:24:14,  7.56s/it]
 89%|████████▉ | 33963/37963 [83:57:23<8:27:59,  7.62s/it]
 89%|████████▉ | 33964/37963 [83:57:30<8:23:56,  7.56s/it]
 89%|████████▉ | 33965/37963 [83:57:38<8:25:52,  7.59s/it]
 89%|████████▉ | 33966/37963 [83:57:45<8:23:12,  7.55s/it]
 89%|████████▉ | 33967/37963 [83:57:53<8:27:04,  7.61s/it]
 89%|████████▉ | 33968/37963 [83:58:01<8:29:45,  7.66s/it]
 89%|████████▉ | 33969/37963 [83:58:09<8:30:31,  7.67s/it]
 89%|████████▉ | 33970/37963 [83:58:16<8:26:00,  7.60s/it]
                                                          
{'loss': '0.08098', 'grad_norm': '2.651', 'learning_rate': '5.749e-07', 'epoch': '0.8948'}
+
 89%|████████▉ | 33970/37963 [83:58:16<8:26:00,  7.60s/it]
 89%|████████▉ | 33971/37963 [83:58:30<10:37:32,  9.58s/it]
 89%|████████▉ | 33972/37963 [83:58:51<14:28:46, 13.06s/it]
 89%|████████▉ | 33973/37963 [83:58:59<12:46:19, 11.52s/it]
 89%|████████▉ | 33974/37963 [83:59:14<13:39:51, 12.33s/it]
 89%|████████▉ | 33975/37963 [83:59:21<12:07:21, 10.94s/it]
 89%|████████▉ | 33976/37963 [83:59:29<11:03:08,  9.98s/it]
 90%|████████▉ | 33977/37963 [83:59:43<12:27:27, 11.25s/it]
 90%|████████▉ | 33978/37963 [83:59:51<11:08:59, 10.07s/it]
 90%|████████▉ | 33979/37963 [83:59:58<10:20:50,  9.35s/it]
 90%|████████▉ | 33980/37963 [84:00:06<9:47:49,  8.86s/it] 
                                                          
{'loss': '0.09175', 'grad_norm': '3.909', 'learning_rate': '5.721e-07', 'epoch': '0.8951'}
+
 90%|████████▉ | 33980/37963 [84:00:06<9:47:49,  8.86s/it]
 90%|████████▉ | 33981/37963 [84:00:13<9:19:39,  8.43s/it]
 90%|████████▉ | 33982/37963 [84:00:28<11:15:07, 10.18s/it]
 90%|████████▉ | 33983/37963 [84:00:35<10:23:26,  9.40s/it]
 90%|████████▉ | 33984/37963 [84:00:50<12:11:16, 11.03s/it]
 90%|████████▉ | 33985/37963 [84:00:58<11:05:37, 10.04s/it]
 90%|████████▉ | 33986/37963 [84:01:05<10:18:04,  9.32s/it]
 90%|████████▉ | 33987/37963 [84:01:13<9:44:44,  8.82s/it] 
 90%|████████▉ | 33988/37963 [84:01:21<9:23:04,  8.50s/it]
 90%|████████▉ | 33989/37963 [84:01:35<11:16:02, 10.21s/it]
 90%|████████▉ | 33990/37963 [84:01:42<10:19:19,  9.35s/it]
                                                           
{'loss': '0.08094', 'grad_norm': '3.762', 'learning_rate': '5.692e-07', 'epoch': '0.8953'}
+
 90%|████████▉ | 33990/37963 [84:01:42<10:19:19,  9.35s/it]
 90%|████████▉ | 33991/37963 [84:01:50<9:46:11,  8.85s/it] 
 90%|████████▉ | 33992/37963 [84:01:58<9:21:35,  8.49s/it]
 90%|████████▉ | 33993/37963 [84:02:05<9:03:47,  8.22s/it]
 90%|████████▉ | 33994/37963 [84:02:13<8:48:35,  7.99s/it]
 90%|████████▉ | 33995/37963 [84:02:20<8:42:06,  7.89s/it]
 90%|████████▉ | 33996/37963 [84:02:28<8:38:24,  7.84s/it]
 90%|████████▉ | 33997/37963 [84:02:36<8:34:26,  7.78s/it]
 90%|████████▉ | 33998/37963 [84:02:43<8:31:08,  7.73s/it]
 90%|████████▉ | 33999/37963 [84:02:51<8:31:10,  7.74s/it]
 90%|████████▉ | 34000/37963 [84:02:59<8:23:47,  7.63s/it]
                                                          
{'loss': '0.07919', 'grad_norm': '2.562', 'learning_rate': '5.664e-07', 'epoch': '0.8956'}
+
 90%|████████▉ | 34000/37963 [84:02:59<8:23:47,  7.63s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.57s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.57s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 90%|████████▉ | 34001/37963 [84:03:56<24:58:43, 22.70s/it]
 90%|████████▉ | 34002/37963 [84:04:04<20:04:46, 18.25s/it]
 90%|████████▉ | 34003/37963 [84:04:12<16:37:36, 15.12s/it]
 90%|████████▉ | 34004/37963 [84:04:20<14:13:16, 12.93s/it]
 90%|████████▉ | 34005/37963 [84:04:28<12:34:17, 11.43s/it]
 90%|████████▉ | 34006/37963 [84:04:36<11:21:36, 10.34s/it]
 90%|████████▉ | 34007/37963 [84:04:43<10:31:37,  9.58s/it]
 90%|████████▉ | 34008/37963 [84:04:51<9:55:29,  9.03s/it] 
 90%|████████▉ | 34009/37963 [84:04:59<9:28:28,  8.63s/it]
 90%|████████▉ | 34010/37963 [84:05:06<9:07:43,  8.31s/it]
                                                          
{'loss': '0.08357', 'grad_norm': '2.805', 'learning_rate': '5.636e-07', 'epoch': '0.8959'}
+
 90%|████████▉ | 34010/37963 [84:05:06<9:07:43,  8.31s/it]
 90%|████████▉ | 34011/37963 [84:05:14<8:56:06,  8.14s/it]
 90%|████████▉ | 34012/37963 [84:05:22<8:48:28,  8.03s/it]
 90%|████████▉ | 34013/37963 [84:05:30<8:39:15,  7.89s/it]
 90%|████████▉ | 34014/37963 [84:05:37<8:35:32,  7.83s/it]
 90%|████████▉ | 34015/37963 [84:05:45<8:32:18,  7.79s/it]
 90%|████████▉ | 34016/37963 [84:05:52<8:27:20,  7.71s/it]
 90%|████████▉ | 34017/37963 [84:06:00<8:26:09,  7.70s/it]
 90%|████████▉ | 34018/37963 [84:06:08<8:25:09,  7.68s/it]
 90%|████████▉ | 34019/37963 [84:06:15<8:24:39,  7.68s/it]
 90%|████████▉ | 34020/37963 [84:06:30<10:48:12,  9.86s/it]
                                                           
{'loss': '0.08216', 'grad_norm': '3.255', 'learning_rate': '5.608e-07', 'epoch': '0.8961'}
+
 90%|████████▉ | 34020/37963 [84:06:30<10:48:12,  9.86s/it]
 90%|████████▉ | 34021/37963 [84:06:38<10:04:08,  9.20s/it]
 90%|████████▉ | 34022/37963 [84:06:52<11:43:13, 10.71s/it]
 90%|████████▉ | 34023/37963 [84:07:13<15:09:51, 13.86s/it]
 90%|████████▉ | 34024/37963 [84:07:21<13:11:55, 12.06s/it]
 90%|████████▉ | 34025/37963 [84:07:29<11:44:33, 10.73s/it]
 90%|████████▉ | 34026/37963 [84:07:37<10:45:39,  9.84s/it]
 90%|████████▉ | 34027/37963 [84:07:44<9:59:12,  9.13s/it] 
 90%|████████▉ | 34028/37963 [84:08:07<14:17:44, 13.08s/it]
 90%|████████▉ | 34029/37963 [84:08:14<12:35:04, 11.52s/it]
 90%|████████▉ | 34030/37963 [84:08:22<11:20:01, 10.37s/it]
                                                           
{'loss': '0.08203', 'grad_norm': '3.272', 'learning_rate': '5.58e-07', 'epoch': '0.8964'}
+
 90%|████████▉ | 34030/37963 [84:08:22<11:20:01, 10.37s/it]
 90%|████████▉ | 34031/37963 [84:08:37<12:45:21, 11.68s/it]
 90%|████████▉ | 34032/37963 [84:08:45<11:32:29, 10.57s/it]
 90%|████████▉ | 34033/37963 [84:08:52<10:31:40,  9.64s/it]
 90%|████████▉ | 34034/37963 [84:09:00<9:51:53,  9.04s/it] 
 90%|████████▉ | 34035/37963 [84:09:08<9:25:19,  8.64s/it]
 90%|████████▉ | 34036/37963 [84:09:15<9:09:16,  8.39s/it]
 90%|████████▉ | 34037/37963 [84:09:23<8:56:04,  8.19s/it]
 90%|████████▉ | 34038/37963 [84:09:31<8:44:35,  8.02s/it]
 90%|████████▉ | 34039/37963 [84:09:45<10:47:12,  9.90s/it]
 90%|████████▉ | 34040/37963 [84:09:52<9:57:57,  9.15s/it] 
                                                          
{'loss': '0.07894', 'grad_norm': '4.234', 'learning_rate': '5.551e-07', 'epoch': '0.8967'}
+
 90%|████████▉ | 34040/37963 [84:09:52<9:57:57,  9.15s/it]
 90%|████████▉ | 34041/37963 [84:10:00<9:29:23,  8.71s/it]
 90%|████████▉ | 34042/37963 [84:10:08<9:10:48,  8.43s/it]
 90%|████████▉ | 34043/37963 [84:10:16<8:58:17,  8.24s/it]
 90%|████████▉ | 34044/37963 [84:10:23<8:47:18,  8.07s/it]
 90%|████████▉ | 34045/37963 [84:10:31<8:39:24,  7.95s/it]
 90%|████████▉ | 34046/37963 [84:10:39<8:33:06,  7.86s/it]
 90%|████████▉ | 34047/37963 [84:10:46<8:30:59,  7.83s/it]
 90%|████████▉ | 34048/37963 [84:10:54<8:27:09,  7.77s/it]
 90%|████████▉ | 34049/37963 [84:11:02<8:24:18,  7.73s/it]
 90%|████████▉ | 34050/37963 [84:11:09<8:22:48,  7.71s/it]
                                                          
{'loss': '0.09295', 'grad_norm': '3.622', 'learning_rate': '5.523e-07', 'epoch': '0.8969'}
+
 90%|████████▉ | 34050/37963 [84:11:09<8:22:48,  7.71s/it]
 90%|████████▉ | 34051/37963 [84:11:17<8:24:11,  7.73s/it]
 90%|████████▉ | 34052/37963 [84:11:25<8:22:28,  7.71s/it]
 90%|████████▉ | 34053/37963 [84:11:32<8:21:00,  7.69s/it]
 90%|████████▉ | 34054/37963 [84:11:40<8:24:06,  7.74s/it]
 90%|████████▉ | 34055/37963 [84:11:48<8:22:26,  7.71s/it]
 90%|████████▉ | 34056/37963 [84:11:56<8:21:44,  7.71s/it]
 90%|████████▉ | 34057/37963 [84:12:03<8:21:02,  7.70s/it]
 90%|████████▉ | 34058/37963 [84:12:11<8:16:55,  7.64s/it]
 90%|████████▉ | 34059/37963 [84:12:19<8:19:50,  7.68s/it]
 90%|████████▉ | 34060/37963 [84:12:26<8:17:40,  7.65s/it]
                                                          
{'loss': '0.07746', 'grad_norm': '2.471', 'learning_rate': '5.496e-07', 'epoch': '0.8972'}
+
 90%|████████▉ | 34060/37963 [84:12:26<8:17:40,  7.65s/it]
 90%|████████▉ | 34061/37963 [84:12:34<8:15:47,  7.62s/it]
 90%|████████▉ | 34062/37963 [84:12:41<8:16:47,  7.64s/it]
 90%|████████▉ | 34063/37963 [84:12:49<8:12:17,  7.57s/it]
 90%|████████▉ | 34064/37963 [84:12:57<8:14:31,  7.61s/it]
 90%|████████▉ | 34065/37963 [84:13:04<8:16:02,  7.64s/it]
 90%|████████▉ | 34066/37963 [84:13:12<8:16:46,  7.65s/it]
 90%|████████▉ | 34067/37963 [84:13:26<10:24:26,  9.62s/it]
 90%|████████▉ | 34068/37963 [84:13:41<12:09:23, 11.24s/it]
 90%|████████▉ | 34069/37963 [84:13:49<11:00:48, 10.18s/it]
 90%|████████▉ | 34070/37963 [84:13:57<10:14:07,  9.47s/it]
                                                           
{'loss': '0.07891', 'grad_norm': '3.394', 'learning_rate': '5.468e-07', 'epoch': '0.8975'}
+
 90%|████████▉ | 34070/37963 [84:13:57<10:14:07,  9.47s/it]
 90%|████████▉ | 34071/37963 [84:14:04<9:33:29,  8.84s/it] 
 90%|████████▉ | 34072/37963 [84:14:12<9:07:08,  8.44s/it]
 90%|████████▉ | 34073/37963 [84:14:19<8:55:44,  8.26s/it]
 90%|████████▉ | 34074/37963 [84:14:35<11:09:05, 10.32s/it]
 90%|████████▉ | 34075/37963 [84:14:49<12:34:28, 11.64s/it]
 90%|████████▉ | 34076/37963 [84:15:04<13:26:39, 12.45s/it]
 90%|████████▉ | 34077/37963 [84:15:11<11:50:48, 10.97s/it]
 90%|████████▉ | 34078/37963 [84:15:19<10:47:51, 10.01s/it]
 90%|████████▉ | 34079/37963 [84:15:33<12:12:33, 11.32s/it]
 90%|████████▉ | 34080/37963 [84:15:41<10:58:58, 10.18s/it]
                                                           
{'loss': '0.09476', 'grad_norm': '3.165', 'learning_rate': '5.44e-07', 'epoch': '0.8977'}
+
 90%|████████▉ | 34080/37963 [84:15:41<10:58:58, 10.18s/it]
 90%|████████▉ | 34081/37963 [84:15:55<12:22:15, 11.47s/it]
 90%|████████▉ | 34082/37963 [84:16:09<13:14:02, 12.28s/it]
 90%|████████▉ | 34083/37963 [84:16:17<11:47:52, 10.95s/it]
 90%|████████▉ | 34084/37963 [84:16:25<10:45:51,  9.99s/it]
 90%|████████▉ | 34085/37963 [84:16:33<10:01:46,  9.31s/it]
 90%|████████▉ | 34086/37963 [84:16:40<9:26:05,  8.76s/it] 
 90%|████████▉ | 34087/37963 [84:16:48<9:03:24,  8.41s/it]
 90%|████████▉ | 34088/37963 [84:16:56<8:49:23,  8.20s/it]
 90%|████████▉ | 34089/37963 [84:17:03<8:33:38,  7.96s/it]
 90%|████████▉ | 34090/37963 [84:17:11<8:28:23,  7.88s/it]
                                                          
{'loss': '0.0771', 'grad_norm': '3.573', 'learning_rate': '5.412e-07', 'epoch': '0.898'}
+
 90%|████████▉ | 34090/37963 [84:17:11<8:28:23,  7.88s/it]
 90%|████████▉ | 34091/37963 [84:17:18<8:26:33,  7.85s/it]
 90%|████████▉ | 34092/37963 [84:17:26<8:23:58,  7.81s/it]
 90%|████████▉ | 34093/37963 [84:17:34<8:21:19,  7.77s/it]
 90%|████████▉ | 34094/37963 [84:17:42<8:20:49,  7.77s/it]
 90%|████████▉ | 34095/37963 [84:17:49<8:20:47,  7.77s/it]
 90%|████████▉ | 34096/37963 [84:17:57<8:17:56,  7.73s/it]
 90%|████████▉ | 34097/37963 [84:18:05<8:14:28,  7.67s/it]
 90%|████████▉ | 34098/37963 [84:18:12<8:12:56,  7.65s/it]
 90%|████████▉ | 34099/37963 [84:18:20<8:14:26,  7.68s/it]
 90%|████████▉ | 34100/37963 [84:18:27<8:12:25,  7.65s/it]
                                                          
{'loss': '0.08872', 'grad_norm': '2.571', 'learning_rate': '5.385e-07', 'epoch': '0.8982'}
+
 90%|████████▉ | 34100/37963 [84:18:27<8:12:25,  7.65s/it]
 90%|████████▉ | 34101/37963 [84:18:35<8:13:59,  7.67s/it]
 90%|████████▉ | 34102/37963 [84:18:43<8:15:23,  7.70s/it]
 90%|████████▉ | 34103/37963 [84:18:51<8:15:26,  7.70s/it]
 90%|████████▉ | 34104/37963 [84:18:58<8:15:55,  7.71s/it]
 90%|████████▉ | 34105/37963 [84:19:06<8:13:45,  7.68s/it]
 90%|████████▉ | 34106/37963 [84:19:14<8:16:47,  7.73s/it]
 90%|████████▉ | 34107/37963 [84:19:21<8:14:34,  7.70s/it]
 90%|████████▉ | 34108/37963 [84:19:29<8:15:27,  7.71s/it]
 90%|████████▉ | 34109/37963 [84:19:37<8:15:31,  7.71s/it]
 90%|████████▉ | 34110/37963 [84:19:45<8:15:47,  7.72s/it]
                                                          
{'loss': '0.09153', 'grad_norm': '2.862', 'learning_rate': '5.357e-07', 'epoch': '0.8985'}
+
 90%|████████▉ | 34110/37963 [84:19:45<8:15:47,  7.72s/it]
 90%|████████▉ | 34111/37963 [84:19:52<8:14:15,  7.70s/it]
 90%|████████▉ | 34112/37963 [84:20:00<8:08:33,  7.61s/it]
 90%|████████▉ | 34113/37963 [84:20:07<8:09:26,  7.63s/it]
 90%|████████▉ | 34114/37963 [84:20:15<8:10:42,  7.65s/it]
 90%|████████▉ | 34115/37963 [84:20:23<8:11:55,  7.67s/it]
 90%|████████▉ | 34116/37963 [84:20:30<8:12:31,  7.68s/it]
 90%|████████▉ | 34117/37963 [84:20:38<8:06:47,  7.59s/it]
 90%|████████▉ | 34118/37963 [84:20:46<8:09:10,  7.63s/it]
 90%|████████▉ | 34119/37963 [84:21:00<10:23:29,  9.73s/it]
 90%|████��███▉ | 34120/37963 [84:21:08<9:43:56,  9.12s/it] 
                                                          
{'loss': '0.08451', 'grad_norm': '4.356', 'learning_rate': '5.329e-07', 'epoch': '0.8988'}
+
 90%|████████▉ | 34120/37963 [84:21:08<9:43:56,  9.12s/it]
 90%|████████▉ | 34121/37963 [84:21:30<13:49:25, 12.95s/it]
 90%|████████▉ | 34122/37963 [84:21:38<12:09:29, 11.40s/it]
 90%|████████▉ | 34123/37963 [84:21:59<15:13:16, 14.27s/it]
 90%|████████▉ | 34124/37963 [84:22:06<13:01:06, 12.21s/it]
 90%|████████▉ | 34125/37963 [84:22:13<11:28:21, 10.76s/it]
 90%|████████▉ | 34126/37963 [84:22:21<10:30:48,  9.86s/it]
 90%|████████▉ | 34127/37963 [84:22:29<9:49:47,  9.23s/it] 
 90%|████████▉ | 34128/37963 [84:22:44<11:47:37, 11.07s/it]
 90%|████████▉ | 34129/37963 [84:22:52<10:44:51, 10.09s/it]
 90%|████████▉ | 34130/37963 [84:23:00<10:02:57,  9.44s/it]
                                                           
{'loss': '0.07692', 'grad_norm': '3.574', 'learning_rate': '5.302e-07', 'epoch': '0.899'}
+
 90%|████████▉ | 34130/37963 [84:23:00<10:02:57,  9.44s/it]
 90%|████████▉ | 34131/37963 [84:23:14<11:30:44, 10.82s/it]
 90%|████████▉ | 34132/37963 [84:23:22<10:30:47,  9.88s/it]
 90%|████████▉ | 34133/37963 [84:23:29<9:48:39,  9.22s/it] 
 90%|████████▉ | 34134/37963 [84:23:37<9:19:56,  8.77s/it]
 90%|████████▉ | 34135/37963 [84:23:52<11:11:29, 10.52s/it]
 90%|████████▉ | 34136/37963 [84:23:59<10:17:38,  9.68s/it]
 90%|████████▉ | 34137/37963 [84:24:07<9:37:51,  9.06s/it] 
 90%|████████▉ | 34138/37963 [84:24:14<9:04:30,  8.54s/it]
 90%|████████▉ | 34139/37963 [84:24:22<8:48:04,  8.29s/it]
 90%|████████▉ | 34140/37963 [84:24:30<8:36:01,  8.10s/it]
                                                          
{'loss': '0.0886', 'grad_norm': '3.605', 'learning_rate': '5.275e-07', 'epoch': '0.8993'}
+
 90%|████████▉ | 34140/37963 [84:24:30<8:36:01,  8.10s/it]
 90%|████████▉ | 34141/37963 [84:24:37<8:29:57,  8.01s/it]
 90%|████████▉ | 34142/37963 [84:24:45<8:24:36,  7.92s/it]
 90%|████████▉ | 34143/37963 [84:24:53<8:16:56,  7.81s/it]
 90%|████████▉ | 34144/37963 [84:25:01<8:19:29,  7.85s/it]
 90%|████████▉ | 34145/37963 [84:25:08<8:16:13,  7.80s/it]
 90%|████████▉ | 34146/37963 [84:25:16<8:13:07,  7.75s/it]
 90%|████████▉ | 34147/37963 [84:25:24<8:13:23,  7.76s/it]
 90%|████████▉ | 34148/37963 [84:25:32<8:12:46,  7.75s/it]
 90%|████████▉ | 34149/37963 [84:25:39<8:11:36,  7.73s/it]
 90%|████████▉ | 34150/37963 [84:25:47<8:11:37,  7.74s/it]
                                                          
{'loss': '0.08143', 'grad_norm': '3.272', 'learning_rate': '5.247e-07', 'epoch': '0.8996'}
+
 90%|████████▉ | 34150/37963 [84:25:47<8:11:37,  7.74s/it]
 90%|████████▉ | 34151/37963 [84:25:55<8:11:50,  7.74s/it]
 90%|████████▉ | 34152/37963 [84:26:02<8:10:20,  7.72s/it]
 90%|████████▉ | 34153/37963 [84:26:10<8:11:07,  7.73s/it]
 90%|████████▉ | 34154/37963 [84:26:18<8:10:15,  7.72s/it]
 90%|████████▉ | 34155/37963 [84:26:26<8:09:50,  7.72s/it]
 90%|████████▉ | 34156/37963 [84:26:33<8:03:26,  7.62s/it]
 90%|████████▉ | 34157/37963 [84:26:41<8:04:32,  7.64s/it]
 90%|████████▉ | 34158/37963 [84:26:48<8:07:58,  7.69s/it]
 90%|████████▉ | 34159/37963 [84:26:56<8:06:27,  7.67s/it]
 90%|████████▉ | 34160/37963 [84:27:04<8:05:50,  7.67s/it]
                                                          
{'loss': '0.08495', 'grad_norm': '3.336', 'learning_rate': '5.22e-07', 'epoch': '0.8998'}
+
 90%|████████▉ | 34160/37963 [84:27:04<8:05:50,  7.67s/it]
 90%|████████▉ | 34161/37963 [84:27:11<8:03:52,  7.64s/it]
 90%|████████▉ | 34162/37963 [84:27:19<8:07:38,  7.70s/it]
 90%|████████▉ | 34163/37963 [84:27:27<8:03:33,  7.64s/it]
 90%|████████▉ | 34164/37963 [84:27:34<8:04:52,  7.66s/it]
 90%|████████▉ | 34165/37963 [84:27:42<8:04:57,  7.66s/it]
 90%|████████▉ | 34166/37963 [84:27:56<10:07:54,  9.61s/it]
 90%|█████████ | 34167/37963 [84:28:11<11:38:28, 11.04s/it]
 90%|█████████ | 34168/37963 [84:28:18<10:36:44, 10.07s/it]
 90%|█████████ | 34169/37963 [84:28:26<9:47:14,  9.29s/it] 
 90%|█████████ | 34170/37963 [84:28:47<13:36:48, 12.92s/it]
                                                           
{'loss': '0.08319', 'grad_norm': '3.273', 'learning_rate': '5.193e-07', 'epoch': '0.9001'}
+
 90%|█████████ | 34170/37963 [84:28:47<13:36:48, 12.92s/it]
 90%|█████████ | 34171/37963 [84:29:01<13:59:56, 13.29s/it]
 90%|█████████ | 34172/37963 [84:29:09<12:13:51, 11.61s/it]
 90%|█████████ | 34173/37963 [84:29:17<10:58:50, 10.43s/it]
 90%|█████████ | 34174/37963 [84:29:31<12:08:49, 11.54s/it]
 90%|█████████ | 34175/37963 [84:29:39<10:58:23, 10.43s/it]
 90%|█████████ | 34176/37963 [84:29:46<10:06:43,  9.61s/it]
 90%|█████████ | 34177/37963 [84:29:54<9:29:18,  9.02s/it] 
 90%|█████████ | 34178/37963 [84:30:02<9:04:14,  8.63s/it]
 90%|█████████ | 34179/37963 [84:30:09<8:45:05,  8.33s/it]
 90%|█████████ | 34180/37963 [84:30:17<8:33:00,  8.14s/it]
                                                          
{'loss': '0.0859', 'grad_norm': '3.054', 'learning_rate': '5.166e-07', 'epoch': '0.9004'}
+
 90%|█████████ | 34180/37963 [84:30:17<8:33:00,  8.14s/it]
 90%|█████████ | 34181/37963 [84:30:25<8:24:18,  8.00s/it]
 90%|█████████ | 34182/37963 [84:30:40<10:33:27, 10.05s/it]
 90%|█████████ | 34183/37963 [84:30:47<9:45:30,  9.29s/it] 
 90%|█████████ | 34184/37963 [84:30:55<9:14:50,  8.81s/it]
 90%|█████████ | 34185/37963 [84:31:02<8:53:27,  8.47s/it]
 90%|█████████ | 34186/37963 [84:31:10<8:40:37,  8.27s/it]
 90%|█████████ | 34187/37963 [84:31:18<8:29:26,  8.09s/it]
 90%|█████████ | 34188/37963 [84:31:26<8:22:17,  7.98s/it]
 90%|█████████ | 34189/37963 [84:31:40<10:18:35,  9.83s/it]
 90%|█████████ | 34190/37963 [84:31:48<9:42:03,  9.26s/it] 
                                                          
{'loss': '0.07474', 'grad_norm': '2.726', 'learning_rate': '5.139e-07', 'epoch': '0.9006'}
+
 90%|█████████ | 34190/37963 [84:31:48<9:42:03,  9.26s/it]
 90%|█████████ | 34191/37963 [84:31:55<9:06:14,  8.69s/it]
 90%|█████████ | 34192/37963 [84:32:02<8:41:05,  8.29s/it]
 90%|█████████ | 34193/37963 [84:32:10<8:28:14,  8.09s/it]
 90%|█████████ | 34194/37963 [84:32:18<8:24:33,  8.03s/it]
 90%|█████████ | 34195/37963 [84:32:26<8:17:49,  7.93s/it]
 90%|█████████ | 34196/37963 [84:32:33<8:14:37,  7.88s/it]
 90%|█████████ | 34197/37963 [84:32:41<8:09:07,  7.79s/it]
 90%|█████████ | 34198/37963 [84:32:49<8:07:23,  7.77s/it]
 90%|█████████ | 34199/37963 [84:32:56<8:05:24,  7.74s/it]
 90%|█████████ | 34200/37963 [84:33:04<8:03:35,  7.71s/it]
                                                          
{'loss': '0.08323', 'grad_norm': '3.451', 'learning_rate': '5.112e-07', 'epoch': '0.9009'}
+
 90%|█████████ | 34200/37963 [84:33:04<8:03:35,  7.71s/it]
 90%|█████████ | 34201/37963 [84:33:12<7:59:55,  7.65s/it]
 90%|█████████ | 34202/37963 [84:33:19<8:00:36,  7.67s/it]
 90%|█████████ | 34203/37963 [84:33:27<8:01:20,  7.68s/it]
 90%|█████████ | 34204/37963 [84:33:35<8:00:10,  7.66s/it]
 90%|█████████ | 34205/37963 [84:33:42<8:02:05,  7.70s/it]
 90%|█████████ | 34206/37963 [84:33:50<7:57:59,  7.63s/it]
 90%|█████████ | 34207/37963 [84:33:58<7:59:51,  7.67s/it]
 90%|█████████ | 34208/37963 [84:34:05<7:59:07,  7.66s/it]
 90%|█████████ | 34209/37963 [84:34:20<10:06:38,  9.70s/it]
 90%|█████████ | 34210/37963 [84:34:28<9:31:32,  9.14s/it] 
                                                          
{'loss': '0.06671', 'grad_norm': '3.169', 'learning_rate': '5.085e-07', 'epoch': '0.9011'}
+
 90%|█████████ | 34210/37963 [84:34:28<9:31:32,  9.14s/it]
 90%|█████████ | 34211/37963 [84:34:35<9:03:26,  8.69s/it]
 90%|█████████ | 34212/37963 [84:34:43<8:45:51,  8.41s/it]
 90%|█████████ | 34213/37963 [84:34:51<8:33:33,  8.22s/it]
 90%|█████████ | 34214/37963 [84:34:58<8:18:59,  7.99s/it]
 90%|█████████ | 34215/37963 [84:35:06<8:08:13,  7.82s/it]
 90%|█████████ | 34216/37963 [84:35:20<10:11:27,  9.79s/it]
 90%|█████████ | 34217/37963 [84:35:28<9:33:06,  9.18s/it] 
 90%|█████████ | 34218/37963 [84:35:43<11:18:01, 10.86s/it]
 90%|█████████ | 34219/37963 [84:35:58<12:41:51, 12.21s/it]
 90%|█████████ | 34220/37963 [84:36:06<11:16:42, 10.85s/it]
                                                           
{'loss': '0.08162', 'grad_norm': '3.08', 'learning_rate': '5.058e-07', 'epoch': '0.9014'}
+
 90%|█████████ | 34220/37963 [84:36:06<11:16:42, 10.85s/it]
 90%|█████████ | 34221/37963 [84:36:13<10:16:34,  9.89s/it]
 90%|█████████ | 34222/37963 [84:36:21<9:36:41,  9.25s/it] 
 90%|█████████ | 34223/37963 [84:36:29<9:07:26,  8.78s/it]
 90%|█████████ | 34224/37963 [84:36:43<10:46:58, 10.38s/it]
 90%|█████████ | 34225/37963 [84:36:51<9:59:00,  9.61s/it] 
 90%|█████████ | 34226/37963 [84:37:06<11:39:04, 11.22s/it]
 90%|█████████ | 34227/37963 [84:37:13<10:34:36, 10.19s/it]
 90%|█████████ | 34228/37963 [84:37:28<11:51:43, 11.43s/it]
 90%|█████████ | 34229/37963 [84:37:35<10:42:24, 10.32s/it]
 90%|█████████ | 34230/37963 [84:37:43<9:51:56,  9.51s/it] 
                                                          
{'loss': '0.08676', 'grad_norm': '2.728', 'learning_rate': '5.031e-07', 'epoch': '0.9017'}
+
 90%|█████████ | 34230/37963 [84:37:43<9:51:56,  9.51s/it]
 90%|█████████ | 34231/37963 [84:37:51<9:19:53,  9.00s/it]
 90%|█████████ | 34232/37963 [84:37:59<8:55:33,  8.61s/it]
 90%|█████████ | 34233/37963 [84:38:12<10:34:30, 10.21s/it]
 90%|█████████ | 34234/37963 [84:38:20<9:47:43,  9.46s/it] 
 90%|█████████ | 34235/37963 [84:38:28<9:16:54,  8.96s/it]
 90%|█████████ | 34236/37963 [84:38:36<8:53:58,  8.60s/it]
 90%|█████████ | 34237/37963 [84:38:43<8:37:11,  8.33s/it]
 90%|█████████ | 34238/37963 [84:38:51<8:19:11,  8.04s/it]
 90%|█████████ | 34239/37963 [84:38:58<8:05:56,  7.83s/it]
 90%|█████████ | 34240/37963 [84:39:06<8:02:52,  7.78s/it]
                                                          
{'loss': '0.09388', 'grad_norm': '4.355', 'learning_rate': '5.005e-07', 'epoch': '0.9019'}
+
 90%|█████████ | 34240/37963 [84:39:06<8:02:52,  7.78s/it]
 90%|█████████ | 34241/37963 [84:39:14<8:02:15,  7.77s/it]
 90%|█████████ | 34242/37963 [84:39:21<8:01:02,  7.76s/it]
 90%|█████████ | 34243/37963 [84:39:29<8:00:38,  7.75s/it]
 90%|█████████ | 34244/37963 [84:39:37<7:58:34,  7.72s/it]
 90%|█████████ | 34245/37963 [84:39:44<7:56:44,  7.69s/it]
 90%|█████████ | 34246/37963 [84:39:52<8:01:10,  7.77s/it]
 90%|█████████ | 34247/37963 [84:40:00<7:59:21,  7.74s/it]
 90%|█████████ | 34248/37963 [84:40:08<7:57:53,  7.72s/it]
 90%|█████████ | 34249/37963 [84:40:15<7:57:05,  7.71s/it]
 90%|█████████ | 34250/37963 [84:40:23<7:56:14,  7.70s/it]
                                                          
{'loss': '0.0858', 'grad_norm': '3.553', 'learning_rate': '4.978e-07', 'epoch': '0.9022'}
+
 90%|█████████ | 34250/37963 [84:40:23<7:56:14,  7.70s/it]
 90%|█████████ | 34251/37963 [84:40:31<7:55:52,  7.69s/it]
 90%|█████████ | 34252/37963 [84:40:38<7:56:31,  7.70s/it]
 90%|█████████ | 34253/37963 [84:40:46<7:54:15,  7.67s/it]
 90%|█████████ | 34254/37963 [84:40:54<7:54:50,  7.68s/it]
 90%|█████████ | 34255/37963 [84:41:01<7:53:49,  7.67s/it]
 90%|█████████ | 34256/37963 [84:41:09<7:49:02,  7.59s/it]
 90%|█████████ | 34257/37963 [84:41:16<7:48:35,  7.59s/it]
 90%|█████████ | 34258/37963 [84:41:24<7:50:13,  7.62s/it]
 90%|█████████ | 34259/37963 [84:41:32<7:52:16,  7.65s/it]
 90%|█████████ | 34260/37963 [84:41:39<7:53:22,  7.67s/it]
                                                          
{'loss': '0.08337', 'grad_norm': '3.629', 'learning_rate': '4.951e-07', 'epoch': '0.9025'}
+
 90%|█████████ | 34260/37963 [84:41:39<7:53:22,  7.67s/it]
 90%|█████████ | 34261/37963 [84:41:47<7:52:34,  7.66s/it]
 90%|█████████ | 34262/37963 [84:42:02<10:03:13,  9.78s/it]
 90%|█████████ | 34263/37963 [84:42:16<11:29:28, 11.18s/it]
 90%|█████████ | 34264/37963 [84:42:30<12:25:20, 12.09s/it]
 90%|█████████ | 34265/37963 [84:42:38<11:02:37, 10.75s/it]
 90%|█████████ | 34266/37963 [84:42:46<10:09:09,  9.89s/it]
 90%|█████████ | 34267/37963 [84:42:54<9:26:53,  9.20s/it] 
 90%|█████████ | 34268/37963 [84:43:08<10:58:14, 10.69s/it]
 90%|█████████ | 34269/37963 [84:43:15<10:03:41,  9.81s/it]
 90%|█████████ | 34270/37963 [84:43:23<9:25:29,  9.19s/it] 
                                                          
{'loss': '0.07401', 'grad_norm': '2.876', 'learning_rate': '4.925e-07', 'epoch': '0.9027'}
+
 90%|█████████ | 34270/37963 [84:43:23<9:25:29,  9.19s/it]
 90%|███████��█ | 34271/37963 [84:43:31<8:59:22,  8.77s/it]
 90%|█████████ | 34272/37963 [84:43:39<8:38:23,  8.43s/it]
 90%|█████████ | 34273/37963 [84:43:54<10:38:30, 10.38s/it]
 90%|█████████ | 34274/37963 [84:44:01<9:49:22,  9.59s/it] 
 90%|█████████ | 34275/37963 [84:44:09<9:11:23,  8.97s/it]
 90%|█████████ | 34276/37963 [84:44:16<8:46:07,  8.56s/it]
 90%|█████████ | 34277/37963 [84:44:24<8:26:20,  8.24s/it]
 90%|█████████ | 34278/37963 [84:44:32<8:16:11,  8.08s/it]
 90%|█████████ | 34279/37963 [84:44:45<10:03:12,  9.82s/it]
 90%|█████████ | 34280/37963 [84:45:07<13:40:08, 13.36s/it]
                                                           
{'loss': '0.07899', 'grad_norm': '4.328', 'learning_rate': '4.899e-07', 'epoch': '0.903'}
+
 90%|█████████ | 34280/37963 [84:45:07<13:40:08, 13.36s/it]
 90%|█████████ | 34281/37963 [84:45:15<11:59:13, 11.72s/it]
 90%|█████████ | 34282/37963 [84:45:22<10:40:31, 10.44s/it]
 90%|█████████ | 34283/37963 [84:45:30<9:46:07,  9.56s/it] 
 90%|█████████ | 34284/37963 [84:45:38<9:09:43,  8.97s/it]
 90%|█████████ | 34285/37963 [84:45:45<8:46:26,  8.59s/it]
 90%|█████████ | 34286/37963 [84:45:53<8:29:41,  8.32s/it]
 90%|█████████ | 34287/37963 [84:46:00<8:13:38,  8.06s/it]
 90%|█████████ | 34288/37963 [84:46:08<8:06:55,  7.95s/it]
 90%|█████████ | 34289/37963 [84:46:16<8:00:28,  7.85s/it]
 90%|█████████ | 34290/37963 [84:46:23<7:58:49,  7.82s/it]
                                                          
{'loss': '0.07622', 'grad_norm': '5.126', 'learning_rate': '4.872e-07', 'epoch': '0.9033'}
+
 90%|█████████ | 34290/37963 [84:46:23<7:58:49,  7.82s/it]
 90%|█████████ | 34291/37963 [84:46:31<7:57:07,  7.80s/it]
 90%|█████████ | 34292/37963 [84:46:38<7:47:50,  7.65s/it]
 90%|█████████ | 34293/37963 [84:46:46<7:41:38,  7.55s/it]
 90%|█████████ | 34294/37963 [84:46:53<7:43:32,  7.58s/it]
 90%|█████████ | 34295/37963 [84:47:01<7:49:04,  7.67s/it]
 90%|█████████ | 34296/37963 [84:47:09<7:48:45,  7.67s/it]
 90%|█████████ | 34297/37963 [84:47:17<7:48:27,  7.67s/it]
 90%|█████████ | 34298/37963 [84:47:24<7:46:35,  7.64s/it]
 90%|█████████ | 34299/37963 [84:47:32<7:47:14,  7.65s/it]
 90%|█████████ | 34300/37963 [84:47:40<7:51:41,  7.73s/it]
                                                          
{'loss': '0.08053', 'grad_norm': '2.865', 'learning_rate': '4.846e-07', 'epoch': '0.9035'}
+
 90%|█████████ | 34300/37963 [84:47:40<7:51:41,  7.73s/it]
 90%|█████████ | 34301/37963 [84:47:48<7:51:33,  7.73s/it]
 90%|█████████ | 34302/37963 [84:47:55<7:54:39,  7.78s/it]
 90%|█████████ | 34303/37963 [84:48:03<7:52:14,  7.74s/it]
 90%|█████████ | 34304/37963 [84:48:11<7:51:32,  7.73s/it]
 90%|█████████ | 34305/37963 [84:48:19<7:51:36,  7.74s/it]
 90%|█████████ | 34306/37963 [84:48:26<7:50:47,  7.72s/it]
 90%|█████████ | 34307/37963 [84:48:34<7:50:02,  7.71s/it]
 90%|█████████ | 34308/37963 [84:48:42<7:49:33,  7.71s/it]
 90%|█████████ | 34309/37963 [84:48:49<7:47:52,  7.68s/it]
 90%|█████████ | 34310/37963 [84:48:57<7:48:03,  7.69s/it]
                                                          
{'loss': '0.09256', 'grad_norm': '3.178', 'learning_rate': '4.82e-07', 'epoch': '0.9038'}
+
 90%|█████████ | 34310/37963 [84:48:57<7:48:03,  7.69s/it]
 90%|█████████ | 34311/37963 [84:49:05<7:48:34,  7.70s/it]
 90%|█████████ | 34312/37963 [84:49:19<9:51:00,  9.71s/it]
 90%|█████████ | 34313/37963 [84:49:27<9:16:18,  9.14s/it]
 90%|█████████ | 34314/37963 [84:49:41<10:49:33, 10.68s/it]
 90%|█████████ | 34315/37963 [84:49:49<10:02:05,  9.90s/it]
 90%|█████████ | 34316/37963 [84:50:03<11:19:21, 11.18s/it]
 90%|█████████ | 34317/37963 [84:50:11<10:20:38, 10.21s/it]
 90%|█████████ | 34318/37963 [84:50:26<11:36:55, 11.47s/it]
 90%|█████████ | 34319/37963 [84:50:33<10:28:00, 10.34s/it]
 90%|█████████ | 34320/37963 [84:50:41<9:41:03,  9.57s/it] 
                                                          
{'loss': '0.09213', 'grad_norm': '3.443', 'learning_rate': '4.794e-07', 'epoch': '0.904'}
+
 90%|█████████ | 34320/37963 [84:50:41<9:41:03,  9.57s/it]
 90%|█████████ | 34321/37963 [84:50:49<9:06:08,  9.00s/it]
 90%|█████████ | 34322/37963 [84:51:03<10:42:01, 10.58s/it]
 90%|█████████ | 34323/37963 [84:51:11<9:50:28,  9.73s/it] 
 90%|█████████ | 34324/37963 [84:51:25<11:07:53, 11.01s/it]
 90%|█████████ | 34325/37963 [84:51:33<10:06:45, 10.01s/it]
 90%|█████████ | 34326/37963 [84:51:40<9:23:47,  9.30s/it] 
 90%|█████████ | 34327/37963 [84:51:54<10:53:14, 10.78s/it]
 90%|█████████ | 34328/37963 [84:52:02<9:57:27,  9.86s/it] 
 90%|█████████ | 34329/37963 [84:52:10<9:16:36,  9.19s/it]
 90%|█████████ | 34330/37963 [84:52:18<8:49:13,  8.74s/it]
                                                          
{'loss': '0.08183', 'grad_norm': '4.8', 'learning_rate': '4.768e-07', 'epoch': '0.9043'}
+
 90%|█████████ | 34330/37963 [84:52:18<8:49:13,  8.74s/it]
 90%|█████████ | 34331/37963 [84:52:32<10:41:48, 10.60s/it]
 90%|█████████ | 34332/37963 [84:52:40<9:49:04,  9.73s/it] 
 90%|█████████ | 34333/37963 [84:52:48<9:11:32,  9.12s/it]
 90%|█████████ | 34334/37963 [84:52:55<8:42:34,  8.64s/it]
 90%|█████████ | 34335/37963 [84:53:03<8:24:28,  8.34s/it]
 90%|█████████ | 34336/37963 [84:53:11<8:12:08,  8.14s/it]
 90%|█████████ | 34337/37963 [84:53:18<7:58:46,  7.92s/it]
 90%|█████████ | 34338/37963 [84:53:26<7:54:22,  7.85s/it]
 90%|█████████ | 34339/37963 [84:53:34<7:53:26,  7.84s/it]
 90%|█████████ | 34340/37963 [84:53:41<7:50:38,  7.79s/it]
                                                          
{'loss': '0.07596', 'grad_norm': '4.786', 'learning_rate': '4.742e-07', 'epoch': '0.9046'}
+
 90%|█████████ | 34340/37963 [84:53:41<7:50:38,  7.79s/it]
 90%|█████████ | 34341/37963 [84:53:49<7:51:22,  7.81s/it]
 90%|█████████ | 34342/37963 [84:53:57<7:48:20,  7.76s/it]
 90%|█████████ | 34343/37963 [84:54:04<7:45:40,  7.72s/it]
 90%|█████████ | 34344/37963 [84:54:12<7:44:11,  7.70s/it]
 90%|█████████ | 34345/37963 [84:54:20<7:46:18,  7.73s/it]
 90%|█████████ | 34346/37963 [84:54:28<7:45:55,  7.73s/it]
 90%|█████████ | 34347/37963 [84:54:35<7:44:44,  7.71s/it]
 90%|█████████ | 34348/37963 [84:54:43<7:40:54,  7.65s/it]
 90%|█████████ | 34349/37963 [84:54:51<7:42:59,  7.69s/it]
 90%|█████████ | 34350/37963 [84:54:58<7:43:27,  7.70s/it]
                                                          
{'loss': '0.0796', 'grad_norm': '3.432', 'learning_rate': '4.716e-07', 'epoch': '0.9048'}
+
 90%|█████████ | 34350/37963 [84:54:58<7:43:27,  7.70s/it]
 90%|█████████ | 34351/37963 [84:55:06<7:44:55,  7.72s/it]
 90%|█████████ | 34352/37963 [84:55:14<7:42:40,  7.69s/it]
 90%|█████████ | 34353/37963 [84:55:21<7:42:56,  7.69s/it]
 90%|█████████ | 34354/37963 [84:55:29<7:42:41,  7.69s/it]
 90%|█████████ | 34355/37963 [84:55:37<7:43:10,  7.70s/it]
 90%|█████████ | 34356/37963 [84:55:51<9:44:09,  9.72s/it]
 91%|█████████ | 34357/37963 [84:55:59<9:08:55,  9.13s/it]
 91%|█████████ | 34358/37963 [84:56:07<8:44:00,  8.72s/it]
 91%|█████████ | 34359/37963 [84:56:14<8:23:42,  8.39s/it]
 91%|█████████ | 34360/37963 [84:56:28<10:02:41, 10.04s/it]
                                                           
{'loss': '0.0764', 'grad_norm': '3.113', 'learning_rate': '4.69e-07', 'epoch': '0.9051'}
+
 91%|█████████ | 34360/37963 [84:56:28<10:02:41, 10.04s/it]
 91%|█████████ | 34361/37963 [84:56:43<11:28:50, 11.47s/it]
 91%|█████████ | 34362/37963 [84:56:58<12:28:16, 12.47s/it]
 91%|█████████ | 34363/37963 [84:57:05<11:01:13, 11.02s/it]
 91%|█████████ | 34364/37963 [84:57:13<9:57:07,  9.95s/it] 
 91%|█████████ | 34365/37963 [84:57:27<11:16:10, 11.28s/it]
 91%|█████████ | 34366/37963 [84:57:35<10:11:09, 10.19s/it]
 91%|█████████ | 34367/37963 [84:57:43<9:25:55,  9.44s/it] 
 91%|█████████ | 34368/37963 [84:57:50<8:50:39,  8.86s/it]
 91%|█████████ | 34369/37963 [84:57:58<8:30:58,  8.53s/it]
 91%|█████████ | 34370/37963 [84:58:05<8:10:02,  8.18s/it]
                                                          
{'loss': '0.08166', 'grad_norm': '3.808', 'learning_rate': '4.664e-07', 'epoch': '0.9054'}
+
 91%|█████████ | 34370/37963 [84:58:05<8:10:02,  8.18s/it]
 91%|█████████ | 34371/37963 [84:58:13<8:02:26,  8.06s/it]
 91%|█████████ | 34372/37963 [84:58:21<7:57:25,  7.98s/it]
 91%|█████████ | 34373/37963 [84:58:28<7:51:07,  7.87s/it]
 91%|█████████ | 34374/37963 [84:58:36<7:46:04,  7.79s/it]
 91%|█████████ | 34375/37963 [84:58:51<9:48:58,  9.85s/it]
 91%|█████████ | 34376/37963 [84:58:59<9:15:24,  9.29s/it]
 91%|█████████ | 34377/37963 [84:59:06<8:46:48,  8.81s/it]
 91%|█████████ | 34378/37963 [84:59:21<10:26:14, 10.48s/it]
 91%|█████████ | 34379/37963 [84:59:36<11:43:36, 11.78s/it]
 91%|█████████ | 34380/37963 [84:59:43<10:31:02, 10.57s/it]
                                                           
{'loss': '0.08833', 'grad_norm': '4.98', 'learning_rate': '4.638e-07', 'epoch': '0.9056'}
+
 91%|█████████ | 34380/37963 [84:59:43<10:31:02, 10.57s/it]
 91%|█████████ | 34381/37963 [84:59:51<9:40:40,  9.73s/it] 
 91%|█████████ | 34382/37963 [84:59:59<9:06:07,  9.15s/it]
 91%|█████████ | 34383/37963 [85:00:07<8:39:55,  8.71s/it]
 91%|█████████ | 34384/37963 [85:00:14<8:18:26,  8.36s/it]
 91%|█████████ | 34385/37963 [85:00:22<8:08:17,  8.19s/it]
 91%|█████████ | 34386/37963 [85:00:30<7:59:08,  8.04s/it]
 91%|█████████ | 34387/37963 [85:00:37<7:52:17,  7.92s/it]
 91%|█████████ | 34388/37963 [85:00:45<7:45:21,  7.81s/it]
 91%|█████████ | 34389/37963 [85:00:53<7:44:53,  7.80s/it]
 91%|█████████ | 34390/37963 [85:01:00<7:37:57,  7.69s/it]
                                                          
{'loss': '0.08099', 'grad_norm': '2.528', 'learning_rate': '4.613e-07', 'epoch': '0.9059'}
+
 91%|█████████ | 34390/37963 [85:01:00<7:37:57,  7.69s/it]
 91%|█████████ | 34391/37963 [85:01:08<7:37:19,  7.68s/it]
 91%|█████████ | 34392/37963 [85:01:15<7:36:33,  7.67s/it]
 91%|█████████ | 34393/37963 [85:01:23<7:34:39,  7.64s/it]
 91%|█████████ | 34394/37963 [85:01:30<7:33:28,  7.62s/it]
 91%|█████████ | 34395/37963 [85:01:38<7:36:51,  7.68s/it]
 91%|█████████ | 34396/37963 [85:01:46<7:37:20,  7.69s/it]
 91%|█████████ | 34397/37963 [85:01:54<7:37:52,  7.70s/it]
 91%|█████████ | 34398/37963 [85:02:02<7:39:40,  7.74s/it]
 91%|█████████ | 34399/37963 [85:02:09<7:38:35,  7.72s/it]
 91%|█████████ | 34400/37963 [85:02:17<7:32:45,  7.62s/it]
                                                          
{'loss': '0.08619', 'grad_norm': '2.658', 'learning_rate': '4.587e-07', 'epoch': '0.9061'}
+
 91%|█████████ | 34400/37963 [85:02:17<7:32:45,  7.62s/it]
 91%|█████████ | 34401/37963 [85:02:24<7:33:15,  7.64s/it]
 91%|█████████ | 34402/37963 [85:02:32<7:30:02,  7.58s/it]
 91%|█████████ | 34403/37963 [85:02:39<7:31:10,  7.60s/it]
 91%|█████████ | 34404/37963 [85:03:00<11:26:37, 11.58s/it]
 91%|█████████ | 34405/37963 [85:03:08<10:18:07, 10.42s/it]
 91%|█████████ | 34406/37963 [85:03:23<11:33:32, 11.70s/it]
 91%|█████████ | 34407/37963 [85:03:30<10:22:35, 10.50s/it]
 91%|█████████ | 34408/37963 [85:03:38<9:32:53,  9.67s/it] 
 91%|█████████ | 34409/37963 [85:03:46<8:57:36,  9.08s/it]
 91%|█████████ | 34410/37963 [85:03:54<8:34:59,  8.70s/it]
                                                          
{'loss': '0.09159', 'grad_norm': '3.293', 'learning_rate': '4.562e-07', 'epoch': '0.9064'}
+
 91%|█████████ | 34410/37963 [85:03:54<8:34:59,  8.70s/it]
 91%|█████████ | 34411/37963 [85:04:08<10:18:12, 10.44s/it]
 91%|█████████ | 34412/37963 [85:04:23<11:38:28, 11.80s/it]
 91%|█████████ | 34413/37963 [85:04:30<10:19:05, 10.46s/it]
 91%|█████████ | 34414/37963 [85:04:38<9:29:15,  9.62s/it] 
 91%|█████████ | 34415/37963 [85:04:46<8:55:49,  9.06s/it]
 91%|█████████ | 34416/37963 [85:04:54<8:30:53,  8.64s/it]
 91%|█████████ | 34417/37963 [85:05:01<8:15:29,  8.38s/it]
 91%|█████████ | 34418/37963 [85:05:15<9:53:23, 10.04s/it]
 91%|█████████ | 34419/37963 [85:05:23<9:14:01,  9.38s/it]
 91%|█████████ | 34420/37963 [85:05:31<8:42:02,  8.84s/it]
                                                          
{'loss': '0.08954', 'grad_norm': '3.529', 'learning_rate': '4.536e-07', 'epoch': '0.9067'}
+
 91%|█████████ | 34420/37963 [85:05:31<8:42:02,  8.84s/it]
 91%|█████████ | 34421/37963 [85:05:38<8:23:24,  8.53s/it]
 91%|█████████ | 34422/37963 [85:05:46<8:08:17,  8.27s/it]
 91%|█████████ | 34423/37963 [85:05:54<7:57:33,  8.09s/it]
 91%|█████████ | 34424/37963 [85:06:01<7:50:32,  7.98s/it]
 91%|█████████ | 34425/37963 [85:06:09<7:43:26,  7.86s/it]
 91%|█████████ | 34426/37963 [85:06:17<7:39:47,  7.80s/it]
 91%|█████████ | 34427/37963 [85:06:24<7:37:57,  7.77s/it]
 91%|█████████ | 34428/37963 [85:06:32<7:35:49,  7.74s/it]
 91%|█████████ | 34429/37963 [85:06:40<7:32:11,  7.68s/it]
 91%|█████████ | 34430/37963 [85:06:47<7:30:22,  7.65s/it]
                                                          
{'loss': '0.08773', 'grad_norm': '3.843', 'learning_rate': '4.511e-07', 'epoch': '0.9069'}
+
 91%|█████████ | 34430/37963 [85:06:47<7:30:22,  7.65s/it]
 91%|█████████ | 34431/37963 [85:06:55<7:27:01,  7.59s/it]
 91%|█████████ | 34432/37963 [85:07:08<9:15:05,  9.43s/it]
 91%|█████████ | 34433/37963 [85:07:24<10:56:59, 11.17s/it]
 91%|█████████ | 34434/37963 [85:07:32<9:59:47, 10.20s/it] 
 91%|█████████ | 34435/37963 [85:07:39<9:17:01,  9.47s/it]
 91%|█████████ | 34436/37963 [85:07:47<8:46:35,  8.96s/it]
 91%|█████████ | 34437/37963 [85:07:55<8:24:21,  8.58s/it]
 91%|█████████ | 34438/37963 [85:08:03<8:08:38,  8.32s/it]
 91%|█████████ | 34439/37963 [85:08:10<7:56:41,  8.12s/it]
 91%|█████████ | 34440/37963 [85:08:18<7:51:20,  8.03s/it]
                                                          
{'loss': '0.08292', 'grad_norm': '3.405', 'learning_rate': '4.485e-07', 'epoch': '0.9072'}
+
 91%|█████████ | 34440/37963 [85:08:18<7:51:20,  8.03s/it]
 91%|█████████ | 34441/37963 [85:08:26<7:44:36,  7.91s/it]
 91%|█████████ | 34442/37963 [85:08:33<7:39:35,  7.83s/it]
 91%|█████████ | 34443/37963 [85:08:41<7:36:50,  7.79s/it]
 91%|█████████ | 34444/37963 [85:08:48<7:31:29,  7.70s/it]
 91%|█████████ | 34445/37963 [85:08:56<7:30:08,  7.68s/it]
 91%|█████████ | 34446/37963 [85:09:04<7:29:48,  7.67s/it]
 91%|█████████ | 34447/37963 [85:09:12<7:32:30,  7.72s/it]
 91%|█████████ | 34448/37963 [85:09:26<9:26:26,  9.67s/it]
 91%|█████████ | 34449/37963 [85:09:33<8:51:07,  9.07s/it]
 91%|█████████ | 34450/37963 [85:09:41<8:24:29,  8.62s/it]
                                                          
{'loss': '0.0748', 'grad_norm': '3.591', 'learning_rate': '4.46e-07', 'epoch': '0.9075'}
+
 91%|█████████ | 34450/37963 [85:09:41<8:24:29,  8.62s/it]
 91%|█████████ | 34451/37963 [85:09:49<8:09:31,  8.36s/it]
 91%|█████████ | 34452/37963 [85:09:56<7:54:39,  8.11s/it]
 91%|█████████ | 34453/37963 [85:10:04<7:48:21,  8.01s/it]
 91%|█████████ | 34454/37963 [85:10:19<9:48:55, 10.07s/it]
 91%|█████████ | 34455/37963 [85:10:27<9:08:31,  9.38s/it]
 91%|█████████ | 34456/37963 [85:10:41<10:27:58, 10.74s/it]
 91%|█████████ | 34457/37963 [85:10:48<9:35:52,  9.86s/it] 
 91%|█████████ | 34458/37963 [85:10:56<8:55:42,  9.17s/it]
 91%|█████████ | 34459/37963 [85:11:11<10:35:21, 10.88s/it]
 91%|█████████ | 34460/37963 [85:11:26<11:45:59, 12.09s/it]
                                                           
{'loss': '0.07705', 'grad_norm': '3.009', 'learning_rate': '4.435e-07', 'epoch': '0.9077'}
+
 91%|█████████ | 34460/37963 [85:11:26<11:45:59, 12.09s/it]
 91%|█████████ | 34461/37963 [85:11:34<10:30:27, 10.80s/it]
 91%|█████████ | 34462/37963 [85:11:41<9:35:35,  9.86s/it] 
 91%|█████████ | 34463/37963 [85:11:49<8:55:45,  9.18s/it]
 91%|█████████ | 34464/37963 [85:11:56<8:25:40,  8.67s/it]
 91%|█████████ | 34465/37963 [85:12:04<8:08:13,  8.37s/it]
 91%|█████████ | 34466/37963 [85:12:11<7:52:33,  8.11s/it]
 91%|█████████ | 34467/37963 [85:12:19<7:44:20,  7.97s/it]
 91%|█████████ | 34468/37963 [85:12:27<7:36:06,  7.83s/it]
 91%|█████████ | 34469/37963 [85:12:34<7:32:38,  7.77s/it]
 91%|█████████ | 34470/37963 [85:12:42<7:27:39,  7.69s/it]
                                                          
{'loss': '0.08993', 'grad_norm': '3.807', 'learning_rate': '4.41e-07', 'epoch': '0.908'}
+
 91%|█████████ | 34470/37963 [85:12:42<7:27:39,  7.69s/it]
 91%|█████████ | 34471/37963 [85:12:49<7:27:41,  7.69s/it]
 91%|█████████ | 34472/37963 [85:13:03<9:17:23,  9.58s/it]
 91%|█████████ | 34473/37963 [85:13:11<8:40:18,  8.95s/it]
 91%|█████████ | 34474/37963 [85:13:19<8:18:53,  8.58s/it]
 91%|█████████ | 34475/37963 [85:13:26<7:58:20,  8.23s/it]
 91%|█████████ | 34476/37963 [85:13:34<7:48:37,  8.06s/it]
 91%|████��████ | 34477/37963 [85:13:41<7:40:31,  7.93s/it]
 91%|█████████ | 34478/37963 [85:13:49<7:31:49,  7.78s/it]
 91%|█████████ | 34479/37963 [85:13:56<7:29:53,  7.75s/it]
 91%|█████████ | 34480/37963 [85:14:04<7:30:34,  7.76s/it]
                                                          
{'loss': '0.08391', 'grad_norm': '2.767', 'learning_rate': '4.385e-07', 'epoch': '0.9083'}
+
 91%|█████████ | 34480/37963 [85:14:04<7:30:34,  7.76s/it]
 91%|█████████ | 34481/37963 [85:14:12<7:29:33,  7.75s/it]
 91%|█████████ | 34482/37963 [85:14:27<9:34:03,  9.89s/it]
 91%|█████████ | 34483/37963 [85:14:35<8:58:01,  9.28s/it]
 91%|█████████ | 34484/37963 [85:14:42<8:30:11,  8.80s/it]
 91%|█████████ | 34485/37963 [85:14:50<8:11:02,  8.47s/it]
 91%|█████████ | 34486/37963 [85:15:04<9:51:58, 10.22s/it]
 91%|█████████ | 34487/37963 [85:15:12<9:07:45,  9.45s/it]
 91%|█████████ | 34488/37963 [85:15:20<8:36:41,  8.92s/it]
 91%|█████████ | 34489/37963 [85:15:27<8:14:17,  8.54s/it]
 91%|█████████ | 34490/37963 [85:15:35<7:58:49,  8.27s/it]
                                                          
{'loss': '0.08591', 'grad_norm': '3.331', 'learning_rate': '4.36e-07', 'epoch': '0.9085'}
+
 91%|█████████ | 34490/37963 [85:15:35<7:58:49,  8.27s/it]
 91%|█████████ | 34491/37963 [85:15:43<7:52:10,  8.16s/it]
 91%|█████████ | 34492/37963 [85:15:51<7:42:20,  7.99s/it]
 91%|█████████ | 34493/37963 [85:15:58<7:38:21,  7.93s/it]
 91%|█████████ | 34494/37963 [85:16:06<7:33:44,  7.85s/it]
 91%|█████████ | 34495/37963 [85:16:14<7:31:02,  7.80s/it]
 91%|█████████ | 34496/37963 [85:16:21<7:30:03,  7.79s/it]
 91%|█████████ | 34497/37963 [85:16:29<7:28:01,  7.76s/it]
 91%|█████████ | 34498/37963 [85:16:37<7:23:32,  7.68s/it]
 91%|█████████ | 34499/37963 [85:16:51<9:19:49,  9.70s/it]
 91%|█████████ | 34500/37963 [85:16:59<8:46:57,  9.13s/it]
                                                          
{'loss': '0.08751', 'grad_norm': '2.858', 'learning_rate': '4.335e-07', 'epoch': '0.9088'}
+
 91%|█████████ | 34500/37963 [85:16:59<8:46:57,  9.13s/it]
 91%|█████████ | 34501/37963 [85:17:13<10:18:56, 10.73s/it]
 91%|█████████ | 34502/37963 [85:17:21<9:25:31,  9.80s/it] 
 91%|█████████ | 34503/37963 [85:17:36<10:54:24, 11.35s/it]
 91%|█████████ | 34504/37963 [85:17:44<9:55:42, 10.33s/it] 
 91%|█████████ | 34505/37963 [85:17:52<9:09:41,  9.54s/it]
 91%|█████████ | 34506/37963 [85:17:59<8:35:31,  8.95s/it]
 91%|█████████ | 34507/37963 [85:18:07<8:14:16,  8.58s/it]
 91%|█████████ | 34508/37963 [85:18:21<9:50:13, 10.25s/it]
 91%|█████████ | 34509/37963 [85:18:29<9:05:18,  9.47s/it]
 91%|█████████ | 34510/37963 [85:18:43<10:32:41, 10.99s/it]
                                                           
{'loss': '0.0802', 'grad_norm': '3.79', 'learning_rate': '4.31e-07', 'epoch': '0.909'}
+
 91%|█████████ | 34510/37963 [85:18:43<10:32:41, 10.99s/it]
 91%|█████████ | 34511/37963 [85:18:51<9:33:13,  9.96s/it] 
 91%|█████████ | 34512/37963 [85:18:58<8:51:55,  9.25s/it]
 91%|█████████ | 34513/37963 [85:19:06<8:25:25,  8.79s/it]
 91%|█████████ | 34514/37963 [85:19:14<8:05:31,  8.45s/it]
 91%|█████████ | 34515/37963 [85:19:21<7:52:14,  8.22s/it]
 91%|█████████ | 34516/37963 [85:19:29<7:42:16,  8.05s/it]
 91%|█████████ | 34517/37963 [85:19:37<7:35:27,  7.93s/it]
 91%|█████████ | 34518/37963 [85:19:44<7:30:47,  7.85s/it]
 91%|█████████ | 34519/37963 [85:19:52<7:25:19,  7.76s/it]
 91%|█████████ | 34520/37963 [85:20:06<9:17:03,  9.71s/it]
                                                          
{'loss': '0.07868', 'grad_norm': '3.584', 'learning_rate': '4.286e-07', 'epoch': '0.9093'}
+
 91%|█████████ | 34520/37963 [85:20:06<9:17:03,  9.71s/it]
 91%|█████████ | 34521/37963 [85:20:14<8:41:43,  9.09s/it]
 91%|█████████ | 34522/37963 [85:20:21<8:16:35,  8.66s/it]
 91%|█████████ | 34523/37963 [85:20:29<7:59:38,  8.37s/it]
 91%|█████████ | 34524/37963 [85:20:37<7:49:46,  8.20s/it]
 91%|█████████ | 34525/37963 [85:20:45<7:41:49,  8.06s/it]
 91%|█████████ | 34526/37963 [85:20:52<7:34:26,  7.93s/it]
 91%|█████████ | 34527/37963 [85:21:00<7:28:52,  7.84s/it]
 91%|█████████ | 34528/37963 [85:21:08<7:26:01,  7.79s/it]
 91%|█████████ | 34529/37963 [85:21:15<7:20:38,  7.70s/it]
 91%|█████████ | 34530/37963 [85:21:23<7:21:58,  7.72s/it]
                                                          
{'loss': '0.07393', 'grad_norm': '2.49', 'learning_rate': '4.261e-07', 'epoch': '0.9096'}
+
 91%|█████████ | 34530/37963 [85:21:23<7:21:58,  7.72s/it]
 91%|█████████ | 34531/37963 [85:21:31<7:23:40,  7.76s/it]
 91%|█████████ | 34532/37963 [85:21:38<7:23:05,  7.75s/it]
 91%|█████████ | 34533/37963 [85:21:46<7:22:53,  7.75s/it]
 91%|█████████ | 34534/37963 [85:21:54<7:22:05,  7.74s/it]
 91%|█████████ | 34535/37963 [85:22:01<7:20:11,  7.70s/it]
 91%|█████████ | 34536/37963 [85:22:16<9:19:20,  9.79s/it]
 91%|█████████ | 34537/37963 [85:22:24<8:46:38,  9.22s/it]
 91%|█████████ | 34538/37963 [85:22:32<8:17:13,  8.71s/it]
 91%|█████████ | 34539/37963 [85:22:46<9:48:36, 10.31s/it]
 91%|█████████ | 34540/37963 [85:22:53<9:03:14,  9.52s/it]
                                                          
{'loss': '0.08009', 'grad_norm': '3.597', 'learning_rate': '4.236e-07', 'epoch': '0.9098'}
+
 91%|█████████ | 34540/37963 [85:22:53<9:03:14,  9.52s/it]
 91%|█████████ | 34541/37963 [85:23:01<8:32:34,  8.99s/it]
 91%|█████████ | 34542/37963 [85:23:09<8:10:02,  8.59s/it]
 91%|█████████ | 34543/37963 [85:23:16<7:52:51,  8.30s/it]
 91%|█████████ | 34544/37963 [85:23:24<7:43:29,  8.13s/it]
 91%|█████████ | 34545/37963 [85:23:32<7:38:04,  8.04s/it]
 91%|█████████ | 34546/37963 [85:23:40<7:31:04,  7.92s/it]
 91%|█████████ | 34547/37963 [85:24:01<11:20:19, 11.95s/it]
 91%|█████████ | 34548/37963 [85:24:09<10:06:46, 10.66s/it]
 91%|█████████ | 34549/37963 [85:24:23<11:08:17, 11.75s/it]
 91%|█████████ | 34550/37963 [85:24:30<9:58:36, 10.52s/it] 
                                                          
{'loss': '0.08197', 'grad_norm': '2.727', 'learning_rate': '4.212e-07', 'epoch': '0.9101'}
+
 91%|█████████ | 34550/37963 [85:24:30<9:58:36, 10.52s/it]
 91%|█████████ | 34551/37963 [85:24:38<9:10:56,  9.69s/it]
 91%|█████████ | 34552/37963 [85:24:46<8:34:15,  9.05s/it]
 91%|█████████ | 34553/37963 [85:24:53<8:11:01,  8.64s/it]
 91%|█████████ | 34554/37963 [85:25:01<7:52:29,  8.32s/it]
 91%|█████████ | 34555/37963 [85:25:16<9:39:14, 10.20s/it]
 91%|█████████ | 34556/37963 [85:25:30<10:48:39, 11.42s/it]
 91%|█████████ | 34557/37963 [85:25:38<9:43:34, 10.28s/it] 
 91%|█████████ | 34558/37963 [85:25:45<8:52:01,  9.37s/it]
 91%|█████████ | 34559/37963 [85:25:52<8:23:01,  8.87s/it]
 91%|█████████ | 34560/37963 [85:26:00<8:03:43,  8.53s/it]
                                                          
{'loss': '0.077', 'grad_norm': '3.827', 'learning_rate': '4.187e-07', 'epoch': '0.9104'}
+
 91%|█████████ | 34560/37963 [85:26:00<8:03:43,  8.53s/it]
 91%|█████████ | 34561/37963 [85:26:08<7:51:44,  8.32s/it]
 91%|█████████ | 34562/37963 [85:26:16<7:41:08,  8.14s/it]
 91%|█████████ | 34563/37963 [85:26:23<7:34:07,  8.01s/it]
 91%|█████████ | 34564/37963 [85:26:31<7:25:53,  7.87s/it]
 91%|█████████ | 34565/37963 [85:26:39<7:23:05,  7.82s/it]
 91%|█████████ | 34566/37963 [85:26:46<7:19:59,  7.77s/it]
 91%|█████████ | 34567/37963 [85:27:00<9:04:52,  9.63s/it]
 91%|█████████ | 34568/37963 [85:27:08<8:32:21,  9.05s/it]
 91%|█████████ | 34569/37963 [85:27:16<8:08:54,  8.64s/it]
 91%|█████████ | 34570/37963 [85:27:23<7:52:28,  8.36s/it]
                                                          
{'loss': '0.0817', 'grad_norm': '3.551', 'learning_rate': '4.163e-07', 'epoch': '0.9106'}
+
 91%|█████████ | 34570/37963 [85:27:23<7:52:28,  8.36s/it]
 91%|█████████ | 34571/37963 [85:27:31<7:38:43,  8.11s/it]
 91%|█████████ | 34572/37963 [85:27:38<7:28:18,  7.93s/it]
 91%|█████████ | 34573/37963 [85:27:46<7:23:54,  7.86s/it]
 91%|█████████ | 34574/37963 [85:27:54<7:21:40,  7.82s/it]
 91%|█████████ | 34575/37963 [85:28:02<7:20:12,  7.80s/it]
 91%|█████████ | 34576/37963 [85:28:09<7:18:51,  7.77s/it]
 91%|█████████ | 34577/37963 [85:28:17<7:16:52,  7.74s/it]
 91%|█████████ | 34578/37963 [85:28:25<7:15:21,  7.72s/it]
 91%|█████████ | 34579/37963 [85:28:32<7:14:46,  7.71s/it]
 91%|█████████ | 34580/37963 [85:28:40<7:09:05,  7.61s/it]
                                                          
{'loss': '0.08992', 'grad_norm': '3.644', 'learning_rate': '4.139e-07', 'epoch': '0.9109'}
+
 91%|█████████ | 34580/37963 [85:28:40<7:09:05,  7.61s/it]
 91%|█████████ | 34581/37963 [85:28:47<7:06:15,  7.56s/it]
 91%|█████████ | 34582/37963 [85:28:55<7:04:35,  7.53s/it]
 91%|█████████ | 34583/37963 [85:29:02<7:06:10,  7.57s/it]
 91%|█████████ | 34584/37963 [85:29:10<7:07:43,  7.59s/it]
 91%|█████████ | 34585/37963 [85:29:25<9:16:57,  9.89s/it]
 91%|█████████ | 34586/37963 [85:29:33<8:39:48,  9.24s/it]
 91%|█████████ | 34587/37963 [85:29:41<8:13:10,  8.77s/it]
 91%|█████████ | 34588/37963 [85:29:48<7:55:24,  8.45s/it]
 91%|█████████ | 34589/37963 [85:29:56<7:42:27,  8.22s/it]
 91%|█████████ | 34590/37963 [85:30:04<7:31:17,  8.03s/it]
                                                          
{'loss': '0.07615', 'grad_norm': '3.513', 'learning_rate': '4.114e-07', 'epoch': '0.9112'}
+
 91%|█████████ | 34590/37963 [85:30:04<7:31:17,  8.03s/it]
 91%|█████████ | 34591/37963 [85:30:18<9:13:33,  9.85s/it]
 91%|█████████ | 34592/37963 [85:30:25<8:38:32,  9.23s/it]
 91%|█████████ | 34593/37963 [85:30:40<10:06:51, 10.80s/it]
 91%|█████████ | 34594/37963 [85:30:55<11:16:13, 12.04s/it]
 91%|█████████ | 34595/37963 [85:31:03<10:04:07, 10.76s/it]
 91%|█████████ | 34596/37963 [85:31:16<10:55:41, 11.68s/it]
 91%|█████████ | 34597/37963 [85:31:24<9:45:41, 10.44s/it] 
 91%|█████████ | 34598/37963 [85:31:32<8:58:52,  9.61s/it]
 91%|█████████ | 34599/37963 [85:31:39<8:26:25,  9.03s/it]
 91%|█████████ | 34600/37963 [85:31:54<10:06:25, 10.82s/it]
                                                           
{'loss': '0.08692', 'grad_norm': '3.859', 'learning_rate': '4.09e-07', 'epoch': '0.9114'}
+
 91%|█████████ | 34600/37963 [85:31:54<10:06:25, 10.82s/it]
 91%|█████████ | 34601/37963 [85:32:02<9:13:24,  9.88s/it] 
 91%|█████████ | 34602/37963 [85:32:10<8:35:50,  9.21s/it]
 91%|█████████ | 34603/37963 [85:32:17<8:09:55,  8.75s/it]
 91%|█████████ | 34604/37963 [85:32:25<7:48:51,  8.38s/it]
 91%|█████████ | 34605/37963 [85:32:33<7:37:21,  8.17s/it]
 91%|█████████ | 34606/37963 [85:32:40<7:29:54,  8.04s/it]
 91%|█████████ | 34607/37963 [85:32:48<7:22:09,  7.91s/it]
 91%|█████████ | 34608/37963 [85:32:56<7:18:58,  7.85s/it]
 91%|█████████ | 34609/37963 [85:33:03<7:16:00,  7.80s/it]
 91%|█████████ | 34610/37963 [85:33:18<9:06:36,  9.78s/it]
                                                          
{'loss': '0.09349', 'grad_norm': '3.145', 'learning_rate': '4.066e-07', 'epoch': '0.9117'}
+
 91%|█████████ | 34610/37963 [85:33:18<9:06:36,  9.78s/it]
 91%|█████████ | 34611/37963 [85:33:26<8:37:59,  9.27s/it]
 91%|█████████ | 34612/37963 [85:33:33<8:11:07,  8.79s/it]
 91%|█████████ | 34613/37963 [85:33:41<7:53:58,  8.49s/it]
 91%|█████████ | 34614/37963 [85:33:49<7:39:40,  8.24s/it]
 91%|█████████ | 34615/37963 [85:33:57<7:29:26,  8.05s/it]
 91%|█████████ | 34616/37963 [85:34:04<7:22:46,  7.94s/it]
 91%|█████████ | 34617/37963 [85:34:12<7:14:18,  7.79s/it]
 91%|█████████ | 34618/37963 [85:34:20<7:16:45,  7.83s/it]
 91%|█████████ | 34619/37963 [85:34:27<7:14:14,  7.79s/it]
 91%|█████████ | 34620/37963 [85:34:35<7:12:34,  7.76s/it]
                                                          
{'loss': '0.08613', 'grad_norm': '3.199', 'learning_rate': '4.042e-07', 'epoch': '0.9119'}
+
 91%|█████████ | 34620/37963 [85:34:35<7:12:34,  7.76s/it]
 91%|█████████ | 34621/37963 [85:34:49<9:05:12,  9.79s/it]
 91%|█████████ | 34622/37963 [85:34:57<8:33:50,  9.23s/it]
 91%|█████████ | 34623/37963 [85:35:05<8:08:21,  8.77s/it]
 91%|█████████ | 34624/37963 [85:35:13<7:51:53,  8.48s/it]
 91%|█████████ | 34625/37963 [85:35:21<7:39:06,  8.25s/it]
 91%|█████████ | 34626/37963 [85:35:28<7:29:53,  8.09s/it]
 91%|█████████ | 34627/37963 [85:35:36<7:23:05,  7.97s/it]
 91%|█████████ | 34628/37963 [85:35:43<7:14:40,  7.82s/it]
 91%|█████████ | 34629/37963 [85:35:51<7:15:04,  7.83s/it]
 91%|█████████ | 34630/37963 [85:35:59<7:13:18,  7.80s/it]
                                                          
{'loss': '0.07631', 'grad_norm': '3.493', 'learning_rate': '4.018e-07', 'epoch': '0.9122'}
+
 91%|█████████ | 34630/37963 [85:35:59<7:13:18,  7.80s/it]
 91%|█████████ | 34631/37963 [85:36:07<7:13:31,  7.81s/it]
 91%|█████████ | 34632/37963 [85:36:15<7:10:48,  7.76s/it]
 91%|█████████ | 34633/37963 [85:36:30<9:13:32,  9.97s/it]
 91%|█████████ | 34634/37963 [85:36:37<8:36:38,  9.31s/it]
 91%|█████████ | 34635/37963 [85:36:45<8:10:10,  8.84s/it]
 91%|█████████ | 34636/37963 [85:36:53<7:51:37,  8.51s/it]
 91%|█████████ | 34637/37963 [85:37:01<7:38:04,  8.26s/it]
 91%|█████████ | 34638/37963 [85:37:22<11:11:36, 12.12s/it]
 91%|█████████ | 34639/37963 [85:37:36<11:41:19, 12.66s/it]
 91%|█████████ | 34640/37963 [85:37:43<10:17:56, 11.16s/it]
                                                           
{'loss': '0.07311', 'grad_norm': '2.933', 'learning_rate': '3.994e-07', 'epoch': '0.9125'}
+
 91%|█████████ | 34640/37963 [85:37:43<10:17:56, 11.16s/it]
 91%|█████████ | 34641/37963 [85:37:51<9:20:57, 10.13s/it] 
 91%|█████████▏| 34642/37963 [85:37:58<8:36:29,  9.33s/it]
 91%|█████████▏| 34643/37963 [85:38:06<8:11:05,  8.88s/it]
 91%|█████████▏| 34644/37963 [85:38:14<7:51:51,  8.53s/it]
 91%|█████████▏| 34645/37963 [85:38:28<9:24:57, 10.22s/it]
 91%|█████████▏| 34646/37963 [85:38:36<8:42:39,  9.45s/it]
 91%|█████████▏| 34647/37963 [85:38:44<8:16:34,  8.99s/it]
 91%|█████████▏| 34648/37963 [85:38:51<7:54:59,  8.60s/it]
 91%|█████████▏| 34649/37963 [85:38:59<7:39:25,  8.32s/it]
 91%|█████████▏| 34650/37963 [85:39:07<7:29:01,  8.13s/it]
                                                          
{'loss': '0.09793', 'grad_norm': '4.796', 'learning_rate': '3.97e-07', 'epoch': '0.9127'}
+
 91%|█████████▏| 34650/37963 [85:39:07<7:29:01,  8.13s/it]
 91%|█████████▏| 34651/37963 [85:39:15<7:21:57,  8.01s/it]
 91%|█████████▏| 34652/37963 [85:39:29<9:06:02,  9.90s/it]
 91%|█████████▏| 34653/37963 [85:39:37<8:29:32,  9.24s/it]
 91%|█████████▏| 34654/37963 [85:39:44<8:05:20,  8.80s/it]
 91%|█████████▏| 34655/37963 [85:39:52<7:40:56,  8.36s/it]
 91%|█████████▏| 34656/37963 [85:39:59<7:29:49,  8.16s/it]
 91%|█████████▏| 34657/37963 [85:40:07<7:22:02,  8.02s/it]
 91%|█████████▏| 34658/37963 [85:40:15<7:16:15,  7.92s/it]
 91%|█████████▏| 34659/37963 [85:40:22<7:08:07,  7.77s/it]
 91%|█████████▏| 34660/37963 [85:40:30<7:06:39,  7.75s/it]
                                                          
{'loss': '0.0783', 'grad_norm': '3.334', 'learning_rate': '3.946e-07', 'epoch': '0.913'}
+
 91%|█████████▏| 34660/37963 [85:40:30<7:06:39,  7.75s/it]
 91%|█████████▏| 34661/37963 [85:40:37<7:04:25,  7.71s/it]
 91%|█████████▏| 34662/37963 [85:40:45<7:04:15,  7.71s/it]
 91%|█████████▏| 34663/37963 [85:41:00<8:55:26,  9.74s/it]
 91%|█████████▏| 34664/37963 [85:41:07<8:22:38,  9.14s/it]
 91%|█████████▏| 34665/37963 [85:41:22<9:56:28, 10.85s/it]
 91%|█████████▏| 34666/37963 [85:41:30<9:02:43,  9.88s/it]
 91%|█████████▏| 34667/37963 [85:41:37<8:26:06,  9.21s/it]
 91%|█████████▏| 34668/37963 [85:41:45<7:59:50,  8.74s/it]
 91%|█████████▏| 34669/37963 [85:41:53<7:42:15,  8.42s/it]
 91%|█████████▏| 34670/37963 [85:42:00<7:27:23,  8.15s/it]
                                                          
{'loss': '0.07794', 'grad_norm': '3.656', 'learning_rate': '3.923e-07', 'epoch': '0.9133'}
+
 91%|█████████▏| 34670/37963 [85:42:00<7:27:23,  8.15s/it]
 91%|█████████▏| 34671/37963 [85:42:08<7:20:21,  8.03s/it]
 91%|█████████▏| 34672/37963 [85:42:16<7:14:17,  7.92s/it]
 91%|█████████▏| 34673/37963 [85:42:24<7:12:38,  7.89s/it]
 91%|█████████▏| 34674/37963 [85:42:31<7:09:28,  7.83s/it]
 91%|█████████▏| 34675/37963 [85:42:39<7:03:15,  7.72s/it]
 91%|█████████▏| 34676/37963 [85:42:46<7:00:57,  7.68s/it]
 91%|█████████▏| 34677/37963 [85:42:54<7:02:19,  7.71s/it]
 91%|█████████▏| 34678/37963 [85:43:02<7:02:50,  7.72s/it]
 91%|█████████▏| 34679/37963 [85:43:10<7:01:57,  7.71s/it]
 91%|█████████▏| 34680/37963 [85:43:17<7:02:32,  7.72s/it]
                                                          
{'loss': '0.08973', 'grad_norm': '4.062', 'learning_rate': '3.899e-07', 'epoch': '0.9135'}
+
 91%|█████████▏| 34680/37963 [85:43:17<7:02:32,  7.72s/it]
 91%|█████████▏| 34681/37963 [85:43:25<7:01:18,  7.70s/it]
 91%|█████████▏| 34682/37963 [85:43:33<7:00:14,  7.69s/it]
 91%|█████████▏| 34683/37963 [85:43:40<6:55:03,  7.59s/it]
 91%|█████████▏| 34684/37963 [85:43:48<6:55:54,  7.61s/it]
 91%|█████████▏| 34685/37963 [85:43:55<6:57:51,  7.65s/it]
 91%|█████████▏| 34686/37963 [85:44:03<7:00:00,  7.69s/it]
 91%|█████████▏| 34687/37963 [85:44:25<10:44:07, 11.80s/it]
 91%|█████████▏| 34688/37963 [85:44:32<9:37:18, 10.58s/it] 
 91%|█████████▏| 34689/37963 [85:44:40<8:50:03,  9.71s/it]
 91%|█████████▏| 34690/37963 [85:44:48<8:17:25,  9.12s/it]
                                                          
{'loss': '0.08322', 'grad_norm': '2.914', 'learning_rate': '3.876e-07', 'epoch': '0.9138'}
+
 91%|█████████▏| 34690/37963 [85:44:48<8:17:25,  9.12s/it]
 91%|█████████▏| 34691/37963 [85:45:03<9:59:21, 10.99s/it]
 91%|█████████▏| 34692/37963 [85:45:11<9:09:00, 10.07s/it]
 91%|█████████▏| 34693/37963 [85:45:18<8:26:10,  9.29s/it]
 91%|█████████▏| 34694/37963 [85:45:26<7:59:54,  8.81s/it]
 91%|█████████▏| 34695/37963 [85:45:34<7:44:10,  8.52s/it]
 91%|█████████▏| 34696/37963 [85:45:42<7:29:39,  8.26s/it]
 91%|█████████▏| 34697/37963 [85:45:49<7:21:37,  8.11s/it]
 91%|█████████▏| 34698/37963 [85:45:57<7:14:17,  7.98s/it]
 91%|█████████▏| 34699/37963 [85:46:11<8:58:26,  9.90s/it]
 91%|█████████▏| 34700/37963 [85:46:19<8:25:20,  9.29s/it]
                                                          
{'loss': '0.08831', 'grad_norm': '2.941', 'learning_rate': '3.852e-07', 'epoch': '0.9141'}
+
 91%|█████████▏| 34700/37963 [85:46:19<8:25:20,  9.29s/it]
 91%|█████████▏| 34701/37963 [85:46:27<7:58:16,  8.80s/it]
 91%|█████████▏| 34702/37963 [85:46:35<7:39:13,  8.45s/it]
 91%|█████████▏| 34703/37963 [85:46:42<7:26:14,  8.21s/it]
 91%|█████████▏| 34704/37963 [85:46:57<9:09:33, 10.12s/it]
 91%|█████████▏| 34705/37963 [85:47:05<8:31:05,  9.41s/it]
 91%|█████████▏| 34706/37963 [85:47:13<8:07:53,  8.99s/it]
 91%|█████████▏| 34707/37963 [85:47:20<7:45:24,  8.58s/it]
 91%|█████████▏| 34708/37963 [85:47:28<7:32:51,  8.35s/it]
 91%|█████████▏| 34709/37963 [85:47:42<9:10:57, 10.16s/it]
 91%|█████████▏| 34710/37963 [85:47:57<10:23:22, 11.50s/it]
                                                           
{'loss': '0.07252', 'grad_norm': '2.48', 'learning_rate': '3.829e-07', 'epoch': '0.9143'}
+
 91%|█████████▏| 34710/37963 [85:47:57<10:23:22, 11.50s/it]
 91%|█████████▏| 34711/37963 [85:48:05<9:23:03, 10.39s/it] 
 91%|█████████▏| 34712/37963 [85:48:13<8:41:12,  9.62s/it]
 91%|█████████▏| 34713/37963 [85:48:21<8:13:16,  9.11s/it]
 91%|█████████▏| 34714/37963 [85:48:28<7:49:49,  8.68s/it]
 91%|█████████▏| 34715/37963 [85:48:36<7:29:32,  8.30s/it]
 91%|█████████▏| 34716/37963 [85:48:43<7:18:45,  8.11s/it]
 91%|█████████▏| 34717/37963 [85:48:51<7:15:07,  8.04s/it]
 91%|█████████▏| 34718/37963 [85:48:59<7:07:33,  7.91s/it]
 91%|█████████▏| 34719/37963 [85:49:06<7:04:09,  7.85s/it]
 91%|█████████▏| 34720/37963 [85:49:14<7:02:07,  7.81s/it]
                                                          
{'loss': '0.07925', 'grad_norm': '2.372', 'learning_rate': '3.805e-07', 'epoch': '0.9146'}
+
 91%|█████████▏| 34720/37963 [85:49:14<7:02:07,  7.81s/it]
 91%|█████████▏| 34721/37963 [85:49:22<6:58:27,  7.74s/it]
 91%|█████████▏| 34722/37963 [85:49:29<6:56:32,  7.71s/it]
 91%|█████████▏| 34723/37963 [85:49:37<6:51:05,  7.61s/it]
 91%|█████████▏| 34724/37963 [85:49:44<6:51:01,  7.61s/it]
 91%|█████████▏| 34725/37963 [85:49:52<6:52:33,  7.64s/it]
 91%|█████████▏| 34726/37963 [85:50:00<6:52:29,  7.65s/it]
 91%|█████████▏| 34727/37963 [85:50:08<6:53:59,  7.68s/it]
 91%|█████████▏| 34728/37963 [85:50:15<6:54:08,  7.68s/it]
 91%|█████████▏| 34729/37963 [85:50:23<6:51:32,  7.64s/it]
 91%|█████████▏| 34730/37963 [85:50:30<6:52:33,  7.66s/it]
                                                          
{'loss': '0.07787', 'grad_norm': '2.673', 'learning_rate': '3.782e-07', 'epoch': '0.9148'}
+
 91%|█████████▏| 34730/37963 [85:50:30<6:52:33,  7.66s/it]
 91%|█████████▏| 34731/37963 [85:50:44<8:35:07,  9.56s/it]
 91%|█████████▏| 34732/37963 [85:50:52<7:59:20,  8.90s/it]
 91%|█████████▏| 34733/37963 [85:50:59<7:38:14,  8.51s/it]
 91%|█████████▏| 34734/37963 [85:51:07<7:26:01,  8.29s/it]
 91%|█████████▏| 34735/37963 [85:51:22<9:04:55, 10.13s/it]
 91%|█████████▏| 34736/37963 [85:51:29<8:26:23,  9.42s/it]
 92%|█████████▏| 34737/37963 [85:51:37<7:58:31,  8.90s/it]
 92%|█████████▏| 34738/37963 [85:51:53<9:44:31, 10.87s/it]
 92%|█████████▏| 34739/37963 [85:52:07<10:48:03, 12.06s/it]
 92%|█████████▏| 34740/37963 [85:52:15<9:32:51, 10.66s/it] 
                                                          
{'loss': '0.08615', 'grad_norm': '3.414', 'learning_rate': '3.759e-07', 'epoch': '0.9151'}
+
 92%|█████████▏| 34740/37963 [85:52:15<9:32:51, 10.66s/it]
 92%|█████████▏| 34741/37963 [85:52:22<8:44:14,  9.76s/it]
 92%|█████████▏| 34742/37963 [85:52:30<8:10:04,  9.13s/it]
 92%|█████████▏| 34743/37963 [85:52:38<7:43:42,  8.64s/it]
 92%|█████████▏| 34744/37963 [85:52:45<7:29:26,  8.38s/it]
 92%|█████████▏| 34745/37963 [85:52:53<7:16:22,  8.14s/it]
 92%|█████████▏| 34746/37963 [85:53:00<7:05:54,  7.94s/it]
 92%|█████████▏| 34747/37963 [85:53:15<8:48:53,  9.87s/it]
 92%|█████████▏| 34748/37963 [85:53:23<8:14:38,  9.23s/it]
 92%|█████████▏| 34749/37963 [85:53:30<7:49:20,  8.76s/it]
 92%|█████████▏| 34750/37963 [85:53:38<7:30:31,  8.41s/it]
                                                          
{'loss': '0.08145', 'grad_norm': '3.062', 'learning_rate': '3.736e-07', 'epoch': '0.9154'}
+
 92%|█████████▏| 34750/37963 [85:53:38<7:30:31,  8.41s/it]
 92%|█████████▏| 34751/37963 [85:53:45<7:18:51,  8.20s/it]
 92%|█████████▏| 34752/37963 [85:53:53<7:10:56,  8.05s/it]
 92%|█████████▏| 34753/37963 [85:54:08<9:01:14, 10.12s/it]
 92%|█████████▏| 34754/37963 [85:54:23<10:15:34, 11.51s/it]
 92%|█████████▏| 34755/37963 [85:54:31<9:13:56, 10.36s/it] 
 92%|█████████▏| 34756/37963 [85:54:46<10:27:06, 11.73s/it]
 92%|█████████▏| 34757/37963 [85:54:53<9:22:10, 10.52s/it] 
 92%|█████████▏| 34758/37963 [85:55:01<8:35:37,  9.65s/it]
 92%|█████████▏| 34759/37963 [85:55:09<8:04:22,  9.07s/it]
 92%|█████████▏| 34760/37963 [85:55:16<7:44:39,  8.70s/it]
                                                          
{'loss': '0.07849', 'grad_norm': '2.242', 'learning_rate': '3.713e-07', 'epoch': '0.9156'}
+
 92%|█████████▏| 34760/37963 [85:55:16<7:44:39,  8.70s/it]
 92%|█████████▏| 34761/37963 [85:55:24<7:28:27,  8.40s/it]
 92%|█████████▏| 34762/37963 [85:55:32<7:15:36,  8.17s/it]
 92%|█████████▏| 34763/37963 [85:55:39<7:02:12,  7.92s/it]
 92%|█████████▏| 34764/37963 [85:55:47<6:59:50,  7.87s/it]
 92%|█████████▏| 34765/37963 [85:55:54<6:55:43,  7.80s/it]
 92%|█████████▏| 34766/37963 [85:56:02<6:52:00,  7.73s/it]
 92%|█████████▏| 34767/37963 [85:56:10<6:50:36,  7.71s/it]
 92%|█████████▏| 34768/37963 [85:56:17<6:50:16,  7.70s/it]
 92%|█████████▏| 34769/37963 [85:56:25<6:50:33,  7.71s/it]
 92%|█████████▏| 34770/37963 [85:56:33<6:50:17,  7.71s/it]
                                                          
{'loss': '0.08356', 'grad_norm': '4.118', 'learning_rate': '3.69e-07', 'epoch': '0.9159'}
+
 92%|█████████▏| 34770/37963 [85:56:33<6:50:17,  7.71s/it]
 92%|█████████▏| 34771/37963 [85:56:40<6:49:37,  7.70s/it]
 92%|█████████▏| 34772/37963 [85:56:48<6:49:27,  7.70s/it]
 92%|█████████▏| 34773/37963 [85:56:56<6:48:26,  7.68s/it]
 92%|█████████▏| 34774/37963 [85:57:03<6:48:18,  7.68s/it]
 92%|█████████▏| 34775/37963 [85:57:11<6:48:12,  7.68s/it]
 92%|█████████▏| 34776/37963 [85:57:19<6:49:01,  7.70s/it]
 92%|█████████▏| 34777/37963 [85:57:27<6:48:18,  7.69s/it]
 92%|█████████▏| 34778/37963 [85:57:34<6:47:08,  7.67s/it]
 92%|█████████▏| 34779/37963 [85:57:42<6:50:01,  7.73s/it]
 92%|█████████▏| 34780/37963 [85:57:50<6:45:31,  7.64s/it]
                                                          
{'loss': '0.07292', 'grad_norm': '2.645', 'learning_rate': '3.667e-07', 'epoch': '0.9162'}
+
 92%|█████████▏| 34780/37963 [85:57:50<6:45:31,  7.64s/it]
 92%|█████████▏| 34781/37963 [85:57:57<6:42:59,  7.60s/it]
 92%|█████████▏| 34782/37963 [85:58:12<8:39:14,  9.79s/it]
 92%|█████████▏| 34783/37963 [85:58:26<9:50:47, 11.15s/it]
 92%|█████████▏| 34784/37963 [85:58:34<8:57:14, 10.14s/it]
 92%|█████████▏| 34785/37963 [85:58:48<10:01:02, 11.35s/it]
 92%|█████████▏| 34786/37963 [85:58:56<8:59:15, 10.18s/it] 
 92%|█████████▏| 34787/37963 [85:59:03<8:14:02,  9.33s/it]
 92%|█████████▏| 34788/37963 [85:59:11<7:45:58,  8.81s/it]
 92%|█████████▏| 34789/37963 [85:59:18<7:29:45,  8.50s/it]
 92%|█████████▏| 34790/37963 [85:59:32<8:57:58, 10.17s/it]
                                                          
{'loss': '0.09753', 'grad_norm': '3.703', 'learning_rate': '3.644e-07', 'epoch': '0.9164'}
+
 92%|█████████▏| 34790/37963 [85:59:32<8:57:58, 10.17s/it]
 92%|█████████▏| 34791/37963 [85:59:47<10:07:56, 11.50s/it]
 92%|█████████▏| 34792/37963 [85:59:55<9:04:20, 10.30s/it] 
 92%|█████████▏| 34793/37963 [86:00:02<8:23:34,  9.53s/it]
 92%|█████████▏| 34794/37963 [86:00:10<7:56:30,  9.02s/it]
 92%|█████████▏| 34795/37963 [86:00:18<7:34:08,  8.60s/it]
 92%|█████████▏| 34796/37963 [86:00:25<7:18:46,  8.31s/it]
 92%|█████████▏| 34797/37963 [86:00:33<7:09:51,  8.15s/it]
 92%|█████████▏| 34798/37963 [86:00:41<7:02:09,  8.00s/it]
 92%|█████████▏| 34799/37963 [86:00:55<8:45:36,  9.97s/it]
 92%|█████████▏| 34800/37963 [86:01:10<9:58:07, 11.35s/it]
                                                          
{'loss': '0.0768', 'grad_norm': '4.209', 'learning_rate': '3.621e-07', 'epoch': '0.9167'}
+
 92%|█████████▏| 34800/37963 [86:01:10<9:58:07, 11.35s/it]
 92%|█████████▏| 34801/37963 [86:01:18<9:02:16, 10.29s/it]
 92%|█████████▏| 34802/37963 [86:01:25<8:18:30,  9.46s/it]
 92%|█████████▏| 34803/37963 [86:01:33<7:50:19,  8.93s/it]
 92%|█████████▏| 34804/37963 [86:01:41<7:29:26,  8.54s/it]
 92%|█████████▏| 34805/37963 [86:01:48<7:17:35,  8.31s/it]
 92%|█████████▏| 34806/37963 [86:01:56<7:08:14,  8.14s/it]
 92%|█████████▏| 34807/37963 [86:02:11<8:52:05, 10.12s/it]
 92%|█████████▏| 34808/37963 [86:02:18<8:13:16,  9.38s/it]
 92%|█████████▏| 34809/37963 [86:02:26<7:45:50,  8.86s/it]
 92%|█████████▏| 34810/37963 [86:02:34<7:21:52,  8.41s/it]
                                                          
{'loss': '0.08936', 'grad_norm': '4.415', 'learning_rate': '3.598e-07', 'epoch': '0.9169'}
+
 92%|█████████▏| 34810/37963 [86:02:34<7:21:52,  8.41s/it]
 92%|█████████▏| 34811/37963 [86:02:41<7:05:26,  8.10s/it]
 92%|█████████▏| 34812/37963 [86:02:49<6:58:34,  7.97s/it]
 92%|█████████▏| 34813/37963 [86:02:56<6:53:52,  7.88s/it]
 92%|█████████▏| 34814/37963 [86:03:04<6:50:22,  7.82s/it]
 92%|█████████▏| 34815/37963 [86:03:12<6:47:36,  7.77s/it]
 92%|█████████▏| 34816/37963 [86:03:19<6:47:42,  7.77s/it]
 92%|█████████▏| 34817/37963 [86:03:27<6:46:55,  7.76s/it]
 92%|█████████▏| 34818/37963 [86:03:35<6:44:44,  7.72s/it]
 92%|█████████▏| 34819/37963 [86:03:42<6:43:16,  7.70s/it]
 92%|█████████▏| 34820/37963 [86:03:50<6:43:15,  7.70s/it]
                                                          
{'loss': '0.07583', 'grad_norm': '2.382', 'learning_rate': '3.576e-07', 'epoch': '0.9172'}
+
 92%|█████████▏| 34820/37963 [86:03:50<6:43:15,  7.70s/it]
 92%|█████████▏| 34821/37963 [86:03:58<6:43:40,  7.71s/it]
 92%|█████████▏| 34822/37963 [86:04:05<6:42:36,  7.69s/it]
 92%|█████████▏| 34823/37963 [86:04:13<6:43:10,  7.70s/it]
 92%|█████████▏| 34824/37963 [86:04:21<6:45:37,  7.75s/it]
 92%|█████████▏| 34825/37963 [86:04:29<6:44:09,  7.73s/it]
 92%|█████████▏| 34826/37963 [86:04:36<6:41:24,  7.68s/it]
 92%|█████████▏| 34827/37963 [86:04:51<8:29:27,  9.75s/it]
 92%|█████████▏| 34828/37963 [86:04:58<7:56:14,  9.11s/it]
 92%|█████████▏| 34829/37963 [86:05:06<7:34:54,  8.71s/it]
 92%|█████████▏| 34830/37963 [86:05:14<7:19:39,  8.42s/it]
                                                          
{'loss': '0.08214', 'grad_norm': '3.526', 'learning_rate': '3.553e-07', 'epoch': '0.9175'}
+
 92%|█████████▏| 34830/37963 [86:05:14<7:19:39,  8.42s/it]
 92%|█████████▏| 34831/37963 [86:05:29<9:02:51, 10.40s/it]
 92%|█████████▏| 34832/37963 [86:05:43<10:02:53, 11.55s/it]
 92%|█████████▏| 34833/37963 [86:05:51<9:04:14, 10.43s/it] 
 92%|█████████▏| 34834/37963 [86:06:05<10:03:16, 11.57s/it]
 92%|█████████▏| 34835/37963 [86:06:13<9:08:35, 10.52s/it] 
 92%|█████████▏| 34836/37963 [86:06:21<8:25:00,  9.69s/it]
 92%|█████████▏| 34837/37963 [86:06:29<7:53:48,  9.09s/it]
 92%|█████████▏| 34838/37963 [86:06:36<7:27:27,  8.59s/it]
 92%|█████████▏| 34839/37963 [86:06:51<9:08:08, 10.53s/it]
 92%|█████████▏| 34840/37963 [86:06:59<8:23:54,  9.68s/it]
                                                          
{'loss': '0.07533', 'grad_norm': '2.423', 'learning_rate': '3.531e-07', 'epoch': '0.9177'}
+
 92%|█████████▏| 34840/37963 [86:06:59<8:23:54,  9.68s/it]
 92%|█████████▏| 34841/37963 [86:07:07<7:53:25,  9.10s/it]
 92%|█████████▏| 34842/37963 [86:07:14<7:32:11,  8.69s/it]
 92%|█████████▏| 34843/37963 [86:07:29<9:03:08, 10.45s/it]
 92%|█████████▏| 34844/37963 [86:07:37<8:18:28,  9.59s/it]
 92%|█████████▏| 34845/37963 [86:07:44<7:47:46,  9.00s/it]
 92%|█████████▏| 34846/37963 [86:07:52<7:27:54,  8.62s/it]
 92%|█████████▏| 34847/37963 [86:08:00<7:13:05,  8.34s/it]
 92%|█████████▏| 34848/37963 [86:08:07<7:01:38,  8.12s/it]
 92%|█████████▏| 34849/37963 [86:08:15<6:54:00,  7.98s/it]
 92%|█████████▏| 34850/37963 [86:08:23<6:48:19,  7.87s/it]
                                                          
{'loss': '0.08387', 'grad_norm': '3.16', 'learning_rate': '3.508e-07', 'epoch': '0.918'}
+
 92%|█████████▏| 34850/37963 [86:08:23<6:48:19,  7.87s/it]
 92%|█████████▏| 34851/37963 [86:08:30<6:42:37,  7.76s/it]
 92%|█████████▏| 34852/37963 [86:08:38<6:39:18,  7.70s/it]
 92%|█████████▏| 34853/37963 [86:08:45<6:39:52,  7.71s/it]
 92%|█████████▏| 34854/37963 [86:08:53<6:40:02,  7.72s/it]
 92%|█████████▏| 34855/37963 [86:09:07<8:19:24,  9.64s/it]
 92%|█████████▏| 34856/37963 [86:09:15<7:52:16,  9.12s/it]
 92%|█████████▏| 34857/37963 [86:09:23<7:30:07,  8.70s/it]
 92%|█████████▏| 34858/37963 [86:09:30<7:14:10,  8.39s/it]
 92%|█████████▏| 34859/37963 [86:09:38<7:04:24,  8.20s/it]
 92%|█████████▏| 34860/37963 [86:09:46<6:56:26,  8.05s/it]
                                                          
{'loss': '0.08767', 'grad_norm': '2.978', 'learning_rate': '3.486e-07', 'epoch': '0.9183'}
+
 92%|█████████▏| 34860/37963 [86:09:46<6:56:26,  8.05s/it]
 92%|█████████▏| 34861/37963 [86:09:54<6:52:22,  7.98s/it]
 92%|█████████▏| 34862/37963 [86:10:01<6:48:08,  7.90s/it]
 92%|█████████▏| 34863/37963 [86:10:09<6:46:13,  7.86s/it]
 92%|█████████▏| 34864/37963 [86:10:17<6:45:27,  7.85s/it]
 92%|█████████▏| 34865/37963 [86:10:25<6:43:35,  7.82s/it]
 92%|█████████▏| 34866/37963 [86:10:33<6:42:52,  7.81s/it]
 92%|█████████▏| 34867/37963 [86:10:40<6:35:57,  7.67s/it]
 92%|█████████▏| 34868/37963 [86:10:48<6:36:33,  7.69s/it]
 92%|█████████▏| 34869/37963 [86:10:55<6:37:43,  7.71s/it]
 92%|█████████▏| 34870/37963 [86:11:03<6:38:03,  7.72s/it]
                                                          
{'loss': '0.08773', 'grad_norm': '2.804', 'learning_rate': '3.464e-07', 'epoch': '0.9185'}
+
 92%|█████████▏| 34870/37963 [86:11:03<6:38:03,  7.72s/it]
 92%|█████████▏| 34871/37963 [86:11:11<6:34:55,  7.66s/it]
 92%|█████████▏| 34872/37963 [86:11:18<6:35:24,  7.68s/it]
 92%|█████████▏| 34873/37963 [86:11:26<6:36:19,  7.70s/it]
 92%|█████████▏| 34874/37963 [86:11:34<6:35:52,  7.69s/it]
 92%|█████████▏| 34875/37963 [86:11:42<6:35:48,  7.69s/it]
 92%|█████████▏| 34876/37963 [86:11:49<6:37:07,  7.72s/it]
 92%|█████████▏| 34877/37963 [86:12:10<10:02:50, 11.72s/it]
 92%|█████████▏| 34878/37963 [86:12:18<9:03:06, 10.56s/it] 
 92%|█████████▏| 34879/37963 [86:12:33<10:07:22, 11.82s/it]
 92%|█████████▏| 34880/37963 [86:12:41<9:04:15, 10.59s/it] 
                                                          
{'loss': '0.08346', 'grad_norm': '3.524', 'learning_rate': '3.441e-07', 'epoch': '0.9188'}
+
 92%|█████████▏| 34880/37963 [86:12:41<9:04:15, 10.59s/it]
 92%|█████████▏| 34881/37963 [86:12:48<8:19:57,  9.73s/it]
 92%|█████████▏| 34882/37963 [86:12:56<7:48:56,  9.13s/it]
 92%|█████████▏| 34883/37963 [86:13:04<7:22:09,  8.61s/it]
 92%|█████████▏| 34884/37963 [86:13:11<7:04:33,  8.27s/it]
 92%|█████████▏| 34885/37963 [86:13:19<6:56:45,  8.12s/it]
 92%|█████████▏| 34886/37963 [86:13:27<6:50:26,  8.00s/it]
 92%|█████████▏| 34887/37963 [86:13:48<10:21:55, 12.13s/it]
 92%|█████████▏| 34888/37963 [86:14:03<10:56:07, 12.80s/it]
 92%|█████████▏| 34889/37963 [86:14:10<9:39:04, 11.30s/it] 
 92%|█████████▏| 34890/37963 [86:14:18<8:43:46, 10.23s/it]
                                                          
{'loss': '0.08667', 'grad_norm': '4.163', 'learning_rate': '3.419e-07', 'epoch': '0.9191'}
+
 92%|█████████▏| 34890/37963 [86:14:18<8:43:46, 10.23s/it]
 92%|█████████▏| 34891/37963 [86:14:26<8:03:42,  9.45s/it]
 92%|█████████▏| 34892/37963 [86:14:34<7:37:54,  8.95s/it]
 92%|█████████▏| 34893/37963 [86:14:41<7:16:07,  8.52s/it]
 92%|█████████▏| 34894/37963 [86:14:49<7:02:29,  8.26s/it]
 92%|█████████▏| 34895/37963 [86:14:56<6:53:33,  8.09s/it]
 92%|█████████▏| 34896/37963 [86:15:04<6:45:23,  7.93s/it]
 92%|█████████▏| 34897/37963 [86:15:18<8:22:21,  9.83s/it]
 92%|█████████▏| 34898/37963 [86:15:26<7:48:05,  9.16s/it]
 92%|█████████▏| 34899/37963 [86:15:33<7:23:25,  8.68s/it]
 92%|█████████▏| 34900/37963 [86:15:41<7:10:02,  8.42s/it]
                                                          
{'loss': '0.0768', 'grad_norm': '3.304', 'learning_rate': '3.397e-07', 'epoch': '0.9193'}
+
 92%|█████████▏| 34900/37963 [86:15:41<7:10:02,  8.42s/it]
 92%|█████████▏| 34901/37963 [86:15:49<7:01:26,  8.26s/it]
 92%|█████████▏| 34902/37963 [86:15:57<6:51:14,  8.06s/it]
 92%|█████████▏| 34903/37963 [86:16:04<6:41:22,  7.87s/it]
 92%|█████████▏| 34904/37963 [86:16:12<6:41:12,  7.87s/it]
 92%|█████████▏| 34905/37963 [86:16:20<6:38:57,  7.83s/it]
 92%|█████████▏| 34906/37963 [86:16:28<6:38:02,  7.81s/it]
 92%|█████████▏| 34907/37963 [86:16:42<8:22:41,  9.87s/it]
 92%|█████████▏| 34908/37963 [86:16:50<7:47:40,  9.19s/it]
 92%|█████████▏| 34909/37963 [86:16:57<7:24:03,  8.72s/it]
 92%|█████████▏| 34910/37963 [86:17:05<7:09:21,  8.44s/it]
                                                          
{'loss': '0.07596', 'grad_norm': '3.475', 'learning_rate': '3.375e-07', 'epoch': '0.9196'}
+
 92%|█████████▏| 34910/37963 [86:17:05<7:09:21,  8.44s/it]
 92%|█████████▏| 34911/37963 [86:17:13<6:58:26,  8.23s/it]
 92%|█████████▏| 34912/37963 [86:17:21<6:51:27,  8.09s/it]
 92%|█████████▏| 34913/37963 [86:17:28<6:44:35,  7.96s/it]
 92%|█████████▏| 34914/37963 [86:17:36<6:40:11,  7.88s/it]
 92%|█████████▏| 34915/37963 [86:17:43<6:33:12,  7.74s/it]
 92%|█████████▏| 34916/37963 [86:17:51<6:31:00,  7.70s/it]
 92%|█████████▏| 34917/37963 [86:17:59<6:29:58,  7.68s/it]
 92%|█████████▏| 34918/37963 [86:18:06<6:26:22,  7.61s/it]
 92%|█████████▏| 34919/37963 [86:18:14<6:22:52,  7.55s/it]
 92%|█████████▏| 34920/37963 [86:18:21<6:25:08,  7.59s/it]
                                                          
{'loss': '0.07814', 'grad_norm': '3.013', 'learning_rate': '3.353e-07', 'epoch': '0.9198'}
+
 92%|█████████▏| 34920/37963 [86:18:21<6:25:08,  7.59s/it]
 92%|█████████▏| 34921/37963 [86:18:29<6:20:56,  7.51s/it]
 92%|█████████▏| 34922/37963 [86:18:36<6:19:27,  7.49s/it]
 92%|█████████▏| 34923/37963 [86:18:44<6:22:25,  7.55s/it]
 92%|█████████▏| 34924/37963 [86:18:51<6:21:57,  7.54s/it]
 92%|█████████▏| 34925/37963 [86:19:12<9:44:43, 11.55s/it]
 92%|█████████▏| 34926/37963 [86:19:20<8:49:56, 10.47s/it]
 92%|█████████▏| 34927/37963 [86:19:28<8:10:26,  9.69s/it]
 92%|█████████▏| 34928/37963 [86:19:36<7:39:53,  9.09s/it]
 92%|█████████▏| 34929/37963 [86:19:43<7:17:44,  8.66s/it]
 92%|█████████▏| 34930/37963 [86:19:58<8:47:57, 10.44s/it]
                                                          
{'loss': '0.08583', 'grad_norm': '3.607', 'learning_rate': '3.331e-07', 'epoch': '0.9201'}
+
 92%|██��██████▏| 34930/37963 [86:19:58<8:47:57, 10.44s/it]
 92%|█████████▏| 34931/37963 [86:20:06<8:07:59,  9.66s/it]
 92%|█████████▏| 34932/37963 [86:20:13<7:37:58,  9.07s/it]
 92%|█████████▏| 34933/37963 [86:20:29<9:09:00, 10.87s/it]
 92%|█████████▏| 34934/37963 [86:20:36<8:23:40,  9.98s/it]
 92%|█████████▏| 34935/37963 [86:20:50<9:24:11, 11.18s/it]
 92%|█████████▏| 34936/37963 [86:20:58<8:27:57, 10.07s/it]
 92%|█████████▏| 34937/37963 [86:21:05<7:50:42,  9.33s/it]
 92%|█████████▏| 34938/37963 [86:21:13<7:24:55,  8.83s/it]
 92%|█████████▏| 34939/37963 [86:21:21<7:08:34,  8.50s/it]
 92%|█████████▏| 34940/37963 [86:21:29<6:56:30,  8.27s/it]
                                                          
{'loss': '0.08738', 'grad_norm': '4.179', 'learning_rate': '3.309e-07', 'epoch': '0.9204'}
+
 92%|█████████▏| 34940/37963 [86:21:29<6:56:30,  8.27s/it]
 92%|█████████▏| 34941/37963 [86:21:36<6:45:58,  8.06s/it]
 92%|█████████▏| 34942/37963 [86:21:50<8:17:41,  9.88s/it]
 92%|█████████▏| 34943/37963 [86:21:58<7:49:22,  9.33s/it]
 92%|█████████▏| 34944/37963 [86:22:06<7:22:29,  8.79s/it]
 92%|█████████▏| 34945/37963 [86:22:14<7:04:51,  8.45s/it]
 92%|█████████▏| 34946/37963 [86:22:29<8:44:43, 10.44s/it]
 92%|█████████▏| 34947/37963 [86:22:36<8:04:23,  9.64s/it]
 92%|█████████▏| 34948/37963 [86:22:44<7:34:14,  9.04s/it]
 92%|█████████▏| 34949/37963 [86:22:52<7:14:08,  8.64s/it]
 92%|█████████▏| 34950/37963 [86:22:59<6:59:17,  8.35s/it]
                                                          
{'loss': '0.08195', 'grad_norm': '3.509', 'learning_rate': '3.288e-07', 'epoch': '0.9206'}
+
 92%|█████████▏| 34950/37963 [86:22:59<6:59:17,  8.35s/it]
 92%|█████████▏| 34951/37963 [86:23:07<6:48:36,  8.14s/it]
 92%|█████████▏| 34952/37963 [86:23:15<6:41:27,  8.00s/it]
 92%|█████████▏| 34953/37963 [86:23:22<6:37:43,  7.93s/it]
 92%|█████████▏| 34954/37963 [86:23:30<6:33:05,  7.84s/it]
 92%|█████████▏| 34955/37963 [86:23:45<8:13:33,  9.84s/it]
 92%|█████████▏| 34956/37963 [86:23:52<7:43:39,  9.25s/it]
 92%|█████████▏| 34957/37963 [86:24:00<7:20:05,  8.78s/it]
 92%|█████████▏| 34958/37963 [86:24:08<6:59:31,  8.38s/it]
 92%|█████████▏| 34959/37963 [86:24:15<6:50:03,  8.19s/it]
 92%|█████████▏| 34960/37963 [86:24:23<6:42:45,  8.05s/it]
                                                          
{'loss': '0.08615', 'grad_norm': '3.703', 'learning_rate': '3.266e-07', 'epoch': '0.9209'}
+
 92%|█████████▏| 34960/37963 [86:24:23<6:42:45,  8.05s/it]
 92%|█████████▏| 34961/37963 [86:24:31<6:35:51,  7.91s/it]
 92%|█████████▏| 34962/37963 [86:24:38<6:32:02,  7.84s/it]
 92%|█████████▏| 34963/37963 [86:24:46<6:33:05,  7.86s/it]
 92%|█████████▏| 34964/37963 [86:24:54<6:29:57,  7.80s/it]
 92%|█████████▏| 34965/37963 [86:25:02<6:27:40,  7.76s/it]
 92%|█████████▏| 34966/37963 [86:25:09<6:26:47,  7.74s/it]
 92%|█████████▏| 34967/37963 [86:25:17<6:25:50,  7.73s/it]
 92%|█████████▏| 34968/37963 [86:25:25<6:24:19,  7.70s/it]
 92%|█████████▏| 34969/37963 [86:25:38<7:53:27,  9.49s/it]
 92%|█████████▏| 34970/37963 [86:25:46<7:29:02,  9.00s/it]
                                                          
{'loss': '0.07113', 'grad_norm': '2.931', 'learning_rate': '3.245e-07', 'epoch': '0.9212'}
+
 92%|█████████▏| 34970/37963 [86:25:46<7:29:02,  9.00s/it]
 92%|█████████▏| 34971/37963 [86:25:54<7:07:32,  8.57s/it]
 92%|█████████▏| 34972/37963 [86:26:02<6:57:13,  8.37s/it]
 92%|█████████▏| 34973/37963 [86:26:09<6:46:30,  8.16s/it]
 92%|█████████▏| 34974/37963 [86:26:24<8:19:11, 10.02s/it]
 92%|█████████▏| 34975/37963 [86:26:31<7:45:13,  9.34s/it]
 92%|█████████▏| 34976/37963 [86:26:39<7:19:49,  8.83s/it]
 92%|█████████▏| 34977/37963 [86:26:47<7:02:39,  8.49s/it]
 92%|█████████▏| 34978/37963 [86:27:02<8:41:18, 10.48s/it]
 92%|█████████▏| 34979/37963 [86:27:10<8:00:42,  9.67s/it]
 92%|█████████▏| 34980/37963 [86:27:17<7:33:32,  9.12s/it]
                                                          
{'loss': '0.08451', 'grad_norm': '3.773', 'learning_rate': '3.223e-07', 'epoch': '0.9214'}
+
 92%|███████��█▏| 34980/37963 [86:27:17<7:33:32,  9.12s/it]
 92%|█████████▏| 34981/37963 [86:27:25<7:11:14,  8.68s/it]
 92%|█████████▏| 34982/37963 [86:27:33<6:57:00,  8.39s/it]
 92%|█████████▏| 34983/37963 [86:27:40<6:44:34,  8.15s/it]
 92%|█████████▏| 34984/37963 [86:27:48<6:37:42,  8.01s/it]
 92%|█████████▏| 34985/37963 [86:27:56<6:32:48,  7.91s/it]
 92%|█████████▏| 34986/37963 [86:28:17<9:55:50, 12.01s/it]
 92%|█████████▏| 34987/37963 [86:28:25<8:51:57, 10.72s/it]
 92%|█████████▏| 34988/37963 [86:28:33<8:05:52,  9.80s/it]
 92%|█████████▏| 34989/37963 [86:28:47<9:11:06, 11.12s/it]
 92%|█████████▏| 34990/37963 [86:28:55<8:19:03, 10.07s/it]
                                                          
{'loss': '0.08986', 'grad_norm': '2.965', 'learning_rate': '3.202e-07', 'epoch': '0.9217'}
+
 92%|█████████▏| 34990/37963 [86:28:55<8:19:03, 10.07s/it]
 92%|█████████▏| 34991/37963 [86:29:09<9:19:47, 11.30s/it]
 92%|█████████▏| 34992/37963 [86:29:16<8:24:51, 10.20s/it]
 92%|█████████▏| 34993/37963 [86:29:24<7:46:46,  9.43s/it]
 92%|█████████▏| 34994/37963 [86:29:31<7:15:54,  8.81s/it]
 92%|█████████▏| 34995/37963 [86:29:39<7:01:48,  8.53s/it]
 92%|█████████▏| 34996/37963 [86:29:47<6:51:10,  8.32s/it]
 92%|█████████▏| 34997/37963 [86:29:55<6:41:51,  8.13s/it]
 92%|█████████▏| 34998/37963 [86:30:02<6:34:53,  7.99s/it]
 92%|█████████▏| 34999/37963 [86:30:10<6:30:05,  7.90s/it]
 92%|█████████▏| 35000/37963 [86:30:18<6:24:49,  7.79s/it]
                                                          
{'loss': '0.07864', 'grad_norm': '2.902', 'learning_rate': '3.18e-07', 'epoch': '0.922'}
+
 92%|█████████▏| 35000/37963 [86:30:18<6:24:49,  7.79s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.72s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.72s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 92%|█████████▏| 35001/37963 [86:31:15<18:35:08, 22.59s/it]
 92%|█████████▏| 35002/37963 [86:31:23<14:58:00, 18.20s/it]
 92%|█████████▏| 35003/37963 [86:31:30<12:22:30, 15.05s/it]
 92%|█████████▏| 35004/37963 [86:31:38<10:33:50, 12.85s/it]
 92%|█████████▏| 35005/37963 [86:31:53<11:06:03, 13.51s/it]
 92%|█████████▏| 35006/37963 [86:32:01<9:35:05, 11.67s/it] 
 92%|█████████▏| 35007/37963 [86:32:08<8:37:24, 10.50s/it]
 92%|█████████▏| 35008/37963 [86:32:16<7:54:07,  9.63s/it]
 92%|█████████▏| 35009/37963 [86:32:23<7:21:20,  8.96s/it]
 92%|█████████▏| 35010/37963 [86:32:31<7:04:49,  8.63s/it]
                                                          
{'loss': '0.08521', 'grad_norm': '3.427', 'learning_rate': '3.159e-07', 'epoch': '0.9222'}
+
 92%|█████████▏| 35010/37963 [86:32:31<7:04:49,  8.63s/it]
 92%|█████████▏| 35011/37963 [86:32:39<6:51:50,  8.37s/it]
 92%|█████████▏| 35012/37963 [86:32:47<6:40:42,  8.15s/it]
 92%|█████████▏| 35013/37963 [86:32:54<6:32:45,  7.99s/it]
 92%|█████████▏| 35014/37963 [86:33:02<6:27:34,  7.89s/it]
 92%|█████████▏| 35015/37963 [86:33:09<6:23:39,  7.81s/it]
 92%|█████████▏| 35016/37963 [86:33:17<6:18:56,  7.72s/it]
 92%|█████████▏| 35017/37963 [86:33:25<6:19:26,  7.73s/it]
 92%|█████████▏| 35018/37963 [86:33:32<6:17:43,  7.70s/it]
 92%|█████████▏| 35019/37963 [86:33:40<6:17:43,  7.70s/it]
 92%|█████████▏| 35020/37963 [86:33:48<6:16:41,  7.68s/it]
                                                          
{'loss': '0.0893', 'grad_norm': '3.453', 'learning_rate': '3.138e-07', 'epoch': '0.9225'}
+
 92%|█████████▏| 35020/37963 [86:33:48<6:16:41,  7.68s/it]
 92%|█████████▏| 35021/37963 [86:34:08<9:24:58, 11.52s/it]
 92%|█████████▏| 35022/37963 [86:34:16<8:28:57, 10.38s/it]
 92%|█████████▏| 35023/37963 [86:34:31<9:36:49, 11.77s/it]
 92%|█████████▏| 35024/37963 [86:34:39<8:37:59, 10.57s/it]
 92%|█████████▏| 35025/37963 [86:34:46<7:56:59,  9.74s/it]
 92%|█████████▏| 35026/37963 [86:34:54<7:26:56,  9.13s/it]
 92%|█████████▏| 35027/37963 [86:35:02<7:05:12,  8.69s/it]
 92%|█████████▏| 35028/37963 [86:35:09<6:49:23,  8.37s/it]
 92%|█████████▏| 35029/37963 [86:35:17<6:39:58,  8.18s/it]
 92%|█████████▏| 35030/37963 [86:35:32<8:11:24, 10.05s/it]
                                                          
{'loss': '0.07726', 'grad_norm': '2.677', 'learning_rate': '3.116e-07', 'epoch': '0.9227'}
+
 92%|█████████▏| 35030/37963 [86:35:32<8:11:24, 10.05s/it]
 92%|█████████▏| 35031/37963 [86:35:47<9:24:43, 11.56s/it]
 92%|█████████▏| 35032/37963 [86:35:55<8:33:08, 10.50s/it]
 92%|█████████▏| 35033/37963 [86:36:02<7:50:44,  9.64s/it]
 92%|█████████▏| 35034/37963 [86:36:10<7:22:39,  9.07s/it]
 92%|█████████▏| 35035/37963 [86:36:18<7:03:56,  8.69s/it]
 92%|█████████▏| 35036/37963 [86:36:26<6:48:59,  8.38s/it]
 92%|█████████▏| 35037/37963 [86:36:33<6:37:43,  8.16s/it]
 92%|█████████▏| 35038/37963 [86:36:48<8:10:09, 10.05s/it]
 92%|█████████▏| 35039/37963 [86:37:02<9:14:01, 11.37s/it]
 92%|█████████▏| 35040/37963 [86:37:10<8:24:53, 10.36s/it]
                                                          
{'loss': '0.07625', 'grad_norm': '4.682', 'learning_rate': '3.095e-07', 'epoch': '0.923'}
+
 92%|█████████▏| 35040/37963 [86:37:10<8:24:53, 10.36s/it]
 92%|█████████▏| 35041/37963 [86:37:18<7:42:44,  9.50s/it]
 92%|█████████▏| 35042/37963 [86:37:25<7:14:56,  8.93s/it]
 92%|█████████▏| 35043/37963 [86:37:33<6:56:56,  8.57s/it]
 92%|█████████▏| 35044/37963 [86:37:41<6:44:31,  8.31s/it]
 92%|█████████▏| 35045/37963 [86:37:48<6:36:02,  8.14s/it]
 92%|█████████▏| 35046/37963 [86:37:56<6:24:32,  7.91s/it]
 92%|█████████▏| 35047/37963 [86:38:03<6:20:44,  7.83s/it]
 92%|█████████▏| 35048/37963 [86:38:11<6:18:54,  7.80s/it]
 92%|█████████▏| 35049/37963 [86:38:19<6:17:04,  7.76s/it]
 92%|█████████▏| 35050/37963 [86:38:27<6:16:37,  7.76s/it]
                                                          
{'loss': '0.08541', 'grad_norm': '3.784', 'learning_rate': '3.074e-07', 'epoch': '0.9233'}
+
 92%|█████████▏| 35050/37963 [86:38:27<6:16:37,  7.76s/it]
 92%|█████████▏| 35051/37963 [86:38:34<6:15:33,  7.74s/it]
 92%|█████████▏| 35052/37963 [86:38:42<6:14:07,  7.71s/it]
 92%|█████████▏| 35053/37963 [86:38:50<6:14:29,  7.72s/it]
 92%|█████████▏| 35054/37963 [86:39:04<7:55:45,  9.81s/it]
 92%|█████████▏| 35055/37963 [86:39:12<7:24:47,  9.18s/it]
 92%|█████████▏| 35056/37963 [86:39:20<7:03:46,  8.75s/it]
 92%|█████████▏| 35057/37963 [86:39:27<6:48:10,  8.43s/it]
 92%|█████████▏| 35058/37963 [86:39:35<6:32:20,  8.10s/it]
 92%|█████████▏| 35059/37963 [86:39:43<6:27:15,  8.00s/it]
 92%|█████████▏| 35060/37963 [86:39:50<6:23:25,  7.92s/it]
                                                          
{'loss': '0.08852', 'grad_norm': '2.892', 'learning_rate': '3.053e-07', 'epoch': '0.9235'}
+
 92%|█████████▏| 35060/37963 [86:39:50<6:23:25,  7.92s/it]
 92%|█████████▏| 35061/37963 [86:39:58<6:20:23,  7.86s/it]
 92%|█████████▏| 35062/37963 [86:40:06<6:17:21,  7.80s/it]
 92%|█████████▏| 35063/37963 [86:40:13<6:15:39,  7.77s/it]
 92%|█████████▏| 35064/37963 [86:40:21<6:15:51,  7.78s/it]
 92%|█████████▏| 35065/37963 [86:40:29<6:10:20,  7.67s/it]
 92%|█████████▏| 35066/37963 [86:40:36<6:09:54,  7.66s/it]
 92%|█████████▏| 35067/37963 [86:40:58<9:30:32, 11.82s/it]
 92%|█████████▏| 35068/37963 [86:41:05<8:29:53, 10.57s/it]
 92%|█████████▏| 35069/37963 [86:41:13<7:49:14,  9.73s/it]
 92%|█████████▏| 35070/37963 [86:41:21<7:17:57,  9.08s/it]
                                                          
{'loss': '0.08331', 'grad_norm': '5.232', 'learning_rate': '3.032e-07', 'epoch': '0.9238'}
+
 92%|█████████▏| 35070/37963 [86:41:21<7:17:57,  9.08s/it]
 92%|█████████▏| 35071/37963 [86:41:28<6:54:58,  8.61s/it]
 92%|█████████▏| 35072/37963 [86:41:36<6:41:27,  8.33s/it]
 92%|█████████▏| 35073/37963 [86:41:44<6:32:30,  8.15s/it]
 92%|█████████▏| 35074/37963 [86:41:58<7:58:20,  9.93s/it]
 92%|█████████▏| 35075/37963 [86:42:12<9:00:28, 11.23s/it]
 92%|█████████▏| 35076/37963 [86:42:20<8:09:55, 10.18s/it]
 92%|█████████▏| 35077/37963 [86:42:28<7:35:01,  9.46s/it]
 92%|█████████▏| 35078/37963 [86:42:35<7:05:54,  8.86s/it]
 92%|█████████▏| 35079/37963 [86:42:43<6:50:55,  8.55s/it]
 92%|█████████▏| 35080/37963 [86:42:51<6:39:17,  8.31s/it]
                                                          
{'loss': '0.08966', 'grad_norm': '3.828', 'learning_rate': '3.012e-07', 'epoch': '0.9241'}
+
 92%|█████████▏| 35080/37963 [86:42:51<6:39:17,  8.31s/it]
 92%|█████████▏| 35081/37963 [86:43:05<8:07:39, 10.15s/it]
 92%|█████████▏| 35082/37963 [86:43:13<7:30:04,  9.37s/it]
 92%|█████████▏| 35083/37963 [86:43:20<7:03:09,  8.82s/it]
 92%|█████████▏| 35084/37963 [86:43:28<6:49:15,  8.53s/it]
 92%|█████████▏| 35085/37963 [86:43:42<8:11:40, 10.25s/it]
 92%|█████████▏| 35086/37963 [86:43:50<7:31:34,  9.42s/it]
 92%|█████████▏| 35087/37963 [86:44:04<8:43:59, 10.93s/it]
 92%|█████████▏| 35088/37963 [86:44:12<7:56:55,  9.95s/it]
 92%|█████████▏| 35089/37963 [86:44:20<7:23:58,  9.27s/it]
 92%|█████████▏| 35090/37963 [86:44:27<7:01:41,  8.81s/it]
                                                          
{'loss': '0.0719', 'grad_norm': '2.91', 'learning_rate': '2.991e-07', 'epoch': '0.9243'}
+
 92%|█████████▏| 35090/37963 [86:44:27<7:01:41,  8.81s/it]
 92%|█████████▏| 35091/37963 [86:44:35<6:44:00,  8.44s/it]
 92%|█████████▏| 35092/37963 [86:44:42<6:32:30,  8.20s/it]
 92%|█████████▏| 35093/37963 [86:44:50<6:19:26,  7.93s/it]
 92%|█████████▏| 35094/37963 [86:44:57<6:15:41,  7.86s/it]
 92%|█████████▏| 35095/37963 [86:45:05<6:10:36,  7.75s/it]
 92%|█████████▏| 35096/37963 [86:45:13<6:08:10,  7.71s/it]
 92%|█████████▏| 35097/37963 [86:45:20<6:07:36,  7.70s/it]
 92%|█████████▏| 35098/37963 [86:45:28<6:07:17,  7.69s/it]
 92%|█████████▏| 35099/37963 [86:45:36<6:09:13,  7.74s/it]
 92%|█████████▏| 35100/37963 [86:45:44<6:10:19,  7.76s/it]
                                                          
{'loss': '0.08451', 'grad_norm': '3.312', 'learning_rate': '2.97e-07', 'epoch': '0.9246'}
+
 92%|█████████▏| 35100/37963 [86:45:44<6:10:19,  7.76s/it]
 92%|█████████▏| 35101/37963 [86:45:51<6:08:14,  7.72s/it]
 92%|█████████▏| 35102/37963 [86:45:59<6:07:27,  7.71s/it]
 92%|█████████▏| 35103/37963 [86:46:13<7:41:56,  9.69s/it]
 92%|█████████▏| 35104/37963 [86:46:21<7:16:15,  9.16s/it]
 92%|█████████▏| 35105/37963 [86:46:29<6:54:53,  8.71s/it]
 92%|█████████▏| 35106/37963 [86:46:37<6:41:58,  8.44s/it]
 92%|█████████▏| 35107/37963 [86:46:44<6:29:58,  8.19s/it]
 92%|█████████▏| 35108/37963 [86:46:52<6:23:07,  8.05s/it]
 92%|█████████▏| 35109/37963 [86:47:00<6:19:28,  7.98s/it]
 92%|█████████▏| 35110/37963 [86:47:08<6:16:52,  7.93s/it]
                                                          
{'loss': '0.0757', 'grad_norm': '3.764', 'learning_rate': '2.95e-07', 'epoch': '0.9249'}
+
 92%|█████████▏| 35110/37963 [86:47:08<6:16:52,  7.93s/it]
 92%|█████████▏| 35111/37963 [86:47:15<6:13:20,  7.85s/it]
 92%|█████████▏| 35112/37963 [86:47:23<6:11:41,  7.82s/it]
 92%|█████████▏| 35113/37963 [86:47:38<7:51:27,  9.93s/it]
 92%|█████████▏| 35114/37963 [86:47:46<7:20:21,  9.27s/it]
 92%|█████████▏| 35115/37963 [86:48:00<8:29:48, 10.74s/it]
 93%|█████████▎| 35116/37963 [86:48:07<7:46:56,  9.84s/it]
 93%|█████████▎| 35117/37963 [86:48:22<8:48:19, 11.14s/it]
 93%|█████████▎| 35118/37963 [86:48:29<7:59:02, 10.10s/it]
 93%|█████████▎| 35119/37963 [86:48:37<7:24:15,  9.37s/it]
 93%|█████████▎| 35120/37963 [86:48:45<7:00:46,  8.88s/it]
                                                          
{'loss': '0.08542', 'grad_norm': '4.374', 'learning_rate': '2.929e-07', 'epoch': '0.9251'}
+
 93%|█████████▎| 35120/37963 [86:48:45<7:00:46,  8.88s/it]
 93%|█████████▎| 35121/37963 [86:48:52<6:42:44,  8.50s/it]
 93%|█████████▎| 35122/37963 [86:49:00<6:30:34,  8.25s/it]
 93%|█████████▎| 35123/37963 [86:49:08<6:21:50,  8.07s/it]
 93%|█████████▎| 35124/37963 [86:49:15<6:16:55,  7.97s/it]
 93%|█████████▎| 35125/37963 [86:49:30<7:44:55,  9.83s/it]
 93%|█████████▎| 35126/37963 [86:49:37<7:09:39,  9.09s/it]
 93%|█████████��| 35127/37963 [86:49:45<6:50:43,  8.69s/it]
 93%|█████████▎| 35128/37963 [86:49:52<6:35:45,  8.38s/it]
 93%|█████████▎| 35129/37963 [86:50:00<6:24:45,  8.15s/it]
 93%|█████████▎| 35130/37963 [86:50:08<6:16:46,  7.98s/it]
                                                          
{'loss': '0.08136', 'grad_norm': '3.911', 'learning_rate': '2.909e-07', 'epoch': '0.9254'}
+
 93%|█████████▎| 35130/37963 [86:50:08<6:16:46,  7.98s/it]
 93%|█████████▎| 35131/37963 [86:50:15<6:12:33,  7.89s/it]
 93%|█████████▎| 35132/37963 [86:50:23<6:09:09,  7.82s/it]
 93%|█████████▎| 35133/37963 [86:50:31<6:06:31,  7.77s/it]
 93%|█████████▎| 35134/37963 [86:50:45<7:45:43,  9.88s/it]
 93%|█████████▎| 35135/37963 [86:50:53<7:14:35,  9.22s/it]
 93%|█████████▎| 35136/37963 [86:51:01<6:52:51,  8.76s/it]
 93%|█████████▎| 35137/37963 [86:51:08<6:35:00,  8.39s/it]
 93%|█████████▎| 35138/37963 [86:51:16<6:22:04,  8.11s/it]
 93%|█████████▎| 35139/37963 [86:51:30<7:47:18,  9.93s/it]
 93%|█████████▎| 35140/37963 [86:51:38<7:16:41,  9.28s/it]
                                                          
{'loss': '0.07881', 'grad_norm': '3.8', 'learning_rate': '2.888e-07', 'epoch': '0.9256'}
+
 93%|█████████▎| 35140/37963 [86:51:38<7:16:41,  9.28s/it]
 93%|█████████▎| 35141/37963 [86:51:52<8:29:16, 10.83s/it]
 93%|█████████▎| 35142/37963 [86:52:00<7:41:43,  9.82s/it]
 93%|█████████▎| 35143/37963 [86:52:07<7:09:53,  9.15s/it]
 93%|█████████▎| 35144/37963 [86:52:15<6:46:39,  8.66s/it]
 93%|█████████▎| 35145/37963 [86:52:22<6:33:55,  8.39s/it]
 93%|█████████▎| 35146/37963 [86:52:30<6:22:55,  8.16s/it]
 93%|█████████▎| 35147/37963 [86:52:38<6:15:21,  8.00s/it]
 93%|█████████▎| 35148/37963 [86:52:45<6:10:36,  7.90s/it]
 93%|█████████▎| 35149/37963 [86:52:53<6:06:35,  7.82s/it]
 93%|█████████▎| 35150/37963 [86:53:08<7:41:59,  9.85s/it]
                                                          
{'loss': '0.08399', 'grad_norm': '3.959', 'learning_rate': '2.868e-07', 'epoch': '0.9259'}
+
 93%|█████████▎| 35150/37963 [86:53:08<7:41:59,  9.85s/it]
 93%|█████████▎| 35151/37963 [86:53:15<7:14:04,  9.26s/it]
 93%|█████████▎| 35152/37963 [86:53:23<6:52:23,  8.80s/it]
 93%|█████████▎| 35153/37963 [86:53:31<6:32:59,  8.39s/it]
 93%|█████████▎| 35154/37963 [86:53:38<6:22:47,  8.18s/it]
 93%|█████████▎| 35155/37963 [86:53:46<6:15:48,  8.03s/it]
 93%|█████████▎| 35156/37963 [86:53:54<6:11:27,  7.94s/it]
 93%|█████████▎| 35157/37963 [86:54:01<6:07:59,  7.87s/it]
 93%|█████████▎| 35158/37963 [86:54:09<6:06:55,  7.85s/it]
 93%|█████████▎| 35159/37963 [86:54:17<6:04:56,  7.81s/it]
 93%|█████████▎| 35160/37963 [86:54:25<6:06:16,  7.84s/it]
                                                          
{'loss': '0.08326', 'grad_norm': '5.402', 'learning_rate': '2.848e-07', 'epoch': '0.9262'}
+
 93%|█████████▎| 35160/37963 [86:54:25<6:06:16,  7.84s/it]
 93%|█████████▎| 35161/37963 [86:54:39<7:39:28,  9.84s/it]
 93%|█████████▎| 35162/37963 [86:54:54<8:51:39, 11.39s/it]
 93%|█████████▎| 35163/37963 [86:55:02<8:00:05, 10.29s/it]
 93%|█████████▎| 35164/37963 [86:55:10<7:22:42,  9.49s/it]
 93%|█████████▎| 35165/37963 [86:55:18<7:00:12,  9.01s/it]
 93%|█████████▎| 35166/37963 [86:55:25<6:42:10,  8.63s/it]
 93%|█████████▎| 35167/37963 [86:55:33<6:29:36,  8.36s/it]
 93%|█████████▎| 35168/37963 [86:55:41<6:19:25,  8.14s/it]
 93%|█████████▎| 35169/37963 [86:55:48<6:13:17,  8.02s/it]
 93%|█████████▎| 35170/37963 [86:55:56<6:09:09,  7.93s/it]
                                                          
{'loss': '0.08301', 'grad_norm': '3.678', 'learning_rate': '2.828e-07', 'epoch': '0.9264'}
+
 93%|█████████▎| 35170/37963 [86:55:56<6:09:09,  7.93s/it]
 93%|█████████▎| 35171/37963 [86:56:10<7:38:28,  9.85s/it]
 93%|█████████▎| 35172/37963 [86:56:18<7:09:03,  9.22s/it]
 93%|█████████▎| 35173/37963 [86:56:26<6:47:54,  8.77s/it]
 93%|█████████▎| 35174/37963 [86:56:34<6:32:31,  8.44s/it]
 93%|█████████▎| 35175/37963 [86:56:48<7:54:35, 10.21s/it]
 93%|█████████▎| 35176/37963 [86:56:56<7:22:02,  9.52s/it]
 93%|█████████▎| 35177/37963 [86:57:03<6:56:03,  8.96s/it]
 93%|█████████▎| 35178/37963 [86:57:18<8:15:21, 10.67s/it]
 93%|█████████▎| 35179/37963 [86:57:26<7:34:30,  9.80s/it]
 93%|█████████▎| 35180/37963 [86:57:34<7:04:51,  9.16s/it]
                                                          
{'loss': '0.08834', 'grad_norm': '2.815', 'learning_rate': '2.807e-07', 'epoch': '0.9267'}
+
 93%|█████████▎| 35180/37963 [86:57:34<7:04:51,  9.16s/it]
 93%|█████████▎| 35181/37963 [86:57:41<6:41:49,  8.67s/it]
 93%|█████████▎| 35182/37963 [86:57:49<6:28:49,  8.39s/it]
 93%|█████████▎| 35183/37963 [86:57:57<6:18:59,  8.18s/it]
 93%|█████████▎| 35184/37963 [86:58:04<6:11:42,  8.03s/it]
 93%|█████████▎| 35185/37963 [86:58:12<6:06:34,  7.92s/it]
 93%|█████████▎| 35186/37963 [86:58:20<6:03:39,  7.86s/it]
 93%|█████████▎| 35187/37963 [86:58:34<7:35:49,  9.85s/it]
 93%|█████████▎| 35188/37963 [86:58:42<7:06:41,  9.23s/it]
 93%|█████████▎| 35189/37963 [86:58:56<8:12:30, 10.65s/it]
 93%|█████████▎| 35190/37963 [86:59:04<7:32:49,  9.80s/it]
                                                          
{'loss': '0.09224', 'grad_norm': '4.183', 'learning_rate': '2.787e-07', 'epoch': '0.927'}
+
 93%|█████████▎| 35190/37963 [86:59:04<7:32:49,  9.80s/it]
 93%|█████████▎| 35191/37963 [86:59:11<7:05:03,  9.20s/it]
 93%|█████████▎| 35192/37963 [86:59:19<6:45:04,  8.77s/it]
 93%|█████████▎| 35193/37963 [86:59:27<6:28:23,  8.41s/it]
 93%|█████████▎| 35194/37963 [86:59:34<6:18:01,  8.19s/it]
 93%|█████████▎| 35195/37963 [86:59:49<7:50:33, 10.20s/it]
 93%|█████████▎| 35196/37963 [86:59:57<7:15:59,  9.45s/it]
 93%|█████████▎| 35197/37963 [87:00:05<6:51:06,  8.92s/it]
 93%|█████████▎| 35198/37963 [87:00:12<6:32:32,  8.52s/it]
 93%|█████████▎| 35199/37963 [87:00:20<6:21:38,  8.28s/it]
 93%|█████████▎| 35200/37963 [87:00:28<6:12:59,  8.10s/it]
                                                          
{'loss': '0.06256', 'grad_norm': '2.656', 'learning_rate': '2.767e-07', 'epoch': '0.9272'}
+
 93%|█████████▎| 35200/37963 [87:00:28<6:12:59,  8.10s/it]
 93%|█████████▎| 35201/37963 [87:00:35<6:06:10,  7.95s/it]
 93%|█████████▎| 35202/37963 [87:00:43<6:02:45,  7.88s/it]
 93%|█████████▎| 35203/37963 [87:00:51<6:01:44,  7.86s/it]
 93%|█████████▎| 35204/37963 [87:00:59<5:59:28,  7.82s/it]
 93%|█████████▎| 35205/37963 [87:01:13<7:27:58,  9.75s/it]
 93%|█████████▎| 35206/37963 [87:01:21<7:00:26,  9.15s/it]
 93%|█████████▎| 35207/37963 [87:01:28<6:40:02,  8.71s/it]
 93%|█████████▎| 35208/37963 [87:01:36<6:20:43,  8.29s/it]
 93%|█████████▎| 35209/37963 [87:01:43<6:12:21,  8.11s/it]
 93%|█████████▎| 35210/37963 [87:01:51<6:07:05,  8.00s/it]
                                                          
{'loss': '0.07249', 'grad_norm': '3.287', 'learning_rate': '2.747e-07', 'epoch': '0.9275'}
+
 93%|█████████▎| 35210/37963 [87:01:51<6:07:05,  8.00s/it]
 93%|█████████▎| 35211/37963 [87:01:59<6:02:33,  7.90s/it]
 93%|█████████▎| 35212/37963 [87:02:06<5:58:40,  7.82s/it]
 93%|█████████▎| 35213/37963 [87:02:14<5:56:42,  7.78s/it]
 93%|█████████▎| 35214/37963 [87:02:22<5:56:21,  7.78s/it]
 93%|█████████▎| 35215/37963 [87:02:37<7:37:18,  9.98s/it]
 93%|█████████▎| 35216/37963 [87:02:45<7:07:18,  9.33s/it]
 93%|█████████▎| 35217/37963 [87:02:52<6:44:19,  8.83s/it]
 93%|█████████▎| 35218/37963 [87:03:00<6:25:05,  8.42s/it]
 93%|█████████▎| 35219/37963 [87:03:14<7:49:29, 10.27s/it]
 93%|█████████▎| 35220/37963 [87:03:22<7:14:30,  9.50s/it]
                                                          
{'loss': '0.08339', 'grad_norm': '2.98', 'learning_rate': '2.728e-07', 'epoch': '0.9277'}
+
 93%|█████████▎| 35220/37963 [87:03:22<7:14:30,  9.50s/it]
 93%|█████████▎| 35221/37963 [87:03:30<6:51:37,  9.01s/it]
 93%|█████████▎| 35222/37963 [87:03:38<6:31:05,  8.56s/it]
 93%|█████████▎| 35223/37963 [87:03:45<6:18:39,  8.29s/it]
 93%|█████████▎| 35224/37963 [87:03:53<6:07:27,  8.05s/it]
 93%|█████████▎| 35225/37963 [87:04:00<6:02:26,  7.94s/it]
 93%|█████████▎| 35226/37963 [87:04:08<5:56:23,  7.81s/it]
 93%|█████████▎| 35227/37963 [87:04:16<5:53:54,  7.76s/it]
 93%|█████████▎| 35228/37963 [87:04:30<7:22:05,  9.70s/it]
 93%|█████████▎| 35229/37963 [87:04:37<6:55:31,  9.12s/it]
 93%|█████████▎| 35230/37963 [87:04:53<8:17:52, 10.93s/it]
                                                          
{'loss': '0.08633', 'grad_norm': '3.224', 'learning_rate': '2.708e-07', 'epoch': '0.928'}
+
 93%|█████████▎| 35230/37963 [87:04:53<8:17:52, 10.93s/it]
 93%|█████████▎| 35231/37963 [87:05:00<7:33:08,  9.95s/it]
 93%|█████████▎| 35232/37963 [87:05:08<7:01:06,  9.25s/it]
 93%|█████████▎| 35233/37963 [87:05:16<6:38:47,  8.76s/it]
 93%|█████████▎| 35234/37963 [87:05:23<6:24:21,  8.45s/it]
 93%|█████████▎| 35235/37963 [87:05:31<6:13:01,  8.20s/it]
 93%|█████████▎| 35236/37963 [87:05:39<6:05:58,  8.05s/it]
 93%|█████████▎| 35237/37963 [87:05:46<5:59:40,  7.92s/it]
 93%|█████████▎| 35238/37963 [87:05:54<5:57:16,  7.87s/it]
 93%|█████████▎| 35239/37963 [87:06:02<5:54:30,  7.81s/it]
 93%|█████████▎| 35240/37963 [87:06:09<5:53:13,  7.78s/it]
                                                          
{'loss': '0.0662', 'grad_norm': '2.758', 'learning_rate': '2.688e-07', 'epoch': '0.9283'}
+
 93%|█████████▎| 35240/37963 [87:06:09<5:53:13,  7.78s/it]
 93%|█████████▎| 35241/37963 [87:06:24<7:20:05,  9.70s/it]
 93%|█████████▎| 35242/37963 [87:06:31<6:51:48,  9.08s/it]
 93%|█████████▎| 35243/37963 [87:06:46<8:05:34, 10.71s/it]
 93%|█████████▎| 35244/37963 [87:06:54<7:27:19,  9.87s/it]
 93%|█████████▎| 35245/37963 [87:07:01<6:56:54,  9.20s/it]
 93%|█████████▎| 35246/37963 [87:07:09<6:35:56,  8.74s/it]
 93%|█████████▎| 35247/37963 [87:07:17<6:20:18,  8.40s/it]
 93%|█████████▎| 35248/37963 [87:07:31<7:44:36, 10.27s/it]
 93%|█████████▎| 35249/37963 [87:07:45<8:38:09, 11.46s/it]
 93%|█████████▎| 35250/37963 [87:07:53<7:46:47, 10.32s/it]
                                                          
{'loss': '0.07255', 'grad_norm': '3.563', 'learning_rate': '2.669e-07', 'epoch': '0.9285'}
+
 93%|█████████▎| 35250/37963 [87:07:53<7:46:47, 10.32s/it]
 93%|█████████▎| 35251/37963 [87:08:01<7:10:54,  9.53s/it]
 93%|█████████▎| 35252/37963 [87:08:09<6:49:22,  9.06s/it]
 93%|█████████▎| 35253/37963 [87:08:16<6:32:10,  8.68s/it]
 93%|█████████▎| 35254/37963 [87:08:24<6:18:07,  8.37s/it]
 93%|█████████▎| 35255/37963 [87:08:32<6:07:21,  8.14s/it]
 93%|█████████▎| 35256/37963 [87:08:39<5:58:05,  7.94s/it]
 93%|█████████▎| 35257/37963 [87:08:47<5:51:32,  7.79s/it]
 93%|█████████▎| 35258/37963 [87:08:54<5:50:33,  7.78s/it]
 93%|█████████▎| 35259/37963 [87:09:02<5:48:47,  7.74s/it]
 93%|█████████▎| 35260/37963 [87:09:10<5:47:37,  7.72s/it]
                                                          
{'loss': '0.08207', 'grad_norm': '3.267', 'learning_rate': '2.649e-07', 'epoch': '0.9288'}
+
 93%|█████████▎| 35260/37963 [87:09:10<5:47:37,  7.72s/it]
 93%|█████████▎| 35261/37963 [87:09:18<5:48:40,  7.74s/it]
 93%|█████████▎| 35262/37963 [87:09:25<5:47:08,  7.71s/it]
 93%|█████████▎| 35263/37963 [87:09:33<5:45:12,  7.67s/it]
 93%|█████████▎| 35264/37963 [87:09:40<5:43:38,  7.64s/it]
 93%|█████████▎| 35265/37963 [87:09:48<5:47:07,  7.72s/it]
 93%|█████████▎| 35266/37963 [87:10:03<7:27:24,  9.95s/it]
 93%|█████████▎| 35267/37963 [87:10:18<8:30:04, 11.35s/it]
 93%|█████████▎| 35268/37963 [87:10:26<7:41:31, 10.28s/it]
 93%|█████████▎| 35269/37963 [87:10:33<7:05:23,  9.47s/it]
 93%|█████████▎| 35270/37963 [87:10:41<6:39:15,  8.90s/it]
                                                          
{'loss': '0.08328', 'grad_norm': '3.895', 'learning_rate': '2.63e-07', 'epoch': '0.9291'}
+
 93%|█████████▎| 35270/37963 [87:10:41<6:39:15,  8.90s/it]
 93%|█████████▎| 35271/37963 [87:10:49<6:24:52,  8.58s/it]
 93%|█████████▎| 35272/37963 [87:10:57<6:14:06,  8.34s/it]
 93%|█████████▎| 35273/37963 [87:11:04<6:06:01,  8.16s/it]
 93%|█████████▎| 35274/37963 [87:11:19<7:34:46, 10.15s/it]
 93%|█████████▎| 35275/37963 [87:11:27<7:01:15,  9.40s/it]
 93%|█████████▎| 35276/37963 [87:11:41<8:03:21, 10.79s/it]
 93%|█████████▎| 35277/37963 [87:11:48<7:22:10,  9.88s/it]
 93%|��████████▎| 35278/37963 [87:11:56<6:50:19,  9.17s/it]
 93%|█████████▎| 35279/37963 [87:12:04<6:30:08,  8.72s/it]
 93%|█████████▎| 35280/37963 [87:12:11<6:16:10,  8.41s/it]
                                                          
{'loss': '0.08589', 'grad_norm': '3.53', 'learning_rate': '2.61e-07', 'epoch': '0.9293'}
+
 93%|█████████▎| 35280/37963 [87:12:11<6:16:10,  8.41s/it]
 93%|█████████▎| 35281/37963 [87:12:19<6:07:49,  8.23s/it]
 93%|█████████▎| 35282/37963 [87:12:27<6:00:30,  8.07s/it]
 93%|█████████▎| 35283/37963 [87:12:35<5:55:52,  7.97s/it]
 93%|█████████▎| 35284/37963 [87:12:42<5:51:08,  7.86s/it]
 93%|█████████▎| 35285/37963 [87:12:50<5:49:54,  7.84s/it]
 93%|█████████▎| 35286/37963 [87:12:58<5:48:59,  7.82s/it]
 93%|█████████▎| 35287/37963 [87:13:05<5:44:57,  7.73s/it]
 93%|█████████▎| 35288/37963 [87:13:13<5:43:26,  7.70s/it]
 93%|█████████▎| 35289/37963 [87:13:21<5:44:07,  7.72s/it]
 93%|█████████▎| 35290/37963 [87:13:28<5:44:51,  7.74s/it]
                                                          
{'loss': '0.06922', 'grad_norm': '4.171', 'learning_rate': '2.591e-07', 'epoch': '0.9296'}
+
 93%|█████████▎| 35290/37963 [87:13:29<5:44:51,  7.74s/it]
 93%|█████████▎| 35291/37963 [87:13:36<5:44:03,  7.73s/it]
 93%|█████████▎| 35292/37963 [87:13:44<5:43:43,  7.72s/it]
 93%|█████████▎| 35293/37963 [87:13:52<5:42:39,  7.70s/it]
 93%|█████████▎| 35294/37963 [87:13:59<5:42:21,  7.70s/it]
 93%|█████████▎| 35295/37963 [87:14:20<8:41:52, 11.74s/it]
 93%|█████████▎| 35296/37963 [87:14:28<7:44:58, 10.46s/it]
 93%|█████████▎| 35297/37963 [87:14:49<10:04:18, 13.60s/it]
 93%|█████████▎| 35298/37963 [87:14:57<8:48:38, 11.90s/it] 
 93%|█████████▎| 35299/37963 [87:15:04<7:52:00, 10.63s/it]
 93%|█████████▎| 35300/37963 [87:15:12<7:12:15,  9.74s/it]
                                                          
{'loss': '0.07975', 'grad_norm': '3.071', 'learning_rate': '2.572e-07', 'epoch': '0.9299'}
+
 93%|█████████▎| 35300/37963 [87:15:12<7:12:15,  9.74s/it]
 93%|█████████▎| 35301/37963 [87:15:20<6:44:48,  9.12s/it]
 93%|█████████▎| 35302/37963 [87:15:27<6:23:35,  8.65s/it]
 93%|█████████▎| 35303/37963 [87:15:35<6:09:35,  8.34s/it]
 93%|█████████▎| 35304/37963 [87:15:43<6:01:48,  8.16s/it]
 93%|█████████▎| 35305/37963 [87:15:50<5:55:31,  8.03s/it]
 93%|█████████▎| 35306/37963 [87:15:58<5:50:19,  7.91s/it]
 93%|█████████▎| 35307/37963 [87:16:06<5:47:05,  7.84s/it]
 93%|█████████▎| 35308/37963 [87:16:13<5:45:21,  7.80s/it]
 93%|█████████▎| 35309/37963 [87:16:21<5:45:10,  7.80s/it]
 93%|█████████▎| 35310/37963 [87:16:29<5:44:29,  7.79s/it]
                                                          
{'loss': '0.07646', 'grad_norm': '4.569', 'learning_rate': '2.552e-07', 'epoch': '0.9301'}
+
 93%|█████████▎| 35310/37963 [87:16:29<5:44:29,  7.79s/it]
 93%|█████████▎| 35311/37963 [87:16:37<5:43:04,  7.76s/it]
 93%|█████████▎| 35312/37963 [87:16:44<5:41:37,  7.73s/it]
 93%|█████████▎| 35313/37963 [87:16:52<5:41:30,  7.73s/it]
 93%|█████████▎| 35314/37963 [87:17:07<7:17:12,  9.90s/it]
 93%|█████████▎| 35315/37963 [87:17:21<8:14:59, 11.22s/it]
 93%|█████████▎| 35316/37963 [87:17:29<7:26:40, 10.12s/it]
 93%|█████████▎| 35317/37963 [87:17:36<6:52:52,  9.36s/it]
 93%|█████████▎| 35318/37963 [87:17:44<6:30:32,  8.86s/it]
 93%|█████████▎| 35319/37963 [87:17:52<6:15:50,  8.53s/it]
 93%|█████████▎| 35320/37963 [87:18:00<6:04:40,  8.28s/it]
                                                          
{'loss': '0.07725', 'grad_norm': '3.559', 'learning_rate': '2.533e-07', 'epoch': '0.9304'}
+
 93%|█████████▎| 35320/37963 [87:18:00<6:04:40,  8.28s/it]
 93%|█████████▎| 35321/37963 [87:18:07<5:55:13,  8.07s/it]
 93%|█████████▎| 35322/37963 [87:18:15<5:46:53,  7.88s/it]
 93%|█████████▎| 35323/37963 [87:18:29<7:16:23,  9.92s/it]
 93%|█████████▎| 35324/37963 [87:18:37<6:47:58,  9.28s/it]
 93%|█████████▎| 35325/37963 [87:18:51<7:52:50, 10.75s/it]
 93%|█████████▎| 35326/37963 [87:18:59<7:12:29,  9.84s/it]
 93%|█████████▎| 35327/37963 [87:19:07<6:45:43,  9.24s/it]
 93%|█████��███▎| 35328/37963 [87:19:15<6:26:59,  8.81s/it]
 93%|█████████▎| 35329/37963 [87:19:22<6:12:44,  8.49s/it]
 93%|█████████▎| 35330/37963 [87:19:30<6:00:29,  8.21s/it]
                                                          
{'loss': '0.08535', 'grad_norm': '3.469', 'learning_rate': '2.514e-07', 'epoch': '0.9306'}
+
 93%|█████████▎| 35330/37963 [87:19:30<6:00:29,  8.21s/it]
 93%|█████████▎| 35331/37963 [87:19:38<5:53:16,  8.05s/it]
 93%|█████████▎| 35332/37963 [87:19:45<5:49:46,  7.98s/it]
 93%|█████████▎| 35333/37963 [87:19:53<5:45:24,  7.88s/it]
 93%|█████████▎| 35334/37963 [87:20:01<5:43:58,  7.85s/it]
 93%|█████████▎| 35335/37963 [87:20:08<5:39:29,  7.75s/it]
 93%|█████████▎| 35336/37963 [87:20:16<5:35:42,  7.67s/it]
 93%|█████████▎| 35337/37963 [87:20:24<5:36:07,  7.68s/it]
 93%|█████████▎| 35338/37963 [87:20:31<5:34:42,  7.65s/it]
 93%|█████████▎| 35339/37963 [87:20:39<5:35:51,  7.68s/it]
 93%|█████████▎| 35340/37963 [87:20:46<5:33:15,  7.62s/it]
                                                          
{'loss': '0.08193', 'grad_norm': '3.037', 'learning_rate': '2.495e-07', 'epoch': '0.9309'}
+
 93%|█████████▎| 35340/37963 [87:20:46<5:33:15,  7.62s/it]
 93%|█████████▎| 35341/37963 [87:21:01<7:02:32,  9.67s/it]
 93%|█████████▎| 35342/37963 [87:21:09<6:36:43,  9.08s/it]
 93%|█████████▎| 35343/37963 [87:21:16<6:16:37,  8.62s/it]
 93%|█████████▎| 35344/37963 [87:21:24<6:04:02,  8.34s/it]
 93%|█████████▎| 35345/37963 [87:21:32<5:56:35,  8.17s/it]
 93%|█████████▎| 35346/37963 [87:21:46<7:19:08, 10.07s/it]
 93%|█████████▎| 35347/37963 [87:21:54<6:50:32,  9.42s/it]
 93%|█████████▎| 35348/37963 [87:22:08<7:56:44, 10.94s/it]
 93%|█████████▎| 35349/37963 [87:22:23<8:38:26, 11.90s/it]
 93%|█████████▎| 35350/37963 [87:22:30<7:45:10, 10.68s/it]
                                                          
{'loss': '0.08309', 'grad_norm': '3.584', 'learning_rate': '2.476e-07', 'epoch': '0.9312'}
+
 93%|█████████▎| 35350/37963 [87:22:30<7:45:10, 10.68s/it]
 93%|█████████▎| 35351/37963 [87:22:38<7:06:34,  9.80s/it]
 93%|█████████▎| 35352/37963 [87:22:46<6:35:37,  9.09s/it]
 93%|█████████▎| 35353/37963 [87:22:53<6:17:11,  8.67s/it]
 93%|█████████▎| 35354/37963 [87:23:01<6:04:10,  8.38s/it]
 93%|█████████▎| 35355/37963 [87:23:09<5:53:51,  8.14s/it]
 93%|█████████▎| 35356/37963 [87:23:16<5:48:02,  8.01s/it]
 93%|█████████▎| 35357/37963 [87:23:24<5:43:43,  7.91s/it]
 93%|█████████▎| 35358/37963 [87:23:32<5:39:09,  7.81s/it]
 93%|█████████▎| 35359/37963 [87:23:46<7:07:25,  9.85s/it]
 93%|█████████▎| 35360/37963 [87:23:54<6:42:58,  9.29s/it]
                                                          
{'loss': '0.07844', 'grad_norm': '3.876', 'learning_rate': '2.458e-07', 'epoch': '0.9314'}
+
 93%|█████████▎| 35360/37963 [87:23:54<6:42:58,  9.29s/it]
 93%|█████████▎| 35361/37963 [87:24:02<6:22:44,  8.83s/it]
 93%|█████████▎| 35362/37963 [87:24:10<6:08:08,  8.49s/it]
 93%|█████████▎| 35363/37963 [87:24:17<5:59:11,  8.29s/it]
 93%|█████████▎| 35364/37963 [87:24:25<5:51:31,  8.12s/it]
 93%|█████████▎| 35365/37963 [87:24:33<5:46:06,  7.99s/it]
 93%|█████████▎| 35366/37963 [87:24:40<5:41:50,  7.90s/it]
 93%|█████████▎| 35367/37963 [87:24:48<5:38:44,  7.83s/it]
 93%|█████████▎| 35368/37963 [87:25:03<7:11:20,  9.97s/it]
 93%|█████████▎| 35369/37963 [87:25:11<6:42:25,  9.31s/it]
 93%|█████████▎| 35370/37963 [87:25:19<6:21:59,  8.84s/it]
                                                          
{'loss': '0.08861', 'grad_norm': '3.084', 'learning_rate': '2.439e-07', 'epoch': '0.9317'}
+
 93%|█████████▎| 35370/37963 [87:25:19<6:21:59,  8.84s/it]
 93%|█████████▎| 35371/37963 [87:25:26<6:07:36,  8.51s/it]
 93%|█████████▎| 35372/37963 [87:25:34<5:56:03,  8.25s/it]
 93%|█████████▎| 35373/37963 [87:25:42<5:48:52,  8.08s/it]
 93%|█████████▎| 35374/37963 [87:25:49<5:41:55,  7.92s/it]
 93%|█████████▎| 35375/37963 [87:26:04<7:06:20,  9.88s/it]
 93%|█████████▎| 35376/37963 [87:26:11<6:38:18,  9.24s/it]
 93%|█████████▎| 35377/37963 [87:26:19<6:15:15,  8.71s/it]
 93%|█████████▎| 35378/37963 [87:26:33<7:25:56, 10.35s/it]
 93%|█████████▎| 35379/37963 [87:26:41<6:51:55,  9.56s/it]
 93%|█████████▎| 35380/37963 [87:26:49<6:29:11,  9.04s/it]
                                                          
{'loss': '0.0819', 'grad_norm': '3.781', 'learning_rate': '2.42e-07', 'epoch': '0.932'}
+
 93%|█████████▎| 35380/37963 [87:26:49<6:29:11,  9.04s/it]
 93%|█████████▎| 35381/37963 [87:26:56<6:13:30,  8.68s/it]
 93%|█████████▎| 35382/37963 [87:27:04<5:57:33,  8.31s/it]
 93%|█████████▎| 35383/37963 [87:27:12<5:48:32,  8.11s/it]
 93%|█████████▎| 35384/37963 [87:27:19<5:42:56,  7.98s/it]
 93%|█████████▎| 35385/37963 [87:27:27<5:38:22,  7.88s/it]
 93%|█████████▎| 35386/37963 [87:27:35<5:36:48,  7.84s/it]
 93%|█████████▎| 35387/37963 [87:27:42<5:34:58,  7.80s/it]
 93%|█████████▎| 35388/37963 [87:27:50<5:29:27,  7.68s/it]
 93%|█████████▎| 35389/37963 [87:27:57<5:25:48,  7.59s/it]
 93%|█████████▎| 35390/37963 [87:28:12<6:53:41,  9.65s/it]
                                                          
{'loss': '0.08306', 'grad_norm': '4.939', 'learning_rate': '2.401e-07', 'epoch': '0.9322'}
+
 93%|█████████▎| 35390/37963 [87:28:12<6:53:41,  9.65s/it]
 93%|█████████▎| 35391/37963 [87:28:19<6:30:08,  9.10s/it]
 93%|█████████▎| 35392/37963 [87:28:34<7:44:25, 10.84s/it]
 93%|█████████▎| 35393/37963 [87:28:42<7:05:26,  9.93s/it]
 93%|█████████▎| 35394/37963 [87:28:56<8:00:19, 11.22s/it]
 93%|█████████▎| 35395/37963 [87:29:04<7:12:38, 10.11s/it]
 93%|█████████▎| 35396/37963 [87:29:11<6:38:55,  9.32s/it]
 93%|█████████▎| 35397/37963 [87:29:19<6:14:01,  8.75s/it]
 93%|█████████▎| 35398/37963 [87:29:33<7:21:47, 10.33s/it]
 93%|█████████▎| 35399/37963 [87:29:40<6:47:23,  9.53s/it]
 93%|█████████▎| 35400/37963 [87:29:48<6:24:08,  8.99s/it]
                                                          
{'loss': '0.08596', 'grad_norm': '2.744', 'learning_rate': '2.383e-07', 'epoch': '0.9325'}
+
 93%|█████████▎| 35400/37963 [87:29:48<6:24:08,  8.99s/it]
 93%|█████████▎| 35401/37963 [87:29:56<6:06:46,  8.59s/it]
 93%|█████████▎| 35402/37963 [87:30:03<5:54:00,  8.29s/it]
 93%|█████████▎| 35403/37963 [87:30:11<5:43:42,  8.06s/it]
 93%|█████████▎| 35404/37963 [87:30:19<5:37:24,  7.91s/it]
 93%|█████████▎| 35405/37963 [87:30:26<5:31:52,  7.78s/it]
 93%|█████████▎| 35406/37963 [87:30:34<5:29:44,  7.74s/it]
 93%|█████████▎| 35407/37963 [87:30:48<6:55:29,  9.75s/it]
 93%|█████████▎| 35408/37963 [87:30:56<6:32:01,  9.21s/it]
 93%|█████████▎| 35409/37963 [87:31:04<6:11:06,  8.72s/it]
 93%|█████████▎| 35410/37963 [87:31:11<5:57:40,  8.41s/it]
                                                          
{'loss': '0.0821', 'grad_norm': '4.373', 'learning_rate': '2.364e-07', 'epoch': '0.9328'}
+
 93%|█████████▎| 35410/37963 [87:31:11<5:57:40,  8.41s/it]
 93%|█████████▎| 35411/37963 [87:31:19<5:45:42,  8.13s/it]
 93%|█████████▎| 35412/37963 [87:31:27<5:41:01,  8.02s/it]
 93%|█████████▎| 35413/37963 [87:31:34<5:36:05,  7.91s/it]
 93%|█████████▎| 35414/37963 [87:31:42<5:31:53,  7.81s/it]
 93%|█████████▎| 35415/37963 [87:31:49<5:30:50,  7.79s/it]
 93%|█████████▎| 35416/37963 [87:31:57<5:28:12,  7.73s/it]
 93%|█████████▎| 35417/37963 [87:32:05<5:25:14,  7.66s/it]
 93%|█████████▎| 35418/37963 [87:32:12<5:25:50,  7.68s/it]
 93%|█████████▎| 35419/37963 [87:32:20<5:26:52,  7.71s/it]
 93%|█████████▎| 35420/37963 [87:32:35<6:57:49,  9.86s/it]
                                                          
{'loss': '0.07747', 'grad_norm': '3.601', 'learning_rate': '2.346e-07', 'epoch': '0.933'}
+
 93%|█████████▎| 35420/37963 [87:32:35<6:57:49,  9.86s/it]
 93%|█████████▎| 35421/37963 [87:32:50<8:06:59, 11.49s/it]
 93%|█████████▎| 35422/37963 [87:32:58<7:20:22, 10.40s/it]
 93%|█████████▎| 35423/37963 [87:33:06<6:46:14,  9.60s/it]
 93%|█████████▎| 35424/37963 [87:33:14<6:22:09,  9.03s/it]
 93%|█████████▎| 35425/37963 [87:33:21<6:04:55,  8.63s/it]
 93%|█████████▎| 35426/37963 [87:33:29<5:51:29,  8.31s/it]
 93%|█████████▎| 35427/37963 [87:33:43<7:09:25, 10.16s/it]
 93%|█████████▎| 35428/37963 [87:33:51<6:39:27,  9.45s/it]
 93%|█████████▎| 35429/37963 [87:33:59<6:16:30,  8.91s/it]
 93%|█████████▎| 35430/37963 [87:34:06<5:56:02,  8.43s/it]
                                                          
{'loss': '0.08126', 'grad_norm': '2.513', 'learning_rate': '2.328e-07', 'epoch': '0.9333'}
+
 93%|█████████▎| 35430/37963 [87:34:06<5:56:02,  8.43s/it]
 93%|█████████▎| 35431/37963 [87:34:14<5:46:19,  8.21s/it]
 93%|█████████▎| 35432/37963 [87:34:21<5:40:05,  8.06s/it]
 93%|█████████▎| 35433/37963 [87:34:36<6:57:26,  9.90s/it]
 93%|█████████▎| 35434/37963 [87:34:44<6:31:51,  9.30s/it]
 93%|█████████▎| 35435/37963 [87:34:51<6:11:40,  8.82s/it]
 93%|█████████▎| 35436/37963 [87:34:59<5:55:26,  8.44s/it]
 93%|█████████▎| 35437/37963 [87:35:06<5:43:33,  8.16s/it]
 93%|█████████▎| 35438/37963 [87:35:21<7:04:25, 10.09s/it]
 93%|█████████▎| 35439/37963 [87:35:29<6:36:55,  9.44s/it]
 93%|█████████▎| 35440/37963 [87:35:36<6:14:27,  8.91s/it]
                                                          
{'loss': '0.08011', 'grad_norm': '3.017', 'learning_rate': '2.309e-07', 'epoch': '0.9335'}
+
 93%|█████████▎| 35440/37963 [87:35:36<6:14:27,  8.91s/it]
 93%|█████████▎| 35441/37963 [87:35:51<7:21:22, 10.50s/it]
 93%|█████████▎| 35442/37963 [87:36:05<8:08:02, 11.62s/it]
 93%|█████████▎| 35443/37963 [87:36:13<7:17:56, 10.43s/it]
 93%|█████████▎| 35444/37963 [87:36:20<6:42:37,  9.59s/it]
 93%|█████████▎| 35445/37963 [87:36:28<6:19:24,  9.04s/it]
 93%|█████████▎| 35446/37963 [87:36:36<6:02:16,  8.64s/it]
 93%|█████████▎| 35447/37963 [87:36:43<5:50:19,  8.35s/it]
 93%|█████████▎| 35448/37963 [87:36:51<5:41:52,  8.16s/it]
 93%|█████████▎| 35449/37963 [87:36:59<5:33:30,  7.96s/it]
 93%|█████████▎| 35450/37963 [87:37:06<5:31:01,  7.90s/it]
                                                          
{'loss': '0.07068', 'grad_norm': '4.693', 'learning_rate': '2.291e-07', 'epoch': '0.9338'}
+
 93%|█████████▎| 35450/37963 [87:37:06<5:31:01,  7.90s/it]
 93%|█████████▎| 35451/37963 [87:37:14<5:27:46,  7.83s/it]
 93%|█████████▎| 35452/37963 [87:37:22<5:25:32,  7.78s/it]
 93%|█████████▎| 35453/37963 [87:37:29<5:18:52,  7.62s/it]
 93%|█████████▎| 35454/37963 [87:37:43<6:43:30,  9.65s/it]
 93%|█████████▎| 35455/37963 [87:37:51<6:20:49,  9.11s/it]
 93%|█████████▎| 35456/37963 [87:37:59<6:05:28,  8.75s/it]
 93%|█████████▎| 35457/37963 [87:38:07<5:50:47,  8.40s/it]
 93%|█████████▎| 35458/37963 [87:38:14<5:40:13,  8.15s/it]
 93%|█████████▎| 35459/37963 [87:38:22<5:33:23,  7.99s/it]
 93%|█████████▎| 35460/37963 [87:38:29<5:29:03,  7.89s/it]
                                                          
{'loss': '0.07269', 'grad_norm': '3.824', 'learning_rate': '2.273e-07', 'epoch': '0.9341'}
+
 93%|█████████▎| 35460/37963 [87:38:29<5:29:03,  7.89s/it]
 93%|█████████▎| 35461/37963 [87:38:37<5:25:34,  7.81s/it]
 93%|█████████▎| 35462/37963 [87:38:45<5:24:00,  7.77s/it]
 93%|█████████▎| 35463/37963 [87:38:53<5:24:11,  7.78s/it]
 93%|█████████▎| 35464/37963 [87:39:08<6:55:14,  9.97s/it]
 93%|█████████▎| 35465/37963 [87:39:15<6:25:41,  9.26s/it]
 93%|█████████▎| 35466/37963 [87:39:23<6:04:16,  8.75s/it]
 93%|█████████▎| 35467/37963 [87:39:30<5:47:11,  8.35s/it]
 93%|█████████▎| 35468/37963 [87:39:38<5:35:01,  8.06s/it]
 93%|█████████▎| 35469/37963 [87:39:53<7:03:55, 10.20s/it]
 93%|█████████▎| 35470/37963 [87:40:07<7:48:53, 11.29s/it]
                                                          
{'loss': '0.08249', 'grad_norm': '4.133', 'learning_rate': '2.255e-07', 'epoch': '0.9343'}
+
 93%|█████████▎| 35470/37963 [87:40:07<7:48:53, 11.29s/it]
 93%|█████████▎| 35471/37963 [87:40:14<7:01:17, 10.14s/it]
 93%|█████████▎| 35472/37963 [87:40:22<6:30:59,  9.42s/it]
 93%|█████████▎| 35473/37963 [87:40:29<6:09:08,  8.90s/it]
 93%|█████████▎| 35474/37963 [87:40:37<5:54:00,  8.53s/it]
 93%|█████████▎| 35475/37963 [87:40:45<5:43:44,  8.29s/it]
 93%|█████████▎| 35476/37963 [87:40:52<5:34:51,  8.08s/it]
 93%|█████████▎| 35477/37963 [87:41:07<6:52:27,  9.95s/it]
 93%|█████████▎| 35478/37963 [87:41:14<6:23:00,  9.25s/it]
 93%|█████████▎| 35479/37963 [87:41:22<6:04:33,  8.81s/it]
 93%|█████████▎| 35480/37963 [87:41:30<5:49:38,  8.45s/it]
                                                          
{'loss': '0.06637', 'grad_norm': '4.361', 'learning_rate': '2.237e-07', 'epoch': '0.9346'}
+
 93%|█████████▎| 35480/37963 [87:41:30<5:49:38,  8.45s/it]
 93%|█████████▎| 35481/37963 [87:41:37<5:39:39,  8.21s/it]
 93%|█████████▎| 35482/37963 [87:41:45<5:34:44,  8.10s/it]
 93%|█████████▎| 35483/37963 [87:41:53<5:28:45,  7.95s/it]
 93%|█████████▎| 35484/37963 [87:42:00<5:23:30,  7.83s/it]
 93%|█████████▎| 35485/37963 [87:42:08<5:20:43,  7.77s/it]
 93%|█████████▎| 35486/37963 [87:42:22<6:41:13,  9.72s/it]
 93%|█████████▎| 35487/37963 [87:42:30<6:17:50,  9.16s/it]
 93%|█████████▎| 35488/37963 [87:42:38<5:57:07,  8.66s/it]
 93%|█████████▎| 35489/37963 [87:42:45<5:44:34,  8.36s/it]
 93%|█████████▎| 35490/37963 [87:42:53<5:36:03,  8.15s/it]
                                                          
{'loss': '0.07679', 'grad_norm': '4.747', 'learning_rate': '2.219e-07', 'epoch': '0.9349'}
+
 93%|█████████▎| 35490/37963 [87:42:53<5:36:03,  8.15s/it]
 93%|█████████▎| 35491/37963 [87:43:01<5:29:58,  8.01s/it]
 93%|█████████▎| 35492/37963 [87:43:08<5:27:24,  7.95s/it]
 93%|█████████▎| 35493/37963 [87:43:22<6:38:11,  9.67s/it]
 93%|█████████▎| 35494/37963 [87:43:30<6:15:27,  9.12s/it]
 93%|█████████▎| 35495/37963 [87:43:38<5:57:35,  8.69s/it]
 94%|█████████▎| 35496/37963 [87:43:52<7:04:04, 10.31s/it]
 94%|█████████▎| 35497/37963 [87:44:00<6:32:42,  9.55s/it]
 94%|█████████▎| 35498/37963 [87:44:07<6:09:38,  9.00s/it]
 94%|█████████▎| 35499/37963 [87:44:15<5:54:16,  8.63s/it]
 94%|█████████▎| 35500/37963 [87:44:23<5:41:56,  8.33s/it]
                                                          
{'loss': '0.07599', 'grad_norm': '3.578', 'learning_rate': '2.201e-07', 'epoch': '0.9351'}
+
 94%|█████████▎| 35500/37963 [87:44:23<5:41:56,  8.33s/it]
 94%|█████████▎| 35501/37963 [87:44:37<6:58:23, 10.20s/it]
 94%|█████████▎| 35502/37963 [87:44:45<6:26:10,  9.42s/it]
 94%|█████████▎| 35503/37963 [87:44:53<6:05:16,  8.91s/it]
 94%|█████████▎| 35504/37963 [87:45:00<5:50:00,  8.54s/it]
 94%|█████████▎| 35505/37963 [87:45:08<5:40:08,  8.30s/it]
 94%|█████████▎| 35506/37963 [87:45:16<5:32:55,  8.13s/it]
 94%|█████████▎| 35507/37963 [87:45:23<5:26:47,  7.98s/it]
 94%|█████████▎| 35508/37963 [87:45:31<5:22:11,  7.87s/it]
 94%|█████████▎| 35509/37963 [87:45:39<5:21:27,  7.86s/it]
 94%|█████████▎| 35510/37963 [87:45:47<5:19:29,  7.81s/it]
                                                          
{'loss': '0.0853', 'grad_norm': '2.851', 'learning_rate': '2.184e-07', 'epoch': '0.9354'}
+
 94%|█████████▎| 35510/37963 [87:45:47<5:19:29,  7.81s/it]
 94%|█████████▎| 35511/37963 [87:45:54<5:19:19,  7.81s/it]
 94%|█████████▎| 35512/37963 [87:46:02<5:18:56,  7.81s/it]
 94%|█████████▎| 35513/37963 [87:46:10<5:17:17,  7.77s/it]
 94%|█████████▎| 35514/37963 [87:46:18<5:16:46,  7.76s/it]
 94%|█████████▎| 35515/37963 [87:46:33<6:45:05,  9.93s/it]
 94%|█████████▎| 35516/37963 [87:46:40<6:17:48,  9.26s/it]
 94%|█████████▎| 35517/37963 [87:46:55<7:24:16, 10.90s/it]
 94%|█████████▎| 35518/37963 [87:47:03<6:46:49,  9.98s/it]
 94%|█████████▎| 35519/37963 [87:47:17<7:40:19, 11.30s/it]
 94%|█████████▎| 35520/37963 [87:47:25<6:55:33, 10.21s/it]
                                                          
{'loss': '0.07657', 'grad_norm': '3.307', 'learning_rate': '2.166e-07', 'epoch': '0.9357'}
+
 94%|█████████▎| 35520/37963 [87:47:25<6:55:33, 10.21s/it]
 94%|█████████▎| 35521/37963 [87:47:39<7:43:00, 11.38s/it]
 94%|█████████▎| 35522/37963 [87:47:47<6:57:23, 10.26s/it]
 94%|█████████▎| 35523/37963 [87:47:54<6:26:57,  9.52s/it]
 94%|█████████▎| 35524/37963 [87:48:02<6:07:00,  9.03s/it]
 94%|█████████▎| 35525/37963 [87:48:10<5:50:47,  8.63s/it]
 94%|█████████▎| 35526/37963 [87:48:17<5:35:19,  8.26s/it]
 94%|█████████▎| 35527/37963 [87:48:25<5:26:10,  8.03s/it]
 94%|█████████▎| 35528/37963 [87:48:33<5:22:45,  7.95s/it]
 94%|█���███████▎| 35529/37963 [87:48:40<5:19:05,  7.87s/it]
 94%|█████████▎| 35530/37963 [87:48:48<5:18:32,  7.86s/it]
                                                          
{'loss': '0.07832', 'grad_norm': '4.234', 'learning_rate': '2.148e-07', 'epoch': '0.9359'}
+
 94%|█████████▎| 35530/37963 [87:48:48<5:18:32,  7.86s/it]
 94%|█████████▎| 35531/37963 [87:48:56<5:16:58,  7.82s/it]
 94%|█████████▎| 35532/37963 [87:49:03<5:14:29,  7.76s/it]
 94%|█████████▎| 35533/37963 [87:49:11<5:12:14,  7.71s/it]
 94%|█████████▎| 35534/37963 [87:49:25<6:32:35,  9.70s/it]
 94%|█████████▎| 35535/37963 [87:49:33<6:08:06,  9.10s/it]
 94%|█████████▎| 35536/37963 [87:49:41<5:51:30,  8.69s/it]
 94%|█████████▎| 35537/37963 [87:49:55<6:53:29, 10.23s/it]
 94%|█████████▎| 35538/37963 [87:50:02<6:18:25,  9.36s/it]
 94%|█████████▎| 35539/37963 [87:50:10<5:56:44,  8.83s/it]
 94%|█████████▎| 35540/37963 [87:50:17<5:44:03,  8.52s/it]
                                                          
{'loss': '0.07321', 'grad_norm': '2.665', 'learning_rate': '2.131e-07', 'epoch': '0.9362'}
+
 94%|█████████▎| 35540/37963 [87:50:17<5:44:03,  8.52s/it]
 94%|█████████▎| 35541/37963 [87:50:25<5:34:10,  8.28s/it]
 94%|█████████▎| 35542/37963 [87:50:33<5:25:16,  8.06s/it]
 94%|█████████▎| 35543/37963 [87:50:40<5:22:21,  7.99s/it]
 94%|█████████▎| 35544/37963 [87:50:48<5:18:49,  7.91s/it]
 94%|█████████▎| 35545/37963 [87:50:56<5:14:48,  7.81s/it]
 94%|█████████▎| 35546/37963 [87:51:17<7:53:02, 11.74s/it]
 94%|█████████▎| 35547/37963 [87:51:24<7:01:17, 10.46s/it]
 94%|█████████▎| 35548/37963 [87:51:32<6:24:31,  9.55s/it]
 94%|█████████▎| 35549/37963 [87:51:39<6:01:48,  8.99s/it]
 94%|█████████▎| 35550/37963 [87:51:47<5:43:27,  8.54s/it]
                                                          
{'loss': '0.07153', 'grad_norm': '2.767', 'learning_rate': '2.113e-07', 'epoch': '0.9364'}
+
 94%|█████████▎| 35550/37963 [87:51:47<5:43:27,  8.54s/it]
 94%|█████████▎| 35551/37963 [87:51:54<5:32:48,  8.28s/it]
 94%|█████████▎| 35552/37963 [87:52:02<5:27:19,  8.15s/it]
 94%|█████████▎| 35553/37963 [87:52:10<5:21:56,  8.02s/it]
 94%|█████████▎| 35554/37963 [87:52:18<5:17:27,  7.91s/it]
 94%|█████████▎| 35555/37963 [87:52:25<5:15:06,  7.85s/it]
 94%|█████████▎| 35556/37963 [87:52:33<5:10:18,  7.74s/it]
 94%|█████████▎| 35557/37963 [87:52:41<5:09:58,  7.73s/it]
 94%|█████████▎| 35558/37963 [87:52:55<6:28:58,  9.70s/it]
 94%|█████████▎| 35559/37963 [87:53:02<6:03:48,  9.08s/it]
 94%|█████████▎| 35560/37963 [87:53:10<5:46:40,  8.66s/it]
                                                          
{'loss': '0.08089', 'grad_norm': '3.271', 'learning_rate': '2.096e-07', 'epoch': '0.9367'}
+
 94%|█████████▎| 35560/37963 [87:53:10<5:46:40,  8.66s/it]
 94%|█████████▎| 35561/37963 [87:53:18<5:32:14,  8.30s/it]
 94%|█████████▎| 35562/37963 [87:53:25<5:23:55,  8.09s/it]
 94%|█████████▎| 35563/37963 [87:53:33<5:19:13,  7.98s/it]
 94%|█████████▎| 35564/37963 [87:53:47<6:29:48,  9.75s/it]
 94%|█████████▎| 35565/37963 [87:53:55<6:06:22,  9.17s/it]
 94%|█████████▎| 35566/37963 [87:54:10<7:15:51, 10.91s/it]
 94%|█████████▎| 35567/37963 [87:54:24<7:57:53, 11.97s/it]
 94%|█████████▎| 35568/37963 [87:54:32<7:07:25, 10.71s/it]
 94%|█████████▎| 35569/37963 [87:54:39<6:29:54,  9.77s/it]
 94%|█████████▎| 35570/37963 [87:54:47<6:05:09,  9.16s/it]
                                                          
{'loss': '0.07652', 'grad_norm': '3.724', 'learning_rate': '2.078e-07', 'epoch': '0.937'}
+
 94%|█████████▎| 35570/37963 [87:54:47<6:05:09,  9.16s/it]
 94%|█████████▎| 35571/37963 [87:54:55<5:48:06,  8.73s/it]
 94%|█████████▎| 35572/37963 [87:55:02<5:34:27,  8.39s/it]
 94%|█████████▎| 35573/37963 [87:55:10<5:24:42,  8.15s/it]
 94%|█████████▎| 35574/37963 [87:55:18<5:19:10,  8.02s/it]
 94%|█████████▎| 35575/37963 [87:55:25<5:15:09,  7.92s/it]
 94%|█████████▎| 35576/37963 [87:55:33<5:12:08,  7.85s/it]
 94%|█████████▎| 35577/37963 [87:55:41<5:06:28,  7.71s/it]
 94%|█████████▎| 35578/37963 [87:55:48<5:07:16,  7.73s/it]
 94%|██████��██▎| 35579/37963 [87:55:56<5:05:26,  7.69s/it]
 94%|█████████▎| 35580/37963 [87:56:10<6:21:32,  9.61s/it]
                                                          
{'loss': '0.08133', 'grad_norm': '4.118', 'learning_rate': '2.061e-07', 'epoch': '0.9372'}
+
 94%|█████████▎| 35580/37963 [87:56:10<6:21:32,  9.61s/it]
 94%|█████████▎| 35581/37963 [87:56:18<6:00:42,  9.09s/it]
 94%|█████████▎| 35582/37963 [87:56:33<7:07:50, 10.78s/it]
 94%|█████████▎| 35583/37963 [87:56:40<6:32:26,  9.89s/it]
 94%|█████████▎| 35584/37963 [87:56:48<6:05:51,  9.23s/it]
 94%|█████████▎| 35585/37963 [87:56:56<5:48:00,  8.78s/it]
 94%|█████████▎| 35586/37963 [87:57:03<5:33:42,  8.42s/it]
 94%|█████████▎| 35587/37963 [87:57:11<5:24:40,  8.20s/it]
 94%|█████████▎| 35588/37963 [87:57:19<5:18:35,  8.05s/it]
 94%|█████████▎| 35589/37963 [87:57:27<5:14:59,  7.96s/it]
 94%|█████████▎| 35590/37963 [87:57:34<5:11:57,  7.89s/it]
                                                          
{'loss': '0.0772', 'grad_norm': '3.407', 'learning_rate': '2.044e-07', 'epoch': '0.9375'}
+
 94%|█████████▎| 35590/37963 [87:57:34<5:11:57,  7.89s/it]
 94%|█████████▍| 35591/37963 [87:57:42<5:09:57,  7.84s/it]
 94%|█████████▍| 35592/37963 [87:57:50<5:07:59,  7.79s/it]
 94%|█████████▍| 35593/37963 [87:57:57<5:06:58,  7.77s/it]
 94%|█████████▍| 35594/37963 [87:58:12<6:25:32,  9.76s/it]
 94%|█████████▍| 35595/37963 [87:58:19<5:59:47,  9.12s/it]
 94%|█████████▍| 35596/37963 [87:58:27<5:44:25,  8.73s/it]
 94%|█████████▍| 35597/37963 [87:58:35<5:32:14,  8.43s/it]
 94%|█████████▍| 35598/37963 [87:58:43<5:23:40,  8.21s/it]
 94%|█████████▍| 35599/37963 [87:58:50<5:18:31,  8.08s/it]
 94%|█████████▍| 35600/37963 [87:58:58<5:13:42,  7.97s/it]
                                                          
{'loss': '0.07075', 'grad_norm': '2.352', 'learning_rate': '2.027e-07', 'epoch': '0.9378'}
+
 94%|█████████▍| 35600/37963 [87:58:58<5:13:42,  7.97s/it]
 94%|█████████▍| 35601/37963 [87:59:13<6:29:47,  9.90s/it]
 94%|█████████▍| 35602/37963 [87:59:28<7:31:15, 11.47s/it]
 94%|█████████▍| 35603/37963 [87:59:36<6:49:00, 10.40s/it]
 94%|█████████▍| 35604/37963 [87:59:43<6:15:51,  9.56s/it]
 94%|█████████▍| 35605/37963 [87:59:51<5:54:51,  9.03s/it]
 94%|█████████▍| 35606/37963 [87:59:59<5:38:55,  8.63s/it]
 94%|█████████▍| 35607/37963 [88:00:06<5:27:39,  8.34s/it]
 94%|█████████▍| 35608/37963 [88:00:21<6:38:52, 10.16s/it]
 94%|█████████▍| 35609/37963 [88:00:28<6:09:54,  9.43s/it]
 94%|█████████▍| 35610/37963 [88:00:36<5:49:43,  8.92s/it]
                                                          
{'loss': '0.0745', 'grad_norm': '3.308', 'learning_rate': '2.01e-07', 'epoch': '0.938'}
+
 94%|█████████▍| 35610/37963 [88:00:36<5:49:43,  8.92s/it]
 94%|█████████▍| 35611/37963 [88:00:44<5:36:50,  8.59s/it]
 94%|█████████▍| 35612/37963 [88:00:51<5:21:45,  8.21s/it]
 94%|█████████▍| 35613/37963 [88:00:59<5:16:13,  8.07s/it]
 94%|█████████▍| 35614/37963 [88:01:07<5:11:17,  7.95s/it]
 94%|█████████▍| 35615/37963 [88:01:21<6:21:57,  9.76s/it]
 94%|█████████▍| 35616/37963 [88:01:28<5:58:08,  9.16s/it]
 94%|█████████▍| 35617/37963 [88:01:36<5:41:59,  8.75s/it]
 94%|█████████▍| 35618/37963 [88:01:44<5:29:07,  8.42s/it]
 94%|█████████▍| 35619/37963 [88:01:52<5:22:25,  8.25s/it]
 94%|█████████▍| 35620/37963 [88:02:07<6:38:40, 10.21s/it]
                                                          
{'loss': '0.07755', 'grad_norm': '4.03', 'learning_rate': '1.993e-07', 'epoch': '0.9383'}
+
 94%|█████████▍| 35620/37963 [88:02:07<6:38:40, 10.21s/it]
 94%|█████████▍| 35621/37963 [88:02:14<6:09:29,  9.47s/it]
 94%|█████████▍| 35622/37963 [88:02:22<5:48:46,  8.94s/it]
 94%|█████████▍| 35623/37963 [88:02:30<5:32:51,  8.53s/it]
 94%|█████████▍| 35624/37963 [88:02:44<6:39:09, 10.24s/it]
 94%|█████████▍| 35625/37963 [88:02:52<6:09:22,  9.48s/it]
 94%|█████████▍| 35626/37963 [88:02:59<5:48:33,  8.95s/it]
 94%|█████████▍| 35627/37963 [88:03:07<5:32:45,  8.55s/it]
 94%|█████████▍| 35628/37963 [88:03:15<5:22:27,  8.29s/it]
 94%|█████████▍| 35629/37963 [88:03:22<5:13:46,  8.07s/it]
 94%|█████████▍| 35630/37963 [88:03:37<6:30:32, 10.04s/it]
                                                          
{'loss': '0.08223', 'grad_norm': '3.149', 'learning_rate': '1.976e-07', 'epoch': '0.9385'}
+
 94%|█████████▍| 35630/37963 [88:03:37<6:30:32, 10.04s/it]
 94%|█████████▍| 35631/37963 [88:03:44<6:01:27,  9.30s/it]
 94%|█████████▍| 35632/37963 [88:03:52<5:42:49,  8.82s/it]
 94%|█████████▍| 35633/37963 [88:04:00<5:30:47,  8.52s/it]
 94%|█████████▍| 35634/37963 [88:04:08<5:21:05,  8.27s/it]
 94%|█████████▍| 35635/37963 [88:04:15<5:13:39,  8.08s/it]
 94%|█████████▍| 35636/37963 [88:04:23<5:09:00,  7.97s/it]
 94%|█████████▍| 35637/37963 [88:04:31<5:05:31,  7.88s/it]
 94%|█████████▍| 35638/37963 [88:04:45<6:24:16,  9.92s/it]
 94%|█████████▍| 35639/37963 [88:04:53<5:57:56,  9.24s/it]
 94%|█████████▍| 35640/37963 [88:05:01<5:39:33,  8.77s/it]
                                                          
{'loss': '0.08935', 'grad_norm': '2.939', 'learning_rate': '1.959e-07', 'epoch': '0.9388'}
+
 94%|█████████▍| 35640/37963 [88:05:01<5:39:33,  8.77s/it]
 94%|█████████▍| 35641/37963 [88:05:08<5:27:58,  8.47s/it]
 94%|█████████▍| 35642/37963 [88:05:16<5:21:23,  8.31s/it]
 94%|█████████▍| 35643/37963 [88:05:24<5:14:31,  8.13s/it]
 94%|█████████▍| 35644/37963 [88:05:32<5:09:22,  8.00s/it]
 94%|█████████▍| 35645/37963 [88:05:39<5:01:45,  7.81s/it]
 94%|█████████▍| 35646/37963 [88:05:47<5:00:28,  7.78s/it]
 94%|█████████▍| 35647/37963 [88:05:55<5:01:04,  7.80s/it]
 94%|█████████▍| 35648/37963 [88:06:09<6:14:35,  9.71s/it]
 94%|█████████▍| 35649/37963 [88:06:16<5:51:21,  9.11s/it]
 94%|█████████▍| 35650/37963 [88:06:31<6:57:57, 10.84s/it]
                                                          
{'loss': '0.08019', 'grad_norm': '2.789', 'learning_rate': '1.942e-07', 'epoch': '0.9391'}
+
 94%|█████████▍| 35650/37963 [88:06:31<6:57:57, 10.84s/it]
 94%|█████████▍| 35651/37963 [88:06:39<6:22:45,  9.93s/it]
 94%|█████████▍| 35652/37963 [88:06:53<7:06:50, 11.08s/it]
 94%|█████████▍| 35653/37963 [88:07:01<6:28:41, 10.10s/it]
 94%|█████████▍| 35654/37963 [88:07:09<6:03:06,  9.44s/it]
 94%|█████████▍| 35655/37963 [88:07:16<5:43:08,  8.92s/it]
 94%|█████████▍| 35656/37963 [88:07:24<5:30:06,  8.59s/it]
 94%|█████████▍| 35657/37963 [88:07:32<5:16:36,  8.24s/it]
 94%|█████████▍| 35658/37963 [88:07:39<5:10:06,  8.07s/it]
 94%|█████████▍| 35659/37963 [88:07:47<5:05:28,  7.96s/it]
 94%|█████████▍| 35660/37963 [88:07:54<5:00:04,  7.82s/it]
                                                          
{'loss': '0.08021', 'grad_norm': '3.189', 'learning_rate': '1.926e-07', 'epoch': '0.9393'}
+
 94%|█████████▍| 35660/37963 [88:07:54<5:00:04,  7.82s/it]
 94%|█████████▍| 35661/37963 [88:08:02<4:59:05,  7.80s/it]
 94%|█████████▍| 35662/37963 [88:08:10<4:59:51,  7.82s/it]
 94%|█████████▍| 35663/37963 [88:08:18<4:59:58,  7.83s/it]
 94%|█████████▍| 35664/37963 [88:08:25<4:55:53,  7.72s/it]
 94%|█████████▍| 35665/37963 [88:08:33<4:53:43,  7.67s/it]
 94%|█████████▍| 35666/37963 [88:08:41<4:54:48,  7.70s/it]
 94%|█████████▍| 35667/37963 [88:08:48<4:55:28,  7.72s/it]
 94%|█████████▍| 35668/37963 [88:09:03<6:18:34,  9.90s/it]
 94%|█████████▍| 35669/37963 [88:09:18<7:08:23, 11.20s/it]
 94%|█████████▍| 35670/37963 [88:09:25<6:28:28, 10.17s/it]
                                                          
{'loss': '0.06912', 'grad_norm': '2.661', 'learning_rate': '1.909e-07', 'epoch': '0.9396'}
+
 94%|█████████▍| 35670/37963 [88:09:25<6:28:28, 10.17s/it]
 94%|█████████▍| 35671/37963 [88:09:33<6:00:54,  9.45s/it]
 94%|█████████▍| 35672/37963 [88:09:48<7:00:37, 11.02s/it]
 94%|█████████▍| 35673/37963 [88:09:56<6:21:38, 10.00s/it]
 94%|█████████▍| 35674/37963 [88:10:03<5:54:35,  9.29s/it]
 94%|█████████▍| 35675/37963 [88:10:11<5:35:35,  8.80s/it]
 94%|█████████▍| 35676/37963 [88:10:18<5:22:39,  8.47s/it]
 94%|█████████▍| 35677/37963 [88:10:26<5:09:24,  8.12s/it]
 94%|█████████▍| 35678/37963 [88:10:34<5:05:20,  8.02s/it]
 94%|█████████▍| 35679/37963 [88:10:41<5:02:12,  7.94s/it]
 94%|█████████▍| 35680/37963 [88:10:49<5:00:53,  7.91s/it]
                                                          
{'loss': '0.08753', 'grad_norm': '3.354', 'learning_rate': '1.892e-07', 'epoch': '0.9399'}
+
 94%|█████████▍| 35680/37963 [88:10:49<5:00:53,  7.91s/it]
 94%|█████████▍| 35681/37963 [88:10:57<4:57:04,  7.81s/it]
 94%|█████████▍| 35682/37963 [88:11:11<6:15:00,  9.86s/it]
 94%|█████████▍| 35683/37963 [88:11:19<5:51:41,  9.26s/it]
 94%|█████████▍| 35684/37963 [88:11:27<5:33:14,  8.77s/it]
 94%|█████████▍| 35685/37963 [88:11:35<5:21:21,  8.46s/it]
 94%|█████████▍| 35686/37963 [88:11:42<5:12:27,  8.23s/it]
 94%|█████████▍| 35687/37963 [88:11:50<5:08:48,  8.14s/it]
 94%|█████████▍| 35688/37963 [88:11:58<5:03:32,  8.01s/it]
 94%|█████████▍| 35689/37963 [88:12:05<4:57:15,  7.84s/it]
 94%|█████████▍| 35690/37963 [88:12:13<4:55:07,  7.79s/it]
                                                          
{'loss': '0.08856', 'grad_norm': '3.919', 'learning_rate': '1.876e-07', 'epoch': '0.9401'}
+
 94%|█████████▍| 35690/37963 [88:12:13<4:55:07,  7.79s/it]
 94%|█████████▍| 35691/37963 [88:12:21<4:55:49,  7.81s/it]
 94%|█████████▍| 35692/37963 [88:12:29<4:54:04,  7.77s/it]
 94%|█████████▍| 35693/37963 [88:12:36<4:51:00,  7.69s/it]
 94%|█████████▍| 35694/37963 [88:12:44<4:47:38,  7.61s/it]
 94%|█████████▍| 35695/37963 [88:12:58<6:10:31,  9.80s/it]
 94%|█████████▍| 35696/37963 [88:13:06<5:42:51,  9.07s/it]
 94%|█████████▍| 35697/37963 [88:13:14<5:28:41,  8.70s/it]
 94%|█████████▍| 35698/37963 [88:13:22<5:18:54,  8.45s/it]
 94%|█████████▍| 35699/37963 [88:13:29<5:09:25,  8.20s/it]
 94%|█████████▍| 35700/37963 [88:13:37<5:04:19,  8.07s/it]
                                                          
{'loss': '0.08229', 'grad_norm': '4.091', 'learning_rate': '1.86e-07', 'epoch': '0.9404'}
+
 94%|█████████▍| 35700/37963 [88:13:37<5:04:19,  8.07s/it]
 94%|█████████▍| 35701/37963 [88:13:51<6:12:56,  9.89s/it]
 94%|█████████▍| 35702/37963 [88:14:05<7:03:11, 11.23s/it]
 94%|█████████▍| 35703/37963 [88:14:13<6:24:08, 10.20s/it]
 94%|█████████▍| 35704/37963 [88:14:21<5:56:35,  9.47s/it]
 94%|█████████▍| 35705/37963 [88:14:29<5:37:23,  8.97s/it]
 94%|█████████▍| 35706/37963 [88:14:36<5:18:43,  8.47s/it]
 94%|█████████▍| 35707/37963 [88:14:44<5:09:42,  8.24s/it]
 94%|█████████▍| 35708/37963 [88:14:51<5:03:53,  8.09s/it]
 94%|█████████▍| 35709/37963 [88:14:59<4:58:06,  7.94s/it]
 94%|█████████▍| 35710/37963 [88:15:07<4:55:49,  7.88s/it]
                                                          
{'loss': '0.08776', 'grad_norm': '3.472', 'learning_rate': '1.843e-07', 'epoch': '0.9407'}
+
 94%|█████████▍| 35710/37963 [88:15:07<4:55:49,  7.88s/it]
 94%|█████████▍| 35711/37963 [88:15:14<4:52:45,  7.80s/it]
 94%|█████████▍| 35712/37963 [88:15:22<4:51:39,  7.77s/it]
 94%|█████████▍| 35713/37963 [88:15:30<4:49:41,  7.73s/it]
 94%|█████████▍| 35714/37963 [88:15:38<4:50:03,  7.74s/it]
 94%|█████████▍| 35715/37963 [88:15:45<4:48:12,  7.69s/it]
 94%|█████████▍| 35716/37963 [88:16:00<6:04:45,  9.74s/it]
 94%|█████████▍| 35717/37963 [88:16:07<5:40:55,  9.11s/it]
 94%|█████████▍| 35718/37963 [88:16:15<5:25:04,  8.69s/it]
 94%|█████████▍| 35719/37963 [88:16:30<6:30:42, 10.45s/it]
 94%|█████████▍| 35720/37963 [88:16:44<7:19:08, 11.75s/it]
                                                          
{'loss': '0.08047', 'grad_norm': '3.025', 'learning_rate': '1.827e-07', 'epoch': '0.9409'}
+
 94%|█████████▍| 35720/37963 [88:16:44<7:19:08, 11.75s/it]
 94%|█████████▍| 35721/37963 [88:16:52<6:35:09, 10.57s/it]
 94%|█████████▍| 35722/37963 [88:17:00<6:03:22,  9.73s/it]
 94%|█████████▍| 35723/37963 [88:17:08<5:40:17,  9.12s/it]
 94%|█████████▍| 35724/37963 [88:17:15<5:25:42,  8.73s/it]
 94%|█████████▍| 35725/37963 [88:17:23<5:14:42,  8.44s/it]
 94%|█████████▍| 35726/37963 [88:17:31<5:06:47,  8.23s/it]
 94%|█████████▍| 35727/37963 [88:17:39<5:00:46,  8.07s/it]
 94%|█████████▍| 35728/37963 [88:17:46<4:57:20,  7.98s/it]
 94%|█████████▍| 35729/37963 [88:17:54<4:56:13,  7.96s/it]
 94%|█████████▍| 35730/37963 [88:18:16<7:27:26, 12.02s/it]
                                                          
{'loss': '0.08313', 'grad_norm': '3.499', 'learning_rate': '1.811e-07', 'epoch': '0.9412'}
+
 94%|█████████▍| 35730/37963 [88:18:16<7:27:26, 12.02s/it]
 94%|█████████▍| 35731/37963 [88:18:24<6:45:01, 10.89s/it]
 94%|█████████▍| 35732/37963 [88:18:32<6:09:54,  9.95s/it]
 94%|█████████▍| 35733/37963 [88:18:39<5:41:10,  9.18s/it]
 94%|█████████▍| 35734/37963 [88:18:47<5:23:48,  8.72s/it]
 94%|█████████▍| 35735/37963 [88:18:54<5:11:43,  8.39s/it]
 94%|█████████▍| 35736/37963 [88:19:02<5:04:00,  8.19s/it]
 94%|█████████▍| 35737/37963 [88:19:10<4:57:37,  8.02s/it]
 94%|█████████▍| 35738/37963 [88:19:17<4:53:29,  7.91s/it]
 94%|█████████▍| 35739/37963 [88:19:25<4:49:47,  7.82s/it]
 94%|█████████▍| 35740/37963 [88:19:33<4:49:26,  7.81s/it]
                                                          
{'loss': '0.08592', 'grad_norm': '3.29', 'learning_rate': '1.795e-07', 'epoch': '0.9414'}
+
 94%|█████████▍| 35740/37963 [88:19:33<4:49:26,  7.81s/it]
 94%|█████████▍| 35741/37963 [88:19:40<4:38:39,  7.52s/it]
 94%|█████████▍| 35742/37963 [88:19:47<4:39:20,  7.55s/it]
 94%|█████████▍| 35743/37963 [88:20:02<6:00:50,  9.75s/it]
 94%|█████████▍| 35744/37963 [88:20:10<5:35:25,  9.07s/it]
 94%|█████████▍| 35745/37963 [88:20:17<5:20:16,  8.66s/it]
 94%|█████████▍| 35746/37963 [88:20:25<5:09:06,  8.37s/it]
 94%|█████████▍| 35747/37963 [88:20:33<5:01:15,  8.16s/it]
 94%|█████████▍| 35748/37963 [88:20:41<4:57:05,  8.05s/it]
 94%|█████████▍| 35749/37963 [88:20:55<6:06:26,  9.93s/it]
 94%|█████████▍| 35750/37963 [88:21:03<5:42:41,  9.29s/it]
                                                          
{'loss': '0.08309', 'grad_norm': '2.377', 'learning_rate': '1.779e-07', 'epoch': '0.9417'}
+
 94%|█████████▍| 35750/37963 [88:21:03<5:42:41,  9.29s/it]
 94%|█████████▍| 35751/37963 [88:21:10<5:24:14,  8.79s/it]
 94%|█████████▍| 35752/37963 [88:21:18<5:11:46,  8.46s/it]
 94%|█████████▍| 35753/37963 [88:21:26<5:03:44,  8.25s/it]
 94%|█████████▍| 35754/37963 [88:21:33<4:57:30,  8.08s/it]
 94%|█████████▍| 35755/37963 [88:21:48<6:06:46,  9.97s/it]
 94%|█████████▍| 35756/37963 [88:21:55<5:41:19,  9.28s/it]
 94%|█████████▍| 35757/37963 [88:22:03<5:22:32,  8.77s/it]
 94%|█████████▍| 35758/37963 [88:22:11<5:10:03,  8.44s/it]
 94%|█████████▍| 35759/37963 [88:22:18<5:01:49,  8.22s/it]
 94%|█████████▍| 35760/37963 [88:22:26<4:55:21,  8.04s/it]
                                                          
{'loss': '0.08125', 'grad_norm': '3.593', 'learning_rate': '1.763e-07', 'epoch': '0.942'}
+
 94%|█████████▍| 35760/37963 [88:22:26<4:55:21,  8.04s/it]
 94%|█████████▍| 35761/37963 [88:22:40<5:57:36,  9.74s/it]
 94%|█████████▍| 35762/37963 [88:22:48<5:36:16,  9.17s/it]
 94%|█████████▍| 35763/37963 [88:23:02<6:32:45, 10.71s/it]
 94%|█████████▍| 35764/37963 [88:23:10<5:58:27,  9.78s/it]
 94%|█████████▍| 35765/37963 [88:23:17<5:35:03,  9.15s/it]
 94%|█████████▍| 35766/37963 [88:23:32<6:38:27, 10.88s/it]
 94%|█████████▍| 35767/37963 [88:23:40<6:04:21,  9.96s/it]
 94%|█████████▍| 35768/37963 [88:23:48<5:39:58,  9.29s/it]
 94%|█████████▍| 35769/37963 [88:23:55<5:22:44,  8.83s/it]
 94%|█████████▍| 35770/37963 [88:24:03<5:10:05,  8.48s/it]
                                                          
{'loss': '0.07245', 'grad_norm': '2.178', 'learning_rate': '1.747e-07', 'epoch': '0.9422'}
+
 94%|█████████▍| 35770/37963 [88:24:03<5:10:05,  8.48s/it]
 94%|█████████▍| 35771/37963 [88:24:11<5:01:00,  8.24s/it]
 94%|█████████▍| 35772/37963 [88:24:18<4:53:15,  8.03s/it]
 94%|█████████▍| 35773/37963 [88:24:33<6:02:44,  9.94s/it]
 94%|█████████▍| 35774/37963 [88:24:40<5:36:47,  9.23s/it]
 94%|█████████▍| 35775/37963 [88:24:48<5:21:16,  8.81s/it]
 94%|█████████▍| 35776/37963 [88:24:56<5:07:53,  8.45s/it]
 94%|█████████▍| 35777/37963 [88:25:03<4:59:05,  8.21s/it]
 94%|█████████▍| 35778/37963 [88:25:11<4:52:42,  8.04s/it]
 94%|█████████▍| 35779/37963 [88:25:19<4:48:44,  7.93s/it]
 94%|█████████▍| 35780/37963 [88:25:26<4:46:32,  7.88s/it]
                                                          
{'loss': '0.06993', 'grad_norm': '2.857', 'learning_rate': '1.731e-07', 'epoch': '0.9425'}
+
 94%|█████████▍| 35780/37963 [88:25:26<4:46:32,  7.88s/it]
 94%|█████████▍| 35781/37963 [88:25:34<4:45:29,  7.85s/it]
 94%|█████████▍| 35782/37963 [88:25:49<5:59:16,  9.88s/it]
 94%|█████████▍| 35783/37963 [88:25:56<5:34:48,  9.22s/it]
 94%|█████████▍| 35784/37963 [88:26:04<5:17:26,  8.74s/it]
 94%|█████████▍| 35785/37963 [88:26:12<5:04:34,  8.39s/it]
 94%|█████████▍| 35786/37963 [88:26:19<4:54:41,  8.12s/it]
 94%|█████████▍| 35787/37963 [88:26:34<6:04:17, 10.04s/it]
 94%|█████████▍| 35788/37963 [88:26:41<5:38:45,  9.34s/it]
 94%|█████████▍| 35789/37963 [88:26:49<5:21:31,  8.87s/it]
 94%|█████████▍| 35790/37963 [88:26:57<5:09:19,  8.54s/it]
                                                          
{'loss': '0.08458', 'grad_norm': '3.339', 'learning_rate': '1.715e-07', 'epoch': '0.9428'}
+
 94%|█████████▍| 35790/37963 [88:26:57<5:09:19,  8.54s/it]
 94%|█████████▍| 35791/37963 [88:27:05<4:59:37,  8.28s/it]
 94%|█████████▍| 35792/37963 [88:27:12<4:55:06,  8.16s/it]
 94%|█████████▍| 35793/37963 [88:27:27<5:59:53,  9.95s/it]
 94%|█████████▍| 35794/37963 [88:27:34<5:35:01,  9.27s/it]
 94%|█████████▍| 35795/37963 [88:27:42<5:17:26,  8.79s/it]
 94%|█████████▍| 35796/37963 [88:27:50<5:05:13,  8.45s/it]
 94%|█████████▍| 35797/37963 [88:27:57<4:56:58,  8.23s/it]
 94%|█████████▍| 35798/37963 [88:28:05<4:49:28,  8.02s/it]
 94%|█████████▍| 35799/37963 [88:28:13<4:45:21,  7.91s/it]
 94%|█████████▍| 35800/37963 [88:28:20<4:42:22,  7.83s/it]
                                                          
{'loss': '0.08302', 'grad_norm': '3.054', 'learning_rate': '1.699e-07', 'epoch': '0.943'}
+
 94%|█████████▍| 35800/37963 [88:28:20<4:42:22,  7.83s/it]
 94%|█████████▍| 35801/37963 [88:28:28<4:41:18,  7.81s/it]
 94%|█████████▍| 35802/37963 [88:28:35<4:37:13,  7.70s/it]
 94%|█████████▍| 35803/37963 [88:28:43<4:36:20,  7.68s/it]
 94%|█████████▍| 35804/37963 [88:28:57<5:47:04,  9.65s/it]
 94%|█████████▍| 35805/37963 [88:29:05<5:23:43,  9.00s/it]
 94%|█████████▍| 35806/37963 [88:29:13<5:11:17,  8.66s/it]
 94%|█████████▍| 35807/37963 [88:29:20<5:01:27,  8.39s/it]
 94%|█████████▍| 35808/37963 [88:29:28<4:53:36,  8.17s/it]
 94%|█████████▍| 35809/37963 [88:29:36<4:48:52,  8.05s/it]
 94%|█████████▍| 35810/37963 [88:29:50<5:54:48,  9.89s/it]
                                                          
{'loss': '0.07109', 'grad_norm': '3.11', 'learning_rate': '1.684e-07', 'epoch': '0.9433'}
+
 94%|█████████▍| 35810/37963 [88:29:50<5:54:48,  9.89s/it]
 94%|█████████▍| 35811/37963 [88:30:04<6:41:25, 11.19s/it]
 94%|█████████▍| 35812/37963 [88:30:12<6:03:24, 10.14s/it]
 94%|█████████▍| 35813/37963 [88:30:20<5:36:37,  9.39s/it]
 94%|█████████▍| 35814/37963 [88:30:27<5:18:56,  8.90s/it]
 94%|█████████▍| 35815/37963 [88:30:35<5:05:11,  8.52s/it]
 94%|█████████▍| 35816/37963 [88:30:43<4:56:12,  8.28s/it]
 94%|█████████▍| 35817/37963 [88:30:58<6:10:25, 10.36s/it]
 94%|█████████▍| 35818/37963 [88:31:06<5:41:15,  9.55s/it]
 94%|█████████▍| 35819/37963 [88:31:13<5:20:36,  8.97s/it]
 94%|█████████▍| 35820/37963 [88:31:21<5:07:43,  8.62s/it]
                                                          
{'loss': '0.08669', 'grad_norm': '3.684', 'learning_rate': '1.668e-07', 'epoch': '0.9436'}
+
 94%|█████████▍| 35820/37963 [88:31:21<5:07:43,  8.62s/it]
 94%|█████████▍| 35821/37963 [88:31:29<4:57:40,  8.34s/it]
 94%|█████████▍| 35822/37963 [88:31:36<4:51:42,  8.17s/it]
 94%|█████████▍| 35823/37963 [88:31:44<4:46:00,  8.02s/it]
 94%|█████████▍| 35824/37963 [88:31:58<5:51:28,  9.86s/it]
 94%|█████████▍| 35825/37963 [88:32:06<5:28:57,  9.23s/it]
 94%|█████████▍| 35826/37963 [88:32:13<5:09:08,  8.68s/it]
 94%|█████████▍| 35827/37963 [88:32:21<4:57:46,  8.36s/it]
 94%|█████████▍| 35828/37963 [88:32:29<4:49:56,  8.15s/it]
 94%|█████████▍| 35829/37963 [88:32:36<4:42:06,  7.93s/it]
 94%|████████��▍| 35830/37963 [88:32:51<5:54:02,  9.96s/it]
                                                          
{'loss': '0.08793', 'grad_norm': '3.09', 'learning_rate': '1.653e-07', 'epoch': '0.9438'}
+
 94%|█████████▍| 35830/37963 [88:32:51<5:54:02,  9.96s/it]
 94%|█████████▍| 35831/37963 [88:32:59<5:34:28,  9.41s/it]
 94%|█████████▍| 35832/37963 [88:33:14<6:31:36, 11.03s/it]
 94%|█████████▍| 35833/37963 [88:33:21<5:56:35, 10.04s/it]
 94%|█████████▍| 35834/37963 [88:33:29<5:28:46,  9.27s/it]
 94%|█████████▍| 35835/37963 [88:33:37<5:12:00,  8.80s/it]
 94%|█████████▍| 35836/37963 [88:33:51<6:11:06, 10.47s/it]
 94%|█████████▍| 35837/37963 [88:33:59<5:46:37,  9.78s/it]
 94%|█████████▍| 35838/37963 [88:34:07<5:24:14,  9.16s/it]
 94%|█████████▍| 35839/37963 [88:34:14<5:06:31,  8.66s/it]
 94%|█████████▍| 35840/37963 [88:34:22<4:57:02,  8.40s/it]
                                                          
{'loss': '0.08573', 'grad_norm': '2.36', 'learning_rate': '1.637e-07', 'epoch': '0.9441'}
+
 94%|█████████▍| 35840/37963 [88:34:22<4:57:02,  8.40s/it]
 94%|█████████▍| 35841/37963 [88:34:30<4:49:28,  8.19s/it]
 94%|█████████▍| 35842/37963 [88:34:37<4:42:30,  7.99s/it]
 94%|█████████▍| 35843/37963 [88:34:45<4:38:43,  7.89s/it]
 94%|█████████▍| 35844/37963 [88:34:53<4:36:13,  7.82s/it]
 94%|█████████▍| 35845/37963 [88:35:00<4:33:26,  7.75s/it]
 94%|█████████▍| 35846/37963 [88:35:08<4:32:48,  7.73s/it]
 94%|█████████▍| 35847/37963 [88:35:16<4:32:18,  7.72s/it]
 94%|█████████▍| 35848/37963 [88:35:23<4:30:58,  7.69s/it]
 94%|█████████▍| 35849/37963 [88:35:31<4:29:08,  7.64s/it]
 94%|█████████▍| 35850/37963 [88:35:39<4:32:41,  7.74s/it]
                                                          
{'loss': '0.0713', 'grad_norm': '2.933', 'learning_rate': '1.622e-07', 'epoch': '0.9443'}
+
 94%|█████████▍| 35850/37963 [88:35:39<4:32:41,  7.74s/it]
 94%|█████████▍| 35851/37963 [88:35:46<4:32:09,  7.73s/it]
 94%|█████████▍| 35852/37963 [88:35:54<4:29:50,  7.67s/it]
 94%|█████████▍| 35853/37963 [88:36:02<4:29:30,  7.66s/it]
 94%|█████████▍| 35854/37963 [88:36:09<4:30:00,  7.68s/it]
 94%|█████████▍| 35855/37963 [88:36:17<4:32:56,  7.77s/it]
 94%|█████████▍| 35856/37963 [88:36:25<4:31:38,  7.74s/it]
 94%|█████████▍| 35857/37963 [88:36:33<4:30:43,  7.71s/it]
 94%|█████████▍| 35858/37963 [88:36:47<5:44:11,  9.81s/it]
 94%|█████████▍| 35859/37963 [88:36:55<5:22:51,  9.21s/it]
 94%|█████████▍| 35860/37963 [88:37:03<5:07:02,  8.76s/it]
                                                          
{'loss': '0.08593', 'grad_norm': '3.721', 'learning_rate': '1.607e-07', 'epoch': '0.9446'}
+
 94%|█████████▍| 35860/37963 [88:37:03<5:07:02,  8.76s/it]
 94%|█████████▍| 35861/37963 [88:37:17<6:07:29, 10.49s/it]
 94%|█████████▍| 35862/37963 [88:37:25<5:39:46,  9.70s/it]
 94%|█████████▍| 35863/37963 [88:37:33<5:20:34,  9.16s/it]
 94%|█████████▍| 35864/37963 [88:37:54<7:26:48, 12.77s/it]
 94%|█████████▍| 35865/37963 [88:38:02<6:33:31, 11.25s/it]
 94%|█████████▍| 35866/37963 [88:38:10<5:55:28, 10.17s/it]
 94%|█████████▍| 35867/37963 [88:38:17<5:29:47,  9.44s/it]
 94%|█████████▍| 35868/37963 [88:38:25<5:11:21,  8.92s/it]
 94%|█████████▍| 35869/37963 [88:38:33<4:58:41,  8.56s/it]
 94%|█████████▍| 35870/37963 [88:38:41<4:51:33,  8.36s/it]
                                                          
{'loss': '0.09974', 'grad_norm': '3.266', 'learning_rate': '1.591e-07', 'epoch': '0.9449'}
+
 94%|█████████▍| 35870/37963 [88:38:41<4:51:33,  8.36s/it]
 94%|█████████▍| 35871/37963 [88:38:49<4:45:09,  8.18s/it]
 94%|█████████▍| 35872/37963 [88:38:56<4:40:33,  8.05s/it]
 94%|█████████▍| 35873/37963 [88:39:11<5:46:14,  9.94s/it]
 94%|█████████▍| 35874/37963 [88:39:18<5:23:47,  9.30s/it]
 94%|█████████▍| 35875/37963 [88:39:26<5:05:53,  8.79s/it]
 95%|█████████▍| 35876/37963 [88:39:34<4:53:50,  8.45s/it]
 95%|█████████▍| 35877/37963 [88:39:41<4:42:49,  8.13s/it]
 95%|█████████▍| 35878/37963 [88:39:56<5:52:49, 10.15s/it]
 95%|█████████▍| 35879/37963 [88:40:04<5:27:00,  9.41s/it]
 95%|█████████▍| 35880/37963 [88:40:25<7:34:23, 13.09s/it]
                                                          
{'loss': '0.07222', 'grad_norm': '3.096', 'learning_rate': '1.576e-07', 'epoch': '0.9451'}
+
 95%|█████████▍| 35880/37963 [88:40:25<7:34:23, 13.09s/it]
 95%|█████████▍| 35881/37963 [88:40:33<6:38:26, 11.48s/it]
 95%|█████████▍| 35882/37963 [88:40:41<5:59:27, 10.36s/it]
 95%|█████████▍| 35883/37963 [88:40:49<5:31:52,  9.57s/it]
 95%|█████████▍| 35884/37963 [88:40:56<5:12:59,  9.03s/it]
 95%|█████████▍| 35885/37963 [88:41:04<4:58:48,  8.63s/it]
 95%|█████████▍| 35886/37963 [88:41:12<4:48:49,  8.34s/it]
 95%|█████████▍| 35887/37963 [88:41:20<4:44:51,  8.23s/it]
 95%|█████████▍| 35888/37963 [88:41:27<4:36:56,  8.01s/it]
 95%|█████████▍| 35889/37963 [88:41:34<4:30:21,  7.82s/it]
 95%|█████████▍| 35890/37963 [88:41:42<4:27:57,  7.76s/it]
                                                          
{'loss': '0.07666', 'grad_norm': '2.588', 'learning_rate': '1.561e-07', 'epoch': '0.9454'}
+
 95%|█████████▍| 35890/37963 [88:41:42<4:27:57,  7.76s/it]
 95%|█████████▍| 35891/37963 [88:41:50<4:27:23,  7.74s/it]
 95%|█████████▍| 35892/37963 [88:41:57<4:24:21,  7.66s/it]
 95%|█████████▍| 35893/37963 [88:42:05<4:24:03,  7.65s/it]
 95%|█████████▍| 35894/37963 [88:42:13<4:24:28,  7.67s/it]
 95%|█████████▍| 35895/37963 [88:42:20<4:21:05,  7.58s/it]
 95%|█████████▍| 35896/37963 [88:42:28<4:21:19,  7.59s/it]
 95%|█████████▍| 35897/37963 [88:42:35<4:21:00,  7.58s/it]
 95%|█████████▍| 35898/37963 [88:42:43<4:21:03,  7.59s/it]
 95%|█████████▍| 35899/37963 [88:42:50<4:21:12,  7.59s/it]
 95%|█████████▍| 35900/37963 [88:42:58<4:22:12,  7.63s/it]
                                                          
{'loss': '0.07886', 'grad_norm': '3.726', 'learning_rate': '1.546e-07', 'epoch': '0.9457'}
+
 95%|█████████▍| 35900/37963 [88:42:58<4:22:12,  7.63s/it]
 95%|█████████▍| 35901/37963 [88:43:06<4:22:19,  7.63s/it]
 95%|█████████▍| 35902/37963 [88:43:13<4:22:21,  7.64s/it]
 95%|█████████▍| 35903/37963 [88:43:21<4:22:13,  7.64s/it]
 95%|█████████▍| 35904/37963 [88:43:29<4:23:41,  7.68s/it]
 95%|█████████▍| 35905/37963 [88:43:36<4:22:49,  7.66s/it]
 95%|█████████▍| 35906/37963 [88:43:51<5:29:01,  9.60s/it]
 95%|█████████▍| 35907/37963 [88:43:58<5:10:14,  9.05s/it]
 95%|█████████▍| 35908/37963 [88:44:13<6:03:11, 10.60s/it]
 95%|█████████▍| 35909/37963 [88:44:20<5:31:18,  9.68s/it]
 95%|█████████▍| 35910/37963 [88:44:28<5:10:52,  9.09s/it]
                                                          
{'loss': '0.08063', 'grad_norm': '2.83', 'learning_rate': '1.531e-07', 'epoch': '0.9459'}
+
 95%|█████████▍| 35910/37963 [88:44:28<5:10:52,  9.09s/it]
 95%|█████████▍| 35911/37963 [88:44:43<6:10:27, 10.83s/it]
 95%|█████████▍| 35912/37963 [88:44:51<5:40:02,  9.95s/it]
 95%|█████████▍| 35913/37963 [88:44:58<5:16:55,  9.28s/it]
 95%|█████████▍| 35914/37963 [88:45:06<5:01:07,  8.82s/it]
 95%|█████████▍| 35915/37963 [88:45:21<5:59:31, 10.53s/it]
 95%|█████████▍| 35916/37963 [88:45:28<5:30:49,  9.70s/it]
 95%|█████████▍| 35917/37963 [88:45:36<5:07:27,  9.02s/it]
 95%|█████████▍| 35918/37963 [88:45:43<4:54:12,  8.63s/it]
 95%|█████████▍| 35919/37963 [88:45:58<5:54:57, 10.42s/it]
 95%|█████████▍| 35920/37963 [88:46:06<5:26:46,  9.60s/it]
                                                          
{'loss': '0.07736', 'grad_norm': '2.055', 'learning_rate': '1.517e-07', 'epoch': '0.9462'}
+
 95%|█████████▍| 35920/37963 [88:46:06<5:26:46,  9.60s/it]
 95%|█████████▍| 35921/37963 [88:46:13<5:06:57,  9.02s/it]
 95%|█████████▍| 35922/37963 [88:46:21<4:56:11,  8.71s/it]
 95%|█████████▍| 35923/37963 [88:46:29<4:43:37,  8.34s/it]
 95%|█████████▍| 35924/37963 [88:46:36<4:35:52,  8.12s/it]
 95%|█████████▍| 35925/37963 [88:46:44<4:32:54,  8.03s/it]
 95%|█████████▍| 35926/37963 [88:46:59<5:41:30, 10.06s/it]
 95%|█████████▍| 35927/37963 [88:47:07<5:18:01,  9.37s/it]
 95%|█████████▍| 35928/37963 [88:47:14<5:00:25,  8.86s/it]
 95%|█████████▍| 35929/37963 [88:47:29<5:59:49, 10.61s/it]
 95%|█████████▍| 35930/37963 [88:47:37<5:29:50,  9.73s/it]
                                                          
{'loss': '0.06661', 'grad_norm': '2.322', 'learning_rate': '1.502e-07', 'epoch': '0.9465'}
+
 95%|█████████▍| 35930/37963 [88:47:37<5:29:50,  9.73s/it]
 95%|█████████▍| 35931/37963 [88:47:44<5:07:15,  9.07s/it]
 95%|█████████▍| 35932/37963 [88:47:52<4:53:40,  8.68s/it]
 95%|█████████▍| 35933/37963 [88:48:07<5:59:57, 10.64s/it]
 95%|█████████▍| 35934/37963 [88:48:15<5:30:33,  9.77s/it]
 95%|█████████▍| 35935/37963 [88:48:23<5:08:29,  9.13s/it]
 95%|█████████▍| 35936/37963 [88:48:30<4:53:07,  8.68s/it]
 95%|█████████▍| 35937/37963 [88:48:38<4:42:47,  8.37s/it]
 95%|█████████▍| 35938/37963 [88:48:46<4:36:05,  8.18s/it]
 95%|█████████▍| 35939/37963 [88:48:53<4:29:13,  7.98s/it]
 95%|█████████▍| 35940/37963 [88:49:01<4:25:37,  7.88s/it]
                                                          
{'loss': '0.07882', 'grad_norm': '2.892', 'learning_rate': '1.487e-07', 'epoch': '0.9467'}
+
 95%|█████████▍| 35940/37963 [88:49:01<4:25:37,  7.88s/it]
 95%|█████████▍| 35941/37963 [88:49:08<4:21:40,  7.76s/it]
 95%|█████████▍| 35942/37963 [88:49:16<4:20:29,  7.73s/it]
 95%|█████████▍| 35943/37963 [88:49:24<4:18:42,  7.68s/it]
 95%|█████████▍| 35944/37963 [88:49:31<4:18:31,  7.68s/it]
 95%|█████████▍| 35945/37963 [88:49:39<4:16:10,  7.62s/it]
 95%|█████████▍| 35946/37963 [88:49:46<4:16:09,  7.62s/it]
 95%|█████████▍| 35947/37963 [88:49:54<4:17:29,  7.66s/it]
 95%|█████████▍| 35948/37963 [88:50:02<4:15:50,  7.62s/it]
 95%|█████████▍| 35949/37963 [88:50:09<4:16:49,  7.65s/it]
 95%|█████████▍| 35950/37963 [88:50:17<4:16:56,  7.66s/it]
                                                          
{'loss': '0.08098', 'grad_norm': '4.59', 'learning_rate': '1.473e-07', 'epoch': '0.947'}
+
 95%|█████████▍| 35950/37963 [88:50:17<4:16:56,  7.66s/it]
 95%|█████████▍| 35951/37963 [88:50:25<4:16:00,  7.63s/it]
 95%|█████████▍| 35952/37963 [88:50:39<5:19:28,  9.53s/it]
 95%|█████████▍| 35953/37963 [88:50:46<5:01:52,  9.01s/it]
 95%|█████████▍| 35954/37963 [88:50:54<4:48:07,  8.61s/it]
 95%|█████████▍| 35955/37963 [88:51:08<5:45:29, 10.32s/it]
 95%|█████████▍| 35956/37963 [88:51:16<5:17:45,  9.50s/it]
 95%|█████████▍| 35957/37963 [88:51:24<4:59:11,  8.95s/it]
 95%|█████████▍| 35958/37963 [88:51:31<4:46:25,  8.57s/it]
 95%|█████████▍| 35959/37963 [88:51:39<4:37:43,  8.31s/it]
 95%|█████████▍| 35960/37963 [88:51:47<4:32:35,  8.17s/it]
                                                          
{'loss': '0.08319', 'grad_norm': '3.035', 'learning_rate': '1.458e-07', 'epoch': '0.9472'}
+
 95%|█████████▍| 35960/37963 [88:51:47<4:32:35,  8.17s/it]
 95%|█████████▍| 35961/37963 [88:51:55<4:26:54,  8.00s/it]
 95%|█████████▍| 35962/37963 [88:52:02<4:21:27,  7.84s/it]
 95%|█████████▍| 35963/37963 [88:52:16<5:20:21,  9.61s/it]
 95%|█████████▍| 35964/37963 [88:52:24<5:02:50,  9.09s/it]
 95%|█████████▍| 35965/37963 [88:52:39<6:03:41, 10.92s/it]
 95%|█████████▍| 35966/37963 [88:52:47<5:31:44,  9.97s/it]
 95%|█████████▍| 35967/37963 [88:52:54<5:07:04,  9.23s/it]
 95%|█████████▍| 35968/37963 [88:53:02<4:51:22,  8.76s/it]
 95%|█████████▍| 35969/37963 [88:53:09<4:37:49,  8.36s/it]
 95%|█████████▍| 35970/37963 [88:53:17<4:29:15,  8.11s/it]
                                                          
{'loss': '0.07231', 'grad_norm': '2.555', 'learning_rate': '1.443e-07', 'epoch': '0.9475'}
+
 95%|█████████▍| 35970/37963 [88:53:17<4:29:15,  8.11s/it]
 95%|█████████▍| 35971/37963 [88:53:24<4:24:38,  7.97s/it]
 95%|█████████▍| 35972/37963 [88:53:32<4:21:34,  7.88s/it]
 95%|█████████▍| 35973/37963 [88:53:46<5:24:38,  9.79s/it]
 95%|█████████▍| 35974/37963 [88:54:01<6:15:18, 11.32s/it]
 95%|█████████▍| 35975/37963 [88:54:09<5:39:25, 10.24s/it]
 95%|█████████▍| 35976/37963 [88:54:17<5:15:13,  9.52s/it]
 95%|█████████▍| 35977/37963 [88:54:24<4:57:29,  8.99s/it]
 95%|█████████▍| 35978/37963 [88:54:39<5:53:56, 10.70s/it]
 95%|█████████▍| 35979/37963 [88:54:47<5:22:47,  9.76s/it]
 95%|█████████▍| 35980/37963 [88:55:01<6:08:45, 11.16s/it]
                                                          
{'loss': '0.0736', 'grad_norm': '3.992', 'learning_rate': '1.429e-07', 'epoch': '0.9478'}
+
 95%|█████████▍| 35980/37963 [88:55:01<6:08:45, 11.16s/it]
 95%|█████████▍| 35981/37963 [88:55:09<5:33:57, 10.11s/it]
 95%|█████████▍| 35982/37963 [88:55:16<5:08:17,  9.34s/it]
 95%|█████████▍| 35983/37963 [88:55:24<4:47:43,  8.72s/it]
 95%|█████████▍| 35984/37963 [88:55:31<4:33:58,  8.31s/it]
 95%|█████████▍| 35985/37963 [88:55:39<4:27:02,  8.10s/it]
 95%|█████████▍| 35986/37963 [88:55:46<4:23:22,  7.99s/it]
 95%|█████████▍| 35987/37963 [88:55:54<4:17:38,  7.82s/it]
 95%|█████████▍| 35988/37963 [88:56:01<4:15:46,  7.77s/it]
 95%|█████████▍| 35989/37963 [88:56:09<4:13:59,  7.72s/it]
 95%|█████████▍| 35990/37963 [88:56:17<4:14:14,  7.73s/it]
                                                          
{'loss': '0.08644', 'grad_norm': '3.762', 'learning_rate': '1.415e-07', 'epoch': '0.948'}
+
 95%|█████████▍| 35990/37963 [88:56:17<4:14:14,  7.73s/it]
 95%|█████████▍| 35991/37963 [88:56:25<4:14:41,  7.75s/it]
 95%|█████████▍| 35992/37963 [88:56:32<4:12:34,  7.69s/it]
 95%|█████████▍| 35993/37963 [88:56:40<4:12:29,  7.69s/it]
 95%|█████████▍| 35994/37963 [88:56:48<4:14:05,  7.74s/it]
 95%|█████████▍| 35995/37963 [88:56:55<4:13:20,  7.72s/it]
 95%|█████████▍| 35996/37963 [88:57:03<4:12:55,  7.72s/it]
 95%|█████████▍| 35997/37963 [88:57:11<4:13:28,  7.74s/it]
 95%|█████████▍| 35998/37963 [88:57:18<4:12:45,  7.72s/it]
 95%|█████████▍| 35999/37963 [88:57:26<4:12:01,  7.70s/it]
 95%|█████████▍| 36000/37963 [88:57:41<5:18:18,  9.73s/it]
                                                          
{'loss': '0.0926', 'grad_norm': '3.703', 'learning_rate': '1.4e-07', 'epoch': '0.9483'}
+
 95%|█████████▍| 36000/37963 [88:57:41<5:18:18,  9.73s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.78s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.79s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 95%|█████████▍| 36001/37963 [88:58:37<12:58:12, 23.80s/it]
 95%|█████████▍| 36002/37963 [88:58:45<10:21:17, 19.01s/it]
 95%|█████████▍| 36003/37963 [88:58:53<8:30:34, 15.63s/it] 
 95%|█████████▍| 36004/37963 [88:59:01<7:13:10, 13.27s/it]
 95%|█████████▍| 36005/37963 [88:59:15<7:23:54, 13.60s/it]
 95%|█████████▍| 36006/37963 [88:59:23<6:25:13, 11.81s/it]
 95%|█████████▍| 36007/37963 [88:59:30<5:45:11, 10.59s/it]
 95%|█████████▍| 36008/37963 [88:59:38<5:17:20,  9.74s/it]
 95%|█████████▍| 36009/37963 [88:59:46<4:58:08,  9.16s/it]
 95%|█████████▍| 36010/37963 [89:00:00<5:49:02, 10.72s/it]
                                                          
{'loss': '0.08159', 'grad_norm': '3.368', 'learning_rate': '1.386e-07', 'epoch': '0.9486'}
+
 95%|█████████▍| 36010/37963 [89:00:00<5:49:02, 10.72s/it]
 95%|█████████▍| 36011/37963 [89:00:15<6:32:37, 12.07s/it]
 95%|█████████▍| 36012/37963 [89:00:23<5:45:49, 10.64s/it]
 95%|█████████▍| 36013/37963 [89:00:30<5:15:49,  9.72s/it]
 95%|█████████▍| 36014/37963 [89:00:38<4:54:44,  9.07s/it]
 95%|█████████▍| 36015/37963 [89:00:46<4:40:56,  8.65s/it]
 95%|█████████▍| 36016/37963 [89:00:53<4:30:22,  8.33s/it]
 95%|█████████▍| 36017/37963 [89:01:01<4:23:31,  8.12s/it]
 95%|█████████▍| 36018/37963 [89:01:08<4:19:25,  8.00s/it]
 95%|█████████▍| 36019/37963 [89:01:16<4:16:46,  7.93s/it]
 95%|█████████▍| 36020/37963 [89:01:31<5:24:13, 10.01s/it]
                                                          
{'loss': '0.08166', 'grad_norm': '2.933', 'learning_rate': '1.372e-07', 'epoch': '0.9488'}
+
 95%|█████████▍| 36020/37963 [89:01:31<5:24:13, 10.01s/it]
 95%|█████████▍| 36021/37963 [89:01:39<5:01:25,  9.31s/it]
 95%|█████████▍| 36022/37963 [89:01:46<4:45:34,  8.83s/it]
 95%|█████████▍| 36023/37963 [89:01:54<4:35:30,  8.52s/it]
 95%|█████████▍| 36024/37963 [89:02:09<5:32:13, 10.28s/it]
 95%|█████████▍| 36025/37963 [89:02:17<5:08:28,  9.55s/it]
 95%|█████████▍| 36026/37963 [89:02:24<4:48:12,  8.93s/it]
 95%|█████████▍| 36027/37963 [89:02:39<5:46:16, 10.73s/it]
 95%|█████████▍| 36028/37963 [89:02:47<5:16:55,  9.83s/it]
 95%|█████████▍| 36029/37963 [89:02:54<4:56:08,  9.19s/it]
 95%|█████████▍| 36030/37963 [89:03:02<4:41:42,  8.74s/it]
                                                          
{'loss': '0.08174', 'grad_norm': '3.536', 'learning_rate': '1.358e-07', 'epoch': '0.9491'}
+
 95%|█████████▍| 36030/37963 [89:03:02<4:41:42,  8.74s/it]
 95%|█████████▍| 36031/37963 [89:03:10<4:30:57,  8.41s/it]
 95%|█████████▍| 36032/37963 [89:03:17<4:24:50,  8.23s/it]
 95%|█████████▍| 36033/37963 [89:03:32<5:25:50, 10.13s/it]
 95%|█████████▍| 36034/37963 [89:03:40<5:01:58,  9.39s/it]
 95%|█████████▍| 36035/37963 [89:03:48<4:46:29,  8.92s/it]
 95%|█████████▍| 36036/37963 [89:03:55<4:33:47,  8.52s/it]
 95%|█████████▍| 36037/37963 [89:04:03<4:26:09,  8.29s/it]
 95%|█████████▍| 36038/37963 [89:04:10<4:17:31,  8.03s/it]
 95%|█████████▍| 36039/37963 [89:04:18<4:13:02,  7.89s/it]
 95%|█████████▍| 36040/37963 [89:04:26<4:10:50,  7.83s/it]
                                                          
{'loss': '0.07789', 'grad_norm': '3.809', 'learning_rate': '1.344e-07', 'epoch': '0.9493'}
+
 95%|█████████▍| 36040/37963 [89:04:26<4:10:50,  7.83s/it]
 95%|█████████▍| 36041/37963 [89:04:33<4:09:06,  7.78s/it]
 95%|█████████▍| 36042/37963 [89:04:41<4:06:32,  7.70s/it]
 95%|█████████▍| 36043/37963 [89:04:48<4:05:13,  7.66s/it]
 95%|█████████▍| 36044/37963 [89:04:56<4:05:03,  7.66s/it]
 95%|█████████▍| 36045/37963 [89:05:04<4:04:51,  7.66s/it]
 95%|█████████▍| 36046/37963 [89:05:11<4:04:45,  7.66s/it]
 95%|█████████▍| 36047/37963 [89:05:19<4:03:54,  7.64s/it]
 95%|█████████▍| 36048/37963 [89:05:27<4:04:31,  7.66s/it]
 95%|█████████▍| 36049/37963 [89:05:34<4:03:42,  7.64s/it]
 95%|█████████▍| 36050/37963 [89:05:42<4:03:51,  7.65s/it]
                                                          
{'loss': '0.08171', 'grad_norm': '5.369', 'learning_rate': '1.33e-07', 'epoch': '0.9496'}
+
 95%|█████████▍| 36050/37963 [89:05:42<4:03:51,  7.65s/it]
 95%|█████████▍| 36051/37963 [89:05:50<4:05:05,  7.69s/it]
 95%|█████████▍| 36052/37963 [89:05:57<4:06:17,  7.73s/it]
 95%|█████████▍| 36053/37963 [89:06:05<4:06:30,  7.74s/it]
 95%|█████████▍| 36054/37963 [89:06:19<5:08:25,  9.69s/it]
 95%|█████████▍| 36055/37963 [89:06:27<4:50:33,  9.14s/it]
 95%|█████████▍| 36056/37963 [89:06:35<4:33:13,  8.60s/it]
 95%|█████████▍| 36057/37963 [89:06:42<4:25:06,  8.35s/it]
 95%|█████████▍| 36058/37963 [89:06:50<4:19:40,  8.18s/it]
 95%|█████████▍| 36059/37963 [89:07:12<6:29:04, 12.26s/it]
 95%|█████████▍| 36060/37963 [89:07:20<5:44:02, 10.85s/it]
                                                          
{'loss': '0.07642', 'grad_norm': '2.82', 'learning_rate': '1.316e-07', 'epoch': '0.9499'}
+
 95%|█████████▍| 36060/37963 [89:07:20<5:44:02, 10.85s/it]
 95%|█████████▍| 36061/37963 [89:07:27<5:13:48,  9.90s/it]
 95%|█████████▍| 36062/37963 [89:07:35<4:54:00,  9.28s/it]
 95%|█████████▍| 36063/37963 [89:07:49<5:36:51, 10.64s/it]
 95%|█████████▍| 36064/37963 [89:08:04<6:17:22, 11.92s/it]
 95%|█████████▌| 36065/37963 [89:08:11<5:37:07, 10.66s/it]
 95%|█████████▌| 36066/37963 [89:08:19<5:08:31,  9.76s/it]
 95%|█████████▌| 36067/37963 [89:08:27<4:49:01,  9.15s/it]
 95%|█████████▌| 36068/37963 [89:08:35<4:35:10,  8.71s/it]
 95%|█████████▌| 36069/37963 [89:08:43<4:28:46,  8.51s/it]
 95%|█████████▌| 36070/37963 [89:08:50<4:18:45,  8.20s/it]
                                                          
{'loss': '0.07288', 'grad_norm': '3.631', 'learning_rate': '1.303e-07', 'epoch': '0.9501'}
+
 95%|█████████▌| 36070/37963 [89:08:50<4:18:45,  8.20s/it]
 95%|█████████▌| 36071/37963 [89:08:58<4:13:19,  8.03s/it]
 95%|█████████▌| 36072/37963 [89:09:05<4:09:56,  7.93s/it]
 95%|█████████▌| 36073/37963 [89:09:20<5:14:26,  9.98s/it]
 95%|█████████▌| 36074/37963 [89:09:28<4:52:50,  9.30s/it]
 95%|█████████▌| 36075/37963 [89:09:36<4:37:31,  8.82s/it]
 95%|█████████▌| 36076/37963 [89:09:50<5:32:04, 10.56s/it]
 95%|█████████▌| 36077/37963 [89:09:58<5:04:29,  9.69s/it]
 95%|█████████▌| 36078/37963 [89:10:05<4:44:29,  9.06s/it]
 95%|█████████▌| 36079/37963 [89:10:13<4:33:16,  8.70s/it]
 95%|█████████▌| 36080/37963 [89:10:21<4:24:33,  8.43s/it]
                                                          
{'loss': '0.07605', 'grad_norm': '1.886', 'learning_rate': '1.289e-07', 'epoch': '0.9504'}
+
 95%|█████████▌| 36080/37963 [89:10:21<4:24:33,  8.43s/it]
 95%|█████████▌| 36081/37963 [89:10:29<4:14:39,  8.12s/it]
 95%|█████████▌| 36082/37963 [89:10:36<4:10:34,  7.99s/it]
 95%|█████████▌| 36083/37963 [89:10:44<4:07:31,  7.90s/it]
 95%|█████████▌| 36084/37963 [89:10:52<4:05:24,  7.84s/it]
 95%|█████████▌| 36085/37963 [89:10:59<4:04:14,  7.80s/it]
 95%|█████████▌| 36086/37963 [89:11:07<4:01:45,  7.73s/it]
 95%|█████████▌| 36087/37963 [89:11:21<5:02:33,  9.68s/it]
 95%|█████████▌| 36088/37963 [89:11:29<4:46:27,  9.17s/it]
 95%|█████████▌| 36089/37963 [89:11:37<4:32:57,  8.74s/it]
 95%|█████████▌| 36090/37963 [89:11:45<4:23:08,  8.43s/it]
                                                          
{'loss': '0.08244', 'grad_norm': '4.382', 'learning_rate': '1.275e-07', 'epoch': '0.9507'}
+
 95%|█████████▌| 36090/37963 [89:11:45<4:23:08,  8.43s/it]
 95%|█████████▌| 36091/37963 [89:11:52<4:15:39,  8.19s/it]
 95%|█████████▌| 36092/37963 [89:12:00<4:10:21,  8.03s/it]
 95%|█████████▌| 36093/37963 [89:12:07<4:02:41,  7.79s/it]
 95%|█████████▌| 36094/37963 [89:12:15<4:01:43,  7.76s/it]
 95%|█████████▌| 36095/37963 [89:12:22<4:01:26,  7.76s/it]
 95%|█████████▌| 36096/37963 [89:12:30<4:00:30,  7.73s/it]
 95%|█████████▌| 36097/37963 [89:12:38<3:59:32,  7.70s/it]
 95%|█████████▌| 36098/37963 [89:12:46<3:59:52,  7.72s/it]
 95%|█████████▌| 36099/37963 [89:12:53<3:59:45,  7.72s/it]
 95%|█████████▌| 36100/37963 [89:13:01<3:59:51,  7.72s/it]
                                                          
{'loss': '0.0806', 'grad_norm': '2.485', 'learning_rate': '1.262e-07', 'epoch': '0.9509'}
+
 95%|█████████▌| 36100/37963 [89:13:01<3:59:51,  7.72s/it]
 95%|█████████▌| 36101/37963 [89:13:09<3:59:35,  7.72s/it]
 95%|█████████▌| 36102/37963 [89:13:23<5:02:45,  9.76s/it]
 95%|█████████▌| 36103/37963 [89:13:38<5:44:54, 11.13s/it]
 95%|█████████▌| 36104/37963 [89:13:45<5:12:16, 10.08s/it]
 95%|█████████▌| 36105/37963 [89:13:53<4:50:55,  9.39s/it]
 95%|█████████▌| 36106/37963 [89:14:01<4:35:47,  8.91s/it]
 95%|█████████▌| 36107/37963 [89:14:16<5:31:53, 10.73s/it]
 95%|█████████▌| 36108/37963 [89:14:24<5:05:46,  9.89s/it]
 95%|█████████▌| 36109/37963 [89:14:31<4:44:41,  9.21s/it]
 95%|█████████▌| 36110/37963 [89:14:39<4:30:51,  8.77s/it]
                                                          
{'loss': '0.08806', 'grad_norm': '3.643', 'learning_rate': '1.248e-07', 'epoch': '0.9512'}
+
 95%|█████████▌| 36110/37963 [89:14:39<4:30:51,  8.77s/it]
 95%|█████████▌| 36111/37963 [89:14:47<4:18:46,  8.38s/it]
 95%|█████████▌| 36112/37963 [89:15:01<5:15:30, 10.23s/it]
 95%|█████████▌| 36113/37963 [89:15:09<4:50:20,  9.42s/it]
 95%|█████████▌| 36114/37963 [89:15:16<4:33:53,  8.89s/it]
 95%|█████████▌| 36115/37963 [89:15:24<4:22:17,  8.52s/it]
 95%|█████████▌| 36116/37963 [89:15:32<4:14:10,  8.26s/it]
 95%|█████████▌| 36117/37963 [89:15:46<5:13:02, 10.17s/it]
 95%|█████████▌| 36118/37963 [89:15:54<4:52:16,  9.51s/it]
 95%|█████████▌| 36119/37963 [89:16:02<4:33:49,  8.91s/it]
 95%|█████████▌| 36120/37963 [89:16:09<4:21:34,  8.52s/it]
                                                          
{'loss': '0.07714', 'grad_norm': '3.726', 'learning_rate': '1.235e-07', 'epoch': '0.9515'}
+
 95%|█████████▌| 36120/37963 [89:16:09<4:21:34,  8.52s/it]
 95%|█████████▌| 36121/37963 [89:16:17<4:14:02,  8.27s/it]
 95%|█████████▌| 36122/37963 [89:16:25<4:08:01,  8.08s/it]
 95%|█████████▌| 36123/37963 [89:16:32<4:04:35,  7.98s/it]
 95%|█████████▌| 36124/37963 [89:16:47<5:04:49,  9.95s/it]
 95%|█████████▌| 36125/37963 [89:16:55<4:45:28,  9.32s/it]
 95%|█████████▌| 36126/37963 [89:17:10<5:36:03, 10.98s/it]
 95%|█████████▌| 36127/37963 [89:17:17<5:07:42, 10.06s/it]
 95%|█████████▌| 36128/37963 [89:17:25<4:45:59,  9.35s/it]
 95%|█████████▌| 36129/37963 [89:17:33<4:29:04,  8.80s/it]
 95%|█████████▌| 36130/37963 [89:17:40<4:18:43,  8.47s/it]
                                                          
{'loss': '0.08165', 'grad_norm': '2.486', 'learning_rate': '1.222e-07', 'epoch': '0.9517'}
+
 95%|█████████▌| 36130/37963 [89:17:40<4:18:43,  8.47s/it]
 95%|█████████▌| 36131/37963 [89:17:48<4:12:07,  8.26s/it]
 95%|█████████▌| 36132/37963 [89:17:56<4:04:28,  8.01s/it]
 95%|█████████▌| 36133/37963 [89:18:03<4:01:39,  7.92s/it]
 95%|█████████▌| 36134/37963 [89:18:11<3:56:14,  7.75s/it]
 95%|█████████▌| 36135/37963 [89:18:25<4:55:24,  9.70s/it]
 95%|█████████▌| 36136/37963 [89:18:32<4:36:10,  9.07s/it]
 95%|█████████▌| 36137/37963 [89:18:40<4:25:11,  8.71s/it]
 95%|█████████▌| 36138/37963 [89:18:48<4:13:19,  8.33s/it]
 95%|█████████▌| 36139/37963 [89:18:55<4:07:01,  8.13s/it]
 95%|█████████▌| 36140/37963 [89:19:03<4:02:02,  7.97s/it]
                                                          
{'loss': '0.09024', 'grad_norm': '2.88', 'learning_rate': '1.208e-07', 'epoch': '0.952'}
+
 95%|█████████▌| 36140/37963 [89:19:03<4:02:02,  7.97s/it]
 95%|█████████▌| 36141/37963 [89:19:11<3:59:40,  7.89s/it]
 95%|█████████▌| 36142/37963 [89:19:18<3:57:58,  7.84s/it]
 95%|█████████▌| 36143/37963 [89:19:26<3:57:45,  7.84s/it]
 95%|█████████▌| 36144/37963 [89:19:34<3:57:08,  7.82s/it]
 95%|█████████▌| 36145/37963 [89:19:42<3:56:03,  7.79s/it]
 95%|█████████▌| 36146/37963 [89:19:50<3:55:17,  7.77s/it]
 95%|█████████▌| 36147/37963 [89:19:57<3:50:00,  7.60s/it]
 95%|█████████▌| 36148/37963 [89:20:11<4:51:51,  9.65s/it]
 95%|█████████▌| 36149/37963 [89:20:19<4:32:50,  9.02s/it]
 95%|█████████▌| 36150/37963 [89:20:27<4:21:54,  8.67s/it]
                                                          
{'loss': '0.07635', 'grad_norm': '3.944', 'learning_rate': '1.195e-07', 'epoch': '0.9522'}
+
 95%|█████████▌| 36150/37963 [89:20:27<4:21:54,  8.67s/it]
 95%|█████████▌| 36151/37963 [89:20:34<4:12:33,  8.36s/it]
 95%|█████████▌| 36152/37963 [89:20:42<4:06:20,  8.16s/it]
 95%|█████████▌| 36153/37963 [89:20:49<3:58:58,  7.92s/it]
 95%|█████████▌| 36154/37963 [89:20:57<3:56:36,  7.85s/it]
 95%|█████████▌| 36155/37963 [89:21:12<5:00:25,  9.97s/it]
 95%|█████████▌| 36156/37963 [89:21:20<4:39:28,  9.28s/it]
 95%|█████████▌| 36157/37963 [89:21:34<5:22:59, 10.73s/it]
 95%|█████████▌| 36158/37963 [89:21:41<4:53:54,  9.77s/it]
 95%|█████████▌| 36159/37963 [89:21:49<4:36:09,  9.18s/it]
 95%|█████████▌| 36160/37963 [89:21:56<4:19:19,  8.63s/it]
                                                          
{'loss': '0.07661', 'grad_norm': '3.926', 'learning_rate': '1.182e-07', 'epoch': '0.9525'}
+
 95%|█████████▌| 36160/37963 [89:21:56<4:19:19,  8.63s/it]
 95%|█████████▌| 36161/37963 [89:22:11<5:09:10, 10.29s/it]
 95%|█████████▌| 36162/37963 [89:22:18<4:44:04,  9.46s/it]
 95%|█████████▌| 36163/37963 [89:22:26<4:27:37,  8.92s/it]
 95%|█████████▌| 36164/37963 [89:22:33<4:15:58,  8.54s/it]
 95%|█████████▌| 36165/37963 [89:22:41<4:09:10,  8.32s/it]
 95%|█████████▌| 36166/37963 [89:22:56<5:09:22, 10.33s/it]
 95%|█████████▌| 36167/37963 [89:23:04<4:43:34,  9.47s/it]
 95%|█████████▌| 36168/37963 [89:23:18<5:28:55, 10.99s/it]
 95%|█████████▌| 36169/37963 [89:23:26<4:58:25,  9.98s/it]
 95%|█████████▌| 36170/37963 [89:23:34<4:37:49,  9.30s/it]
                                                          
{'loss': '0.07075', 'grad_norm': '2.311', 'learning_rate': '1.169e-07', 'epoch': '0.9528'}
+
 95%|█████████▌| 36170/37963 [89:23:34<4:37:49,  9.30s/it]
 95%|█████████▌| 36171/37963 [89:23:41<4:20:57,  8.74s/it]
 95%|█████████▌| 36172/37963 [89:23:49<4:12:14,  8.45s/it]
 95%|█████████▌| 36173/37963 [89:23:57<4:06:11,  8.25s/it]
 95%|█████████▌| 36174/37963 [89:24:04<4:01:13,  8.09s/it]
 95%|█████████��| 36175/37963 [89:24:12<3:56:53,  7.95s/it]
 95%|█████████▌| 36176/37963 [89:24:20<3:55:22,  7.90s/it]
 95%|█████████▌| 36177/37963 [89:24:27<3:52:42,  7.82s/it]
 95%|█████████▌| 36178/37963 [89:24:35<3:49:29,  7.71s/it]
 95%|█████████▌| 36179/37963 [89:24:42<3:49:07,  7.71s/it]
 95%|█████████▌| 36180/37963 [89:24:50<3:49:12,  7.71s/it]
                                                          
{'loss': '0.07508', 'grad_norm': '3.693', 'learning_rate': '1.156e-07', 'epoch': '0.953'}
+
 95%|█████████▌| 36180/37963 [89:24:50<3:49:12,  7.71s/it]
 95%|█████████▌| 36181/37963 [89:25:05<4:50:02,  9.77s/it]
 95%|█████████▌| 36182/37963 [89:25:13<4:32:36,  9.18s/it]
 95%|█████████▌| 36183/37963 [89:25:20<4:19:41,  8.75s/it]
 95%|█████████▌| 36184/37963 [89:25:28<4:10:24,  8.45s/it]
 95%|█████████▌| 36185/37963 [89:25:35<4:01:38,  8.15s/it]
 95%|█████████▌| 36186/37963 [89:25:43<3:57:21,  8.01s/it]
 95%|█████████▌| 36187/37963 [89:25:51<3:53:04,  7.87s/it]
 95%|█████████▌| 36188/37963 [89:25:58<3:51:13,  7.82s/it]
 95%|█████████▌| 36189/37963 [89:26:13<4:49:56,  9.81s/it]
 95%|█████████▌| 36190/37963 [89:26:21<4:32:29,  9.22s/it]
                                                          
{'loss': '0.09243', 'grad_norm': '4.069', 'learning_rate': '1.143e-07', 'epoch': '0.9533'}
+
 95%|█████████▌| 36190/37963 [89:26:21<4:32:29,  9.22s/it]
 95%|█████████▌| 36191/37963 [89:26:28<4:19:00,  8.77s/it]
 95%|█████████▌| 36192/37963 [89:26:36<4:08:55,  8.43s/it]
 95%|█████████▌| 36193/37963 [89:26:44<4:01:27,  8.19s/it]
 95%|█████████▌| 36194/37963 [89:26:51<3:57:12,  8.05s/it]
 95%|█████████▌| 36195/37963 [89:26:59<3:53:47,  7.93s/it]
 95%|█████████▌| 36196/37963 [89:27:06<3:48:32,  7.76s/it]
 95%|█████████▌| 36197/37963 [89:27:14<3:48:50,  7.77s/it]
 95%|█████████▌| 36198/37963 [89:27:22<3:48:53,  7.78s/it]
 95%|█████████▌| 36199/37963 [89:27:37<4:51:15,  9.91s/it]
 95%|█████████▌| 36200/37963 [89:27:45<4:33:13,  9.30s/it]
                                                          
{'loss': '0.08198', 'grad_norm': '3.347', 'learning_rate': '1.13e-07', 'epoch': '0.9536'}
+
 95%|█████████▌| 36200/37963 [89:27:45<4:33:13,  9.30s/it]
 95%|█████████▌| 36201/37963 [89:27:59<5:18:11, 10.84s/it]
 95%|█████████▌| 36202/37963 [89:28:07<4:48:41,  9.84s/it]
 95%|█████████▌| 36203/37963 [89:28:14<4:30:17,  9.21s/it]
 95%|█████████▌| 36204/37963 [89:28:22<4:16:05,  8.74s/it]
 95%|█████████▌| 36205/37963 [89:28:36<5:03:31, 10.36s/it]
 95%|█████████▌| 36206/37963 [89:28:44<4:40:30,  9.58s/it]
 95%|█████████▌| 36207/37963 [89:28:52<4:24:41,  9.04s/it]
 95%|█████████▌| 36208/37963 [89:28:59<4:11:32,  8.60s/it]
 95%|█████████▌| 36209/37963 [89:29:13<5:00:08, 10.27s/it]
 95%|█████████▌| 36210/37963 [89:29:21<4:36:53,  9.48s/it]
                                                          
{'loss': '0.08153', 'grad_norm': '3.078', 'learning_rate': '1.118e-07', 'epoch': '0.9538'}
+
 95%|█████████▌| 36210/37963 [89:29:21<4:36:53,  9.48s/it]
 95%|█████████▌| 36211/37963 [89:29:29<4:18:42,  8.86s/it]
 95%|█████████▌| 36212/37963 [89:29:36<4:07:14,  8.47s/it]
 95%|█████████▌| 36213/37963 [89:29:44<4:02:03,  8.30s/it]
 95%|█████████▌| 36214/37963 [89:29:52<4:01:15,  8.28s/it]
 95%|█████████▌| 36215/37963 [89:30:00<3:56:33,  8.12s/it]
 95%|█████████▌| 36216/37963 [89:30:14<4:51:25, 10.01s/it]
 95%|█████████▌| 36217/37963 [89:30:23<4:34:34,  9.44s/it]
 95%|█████████▌| 36218/37963 [89:30:30<4:19:23,  8.92s/it]
 95%|█████████▌| 36219/37963 [89:30:45<5:10:14, 10.67s/it]
 95%|█████████▌| 36220/37963 [89:30:53<4:45:36,  9.83s/it]
                                                          
{'loss': '0.08188', 'grad_norm': '3.856', 'learning_rate': '1.105e-07', 'epoch': '0.9541'}
+
 95%|█████████▌| 36220/37963 [89:30:53<4:45:36,  9.83s/it]
 95%|█████████▌| 36221/37963 [89:31:01<4:30:10,  9.31s/it]
 95%|█████████▌| 36222/37963 [89:31:09<4:17:18,  8.87s/it]
 95%|█████████▌| 36223/37963 [89:31:17<4:07:52,  8.55s/it]
 95%|█████████▌| 36224/37963 [89:31:31<5:02:32, 10.44s/it]
 95%|█████████▌| 36225/37963 [89:31:39<4:39:18,  9.64s/it]
 95%|█████████▌| 36226/37963 [89:31:47<4:24:23,  9.13s/it]
 95%|█████████▌| 36227/37963 [89:31:55<4:12:49,  8.74s/it]
 95%|█████████▌| 36228/37963 [89:32:02<4:01:55,  8.37s/it]
 95%|█████████▌| 36229/37963 [89:32:10<3:54:08,  8.10s/it]
 95%|█████████▌| 36230/37963 [89:32:18<3:51:05,  8.00s/it]
                                                          
{'loss': '0.09461', 'grad_norm': '3.298', 'learning_rate': '1.092e-07', 'epoch': '0.9544'}
+
 95%|█████████▌| 36230/37963 [89:32:18<3:51:05,  8.00s/it]
 95%|█████████▌| 36231/37963 [89:32:25<3:48:29,  7.92s/it]
 95%|█████████▌| 36232/37963 [89:32:33<3:47:32,  7.89s/it]
 95%|█████████▌| 36233/37963 [89:32:41<3:46:09,  7.84s/it]
 95%|█████████▌| 36234/37963 [89:32:49<3:46:43,  7.87s/it]
 95%|█████████▌| 36235/37963 [89:32:57<3:44:32,  7.80s/it]
 95%|█████████▌| 36236/37963 [89:33:04<3:44:43,  7.81s/it]
 95%|█████████▌| 36237/37963 [89:33:12<3:44:23,  7.80s/it]
 95%|█████████▌| 36238/37963 [89:33:20<3:44:53,  7.82s/it]
 95%|█████████▌| 36239/37963 [89:33:28<3:43:57,  7.79s/it]
 95%|█████████▌| 36240/37963 [89:33:35<3:42:51,  7.76s/it]
                                                          
{'loss': '0.08123', 'grad_norm': '3.439', 'learning_rate': '1.08e-07', 'epoch': '0.9546'}
+
 95%|█████████▌| 36240/37963 [89:33:35<3:42:51,  7.76s/it]
 95%|█████████▌| 36241/37963 [89:33:43<3:43:20,  7.78s/it]
 95%|█████████▌| 36242/37963 [89:33:51<3:42:03,  7.74s/it]
 95%|█████████▌| 36243/37963 [89:34:06<4:41:55,  9.83s/it]
 95%|█████████▌| 36244/37963 [89:34:14<4:25:02,  9.25s/it]
 95%|█████████▌| 36245/37963 [89:34:21<4:10:41,  8.76s/it]
 95%|█████████▌| 36246/37963 [89:34:36<5:03:53, 10.62s/it]
 95%|█████████▌| 36247/37963 [89:34:44<4:38:14,  9.73s/it]
 95%|█████████▌| 36248/37963 [89:34:52<4:21:39,  9.15s/it]
 95%|█████████▌| 36249/37963 [89:34:59<4:10:29,  8.77s/it]
 95%|█████████▌| 36250/37963 [89:35:07<4:01:38,  8.46s/it]
                                                          
{'loss': '0.07502', 'grad_norm': '3.14', 'learning_rate': '1.067e-07', 'epoch': '0.9549'}
+
 95%|█████████▌| 36250/37963 [89:35:07<4:01:38,  8.46s/it]
 95%|█████████▌| 36251/37963 [89:35:15<3:53:24,  8.18s/it]
 95%|█████████▌| 36252/37963 [89:35:22<3:47:34,  7.98s/it]
 95%|█████████▌| 36253/37963 [89:35:30<3:45:46,  7.92s/it]
 95%|█████████▌| 36254/37963 [89:35:38<3:42:42,  7.82s/it]
 96%|█████████▌| 36255/37963 [89:35:52<4:41:01,  9.87s/it]
 96%|█████████▌| 36256/37963 [89:36:00<4:23:39,  9.27s/it]
 96%|█████████▌| 36257/37963 [89:36:15<5:07:41, 10.82s/it]
 96%|█████████▌| 36258/37963 [89:36:22<4:38:05,  9.79s/it]
 96%|█████████▌| 36259/37963 [89:36:36<5:14:16, 11.07s/it]
 96%|█████████▌| 36260/37963 [89:36:44<4:46:27, 10.09s/it]
                                                          
{'loss': '0.07005', 'grad_norm': '4.078', 'learning_rate': '1.055e-07', 'epoch': '0.9551'}
+
 96%|█████████▌| 36260/37963 [89:36:44<4:46:27, 10.09s/it]
 96%|█████████▌| 36261/37963 [89:36:52<4:27:01,  9.41s/it]
 96%|█████████▌| 36262/37963 [89:36:59<4:12:40,  8.91s/it]
 96%|█████████▌| 36263/37963 [89:37:14<5:00:29, 10.61s/it]
 96%|█████████▌| 36264/37963 [89:37:22<4:36:48,  9.78s/it]
 96%|█████████▌| 36265/37963 [89:37:30<4:19:21,  9.16s/it]
 96%|█████████▌| 36266/37963 [89:37:37<4:08:09,  8.77s/it]
 96%|█████████▌| 36267/37963 [89:37:52<4:58:31, 10.56s/it]
 96%|█████████▌| 36268/37963 [89:38:00<4:34:54,  9.73s/it]
 96%|█████████▌| 36269/37963 [89:38:08<4:18:28,  9.15s/it]
 96%|█████████▌| 36270/37963 [89:38:15<4:05:38,  8.71s/it]
                                                          
{'loss': '0.077', 'grad_norm': '3.43', 'learning_rate': '1.043e-07', 'epoch': '0.9554'}
+
 96%|█████████▌| 36270/37963 [89:38:15<4:05:38,  8.71s/it]
 96%|█████████▌| 36271/37963 [89:38:23<3:58:00,  8.44s/it]
 96%|█████████▌| 36272/37963 [89:38:31<3:53:02,  8.27s/it]
 96%|█████████▌| 36273/37963 [89:38:46<4:49:10, 10.27s/it]
 96%|█████████▌| 36274/37963 [89:38:54<4:27:57,  9.52s/it]
 96%|█████████▌| 36275/37963 [89:39:01<4:10:05,  8.89s/it]
 96%|█████████▌| 36276/37963 [89:39:09<3:57:54,  8.46s/it]
 96%|█████████▌| 36277/37963 [89:39:16<3:46:34,  8.06s/it]
 96%|█████████▌| 36278/37963 [89:39:23<3:41:26,  7.89s/it]
 96%|█████████▌| 36279/37963 [89:39:31<3:39:47,  7.83s/it]
 96%|█████████▌| 36280/37963 [89:39:39<3:37:27,  7.75s/it]
                                                          
{'loss': '0.08675', 'grad_norm': '4.287', 'learning_rate': '1.03e-07', 'epoch': '0.9557'}
+
 96%|█████████▌| 36280/37963 [89:39:39<3:37:27,  7.75s/it]
 96%|█████████▌| 36281/37963 [89:39:46<3:34:02,  7.64s/it]
 96%|█████████▌| 36282/37963 [89:39:54<3:34:38,  7.66s/it]
 96%|█████████▌| 36283/37963 [89:40:01<3:36:01,  7.71s/it]
 96%|█████████▌| 36284/37963 [89:40:09<3:36:01,  7.72s/it]
 96%|█████████▌| 36285/37963 [89:40:17<3:35:45,  7.72s/it]
 96%|█████████▌| 36286/37963 [89:40:25<3:35:55,  7.73s/it]
 96%|█████████▌| 36287/37963 [89:40:32<3:35:27,  7.71s/it]
 96%|█████████▌| 36288/37963 [89:40:40<3:35:35,  7.72s/it]
 96%|█████████▌| 36289/37963 [89:40:48<3:35:45,  7.73s/it]
 96%|█████████▌| 36290/37963 [89:40:55<3:33:53,  7.67s/it]
                                                          
{'loss': '0.08633', 'grad_norm': '3.538', 'learning_rate': '1.018e-07', 'epoch': '0.9559'}
+
 96%|█████████▌| 36290/37963 [89:40:55<3:33:53,  7.67s/it]
 96%|█████████▌| 36291/37963 [89:41:10<4:28:48,  9.65s/it]
 96%|█████████▌| 36292/37963 [89:41:17<4:12:42,  9.07s/it]
 96%|█████████▌| 36293/37963 [89:41:25<3:58:27,  8.57s/it]
 96%|█████████▌| 36294/37963 [89:41:32<3:51:29,  8.32s/it]
 96%|█████████▌| 36295/37963 [89:41:40<3:44:16,  8.07s/it]
 96%|█████████▌| 36296/37963 [89:41:47<3:39:20,  7.89s/it]
 96%|█████████▌| 36297/37963 [89:41:55<3:37:16,  7.82s/it]
 96%|█████████▌| 36298/37963 [89:42:03<3:36:32,  7.80s/it]
 96%|█████████▌| 36299/37963 [89:42:11<3:35:35,  7.77s/it]
 96%|█████████▌| 36300/37963 [89:42:26<4:35:37,  9.94s/it]
                                                          
{'loss': '0.0731', 'grad_norm': '2.94', 'learning_rate': '1.006e-07', 'epoch': '0.9562'}
+
 96%|█████████▌| 36300/37963 [89:42:26<4:35:37,  9.94s/it]
 96%|█████████▌| 36301/37963 [89:42:40<5:10:41, 11.22s/it]
 96%|█████████▌| 36302/37963 [89:42:47<4:40:03, 10.12s/it]
 96%|█████████▌| 36303/37963 [89:42:55<4:19:31,  9.38s/it]
 96%|█████████▌| 36304/37963 [89:43:03<4:04:58,  8.86s/it]
 96%|█████████▌| 36305/37963 [89:43:10<3:55:21,  8.52s/it]
 96%|█████████▌| 36306/37963 [89:43:18<3:48:49,  8.29s/it]
 96%|█████████▌| 36307/37963 [89:43:32<4:38:08, 10.08s/it]
 96%|█████████▌| 36308/37963 [89:43:40<4:19:56,  9.42s/it]
 96%|█████████▌| 36309/37963 [89:43:55<5:02:09, 10.96s/it]
 96%|█████████▌| 36310/37963 [89:44:02<4:34:38,  9.97s/it]
                                                          
{'loss': '0.07313', 'grad_norm': '3.077', 'learning_rate': '9.939e-08', 'epoch': '0.9565'}
+
 96%|█████████▌| 36310/37963 [89:44:02<4:34:38,  9.97s/it]
 96%|█████████▌| 36311/37963 [89:44:17<5:13:52, 11.40s/it]
 96%|█████████▌| 36312/37963 [89:44:25<4:41:18, 10.22s/it]
 96%|█████████▌| 36313/37963 [89:44:32<4:20:14,  9.46s/it]
 96%|█████████▌| 36314/37963 [89:44:40<4:04:00,  8.88s/it]
 96%|█████████▌| 36315/37963 [89:44:48<3:54:56,  8.55s/it]
 96%|█████████▌| 36316/37963 [89:44:55<3:46:43,  8.26s/it]
 96%|█████████▌| 36317/37963 [89:45:10<4:38:08, 10.14s/it]
 96%|█████████▌| 36318/37963 [89:45:18<4:19:25,  9.46s/it]
 96%|█████████▌| 36319/37963 [89:45:25<4:04:12,  8.91s/it]
 96%|█████████▌| 36320/37963 [89:45:33<3:51:55,  8.47s/it]
                                                          
{'loss': '0.08234', 'grad_norm': '2.507', 'learning_rate': '9.82e-08', 'epoch': '0.9567'}
+
 96%|█████████▌| 36320/37963 [89:45:33<3:51:55,  8.47s/it]
 96%|█████████▌| 36321/37963 [89:45:48<4:44:20, 10.39s/it]
 96%|█████████▌| 36322/37963 [89:45:55<4:23:06,  9.62s/it]
 96%|█████████▌| 36323/37963 [89:46:03<4:08:31,  9.09s/it]
 96%|█████████▌| 36324/37963 [89:46:11<3:56:20,  8.65s/it]
 96%|█████████▌| 36325/37963 [89:46:19<3:49:10,  8.39s/it]
 96%|█████████▌| 36326/37963 [89:46:26<3:42:24,  8.15s/it]
 96%|█████████▌| 36327/37963 [89:46:34<3:38:25,  8.01s/it]
 96%|█████████▌| 36328/37963 [89:46:42<3:36:14,  7.94s/it]
 96%|█████████▌| 36329/37963 [89:46:49<3:32:38,  7.81s/it]
 96%|█████████▌| 36330/37963 [89:46:57<3:30:57,  7.75s/it]
                                                          
{'loss': '0.07579', 'grad_norm': '3.323', 'learning_rate': '9.701e-08', 'epoch': '0.957'}
+
 96%|█████████▌| 36330/37963 [89:46:57<3:30:57,  7.75s/it]
 96%|█████████▌| 36331/37963 [89:47:04<3:28:27,  7.66s/it]
 96%|█████████▌| 36332/37963 [89:47:12<3:28:15,  7.66s/it]
 96%|█████████▌| 36333/37963 [89:47:20<3:28:59,  7.69s/it]
 96%|█████████▌| 36334/37963 [89:47:27<3:25:52,  7.58s/it]
 96%|█████████▌| 36335/37963 [89:47:42<4:23:02,  9.69s/it]
 96%|█████████▌| 36336/37963 [89:47:50<4:08:17,  9.16s/it]
 96%|█████████▌| 36337/37963 [89:47:57<3:55:43,  8.70s/it]
 96%|█████████▌| 36338/37963 [89:48:05<3:47:16,  8.39s/it]
 96%|█████████▌| 36339/37963 [89:48:12<3:40:13,  8.14s/it]
 96%|█████████▌| 36340/37963 [89:48:20<3:36:36,  8.01s/it]
                                                          
{'loss': '0.077', 'grad_norm': '2.385', 'learning_rate': '9.583e-08', 'epoch': '0.9573'}
+
 96%|█████████▌| 36340/37963 [89:48:20<3:36:36,  8.01s/it]
 96%|█████████▌| 36341/37963 [89:48:28<3:31:32,  7.83s/it]
 96%|█████████▌| 36342/37963 [89:48:35<3:29:45,  7.76s/it]
 96%|█████████▌| 36343/37963 [89:48:43<3:29:25,  7.76s/it]
 96%|█████████▌| 36344/37963 [89:48:57<4:18:42,  9.59s/it]
 96%|█████████▌| 36345/37963 [89:49:04<4:02:56,  9.01s/it]
 96%|█████████▌| 36346/37963 [89:49:12<3:50:33,  8.55s/it]
 96%|█████████▌| 36347/37963 [89:49:20<3:43:49,  8.31s/it]
 96%|█████████▌| 36348/37963 [89:49:27<3:38:36,  8.12s/it]
 96%|█████████▌| 36349/37963 [89:49:35<3:36:14,  8.04s/it]
 96%|█████████▌| 36350/37963 [89:49:50<4:32:59, 10.15s/it]
                                                          
{'loss': '0.07629', 'grad_norm': '3.131', 'learning_rate': '9.465e-08', 'epoch': '0.9575'}
+
 96%|█████████▌| 36350/37963 [89:49:50<4:32:59, 10.15s/it]
 96%|█████████▌| 36351/37963 [89:49:58<4:13:44,  9.44s/it]
 96%|█████████▌| 36352/37963 [89:50:06<3:59:06,  8.91s/it]
 96%|█████████▌| 36353/37963 [89:50:13<3:49:12,  8.54s/it]
 96%|█████████▌| 36354/37963 [89:50:21<3:40:05,  8.21s/it]
 96%|█████████▌| 36355/37963 [89:50:35<4:27:20,  9.98s/it]
 96%|█████████▌| 36356/37963 [89:50:43<4:09:35,  9.32s/it]
 96%|█████████▌| 36357/37963 [89:50:56<4:44:18, 10.62s/it]
 96%|█████████▌| 36358/37963 [89:51:04<4:22:25,  9.81s/it]
 96%|█████████▌| 36359/37963 [89:51:19<5:02:52, 11.33s/it]
 96%|█████████▌| 36360/37963 [89:51:27<4:33:38, 10.24s/it]
                                                          
{'loss': '0.0847', 'grad_norm': '2.852', 'learning_rate': '9.348e-08', 'epoch': '0.9578'}
+
 96%|█████████▌| 36360/37963 [89:51:27<4:33:38, 10.24s/it]
 96%|█████████▌| 36361/37963 [89:51:34<4:12:36,  9.46s/it]
 96%|█████████▌| 36362/37963 [89:51:42<3:58:33,  8.94s/it]
 96%|█████████▌| 36363/37963 [89:51:50<3:48:44,  8.58s/it]
 96%|█████████▌| 36364/37963 [89:51:57<3:38:39,  8.20s/it]
 96%|█████████▌| 36365/37963 [89:52:05<3:34:37,  8.06s/it]
 96%|█████████▌| 36366/37963 [89:52:13<3:31:01,  7.93s/it]
 96%|█████████▌| 36367/37963 [89:52:20<3:28:51,  7.85s/it]
 96%|█████████▌| 36368/37963 [89:52:28<3:27:41,  7.81s/it]
 96%|█████████▌| 36369/37963 [89:52:35<3:24:32,  7.70s/it]
 96%|█████████▌| 36370/37963 [89:52:43<3:24:49,  7.71s/it]
                                                          
{'loss': '0.08691', 'grad_norm': '4.169', 'learning_rate': '9.232e-08', 'epoch': '0.958'}
+
 96%|█████████▌| 36370/37963 [89:52:43<3:24:49,  7.71s/it]
 96%|█████████▌| 36371/37963 [89:53:05<5:13:45, 11.82s/it]
 96%|█████████▌| 36372/37963 [89:53:12<4:40:49, 10.59s/it]
 96%|█████████▌| 36373/37963 [89:53:20<4:17:30,  9.72s/it]
 96%|█████████▌| 36374/37963 [89:53:28<4:00:18,  9.07s/it]
 96%|█████████▌| 36375/37963 [89:53:35<3:49:40,  8.68s/it]
 96%|████████��▌| 36376/37963 [89:53:43<3:40:45,  8.35s/it]
 96%|█████████▌| 36377/37963 [89:53:51<3:35:48,  8.16s/it]
 96%|█████████▌| 36378/37963 [89:53:58<3:32:22,  8.04s/it]
 96%|█████████▌| 36379/37963 [89:54:13<4:23:35,  9.98s/it]
 96%|█████████▌| 36380/37963 [89:54:21<4:07:14,  9.37s/it]
                                                          
{'loss': '0.08628', 'grad_norm': '3.446', 'learning_rate': '9.117e-08', 'epoch': '0.9583'}
+
 96%|█████████▌| 36380/37963 [89:54:21<4:07:14,  9.37s/it]
 96%|█████████▌| 36381/37963 [89:54:29<3:53:39,  8.86s/it]
 96%|█████████▌| 36382/37963 [89:54:36<3:44:07,  8.51s/it]
 96%|█████████▌| 36383/37963 [89:54:44<3:37:29,  8.26s/it]
 96%|█████████▌| 36384/37963 [89:54:51<3:32:06,  8.06s/it]
 96%|█████████▌| 36385/37963 [89:54:59<3:30:25,  8.00s/it]
 96%|█████████▌| 36386/37963 [89:55:07<3:27:40,  7.90s/it]
 96%|█████████▌| 36387/37963 [89:55:15<3:25:56,  7.84s/it]
 96%|█████████▌| 36388/37963 [89:55:22<3:22:48,  7.73s/it]
 96%|█████████▌| 36389/37963 [89:55:30<3:22:12,  7.71s/it]
 96%|█████████▌| 36390/37963 [89:55:37<3:21:33,  7.69s/it]
                                                          
{'loss': '0.07554', 'grad_norm': '2.528', 'learning_rate': '9.003e-08', 'epoch': '0.9586'}
+
 96%|█████████▌| 36390/37963 [89:55:37<3:21:33,  7.69s/it]
 96%|█████████▌| 36391/37963 [89:55:45<3:21:39,  7.70s/it]
 96%|█████████▌| 36392/37963 [89:55:53<3:20:49,  7.67s/it]
 96%|█████████▌| 36393/37963 [89:56:01<3:21:11,  7.69s/it]
 96%|█████████▌| 36394/37963 [89:56:08<3:21:56,  7.72s/it]
 96%|█████████▌| 36395/37963 [89:56:16<3:22:20,  7.74s/it]
 96%|█████████▌| 36396/37963 [89:56:24<3:22:24,  7.75s/it]
 96%|█████████▌| 36397/37963 [89:56:31<3:20:06,  7.67s/it]
 96%|█████████▌| 36398/37963 [89:56:39<3:19:01,  7.63s/it]
 96%|█████████▌| 36399/37963 [89:57:00<5:03:35, 11.65s/it]
 96%|█████████▌| 36400/37963 [89:57:08<4:34:18, 10.53s/it]
                                                          
{'loss': '0.0754', 'grad_norm': '3.029', 'learning_rate': '8.889e-08', 'epoch': '0.9588'}
+
 96%|█████████▌| 36400/37963 [89:57:08<4:34:18, 10.53s/it]
 96%|█████████▌| 36401/37963 [89:57:16<4:12:20,  9.69s/it]
 96%|█████████▌| 36402/37963 [89:57:23<3:56:33,  9.09s/it]
 96%|█████████▌| 36403/37963 [89:57:31<3:47:02,  8.73s/it]
 96%|█████████▌| 36404/37963 [89:57:46<4:37:03, 10.66s/it]
 96%|█████████▌| 36405/37963 [89:57:54<4:15:27,  9.84s/it]
 96%|█████████▌| 36406/37963 [89:58:02<3:58:27,  9.19s/it]
 96%|█████████▌| 36407/37963 [89:58:17<4:42:21, 10.89s/it]
 96%|█████████▌| 36408/37963 [89:58:25<4:18:42,  9.98s/it]
 96%|█████████▌| 36409/37963 [89:58:32<3:58:37,  9.21s/it]
 96%|█████████▌| 36410/37963 [89:58:40<3:47:05,  8.77s/it]
                                                          
{'loss': '0.07393', 'grad_norm': '3.553', 'learning_rate': '8.776e-08', 'epoch': '0.9591'}
+
 96%|█████████▌| 36410/37963 [89:58:40<3:47:05,  8.77s/it]
 96%|█████████▌| 36411/37963 [89:58:48<3:39:12,  8.47s/it]
 96%|█████████▌| 36412/37963 [89:59:02<4:24:47, 10.24s/it]
 96%|█████████▌| 36413/37963 [89:59:10<4:05:38,  9.51s/it]
 96%|█████████▌| 36414/37963 [89:59:17<3:51:17,  8.96s/it]
 96%|█████████▌| 36415/37963 [89:59:25<3:41:16,  8.58s/it]
 96%|█████████▌| 36416/37963 [89:59:33<3:34:56,  8.34s/it]
 96%|█████████▌| 36417/37963 [89:59:41<3:29:34,  8.13s/it]
 96%|█████████▌| 36418/37963 [89:59:48<3:26:26,  8.02s/it]
 96%|█████████▌| 36419/37963 [89:59:56<3:24:32,  7.95s/it]
 96%|█████████▌| 36420/37963 [90:00:04<3:23:40,  7.92s/it]
                                                          
{'loss': '0.06979', 'grad_norm': '3.272', 'learning_rate': '8.663e-08', 'epoch': '0.9594'}
+
 96%|█████████▌| 36420/37963 [90:00:04<3:23:40,  7.92s/it]
 96%|█████████▌| 36421/37963 [90:00:12<3:21:24,  7.84s/it]
 96%|█████████▌| 36422/37963 [90:00:19<3:20:12,  7.80s/it]
 96%|█████████▌| 36423/37963 [90:00:34<4:11:50,  9.81s/it]
 96%|█████████▌| 36424/37963 [90:00:42<3:55:39,  9.19s/it]
 96%|█████████▌| 36425/37963 [90:00:56<4:33:02, 10.65s/it]
 96%|█████████▌| 36426/37963 [90:01:03<4:10:21,  9.77s/it]
 96%|█████████▌| 36427/37963 [90:01:11<3:54:23,  9.16s/it]
 96%|█████████▌| 36428/37963 [90:01:25<4:33:35, 10.69s/it]
 96%|█████████▌| 36429/37963 [90:01:33<4:11:55,  9.85s/it]
 96%|█████████▌| 36430/37963 [90:01:41<3:54:56,  9.20s/it]
                                                          
{'loss': '0.0833', 'grad_norm': '3.334', 'learning_rate': '8.551e-08', 'epoch': '0.9596'}
+
 96%|█████████▌| 36430/37963 [90:01:41<3:54:56,  9.20s/it]
 96%|█████████▌| 36431/37963 [90:01:49<3:43:15,  8.74s/it]
 96%|█████████▌| 36432/37963 [90:01:56<3:35:07,  8.43s/it]
 96%|█████████▌| 36433/37963 [90:02:04<3:26:16,  8.09s/it]
 96%|█████████▌| 36434/37963 [90:02:11<3:22:41,  7.95s/it]
 96%|█████████▌| 36435/37963 [90:02:19<3:21:24,  7.91s/it]
 96%|█████████▌| 36436/37963 [90:02:27<3:19:52,  7.85s/it]
 96%|█████████▌| 36437/37963 [90:02:35<3:19:32,  7.85s/it]
 96%|█████████▌| 36438/37963 [90:02:42<3:18:47,  7.82s/it]
 96%|█████████▌| 36439/37963 [90:02:50<3:18:27,  7.81s/it]
 96%|█████████▌| 36440/37963 [90:02:58<3:17:30,  7.78s/it]
                                                          
{'loss': '0.07924', 'grad_norm': '3.388', 'learning_rate': '8.44e-08', 'epoch': '0.9599'}
+
 96%|█████████▌| 36440/37963 [90:02:58<3:17:30,  7.78s/it]
 96%|█████████▌| 36441/37963 [90:03:06<3:17:15,  7.78s/it]
 96%|█████████▌| 36442/37963 [90:03:13<3:16:36,  7.76s/it]
 96%|█████████▌| 36443/37963 [90:03:21<3:16:36,  7.76s/it]
 96%|█████████▌| 36444/37963 [90:03:29<3:16:34,  7.76s/it]
 96%|█████████▌| 36445/37963 [90:03:43<4:08:01,  9.80s/it]
 96%|█████████▌| 36446/37963 [90:03:51<3:50:44,  9.13s/it]
 96%|█████████▌| 36447/37963 [90:04:05<4:28:09, 10.61s/it]
 96%|█████████▌| 36448/37963 [90:04:13<4:05:59,  9.74s/it]
 96%|█████████▌| 36449/37963 [90:04:20<3:50:40,  9.14s/it]
 96%|█████████▌| 36450/37963 [90:04:36<4:36:16, 10.96s/it]
                                                          
{'loss': '0.07855', 'grad_norm': '2.503', 'learning_rate': '8.33e-08', 'epoch': '0.9601'}
+
 96%|█████████▌| 36450/37963 [90:04:36<4:36:16, 10.96s/it]
 96%|█████████▌| 36451/37963 [90:04:44<4:12:36, 10.02s/it]
 96%|█████████▌| 36452/37963 [90:04:51<3:55:50,  9.37s/it]
 96%|█████████▌| 36453/37963 [90:05:07<4:39:48, 11.12s/it]
 96%|█████████▌| 36454/37963 [90:05:14<4:14:06, 10.10s/it]
 96%|█████████▌| 36455/37963 [90:05:22<3:55:42,  9.38s/it]
 96%|█████████▌| 36456/37963 [90:05:30<3:42:39,  8.87s/it]
 96%|█████████▌| 36457/37963 [90:05:37<3:32:52,  8.48s/it]
 96%|█████████▌| 36458/37963 [90:05:45<3:28:25,  8.31s/it]
 96%|█████████▌| 36459/37963 [90:05:53<3:23:56,  8.14s/it]
 96%|█████████▌| 36460/37963 [90:06:01<3:20:41,  8.01s/it]
                                                          
{'loss': '0.08703', 'grad_norm': '3.762', 'learning_rate': '8.221e-08', 'epoch': '0.9604'}
+
 96%|█████████▌| 36460/37963 [90:06:01<3:20:41,  8.01s/it]
 96%|█████████▌| 36461/37963 [90:06:08<3:17:35,  7.89s/it]
 96%|█████████▌| 36462/37963 [90:06:16<3:15:42,  7.82s/it]
 96%|█████████▌| 36463/37963 [90:06:23<3:13:49,  7.75s/it]
 96%|█████████▌| 36464/37963 [90:06:31<3:13:30,  7.75s/it]
 96%|█████████▌| 36465/37963 [90:06:39<3:13:10,  7.74s/it]
 96%|█████████▌| 36466/37963 [90:06:53<4:02:05,  9.70s/it]
 96%|█████████▌| 36467/37963 [90:07:01<3:46:36,  9.09s/it]
 96%|█████████▌| 36468/37963 [90:07:08<3:33:45,  8.58s/it]
 96%|█████████▌| 36469/37963 [90:07:16<3:26:57,  8.31s/it]
 96%|█████████▌| 36470/37963 [90:07:23<3:20:31,  8.06s/it]
                                                          
{'loss': '0.07891', 'grad_norm': '2.636', 'learning_rate': '8.112e-08', 'epoch': '0.9607'}
+
 96%|█████████▌| 36470/37963 [90:07:23<3:20:31,  8.06s/it]
 96%|█████████▌| 36471/37963 [90:07:31<3:18:00,  7.96s/it]
 96%|█████████▌| 36472/37963 [90:07:39<3:16:05,  7.89s/it]
 96%|█████████▌| 36473/37963 [90:07:47<3:15:04,  7.86s/it]
 96%|█████████▌| 36474/37963 [90:07:54<3:14:22,  7.83s/it]
 96%|█████████▌| 36475/37963 [90:08:09<4:03:29,  9.82s/it]
 96%|█████████▌| 36476/37963 [90:08:24<4:40:24, 11.31s/it]
 96%|█████████▌| 36477/37963 [90:08:38<5:05:52, 12.35s/it]
 96%|█████████▌| 36478/37963 [90:08:46<4:31:24, 10.97s/it]
 96%|█████████▌| 36479/37963 [90:08:54<4:06:10,  9.95s/it]
 96%|█████████▌| 36480/37963 [90:09:01<3:49:16,  9.28s/it]
                                                          
{'loss': '0.08091', 'grad_norm': '3.622', 'learning_rate': '8.004e-08', 'epoch': '0.9609'}
+
 96%|█████████▌| 36480/37963 [90:09:01<3:49:16,  9.28s/it]
 96%|█████████▌| 36481/37963 [90:09:09<3:37:03,  8.79s/it]
 96%|█████████▌| 36482/37963 [90:09:17<3:27:47,  8.42s/it]
 96%|█████████▌| 36483/37963 [90:09:24<3:21:57,  8.19s/it]
 96%|█████████▌| 36484/37963 [90:09:32<3:17:53,  8.03s/it]
 96%|█████████▌| 36485/37963 [90:09:40<3:14:48,  7.91s/it]
 96%|█████████▌| 36486/37963 [90:09:47<3:13:51,  7.88s/it]
 96%|█████████▌| 36487/37963 [90:09:55<3:13:18,  7.86s/it]
 96%|█████████▌| 36488/37963 [90:10:03<3:11:59,  7.81s/it]
 96%|█████████▌| 36489/37963 [90:10:11<3:11:02,  7.78s/it]
 96%|█████████▌| 36490/37963 [90:10:19<3:11:55,  7.82s/it]
                                                          
{'loss': '0.07854', 'grad_norm': '4.394', 'learning_rate': '7.896e-08', 'epoch': '0.9612'}
+
 96%|█████████▌| 36490/37963 [90:10:19<3:11:55,  7.82s/it]
 96%|█████████▌| 36491/37963 [90:10:26<3:11:21,  7.80s/it]
 96%|█████████▌| 36492/37963 [90:10:34<3:08:01,  7.67s/it]
 96%|█████████▌| 36493/37963 [90:10:48<3:56:56,  9.67s/it]
 96%|█████████▌| 36494/37963 [90:10:56<3:43:42,  9.14s/it]
 96%|█████████▌| 36495/37963 [90:11:10<4:21:15, 10.68s/it]
 96%|█████████▌| 36496/37963 [90:11:18<3:59:02,  9.78s/it]
 96%|█████████▌| 36497/37963 [90:11:25<3:40:55,  9.04s/it]
 96%|█████████▌| 36498/37963 [90:11:40<4:20:46, 10.68s/it]
 96%|█████████▌| 36499/37963 [90:11:54<4:46:32, 11.74s/it]
 96%|█████████▌| 36500/37963 [90:12:02<4:18:25, 10.60s/it]
                                                          
{'loss': '0.08259', 'grad_norm': '2.878', 'learning_rate': '7.79e-08', 'epoch': '0.9615'}
+
 96%|█████████▌| 36500/37963 [90:12:02<4:18:25, 10.60s/it]
 96%|█████████▌| 36501/37963 [90:12:09<3:56:47,  9.72s/it]
 96%|█████████▌| 36502/37963 [90:12:17<3:41:49,  9.11s/it]
 96%|█████████▌| 36503/37963 [90:12:25<3:32:07,  8.72s/it]
 96%|█████████▌| 36504/37963 [90:12:32<3:23:01,  8.35s/it]
 96%|█████████▌| 36505/37963 [90:12:40<3:17:13,  8.12s/it]
 96%|█████████▌| 36506/37963 [90:12:48<3:14:30,  8.01s/it]
 96%|█████████▌| 36507/37963 [90:12:55<3:12:03,  7.91s/it]
 96%|█████████▌| 36508/37963 [90:13:03<3:09:38,  7.82s/it]
 96%|█████████▌| 36509/37963 [90:13:11<3:07:36,  7.74s/it]
 96%|█████████▌| 36510/37963 [90:13:18<3:04:53,  7.63s/it]
                                                          
{'loss': '0.07894', 'grad_norm': '3.396', 'learning_rate': '7.684e-08', 'epoch': '0.9617'}
+
 96%|█████████▌| 36510/37963 [90:13:18<3:04:53,  7.63s/it]
 96%|█████████▌| 36511/37963 [90:13:26<3:05:19,  7.66s/it]
 96%|█████████▌| 36512/37963 [90:13:34<3:07:01,  7.73s/it]
 96%|█████████▌| 36513/37963 [90:13:41<3:06:30,  7.72s/it]
 96%|█████████▌| 36514/37963 [90:13:49<3:03:35,  7.60s/it]
 96%|█████████▌| 36515/37963 [90:13:56<3:03:28,  7.60s/it]
 96%|█████████▌| 36516/37963 [90:14:04<3:04:01,  7.63s/it]
 96%|█████████▌| 36517/37963 [90:14:12<3:05:10,  7.68s/it]
 96%|█████████▌| 36518/37963 [90:14:20<3:06:08,  7.73s/it]
 96%|█████████▌| 36519/37963 [90:14:27<3:06:01,  7.73s/it]
 96%|█████████▌| 36520/37963 [90:14:42<3:53:13,  9.70s/it]
                                                          
{'loss': '0.0818', 'grad_norm': '4.029', 'learning_rate': '7.579e-08', 'epoch': '0.962'}
+
 96%|█████████▌| 36520/37963 [90:14:42<3:53:13,  9.70s/it]
 96%|█████████▌| 36521/37963 [90:14:49<3:39:02,  9.11s/it]
 96%|█████████▌| 36522/37963 [90:14:57<3:29:14,  8.71s/it]
 96%|█████████▌| 36523/37963 [90:15:05<3:21:12,  8.38s/it]
 96%|█████████▌| 36524/37963 [90:15:19<4:03:21, 10.15s/it]
 96%|█████████▌| 36525/37963 [90:15:27<3:46:28,  9.45s/it]
 96%|█████████▌| 36526/37963 [90:15:34<3:32:51,  8.89s/it]
 96%|█████████▌| 36527/37963 [90:15:50<4:18:38, 10.81s/it]
 96%|█████████▌| 36528/37963 [90:15:57<3:56:26,  9.89s/it]
 96%|█████████▌| 36529/37963 [90:16:05<3:40:40,  9.23s/it]
 96%|█████████▌| 36530/37963 [90:16:19<4:16:52, 10.76s/it]
                                                          
{'loss': '0.08218', 'grad_norm': '3.343', 'learning_rate': '7.474e-08', 'epoch': '0.9623'}
+
 96%|█████████▌| 36530/37963 [90:16:19<4:16:52, 10.76s/it]
 96%|█████████▌| 36531/37963 [90:16:27<3:54:14,  9.81s/it]
 96%|█████████▌| 36532/37963 [90:16:35<3:37:48,  9.13s/it]
 96%|█████████▌| 36533/37963 [90:16:42<3:27:42,  8.71s/it]
 96%|█████████▌| 36534/37963 [90:16:50<3:21:08,  8.45s/it]
 96%|█████████▌| 36535/37963 [90:16:58<3:15:41,  8.22s/it]
 96%|█████████▌| 36536/37963 [90:17:06<3:11:30,  8.05s/it]
 96%|█████████▌| 36537/37963 [90:17:13<3:08:51,  7.95s/it]
 96%|█████████▌| 36538/37963 [90:17:21<3:07:31,  7.90s/it]
 96%|█████████▌| 36539/37963 [90:17:35<3:51:23,  9.75s/it]
 96%|█████████▋| 36540/37963 [90:17:43<3:37:22,  9.17s/it]
                                                          
{'loss': '0.07246', 'grad_norm': '2.77', 'learning_rate': '7.37e-08', 'epoch': '0.9625'}
+
 96%|█████████▋| 36540/37963 [90:17:43<3:37:22,  9.17s/it]
 96%|█████████▋| 36541/37963 [90:17:50<3:26:04,  8.70s/it]
 96%|█████████▋| 36542/37963 [90:18:04<4:03:16, 10.27s/it]
 96%|█████████▋| 36543/37963 [90:18:12<3:46:26,  9.57s/it]
 96%|█████████▋| 36544/37963 [90:18:20<3:32:05,  8.97s/it]
 96%|█████████▋| 36545/37963 [90:18:34<4:10:56, 10.62s/it]
 96%|█████████▋| 36546/37963 [90:18:42<3:48:08,  9.66s/it]
 96%|█████████▋| 36547/37963 [90:18:50<3:33:57,  9.07s/it]
 96%|█████████▋| 36548/37963 [90:18:57<3:23:05,  8.61s/it]
 96%|█████████▋| 36549/37963 [90:19:05<3:16:42,  8.35s/it]
 96%|█████████▋| 36550/37963 [90:19:12<3:08:35,  8.01s/it]
                                                          
{'loss': '0.06804', 'grad_norm': '2.89', 'learning_rate': '7.267e-08', 'epoch': '0.9628'}
+
 96%|█████████▋| 36550/37963 [90:19:12<3:08:35,  8.01s/it]
 96%|█████████▋| 36551/37963 [90:19:20<3:05:39,  7.89s/it]
 96%|█████████▋| 36552/37963 [90:19:27<3:04:23,  7.84s/it]
 96%|█████████▋| 36553/37963 [90:19:42<3:52:18,  9.89s/it]
 96%|█████████▋| 36554/37963 [90:19:50<3:36:27,  9.22s/it]
 96%|█████████▋| 36555/37963 [90:19:57<3:25:24,  8.75s/it]
 96%|█████████▋| 36556/37963 [90:20:05<3:17:55,  8.44s/it]
 96%|█████████▋| 36557/37963 [90:20:13<3:11:06,  8.16s/it]
 96%|█████████▋| 36558/37963 [90:20:20<3:07:38,  8.01s/it]
 96%|█████████▋| 36559/37963 [90:20:28<3:05:53,  7.94s/it]
 96%|█████████▋| 36560/37963 [90:20:36<3:03:52,  7.86s/it]
                                                          
{'loss': '0.08338', 'grad_norm': '2.921', 'learning_rate': '7.165e-08', 'epoch': '0.963'}
+
 96%|█████████▋| 36560/37963 [90:20:36<3:03:52,  7.86s/it]
 96%|█████████▋| 36561/37963 [90:20:43<3:02:36,  7.81s/it]
 96%|█████████▋| 36562/37963 [90:20:51<3:01:09,  7.76s/it]
 96%|█████████▋| 36563/37963 [90:20:59<3:00:20,  7.73s/it]
 96%|█████████▋| 36564/37963 [90:21:06<2:59:34,  7.70s/it]
 96%|█████████▋| 36565/37963 [90:21:14<2:58:43,  7.67s/it]
 96%|█████████▋| 36566/37963 [90:21:22<2:58:40,  7.67s/it]
 96%|█████████▋| 36567/37963 [90:21:29<2:57:36,  7.63s/it]
 96%|█████████▋| 36568/37963 [90:21:43<3:41:44,  9.54s/it]
 96%|█████████▋| 36569/37963 [90:21:51<3:31:30,  9.10s/it]
 96%|█████████▋| 36570/37963 [90:22:06<4:11:15, 10.82s/it]
                                                          
{'loss': '0.08284', 'grad_norm': '3.127', 'learning_rate': '7.064e-08', 'epoch': '0.9633'}
+
 96%|█████████▋| 36570/37963 [90:22:06<4:11:15, 10.82s/it]
 96%|█████████▋| 36571/37963 [90:22:14<3:49:49,  9.91s/it]
 96%|█████████▋| 36572/37963 [90:22:22<3:35:22,  9.29s/it]
 96%|█████████▋| 36573/37963 [90:22:36<4:10:51, 10.83s/it]
 96%|█████████▋| 36574/37963 [90:22:44<3:49:21,  9.91s/it]
 96%|█████████▋| 36575/37963 [90:22:51<3:31:33,  9.14s/it]
 96%|█████████▋| 36576/37963 [90:22:59<3:22:10,  8.75s/it]
 96%|█████████▋| 36577/37963 [90:23:07<3:14:48,  8.43s/it]
 96%|█████████▋| 36578/37963 [90:23:14<3:09:14,  8.20s/it]
 96%|█████████▋| 36579/37963 [90:23:22<3:06:47,  8.10s/it]
 96%|█████████▋| 36580/37963 [90:23:37<3:51:26, 10.04s/it]
                                                          
{'loss': '0.08349', 'grad_norm': '3.69', 'learning_rate': '6.963e-08', 'epoch': '0.9636'}
+
 96%|█████████▋| 36580/37963 [90:23:37<3:51:26, 10.04s/it]
 96%|█████████▋| 36581/37963 [90:23:44<3:33:54,  9.29s/it]
 96%|█████████▋| 36582/37963 [90:23:52<3:20:36,  8.72s/it]
 96%|█████████▋| 36583/37963 [90:23:59<3:13:20,  8.41s/it]
 96%|█████████▋| 36584/37963 [90:24:07<3:09:16,  8.24s/it]
 96%|█████████▋| 36585/37963 [90:24:15<3:04:00,  8.01s/it]
 96%|█████████▋| 36586/37963 [90:24:22<3:02:11,  7.94s/it]
 96%|█████████▋| 36587/37963 [90:24:30<3:01:18,  7.91s/it]
 96%|█████████▋| 36588/37963 [90:24:38<2:59:11,  7.82s/it]
 96%|█████████▋| 36589/37963 [90:24:46<2:58:49,  7.81s/it]
 96%|█████████▋| 36590/37963 [90:25:00<3:43:31,  9.77s/it]
                                                          
{'loss': '0.07167', 'grad_norm': '3.128', 'learning_rate': '6.863e-08', 'epoch': '0.9638'}
+
 96%|█████████▋| 36590/37963 [90:25:00<3:43:31,  9.77s/it]
 96%|█████████▋| 36591/37963 [90:25:15<4:19:19, 11.34s/it]
 96%|█████████▋| 36592/37963 [90:25:29<4:38:14, 12.18s/it]
 96%|█████████▋| 36593/37963 [90:25:36<4:04:36, 10.71s/it]
 96%|█████████▋| 36594/37963 [90:25:44<3:43:53,  9.81s/it]
 96%|█████████▋| 36595/37963 [90:25:52<3:28:44,  9.16s/it]
 96%|█████████▋| 36596/37963 [90:26:00<3:19:39,  8.76s/it]
 96%|█████████▋| 36597/37963 [90:26:07<3:10:26,  8.36s/it]
 96%|█████████▋| 36598/37963 [90:26:15<3:05:51,  8.17s/it]
 96%|█████████▋| 36599/37963 [90:26:29<3:50:08, 10.12s/it]
 96%|█████████▋| 36600/37963 [90:26:37<3:34:05,  9.42s/it]
                                                          
{'loss': '0.07865', 'grad_norm': '4.893', 'learning_rate': '6.763e-08', 'epoch': '0.9641'}
+
 96%|█████████▋| 36600/37963 [90:26:37<3:34:05,  9.42s/it]
 96%|█████████▋| 36601/37963 [90:26:45<3:21:49,  8.89s/it]
 96%|█████████▋| 36602/37963 [90:26:53<3:14:24,  8.57s/it]
 96%|█████████▋| 36603/37963 [90:27:00<3:07:35,  8.28s/it]
 96%|█████████▋| 36604/37963 [90:27:08<3:03:50,  8.12s/it]
 96%|█████████▋| 36605/37963 [90:27:16<3:00:47,  7.99s/it]
 96%|█████████▋| 36606/37963 [90:27:23<2:58:39,  7.90s/it]
 96%|█████████▋| 36607/37963 [90:27:31<2:56:31,  7.81s/it]
 96%|█████████▋| 36608/37963 [90:27:39<2:55:53,  7.79s/it]
 96%|█████████▋| 36609/37963 [90:27:46<2:52:44,  7.65s/it]
 96%|█████████▋| 36610/37963 [90:27:54<2:51:52,  7.62s/it]
                                                          
{'loss': '0.08897', 'grad_norm': '3.741', 'learning_rate': '6.664e-08', 'epoch': '0.9644'}
+
 96%|█████████▋| 36610/37963 [90:27:54<2:51:52,  7.62s/it]
 96%|█████████▋| 36611/37963 [90:28:08<3:36:59,  9.63s/it]
 96%|█████████▋| 36612/37963 [90:28:16<3:23:59,  9.06s/it]
 96%|█████████▋| 36613/37963 [90:28:24<3:15:02,  8.67s/it]
 96%|█████████▋| 36614/37963 [90:28:31<3:08:42,  8.39s/it]
 96%|█████████▋| 36615/37963 [90:28:39<3:03:48,  8.18s/it]
 96%|█████████▋| 36616/37963 [90:28:47<2:59:59,  8.02s/it]
 96%|█████████▋| 36617/37963 [90:28:54<2:56:34,  7.87s/it]
 96%|█████████▋| 36618/37963 [90:29:02<2:55:48,  7.84s/it]
 96%|█████████▋| 36619/37963 [90:29:17<3:43:08,  9.96s/it]
 96%|█████████▋| 36620/37963 [90:29:25<3:29:04,  9.34s/it]
                                                          
{'loss': '0.08241', 'grad_norm': '3.263', 'learning_rate': '6.566e-08', 'epoch': '0.9646'}
+
 96%|█████████▋| 36620/37963 [90:29:25<3:29:04,  9.34s/it]
 96%|█████████▋| 36621/37963 [90:29:32<3:17:23,  8.83s/it]
 96%|█████████▋| 36622/37963 [90:29:40<3:09:23,  8.47s/it]
 96%|█████████▋| 36623/37963 [90:29:48<3:04:10,  8.25s/it]
 96%|█████████▋| 36624/37963 [90:29:55<3:00:03,  8.07s/it]
 96%|█████████▋| 36625/37963 [90:30:03<2:55:52,  7.89s/it]
 96%|█████████▋| 36626/37963 [90:30:17<3:40:42,  9.90s/it]
 96%|█████████▋| 36627/37963 [90:30:32<4:09:50, 11.22s/it]
 96%|█████████▋| 36628/37963 [90:30:39<3:46:46, 10.19s/it]
 96%|█████████▋| 36629/37963 [90:30:47<3:31:06,  9.50s/it]
 96%|█████████▋| 36630/37963 [90:30:55<3:18:20,  8.93s/it]
                                                          
{'loss': '0.08215', 'grad_norm': '2.728', 'learning_rate': '6.469e-08', 'epoch': '0.9649'}
+
 96%|█████████▋| 36630/37963 [90:30:55<3:18:20,  8.93s/it]
 96%|█████████▋| 36631/37963 [90:31:03<3:09:46,  8.55s/it]
 96%|█████████▋| 36632/37963 [90:31:10<3:03:46,  8.28s/it]
 96%|█████████▋| 36633/37963 [90:31:18<2:59:47,  8.11s/it]
 96%|█████████▋| 36634/37963 [90:31:26<2:57:21,  8.01s/it]
 97%|█████████▋| 36635/37963 [90:31:33<2:54:59,  7.91s/it]
 97%|█████████▋| 36636/37963 [90:31:48<3:39:10,  9.91s/it]
 97%|█████████▋| 36637/37963 [90:31:56<3:25:02,  9.28s/it]
 97%|█████████▋| 36638/37963 [90:32:04<3:14:51,  8.82s/it]
 97%|█████████▋| 36639/37963 [90:32:11<3:07:18,  8.49s/it]
 97%|█████████▋| 36640/37963 [90:32:19<3:01:54,  8.25s/it]
                                                          
{'loss': '0.07352', 'grad_norm': '3.445', 'learning_rate': '6.373e-08', 'epoch': '0.9652'}
+
 97%|█████████▋| 36640/37963 [90:32:19<3:01:54,  8.25s/it]
 97%|█████████▋| 36641/37963 [90:32:26<2:56:53,  8.03s/it]
 97%|█████████▋| 36642/37963 [90:32:41<3:40:59, 10.04s/it]
 97%|█████████▋| 36643/37963 [90:32:49<3:26:16,  9.38s/it]
 97%|█████████▋| 36644/37963 [90:33:03<3:57:12, 10.79s/it]
 97%|█████████▋| 36645/37963 [90:33:11<3:35:24,  9.81s/it]
 97%|█████████▋| 36646/37963 [90:33:18<3:21:46,  9.19s/it]
 97%|█████████▋| 36647/37963 [90:33:26<3:10:25,  8.68s/it]
 97%|█████████▋| 36648/37963 [90:33:40<3:47:28, 10.38s/it]
 97%|█████████▋| 36649/37963 [90:33:48<3:30:35,  9.62s/it]
 97%|█████████▋| 36650/37963 [90:33:56<3:17:23,  9.02s/it]
                                                          
{'loss': '0.07435', 'grad_norm': '3.45', 'learning_rate': '6.277e-08', 'epoch': '0.9654'}
+
 97%|█████████▋| 36650/37963 [90:33:56<3:17:23,  9.02s/it]
 97%|█████████▋| 36651/37963 [90:34:03<3:08:18,  8.61s/it]
 97%|█████████▋| 36652/37963 [90:34:11<2:59:55,  8.23s/it]
 97%|█████████▋| 36653/37963 [90:34:18<2:53:51,  7.96s/it]
 97%|█████████▋| 36654/37963 [90:34:26<2:52:33,  7.91s/it]
 97%|█████████▋| 36655/37963 [90:34:33<2:50:50,  7.84s/it]
 97%|█████████▋| 36656/37963 [90:34:41<2:50:06,  7.81s/it]
 97%|█████████▋| 36657/37963 [90:34:49<2:49:35,  7.79s/it]
 97%|█████████▋| 36658/37963 [90:34:57<2:48:57,  7.77s/it]
 97%|█████████▋| 36659/37963 [90:35:04<2:48:34,  7.76s/it]
 97%|█████████▋| 36660/37963 [90:35:12<2:46:41,  7.68s/it]
                                                          
{'loss': '0.07789', 'grad_norm': '3.13', 'learning_rate': '6.182e-08', 'epoch': '0.9657'}
+
 97%|█████████▋| 36660/37963 [90:35:12<2:46:41,  7.68s/it]
 97%|█████████▋| 36661/37963 [90:35:20<2:46:07,  7.66s/it]
 97%|█████████▋| 36662/37963 [90:35:27<2:46:02,  7.66s/it]
 97%|█████████▋| 36663/37963 [90:35:42<3:33:38,  9.86s/it]
 97%|█████████▋| 36664/37963 [90:35:50<3:19:01,  9.19s/it]
 97%|█████████▋| 36665/37963 [90:36:04<3:49:47, 10.62s/it]
 97%|█████████▋| 36666/37963 [90:36:11<3:30:14,  9.73s/it]
 97%|█████████▋| 36667/37963 [90:36:19<3:17:28,  9.14s/it]
 97%|█████████▋| 36668/37963 [90:36:27<3:06:58,  8.66s/it]
 97%|█████████▋| 36669/37963 [90:36:34<2:59:53,  8.34s/it]
 97%|█████████▋| 36670/37963 [90:36:42<2:54:27,  8.10s/it]
                                                          
{'loss': '0.07405', 'grad_norm': '3.817', 'learning_rate': '6.087e-08', 'epoch': '0.9659'}
+
 97%|█████████▋| 36670/37963 [90:36:42<2:54:27,  8.10s/it]
 97%|█████████▋| 36671/37963 [90:36:50<2:51:41,  7.97s/it]
 97%|█████████▋| 36672/37963 [90:36:57<2:49:55,  7.90s/it]
 97%|█████████▋| 36673/37963 [90:37:11<3:29:55,  9.76s/it]
 97%|█████████▋| 36674/37963 [90:37:26<3:59:52, 11.17s/it]
 97%|█████████▋| 36675/37963 [90:37:34<3:38:52, 10.20s/it]
 97%|█████████▋| 36676/37963 [90:37:41<3:22:32,  9.44s/it]
 97%|█████████▋| 36677/37963 [90:37:49<3:10:46,  8.90s/it]
 97%|█████████▋| 36678/37963 [90:37:57<3:02:56,  8.54s/it]
 97%|█████████▋| 36679/37963 [90:38:11<3:37:14, 10.15s/it]
 97%|█████████▋| 36680/37963 [90:38:19<3:22:59,  9.49s/it]
                                                          
{'loss': '0.09163', 'grad_norm': '4.553', 'learning_rate': '5.994e-08', 'epoch': '0.9662'}
+
 97%|█████████▋| 36680/37963 [90:38:19<3:22:59,  9.49s/it]
 97%|█████████▋| 36681/37963 [90:38:26<3:09:15,  8.86s/it]
 97%|█████████▋| 36682/37963 [90:38:34<3:01:26,  8.50s/it]
 97%|█████████▋| 36683/37963 [90:38:41<2:56:16,  8.26s/it]
 97%|█████████▋| 36684/37963 [90:38:49<2:52:44,  8.10s/it]
 97%|█████████▋| 36685/37963 [90:38:57<2:50:00,  7.98s/it]
 97%|█████████▋| 36686/37963 [90:39:04<2:47:20,  7.86s/it]
 97%|█████████▋| 36687/37963 [90:39:12<2:46:08,  7.81s/it]
 97%|█████████▋| 36688/37963 [90:39:20<2:45:23,  7.78s/it]
 97%|█████████▋| 36689/37963 [90:39:28<2:45:15,  7.78s/it]
 97%|█████████▋| 36690/37963 [90:39:42<3:28:25,  9.82s/it]
                                                          
{'loss': '0.07671', 'grad_norm': '4.183', 'learning_rate': '5.901e-08', 'epoch': '0.9665'}
+
 97%|█████████▋| 36690/37963 [90:39:42<3:28:25,  9.82s/it]
 97%|█████████▋| 36691/37963 [90:39:50<3:14:19,  9.17s/it]
 97%|█████████▋| 36692/37963 [90:39:57<3:04:29,  8.71s/it]
 97%|█████████▋| 36693/37963 [90:40:05<2:58:28,  8.43s/it]
 97%|█████████▋| 36694/37963 [90:40:13<2:55:09,  8.28s/it]
 97%|█████████▋| 36695/37963 [90:40:29<3:40:33, 10.44s/it]
 97%|█████████▋| 36696/37963 [90:40:36<3:23:03,  9.62s/it]
 97%|█████████▋| 36697/37963 [90:40:44<3:13:27,  9.17s/it]
 97%|█████████▋| 36698/37963 [90:40:59<3:45:30, 10.70s/it]
 97%|█████████▋| 36699/37963 [90:41:07<3:27:12,  9.84s/it]
 97%|█████████▋| 36700/37963 [90:41:14<3:12:05,  9.13s/it]
                                                          
{'loss': '0.08302', 'grad_norm': '4.834', 'learning_rate': '5.809e-08', 'epoch': '0.9667'}
+
 97%|█████████▋| 36700/37963 [90:41:14<3:12:05,  9.13s/it]
 97%|█████████▋| 36701/37963 [90:41:22<3:02:32,  8.68s/it]
 97%|█████████▋| 36702/37963 [90:41:29<2:56:02,  8.38s/it]
 97%|█████████▋| 36703/37963 [90:41:37<2:50:39,  8.13s/it]
 97%|█████████▋| 36704/37963 [90:41:45<2:47:47,  8.00s/it]
 97%|█████████▋| 36705/37963 [90:41:52<2:45:57,  7.91s/it]
 97%|█████████▋| 36706/37963 [90:42:07<3:25:20,  9.80s/it]
 97%|█████████▋| 36707/37963 [90:42:14<3:11:46,  9.16s/it]
 97%|█████████▋| 36708/37963 [90:42:22<3:00:45,  8.64s/it]
 97%|█████████▋| 36709/37963 [90:42:29<2:54:08,  8.33s/it]
 97%|█████████▋| 36710/37963 [90:42:37<2:49:48,  8.13s/it]
                                                          
{'loss': '0.0728', 'grad_norm': '3.182', 'learning_rate': '5.717e-08', 'epoch': '0.967'}
+
 97%|█████████▋| 36710/37963 [90:42:37<2:49:48,  8.13s/it]
 97%|█████████▋| 36711/37963 [90:42:45<2:49:41,  8.13s/it]
 97%|█████████▋| 36712/37963 [90:42:59<3:27:51,  9.97s/it]
 97%|█████████▋| 36713/37963 [90:43:07<3:12:11,  9.23s/it]
 97%|█████████▋| 36714/37963 [90:43:14<3:01:41,  8.73s/it]
 97%|█████████▋| 36715/37963 [90:43:22<2:55:11,  8.42s/it]
 97%|█████████▋| 36716/37963 [90:43:29<2:48:42,  8.12s/it]
 97%|█████████▋| 36717/37963 [90:43:37<2:46:23,  8.01s/it]
 97%|█████████▋| 36718/37963 [90:43:45<2:43:54,  7.90s/it]
 97%|█████████▋| 36719/37963 [90:43:59<3:24:36,  9.87s/it]
 97%|█████████▋| 36720/37963 [90:44:14<3:52:16, 11.21s/it]
                                                          
{'loss': '0.08204', 'grad_norm': '3.584', 'learning_rate': '5.627e-08', 'epoch': '0.9673'}
+
 97%|█████████▋| 36720/37963 [90:44:14<3:52:16, 11.21s/it]
 97%|█████████▋| 36721/37963 [90:44:21<3:30:27, 10.17s/it]
 97%|█████████▋| 36722/37963 [90:44:29<3:16:32,  9.50s/it]
 97%|█████████▋| 36723/37963 [90:44:37<3:03:25,  8.88s/it]
 97%|█████████▋| 36724/37963 [90:44:44<2:55:12,  8.49s/it]
 97%|█████████▋| 36725/37963 [90:44:52<2:51:03,  8.29s/it]
 97%|█████████▋| 36726/37963 [90:45:00<2:47:42,  8.13s/it]
 97%|█████████▋| 36727/37963 [90:45:08<2:46:19,  8.07s/it]
 97%|█████████▋| 36728/37963 [90:45:16<2:44:53,  8.01s/it]
 97%|█████████▋| 36729/37963 [90:45:30<3:23:57,  9.92s/it]
 97%|█████████▋| 36730/37963 [90:45:38<3:11:06,  9.30s/it]
                                                          
{'loss': '0.07874', 'grad_norm': '3.487', 'learning_rate': '5.537e-08', 'epoch': '0.9675'}
+
 97%|█████████▋| 36730/37963 [90:45:38<3:11:06,  9.30s/it]
 97%|█████████▋| 36731/37963 [90:45:46<3:01:58,  8.86s/it]
 97%|█████████▋| 36732/37963 [90:45:54<2:55:11,  8.54s/it]
 97%|█████████▋| 36733/37963 [90:46:01<2:49:48,  8.28s/it]
 97%|█████████▋| 36734/37963 [90:46:09<2:46:48,  8.14s/it]
 97%|█████████▋| 36735/37963 [90:46:17<2:44:02,  8.02s/it]
 97%|█████████▋| 36736/37963 [90:46:24<2:41:30,  7.90s/it]
 97%|█████████▋| 36737/37963 [90:46:39<3:23:10,  9.94s/it]
 97%|█████████▋| 36738/37963 [90:46:47<3:09:19,  9.27s/it]
 97%|█████████▋| 36739/37963 [90:46:55<2:59:20,  8.79s/it]
 97%|█████████▋| 36740/37963 [90:47:02<2:52:59,  8.49s/it]
                                                          
{'loss': '0.07419', 'grad_norm': '3.478', 'learning_rate': '5.447e-08', 'epoch': '0.9678'}
+
 97%|█████████▋| 36740/37963 [90:47:02<2:52:59,  8.49s/it]
 97%|█████████▋| 36741/37963 [90:47:11<2:51:35,  8.43s/it]
 97%|█████████▋| 36742/37963 [90:47:18<2:46:55,  8.20s/it]
 97%|█████████▋| 36743/37963 [90:47:33<3:28:32, 10.26s/it]
 97%|█████████▋| 36744/37963 [90:47:41<3:13:13,  9.51s/it]
 97%|█████████▋| 36745/37963 [90:47:49<3:02:29,  8.99s/it]
 97%|█████████▋| 36746/37963 [90:47:56<2:53:35,  8.56s/it]
 97%|█████████▋| 36747/37963 [90:48:04<2:48:36,  8.32s/it]
 97%|█████████▋| 36748/37963 [90:48:12<2:44:48,  8.14s/it]
 97%|█████████▋| 36749/37963 [90:48:20<2:42:54,  8.05s/it]
 97%|█████████▋| 36750/37963 [90:48:27<2:40:44,  7.95s/it]
                                                          
{'loss': '0.06631', 'grad_norm': '2.884', 'learning_rate': '5.359e-08', 'epoch': '0.9681'}
+
 97%|█████████▋| 36750/37963 [90:48:27<2:40:44,  7.95s/it]
 97%|█████████▋| 36751/37963 [90:48:35<2:38:36,  7.85s/it]
 97%|█████████▋| 36752/37963 [90:48:50<3:19:06,  9.86s/it]
 97%|█████████▋| 36753/37963 [90:48:57<3:05:07,  9.18s/it]
 97%|█████████▋| 36754/37963 [90:49:05<2:56:01,  8.74s/it]
 97%|█████████▋| 36755/37963 [90:49:13<2:49:26,  8.42s/it]
 97%|█████████▋| 36756/37963 [90:49:20<2:45:43,  8.24s/it]
 97%|█████████▋| 36757/37963 [90:49:28<2:43:14,  8.12s/it]
 97%|█████████▋| 36758/37963 [90:49:43<3:23:58, 10.16s/it]
 97%|█████████▋| 36759/37963 [90:49:57<3:46:12, 11.27s/it]
 97%|█████████▋| 36760/37963 [90:50:05<3:23:47, 10.16s/it]
                                                          
{'loss': '0.06167', 'grad_norm': '3.165', 'learning_rate': '5.271e-08', 'epoch': '0.9683'}
+
 97%|█████████▋| 36760/37963 [90:50:05<3:23:47, 10.16s/it]
 97%|█████████▋| 36761/37963 [90:50:12<3:07:29,  9.36s/it]
 97%|█████████▋| 36762/37963 [90:50:20<2:57:18,  8.86s/it]
 97%|█████████▋| 36763/37963 [90:50:27<2:50:10,  8.51s/it]
 97%|█████████▋| 36764/37963 [90:50:35<2:45:02,  8.26s/it]
 97%|█████████▋| 36765/37963 [90:50:43<2:41:34,  8.09s/it]
 97%|█████████▋| 36766/37963 [90:50:50<2:37:55,  7.92s/it]
 97%|█████████▋| 36767/37963 [90:51:05<3:15:26,  9.80s/it]
 97%|█████████▋| 36768/37963 [90:51:12<3:03:39,  9.22s/it]
 97%|█████████▋| 36769/37963 [90:51:20<2:55:13,  8.81s/it]
 97%|█████████▋| 36770/37963 [90:51:28<2:49:07,  8.51s/it]
                                                          
{'loss': '0.07675', 'grad_norm': '3.019', 'learning_rate': '5.184e-08', 'epoch': '0.9686'}
+
 97%|█████████▋| 36770/37963 [90:51:28<2:49:07,  8.51s/it]
 97%|█████████▋| 36771/37963 [90:51:36<2:44:20,  8.27s/it]
 97%|█████████▋| 36772/37963 [90:51:44<2:41:11,  8.12s/it]
 97%|█████████▋| 36773/37963 [90:52:05<4:00:04, 12.10s/it]
 97%|█████████▋| 36774/37963 [90:52:13<3:36:22, 10.92s/it]
 97%|█████████▋| 36775/37963 [90:52:21<3:16:04,  9.90s/it]
 97%|█████████▋| 36776/37963 [90:52:28<3:02:05,  9.20s/it]
 97%|█████████▋| 36777/37963 [90:52:36<2:52:44,  8.74s/it]
 97%|█���███████▋| 36778/37963 [90:52:44<2:46:05,  8.41s/it]
 97%|█████████▋| 36779/37963 [90:52:51<2:42:10,  8.22s/it]
 97%|█████████▋| 36780/37963 [90:52:59<2:38:52,  8.06s/it]
                                                          
{'loss': '0.07701', 'grad_norm': '3.943', 'learning_rate': '5.097e-08', 'epoch': '0.9688'}
+
 97%|█████████▋| 36780/37963 [90:52:59<2:38:52,  8.06s/it]
 97%|█████████▋| 36781/37963 [90:53:07<2:36:12,  7.93s/it]
 97%|█████████▋| 36782/37963 [90:53:14<2:33:39,  7.81s/it]
 97%|█████████▋| 36783/37963 [90:53:22<2:33:23,  7.80s/it]
 97%|█████████▋| 36784/37963 [90:53:30<2:32:23,  7.76s/it]
 97%|█████████▋| 36785/37963 [90:53:37<2:31:02,  7.69s/it]
 97%|█████████▋| 36786/37963 [90:53:45<2:31:08,  7.70s/it]
 97%|█████████▋| 36787/37963 [90:54:00<3:12:28,  9.82s/it]
 97%|█████████▋| 36788/37963 [90:54:07<2:59:31,  9.17s/it]
 97%|█████████▋| 36789/37963 [90:54:15<2:49:51,  8.68s/it]
 97%|█████████▋| 36790/37963 [90:54:23<2:44:58,  8.44s/it]
                                                          
{'loss': '0.07377', 'grad_norm': '3.187', 'learning_rate': '5.012e-08', 'epoch': '0.9691'}
+
 97%|█████████▋| 36790/37963 [90:54:23<2:44:58,  8.44s/it]
 97%|█████████▋| 36791/37963 [90:54:30<2:40:28,  8.22s/it]
 97%|█████████▋| 36792/37963 [90:54:38<2:37:45,  8.08s/it]
 97%|█████████▋| 36793/37963 [90:54:46<2:35:10,  7.96s/it]
 97%|█████████▋| 36794/37963 [90:54:54<2:34:00,  7.90s/it]
 97%|█████████▋| 36795/37963 [90:55:01<2:30:48,  7.75s/it]
 97%|█████████▋| 36796/37963 [90:55:09<2:30:31,  7.74s/it]
 97%|█████████▋| 36797/37963 [90:55:24<3:11:53,  9.87s/it]
 97%|█████████▋| 36798/37963 [90:55:31<2:59:23,  9.24s/it]
 97%|█████████▋| 36799/37963 [90:55:39<2:49:46,  8.75s/it]
 97%|█████████▋| 36800/37963 [90:55:47<2:44:16,  8.48s/it]
                                                          
{'loss': '0.07843', 'grad_norm': '4.149', 'learning_rate': '4.927e-08', 'epoch': '0.9694'}
+
 97%|█████████▋| 36800/37963 [90:55:47<2:44:16,  8.48s/it]
 97%|█████████▋| 36801/37963 [90:55:55<2:40:20,  8.28s/it]
 97%|█████████▋| 36802/37963 [90:56:15<3:53:20, 12.06s/it]
 97%|█████████▋| 36803/37963 [90:56:23<3:29:25, 10.83s/it]
 97%|█████████▋| 36804/37963 [90:56:31<3:10:45,  9.88s/it]
 97%|█████████▋| 36805/37963 [90:56:39<2:59:10,  9.28s/it]
 97%|█████████▋| 36806/37963 [90:56:53<3:27:14, 10.75s/it]
 97%|█████████▋| 36807/37963 [90:57:01<3:09:46,  9.85s/it]
 97%|█████████▋| 36808/37963 [90:57:08<2:56:11,  9.15s/it]
 97%|█████████▋| 36809/37963 [90:57:16<2:48:02,  8.74s/it]
 97%|█████████▋| 36810/37963 [90:57:24<2:42:01,  8.43s/it]
                                                          
{'loss': '0.08038', 'grad_norm': '2.806', 'learning_rate': '4.842e-08', 'epoch': '0.9696'}
+
 97%|█████████▋| 36810/37963 [90:57:24<2:42:01,  8.43s/it]
 97%|█████████▋| 36811/37963 [90:57:32<2:38:22,  8.25s/it]
 97%|█████████▋| 36812/37963 [90:57:39<2:35:00,  8.08s/it]
 97%|█████████▋| 36813/37963 [90:57:47<2:33:37,  8.02s/it]
 97%|█████████▋| 36814/37963 [90:57:55<2:31:47,  7.93s/it]
 97%|█████████▋| 36815/37963 [90:58:03<2:30:24,  7.86s/it]
 97%|█████████▋| 36816/37963 [90:58:17<3:07:09,  9.79s/it]
 97%|█████████▋| 36817/37963 [90:58:25<2:55:37,  9.20s/it]
 97%|█████████▋| 36818/37963 [90:58:33<2:47:41,  8.79s/it]
 97%|█████████▋| 36819/37963 [90:58:40<2:41:53,  8.49s/it]
 97%|█████████▋| 36820/37963 [90:58:55<3:14:24, 10.21s/it]
                                                          
{'loss': '0.0774', 'grad_norm': '2.395', 'learning_rate': '4.759e-08', 'epoch': '0.9699'}
+
 97%|█████████▋| 36820/37963 [90:58:55<3:14:24, 10.21s/it]
 97%|█████████▋| 36821/37963 [90:59:09<3:37:03, 11.40s/it]
 97%|█████████▋| 36822/37963 [90:59:16<3:15:20, 10.27s/it]
 97%|█████████▋| 36823/37963 [90:59:24<2:59:08,  9.43s/it]
 97%|█████████▋| 36824/37963 [90:59:31<2:48:04,  8.85s/it]
 97%|█████████▋| 36825/37963 [90:59:39<2:41:39,  8.52s/it]
 97%|█████████▋| 36826/37963 [90:59:47<2:37:12,  8.30s/it]
 97%|█████████▋| 36827/37963 [90:59:55<2:34:57,  8.18s/it]
 97%|██████��██▋| 36828/37963 [91:00:03<2:32:36,  8.07s/it]
 97%|█████████▋| 36829/37963 [91:00:10<2:30:19,  7.95s/it]
 97%|█████████▋| 36830/37963 [91:00:18<2:29:39,  7.93s/it]
                                                          
{'loss': '0.08344', 'grad_norm': '3.024', 'learning_rate': '4.676e-08', 'epoch': '0.9702'}
+
 97%|█████████▋| 36830/37963 [91:00:18<2:29:39,  7.93s/it]
 97%|█████████▋| 36831/37963 [91:00:26<2:27:53,  7.84s/it]
 97%|█████████▋| 36832/37963 [91:00:33<2:26:17,  7.76s/it]
 97%|█████████▋| 36833/37963 [91:00:49<3:11:57, 10.19s/it]
 97%|█████████▋| 36834/37963 [91:00:57<2:57:58,  9.46s/it]
 97%|█████████▋| 36835/37963 [91:01:05<2:47:56,  8.93s/it]
 97%|█████████▋| 36836/37963 [91:01:13<2:41:19,  8.59s/it]
 97%|█████████▋| 36837/37963 [91:01:20<2:36:58,  8.36s/it]
 97%|█████████▋| 36838/37963 [91:01:28<2:33:30,  8.19s/it]
 97%|█████████▋| 36839/37963 [91:01:36<2:30:49,  8.05s/it]
 97%|█████████▋| 36840/37963 [91:01:44<2:30:11,  8.02s/it]
                                                          
{'loss': '0.09053', 'grad_norm': '5.282', 'learning_rate': '4.594e-08', 'epoch': '0.9704'}
+
 97%|█████████▋| 36840/37963 [91:01:44<2:30:11,  8.02s/it]
 97%|█████████▋| 36841/37963 [91:01:52<2:29:01,  7.97s/it]
 97%|█████████▋| 36842/37963 [91:01:59<2:25:54,  7.81s/it]
 97%|█████████▋| 36843/37963 [91:02:13<3:02:21,  9.77s/it]
 97%|█████████▋| 36844/37963 [91:02:21<2:51:55,  9.22s/it]
 97%|█████████▋| 36845/37963 [91:02:29<2:44:25,  8.82s/it]
 97%|█████████▋| 36846/37963 [91:02:44<3:15:35, 10.51s/it]
 97%|█████████▋| 36847/37963 [91:02:51<2:58:52,  9.62s/it]
 97%|█████████▋| 36848/37963 [91:02:59<2:47:16,  9.00s/it]
 97%|█████████▋| 36849/37963 [91:03:13<3:17:45, 10.65s/it]
 97%|█████████▋| 36850/37963 [91:03:21<3:02:30,  9.84s/it]
                                                          
{'loss': '0.09534', 'grad_norm': '3.098', 'learning_rate': '4.513e-08', 'epoch': '0.9707'}
+
 97%|█████████▋| 36850/37963 [91:03:21<3:02:30,  9.84s/it]
 97%|█████████▋| 36851/37963 [91:03:35<3:26:47, 11.16s/it]
 97%|█████████▋| 36852/37963 [91:03:44<3:10:02, 10.26s/it]
 97%|█████████▋| 36853/37963 [91:03:52<2:57:00,  9.57s/it]
 97%|█████████▋| 36854/37963 [91:04:00<2:48:29,  9.12s/it]
 97%|█████████▋| 36855/37963 [91:04:07<2:39:28,  8.64s/it]
 97%|█████████▋| 36856/37963 [91:04:15<2:35:01,  8.40s/it]
 97%|█████████▋| 36857/37963 [91:04:23<2:32:29,  8.27s/it]
 97%|█████████▋| 36858/37963 [91:04:31<2:29:16,  8.11s/it]
 97%|█████████▋| 36859/37963 [91:04:38<2:26:53,  7.98s/it]
 97%|█████████▋| 36860/37963 [91:04:46<2:24:26,  7.86s/it]
                                                          
{'loss': '0.07747', 'grad_norm': '2.072', 'learning_rate': '4.432e-08', 'epoch': '0.9709'}
+
 97%|█████████▋| 36860/37963 [91:04:46<2:24:26,  7.86s/it]
 97%|█████████▋| 36861/37963 [91:04:54<2:24:25,  7.86s/it]
 97%|█████████▋| 36862/37963 [91:05:01<2:22:12,  7.75s/it]
 97%|█████████▋| 36863/37963 [91:05:16<2:59:20,  9.78s/it]
 97%|█████████▋| 36864/37963 [91:05:30<3:22:21, 11.05s/it]
 97%|█████████▋| 36865/37963 [91:05:44<3:41:01, 12.08s/it]
 97%|█████████▋| 36866/37963 [91:05:52<3:18:04, 10.83s/it]
 97%|█████████▋| 36867/37963 [91:06:00<3:00:26,  9.88s/it]
 97%|█████████▋| 36868/37963 [91:06:07<2:46:59,  9.15s/it]
 97%|█████████▋| 36869/37963 [91:06:15<2:39:39,  8.76s/it]
 97%|█████████▋| 36870/37963 [91:06:23<2:33:58,  8.45s/it]
                                                          
{'loss': '0.07085', 'grad_norm': '3.209', 'learning_rate': '4.352e-08', 'epoch': '0.9712'}
+
 97%|█████████▋| 36870/37963 [91:06:23<2:33:58,  8.45s/it]
 97%|█████████▋| 36871/37963 [91:06:31<2:29:46,  8.23s/it]
 97%|█████████▋| 36872/37963 [91:06:39<2:27:27,  8.11s/it]
 97%|█████████▋| 36873/37963 [91:06:46<2:25:35,  8.01s/it]
 97%|█████████▋| 36874/37963 [91:06:54<2:23:24,  7.90s/it]
 97%|█████████▋| 36875/37963 [91:07:02<2:22:11,  7.84s/it]
 97%|█████████▋| 36876/37963 [91:07:09<2:19:56,  7.72s/it]
 97%|█████████▋| 36877/37963 [91:07:17<2:19:26,  7.70s/it]
 97%|█████████▋| 36878/37963 [91:07:24<2:19:15,  7.70s/it]
 97%|█████████▋| 36879/37963 [91:07:39<2:58:24,  9.87s/it]
 97%|█████████▋| 36880/37963 [91:07:47<2:47:10,  9.26s/it]
                                                          
{'loss': '0.07047', 'grad_norm': '4.408', 'learning_rate': '4.273e-08', 'epoch': '0.9715'}
+
 97%|█████████▋| 36880/37963 [91:07:47<2:47:10,  9.26s/it]
 97%|█████████▋| 36881/37963 [91:07:55<2:39:13,  8.83s/it]
 97%|█████████▋| 36882/37963 [91:08:03<2:33:06,  8.50s/it]
 97%|█████████▋| 36883/37963 [91:08:10<2:27:03,  8.17s/it]
 97%|█████████▋| 36884/37963 [91:08:18<2:24:50,  8.05s/it]
 97%|█████████▋| 36885/37963 [91:08:26<2:22:53,  7.95s/it]
 97%|█████████▋| 36886/37963 [91:08:33<2:19:10,  7.75s/it]
 97%|█████████▋| 36887/37963 [91:08:40<2:17:06,  7.65s/it]
 97%|█████████▋| 36888/37963 [91:08:48<2:17:27,  7.67s/it]
 97%|█████████▋| 36889/37963 [91:08:56<2:18:33,  7.74s/it]
 97%|█████████▋| 36890/37963 [91:09:10<2:53:25,  9.70s/it]
                                                          
{'loss': '0.07779', 'grad_norm': '3.732', 'learning_rate': '4.195e-08', 'epoch': '0.9717'}
+
 97%|█████████▋| 36890/37963 [91:09:10<2:53:25,  9.70s/it]
 97%|█████████▋| 36891/37963 [91:09:18<2:42:12,  9.08s/it]
 97%|█████████▋| 36892/37963 [91:09:26<2:34:35,  8.66s/it]
 97%|█████████▋| 36893/37963 [91:09:33<2:29:30,  8.38s/it]
 97%|█████████▋| 36894/37963 [91:09:41<2:24:27,  8.11s/it]
 97%|█████████▋| 36895/37963 [91:09:48<2:22:11,  7.99s/it]
 97%|█████████▋| 36896/37963 [91:10:03<2:56:49,  9.94s/it]
 97%|█████████▋| 36897/37963 [91:10:11<2:45:22,  9.31s/it]
 97%|█████████▋| 36898/37963 [91:10:19<2:37:27,  8.87s/it]
 97%|█████████▋| 36899/37963 [91:10:26<2:30:26,  8.48s/it]
 97%|█████████▋| 36900/37963 [91:10:40<3:00:11, 10.17s/it]
                                                          
{'loss': '0.07429', 'grad_norm': '3.779', 'learning_rate': '4.117e-08', 'epoch': '0.972'}
+
 97%|█████████▋| 36900/37963 [91:10:40<3:00:11, 10.17s/it]
 97%|█████████▋| 36901/37963 [91:10:48<2:47:25,  9.46s/it]
 97%|█████████▋| 36902/37963 [91:11:03<3:17:44, 11.18s/it]
 97%|█████████▋| 36903/37963 [91:11:11<2:59:20, 10.15s/it]
 97%|█████████▋| 36904/37963 [91:11:19<2:45:46,  9.39s/it]
 97%|█████████▋| 36905/37963 [91:11:26<2:35:39,  8.83s/it]
 97%|█████████▋| 36906/37963 [91:11:34<2:30:15,  8.53s/it]
 97%|█████████▋| 36907/37963 [91:11:48<2:59:28, 10.20s/it]
 97%|█████████▋| 36908/37963 [91:11:56<2:46:41,  9.48s/it]
 97%|█████████▋| 36909/37963 [91:12:10<3:11:21, 10.89s/it]
 97%|█████████▋| 36910/37963 [91:12:18<2:55:07,  9.98s/it]
                                                          
{'loss': '0.07595', 'grad_norm': '3.353', 'learning_rate': '4.04e-08', 'epoch': '0.9723'}
+
 97%|█████████▋| 36910/37963 [91:12:18<2:55:07,  9.98s/it]
 97%|█████████▋| 36911/37963 [91:12:26<2:42:47,  9.28s/it]
 97%|█████████▋| 36912/37963 [91:12:33<2:34:19,  8.81s/it]
 97%|█████████▋| 36913/37963 [91:12:41<2:27:22,  8.42s/it]
 97%|█████████▋| 36914/37963 [91:12:49<2:24:22,  8.26s/it]
 97%|█████████▋| 36915/37963 [91:12:56<2:19:21,  7.98s/it]
 97%|█████████▋| 36916/37963 [91:13:04<2:17:53,  7.90s/it]
 97%|█████████▋| 36917/37963 [91:13:18<2:51:45,  9.85s/it]
 97%|█████████▋| 36918/37963 [91:13:26<2:41:23,  9.27s/it]
 97%|█████████▋| 36919/37963 [91:13:34<2:33:08,  8.80s/it]
 97%|█████████▋| 36920/37963 [91:13:41<2:25:50,  8.39s/it]
                                                          
{'loss': '0.07602', 'grad_norm': '4.141', 'learning_rate': '3.964e-08', 'epoch': '0.9725'}
+
 97%|█████████▋| 36920/37963 [91:13:41<2:25:50,  8.39s/it]
 97%|█████████▋| 36921/37963 [91:13:49<2:23:55,  8.29s/it]
 97%|█████████▋| 36922/37963 [91:13:57<2:20:01,  8.07s/it]
 97%|█████████▋| 36923/37963 [91:14:05<2:18:31,  7.99s/it]
 97%|█████████▋| 36924/37963 [91:14:12<2:17:09,  7.92s/it]
 97%|█████████▋| 36925/37963 [91:14:20<2:16:28,  7.89s/it]
 97%|█████████▋| 36926/37963 [91:14:28<2:15:22,  7.83s/it]
 97%|█████████▋| 36927/37963 [91:14:43<2:50:53,  9.90s/it]
 97%|█████████▋| 36928/37963 [91:14:50<2:39:54,  9.27s/it]
 97%|█████████▋| 36929/37963 [91:14:58<2:30:59,  8.76s/it]
 97%|█████████▋| 36930/37963 [91:15:06<2:25:05,  8.43s/it]
                                                          
{'loss': '0.07733', 'grad_norm': '3.971', 'learning_rate': '3.888e-08', 'epoch': '0.9728'}
+
 97%|█████████▋| 36930/37963 [91:15:06<2:25:05,  8.43s/it]
 97%|█████████▋| 36931/37963 [91:15:13<2:21:20,  8.22s/it]
 97%|█████████▋| 36932/37963 [91:15:21<2:17:55,  8.03s/it]
 97%|█████████▋| 36933/37963 [91:15:29<2:16:35,  7.96s/it]
 97%|█████████▋| 36934/37963 [91:15:36<2:15:05,  7.88s/it]
 97%|█████████▋| 36935/37963 [91:15:44<2:12:21,  7.73s/it]
 97%|█████████▋| 36936/37963 [91:15:52<2:12:03,  7.72s/it]
 97%|█████████▋| 36937/37963 [91:15:59<2:12:31,  7.75s/it]
 97%|█████████▋| 36938/37963 [91:16:07<2:11:57,  7.72s/it]
 97%|█████████▋| 36939/37963 [91:16:22<2:49:23,  9.93s/it]
 97%|█████████▋| 36940/37963 [91:16:30<2:39:28,  9.35s/it]
                                                          
{'loss': '0.0937', 'grad_norm': '4.2', 'learning_rate': '3.814e-08', 'epoch': '0.9731'}
+
 97%|█████████▋| 36940/37963 [91:16:30<2:39:28,  9.35s/it]
 97%|█████████▋| 36941/37963 [91:16:38<2:31:51,  8.92s/it]
 97%|█████████▋| 36942/37963 [91:16:53<3:01:04, 10.64s/it]
 97%|█████████▋| 36943/37963 [91:17:00<2:44:48,  9.69s/it]
 97%|█████████▋| 36944/37963 [91:17:15<3:09:12, 11.14s/it]
 97%|█████████▋| 36945/37963 [91:17:22<2:51:54, 10.13s/it]
 97%|█████████▋| 36946/37963 [91:17:30<2:40:22,  9.46s/it]
 97%|█████████▋| 36947/37963 [91:17:38<2:30:58,  8.92s/it]
 97%|█████████▋| 36948/37963 [91:17:46<2:24:24,  8.54s/it]
 97%|█████████▋| 36949/37963 [91:17:53<2:19:50,  8.27s/it]
 97%|█████████▋| 36950/37963 [91:18:01<2:16:37,  8.09s/it]
                                                          
{'loss': '0.09208', 'grad_norm': '4.016', 'learning_rate': '3.739e-08', 'epoch': '0.9733'}
+
 97%|█████████▋| 36950/37963 [91:18:01<2:16:37,  8.09s/it]
 97%|█████████▋| 36951/37963 [91:18:15<2:47:42,  9.94s/it]
 97%|█████████▋| 36952/37963 [91:18:23<2:36:37,  9.29s/it]
 97%|█████████▋| 36953/37963 [91:18:31<2:28:22,  8.81s/it]
 97%|█████████▋| 36954/37963 [91:18:38<2:22:47,  8.49s/it]
 97%|█████████▋| 36955/37963 [91:18:53<2:52:59, 10.30s/it]
 97%|█████████▋| 36956/37963 [91:19:00<2:38:28,  9.44s/it]
 97%|█████████▋| 36957/37963 [91:19:08<2:29:54,  8.94s/it]
 97%|█████████▋| 36958/37963 [91:19:16<2:22:27,  8.50s/it]
 97%|█████████▋| 36959/37963 [91:19:23<2:17:47,  8.24s/it]
 97%|█████████▋| 36960/37963 [91:19:31<2:15:37,  8.11s/it]
                                                          
{'loss': '0.0835', 'grad_norm': '3.191', 'learning_rate': '3.666e-08', 'epoch': '0.9736'}
+
 97%|█████████▋| 36960/37963 [91:19:31<2:15:37,  8.11s/it]
 97%|█████████▋| 36961/37963 [91:19:38<2:11:42,  7.89s/it]
 97%|█████████▋| 36962/37963 [91:19:46<2:10:50,  7.84s/it]
 97%|█████████▋| 36963/37963 [91:19:54<2:10:04,  7.80s/it]
 97%|█████████▋| 36964/37963 [91:20:02<2:09:20,  7.77s/it]
 97%|█████████▋| 36965/37963 [91:20:09<2:09:07,  7.76s/it]
 97%|█████████▋| 36966/37963 [91:20:17<2:08:57,  7.76s/it]
 97%|█████████▋| 36967/37963 [91:20:25<2:08:41,  7.75s/it]
 97%|█████████▋| 36968/37963 [91:20:33<2:08:37,  7.76s/it]
 97%|█████████▋| 36969/37963 [91:20:40<2:08:14,  7.74s/it]
 97%|█████████▋| 36970/37963 [91:20:55<2:41:52,  9.78s/it]
                                                          
{'loss': '0.06225', 'grad_norm': '3.945', 'learning_rate': '3.594e-08', 'epoch': '0.9738'}
+
 97%|█████████▋| 36970/37963 [91:20:55<2:41:52,  9.78s/it]
 97%|█████████▋| 36971/37963 [91:21:03<2:32:24,  9.22s/it]
 97%|█████████▋| 36972/37963 [91:21:10<2:23:20,  8.68s/it]
 97%|█████████▋| 36973/37963 [91:21:18<2:19:03,  8.43s/it]
 97%|█████████▋| 36974/37963 [91:21:26<2:15:14,  8.21s/it]
 97%|█████████▋| 36975/37963 [91:21:33<2:12:34,  8.05s/it]
 97%|█████████▋| 36976/37963 [91:21:48<2:45:27, 10.06s/it]
 97%|█████████▋| 36977/37963 [91:21:56<2:33:09,  9.32s/it]
 97%|█████████▋| 36978/37963 [91:22:03<2:24:31,  8.80s/it]
 97%|█████████▋| 36979/37963 [91:22:11<2:17:48,  8.40s/it]
 97%|█████████▋| 36980/37963 [91:22:19<2:14:40,  8.22s/it]
                                                          
{'loss': '0.08834', 'grad_norm': '4.525', 'learning_rate': '3.522e-08', 'epoch': '0.9741'}
+
 97%|█████████▋| 36980/37963 [91:22:19<2:14:40,  8.22s/it]
 97%|█████████▋| 36981/37963 [91:22:26<2:11:43,  8.05s/it]
 97%|█████████▋| 36982/37963 [91:22:34<2:09:43,  7.93s/it]
 97%|█████████▋| 36983/37963 [91:22:42<2:08:34,  7.87s/it]
 97%|█████████▋| 36984/37963 [91:22:49<2:08:01,  7.85s/it]
 97%|█████████▋| 36985/37963 [91:22:57<2:07:06,  7.80s/it]
 97%|█████████▋| 36986/37963 [91:23:11<2:38:14,  9.72s/it]
 97%|█████████▋| 36987/37963 [91:23:26<3:03:14, 11.26s/it]
 97%|█████████▋| 36988/37963 [91:23:40<3:17:13, 12.14s/it]
 97%|█████████▋| 36989/37963 [91:23:48<2:56:23, 10.87s/it]
 97%|█████████▋| 36990/37963 [91:23:56<2:41:23,  9.95s/it]
                                                          
{'loss': '0.07712', 'grad_norm': '3.422', 'learning_rate': '3.45e-08', 'epoch': '0.9744'}
+
 97%|█████████▋| 36990/37963 [91:23:56<2:41:23,  9.95s/it]
 97%|█████████▋| 36991/37963 [91:24:04<2:29:50,  9.25s/it]
 97%|█████████▋| 36992/37963 [91:24:11<2:19:48,  8.64s/it]
 97%|█████████▋| 36993/37963 [91:24:19<2:15:18,  8.37s/it]
 97%|█████████▋| 36994/37963 [91:24:26<2:11:54,  8.17s/it]
 97%|█████████▋| 36995/37963 [91:24:34<2:09:09,  8.01s/it]
 97%|█████████▋| 36996/37963 [91:24:42<2:07:24,  7.91s/it]
 97%|█████████▋| 36997/37963 [91:24:49<2:06:28,  7.86s/it]
 97%|█████████▋| 36998/37963 [91:24:57<2:05:41,  7.82s/it]
 97%|█████████▋| 36999/37963 [91:25:11<2:35:52,  9.70s/it]
 97%|█████████▋| 37000/37963 [91:25:26<2:59:29, 11.18s/it]
                                                          
{'loss': '0.06669', 'grad_norm': '3.535', 'learning_rate': '3.38e-08', 'epoch': '0.9746'}
+
 97%|█████████▋| 37000/37963 [91:25:26<2:59:29, 11.18s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.79s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.80s/it]
+/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:177: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
+  with torch.cuda.amp.autocast(dtype=dtype):
+
 97%|█████████▋| 37001/37963 [91:26:23<6:42:35, 25.11s/it]
 97%|█████████▋| 37002/37963 [91:26:31<5:18:52, 19.91s/it]
 97%|█████████▋| 37003/37963 [91:26:46<4:52:40, 18.29s/it]
 97%|█████████▋| 37004/37963 [91:26:53<4:01:13, 15.09s/it]
 97%|█████████▋| 37005/37963 [91:27:01<3:26:04, 12.91s/it]
 97%|█████████▋| 37006/37963 [91:27:09<3:00:56, 11.34s/it]
 97%|█████████▋| 37007/37963 [91:27:17<2:43:02, 10.23s/it]
 97%|█████████▋| 37008/37963 [91:27:24<2:30:40,  9.47s/it]
 97%|█████████▋| 37009/37963 [91:27:32<2:22:09,  8.94s/it]
 97%|█████████▋| 37010/37963 [91:27:40<2:16:48,  8.61s/it]
                                                          
{'loss': '0.07273', 'grad_norm': '3.627', 'learning_rate': '3.31e-08', 'epoch': '0.9749'}
+
 97%|█████████▋| 37010/37963 [91:27:40<2:16:48,  8.61s/it]
 97%|█████████▋| 37011/37963 [91:27:47<2:12:10,  8.33s/it]
 97%|█████████▋| 37012/37963 [91:27:55<2:08:43,  8.12s/it]
 97%|█████████▋| 37013/37963 [91:28:03<2:06:41,  8.00s/it]
 98%|█████████▊| 37014/37963 [91:28:10<2:04:13,  7.85s/it]
 98%|█████████▊| 37015/37963 [91:28:18<2:03:31,  7.82s/it]
 98%|█████████▊| 37016/37963 [91:28:26<2:02:27,  7.76s/it]
 98%|█████████▊| 37017/37963 [91:28:33<2:02:07,  7.75s/it]
 98%|█████████▊| 37018/37963 [91:28:41<2:01:54,  7.74s/it]
 98%|█████████▊| 37019/37963 [91:28:49<2:01:27,  7.72s/it]
 98%|█████████▊| 37020/37963 [91:28:56<2:00:44,  7.68s/it]
                                                          
{'loss': '0.07383', 'grad_norm': '3.819', 'learning_rate': '3.241e-08', 'epoch': '0.9752'}
+
 98%|█████████▊| 37020/37963 [91:28:56<2:00:44,  7.68s/it]
 98%|█████████▊| 37021/37963 [91:29:18<3:04:29, 11.75s/it]
 98%|█████████▊| 37022/37963 [91:29:25<2:45:43, 10.57s/it]
 98%|█████████▊| 37023/37963 [91:29:33<2:31:43,  9.68s/it]
 98%|█████████▊| 37024/37963 [91:29:41<2:22:19,  9.09s/it]
 98%|█████████▊| 37025/37963 [91:29:49<2:15:50,  8.69s/it]
 98%|█████████▊| 37026/37963 [91:29:56<2:10:28,  8.35s/it]
 98%|█████████▊| 37027/37963 [91:30:04<2:06:14,  8.09s/it]
 98%|█████████▊| 37028/37963 [91:30:11<2:04:42,  8.00s/it]
 98%|█████████▊| 37029/37963 [91:30:19<2:03:51,  7.96s/it]
 98%|█████████▊| 37030/37963 [91:30:27<2:02:01,  7.85s/it]
                                                          
{'loss': '0.06988', 'grad_norm': '4.088', 'learning_rate': '3.173e-08', 'epoch': '0.9754'}
+
 98%|█████████▊| 37030/37963 [91:30:27<2:02:01,  7.85s/it]
 98%|█████████▊| 37031/37963 [91:30:34<2:00:57,  7.79s/it]
 98%|█████████▊| 37032/37963 [91:30:42<2:00:47,  7.78s/it]
 98%|█████████▊| 37033/37963 [91:30:50<2:00:07,  7.75s/it]
 98%|█████████▊| 37034/37963 [91:30:57<1:58:08,  7.63s/it]
 98%|█████████▊| 37035/37963 [91:31:05<1:57:29,  7.60s/it]
 98%|█████████▊| 37036/37963 [91:31:19<2:28:22,  9.60s/it]
 98%|█████████▊| 37037/37963 [91:31:27<2:19:06,  9.01s/it]
 98%|█████████▊| 37038/37963 [91:31:34<2:12:46,  8.61s/it]
 98%|█████████▊| 37039/37963 [91:31:49<2:38:51, 10.32s/it]
 98%|█████████▊| 37040/37963 [91:32:03<2:56:57, 11.50s/it]
                                                          
{'loss': '0.06831', 'grad_norm': '2.956', 'learning_rate': '3.105e-08', 'epoch': '0.9757'}
+
 98%|█████████▊| 37040/37963 [91:32:03<2:56:57, 11.50s/it]
 98%|█████████▊| 37041/37963 [91:32:11<2:39:20, 10.37s/it]
 98%|█████████▊| 37042/37963 [91:32:18<2:27:16,  9.59s/it]
 98%|█████████▊| 37043/37963 [91:32:26<2:18:27,  9.03s/it]
 98%|█████████▊| 37044/37963 [91:32:34<2:12:29,  8.65s/it]
 98%|█████████▊| 37045/37963 [91:32:42<2:07:45,  8.35s/it]
 98%|█████████▊| 37046/37963 [91:32:49<2:03:58,  8.11s/it]
 98%|█████████▊| 37047/37963 [91:33:03<2:29:38,  9.80s/it]
 98%|█████████▊| 37048/37963 [91:33:10<2:19:10,  9.13s/it]
 98%|█████████▊| 37049/37963 [91:33:18<2:13:12,  8.74s/it]
 98%|█████████▊| 37050/37963 [91:33:33<2:41:18, 10.60s/it]
                                                          
{'loss': '0.09697', 'grad_norm': '3.817', 'learning_rate': '3.039e-08', 'epoch': '0.976'}
+
 98%|█████████▊| 37050/37963 [91:33:33<2:41:18, 10.60s/it]
 98%|█████████▊| 37051/37963 [91:33:41<2:28:27,  9.77s/it]
 98%|█████████▊| 37052/37963 [91:33:49<2:18:58,  9.15s/it]
 98%|█████████▊| 37053/37963 [91:34:03<2:42:30, 10.71s/it]
 98%|█████████▊| 37054/37963 [91:34:11<2:28:44,  9.82s/it]
 98%|█████████▊| 37055/37963 [91:34:19<2:19:06,  9.19s/it]
 98%|█████████▊| 37056/37963 [91:34:26<2:11:58,  8.73s/it]
 98%|█████████▊| 37057/37963 [91:34:34<2:06:58,  8.41s/it]
 98%|█████████▊| 37058/37963 [91:34:42<2:03:36,  8.20s/it]
 98%|█████████▊| 37059/37963 [91:34:49<2:00:47,  8.02s/it]
 98%|█████████▊| 37060/37963 [91:34:57<1:59:31,  7.94s/it]
                                                          
{'loss': '0.08493', 'grad_norm': '3.164', 'learning_rate': '2.973e-08', 'epoch': '0.9762'}
+
 98%|█████████▊| 37060/37963 [91:34:57<1:59:31,  7.94s/it]
 98%|█████████▊| 37061/37963 [91:35:04<1:57:41,  7.83s/it]
 98%|█████████▊| 37062/37963 [91:35:12<1:56:15,  7.74s/it]
 98%|█████████▊| 37063/37963 [91:35:20<1:56:01,  7.73s/it]
 98%|█████████▊| 37064/37963 [91:35:27<1:55:36,  7.72s/it]
 98%|█████████▊| 37065/37963 [91:35:35<1:55:08,  7.69s/it]
 98%|█████████▊| 37066/37963 [91:35:43<1:55:00,  7.69s/it]
 98%|█████████▊| 37067/37963 [91:35:51<1:55:20,  7.72s/it]
 98%|█████████▊| 37068/37963 [91:35:58<1:55:28,  7.74s/it]
 98%|█████████▊| 37069/37963 [91:36:13<2:25:30,  9.77s/it]
 98%|█████████▊| 37070/37963 [91:36:21<2:16:46,  9.19s/it]
                                                          
{'loss': '0.08992', 'grad_norm': '3.506', 'learning_rate': '2.907e-08', 'epoch': '0.9765'}
+
 98%|█████████▊| 37070/37963 [91:36:21<2:16:46,  9.19s/it]
 98%|█████████▊| 37071/37963 [91:36:28<2:09:58,  8.74s/it]
 98%|█████████▊| 37072/37963 [91:36:36<2:04:08,  8.36s/it]
 98%|█████████▊| 37073/37963 [91:36:51<2:34:43, 10.43s/it]
 98%|█████████▊| 37074/37963 [91:36:59<2:22:33,  9.62s/it]
 98%|█████████▊| 37075/37963 [91:37:06<2:13:42,  9.03s/it]
 98%|█████████▊| 37076/37963 [91:37:14<2:07:46,  8.64s/it]
 98%|█████████▊| 37077/37963 [91:37:22<2:03:08,  8.34s/it]
 98%|█████████▊| 37078/37963 [91:37:29<1:59:13,  8.08s/it]
 98%|█████████▊| 37079/37963 [91:37:37<1:57:36,  7.98s/it]
 98%|█████████▊| 37080/37963 [91:37:51<2:25:44,  9.90s/it]
                                                          
{'loss': '0.07178', 'grad_norm': '2.829', 'learning_rate': '2.843e-08', 'epoch': '0.9767'}
+
 98%|█████████▊| 37080/37963 [91:37:51<2:25:44,  9.90s/it]
 98%|█████████▊| 37081/37963 [91:37:59<2:16:54,  9.31s/it]
 98%|█████████▊| 37082/37963 [91:38:07<2:10:03,  8.86s/it]
 98%|█████████▊| 37083/37963 [91:38:15<2:05:01,  8.52s/it]
 98%|█████████▊| 37084/37963 [91:38:23<2:01:32,  8.30s/it]
 98%|█████████▊| 37085/37963 [91:38:30<1:58:30,  8.10s/it]
 98%|█████████▊| 37086/37963 [91:38:38<1:57:01,  8.01s/it]
 98%|█████████▊| 37087/37963 [91:38:46<1:54:03,  7.81s/it]
 98%|█████████▊| 37088/37963 [91:39:00<2:22:47,  9.79s/it]
 98%|█████████▊| 37089/37963 [91:39:08<2:13:32,  9.17s/it]
 98%|█████████▊| 37090/37963 [91:39:15<2:06:52,  8.72s/it]
                                                          
{'loss': '0.07621', 'grad_norm': '2.9', 'learning_rate': '2.779e-08', 'epoch': '0.977'}
+
 98%|█████████▊| 37090/37963 [91:39:15<2:06:52,  8.72s/it]
 98%|█████████▊| 37091/37963 [91:39:30<2:34:14, 10.61s/it]
 98%|█████████▊| 37092/37963 [91:39:45<2:49:37, 11.69s/it]
 98%|█████████▊| 37093/37963 [91:39:52<2:32:31, 10.52s/it]
 98%|█████████▊| 37094/37963 [91:40:00<2:20:07,  9.67s/it]
 98%|█████████▊| 37095/37963 [91:40:08<2:11:25,  9.08s/it]
 98%|█████████▊| 37096/37963 [91:40:16<2:05:39,  8.70s/it]
 98%|█████████▊| 37097/37963 [91:40:23<2:00:33,  8.35s/it]
 98%|█████████▊| 37098/37963 [91:40:31<1:57:17,  8.14s/it]
 98%|█████████▊| 37099/37963 [91:40:38<1:55:12,  8.00s/it]
 98%|█████████▊| 37100/37963 [91:40:53<2:25:15, 10.10s/it]
                                                          
{'loss': '0.05856', 'grad_norm': '2.454', 'learning_rate': '2.715e-08', 'epoch': '0.9773'}
+
 98%|█████████▊| 37100/37963 [91:40:53<2:25:15, 10.10s/it]
 98%|█████████▊| 37101/37963 [91:41:01<2:15:24,  9.42s/it]
 98%|█████████▊| 37102/37963 [91:41:16<2:36:14, 10.89s/it]
 98%|█████████▊| 37103/37963 [91:41:23<2:21:46,  9.89s/it]
 98%|█████████▊| 37104/37963 [91:41:31<2:11:21,  9.18s/it]
 98%|█████████▊| 37105/37963 [91:41:38<2:03:41,  8.65s/it]
 98%|█████████▊| 37106/37963 [91:41:46<1:59:26,  8.36s/it]
 98%|█████████▊| 37107/37963 [91:41:53<1:56:22,  8.16s/it]
 98%|█████████▊| 37108/37963 [91:42:01<1:54:29,  8.03s/it]
 98%|█████████▊| 37109/37963 [91:42:09<1:53:01,  7.94s/it]
 98%|█████████▊| 37110/37963 [91:42:17<1:51:55,  7.87s/it]
                                                          
{'loss': '0.08513', 'grad_norm': '3.632', 'learning_rate': '2.653e-08', 'epoch': '0.9775'}
+
 98%|█████████▊| 37110/37963 [91:42:17<1:51:55,  7.87s/it]
 98%|█████████▊| 37111/37963 [91:42:24<1:50:58,  7.81s/it]
 98%|█████████▊| 37112/37963 [91:42:32<1:50:30,  7.79s/it]
 98%|█████████▊| 37113/37963 [91:42:39<1:48:12,  7.64s/it]
 98%|█████████▊| 37114/37963 [91:42:47<1:48:11,  7.65s/it]
 98%|█████████▊| 37115/37963 [91:42:55<1:48:06,  7.65s/it]
 98%|█████████▊| 37116/37963 [91:43:02<1:48:08,  7.66s/it]
 98%|█████████▊| 37117/37963 [91:43:10<1:47:26,  7.62s/it]
 98%|█████████▊| 37118/37963 [91:43:17<1:47:24,  7.63s/it]
 98%|█████████▊| 37119/37963 [91:43:25<1:47:41,  7.66s/it]
 98%|█████████▊| 37120/37963 [91:43:33<1:48:02,  7.69s/it]
                                                          
{'loss': '0.07666', 'grad_norm': '4.193', 'learning_rate': '2.591e-08', 'epoch': '0.9778'}
+
 98%|█████████▊| 37120/37963 [91:43:33<1:48:02,  7.69s/it]
 98%|█████████▊| 37121/37963 [91:43:48<2:19:04,  9.91s/it]
 98%|█████████▊| 37122/37963 [91:43:56<2:10:02,  9.28s/it]
 98%|██��██████▊| 37123/37963 [91:44:11<2:32:31, 10.89s/it]
 98%|█████████▊| 37124/37963 [91:44:18<2:18:56,  9.94s/it]
 98%|█████████▊| 37125/37963 [91:44:26<2:09:36,  9.28s/it]
 98%|█████████▊| 37126/37963 [91:44:34<2:02:58,  8.82s/it]
 98%|█████████▊| 37127/37963 [91:44:41<1:57:49,  8.46s/it]
 98%|█████████▊| 37128/37963 [91:44:49<1:54:36,  8.24s/it]
 98%|█████████▊| 37129/37963 [91:45:03<2:20:16, 10.09s/it]
 98%|█████████▊| 37130/37963 [91:45:11<2:10:25,  9.39s/it]
                                                          
{'loss': '0.08083', 'grad_norm': '3.381', 'learning_rate': '2.53e-08', 'epoch': '0.9781'}
+
 98%|█████████▊| 37130/37963 [91:45:11<2:10:25,  9.39s/it]
 98%|█████████▊| 37131/37963 [91:45:19<2:03:13,  8.89s/it]
 98%|█████████▊| 37132/37963 [91:45:27<1:57:45,  8.50s/it]
 98%|█████████▊| 37133/37963 [91:45:34<1:54:16,  8.26s/it]
 98%|█████████▊| 37134/37963 [91:45:42<1:50:58,  8.03s/it]
 98%|█████████▊| 37135/37963 [91:45:49<1:49:26,  7.93s/it]
 98%|█████████▊| 37136/37963 [91:45:57<1:47:37,  7.81s/it]
 98%|█████████▊| 37137/37963 [91:46:11<2:15:00,  9.81s/it]
 98%|█████████▊| 37138/37963 [91:46:19<2:06:24,  9.19s/it]
 98%|█████████▊| 37139/37963 [91:46:27<1:59:37,  8.71s/it]
 98%|█████████▊| 37140/37963 [91:46:34<1:55:29,  8.42s/it]
                                                          
{'loss': '0.07542', 'grad_norm': '3.326', 'learning_rate': '2.47e-08', 'epoch': '0.9783'}
+
 98%|█████████▊| 37140/37963 [91:46:34<1:55:29,  8.42s/it]
 98%|█████████▊| 37141/37963 [91:46:49<2:18:55, 10.14s/it]
 98%|█████████▊| 37142/37963 [91:46:56<2:08:39,  9.40s/it]
 98%|█████████▊| 37143/37963 [91:47:03<1:59:20,  8.73s/it]
 98%|█████████▊| 37144/37963 [91:47:11<1:54:32,  8.39s/it]
 98%|█████████▊| 37145/37963 [91:47:26<2:19:37, 10.24s/it]
 98%|█████████▊| 37146/37963 [91:47:40<2:36:27, 11.49s/it]
 98%|█████████▊| 37147/37963 [91:47:48<2:20:41, 10.34s/it]
 98%|█████████▊| 37148/37963 [91:47:55<2:09:03,  9.50s/it]
 98%|█████████▊| 37149/37963 [91:48:03<2:00:25,  8.88s/it]
 98%|█████████▊| 37150/37963 [91:48:10<1:55:26,  8.52s/it]
                                                          
{'loss': '0.08769', 'grad_norm': '5.419', 'learning_rate': '2.41e-08', 'epoch': '0.9786'}
+
 98%|█████████▊| 37150/37963 [91:48:10<1:55:26,  8.52s/it]
 98%|█████████▊| 37151/37963 [91:48:18<1:52:23,  8.30s/it]
 98%|█████████▊| 37152/37963 [91:48:26<1:49:47,  8.12s/it]
 98%|█████████▊| 37153/37963 [91:48:34<1:47:54,  7.99s/it]
 98%|█████████▊| 37154/37963 [91:48:41<1:46:24,  7.89s/it]
 98%|█████████▊| 37155/37963 [91:48:49<1:46:23,  7.90s/it]
 98%|█████████▊| 37156/37963 [91:49:04<2:12:49,  9.88s/it]
 98%|█████████▊| 37157/37963 [91:49:11<2:03:25,  9.19s/it]
 98%|█████████▊| 37158/37963 [91:49:19<1:57:27,  8.76s/it]
 98%|█████████▊| 37159/37963 [91:49:27<1:52:50,  8.42s/it]
 98%|█████████▊| 37160/37963 [91:49:34<1:49:35,  8.19s/it]
                                                          
{'loss': '0.08357', 'grad_norm': '3.301', 'learning_rate': '2.352e-08', 'epoch': '0.9789'}
+
 98%|█████████▊| 37160/37963 [91:49:34<1:49:35,  8.19s/it]
 98%|█████████▊| 37161/37963 [91:49:42<1:47:26,  8.04s/it]
 98%|█████████▊| 37162/37963 [91:49:50<1:46:02,  7.94s/it]
 98%|█████████▊| 37163/37963 [91:49:57<1:45:19,  7.90s/it]
 98%|█████████▊| 37164/37963 [91:50:05<1:44:35,  7.85s/it]
 98%|█████████▊| 37165/37963 [91:50:13<1:43:43,  7.80s/it]
 98%|█████████▊| 37166/37963 [91:50:21<1:43:36,  7.80s/it]
 98%|█████████▊| 37167/37963 [91:50:28<1:42:48,  7.75s/it]
 98%|█████████▊| 37168/37963 [91:50:36<1:41:58,  7.70s/it]
 98%|█████████▊| 37169/37963 [91:50:51<2:11:24,  9.93s/it]
 98%|█████████▊| 37170/37963 [91:50:59<2:02:18,  9.25s/it]
                                                          
{'loss': '0.08327', 'grad_norm': '3.709', 'learning_rate': '2.293e-08', 'epoch': '0.9791'}
+
 98%|█████████▊| 37170/37963 [91:50:59<2:02:18,  9.25s/it]
 98%|█████████▊| 37171/37963 [91:51:13<2:21:42, 10.74s/it]
 98%|█████████▊| 37172/37963 [91:51:21<2:09:45,  9.84s/it]
 98%|████████��▊| 37173/37963 [91:51:28<2:01:07,  9.20s/it]
 98%|█████████▊| 37174/37963 [91:51:36<1:54:24,  8.70s/it]
 98%|█████████▊| 37175/37963 [91:51:44<1:50:10,  8.39s/it]
 98%|█████████▊| 37176/37963 [91:51:51<1:46:37,  8.13s/it]
 98%|█████████▊| 37177/37963 [91:52:05<2:10:29,  9.96s/it]
 98%|█████████▊| 37178/37963 [91:52:13<2:01:58,  9.32s/it]
 98%|█████████▊| 37179/37963 [91:52:21<1:55:20,  8.83s/it]
 98%|█████████▊| 37180/37963 [91:52:29<1:50:58,  8.50s/it]
                                                          
{'loss': '0.06682', 'grad_norm': '4.188', 'learning_rate': '2.236e-08', 'epoch': '0.9794'}
+
 98%|█████████▊| 37180/37963 [91:52:29<1:50:58,  8.50s/it]
 98%|█████████▊| 37181/37963 [91:52:36<1:47:26,  8.24s/it]
 98%|█████████▊| 37182/37963 [91:52:44<1:45:01,  8.07s/it]
 98%|█████████▊| 37183/37963 [91:52:51<1:42:51,  7.91s/it]
 98%|█████████▊| 37184/37963 [91:52:59<1:41:36,  7.83s/it]
 98%|█████████▊| 37185/37963 [91:53:13<2:06:25,  9.75s/it]
 98%|█████████▊| 37186/37963 [91:53:21<1:58:48,  9.17s/it]
 98%|█████████▊| 37187/37963 [91:53:29<1:52:52,  8.73s/it]
 98%|█████████▊| 37188/37963 [91:53:36<1:48:05,  8.37s/it]
 98%|█████████▊| 37189/37963 [91:53:44<1:44:42,  8.12s/it]
 98%|█████████▊| 37190/37963 [91:53:58<2:09:16, 10.03s/it]
                                                          
{'loss': '0.08953', 'grad_norm': '3.481', 'learning_rate': '2.179e-08', 'epoch': '0.9796'}
+
 98%|█████████▊| 37190/37963 [91:53:58<2:09:16, 10.03s/it]
 98%|█████████▊| 37191/37963 [91:54:06<2:00:16,  9.35s/it]
 98%|█████████▊| 37192/37963 [91:54:14<1:53:07,  8.80s/it]
 98%|█████████▊| 37193/37963 [91:54:21<1:49:01,  8.50s/it]
 98%|█████████▊| 37194/37963 [91:54:35<2:10:24, 10.17s/it]
 98%|█████████▊| 37195/37963 [91:54:50<2:28:35, 11.61s/it]
 98%|█████████▊| 37196/37963 [91:54:58<2:13:56, 10.48s/it]
 98%|█████████▊| 37197/37963 [91:55:06<2:01:56,  9.55s/it]
 98%|█████████▊| 37198/37963 [91:55:13<1:54:38,  8.99s/it]
 98%|█████████▊| 37199/37963 [91:55:21<1:49:31,  8.60s/it]
 98%|█████████▊| 37200/37963 [91:55:29<1:45:23,  8.29s/it]
                                                          
{'loss': '0.07402', 'grad_norm': '3.374', 'learning_rate': '2.123e-08', 'epoch': '0.9799'}
+
 98%|█████████▊| 37200/37963 [91:55:29<1:45:23,  8.29s/it]
 98%|█████████▊| 37201/37963 [91:55:36<1:43:20,  8.14s/it]
 98%|█████████▊| 37202/37963 [91:55:44<1:41:35,  8.01s/it]
 98%|█████████▊| 37203/37963 [91:55:52<1:40:35,  7.94s/it]
 98%|█████████▊| 37204/37963 [91:55:59<1:39:12,  7.84s/it]
 98%|█████████▊| 37205/37963 [91:56:07<1:37:35,  7.72s/it]
 98%|█████████▊| 37206/37963 [91:56:21<2:02:13,  9.69s/it]
 98%|█████████▊| 37207/37963 [91:56:29<1:54:00,  9.05s/it]
 98%|█████████▊| 37208/37963 [91:56:36<1:48:44,  8.64s/it]
 98%|█████████▊| 37209/37963 [91:56:44<1:44:47,  8.34s/it]
 98%|█████████▊| 37210/37963 [91:56:52<1:42:08,  8.14s/it]
                                                          
{'loss': '0.07667', 'grad_norm': '2.656', 'learning_rate': '2.068e-08', 'epoch': '0.9802'}
+
 98%|█████████▊| 37210/37963 [91:56:52<1:42:08,  8.14s/it]
 98%|█████████▊| 37211/37963 [91:56:59<1:40:23,  8.01s/it]
 98%|█████████▊| 37212/37963 [91:57:07<1:37:29,  7.79s/it]
 98%|█████████▊| 37213/37963 [91:57:14<1:36:04,  7.69s/it]
 98%|█████████▊| 37214/37963 [91:57:22<1:35:55,  7.68s/it]
 98%|█████████▊| 37215/37963 [91:57:30<1:35:52,  7.69s/it]
 98%|█████████▊| 37216/37963 [91:57:37<1:34:55,  7.62s/it]
 98%|█████████▊| 37217/37963 [91:57:45<1:34:38,  7.61s/it]
 98%|█████████▊| 37218/37963 [91:57:52<1:34:30,  7.61s/it]
 98%|█████████▊| 37219/37963 [91:58:00<1:35:11,  7.68s/it]
 98%|█████████▊| 37220/37963 [91:58:15<2:00:56,  9.77s/it]
                                                          
{'loss': '0.07475', 'grad_norm': '5.152', 'learning_rate': '2.014e-08', 'epoch': '0.9804'}
+
 98%|█████████▊| 37220/37963 [91:58:15<2:00:56,  9.77s/it]
 98%|█████████▊| 37221/37963 [91:58:29<2:16:50, 11.07s/it]
 98%|█████████▊| 37222/37963 [91:58:36<2:04:01, 10.04s/it]
 98%|█████████▊| 37223/37963 [91:58:44<1:55:09,  9.34s/it]
 98%|█████████▊| 37224/37963 [91:58:51<1:47:01,  8.69s/it]
 98%|█████████▊| 37225/37963 [91:59:06<2:07:22, 10.36s/it]
 98%|█████████▊| 37226/37963 [91:59:13<1:57:34,  9.57s/it]
 98%|█████████▊| 37227/37963 [91:59:21<1:50:57,  9.05s/it]
 98%|█████████▊| 37228/37963 [91:59:29<1:45:38,  8.62s/it]
 98%|█████████▊| 37229/37963 [91:59:36<1:41:45,  8.32s/it]
 98%|█████████▊| 37230/37963 [91:59:44<1:39:15,  8.12s/it]
                                                          
{'loss': '0.07425', 'grad_norm': '3.753', 'learning_rate': '1.96e-08', 'epoch': '0.9807'}
+
 98%|█████████▊| 37230/37963 [91:59:44<1:39:15,  8.12s/it]
 98%|█████████▊| 37231/37963 [91:59:51<1:36:13,  7.89s/it]
 98%|█████████▊| 37232/37963 [91:59:59<1:33:44,  7.69s/it]
 98%|█████████▊| 37233/37963 [92:00:13<1:58:19,  9.73s/it]
 98%|█████████▊| 37234/37963 [92:00:21<1:51:12,  9.15s/it]
 98%|█████████▊| 37235/37963 [92:00:29<1:45:20,  8.68s/it]
 98%|█████████▊| 37236/37963 [92:00:36<1:40:59,  8.34s/it]
 98%|█████████▊| 37237/37963 [92:00:44<1:38:03,  8.10s/it]
 98%|█████████▊| 37238/37963 [92:00:51<1:36:40,  8.00s/it]
 98%|█████████▊| 37239/37963 [92:00:59<1:35:25,  7.91s/it]
 98%|█████████▊| 37240/37963 [92:01:07<1:34:09,  7.81s/it]
                                                          
{'loss': '0.07132', 'grad_norm': '3.378', 'learning_rate': '1.907e-08', 'epoch': '0.981'}
+
 98%|█████████▊| 37240/37963 [92:01:07<1:34:09,  7.81s/it]
 98%|█████████▊| 37241/37963 [92:01:14<1:33:27,  7.77s/it]
 98%|█████████▊| 37242/37963 [92:01:22<1:33:14,  7.76s/it]
 98%|█████████▊| 37243/37963 [92:01:37<1:58:49,  9.90s/it]
 98%|█████████▊| 37244/37963 [92:01:52<2:16:27, 11.39s/it]
 98%|█████████▊| 37245/37963 [92:01:59<2:01:51, 10.18s/it]
 98%|█████████▊| 37246/37963 [92:02:07<1:52:10,  9.39s/it]
 98%|█████████▊| 37247/37963 [92:02:21<2:10:08, 10.91s/it]
 98%|█████████▊| 37248/37963 [92:02:29<1:57:55,  9.90s/it]
 98%|█████████▊| 37249/37963 [92:02:36<1:49:41,  9.22s/it]
 98%|█████████▊| 37250/37963 [92:02:44<1:43:29,  8.71s/it]
                                                          
{'loss': '0.07683', 'grad_norm': '3.233', 'learning_rate': '1.855e-08', 'epoch': '0.9812'}
+
 98%|█████████▊| 37250/37963 [92:02:44<1:43:29,  8.71s/it]
 98%|█████████▊| 37251/37963 [92:02:52<1:40:21,  8.46s/it]
 98%|█████████▊| 37252/37963 [92:02:59<1:36:47,  8.17s/it]
 98%|█████████▊| 37253/37963 [92:03:07<1:34:53,  8.02s/it]
 98%|█████████▊| 37254/37963 [92:03:14<1:33:15,  7.89s/it]
 98%|█████████▊| 37255/37963 [92:03:22<1:32:08,  7.81s/it]
 98%|█████████▊| 37256/37963 [92:03:30<1:32:03,  7.81s/it]
 98%|█████████▊| 37257/37963 [92:03:38<1:31:15,  7.76s/it]
 98%|█████████▊| 37258/37963 [92:03:45<1:31:03,  7.75s/it]
 98%|█████████▊| 37259/37963 [92:03:53<1:30:54,  7.75s/it]
 98%|█████████▊| 37260/37963 [92:04:08<1:54:34,  9.78s/it]
                                                          
{'loss': '0.08557', 'grad_norm': '4.143', 'learning_rate': '1.803e-08', 'epoch': '0.9815'}
+
 98%|█████████▊| 37260/37963 [92:04:08<1:54:34,  9.78s/it]
 98%|█████████▊| 37261/37963 [92:04:15<1:47:15,  9.17s/it]
 98%|█████████▊| 37262/37963 [92:04:23<1:41:58,  8.73s/it]
 98%|█████████▊| 37263/37963 [92:04:31<1:38:12,  8.42s/it]
 98%|█████████▊| 37264/37963 [92:04:39<1:36:01,  8.24s/it]
 98%|█████████▊| 37265/37963 [92:04:46<1:34:32,  8.13s/it]
 98%|█████████▊| 37266/37963 [92:04:54<1:33:12,  8.02s/it]
 98%|█████████▊| 37267/37963 [92:05:02<1:31:50,  7.92s/it]
 98%|█████████▊| 37268/37963 [92:05:09<1:30:34,  7.82s/it]
 98%|█████████▊| 37269/37963 [92:05:24<1:53:24,  9.80s/it]
 98%|█████████▊| 37270/37963 [92:05:31<1:45:48,  9.16s/it]
                                                          
{'loss': '0.08883', 'grad_norm': '3.559', 'learning_rate': '1.752e-08', 'epoch': '0.9817'}
+
 98%|█████████▊| 37270/37963 [92:05:31<1:45:48,  9.16s/it]
 98%|█████████▊| 37271/37963 [92:05:39<1:40:15,  8.69s/it]
 98%|█████████▊| 37272/37963 [92:05:54<2:00:50, 10.49s/it]
 98%|█████████▊| 37273/37963 [92:06:01<1:51:02,  9.66s/it]
 98%|█████████▊| 37274/37963 [92:06:09<1:43:53,  9.05s/it]
 98%|█████████▊| 37275/37963 [92:06:24<2:02:34, 10.69s/it]
 98%|█████████▊| 37276/37963 [92:06:31<1:52:34,  9.83s/it]
 98%|█████████▊| 37277/37963 [92:06:39<1:44:04,  9.10s/it]
 98%|█████████▊| 37278/37963 [92:06:47<1:39:55,  8.75s/it]
 98%|█████████▊| 37279/37963 [92:06:54<1:36:06,  8.43s/it]
 98%|█████████▊| 37280/37963 [92:07:02<1:34:00,  8.26s/it]
                                                          
{'loss': '0.08155', 'grad_norm': '4.472', 'learning_rate': '1.702e-08', 'epoch': '0.982'}
+
 98%|█████████▊| 37280/37963 [92:07:02<1:34:00,  8.26s/it]
 98%|█████████▊| 37281/37963 [92:07:17<1:54:53, 10.11s/it]
 98%|█████████▊| 37282/37963 [92:07:25<1:46:59,  9.43s/it]
 98%|█████████▊| 37283/37963 [92:07:32<1:40:04,  8.83s/it]
 98%|█████████▊| 37284/37963 [92:07:40<1:35:33,  8.44s/it]
 98%|█████████▊| 37285/37963 [92:07:47<1:32:34,  8.19s/it]
 98%|█████████▊| 37286/37963 [92:07:55<1:31:00,  8.07s/it]
 98%|█████████▊| 37287/37963 [92:08:10<1:53:49, 10.10s/it]
 98%|█████████▊| 37288/37963 [92:08:17<1:44:43,  9.31s/it]
 98%|█████████▊| 37289/37963 [92:08:25<1:39:11,  8.83s/it]
 98%|█████████▊| 37290/37963 [92:08:33<1:34:40,  8.44s/it]
                                                          
{'loss': '0.07244', 'grad_norm': '2.905', 'learning_rate': '1.653e-08', 'epoch': '0.9823'}
+
 98%|█████████▊| 37290/37963 [92:08:33<1:34:40,  8.44s/it]
 98%|█████████▊| 37291/37963 [92:08:47<1:54:12, 10.20s/it]
 98%|█████████▊| 37292/37963 [92:08:55<1:46:06,  9.49s/it]
 98%|█████████▊| 37293/37963 [92:09:02<1:39:13,  8.89s/it]
 98%|█████████▊| 37294/37963 [92:09:10<1:35:00,  8.52s/it]
 98%|█████████▊| 37295/37963 [92:09:18<1:32:41,  8.33s/it]
 98%|█████████▊| 37296/37963 [92:09:25<1:30:38,  8.15s/it]
 98%|█████████▊| 37297/37963 [92:09:33<1:27:57,  7.92s/it]
 98%|█████████▊| 37298/37963 [92:09:47<1:49:50,  9.91s/it]
 98%|█████████▊| 37299/37963 [92:09:55<1:43:01,  9.31s/it]
 98%|█████████▊| 37300/37963 [92:10:03<1:37:51,  8.86s/it]
                                                          
{'loss': '0.07873', 'grad_norm': '2.913', 'learning_rate': '1.604e-08', 'epoch': '0.9825'}
+
 98%|█████████▊| 37300/37963 [92:10:03<1:37:51,  8.86s/it]
 98%|█████████▊| 37301/37963 [92:10:11<1:33:55,  8.51s/it]
 98%|█████████▊| 37302/37963 [92:10:18<1:30:14,  8.19s/it]
 98%|█████████▊| 37303/37963 [92:10:26<1:28:33,  8.05s/it]
 98%|█████████▊| 37304/37963 [92:10:33<1:26:48,  7.90s/it]
 98%|█████████▊| 37305/37963 [92:10:41<1:26:09,  7.86s/it]
 98%|█████████▊| 37306/37963 [92:10:49<1:24:33,  7.72s/it]
 98%|█████████▊| 37307/37963 [92:10:56<1:24:13,  7.70s/it]
 98%|█████████▊| 37308/37963 [92:11:04<1:24:01,  7.70s/it]
 98%|█████████▊| 37309/37963 [92:11:11<1:22:54,  7.61s/it]
 98%|█████████▊| 37310/37963 [92:11:26<1:45:10,  9.66s/it]
                                                          
{'loss': '0.07599', 'grad_norm': '4.145', 'learning_rate': '1.556e-08', 'epoch': '0.9828'}
+
 98%|█████████▊| 37310/37963 [92:11:26<1:45:10,  9.66s/it]
 98%|█████████▊| 37311/37963 [92:11:33<1:38:15,  9.04s/it]
 98%|█████████▊| 37312/37963 [92:11:41<1:32:53,  8.56s/it]
 98%|█████████▊| 37313/37963 [92:11:49<1:29:55,  8.30s/it]
 98%|█████████▊| 37314/37963 [92:11:56<1:27:58,  8.13s/it]
 98%|█████████▊| 37315/37963 [92:12:04<1:26:16,  7.99s/it]
 98%|█████████▊| 37316/37963 [92:12:11<1:24:32,  7.84s/it]
 98%|█████████▊| 37317/37963 [92:12:26<1:45:45,  9.82s/it]
 98%|█████████▊| 37318/37963 [92:12:33<1:38:17,  9.14s/it]
 98%|█████████▊| 37319/37963 [92:12:48<1:56:23, 10.84s/it]
 98%|█████████▊| 37320/37963 [92:12:56<1:46:05,  9.90s/it]
                                                          
{'loss': '0.07679', 'grad_norm': '3.116', 'learning_rate': '1.509e-08', 'epoch': '0.9831'}
+
 98%|█████████▊| 37320/37963 [92:12:56<1:46:05,  9.90s/it]
 98%|█████████▊| 37321/37963 [92:13:11<2:00:59, 11.31s/it]
 98%|█████████▊| 37322/37963 [92:13:18<1:49:53, 10.29s/it]
 98%|█████████▊| 37323/37963 [92:13:26<1:42:24,  9.60s/it]
 98%|█████████▊| 37324/37963 [92:13:34<1:36:11,  9.03s/it]
 98%|█████████▊| 37325/37963 [92:13:42<1:31:45,  8.63s/it]
 98%|█████████▊| 37326/37963 [92:13:50<1:28:28,  8.33s/it]
 98%|█████████▊| 37327/37963 [92:14:04<1:47:57, 10.18s/it]
 98%|█████████▊| 37328/37963 [92:14:12<1:39:39,  9.42s/it]
 98%|█████████▊| 37329/37963 [92:14:19<1:34:09,  8.91s/it]
 98%|█████████▊| 37330/37963 [92:14:27<1:30:04,  8.54s/it]
                                                          
{'loss': '0.07898', 'grad_norm': '3.304', 'learning_rate': '1.462e-08', 'epoch': '0.9833'}
+
 98%|█████████▊| 37330/37963 [92:14:27<1:30:04,  8.54s/it]
 98%|█████████▊| 37331/37963 [92:14:35<1:26:57,  8.26s/it]
 98%|█████████▊| 37332/37963 [92:14:42<1:24:46,  8.06s/it]
 98%|█████████▊| 37333/37963 [92:14:50<1:23:19,  7.94s/it]
 98%|█████████▊| 37334/37963 [92:14:57<1:21:25,  7.77s/it]
 98%|█████████▊| 37335/37963 [92:15:12<1:44:11,  9.95s/it]
 98%|█████████▊| 37336/37963 [92:15:20<1:37:12,  9.30s/it]
 98%|█████████▊| 37337/37963 [92:15:28<1:32:01,  8.82s/it]
 98%|█████████▊| 37338/37963 [92:15:35<1:28:11,  8.47s/it]
 98%|█████████▊| 37339/37963 [92:15:43<1:25:24,  8.21s/it]
 98%|█████████▊| 37340/37963 [92:15:51<1:23:43,  8.06s/it]
                                                          
{'loss': '0.06951', 'grad_norm': '2.804', 'learning_rate': '1.417e-08', 'epoch': '0.9836'}
+
 98%|█████████▊| 37340/37963 [92:15:51<1:23:43,  8.06s/it]
 98%|█████████▊| 37341/37963 [92:15:59<1:22:48,  7.99s/it]
 98%|█████████▊| 37342/37963 [92:16:06<1:20:57,  7.82s/it]
 98%|█████████▊| 37343/37963 [92:16:14<1:20:21,  7.78s/it]
 98%|█████████▊| 37344/37963 [92:16:29<1:42:25,  9.93s/it]
 98%|█████████▊| 37345/37963 [92:16:43<1:55:37, 11.23s/it]
 98%|█████████▊| 37346/37963 [92:16:51<1:44:42, 10.18s/it]
 98%|█████████▊| 37347/37963 [92:16:58<1:36:59,  9.45s/it]
 98%|█████████▊| 37348/37963 [92:17:06<1:31:59,  8.97s/it]
 98%|█████████▊| 37349/37963 [92:17:14<1:28:34,  8.66s/it]
 98%|█████████▊| 37350/37963 [92:17:22<1:25:45,  8.39s/it]
                                                          
{'loss': '0.07706', 'grad_norm': '3.002', 'learning_rate': '1.372e-08', 'epoch': '0.9839'}
+
 98%|█████████▊| 37350/37963 [92:17:22<1:25:45,  8.39s/it]
 98%|█████████▊| 37351/37963 [92:17:30<1:23:53,  8.23s/it]
 98%|█████████▊| 37352/37963 [92:17:37<1:21:33,  8.01s/it]
 98%|█████████▊| 37353/37963 [92:17:45<1:19:53,  7.86s/it]
 98%|█████████▊| 37354/37963 [92:17:52<1:19:14,  7.81s/it]
 98%|█████████▊| 37355/37963 [92:18:00<1:18:42,  7.77s/it]
 98%|█████████▊| 37356/37963 [92:18:08<1:18:24,  7.75s/it]
 98%|█████████▊| 37357/37963 [92:18:16<1:18:32,  7.78s/it]
 98%|█████████▊| 37358/37963 [92:18:23<1:17:28,  7.68s/it]
 98%|█████████▊| 37359/37963 [92:18:31<1:16:21,  7.59s/it]
 98%|█████████▊| 37360/37963 [92:18:45<1:35:59,  9.55s/it]
                                                          
{'loss': '0.08414', 'grad_norm': '3.987', 'learning_rate': '1.327e-08', 'epoch': '0.9841'}
+
 98%|█████████▊| 37360/37963 [92:18:45<1:35:59,  9.55s/it]
 98%|█████████▊| 37361/37963 [92:18:53<1:30:53,  9.06s/it]
 98%|█████████▊| 37362/37963 [92:19:07<1:46:24, 10.62s/it]
 98%|█████████▊| 37363/37963 [92:19:15<1:37:53,  9.79s/it]
 98%|█████████▊| 37364/37963 [92:19:29<1:52:11, 11.24s/it]
 98%|█████████▊| 37365/37963 [92:19:37<1:41:17, 10.16s/it]
 98%|█████████▊| 37366/37963 [92:19:45<1:33:38,  9.41s/it]
 98%|█████████▊| 37367/37963 [92:19:52<1:28:15,  8.88s/it]
 98%|█████████▊| 37368/37963 [92:20:08<1:47:18, 10.82s/it]
 98%|█████████▊| 37369/37963 [92:20:15<1:38:11,  9.92s/it]
 98%|█████████▊| 37370/37963 [92:20:23<1:31:48,  9.29s/it]
                                                          
{'loss': '0.06648', 'grad_norm': '2.877', 'learning_rate': '1.284e-08', 'epoch': '0.9844'}
+
 98%|█████████▊| 37370/37963 [92:20:23<1:31:48,  9.29s/it]
 98%|█████████▊| 37371/37963 [92:20:31<1:26:34,  8.77s/it]
 98%|█████████▊| 37372/37963 [92:20:38<1:22:27,  8.37s/it]
 98%|█████████▊| 37373/37963 [92:20:46<1:20:22,  8.17s/it]
 98%|███���█████▊| 37374/37963 [92:20:54<1:18:59,  8.05s/it]
 98%|█████████▊| 37375/37963 [92:21:10<1:42:14, 10.43s/it]
 98%|█████████▊| 37376/37963 [92:21:18<1:34:29,  9.66s/it]
 98%|█████████▊| 37377/37963 [92:21:25<1:28:30,  9.06s/it]
 98%|█████████▊| 37378/37963 [92:21:33<1:24:02,  8.62s/it]
 98%|█████████▊| 37379/37963 [92:21:41<1:21:32,  8.38s/it]
 98%|█████████▊| 37380/37963 [92:21:48<1:19:36,  8.19s/it]
                                                          
{'loss': '0.07374', 'grad_norm': '2.49', 'learning_rate': '1.241e-08', 'epoch': '0.9846'}
+
 98%|█████████▊| 37380/37963 [92:21:48<1:19:36,  8.19s/it]
 98%|█████████▊| 37381/37963 [92:21:56<1:18:07,  8.05s/it]
 98%|█████████▊| 37382/37963 [92:22:04<1:16:59,  7.95s/it]
 98%|█████████▊| 37383/37963 [92:22:18<1:35:31,  9.88s/it]
 98%|█████████▊| 37384/37963 [92:22:26<1:29:13,  9.25s/it]
 98%|█████████▊| 37385/37963 [92:22:34<1:24:36,  8.78s/it]
 98%|█████████▊| 37386/37963 [92:22:41<1:20:35,  8.38s/it]
 98%|█████████▊| 37387/37963 [92:22:49<1:19:01,  8.23s/it]
 98%|█████████▊| 37388/37963 [92:22:57<1:17:21,  8.07s/it]
 98%|█████████▊| 37389/37963 [92:23:04<1:16:07,  7.96s/it]
 98%|█████████▊| 37390/37963 [92:23:12<1:14:12,  7.77s/it]
                                                          
{'loss': '0.07643', 'grad_norm': '3.613', 'learning_rate': '1.199e-08', 'epoch': '0.9849'}
+
 98%|█████████▊| 37390/37963 [92:23:12<1:14:12,  7.77s/it]
 98%|█████████▊| 37391/37963 [92:23:19<1:13:50,  7.74s/it]
 98%|█████████▊| 37392/37963 [92:23:34<1:32:05,  9.68s/it]
 98%|█████████▊| 37393/37963 [92:23:41<1:26:38,  9.12s/it]
 99%|█████████▊| 37394/37963 [92:23:49<1:22:30,  8.70s/it]
 99%|█████████▊| 37395/37963 [92:23:57<1:19:34,  8.41s/it]
 99%|█████████▊| 37396/37963 [92:24:11<1:36:10, 10.18s/it]
 99%|█████████▊| 37397/37963 [92:24:19<1:29:06,  9.45s/it]
 99%|█████████▊| 37398/37963 [92:24:27<1:23:58,  8.92s/it]
 99%|█████████▊| 37399/37963 [92:24:34<1:19:08,  8.42s/it]
 99%|█████████▊| 37400/37963 [92:24:42<1:17:01,  8.21s/it]
                                                          
{'loss': '0.08434', 'grad_norm': '4.141', 'learning_rate': '1.157e-08', 'epoch': '0.9852'}
+
 99%|█████████▊| 37400/37963 [92:24:42<1:17:01,  8.21s/it]
 99%|█████████▊| 37401/37963 [92:24:49<1:15:44,  8.09s/it]
 99%|█████████▊| 37402/37963 [92:24:57<1:14:25,  7.96s/it]
 99%|█████████▊| 37403/37963 [92:25:04<1:12:39,  7.79s/it]
 99%|█████████▊| 37404/37963 [92:25:12<1:11:30,  7.67s/it]
 99%|█████████▊| 37405/37963 [92:25:19<1:11:15,  7.66s/it]
 99%|█████████▊| 37406/37963 [92:25:34<1:29:55,  9.69s/it]
 99%|█████████▊| 37407/37963 [92:25:41<1:23:46,  9.04s/it]
 99%|█████████▊| 37408/37963 [92:25:56<1:39:22, 10.74s/it]
 99%|█████████▊| 37409/37963 [92:26:11<1:49:33, 11.86s/it]
 99%|█████████▊| 37410/37963 [92:26:19<1:38:44, 10.71s/it]
                                                          
{'loss': '0.07519', 'grad_norm': '3.683', 'learning_rate': '1.117e-08', 'epoch': '0.9854'}
+
 99%|█████████▊| 37410/37963 [92:26:19<1:38:44, 10.71s/it]
 99%|█████████▊| 37411/37963 [92:26:26<1:30:19,  9.82s/it]
 99%|█████████▊| 37412/37963 [92:26:34<1:23:45,  9.12s/it]
 99%|█████████▊| 37413/37963 [92:26:42<1:19:57,  8.72s/it]
 99%|█████████▊| 37414/37963 [92:26:56<1:36:23, 10.54s/it]
 99%|█████████▊| 37415/37963 [92:27:04<1:28:12,  9.66s/it]
 99%|█████████▊| 37416/37963 [92:27:12<1:22:51,  9.09s/it]
 99%|█████████▊| 37417/37963 [92:27:20<1:19:00,  8.68s/it]
 99%|█████████▊| 37418/37963 [92:27:27<1:16:14,  8.39s/it]
 99%|█████████▊| 37419/37963 [92:27:42<1:33:20, 10.30s/it]
 99%|█████████▊| 37420/37963 [92:27:49<1:25:09,  9.41s/it]
                                                          
{'loss': '0.07626', 'grad_norm': '3.638', 'learning_rate': '1.077e-08', 'epoch': '0.9857'}
+
 99%|█████████▊| 37420/37963 [92:27:49<1:25:09,  9.41s/it]
 99%|█████████▊| 37421/37963 [92:27:57<1:20:15,  8.89s/it]
 99%|█████████▊| 37422/37963 [92:28:05<1:16:52,  8.53s/it]
 99%|█████████▊| 37423/37963 [92:28:12<1:14:25,  8.27s/it]
 99%|████████��▊| 37424/37963 [92:28:20<1:13:38,  8.20s/it]
 99%|█████████▊| 37425/37963 [92:28:28<1:12:19,  8.07s/it]
 99%|█████████▊| 37426/37963 [92:28:36<1:11:12,  7.96s/it]
 99%|█████████▊| 37427/37963 [92:28:43<1:09:50,  7.82s/it]
 99%|█████████▊| 37428/37963 [92:28:51<1:08:56,  7.73s/it]
 99%|█████████▊| 37429/37963 [92:28:58<1:08:25,  7.69s/it]
 99%|█████████▊| 37430/37963 [92:29:06<1:08:20,  7.69s/it]
                                                          
{'loss': '0.07155', 'grad_norm': '3.547', 'learning_rate': '1.038e-08', 'epoch': '0.986'}
+
 99%|█████████▊| 37430/37963 [92:29:06<1:08:20,  7.69s/it]
 99%|█████████▊| 37431/37963 [92:29:21<1:27:06,  9.82s/it]
 99%|█████████▊| 37432/37963 [92:29:29<1:21:37,  9.22s/it]
 99%|█████████▊| 37433/37963 [92:29:36<1:16:44,  8.69s/it]
 99%|█████████▊| 37434/37963 [92:29:44<1:13:44,  8.36s/it]
 99%|█████████▊| 37435/37963 [92:29:52<1:12:00,  8.18s/it]
 99%|█████████▊| 37436/37963 [92:29:59<1:10:29,  8.03s/it]
 99%|█████████▊| 37437/37963 [92:30:07<1:09:31,  7.93s/it]
 99%|█████████▊| 37438/37963 [92:30:14<1:08:16,  7.80s/it]
 99%|█████████▊| 37439/37963 [92:30:22<1:07:59,  7.79s/it]
 99%|█████████▊| 37440/37963 [92:30:37<1:25:55,  9.86s/it]
                                                          
{'loss': '0.07737', 'grad_norm': '4.558', 'learning_rate': '9.991e-09', 'epoch': '0.9862'}
+
 99%|█████████▊| 37440/37963 [92:30:37<1:25:55,  9.86s/it]
 99%|█████████▊| 37441/37963 [92:30:45<1:20:01,  9.20s/it]
 99%|█████████▊| 37442/37963 [92:30:52<1:15:55,  8.74s/it]
 99%|█████████▊| 37443/37963 [92:31:00<1:13:14,  8.45s/it]
 99%|█████████▊| 37444/37963 [92:31:08<1:10:57,  8.20s/it]
 99%|█████████▊| 37445/37963 [92:31:15<1:09:29,  8.05s/it]
 99%|█████████▊| 37446/37963 [92:31:23<1:08:21,  7.93s/it]
 99%|█████████▊| 37447/37963 [92:31:30<1:07:11,  7.81s/it]
 99%|█████████▊| 37448/37963 [92:31:38<1:06:40,  7.77s/it]
 99%|█████████▊| 37449/37963 [92:31:46<1:06:23,  7.75s/it]
 99%|█████████▊| 37450/37963 [92:32:06<1:39:16, 11.61s/it]
                                                          
{'loss': '0.08174', 'grad_norm': '4.18', 'learning_rate': '9.613e-09', 'epoch': '0.9865'}
+
 99%|█████████▊| 37450/37963 [92:32:06<1:39:16, 11.61s/it]
 99%|█████████▊| 37451/37963 [92:32:14<1:29:16, 10.46s/it]
 99%|█████████▊| 37452/37963 [92:32:29<1:39:32, 11.69s/it]
 99%|█████████▊| 37453/37963 [92:32:36<1:29:06, 10.48s/it]
 99%|█████████▊| 37454/37963 [92:32:44<1:21:40,  9.63s/it]
 99%|█████████▊| 37455/37963 [92:32:52<1:16:04,  8.99s/it]
 99%|█████████▊| 37456/37963 [92:33:06<1:29:35, 10.60s/it]
 99%|█████████▊| 37457/37963 [92:33:14<1:22:19,  9.76s/it]
 99%|█████████▊| 37458/37963 [92:33:22<1:17:05,  9.16s/it]
 99%|█████████▊| 37459/37963 [92:33:29<1:13:12,  8.72s/it]
 99%|█████████▊| 37460/37963 [92:33:44<1:28:15, 10.53s/it]
                                                          
{'loss': '0.08027', 'grad_norm': '3.751', 'learning_rate': '9.243e-09', 'epoch': '0.9868'}
+
 99%|█████████▊| 37460/37963 [92:33:44<1:28:15, 10.53s/it]
 99%|█████████▊| 37461/37963 [92:33:52<1:21:12,  9.71s/it]
 99%|█████████▊| 37462/37963 [92:33:59<1:15:46,  9.07s/it]
 99%|█████████▊| 37463/37963 [92:34:07<1:12:01,  8.64s/it]
 99%|█████████▊| 37464/37963 [92:34:15<1:09:37,  8.37s/it]
 99%|█████████▊| 37465/37963 [92:34:23<1:08:20,  8.23s/it]
 99%|█████████▊| 37466/37963 [92:34:30<1:06:52,  8.07s/it]
 99%|█████████▊| 37467/37963 [92:34:45<1:24:12, 10.19s/it]
 99%|█████████▊| 37468/37963 [92:34:53<1:17:55,  9.45s/it]
 99%|█████████▊| 37469/37963 [92:35:01<1:13:28,  8.92s/it]
 99%|█████████▊| 37470/37963 [92:35:09<1:10:17,  8.56s/it]
                                                          
{'loss': '0.0913', 'grad_norm': '3.253', 'learning_rate': '8.88e-09', 'epoch': '0.987'}
+
 99%|█████████▊| 37470/37963 [92:35:09<1:10:17,  8.56s/it]
 99%|█████████▊| 37471/37963 [92:35:16<1:07:56,  8.28s/it]
 99%|█████████▊| 37472/37963 [92:35:24<1:06:25,  8.12s/it]
 99%|█████████▊| 37473/37963 [92:35:32<1:05:00,  7.96s/it]
 99%|█████████▊| 37474/37963 [92:35:39<1:04:11,  7.88s/it]
 99%|█████████▊| 37475/37963 [92:35:54<1:21:33, 10.03s/it]
 99%|█████████▊| 37476/37963 [92:36:02<1:15:47,  9.34s/it]
 99%|█████████▊| 37477/37963 [92:36:10<1:11:32,  8.83s/it]
 99%|█████████▊| 37478/37963 [92:36:17<1:08:03,  8.42s/it]
 99%|█████████▊| 37479/37963 [92:36:25<1:06:23,  8.23s/it]
 99%|█████████▊| 37480/37963 [92:36:32<1:04:11,  7.98s/it]
                                                          
{'loss': '0.06389', 'grad_norm': '2.52', 'learning_rate': '8.524e-09', 'epoch': '0.9873'}
+
 99%|█████████▊| 37480/37963 [92:36:32<1:04:11,  7.98s/it]
 99%|█████████▊| 37481/37963 [92:36:40<1:03:33,  7.91s/it]
 99%|█████████▊| 37482/37963 [92:36:48<1:02:47,  7.83s/it]
 99%|█████████▊| 37483/37963 [92:36:55<1:02:13,  7.78s/it]
 99%|█████████▊| 37484/37963 [92:37:10<1:18:59,  9.89s/it]
 99%|█████████▊| 37485/37963 [92:37:18<1:14:05,  9.30s/it]
 99%|█████████▊| 37486/37963 [92:37:26<1:09:30,  8.74s/it]
 99%|█████████▊| 37487/37963 [92:37:33<1:07:08,  8.46s/it]
 99%|█████████▊| 37488/37963 [92:37:41<1:05:22,  8.26s/it]
 99%|█████████▉| 37489/37963 [92:37:49<1:04:02,  8.11s/it]
 99%|█████████▉| 37490/37963 [92:37:56<1:02:36,  7.94s/it]
                                                          
{'loss': '0.07279', 'grad_norm': '3.129', 'learning_rate': '8.175e-09', 'epoch': '0.9875'}
+
 99%|█████████▉| 37490/37963 [92:37:56<1:02:36,  7.94s/it]
 99%|█████████▉| 37491/37963 [92:38:04<1:01:55,  7.87s/it]
 99%|█████████▉| 37492/37963 [92:38:12<1:00:49,  7.75s/it]
 99%|█████████▉| 37493/37963 [92:38:26<1:16:08,  9.72s/it]
 99%|█████████▉| 37494/37963 [92:38:34<1:10:58,  9.08s/it]
 99%|█████████▉| 37495/37963 [92:38:48<1:24:26, 10.83s/it]
 99%|█████████▉| 37496/37963 [92:38:56<1:17:10,  9.92s/it]
 99%|█████████▉| 37497/37963 [92:39:11<1:27:16, 11.24s/it]
 99%|█████████▉| 37498/37963 [92:39:18<1:19:12, 10.22s/it]
 99%|█████████▉| 37499/37963 [92:39:26<1:13:25,  9.49s/it]
 99%|█████████▉| 37500/37963 [92:39:34<1:08:14,  8.84s/it]
                                                          
{'loss': '0.08549', 'grad_norm': '3.495', 'learning_rate': '7.834e-09', 'epoch': '0.9878'}
+
 99%|█████████▉| 37500/37963 [92:39:34<1:08:14,  8.84s/it]
 99%|█████████▉| 37501/37963 [92:39:41<1:05:30,  8.51s/it]
 99%|█████████▉| 37502/37963 [92:39:49<1:03:26,  8.26s/it]
 99%|█████████▉| 37503/37963 [92:39:57<1:02:07,  8.10s/it]
 99%|█████████▉| 37504/37963 [92:40:11<1:16:05,  9.95s/it]
 99%|█████████▉| 37505/37963 [92:40:19<1:10:45,  9.27s/it]
 99%|█████████▉| 37506/37963 [92:40:34<1:23:51, 11.01s/it]
 99%|█████████▉| 37507/37963 [92:40:41<1:16:20, 10.04s/it]
 99%|█████████▉| 37508/37963 [92:40:49<1:10:41,  9.32s/it]
 99%|█████████▉| 37509/37963 [92:40:57<1:06:45,  8.82s/it]
 99%|█████████▉| 37510/37963 [92:41:04<1:04:04,  8.49s/it]
                                                          
{'loss': '0.08435', 'grad_norm': '3.232', 'learning_rate': '7.5e-09', 'epoch': '0.9881'}
+
 99%|█████████▉| 37510/37963 [92:41:04<1:04:04,  8.49s/it]
 99%|█████████▉| 37511/37963 [92:41:12<1:02:01,  8.23s/it]
 99%|█████████▉| 37512/37963 [92:41:20<1:01:13,  8.14s/it]
 99%|█████████▉| 37513/37963 [92:41:28<59:52,  7.98s/it]  
 99%|█████████▉| 37514/37963 [92:41:35<58:43,  7.85s/it]
 99%|█████████▉| 37515/37963 [92:41:50<1:15:01, 10.05s/it]
 99%|█████████▉| 37516/37963 [92:41:58<1:09:13,  9.29s/it]
 99%|█████████▉| 37517/37963 [92:42:06<1:05:40,  8.83s/it]
 99%|█████████▉| 37518/37963 [92:42:13<1:03:02,  8.50s/it]
 99%|█████████▉| 37519/37963 [92:42:28<1:17:17, 10.44s/it]
 99%|█████████▉| 37520/37963 [92:42:36<1:11:16,  9.65s/it]
                                                          
{'loss': '0.0814', 'grad_norm': '3.587', 'learning_rate': '7.173e-09', 'epoch': '0.9883'}
+
 99%|█████████▉| 37520/37963 [92:42:36<1:11:16,  9.65s/it]
 99%|█████████▉| 37521/37963 [92:42:44<1:06:41,  9.05s/it]
 99%|█████████▉| 37522/37963 [92:42:51<1:03:31,  8.64s/it]
 99%|█████████▉| 37523/37963 [92:42:59<1:01:08,  8.34s/it]
 99%|█████████▉| 37524/37963 [92:43:07<59:14,  8.10s/it]  
 99%|█████████▉| 37525/37963 [92:43:14<58:06,  7.96s/it]
 99%|█████████▉| 37526/37963 [92:43:22<56:50,  7.80s/it]
 99%|█████████▉| 37527/37963 [92:43:29<56:22,  7.76s/it]
 99%|█████████▉| 37528/37963 [92:43:37<56:02,  7.73s/it]
 99%|█████████▉| 37529/37963 [92:43:45<55:43,  7.70s/it]
 99%|█████████▉| 37530/37963 [92:43:52<55:09,  7.64s/it]
                                                        
{'loss': '0.07827', 'grad_norm': '3.544', 'learning_rate': '6.854e-09', 'epoch': '0.9886'}
+
 99%|█████████▉| 37530/37963 [92:43:52<55:09,  7.64s/it]
 99%|█████████▉| 37531/37963 [92:44:00<55:06,  7.65s/it]
 99%|█████████▉| 37532/37963 [92:44:14<1:09:56,  9.74s/it]
 99%|█████████▉| 37533/37963 [92:44:22<1:05:21,  9.12s/it]
 99%|█████████▉| 37534/37963 [92:44:30<1:01:53,  8.66s/it]
 99%|█████████▉| 37535/37963 [92:44:37<59:50,  8.39s/it]  
 99%|█████████▉| 37536/37963 [92:44:45<57:26,  8.07s/it]
 99%|█████████▉| 37537/37963 [92:44:53<56:35,  7.97s/it]
 99%|█████████▉| 37538/37963 [92:45:00<55:44,  7.87s/it]
 99%|█████████▉| 37539/37963 [92:45:08<55:09,  7.80s/it]
 99%|█████████▉| 37540/37963 [92:45:15<54:16,  7.70s/it]
                                                        
{'loss': '0.06957', 'grad_norm': '3.331', 'learning_rate': '6.542e-09', 'epoch': '0.9889'}
+
 99%|█████████▉| 37540/37963 [92:45:15<54:16,  7.70s/it]
 99%|█████████▉| 37541/37963 [92:45:29<1:07:30,  9.60s/it]
 99%|█████████▉| 37542/37963 [92:45:37<1:03:12,  9.01s/it]
 99%|█████████▉| 37543/37963 [92:45:45<1:00:04,  8.58s/it]
 99%|█████████▉| 37544/37963 [92:45:59<1:11:23, 10.22s/it]
 99%|█████████▉| 37545/37963 [92:46:06<1:05:45,  9.44s/it]
 99%|█████████▉| 37546/37963 [92:46:14<1:01:58,  8.92s/it]
 99%|█████████▉| 37547/37963 [92:46:22<59:19,  8.56s/it]  
 99%|█████████▉| 37548/37963 [92:46:43<1:25:00, 12.29s/it]
 99%|█████████▉| 37549/37963 [92:46:50<1:14:24, 10.78s/it]
 99%|█████████▉| 37550/37963 [92:46:58<1:07:46,  9.85s/it]
                                                          
{'loss': '0.07109', 'grad_norm': '3.205', 'learning_rate': '6.237e-09', 'epoch': '0.9891'}
+
 99%|█████████▉| 37550/37963 [92:46:58<1:07:46,  9.85s/it]
 99%|█████████▉| 37551/37963 [92:47:05<1:03:01,  9.18s/it]
 99%|█████████▉| 37552/37963 [92:47:13<59:20,  8.66s/it]  
 99%|█████████▉| 37553/37963 [92:47:20<57:04,  8.35s/it]
 99%|█████████▉| 37554/37963 [92:47:28<55:28,  8.14s/it]
 99%|█████████▉| 37555/37963 [92:47:43<1:09:07, 10.17s/it]
 99%|█████████▉| 37556/37963 [92:47:50<1:03:45,  9.40s/it]
 99%|█████████▉| 37557/37963 [92:47:58<1:00:00,  8.87s/it]
 99%|█████████▉| 37558/37963 [92:48:06<57:21,  8.50s/it]  
 99%|█████████▉| 37559/37963 [92:48:21<1:10:25, 10.46s/it]
 99%|█████████▉| 37560/37963 [92:48:28<1:04:46,  9.64s/it]
                                                          
{'loss': '0.07589', 'grad_norm': '3.452', 'learning_rate': '5.939e-09', 'epoch': '0.9894'}
+
 99%|█████████▉| 37560/37963 [92:48:28<1:04:46,  9.64s/it]
 99%|█████████▉| 37561/37963 [92:48:36<59:49,  8.93s/it]  
 99%|█████████▉| 37562/37963 [92:48:43<57:00,  8.53s/it]
 99%|█████████▉| 37563/37963 [92:48:51<55:23,  8.31s/it]
 99%|█████████▉| 37564/37963 [92:48:59<53:47,  8.09s/it]
 99%|█████████▉| 37565/37963 [92:49:13<1:06:32, 10.03s/it]
 99%|█████████▉| 37566/37963 [92:49:21<1:01:46,  9.34s/it]
 99%|█████████▉| 37567/37963 [92:49:29<58:15,  8.83s/it]  
 99%|█████████▉| 37568/37963 [92:49:36<55:39,  8.45s/it]
 99%|█████████▉| 37569/37963 [92:49:44<54:03,  8.23s/it]
 99%|█████████▉| 37570/37963 [92:49:52<52:52,  8.07s/it]
                                                        
{'loss': '0.08056', 'grad_norm': '5.076', 'learning_rate': '5.649e-09', 'epoch': '0.9897'}
+
 99%|█████████▉| 37570/37963 [92:49:52<52:52,  8.07s/it]
 99%|█████████▉| 37571/37963 [92:49:59<52:00,  7.96s/it]
 99%|█████████▉| 37572/37963 [92:50:07<51:34,  7.91s/it]
 99%|█████████▉| 37573/37963 [92:50:15<51:02,  7.85s/it]
 99%|█████████▉| 37574/37963 [92:50:23<50:51,  7.85s/it]
 99%|█████████▉| 37575/37963 [92:50:30<50:20,  7.79s/it]
 99%|█████████▉| 37576/37963 [92:50:38<49:51,  7.73s/it]
 99%|█████████▉| 37577/37963 [92:50:46<49:52,  7.75s/it]
 99%|█████████▉| 37578/37963 [92:50:53<49:46,  7.76s/it]
 99%|█████████▉| 37579/37963 [92:51:01<48:51,  7.63s/it]
 99%|█████████▉| 37580/37963 [92:51:09<48:53,  7.66s/it]
                                                        
{'loss': '0.07215', 'grad_norm': '3.539', 'learning_rate': '5.366e-09', 'epoch': '0.9899'}
+
 99%|█████████▉| 37580/37963 [92:51:09<48:53,  7.66s/it]
 99%|█████████▉| 37581/37963 [92:51:23<1:02:38,  9.84s/it]
 99%|█████████▉| 37582/37963 [92:51:31<58:33,  9.22s/it]  
 99%|█████████▉| 37583/37963 [92:51:39<55:31,  8.77s/it]
 99%|█████████▉| 37584/37963 [92:51:47<53:25,  8.46s/it]
 99%|█████████▉| 37585/37963 [92:51:54<51:48,  8.22s/it]
 99%|█████████▉| 37586/37963 [92:52:02<50:03,  7.97s/it]
 99%|█████████▉| 37587/37963 [92:52:09<48:48,  7.79s/it]
 99%|█████████▉| 37588/37963 [92:52:17<48:24,  7.75s/it]
 99%|█████████▉| 37589/37963 [92:52:24<48:02,  7.71s/it]
 99%|█████████▉| 37590/37963 [92:52:32<47:45,  7.68s/it]
                                                        
{'loss': '0.08195', 'grad_norm': '2.587', 'learning_rate': '5.09e-09', 'epoch': '0.9902'}
+
 99%|█████████▉| 37590/37963 [92:52:32<47:45,  7.68s/it]
 99%|█████████▉| 37591/37963 [92:52:40<47:45,  7.70s/it]
 99%|█████████▉| 37592/37963 [92:52:54<59:52,  9.68s/it]
 99%|█████████▉| 37593/37963 [92:53:02<56:16,  9.13s/it]
 99%|█████████▉| 37594/37963 [92:53:16<1:05:57, 10.73s/it]
 99%|█████████▉| 37595/37963 [92:53:31<1:12:39, 11.85s/it]
 99%|█████████▉| 37596/37963 [92:53:38<1:04:41, 10.58s/it]
 99%|█████████▉| 37597/37963 [92:53:46<59:16,  9.72s/it]  
 99%|█████████▉| 37598/37963 [92:53:54<55:15,  9.08s/it]
 99%|█████████▉| 37599/37963 [92:54:09<1:06:08, 10.90s/it]
 99%|█████████▉| 37600/37963 [92:54:17<1:00:11,  9.95s/it]
                                                          
{'loss': '0.08322', 'grad_norm': '2.636', 'learning_rate': '4.821e-09', 'epoch': '0.9904'}
+
 99%|█████████▉| 37600/37963 [92:54:17<1:00:11,  9.95s/it]
 99%|█████████▉| 37601/37963 [92:54:24<55:40,  9.23s/it]  
 99%|█████████▉| 37602/37963 [92:54:39<1:05:19, 10.86s/it]
 99%|█████████▉| 37603/37963 [92:54:46<59:17,  9.88s/it]  
 99%|█████████▉| 37604/37963 [92:54:54<55:07,  9.21s/it]
 99%|█████████▉| 37605/37963 [92:55:02<52:14,  8.76s/it]
 99%|█████████▉| 37606/37963 [92:55:09<49:38,  8.34s/it]
 99%|█████████▉| 37607/37963 [92:55:24<1:00:23, 10.18s/it]
 99%|█████████▉| 37608/37963 [92:55:31<55:40,  9.41s/it]  
 99%|█████████▉| 37609/37963 [92:55:39<52:00,  8.81s/it]
 99%|█████████▉| 37610/37963 [92:55:46<49:37,  8.44s/it]
                                                        
{'loss': '0.08132', 'grad_norm': '3.324', 'learning_rate': '4.56e-09', 'epoch': '0.9907'}
+
 99%|█████████▉| 37610/37963 [92:55:46<49:37,  8.44s/it]
 99%|█████████▉| 37611/37963 [92:55:54<48:06,  8.20s/it]
 99%|█████████▉| 37612/37963 [92:56:09<59:49, 10.23s/it]
 99%|█████████▉| 37613/37963 [92:56:17<55:30,  9.51s/it]
 99%|█████████▉| 37614/37963 [92:56:24<52:08,  8.96s/it]
 99%|█████████▉| 37615/37963 [92:56:32<49:20,  8.51s/it]
 99%|█████████▉| 37616/37963 [92:56:39<47:53,  8.28s/it]
 99%|█████████▉| 37617/37963 [92:56:47<46:40,  8.09s/it]
 99%|█████████▉| 37618/37963 [92:56:55<45:50,  7.97s/it]
 99%|█████████▉| 37619/37963 [92:57:02<45:04,  7.86s/it]
 99%|█████████▉| 37620/37963 [92:57:10<44:44,  7.83s/it]
                                                        
{'loss': '0.07278', 'grad_norm': '3.87', 'learning_rate': '4.306e-09', 'epoch': '0.991'}
+
 99%|█████████▉| 37620/37963 [92:57:10<44:44,  7.83s/it]
 99%|█████████▉| 37621/37963 [92:57:18<44:35,  7.82s/it]
 99%|█████████▉| 37622/37963 [92:57:26<44:57,  7.91s/it]
 99%|█████████▉| 37623/37963 [92:57:34<44:26,  7.84s/it]
 99%|█████████▉| 37624/37963 [92:57:41<44:04,  7.80s/it]
 99%|█████████▉| 37625/37963 [92:57:49<43:22,  7.70s/it]
 99%|█████████▉| 37626/37963 [92:57:57<43:15,  7.70s/it]
 99%|█████████▉| 37627/37963 [92:58:04<43:14,  7.72s/it]
 99%|█████████▉| 37628/37963 [92:58:12<43:00,  7.70s/it]
 99%|█████████▉| 37629/37963 [92:58:20<43:01,  7.73s/it]
 99%|█████████▉| 37630/37963 [92:58:27<42:29,  7.65s/it]
                                                        
{'loss': '0.06726', 'grad_norm': '2.37', 'learning_rate': '4.059e-09', 'epoch': '0.9912'}
+
 99%|█████████▉| 37630/37963 [92:58:27<42:29,  7.65s/it]
 99%|█████████▉| 37631/37963 [92:58:35<42:16,  7.64s/it]
 99%|█████████▉| 37632/37963 [92:58:43<42:01,  7.62s/it]
 99%|█████████▉| 37633/37963 [92:58:50<41:36,  7.56s/it]
 99%|█████████▉| 37634/37963 [92:58:58<41:36,  7.59s/it]
 99%|█████████▉| 37635/37963 [92:59:12<52:54,  9.68s/it]
 99%|█████████▉| 37636/37963 [92:59:26<1:00:13, 11.05s/it]
 99%|█████████▉| 37637/37963 [92:59:34<54:31, 10.03s/it]  
 99%|█████████▉| 37638/37963 [92:59:49<1:01:35, 11.37s/it]
 99%|█████████▉| 37639/37963 [92:59:56<55:32, 10.29s/it]  
 99%|█████████▉| 37640/37963 [93:00:04<51:27,  9.56s/it]
                                                        
{'loss': '0.08136', 'grad_norm': '3.565', 'learning_rate': '3.82e-09', 'epoch': '0.9915'}
+
 99%|█████████▉| 37640/37963 [93:00:04<51:27,  9.56s/it]
 99%|█████████▉| 37641/37963 [93:00:12<48:05,  8.96s/it]
 99%|█████████▉| 37642/37963 [93:00:20<46:02,  8.61s/it]
 99%|█████████▉| 37643/37963 [93:00:34<54:40, 10.25s/it]
 99%|█████████▉| 37644/37963 [93:00:41<50:25,  9.48s/it]
 99%|█████████▉| 37645/37963 [93:00:49<47:03,  8.88s/it]
 99%|█████████▉| 37646/37963 [93:01:03<55:47, 10.56s/it]
 99%|█████████▉| 37647/37963 [93:01:18<1:02:11, 11.81s/it]
 99%|█████████▉| 37648/37963 [93:01:26<55:31, 10.58s/it]  
 99%|█████████▉| 37649/37963 [93:01:33<50:40,  9.68s/it]
 99%|█████████▉| 37650/37963 [93:01:41<46:58,  9.00s/it]
                                                        
{'loss': '0.07826', 'grad_norm': '5.56', 'learning_rate': '3.588e-09', 'epoch': '0.9918'}
+
 99%|█████████▉| 37650/37963 [93:01:41<46:58,  9.00s/it]
 99%|█████████▉| 37651/37963 [93:01:55<55:40, 10.71s/it]
 99%|█████████▉| 37652/37963 [93:02:03<50:40,  9.78s/it]
 99%|█████████▉| 37653/37963 [93:02:11<47:30,  9.19s/it]
 99%|█████████▉| 37654/37963 [93:02:19<45:06,  8.76s/it]
 99%|█████████▉| 37655/37963 [93:02:26<43:10,  8.41s/it]
 99%|█████████▉| 37656/37963 [93:02:34<42:10,  8.24s/it]
 99%|█████████▉| 37657/37963 [93:02:42<41:14,  8.09s/it]
 99%|█████████▉| 37658/37963 [93:02:50<40:42,  8.01s/it]
 99%|█████████▉| 37659/37963 [93:02:57<40:05,  7.91s/it]
 99%|█████████▉| 37660/37963 [93:03:11<49:30,  9.81s/it]
                                                        
{'loss': '0.06349', 'grad_norm': '3.074', 'learning_rate': '3.363e-09', 'epoch': '0.992'}
+
 99%|█████████▉| 37660/37963 [93:03:11<49:30,  9.81s/it]
 99%|█████████▉| 37661/37963 [93:03:19<45:51,  9.11s/it]
 99%|█████████▉| 37662/37963 [93:03:26<43:07,  8.60s/it]
 99%|█████████▉| 37663/37963 [93:03:34<41:58,  8.39s/it]
 99%|█████████▉| 37664/37963 [93:03:42<40:22,  8.10s/it]
 99%|█████████▉| 37665/37963 [93:03:49<39:21,  7.93s/it]
 99%|█████████▉| 37666/37963 [93:03:57<38:52,  7.85s/it]
 99%|█████████▉| 37667/37963 [93:04:05<38:32,  7.81s/it]
 99%|█████████▉| 37668/37963 [93:04:12<38:05,  7.75s/it]
 99%|█████████▉| 37669/37963 [93:04:20<37:58,  7.75s/it]
 99%|█████████▉| 37670/37963 [93:04:28<37:49,  7.74s/it]
                                                        
{'loss': '0.08498', 'grad_norm': '3.799', 'learning_rate': '3.145e-09', 'epoch': '0.9923'}
+
 99%|█████████▉| 37670/37963 [93:04:28<37:49,  7.74s/it]
 99%|█████████▉| 37671/37963 [93:04:35<37:31,  7.71s/it]
 99%|█████████▉| 37672/37963 [93:04:43<37:21,  7.70s/it]
 99%|█████████▉| 37673/37963 [93:04:51<37:21,  7.73s/it]
 99%|█████████▉| 37674/37963 [93:04:58<37:04,  7.70s/it]
 99%|█████████▉| 37675/37963 [93:05:06<36:51,  7.68s/it]
 99%|█████████▉| 37676/37963 [93:05:14<36:44,  7.68s/it]
 99%|█████████▉| 37677/37963 [93:05:21<36:27,  7.65s/it]
 99%|█████████▉| 37678/37963 [93:05:29<36:17,  7.64s/it]
 99%|█████████▉| 37679/37963 [93:05:37<36:13,  7.65s/it]
 99%|█████████▉| 37680/37963 [93:05:44<35:43,  7.57s/it]
                                                        
{'loss': '0.08448', 'grad_norm': '2.963', 'learning_rate': '2.935e-09', 'epoch': '0.9925'}
+
 99%|█████████▉| 37680/37963 [93:05:44<35:43,  7.57s/it]
 99%|█████████▉| 37681/37963 [93:05:52<35:50,  7.63s/it]
 99%|█████████▉| 37682/37963 [93:06:06<44:45,  9.56s/it]
 99%|█████████▉| 37683/37963 [93:06:21<51:47, 11.10s/it]
 99%|█████████▉| 37684/37963 [93:06:35<56:12, 12.09s/it]
 99%|█████████▉| 37685/37963 [93:06:43<49:49, 10.75s/it]
 99%|█████████▉| 37686/37963 [93:06:50<45:21,  9.82s/it]
 99%|█████████▉| 37687/37963 [93:06:58<42:12,  9.18s/it]
 99%|█████████▉| 37688/37963 [93:07:06<39:58,  8.72s/it]
 99%|█████████▉| 37689/37963 [93:07:13<38:13,  8.37s/it]
 99%|█████████▉| 37690/37963 [93:07:21<37:05,  8.15s/it]
                                                        
{'loss': '0.06762', 'grad_norm': '2.819', 'learning_rate': '2.732e-09', 'epoch': '0.9928'}
+
 99%|█████████▉| 37690/37963 [93:07:21<37:05,  8.15s/it]
 99%|█████████▉| 37691/37963 [93:07:28<36:01,  7.95s/it]
 99%|█████████▉| 37692/37963 [93:07:49<53:31, 11.85s/it]
 99%|█████████▉| 37693/37963 [93:07:57<47:59, 10.66s/it]
 99%|█████████▉| 37694/37963 [93:08:12<53:45, 11.99s/it]
 99%|█████████▉| 37695/37963 [93:08:20<47:50, 10.71s/it]
 99%|█████████▉| 37696/37963 [93:08:28<43:42,  9.82s/it]
 99%|█████████▉| 37697/37963 [93:08:35<40:37,  9.16s/it]
 99%|█████████▉| 37698/37963 [93:08:43<38:24,  8.70s/it]
 99%|█████████▉| 37699/37963 [93:08:58<46:12, 10.50s/it]
 99%|█████████▉| 37700/37963 [93:09:05<42:25,  9.68s/it]
                                                        
{'loss': '0.08447', 'grad_norm': '3.348', 'learning_rate': '2.536e-09', 'epoch': '0.9931'}
+
 99%|█████████▉| 37700/37963 [93:09:05<42:25,  9.68s/it]
 99%|█████████▉| 37701/37963 [93:09:13<39:10,  8.97s/it]
 99%|█████████▉| 37702/37963 [93:09:20<37:33,  8.64s/it]
 99%|█████████▉| 37703/37963 [93:09:28<36:11,  8.35s/it]
 99%|█████████▉| 37704/37963 [93:09:43<44:08, 10.23s/it]
 99%|█████████▉| 37705/37963 [93:09:51<40:55,  9.52s/it]
 99%|█████████▉| 37706/37963 [93:09:58<38:08,  8.90s/it]
 99%|█████████▉| 37707/37963 [93:10:06<36:16,  8.50s/it]
 99%|█████████▉| 37708/37963 [93:10:13<35:06,  8.26s/it]
 99%|█████████▉| 37709/37963 [93:10:21<33:50,  7.99s/it]
 99%|█████████▉| 37710/37963 [93:10:28<33:11,  7.87s/it]
                                                        
{'loss': '0.07284', 'grad_norm': '3.383', 'learning_rate': '2.348e-09', 'epoch': '0.9933'}
+
 99%|█████████▉| 37710/37963 [93:10:28<33:11,  7.87s/it]
 99%|█████████▉| 37711/37963 [93:10:36<32:45,  7.80s/it]
 99%|█████████▉| 37712/37963 [93:10:43<32:05,  7.67s/it]
 99%|█████████▉| 37713/37963 [93:10:51<32:04,  7.70s/it]
 99%|█████████▉| 37714/37963 [93:10:59<31:52,  7.68s/it]
 99%|█████████▉| 37715/37963 [93:11:06<31:17,  7.57s/it]
 99%|█████████▉| 37716/37963 [93:11:14<31:15,  7.59s/it]
 99%|█████████▉| 37717/37963 [93:11:21<31:20,  7.65s/it]
 99%|█████████▉| 37718/37963 [93:11:29<31:21,  7.68s/it]
 99%|█████████▉| 37719/37963 [93:11:37<31:21,  7.71s/it]
 99%|█████████▉| 37720/37963 [93:11:45<31:20,  7.74s/it]
                                                        
{'loss': '0.07825', 'grad_norm': '3.939', 'learning_rate': '2.167e-09', 'epoch': '0.9936'}
+
 99%|█████████▉| 37720/37963 [93:11:45<31:20,  7.74s/it]
 99%|█████████▉| 37721/37963 [93:11:53<31:08,  7.72s/it]
 99%|█████████▉| 37722/37963 [93:12:00<30:55,  7.70s/it]
 99%|█████████▉| 37723/37963 [93:12:08<30:36,  7.65s/it]
 99%|█████████▉| 37724/37963 [93:12:15<30:24,  7.63s/it]
 99%|█████████▉| 37725/37963 [93:12:23<30:18,  7.64s/it]
 99%|█████████▉| 37726/37963 [93:12:31<30:11,  7.64s/it]
 99%|█████████▉| 37727/37963 [93:12:38<30:00,  7.63s/it]
 99%|█████████▉| 37728/37963 [93:12:46<30:02,  7.67s/it]
 99%|█████████▉| 37729/37963 [93:12:54<29:54,  7.67s/it]
 99%|█████████▉| 37730/37963 [93:13:08<37:22,  9.62s/it]
                                                        
{'loss': '0.07571', 'grad_norm': '3.138', 'learning_rate': '1.993e-09', 'epoch': '0.9939'}
+
 99%|█████████▉| 37730/37963 [93:13:08<37:22,  9.62s/it]
 99%|█████████▉| 37731/37963 [93:13:22<42:45, 11.06s/it]
 99%|█████████▉| 37732/37963 [93:13:37<47:12, 12.26s/it]
 99%|█████████▉| 37733/37963 [93:13:45<41:50, 10.92s/it]
 99%|█████████▉| 37734/37963 [93:13:53<37:58,  9.95s/it]
 99%|█████████▉| 37735/37963 [93:14:00<35:17,  9.29s/it]
 99%|█████████▉| 37736/37963 [93:14:08<33:06,  8.75s/it]
 99%|█████████▉| 37737/37963 [93:14:16<31:42,  8.42s/it]
 99%|█████████▉| 37738/37963 [93:14:24<31:04,  8.29s/it]
 99%|█████████▉| 37739/37963 [93:14:31<30:15,  8.11s/it]
 99%|█████████▉| 37740/37963 [93:14:39<29:47,  8.02s/it]
                                                        
{'loss': '0.07726', 'grad_norm': '3.744', 'learning_rate': '1.826e-09', 'epoch': '0.9941'}
+
 99%|█████████▉| 37740/37963 [93:14:39<29:47,  8.02s/it]
 99%|█████████▉| 37741/37963 [93:14:54<36:59, 10.00s/it]
 99%|█████████▉| 37742/37963 [93:15:09<42:08, 11.44s/it]
 99%|█████████▉| 37743/37963 [93:15:16<37:56, 10.35s/it]
 99%|█████████▉| 37744/37963 [93:15:24<34:50,  9.54s/it]
 99%|█████████▉| 37745/37963 [93:15:32<32:34,  8.97s/it]
 99%|█████████▉| 37746/37963 [93:15:46<38:16, 10.58s/it]
 99%|█████████▉| 37747/37963 [93:15:54<34:57,  9.71s/it]
 99%|█████████▉| 37748/37963 [93:16:01<32:46,  9.15s/it]
 99%|█████████▉| 37749/37963 [93:16:09<30:54,  8.66s/it]
 99%|█████████▉| 37750/37963 [93:16:17<29:47,  8.39s/it]
                                                        
{'loss': '0.07146', 'grad_norm': '3.593', 'learning_rate': '1.667e-09', 'epoch': '0.9944'}
+
 99%|█████████▉| 37750/37963 [93:16:17<29:47,  8.39s/it]
 99%|█████████▉| 37751/37963 [93:16:31<36:13, 10.25s/it]
 99%|█████████▉| 37752/37963 [93:16:39<33:27,  9.52s/it]
 99%|█████████▉| 37753/37963 [93:16:54<39:17, 11.23s/it]
 99%|█████████▉| 37754/37963 [93:17:02<35:12, 10.11s/it]
 99%|█████████▉| 37755/37963 [93:17:10<32:28,  9.37s/it]
 99%|█████████▉| 37756/37963 [93:17:17<30:18,  8.78s/it]
 99%|█████████▉| 37757/37963 [93:17:25<29:00,  8.45s/it]
 99%|█████████▉| 37758/37963 [93:17:32<27:42,  8.11s/it]
 99%|█████████▉| 37759/37963 [93:17:39<27:01,  7.95s/it]
 99%|█████████▉| 37760/37963 [93:17:47<26:42,  7.89s/it]
                                                        
{'loss': '0.08571', 'grad_norm': '4.778', 'learning_rate': '1.514e-09', 'epoch': '0.9947'}
+
 99%|█████████▉| 37760/37963 [93:17:47<26:42,  7.89s/it]
 99%|█████████▉| 37761/37963 [93:17:55<26:28,  7.86s/it]
 99%|█████████▉| 37762/37963 [93:18:03<26:12,  7.82s/it]
 99%|█████████▉| 37763/37963 [93:18:10<25:50,  7.75s/it]
 99%|█████████▉| 37764/37963 [93:18:18<25:40,  7.74s/it]
 99%|█████████▉| 37765/37963 [93:18:26<25:27,  7.71s/it]
 99%|█████████▉| 37766/37963 [93:18:33<25:12,  7.68s/it]
 99%|█████████▉| 37767/37963 [93:18:41<25:03,  7.67s/it]
 99%|█████████▉| 37768/37963 [93:18:48<24:44,  7.61s/it]
 99%|█████████▉| 37769/37963 [93:18:56<24:35,  7.61s/it]
 99%|█████████▉| 37770/37963 [93:19:04<24:21,  7.57s/it]
                                                        
{'loss': '0.08875', 'grad_norm': '2.465', 'learning_rate': '1.37e-09', 'epoch': '0.9949'}
+
 99%|█████████▉| 37770/37963 [93:19:04<24:21,  7.57s/it]
 99%|█████████▉| 37771/37963 [93:19:11<24:17,  7.59s/it]
 99%|█████████▉| 37772/37963 [93:19:19<24:22,  7.66s/it]
 99%|█████████▉| 37773/37963 [93:19:27<24:27,  7.73s/it]
100%|█████████▉| 37774/37963 [93:19:35<24:15,  7.70s/it]
100%|█████████▉| 37775/37963 [93:19:42<24:10,  7.72s/it]
100%|█████████▉| 37776/37963 [93:19:50<24:11,  7.76s/it]
100%|█████████▉| 37777/37963 [93:19:58<23:54,  7.71s/it]
100%|█████████▉| 37778/37963 [93:20:12<29:46,  9.66s/it]
100%|█████████▉| 37779/37963 [93:20:26<34:01, 11.09s/it]
100%|█████████▉| 37780/37963 [93:20:34<30:39, 10.05s/it]
                                                        
{'loss': '0.08692', 'grad_norm': '4.583', 'learning_rate': '1.232e-09', 'epoch': '0.9952'}
+
100%|█████████▉| 37780/37963 [93:20:34<30:39, 10.05s/it]
100%|█████████▉| 37781/37963 [93:20:42<28:18,  9.33s/it]
100%|█████████▉| 37782/37963 [93:20:49<26:34,  8.81s/it]
100%|█████████▉| 37783/37963 [93:20:57<25:27,  8.49s/it]
100%|█████████▉| 37784/37963 [93:21:05<24:38,  8.26s/it]
100%|█████████▉| 37785/37963 [93:21:19<30:07, 10.15s/it]
100%|█████████▉| 37786/37963 [93:21:27<27:53,  9.46s/it]
100%|█████████▉| 37787/37963 [93:21:35<26:15,  8.95s/it]
100%|█████████▉| 37788/37963 [93:21:50<31:14, 10.71s/it]
100%|█████████▉| 37789/37963 [93:22:04<34:13, 11.80s/it]
100%|█████████▉| 37790/37963 [93:22:11<30:13, 10.48s/it]
                                                        
{'loss': '0.07828', 'grad_norm': '3.504', 'learning_rate': '1.102e-09', 'epoch': '0.9954'}
+
100%|█████████▉| 37790/37963 [93:22:11<30:13, 10.48s/it]
100%|█████████▉| 37791/37963 [93:22:19<27:43,  9.67s/it]
100%|█████████▉| 37792/37963 [93:22:27<25:52,  9.08s/it]
100%|█████████▉| 37793/37963 [93:22:35<24:37,  8.69s/it]
100%|█████████▉| 37794/37963 [93:22:42<23:34,  8.37s/it]
100%|█████████▉| 37795/37963 [93:22:50<22:54,  8.18s/it]
100%|█████████▉| 37796/37963 [93:22:58<22:10,  7.97s/it]
100%|█████████▉| 37797/37963 [93:23:13<28:11, 10.19s/it]
100%|█████████▉| 37798/37963 [93:23:27<31:31, 11.46s/it]
100%|█████████▉| 37799/37963 [93:23:41<33:24, 12.22s/it]
100%|█████████▉| 37800/37963 [93:23:49<29:32, 10.87s/it]
                                                        
{'loss': '0.07319', 'grad_norm': '3.48', 'learning_rate': '9.788e-10', 'epoch': '0.9957'}
+
100%|█████████▉| 37800/37963 [93:23:49<29:32, 10.87s/it]
100%|█████████▉| 37801/37963 [93:23:57<26:55,  9.97s/it]
100%|█████████▉| 37802/37963 [93:24:05<24:54,  9.28s/it]
100%|█████████▉| 37803/37963 [93:24:12<23:27,  8.80s/it]
100%|█████████▉| 37804/37963 [93:24:20<22:30,  8.49s/it]
100%|█████████▉| 37805/37963 [93:24:28<21:47,  8.28s/it]
100%|█████████▉| 37806/37963 [93:24:35<21:08,  8.08s/it]
100%|█████████▉| 37807/37963 [93:24:43<20:37,  7.94s/it]
100%|█████████▉| 37808/37963 [93:24:51<20:12,  7.82s/it]
100%|█████████▉| 37809/37963 [93:24:58<19:56,  7.77s/it]
100%|█████████▉| 37810/37963 [93:25:06<19:45,  7.75s/it]
                                                        
{'loss': '0.08561', 'grad_norm': '3.5', 'learning_rate': '8.631e-10', 'epoch': '0.996'}
+
100%|█████████▉| 37810/37963 [93:25:06<19:45,  7.75s/it]
100%|█████████▉| 37811/37963 [93:25:14<19:33,  7.72s/it]
100%|█████████▉| 37812/37963 [93:25:21<19:13,  7.64s/it]
100%|█████████▉| 37813/37963 [93:25:29<19:05,  7.64s/it]
100%|█████████▉| 37814/37963 [93:25:36<18:59,  7.64s/it]
100%|█████████▉| 37815/37963 [93:25:44<18:48,  7.63s/it]
100%|█████████▉| 37816/37963 [93:25:52<18:40,  7.62s/it]
100%|█████████▉| 37817/37963 [93:25:59<18:39,  7.67s/it]
100%|█████████▉| 37818/37963 [93:26:07<18:43,  7.75s/it]
100%|█████████▉| 37819/37963 [93:26:15<18:24,  7.67s/it]
100%|█████████▉| 37820/37963 [93:26:22<18:14,  7.65s/it]
                                                        
{'loss': '0.08032', 'grad_norm': '3.11', 'learning_rate': '7.546e-10', 'epoch': '0.9962'}
+
100%|█████████▉| 37820/37963 [93:26:22<18:14,  7.65s/it]
100%|█████████▉| 37821/37963 [93:26:36<22:31,  9.52s/it]
100%|█████████▉| 37822/37963 [93:26:44<21:05,  8.98s/it]
100%|█████████▉| 37823/37963 [93:26:51<19:50,  8.50s/it]
100%|█████████▉| 37824/37963 [93:26:59<19:03,  8.23s/it]
100%|█████████▉| 37825/37963 [93:27:07<18:31,  8.06s/it]
100%|█████████▉| 37826/37963 [93:27:21<22:29,  9.85s/it]
100%|█████████▉| 37827/37963 [93:27:28<20:49,  9.19s/it]
100%|█████████▉| 37828/37963 [93:27:36<19:47,  8.79s/it]
100%|█████████▉| 37829/37963 [93:27:44<18:53,  8.46s/it]
100%|█████████▉| 37830/37963 [93:27:52<18:22,  8.29s/it]
                                                        
{'loss': '0.07283', 'grad_norm': '3.106', 'learning_rate': '6.535e-10', 'epoch': '0.9965'}
+
100%|█████████▉| 37830/37963 [93:27:52<18:22,  8.29s/it]
100%|█████████▉| 37831/37963 [93:27:59<17:51,  8.12s/it]
100%|█████████▉| 37832/37963 [93:28:07<17:23,  7.96s/it]
100%|█████████▉| 37833/37963 [93:28:15<16:58,  7.84s/it]
100%|█████████▉| 37834/37963 [93:28:30<21:31, 10.01s/it]
100%|█████████▉| 37835/37963 [93:28:44<24:26, 11.45s/it]
100%|█████████▉| 37836/37963 [93:28:52<21:46, 10.29s/it]
100%|█████████▉| 37837/37963 [93:29:00<19:57,  9.51s/it]
100%|█████████▉| 37838/37963 [93:29:07<18:40,  8.96s/it]
100%|█████████▉| 37839/37963 [93:29:15<17:41,  8.56s/it]
100%|█████████▉| 37840/37963 [93:29:30<21:20, 10.41s/it]
                                                        
{'loss': '0.09367', 'grad_norm': '3.668', 'learning_rate': '5.596e-10', 'epoch': '0.9968'}
+
100%|█████████▉| 37840/37963 [93:29:30<21:20, 10.41s/it]
100%|█████████▉| 37841/37963 [93:29:37<19:23,  9.53s/it]
100%|█████████▉| 37842/37963 [93:29:52<22:14, 11.03s/it]
100%|█████████▉| 37843/37963 [93:30:00<20:12, 10.10s/it]
100%|█████████▉| 37844/37963 [93:30:14<22:48, 11.50s/it]
100%|█████████▉| 37845/37963 [93:30:29<24:30, 12.46s/it]
100%|█████████▉| 37846/37963 [93:30:37<21:39, 11.11s/it]
100%|█████████▉| 37847/37963 [93:30:45<19:25, 10.05s/it]
100%|█████████▉| 37848/37963 [93:30:52<17:50,  9.31s/it]
100%|█████████▉| 37849/37963 [93:31:00<16:43,  8.80s/it]
100%|█████████▉| 37850/37963 [93:31:08<15:55,  8.46s/it]
                                                        
{'loss': '0.07127', 'grad_norm': '3.511', 'learning_rate': '4.729e-10', 'epoch': '0.997'}
+
100%|█████████▉| 37850/37963 [93:31:08<15:55,  8.46s/it]
100%|█████████▉| 37851/37963 [93:31:15<15:20,  8.22s/it]
100%|█████████▉| 37852/37963 [93:31:23<14:56,  8.08s/it]
100%|█████████▉| 37853/37963 [93:31:31<14:35,  7.96s/it]
100%|█████████▉| 37854/37963 [93:31:38<14:17,  7.87s/it]
100%|█████████▉| 37855/37963 [93:31:46<14:03,  7.81s/it]
100%|█████████▉| 37856/37963 [93:31:54<13:52,  7.78s/it]
100%|█████████▉| 37857/37963 [93:32:01<13:41,  7.75s/it]
100%|█████████▉| 37858/37963 [93:32:09<13:27,  7.69s/it]
100%|█████████▉| 37859/37963 [93:32:16<13:11,  7.61s/it]
100%|█████████▉| 37860/37963 [93:32:24<13:06,  7.64s/it]
                                                        
{'loss': '0.08577', 'grad_norm': '4.285', 'learning_rate': '3.936e-10', 'epoch': '0.9973'}
+
100%|█████████▉| 37860/37963 [93:32:24<13:06,  7.64s/it]
100%|█████████▉| 37861/37963 [93:32:32<12:57,  7.62s/it]
100%|█████████▉| 37862/37963 [93:32:39<12:49,  7.62s/it]
100%|█████████▉| 37863/37963 [93:32:47<12:50,  7.70s/it]
100%|█████████▉| 37864/37963 [93:32:55<12:40,  7.68s/it]
100%|█████████▉| 37865/37963 [93:33:02<12:30,  7.66s/it]
100%|█████████▉| 37866/37963 [93:33:10<12:20,  7.64s/it]
100%|█████████▉| 37867/37963 [93:33:18<12:16,  7.67s/it]
100%|█████████▉| 37868/37963 [93:33:25<12:11,  7.70s/it]
100%|█████████▉| 37869/37963 [93:33:33<12:08,  7.76s/it]
100%|█████████▉| 37870/37963 [93:33:41<12:00,  7.75s/it]
                                                        
{'loss': '0.08021', 'grad_norm': '3.386', 'learning_rate': '3.216e-10', 'epoch': '0.9976'}
+
100%|█████████▉| 37870/37963 [93:33:41<12:00,  7.75s/it]
100%|█████████▉| 37871/37963 [93:33:49<11:52,  7.75s/it]
100%|█████████▉| 37872/37963 [93:33:57<11:42,  7.73s/it]
100%|█████████▉| 37873/37963 [93:34:04<11:34,  7.72s/it]
100%|█████████▉| 37874/37963 [93:34:19<14:26,  9.74s/it]
100%|█████████▉| 37875/37963 [93:34:26<13:22,  9.12s/it]
100%|█████████▉| 37876/37963 [93:34:40<15:16, 10.54s/it]
100%|█████████▉| 37877/37963 [93:34:48<13:58,  9.75s/it]
100%|█████████▉| 37878/37963 [93:34:55<12:45,  9.01s/it]
100%|█████████▉| 37879/37963 [93:35:10<14:55, 10.66s/it]
100%|█████████▉| 37880/37963 [93:35:17<13:27,  9.73s/it]
                                                        
{'loss': '0.08186', 'grad_norm': '3.094', 'learning_rate': '2.568e-10', 'epoch': '0.9978'}
+
100%|█████████▉| 37880/37963 [93:35:17<13:27,  9.73s/it]
100%|█████████▉| 37881/37963 [93:35:25<12:31,  9.16s/it]
100%|█████████▉| 37882/37963 [93:35:40<14:36, 10.82s/it]
100%|█████████▉| 37883/37963 [93:35:48<13:11,  9.90s/it]
100%|█████████▉| 37884/37963 [93:36:03<15:01, 11.42s/it]
100%|█████████▉| 37885/37963 [93:36:10<13:23, 10.30s/it]
100%|█████████▉| 37886/37963 [93:36:18<12:14,  9.53s/it]
100%|█████████▉| 37887/37963 [93:36:32<13:53, 10.97s/it]
100%|█████████▉| 37888/37963 [93:36:40<12:30, 10.01s/it]
100%|█████████▉| 37889/37963 [93:36:48<11:25,  9.27s/it]
100%|█████████▉| 37890/37963 [93:36:55<10:40,  8.78s/it]
                                                        
{'loss': '0.08137', 'grad_norm': '3.338', 'learning_rate': '1.993e-10', 'epoch': '0.9981'}
+
100%|█████████▉| 37890/37963 [93:36:55<10:40,  8.78s/it]
100%|█████████▉| 37891/37963 [93:37:03<10:07,  8.44s/it]
100%|█████████▉| 37892/37963 [93:37:11<09:42,  8.21s/it]
100%|█████████▉| 37893/37963 [93:37:25<11:46, 10.09s/it]
100%|█████████▉| 37894/37963 [93:37:33<10:48,  9.40s/it]
100%|█████████▉| 37895/37963 [93:37:41<10:02,  8.86s/it]
100%|█████████▉| 37896/37963 [93:37:48<09:32,  8.54s/it]
100%|█████████▉| 37897/37963 [93:38:03<11:22, 10.34s/it]
100%|█████████▉| 37898/37963 [93:38:11<10:19,  9.53s/it]
100%|█████████▉| 37899/37963 [93:38:18<09:32,  8.95s/it]
100%|█████████▉| 37900/37963 [93:38:26<08:56,  8.51s/it]
                                                        
{'loss': '0.07682', 'grad_norm': '3.227', 'learning_rate': '1.491e-10', 'epoch': '0.9983'}
+
100%|█████████▉| 37900/37963 [93:38:26<08:56,  8.51s/it]
100%|█████████▉| 37901/37963 [93:38:33<08:31,  8.26s/it]
100%|█████████▉| 37902/37963 [93:38:41<08:12,  8.08s/it]
100%|█████████▉| 37903/37963 [93:38:49<07:56,  7.93s/it]
100%|█████████▉| 37904/37963 [93:38:56<07:43,  7.86s/it]
100%|█████████▉| 37905/37963 [93:39:04<07:30,  7.77s/it]
100%|█████████▉| 37906/37963 [93:39:11<07:20,  7.72s/it]
100%|█████████▉| 37907/37963 [93:39:19<07:13,  7.74s/it]
100%|█████████▉| 37908/37963 [93:39:27<07:00,  7.65s/it]
100%|█████████▉| 37909/37963 [93:39:34<06:50,  7.60s/it]
100%|█████████▉| 37910/37963 [93:39:42<06:44,  7.63s/it]
                                                        
{'loss': '0.07405', 'grad_norm': '3.019', 'learning_rate': '1.061e-10', 'epoch': '0.9986'}
+
100%|█████████▉| 37910/37963 [93:39:42<06:44,  7.63s/it]
100%|█████████▉| 37911/37963 [93:39:50<06:40,  7.70s/it]
100%|█████████▉| 37912/37963 [93:39:57<06:30,  7.66s/it]
100%|█████████▉| 37913/37963 [93:40:05<06:23,  7.66s/it]
100%|█████████▉| 37914/37963 [93:40:13<06:14,  7.65s/it]
100%|█████████▉| 37915/37963 [93:40:20<06:05,  7.62s/it]
100%|█████████▉| 37916/37963 [93:40:28<06:00,  7.68s/it]
100%|█████████▉| 37917/37963 [93:40:36<05:52,  7.66s/it]
100%|█████████▉| 37918/37963 [93:40:43<05:43,  7.63s/it]
100%|█████████▉| 37919/37963 [93:40:51<05:39,  7.71s/it]
100%|█████████▉| 37920/37963 [93:40:59<05:32,  7.73s/it]
                                                        
{'loss': '0.0746', 'grad_norm': '3.228', 'learning_rate': '7.046e-11', 'epoch': '0.9989'}
+
100%|█████████▉| 37920/37963 [93:40:59<05:32,  7.73s/it]
100%|█████████▉| 37921/37963 [93:41:06<05:21,  7.65s/it]
100%|█████████▉| 37922/37963 [93:41:14<05:12,  7.63s/it]
100%|█████████▉| 37923/37963 [93:41:28<06:24,  9.62s/it]
100%|█████████▉| 37924/37963 [93:41:36<05:53,  9.06s/it]
100%|█████████▉| 37925/37963 [93:41:51<06:50, 10.79s/it]
100%|█████████▉| 37926/37963 [93:42:05<07:21, 11.94s/it]
100%|█████████▉| 37927/37963 [93:42:13<06:24, 10.67s/it]
100%|█████████▉| 37928/37963 [93:42:21<05:41,  9.76s/it]
100%|█████████▉| 37929/37963 [93:42:28<05:09,  9.10s/it]
100%|█████████▉| 37930/37963 [93:42:36<04:46,  8.67s/it]
                                                        
{'loss': '0.06469', 'grad_norm': '2.369', 'learning_rate': '4.207e-11', 'epoch': '0.9991'}
+
100%|█████████▉| 37930/37963 [93:42:36<04:46,  8.67s/it]
100%|█████████▉| 37931/37963 [93:42:50<05:30, 10.34s/it]
100%|█████████▉| 37932/37963 [93:43:05<06:04, 11.76s/it]
100%|█████████▉| 37933/37963 [93:43:13<05:15, 10.52s/it]
100%|█████████▉| 37934/37963 [93:43:21<04:40,  9.69s/it]
100%|█████████▉| 37935/37963 [93:43:28<04:14,  9.10s/it]
100%|█████████▉| 37936/37963 [93:43:36<03:54,  8.67s/it]
100%|█████████▉| 37937/37963 [93:43:50<04:29, 10.38s/it]
100%|█████████▉| 37938/37963 [93:43:58<03:58,  9.55s/it]
100%|█████████▉| 37939/37963 [93:44:06<03:35,  9.00s/it]
100%|█████████▉| 37940/37963 [93:44:13<03:17,  8.58s/it]
                                                        
{'loss': '0.06821', 'grad_norm': '3.551', 'learning_rate': '2.096e-11', 'epoch': '0.9994'}
+
100%|█████████▉| 37940/37963 [93:44:13<03:17,  8.58s/it]
100%|█████████▉| 37941/37963 [93:44:21<03:01,  8.25s/it]
100%|█████████▉| 37942/37963 [93:44:28<02:49,  8.08s/it]
100%|█████████▉| 37943/37963 [93:44:36<02:39,  7.96s/it]
100%|█████████▉| 37944/37963 [93:44:44<02:29,  7.86s/it]
100%|█████████▉| 37945/37963 [93:44:51<02:20,  7.80s/it]
100%|█████████▉| 37946/37963 [93:44:59<02:11,  7.73s/it]
100%|█████████▉| 37947/37963 [93:45:14<02:40, 10.00s/it]
100%|█████████▉| 37948/37963 [93:45:22<02:19,  9.33s/it]
100%|█████████▉| 37949/37963 [93:45:30<02:03,  8.84s/it]
100%|█████████▉| 37950/37963 [93:45:37<01:50,  8.48s/it]
                                                        
{'loss': '0.07592', 'grad_norm': '1.824', 'learning_rate': '7.133e-12', 'epoch': '0.9997'}
+
100%|█████████▉| 37950/37963 [93:45:37<01:50,  8.48s/it]
100%|█████████▉| 37951/37963 [93:45:45<01:38,  8.21s/it]
100%|█████████▉| 37952/37963 [93:45:53<01:28,  8.08s/it]
100%|█████████▉| 37953/37963 [93:46:00<01:19,  7.95s/it]
100%|█████████▉| 37954/37963 [93:46:08<01:10,  7.87s/it]
100%|█████████▉| 37955/37963 [93:46:16<01:02,  7.82s/it]
100%|█████████▉| 37956/37963 [93:46:23<00:54,  7.79s/it]
100%|█████████▉| 37957/37963 [93:46:31<00:46,  7.76s/it]
100%|█████████▉| 37958/37963 [93:46:39<00:38,  7.67s/it]
100%|█████████▉| 37959/37963 [93:46:46<00:30,  7.65s/it]
100%|█████████▉| 37960/37963 [93:46:54<00:23,  7.68s/it]
                                                        
{'loss': '0.07169', 'grad_norm': '3.445', 'learning_rate': '5.823e-13', 'epoch': '0.9999'}
+
100%|█████████▉| 37960/37963 [93:46:54<00:23,  7.68s/it]
100%|█████████▉| 37961/37963 [93:47:01<00:15,  7.62s/it]
100%|█████████▉| 37962/37963 [93:47:08<00:07,  7.43s/it]
100%|██████████| 37963/37963 [93:47:18<00:00,  8.06s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
+
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.60s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.60s/it]
+
                                                        
{'train_runtime': '3.377e+05', 'train_samples_per_second': '7.195', 'train_steps_per_second': '0.112', 'train_loss': '0.1409', 'epoch': '1'}
+
100%|██████████| 37963/37963 [93:48:12<00:00,  8.06s/it]
100%|██████████| 37963/37963 [93:48:12<00:00,  8.90s/it]
+
Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.28s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.28s/it]
+[rank0]:[W619 13:54:56.730890824 ProcessGroupNCCL.cpp:1476] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())